-- Logs begin at Fri 2022-05-27 14:05:44 UTC, end at Fri 2022-05-27 16:06:21 UTC. -- May 27 14:46:17.647742 n-d-843621-1 systemd[1]: Starting Devstack devstack@n-api.service... May 27 14:46:17.657314 n-d-843621-1 devstack@n-api.service[103848]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 14:46:17.659935 n-d-843621-1 devstack@n-api.service[103848]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 14:46:17 2022] *** May 27 14:46:17.659935 n-d-843621-1 devstack@n-api.service[103848]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 14:46:17.659935 n-d-843621-1 devstack@n-api.service[103848]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 14:46:17.659935 n-d-843621-1 devstack@n-api.service[103848]: nodename: n-d-843621-1 May 27 14:46:17.659935 n-d-843621-1 devstack@n-api.service[103848]: machine: x86_64 May 27 14:46:17.659935 n-d-843621-1 devstack@n-api.service[103848]: clock source: unix May 27 14:46:17.659935 n-d-843621-1 devstack@n-api.service[103848]: pcre jit disabled May 27 14:46:17.659935 n-d-843621-1 devstack@n-api.service[103848]: detected number of CPU cores: 4 May 27 14:46:17.659935 n-d-843621-1 devstack@n-api.service[103848]: current working directory: / May 27 14:46:17.659935 n-d-843621-1 devstack@n-api.service[103848]: detected binary path: /usr/bin/uwsgi-core May 27 14:46:17.660610 n-d-843621-1 devstack@n-api.service[103848]: your processes number limit is 47680 May 27 14:46:17.660610 n-d-843621-1 devstack@n-api.service[103848]: your memory page size is 4096 bytes May 27 14:46:17.660610 n-d-843621-1 devstack@n-api.service[103848]: detected max file descriptor number: 2048 May 27 14:46:17.660610 n-d-843621-1 devstack@n-api.service[103848]: lock engine: pthread robust mutexes May 27 14:46:17.660610 n-d-843621-1 devstack@n-api.service[103848]: thunder lock: enabled May 27 14:46:17.660610 n-d-843621-1 devstack@n-api.service[103848]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 14:46:17.660610 n-d-843621-1 devstack@n-api.service[103848]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 14:46:17.704436 n-d-843621-1 devstack@n-api.service[103848]: Python main interpreter initialized at 0x5616b33e79c0 May 27 14:46:17.704436 n-d-843621-1 devstack@n-api.service[103848]: python threads support enabled May 27 14:46:17.704436 n-d-843621-1 devstack@n-api.service[103848]: your server socket listen backlog is limited to 100 connections May 27 14:46:17.704436 n-d-843621-1 devstack@n-api.service[103848]: your mercy for graceful operations on workers is 90 seconds May 27 14:46:17.704784 n-d-843621-1 devstack@n-api.service[103848]: mapped 403077 bytes (393 KB) for 2 cores May 27 14:46:17.704858 n-d-843621-1 devstack@n-api.service[103848]: *** Operational MODE: preforking *** May 27 14:46:17.705123 n-d-843621-1 devstack@n-api.service[103848]: *** uWSGI is running in multiple interpreter mode *** May 27 14:46:17.705123 n-d-843621-1 devstack@n-api.service[103848]: spawned uWSGI master process (pid: 103848) May 27 14:46:17.705858 n-d-843621-1 systemd[1]: Started Devstack devstack@n-api.service. May 27 14:46:17.706671 n-d-843621-1 devstack@n-api.service[103848]: spawned uWSGI worker 1 (pid: 103849, cores: 1) May 27 14:46:17.707033 n-d-843621-1 devstack@n-api.service[103848]: spawned uWSGI worker 2 (pid: 103850, cores: 1) May 27 14:46:17.707922 n-d-843621-1 devstack@n-api.service[103848]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 14:46:18.869151 n-d-843621-1 devstack@n-api.service[103849]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 14:46:18.883134 n-d-843621-1 devstack@n-api.service[103850]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 14:46:19.590412 n-d-843621-1 devstack@n-api.service[103849]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 14:46:19.590412 n-d-843621-1 devstack@n-api.service[103849]: from cryptography.utils import int_from_bytes May 27 14:46:19.590744 n-d-843621-1 devstack@n-api.service[103849]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 14:46:19.590744 n-d-843621-1 devstack@n-api.service[103849]: from cryptography.utils import int_from_bytes May 27 14:46:19.594714 n-d-843621-1 devstack@n-api.service[103850]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 14:46:19.594714 n-d-843621-1 devstack@n-api.service[103850]: from cryptography.utils import int_from_bytes May 27 14:46:19.595054 n-d-843621-1 devstack@n-api.service[103850]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 14:46:19.595054 n-d-843621-1 devstack@n-api.service[103850]: from cryptography.utils import int_from_bytes May 27 14:46:22.177633 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 14:46:22.178205 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 14:46:22.178391 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 14:46:22.178752 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 14:46:22.179009 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 14:46:22.179399 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.179727 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.180051 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.180373 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.180729 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.181042 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.181365 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.181687 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.182015 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.182275 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.182593 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.182916 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-843621-1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.183236 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.183544 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.183861 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.184184 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.184492 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.184850 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.185163 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.185934 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 14:46:22.185934 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 14:46:22.186396 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.186481 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 14:46:22.187010 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.187353 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 14:46:22.187445 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.187528 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 14:46:22.187605 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.187678 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.187743 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.187806 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.187881 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.187953 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.188018 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.188087 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.188153 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.188224 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.188298 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.188463 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.188555 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.188749 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.188902 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.189069 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.189215 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-843621-1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.189394 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.190045 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.190184 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.190362 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.190495 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.190678 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.190815 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-843621-1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.191092 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.191190 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.191405 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.191489 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.191714 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.191841 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.192026 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.192123 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.192326 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.192417 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.192641 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.192775 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.192969 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.193075 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.193292 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.193466 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.193613 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.193774 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.193934 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.194075 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.194237 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.194384 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.194552 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.194712 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.194865 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.195024 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.195186 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.195328 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.195493 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.195641 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.195796 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.195945 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.196040 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.196260 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.196358 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.196564 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.196661 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.196982 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-843621-1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.197079 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.197293 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.197388 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.197545 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.197639 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.197797 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.197891 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.198117 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.198288 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.198438 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.198600 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.198748 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.198904 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.199057 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.199225 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.199364 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.199543 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.199671 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.199844 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.199982 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.200165 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.200286 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.200478 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.200593 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.200816 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.200914 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.201131 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.201225 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.201429 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.201514 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.201733 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.201823 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.202038 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.202123 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.202420 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.202515 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.202801 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.202951 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.203101 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.203240 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.203377 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.203511 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.203652 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.203787 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.203983 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.204113 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.204299 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.204432 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.204620 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.204772 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.204967 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.205065 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.205316 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.205908 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.206113 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.206212 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.206422 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.206509 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.206742 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.206869 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.207068 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.207189 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.207375 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.207498 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.207629 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.207803 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.207932 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.208108 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.208239 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.208413 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.208557 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.208743 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.208887 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.209091 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.209198 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.209484 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.209591 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.209799 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.209903 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.210107 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.210202 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.210428 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.210523 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.210724 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.210869 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.211029 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.211216 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.211344 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.211517 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.211661 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.211826 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.211965 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.212166 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.212300 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.212482 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.212619 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.212799 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.212901 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.213123 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.213219 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.213436 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.213541 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.213740 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.213823 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.214046 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.214138 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.214358 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.214451 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.214679 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.214831 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.214984 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.215157 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.215292 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.215463 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.215616 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.215745 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.215920 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.216007 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.216224 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.216310 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.216543 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.216633 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.216874 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.216968 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.217182 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.217268 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.217494 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.217576 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.217795 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.217884 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.218100 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.218191 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.218405 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.218490 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.218711 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.218793 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.219016 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.219101 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.219317 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.219399 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.219621 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.219706 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.219924 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.220018 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.220227 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.220310 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.220528 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.220618 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.220873 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.220968 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.221175 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.221259 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.221492 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.221585 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.221812 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.222079 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.222164 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.222393 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.222485 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.222698 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.222783 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.223014 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.223116 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.223321 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.223423 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.223623 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.223709 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.223942 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.224034 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.224246 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.224331 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.224549 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.224634 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.224890 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.224978 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.225195 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.225291 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.225500 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.225591 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.225815 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.225914 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.226114 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.226208 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.226421 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.226512 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.226736 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.226826 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.227039 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.227132 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.227342 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.227427 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.227643 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.227726 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.227944 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.228036 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.228245 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.228342 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.228548 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.228633 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.228877 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.228973 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.229177 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.229262 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.229474 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.229571 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.229787 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.229872 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.230356 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.230449 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.230662 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.230747 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.230967 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.231059 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.231274 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.231378 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.231585 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:46:22.231676 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.231915 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.232001 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.232241 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.232336 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.232575 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.232659 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.232910 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.232997 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.233222 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.233328 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.233549 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.233644 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.233860 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.233945 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.234170 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.234254 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.234480 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.234572 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.234793 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.234923 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.235101 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.235185 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.235409 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.235501 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.235717 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.235801 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.236026 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.236109 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.236341 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.236439 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.236710 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.236827 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.237025 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.237124 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.237338 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.237453 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.237651 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.237755 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.237960 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.238057 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.238268 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.238371 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.238578 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.238676 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.238882 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.238978 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.239187 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.239291 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.239490 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.239586 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.239800 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.239910 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.240100 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.240198 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.240419 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.240555 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.240764 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.240909 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.241063 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.241201 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.241369 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.241505 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.241678 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.241816 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.241986 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.242121 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.242296 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.242440 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.242605 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.242749 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.242892 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.243026 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.243207 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.243339 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.243513 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.243678 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.243819 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.243909 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.244115 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.244201 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.244423 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.244522 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.244747 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.244835 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.245072 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.245162 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.245379 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.245479 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.245683 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.245770 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.245994 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.246078 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.246302 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.246395 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.246608 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.246700 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.246917 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.247008 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.247219 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.247305 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.247522 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.247609 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.247827 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.247920 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.248135 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.248228 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.248436 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.248529 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.248780 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.248869 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.249099 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.249192 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.249399 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.249485 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.249724 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.249833 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.250031 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.250129 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.250331 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.250416 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.250636 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.250731 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.250937 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.251028 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.251238 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.251329 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.251540 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.251703 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.251844 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.251931 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.252657 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.252773 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.252983 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.253081 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.253289 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.253383 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.253595 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.253721 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.253902 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.253989 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.254225 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.254311 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.254527 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.254611 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.254833 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.254919 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.255138 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.255224 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.255439 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.255524 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.255746 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.255840 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.256053 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.256140 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.256371 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.256458 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.256697 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.256789 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.257015 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.257101 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.257345 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.257446 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.257655 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.257741 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.257963 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.258048 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.258271 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.258364 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.258581 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.258667 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.258891 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.258976 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.259198 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.259291 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.259508 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.259595 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.259811 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.259903 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.260114 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.260226 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.260412 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.260500 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.260738 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.260837 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.261044 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.261145 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.261348 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.261435 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.261649 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.261734 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.261950 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.262044 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.262253 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.262338 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.262573 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.262659 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.262878 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.262971 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.263181 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.263268 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.263482 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.263568 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.263782 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.263875 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.264123 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.264218 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.264425 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.264520 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.264777 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.264866 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.265091 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.265216 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.265410 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.265507 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.265717 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.265801 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.266023 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.266107 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.266333 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.266426 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.266637 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.266721 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.266944 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.267030 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.267250 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.267353 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.267553 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.267641 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.268427 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.268520 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.268829 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.268932 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.269162 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.269247 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.269472 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.269568 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.269784 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.269876 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.270092 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.270234 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.270405 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.270489 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.270707 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.270802 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.271018 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.271110 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.271324 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.271410 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.271631 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.271718 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.271941 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.272026 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.272257 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.272341 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.272568 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.272655 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.272902 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.272990 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.273208 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.273302 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.273518 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.273603 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.273826 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.273946 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.274134 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.274229 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.274439 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.274525 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.274746 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.274838 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.275063 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.275162 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.275371 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.275473 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.275689 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.275774 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.275992 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.276091 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.276302 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.276387 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.276602 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.276706 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.276941 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.277038 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.277249 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.277341 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.277554 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.277648 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.277858 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.277952 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.278161 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.278255 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.278477 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.278563 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.278788 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.278883 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.279092 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.279176 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.279398 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.279483 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.279703 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.279790 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.280005 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.280091 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.280312 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.280406 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.280617 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.280751 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.280947 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.281042 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.281254 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.281420 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.281556 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.281650 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.281864 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.281949 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.282167 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.282261 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.282469 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.282555 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.282771 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.282870 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.283080 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.283174 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.283418 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.283508 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.283725 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.283811 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.284036 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.284128 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.284347 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.284446 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.284646 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.284790 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.284972 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.285060 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.285288 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.285407 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.285591 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.285856 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.285951 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.286178 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.286263 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.286477 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.286562 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.286805 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.286900 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.287109 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.287202 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.287410 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.287496 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.287722 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.287816 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.288039 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.288133 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.288344 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.288430 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.288652 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.288801 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.288979 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.289086 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.289283 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.289375 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.289588 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.289682 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.289894 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.289978 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.290197 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.290282 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.290504 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.290608 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.290806 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.290891 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.291111 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.291197 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.291415 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.291508 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.291719 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.291805 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.292020 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.292111 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.292323 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.292420 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.292627 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.292742 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.292954 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.293118 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.293258 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.293575 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.293685 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.294962 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.295067 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.295148 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.295242 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.295324 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.295409 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.295545 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.295634 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.295634 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.295785 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.295864 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.295941 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.296019 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.296102 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.296262 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.296356 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.296595 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.296712 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.296924 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.297019 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.297229 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.297317 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.297530 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.297618 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.297833 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.297920 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.298141 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.298228 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.298442 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.298533 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.298742 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.298836 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.299069 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.299165 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.299372 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.299457 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.299672 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.299759 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.299972 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.300072 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.300274 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.300360 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.300575 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.300661 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.300907 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.301006 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.301208 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.301294 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.301509 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.301601 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.301805 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.301899 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.302106 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.302191 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.302425 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.302518 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.302709 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.302800 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.303009 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.303103 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.303309 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.303407 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.303616 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.303702 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.303923 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.304009 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.304227 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.304312 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.304537 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.304633 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.304865 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.304952 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.305180 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.305267 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.305488 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.305615 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.305793 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.305880 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.306090 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.306185 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.306392 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.306479 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.306693 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.306779 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.306993 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.307087 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.307294 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.307387 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.307594 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.307681 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.307900 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.307996 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.308202 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.308287 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.308505 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.308597 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.308830 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.308930 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.309129 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.309214 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.309432 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.309526 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.309731 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.309819 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.310041 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.310127 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.310346 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.310432 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.310644 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.310742 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.310942 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.311028 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.311243 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.311327 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.311543 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.311629 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.311841 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.311927 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.312142 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.312226 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.312436 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.312523 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.312759 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.312847 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.313061 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.313163 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.313361 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.313446 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.313659 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.313750 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.313966 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.314060 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.314265 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.314396 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.315082 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.315301 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.315387 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.315628 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.315760 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.315939 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.316026 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.316243 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.316353 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.316546 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.316661 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.316878 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.316998 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.317180 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.317319 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.317482 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.317634 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.317788 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.317948 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.318106 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.318261 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.318419 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.318564 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.318721 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.318879 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.319026 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.319190 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.319330 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.319503 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.319628 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.319811 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.319927 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.320117 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.320229 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.320437 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.320522 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.320769 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.320872 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.321082 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.321169 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.321402 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.321488 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.321699 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.321794 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.322016 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.322102 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.322319 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.322412 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.322618 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.322732 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.322924 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.323164 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.323252 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.323466 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.323559 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.323801 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.323889 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.324101 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.324187 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.324416 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.324556 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.324757 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.324846 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.325069 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.325154 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.325384 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.325490 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.325687 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.325775 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.325991 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.326085 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.326296 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.326391 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.326593 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.326678 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.326903 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.326991 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.327209 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.327303 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.327513 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.327608 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.327810 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.327895 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.328108 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.328203 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.328414 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.328498 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.328743 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.328832 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.329053 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.329164 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.329376 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.329464 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.329694 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.329789 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.330013 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.330101 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.330884 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.330975 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.331195 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.331271 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.331505 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.331583 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.331844 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.331940 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.332152 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.332240 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.332456 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.332598 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.332787 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.332934 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.333099 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.333244 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.333408 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.333553 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.333715 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.333857 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.334022 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.334159 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.334323 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.334471 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.334627 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.334791 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.334932 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.335097 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.335232 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.335390 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.335552 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.335692 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.335857 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.336015 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.336157 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.336319 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.336461 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.336639 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.336767 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.337076 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.337163 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.337373 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.337459 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.337679 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.337793 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.338090 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.338177 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.338395 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.338480 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.338694 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.338792 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.338998 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.339086 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.339308 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.339401 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.339618 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.339714 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.339920 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.340015 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.340219 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.340304 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.340531 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.340617 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.340878 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.340967 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.341202 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.341288 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.341513 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.341607 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.341818 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.341903 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.342117 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.342203 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.342421 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.342508 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.342740 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.342824 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.343037 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.343130 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.343336 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.343423 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.343634 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.343757 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.343950 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.344079 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.344250 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.344389 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.344565 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.344735 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.345002 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.345099 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.345324 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.345492 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.345659 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.345824 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.345961 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.346093 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.346264 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.346363 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.346567 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.346656 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.346886 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.346972 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.347189 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.347284 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.347498 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.347585 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.347807 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.347893 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.348113 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.348201 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.348417 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.348503 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.348739 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.348828 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.349061 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.349149 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.349364 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.349450 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.349684 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.349777 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.349984 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.350078 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.350302 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.350378 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.353069 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.353221 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.353350 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.353461 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.353568 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.353672 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.353776 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.353882 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.354002 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.354118 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.354224 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.354327 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.354433 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.354546 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.354651 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.354762 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.354877 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.355250 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.355842 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.355983 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.356090 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.356195 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.356313 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.356419 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.356537 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.356653 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.356783 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.356889 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.357000 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.357110 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.357227 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.357334 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.357439 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.357549 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.357549 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.357761 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.357875 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.357989 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.358094 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.358198 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.358302 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.358412 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.358526 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.358632 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.358632 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.358826 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.358929 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.359039 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.359158 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.359264 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.359375 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.359480 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.359591 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.359705 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.359809 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.359922 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.360521 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.360606 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.360762 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.360847 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.360939 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.361028 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.361028 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.361171 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.361171 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.361323 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.361423 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.361510 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.361590 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.361667 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.361754 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.361834 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.361918 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.362009 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.362131 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.362227 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.362309 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.362387 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.362625 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.362719 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.362948 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.363043 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.363256 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.363341 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.363574 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.363669 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.363876 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.363972 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.364176 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.364268 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.364480 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.364573 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.364804 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.364907 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.365106 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.365193 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.365407 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.365493 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.365711 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.365824 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.366012 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.366109 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.366312 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.366398 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.366611 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.366698 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.366925 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.367010 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.367223 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.367465 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.367580 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.367796 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.367889 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.368109 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.368195 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.368407 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.368500 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.368731 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.368832 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.369044 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.369132 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.369357 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.369445 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.369669 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.369763 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.369975 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.370115 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.370283 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.370379 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.370590 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.370677 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.370891 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.370977 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.371209 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.371297 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.371521 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.371608 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.371834 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.371919 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.372147 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.372233 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.372457 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.372542 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.372788 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.372895 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.373099 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.373186 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.373410 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.373505 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.373714 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.373876 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.374026 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.374113 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.374337 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.374424 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.374649 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.374735 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.374963 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.375176 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.375261 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.375501 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.375602 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.375812 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.375900 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.376124 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.376221 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.376431 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.376532 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.376773 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.376862 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.377610 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.377716 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.377916 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.378011 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.378224 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.378318 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.378533 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.378622 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.378841 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.378990 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.379159 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.379294 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.379473 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.379623 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.379790 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.379932 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.380116 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.380308 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.380450 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.380623 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.380818 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.380982 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.381127 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.381308 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.381451 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.381631 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.381763 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.381949 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.382086 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.382270 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.382412 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.382562 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.382702 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.382877 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.383013 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.383180 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.383323 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.383485 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.383619 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.383790 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.383927 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.384094 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.384237 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.384381 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.384513 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.384703 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.384841 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.385012 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.385158 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.385318 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.385461 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.385625 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.385758 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.385940 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.386160 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.386313 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.386509 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.386645 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.386827 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.386968 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.387154 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.387297 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.387462 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.387592 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.387784 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.387973 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.388105 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.388284 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.388426 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.388612 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.388791 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.388975 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.389155 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.389301 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.389444 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.389580 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.389714 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.389889 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.390033 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.390199 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.390328 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.390500 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.390640 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.390801 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.390939 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.391104 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.391233 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.391407 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.391545 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.391706 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.391837 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.392022 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.392153 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.392326 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.392475 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.392642 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.393286 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.393500 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.393586 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.393807 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.393907 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.394139 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.394332 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.394446 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.394675 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.394770 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.394988 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.395075 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.395309 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.395396 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.395628 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.395728 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.395941 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.396025 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.396242 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.396327 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.396549 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.396642 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.396874 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.396961 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.397177 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.397263 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.397488 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.397587 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.397795 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.397881 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.398096 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.398189 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.398397 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.398484 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.398701 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.398795 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.399012 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.399098 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.399312 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.399399 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.399616 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.399703 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.399914 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.400002 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.400234 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.400322 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.400537 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.400713 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.400874 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.401096 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.401237 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.401430 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.401566 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.401711 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.401843 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.402010 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.402154 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.402310 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.402446 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.402611 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.402749 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.402921 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.403061 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.403193 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.403283 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.403492 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.403623 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.403836 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.403981 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.404117 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.404251 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.404385 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.404526 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.404661 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.404838 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.405015 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.405147 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.405332 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.405473 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.405621 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.405763 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.405921 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.406053 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.406231 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.406380 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.406538 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.406626 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.406856 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.406944 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.407162 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.407257 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.407468 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.407560 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.407780 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.407865 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.408104 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.408194 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.408451 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.408652 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.408794 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.409014 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.409113 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.409339 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.409476 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.409669 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.409800 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.409998 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.410138 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.410306 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.410442 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.410593 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.410722 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.410902 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.411043 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.411223 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.411363 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.411532 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.411669 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.411818 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.411959 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.412133 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.412268 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.412439 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.412569 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.412768 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.412904 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.413078 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.413210 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.413385 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.413530 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.413692 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.413824 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.413997 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.414129 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.414304 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.414445 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.414611 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.414702 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.414916 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.415053 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.415222 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.415375 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.415535 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.415668 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.415870 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.416002 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.416188 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.416330 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.416505 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.416648 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.416851 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.416993 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.417138 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.417267 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.417431 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.417563 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.417737 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.417868 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.418043 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.418175 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.418345 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.418486 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.418648 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.418780 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.418960 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.419099 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.419263 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.419418 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.419569 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.419713 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.419874 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.420104 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.420238 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.420413 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.420559 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.420752 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.420960 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.421173 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.421411 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.421643 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.421852 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.422087 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.422292 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.422429 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.422565 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.422664 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.422744 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.422902 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.423039 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.423169 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.423308 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.423445 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.423595 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.423595 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.424029 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.424248 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.424248 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.424519 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.424662 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.424868 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.424868 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.425144 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.425289 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.425424 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.425565 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.425736 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.425871 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.426042 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.426256 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.426488 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.426701 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.426915 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.427157 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.427375 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.427591 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.427882 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.428108 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.428249 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.428383 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.428515 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.428647 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.428875 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.429093 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.429316 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.429569 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.429782 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.429998 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.430232 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.430449 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.430663 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.430881 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.431100 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.431317 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.431452 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.431585 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.431716 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.431847 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.431991 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.432136 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.432278 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.432411 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.432543 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.432728 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.432816 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.432954 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.433088 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.433220 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.433352 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.433487 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.433698 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.433852 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.433994 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.434137 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.434272 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.434414 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.434558 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.434700 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.434843 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.434976 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.435109 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.435256 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.435398 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.435557 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.435692 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.435825 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.435958 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.436092 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.436239 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.436373 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.436506 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.436646 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.436799 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.436903 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.436991 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.437071 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.437149 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.437227 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.437313 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.437402 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.437483 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.437570 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.437651 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.437729 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.437820 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.437912 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.437993 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.438079 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.438159 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.438239 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.438318 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.438408 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.438489 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 14:46:22.438569 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.438857 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.439179 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.440034 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.440360 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.440690 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.441031 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.441343 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.441649 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.441961 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.442270 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.442579 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.442892 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.443205 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.443530 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.443853 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.444162 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.444487 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.444833 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.445176 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.445487 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.445830 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.446156 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.446468 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.446778 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.447080 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:46:22.447319 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 14:46:22.497286 n-d-843621-1 devstack@n-api.service[103849]: INFO dbcounter [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] Registered counter for database nova_api May 27 14:46:22.506517 n-d-843621-1 devstack@n-api.service[103850]: INFO dbcounter [None req-b8791def-97d5-4cf0-aced-fa3d0046df10 None None] Registered counter for database nova_api May 27 14:46:22.519431 n-d-843621-1 devstack@n-api.service[103849]: DEBUG oslo_db.sqlalchemy.engines [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 14:46:22.526051 n-d-843621-1 devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writer thread running {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 14:46:22.526434 n-d-843621-1 devstack@n-api.service[103850]: DEBUG oslo_db.sqlalchemy.engines [None req-b8791def-97d5-4cf0-aced-fa3d0046df10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 14:46:22.532624 n-d-843621-1 devstack@n-api.service[103850]: DEBUG dbcounter [-] [103850] Writer thread running {{(pid=103850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 14:46:22.583345 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.context [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57e0886a-3e0a-4a65-b585-e8d63742d44b(cell1) {{(pid=103849) load_cells /opt/stack/nova/nova/context.py:464}} May 27 14:46:22.587443 n-d-843621-1 devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:46:22.589052 n-d-843621-1 devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:46:22.589697 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.context [None req-b8791def-97d5-4cf0-aced-fa3d0046df10 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57e0886a-3e0a-4a65-b585-e8d63742d44b(cell1) {{(pid=103850) load_cells /opt/stack/nova/nova/context.py:464}} May 27 14:46:22.589825 n-d-843621-1 devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:46:22.591787 n-d-843621-1 devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:46:22.593755 n-d-843621-1 devstack@n-api.service[103850]: DEBUG oslo_concurrency.lockutils [None req-b8791def-97d5-4cf0-aced-fa3d0046df10 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:46:22.593874 n-d-843621-1 devstack@n-api.service[103849]: INFO dbcounter [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] Registered counter for database nova_cell0 May 27 14:46:22.595323 n-d-843621-1 devstack@n-api.service[103850]: DEBUG oslo_concurrency.lockutils [None req-b8791def-97d5-4cf0-aced-fa3d0046df10 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:46:22.596123 n-d-843621-1 devstack@n-api.service[103850]: DEBUG oslo_concurrency.lockutils [None req-b8791def-97d5-4cf0-aced-fa3d0046df10 None None] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:46:22.597789 n-d-843621-1 devstack@n-api.service[103849]: INFO dbcounter [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] Registered counter for database nova_cell1 May 27 14:46:22.598094 n-d-843621-1 devstack@n-api.service[103850]: DEBUG oslo_concurrency.lockutils [None req-b8791def-97d5-4cf0-aced-fa3d0046df10 None None] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:46:22.600395 n-d-843621-1 devstack@n-api.service[103850]: INFO dbcounter [None req-b8791def-97d5-4cf0-aced-fa3d0046df10 None None] Registered counter for database nova_cell0 May 27 14:46:22.604399 n-d-843621-1 devstack@n-api.service[103850]: INFO dbcounter [None req-b8791def-97d5-4cf0-aced-fa3d0046df10 None None] Registered counter for database nova_cell1 May 27 14:46:22.604906 n-d-843621-1 devstack@n-api.service[103849]: DEBUG oslo_db.sqlalchemy.engines [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 14:46:22.607754 n-d-843621-1 devstack@n-api.service[103849]: DEBUG oslo_db.sqlalchemy.engines [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 14:46:22.611165 n-d-843621-1 devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writer thread running {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 14:46:22.612386 n-d-843621-1 devstack@n-api.service[103850]: DEBUG oslo_db.sqlalchemy.engines [None req-b8791def-97d5-4cf0-aced-fa3d0046df10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 14:46:22.616126 n-d-843621-1 devstack@n-api.service[103850]: DEBUG oslo_db.sqlalchemy.engines [None req-b8791def-97d5-4cf0-aced-fa3d0046df10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 14:46:22.617886 n-d-843621-1 devstack@n-api.service[103850]: DEBUG dbcounter [-] [103850] Writer thread running {{(pid=103850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 14:46:22.750727 n-d-843621-1 devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writer thread running {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 14:46:22.758915 n-d-843621-1 devstack@n-api.service[103850]: DEBUG dbcounter [-] [103850] Writer thread running {{(pid=103850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 14:46:22.761021 n-d-843621-1 devstack@n-api.service[103849]: INFO dbcounter [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] Registered counter for database nova_cell0 May 27 14:46:22.767615 n-d-843621-1 devstack@n-api.service[103850]: INFO dbcounter [None req-b8791def-97d5-4cf0-aced-fa3d0046df10 None None] Registered counter for database nova_cell0 May 27 14:46:22.769676 n-d-843621-1 devstack@n-api.service[103849]: DEBUG oslo_db.sqlalchemy.engines [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 14:46:22.774001 n-d-843621-1 devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writer thread running {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 14:46:22.776133 n-d-843621-1 devstack@n-api.service[103850]: DEBUG oslo_db.sqlalchemy.engines [None req-b8791def-97d5-4cf0-aced-fa3d0046df10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 14:46:22.780396 n-d-843621-1 devstack@n-api.service[103850]: DEBUG dbcounter [-] [103850] Writer thread running {{(pid=103850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 14:46:23.115215 n-d-843621-1 devstack@n-api.service[103850]: WARNING keystonemiddleware.auth_token [None req-b8791def-97d5-4cf0-aced-fa3d0046df10 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 14:46:23.116401 n-d-843621-1 devstack@n-api.service[103849]: WARNING keystonemiddleware.auth_token [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 14:46:23.122404 n-d-843621-1 devstack@n-api.service[103850]: WARNING keystonemiddleware.auth_token [None req-b8791def-97d5-4cf0-aced-fa3d0046df10 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 14:46:23.123580 n-d-843621-1 devstack@n-api.service[103849]: WARNING keystonemiddleware.auth_token [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 14:46:23.467480 n-d-843621-1 devstack@n-api.service[103849]: WARNING keystonemiddleware.auth_token [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 14:46:23.473961 n-d-843621-1 devstack@n-api.service[103849]: WARNING keystonemiddleware.auth_token [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 14:46:23.478187 n-d-843621-1 devstack@n-api.service[103850]: WARNING keystonemiddleware.auth_token [None req-b8791def-97d5-4cf0-aced-fa3d0046df10 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 14:46:23.479338 n-d-843621-1 devstack@n-api.service[103849]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5616b33e79c0 pid: 103849 (default app) May 27 14:46:23.481686 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:46:23.482888 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001771 May 27 14:46:23.483300 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Fri May 27 14:46:23 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:46:23.484452 n-d-843621-1 devstack@n-api.service[103850]: WARNING keystonemiddleware.auth_token [None req-b8791def-97d5-4cf0-aced-fa3d0046df10 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 14:46:23.489871 n-d-843621-1 devstack@n-api.service[103850]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5616b33e79c0 pid: 103850 (default app) May 27 14:47:40.260840 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:47:40.261849 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 27 14:47:40.262232 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 14:47:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:47:40.275096 n-d-843621-1 devstack@n-api.service[103850]: DEBUG dbcounter [-] [103850] Writing DB stats nova_api:SELECT=3 {{(pid=103850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:47:40.276253 n-d-843621-1 devstack@n-api.service[103850]: DEBUG dbcounter [-] [103850] Writing DB stats nova_cell0:SELECT=3 {{(pid=103850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:47:40.277305 n-d-843621-1 devstack@n-api.service[103850]: DEBUG dbcounter [-] [103850] Writing DB stats nova_cell1:SELECT=3 {{(pid=103850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:47:40.278337 n-d-843621-1 devstack@n-api.service[103850]: DEBUG dbcounter [-] [103850] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:47:40.717696 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-ea6a88ff-f7ad-47a0-b77e-adaaab4d4751 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:47:40.747031 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-ea6a88ff-f7ad-47a0-b77e-adaaab4d4751 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.477194 May 27 14:47:40.747763 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1291 bytes} [Fri May 27 14:47:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:47:43.012418 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:47:43.013481 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-c87b9407-32d8-4129-8c19-8d5e6ef16ef4 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 27 14:47:43.013886 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 14:47:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:47:43.074571 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-be6c4d53-c035-4fe6-94be-29065c0ee001 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 256, "disk": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256"}} {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:47:43.093296 n-d-843621-1 devstack@n-api.service[103850]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:47:43.093296 n-d-843621-1 devstack@n-api.service[103850]: warnings.warn(msg) May 27 14:47:43.125083 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-be6c4d53-c035-4fe6-94be-29065c0ee001 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104526 May 27 14:47:43.125762 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 27 14:47:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:47:43.341974 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-c1251551-e50c-40b6-9abd-4c4932dbc5e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:47:43.344664 n-d-843621-1 devstack@n-api.service[103849]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:47:43.344664 n-d-843621-1 devstack@n-api.service[103849]: warnings.warn(msg) May 27 14:47:43.347405 n-d-843621-1 devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writing DB stats nova_api:SELECT=3 {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:47:43.348291 n-d-843621-1 devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writing DB stats nova_cell1:SELECT=3 {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:47:43.349529 n-d-843621-1 devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writing DB stats nova_cell0:SELECT=3 {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:47:43.350326 n-d-843621-1 devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:47:43.418528 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-c1251551-e50c-40b6-9abd-4c4932dbc5e0 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284507 May 27 14:47:43.419108 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1335 bytes} [Fri May 27 14:47:43 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:47:45.694246 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-be6c4d53-c035-4fe6-94be-29065c0ee001 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:47:45.695258 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-be6c4d53-c035-4fe6-94be-29065c0ee001 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 27 14:47:45.697885 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 14:47:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:47:45.805094 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-e17da75a-96a2-48f3-9a57-03341b5e0d2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "ram": 512, "vcpus": 1, "swap": 0, "disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "rxtx_factor": 1.0}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:47:45.822244 n-d-843621-1 devstack@n-api.service[103849]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:47:45.822244 n-d-843621-1 devstack@n-api.service[103849]: warnings.warn(msg) May 27 14:47:45.841295 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-e17da75a-96a2-48f3-9a57-03341b5e0d2a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138572 May 27 14:47:45.841871 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 27 14:47:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:47:45.854114 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-894fda31-f57f-4f58-9300-7b079ea7edb7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:47:45.855685 n-d-843621-1 devstack@n-api.service[103850]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:47:45.855685 n-d-843621-1 devstack@n-api.service[103850]: warnings.warn(msg) May 27 14:47:45.887719 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-894fda31-f57f-4f58-9300-7b079ea7edb7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037158 May 27 14:47:45.888217 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1335 bytes} [Fri May 27 14:47:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:47:48.236438 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-e17da75a-96a2-48f3-9a57-03341b5e0d2a admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:47:48.237859 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-e17da75a-96a2-48f3-9a57-03341b5e0d2a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002441 May 27 14:47:48.238424 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 14:47:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:47:48.312718 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-d91702b9-edcb-4297-a922-7386a864c8c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "vcpus": 1, "id": "d2", "swap": 0, "rxtx_factor": 1.0, "ram": 1024}} {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:47:48.342187 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-d91702b9-edcb-4297-a922-7386a864c8c1 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.097486 May 27 14:47:48.348749 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 27 14:47:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:47:48.359055 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-b4a1bdc9-655a-4e21-9efd-eb9b72796ba5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:47:48.393077 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-b4a1bdc9-655a-4e21-9efd-eb9b72796ba5 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040223 May 27 14:47:48.405002 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1335 bytes} [Fri May 27 14:47:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:47:51.008363 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-d91702b9-edcb-4297-a922-7386a864c8c1 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:47:51.010205 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-d91702b9-edcb-4297-a922-7386a864c8c1 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002284 May 27 14:47:51.011066 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 14:47:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:47:51.084607 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-a86af331-f1e8-4520-b880-8e3594fc08f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "rxtx_factor": 1.0}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:47:51.109206 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-a86af331-f1e8-4520-b880-8e3594fc08f0 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.091985 May 27 14:47:51.118156 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 27 14:47:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:47:51.124513 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-782c4b5e-9720-46c0-b282-9741ab619203 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:47:51.153109 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-782c4b5e-9720-46c0-b282-9741ab619203 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032560 May 27 14:47:51.163291 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1335 bytes} [Fri May 27 14:47:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:47:53.529832 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-a86af331-f1e8-4520-b880-8e3594fc08f0 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:47:53.530845 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-a86af331-f1e8-4520-b880-8e3594fc08f0 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 May 27 14:47:53.531241 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 14:47:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:47:53.592763 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-1153061c-15c7-4b2d-864c-d5de4c5f6074 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "disk": 20}} {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:47:53.612239 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-1153061c-15c7-4b2d-864c-d5de4c5f6074 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074615 May 27 14:47:53.619754 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 27 14:47:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:47:53.624970 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-f7f244cc-b85a-48d7-8c75-4750426ce14a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:47:53.648491 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-f7f244cc-b85a-48d7-8c75-4750426ce14a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027231 May 27 14:47:53.649302 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1335 bytes} [Fri May 27 14:47:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:47:55.948247 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-1153061c-15c7-4b2d-864c-d5de4c5f6074 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:47:55.949533 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-1153061c-15c7-4b2d-864c-d5de4c5f6074 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001711 May 27 14:47:55.950167 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 14:47:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:47:56.068502 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-53616ee3-4be1-4341-8d8c-ec0b0ab84c7a admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:47:56.121531 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-53616ee3-4be1-4341-8d8c-ec0b0ab84c7a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.164865 May 27 14:47:56.122525 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1291 bytes} [Fri May 27 14:47:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:47:58.535927 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-1153061c-15c7-4b2d-864c-d5de4c5f6074 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:47:58.537563 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-1153061c-15c7-4b2d-864c-d5de4c5f6074 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002036 May 27 14:47:58.538702 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 14:47:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:47:58.607316 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-65f5c466-a09a-42bb-a780-406c89534ab5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "1", "disk": 1, "vcpus": 1, "swap": 0}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:47:58.634847 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-65f5c466-a09a-42bb-a780-406c89534ab5 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.090066 May 27 14:47:58.648122 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-89397fff-92e7-4ea2-b5d2-005c63b5321d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:47:58.655365 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 27 14:47:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:47:58.675615 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-89397fff-92e7-4ea2-b5d2-005c63b5321d admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031015 May 27 14:47:58.676816 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1332 bytes} [Fri May 27 14:47:58 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:48:01.049438 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-65f5c466-a09a-42bb-a780-406c89534ab5 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:01.050520 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-65f5c466-a09a-42bb-a780-406c89534ab5 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 27 14:48:01.050843 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 14:48:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 14:48:01.116296 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-c358a3e4-df77-4e54-9302-eabca9207253 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "vcpus": 1, "id": "2", "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:48:01.135017 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-c358a3e4-df77-4e54-9302-eabca9207253 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078382 May 27 14:48:01.136778 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 27 14:48:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 14:48:01.154153 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-f441effe-b6e1-4d1d-997c-5825f03e25ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:48:01.181187 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-f441effe-b6e1-4d1d-997c-5825f03e25ff admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030759 May 27 14:48:01.181876 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1332 bytes} [Fri May 27 14:48:01 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:48:03.557273 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-c358a3e4-df77-4e54-9302-eabca9207253 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:03.558286 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-c358a3e4-df77-4e54-9302-eabca9207253 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 May 27 14:48:03.558923 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 14:48:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:48:03.625483 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-d51deacc-3a92-401c-865e-b137c456f660 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 40, "ram": 4096, "name": "m1.medium"}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:48:03.647158 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-d51deacc-3a92-401c-865e-b137c456f660 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.081532 May 27 14:48:03.652759 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 27 14:48:03 2022] POST /compute/v2.1/flavors => generated 406 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:48:03.659949 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-7743c758-e196-4397-b9e3-0736c7b82811 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:48:03.683760 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-7743c758-e196-4397-b9e3-0736c7b82811 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027443 May 27 14:48:03.684341 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1332 bytes} [Fri May 27 14:48:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:48:05.947648 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-d51deacc-3a92-401c-865e-b137c456f660 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:05.948775 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-d51deacc-3a92-401c-865e-b137c456f660 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 27 14:48:05.949251 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 14:48:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:48:06.024887 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-9067f85e-a5d3-41e1-adf6-ed657e5841b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:48:06.043712 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-9067f85e-a5d3-41e1-adf6-ed657e5841b0 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.088628 May 27 14:48:06.044240 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 27 14:48:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:48:06.056565 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-ffeb3797-00ed-4d02-8200-3229cbb2cb69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:48:06.080169 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-ffeb3797-00ed-4d02-8200-3229cbb2cb69 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027147 May 27 14:48:06.080694 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1332 bytes} [Fri May 27 14:48:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:48:08.343674 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-9067f85e-a5d3-41e1-adf6-ed657e5841b0 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:08.344744 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-9067f85e-a5d3-41e1-adf6-ed657e5841b0 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 27 14:48:08.345388 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 14:48:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:48:08.407185 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-299cff42-5f5c-44ad-ad56-c024d3e58e1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge", "rxtx_factor": 1.0, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:48:08.424945 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-299cff42-5f5c-44ad-ad56-c024d3e58e1c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073730 May 27 14:48:08.425485 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1282 bytes} [Fri May 27 14:48:08 2022] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:48:08.437540 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-16f7b595-73d1-49e3-855e-f0339ff6a8f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:48:08.460729 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-16f7b595-73d1-49e3-855e-f0339ff6a8f7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026853 May 27 14:48:08.461304 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1332 bytes} [Fri May 27 14:48:08 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:48:36.533422 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-299cff42-5f5c-44ad-ad56-c024d3e58e1c admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:36.534432 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-299cff42-5f5c-44ad-ad56-c024d3e58e1c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 27 14:48:36.534823 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 14:48:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:48:36.545487 n-d-843621-1 devstack@n-api.service[103850]: DEBUG dbcounter [-] [103850] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:48:36.593877 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-18329db2-6ce8-4a31-937b-46ae12c420a8 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:36.611712 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-18329db2-6ce8-4a31-937b-46ae12c420a8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070737 May 27 14:48:36.612174 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1291 bytes} [Fri May 27 14:48:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:48:37.590806 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-299cff42-5f5c-44ad-ad56-c024d3e58e1c admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:37.591805 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-299cff42-5f5c-44ad-ad56-c024d3e58e1c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 27 14:48:37.592198 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 14:48:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:48:37.800467 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-bb8ec387-1ed1-4199-b3b5-420c6990a60b admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:37.806134 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.wsgi [None req-bb8ec387-1ed1-4199-b3b5-420c6990a60b admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-bb8ec387-1ed1-4199-b3b5-420c6990a60b admin admin] Request method failure captured: May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: Accept: application/json May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: Accept-Encoding: gzip, deflate May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: Connection: keep-alive May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: Content-Length: 0 May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: Host: 10.222.0.13 May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: Openstack-Api-Version: compute 2.90 May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: Openstack-System-Scope: None May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: User-Agent: python-novaclient May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: X-Auth-Token: gAAAAABikOTFW6kxwNv90eQvYrxc-W5s8r0bUUrbh6PEbHcqIkhp67vuSTApBGr_I8456hxF7e19pWEsMkiFRVfOhVtPHyHeMnfwzkRC9L8vFCZTdoD2cIDvYOOOq4DnHUkTHUqEc_CANcemjnRCIQlJ_6OXzKJS3pY1jiNWX8gZY6WtTC2rm5Q May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: X-Domain-Id: None May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: X-Domain-Name: None May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: X-Identity-Status: Confirmed May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: X-Is-Admin-Project: True May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: X-Openstack-Nova-Api-Version: 2.90 May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: X-Project-Domain-Id: default May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: X-Project-Domain-Name: Default May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: X-Project-Id: 182a5f45684d451daf0ad53183be69eb May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: X-Project-Name: admin May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: X-Role: reader,admin,member May 27 14:48:37.809401 n-d-843621-1 devstack@n-api.service[103850]: X-Roles: reader,admin,member May 27 14:48:37.811046 n-d-843621-1 devstack@n-api.service[103850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/182a5f45684d451daf0ad53183be69eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/182a5f45684d451daf0ad53183be69eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/182a5f45684d451daf0ad53183be69eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_182a5f45684d451daf0ad53183be69eb", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:48:37.811046 n-d-843621-1 devstack@n-api.service[103850]: X-Tenant: admin May 27 14:48:37.811046 n-d-843621-1 devstack@n-api.service[103850]: X-Tenant-Id: 182a5f45684d451daf0ad53183be69eb May 27 14:48:37.811046 n-d-843621-1 devstack@n-api.service[103850]: X-Tenant-Name: admin May 27 14:48:37.811046 n-d-843621-1 devstack@n-api.service[103850]: X-User: admin May 27 14:48:37.811046 n-d-843621-1 devstack@n-api.service[103850]: X-User-Domain-Id: default May 27 14:48:37.811046 n-d-843621-1 devstack@n-api.service[103850]: X-User-Domain-Name: Default May 27 14:48:37.811046 n-d-843621-1 devstack@n-api.service[103850]: X-User-Id: 3d7e94b1e9764a2eb614ea180d924a78 May 27 14:48:37.811046 n-d-843621-1 devstack@n-api.service[103850]: X-User-Name: admin May 27 14:48:37.811046 n-d-843621-1 devstack@n-api.service[103850]: method: > May 27 14:48:37.811046 n-d-843621-1 devstack@n-api.service[103850]: exception: Flavor 42 could not be found. May 27 14:48:37.811046 n-d-843621-1 devstack@n-api.service[103850]: action_args: {'id': '42'} May 27 14:48:37.811046 n-d-843621-1 devstack@n-api.service[103850]: {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:48:37.811046 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:48:37.812080 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 14:48:37.812080 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 14:48:37.812080 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 14:48:37.812080 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 14:48:37.812080 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:48:37.812080 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:48:37.812080 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 14:48:37.812080 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 14:48:37.812080 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 14:48:37.812080 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:48:37.812080 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 14:48:37.812080 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 14:48:37.812080 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 27 14:48:37.812080 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi May 27 14:48:37.812080 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:48:37.812080 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi May 27 14:48:37.812080 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:48:37.812080 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:48:37.812080 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:48:37.814064 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:48:37.814064 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:48:37.814064 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:48:37.814064 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:48:37.814064 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 14:48:37.814064 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 14:48:37.814064 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 27 14:48:37.814064 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi May 27 14:48:37.814064 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:48:37.814064 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi May 27 14:48:37.814064 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:48:37.814064 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:48:37.814064 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:48:37.814064 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:48:37.814064 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:48:37.814064 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 27 14:48:37.814064 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi May 27 14:48:37.814064 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-bb8ec387-1ed1-4199-b3b5-420c6990a60b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:48:37.815118 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-bb8ec387-1ed1-4199-b3b5-420c6990a60b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061983 May 27 14:48:37.815118 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 27 14:48:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 14:48:37.821120 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-66712664-36ef-4fe4-9021-19fb1bee0148 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:37.823963 n-d-843621-1 devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:48:37.843451 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-66712664-36ef-4fe4-9021-19fb1bee0148 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025803 May 27 14:48:37.843981 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1210 bytes} [Fri May 27 14:48:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:48:37.860968 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-ac4a0cde-5639-411e-bec2-10aaee4edf0b admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:37.882210 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-ac4a0cde-5639-411e-bec2-10aaee4edf0b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025576 May 27 14:48:37.882732 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1210 bytes} [Fri May 27 14:48:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 14:48:37.891663 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-146530d3-1aa2-43fc-83fd-f0d87ca297d2 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:37.897838 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.wsgi [None req-146530d3-1aa2-43fc-83fd-f0d87ca297d2 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-146530d3-1aa2-43fc-83fd-f0d87ca297d2 admin admin] Request method failure captured: May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: Accept: application/json May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: Accept-Encoding: gzip, deflate May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: Connection: keep-alive May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: Content-Length: 0 May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: Host: 10.222.0.13 May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: Openstack-Api-Version: compute 2.90 May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: Openstack-System-Scope: None May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: User-Agent: python-novaclient May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: X-Auth-Token: gAAAAABikOTFW6kxwNv90eQvYrxc-W5s8r0bUUrbh6PEbHcqIkhp67vuSTApBGr_I8456hxF7e19pWEsMkiFRVfOhVtPHyHeMnfwzkRC9L8vFCZTdoD2cIDvYOOOq4DnHUkTHUqEc_CANcemjnRCIQlJ_6OXzKJS3pY1jiNWX8gZY6WtTC2rm5Q May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: X-Domain-Id: None May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: X-Domain-Name: None May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: X-Identity-Status: Confirmed May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: X-Is-Admin-Project: True May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: X-Openstack-Nova-Api-Version: 2.90 May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: X-Project-Domain-Id: default May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: X-Project-Domain-Name: Default May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: X-Project-Id: 182a5f45684d451daf0ad53183be69eb May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: X-Project-Name: admin May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: X-Role: reader,admin,member May 27 14:48:37.901099 n-d-843621-1 devstack@n-api.service[103849]: X-Roles: reader,admin,member May 27 14:48:37.902610 n-d-843621-1 devstack@n-api.service[103849]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/182a5f45684d451daf0ad53183be69eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/182a5f45684d451daf0ad53183be69eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/182a5f45684d451daf0ad53183be69eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_182a5f45684d451daf0ad53183be69eb", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:48:37.902610 n-d-843621-1 devstack@n-api.service[103849]: X-Tenant: admin May 27 14:48:37.902610 n-d-843621-1 devstack@n-api.service[103849]: X-Tenant-Id: 182a5f45684d451daf0ad53183be69eb May 27 14:48:37.902610 n-d-843621-1 devstack@n-api.service[103849]: X-Tenant-Name: admin May 27 14:48:37.902610 n-d-843621-1 devstack@n-api.service[103849]: X-User: admin May 27 14:48:37.902610 n-d-843621-1 devstack@n-api.service[103849]: X-User-Domain-Id: default May 27 14:48:37.902610 n-d-843621-1 devstack@n-api.service[103849]: X-User-Domain-Name: Default May 27 14:48:37.902610 n-d-843621-1 devstack@n-api.service[103849]: X-User-Id: 3d7e94b1e9764a2eb614ea180d924a78 May 27 14:48:37.902610 n-d-843621-1 devstack@n-api.service[103849]: X-User-Name: admin May 27 14:48:37.902610 n-d-843621-1 devstack@n-api.service[103849]: method: > May 27 14:48:37.902610 n-d-843621-1 devstack@n-api.service[103849]: exception: Flavor 42 could not be found. May 27 14:48:37.902610 n-d-843621-1 devstack@n-api.service[103849]: action_args: {'id': '42'} May 27 14:48:37.902610 n-d-843621-1 devstack@n-api.service[103849]: {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:48:37.902610 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:48:37.903547 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 14:48:37.903547 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 14:48:37.903547 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 14:48:37.903547 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 14:48:37.903547 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:48:37.903547 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:48:37.903547 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 14:48:37.903547 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 14:48:37.903547 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 14:48:37.903547 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:48:37.903547 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 14:48:37.903547 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 14:48:37.903547 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 27 14:48:37.903547 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi May 27 14:48:37.903547 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:48:37.903547 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi May 27 14:48:37.903547 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:48:37.903547 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:48:37.903547 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:48:37.904839 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:48:37.904839 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:48:37.904839 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:48:37.904839 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:48:37.904839 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 14:48:37.904839 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 14:48:37.904839 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 27 14:48:37.904839 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi May 27 14:48:37.904839 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:48:37.904839 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi May 27 14:48:37.904839 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:48:37.904839 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:48:37.904839 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:48:37.904839 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:48:37.904839 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:48:37.904839 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 27 14:48:37.904839 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi May 27 14:48:37.904839 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-146530d3-1aa2-43fc-83fd-f0d87ca297d2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:48:37.906068 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-146530d3-1aa2-43fc-83fd-f0d87ca297d2 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014335 May 27 14:48:37.906068 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 27 14:48:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 14:48:38.775667 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-ac4a0cde-5639-411e-bec2-10aaee4edf0b admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:38.776847 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-ac4a0cde-5639-411e-bec2-10aaee4edf0b admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 27 14:48:38.777238 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 14:48:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:48:38.966395 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-3c9c0a88-0916-42c6-86cb-bd4cba0190e8 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:38.972180 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.wsgi [None req-3c9c0a88-0916-42c6-86cb-bd4cba0190e8 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-3c9c0a88-0916-42c6-86cb-bd4cba0190e8 admin admin] Request method failure captured: May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: Accept: application/json May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: Accept-Encoding: gzip, deflate May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: Connection: keep-alive May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: Content-Length: 0 May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: Host: 10.222.0.13 May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: Openstack-Api-Version: compute 2.90 May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: Openstack-System-Scope: None May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: User-Agent: python-novaclient May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: X-Auth-Token: gAAAAABikOTGS9h3q9_ex-dpTlyatmQj4rHTOoGXCEcTaS9gsbdMtNeOLAJqocNmDvRwHS5jFt35dxditg5QJZP_hbecsYsLSvMGQmd8vZF17hPpMe4qGew9N9dGgQ--oA4AaCcpiWiGSG7dIuTrnlBuVQhe1Y0fffJnfm5wccgYtc23JUnMlcw May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: X-Domain-Id: None May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: X-Domain-Name: None May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: X-Identity-Status: Confirmed May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: X-Is-Admin-Project: True May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: X-Openstack-Nova-Api-Version: 2.90 May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: X-Project-Domain-Id: default May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: X-Project-Domain-Name: Default May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: X-Project-Id: 182a5f45684d451daf0ad53183be69eb May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: X-Project-Name: admin May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: X-Role: reader,admin,member May 27 14:48:38.973697 n-d-843621-1 devstack@n-api.service[103849]: X-Roles: reader,admin,member May 27 14:48:38.975164 n-d-843621-1 devstack@n-api.service[103849]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/182a5f45684d451daf0ad53183be69eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/182a5f45684d451daf0ad53183be69eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/182a5f45684d451daf0ad53183be69eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_182a5f45684d451daf0ad53183be69eb", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:48:38.975164 n-d-843621-1 devstack@n-api.service[103849]: X-Tenant: admin May 27 14:48:38.975164 n-d-843621-1 devstack@n-api.service[103849]: X-Tenant-Id: 182a5f45684d451daf0ad53183be69eb May 27 14:48:38.975164 n-d-843621-1 devstack@n-api.service[103849]: X-Tenant-Name: admin May 27 14:48:38.975164 n-d-843621-1 devstack@n-api.service[103849]: X-User: admin May 27 14:48:38.975164 n-d-843621-1 devstack@n-api.service[103849]: X-User-Domain-Id: default May 27 14:48:38.975164 n-d-843621-1 devstack@n-api.service[103849]: X-User-Domain-Name: Default May 27 14:48:38.975164 n-d-843621-1 devstack@n-api.service[103849]: X-User-Id: 3d7e94b1e9764a2eb614ea180d924a78 May 27 14:48:38.975164 n-d-843621-1 devstack@n-api.service[103849]: X-User-Name: admin May 27 14:48:38.975164 n-d-843621-1 devstack@n-api.service[103849]: method: > May 27 14:48:38.975164 n-d-843621-1 devstack@n-api.service[103849]: exception: Flavor 84 could not be found. May 27 14:48:38.975164 n-d-843621-1 devstack@n-api.service[103849]: action_args: {'id': '84'} May 27 14:48:38.975164 n-d-843621-1 devstack@n-api.service[103849]: {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:48:38.975164 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:48:38.976089 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 14:48:38.976089 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 14:48:38.976089 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 14:48:38.976089 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 14:48:38.976089 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:48:38.976089 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:48:38.976089 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 14:48:38.976089 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 14:48:38.976089 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 14:48:38.976089 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:48:38.976089 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 14:48:38.976089 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 14:48:38.976089 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 27 14:48:38.976089 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi May 27 14:48:38.976089 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:48:38.976089 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi May 27 14:48:38.976089 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:48:38.976089 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:48:38.976089 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:48:38.977397 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:48:38.977397 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:48:38.977397 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:48:38.977397 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:48:38.977397 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 14:48:38.977397 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 14:48:38.977397 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 27 14:48:38.977397 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi May 27 14:48:38.977397 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:48:38.977397 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi May 27 14:48:38.977397 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:48:38.977397 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:48:38.977397 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:48:38.977397 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:48:38.977397 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:48:38.977397 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 27 14:48:38.977397 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi May 27 14:48:38.977397 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-3c9c0a88-0916-42c6-86cb-bd4cba0190e8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:48:38.978701 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-3c9c0a88-0916-42c6-86cb-bd4cba0190e8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060578 May 27 14:48:38.978701 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 27 14:48:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 14:48:38.985197 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-b90ccaec-351f-45e5-8c44-372cee0604b3 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:39.004508 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-b90ccaec-351f-45e5-8c44-372cee0604b3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018839 May 27 14:48:39.005151 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1210 bytes} [Fri May 27 14:48:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:48:39.014798 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-f78db04a-7174-42fd-9f6d-389186b26fb0 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:39.029258 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-f78db04a-7174-42fd-9f6d-389186b26fb0 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018009 May 27 14:48:39.029789 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1210 bytes} [Fri May 27 14:48:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:48:39.039086 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-8ac34eb5-d2e3-4ec9-a545-31fd5dbcdcfb admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:39.044310 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.wsgi [None req-8ac34eb5-d2e3-4ec9-a545-31fd5dbcdcfb admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-8ac34eb5-d2e3-4ec9-a545-31fd5dbcdcfb admin admin] Request method failure captured: May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: Accept: application/json May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: Accept-Encoding: gzip, deflate May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: Connection: keep-alive May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: Content-Length: 0 May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: Host: 10.222.0.13 May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: Openstack-Api-Version: compute 2.90 May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: Openstack-System-Scope: None May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: User-Agent: python-novaclient May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: X-Auth-Token: gAAAAABikOTGS9h3q9_ex-dpTlyatmQj4rHTOoGXCEcTaS9gsbdMtNeOLAJqocNmDvRwHS5jFt35dxditg5QJZP_hbecsYsLSvMGQmd8vZF17hPpMe4qGew9N9dGgQ--oA4AaCcpiWiGSG7dIuTrnlBuVQhe1Y0fffJnfm5wccgYtc23JUnMlcw May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: X-Domain-Id: None May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: X-Domain-Name: None May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: X-Identity-Status: Confirmed May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: X-Is-Admin-Project: True May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: X-Openstack-Nova-Api-Version: 2.90 May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: X-Project-Domain-Id: default May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: X-Project-Domain-Name: Default May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: X-Project-Id: 182a5f45684d451daf0ad53183be69eb May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: X-Project-Name: admin May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: X-Role: reader,admin,member May 27 14:48:39.045835 n-d-843621-1 devstack@n-api.service[103850]: X-Roles: reader,admin,member May 27 14:48:39.047837 n-d-843621-1 devstack@n-api.service[103850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/182a5f45684d451daf0ad53183be69eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/182a5f45684d451daf0ad53183be69eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/182a5f45684d451daf0ad53183be69eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_182a5f45684d451daf0ad53183be69eb", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:48:39.047837 n-d-843621-1 devstack@n-api.service[103850]: X-Tenant: admin May 27 14:48:39.047837 n-d-843621-1 devstack@n-api.service[103850]: X-Tenant-Id: 182a5f45684d451daf0ad53183be69eb May 27 14:48:39.047837 n-d-843621-1 devstack@n-api.service[103850]: X-Tenant-Name: admin May 27 14:48:39.047837 n-d-843621-1 devstack@n-api.service[103850]: X-User: admin May 27 14:48:39.047837 n-d-843621-1 devstack@n-api.service[103850]: X-User-Domain-Id: default May 27 14:48:39.047837 n-d-843621-1 devstack@n-api.service[103850]: X-User-Domain-Name: Default May 27 14:48:39.047837 n-d-843621-1 devstack@n-api.service[103850]: X-User-Id: 3d7e94b1e9764a2eb614ea180d924a78 May 27 14:48:39.047837 n-d-843621-1 devstack@n-api.service[103850]: X-User-Name: admin May 27 14:48:39.047837 n-d-843621-1 devstack@n-api.service[103850]: method: > May 27 14:48:39.047837 n-d-843621-1 devstack@n-api.service[103850]: exception: Flavor 84 could not be found. May 27 14:48:39.047837 n-d-843621-1 devstack@n-api.service[103850]: action_args: {'id': '84'} May 27 14:48:39.047837 n-d-843621-1 devstack@n-api.service[103850]: {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:48:39.047837 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:48:39.048888 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 14:48:39.048888 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 14:48:39.048888 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 14:48:39.048888 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 14:48:39.048888 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:48:39.048888 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:48:39.048888 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 14:48:39.048888 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 14:48:39.048888 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 14:48:39.048888 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:48:39.048888 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 14:48:39.048888 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 14:48:39.048888 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 27 14:48:39.048888 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi May 27 14:48:39.048888 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:48:39.048888 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi May 27 14:48:39.048888 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:48:39.048888 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:48:39.048888 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:48:39.050447 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:48:39.050447 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:48:39.050447 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:48:39.050447 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:48:39.050447 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 14:48:39.050447 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 14:48:39.050447 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 27 14:48:39.050447 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi May 27 14:48:39.050447 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:48:39.050447 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi May 27 14:48:39.050447 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:48:39.050447 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:48:39.050447 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:48:39.050447 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:48:39.050447 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:48:39.050447 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 27 14:48:39.050447 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi May 27 14:48:39.050447 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-8ac34eb5-d2e3-4ec9-a545-31fd5dbcdcfb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:48:39.051777 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-8ac34eb5-d2e3-4ec9-a545-31fd5dbcdcfb admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011625 May 27 14:48:39.051777 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 27 14:48:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 14:48:39.916372 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-f78db04a-7174-42fd-9f6d-389186b26fb0 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:39.917409 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-f78db04a-7174-42fd-9f6d-389186b26fb0 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 27 14:48:39.917795 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 14:48:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:48:40.104525 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-f7c9b5c6-0c50-4d3a-af67-29e6217222c7 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:40.110521 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.wsgi [None req-f7c9b5c6-0c50-4d3a-af67-29e6217222c7 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-f7c9b5c6-0c50-4d3a-af67-29e6217222c7 admin admin] Request method failure captured: May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: Accept: application/json May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: Accept-Encoding: gzip, deflate May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: Connection: keep-alive May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: Content-Length: 0 May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: Host: 10.222.0.13 May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: Openstack-Api-Version: compute 2.90 May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: Openstack-System-Scope: None May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: User-Agent: python-novaclient May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: X-Auth-Token: gAAAAABikOTH_PyGRN9YOfzlbiMcUj_wjvAiIBy3BR8SNF-R7gXbeDLJO-37vo0dt1icpTeiQeHeJWSxCw16eZMh-9LlRVYnkpDH4mzKmoSeFTHmWuok8r3W06UwdC93i0kkVylxrcQgy-KXOVHUdiUNUnwh4iOawmjul1wZXgXFa9fm-9CUytI May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: X-Domain-Id: None May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: X-Domain-Name: None May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: X-Identity-Status: Confirmed May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: X-Is-Admin-Project: True May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: X-Openstack-Nova-Api-Version: 2.90 May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: X-Project-Domain-Id: default May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: X-Project-Domain-Name: Default May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: X-Project-Id: 182a5f45684d451daf0ad53183be69eb May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: X-Project-Name: admin May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: X-Role: reader,admin,member May 27 14:48:40.112728 n-d-843621-1 devstack@n-api.service[103850]: X-Roles: reader,admin,member May 27 14:48:40.114327 n-d-843621-1 devstack@n-api.service[103850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/182a5f45684d451daf0ad53183be69eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/182a5f45684d451daf0ad53183be69eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/182a5f45684d451daf0ad53183be69eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_182a5f45684d451daf0ad53183be69eb", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:48:40.114327 n-d-843621-1 devstack@n-api.service[103850]: X-Tenant: admin May 27 14:48:40.114327 n-d-843621-1 devstack@n-api.service[103850]: X-Tenant-Id: 182a5f45684d451daf0ad53183be69eb May 27 14:48:40.114327 n-d-843621-1 devstack@n-api.service[103850]: X-Tenant-Name: admin May 27 14:48:40.114327 n-d-843621-1 devstack@n-api.service[103850]: X-User: admin May 27 14:48:40.114327 n-d-843621-1 devstack@n-api.service[103850]: X-User-Domain-Id: default May 27 14:48:40.114327 n-d-843621-1 devstack@n-api.service[103850]: X-User-Domain-Name: Default May 27 14:48:40.114327 n-d-843621-1 devstack@n-api.service[103850]: X-User-Id: 3d7e94b1e9764a2eb614ea180d924a78 May 27 14:48:40.114327 n-d-843621-1 devstack@n-api.service[103850]: X-User-Name: admin May 27 14:48:40.114327 n-d-843621-1 devstack@n-api.service[103850]: method: > May 27 14:48:40.114327 n-d-843621-1 devstack@n-api.service[103850]: exception: Flavor 451 could not be found. May 27 14:48:40.114327 n-d-843621-1 devstack@n-api.service[103850]: action_args: {'id': '451'} May 27 14:48:40.114327 n-d-843621-1 devstack@n-api.service[103850]: {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:48:40.114327 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:48:40.115166 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 14:48:40.115166 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 14:48:40.115166 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 14:48:40.115166 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 14:48:40.115166 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:48:40.115166 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:48:40.115166 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 14:48:40.115166 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 14:48:40.115166 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 14:48:40.115166 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:48:40.115166 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 14:48:40.115166 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 14:48:40.115166 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 27 14:48:40.115166 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi May 27 14:48:40.115166 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:48:40.115166 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi May 27 14:48:40.115166 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:48:40.115166 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:48:40.115166 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:48:40.116205 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:48:40.116205 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:48:40.116205 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:48:40.116205 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:48:40.116205 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 14:48:40.116205 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 14:48:40.116205 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 27 14:48:40.116205 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi May 27 14:48:40.116205 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:48:40.116205 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi May 27 14:48:40.116205 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:48:40.116205 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:48:40.116205 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:48:40.116205 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:48:40.116205 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:48:40.116205 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 27 14:48:40.116205 n-d-843621-1 devstack@n-api.service[103850]: ERROR nova.api.openstack.wsgi May 27 14:48:40.116205 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-f7c9b5c6-0c50-4d3a-af67-29e6217222c7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:48:40.117405 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-f7c9b5c6-0c50-4d3a-af67-29e6217222c7 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060400 May 27 14:48:40.117405 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 14:48:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 14:48:40.124115 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-c6785371-2678-45cc-8256-65549cc015a3 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:40.139203 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-c6785371-2678-45cc-8256-65549cc015a3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018776 May 27 14:48:40.139662 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1210 bytes} [Fri May 27 14:48:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:48:40.149358 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-b4dcdc6d-ae38-4aa0-98c1-df1ee4056099 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:40.163330 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-b4dcdc6d-ae38-4aa0-98c1-df1ee4056099 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017509 May 27 14:48:40.163840 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1210 bytes} [Fri May 27 14:48:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 14:48:40.172620 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-83a703ba-e25a-435e-8e4d-3bcacb5ef92d admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:40.177864 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.wsgi [None req-83a703ba-e25a-435e-8e4d-3bcacb5ef92d admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-83a703ba-e25a-435e-8e4d-3bcacb5ef92d admin admin] Request method failure captured: May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: Accept: application/json May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: Accept-Encoding: gzip, deflate May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: Connection: keep-alive May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: Content-Length: 0 May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: Host: 10.222.0.13 May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: Openstack-Api-Version: compute 2.90 May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: Openstack-System-Scope: None May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: User-Agent: python-novaclient May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: X-Auth-Token: gAAAAABikOTH_PyGRN9YOfzlbiMcUj_wjvAiIBy3BR8SNF-R7gXbeDLJO-37vo0dt1icpTeiQeHeJWSxCw16eZMh-9LlRVYnkpDH4mzKmoSeFTHmWuok8r3W06UwdC93i0kkVylxrcQgy-KXOVHUdiUNUnwh4iOawmjul1wZXgXFa9fm-9CUytI May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: X-Domain-Id: None May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: X-Domain-Name: None May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: X-Identity-Status: Confirmed May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: X-Is-Admin-Project: True May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: X-Openstack-Nova-Api-Version: 2.90 May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: X-Project-Domain-Id: default May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: X-Project-Domain-Name: Default May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: X-Project-Id: 182a5f45684d451daf0ad53183be69eb May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: X-Project-Name: admin May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: X-Role: reader,admin,member May 27 14:48:40.179366 n-d-843621-1 devstack@n-api.service[103849]: X-Roles: reader,admin,member May 27 14:48:40.180895 n-d-843621-1 devstack@n-api.service[103849]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/182a5f45684d451daf0ad53183be69eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/182a5f45684d451daf0ad53183be69eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/182a5f45684d451daf0ad53183be69eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_182a5f45684d451daf0ad53183be69eb", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:48:40.180895 n-d-843621-1 devstack@n-api.service[103849]: X-Tenant: admin May 27 14:48:40.180895 n-d-843621-1 devstack@n-api.service[103849]: X-Tenant-Id: 182a5f45684d451daf0ad53183be69eb May 27 14:48:40.180895 n-d-843621-1 devstack@n-api.service[103849]: X-Tenant-Name: admin May 27 14:48:40.180895 n-d-843621-1 devstack@n-api.service[103849]: X-User: admin May 27 14:48:40.180895 n-d-843621-1 devstack@n-api.service[103849]: X-User-Domain-Id: default May 27 14:48:40.180895 n-d-843621-1 devstack@n-api.service[103849]: X-User-Domain-Name: Default May 27 14:48:40.180895 n-d-843621-1 devstack@n-api.service[103849]: X-User-Id: 3d7e94b1e9764a2eb614ea180d924a78 May 27 14:48:40.180895 n-d-843621-1 devstack@n-api.service[103849]: X-User-Name: admin May 27 14:48:40.180895 n-d-843621-1 devstack@n-api.service[103849]: method: > May 27 14:48:40.180895 n-d-843621-1 devstack@n-api.service[103849]: exception: Flavor 451 could not be found. May 27 14:48:40.180895 n-d-843621-1 devstack@n-api.service[103849]: action_args: {'id': '451'} May 27 14:48:40.180895 n-d-843621-1 devstack@n-api.service[103849]: {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:48:40.180895 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:48:40.181819 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 14:48:40.181819 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 14:48:40.181819 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 14:48:40.181819 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 14:48:40.181819 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:48:40.181819 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:48:40.181819 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 14:48:40.181819 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 14:48:40.181819 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 14:48:40.181819 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:48:40.181819 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 14:48:40.181819 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 14:48:40.181819 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 27 14:48:40.181819 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi May 27 14:48:40.181819 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:48:40.181819 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi May 27 14:48:40.181819 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:48:40.181819 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:48:40.181819 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:48:40.183124 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:48:40.183124 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:48:40.183124 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:48:40.183124 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:48:40.183124 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 14:48:40.183124 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 14:48:40.183124 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 27 14:48:40.183124 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi May 27 14:48:40.183124 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:48:40.183124 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi May 27 14:48:40.183124 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:48:40.183124 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:48:40.183124 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:48:40.183124 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:48:40.183124 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:48:40.183124 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 27 14:48:40.183124 n-d-843621-1 devstack@n-api.service[103849]: ERROR nova.api.openstack.wsgi May 27 14:48:40.183124 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-83a703ba-e25a-435e-8e4d-3bcacb5ef92d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:48:40.184318 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-83a703ba-e25a-435e-8e4d-3bcacb5ef92d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011447 May 27 14:48:40.184318 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 14:48:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 14:48:41.050161 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-b4dcdc6d-ae38-4aa0-98c1-df1ee4056099 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:41.051161 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-b4dcdc6d-ae38-4aa0-98c1-df1ee4056099 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 27 14:48:41.051548 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 14:48:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:48:41.237286 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-d0cb41c7-ca50-4745-b1b7-52e7a235d981 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:48:41.254317 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-d0cb41c7-ca50-4745-b1b7-52e7a235d981 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068579 May 27 14:48:41.254840 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1235 bytes} [Fri May 27 14:48:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:48:42.124736 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-b4dcdc6d-ae38-4aa0-98c1-df1ee4056099 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:42.126497 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-b4dcdc6d-ae38-4aa0-98c1-df1ee4056099 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002221 May 27 14:48:42.126884 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 14:48:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:48:42.315379 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-872cbbaf-6454-4d87-81a6-a4ea4ef6670f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:48:42.332623 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-872cbbaf-6454-4d87-81a6-a4ea4ef6670f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069115 May 27 14:48:42.333423 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1235 bytes} [Fri May 27 14:48:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:48:43.198239 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-b4dcdc6d-ae38-4aa0-98c1-df1ee4056099 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:43.199241 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-b4dcdc6d-ae38-4aa0-98c1-df1ee4056099 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 27 14:48:43.199625 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 14:48:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:48:43.388648 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-9cf6a43a-e369-44a0-a19a-f41d68662366 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:48:43.406667 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-9cf6a43a-e369-44a0-a19a-f41d68662366 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071163 May 27 14:48:43.407206 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1235 bytes} [Fri May 27 14:48:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 14:48:44.271867 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-b4dcdc6d-ae38-4aa0-98c1-df1ee4056099 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:44.272928 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-b4dcdc6d-ae38-4aa0-98c1-df1ee4056099 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 27 14:48:44.273312 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 14:48:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:48:44.461940 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-972ecd2e-4621-4b35-9d19-10e3fed217c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:48:44.479474 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-972ecd2e-4621-4b35-9d19-10e3fed217c9 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068910 May 27 14:48:44.480006 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1235 bytes} [Fri May 27 14:48:44 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:48:45.350761 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-b4dcdc6d-ae38-4aa0-98c1-df1ee4056099 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:45.351777 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-b4dcdc6d-ae38-4aa0-98c1-df1ee4056099 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001906 May 27 14:48:45.352183 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 14:48:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:48:45.541761 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-cf79c711-eb11-4dd5-af22-988e80548934 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:48:45.560374 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-cf79c711-eb11-4dd5-af22-988e80548934 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070023 May 27 14:48:45.560925 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1202 bytes} [Fri May 27 14:48:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:49:47.847065 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-b4dcdc6d-ae38-4aa0-98c1-df1ee4056099 admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:49:47.848060 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-b4dcdc6d-ae38-4aa0-98c1-df1ee4056099 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 May 27 14:49:47.848473 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 930 bytes} [Fri May 27 14:49:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:49:47.855779 n-d-843621-1 devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:49:47.908466 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-7fd93484-a083-40f5-aed4-4c94b1cb76d4 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:49:47.928877 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-7fd93484-a083-40f5-aed4-4c94b1cb76d4 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074484 May 27 14:49:47.929406 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1291 bytes} [Fri May 27 14:49:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:49:47.949972 n-d-843621-1 devstack@n-api.service[103850]: DEBUG dbcounter [-] [103850] Writing DB stats nova_api:SELECT=14 {{(pid=103850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:49:47.953812 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-a576a8b4-430d-4d23-afbd-3461fabc1c6a admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:49:47.961406 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-a576a8b4-430d-4d23-afbd-3461fabc1c6a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012868 May 27 14:49:47.961906 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1282 bytes} [Fri May 27 14:49:47 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:49:47.973583 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-6125609c-96d0-427e-9fbb-eb8970e431ec admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:49:47.981035 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-6125609c-96d0-427e-9fbb-eb8970e431ec admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010933 May 27 14:49:47.981541 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1285 bytes} [Fri May 27 14:49:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:49:47.993201 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-b0fe2144-c1a9-43fc-9510-e6153e95854f admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:49:48.000782 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-b0fe2144-c1a9-43fc-9510-e6153e95854f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011039 May 27 14:49:48.001320 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1285 bytes} [Fri May 27 14:49:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:49:48.014010 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-eac253b5-d600-4008-b06a-82785e29eace admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:49:48.021557 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-eac253b5-d600-4008-b06a-82785e29eace admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011147 May 27 14:49:48.022064 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1282 bytes} [Fri May 27 14:49:48 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:55:34.973847 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-b0fe2144-c1a9-43fc-9510-e6153e95854f admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:55:34.974859 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-b0fe2144-c1a9-43fc-9510-e6153e95854f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 27 14:55:34.975250 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 14:55:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:55:35.130706 n-d-843621-1 devstack@n-api.service[103849]: DEBUG dbcounter [-] [103849] Writing DB stats nova_api:SELECT=6 {{(pid=103849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:55:35.245017 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-c1f639e8-d747-47e8-948f-14cd6c13ab8e admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:55:35.246797 n-d-843621-1 devstack@n-api.service[103849]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:55:35.246797 n-d-843621-1 devstack@n-api.service[103849]: warnings.warn(msg) May 27 14:55:35.248014 n-d-843621-1 devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-c1f639e8-d747-47e8-948f-14cd6c13ab8e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:55:35.248450 n-d-843621-1 devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-c1f639e8-d747-47e8-948f-14cd6c13ab8e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:55:35.249248 n-d-843621-1 devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-c1f639e8-d747-47e8-948f-14cd6c13ab8e admin admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:55:35.249675 n-d-843621-1 devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-c1f639e8-d747-47e8-948f-14cd6c13ab8e admin admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:55:35.289401 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-c1f639e8-d747-47e8-948f-14cd6c13ab8e admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.160060 May 27 14:55:35.289946 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 36/70] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 14:55:35 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:55:36.161096 n-d-843621-1 devstack@n-api.service[103850]: DEBUG nova.api.openstack.wsgi [None req-b0fe2144-c1a9-43fc-9510-e6153e95854f admin admin] Calling method '>' {{(pid=103850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:55:36.162102 n-d-843621-1 devstack@n-api.service[103850]: INFO nova.api.openstack.requestlog [None req-b0fe2144-c1a9-43fc-9510-e6153e95854f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 27 14:55:36.162495 n-d-843621-1 devstack@n-api.service[103850]: [pid: 103850|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1074 bytes} [Fri May 27 14:55:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:55:36.353135 n-d-843621-1 devstack@n-api.service[103849]: DEBUG nova.api.openstack.wsgi [None req-9ef0e551-4fd5-4663-a0fc-00c225cab9e0 admin admin] Calling method '>' {{(pid=103849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:55:36.354451 n-d-843621-1 devstack@n-api.service[103849]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:55:36.354451 n-d-843621-1 devstack@n-api.service[103849]: warnings.warn(msg) May 27 14:55:36.355767 n-d-843621-1 devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-9ef0e551-4fd5-4663-a0fc-00c225cab9e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:55:36.356518 n-d-843621-1 devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-9ef0e551-4fd5-4663-a0fc-00c225cab9e0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:55:36.357874 n-d-843621-1 devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-9ef0e551-4fd5-4663-a0fc-00c225cab9e0 admin admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:55:36.358649 n-d-843621-1 devstack@n-api.service[103849]: DEBUG oslo_concurrency.lockutils [None req-9ef0e551-4fd5-4663-a0fc-00c225cab9e0 admin admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:55:36.383832 n-d-843621-1 devstack@n-api.service[103849]: INFO nova.api.openstack.requestlog [None req-9ef0e551-4fd5-4663-a0fc-00c225cab9e0 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.082489 May 27 14:55:36.384323 n-d-843621-1 devstack@n-api.service[103849]: [pid: 103849|app: 0|req: 37/72] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 14:55:36 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:56:23.611959 n-d-843621-1 systemd[1]: Stopping Devstack devstack@n-api.service... May 27 14:56:23.612501 n-d-843621-1 devstack@n-api.service[103848]: Fri May 27 14:56:23 2022 - graceful shutdown triggered... May 27 14:56:23.612993 n-d-843621-1 devstack@n-api.service[103850]: Gracefully killing worker 2 (pid: 103850)... May 27 14:56:23.613353 n-d-843621-1 devstack@n-api.service[103849]: Gracefully killing worker 1 (pid: 103849)... May 27 14:56:24.613514 n-d-843621-1 devstack@n-api.service[103848]: worker 1 buried after 1 seconds May 27 14:56:24.613514 n-d-843621-1 devstack@n-api.service[103848]: worker 2 buried after 1 seconds May 27 14:56:24.613514 n-d-843621-1 devstack@n-api.service[103848]: goodbye to uWSGI. May 27 14:56:24.615032 n-d-843621-1 systemd[1]: devstack@n-api.service: Succeeded. May 27 14:56:24.615621 n-d-843621-1 systemd[1]: Stopped Devstack devstack@n-api.service. May 27 14:56:24.618402 n-d-843621-1 systemd[1]: Starting Devstack devstack@n-api.service... May 27 14:56:24.636284 n-d-843621-1 devstack@n-api.service[119234]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 14:56:24.654948 n-d-843621-1 devstack@n-api.service[119234]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 14:56:24 2022] *** May 27 14:56:24.654948 n-d-843621-1 devstack@n-api.service[119234]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 14:56:24.654948 n-d-843621-1 devstack@n-api.service[119234]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 14:56:24.654948 n-d-843621-1 devstack@n-api.service[119234]: nodename: n-d-843621-1 May 27 14:56:24.654948 n-d-843621-1 devstack@n-api.service[119234]: machine: x86_64 May 27 14:56:24.654948 n-d-843621-1 devstack@n-api.service[119234]: clock source: unix May 27 14:56:24.654948 n-d-843621-1 devstack@n-api.service[119234]: pcre jit disabled May 27 14:56:24.654948 n-d-843621-1 devstack@n-api.service[119234]: detected number of CPU cores: 4 May 27 14:56:24.654948 n-d-843621-1 devstack@n-api.service[119234]: current working directory: / May 27 14:56:24.654948 n-d-843621-1 devstack@n-api.service[119234]: detected binary path: /usr/bin/uwsgi-core May 27 14:56:24.654948 n-d-843621-1 devstack@n-api.service[119234]: your processes number limit is 47680 May 27 14:56:24.654948 n-d-843621-1 devstack@n-api.service[119234]: your memory page size is 4096 bytes May 27 14:56:24.654948 n-d-843621-1 devstack@n-api.service[119234]: detected max file descriptor number: 2048 May 27 14:56:24.656061 n-d-843621-1 devstack@n-api.service[119234]: lock engine: pthread robust mutexes May 27 14:56:24.656061 n-d-843621-1 devstack@n-api.service[119234]: thunder lock: enabled May 27 14:56:24.656061 n-d-843621-1 devstack@n-api.service[119234]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 14:56:24.656061 n-d-843621-1 devstack@n-api.service[119234]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 14:56:24.703390 n-d-843621-1 devstack@n-api.service[119234]: Python main interpreter initialized at 0x55c1c03f29c0 May 27 14:56:24.703390 n-d-843621-1 devstack@n-api.service[119234]: python threads support enabled May 27 14:56:24.703390 n-d-843621-1 devstack@n-api.service[119234]: your server socket listen backlog is limited to 100 connections May 27 14:56:24.703390 n-d-843621-1 devstack@n-api.service[119234]: your mercy for graceful operations on workers is 90 seconds May 27 14:56:24.703838 n-d-843621-1 devstack@n-api.service[119234]: mapped 403077 bytes (393 KB) for 2 cores May 27 14:56:24.703838 n-d-843621-1 devstack@n-api.service[119234]: *** Operational MODE: preforking *** May 27 14:56:24.704103 n-d-843621-1 devstack@n-api.service[119234]: *** uWSGI is running in multiple interpreter mode *** May 27 14:56:24.704103 n-d-843621-1 devstack@n-api.service[119234]: spawned uWSGI master process (pid: 119234) May 27 14:56:24.704309 n-d-843621-1 systemd[1]: Started Devstack devstack@n-api.service. May 27 14:56:24.704974 n-d-843621-1 devstack@n-api.service[119234]: spawned uWSGI worker 1 (pid: 119248, cores: 1) May 27 14:56:24.705348 n-d-843621-1 devstack@n-api.service[119234]: spawned uWSGI worker 2 (pid: 119249, cores: 1) May 27 14:56:24.705506 n-d-843621-1 devstack@n-api.service[119234]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 14:56:25.911367 n-d-843621-1 devstack@n-api.service[119249]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 14:56:25.912358 n-d-843621-1 devstack@n-api.service[119248]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 14:56:26.710361 n-d-843621-1 devstack@n-api.service[119249]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 14:56:26.710361 n-d-843621-1 devstack@n-api.service[119249]: from cryptography.utils import int_from_bytes May 27 14:56:26.710693 n-d-843621-1 devstack@n-api.service[119249]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 14:56:26.710693 n-d-843621-1 devstack@n-api.service[119249]: from cryptography.utils import int_from_bytes May 27 14:56:26.718587 n-d-843621-1 devstack@n-api.service[119248]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 14:56:26.718587 n-d-843621-1 devstack@n-api.service[119248]: from cryptography.utils import int_from_bytes May 27 14:56:26.718923 n-d-843621-1 devstack@n-api.service[119248]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 14:56:26.718923 n-d-843621-1 devstack@n-api.service[119248]: from cryptography.utils import int_from_bytes May 27 14:56:29.174871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 14:56:29.175497 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 14:56:29.175662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 14:56:29.176027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 14:56:29.176314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 14:56:29.176702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.177037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.177370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.177695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.178031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.178344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.178671 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.178998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.179331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.179598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.179919 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.180249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-843621-1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.180576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.180924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.181242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.181566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.181876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.182202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.182516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.183034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.185723 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.186064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.186379 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.186736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.187067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.187405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.187727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.188045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.188379 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.188713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.189127 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-843621-1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.189455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.189778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.190099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.190521 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.190838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.191155 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.191254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 14:56:29.191653 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 14:56:29.191750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.191835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.191979 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 14:56:29.192097 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.192352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 14:56:29.192452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.192616 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 14:56:29.192755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.193053 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.193152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.193384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.193485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.193687 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.193784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.193994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.194084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.194313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.194425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.194633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.194737 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.194944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.195040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.195252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.195350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.195507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.195603 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.195818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.195915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.196142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.196244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.196467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.196563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-843621-1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.196816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.196930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.197075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.197183 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.197329 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.197431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.197656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.197757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.197978 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.198080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.198290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.198379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.198597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.198694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.199457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.199775 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.200088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.200468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.201069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.201495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.201870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.202475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.202910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.203228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.203426 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.203561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.203785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.203960 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.204129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.204236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.204479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.204600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.204870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.205051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.205212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.205382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.205544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.205755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.206030 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.206128 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.206360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.206633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.206814 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.206972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.207265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.207370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.207596 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.207852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.207963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.208325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-843621-1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.208428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.208581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.208690 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.208911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.209010 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.209224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.209317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.209548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.209751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.209855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.210080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.210197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.210407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.210499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.210745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.210845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.211082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.211181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.211404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.211502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.211731 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.211821 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.212042 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.212134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.212354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.212443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.212725 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.212832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.213036 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.213321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.213413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.213663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.213819 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.214142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.214236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.214523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.215370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.215513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.215690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.216002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.216095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.216316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.216519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.216638 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.216969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.217157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.217282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.217639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.217737 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.217987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.218079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.218326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.218426 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.218593 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.218690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.218859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.218953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.219195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.219293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.219531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.219630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.219852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.219951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.220153 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.220251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.220462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.220554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.220809 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.220905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.221122 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.221216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.221432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.221523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.221741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.221845 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.222048 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.222140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.222356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.222454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.222664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.222768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.222971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.223069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.223278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.223379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.223580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.223699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.223905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.224016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.224226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.224326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.224540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.224657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.224876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.224979 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.225184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.225276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.225506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.225613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.225836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.225934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.226165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.226265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.226479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.226578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.226794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.226895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.227109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.227208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.227435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.227537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.227766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.227897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.228079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.228219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.228323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.228542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.228644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.228900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.229003 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.229220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.229313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.229540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.229639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.229859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.229950 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.230195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.230285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.230511 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.230610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.230843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.231150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.231255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.231471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.231571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.231786 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.231884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.232098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.232204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.232411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.232509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.232750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.232902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.233068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.233174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.233381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.233516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.233692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.233793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.234018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.234180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.234348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.234506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.234649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.234840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.234961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.235174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.235278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.235490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.235642 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.235808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.235907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.236376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.236474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.236741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.236862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.237077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.237235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.237388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.237643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.237816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.238016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.238141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.238330 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.238614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.238717 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.238955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.239053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.239265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.239356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.239583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.239684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.239908 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.239999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.240221 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.240318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.240533 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.240755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.240867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.240951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.241167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.241260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.241478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.241608 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.241790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.242091 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.242237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.242398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.242561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.242693 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.243017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.243121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.243332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.243430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.243644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.243735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.243957 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.244048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.244264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.244373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.244577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.244709 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 14:56:29.244931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.245027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.245268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.245372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.245614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.245777 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.245964 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.246140 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.246307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.246508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.246646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.246863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.246963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.247280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.247370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.247606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.247739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.247940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.248072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.248262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.248357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.248584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.248748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.248944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.249037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.249274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.249368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.249601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.249702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.249926 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.250027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.250252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.250344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.250579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.250741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.250905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.251200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.251291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.251538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.251706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.251877 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.252036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.252206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.252361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.252525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.252729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.252900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.253029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.253254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.253349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.253578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.253682 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.253914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.254009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.254245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.254336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.254566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.254667 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.254889 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.254989 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.255210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.255326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.255543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.255665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.255875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.255973 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.256192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.256284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.256511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.256610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.256851 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.256944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.257167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.257267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.257479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.257572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.257795 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.257884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.258109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.258206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.258421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.258521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.258733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.258831 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.259044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.259145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.259354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.259447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.259686 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.259784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.260003 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.260102 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.260313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.260410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.260626 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.260745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.260961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.261068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.261271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.261890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.262135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.262227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.262455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.262560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.262771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.262871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.263103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.263202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.263438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.263540 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.263751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.263842 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.264069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.264162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.264388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.264488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.264722 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.264817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.265041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.265139 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.265357 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.265458 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.265673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.265785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.265984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.266081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.266319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.266408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.266602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.266695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.266928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.267033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.267242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.267348 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.267580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.267687 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.267882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.267988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.268193 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.268284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.268507 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.268598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.268858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.268966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.269180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.269283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.269501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.269601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.269815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.269915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.270133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.270232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.270446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.270543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.270764 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.270864 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.271083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.271181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.271401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.271499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.271726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.271828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.272043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.272141 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.272369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.272461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.272699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.272807 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.273033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.273126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.273345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.273489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.273666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.273760 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.273976 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.274111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.274289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.274380 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.274603 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.274695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.274923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.275022 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.275237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.275374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.275551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.275728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.275868 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.276004 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.276182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.276296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.276491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.276582 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.276838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.276943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.277710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.277821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.278028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.278121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.278395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.278487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.278710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.278812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.279063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.279198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.279378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.279478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.279687 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.279788 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.280009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.280101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.280326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.280425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.280639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.280782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.280976 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.281069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.281295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.281398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.281625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.281718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.281942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.282041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.282258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.282357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.282578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.282683 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.282888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.282978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.283199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.283298 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.283527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.283626 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.283840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.283942 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.284151 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.284258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.284460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.284557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.284794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.284891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.285110 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.285216 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.285436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.285528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.285744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.285834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.286068 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.286189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.286391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.286492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.286708 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.286810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.287029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.287136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.287348 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.287447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.287663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.287754 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.287984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.288083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.288300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.288389 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.288615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.288747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.288957 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.289058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.289273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.289365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.289586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.289676 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.289902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.289995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.290230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.290328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.290542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.290632 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.290859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.290957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.291169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.291295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.291475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.291566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.291790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.291882 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.292113 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.292203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.292440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.292762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.292861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.293103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.293196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.293425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.293517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.293740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.293833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.294060 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.294158 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.294376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.294482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.294690 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.294833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.295010 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.295151 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.295340 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.295443 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.295650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.295817 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.295966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.296093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.296274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.296366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.296585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.296691 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.296924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.297034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.297235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.297332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.297544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.297633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.297859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.297964 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.298176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.298275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.298488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.298592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.298801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.298893 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.299111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.299203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.299423 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.299518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.299733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.299831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.300040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.300138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.300358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.300449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.300723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.300830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.301007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.301099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.301321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.301421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.301634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.301725 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.301944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.302034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.302253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.302366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.302582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.302673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.302902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.302990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.303219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.303323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.303543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.303642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.303863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.303956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.304180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.304289 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.304488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.304589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.304852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.305162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.305335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.305454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.305662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.305866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.305987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.306188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.306327 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.306505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.306598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.306813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.306950 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.307131 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.307237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.307445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.307546 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.307761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.307854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.308084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.308189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.308437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.308529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.308806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.308903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.309192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.309293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.309538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.309770 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.309861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.310112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.310218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.310437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.310556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.310754 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.310893 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.311070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.311178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.311382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.311474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.311700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.311792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.312008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.312112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.312328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.312428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.312640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.312771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.312974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.313067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.313284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.313384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.313595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.313686 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.313908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.314013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.314215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.314316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.314528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.314630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.314840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.314947 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.315150 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.315276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.315457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.315611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.315767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.315860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.316073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.316173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.316383 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.316476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.316718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.316813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.317035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.317177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.317354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.317453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.317661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.317753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.317982 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.318083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.318293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.318393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.318603 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.318695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.318910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.319011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.319220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.319319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.319524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.319660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.319831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.319933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.320139 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.320232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.320447 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.320540 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.320778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.320873 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.321106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.321208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.321421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.321513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.321731 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.321832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.322040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.322139 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.322348 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.322449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.322695 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.322786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.323004 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.323105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.323320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.323420 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.323633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.323725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.324474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.324578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.324818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.324932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.325136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.325283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.325452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.325596 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.325767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.325873 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.326076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.326168 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.326385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.326520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.326689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.326784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.326995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.327095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.327304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.327397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.327612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.327711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.327930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.328023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.328243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.328339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.328551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.328653 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.328896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.328993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.329206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.329299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.329530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.329675 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.329837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.329928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.330145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.330250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.330457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.330557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.330768 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.330865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.331083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.331183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.331394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.331493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.331713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.331812 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.332027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.332135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.332339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.332439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.332651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.332784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.332987 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.333093 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.333296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.333397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.333606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.333703 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.333919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.334027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.334225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.334317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.334554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.334653 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.334868 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.334998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.335171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.335309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.335990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.335990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.336171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.336388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.336657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.336805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.337014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.337123 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.337332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.337439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.337643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.337749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.337953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.338094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.338284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.338423 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.338587 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.338788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.338900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.339139 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.339228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.339368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.339570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.340249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.340427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.340579 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.340785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.340929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.341155 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.341247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.341473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.341661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.341799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.341982 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.342126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.342302 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.342446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.342622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.342764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.342934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.343087 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.343248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.343399 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.343568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.343721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.343900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.344040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.344213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.344362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.344526 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.344735 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.344864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.344996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.345316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.345422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.345633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.345730 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.345964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.346065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.346318 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.346412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.346649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.346795 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.346982 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.347082 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.347295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.347387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.347613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.347712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.347933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.348024 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.348248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.348350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.348568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.348687 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.348923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.349017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.349244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.349350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.349565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.349657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.349886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.349986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.350207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.350346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.350526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.350655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.350841 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.350968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.351161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.351288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.351471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.351590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.351782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.351900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.352115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.352248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.352432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.352566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.352766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.352899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.353086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.353207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.353398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.353518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.353714 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.353842 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.354024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.354152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.354451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.354568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.354767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.354906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.355099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.355454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.355586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.355754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.355874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.356073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.356223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.356400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.356518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.356797 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.356953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.357083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.357198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.357414 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.357612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.357747 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.357872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.358035 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.358155 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.358369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.358492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.358678 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.358808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.358986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.359112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.359305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.359468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.359631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.359757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.359940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.360066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.360315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.360443 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.360597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.360732 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.360898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.361027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.361460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.361620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.361783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.361927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.362565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.362715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.362814 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.362914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.363000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.363084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.363167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.363251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.363352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.363527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.363630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.363846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.363947 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.364177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.364281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.364509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.364610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.364869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.364964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.365186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.365301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.365510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.365603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.365832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.365925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.366157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.366249 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.366468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.366573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.366777 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.366982 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.367135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.367234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.367394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.367504 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.367691 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.367794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.368000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.368094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.368317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.368416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.368625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.368749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.368958 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.369077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.369266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.369408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.369591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.369726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.369900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.370060 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.370226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.370396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.370541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.370723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.370879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.371047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.371191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.371367 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.371499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.371682 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.371844 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.371998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.372153 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.372331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.372491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.372645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.372841 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.372987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.373167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.373306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.373500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.373626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.373817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.373938 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.374147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.374247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.374470 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.374564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.374794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.374888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.375116 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.375219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.375436 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.375531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.375756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.375895 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.376078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.376179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.376398 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.376499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.376733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.376832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.377060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.377212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.377369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.377474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.377683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.377785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.377996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.378243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.378341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.378581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.378681 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.378904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.379005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.379223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.379317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.379542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.379674 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.379860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.379953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.380178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.380272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.380495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.380595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.380835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.380942 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.381154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.381254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.381470 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.381563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.381803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.381903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.382115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.382208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.382435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.382566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.382750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.382858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.383062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.383162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.383375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.383467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.383690 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.383818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.383999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.384119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.384310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.384405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.384621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.384745 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.384975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.385069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.385287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.385386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.385606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.385705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.385924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.386020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.386234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.386931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.387086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.387172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.387392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.387496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.387702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.387808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.388021 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.388113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.388338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.388439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.388657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.388821 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.389003 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.389104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.389334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.389427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.389650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.389753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.389985 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.390078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.390300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.390392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.390619 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.390720 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.390938 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.391037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.391261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.391456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.391585 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.391776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.391909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.392115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.392233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.392445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.392546 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.392808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.392916 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.393134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.393234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.393456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.393550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.393790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.394043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.394142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.394381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.394483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.394701 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.394799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.395018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.395111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.395330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.395432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.395647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.395746 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.395960 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.396058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.396268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.396374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.396585 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.396722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.396922 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.397049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.397237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.397466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.397597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.397817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.397926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.398142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.398255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.398474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.398566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.398807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.398909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.399131 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.399233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.399444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.399537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.399773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.399872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.400082 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.400173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.400393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.400484 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.400731 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.400842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.401069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.401210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.401361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.401466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.401673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.401772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.402037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.402620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.402849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.402933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.403157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.403248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.403475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.403564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.403785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.403888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.404101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.404207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.404415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.404550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.404748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.404844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.405060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.405167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.405377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.405477 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.405686 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.406033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.406138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.406352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.406456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.406751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.406842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.407074 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.407212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.407383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.407612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.407726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.407992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.408309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.408521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.408627 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.408909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.409012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.409250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.409343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.409588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.409689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.409910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.410008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.410220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.410324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.410542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.410633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.410858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.410957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.411169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.411272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.411490 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.411583 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.411803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.411903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.412116 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.412215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.412447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.412540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.412791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.413014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.413107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.413359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.413453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.413690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.413828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.414032 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.414258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.414373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.414618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.414710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.414949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.415041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.415287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.415381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.415614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.415712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.415936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.416028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.416255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.416347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.416570 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.416696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.416913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.417017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.417227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.417319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.417609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.417774 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.417877 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.418037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.418188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.418281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.418502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.418602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.418819 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.418920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.419137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.419254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.419452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.419592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.419762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.419906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.420078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.420377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.420475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.420731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.420842 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.421048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.421143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.421363 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.421464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.421683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.421784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.421996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.422095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.422308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.422403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.422621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.422726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.422928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.423027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.423239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.423338 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.423549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.423653 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.423869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.423965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.424181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.424274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.424490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.424582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.424823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.424980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.425143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.425236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.425508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.425603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.425842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.425942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.426161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.426254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.426478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.426571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.426803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.426894 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.427118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.427218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.427450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.427583 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.427836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.427929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.428078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.428215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.428431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.428563 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.428783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.428930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.429263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.429374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.429577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.429671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.429888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.429980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.430199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.430304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.430513 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.430614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.430837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.430938 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.431153 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.431254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.431461 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.431555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.431771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.431870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.432085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.432186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.432396 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.432496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.432723 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.432820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.433038 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.433133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.433376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.433478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.433693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.433796 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.434002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.434132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.434313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.434443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.434621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.434724 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.434929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.435033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.435238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.435331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.435546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.435653 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.435862 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.435954 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.436167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.436265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.436475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.436576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.436809 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.436919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.437119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.437212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.437426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.437565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.437761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.437974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.438098 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.438189 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.438415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.438512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.438732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.438832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.439050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.439150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.439369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.439461 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.439680 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.439777 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.440007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.440109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.440317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.440408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.440638 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.440765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.440973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.441076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.441310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.441412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.441624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.441717 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.441938 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.442039 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.442252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.442352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.442566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.442666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.442880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.442986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.443193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.443287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.443522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.443621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.443851 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.443979 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.444161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.444255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.444490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.444597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.444835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.444989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.445163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.445255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.445473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.445577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.445786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.445877 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.446108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.446199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.446421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.446522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.446737 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.446843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.447049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.447148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.447361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.447530 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.447676 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.447802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.448016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.448130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.448288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.448397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.448601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.448731 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.449466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.449565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.449785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.449887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.450099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.450191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.450411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.450502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.450723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.450823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.451034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.451135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.451345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.451446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.451656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.451756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.451972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.452070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.452282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.452382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.452594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.452719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.452870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119249) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 14:56:29.452973 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.453228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.453540 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.453880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.454219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.454541 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.454875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.455196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.455526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.455844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.456175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.456508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.456859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.457180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.457522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.457841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.458165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.458480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.459185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.459515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.459838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.460176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.460513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.460855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.461192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.461521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.461852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.462179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.462501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.462842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.463162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.463481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.463806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.464218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.464450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.465444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.465776 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.466112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.466447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.466772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.467107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.467463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.468294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.468494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.469045 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.469388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.469717 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.470041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.470358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 14:56:29.470611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119248) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 14:56:29.514173 n-d-843621-1 devstack@n-api.service[119249]: INFO dbcounter [None req-f21c1145-5669-4787-ba85-f515e61d0725 None None] Registered counter for database nova_api May 27 14:56:29.531600 n-d-843621-1 devstack@n-api.service[119248]: INFO dbcounter [None req-bdd66456-eea8-4959-959c-0725cf2df547 None None] Registered counter for database nova_api May 27 14:56:29.535557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_db.sqlalchemy.engines [None req-f21c1145-5669-4787-ba85-f515e61d0725 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119249) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 14:56:29.544037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writer thread running {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 14:56:29.551588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_db.sqlalchemy.engines [None req-bdd66456-eea8-4959-959c-0725cf2df547 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119248) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 14:56:29.559512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writer thread running {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 14:56:29.600375 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.context [None req-f21c1145-5669-4787-ba85-f515e61d0725 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57e0886a-3e0a-4a65-b585-e8d63742d44b(cell1) {{(pid=119249) load_cells /opt/stack/nova/nova/context.py:464}} May 27 14:56:29.604556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f21c1145-5669-4787-ba85-f515e61d0725 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:56:29.606193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f21c1145-5669-4787-ba85-f515e61d0725 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:56:29.606996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f21c1145-5669-4787-ba85-f515e61d0725 None None] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:56:29.609076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f21c1145-5669-4787-ba85-f515e61d0725 None None] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:56:29.611066 n-d-843621-1 devstack@n-api.service[119249]: INFO dbcounter [None req-f21c1145-5669-4787-ba85-f515e61d0725 None None] Registered counter for database nova_cell0 May 27 14:56:29.615527 n-d-843621-1 devstack@n-api.service[119249]: INFO dbcounter [None req-f21c1145-5669-4787-ba85-f515e61d0725 None None] Registered counter for database nova_cell1 May 27 14:56:29.615852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.context [None req-bdd66456-eea8-4959-959c-0725cf2df547 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57e0886a-3e0a-4a65-b585-e8d63742d44b(cell1) {{(pid=119248) load_cells /opt/stack/nova/nova/context.py:464}} May 27 14:56:29.620067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bdd66456-eea8-4959-959c-0725cf2df547 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:56:29.624191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bdd66456-eea8-4959-959c-0725cf2df547 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:56:29.624349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_db.sqlalchemy.engines [None req-f21c1145-5669-4787-ba85-f515e61d0725 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119249) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 14:56:29.624450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bdd66456-eea8-4959-959c-0725cf2df547 None None] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:56:29.625217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bdd66456-eea8-4959-959c-0725cf2df547 None None] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:56:29.625386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_db.sqlalchemy.engines [None req-f21c1145-5669-4787-ba85-f515e61d0725 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119249) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 14:56:29.627247 n-d-843621-1 devstack@n-api.service[119248]: INFO dbcounter [None req-bdd66456-eea8-4959-959c-0725cf2df547 None None] Registered counter for database nova_cell0 May 27 14:56:29.630587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writer thread running {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 14:56:29.631354 n-d-843621-1 devstack@n-api.service[119248]: INFO dbcounter [None req-bdd66456-eea8-4959-959c-0725cf2df547 None None] Registered counter for database nova_cell1 May 27 14:56:29.633187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writer thread running {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 14:56:29.639290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_db.sqlalchemy.engines [None req-bdd66456-eea8-4959-959c-0725cf2df547 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119248) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 14:56:29.641165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_db.sqlalchemy.engines [None req-bdd66456-eea8-4959-959c-0725cf2df547 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119248) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 14:56:29.648069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writer thread running {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 14:56:29.648440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writer thread running {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 14:56:29.780910 n-d-843621-1 devstack@n-api.service[119249]: INFO dbcounter [None req-f21c1145-5669-4787-ba85-f515e61d0725 None None] Registered counter for database nova_cell0 May 27 14:56:29.787948 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_db.sqlalchemy.engines [None req-f21c1145-5669-4787-ba85-f515e61d0725 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119249) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 14:56:29.792567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writer thread running {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 14:56:29.795585 n-d-843621-1 devstack@n-api.service[119248]: INFO dbcounter [None req-bdd66456-eea8-4959-959c-0725cf2df547 None None] Registered counter for database nova_cell0 May 27 14:56:29.802517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_db.sqlalchemy.engines [None req-bdd66456-eea8-4959-959c-0725cf2df547 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119248) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 14:56:29.807062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writer thread running {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 14:56:30.113545 n-d-843621-1 devstack@n-api.service[119249]: WARNING keystonemiddleware.auth_token [None req-f21c1145-5669-4787-ba85-f515e61d0725 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 14:56:30.121564 n-d-843621-1 devstack@n-api.service[119249]: WARNING keystonemiddleware.auth_token [None req-f21c1145-5669-4787-ba85-f515e61d0725 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 14:56:30.129168 n-d-843621-1 devstack@n-api.service[119248]: WARNING keystonemiddleware.auth_token [None req-bdd66456-eea8-4959-959c-0725cf2df547 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 14:56:30.137423 n-d-843621-1 devstack@n-api.service[119248]: WARNING keystonemiddleware.auth_token [None req-bdd66456-eea8-4959-959c-0725cf2df547 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 14:56:30.472696 n-d-843621-1 devstack@n-api.service[119249]: WARNING keystonemiddleware.auth_token [None req-f21c1145-5669-4787-ba85-f515e61d0725 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 14:56:30.478754 n-d-843621-1 devstack@n-api.service[119249]: WARNING keystonemiddleware.auth_token [None req-f21c1145-5669-4787-ba85-f515e61d0725 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 14:56:30.484166 n-d-843621-1 devstack@n-api.service[119249]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c1c03f29c0 pid: 119249 (default app) May 27 14:56:30.485387 n-d-843621-1 devstack@n-api.service[119248]: WARNING keystonemiddleware.auth_token [None req-bdd66456-eea8-4959-959c-0725cf2df547 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 14:56:30.491616 n-d-843621-1 devstack@n-api.service[119248]: WARNING keystonemiddleware.auth_token [None req-bdd66456-eea8-4959-959c-0725cf2df547 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 14:56:30.497484 n-d-843621-1 devstack@n-api.service[119248]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c1c03f29c0 pid: 119248 (default app) May 27 14:57:15.307668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:15.308620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:15.309605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:15.310658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:16.594195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:16.595846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:16.597500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:16.598684 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:16.750247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a91f3978-eb1f-4e3d-b407-09b3d86681b9 tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-141020462", "ram": 512, "vcpus": 1, "disk": 10, "id": 962418846, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:16.768869 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:16.768869 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:16.810854 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a91f3978-eb1f-4e3d-b407-09b3d86681b9 tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 1.513659 May 27 14:57:16.811486 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:57:15 2022] POST /compute/v2.1/flavors => generated 412 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:16.824357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e67abbec-edf9-484a-9c9c-ec3bf9a905df tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:16.826078 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:16.826078 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:16.873222 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e67abbec-edf9-484a-9c9c-ec3bf9a905df tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/962418846/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.053719 May 27 14:57:16.874761 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2/2] 10.222.0.13 () {60 vars in 1220 bytes} [Fri May 27 14:57:16 2022] POST /compute/v2.1/flavors/962418846/os-extra_specs => generated 66 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 14:57:17.414727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f0f15e97-b59d-4b9a-ae65-8f96239cf771 tempest-FlavorsExtraSpecsTestJSON-878884184 tempest-FlavorsExtraSpecsTestJSON-878884184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:17.438894 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f0f15e97-b59d-4b9a-ae65-8f96239cf771 tempest-FlavorsExtraSpecsTestJSON-878884184 tempest-FlavorsExtraSpecsTestJSON-878884184-project] 10.222.0.13 "GET /compute/v2.1/flavors/962418846/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.558126 May 27 14:57:17.439842 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3/3] 10.222.0.13 () {58 vars in 1199 bytes} [Fri May 27 14:57:16 2022] GET /compute/v2.1/flavors/962418846/os-extra_specs => generated 66 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 14:57:17.451807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3dd949e0-3814-40df-8b42-93c41a681971 tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:17.473397 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3dd949e0-3814-40df-8b42-93c41a681971 tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/962418846/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.025231 May 27 14:57:17.474146 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 4/4] 10.222.0.13 () {60 vars in 1220 bytes} [Fri May 27 14:57:17 2022] POST /compute/v2.1/flavors/962418846/os-extra_specs => generated 66 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 14:57:17.483384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6f2493ca-4d13-4d12-97d7-72b5b36b3100 tempest-FlavorsExtraSpecsTestJSON-878884184 tempest-FlavorsExtraSpecsTestJSON-878884184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:17.492584 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6f2493ca-4d13-4d12-97d7-72b5b36b3100 tempest-FlavorsExtraSpecsTestJSON-878884184 tempest-FlavorsExtraSpecsTestJSON-878884184-project] 10.222.0.13 "GET /compute/v2.1/flavors/962418846/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.013466 May 27 14:57:17.497989 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 5/5] 10.222.0.13 () {58 vars in 1241 bytes} [Fri May 27 14:57:17 2022] GET /compute/v2.1/flavors/962418846/os-extra_specs/hw:numa_nodes => generated 22 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 14:57:17.503031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0e789e5b-15d0-4991-91c7-cbf3642dec9e tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:17.528957 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0e789e5b-15d0-4991-91c7-cbf3642dec9e tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/962418846/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.029119 May 27 14:57:17.529537 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 6/6] 10.222.0.13 () {60 vars in 1220 bytes} [Fri May 27 14:57:17 2022] POST /compute/v2.1/flavors/962418846/os-extra_specs => generated 66 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 14:57:17.537913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bd36afa6-c7b8-4797-babb-b7d7688cb05a tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:17.548023 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bd36afa6-c7b8-4797-babb-b7d7688cb05a tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/962418846/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.013528 May 27 14:57:17.548970 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 7/7] 10.222.0.13 () {58 vars in 1199 bytes} [Fri May 27 14:57:17 2022] GET /compute/v2.1/flavors/962418846/os-extra_specs => generated 66 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 14:57:17.557398 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4ca47c32-4b60-4cbb-886d-185e1557bb1d tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:17.558594 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:17.558594 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:17.587449 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4ca47c32-4b60-4cbb-886d-185e1557bb1d tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/962418846/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.033467 May 27 14:57:17.588121 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 8/8] 10.222.0.13 () {60 vars in 1261 bytes} [Fri May 27 14:57:17 2022] PUT /compute/v2.1/flavors/962418846/os-extra_specs/hw:numa_nodes => generated 22 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 14:57:17.596908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-71105499-ef27-4ee6-b0a9-011290f685fb tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:17.609262 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-71105499-ef27-4ee6-b0a9-011290f685fb tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/962418846/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015643 May 27 14:57:17.609920 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 9/9] 10.222.0.13 () {58 vars in 1199 bytes} [Fri May 27 14:57:17 2022] GET /compute/v2.1/flavors/962418846/os-extra_specs => generated 66 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 14:57:17.618782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c3a3af15-5af1-49b7-b578-a3a32d2a04eb tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:17.619588 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:17.619588 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:17.646495 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c3a3af15-5af1-49b7-b578-a3a32d2a04eb tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/962418846/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.031042 May 27 14:57:17.647517 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 10/10] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 14:57:17 2022] DELETE /compute/v2.1/flavors/962418846/os-extra_specs/hw:numa_nodes => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 27 14:57:17.656359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c657a62c-4ba9-496c-9d76-93efb438cccd tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:17.677062 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c657a62c-4ba9-496c-9d76-93efb438cccd tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/962418846/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.024914 May 27 14:57:17.677955 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 11/11] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 14:57:17 2022] DELETE /compute/v2.1/flavors/962418846/os-extra_specs/hw:cpu_policy => generated 0 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 27 14:57:17.686798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b212bc45-a8ef-4a0f-bc99-2dd83e62f0a8 tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:17.694995 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b212bc45-a8ef-4a0f-bc99-2dd83e62f0a8 tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/962418846/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012708 May 27 14:57:17.695679 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 12/12] 10.222.0.13 () {58 vars in 1199 bytes} [Fri May 27 14:57:17 2022] GET /compute/v2.1/flavors/962418846/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 14:57:17.706034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6192bf75-c72d-41b9-ac67-0d58a16cfe26 tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:17.706799 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:17.706799 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:17.731262 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6192bf75-c72d-41b9-ac67-0d58a16cfe26 tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/962418846" status: 202 len: 0 microversion: 2.1 time: 0.029765 May 27 14:57:17.731833 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 13/13] 10.222.0.13 () {58 vars in 1157 bytes} [Fri May 27 14:57:17 2022] DELETE /compute/v2.1/flavors/962418846 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:57:17.741553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0660c26d-febd-43e6-b04a-4ca2c9d739d7 tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:17.769178 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0660c26d-febd-43e6-b04a-4ca2c9d739d7 tempest-FlavorsExtraSpecsTestJSON-575957410 tempest-FlavorsExtraSpecsTestJSON-575957410-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031193 May 27 14:57:17.773015 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 14/14] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:18.006095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d5977c38-9a43-4ab1-a667-ca627d56ad78 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] Calling method '.version_select at 0x7fc77d5cad30>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:18.008357 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:18.008357 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:18.014754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d5977c38-9a43-4ab1-a667-ca627d56ad78 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57e0886a-3e0a-4a65-b585-e8d63742d44b(cell1) {{(pid=119248) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 27 14:57:18.015687 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5977c38-9a43-4ab1-a667-ca627d56ad78 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:18.016197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5977c38-9a43-4ab1-a667-ca627d56ad78 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:18.041828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5977c38-9a43-4ab1-a667-ca627d56ad78 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:18.042283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5977c38-9a43-4ab1-a667-ca627d56ad78 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:18.055716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5977c38-9a43-4ab1-a667-ca627d56ad78 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:18.056169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5977c38-9a43-4ab1-a667-ca627d56ad78 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:18.064770 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d5977c38-9a43-4ab1-a667-ca627d56ad78 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.480295 May 27 14:57:18.065972 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1/15] 10.222.0.13 () {60 vars in 1207 bytes} [Fri May 27 14:57:16 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 14:57:18.084827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-27dc8ce0-45cc-4f4b-92b1-5895d631e7f4 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1948292132"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:18.102840 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:18.102840 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:18.103976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.aggregate [None req-27dc8ce0-45cc-4f4b-92b1-5895d631e7f4 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] Generated uuid 1f0ebe90-7084-4932-8bb9-c7507501488f for aggregate {{(pid=119248) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 27 14:57:18.167513 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-27dc8ce0-45cc-4f4b-92b1-5895d631e7f4 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.088147 May 27 14:57:18.168932 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2/16] 10.222.0.13 () {62 vars in 1204 bytes} [Fri May 27 14:57:18 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 14:57:18.178882 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0177d807-3e9f-4b89-b741-291c99fae2d2 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1796833988"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:18.253839 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:18.253839 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:18.298375 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0177d807-3e9f-4b89-b741-291c99fae2d2 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.123329 May 27 14:57:18.299600 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3/17] 10.222.0.13 () {62 vars in 1209 bytes} [Fri May 27 14:57:18 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 14:57:18.607283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-614ae49f-d580-4835-8c88-434904665cd4 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:18.608791 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:18.608791 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:18.610140 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-614ae49f-d580-4835-8c88-434904665cd4 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:18.610598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-614ae49f-d580-4835-8c88-434904665cd4 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:18.611649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-614ae49f-d580-4835-8c88-434904665cd4 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:18.612140 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-614ae49f-d580-4835-8c88-434904665cd4 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:18.654370 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-614ae49f-d580-4835-8c88-434904665cd4 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.698214 May 27 14:57:18.660989 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 15/18] 10.222.0.13 () {58 vars in 1175 bytes} [Fri May 27 14:57:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:18.665827 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f7ec93b1-1b7e-49ab-9de9-ef5dfa4a5391 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:18.667305 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:18.667305 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:18.682621 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f7ec93b1-1b7e-49ab-9de9-ef5dfa4a5391 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.019730 May 27 14:57:18.683497 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 16/19] 10.222.0.13 () {60 vars in 1189 bytes} [Fri May 27 14:57:18 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:57:18.723983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f1e61b71-366f-4642-8057-390965f12f1e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-643668164", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:18.819195 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-17b29fa8-47df-4e39-a9dd-12b7a4f2778c tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '.version_select at 0x7fc77d3ca700>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:18.820004 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:18.820004 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:18.827225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-17b29fa8-47df-4e39-a9dd-12b7a4f2778c tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57e0886a-3e0a-4a65-b585-e8d63742d44b(cell1) {{(pid=119249) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 27 14:57:18.828042 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17b29fa8-47df-4e39-a9dd-12b7a4f2778c tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:18.828492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17b29fa8-47df-4e39-a9dd-12b7a4f2778c tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:18.855055 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17b29fa8-47df-4e39-a9dd-12b7a4f2778c tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:18.855995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17b29fa8-47df-4e39-a9dd-12b7a4f2778c tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:18.872021 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17b29fa8-47df-4e39-a9dd-12b7a4f2778c tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:18.872444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17b29fa8-47df-4e39-a9dd-12b7a4f2778c tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:18.878640 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-17b29fa8-47df-4e39-a9dd-12b7a4f2778c tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.194179 May 27 14:57:18.879219 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 17/20] 10.222.0.13 () {58 vars in 1166 bytes} [Fri May 27 14:57:18 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:18.942286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-86b67519-5c03-4d36-885c-2f1d880cdc1d tempest-FlavorMetadataValidation-2006323447 tempest-FlavorMetadataValidation-2006323447-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-798134554", "id": 690839767, "os-flavor-access:is_public": "True"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:18.943820 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:18.943820 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:18.963540 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-86b67519-5c03-4d36-885c-2f1d880cdc1d tempest-FlavorMetadataValidation-2006323447 tempest-FlavorMetadataValidation-2006323447-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.083070 May 27 14:57:18.964196 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 18/21] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 27 14:57:18 2022] POST /compute/v2.1/flavors => generated 467 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:57:19.020455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-761798cb-8b9b-40d9-a045-d9bb8a9f12a5 tempest-FlavorsV255TestJSON-2035354519 tempest-FlavorsV255TestJSON-2035354519-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1005584192", "id": 1280471315, "os-flavor-access:is_public": "True"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:19.026914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=5,nova_api:SAVEPOINT=9,nova_api:RELEASE=9,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:19.046819 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-761798cb-8b9b-40d9-a045-d9bb8a9f12a5 tempest-FlavorsV255TestJSON-2035354519 tempest-FlavorsV255TestJSON-2035354519-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.081195 May 27 14:57:19.047894 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 19/22] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 27 14:57:18 2022] POST /compute/v2.1/flavors => generated 449 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:57:19.053387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-f1e61b71-366f-4642-8057-390965f12f1e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] validate_networks() for None {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 14:57:19.061336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8b028e49-edae-4e32-8ef6-e51553b88587 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-843621-1"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:19.063112 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:19.063112 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:19.094677 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b028e49-edae-4e32-8ef6-e51553b88587 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:19.095137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b028e49-edae-4e32-8ef6-e51553b88587 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:19.397689 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f1e61b71-366f-4642-8057-390965f12f1e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:57:19.398116 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f1e61b71-366f-4642-8057-390965f12f1e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:57:19.398594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f1e61b71-366f-4642-8057-390965f12f1e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:57:19.399404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f1e61b71-366f-4642-8057-390965f12f1e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:57:19.399812 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f1e61b71-366f-4642-8057-390965f12f1e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:57:19.415201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1e61b71-366f-4642-8057-390965f12f1e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:19.415659 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1e61b71-366f-4642-8057-390965f12f1e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:19.417051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1e61b71-366f-4642-8057-390965f12f1e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:19.417497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1e61b71-366f-4642-8057-390965f12f1e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:19.449037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-f1e61b71-366f-4642-8057-390965f12f1e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Getting quotas for project 016d7f67e1704dc888371aa43be736e6. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:57:19.457463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-f1e61b71-366f-4642-8057-390965f12f1e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Getting quotas for user 8a7349483c684d7aa73c85844d1fda97 and project 016d7f67e1704dc888371aa43be736e6. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:57:19.470760 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f1e61b71-366f-4642-8057-390965f12f1e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 14:57:19.474216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f1e61b71-366f-4642-8057-390965f12f1e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 14:57:19.517936 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8b028e49-edae-4e32-8ef6-e51553b88587 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 0.460240 May 27 14:57:19.518546 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 20/23] 10.222.0.13 () {62 vars in 1231 bytes} [Fri May 27 14:57:19 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:57:19.530754 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f1e61b71-366f-4642-8057-390965f12f1e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.229708 May 27 14:57:19.531909 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 4/24] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:57:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 14:57:19.537126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2ed539bc-cbca-4f01-8d40-3218d568d1a1 tempest-FlavorMetadataValidation-2006323447 tempest-FlavorMetadataValidation-2006323447-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:19.538965 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:19.538965 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:19.811449 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2ed539bc-cbca-4f01-8d40-3218d568d1a1 tempest-FlavorMetadataValidation-2006323447 tempest-FlavorMetadataValidation-2006323447-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/690839767/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.278023 May 27 14:57:19.812116 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 5/25] 10.222.0.13 () {62 vars in 1261 bytes} [Fri May 27 14:57:19 2022] POST /compute/v2.1/flavors/690839767/os-extra_specs => generated 62 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:19.872151 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-59ca5854-bb6d-4298-b55b-e68ff4d32011 tempest-InstanceUsageAuditLogNegativeTestJSON-1342885920 tempest-InstanceUsageAuditLogNegativeTestJSON-1342885920-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:19.873596 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:19.873596 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:19.876205 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-59ca5854-bb6d-4298-b55b-e68ff4d32011 tempest-InstanceUsageAuditLogNegativeTestJSON-1342885920 tempest-InstanceUsageAuditLogNegativeTestJSON-1342885920-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-59ca5854-bb6d-4298-b55b-e68ff4d32011 tempest-InstanceUsageAuditLogNegativeTestJSON-1342885920 tempest-InstanceUsageAuditLogNegativeTestJSON-1342885920-project-admin] Request method failure captured: May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikObOHJFAzci-Xuq5aLVedIOSku9xOG_ATGIMN5mNOwU6GltdOw3TLKg44PF51ZucofqeBPHCDpkXhLk6mEbs0UrtZlOiw47N6DRvH7apIx8kqPCH1kANslVi_zpxzhuB5DF_xi5EDyC7Af5AKfFE01T9Uhh01iMXdZKrFtrRVRBTymU May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: efa906b32e6442f0814a0f5fae85ffd2 May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1342885920 May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,admin,member May 27 14:57:19.887548 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,admin,member May 27 14:57:19.888711 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/efa906b32e6442f0814a0f5fae85ffd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/efa906b32e6442f0814a0f5fae85ffd2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/efa906b32e6442f0814a0f5fae85ffd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_efa906b32e6442f0814a0f5fae85ffd2", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:19.888711 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1342885920 May 27 14:57:19.888711 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: efa906b32e6442f0814a0f5fae85ffd2 May 27 14:57:19.888711 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1342885920 May 27 14:57:19.888711 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1342885920-project-admin May 27 14:57:19.888711 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:57:19.888711 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:57:19.888711 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: c09353d2300a42928d601679bc8ff9c7 May 27 14:57:19.888711 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1342885920-project-admin May 27 14:57:19.888711 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 14:57:19.888711 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid timestamp for date invalid_time May 27 14:57:19.889286 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'invalid_time'} May 27 14:57:19.889286 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:19.889286 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:19.889286 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show May 27 14:57:19.889286 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), May 27 14:57:19.889286 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime May 27 14:57:19.889286 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) May 27 14:57:19.889286 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime May 27 14:57:19.889286 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % May 27 14:57:19.889286 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' May 27 14:57:19.889286 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:57:19.889286 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:19.889286 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:57:19.889286 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:19.889286 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:19.889286 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:19.889286 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:19.889286 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:19.889286 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:19.889286 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:19.890307 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show May 27 14:57:19.890307 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) May 27 14:57:19.890307 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time May 27 14:57:19.890307 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:57:19.890307 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:19.890307 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:57:19.890307 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:19.890307 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:19.890307 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:19.890307 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:57:19.890307 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:57:19.890307 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time May 27 14:57:19.890307 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:57:19.892126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-59ca5854-bb6d-4298-b55b-e68ff4d32011 tempest-InstanceUsageAuditLogNegativeTestJSON-1342885920 tempest-InstanceUsageAuditLogNegativeTestJSON-1342885920-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:19.893645 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-59ca5854-bb6d-4298-b55b-e68ff4d32011 tempest-InstanceUsageAuditLogNegativeTestJSON-1342885920 tempest-InstanceUsageAuditLogNegativeTestJSON-1342885920-project-admin] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.373794 May 27 14:57:19.894645 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 21/26] 10.222.0.13 () {58 vars in 1223 bytes} [Fri May 27 14:57:19 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 376 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 27 14:57:19.904801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4a8f6b03-a66e-4a84-a0c8-8add7a966af5 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-843621-1"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:19.906990 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:19.906990 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:19.919256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4a8f6b03-a66e-4a84-a0c8-8add7a966af5 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:19.919737 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4a8f6b03-a66e-4a84-a0c8-8add7a966af5 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:19.984923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-20a1b8f7-2462-4db8-8046-b11d1e36023b tempest-FlavorsV255TestJSON-844065818 tempest-FlavorsV255TestJSON-844065818-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:19.996436 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-20a1b8f7-2462-4db8-8046-b11d1e36023b tempest-FlavorsV255TestJSON-844065818 tempest-FlavorsV255TestJSON-844065818-project] 10.222.0.13 "GET /compute/v2.1/flavors/1280471315" status: 200 len: 449 microversion: 2.55 time: 0.182471 May 27 14:57:20.004127 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 6/27] 10.222.0.13 () {60 vars in 1198 bytes} [Fri May 27 14:57:19 2022] GET /compute/v2.1/flavors/1280471315 => generated 449 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:57:20.010172 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cde99e59-eafa-4444-97ca-3ab59e11738c tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:20.011009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cde99e59-eafa-4444-97ca-3ab59e11738c tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:20.044935 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4a8f6b03-a66e-4a84-a0c8-8add7a966af5 tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.148694 May 27 14:57:20.050312 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 22/28] 10.222.0.13 () {62 vars in 1231 bytes} [Fri May 27 14:57:19 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:57:20.057633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-14ee6f00-2f7e-45af-a2bb-dc307bdfa2b4 tempest-FlavorMetadataValidation-2006323447 tempest-FlavorMetadataValidation-2006323447-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:20.058398 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:20.058398 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:20.079592 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-14ee6f00-2f7e-45af-a2bb-dc307bdfa2b4 tempest-FlavorMetadataValidation-2006323447 tempest-FlavorMetadataValidation-2006323447-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/690839767" status: 202 len: 0 microversion: 2.86 time: 0.025773 May 27 14:57:20.080400 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 23/29] 10.222.0.13 () {60 vars in 1198 bytes} [Fri May 27 14:57:20 2022] DELETE /compute/v2.1/flavors/690839767 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 14:57:20.111972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cde99e59-eafa-4444-97ca-3ab59e11738c tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:20.126469 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cde99e59-eafa-4444-97ca-3ab59e11738c tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1219 microversion: 2.1 time: 0.121013 May 27 14:57:20.127034 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 7/30] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:20 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1219 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:20.132000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fc4b6c1e-f031-4da5-b3cd-6909dbd40db5 tempest-FlavorsV255TestJSON-2035354519 tempest-FlavorsV255TestJSON-2035354519-project-admin] Action: 'update', calling method: .version_select at 0x7fc77da1d280>, body: {"flavor": {"description": "new"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:20.142721 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:20.142721 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:20.170052 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fc4b6c1e-f031-4da5-b3cd-6909dbd40db5 tempest-FlavorsV255TestJSON-2035354519 tempest-FlavorsV255TestJSON-2035354519-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/1280471315" status: 200 len: 450 microversion: 2.55 time: 0.041965 May 27 14:57:20.170885 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 8/31] 10.222.0.13 () {62 vars in 1218 bytes} [Fri May 27 14:57:20 2022] PUT /compute/v2.1/flavors/1280471315 => generated 450 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:57:20.175629 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-af0f0537-d79f-41b9-ac70-b12a5de4042f tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:20.176571 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:20.176571 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:20.199803 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-af0f0537-d79f-41b9-ac70-b12a5de4042f tempest-AggregatesAdminTestV241-535772307 tempest-AggregatesAdminTestV241-535772307-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.027474 May 27 14:57:20.200696 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 9/32] 10.222.0.13 () {60 vars in 1192 bytes} [Fri May 27 14:57:20 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:20.210827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4a12737f-3593-4a82-91ff-521992b6486e tempest-FlavorMetadataValidation-2006323447 tempest-FlavorMetadataValidation-2006323447-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:20.255585 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4a12737f-3593-4a82-91ff-521992b6486e tempest-FlavorMetadataValidation-2006323447 tempest-FlavorMetadataValidation-2006323447-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 6235 microversion: 2.86 time: 0.047712 May 27 14:57:20.256508 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 10/33] 10.222.0.13 () {60 vars in 1186 bytes} [Fri May 27 14:57:20 2022] GET /compute/v2.1/flavors/detail => generated 6235 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:57:20.274449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8f521102-6b2b-43f6-87a2-466d301ca7a3 tempest-FlavorsV255TestJSON-844065818 tempest-FlavorsV255TestJSON-844065818-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:20.312227 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8f521102-6b2b-43f6-87a2-466d301ca7a3 tempest-FlavorsV255TestJSON-844065818 tempest-FlavorsV255TestJSON-844065818-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.054364 May 27 14:57:20.312873 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 11/34] 10.222.0.13 () {60 vars in 1186 bytes} [Fri May 27 14:57:20 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:57:20.320821 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2ffeb543-c6b2-43b5-8aec-82682f2709d5 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1078214851"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:20.338501 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:20.338501 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:20.339715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.aggregate [None req-2ffeb543-c6b2-43b5-8aec-82682f2709d5 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Generated uuid fa82bf1f-1b8b-4f99-b0a6-a7acb814bde9 for aggregate {{(pid=119248) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 27 14:57:20.366791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-33274505-4b0c-492a-875f-e3ff8acdc6f4 tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443 tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:20.367835 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:20.367835 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:20.368988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-33274505-4b0c-492a-875f-e3ff8acdc6f4 tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443 tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '2481e306bc12460aadcc5e6f65f42c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6988d5723c4b4da3ac1709f6ad3348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:20.379464 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2ffeb543-c6b2-43b5-8aec-82682f2709d5 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.055594 May 27 14:57:20.379464 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 12/35] 10.222.0.13 () {60 vars in 1163 bytes} [Fri May 27 14:57:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-33274505-4b0c-492a-875f-e3ff8acdc6f4 tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443 tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443-project] Request method failure captured: May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikObLt7sk8X26b_db8X3HYC5p6liX8pOWzNEpeaI5UquJtgby7VBmetSWAnmytFhJY68iE3FRZfnY0glnhZBG8Fxi4e86HUO10jdqD747UZwsBMvlwkUxIQ7wTnzrbuf8NeM2de6W-Yav_a93Y6kTuCHv7y45whBviIrmKNECAjoTXpU May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: cc6988d5723c4b4da3ac1709f6ad3348 May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443 May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:57:20.379616 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:57:20.380600 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cc6988d5723c4b4da3ac1709f6ad3348"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cc6988d5723c4b4da3ac1709f6ad3348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/cc6988d5723c4b4da3ac1709f6ad3348"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_cc6988d5723c4b4da3ac1709f6ad3348", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:20.380600 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443 May 27 14:57:20.380600 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: cc6988d5723c4b4da3ac1709f6ad3348 May 27 14:57:20.380600 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443 May 27 14:57:20.380600 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443-project May 27 14:57:20.380600 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:57:20.380600 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:57:20.380600 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 2481e306bc12460aadcc5e6f65f42c7c May 27 14:57:20.380600 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443-project May 27 14:57:20.380600 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 14:57:20.380600 n-d-843621-1 devstack@n-api.service[119249]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 27 14:57:20.381227 n-d-843621-1 devstack@n-api.service[119249]: action_args: {} May 27 14:57:20.381227 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:20.381227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:20.381227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:20.381227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:20.381227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:20.381227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:20.381227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:20.381227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:20.381227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index May 27 14:57:20.381227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) May 27 14:57:20.381227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:57:20.381227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:57:20.381227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:57:20.381227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:57:20.381227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:57:20.381227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:57:20.381227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:57:20.381227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:57:20.381227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:57:20.382159 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:57:20.382159 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:57:20.382159 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:57:20.382159 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:57:20.382159 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:57:20.382159 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 27 14:57:20.382159 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:57:20.382159 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:20.382159 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:57:20.382159 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:20.382159 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:20.382159 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:20.382159 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:57:20.382159 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:57:20.382159 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 27 14:57:20.382159 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:57:20.382159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-33274505-4b0c-492a-875f-e3ff8acdc6f4 tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443 tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:20.382942 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-33274505-4b0c-492a-875f-e3ff8acdc6f4 tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443 tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443-project] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.289354 May 27 14:57:20.382942 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 24/36] 10.222.0.13 () {58 vars in 1184 bytes} [Fri May 27 14:57:20 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 298 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:57:20.383050 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6eecf3a5-d7f5-4fae-ba37-d08d03a0f7e4 tempest-FlavorsV255TestJSON-844065818 tempest-FlavorsV255TestJSON-844065818-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:20.391071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-01eb45ae-d01e-400f-a864-0d55e98184f2 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-843621-1"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:20.392453 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:20.392453 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:20.408295 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6eecf3a5-d7f5-4fae-ba37-d08d03a0f7e4 tempest-FlavorsV255TestJSON-844065818 tempest-FlavorsV255TestJSON-844065818-project] 10.222.0.13 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.029138 May 27 14:57:20.409205 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 13/37] 10.222.0.13 () {60 vars in 1165 bytes} [Fri May 27 14:57:20 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:57:20.414639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c0ab7f55-b7b6-4c0f-a80a-be272dbc96bd tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443 tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:20.415422 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:20.415422 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:20.417105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c0ab7f55-b7b6-4c0f-a80a-be272dbc96bd tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443 tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '2481e306bc12460aadcc5e6f65f42c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc6988d5723c4b4da3ac1709f6ad3348', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c0ab7f55-b7b6-4c0f-a80a-be272dbc96bd tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443 tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443-project] Request method failure captured: May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-05-27%2014:57:20 HTTP/1.1 May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObLt7sk8X26b_db8X3HYC5p6liX8pOWzNEpeaI5UquJtgby7VBmetSWAnmytFhJY68iE3FRZfnY0glnhZBG8Fxi4e86HUO10jdqD747UZwsBMvlwkUxIQ7wTnzrbuf8NeM2de6W-Yav_a93Y6kTuCHv7y45whBviIrmKNECAjoTXpU May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: cc6988d5723c4b4da3ac1709f6ad3348 May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443 May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:57:20.421569 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:57:20.423540 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cc6988d5723c4b4da3ac1709f6ad3348"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cc6988d5723c4b4da3ac1709f6ad3348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/cc6988d5723c4b4da3ac1709f6ad3348"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_cc6988d5723c4b4da3ac1709f6ad3348", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:20.423540 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443 May 27 14:57:20.423540 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: cc6988d5723c4b4da3ac1709f6ad3348 May 27 14:57:20.423540 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443 May 27 14:57:20.423540 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443-project May 27 14:57:20.423540 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:57:20.423540 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:57:20.423540 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 2481e306bc12460aadcc5e6f65f42c7c May 27 14:57:20.423540 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443-project May 27 14:57:20.423540 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:57:20.423540 n-d-843621-1 devstack@n-api.service[119248]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 27 14:57:20.424347 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '2022-05-27 14:57:20'} May 27 14:57:20.424347 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:20.424347 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:20.424347 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:20.424347 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:20.424347 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:20.424347 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:20.424347 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:20.424347 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:20.424347 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show May 27 14:57:20.424347 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) May 27 14:57:20.424347 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:57:20.424347 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:57:20.424347 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:57:20.424347 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:57:20.424347 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:57:20.424347 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:57:20.424347 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:57:20.424347 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:57:20.424347 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:57:20.425496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:57:20.425496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:57:20.425496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:57:20.425496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:57:20.425496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:57:20.425496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 27 14:57:20.425496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:20.425496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:20.425496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:20.425496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:20.425496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:20.425496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:20.425496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:57:20.425496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:57:20.425496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 27 14:57:20.425496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:20.426319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01eb45ae-d01e-400f-a864-0d55e98184f2 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:20.426319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01eb45ae-d01e-400f-a864-0d55e98184f2 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:20.426971 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c0ab7f55-b7b6-4c0f-a80a-be272dbc96bd tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443 tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:20.428189 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c0ab7f55-b7b6-4c0f-a80a-be272dbc96bd tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443 tempest-InstanceUsageAuditLogNegativeTestJSON-1466889443-project] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log/2022-05-27 14:57:20" status: 403 len: 128 microversion: 2.1 time: 0.017118 May 27 14:57:20.429384 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 14/38] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 14:57:20 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-05-27%2014%3A57%3A20 => generated 128 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:57:20.445507 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-74d5ad5a-a6ca-48bf-ab28-c5efbdf5ff93 tempest-FlavorsV255TestJSON-2035354519 tempest-FlavorsV255TestJSON-2035354519-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:20.446600 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:20.446600 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:20.477900 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-74d5ad5a-a6ca-48bf-ab28-c5efbdf5ff93 tempest-FlavorsV255TestJSON-2035354519 tempest-FlavorsV255TestJSON-2035354519-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1280471315" status: 202 len: 0 microversion: 2.55 time: 0.043089 May 27 14:57:20.482962 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 15/39] 10.222.0.13 () {60 vars in 1201 bytes} [Fri May 27 14:57:20 2022] DELETE /compute/v2.1/flavors/1280471315 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 14:57:20.488916 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-36460920-da22-4c6d-bd07-bd0270d59df2 tempest-FlavorsV255TestJSON-2035354519 tempest-FlavorsV255TestJSON-2035354519-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:20.509767 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-36460920-da22-4c6d-bd07-bd0270d59df2 tempest-FlavorsV255TestJSON-2035354519 tempest-FlavorsV255TestJSON-2035354519-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.025470 May 27 14:57:20.517087 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 16/40] 10.222.0.13 () {60 vars in 1186 bytes} [Fri May 27 14:57:20 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:57:20.604859 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-01eb45ae-d01e-400f-a864-0d55e98184f2 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.223530 May 27 14:57:20.609004 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 25/41] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 27 14:57:20 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:20.618871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dd09b0dc-4979-4947-b715-6edf0761f61d tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-843621-1"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:20.621106 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:20.621106 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:20.631357 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd09b0dc-4979-4947-b715-6edf0761f61d tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:20.631888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd09b0dc-4979-4947-b715-6edf0761f61d tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:20.676810 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-dd09b0dc-4979-4947-b715-6edf0761f61d tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h2-843621-1. May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dd09b0dc-4979-4947-b715-6edf0761f61d tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Request method failure captured: May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 39 May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObN7rp0I6xVu3rCSiCFDO27jEzcY80JU-7RphQXeYBWB9VBfn8y2OOFLmaSS9MqF8b0UY8dDCkuHdTzofW3qnEfoS67XNRe1S2pYx3kn61UaZIvWc8fDaF8cF4WxvPo1MgxAHoFQaA93SXqqE0b0O0_is3xZ-i2TKMLpSgPEMOuG1k May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: b7e6fccd7ebd4f25a4f74f11f00b29b8 May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:57:20.696574 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:57:20.697790 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b7e6fccd7ebd4f25a4f74f11f00b29b8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:20.697790 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:20.697790 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: b7e6fccd7ebd4f25a4f74f11f00b29b8 May 27 14:57:20.697790 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:20.697790 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin May 27 14:57:20.697790 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:57:20.697790 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:57:20.697790 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: aaecea53d6174f69af450ef16cb2a3ad May 27 14:57:20.697790 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin May 27 14:57:20.697790 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:57:20.697790 n-d-843621-1 devstack@n-api.service[119248]: {"add_host": {"host": "n-h2-843621-1"}} May 27 14:57:20.697790 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:57:20.697790 n-d-843621-1 devstack@n-api.service[119248]: exception: Aggregate 2 already has host n-h2-843621-1. May 27 14:57:20.698418 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-843621-1'}}} May 27 14:57:20.698418 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:20.698418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:20.698418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 14:57:20.698418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 27 14:57:20.698418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 14:57:20.698418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 27 14:57:20.698418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 14:57:20.698418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = self._query(query) May 27 14:57:20.698418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 14:57:20.698418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi conn.query(q) May 27 14:57:20.698418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 14:57:20.698418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 14:57:20.698418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 14:57:20.698418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result.read() May 27 14:57:20.698418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 14:57:20.698418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 27 14:57:20.698418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 14:57:20.698418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 27 14:57:20.699311 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 14:57:20.699311 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 27 14:57:20.699311 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 14:57:20.699311 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 27 14:57:20.699311 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-843621-1-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") May 27 14:57:20.699311 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:20.699311 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 27 14:57:20.699311 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:20.699311 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:20.699311 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db May 27 14:57:20.699311 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) May 27 14:57:20.699311 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 27 14:57:20.699311 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi session.flush() May 27 14:57:20.699311 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 14:57:20.699311 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._flush(objects) May 27 14:57:20.699311 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 14:57:20.699311 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 27 14:57:20.699311 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 14:57:20.699311 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi compat.raise_( May 27 14:57:20.700213 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 14:57:20.700213 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception May 27 14:57:20.700213 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 14:57:20.700213 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi flush_context.execute() May 27 14:57:20.700213 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 14:57:20.700213 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi rec.execute(self) May 27 14:57:20.700213 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 14:57:20.700213 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 27 14:57:20.700213 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 14:57:20.700213 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 27 14:57:20.700213 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 27 14:57:20.700213 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 27 14:57:20.700213 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 14:57:20.700213 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 27 14:57:20.700213 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 14:57:20.700213 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 27 14:57:20.700213 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 14:57:20.700213 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 27 14:57:20.703008 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 14:57:20.703008 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 27 14:57:20.703008 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 14:57:20.703008 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 14:57:20.703008 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 14:57:20.703008 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception May 27 14:57:20.703008 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 14:57:20.703008 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 27 14:57:20.703008 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 14:57:20.703008 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 27 14:57:20.703008 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 14:57:20.703008 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = self._query(query) May 27 14:57:20.703008 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 14:57:20.703008 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi conn.query(q) May 27 14:57:20.703008 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 14:57:20.703008 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 14:57:20.703008 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 14:57:20.703008 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result.read() May 27 14:57:20.704618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 14:57:20.704618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 27 14:57:20.704618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 14:57:20.704618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 27 14:57:20.704618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 14:57:20.704618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 27 14:57:20.704618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 14:57:20.704618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 27 14:57:20.704618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-843621-1-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") May 27 14:57:20.704618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] May 27 14:57:20.704618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 27, 14, 57, 20, 658862), 'updated_at': None, 'host': 'n-h2-843621-1', 'aggregate_id': 2}] May 27 14:57:20.704618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 14:57:20.704618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:20.704618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:20.704618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:20.704618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:20.704618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host May 27 14:57:20.705746 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) May 27 14:57:20.705746 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 27 14:57:20.705746 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 27 14:57:20.705746 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:57:20.705746 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:57:20.705746 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:57:20.705746 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:57:20.705746 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 27 14:57:20.705746 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 27 14:57:20.705746 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate May 27 14:57:20.705746 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) May 27 14:57:20.705746 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 27 14:57:20.705746 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 27 14:57:20.705746 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host May 27 14:57:20.705746 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) May 27 14:57:20.705746 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db May 27 14:57:20.705746 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, May 27 14:57:20.705746 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h2-843621-1. May 27 14:57:20.705746 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:20.705746 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h2-843621-1. May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:57:20.706956 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:57:20.708173 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h2-843621-1. May 27 14:57:20.708173 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:20.708173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dd09b0dc-4979-4947-b715-6edf0761f61d tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Returning 409 to user: Aggregate 2 already has host n-h2-843621-1. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:20.708173 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dd09b0dc-4979-4947-b715-6edf0761f61d tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.086061 May 27 14:57:20.708173 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 17/42] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 27 14:57:20 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) May 27 14:57:20.710328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7078849e-b6ad-4819-8bf4-2829fd460da1 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-843621-1"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:20.711596 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:20.711596 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:20.720289 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7078849e-b6ad-4819-8bf4-2829fd460da1 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:20.720782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7078849e-b6ad-4819-8bf4-2829fd460da1 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:20.855173 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7078849e-b6ad-4819-8bf4-2829fd460da1 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.148590 May 27 14:57:20.856794 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 26/43] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 27 14:57:20 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:20.867974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a29caa44-30c4-4079-b21f-49f77a8c5b36 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:20.868762 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:20.868762 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:20.894330 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a29caa44-30c4-4079-b21f-49f77a8c5b36 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.030176 May 27 14:57:20.896001 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 18/44] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 14:57:20 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 27 14:57:20.906191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bc67ac5c-fbd2-4d3a-a772-d1540b83afdb tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1785008747"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:20.907574 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:20.907574 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:20.908478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.aggregate [None req-bc67ac5c-fbd2-4d3a-a772-d1540b83afdb tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Generated uuid 946a4a81-cc1a-4a79-8cb1-59eb8205cadf for aggregate {{(pid=119249) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 27 14:57:20.942024 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bc67ac5c-fbd2-4d3a-a772-d1540b83afdb tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.039871 May 27 14:57:20.944183 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 27/45] 10.222.0.13 () {60 vars in 1163 bytes} [Fri May 27 14:57:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:20.954922 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9c516f4a-03f8-4e03-9ddd-30072c1c3f03 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1585259917", "name": "tempest-test_aggregate-1573369279"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:20.976017 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:20.976017 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:20.977457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.aggregate [None req-9c516f4a-03f8-4e03-9ddd-30072c1c3f03 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Generated uuid bef4da67-e352-4831-acdb-8ca46a0d4665 for aggregate {{(pid=119248) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 27 14:57:21.000319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9,nova_api:UPDATE=2,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=7 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:21.012613 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9c516f4a-03f8-4e03-9ddd-30072c1c3f03 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.062424 May 27 14:57:21.013606 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 19/46] 10.222.0.13 () {60 vars in 1164 bytes} [Fri May 27 14:57:20 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:21.030502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-92216c51-a5d1-4b54-ac8e-19f25fca8cba tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:21.031275 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:21.031275 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:21.045365 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-92216c51-a5d1-4b54-ac8e-19f25fca8cba tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 517 microversion: 2.1 time: 0.021602 May 27 14:57:21.045939 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 20/47] 10.222.0.13 () {58 vars in 1142 bytes} [Fri May 27 14:57:21 2022] GET /compute/v2.1/os-aggregates => generated 517 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:21.060826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-480a4b59-f7cc-4c2f-b872-cd3fb90c9254 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-843621-1"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:21.062194 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:21.062194 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:21.072916 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-480a4b59-f7cc-4c2f-b872-cd3fb90c9254 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:21.073590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-480a4b59-f7cc-4c2f-b872-cd3fb90c9254 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:21.349109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-74ad4d16-72df-4080-b13e-a0b2fc215c5c tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-843621-1"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:21.350361 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:21.350361 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:21.351224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-74ad4d16-72df-4080-b13e-a0b2fc215c5c tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '22c2db89f04b4669ab1033a7b4f07248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a2f6c7672e43a5b1cdb309e190d1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-74ad4d16-72df-4080-b13e-a0b2fc215c5c tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Request method failure captured: May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 39 May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikObLHQBpn2vNwAEAFjqioMhYUX1iAIwOHh5gzC-B85g0NFSxUYEuEWkzGOl32RwxADIW-3ia7AeeYkgUOTUZl3Jw14LtRncyt5B-dFnD55w4KdQxYbjT7jKQfYCMIxgpq4KK-LS0j9eCyzPGXWglWda9BcYSvcgF_NBBJlMFSO8zAHE May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: c4a2f6c7672e43a5b1cdb309e190d1e4 May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1975648109 May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:57:21.353319 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:57:21.355028 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c4a2f6c7672e43a5b1cdb309e190d1e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c4a2f6c7672e43a5b1cdb309e190d1e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c4a2f6c7672e43a5b1cdb309e190d1e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c4a2f6c7672e43a5b1cdb309e190d1e4", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:21.355028 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1975648109 May 27 14:57:21.355028 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: c4a2f6c7672e43a5b1cdb309e190d1e4 May 27 14:57:21.355028 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1975648109 May 27 14:57:21.355028 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-AggregatesAdminNegativeTestJSON-1975648109-project May 27 14:57:21.355028 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:57:21.355028 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:57:21.355028 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 22c2db89f04b4669ab1033a7b4f07248 May 27 14:57:21.355028 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1975648109-project May 27 14:57:21.355028 n-d-843621-1 devstack@n-api.service[119249]: May 27 14:57:21.355028 n-d-843621-1 devstack@n-api.service[119249]: {"add_host": {"host": "n-h2-843621-1"}} May 27 14:57:21.355028 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 14:57:21.355028 n-d-843621-1 devstack@n-api.service[119249]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 27 14:57:21.355686 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h2-843621-1'}}} May 27 14:57:21.355686 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:21.355686 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:21.355686 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:21.355686 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:21.355686 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:21.355686 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:21.355686 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:21.355686 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:21.355686 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:57:21.355686 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:57:21.355686 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host May 27 14:57:21.355686 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) May 27 14:57:21.355686 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:57:21.355686 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:57:21.355686 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:57:21.355686 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:57:21.355686 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:57:21.355686 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:57:21.356666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:57:21.356666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:57:21.356666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:57:21.356666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:57:21.356666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:57:21.356666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:57:21.356666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:57:21.356666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:57:21.356666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 27 14:57:21.356666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:57:21.356666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:21.356666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:57:21.356666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:21.356666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:21.356666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:21.356666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:57:21.356666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:57:21.356666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 27 14:57:21.356666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:57:21.357630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-74ad4d16-72df-4080-b13e-a0b2fc215c5c tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:21.357630 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-74ad4d16-72df-4080-b13e-a0b2fc215c5c tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] 10.222.0.13 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.403330 May 27 14:57:21.359397 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 28/48] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 27 14:57:20 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 409 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:57:21.365429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0c4947c8-ea1c-43be-86db-2f38dbcafb2a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:21.366365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0c4947c8-ea1c-43be-86db-2f38dbcafb2a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:21.383690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c4947c8-ea1c-43be-86db-2f38dbcafb2a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:21.384325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c4947c8-ea1c-43be-86db-2f38dbcafb2a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:21.385383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c4947c8-ea1c-43be-86db-2f38dbcafb2a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:21.385984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c4947c8-ea1c-43be-86db-2f38dbcafb2a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:21.952928 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-480a4b59-f7cc-4c2f-b872-cd3fb90c9254 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 315 microversion: 2.1 time: 0.899533 May 27 14:57:21.961897 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 21/49] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 27 14:57:21 2022] POST /compute/v2.1/os-aggregates/4/action => generated 315 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 14:57:21.986207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4b8462a7-a752-4ee5-9ec7-dddd9f323b58 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:21.987481 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:21.987481 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:22.057593 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4b8462a7-a752-4ee5-9ec7-dddd9f323b58 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.093413 May 27 14:57:22.062876 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 22/50] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 14:57:21 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 27 14:57:22.073166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cebf6767-fbc3-4824-8bd5-f4287994e106 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-533338427"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:22.074647 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:22.074647 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:22.078109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.aggregate [None req-cebf6767-fbc3-4824-8bd5-f4287994e106 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Generated uuid 80f1a97f-dd72-4c26-90f9-37616f106edb for aggregate {{(pid=119248) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 27 14:57:22.129036 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cebf6767-fbc3-4824-8bd5-f4287994e106 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.064698 May 27 14:57:22.129802 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 23/51] 10.222.0.13 () {60 vars in 1163 bytes} [Fri May 27 14:57:22 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:22.145666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-51a9ac5b-c623-4c45-a426-1ac03b6d7bbd tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1784915643"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:22.150045 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:22.150045 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:22.191021 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51a9ac5b-c623-4c45-a426-1ac03b6d7bbd tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:22.197036 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51a9ac5b-c623-4c45-a426-1ac03b6d7bbd tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:22.220829 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51a9ac5b-c623-4c45-a426-1ac03b6d7bbd tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:22.222631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51a9ac5b-c623-4c45-a426-1ac03b6d7bbd tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:22.233759 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-51a9ac5b-c623-4c45-a426-1ac03b6d7bbd tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1784915643 could not be found. May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-51a9ac5b-c623-4c45-a426-1ac03b6d7bbd tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Request method failure captured: May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 58 May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObN7rp0I6xVu3rCSiCFDO27jEzcY80JU-7RphQXeYBWB9VBfn8y2OOFLmaSS9MqF8b0UY8dDCkuHdTzofW3qnEfoS67XNRe1S2pYx3kn61UaZIvWc8fDaF8cF4WxvPo1MgxAHoFQaA93SXqqE0b0O0_is3xZ-i2TKMLpSgPEMOuG1k May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: b7e6fccd7ebd4f25a4f74f11f00b29b8 May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:57:22.242277 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:57:22.243297 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b7e6fccd7ebd4f25a4f74f11f00b29b8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:22.243297 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:22.243297 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: b7e6fccd7ebd4f25a4f74f11f00b29b8 May 27 14:57:22.243297 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:22.243297 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin May 27 14:57:22.243297 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:57:22.243297 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:57:22.243297 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: aaecea53d6174f69af450ef16cb2a3ad May 27 14:57:22.243297 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin May 27 14:57:22.243297 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:57:22.243297 n-d-843621-1 devstack@n-api.service[119248]: {"add_host": {"host": "tempest-nonexist_host-1784915643"}} May 27 14:57:22.243297 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:57:22.243297 n-d-843621-1 devstack@n-api.service[119248]: exception: Compute host tempest-nonexist_host-1784915643 could not be found. May 27 14:57:22.243942 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-1784915643'}}} May 27 14:57:22.243942 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:22.243942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.243942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host May 27 14:57:22.243942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 27 14:57:22.243942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:57:22.243942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:57:22.243942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 27 14:57:22.243942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 27 14:57:22.243942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 14:57:22.243942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 14:57:22.243942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 27 14:57:22.243942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 27 14:57:22.243942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1784915643' is not mapped to any cell May 27 14:57:22.243942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.243942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:22.243942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.243942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.243942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host May 27 14:57:22.245449 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) May 27 14:57:22.245449 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 27 14:57:22.245449 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 27 14:57:22.245449 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 27 14:57:22.245449 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.245449 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:22.245449 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.245449 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.245449 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host May 27 14:57:22.245449 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) May 27 14:57:22.245449 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 27 14:57:22.245449 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 27 14:57:22.245449 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:57:22.245449 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:57:22.245449 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:57:22.245449 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:57:22.245449 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 27 14:57:22.245449 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 27 14:57:22.245449 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate May 27 14:57:22.245449 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1784915643 could not be found. May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1784915643 could not be found. May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:22.246411 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.247476 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.247476 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:22.247476 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:22.247476 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:57:22.247476 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:57:22.247476 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1784915643 could not be found. May 27 14:57:22.247476 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.247476 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-51a9ac5b-c623-4c45-a426-1ac03b6d7bbd tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1784915643 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:22.247476 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-51a9ac5b-c623-4c45-a426-1ac03b6d7bbd tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 111 microversion: 2.1 time: 0.106266 May 27 14:57:22.247476 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 24/52] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 27 14:57:22 2022] POST /compute/v2.1/os-aggregates/5/action => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:57:22.256355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c5cb6f9a-884f-4fe3-ab58-d578779d6a9d tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:22.257528 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:22.257528 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:22.285651 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c5cb6f9a-884f-4fe3-ab58-d578779d6a9d tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.034075 May 27 14:57:22.286463 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 25/53] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 14:57:22 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 27 14:57:22.299410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4652ca49-234a-458b-ad8b-7da99f3e975f tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4652ca49-234a-458b-ad8b-7da99f3e975f tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Request method failure captured: May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 283 May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObN7rp0I6xVu3rCSiCFDO27jEzcY80JU-7RphQXeYBWB9VBfn8y2OOFLmaSS9MqF8b0UY8dDCkuHdTzofW3qnEfoS67XNRe1S2pYx3kn61UaZIvWc8fDaF8cF4WxvPo1MgxAHoFQaA93SXqqE0b0O0_is3xZ-i2TKMLpSgPEMOuG1k May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: b7e6fccd7ebd4f25a4f74f11f00b29b8 May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:57:22.335162 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:57:22.336222 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b7e6fccd7ebd4f25a4f74f11f00b29b8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:22.336222 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:22.336222 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: b7e6fccd7ebd4f25a4f74f11f00b29b8 May 27 14:57:22.336222 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:22.336222 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin May 27 14:57:22.336222 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:57:22.336222 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:57:22.336222 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: aaecea53d6174f69af450ef16cb2a3ad May 27 14:57:22.336222 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin May 27 14:57:22.336222 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:57:22.336222 n-d-843621-1 devstack@n-api.service[119248]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 27 14:57:22.336812 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:57:22.336812 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 27 14:57:22.336812 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 27 14:57:22.336812 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:22.336812 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.336812 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 14:57:22.336812 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 14:57:22.336812 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 14:57:22.336812 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 14:57:22.336812 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 27 14:57:22.336812 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.337394 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: May 27 14:57:22.337394 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 27 14:57:22.337394 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.337394 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance['aggregate']: May 27 14:57:22.337394 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 27 14:57:22.337394 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.337394 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:22.337394 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.337394 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.337394 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:22.337394 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:22.337394 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:22.337394 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:22.337394 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:22.337394 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:22.337394 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:57:22.337394 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:57:22.337394 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 14:57:22.337394 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 14:57:22.338429 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 14:57:22.338429 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 14:57:22.338429 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 14:57:22.338429 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 14:57:22.338429 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 27 14:57:22.338429 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.338429 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:22.338429 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.338429 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.338429 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:22.338429 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:22.338429 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 14:57:22.338429 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 14:57:22.340037 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 27 14:57:22.340037 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.340037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4652ca49-234a-458b-ad8b-7da99f3e975f tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:22.340037 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4652ca49-234a-458b-ad8b-7da99f3e975f tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.044014 May 27 14:57:22.340276 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 26/54] 10.222.0.13 () {60 vars in 1164 bytes} [Fri May 27 14:57:22 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 14:57:22.348215 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7ca3468c-386c-430a-a76a-5d3e158c14da tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7ca3468c-386c-430a-a76a-5d3e158c14da tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Request method failure captured: May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 27 May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObN7rp0I6xVu3rCSiCFDO27jEzcY80JU-7RphQXeYBWB9VBfn8y2OOFLmaSS9MqF8b0UY8dDCkuHdTzofW3qnEfoS67XNRe1S2pYx3kn61UaZIvWc8fDaF8cF4WxvPo1MgxAHoFQaA93SXqqE0b0O0_is3xZ-i2TKMLpSgPEMOuG1k May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: b7e6fccd7ebd4f25a4f74f11f00b29b8 May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:57:22.368694 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:57:22.370345 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b7e6fccd7ebd4f25a4f74f11f00b29b8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:22.370345 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:22.370345 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: b7e6fccd7ebd4f25a4f74f11f00b29b8 May 27 14:57:22.370345 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:22.370345 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin May 27 14:57:22.370345 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:57:22.370345 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:57:22.370345 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: aaecea53d6174f69af450ef16cb2a3ad May 27 14:57:22.370345 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin May 27 14:57:22.370345 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:57:22.370345 n-d-843621-1 devstack@n-api.service[119248]: {"aggregate": {"name": ""}} May 27 14:57:22.370345 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:57:22.370345 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid input for field/attribute name. Value: . '' is too short May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'aggregate': {'name': ''}}} May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance['aggregate']: May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi '' May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:22.370975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:22.372132 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:22.372132 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:57:22.372132 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:57:22.372132 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 14:57:22.372132 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 14:57:22.372132 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 14:57:22.372132 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 14:57:22.372132 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 14:57:22.372132 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 14:57:22.372132 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 27 14:57:22.372132 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.372132 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:22.372132 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.372132 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.372132 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:22.372132 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:22.372132 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 14:57:22.372132 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 14:57:22.372132 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 27 14:57:22.372132 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.378280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7ca3468c-386c-430a-a76a-5d3e158c14da tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:22.378280 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7ca3468c-386c-430a-a76a-5d3e158c14da tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.027853 May 27 14:57:22.378280 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 27/55] 10.222.0.13 () {60 vars in 1163 bytes} [Fri May 27 14:57:22 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 27 14:57:22.383609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bbc15b60-375b-4589-b1b4-bdd00b914bb4 tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1443983989"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:22.385965 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:22.385965 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:22.386946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bbc15b60-375b-4589-b1b4-bdd00b914bb4 tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '22c2db89f04b4669ab1033a7b4f07248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a2f6c7672e43a5b1cdb309e190d1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bbc15b60-375b-4589-b1b4-bdd00b914bb4 tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Request method failure captured: May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 60 May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObLHQBpn2vNwAEAFjqioMhYUX1iAIwOHh5gzC-B85g0NFSxUYEuEWkzGOl32RwxADIW-3ia7AeeYkgUOTUZl3Jw14LtRncyt5B-dFnD55w4KdQxYbjT7jKQfYCMIxgpq4KK-LS0j9eCyzPGXWglWda9BcYSvcgF_NBBJlMFSO8zAHE May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: c4a2f6c7672e43a5b1cdb309e190d1e4 May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1975648109 May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:57:22.388576 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:57:22.389752 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c4a2f6c7672e43a5b1cdb309e190d1e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c4a2f6c7672e43a5b1cdb309e190d1e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c4a2f6c7672e43a5b1cdb309e190d1e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c4a2f6c7672e43a5b1cdb309e190d1e4", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:22.389752 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1975648109 May 27 14:57:22.389752 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: c4a2f6c7672e43a5b1cdb309e190d1e4 May 27 14:57:22.389752 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1975648109 May 27 14:57:22.389752 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AggregatesAdminNegativeTestJSON-1975648109-project May 27 14:57:22.389752 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:57:22.389752 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:57:22.389752 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 22c2db89f04b4669ab1033a7b4f07248 May 27 14:57:22.389752 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1975648109-project May 27 14:57:22.389752 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:57:22.389752 n-d-843621-1 devstack@n-api.service[119248]: {"aggregate": {"name": "tempest-test_aggregate-1443983989"}} May 27 14:57:22.389752 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:57:22.389752 n-d-843621-1 devstack@n-api.service[119248]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 27 14:57:22.390404 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1443983989'}}} May 27 14:57:22.390404 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:22.390404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.390404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:22.390404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:22.390404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:22.390404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:22.390404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:22.390404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:22.390404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:57:22.390404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:57:22.390404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:57:22.390404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:57:22.390404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create May 27 14:57:22.390404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) May 27 14:57:22.390404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:57:22.390404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:57:22.390404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:57:22.390404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:57:22.393235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:57:22.393235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:57:22.393235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:57:22.393235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:57:22.393235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:57:22.393235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:57:22.393235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:57:22.393235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:57:22.393235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:57:22.393235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:57:22.393235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 27 14:57:22.393235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.393235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:22.393235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.393235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.393235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:22.393235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:22.393235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:57:22.393235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:57:22.393235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 27 14:57:22.394257 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.394257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bbc15b60-375b-4589-b1b4-bdd00b914bb4 tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:22.394257 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bbc15b60-375b-4589-b1b4-bdd00b914bb4 tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.012310 May 27 14:57:22.394257 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 28/56] 10.222.0.13 () {60 vars in 1163 bytes} [Fri May 27 14:57:22 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:57:22.408231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9095b3b9-ef43-4c36-906d-30ab9dc501b0 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1606292418"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:22.410856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.aggregate [None req-9095b3b9-ef43-4c36-906d-30ab9dc501b0 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Generated uuid 703fac6c-312a-4d9d-88b1-649ec038f391 for aggregate {{(pid=119248) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 27 14:57:22.441684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0c4947c8-ea1c-43be-86db-2f38dbcafb2a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:22.470145 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9095b3b9-ef43-4c36-906d-30ab9dc501b0 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.066446 May 27 14:57:22.470986 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 29/57] 10.222.0.13 () {60 vars in 1163 bytes} [Fri May 27 14:57:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:22.476757 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0c4947c8-ea1c-43be-86db-2f38dbcafb2a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1271 microversion: 2.1 time: 1.116071 May 27 14:57:22.495418 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 29/58] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:21 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1271 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:22.497500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-daffcd99-9d4e-4c06-9d00-7aeedda9b360 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1606292418"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:22.499468 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:22.499468 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:22.500589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.aggregate [None req-daffcd99-9d4e-4c06-9d00-7aeedda9b360 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Generated uuid 920f0e7b-9ead-4769-99da-5080f2dcc337 for aggregate {{(pid=119248) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 27 14:57:22.511832 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-daffcd99-9d4e-4c06-9d00-7aeedda9b360 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1606292418 already exists. May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-daffcd99-9d4e-4c06-9d00-7aeedda9b360 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Request method failure captured: May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 60 May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObN7rp0I6xVu3rCSiCFDO27jEzcY80JU-7RphQXeYBWB9VBfn8y2OOFLmaSS9MqF8b0UY8dDCkuHdTzofW3qnEfoS67XNRe1S2pYx3kn61UaZIvWc8fDaF8cF4WxvPo1MgxAHoFQaA93SXqqE0b0O0_is3xZ-i2TKMLpSgPEMOuG1k May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: b7e6fccd7ebd4f25a4f74f11f00b29b8 May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:57:22.513887 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:57:22.515331 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b7e6fccd7ebd4f25a4f74f11f00b29b8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:22.515331 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:22.515331 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: b7e6fccd7ebd4f25a4f74f11f00b29b8 May 27 14:57:22.515331 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:22.515331 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin May 27 14:57:22.515331 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:57:22.515331 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:57:22.515331 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: aaecea53d6174f69af450ef16cb2a3ad May 27 14:57:22.515331 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin May 27 14:57:22.515331 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:57:22.515331 n-d-843621-1 devstack@n-api.service[119248]: {"aggregate": {"name": "tempest-test_aggregate-1606292418"}} May 27 14:57:22.515331 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:57:22.515331 n-d-843621-1 devstack@n-api.service[119248]: exception: Aggregate tempest-test_aggregate-1606292418 already exists. May 27 14:57:22.516061 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1606292418'}}} May 27 14:57:22.516061 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:22.516061 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.516061 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create May 27 14:57:22.516061 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) May 27 14:57:22.516061 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 27 14:57:22.516061 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 27 14:57:22.516061 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:57:22.516061 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:57:22.516061 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:57:22.516061 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:57:22.516061 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 27 14:57:22.516061 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 27 14:57:22.516061 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate May 27 14:57:22.516061 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi aggregate.create() May 27 14:57:22.516061 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 27 14:57:22.516061 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 27 14:57:22.516061 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create May 27 14:57:22.516061 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, May 27 14:57:22.520720 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 14:57:22.520720 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 14:57:22.520720 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db May 27 14:57:22.520720 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) May 27 14:57:22.520720 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1606292418 already exists. May 27 14:57:22.520720 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.520720 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:22.520720 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.520720 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.520720 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:22.520720 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:22.520720 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:22.520720 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:22.520720 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:22.520720 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:22.520720 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:57:22.520720 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:57:22.520720 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:57:22.520720 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:57:22.520720 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create May 27 14:57:22.522297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) May 27 14:57:22.522297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1606292418 already exists. May 27 14:57:22.522297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.522297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:22.522297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.522297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.522297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:22.522297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:22.522297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:57:22.522297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:57:22.522297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1606292418 already exists. May 27 14:57:22.522297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.522297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-daffcd99-9d4e-4c06-9d00-7aeedda9b360 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1606292418 already exists. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:22.522297 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-daffcd99-9d4e-4c06-9d00-7aeedda9b360 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.033079 May 27 14:57:22.523873 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 30/59] 10.222.0.13 () {60 vars in 1163 bytes} [Fri May 27 14:57:22 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 14:57:22.526403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-729b0215-d41c-4589-bb98-6b844db8a05f tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:22.527247 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:22.527247 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:22.567160 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-729b0215-d41c-4589-bb98-6b844db8a05f tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.044794 May 27 14:57:22.568063 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 30/60] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 14:57:22 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 27 14:57:22.577195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e2127f6e-c4bd-4347-a982-21341d4f30f1 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-118421783"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:22.578571 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:22.578571 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:22.579377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.aggregate [None req-e2127f6e-c4bd-4347-a982-21341d4f30f1 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Generated uuid 486d90b3-f336-4261-81ce-b7ea6e29c9bb for aggregate {{(pid=119248) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 27 14:57:22.614771 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e2127f6e-c4bd-4347-a982-21341d4f30f1 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.041353 May 27 14:57:22.616035 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 31/61] 10.222.0.13 () {60 vars in 1163 bytes} [Fri May 27 14:57:22 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:22.627810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ab539b64-3242-4c5a-bc80-3c659e22f7dc tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:22.628900 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:22.628900 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:22.630648 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ab539b64-3242-4c5a-bc80-3c659e22f7dc tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '22c2db89f04b4669ab1033a7b4f07248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a2f6c7672e43a5b1cdb309e190d1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ab539b64-3242-4c5a-bc80-3c659e22f7dc tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Request method failure captured: May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObLHQBpn2vNwAEAFjqioMhYUX1iAIwOHh5gzC-B85g0NFSxUYEuEWkzGOl32RwxADIW-3ia7AeeYkgUOTUZl3Jw14LtRncyt5B-dFnD55w4KdQxYbjT7jKQfYCMIxgpq4KK-LS0j9eCyzPGXWglWda9BcYSvcgF_NBBJlMFSO8zAHE May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: c4a2f6c7672e43a5b1cdb309e190d1e4 May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1975648109 May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:57:22.632208 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:57:22.633422 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c4a2f6c7672e43a5b1cdb309e190d1e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c4a2f6c7672e43a5b1cdb309e190d1e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c4a2f6c7672e43a5b1cdb309e190d1e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c4a2f6c7672e43a5b1cdb309e190d1e4", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:22.633422 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1975648109 May 27 14:57:22.633422 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: c4a2f6c7672e43a5b1cdb309e190d1e4 May 27 14:57:22.633422 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1975648109 May 27 14:57:22.633422 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AggregatesAdminNegativeTestJSON-1975648109-project May 27 14:57:22.633422 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:57:22.633422 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:57:22.633422 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 22c2db89f04b4669ab1033a7b4f07248 May 27 14:57:22.633422 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1975648109-project May 27 14:57:22.633422 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:57:22.633422 n-d-843621-1 devstack@n-api.service[119248]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 27 14:57:22.633422 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '7'} May 27 14:57:22.634023 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:22.634023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.634023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:22.634023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:22.634023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:22.634023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:22.634023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:22.634023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:22.634023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete May 27 14:57:22.634023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) May 27 14:57:22.634023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:57:22.634023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:57:22.634023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:57:22.634023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:57:22.634023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:57:22.634023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:57:22.634023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:57:22.634023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:57:22.634023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:57:22.637227 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:57:22.637227 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:57:22.637227 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:57:22.637227 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:57:22.637227 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:57:22.637227 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 27 14:57:22.637227 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.637227 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:22.637227 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.637227 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.637227 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:22.637227 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:22.637227 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:57:22.637227 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:57:22.637227 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 27 14:57:22.637227 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.637227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ab539b64-3242-4c5a-bc80-3c659e22f7dc tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:22.638250 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ab539b64-3242-4c5a-bc80-3c659e22f7dc tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.011439 May 27 14:57:22.638250 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 32/62] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 14:57:22 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:57:22.643645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-236e5258-cde2-46f7-9646-2e692e4fa897 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:22.674195 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-236e5258-cde2-46f7-9646-2e692e4fa897 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.034466 May 27 14:57:22.675104 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 33/63] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 14:57:22 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 27 14:57:22.688488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6503d80e-3515-4cf8-b265-c47574a9232a tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:22.689079 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:22.689079 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:22.702961 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-6503d80e-3515-4cf8-b265-c47574a9232a tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] HTTP exception thrown: Aggregate -1 could not be found. May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6503d80e-3515-4cf8-b265-c47574a9232a tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Request method failure captured: May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObN7rp0I6xVu3rCSiCFDO27jEzcY80JU-7RphQXeYBWB9VBfn8y2OOFLmaSS9MqF8b0UY8dDCkuHdTzofW3qnEfoS67XNRe1S2pYx3kn61UaZIvWc8fDaF8cF4WxvPo1MgxAHoFQaA93SXqqE0b0O0_is3xZ-i2TKMLpSgPEMOuG1k May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: b7e6fccd7ebd4f25a4f74f11f00b29b8 May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:57:22.705236 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:57:22.706370 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b7e6fccd7ebd4f25a4f74f11f00b29b8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:22.706370 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:22.706370 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: b7e6fccd7ebd4f25a4f74f11f00b29b8 May 27 14:57:22.706370 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:22.706370 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin May 27 14:57:22.706370 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:57:22.706370 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:57:22.706370 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: aaecea53d6174f69af450ef16cb2a3ad May 27 14:57:22.706370 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin May 27 14:57:22.706370 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:57:22.706370 n-d-843621-1 devstack@n-api.service[119248]: exception: Aggregate -1 could not be found. May 27 14:57:22.706370 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '-1'} May 27 14:57:22.707003 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:22.707003 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.707003 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 27 14:57:22.707003 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 27 14:57:22.707003 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 27 14:57:22.707003 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 27 14:57:22.707003 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:57:22.707003 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:57:22.707003 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:57:22.707003 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:57:22.707003 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 27 14:57:22.707003 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 27 14:57:22.707003 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 27 14:57:22.707003 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 27 14:57:22.707003 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:57:22.707003 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:57:22.707003 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 27 14:57:22.707003 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 27 14:57:22.707003 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.708041 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.709140 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:22.709140 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:22.709140 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:57:22.709140 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:57:22.709140 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. May 27 14:57:22.709140 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.709140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6503d80e-3515-4cf8-b265-c47574a9232a tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:22.709140 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6503d80e-3515-4cf8-b265-c47574a9232a tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.026903 May 27 14:57:22.709140 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 34/64] 10.222.0.13 () {58 vars in 1154 bytes} [Fri May 27 14:57:22 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 27 14:57:22.718972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-49a8130c-9cab-49a7-bef7-bec42ed8c878 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2239150"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:22.726220 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:22.726220 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:22.727660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.aggregate [None req-49a8130c-9cab-49a7-bef7-bec42ed8c878 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Generated uuid 99b14bf7-51f0-43bc-8007-403bc4f041fc for aggregate {{(pid=119248) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 27 14:57:22.765638 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-49a8130c-9cab-49a7-bef7-bec42ed8c878 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 195 microversion: 2.1 time: 0.052038 May 27 14:57:22.766786 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 35/65] 10.222.0.13 () {60 vars in 1163 bytes} [Fri May 27 14:57:22 2022] POST /compute/v2.1/os-aggregates => generated 195 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:22.778247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cefc8f3d-c9a9-42b3-b1f9-5f09e1ef43d3 tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:22.779112 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:22.779112 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:22.779975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cefc8f3d-c9a9-42b3-b1f9-5f09e1ef43d3 tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '22c2db89f04b4669ab1033a7b4f07248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a2f6c7672e43a5b1cdb309e190d1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cefc8f3d-c9a9-42b3-b1f9-5f09e1ef43d3 tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Request method failure captured: May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObLHQBpn2vNwAEAFjqioMhYUX1iAIwOHh5gzC-B85g0NFSxUYEuEWkzGOl32RwxADIW-3ia7AeeYkgUOTUZl3Jw14LtRncyt5B-dFnD55w4KdQxYbjT7jKQfYCMIxgpq4KK-LS0j9eCyzPGXWglWda9BcYSvcgF_NBBJlMFSO8zAHE May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: c4a2f6c7672e43a5b1cdb309e190d1e4 May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1975648109 May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:57:22.781726 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:57:22.783210 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c4a2f6c7672e43a5b1cdb309e190d1e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c4a2f6c7672e43a5b1cdb309e190d1e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c4a2f6c7672e43a5b1cdb309e190d1e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c4a2f6c7672e43a5b1cdb309e190d1e4", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:22.783210 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1975648109 May 27 14:57:22.783210 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: c4a2f6c7672e43a5b1cdb309e190d1e4 May 27 14:57:22.783210 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1975648109 May 27 14:57:22.783210 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AggregatesAdminNegativeTestJSON-1975648109-project May 27 14:57:22.783210 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:57:22.783210 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:57:22.783210 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 22c2db89f04b4669ab1033a7b4f07248 May 27 14:57:22.783210 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1975648109-project May 27 14:57:22.783210 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:57:22.783210 n-d-843621-1 devstack@n-api.service[119248]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 27 14:57:22.783210 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '8'} May 27 14:57:22.784337 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:22.784337 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.784337 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:22.784337 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:22.784337 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:22.784337 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:22.784337 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:22.784337 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:22.784337 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show May 27 14:57:22.784337 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) May 27 14:57:22.784337 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:57:22.784337 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:57:22.784337 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:57:22.784337 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:57:22.784337 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:57:22.784337 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:57:22.784337 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:57:22.784337 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:57:22.784337 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:57:22.785982 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:57:22.785982 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:57:22.785982 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:57:22.785982 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:57:22.785982 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:57:22.785982 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 27 14:57:22.785982 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.785982 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:22.785982 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.785982 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.785982 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:22.785982 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:22.785982 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:57:22.785982 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:57:22.785982 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 27 14:57:22.785982 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.785982 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cefc8f3d-c9a9-42b3-b1f9-5f09e1ef43d3 tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:22.788033 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cefc8f3d-c9a9-42b3-b1f9-5f09e1ef43d3 tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] 10.222.0.13 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.010089 May 27 14:57:22.788033 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 36/66] 10.222.0.13 () {58 vars in 1148 bytes} [Fri May 27 14:57:22 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 27 14:57:22.792478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3940e1dc-409f-4988-8a7a-02124fe71236 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:22.793087 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:22.793087 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:22.817194 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3940e1dc-409f-4988-8a7a-02124fe71236 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.028807 May 27 14:57:22.824478 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 37/67] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 14:57:22 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 27 14:57:22.831458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b0a69683-188b-447e-8107-56e741876171 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:22.832038 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:22.832038 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:22.839058 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-b0a69683-188b-447e-8107-56e741876171 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] HTTP exception thrown: Aggregate -1 could not be found. May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b0a69683-188b-447e-8107-56e741876171 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Request method failure captured: May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObN7rp0I6xVu3rCSiCFDO27jEzcY80JU-7RphQXeYBWB9VBfn8y2OOFLmaSS9MqF8b0UY8dDCkuHdTzofW3qnEfoS67XNRe1S2pYx3kn61UaZIvWc8fDaF8cF4WxvPo1MgxAHoFQaA93SXqqE0b0O0_is3xZ-i2TKMLpSgPEMOuG1k May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: b7e6fccd7ebd4f25a4f74f11f00b29b8 May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:57:22.841180 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:57:22.842333 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b7e6fccd7ebd4f25a4f74f11f00b29b8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:22.842333 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:22.842333 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: b7e6fccd7ebd4f25a4f74f11f00b29b8 May 27 14:57:22.842333 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:57:22.842333 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin May 27 14:57:22.842333 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:57:22.842333 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:57:22.842333 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: aaecea53d6174f69af450ef16cb2a3ad May 27 14:57:22.842333 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin May 27 14:57:22.842333 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:57:22.842333 n-d-843621-1 devstack@n-api.service[119248]: exception: Aggregate -1 could not be found. May 27 14:57:22.842333 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '-1'} May 27 14:57:22.843030 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:22.843030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.843030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 27 14:57:22.843030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 27 14:57:22.843030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 27 14:57:22.843030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 27 14:57:22.843030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:57:22.843030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:57:22.843030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 27 14:57:22.843030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 27 14:57:22.843030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 14:57:22.843030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 14:57:22.843030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 27 14:57:22.843030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 27 14:57:22.843030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. May 27 14:57:22.843030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.843030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:22.843030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.843030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.843030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:22.844065 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:22.844065 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:22.844065 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:22.844065 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:22.844065 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:22.844065 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 27 14:57:22.844065 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 14:57:22.844065 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. May 27 14:57:22.844065 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.844065 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:22.844065 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.844065 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.844065 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:22.844065 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:22.844065 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:57:22.844065 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:57:22.844065 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. May 27 14:57:22.844065 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.845054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b0a69683-188b-447e-8107-56e741876171 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:22.845054 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b0a69683-188b-447e-8107-56e741876171 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.015606 May 27 14:57:22.845054 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 38/68] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 14:57:22 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 14:57:22.853241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f6d630d8-e722-4c0e-a1cd-9f36c728d481 tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:22.854631 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:22.854631 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:22.855512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f6d630d8-e722-4c0e-a1cd-9f36c728d481 tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '22c2db89f04b4669ab1033a7b4f07248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a2f6c7672e43a5b1cdb309e190d1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f6d630d8-e722-4c0e-a1cd-9f36c728d481 tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Request method failure captured: May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObLHQBpn2vNwAEAFjqioMhYUX1iAIwOHh5gzC-B85g0NFSxUYEuEWkzGOl32RwxADIW-3ia7AeeYkgUOTUZl3Jw14LtRncyt5B-dFnD55w4KdQxYbjT7jKQfYCMIxgpq4KK-LS0j9eCyzPGXWglWda9BcYSvcgF_NBBJlMFSO8zAHE May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: c4a2f6c7672e43a5b1cdb309e190d1e4 May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1975648109 May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:57:22.857117 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:57:22.858263 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c4a2f6c7672e43a5b1cdb309e190d1e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c4a2f6c7672e43a5b1cdb309e190d1e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c4a2f6c7672e43a5b1cdb309e190d1e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c4a2f6c7672e43a5b1cdb309e190d1e4", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:22.858263 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1975648109 May 27 14:57:22.858263 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: c4a2f6c7672e43a5b1cdb309e190d1e4 May 27 14:57:22.858263 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1975648109 May 27 14:57:22.858263 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AggregatesAdminNegativeTestJSON-1975648109-project May 27 14:57:22.858263 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:57:22.858263 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:57:22.858263 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 22c2db89f04b4669ab1033a7b4f07248 May 27 14:57:22.858263 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1975648109-project May 27 14:57:22.858263 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:57:22.858263 n-d-843621-1 devstack@n-api.service[119248]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 27 14:57:22.858263 n-d-843621-1 devstack@n-api.service[119248]: action_args: {} May 27 14:57:22.858901 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:22.858901 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.858901 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:22.858901 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:22.858901 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:22.858901 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:22.858901 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:22.858901 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:22.858901 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index May 27 14:57:22.858901 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) May 27 14:57:22.858901 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:57:22.858901 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:57:22.858901 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:57:22.858901 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:57:22.858901 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:57:22.858901 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:57:22.858901 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:57:22.858901 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:57:22.858901 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:57:22.859878 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:57:22.859878 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:57:22.859878 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:57:22.859878 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:57:22.859878 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:57:22.859878 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 27 14:57:22.859878 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.859878 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:22.859878 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.859878 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:22.859878 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:22.859878 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:22.859878 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:57:22.859878 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:57:22.859878 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 27 14:57:22.859878 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:22.859878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f6d630d8-e722-4c0e-a1cd-9f36c728d481 tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:22.860732 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f6d630d8-e722-4c0e-a1cd-9f36c728d481 tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.010001 May 27 14:57:22.860732 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 39/69] 10.222.0.13 () {58 vars in 1142 bytes} [Fri May 27 14:57:22 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 27 14:57:23.282815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-04fbe2a0-45bd-46d1-a2a5-ddefa94a5b2e tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1803612770", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "availability_zone": "tempest-test_az-1585259917"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:23.294727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04fbe2a0-45bd-46d1-a2a5-ddefa94a5b2e tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:23.295365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04fbe2a0-45bd-46d1-a2a5-ddefa94a5b2e tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:23.296389 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04fbe2a0-45bd-46d1-a2a5-ddefa94a5b2e tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:23.297091 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04fbe2a0-45bd-46d1-a2a5-ddefa94a5b2e tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:23.442220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-04fbe2a0-45bd-46d1-a2a5-ddefa94a5b2e tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] validate_networks() for None {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 14:57:23.522578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3538ba61-fa43-41b4-8a3d-518128e9c8a7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:23.524253 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3538ba61-fa43-41b4-8a3d-518128e9c8a7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:23.532578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3538ba61-fa43-41b4-8a3d-518128e9c8a7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:23.533468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3538ba61-fa43-41b4-8a3d-518128e9c8a7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:23.535345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3538ba61-fa43-41b4-8a3d-518128e9c8a7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:23.536062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3538ba61-fa43-41b4-8a3d-518128e9c8a7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:24.714142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3538ba61-fa43-41b4-8a3d-518128e9c8a7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:24.746334 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3538ba61-fa43-41b4-8a3d-518128e9c8a7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1319 microversion: 2.1 time: 1.239208 May 27 14:57:24.746923 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 40/70] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:23 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1319 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:57:24.774083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-04fbe2a0-45bd-46d1-a2a5-ddefa94a5b2e tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:57:24.775131 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-04fbe2a0-45bd-46d1-a2a5-ddefa94a5b2e tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:57:24.775819 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-04fbe2a0-45bd-46d1-a2a5-ddefa94a5b2e tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:57:24.776536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-04fbe2a0-45bd-46d1-a2a5-ddefa94a5b2e tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:57:24.777132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-04fbe2a0-45bd-46d1-a2a5-ddefa94a5b2e tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:57:24.810894 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04fbe2a0-45bd-46d1-a2a5-ddefa94a5b2e tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:24.811544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04fbe2a0-45bd-46d1-a2a5-ddefa94a5b2e tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:24.812520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04fbe2a0-45bd-46d1-a2a5-ddefa94a5b2e tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:24.813166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04fbe2a0-45bd-46d1-a2a5-ddefa94a5b2e tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:24.852802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-04fbe2a0-45bd-46d1-a2a5-ddefa94a5b2e tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Getting quotas for project 2e8ad802697947bbbd44c9a3eff36880. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:57:24.862091 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-04fbe2a0-45bd-46d1-a2a5-ddefa94a5b2e tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Getting quotas for user 852d9fd26d404e0b8ff560657e187c7a and project 2e8ad802697947bbbd44c9a3eff36880. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:57:24.895815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-04fbe2a0-45bd-46d1-a2a5-ddefa94a5b2e tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 14:57:24.903091 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-04fbe2a0-45bd-46d1-a2a5-ddefa94a5b2e tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 14:57:25.005685 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-04fbe2a0-45bd-46d1-a2a5-ddefa94a5b2e tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.418372 May 27 14:57:25.012798 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 31/71] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:57:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 14:57:25.023294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bb80412a-eced-4b7a-9b80-a6306dbb2cfd tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:25.025069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bb80412a-eced-4b7a-9b80-a6306dbb2cfd tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:25.266276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bb80412a-eced-4b7a-9b80-a6306dbb2cfd tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:25.276707 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bb80412a-eced-4b7a-9b80-a6306dbb2cfd tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1243 microversion: 2.1 time: 0.261666 May 27 14:57:25.281935 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 41/72] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:25 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1243 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:25.769518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1d4ed795-536d-4cec-89ec-36d6fc0b598a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:25.770437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1d4ed795-536d-4cec-89ec-36d6fc0b598a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:25.783782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d4ed795-536d-4cec-89ec-36d6fc0b598a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:25.786724 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d4ed795-536d-4cec-89ec-36d6fc0b598a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:25.799274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d4ed795-536d-4cec-89ec-36d6fc0b598a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:25.799991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d4ed795-536d-4cec-89ec-36d6fc0b598a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:26.243316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1d4ed795-536d-4cec-89ec-36d6fc0b598a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:26.265733 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1d4ed795-536d-4cec-89ec-36d6fc0b598a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1319 microversion: 2.1 time: 0.501194 May 27 14:57:26.266349 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 32/73] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:25 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1319 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:26.296512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9f32668e-71bc-41ba-8629-b8daa76a1fd2 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:26.297090 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9f32668e-71bc-41ba-8629-b8daa76a1fd2 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:26.446649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9f32668e-71bc-41ba-8629-b8daa76a1fd2 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:26.462245 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9f32668e-71bc-41ba-8629-b8daa76a1fd2 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1243 microversion: 2.1 time: 0.166704 May 27 14:57:26.464738 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 42/74] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:26 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1243 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:26.755615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1d4ed795-536d-4cec-89ec-36d6fc0b598a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:26.757089 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1d4ed795-536d-4cec-89ec-36d6fc0b598a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002141 May 27 14:57:26.757654 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 33/75] 10.222.0.13 () {56 vars in 885 bytes} [Fri May 27 14:57:26 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 27 14:57:27.283875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-53a099c7-068b-448d-9c03-0b4dec8ab0ba tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:27.284490 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-53a099c7-068b-448d-9c03-0b4dec8ab0ba tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:27.306233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53a099c7-068b-448d-9c03-0b4dec8ab0ba tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:27.309902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53a099c7-068b-448d-9c03-0b4dec8ab0ba tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:27.311206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53a099c7-068b-448d-9c03-0b4dec8ab0ba tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:27.313339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53a099c7-068b-448d-9c03-0b4dec8ab0ba tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:27.493501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2524d339-fd0f-4178-b869-6a7ffce7ec7f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:27.494790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2524d339-fd0f-4178-b869-6a7ffce7ec7f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:27.506101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2524d339-fd0f-4178-b869-6a7ffce7ec7f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:27.513744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2524d339-fd0f-4178-b869-6a7ffce7ec7f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:27.515463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2524d339-fd0f-4178-b869-6a7ffce7ec7f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:27.522365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2524d339-fd0f-4178-b869-6a7ffce7ec7f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:27.850694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2524d339-fd0f-4178-b869-6a7ffce7ec7f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:27.860008 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2524d339-fd0f-4178-b869-6a7ffce7ec7f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1291 microversion: 2.1 time: 0.380135 May 27 14:57:27.864659 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 34/76] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:27 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1291 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:27.882911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-53a099c7-068b-448d-9c03-0b4dec8ab0ba tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:27.892383 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-53a099c7-068b-448d-9c03-0b4dec8ab0ba tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1319 microversion: 2.1 time: 0.612231 May 27 14:57:27.899682 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 43/77] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:27 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1319 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:28.881371 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-44bf27d4-6123-49d5-a879-170eaef8707f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:28.881988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-44bf27d4-6123-49d5-a879-170eaef8707f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:28.891941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44bf27d4-6123-49d5-a879-170eaef8707f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:28.892063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44bf27d4-6123-49d5-a879-170eaef8707f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:28.893428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44bf27d4-6123-49d5-a879-170eaef8707f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:28.893428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44bf27d4-6123-49d5-a879-170eaef8707f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:29.055362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-44bf27d4-6123-49d5-a879-170eaef8707f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:29.067358 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-44bf27d4-6123-49d5-a879-170eaef8707f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1297 microversion: 2.1 time: 0.189800 May 27 14:57:29.082057 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 35/78] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:28 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1297 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:29.109299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-94a84844-5d98-417c-a22e-31d70948bf85 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:29.113012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-94a84844-5d98-417c-a22e-31d70948bf85 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:29.123344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94a84844-5d98-417c-a22e-31d70948bf85 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:29.125322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94a84844-5d98-417c-a22e-31d70948bf85 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:29.128552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94a84844-5d98-417c-a22e-31d70948bf85 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:29.129223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94a84844-5d98-417c-a22e-31d70948bf85 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:29.477413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-94a84844-5d98-417c-a22e-31d70948bf85 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:29.497979 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-94a84844-5d98-417c-a22e-31d70948bf85 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1319 microversion: 2.1 time: 0.405497 May 27 14:57:29.502625 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 36/79] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:29 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:29.664050 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-753f8c74-fdb3-48b1-aa8a-4d99f92d70e1 req-bcd4a2cf-07d5-4e76-91d0-c4648e90e775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6308b60c-6cce-4b7b-a8ec-a683a03f0fcc", "tag": "262bc22d-3099-4c20-95f0-39c2553c5754"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:29.690601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-753f8c74-fdb3-48b1-aa8a-4d99f92d70e1 req-bcd4a2cf-07d5-4e76-91d0-c4648e90e775 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:29.691623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-753f8c74-fdb3-48b1-aa8a-4d99f92d70e1 req-bcd4a2cf-07d5-4e76-91d0-c4648e90e775 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:29.751687 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-753f8c74-fdb3-48b1-aa8a-4d99f92d70e1 req-bcd4a2cf-07d5-4e76-91d0-c4648e90e775 service nova] Creating event network-changed:262bc22d-3099-4c20-95f0-39c2553c5754 for instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc on n-h1-843621-1 May 27 14:57:29.753708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-753f8c74-fdb3-48b1-aa8a-4d99f92d70e1 req-bcd4a2cf-07d5-4e76-91d0-c4648e90e775 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119248) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 14:57:29.760654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-40e2a5d7-1df8-4250-b4d3-b18f4ab4f444 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:29.761153 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-40e2a5d7-1df8-4250-b4d3-b18f4ab4f444 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:29.761983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-40e2a5d7-1df8-4250-b4d3-b18f4ab4f444 None None] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:29.762598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-40e2a5d7-1df8-4250-b4d3-b18f4ab4f444 None None] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:29.783826 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.compute.rpcapi [None req-40e2a5d7-1df8-4250-b4d3-b18f4ab4f444 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 27 14:57:29.790946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-40e2a5d7-1df8-4250-b4d3-b18f4ab4f444 None None] Releasing lock "compute-rpcapi-router" {{(pid=119248) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 14:57:29.825221 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-40e2a5d7-1df8-4250-b4d3-b18f4ab4f444 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.923040 May 27 14:57:29.826348 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 44/80] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 14:57:30.090657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-58ab3780-b552-415a-9c9f-78ed98a85a42 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:30.092849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-58ab3780-b552-415a-9c9f-78ed98a85a42 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:30.110922 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58ab3780-b552-415a-9c9f-78ed98a85a42 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:30.113030 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58ab3780-b552-415a-9c9f-78ed98a85a42 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:30.114936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58ab3780-b552-415a-9c9f-78ed98a85a42 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:30.115430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58ab3780-b552-415a-9c9f-78ed98a85a42 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:30.255025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-58ab3780-b552-415a-9c9f-78ed98a85a42 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:30.273335 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-58ab3780-b552-415a-9c9f-78ed98a85a42 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1297 microversion: 2.1 time: 0.189049 May 27 14:57:30.291193 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 37/81] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:30 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1297 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:30.521642 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-98fdcec3-b8e2-41a4-9c74-7b45690e3c1f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:30.522852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-98fdcec3-b8e2-41a4-9c74-7b45690e3c1f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:30.547413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98fdcec3-b8e2-41a4-9c74-7b45690e3c1f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:30.548207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98fdcec3-b8e2-41a4-9c74-7b45690e3c1f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:30.549589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98fdcec3-b8e2-41a4-9c74-7b45690e3c1f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:30.554238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98fdcec3-b8e2-41a4-9c74-7b45690e3c1f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:31.183451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-98fdcec3-b8e2-41a4-9c74-7b45690e3c1f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:31.197278 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-98fdcec3-b8e2-41a4-9c74-7b45690e3c1f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1319 microversion: 2.1 time: 0.679724 May 27 14:57:31.199268 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 45/82] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:30 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1319 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:31.298847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-70d5533d-ae6e-4e94-98a9-5390d12ae8e0 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:31.300328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-70d5533d-ae6e-4e94-98a9-5390d12ae8e0 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:31.313103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70d5533d-ae6e-4e94-98a9-5390d12ae8e0 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:31.313764 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70d5533d-ae6e-4e94-98a9-5390d12ae8e0 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:31.314746 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70d5533d-ae6e-4e94-98a9-5390d12ae8e0 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:31.315486 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70d5533d-ae6e-4e94-98a9-5390d12ae8e0 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:31.771230 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-70d5533d-ae6e-4e94-98a9-5390d12ae8e0 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:31.784471 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-70d5533d-ae6e-4e94-98a9-5390d12ae8e0 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1339 microversion: 2.1 time: 0.489790 May 27 14:57:31.788389 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 38/83] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:31 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1339 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:32.224808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2ae1162e-8038-421b-b1e0-d311d0984c6a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:32.225657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2ae1162e-8038-421b-b1e0-d311d0984c6a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:32.242129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2ae1162e-8038-421b-b1e0-d311d0984c6a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:32.243911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2ae1162e-8038-421b-b1e0-d311d0984c6a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:32.245099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2ae1162e-8038-421b-b1e0-d311d0984c6a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:32.246622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2ae1162e-8038-421b-b1e0-d311d0984c6a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:32.709220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2ae1162e-8038-421b-b1e0-d311d0984c6a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:32.723253 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2ae1162e-8038-421b-b1e0-d311d0984c6a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1319 microversion: 2.1 time: 0.509343 May 27 14:57:32.735690 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 39/84] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:32 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1319 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:32.807265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-93a15534-e170-4f5f-86e7-b62466c2cde3 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:32.808127 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-93a15534-e170-4f5f-86e7-b62466c2cde3 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:32.830652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93a15534-e170-4f5f-86e7-b62466c2cde3 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:32.831127 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93a15534-e170-4f5f-86e7-b62466c2cde3 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:32.831950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93a15534-e170-4f5f-86e7-b62466c2cde3 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:32.843185 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93a15534-e170-4f5f-86e7-b62466c2cde3 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:32.974991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a233136c-09e8-49bd-95b4-2dc52c1cd66c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-967535517", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:33.252368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-93a15534-e170-4f5f-86e7-b62466c2cde3 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:33.266852 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-93a15534-e170-4f5f-86e7-b62466c2cde3 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1339 microversion: 2.1 time: 0.465065 May 27 14:57:33.271819 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 40/85] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:32 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1339 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:33.746510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f0f3f595-3075-4972-b84f-962f391491cf tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:33.748016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f0f3f595-3075-4972-b84f-962f391491cf tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:33.774331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0f3f595-3075-4972-b84f-962f391491cf tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:33.775179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0f3f595-3075-4972-b84f-962f391491cf tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:33.776936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0f3f595-3075-4972-b84f-962f391491cf tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:33.779768 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0f3f595-3075-4972-b84f-962f391491cf tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:34.070487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f0f3f595-3075-4972-b84f-962f391491cf tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:34.086597 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f0f3f595-3075-4972-b84f-962f391491cf tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1319 microversion: 2.1 time: 0.345790 May 27 14:57:34.098263 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 41/86] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:33 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:34.377164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aa93df6b-9da5-48a0-9be1-fed63ff04cc2 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Calling method '.version_select at 0x7fc77c12cf70>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:34.379823 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:34.379823 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:34.381038 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa93df6b-9da5-48a0-9be1-fed63ff04cc2 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:34.382203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa93df6b-9da5-48a0-9be1-fed63ff04cc2 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:34.383345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa93df6b-9da5-48a0-9be1-fed63ff04cc2 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:34.383798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa93df6b-9da5-48a0-9be1-fed63ff04cc2 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:34.439548 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-aa93df6b-9da5-48a0-9be1-fed63ff04cc2 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.339864 May 27 14:57:34.459778 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 42/87] 10.222.0.13 () {58 vars in 1127 bytes} [Fri May 27 14:57:34 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:34.478278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e43aee53-1616-4df6-afc4-8822f524b9e8 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:34.481375 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e43aee53-1616-4df6-afc4-8822f524b9e8 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:34.499436 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e43aee53-1616-4df6-afc4-8822f524b9e8 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:34.500313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e43aee53-1616-4df6-afc4-8822f524b9e8 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:34.501742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e43aee53-1616-4df6-afc4-8822f524b9e8 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:34.503695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e43aee53-1616-4df6-afc4-8822f524b9e8 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:34.871729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e43aee53-1616-4df6-afc4-8822f524b9e8 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:34.878682 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:34.893306 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e43aee53-1616-4df6-afc4-8822f524b9e8 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1339 microversion: 2.1 time: 0.430173 May 27 14:57:34.896865 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 43/88] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:34 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1339 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:34.917837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-87fbe1a3-ac97-497e-aacf-4946790db0f7 req-ce2c2c10-84b5-4f0a-98cd-1185d01a3d4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8", "tag": "81242489-b7cd-4e69-8684-73049292e7a8"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:34.957239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-87fbe1a3-ac97-497e-aacf-4946790db0f7 req-ce2c2c10-84b5-4f0a-98cd-1185d01a3d4e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:34.959364 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-87fbe1a3-ac97-497e-aacf-4946790db0f7 req-ce2c2c10-84b5-4f0a-98cd-1185d01a3d4e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:35.018839 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-87fbe1a3-ac97-497e-aacf-4946790db0f7 req-ce2c2c10-84b5-4f0a-98cd-1185d01a3d4e service nova] Creating event network-changed:81242489-b7cd-4e69-8684-73049292e7a8 for instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 on n-h2-843621-1 May 27 14:57:35.019977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-87fbe1a3-ac97-497e-aacf-4946790db0f7 req-ce2c2c10-84b5-4f0a-98cd-1185d01a3d4e service nova] Acquired lock "compute-rpcapi-router" {{(pid=119249) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 14:57:35.022548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-60d55e57-f3e9-41ed-8141-415e6b541eaf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:35.029044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-60d55e57-f3e9-41ed-8141-415e6b541eaf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:35.030600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-60d55e57-f3e9-41ed-8141-415e6b541eaf None None] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:35.033227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-60d55e57-f3e9-41ed-8141-415e6b541eaf None None] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:35.052987 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:35.066134 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.compute.rpcapi [None req-60d55e57-f3e9-41ed-8141-415e6b541eaf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 27 14:57:35.071821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-60d55e57-f3e9-41ed-8141-415e6b541eaf None None] Releasing lock "compute-rpcapi-router" {{(pid=119249) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 14:57:35.122064 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-60d55e57-f3e9-41ed-8141-415e6b541eaf None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221612 May 27 14:57:35.123394 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 44/89] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:35.137324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-80cbeff9-2f16-4bed-8ebd-9991cd4ea233 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Calling method '.version_select at 0x7fc77c0f5430>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:35.140176 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:35.140176 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:35.144358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-80cbeff9-2f16-4bed-8ebd-9991cd4ea233 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:35.145987 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-80cbeff9-2f16-4bed-8ebd-9991cd4ea233 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:35.150795 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-80cbeff9-2f16-4bed-8ebd-9991cd4ea233 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:35.154429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-80cbeff9-2f16-4bed-8ebd-9991cd4ea233 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:35.226914 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-80cbeff9-2f16-4bed-8ebd-9991cd4ea233 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.100989 May 27 14:57:35.229302 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 45/90] 10.222.0.13 () {58 vars in 1138 bytes} [Fri May 27 14:57:35 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:35.257825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4559790c-d980-47fd-8c99-746467a3f017 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:35.259364 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4559790c-d980-47fd-8c99-746467a3f017 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:35.271548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:DELETE=7 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:35.274707 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4559790c-d980-47fd-8c99-746467a3f017 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:35.275161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4559790c-d980-47fd-8c99-746467a3f017 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:35.277369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4559790c-d980-47fd-8c99-746467a3f017 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:35.277824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4559790c-d980-47fd-8c99-746467a3f017 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:35.905506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4559790c-d980-47fd-8c99-746467a3f017 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:35.927873 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4559790c-d980-47fd-8c99-746467a3f017 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1319 microversion: 2.1 time: 0.694114 May 27 14:57:35.928662 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 46/91] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:35 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1319 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:35.948047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c5638553-a30b-465d-b6ec-bc397b7b14b6 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Calling method '.version_select at 0x7fc77c0d9f70>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:35.949502 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:35.949502 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:35.966397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c5638553-a30b-465d-b6ec-bc397b7b14b6 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:35.966874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c5638553-a30b-465d-b6ec-bc397b7b14b6 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:35.974097 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c5638553-a30b-465d-b6ec-bc397b7b14b6 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:35.975387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c5638553-a30b-465d-b6ec-bc397b7b14b6 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:36.008205 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c5638553-a30b-465d-b6ec-bc397b7b14b6 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.078329 May 27 14:57:36.015286 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 47/92] 10.222.0.13 () {58 vars in 1144 bytes} [Fri May 27 14:57:35 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 14:57:36.020602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-90bf08cc-f441-4b44-8b3a-efd74733becd tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:36.021507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-90bf08cc-f441-4b44-8b3a-efd74733becd tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:36.030272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90bf08cc-f441-4b44-8b3a-efd74733becd tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:36.031700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90bf08cc-f441-4b44-8b3a-efd74733becd tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:36.034720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90bf08cc-f441-4b44-8b3a-efd74733becd tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:36.036770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90bf08cc-f441-4b44-8b3a-efd74733becd tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:36.223474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-90bf08cc-f441-4b44-8b3a-efd74733becd tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:36.235457 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-90bf08cc-f441-4b44-8b3a-efd74733becd tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1339 microversion: 2.1 time: 0.218862 May 27 14:57:36.240722 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 48/93] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:36 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1339 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:36.456682 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=12 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:36.695994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b3b9b98a-9ce8-46e6-9ca5-710fc36bbb09 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Calling method '.version_select at 0x7fc77c262160>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:36.700118 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:36.700118 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:36.700118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3b9b98a-9ce8-46e6-9ca5-710fc36bbb09 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:36.701629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3b9b98a-9ce8-46e6-9ca5-710fc36bbb09 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:36.742572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3b9b98a-9ce8-46e6-9ca5-710fc36bbb09 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:36.743119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3b9b98a-9ce8-46e6-9ca5-710fc36bbb09 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:36.767069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3b9b98a-9ce8-46e6-9ca5-710fc36bbb09 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:36.767868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3b9b98a-9ce8-46e6-9ca5-710fc36bbb09 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:36.777772 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b3b9b98a-9ce8-46e6-9ca5-710fc36bbb09 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.320895 May 27 14:57:36.790480 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 49/94] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:36.797006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-831dc7ff-6d7d-4be3-88bc-c072b3d3af2a tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Calling method '.version_select at 0x7fc77c0f5d30>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:36.798525 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:36.798525 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:36.800132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-831dc7ff-6d7d-4be3-88bc-c072b3d3af2a tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:36.800826 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-831dc7ff-6d7d-4be3-88bc-c072b3d3af2a tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:36.867395 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-831dc7ff-6d7d-4be3-88bc-c072b3d3af2a tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:36.868400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-831dc7ff-6d7d-4be3-88bc-c072b3d3af2a tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:36.923034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-831dc7ff-6d7d-4be3-88bc-c072b3d3af2a tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:36.924279 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-831dc7ff-6d7d-4be3-88bc-c072b3d3af2a tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:36.942090 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-831dc7ff-6d7d-4be3-88bc-c072b3d3af2a tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.149909 May 27 14:57:36.957836 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 50/95] 10.222.0.13 () {58 vars in 1166 bytes} [Fri May 27 14:57:36 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:36.966229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-59b9ad09-38e5-4c6d-9ef2-e9ae4997ec3e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:36.967682 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-59b9ad09-38e5-4c6d-9ef2-e9ae4997ec3e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:36.980226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-59b9ad09-38e5-4c6d-9ef2-e9ae4997ec3e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:36.980951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-59b9ad09-38e5-4c6d-9ef2-e9ae4997ec3e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:36.981975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-59b9ad09-38e5-4c6d-9ef2-e9ae4997ec3e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:36.982547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-59b9ad09-38e5-4c6d-9ef2-e9ae4997ec3e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:37.274779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-59b9ad09-38e5-4c6d-9ef2-e9ae4997ec3e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:37.291672 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-59b9ad09-38e5-4c6d-9ef2-e9ae4997ec3e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1319 microversion: 2.1 time: 0.332104 May 27 14:57:37.292953 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 51/96] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:36 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:37.307742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9878bdd1-89d6-4cfb-9786-0cc93c446295 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Calling method '.version_select at 0x7fc77c0d9670>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:37.308810 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:37.308810 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:37.310444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9878bdd1-89d6-4cfb-9786-0cc93c446295 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:37.311179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9878bdd1-89d6-4cfb-9786-0cc93c446295 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:37.347724 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9878bdd1-89d6-4cfb-9786-0cc93c446295 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:37.348508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9878bdd1-89d6-4cfb-9786-0cc93c446295 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:37.392162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9878bdd1-89d6-4cfb-9786-0cc93c446295 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:37.392644 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9878bdd1-89d6-4cfb-9786-0cc93c446295 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:37.405501 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9878bdd1-89d6-4cfb-9786-0cc93c446295 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.110650 May 27 14:57:37.406441 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 52/97] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:37.411572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-83d5caa6-5203-4c20-993a-ef248a800b1d tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:37.412582 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-83d5caa6-5203-4c20-993a-ef248a800b1d tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:37.424717 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-83d5caa6-5203-4c20-993a-ef248a800b1d tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:37.425173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-83d5caa6-5203-4c20-993a-ef248a800b1d tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:37.425942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-83d5caa6-5203-4c20-993a-ef248a800b1d tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:37.426984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-83d5caa6-5203-4c20-993a-ef248a800b1d tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:37.701723 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-83d5caa6-5203-4c20-993a-ef248a800b1d tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:37.710584 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-83d5caa6-5203-4c20-993a-ef248a800b1d tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1339 microversion: 2.1 time: 0.303106 May 27 14:57:37.712071 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 53/98] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:37 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1339 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:37.720426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-09f9a0c1-814f-47d3-abc9-882b97f68d9c tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Calling method '.version_select at 0x7fc77c097c10>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:37.721273 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:37.721273 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:37.729652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09f9a0c1-814f-47d3-abc9-882b97f68d9c tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:37.732573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09f9a0c1-814f-47d3-abc9-882b97f68d9c tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:37.777063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09f9a0c1-814f-47d3-abc9-882b97f68d9c tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:37.777524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09f9a0c1-814f-47d3-abc9-882b97f68d9c tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:37.796984 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-09f9a0c1-814f-47d3-abc9-882b97f68d9c tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.083784 May 27 14:57:37.797736 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 54/99] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 14:57:37 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:37.819452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fc5c10bd-100b-487c-b79a-0e3c6afb761c tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Calling method '.version_select at 0x7fc77c0f5310>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:37.820245 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:37.820245 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:37.821436 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc5c10bd-100b-487c-b79a-0e3c6afb761c tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:37.821901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc5c10bd-100b-487c-b79a-0e3c6afb761c tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:37.863073 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fc5c10bd-100b-487c-b79a-0e3c6afb761c tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.056251 May 27 14:57:37.870564 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 55/100] 10.222.0.13 () {58 vars in 1178 bytes} [Fri May 27 14:57:37 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:37.881015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2a055585-ad4e-459d-ba1b-bef0b40dde42 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Calling method '.version_select at 0x7fc77c0f5940>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:37.881961 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:37.881961 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:37.883254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a055585-ad4e-459d-ba1b-bef0b40dde42 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:37.883696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a055585-ad4e-459d-ba1b-bef0b40dde42 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:37.922662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a055585-ad4e-459d-ba1b-bef0b40dde42 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:37.923154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a055585-ad4e-459d-ba1b-bef0b40dde42 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:37.942674 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a055585-ad4e-459d-ba1b-bef0b40dde42 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:37.943132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a055585-ad4e-459d-ba1b-bef0b40dde42 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:37.956270 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2a055585-ad4e-459d-ba1b-bef0b40dde42 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.084464 May 27 14:57:37.961578 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 56/101] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:37.968361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a3c70c6e-2a29-4006-b734-865c2d96e7c7 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Calling method '.version_select at 0x7fc77c0973a0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:37.969224 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:37.969224 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:37.970404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3c70c6e-2a29-4006-b734-865c2d96e7c7 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:37.970853 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3c70c6e-2a29-4006-b734-865c2d96e7c7 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:38.041588 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3c70c6e-2a29-4006-b734-865c2d96e7c7 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:38.043790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3c70c6e-2a29-4006-b734-865c2d96e7c7 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:38.065760 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-a233136c-09e8-49bd-95b4-2dc52c1cd66c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] validate_networks() for None {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 14:57:38.089532 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a3c70c6e-2a29-4006-b734-865c2d96e7c7 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.126634 May 27 14:57:38.091233 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 57/102] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 14:57:37 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:38.108839 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ba65cba5-e91a-4d32-91b8-031795b154d1 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Calling method '.version_select at 0x7fc77c097c10>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:38.112175 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:38.112175 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:38.114287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ba65cba5-e91a-4d32-91b8-031795b154d1 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:38.115897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ba65cba5-e91a-4d32-91b8-031795b154d1 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:38.145954 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ba65cba5-e91a-4d32-91b8-031795b154d1 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:38.146858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ba65cba5-e91a-4d32-91b8-031795b154d1 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:38.159002 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ba65cba5-e91a-4d32-91b8-031795b154d1 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.058624 May 27 14:57:38.160924 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 58/103] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 14:57:38 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:38.185100 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f4736bae-ba5d-4c81-908a-b752668536a2 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Calling method '.version_select at 0x7fc77c097940>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:38.191171 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:38.191171 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:38.193269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4736bae-ba5d-4c81-908a-b752668536a2 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:38.194251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4736bae-ba5d-4c81-908a-b752668536a2 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:38.222857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4736bae-ba5d-4c81-908a-b752668536a2 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:38.223562 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4736bae-ba5d-4c81-908a-b752668536a2 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:38.253842 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4736bae-ba5d-4c81-908a-b752668536a2 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:38.255559 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4736bae-ba5d-4c81-908a-b752668536a2 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:38.453966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a233136c-09e8-49bd-95b4-2dc52c1cd66c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:57:38.454465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a233136c-09e8-49bd-95b4-2dc52c1cd66c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:57:38.455009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a233136c-09e8-49bd-95b4-2dc52c1cd66c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:57:38.455631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a233136c-09e8-49bd-95b4-2dc52c1cd66c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:57:38.456125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a233136c-09e8-49bd-95b4-2dc52c1cd66c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:57:38.471405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a233136c-09e8-49bd-95b4-2dc52c1cd66c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:38.477208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a233136c-09e8-49bd-95b4-2dc52c1cd66c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:38.478660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a233136c-09e8-49bd-95b4-2dc52c1cd66c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:38.479325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a233136c-09e8-49bd-95b4-2dc52c1cd66c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:38.527609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-a233136c-09e8-49bd-95b4-2dc52c1cd66c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Getting quotas for project 7369228028774765965f3cf001f8806a. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:57:38.537225 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-a233136c-09e8-49bd-95b4-2dc52c1cd66c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Getting quotas for user a5a825c2385e490d81ddcbc2de76980d and project 7369228028774765965f3cf001f8806a. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:57:38.584150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a233136c-09e8-49bd-95b4-2dc52c1cd66c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 14:57:38.587281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a233136c-09e8-49bd-95b4-2dc52c1cd66c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 14:57:38.686805 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a233136c-09e8-49bd-95b4-2dc52c1cd66c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.508381 May 27 14:57:38.690302 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 46/104] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:57:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 6513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 14:57:38.700104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c47fff35-9e17-49d0-bd5f-d5d3b1ed0643 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:38.704579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c47fff35-9e17-49d0-bd5f-d5d3b1ed0643 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:38.729349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c47fff35-9e17-49d0-bd5f-d5d3b1ed0643 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:38.754021 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c47fff35-9e17-49d0-bd5f-d5d3b1ed0643 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:38.755071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c47fff35-9e17-49d0-bd5f-d5d3b1ed0643 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:38.758108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c47fff35-9e17-49d0-bd5f-d5d3b1ed0643 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:38.961946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c47fff35-9e17-49d0-bd5f-d5d3b1ed0643 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:38.972025 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c47fff35-9e17-49d0-bd5f-d5d3b1ed0643 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1319 microversion: 2.1 time: 0.279541 May 27 14:57:38.973236 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 47/105] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:38 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:38.978842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e3764311-7b9e-486a-9dac-96130d363ffb tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:38.979463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e3764311-7b9e-486a-9dac-96130d363ffb tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:38.988812 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=9,nova_api:DELETE=8 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:39.051401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e3764311-7b9e-486a-9dac-96130d363ffb tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:39.060190 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e3764311-7b9e-486a-9dac-96130d363ffb tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1212 microversion: 2.1 time: 0.085753 May 27 14:57:39.060913 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 48/106] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:38 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1212 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:39.072932 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-37822446-28fc-4511-a060-5d4cb5d8ff8a tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:39.074461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-37822446-28fc-4511-a060-5d4cb5d8ff8a tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:39.089663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-37822446-28fc-4511-a060-5d4cb5d8ff8a tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:39.090116 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-37822446-28fc-4511-a060-5d4cb5d8ff8a tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:39.091311 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-37822446-28fc-4511-a060-5d4cb5d8ff8a tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:39.092009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-37822446-28fc-4511-a060-5d4cb5d8ff8a tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:39.243299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-37822446-28fc-4511-a060-5d4cb5d8ff8a tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:39.251312 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-37822446-28fc-4511-a060-5d4cb5d8ff8a tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1339 microversion: 2.1 time: 0.189367 May 27 14:57:39.251893 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 49/107] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:39 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1339 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:39.390030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-189b7e4d-3084-4151-a48b-c039586aa387 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-207211384", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "0ccca6c3-83b2-4106-9cbd-795a4836060e"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:39.440621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-189b7e4d-3084-4151-a48b-c039586aa387 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] validate_networks() for [('0ccca6c3-83b2-4106-9cbd-795a4836060e', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 14:57:39.809908 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f4736bae-ba5d-4c81-908a-b752668536a2 tempest-HypervisorAdminTestJSON-908550227 tempest-HypervisorAdminTestJSON-908550227-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 1.639211 May 27 14:57:39.816437 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 59/108] 10.222.0.13 () {58 vars in 1172 bytes} [Fri May 27 14:57:38 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:39.879705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fe57f59f-fe44-4f5f-a9a4-7e14c6e6523d tempest-AZAdminV2TestJSON-420424939 tempest-AZAdminV2TestJSON-420424939-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:39.881653 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe57f59f-fe44-4f5f-a9a4-7e14c6e6523d tempest-AZAdminV2TestJSON-420424939 tempest-AZAdminV2TestJSON-420424939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:39.882109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe57f59f-fe44-4f5f-a9a4-7e14c6e6523d tempest-AZAdminV2TestJSON-420424939 tempest-AZAdminV2TestJSON-420424939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:39.882971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe57f59f-fe44-4f5f-a9a4-7e14c6e6523d tempest-AZAdminV2TestJSON-420424939 tempest-AZAdminV2TestJSON-420424939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:39.883406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe57f59f-fe44-4f5f-a9a4-7e14c6e6523d tempest-AZAdminV2TestJSON-420424939 tempest-AZAdminV2TestJSON-420424939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:39.919321 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fe57f59f-fe44-4f5f-a9a4-7e14c6e6523d tempest-AZAdminV2TestJSON-420424939 tempest-AZAdminV2TestJSON-420424939-project-admin] 10.222.0.13 "GET /compute/v2.1/os-availability-zone" status: 200 len: 190 microversion: 2.1 time: 0.101185 May 27 14:57:39.920208 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 60/109] 10.222.0.13 () {58 vars in 1163 bytes} [Fri May 27 14:57:39 2022] GET /compute/v2.1/os-availability-zone => generated 190 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:39.932133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-64090056-015e-4cc7-8f3c-54413e666c37 tempest-AZAdminV2TestJSON-420424939 tempest-AZAdminV2TestJSON-420424939-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:39.933755 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:39.933755 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:39.935153 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64090056-015e-4cc7-8f3c-54413e666c37 tempest-AZAdminV2TestJSON-420424939 tempest-AZAdminV2TestJSON-420424939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:39.935828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64090056-015e-4cc7-8f3c-54413e666c37 tempest-AZAdminV2TestJSON-420424939 tempest-AZAdminV2TestJSON-420424939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:39.936893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64090056-015e-4cc7-8f3c-54413e666c37 tempest-AZAdminV2TestJSON-420424939 tempest-AZAdminV2TestJSON-420424939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:39.938157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64090056-015e-4cc7-8f3c-54413e666c37 tempest-AZAdminV2TestJSON-420424939 tempest-AZAdminV2TestJSON-420424939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:39.968331 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-64090056-015e-4cc7-8f3c-54413e666c37 tempest-AZAdminV2TestJSON-420424939 tempest-AZAdminV2TestJSON-420424939-project-admin] 10.222.0.13 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 701 microversion: 2.1 time: 0.039957 May 27 14:57:39.969184 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 61/110] 10.222.0.13 () {58 vars in 1184 bytes} [Fri May 27 14:57:39 2022] GET /compute/v2.1/os-availability-zone/detail => generated 701 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:39.989838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9f8e4aeb-d5ff-4ecd-b6f4-b7c979727f70 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:39.990871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9f8e4aeb-d5ff-4ecd-b6f4-b7c979727f70 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:39.998702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f8e4aeb-d5ff-4ecd-b6f4-b7c979727f70 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:39.999458 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f8e4aeb-d5ff-4ecd-b6f4-b7c979727f70 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:40.000429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f8e4aeb-d5ff-4ecd-b6f4-b7c979727f70 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:40.001069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f8e4aeb-d5ff-4ecd-b6f4-b7c979727f70 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:40.241484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9f8e4aeb-d5ff-4ecd-b6f4-b7c979727f70 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:40.251728 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9f8e4aeb-d5ff-4ecd-b6f4-b7c979727f70 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1319 microversion: 2.1 time: 0.266240 May 27 14:57:40.255894 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 62/111] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:39 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:57:40.265138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-556b5538-1744-4489-a347-352e6b6499d7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:40.268830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-556b5538-1744-4489-a347-352e6b6499d7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:40.276137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-556b5538-1744-4489-a347-352e6b6499d7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:40.277073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-556b5538-1744-4489-a347-352e6b6499d7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:40.277957 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-556b5538-1744-4489-a347-352e6b6499d7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:40.278614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-556b5538-1744-4489-a347-352e6b6499d7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:40.376868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-556b5538-1744-4489-a347-352e6b6499d7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:40.385671 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-556b5538-1744-4489-a347-352e6b6499d7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1282 microversion: 2.1 time: 0.127893 May 27 14:57:40.396153 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 63/112] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:40 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:40.404722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-505b2b9a-cd3b-4642-a153-f8df34d1ba11 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:40.407439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-505b2b9a-cd3b-4642-a153-f8df34d1ba11 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:40.418083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-505b2b9a-cd3b-4642-a153-f8df34d1ba11 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:40.419678 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-505b2b9a-cd3b-4642-a153-f8df34d1ba11 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:40.420495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-505b2b9a-cd3b-4642-a153-f8df34d1ba11 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:40.421509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-505b2b9a-cd3b-4642-a153-f8df34d1ba11 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:40.544295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-189b7e4d-3084-4151-a48b-c039586aa387 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:57:40.544944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-189b7e4d-3084-4151-a48b-c039586aa387 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:57:40.545347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-189b7e4d-3084-4151-a48b-c039586aa387 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:57:40.546074 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-189b7e4d-3084-4151-a48b-c039586aa387 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:57:40.546745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-189b7e4d-3084-4151-a48b-c039586aa387 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:57:40.558965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-189b7e4d-3084-4151-a48b-c039586aa387 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:40.559683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-189b7e4d-3084-4151-a48b-c039586aa387 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:40.561052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-189b7e4d-3084-4151-a48b-c039586aa387 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:40.561899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-189b7e4d-3084-4151-a48b-c039586aa387 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:40.583048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-189b7e4d-3084-4151-a48b-c039586aa387 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Getting quotas for project 0dbdeb12b89c475cba7fef0ab845dada. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:57:40.589057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-189b7e4d-3084-4151-a48b-c039586aa387 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Getting quotas for user 4284d5f7a29045d18393bde2961a904b and project 0dbdeb12b89c475cba7fef0ab845dada. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:57:40.607301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-189b7e4d-3084-4151-a48b-c039586aa387 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 14:57:40.609844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-189b7e4d-3084-4151-a48b-c039586aa387 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 14:57:40.615647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-505b2b9a-cd3b-4642-a153-f8df34d1ba11 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:40.625333 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-505b2b9a-cd3b-4642-a153-f8df34d1ba11 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1339 microversion: 2.1 time: 0.227759 May 27 14:57:40.626366 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 64/113] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:40 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1339 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:40.655948 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-189b7e4d-3084-4151-a48b-c039586aa387 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.402803 May 27 14:57:40.661859 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 50/114] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 27 14:57:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 14:57:40.670000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-95e7ffd9-b7fa-4785-af6f-2815ffd1b998 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:40.670847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-95e7ffd9-b7fa-4785-af6f-2815ffd1b998 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:40.803595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-95e7ffd9-b7fa-4785-af6f-2815ffd1b998 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:40.818988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-95e7ffd9-b7fa-4785-af6f-2815ffd1b998 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:40.821552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-95e7ffd9-b7fa-4785-af6f-2815ffd1b998 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:40.823371 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-95e7ffd9-b7fa-4785-af6f-2815ffd1b998 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1261 microversion: 2.25 time: 0.159536 May 27 14:57:40.824493 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 65/115] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:57:40 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:57:41.273048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-91b5894f-8694-470d-b746-4fed4a78b09f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:41.273683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-91b5894f-8694-470d-b746-4fed4a78b09f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:41.280146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-91b5894f-8694-470d-b746-4fed4a78b09f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:41.280610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-91b5894f-8694-470d-b746-4fed4a78b09f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:41.281422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-91b5894f-8694-470d-b746-4fed4a78b09f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:41.281871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-91b5894f-8694-470d-b746-4fed4a78b09f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:41.414471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-28c984b8-06ce-4794-9e8c-2a70ac589b44 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:41.415227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-28c984b8-06ce-4794-9e8c-2a70ac589b44 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:41.427014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-28c984b8-06ce-4794-9e8c-2a70ac589b44 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:41.427767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-28c984b8-06ce-4794-9e8c-2a70ac589b44 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:41.429468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-28c984b8-06ce-4794-9e8c-2a70ac589b44 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:41.430147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-28c984b8-06ce-4794-9e8c-2a70ac589b44 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:41.510598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-91b5894f-8694-470d-b746-4fed4a78b09f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:41.525816 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-91b5894f-8694-470d-b746-4fed4a78b09f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1319 microversion: 2.1 time: 0.256233 May 27 14:57:41.526419 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 51/116] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:41 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:57:41.569157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-28c984b8-06ce-4794-9e8c-2a70ac589b44 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:41.575709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:41.579973 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-28c984b8-06ce-4794-9e8c-2a70ac589b44 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1282 microversion: 2.1 time: 0.170224 May 27 14:57:41.589416 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 66/117] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:41 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1282 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:57:41.642833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8db52195-2a34-49d9-ad1e-72df430d2cca tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:41.644199 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8db52195-2a34-49d9-ad1e-72df430d2cca tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:41.652460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8db52195-2a34-49d9-ad1e-72df430d2cca tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:41.653408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8db52195-2a34-49d9-ad1e-72df430d2cca tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:41.654503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8db52195-2a34-49d9-ad1e-72df430d2cca tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:41.655152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8db52195-2a34-49d9-ad1e-72df430d2cca tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:41.815186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8db52195-2a34-49d9-ad1e-72df430d2cca tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:41.833607 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8db52195-2a34-49d9-ad1e-72df430d2cca tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1339 microversion: 2.1 time: 0.190684 May 27 14:57:41.833607 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 52/118] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:41 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1339 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:41.846200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-abca0b68-fd79-41e4-9cfa-eb99a95f10e2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:41.847100 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-abca0b68-fd79-41e4-9cfa-eb99a95f10e2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:41.855342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-abca0b68-fd79-41e4-9cfa-eb99a95f10e2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:41.855879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-abca0b68-fd79-41e4-9cfa-eb99a95f10e2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:41.856850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-abca0b68-fd79-41e4-9cfa-eb99a95f10e2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:41.858053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-abca0b68-fd79-41e4-9cfa-eb99a95f10e2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:41.970395 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-abca0b68-fd79-41e4-9cfa-eb99a95f10e2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:41.983232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-abca0b68-fd79-41e4-9cfa-eb99a95f10e2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:41.984854 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-abca0b68-fd79-41e4-9cfa-eb99a95f10e2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:41.985976 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-abca0b68-fd79-41e4-9cfa-eb99a95f10e2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1335 microversion: 2.25 time: 0.147031 May 27 14:57:41.986815 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 67/119] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:57:41 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1335 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:57:42.544230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9544de43-7800-4b97-9a50-8c07522678ca tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:42.545522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9544de43-7800-4b97-9a50-8c07522678ca tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:42.553600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9544de43-7800-4b97-9a50-8c07522678ca tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:42.554544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9544de43-7800-4b97-9a50-8c07522678ca tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:42.555834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9544de43-7800-4b97-9a50-8c07522678ca tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:42.557130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9544de43-7800-4b97-9a50-8c07522678ca tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:42.597077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-79be8bc9-f532-459d-b0e8-d8c613e37662 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:42.597697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-79be8bc9-f532-459d-b0e8-d8c613e37662 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:42.607090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79be8bc9-f532-459d-b0e8-d8c613e37662 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:42.607546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79be8bc9-f532-459d-b0e8-d8c613e37662 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:42.608337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79be8bc9-f532-459d-b0e8-d8c613e37662 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:42.608811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79be8bc9-f532-459d-b0e8-d8c613e37662 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:42.755370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-79be8bc9-f532-459d-b0e8-d8c613e37662 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:42.766734 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-79be8bc9-f532-459d-b0e8-d8c613e37662 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1282 microversion: 2.1 time: 0.173536 May 27 14:57:42.767671 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 68/120] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:42 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:42.786700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9544de43-7800-4b97-9a50-8c07522678ca tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:42.805404 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9544de43-7800-4b97-9a50-8c07522678ca tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1319 microversion: 2.1 time: 0.266240 May 27 14:57:42.806214 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 53/121] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:42 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:42.849926 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9a1040f1-5bbf-45a5-8c9d-6f58e29d6d8b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:42.850580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9a1040f1-5bbf-45a5-8c9d-6f58e29d6d8b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:42.866701 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a1040f1-5bbf-45a5-8c9d-6f58e29d6d8b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:42.867336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a1040f1-5bbf-45a5-8c9d-6f58e29d6d8b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:42.870343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a1040f1-5bbf-45a5-8c9d-6f58e29d6d8b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:42.870343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a1040f1-5bbf-45a5-8c9d-6f58e29d6d8b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:43.003773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d8579069-7bd3-4930-b7da-ff43627615fe tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:43.004829 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d8579069-7bd3-4930-b7da-ff43627615fe tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:43.020287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8579069-7bd3-4930-b7da-ff43627615fe tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:43.020775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8579069-7bd3-4930-b7da-ff43627615fe tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:43.021565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8579069-7bd3-4930-b7da-ff43627615fe tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:43.022016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8579069-7bd3-4930-b7da-ff43627615fe tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:43.113079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9a1040f1-5bbf-45a5-8c9d-6f58e29d6d8b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:43.124336 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9a1040f1-5bbf-45a5-8c9d-6f58e29d6d8b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1339 microversion: 2.1 time: 0.278209 May 27 14:57:43.126035 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 69/122] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:42 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1339 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:43.130784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d8579069-7bd3-4930-b7da-ff43627615fe tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:43.139940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d8579069-7bd3-4930-b7da-ff43627615fe tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:43.142281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d8579069-7bd3-4930-b7da-ff43627615fe tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:43.144807 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d8579069-7bd3-4930-b7da-ff43627615fe tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1341 microversion: 2.25 time: 0.144875 May 27 14:57:43.157119 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 54/123] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:57:42 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1341 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 14:57:43.785459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-15700633-298f-4606-8a81-0fc71e8240b2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:43.786190 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-15700633-298f-4606-8a81-0fc71e8240b2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:43.802493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15700633-298f-4606-8a81-0fc71e8240b2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:43.803264 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15700633-298f-4606-8a81-0fc71e8240b2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:43.807391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15700633-298f-4606-8a81-0fc71e8240b2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:43.811390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15700633-298f-4606-8a81-0fc71e8240b2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:43.826430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-127d5c2d-e41d-4b6f-8765-2ca4ce14e2b3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:43.827683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-127d5c2d-e41d-4b6f-8765-2ca4ce14e2b3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:43.849660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-127d5c2d-e41d-4b6f-8765-2ca4ce14e2b3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:43.850134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-127d5c2d-e41d-4b6f-8765-2ca4ce14e2b3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:43.850936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-127d5c2d-e41d-4b6f-8765-2ca4ce14e2b3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:43.851388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-127d5c2d-e41d-4b6f-8765-2ca4ce14e2b3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:43.965267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-15700633-298f-4606-8a81-0fc71e8240b2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:43.987226 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-15700633-298f-4606-8a81-0fc71e8240b2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1270 microversion: 2.1 time: 0.204651 May 27 14:57:43.994327 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 70/124] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:43 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1270 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:44.128234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-127d5c2d-e41d-4b6f-8765-2ca4ce14e2b3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:44.146427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1afe6eb6-b21a-4092-8326-0b81b8502a82 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:44.147474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1afe6eb6-b21a-4092-8326-0b81b8502a82 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:44.157465 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-127d5c2d-e41d-4b6f-8765-2ca4ce14e2b3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1319 microversion: 2.1 time: 0.336422 May 27 14:57:44.172065 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 55/125] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:43 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1319 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:44.174308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1afe6eb6-b21a-4092-8326-0b81b8502a82 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:44.176399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1afe6eb6-b21a-4092-8326-0b81b8502a82 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:44.179002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1afe6eb6-b21a-4092-8326-0b81b8502a82 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:44.182370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1afe6eb6-b21a-4092-8326-0b81b8502a82 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:44.188498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c2807717-9167-43db-9d41-89343d123271 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:44.189331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c2807717-9167-43db-9d41-89343d123271 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:44.206873 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2807717-9167-43db-9d41-89343d123271 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:44.207580 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2807717-9167-43db-9d41-89343d123271 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:44.209388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2807717-9167-43db-9d41-89343d123271 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:44.211868 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2807717-9167-43db-9d41-89343d123271 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:44.460749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1afe6eb6-b21a-4092-8326-0b81b8502a82 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:44.472797 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1afe6eb6-b21a-4092-8326-0b81b8502a82 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1339 microversion: 2.1 time: 0.332176 May 27 14:57:44.476641 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 71/126] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:44 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1339 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:57:44.500785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c2807717-9167-43db-9d41-89343d123271 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:44.513379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c2807717-9167-43db-9d41-89343d123271 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:44.515151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c2807717-9167-43db-9d41-89343d123271 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:44.516486 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c2807717-9167-43db-9d41-89343d123271 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1383 microversion: 2.25 time: 0.342499 May 27 14:57:44.518362 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 56/127] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:57:44 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1383 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:57:44.697594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-871829dd-1a71-431b-bd9f-ac13124adfb2 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-542327635", "id": 862975457, "os-flavor-access:is_public": "True"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:44.699578 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:44.699578 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:44.726683 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-871829dd-1a71-431b-bd9f-ac13124adfb2 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.207001 May 27 14:57:44.735893 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 57/128] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:57:44 2022] POST /compute/v2.1/flavors => generated 426 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:44.743931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-350a07c9-5512-4200-975e-bc09d840be51 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:44.745111 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:44.745111 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:44.751690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-851e64d5-f425-4945-ba87-91a398243895 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-168272468", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:44.776281 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-350a07c9-5512-4200-975e-bc09d840be51 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/862975457" status: 202 len: 0 microversion: 2.1 time: 0.037425 May 27 14:57:44.777336 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 58/129] 10.222.0.13 () {58 vars in 1157 bytes} [Fri May 27 14:57:44 2022] DELETE /compute/v2.1/flavors/862975457 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:57:44.791394 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-78d7a764-6976-4c8b-8d01-facb7e58c34a tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:44.813429 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-78d7a764-6976-4c8b-8d01-facb7e58c34a tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029393 May 27 14:57:44.825786 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 59/130] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:44.831567 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d7657d21-fea2-403d-abf6-b678262d7aa3 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2105825173", "id": 553505331, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:44.857135 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d7657d21-fea2-403d-abf6-b678262d7aa3 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.029213 May 27 14:57:44.858705 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 60/131] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:57:44 2022] POST /compute/v2.1/flavors => generated 414 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:44.868572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-851e64d5-f425-4945-ba87-91a398243895 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] validate_networks() for None {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 14:57:44.872463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e9c0590-6879-40b7-a27d-feac9d2a6c29 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:44.897637 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e9c0590-6879-40b7-a27d-feac9d2a6c29 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.030163 May 27 14:57:44.909312 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 61/132] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:44 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:44.916887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-a3cbce5f-6653-4af6-b2c1-73b6570de0ff req-bf1c9f98-9307-40fd-b96e-64e7aa681f10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad32218c-901a-44e3-92e3-5aeb695c4cc8", "tag": "1d06f984-6b2c-4b79-8cfb-73890966fc2a"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:44.941234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-a3cbce5f-6653-4af6-b2c1-73b6570de0ff req-bf1c9f98-9307-40fd-b96e-64e7aa681f10 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:44.941921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-a3cbce5f-6653-4af6-b2c1-73b6570de0ff req-bf1c9f98-9307-40fd-b96e-64e7aa681f10 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:44.970947 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-a3cbce5f-6653-4af6-b2c1-73b6570de0ff req-bf1c9f98-9307-40fd-b96e-64e7aa681f10 service nova] Creating event network-changed:1d06f984-6b2c-4b79-8cfb-73890966fc2a for instance ad32218c-901a-44e3-92e3-5aeb695c4cc8 on n-h2-843621-1 May 27 14:57:44.976220 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-a3cbce5f-6653-4af6-b2c1-73b6570de0ff req-bf1c9f98-9307-40fd-b96e-64e7aa681f10 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064706 May 27 14:57:44.976865 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 62/133] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:44.983335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-20475e53-92da-455d-840a-689c36702b98 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:44.984219 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:44.984219 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:45.003355 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-20475e53-92da-455d-840a-689c36702b98 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/553505331" status: 202 len: 0 microversion: 2.1 time: 0.024832 May 27 14:57:45.004070 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 63/134] 10.222.0.13 () {58 vars in 1157 bytes} [Fri May 27 14:57:44 2022] DELETE /compute/v2.1/flavors/553505331 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:57:45.012947 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-87ebe181-f8ee-4016-9a23-ab76f403a006 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:45.013828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-87ebe181-f8ee-4016-9a23-ab76f403a006 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:45.020614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87ebe181-f8ee-4016-9a23-ab76f403a006 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:45.021211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87ebe181-f8ee-4016-9a23-ab76f403a006 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:45.022263 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87ebe181-f8ee-4016-9a23-ab76f403a006 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:45.022805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87ebe181-f8ee-4016-9a23-ab76f403a006 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:45.153364 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-851e64d5-f425-4945-ba87-91a398243895 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:57:45.153901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-851e64d5-f425-4945-ba87-91a398243895 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:57:45.154262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-851e64d5-f425-4945-ba87-91a398243895 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:57:45.154848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-851e64d5-f425-4945-ba87-91a398243895 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:57:45.155466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-851e64d5-f425-4945-ba87-91a398243895 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:57:45.165966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-851e64d5-f425-4945-ba87-91a398243895 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:45.166755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-851e64d5-f425-4945-ba87-91a398243895 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:45.167874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-851e64d5-f425-4945-ba87-91a398243895 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:45.168611 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-851e64d5-f425-4945-ba87-91a398243895 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:45.191924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-851e64d5-f425-4945-ba87-91a398243895 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Getting quotas for project 12fde8a6988b483cab0e58f2b6a35615. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:57:45.195673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-87ebe181-f8ee-4016-9a23-ab76f403a006 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:45.196655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-851e64d5-f425-4945-ba87-91a398243895 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Getting quotas for user 693e1381d34b4d58b657f2a0ea930190 and project 12fde8a6988b483cab0e58f2b6a35615. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:57:45.205112 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-87ebe181-f8ee-4016-9a23-ab76f403a006 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1312 microversion: 2.1 time: 0.196429 May 27 14:57:45.205985 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 64/135] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:45 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1312 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:45.210740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-41eb3da8-0bcd-4810-949c-adff47c07aab tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:45.219709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-851e64d5-f425-4945-ba87-91a398243895 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 14:57:45.222243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-851e64d5-f425-4945-ba87-91a398243895 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 14:57:45.231563 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-41eb3da8-0bcd-4810-949c-adff47c07aab tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024246 May 27 14:57:45.242868 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 65/136] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:45.242868 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-315cd6ba-dcf5-4e3d-b252-5f85ca1f10bc tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:45.242868 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-315cd6ba-dcf5-4e3d-b252-5f85ca1f10bc tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:45.249337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-315cd6ba-dcf5-4e3d-b252-5f85ca1f10bc tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:45.250051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-315cd6ba-dcf5-4e3d-b252-5f85ca1f10bc tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:45.251005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-315cd6ba-dcf5-4e3d-b252-5f85ca1f10bc tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:45.251522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-315cd6ba-dcf5-4e3d-b252-5f85ca1f10bc tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:45.256542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:45.284353 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-851e64d5-f425-4945-ba87-91a398243895 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805354 May 27 14:57:45.292964 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 72/137] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:57:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 14:57:45.307278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-09f632cd-e8ad-4402-a0ea-91414cf0c556 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-797120123", "id": 1663851685, "os-flavor-access:is_public": "True"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:45.307278 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:45.307278 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:45.321707 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-09f632cd-e8ad-4402-a0ea-91414cf0c556 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.027182 May 27 14:57:45.323017 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 73/138] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:57:45 2022] POST /compute/v2.1/flavors => generated 428 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:45.328374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-92a959e0-2a57-416f-b0b9-15370976639f tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:45.329006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-92a959e0-2a57-416f-b0b9-15370976639f tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:45.425264 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-92a959e0-2a57-416f-b0b9-15370976639f tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:45.434223 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-92a959e0-2a57-416f-b0b9-15370976639f tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad" status: 200 len: 1218 microversion: 2.1 time: 0.109771 May 27 14:57:45.435778 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 74/139] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:45 2022] GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:45.441942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5ac7d64b-9c68-4e09-b262-1fa39366fedd tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:45.445348 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:45.445348 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:45.469498 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5ac7d64b-9c68-4e09-b262-1fa39366fedd tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1663851685" status: 202 len: 0 microversion: 2.1 time: 0.032465 May 27 14:57:45.470315 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 75/140] 10.222.0.13 () {58 vars in 1160 bytes} [Fri May 27 14:57:45 2022] DELETE /compute/v2.1/flavors/1663851685 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:57:45.479580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-55ae09a2-3397-4ad5-9bde-e86319a549ad tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:45.489303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:45.502499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-315cd6ba-dcf5-4e3d-b252-5f85ca1f10bc tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:45.512460 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-55ae09a2-3397-4ad5-9bde-e86319a549ad tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037788 May 27 14:57:45.523015 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 76/141] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:57:45.523224 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-315cd6ba-dcf5-4e3d-b252-5f85ca1f10bc tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1319 microversion: 2.1 time: 0.283955 May 27 14:57:45.523316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dfb627ce-7bb8-47d9-98c1-9e7b5e9f8c7b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:45.523316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dfb627ce-7bb8-47d9-98c1-9e7b5e9f8c7b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:45.524564 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 66/142] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:45 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:45.531114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6f1d0818-b691-4d94-af94-aa6491d39ce9 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1844036342", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:45.535675 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dfb627ce-7bb8-47d9-98c1-9e7b5e9f8c7b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:45.539635 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:45.539635 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:45.540172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dfb627ce-7bb8-47d9-98c1-9e7b5e9f8c7b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:45.542057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dfb627ce-7bb8-47d9-98c1-9e7b5e9f8c7b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:45.543040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dfb627ce-7bb8-47d9-98c1-9e7b5e9f8c7b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:45.567011 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6f1d0818-b691-4d94-af94-aa6491d39ce9 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.039580 May 27 14:57:45.569545 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 67/143] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:57:45 2022] POST /compute/v2.1/flavors => generated 507 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:45.584611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f3792bfb-2f2c-4c7b-a43f-6440e158a2cd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:45.586919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f3792bfb-2f2c-4c7b-a43f-6440e158a2cd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:45.602040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f3792bfb-2f2c-4c7b-a43f-6440e158a2cd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:45.606181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f3792bfb-2f2c-4c7b-a43f-6440e158a2cd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:45.610257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f3792bfb-2f2c-4c7b-a43f-6440e158a2cd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:45.611238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f3792bfb-2f2c-4c7b-a43f-6440e158a2cd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:45.887802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dfb627ce-7bb8-47d9-98c1-9e7b5e9f8c7b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:45.897456 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dfb627ce-7bb8-47d9-98c1-9e7b5e9f8c7b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1339 microversion: 2.1 time: 0.382950 May 27 14:57:45.898074 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 77/144] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:45 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1339 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:45.913717 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-24892426-bfc1-486e-adb4-adf9db2a7878 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:45.914814 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:45.914814 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:45.956443 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-24892426-bfc1-486e-adb4-adf9db2a7878 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/608d2d81-7d49-4365-8cea-3931f7962416" status: 202 len: 0 microversion: 2.1 time: 0.052526 May 27 14:57:45.957961 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 78/145] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 14:57:45 2022] DELETE /compute/v2.1/flavors/608d2d81-7d49-4365-8cea-3931f7962416 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:57:45.969896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f3792bfb-2f2c-4c7b-a43f-6440e158a2cd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:45.981215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5f926fda-3615-427c-9b19-cb7fb8dd1d80 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:45.984444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f3792bfb-2f2c-4c7b-a43f-6440e158a2cd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:45.988905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f3792bfb-2f2c-4c7b-a43f-6440e158a2cd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:45.993585 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f3792bfb-2f2c-4c7b-a43f-6440e158a2cd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1383 microversion: 2.25 time: 0.422071 May 27 14:57:46.015108 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 68/146] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:57:45 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1383 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:57:46.042751 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5f926fda-3615-427c-9b19-cb7fb8dd1d80 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080415 May 27 14:57:46.054644 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 79/147] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:57:46.060107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9673253b-33c4-4ef5-b307-33b2e0621558 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1428612140", "id": "94d27617-185e-4d7f-bed1-e60a369de093", "os-flavor-access:is_public": "True"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:46.062100 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:46.062100 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:46.087304 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9673253b-33c4-4ef5-b307-33b2e0621558 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.030980 May 27 14:57:46.096293 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 69/148] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:57:46 2022] POST /compute/v2.1/flavors => generated 507 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:46.100802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d7d5fdd7-ed92-4c29-a61a-9dd78106f13a tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:46.138996 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d7d5fdd7-ed92-4c29-a61a-9dd78106f13a tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/94d27617-185e-4d7f-bed1-e60a369de093" status: 202 len: 0 microversion: 2.1 time: 0.042132 May 27 14:57:46.143763 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 80/149] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 14:57:46 2022] DELETE /compute/v2.1/flavors/94d27617-185e-4d7f-bed1-e60a369de093 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:57:46.151537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e03ad1a8-bed7-456c-82f1-3fa646862ece tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:46.187473 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e03ad1a8-bed7-456c-82f1-3fa646862ece tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042122 May 27 14:57:46.199965 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 81/150] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:46.206036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-37cbebb8-4fa4-42c0-bd83-722f611b0177 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1880343050", "id": 1871856899, "os-flavor-access:is_public": "True"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:46.208724 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:46.208724 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:46.210083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-b2a04606-4d97-48ee-9b77-e3e9ac8426c3 req-093dd051-5709-451b-ac51-28e4bb463125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8", "name": "network-vif-plugged", "status": "completed", "tag": "81242489-b7cd-4e69-8684-73049292e7a8"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:46.223896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-b2a04606-4d97-48ee-9b77-e3e9ac8426c3 req-093dd051-5709-451b-ac51-28e4bb463125 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:46.224840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-b2a04606-4d97-48ee-9b77-e3e9ac8426c3 req-093dd051-5709-451b-ac51-28e4bb463125 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:46.240654 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-b2a04606-4d97-48ee-9b77-e3e9ac8426c3 req-093dd051-5709-451b-ac51-28e4bb463125 service nova] Creating event network-vif-plugged:81242489-b7cd-4e69-8684-73049292e7a8 for instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 on n-h2-843621-1 May 27 14:57:46.249303 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-b2a04606-4d97-48ee-9b77-e3e9ac8426c3 req-093dd051-5709-451b-ac51-28e4bb463125 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143252 May 27 14:57:46.250867 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 70/151] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 14:57:46.253472 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-37cbebb8-4fa4-42c0-bd83-722f611b0177 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.050427 May 27 14:57:46.257222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6f053572-acb2-4d60-84a2-447f53eafb57 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:46.258108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6f053572-acb2-4d60-84a2-447f53eafb57 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:46.266120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f053572-acb2-4d60-84a2-447f53eafb57 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:46.266771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f053572-acb2-4d60-84a2-447f53eafb57 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:46.268314 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f053572-acb2-4d60-84a2-447f53eafb57 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:46.268856 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 82/152] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:57:46 2022] POST /compute/v2.1/flavors => generated 414 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:46.268970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f053572-acb2-4d60-84a2-447f53eafb57 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:46.283981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-88573306-7bc0-418b-a7fd-c2b74bb1ee84 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:46.301592 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-88573306-7bc0-418b-a7fd-c2b74bb1ee84 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/1871856899" status: 200 len: 414 microversion: 2.1 time: 0.021622 May 27 14:57:46.305740 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 83/153] 10.222.0.13 () {58 vars in 1157 bytes} [Fri May 27 14:57:46 2022] GET /compute/v2.1/flavors/1871856899 => generated 414 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 14:57:46.485365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f3350bf9-4749-4653-a7eb-020ba6e61b72 tempest-FlavorsAdminTestJSON-939968559 tempest-FlavorsAdminTestJSON-939968559-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:46.493177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6f053572-acb2-4d60-84a2-447f53eafb57 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:46.500882 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6f053572-acb2-4d60-84a2-447f53eafb57 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1312 microversion: 2.1 time: 0.248567 May 27 14:57:46.501553 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 71/154] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:46 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1312 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:46.506182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1924fa39-f822-407d-9e1c-59160b63b887 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:46.506871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1924fa39-f822-407d-9e1c-59160b63b887 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:46.513276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1924fa39-f822-407d-9e1c-59160b63b887 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:46.513832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1924fa39-f822-407d-9e1c-59160b63b887 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:46.514673 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f3350bf9-4749-4653-a7eb-020ba6e61b72 tempest-FlavorsAdminTestJSON-939968559 tempest-FlavorsAdminTestJSON-939968559-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.205564 May 27 14:57:46.514772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1924fa39-f822-407d-9e1c-59160b63b887 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:46.515252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1924fa39-f822-407d-9e1c-59160b63b887 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:46.515380 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 84/155] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:46 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:46.529694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8243e7b3-70d3-4f1e-a4c7-486a13cc222d tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:46.547570 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8243e7b3-70d3-4f1e-a4c7-486a13cc222d tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1871856899" status: 202 len: 0 microversion: 2.1 time: 0.021301 May 27 14:57:46.548183 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 85/156] 10.222.0.13 () {58 vars in 1160 bytes} [Fri May 27 14:57:46 2022] DELETE /compute/v2.1/flavors/1871856899 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 14:57:46.554616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-181f0879-3d50-4d4f-b2a1-4e3ad16fe87a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:46.555237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-181f0879-3d50-4d4f-b2a1-4e3ad16fe87a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:46.567077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-181f0879-3d50-4d4f-b2a1-4e3ad16fe87a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:46.567527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-181f0879-3d50-4d4f-b2a1-4e3ad16fe87a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:46.568312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-181f0879-3d50-4d4f-b2a1-4e3ad16fe87a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:46.568956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-181f0879-3d50-4d4f-b2a1-4e3ad16fe87a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:46.584550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1924fa39-f822-407d-9e1c-59160b63b887 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:46.593603 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1924fa39-f822-407d-9e1c-59160b63b887 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad" status: 200 len: 1270 microversion: 2.1 time: 0.090881 May 27 14:57:46.594355 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 72/157] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:46 2022] GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:46.599006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bfff3b3b-d56f-49a8-a311-7e315af12ecb tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:46.628604 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bfff3b3b-d56f-49a8-a311-7e315af12ecb tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033058 May 27 14:57:46.629471 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 73/158] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:46.645460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5dc84264-c30b-4524-8b0d-8474852c8219 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2115012133", "id": 563250796, "os-flavor-access:is_public": "False"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:46.647081 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:46.647081 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:46.663657 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5dc84264-c30b-4524-8b0d-8474852c8219 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.021819 May 27 14:57:46.664255 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 74/159] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:57:46 2022] POST /compute/v2.1/flavors => generated 427 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:46.677382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ef97c245-27d6-45bf-9d6a-09caba4ca7d2 tempest-FlavorsAdminTestJSON-939968559 tempest-FlavorsAdminTestJSON-939968559-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "563250796"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:46.687015 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-ef97c245-27d6-45bf-9d6a-09caba4ca7d2 tempest-FlavorsAdminTestJSON-939968559 tempest-FlavorsAdminTestJSON-939968559-project] HTTP exception thrown: Flavor 563250796 could not be found. May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ef97c245-27d6-45bf-9d6a-09caba4ca7d2 tempest-FlavorsAdminTestJSON-939968559 tempest-FlavorsAdminTestJSON-939968559-project] Request method failure captured: May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 106 May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObn2F3EzdB7kqqaGfPCzKI-uGHTpt_qhjJDTTl2t6umquBleyDtMouyJC7HFLsyQTAZAfVoW7fXEyAT46W6ayaECoVaqZ1q6qAN-tUzUAzLCiMFt-0fO3pK59ACIJYmFp0AM6Ka29L_3MaHNQ8nLbCGpFqGtZ44bCplyHE7YivGv08 May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 357d6405653448e5be6a0e09842223b4 May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-FlavorsAdminTestJSON-939968559 May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:57:46.690192 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:57:46.691706 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/357d6405653448e5be6a0e09842223b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/357d6405653448e5be6a0e09842223b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/357d6405653448e5be6a0e09842223b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_357d6405653448e5be6a0e09842223b4", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:46.691706 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-FlavorsAdminTestJSON-939968559 May 27 14:57:46.691706 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 357d6405653448e5be6a0e09842223b4 May 27 14:57:46.691706 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-939968559 May 27 14:57:46.691706 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-FlavorsAdminTestJSON-939968559-project May 27 14:57:46.691706 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:57:46.691706 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:57:46.691706 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: bbe7a8ec1d7a4ae9881b4f5874700b45 May 27 14:57:46.691706 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-FlavorsAdminTestJSON-939968559-project May 27 14:57:46.691706 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:57:46.691706 n-d-843621-1 devstack@n-api.service[119248]: {"server": {"name": "test", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "563250796"}} May 27 14:57:46.691706 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:57:46.691706 n-d-843621-1 devstack@n-api.service[119248]: exception: Flavor 563250796 could not be found. May 27 14:57:46.692427 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '563250796'}}} May 27 14:57:46.692427 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:46.692427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:46.692427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create May 27 14:57:46.692427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( May 27 14:57:46.692427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 14:57:46.692427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 14:57:46.692427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:57:46.692427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:57:46.692427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 14:57:46.692427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 14:57:46.692427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 14:57:46.692427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:46.692427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 14:57:46.692427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 14:57:46.692427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 563250796 could not be found. May 27 14:57:46.692427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:46.692427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:46.692427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:46.692427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 563250796 could not be found. May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:46.694092 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:46.695246 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:46.695246 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:57:46.695246 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:57:46.695246 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 563250796 could not be found. May 27 14:57:46.695246 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:46.695246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ef97c245-27d6-45bf-9d6a-09caba4ca7d2 tempest-FlavorsAdminTestJSON-939968559 tempest-FlavorsAdminTestJSON-939968559-project] Returning 400 to user: Flavor 563250796 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:46.695246 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ef97c245-27d6-45bf-9d6a-09caba4ca7d2 tempest-FlavorsAdminTestJSON-939968559 tempest-FlavorsAdminTestJSON-939968559-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.018397 May 27 14:57:46.695671 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 75/160] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:57:46 2022] POST /compute/v2.1/servers => generated 80 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 27 14:57:46.701698 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5aafc7ce-0af0-4e1e-a04e-71313f08433f tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:46.702799 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:46.702799 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:46.724472 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5aafc7ce-0af0-4e1e-a04e-71313f08433f tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/563250796" status: 202 len: 0 microversion: 2.1 time: 0.027380 May 27 14:57:46.725333 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 76/161] 10.222.0.13 () {58 vars in 1157 bytes} [Fri May 27 14:57:46 2022] DELETE /compute/v2.1/flavors/563250796 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:57:46.733671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2ae306a0-993d-4901-9796-a4322681c15d tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:46.737076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-181f0879-3d50-4d4f-b2a1-4e3ad16fe87a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:46.747558 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-181f0879-3d50-4d4f-b2a1-4e3ad16fe87a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1319 microversion: 2.1 time: 0.198143 May 27 14:57:46.748797 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 86/162] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:46 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:46.754333 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2ae306a0-993d-4901-9796-a4322681c15d tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024261 May 27 14:57:46.755252 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 77/163] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:46.772149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0d1d4e16-b1ed-4488-ade7-48cb6a5ed4ce tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1772669034", "id": 551722404, "os-flavor-access:is_public": "False"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:46.775886 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:46.775886 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:46.796098 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0d1d4e16-b1ed-4488-ade7-48cb6a5ed4ce tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.027809 May 27 14:57:46.797243 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 87/164] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:57:46 2022] POST /compute/v2.1/flavors => generated 412 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:46.807815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d781b1e5-5918-49ef-b7b2-d5c40b6a34bb tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1301526034", "id": 1119701909, "os-flavor-access:is_public": "True"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:46.812563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8,nova_api:DELETE=9 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:46.840387 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d781b1e5-5918-49ef-b7b2-d5c40b6a34bb tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.036203 May 27 14:57:46.842076 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 78/165] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:57:46 2022] POST /compute/v2.1/flavors => generated 414 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:46.852078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b310c465-580a-4650-9ab2-b609f7d2d92b tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:46.873666 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b310c465-580a-4650-9ab2-b609f7d2d92b tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.025365 May 27 14:57:46.875158 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 88/166] 10.222.0.13 () {58 vars in 1168 bytes} [Fri May 27 14:57:46 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:46.888343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-de6d898e-2d96-40c5-ac6f-ec4693cae6d1 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:46.908748 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-de6d898e-2d96-40c5-ac6f-ec4693cae6d1 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.026202 May 27 14:57:46.915766 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 79/167] 10.222.0.13 () {58 vars in 1176 bytes} [Fri May 27 14:57:46 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:46.918276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-da67e54b-b1f4-40b1-b6b3-1dc034df96ab tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:46.919074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-da67e54b-b1f4-40b1-b6b3-1dc034df96ab tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:46.923056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d1183e50-5b82-458a-af2b-ddfdff091602 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:46.933802 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d1183e50-5b82-458a-af2b-ddfdff091602 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.016470 May 27 14:57:46.934032 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da67e54b-b1f4-40b1-b6b3-1dc034df96ab tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:46.934032 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da67e54b-b1f4-40b1-b6b3-1dc034df96ab tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:46.937675 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da67e54b-b1f4-40b1-b6b3-1dc034df96ab tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:46.938218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da67e54b-b1f4-40b1-b6b3-1dc034df96ab tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:46.940790 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 80/168] 10.222.0.13 () {58 vars in 1170 bytes} [Fri May 27 14:57:46 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:46.945636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8e39a55e-ca8a-4144-bd63-7c2d9eacc9bc tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:46.955830 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8e39a55e-ca8a-4144-bd63-7c2d9eacc9bc tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.013797 May 27 14:57:46.963777 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 81/169] 10.222.0.13 () {58 vars in 1168 bytes} [Fri May 27 14:57:46 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:46.969601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e5aed51b-5259-40cc-9d33-48e79ae01a31 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:46.993201 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e5aed51b-5259-40cc-9d33-48e79ae01a31 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.028109 May 27 14:57:47.011327 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 82/170] 10.222.0.13 () {58 vars in 1168 bytes} [Fri May 27 14:57:46 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:47.019355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-37be2b72-5af5-4e77-aa03-875a81e9e47e tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:47.045919 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-37be2b72-5af5-4e77-aa03-875a81e9e47e tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.032471 May 27 14:57:47.046711 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 83/171] 10.222.0.13 () {58 vars in 1174 bytes} [Fri May 27 14:57:47 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:47.051928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-e13c003e-c1e3-4c04-9a3e-918520278d0c req-86f1b24f-e8f0-4217-9a06-0c51ddc16a0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37dbb2d-08d2-4f90-9c36-d373a0dec9d5", "tag": "a88e358c-7366-488d-b011-77c43429e37d"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:47.063678 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e13c003e-c1e3-4c04-9a3e-918520278d0c req-86f1b24f-e8f0-4217-9a06-0c51ddc16a0d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:47.064821 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e13c003e-c1e3-4c04-9a3e-918520278d0c req-86f1b24f-e8f0-4217-9a06-0c51ddc16a0d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:47.082292 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-e13c003e-c1e3-4c04-9a3e-918520278d0c req-86f1b24f-e8f0-4217-9a06-0c51ddc16a0d service nova] Creating event network-changed:a88e358c-7366-488d-b011-77c43429e37d for instance f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 on n-h1-843621-1 May 27 14:57:47.092369 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-e13c003e-c1e3-4c04-9a3e-918520278d0c req-86f1b24f-e8f0-4217-9a06-0c51ddc16a0d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043953 May 27 14:57:47.093701 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 84/172] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:47.099887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2b659241-cb84-4c05-891d-89467fcb7116 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:47.100910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2b659241-cb84-4c05-891d-89467fcb7116 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:47.110636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b659241-cb84-4c05-891d-89467fcb7116 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:47.111801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b659241-cb84-4c05-891d-89467fcb7116 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:47.114410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b659241-cb84-4c05-891d-89467fcb7116 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:47.115269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b659241-cb84-4c05-891d-89467fcb7116 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:47.242960 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-da67e54b-b1f4-40b1-b6b3-1dc034df96ab tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:47.252129 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-da67e54b-b1f4-40b1-b6b3-1dc034df96ab tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1339 microversion: 2.1 time: 0.341845 May 27 14:57:47.253058 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 89/173] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:46 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1339 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:57:47.259504 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2b3adeff-a590-4098-8c95-22fc05d081dd tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:47.280406 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2b3adeff-a590-4098-8c95-22fc05d081dd tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.025923 May 27 14:57:47.281012 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 90/174] 10.222.0.13 () {58 vars in 1172 bytes} [Fri May 27 14:57:47 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:47.296163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-71df8b1a-cfb5-47da-b499-b09aa132f298 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:47.304983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2b659241-cb84-4c05-891d-89467fcb7116 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:47.324507 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2b659241-cb84-4c05-891d-89467fcb7116 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:47.324740 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-71df8b1a-cfb5-47da-b499-b09aa132f298 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.024509 May 27 14:57:47.324740 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 91/175] 10.222.0.13 () {58 vars in 1168 bytes} [Fri May 27 14:57:47 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:47.324908 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2b659241-cb84-4c05-891d-89467fcb7116 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:47.324908 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2b659241-cb84-4c05-891d-89467fcb7116 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1383 microversion: 2.25 time: 0.224750 May 27 14:57:47.324908 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 85/176] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:57:47 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1383 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:57:47.332033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1f2ad1c7-c705-4386-91be-ce695f0de1cf tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:47.332828 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:47.332828 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:47.348958 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1f2ad1c7-c705-4386-91be-ce695f0de1cf tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1119701909" status: 202 len: 0 microversion: 2.1 time: 0.020370 May 27 14:57:47.349527 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 92/177] 10.222.0.13 () {58 vars in 1160 bytes} [Fri May 27 14:57:47 2022] DELETE /compute/v2.1/flavors/1119701909 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:57:47.359211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6277c473-3ad1-4af6-9901-2c8b793706fc tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:47.378555 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6277c473-3ad1-4af6-9901-2c8b793706fc tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024063 May 27 14:57:47.379134 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 86/178] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:47.395111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a1e60ba2-e02b-400f-9084-7d52dab1a571 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:47.415310 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a1e60ba2-e02b-400f-9084-7d52dab1a571 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/551722404" status: 202 len: 0 microversion: 2.1 time: 0.023669 May 27 14:57:47.416391 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 93/179] 10.222.0.13 () {58 vars in 1157 bytes} [Fri May 27 14:57:47 2022] DELETE /compute/v2.1/flavors/551722404 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:57:47.424997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-02084e7e-8df7-469b-a5b6-7be723c0d7de tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:47.443803 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-02084e7e-8df7-469b-a5b6-7be723c0d7de tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022491 May 27 14:57:47.444390 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 87/180] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:47.459875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2e2869e3-a89a-4731-a835-2f3165ae7c3f tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-176966398", "id": 1482320340, "os-flavor-access:is_public": "False"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:47.461405 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:47.461405 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:47.479674 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2e2869e3-a89a-4731-a835-2f3165ae7c3f tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.023502 May 27 14:57:47.480264 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 94/181] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:57:47 2022] POST /compute/v2.1/flavors => generated 414 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:47.490625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-edf148d7-9ce3-4376-ab91-99768c88ee29 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:47.509124 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-edf148d7-9ce3-4376-ab91-99768c88ee29 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022373 May 27 14:57:47.509728 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 88/182] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:47.518981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6da1d11e-0dc9-43cd-a4d4-613fd7b8a91e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:47.519601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6da1d11e-0dc9-43cd-a4d4-613fd7b8a91e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:47.523000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0f5f9e76-fcb9-4290-9f2f-45ec647ded59 tempest-FlavorsAdminTestJSON-939968559 tempest-FlavorsAdminTestJSON-939968559-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:47.526253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6da1d11e-0dc9-43cd-a4d4-613fd7b8a91e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:47.526705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6da1d11e-0dc9-43cd-a4d4-613fd7b8a91e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:47.527571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6da1d11e-0dc9-43cd-a4d4-613fd7b8a91e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:47.528009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6da1d11e-0dc9-43cd-a4d4-613fd7b8a91e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:47.542793 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0f5f9e76-fcb9-4290-9f2f-45ec647ded59 tempest-FlavorsAdminTestJSON-939968559 tempest-FlavorsAdminTestJSON-939968559-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023425 May 27 14:57:47.543364 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 89/183] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:57:47.557023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4da10d43-f388-416b-af98-4a8b6d4465c4 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:47.557867 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:47.557867 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:47.576104 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4da10d43-f388-416b-af98-4a8b6d4465c4 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1482320340" status: 202 len: 0 microversion: 2.1 time: 0.022401 May 27 14:57:47.576713 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 90/184] 10.222.0.13 () {58 vars in 1160 bytes} [Fri May 27 14:57:47 2022] DELETE /compute/v2.1/flavors/1482320340 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 14:57:47.584344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-68f6628f-c8f6-4f4a-857a-dd5e6640ba96 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:47.603975 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-68f6628f-c8f6-4f4a-857a-dd5e6640ba96 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022494 May 27 14:57:47.604797 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 91/185] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:57:47.611211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-74069fbe-044a-4d24-bc29-68b3a42e7ee1 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:47.612087 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-74069fbe-044a-4d24-bc29-68b3a42e7ee1 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:47.620157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74069fbe-044a-4d24-bc29-68b3a42e7ee1 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:47.620614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74069fbe-044a-4d24-bc29-68b3a42e7ee1 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:47.621433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74069fbe-044a-4d24-bc29-68b3a42e7ee1 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:47.621878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74069fbe-044a-4d24-bc29-68b3a42e7ee1 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:47.659274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6da1d11e-0dc9-43cd-a4d4-613fd7b8a91e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:47.667910 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6da1d11e-0dc9-43cd-a4d4-613fd7b8a91e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1312 microversion: 2.1 time: 0.152980 May 27 14:57:47.668497 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 95/186] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:47 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:47.672937 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6ed80721-a125-4612-81fe-c2812a65b8e7 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-388653736", "id": 1835965675, "os-flavor-access:is_public": "True"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:47.674432 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:47.674432 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:47.689349 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6ed80721-a125-4612-81fe-c2812a65b8e7 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.019814 May 27 14:57:47.690138 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 96/187] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:57:47 2022] POST /compute/v2.1/flavors => generated 413 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:47.690492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-74069fbe-044a-4d24-bc29-68b3a42e7ee1 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:47.698457 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-74069fbe-044a-4d24-bc29-68b3a42e7ee1 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad" status: 200 len: 1276 microversion: 2.1 time: 0.091214 May 27 14:57:47.699026 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 92/188] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:47 2022] GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad => generated 1276 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:47.699643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a4901ad3-1777-4a18-b12b-22955a0474f5 tempest-FlavorsAdminTestJSON-939968559 tempest-FlavorsAdminTestJSON-939968559-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:47.719448 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a4901ad3-1777-4a18-b12b-22955a0474f5 tempest-FlavorsAdminTestJSON-939968559 tempest-FlavorsAdminTestJSON-939968559-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.023339 May 27 14:57:47.720003 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 97/189] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:47 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:47.734234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cb15be9f-8871-4217-b796-c034c6498aa0 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:47.734988 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:47.734988 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:47.751283 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cb15be9f-8871-4217-b796-c034c6498aa0 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1835965675" status: 202 len: 0 microversion: 2.1 time: 0.020595 May 27 14:57:47.752043 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 93/190] 10.222.0.13 () {58 vars in 1160 bytes} [Fri May 27 14:57:47 2022] DELETE /compute/v2.1/flavors/1835965675 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:57:47.760261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a370a268-ee02-4952-9fce-87abe16c3d36 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:47.763309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5b3142c3-0180-46d5-8be2-11811d871585 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:47.763872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5b3142c3-0180-46d5-8be2-11811d871585 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:47.769898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5b3142c3-0180-46d5-8be2-11811d871585 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:47.770361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5b3142c3-0180-46d5-8be2-11811d871585 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:47.771138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5b3142c3-0180-46d5-8be2-11811d871585 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:47.771583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5b3142c3-0180-46d5-8be2-11811d871585 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:47.779600 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a370a268-ee02-4952-9fce-87abe16c3d36 tempest-FlavorsAdminTestJSON-1649511229 tempest-FlavorsAdminTestJSON-1649511229-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023460 May 27 14:57:47.787808 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 98/191] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:57:47.910348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5b3142c3-0180-46d5-8be2-11811d871585 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:47.918435 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5b3142c3-0180-46d5-8be2-11811d871585 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1319 microversion: 2.1 time: 0.159110 May 27 14:57:47.919213 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 94/192] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:47 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:48.270219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ed61e3c9-cce2-428f-80f2-1d922729f6ce tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:48.270914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ed61e3c9-cce2-428f-80f2-1d922729f6ce tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:48.279027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ed61e3c9-cce2-428f-80f2-1d922729f6ce tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:48.279630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ed61e3c9-cce2-428f-80f2-1d922729f6ce tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:48.280545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ed61e3c9-cce2-428f-80f2-1d922729f6ce tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:48.281723 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ed61e3c9-cce2-428f-80f2-1d922729f6ce tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:48.338618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-93fd7285-37bc-4ca2-aa4c-ba13f0bb051d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:48.339988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-93fd7285-37bc-4ca2-aa4c-ba13f0bb051d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:48.347188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-93fd7285-37bc-4ca2-aa4c-ba13f0bb051d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:48.347915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-93fd7285-37bc-4ca2-aa4c-ba13f0bb051d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:48.348895 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-93fd7285-37bc-4ca2-aa4c-ba13f0bb051d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:48.349508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-93fd7285-37bc-4ca2-aa4c-ba13f0bb051d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:48.482494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ed61e3c9-cce2-428f-80f2-1d922729f6ce tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:48.491841 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ed61e3c9-cce2-428f-80f2-1d922729f6ce tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1339 microversion: 2.1 time: 0.226414 May 27 14:57:48.492889 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 99/193] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:48 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1339 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:48.499289 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-eb022383-7df1-4564-8187-1ac2e7eaaa36 req-10d0ad15-a63a-473e-acc1-09d6e39570f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6308b60c-6cce-4b7b-a8ec-a683a03f0fcc", "name": "network-vif-plugged", "status": "completed", "tag": "262bc22d-3099-4c20-95f0-39c2553c5754"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:48.509347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-eb022383-7df1-4564-8187-1ac2e7eaaa36 req-10d0ad15-a63a-473e-acc1-09d6e39570f3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:48.510331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-eb022383-7df1-4564-8187-1ac2e7eaaa36 req-10d0ad15-a63a-473e-acc1-09d6e39570f3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:48.522119 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-eb022383-7df1-4564-8187-1ac2e7eaaa36 req-10d0ad15-a63a-473e-acc1-09d6e39570f3 service nova] Creating event network-vif-plugged:262bc22d-3099-4c20-95f0-39c2553c5754 for instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc on n-h1-843621-1 May 27 14:57:48.527364 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-eb022383-7df1-4564-8187-1ac2e7eaaa36 req-10d0ad15-a63a-473e-acc1-09d6e39570f3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033279 May 27 14:57:48.528057 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 100/194] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:48.537307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-93fd7285-37bc-4ca2-aa4c-ba13f0bb051d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:48.545144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-93fd7285-37bc-4ca2-aa4c-ba13f0bb051d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:48.546644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-93fd7285-37bc-4ca2-aa4c-ba13f0bb051d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:48.547747 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-93fd7285-37bc-4ca2-aa4c-ba13f0bb051d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1383 microversion: 2.25 time: 0.214094 May 27 14:57:48.548452 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 95/195] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:57:48 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1383 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 14:57:48.686308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3712b2cb-9693-45c1-bc1c-395a5f4e2605 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:48.687226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3712b2cb-9693-45c1-bc1c-395a5f4e2605 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:48.693527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3712b2cb-9693-45c1-bc1c-395a5f4e2605 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:48.694050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3712b2cb-9693-45c1-bc1c-395a5f4e2605 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:48.694900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3712b2cb-9693-45c1-bc1c-395a5f4e2605 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:48.695406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3712b2cb-9693-45c1-bc1c-395a5f4e2605 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:48.715319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1bb43da1-fb31-4050-8365-94852851315c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:48.716186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1bb43da1-fb31-4050-8365-94852851315c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:48.722394 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1bb43da1-fb31-4050-8365-94852851315c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:48.722945 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1bb43da1-fb31-4050-8365-94852851315c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:48.723783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1bb43da1-fb31-4050-8365-94852851315c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:48.724291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1bb43da1-fb31-4050-8365-94852851315c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:48.797907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1bb43da1-fb31-4050-8365-94852851315c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:48.806873 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1bb43da1-fb31-4050-8365-94852851315c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad" status: 200 len: 1276 microversion: 2.1 time: 0.094701 May 27 14:57:48.816636 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 96/196] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:48 2022] GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad => generated 1276 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:57:48.860020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3712b2cb-9693-45c1-bc1c-395a5f4e2605 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:48.868356 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3712b2cb-9693-45c1-bc1c-395a5f4e2605 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1312 microversion: 2.1 time: 0.186911 May 27 14:57:48.869584 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 101/197] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:48 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1312 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:48.935814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ea7b7a1b-02cf-4ed2-9b52-f6c1d87278bc tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:48.936433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ea7b7a1b-02cf-4ed2-9b52-f6c1d87278bc tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:48.942495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea7b7a1b-02cf-4ed2-9b52-f6c1d87278bc tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:48.942980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea7b7a1b-02cf-4ed2-9b52-f6c1d87278bc tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:48.943747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea7b7a1b-02cf-4ed2-9b52-f6c1d87278bc tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:48.944189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea7b7a1b-02cf-4ed2-9b52-f6c1d87278bc tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:49.076117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ea7b7a1b-02cf-4ed2-9b52-f6c1d87278bc tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:49.083688 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ea7b7a1b-02cf-4ed2-9b52-f6c1d87278bc tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1319 microversion: 2.1 time: 0.152402 May 27 14:57:49.084261 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 97/198] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:48 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:49.512294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-71b45c46-850a-4df1-8dd6-7d0c595dba58 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:49.513553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-71b45c46-850a-4df1-8dd6-7d0c595dba58 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:49.526280 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71b45c46-850a-4df1-8dd6-7d0c595dba58 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:49.527065 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71b45c46-850a-4df1-8dd6-7d0c595dba58 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:49.529310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71b45c46-850a-4df1-8dd6-7d0c595dba58 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:49.530841 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71b45c46-850a-4df1-8dd6-7d0c595dba58 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:49.568034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7dd85a2a-2c66-462d-910e-483073cdc530 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:49.569683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7dd85a2a-2c66-462d-910e-483073cdc530 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:49.583961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7dd85a2a-2c66-462d-910e-483073cdc530 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:49.585780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7dd85a2a-2c66-462d-910e-483073cdc530 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:49.586800 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7dd85a2a-2c66-462d-910e-483073cdc530 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:49.588224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7dd85a2a-2c66-462d-910e-483073cdc530 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:49.929714 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-71b45c46-850a-4df1-8dd6-7d0c595dba58 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:49.940149 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-71b45c46-850a-4df1-8dd6-7d0c595dba58 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1489 microversion: 2.1 time: 0.432998 May 27 14:57:49.948068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7dd85a2a-2c66-462d-910e-483073cdc530 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:49.953349 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 102/199] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:49 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1489 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:49.958366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f8c75286-8cbc-4e8f-a0c8-76e8f9929bb1 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:49.959240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f8c75286-8cbc-4e8f-a0c8-76e8f9929bb1 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:49.959647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7dd85a2a-2c66-462d-910e-483073cdc530 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:49.961524 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7dd85a2a-2c66-462d-910e-483073cdc530 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:49.962789 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7dd85a2a-2c66-462d-910e-483073cdc530 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1383 microversion: 2.25 time: 0.400675 May 27 14:57:49.963559 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 98/200] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:57:49 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1383 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:57:49.967286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f8c75286-8cbc-4e8f-a0c8-76e8f9929bb1 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:49.967762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f8c75286-8cbc-4e8f-a0c8-76e8f9929bb1 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:49.968548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f8c75286-8cbc-4e8f-a0c8-76e8f9929bb1 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:49.969132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f8c75286-8cbc-4e8f-a0c8-76e8f9929bb1 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:49.978321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9cb16b4f-8d22-42a6-b6a1-eec6673d2533 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:49.980088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9cb16b4f-8d22-42a6-b6a1-eec6673d2533 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:49.987946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cb16b4f-8d22-42a6-b6a1-eec6673d2533 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:49.989067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cb16b4f-8d22-42a6-b6a1-eec6673d2533 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:49.990013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cb16b4f-8d22-42a6-b6a1-eec6673d2533 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:49.990882 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cb16b4f-8d22-42a6-b6a1-eec6673d2533 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:50.051325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f8c75286-8cbc-4e8f-a0c8-76e8f9929bb1 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:50.062820 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f8c75286-8cbc-4e8f-a0c8-76e8f9929bb1 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad" status: 200 len: 1276 microversion: 2.1 time: 0.108211 May 27 14:57:50.064239 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 103/201] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:49 2022] GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad => generated 1276 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:50.069516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ae49992b-8b23-4e60-a21f-9ad014240c94 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:50.070550 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ae49992b-8b23-4e60-a21f-9ad014240c94 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:50.078697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae49992b-8b23-4e60-a21f-9ad014240c94 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:50.079520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae49992b-8b23-4e60-a21f-9ad014240c94 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:50.080513 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae49992b-8b23-4e60-a21f-9ad014240c94 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:50.081531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae49992b-8b23-4e60-a21f-9ad014240c94 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:50.481137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9cb16b4f-8d22-42a6-b6a1-eec6673d2533 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:50.497662 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9cb16b4f-8d22-42a6-b6a1-eec6673d2533 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1312 microversion: 2.1 time: 0.532928 May 27 14:57:50.498626 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 99/202] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:49 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1312 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:50.503287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6bd73ee0-f432-4612-861b-06c597e23280 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:50.504102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6bd73ee0-f432-4612-861b-06c597e23280 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:50.510274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6bd73ee0-f432-4612-861b-06c597e23280 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:50.510904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6bd73ee0-f432-4612-861b-06c597e23280 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:50.511818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6bd73ee0-f432-4612-861b-06c597e23280 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:50.512405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6bd73ee0-f432-4612-861b-06c597e23280 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:50.570823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=10 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:50.598618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=14 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:50.816950 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6bd73ee0-f432-4612-861b-06c597e23280 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:50.824466 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6bd73ee0-f432-4612-861b-06c597e23280 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1319 microversion: 2.1 time: 0.324718 May 27 14:57:50.825073 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 100/203] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:50 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:50.947282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-709f5f80-1513-40b5-b02b-6d5fff7e570d tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-974781606", "ram": 512, "vcpus": 1, "disk": 10, "id": 1014544935, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:50.948949 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:50.948949 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:50.966649 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-709f5f80-1513-40b5-b02b-6d5fff7e570d tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.140517 May 27 14:57:50.968430 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ae49992b-8b23-4e60-a21f-9ad014240c94 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1640 microversion: 2.1 time: 0.902725 May 27 14:57:50.969029 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 104/204] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:50 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1640 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:50.974548 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 101/205] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:57:50 2022] POST /compute/v2.1/flavors => generated 415 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:50.984942 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b190d3dd-ad47-4a52-9f26-2ccb0983ed3f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:50.985953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b190d3dd-ad47-4a52-9f26-2ccb0983ed3f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:50.992515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b190d3dd-ad47-4a52-9f26-2ccb0983ed3f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:50.993307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b190d3dd-ad47-4a52-9f26-2ccb0983ed3f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:50.993921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b190d3dd-ad47-4a52-9f26-2ccb0983ed3f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:50.994750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b190d3dd-ad47-4a52-9f26-2ccb0983ed3f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:51.092259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5e8f6a28-dfd7-471e-8f6e-bbb18799cc78 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:51.101259 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-5e8f6a28-dfd7-471e-8f6e-bbb18799cc78 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project] HTTP exception thrown: Flavor 1014544935 has no extra specs with key hw:cpu_thread_policy. May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5e8f6a28-dfd7-471e-8f6e-bbb18799cc78 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project] Request method failure captured: May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/flavors/1014544935/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikObtw7QVbTG9fVitruMzi5Nu571U6dGzvsdxWjB021nMNyqr8ibHjB0sc9-e47oUos-6gksV_MrbfWlgTORTrMn5jvEBZeW2ZU94MbYeT9FZS3wRfY9DN2LfGH1RREVIPL2yz8g37-ci2NohvwwWvpSnt9eZjy5E7gHhwAPf7DPGqIE May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: ea674ab2d5444e9593bb9ad7c3bf2a85 May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:57:51.102972 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:57:51.104184 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea674ab2d5444e9593bb9ad7c3bf2a85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea674ab2d5444e9593bb9ad7c3bf2a85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea674ab2d5444e9593bb9ad7c3bf2a85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea674ab2d5444e9593bb9ad7c3bf2a85", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:51.104184 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 May 27 14:57:51.104184 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: ea674ab2d5444e9593bb9ad7c3bf2a85 May 27 14:57:51.104184 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 May 27 14:57:51.104184 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project May 27 14:57:51.104184 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:57:51.104184 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:57:51.104184 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: c3ae1b013f3b4e1bb643403f78cbaa38 May 27 14:57:51.104184 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project May 27 14:57:51.104184 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 14:57:51.104184 n-d-843621-1 devstack@n-api.service[119249]: exception: Flavor 1014544935 has no extra specs with key hw:cpu_thread_policy. May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'flavor_id': '1014544935', 'id': 'hw:cpu_thread_policy'} May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1014544935 has no extra specs with key hw:cpu_thread_policy. May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:51.104801 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:57:51.106546 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:51.106546 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:51.106546 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:51.106546 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:57:51.106546 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:57:51.106546 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1014544935 has no extra specs with key hw:cpu_thread_policy. May 27 14:57:51.106546 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:57:51.106546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5e8f6a28-dfd7-471e-8f6e-bbb18799cc78 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project] Returning 404 to user: Flavor 1014544935 has no extra specs with key hw:cpu_thread_policy. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:51.106546 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5e8f6a28-dfd7-471e-8f6e-bbb18799cc78 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project] 10.222.0.13 "GET /compute/v2.1/flavors/1014544935/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.124479 May 27 14:57:51.106546 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 105/206] 10.222.0.13 () {58 vars in 1265 bytes} [Fri May 27 14:57:50 2022] GET /compute/v2.1/flavors/1014544935/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:57:51.112872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3be4dc8c-5e83-46bd-a7f6-5a6d43800ee0 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:51.113441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3be4dc8c-5e83-46bd-a7f6-5a6d43800ee0 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:51.120440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3be4dc8c-5e83-46bd-a7f6-5a6d43800ee0 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:51.120942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3be4dc8c-5e83-46bd-a7f6-5a6d43800ee0 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:51.121710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3be4dc8c-5e83-46bd-a7f6-5a6d43800ee0 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:51.122149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3be4dc8c-5e83-46bd-a7f6-5a6d43800ee0 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:51.148910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3be4dc8c-5e83-46bd-a7f6-5a6d43800ee0 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 14:57:51.230888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:51.265360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b190d3dd-ad47-4a52-9f26-2ccb0983ed3f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:51.279233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b190d3dd-ad47-4a52-9f26-2ccb0983ed3f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:51.281872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b190d3dd-ad47-4a52-9f26-2ccb0983ed3f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:51.283062 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b190d3dd-ad47-4a52-9f26-2ccb0983ed3f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1383 microversion: 2.25 time: 0.302647 May 27 14:57:51.286048 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 102/207] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:57:50 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1383 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:57:51.294033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3291bd8e-797c-45ee-90d1-300b82cb06a5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:51.295112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3291bd8e-797c-45ee-90d1-300b82cb06a5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:51.298703 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3be4dc8c-5e83-46bd-a7f6-5a6d43800ee0 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 204 len: 0 microversion: 2.1 time: 0.192242 May 27 14:57:51.299287 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 106/208] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 14:57:51 2022] DELETE /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 14:57:51.304202 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3291bd8e-797c-45ee-90d1-300b82cb06a5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:51.304683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3291bd8e-797c-45ee-90d1-300b82cb06a5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:51.304790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e123354e-08a2-4aea-b107-181c0283d326 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:51.305512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3291bd8e-797c-45ee-90d1-300b82cb06a5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:51.305962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3291bd8e-797c-45ee-90d1-300b82cb06a5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:51.307033 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:51.307033 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:51.307918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e123354e-08a2-4aea-b107-181c0283d326 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'c3ae1b013f3b4e1bb643403f78cbaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea674ab2d5444e9593bb9ad7c3bf2a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e123354e-08a2-4aea-b107-181c0283d326 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project] Request method failure captured: May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/flavors/1014544935/os-extra_specs HTTP/1.1 May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 66 May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikObtw7QVbTG9fVitruMzi5Nu571U6dGzvsdxWjB021nMNyqr8ibHjB0sc9-e47oUos-6gksV_MrbfWlgTORTrMn5jvEBZeW2ZU94MbYeT9FZS3wRfY9DN2LfGH1RREVIPL2yz8g37-ci2NohvwwWvpSnt9eZjy5E7gHhwAPf7DPGqIE May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: ea674ab2d5444e9593bb9ad7c3bf2a85 May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:57:51.310019 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:57:51.311137 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea674ab2d5444e9593bb9ad7c3bf2a85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea674ab2d5444e9593bb9ad7c3bf2a85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea674ab2d5444e9593bb9ad7c3bf2a85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea674ab2d5444e9593bb9ad7c3bf2a85", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:51.311137 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 May 27 14:57:51.311137 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: ea674ab2d5444e9593bb9ad7c3bf2a85 May 27 14:57:51.311137 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 May 27 14:57:51.311137 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project May 27 14:57:51.311137 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:57:51.311137 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:57:51.311137 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: c3ae1b013f3b4e1bb643403f78cbaa38 May 27 14:57:51.311137 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project May 27 14:57:51.311137 n-d-843621-1 devstack@n-api.service[119249]: May 27 14:57:51.311137 n-d-843621-1 devstack@n-api.service[119249]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} May 27 14:57:51.311137 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 14:57:51.311872 n-d-843621-1 devstack@n-api.service[119249]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 27 14:57:51.311872 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'flavor_id': '1014544935', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} May 27 14:57:51.311872 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:51.311872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:51.311872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:51.311872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:51.311872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:51.311872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:51.311872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:51.311872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:51.311872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:57:51.311872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:57:51.311872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create May 27 14:57:51.311872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) May 27 14:57:51.311872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:57:51.311872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:57:51.311872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:57:51.311872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:57:51.311872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:57:51.312916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:57:51.312916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:57:51.312916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:57:51.312916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:57:51.312916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:57:51.312916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:57:51.312916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:57:51.312916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:57:51.312916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:57:51.312916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 27 14:57:51.312916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:57:51.312916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:51.312916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:57:51.312916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:51.312916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:51.312916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:51.312916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:57:51.312916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:57:51.312916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 27 14:57:51.312916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:57:51.313948 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e123354e-08a2-4aea-b107-181c0283d326 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:51.313948 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e123354e-08a2-4aea-b107-181c0283d326 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project] 10.222.0.13 "POST /compute/v2.1/flavors/1014544935/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.010854 May 27 14:57:51.313948 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 107/209] 10.222.0.13 () {60 vars in 1223 bytes} [Fri May 27 14:57:51 2022] POST /compute/v2.1/flavors/1014544935/os-extra_specs => generated 124 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:57:51.318047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-73c51375-4a4b-4839-ba55-08fcdcabe43f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:51.319474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-73c51375-4a4b-4839-ba55-08fcdcabe43f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:51.320802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=15,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:51.328209 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73c51375-4a4b-4839-ba55-08fcdcabe43f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:51.328727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73c51375-4a4b-4839-ba55-08fcdcabe43f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:51.329536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73c51375-4a4b-4839-ba55-08fcdcabe43f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:51.330055 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73c51375-4a4b-4839-ba55-08fcdcabe43f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:51.591303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3291bd8e-797c-45ee-90d1-300b82cb06a5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:51.600337 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3291bd8e-797c-45ee-90d1-300b82cb06a5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad" status: 200 len: 1318 microversion: 2.1 time: 0.312652 May 27 14:57:51.601221 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 103/210] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:51 2022] GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:51.606335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-03599dfa-a475-40ca-a91f-acf4a5abf56f tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:51.607923 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:51.607923 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:51.623025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-73c51375-4a4b-4839-ba55-08fcdcabe43f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:51.636291 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-73c51375-4a4b-4839-ba55-08fcdcabe43f tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1495 microversion: 2.1 time: 0.321968 May 27 14:57:51.639614 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 108/211] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:51 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1495 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:51.645963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3fbd1ebe-91dc-4d4a-bc9a-e7c10bf5baa9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:51.646828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3fbd1ebe-91dc-4d4a-bc9a-e7c10bf5baa9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:51.653439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fbd1ebe-91dc-4d4a-bc9a-e7c10bf5baa9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:51.654208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fbd1ebe-91dc-4d4a-bc9a-e7c10bf5baa9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:51.655166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fbd1ebe-91dc-4d4a-bc9a-e7c10bf5baa9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:51.655751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fbd1ebe-91dc-4d4a-bc9a-e7c10bf5baa9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:51.658024 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-03599dfa-a475-40ca-a91f-acf4a5abf56f tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1014544935/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.055442 May 27 14:57:51.658918 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 104/212] 10.222.0.13 () {60 vars in 1223 bytes} [Fri May 27 14:57:51 2022] POST /compute/v2.1/flavors/1014544935/os-extra_specs => generated 66 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 14:57:51.672466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bf3d7597-34c5-4153-a014-b2b2ef22b6e1 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:51.673579 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:51.673579 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:51.674756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bf3d7597-34c5-4153-a014-b2b2ef22b6e1 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'c3ae1b013f3b4e1bb643403f78cbaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea674ab2d5444e9593bb9ad7c3bf2a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bf3d7597-34c5-4153-a014-b2b2ef22b6e1 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project] Request method failure captured: May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/flavors/1014544935/os-extra_specs/hw:numa_nodes HTTP/1.1 May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObtw7QVbTG9fVitruMzi5Nu571U6dGzvsdxWjB021nMNyqr8ibHjB0sc9-e47oUos-6gksV_MrbfWlgTORTrMn5jvEBZeW2ZU94MbYeT9FZS3wRfY9DN2LfGH1RREVIPL2yz8g37-ci2NohvwwWvpSnt9eZjy5E7gHhwAPf7DPGqIE May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: ea674ab2d5444e9593bb9ad7c3bf2a85 May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:57:51.677861 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:57:51.678997 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea674ab2d5444e9593bb9ad7c3bf2a85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea674ab2d5444e9593bb9ad7c3bf2a85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea674ab2d5444e9593bb9ad7c3bf2a85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea674ab2d5444e9593bb9ad7c3bf2a85", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:51.678997 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 May 27 14:57:51.678997 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: ea674ab2d5444e9593bb9ad7c3bf2a85 May 27 14:57:51.678997 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 May 27 14:57:51.678997 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project May 27 14:57:51.678997 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:57:51.678997 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:57:51.678997 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: c3ae1b013f3b4e1bb643403f78cbaa38 May 27 14:57:51.678997 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project May 27 14:57:51.678997 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:57:51.678997 n-d-843621-1 devstack@n-api.service[119248]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 27 14:57:51.679579 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'flavor_id': '1014544935', 'id': 'hw:numa_nodes'} May 27 14:57:51.679579 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:51.679579 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:51.679579 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:51.679579 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:51.679579 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:51.679579 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:51.679579 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:51.679579 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:51.679579 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete May 27 14:57:51.679579 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) May 27 14:57:51.679579 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:57:51.679579 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:57:51.679579 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:57:51.679579 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:57:51.679579 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:57:51.679579 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:57:51.679579 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:57:51.679579 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:57:51.679579 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:57:51.680611 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:57:51.680611 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:57:51.680611 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:57:51.680611 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:57:51.680611 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:57:51.680611 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 27 14:57:51.680611 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.680611 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:51.680611 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.680611 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:51.680611 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:51.680611 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:51.680611 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:57:51.680611 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:57:51.680611 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 27 14:57:51.680611 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.680611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bf3d7597-34c5-4153-a014-b2b2ef22b6e1 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:51.682136 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bf3d7597-34c5-4153-a014-b2b2ef22b6e1 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project] 10.222.0.13 "DELETE /compute/v2.1/flavors/1014544935/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.012256 May 27 14:57:51.685192 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 105/213] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 14:57:51 2022] DELETE /compute/v2.1/flavors/1014544935/os-extra_specs/hw:numa_nodes => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:57:51.690310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1b955b96-f79f-4c7c-8e1e-61e601e966c8 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:51.715242 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1b955b96-f79f-4c7c-8e1e-61e601e966c8 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1014544935/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.028887 May 27 14:57:51.716190 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 106/214] 10.222.0.13 () {60 vars in 1223 bytes} [Fri May 27 14:57:51 2022] POST /compute/v2.1/flavors/1014544935/os-extra_specs => generated 66 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 14:57:51.725366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4a08e8e4-016a-4037-b8ed-63efa4c7162c tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:51.726949 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:51.726949 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:51.727892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4a08e8e4-016a-4037-b8ed-63efa4c7162c tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'c3ae1b013f3b4e1bb643403f78cbaa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea674ab2d5444e9593bb9ad7c3bf2a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4a08e8e4-016a-4037-b8ed-63efa4c7162c tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project] Request method failure captured: May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: request: PUT /compute/v2.1/flavors/1014544935/os-extra_specs/hw:numa_nodes HTTP/1.1 May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 22 May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObtw7QVbTG9fVitruMzi5Nu571U6dGzvsdxWjB021nMNyqr8ibHjB0sc9-e47oUos-6gksV_MrbfWlgTORTrMn5jvEBZeW2ZU94MbYeT9FZS3wRfY9DN2LfGH1RREVIPL2yz8g37-ci2NohvwwWvpSnt9eZjy5E7gHhwAPf7DPGqIE May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: ea674ab2d5444e9593bb9ad7c3bf2a85 May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:57:51.730151 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:57:51.731279 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea674ab2d5444e9593bb9ad7c3bf2a85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea674ab2d5444e9593bb9ad7c3bf2a85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea674ab2d5444e9593bb9ad7c3bf2a85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea674ab2d5444e9593bb9ad7c3bf2a85", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:51.731279 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 May 27 14:57:51.731279 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: ea674ab2d5444e9593bb9ad7c3bf2a85 May 27 14:57:51.731279 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 May 27 14:57:51.731279 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project May 27 14:57:51.731279 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:57:51.731279 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:57:51.731279 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: c3ae1b013f3b4e1bb643403f78cbaa38 May 27 14:57:51.731279 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project May 27 14:57:51.731279 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:57:51.731279 n-d-843621-1 devstack@n-api.service[119248]: {"hw:numa_nodes": "1"} May 27 14:57:51.731279 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:57:51.731279 n-d-843621-1 devstack@n-api.service[119248]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 27 14:57:51.732054 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'flavor_id': '1014544935', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} May 27 14:57:51.732054 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:51.732054 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:51.732054 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:51.732054 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:51.732054 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:51.732054 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:51.732054 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:51.732054 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:51.732054 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:57:51.732054 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:57:51.732054 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update May 27 14:57:51.732054 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) May 27 14:57:51.732054 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:57:51.732054 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:57:51.732054 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:57:51.732054 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:57:51.732054 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:57:51.732054 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:57:51.737421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:57:51.737421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:57:51.737421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:57:51.737421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:57:51.737421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:57:51.737421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:57:51.737421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:57:51.737421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:57:51.737421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 27 14:57:51.737421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.737421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:51.737421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.737421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:51.737421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:51.737421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:51.737421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:57:51.737421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:57:51.737421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 27 14:57:51.737421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.739406 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4a08e8e4-016a-4037-b8ed-63efa4c7162c tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:51.739406 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4a08e8e4-016a-4037-b8ed-63efa4c7162c tempest-FlavorsExtraSpecsNegativeTestJSON-434278261 tempest-FlavorsExtraSpecsNegativeTestJSON-434278261-project] 10.222.0.13 "PUT /compute/v2.1/flavors/1014544935/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010051 May 27 14:57:51.739406 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 107/215] 10.222.0.13 () {60 vars in 1264 bytes} [Fri May 27 14:57:51 2022] PUT /compute/v2.1/flavors/1014544935/os-extra_specs/hw:numa_nodes => generated 124 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 27 14:57:51.745309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ec3fff58-1b4e-4027-882f-01ef440b0d3b tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:51.753590 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-ec3fff58-1b4e-4027-882f-01ef440b0d3b tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] HTTP exception thrown: Flavor 1014544935 has no extra specs with key hw:cpu_thread_policy. May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ec3fff58-1b4e-4027-882f-01ef440b0d3b tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] Request method failure captured: May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/flavors/1014544935/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObu14ab2UxlQkvI_SwWmwgo2EGml4X8ykJE7HCU1OSgVedQFwqW5gxy-v8bqelMa2m2KITf09LELMM6ssNdKQ6jOf-F43s1J88mHRdUj_ycnLhGkRKwPjdmbFC2t6yMmcJyy63DoHVhLOqklxRb8lP8sa31VoMNL2FnkZwkS_nmV3I May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: aa6338016e9b4fb0bdd3c40f9cd927ed May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:57:51.755045 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:57:51.756282 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/aa6338016e9b4fb0bdd3c40f9cd927ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/aa6338016e9b4fb0bdd3c40f9cd927ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/aa6338016e9b4fb0bdd3c40f9cd927ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_aa6338016e9b4fb0bdd3c40f9cd927ed", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:51.756282 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 May 27 14:57:51.756282 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: aa6338016e9b4fb0bdd3c40f9cd927ed May 27 14:57:51.756282 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 May 27 14:57:51.756282 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin May 27 14:57:51.756282 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:57:51.756282 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:57:51.756282 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 7330fd9946cd4e8d9fdc1db0cab4dd11 May 27 14:57:51.756282 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin May 27 14:57:51.756282 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:57:51.756282 n-d-843621-1 devstack@n-api.service[119248]: exception: Flavor 1014544935 has no extra specs with key hw:cpu_thread_policy. May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'flavor_id': '1014544935', 'id': 'hw:cpu_thread_policy'} May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1014544935 has no extra specs with key hw:cpu_thread_policy. May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:51.757015 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.758106 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:51.758106 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:51.758106 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:51.758106 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:57:51.758106 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:57:51.758106 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1014544935 has no extra specs with key hw:cpu_thread_policy. May 27 14:57:51.758106 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.759973 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ec3fff58-1b4e-4027-882f-01ef440b0d3b tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] Returning 404 to user: Flavor 1014544935 has no extra specs with key hw:cpu_thread_policy. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:51.761053 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ec3fff58-1b4e-4027-882f-01ef440b0d3b tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1014544935/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.019906 May 27 14:57:51.762125 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 108/216] 10.222.0.13 () {58 vars in 1268 bytes} [Fri May 27 14:57:51 2022] DELETE /compute/v2.1/flavors/1014544935/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:57:51.770354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-bdf8e8b4-8a49-4a38-a16a-998681f701e2 req-3d781a79-ddf7-441e-8c06-5f8d3ea9a87a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad32218c-901a-44e3-92e3-5aeb695c4cc8", "name": "network-vif-plugged", "status": "completed", "tag": "1d06f984-6b2c-4b79-8cfb-73890966fc2a"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:51.778857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-bdf8e8b4-8a49-4a38-a16a-998681f701e2 req-3d781a79-ddf7-441e-8c06-5f8d3ea9a87a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:51.779755 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-bdf8e8b4-8a49-4a38-a16a-998681f701e2 req-3d781a79-ddf7-441e-8c06-5f8d3ea9a87a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:51.792847 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-bdf8e8b4-8a49-4a38-a16a-998681f701e2 req-3d781a79-ddf7-441e-8c06-5f8d3ea9a87a service nova] Creating event network-vif-plugged:1d06f984-6b2c-4b79-8cfb-73890966fc2a for instance ad32218c-901a-44e3-92e3-5aeb695c4cc8 on n-h2-843621-1 May 27 14:57:51.798061 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-bdf8e8b4-8a49-4a38-a16a-998681f701e2 req-3d781a79-ddf7-441e-8c06-5f8d3ea9a87a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034602 May 27 14:57:51.798854 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 109/217] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:51.804980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-215e5ef4-f913-42d6-a007-c0b49b3a665c tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:51.807371 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:51.807371 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:51.808497 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-215e5ef4-f913-42d6-a007-c0b49b3a665c tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] HTTP exception thrown: Request body and URI mismatch May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-215e5ef4-f913-42d6-a007-c0b49b3a665c tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] Request method failure captured: May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: request: PUT /compute/v2.1/flavors/1014544935/os-extra_specs/hw:numa_nodes HTTP/1.1 May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 27 May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObu14ab2UxlQkvI_SwWmwgo2EGml4X8ykJE7HCU1OSgVedQFwqW5gxy-v8bqelMa2m2KITf09LELMM6ssNdKQ6jOf-F43s1J88mHRdUj_ycnLhGkRKwPjdmbFC2t6yMmcJyy63DoHVhLOqklxRb8lP8sa31VoMNL2FnkZwkS_nmV3I May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: aa6338016e9b4fb0bdd3c40f9cd927ed May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:57:51.810171 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:57:51.811582 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/aa6338016e9b4fb0bdd3c40f9cd927ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/aa6338016e9b4fb0bdd3c40f9cd927ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/aa6338016e9b4fb0bdd3c40f9cd927ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_aa6338016e9b4fb0bdd3c40f9cd927ed", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:51.811582 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 May 27 14:57:51.811582 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: aa6338016e9b4fb0bdd3c40f9cd927ed May 27 14:57:51.811582 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 May 27 14:57:51.811582 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin May 27 14:57:51.811582 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:57:51.811582 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:57:51.811582 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 7330fd9946cd4e8d9fdc1db0cab4dd11 May 27 14:57:51.811582 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin May 27 14:57:51.811582 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:57:51.811582 n-d-843621-1 devstack@n-api.service[119248]: {"hw:cpu_policy": "shared"} May 27 14:57:51.811582 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:57:51.811582 n-d-843621-1 devstack@n-api.service[119248]: exception: Request body and URI mismatch May 27 14:57:51.812513 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'flavor_id': '1014544935', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} May 27 14:57:51.812513 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:51.812513 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:51.812513 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:51.812513 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:51.812513 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:51.812513 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:51.812513 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:51.812513 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:51.812513 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:57:51.812513 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:57:51.812513 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update May 27 14:57:51.812513 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) May 27 14:57:51.812513 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch May 27 14:57:51.812513 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.812513 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:51.812513 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.812513 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:51.812513 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:51.812513 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:51.813814 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:57:51.813814 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:57:51.813814 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch May 27 14:57:51.813814 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.820803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-215e5ef4-f913-42d6-a007-c0b49b3a665c tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:51.821915 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-215e5ef4-f913-42d6-a007-c0b49b3a665c tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/1014544935/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.021724 May 27 14:57:51.822643 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 110/218] 10.222.0.13 () {60 vars in 1264 bytes} [Fri May 27 14:57:51 2022] PUT /compute/v2.1/flavors/1014544935/os-extra_specs/hw:numa_nodes => generated 73 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 27 14:57:51.832581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4f2c7192-1eb7-4b7f-9569-76c9f1afac41 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4f2c7192-1eb7-4b7f-9569-76c9f1afac41 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] Request method failure captured: May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: request: PUT /compute/v2.1/flavors/1014544935/os-extra_specs/hw:numa_nodes HTTP/1.1 May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 49 May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObu14ab2UxlQkvI_SwWmwgo2EGml4X8ykJE7HCU1OSgVedQFwqW5gxy-v8bqelMa2m2KITf09LELMM6ssNdKQ6jOf-F43s1J88mHRdUj_ycnLhGkRKwPjdmbFC2t6yMmcJyy63DoHVhLOqklxRb8lP8sa31VoMNL2FnkZwkS_nmV3I May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: aa6338016e9b4fb0bdd3c40f9cd927ed May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:57:51.838231 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:57:51.839394 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/aa6338016e9b4fb0bdd3c40f9cd927ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/aa6338016e9b4fb0bdd3c40f9cd927ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/aa6338016e9b4fb0bdd3c40f9cd927ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_aa6338016e9b4fb0bdd3c40f9cd927ed", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:51.839394 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 May 27 14:57:51.839394 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: aa6338016e9b4fb0bdd3c40f9cd927ed May 27 14:57:51.839394 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 May 27 14:57:51.839394 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin May 27 14:57:51.839394 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:57:51.839394 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:57:51.839394 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 7330fd9946cd4e8d9fdc1db0cab4dd11 May 27 14:57:51.839394 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin May 27 14:57:51.839394 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:57:51.839394 n-d-843621-1 devstack@n-api.service[119248]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} May 27 14:57:51.839394 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'flavor_id': '1014544935', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'minProperties': 1, May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'type': ['string', May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'number']}}, May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance: May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} May 27 14:57:51.840035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.841321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:51.841321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.841321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:51.841321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:51.841321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:51.841321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:51.841321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:51.841321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:51.841321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:51.841321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 14:57:51.841321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 14:57:51.841321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 14:57:51.841321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 14:57:51.841321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 14:57:51.841321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 14:57:51.841321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 27 14:57:51.841321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.841321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:51.841321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.841321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:51.844596 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:51.844596 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:51.844596 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 14:57:51.844596 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 14:57:51.844596 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 27 14:57:51.844596 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:51.844596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4f2c7192-1eb7-4b7f-9569-76c9f1afac41 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:51.844596 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4f2c7192-1eb7-4b7f-9569-76c9f1afac41 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/1014544935/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.013008 May 27 14:57:51.844596 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 111/219] 10.222.0.13 () {60 vars in 1264 bytes} [Fri May 27 14:57:51 2022] PUT /compute/v2.1/flavors/1014544935/os-extra_specs/hw:numa_nodes => generated 117 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 14:57:51.849159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a0cb1604-df77-450b-9b36-fa4e594a27d8 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:51.850061 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a0cb1604-df77-450b-9b36-fa4e594a27d8 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:51.857150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a0cb1604-df77-450b-9b36-fa4e594a27d8 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:51.857684 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a0cb1604-df77-450b-9b36-fa4e594a27d8 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:51.858467 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a0cb1604-df77-450b-9b36-fa4e594a27d8 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:51.858909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a0cb1604-df77-450b-9b36-fa4e594a27d8 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:51.952833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3fbd1ebe-91dc-4d4a-bc9a-e7c10bf5baa9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:51.960716 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3fbd1ebe-91dc-4d4a-bc9a-e7c10bf5baa9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1312 microversion: 2.1 time: 0.320133 May 27 14:57:51.961386 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 109/220] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:51 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1312 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:51.965907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-98bff0e5-90b5-4d31-89ca-27048602022d tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:51.966911 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:51.966911 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:51.986867 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-98bff0e5-90b5-4d31-89ca-27048602022d tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1014544935" status: 202 len: 0 microversion: 2.1 time: 0.024088 May 27 14:57:51.987494 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 110/221] 10.222.0.13 () {58 vars in 1160 bytes} [Fri May 27 14:57:51 2022] DELETE /compute/v2.1/flavors/1014544935 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:57:51.995984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-73a64385-1cd8-4a25-93aa-76757cea3ea2 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:52.015479 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-73a64385-1cd8-4a25-93aa-76757cea3ea2 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852 tempest-FlavorsExtraSpecsNegativeTestJSON-1473036852-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023675 May 27 14:57:52.016077 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 111/222] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:57:52.080572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a0cb1604-df77-450b-9b36-fa4e594a27d8 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:52.092142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:52.097793 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a0cb1604-df77-450b-9b36-fa4e594a27d8 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1319 microversion: 2.1 time: 0.254711 May 27 14:57:52.100066 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 112/223] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:51 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:52.303444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7cdb9962-6275-44e5-84b9-ed8944e54f0c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:52.304066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7cdb9962-6275-44e5-84b9-ed8944e54f0c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:52.312657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7cdb9962-6275-44e5-84b9-ed8944e54f0c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:52.313136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7cdb9962-6275-44e5-84b9-ed8944e54f0c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:52.317864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7cdb9962-6275-44e5-84b9-ed8944e54f0c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:52.318531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7cdb9962-6275-44e5-84b9-ed8944e54f0c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:52.619620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0a5b5d4b-bf2e-4b3e-b8fa-f2ee33aed035 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:52.620477 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0a5b5d4b-bf2e-4b3e-b8fa-f2ee33aed035 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:52.627829 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a5b5d4b-bf2e-4b3e-b8fa-f2ee33aed035 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:52.628386 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a5b5d4b-bf2e-4b3e-b8fa-f2ee33aed035 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:52.629284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a5b5d4b-bf2e-4b3e-b8fa-f2ee33aed035 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:52.629845 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a5b5d4b-bf2e-4b3e-b8fa-f2ee33aed035 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:52.847765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7cdb9962-6275-44e5-84b9-ed8944e54f0c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:52.856301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7cdb9962-6275-44e5-84b9-ed8944e54f0c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:52.858141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7cdb9962-6275-44e5-84b9-ed8944e54f0c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:52.859614 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7cdb9962-6275-44e5-84b9-ed8944e54f0c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1383 microversion: 2.25 time: 0.560189 May 27 14:57:52.860178 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 112/224] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:57:52 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1383 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:57:52.866179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b3508d64-a3af-4cb5-aacd-895c0fdbd092 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:52.866974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b3508d64-a3af-4cb5-aacd-895c0fdbd092 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:52.875536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3508d64-a3af-4cb5-aacd-895c0fdbd092 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:52.876124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3508d64-a3af-4cb5-aacd-895c0fdbd092 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:52.876967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3508d64-a3af-4cb5-aacd-895c0fdbd092 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:52.877405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3508d64-a3af-4cb5-aacd-895c0fdbd092 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:53.223335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0a5b5d4b-bf2e-4b3e-b8fa-f2ee33aed035 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:53.234223 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0a5b5d4b-bf2e-4b3e-b8fa-f2ee33aed035 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad" status: 200 len: 1318 microversion: 2.1 time: 0.618460 May 27 14:57:53.236392 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 113/225] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:52 2022] GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad => generated 1318 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:57:53.309165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-e87f570c-573b-48cc-8e38-f5f00c04d665 req-e928508c-2c17-4535-a33e-4460988e8b3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae05ce87-e077-487e-906e-824915f604ad", "tag": "22359590-0f71-41f7-9cb3-b11408fae17d"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:53.315472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b3508d64-a3af-4cb5-aacd-895c0fdbd092 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:53.321379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e87f570c-573b-48cc-8e38-f5f00c04d665 req-e928508c-2c17-4535-a33e-4460988e8b3b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:53.322178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e87f570c-573b-48cc-8e38-f5f00c04d665 req-e928508c-2c17-4535-a33e-4460988e8b3b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:53.325355 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b3508d64-a3af-4cb5-aacd-895c0fdbd092 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1495 microversion: 2.1 time: 0.463673 May 27 14:57:53.326280 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 113/226] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:52 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1495 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:53.332768 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f32d81d5-5686-40e0-a8c0-b2a9892c7abe tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:53.333397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f32d81d5-5686-40e0-a8c0-b2a9892c7abe tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:53.337194 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-e87f570c-573b-48cc-8e38-f5f00c04d665 req-e928508c-2c17-4535-a33e-4460988e8b3b service nova] Creating event network-changed:22359590-0f71-41f7-9cb3-b11408fae17d for instance ae05ce87-e077-487e-906e-824915f604ad on n-h1-843621-1 May 27 14:57:53.342311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f32d81d5-5686-40e0-a8c0-b2a9892c7abe tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:53.342970 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f32d81d5-5686-40e0-a8c0-b2a9892c7abe tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:53.343910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f32d81d5-5686-40e0-a8c0-b2a9892c7abe tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:53.344157 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-e87f570c-573b-48cc-8e38-f5f00c04d665 req-e928508c-2c17-4535-a33e-4460988e8b3b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105837 May 27 14:57:53.344817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f32d81d5-5686-40e0-a8c0-b2a9892c7abe tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:53.345500 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 114/227] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:53.352350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e75e3cda-e11d-44b3-91ac-7670e2b5643f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:53.353893 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e75e3cda-e11d-44b3-91ac-7670e2b5643f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:53.362816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e75e3cda-e11d-44b3-91ac-7670e2b5643f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:53.363706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e75e3cda-e11d-44b3-91ac-7670e2b5643f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:53.365439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e75e3cda-e11d-44b3-91ac-7670e2b5643f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:53.365959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e75e3cda-e11d-44b3-91ac-7670e2b5643f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:53.678615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e75e3cda-e11d-44b3-91ac-7670e2b5643f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:53.700605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f32d81d5-5686-40e0-a8c0-b2a9892c7abe tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:53.704396 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e75e3cda-e11d-44b3-91ac-7670e2b5643f tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1469 microversion: 2.1 time: 0.357242 May 27 14:57:53.709071 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 115/228] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:53 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1469 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:53.722498 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f32d81d5-5686-40e0-a8c0-b2a9892c7abe tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1312 microversion: 2.1 time: 0.395079 May 27 14:57:53.723077 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 114/229] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:53 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1312 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:53.832767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-4a2f7585-ecaa-42ce-8016-8c592b8cf0dc req-9cb2589b-c8a0-40a5-9296-0218ef15f54d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8", "name": "network-vif-deleted", "tag": "81242489-b7cd-4e69-8684-73049292e7a8"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:53.847808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4a2f7585-ecaa-42ce-8016-8c592b8cf0dc req-9cb2589b-c8a0-40a5-9296-0218ef15f54d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:53.849905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4a2f7585-ecaa-42ce-8016-8c592b8cf0dc req-9cb2589b-c8a0-40a5-9296-0218ef15f54d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:53.873945 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-4a2f7585-ecaa-42ce-8016-8c592b8cf0dc req-9cb2589b-c8a0-40a5-9296-0218ef15f54d service nova] Creating event network-vif-deleted:81242489-b7cd-4e69-8684-73049292e7a8 for instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 on n-h2-843621-1 May 27 14:57:53.886792 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-4a2f7585-ecaa-42ce-8016-8c592b8cf0dc req-9cb2589b-c8a0-40a5-9296-0218ef15f54d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056280 May 27 14:57:53.888972 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 115/230] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 14:57:53.897878 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-88b8dbd7-bc97-4305-b47f-2d48d1c8c5fa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:53.901304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-88b8dbd7-bc97-4305-b47f-2d48d1c8c5fa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:53.905975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3b58b648-7439-4bfa-b2af-e77015d0dd79 tempest-DeleteServersAdminTestJSON-1392015186 tempest-DeleteServersAdminTestJSON-1392015186-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:53.906486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3b58b648-7439-4bfa-b2af-e77015d0dd79 tempest-DeleteServersAdminTestJSON-1392015186 tempest-DeleteServersAdminTestJSON-1392015186-project-admin] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:53.907977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-88b8dbd7-bc97-4305-b47f-2d48d1c8c5fa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:53.908479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=82,nova_api:DELETE=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:53.908618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-88b8dbd7-bc97-4305-b47f-2d48d1c8c5fa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:53.909867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-88b8dbd7-bc97-4305-b47f-2d48d1c8c5fa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:53.910412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-88b8dbd7-bc97-4305-b47f-2d48d1c8c5fa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:53.919376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b58b648-7439-4bfa-b2af-e77015d0dd79 tempest-DeleteServersAdminTestJSON-1392015186 tempest-DeleteServersAdminTestJSON-1392015186-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:53.919845 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b58b648-7439-4bfa-b2af-e77015d0dd79 tempest-DeleteServersAdminTestJSON-1392015186 tempest-DeleteServersAdminTestJSON-1392015186-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:53.920639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b58b648-7439-4bfa-b2af-e77015d0dd79 tempest-DeleteServersAdminTestJSON-1392015186 tempest-DeleteServersAdminTestJSON-1392015186-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:53.925626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b58b648-7439-4bfa-b2af-e77015d0dd79 tempest-DeleteServersAdminTestJSON-1392015186 tempest-DeleteServersAdminTestJSON-1392015186-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:54.015916 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3b58b648-7439-4bfa-b2af-e77015d0dd79 tempest-DeleteServersAdminTestJSON-1392015186 tempest-DeleteServersAdminTestJSON-1392015186-project-admin] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 14:57:54.095527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-88b8dbd7-bc97-4305-b47f-2d48d1c8c5fa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:54.104808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-88b8dbd7-bc97-4305-b47f-2d48d1c8c5fa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:54.106843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-88b8dbd7-bc97-4305-b47f-2d48d1c8c5fa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:54.108182 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-88b8dbd7-bc97-4305-b47f-2d48d1c8c5fa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1383 microversion: 2.25 time: 0.218108 May 27 14:57:54.108922 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 116/231] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:57:53 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1383 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:57:54.176399 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3b58b648-7439-4bfa-b2af-e77015d0dd79 tempest-DeleteServersAdminTestJSON-1392015186 tempest-DeleteServersAdminTestJSON-1392015186-project-admin] 10.222.0.13 "DELETE /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 204 len: 0 microversion: 2.1 time: 0.453990 May 27 14:57:54.177229 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 116/232] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 14:57:53 2022] DELETE /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 14:57:54.185131 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-94c50314-edc5-44d3-b330-05a79f87ea75 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:54.185762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-94c50314-edc5-44d3-b330-05a79f87ea75 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:54.194237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94c50314-edc5-44d3-b330-05a79f87ea75 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:54.194910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94c50314-edc5-44d3-b330-05a79f87ea75 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:54.196135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94c50314-edc5-44d3-b330-05a79f87ea75 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:54.197127 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94c50314-edc5-44d3-b330-05a79f87ea75 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:54.253674 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-21eab2ee-9970-4071-bc18-05a0bd0f514b tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:54.254961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-21eab2ee-9970-4071-bc18-05a0bd0f514b tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:54.265553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21eab2ee-9970-4071-bc18-05a0bd0f514b tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:54.266023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21eab2ee-9970-4071-bc18-05a0bd0f514b tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:54.266827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21eab2ee-9970-4071-bc18-05a0bd0f514b tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:54.267274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21eab2ee-9970-4071-bc18-05a0bd0f514b tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:54.380547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-94c50314-edc5-44d3-b330-05a79f87ea75 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:54.389658 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-94c50314-edc5-44d3-b330-05a79f87ea75 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1475 microversion: 2.1 time: 0.208184 May 27 14:57:54.393571 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 117/233] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:54 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1475 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:54.397881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-8bfedbe1-1f36-443d-9db0-449245152e27 req-a8b4c69f-d2aa-479d-9e77-ef308eb26b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37dbb2d-08d2-4f90-9c36-d373a0dec9d5", "name": "network-vif-plugged", "status": "completed", "tag": "a88e358c-7366-488d-b011-77c43429e37d"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:54.407207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-8bfedbe1-1f36-443d-9db0-449245152e27 req-a8b4c69f-d2aa-479d-9e77-ef308eb26b18 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:54.407862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-8bfedbe1-1f36-443d-9db0-449245152e27 req-a8b4c69f-d2aa-479d-9e77-ef308eb26b18 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:54.441942 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-8bfedbe1-1f36-443d-9db0-449245152e27 req-a8b4c69f-d2aa-479d-9e77-ef308eb26b18 service nova] Creating event network-vif-plugged:a88e358c-7366-488d-b011-77c43429e37d for instance f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 on n-h1-843621-1 May 27 14:57:54.455814 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-8bfedbe1-1f36-443d-9db0-449245152e27 req-a8b4c69f-d2aa-479d-9e77-ef308eb26b18 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061218 May 27 14:57:54.458126 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 118/234] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:54.465989 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d8323462-814b-4451-b56a-56e17b6d3451 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:54.466705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-21eab2ee-9970-4071-bc18-05a0bd0f514b tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:54.466852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d8323462-814b-4451-b56a-56e17b6d3451 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:54.474238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8323462-814b-4451-b56a-56e17b6d3451 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:54.474871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8323462-814b-4451-b56a-56e17b6d3451 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:54.478554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8323462-814b-4451-b56a-56e17b6d3451 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:54.478554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8323462-814b-4451-b56a-56e17b6d3451 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:54.478894 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-21eab2ee-9970-4071-bc18-05a0bd0f514b tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad" status: 200 len: 1318 microversion: 2.1 time: 0.226783 May 27 14:57:54.478894 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 117/235] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:54 2022] GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:57:54.531017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8323462-814b-4451-b56a-56e17b6d3451 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:54.532563 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8323462-814b-4451-b56a-56e17b6d3451 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:54.536321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-d8323462-814b-4451-b56a-56e17b6d3451 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lazy-loading 'fault' on Instance uuid 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:57:54.588978 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d8323462-814b-4451-b56a-56e17b6d3451 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '852d9fd26d404e0b8ff560657e187c7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8ad802697947bbbd44c9a3eff36880', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:54.596683 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d8323462-814b-4451-b56a-56e17b6d3451 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 200 len: 1329 microversion: 2.1 time: 0.136976 May 27 14:57:54.597275 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 119/236] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:54 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 1329 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:54.739531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-06c3601e-7b7b-49a2-a4dd-8ed272e8311d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:54.740142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-06c3601e-7b7b-49a2-a4dd-8ed272e8311d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:54.746542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06c3601e-7b7b-49a2-a4dd-8ed272e8311d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:54.747298 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06c3601e-7b7b-49a2-a4dd-8ed272e8311d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:54.748231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06c3601e-7b7b-49a2-a4dd-8ed272e8311d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:54.748690 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06c3601e-7b7b-49a2-a4dd-8ed272e8311d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:54.880349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-06c3601e-7b7b-49a2-a4dd-8ed272e8311d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:54.888364 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-06c3601e-7b7b-49a2-a4dd-8ed272e8311d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1312 microversion: 2.1 time: 0.152907 May 27 14:57:54.888978 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 118/237] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:54 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:55.126467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-36ba8371-f830-4cc6-87d2-cfb1bd6c3993 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:55.127380 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-36ba8371-f830-4cc6-87d2-cfb1bd6c3993 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:55.134017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36ba8371-f830-4cc6-87d2-cfb1bd6c3993 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:55.135192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36ba8371-f830-4cc6-87d2-cfb1bd6c3993 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:55.136054 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36ba8371-f830-4cc6-87d2-cfb1bd6c3993 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:55.136549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36ba8371-f830-4cc6-87d2-cfb1bd6c3993 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:55.180662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=20 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:55.270992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-36ba8371-f830-4cc6-87d2-cfb1bd6c3993 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:55.279372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-36ba8371-f830-4cc6-87d2-cfb1bd6c3993 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:55.280846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-36ba8371-f830-4cc6-87d2-cfb1bd6c3993 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:55.282004 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-36ba8371-f830-4cc6-87d2-cfb1bd6c3993 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1579 microversion: 2.25 time: 0.159523 May 27 14:57:55.282561 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 120/238] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:57:55 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1579 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:57:55.408859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-df7c5a2b-7a80-4f2b-952e-1d3a19155db4 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:55.410090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-df7c5a2b-7a80-4f2b-952e-1d3a19155db4 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:55.418614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df7c5a2b-7a80-4f2b-952e-1d3a19155db4 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:55.419165 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df7c5a2b-7a80-4f2b-952e-1d3a19155db4 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:55.420157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df7c5a2b-7a80-4f2b-952e-1d3a19155db4 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:55.420657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df7c5a2b-7a80-4f2b-952e-1d3a19155db4 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:55.437078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=10 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:55.498532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d5a17520-d529-43dd-a9fb-ec584f340d11 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:55.500612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d5a17520-d529-43dd-a9fb-ec584f340d11 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:55.509196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5a17520-d529-43dd-a9fb-ec584f340d11 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:55.509919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5a17520-d529-43dd-a9fb-ec584f340d11 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:55.511105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5a17520-d529-43dd-a9fb-ec584f340d11 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:55.511583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5a17520-d529-43dd-a9fb-ec584f340d11 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:55.615068 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-df7c5a2b-7a80-4f2b-952e-1d3a19155db4 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:55.624061 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-df7c5a2b-7a80-4f2b-952e-1d3a19155db4 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1475 microversion: 2.1 time: 0.220516 May 27 14:57:55.624852 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 121/239] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:55 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1475 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:57:55.641601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e92d7bb2-39e4-42dd-a874-bead36b3f36c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:55.642213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e92d7bb2-39e4-42dd-a874-bead36b3f36c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:55.648187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e92d7bb2-39e4-42dd-a874-bead36b3f36c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:55.648640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e92d7bb2-39e4-42dd-a874-bead36b3f36c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:55.649462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e92d7bb2-39e4-42dd-a874-bead36b3f36c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:55.649946 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e92d7bb2-39e4-42dd-a874-bead36b3f36c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:55.675154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-d5a17520-d529-43dd-a9fb-ec584f340d11 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lazy-loading 'services' on Instance uuid ad32218c-901a-44e3-92e3-5aeb695c4cc8 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:57:55.733342 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d5a17520-d529-43dd-a9fb-ec584f340d11 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 2071 microversion: 2.25 time: 0.437449 May 27 14:57:55.734214 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 119/240] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:57:55 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 2071 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:57:55.739421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c534120e-d674-4fc2-a482-7e7518e8e2c6 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:55.740306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c534120e-d674-4fc2-a482-7e7518e8e2c6 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:55.748453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c534120e-d674-4fc2-a482-7e7518e8e2c6 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:55.749243 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c534120e-d674-4fc2-a482-7e7518e8e2c6 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:55.750250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c534120e-d674-4fc2-a482-7e7518e8e2c6 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:55.750879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c534120e-d674-4fc2-a482-7e7518e8e2c6 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:55.765837 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-c534120e-d674-4fc2-a482-7e7518e8e2c6 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] HTTP exception thrown: Instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 could not be found. May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c534120e-d674-4fc2-a482-7e7518e8e2c6 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Request method failure captured: May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 HTTP/1.1 May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObLX5sdBha_C7JLSos0YeUwwH2YZBHxubjOyc7lwlex3uxb6u5qpJUZAyywzO9NxxR0ip5emWe8aTII8XZkgWn5hMxr23Hc5izgHfMiIeNnEUozZ_gVMDh39vJd7qYQmtE9XlYgZQO1p8DzeB7JNE9aDCf58bOhsHH0mlwaUUfnZb0 May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 2e8ad802697947bbbd44c9a3eff36880 May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AggregatesAdminTestJSON-2063592965 May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:57:55.768635 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:57:55.769818 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e8ad802697947bbbd44c9a3eff36880"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e8ad802697947bbbd44c9a3eff36880"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2e8ad802697947bbbd44c9a3eff36880"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2e8ad802697947bbbd44c9a3eff36880", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:55.769818 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AggregatesAdminTestJSON-2063592965 May 27 14:57:55.769818 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 2e8ad802697947bbbd44c9a3eff36880 May 27 14:57:55.769818 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2063592965 May 27 14:57:55.769818 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AggregatesAdminTestJSON-2063592965-project May 27 14:57:55.769818 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:57:55.769818 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:57:55.769818 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 852d9fd26d404e0b8ff560657e187c7a May 27 14:57:55.769818 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AggregatesAdminTestJSON-2063592965-project May 27 14:57:55.769818 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:57:55.769818 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 could not be found. May 27 14:57:55.769818 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8'} May 27 14:57:55.770464 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:55.770464 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:55.770464 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 14:57:55.770464 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 14:57:55.770464 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 14:57:55.770464 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 14:57:55.770464 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 14:57:55.770464 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 14:57:55.770464 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 14:57:55.770464 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 14:57:55.770464 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 could not be found. May 27 14:57:55.770464 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:55.770464 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:55.770464 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:55.770464 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:55.770464 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:55.770464 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:55.770464 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:55.770464 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:55.770464 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:55.771504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:55.771504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 14:57:55.771504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 14:57:55.771504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 14:57:55.771504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 14:57:55.771504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 14:57:55.771504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 14:57:55.771504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 could not be found. May 27 14:57:55.771504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:55.771504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:55.771504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:55.771504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:55.771504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:55.771504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:55.771504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:57:55.771504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:57:55.771504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 could not be found. May 27 14:57:55.771504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:55.773872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c534120e-d674-4fc2-a482-7e7518e8e2c6 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Returning 404 to user: Instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:55.775497 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c534120e-d674-4fc2-a482-7e7518e8e2c6 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 404 len: 111 microversion: 2.1 time: 0.039683 May 27 14:57:55.776396 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 120/241] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:55 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:57:55.782143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f50f5f88-6340-43c5-9ca8-6d3d5d00eb0b tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:55.783099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f50f5f88-6340-43c5-9ca8-6d3d5d00eb0b tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:55.789763 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f50f5f88-6340-43c5-9ca8-6d3d5d00eb0b tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:55.791857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f50f5f88-6340-43c5-9ca8-6d3d5d00eb0b tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:55.793025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f50f5f88-6340-43c5-9ca8-6d3d5d00eb0b tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:55.793661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f50f5f88-6340-43c5-9ca8-6d3d5d00eb0b tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:55.820212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e92d7bb2-39e4-42dd-a874-bead36b3f36c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:55.827997 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e92d7bb2-39e4-42dd-a874-bead36b3f36c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad" status: 200 len: 1318 microversion: 2.1 time: 0.192592 May 27 14:57:55.838555 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 122/242] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:55 2022] GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:55.849574 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-149f3580-3d60-49e7-89f7-af07816b99df tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-843621-1"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:55.851546 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:55.851546 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:55.866168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-149f3580-3d60-49e7-89f7-af07816b99df tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:55.866895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-149f3580-3d60-49e7-89f7-af07816b99df tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:55.981023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-f50f5f88-6340-43c5-9ca8-6d3d5d00eb0b tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lazy-loading 'services' on Instance uuid ad32218c-901a-44e3-92e3-5aeb695c4cc8 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:57:56.005332 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f50f5f88-6340-43c5-9ca8-6d3d5d00eb0b tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 2071 microversion: 2.25 time: 0.227596 May 27 14:57:56.005945 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 121/243] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:57:55 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 2071 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:57:56.013437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4b6cd1f3-f001-4ea0-9131-fea549930d1d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:56.014478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4b6cd1f3-f001-4ea0-9131-fea549930d1d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:56.022056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b6cd1f3-f001-4ea0-9131-fea549930d1d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.022510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b6cd1f3-f001-4ea0-9131-fea549930d1d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:56.023319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b6cd1f3-f001-4ea0-9131-fea549930d1d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.023758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b6cd1f3-f001-4ea0-9131-fea549930d1d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:56.034121 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-149f3580-3d60-49e7-89f7-af07816b99df tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 300 microversion: 2.1 time: 0.194304 May 27 14:57:56.035265 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 123/244] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 27 14:57:55 2022] POST /compute/v2.1/os-aggregates/4/action => generated 300 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:56.052227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c2edd831-93e3-422d-a4c0-8798a45c5ede tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:56.058378 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:56.058378 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:56.061423 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2edd831-93e3-422d-a4c0-8798a45c5ede tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.062385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2edd831-93e3-422d-a4c0-8798a45c5ede tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:56.063533 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2edd831-93e3-422d-a4c0-8798a45c5ede tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.064068 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2edd831-93e3-422d-a4c0-8798a45c5ede tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:56.092515 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c2edd831-93e3-422d-a4c0-8798a45c5ede tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.055958 May 27 14:57:56.093798 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 124/245] 10.222.0.13 () {60 vars in 1216 bytes} [Fri May 27 14:57:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:57:56.098598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fd2c6589-8b60-4a1f-8820-c1e591cbeaf8 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:56.099507 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:56.099507 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:56.129649 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fd2c6589-8b60-4a1f-8820-c1e591cbeaf8 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.034750 May 27 14:57:56.130238 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 125/246] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 14:57:56 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 27 14:57:56.143192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-20dfc0e7-9949-46e0-a774-4842f8efe5a7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843621-1", "block_migration": "auto"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:56.144373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-20dfc0e7-9949-46e0-a774-4842f8efe5a7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:56.152120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20dfc0e7-9949-46e0-a774-4842f8efe5a7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.152565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20dfc0e7-9949-46e0-a774-4842f8efe5a7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:56.153526 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20dfc0e7-9949-46e0-a774-4842f8efe5a7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.154149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20dfc0e7-9949-46e0-a774-4842f8efe5a7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:56.222728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4b6cd1f3-f001-4ea0-9131-fea549930d1d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:56.231693 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4b6cd1f3-f001-4ea0-9131-fea549930d1d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1312 microversion: 2.1 time: 0.224751 May 27 14:57:56.232526 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 122/247] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:56 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1312 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:56.354381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-52a920c0-106b-499b-a1a6-d4d143aa836e tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Calling method '.version_select at 0x7fc777567790>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:56.355649 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:56.355649 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:56.356915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-52a920c0-106b-499b-a1a6-d4d143aa836e tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.357292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-52a920c0-106b-499b-a1a6-d4d143aa836e tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:56.375235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-52a920c0-106b-499b-a1a6-d4d143aa836e tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.375697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-52a920c0-106b-499b-a1a6-d4d143aa836e tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:56.378321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-20dfc0e7-9949-46e0-a774-4842f8efe5a7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lazy-loading 'flavor' on Instance uuid ad32218c-901a-44e3-92e3-5aeb695c4cc8 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:57:56.386873 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-52a920c0-106b-499b-a1a6-d4d143aa836e tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.387332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-52a920c0-106b-499b-a1a6-d4d143aa836e tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:56.395979 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-52a920c0-106b-499b-a1a6-d4d143aa836e tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.162310 May 27 14:57:56.396563 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 123/248] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:56.401463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fe641f61-8777-424c-a645-145bbe2f0856 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-569507431"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:56.402833 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:56.402833 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:56.403693 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.aggregate [None req-fe641f61-8777-424c-a645-145bbe2f0856 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Generated uuid 9fd3ab7e-819a-42c7-995a-1597a0801c1d for aggregate {{(pid=119248) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 27 14:57:56.429307 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fe641f61-8777-424c-a645-145bbe2f0856 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.031686 May 27 14:57:56.429914 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 124/249] 10.222.0.13 () {60 vars in 1163 bytes} [Fri May 27 14:57:56 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:56.434257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fdb72e11-8aca-4cc3-b4fc-5fb537254408 tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Calling method '.version_select at 0x7fc7773f05e0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:56.435047 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:56.435047 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:56.436164 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fdb72e11-8aca-4cc3-b4fc-5fb537254408 tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.436622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fdb72e11-8aca-4cc3-b4fc-5fb537254408 tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:56.442443 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-20dfc0e7-9949-46e0-a774-4842f8efe5a7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Going to try to live migrate instance to n-h1-843621-1 {{(pid=119249) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 27 14:57:56.455404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fdb72e11-8aca-4cc3-b4fc-5fb537254408 tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.455860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fdb72e11-8aca-4cc3-b4fc-5fb537254408 tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:56.490022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fdb72e11-8aca-4cc3-b4fc-5fb537254408 tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.490481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fdb72e11-8aca-4cc3-b4fc-5fb537254408 tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:56.496407 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fdb72e11-8aca-4cc3-b4fc-5fb537254408 tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/n-h2-843621-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.065557 May 27 14:57:56.497025 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 125/250] 10.222.0.13 () {58 vars in 1211 bytes} [Fri May 27 14:57:56 2022] GET /compute/v2.1/os-hypervisors/n-h2-843621-1/servers => generated 196 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:56.503715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-61ff9e04-bf79-4edc-aacd-da81a11c99fb tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-843621-1"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:56.503715 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:56.503715 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:56.512696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-61ff9e04-bf79-4edc-aacd-da81a11c99fb tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.513148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-61ff9e04-bf79-4edc-aacd-da81a11c99fb tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:56.552954 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:56.620339 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-61ff9e04-bf79-4edc-aacd-da81a11c99fb tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.122242 May 27 14:57:56.621018 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 126/251] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 27 14:57:56 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:56.630108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-98476df0-96fd-4888-94bc-f86045d3568b tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Calling method '.version_select at 0x7fc7773fc700>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:56.630999 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:56.630999 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:56.632283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98476df0-96fd-4888-94bc-f86045d3568b tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.632770 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98476df0-96fd-4888-94bc-f86045d3568b tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:56.647941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98476df0-96fd-4888-94bc-f86045d3568b tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.648652 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98476df0-96fd-4888-94bc-f86045d3568b tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:56.658949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98476df0-96fd-4888-94bc-f86045d3568b tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.659399 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98476df0-96fd-4888-94bc-f86045d3568b tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:56.665217 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-98476df0-96fd-4888-94bc-f86045d3568b tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.043258 May 27 14:57:56.665850 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 127/252] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:57:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:56.670332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e1649b65-9a30-415e-91a4-5ea222f39feb tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:56.671293 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:56.671293 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:56.678261 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e1649b65-9a30-415e-91a4-5ea222f39feb tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.011446 May 27 14:57:56.679073 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 128/253] 10.222.0.13 () {58 vars in 1148 bytes} [Fri May 27 14:57:56 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:56.683793 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9194b94e-1ed3-4d96-8293-c05e82dd7489 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:56.684395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9194b94e-1ed3-4d96-8293-c05e82dd7489 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:56.690350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9194b94e-1ed3-4d96-8293-c05e82dd7489 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.690798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9194b94e-1ed3-4d96-8293-c05e82dd7489 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:56.691560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9194b94e-1ed3-4d96-8293-c05e82dd7489 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.692002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9194b94e-1ed3-4d96-8293-c05e82dd7489 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:56.823437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9194b94e-1ed3-4d96-8293-c05e82dd7489 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:56.831229 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9194b94e-1ed3-4d96-8293-c05e82dd7489 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1475 microversion: 2.1 time: 0.151330 May 27 14:57:56.831817 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 129/254] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:56 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1475 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:56.835986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d79489f5-53e5-47cf-bcdd-e254fc148372 tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Calling method '.version_select at 0x7fc777334af0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:56.836803 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:56.836803 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:56.838043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d79489f5-53e5-47cf-bcdd-e254fc148372 tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.838504 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d79489f5-53e5-47cf-bcdd-e254fc148372 tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:56.850271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d79489f5-53e5-47cf-bcdd-e254fc148372 tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.850721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d79489f5-53e5-47cf-bcdd-e254fc148372 tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:56.853662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:56.857650 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d79489f5-53e5-47cf-bcdd-e254fc148372 tempest-HypervisorAdminUnderV252Test-859734809 tempest-HypervisorAdminUnderV252Test-859734809-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/n-h2-843621-1/search" status: 200 len: 104 microversion: 2.1 time: 0.024920 May 27 14:57:56.858231 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 130/255] 10.222.0.13 () {58 vars in 1208 bytes} [Fri May 27 14:57:56 2022] GET /compute/v2.1/os-hypervisors/n-h2-843621-1/search => generated 104 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:56.863969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7219141a-9b06-4b9a-a3a7-6fc95e2bb6b3 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-843621-1"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:56.865596 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:56.865596 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:56.876237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7219141a-9b06-4b9a-a3a7-6fc95e2bb6b3 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:56.876823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7219141a-9b06-4b9a-a3a7-6fc95e2bb6b3 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:57.006513 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7219141a-9b06-4b9a-a3a7-6fc95e2bb6b3 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.147257 May 27 14:57:57.012706 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 131/256] 10.222.0.13 () {60 vars in 1190 bytes} [Fri May 27 14:57:56 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:57.012706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-61c5f8ce-b304-48d6-ba85-a6e73ebdc257 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:57.012706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-61c5f8ce-b304-48d6-ba85-a6e73ebdc257 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:57.020466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-61c5f8ce-b304-48d6-ba85-a6e73ebdc257 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:57.021068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-61c5f8ce-b304-48d6-ba85-a6e73ebdc257 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:57.021928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-61c5f8ce-b304-48d6-ba85-a6e73ebdc257 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:57.022462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-61c5f8ce-b304-48d6-ba85-a6e73ebdc257 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:57.171663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-61c5f8ce-b304-48d6-ba85-a6e73ebdc257 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:57.179229 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-61c5f8ce-b304-48d6-ba85-a6e73ebdc257 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad" status: 200 len: 1318 microversion: 2.1 time: 0.171113 May 27 14:57:57.180242 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 132/257] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:57 2022] GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:57.184645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c85add92-b7d4-435b-9fbf-6aa1954b0e33 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:57.185417 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:57.185417 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:57.228733 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c85add92-b7d4-435b-9fbf-6aa1954b0e33 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.047344 May 27 14:57:57.230620 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 133/258] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 14:57:57 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 27 14:57:57.245999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3a1498ca-a904-4891-a649-00112e2293a9 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-207158451"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:57.247445 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:57.247445 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:57.249888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.aggregate [None req-3a1498ca-a904-4891-a649-00112e2293a9 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Generated uuid db24a93c-eb13-4565-a37f-daa532cbe7d8 for aggregate {{(pid=119248) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 27 14:57:57.288919 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3a1498ca-a904-4891-a649-00112e2293a9 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.049085 May 27 14:57:57.289954 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 134/259] 10.222.0.13 () {60 vars in 1163 bytes} [Fri May 27 14:57:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:57.300242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c2e0f531-fdab-460c-84e8-6761d9f3c879 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:57.302912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c2e0f531-fdab-460c-84e8-6761d9f3c879 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:57.315522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2e0f531-fdab-460c-84e8-6761d9f3c879 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:57.315997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2e0f531-fdab-460c-84e8-6761d9f3c879 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:57.316774 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2e0f531-fdab-460c-84e8-6761d9f3c879 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:57.317216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2e0f531-fdab-460c-84e8-6761d9f3c879 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:57.717415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c2e0f531-fdab-460c-84e8-6761d9f3c879 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:57.725038 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c2e0f531-fdab-460c-84e8-6761d9f3c879 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1312 microversion: 2.1 time: 0.432938 May 27 14:57:57.725614 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 135/260] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:57 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1312 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:57.730447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-be02fc57-191c-4828-80a9-b821b54a52ea tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-843621-1"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:57.731666 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:57.731666 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:57.739691 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be02fc57-191c-4828-80a9-b821b54a52ea tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:57.740143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be02fc57-191c-4828-80a9-b821b54a52ea tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:57.871441 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-be02fc57-191c-4828-80a9-b821b54a52ea tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.144670 May 27 14:57:57.872043 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 136/261] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 14:57:57 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:57.877216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-807dffd5-a1c0-4703-9d02-8215c6f19a3a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:57.879044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-807dffd5-a1c0-4703-9d02-8215c6f19a3a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:57.894943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-807dffd5-a1c0-4703-9d02-8215c6f19a3a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:57.895939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-807dffd5-a1c0-4703-9d02-8215c6f19a3a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:57.897883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-807dffd5-a1c0-4703-9d02-8215c6f19a3a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:57.898575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-807dffd5-a1c0-4703-9d02-8215c6f19a3a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:58.041292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-807dffd5-a1c0-4703-9d02-8215c6f19a3a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:58.050007 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-807dffd5-a1c0-4703-9d02-8215c6f19a3a tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 200 len: 1475 microversion: 2.1 time: 0.176852 May 27 14:57:58.059095 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 137/262] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:57 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 1475 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:58.063858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0367aab1-4dea-428c-838b-b2af9df0b8c1 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:58.064621 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:58.064621 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:58.073654 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0367aab1-4dea-428c-838b-b2af9df0b8c1 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.013420 May 27 14:57:58.074655 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 138/263] 10.222.0.13 () {58 vars in 1142 bytes} [Fri May 27 14:57:58 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:58.086319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f1d41446-10fe-494f-ad13-fa515f47e42f tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-843621-1"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:58.090359 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:58.090359 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:58.100554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1d41446-10fe-494f-ad13-fa515f47e42f tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:58.101082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1d41446-10fe-494f-ad13-fa515f47e42f tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:58.243257 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f1d41446-10fe-494f-ad13-fa515f47e42f tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.160959 May 27 14:57:58.245027 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 139/264] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 14:57:58 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:58.252803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fb572693-dbc7-417e-be23-4f241d8d6939 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:58.253954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fb572693-dbc7-417e-be23-4f241d8d6939 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:58.264584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb572693-dbc7-417e-be23-4f241d8d6939 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:58.265279 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb572693-dbc7-417e-be23-4f241d8d6939 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:58.280952 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb572693-dbc7-417e-be23-4f241d8d6939 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:58.281489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb572693-dbc7-417e-be23-4f241d8d6939 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:58.643437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fb572693-dbc7-417e-be23-4f241d8d6939 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:58.651283 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fb572693-dbc7-417e-be23-4f241d8d6939 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad" status: 200 len: 1318 microversion: 2.1 time: 0.404549 May 27 14:57:58.660996 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 140/265] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:58 2022] GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:58.676299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fbfc9c23-c4d3-462e-b32f-bb12dd0eebca tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:58.677086 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:58.677086 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:58.717688 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fbfc9c23-c4d3-462e-b32f-bb12dd0eebca tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.064419 May 27 14:57:58.718522 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 141/266] 10.222.0.13 () {58 vars in 1154 bytes} [Fri May 27 14:57:58 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 27 14:57:58.722727 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-00ffd351-7dea-483d-803c-c891876dafe9 req-f177f701-c12e-4cf0-bb9d-d5e6127f40bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6308b60c-6cce-4b7b-a8ec-a683a03f0fcc", "name": "network-vif-deleted", "tag": "262bc22d-3099-4c20-95f0-39c2553c5754"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:58.732044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-00ffd351-7dea-483d-803c-c891876dafe9 req-f177f701-c12e-4cf0-bb9d-d5e6127f40bf service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:58.732597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-00ffd351-7dea-483d-803c-c891876dafe9 req-f177f701-c12e-4cf0-bb9d-d5e6127f40bf service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:58.743123 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-00ffd351-7dea-483d-803c-c891876dafe9 req-f177f701-c12e-4cf0-bb9d-d5e6127f40bf service nova] Creating event network-vif-deleted:262bc22d-3099-4c20-95f0-39c2553c5754 for instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc on n-h1-843621-1 May 27 14:57:58.748793 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-00ffd351-7dea-483d-803c-c891876dafe9 req-f177f701-c12e-4cf0-bb9d-d5e6127f40bf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029341 May 27 14:57:58.749399 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 142/267] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:58.754182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f29c1302-b1c6-4c14-86cb-79540dd6f0dd tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-910642254"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:58.755576 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:58.755576 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:58.756427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.aggregate [None req-f29c1302-b1c6-4c14-86cb-79540dd6f0dd tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Generated uuid 7d29ad5a-72a9-451b-946b-a0f7171280d6 for aggregate {{(pid=119248) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 27 14:57:58.763092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:57:58.781669 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f29c1302-b1c6-4c14-86cb-79540dd6f0dd tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.031119 May 27 14:57:58.782799 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 143/268] 10.222.0.13 () {60 vars in 1163 bytes} [Fri May 27 14:57:58 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:58.795000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-35ba8ea6-2026-4a49-aef6-27e6a72d9754 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:58.795741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-35ba8ea6-2026-4a49-aef6-27e6a72d9754 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:58.803683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-35ba8ea6-2026-4a49-aef6-27e6a72d9754 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:58.804151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-35ba8ea6-2026-4a49-aef6-27e6a72d9754 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:58.805030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-35ba8ea6-2026-4a49-aef6-27e6a72d9754 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:58.805478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-35ba8ea6-2026-4a49-aef6-27e6a72d9754 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:58.980649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-35ba8ea6-2026-4a49-aef6-27e6a72d9754 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:58.990005 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-35ba8ea6-2026-4a49-aef6-27e6a72d9754 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1312 microversion: 2.1 time: 0.199527 May 27 14:57:58.994448 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 144/269] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:58 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1312 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:57:59.005338 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a88ccb1e-a883-41d7-ad69-4db09c6e64fd tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-843621-1"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:59.006874 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:59.006874 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:59.043571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a88ccb1e-a883-41d7-ad69-4db09c6e64fd tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:59.051285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a88ccb1e-a883-41d7-ad69-4db09c6e64fd tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:59.234604 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a88ccb1e-a883-41d7-ad69-4db09c6e64fd tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.238835 May 27 14:57:59.235869 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 145/270] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 14:57:58 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:59.241350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5ec83b08-d93e-4644-bf88-5964659e676c tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:59.241858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5ec83b08-d93e-4644-bf88-5964659e676c tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:59.249899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ec83b08-d93e-4644-bf88-5964659e676c tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:59.250806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ec83b08-d93e-4644-bf88-5964659e676c tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:59.251700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ec83b08-d93e-4644-bf88-5964659e676c tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:59.252238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ec83b08-d93e-4644-bf88-5964659e676c tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:59.268039 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-5ec83b08-d93e-4644-bf88-5964659e676c tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] HTTP exception thrown: Instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc could not be found. May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5ec83b08-d93e-4644-bf88-5964659e676c tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Request method failure captured: May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc HTTP/1.1 May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObLcIh_VTFFcY-B7AZUcpaZ8S9WNeS3jQSnR_9LWkTu7KV7tqEgaBZqxW6zm9w9SWRtByAjhS8V_1PsWjCneIFHyuWnBP-LrXBF3pu2lV1bFK06X-HJbGuUsOYT7BJQj2M_d41x-wJa4XI-TpVt-g94MDuuIKh6K9xthI_zGKaVofw May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 016d7f67e1704dc888371aa43be736e6 May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-DeleteServersAdminTestJSON-69833662 May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:57:59.278133 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:57:59.279557 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/016d7f67e1704dc888371aa43be736e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/016d7f67e1704dc888371aa43be736e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/016d7f67e1704dc888371aa43be736e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_016d7f67e1704dc888371aa43be736e6", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:57:59.279557 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-DeleteServersAdminTestJSON-69833662 May 27 14:57:59.279557 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 016d7f67e1704dc888371aa43be736e6 May 27 14:57:59.279557 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-69833662 May 27 14:57:59.279557 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-DeleteServersAdminTestJSON-69833662-project May 27 14:57:59.279557 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:57:59.279557 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:57:59.279557 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 8a7349483c684d7aa73c85844d1fda97 May 27 14:57:59.279557 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-DeleteServersAdminTestJSON-69833662-project May 27 14:57:59.279557 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:57:59.279557 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc could not be found. May 27 14:57:59.279557 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '6308b60c-6cce-4b7b-a8ec-a683a03f0fcc'} May 27 14:57:59.280335 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:57:59.280335 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:59.280335 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 14:57:59.280335 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 14:57:59.280335 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 14:57:59.280335 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 14:57:59.280335 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 14:57:59.280335 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 14:57:59.280335 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 14:57:59.280335 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 14:57:59.280335 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc could not be found. May 27 14:57:59.280335 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:59.280335 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:59.280335 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:59.280335 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:59.280335 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:59.280335 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:59.280335 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:57:59.280335 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:57:59.280335 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:57:59.281487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:57:59.281487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 14:57:59.281487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 14:57:59.281487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 14:57:59.281487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 14:57:59.281487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 14:57:59.281487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 14:57:59.281487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc could not be found. May 27 14:57:59.281487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:59.281487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:57:59.281487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:59.281487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:57:59.281487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:57:59.281487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:57:59.281487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:57:59.281487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:57:59.281487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc could not be found. May 27 14:57:59.281487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:57:59.282616 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5ec83b08-d93e-4644-bf88-5964659e676c tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Returning 404 to user: Instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:57:59.282616 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5ec83b08-d93e-4644-bf88-5964659e676c tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 404 len: 111 microversion: 2.1 time: 0.043984 May 27 14:57:59.283392 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 146/271] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:59 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:57:59.288547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a4202ccf-7218-4e3f-8dbc-c625484b187d tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-843621-1"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:59.290312 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:59.290312 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:59.300804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4202ccf-7218-4e3f-8dbc-c625484b187d tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:59.301454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4202ccf-7218-4e3f-8dbc-c625484b187d tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:59.433508 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a4202ccf-7218-4e3f-8dbc-c625484b187d tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.148504 May 27 14:57:59.434623 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 147/272] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 14:57:59 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:59.448633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d8570343-b061-40de-93e5-3da9732e6ded tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:59.449829 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:59.449829 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:59.472981 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d8570343-b061-40de-93e5-3da9732e6ded tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.031417 May 27 14:57:59.473972 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 148/273] 10.222.0.13 () {58 vars in 1154 bytes} [Fri May 27 14:57:59 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 27 14:57:59.478771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f5b05d76-dcd9-4727-8414-94c128093850 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1012139892", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:59.538606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-f5b05d76-dcd9-4727-8414-94c128093850 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] validate_networks() for None {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 14:57:59.555625 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-20dfc0e7-9949-46e0-a774-4842f8efe5a7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8/action" status: 202 len: 0 microversion: 2.25 time: 3.419523 May 27 14:57:59.560440 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 126/274] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 27 14:57:56 2022] POST /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8/action => generated 0 bytes in 3426 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 14:57:59.566354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f86db305-dbfa-49c5-ab54-46b15ba14f9e tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1303536105"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:59.568034 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:59.568034 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:59.569360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.aggregate [None req-f86db305-dbfa-49c5-ab54-46b15ba14f9e tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Generated uuid d8282fb2-2f5d-41c4-8060-4bf178f436fa for aggregate {{(pid=119249) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 27 14:57:59.605013 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f86db305-dbfa-49c5-ab54-46b15ba14f9e tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.042955 May 27 14:57:59.606452 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 127/275] 10.222.0.13 () {60 vars in 1163 bytes} [Fri May 27 14:57:59 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:59.613548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-23e1a4a1-36db-46dd-903a-3142d8f8f2ac tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-888831144"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:59.615439 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:59.615439 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:59.616634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.aggregate [None req-23e1a4a1-36db-46dd-903a-3142d8f8f2ac tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Generated uuid 089cef35-c4a7-451e-a39d-a1e68430a789 for aggregate {{(pid=119249) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 27 14:57:59.646568 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-23e1a4a1-36db-46dd-903a-3142d8f8f2ac tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038798 May 27 14:57:59.647487 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 128/276] 10.222.0.13 () {60 vars in 1163 bytes} [Fri May 27 14:57:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:57:59.653480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6b5b70b6-c815-4ad7-a152-11765bc54904 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:59.654565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6b5b70b6-c815-4ad7-a152-11765bc54904 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:59.663569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b5b70b6-c815-4ad7-a152-11765bc54904 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:59.664303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b5b70b6-c815-4ad7-a152-11765bc54904 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:59.665575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b5b70b6-c815-4ad7-a152-11765bc54904 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:59.667451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b5b70b6-c815-4ad7-a152-11765bc54904 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:59.818474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f5b05d76-dcd9-4727-8414-94c128093850 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:57:59.818908 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f5b05d76-dcd9-4727-8414-94c128093850 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:57:59.819531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f5b05d76-dcd9-4727-8414-94c128093850 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:57:59.819956 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f5b05d76-dcd9-4727-8414-94c128093850 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:57:59.820382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f5b05d76-dcd9-4727-8414-94c128093850 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:57:59.830180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f5b05d76-dcd9-4727-8414-94c128093850 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:59.830672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f5b05d76-dcd9-4727-8414-94c128093850 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:59.831491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f5b05d76-dcd9-4727-8414-94c128093850 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:59.831929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f5b05d76-dcd9-4727-8414-94c128093850 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:59.850344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-f5b05d76-dcd9-4727-8414-94c128093850 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Getting quotas for project 016d7f67e1704dc888371aa43be736e6. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:57:59.854757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-f5b05d76-dcd9-4727-8414-94c128093850 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Getting quotas for user 8a7349483c684d7aa73c85844d1fda97 and project 016d7f67e1704dc888371aa43be736e6. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:57:59.867561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f5b05d76-dcd9-4727-8414-94c128093850 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 14:57:59.870632 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f5b05d76-dcd9-4727-8414-94c128093850 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: a3017e23-0753-457e-8f51-8f1586807499] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 14:57:59.919327 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f5b05d76-dcd9-4727-8414-94c128093850 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.443878 May 27 14:57:59.920359 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 149/277] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:57:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 14:57:59.928481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-083e5023-1c27-4eea-b8bd-d707f67fb56e tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:59.929852 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:59.929852 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:57:59.937850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6b5b70b6-c815-4ad7-a152-11765bc54904 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:59.946903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6b5b70b6-c815-4ad7-a152-11765bc54904 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:59.948836 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6b5b70b6-c815-4ad7-a152-11765bc54904 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:57:59.951220 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6b5b70b6-c815-4ad7-a152-11765bc54904 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1567 microversion: 2.25 time: 0.301918 May 27 14:57:59.951985 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 129/278] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:57:59 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1567 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:57:59.957818 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-083e5023-1c27-4eea-b8bd-d707f67fb56e tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.035700 May 27 14:57:59.962522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6c7beef2-425c-4dc7-b2f3-81993bcb3667 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-843621-1"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:57:59.962720 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 150/279] 10.222.0.13 () {58 vars in 1154 bytes} [Fri May 27 14:57:59 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 27 14:57:59.964733 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:57:59.964733 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:57:59.970552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-62e11c47-60bf-483d-b7c5-17d327d1e506 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:57:59.971183 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-62e11c47-60bf-483d-b7c5-17d327d1e506 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:57:59.974606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6c7beef2-425c-4dc7-b2f3-81993bcb3667 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:59.975262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6c7beef2-425c-4dc7-b2f3-81993bcb3667 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:59.990784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62e11c47-60bf-483d-b7c5-17d327d1e506 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:59.991371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62e11c47-60bf-483d-b7c5-17d327d1e506 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:57:59.992015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62e11c47-60bf-483d-b7c5-17d327d1e506 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:57:59.997195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62e11c47-60bf-483d-b7c5-17d327d1e506 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:00.158807 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6c7beef2-425c-4dc7-b2f3-81993bcb3667 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 242 microversion: 2.1 time: 0.200740 May 27 14:58:00.160428 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 130/280] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 14:57:59 2022] POST /compute/v2.1/os-aggregates/13/action => generated 242 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:00.188449 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bed51f4f-74ff-47c0-8038-d7fb0ab48b63 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:00.189164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bed51f4f-74ff-47c0-8038-d7fb0ab48b63 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: a3017e23-0753-457e-8f51-8f1586807499] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:00.268755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bed51f4f-74ff-47c0-8038-d7fb0ab48b63 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:00.279529 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bed51f4f-74ff-47c0-8038-d7fb0ab48b63 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499" status: 200 len: 1220 microversion: 2.1 time: 0.117306 May 27 14:58:00.281246 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 131/281] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:00 2022] GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499 => generated 1220 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:00.289315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1b7078bb-c870-4d0a-87c2-4f4396c4f513 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:00.290351 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:00.290351 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:00.297931 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-1b7078bb-c870-4d0a-87c2-4f4396c4f513 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] HTTP exception thrown: Aggregate 12 could not be found. May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1b7078bb-c870-4d0a-87c2-4f4396c4f513 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Request method failure captured: May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikObO0ckQ2nsLhIRen8XLCGPk5Y5rYpIXVlIca0rDL7Ay3wJHrAZcu59HJAjN5sM0TNjanz8wL9IoTYoP7V7d-LqGSLl5s5esdw9Ec1T2rX-YOH23UvrZcOu_fjfggu9cZ-EED0SrZKkQf-QFsldhhLtwzqA_xEdncRaDswWwKew0Bt8 May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 3e3e23c1d0154c7cbfae683dee503e77 May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-AggregatesAdminTestJSON-971242207 May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,admin,member May 27 14:58:00.304173 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,admin,member May 27 14:58:00.305577 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3e3e23c1d0154c7cbfae683dee503e77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3e3e23c1d0154c7cbfae683dee503e77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3e3e23c1d0154c7cbfae683dee503e77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3e3e23c1d0154c7cbfae683dee503e77", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:00.305577 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-AggregatesAdminTestJSON-971242207 May 27 14:58:00.305577 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 3e3e23c1d0154c7cbfae683dee503e77 May 27 14:58:00.305577 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-971242207 May 27 14:58:00.305577 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-AggregatesAdminTestJSON-971242207-project-admin May 27 14:58:00.305577 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:00.305577 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:00.305577 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: ad333b6e466f4e5f8e1c98fd2b82cdb0 May 27 14:58:00.305577 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-AggregatesAdminTestJSON-971242207-project-admin May 27 14:58:00.305577 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 14:58:00.305577 n-d-843621-1 devstack@n-api.service[119249]: exception: Aggregate 12 could not be found. May 27 14:58:00.305577 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '12'} May 27 14:58:00.305577 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:00.306863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:00.306863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 27 14:58:00.306863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 27 14:58:00.306863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 27 14:58:00.306863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 27 14:58:00.306863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:58:00.306863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:58:00.306863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 27 14:58:00.306863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 27 14:58:00.306863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 14:58:00.306863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 14:58:00.306863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 27 14:58:00.306863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 27 14:58:00.306863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. May 27 14:58:00.306863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:00.306863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:00.306863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:00.306863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:00.306863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:00.307881 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:00.307881 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:00.307881 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:00.307881 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:00.307881 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:00.307881 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 27 14:58:00.307881 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 14:58:00.307881 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. May 27 14:58:00.307881 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:00.307881 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:00.307881 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:00.307881 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:00.307881 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:00.307881 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:00.307881 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:00.307881 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:00.307881 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. May 27 14:58:00.307881 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:00.310372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1b7078bb-c870-4d0a-87c2-4f4396c4f513 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:00.311718 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1b7078bb-c870-4d0a-87c2-4f4396c4f513 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.028633 May 27 14:58:00.317242 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 132/282] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 14:58:00 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 14:58:00.325012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4492c260-564d-49f8-b265-96eb9c6af1ce tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:00.325916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4492c260-564d-49f8-b265-96eb9c6af1ce tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:00.332874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4492c260-564d-49f8-b265-96eb9c6af1ce tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:00.333521 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4492c260-564d-49f8-b265-96eb9c6af1ce tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:00.334507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4492c260-564d-49f8-b265-96eb9c6af1ce tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:00.335143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4492c260-564d-49f8-b265-96eb9c6af1ce tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:00.356326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-62e11c47-60bf-483d-b7c5-17d327d1e506 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:00.372025 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-62e11c47-60bf-483d-b7c5-17d327d1e506 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad" status: 200 len: 1318 microversion: 2.1 time: 0.408252 May 27 14:58:00.373795 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 151/283] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:57:59 2022] GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:00.389591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-12cac5ce-e73e-461b-afdd-5650dd41f12f tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-843621-1"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:00.401006 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:00.401006 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:00.402736 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-12cac5ce-e73e-461b-afdd-5650dd41f12f tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '22c2db89f04b4669ab1033a7b4f07248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a2f6c7672e43a5b1cdb309e190d1e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-12cac5ce-e73e-461b-afdd-5650dd41f12f tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Request method failure captured: May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 42 May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObLHQBpn2vNwAEAFjqioMhYUX1iAIwOHh5gzC-B85g0NFSxUYEuEWkzGOl32RwxADIW-3ia7AeeYkgUOTUZl3Jw14LtRncyt5B-dFnD55w4KdQxYbjT7jKQfYCMIxgpq4KK-LS0j9eCyzPGXWglWda9BcYSvcgF_NBBJlMFSO8zAHE May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: c4a2f6c7672e43a5b1cdb309e190d1e4 May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1975648109 May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:58:00.419209 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:58:00.420771 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c4a2f6c7672e43a5b1cdb309e190d1e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c4a2f6c7672e43a5b1cdb309e190d1e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c4a2f6c7672e43a5b1cdb309e190d1e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c4a2f6c7672e43a5b1cdb309e190d1e4", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:00.420771 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1975648109 May 27 14:58:00.420771 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: c4a2f6c7672e43a5b1cdb309e190d1e4 May 27 14:58:00.420771 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1975648109 May 27 14:58:00.420771 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AggregatesAdminNegativeTestJSON-1975648109-project May 27 14:58:00.420771 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:00.420771 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:00.420771 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 22c2db89f04b4669ab1033a7b4f07248 May 27 14:58:00.420771 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1975648109-project May 27 14:58:00.420771 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:58:00.420771 n-d-843621-1 devstack@n-api.service[119248]: {"remove_host": {"host": "n-h2-843621-1"}} May 27 14:58:00.420771 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:58:00.420771 n-d-843621-1 devstack@n-api.service[119248]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 27 14:58:00.421626 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h2-843621-1'}}} May 27 14:58:00.421626 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:00.421626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:00.421626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:00.421626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:00.421626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:00.421626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:00.421626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:00.421626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:00.421626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:58:00.421626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:58:00.421626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host May 27 14:58:00.421626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) May 27 14:58:00.421626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:58:00.421626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:58:00.421626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:58:00.421626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:58:00.421626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:00.421626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:00.422808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:00.422808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:00.422808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:58:00.422808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:58:00.422808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:58:00.422808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:58:00.422808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:58:00.422808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:58:00.422808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 27 14:58:00.422808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:00.422808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:00.422808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:00.422808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:00.422808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:00.422808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:00.422808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:58:00.422808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:58:00.422808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 27 14:58:00.422808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:00.424000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-12cac5ce-e73e-461b-afdd-5650dd41f12f tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:00.424000 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-12cac5ce-e73e-461b-afdd-5650dd41f12f tempest-AggregatesAdminNegativeTestJSON-1975648109 tempest-AggregatesAdminNegativeTestJSON-1975648109-project] 10.222.0.13 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.027753 May 27 14:58:00.424000 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 152/284] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 14:58:00 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:00.424000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f8f91ba7-02e6-47e6-833b-bdfd82cfb0b5 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:00.424000 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:00.424000 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:00.457960 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-f8f91ba7-02e6-47e6-833b-bdfd82cfb0b5 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] HTTP exception thrown: Aggregate 12 could not be found. May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f8f91ba7-02e6-47e6-833b-bdfd82cfb0b5 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Request method failure captured: May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObO0ckQ2nsLhIRen8XLCGPk5Y5rYpIXVlIca0rDL7Ay3wJHrAZcu59HJAjN5sM0TNjanz8wL9IoTYoP7V7d-LqGSLl5s5esdw9Ec1T2rX-YOH23UvrZcOu_fjfggu9cZ-EED0SrZKkQf-QFsldhhLtwzqA_xEdncRaDswWwKew0Bt8 May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 3e3e23c1d0154c7cbfae683dee503e77 May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AggregatesAdminTestJSON-971242207 May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:58:00.460423 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:58:00.461774 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3e3e23c1d0154c7cbfae683dee503e77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3e3e23c1d0154c7cbfae683dee503e77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3e3e23c1d0154c7cbfae683dee503e77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3e3e23c1d0154c7cbfae683dee503e77", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:00.461774 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AggregatesAdminTestJSON-971242207 May 27 14:58:00.461774 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 3e3e23c1d0154c7cbfae683dee503e77 May 27 14:58:00.461774 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-971242207 May 27 14:58:00.461774 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AggregatesAdminTestJSON-971242207-project-admin May 27 14:58:00.461774 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:00.461774 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:00.461774 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: ad333b6e466f4e5f8e1c98fd2b82cdb0 May 27 14:58:00.461774 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AggregatesAdminTestJSON-971242207-project-admin May 27 14:58:00.461774 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:58:00.461774 n-d-843621-1 devstack@n-api.service[119248]: exception: Aggregate 12 could not be found. May 27 14:58:00.461774 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '12'} May 27 14:58:00.461774 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:00.462617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:00.462617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 27 14:58:00.462617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 27 14:58:00.462617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 27 14:58:00.462617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 27 14:58:00.462617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:00.462617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:00.462617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:00.462617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:00.462617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 27 14:58:00.462617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 27 14:58:00.462617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 27 14:58:00.462617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 27 14:58:00.462617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:58:00.462617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:58:00.462617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 27 14:58:00.462617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 27 14:58:00.462617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 14:58:00.462617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:00.463655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:00.465646 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:00.465646 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:00.465646 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:00.465646 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. May 27 14:58:00.465646 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:00.465646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f8f91ba7-02e6-47e6-833b-bdfd82cfb0b5 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:00.465646 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f8f91ba7-02e6-47e6-833b-bdfd82cfb0b5 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.046965 May 27 14:58:00.465646 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 153/285] 10.222.0.13 () {58 vars in 1154 bytes} [Fri May 27 14:58:00 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 14:58:00.475143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-af5b6389-3e74-43b9-a26b-c36413f7c08b tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-843621-1"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:00.501623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af5b6389-3e74-43b9-a26b-c36413f7c08b tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:00.502482 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af5b6389-3e74-43b9-a26b-c36413f7c08b tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:00.687811 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-af5b6389-3e74-43b9-a26b-c36413f7c08b tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.223898 May 27 14:58:00.688416 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 154/286] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 14:58:00 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:00.693578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-cbaa1d2e-e234-4b63-af24-6e873e82e637 req-31c97f77-9434-458e-b3ff-ba0b650fe79c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae05ce87-e077-487e-906e-824915f604ad", "name": "network-vif-plugged", "status": "completed", "tag": "22359590-0f71-41f7-9cb3-b11408fae17d"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:00.702948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-cbaa1d2e-e234-4b63-af24-6e873e82e637 req-31c97f77-9434-458e-b3ff-ba0b650fe79c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:00.703740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-cbaa1d2e-e234-4b63-af24-6e873e82e637 req-31c97f77-9434-458e-b3ff-ba0b650fe79c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:00.711923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4492c260-564d-49f8-b265-96eb9c6af1ce tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:00.720373 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-cbaa1d2e-e234-4b63-af24-6e873e82e637 req-31c97f77-9434-458e-b3ff-ba0b650fe79c service nova] Creating event network-vif-plugged:22359590-0f71-41f7-9cb3-b11408fae17d for instance ae05ce87-e077-487e-906e-824915f604ad on n-h1-843621-1 May 27 14:58:00.726420 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-cbaa1d2e-e234-4b63-af24-6e873e82e637 req-31c97f77-9434-458e-b3ff-ba0b650fe79c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036632 May 27 14:58:00.728563 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4492c260-564d-49f8-b265-96eb9c6af1ce tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1460 microversion: 2.1 time: 0.408735 May 27 14:58:00.731059 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 133/287] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:00 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1460 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:00.737799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bc641b4f-ad3b-4b42-859b-c61404ac1aee tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1986924285", "name": "tempest-test_aggregate-2027595785"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:00.742362 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 155/288] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:00.761489 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:00.761489 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:00.763404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.aggregate [None req-bc641b4f-ad3b-4b42-859b-c61404ac1aee tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Generated uuid 0b0f26ee-d106-4cc0-93e2-6f90ba692ea1 for aggregate {{(pid=119249) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 27 14:58:00.795083 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bc641b4f-ad3b-4b42-859b-c61404ac1aee tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.062589 May 27 14:58:00.795984 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 134/289] 10.222.0.13 () {60 vars in 1164 bytes} [Fri May 27 14:58:00 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:00.800475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-031406e1-ae69-46d1-9fe6-a2a3ee56a499 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:00.801432 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:00.801432 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:00.813663 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=8,nova_api:INSERT=5 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:00.825429 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-031406e1-ae69-46d1-9fe6-a2a3ee56a499 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.028252 May 27 14:58:00.828862 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 135/290] 10.222.0.13 () {58 vars in 1154 bytes} [Fri May 27 14:58:00 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 27 14:58:00.949695 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8aa138f5-10f4-46d3-951c-949065683e6a tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] Calling method '.version_select at 0x7fc77749c280>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:00.950919 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:00.950919 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:00.952015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8aa138f5-10f4-46d3-951c-949065683e6a tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'ee6f1c4798cb4b6fa2a7627a964d93b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ae70477a4abcb8c2ab620b75981f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8aa138f5-10f4-46d3-951c-949065683e6a tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] Request method failure captured: May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOb3LMqOlWujHULoZFeDxmXkMD1RD809MaSghRw2LJO4ahwU7nEn7cNBDPScw-PleWlon4TDN4jkxImCUS0q6kU1dM2eDcO8Dy9njO0bZxboJHTuRSn5dyK30-X0f-zEA7V6VK2eIKo8YIROSsyj5wjLr87UkKM_QXayoPAXtDajPD4 May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: dab2ae70477a4abcb8c2ab620b75981f May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1456577872 May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:58:00.954029 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:58:00.955331 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dab2ae70477a4abcb8c2ab620b75981f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dab2ae70477a4abcb8c2ab620b75981f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dab2ae70477a4abcb8c2ab620b75981f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dab2ae70477a4abcb8c2ab620b75981f", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:00.955331 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1456577872 May 27 14:58:00.955331 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: dab2ae70477a4abcb8c2ab620b75981f May 27 14:58:00.955331 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1456577872 May 27 14:58:00.955331 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-HypervisorAdminNegativeTestJSON-1456577872-project May 27 14:58:00.955331 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:00.955331 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:00.955331 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: ee6f1c4798cb4b6fa2a7627a964d93b9 May 27 14:58:00.955331 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1456577872-project May 27 14:58:00.955331 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 14:58:00.955331 n-d-843621-1 devstack@n-api.service[119248]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 27 14:58:00.955331 n-d-843621-1 devstack@n-api.service[119248]: action_args: {} May 27 14:58:00.955331 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:00.956244 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:00.956244 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:00.956244 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:00.956244 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:00.956244 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:00.956244 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:00.956244 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:00.956244 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:00.956244 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:00.956244 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail May 27 14:58:00.956244 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._detail(req) May 27 14:58:00.956244 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail May 27 14:58:00.956244 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) May 27 14:58:00.956244 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:58:00.956244 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:58:00.956244 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:58:00.956244 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:58:00.956244 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:00.956244 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:00.958321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:00.958321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:00.958321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:58:00.958321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:58:00.958321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:58:00.958321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:58:00.958321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:58:00.958321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:58:00.958321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 27 14:58:00.958321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:00.958321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:00.958321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:00.958321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:00.958321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:00.958321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:00.958321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:58:00.958321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:58:00.958321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 27 14:58:00.958321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:00.960746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8aa138f5-10f4-46d3-951c-949065683e6a tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:00.960746 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8aa138f5-10f4-46d3-951c-949065683e6a tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.211754 May 27 14:58:00.965896 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 156/291] 10.222.0.13 () {58 vars in 1166 bytes} [Fri May 27 14:58:00 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 223 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:00.981217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b8bbd5f7-ad1c-453a-b437-f814fb551741 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:00.982063 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:00.982063 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:01.018491 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b8bbd5f7-ad1c-453a-b437-f814fb551741 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.047536 May 27 14:58:01.022017 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 157/292] 10.222.0.13 () {58 vars in 1154 bytes} [Fri May 27 14:58:00 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 27 14:58:01.024058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dad282b6-15ce-472f-9a67-0b91ba8fd598 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1979108332"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:01.026078 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:01.026078 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:01.026964 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.aggregate [None req-dad282b6-15ce-472f-9a67-0b91ba8fd598 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Generated uuid cd8a54ab-38b9-415c-a376-501c95276ddc for aggregate {{(pid=119248) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 27 14:58:01.050894 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dad282b6-15ce-472f-9a67-0b91ba8fd598 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.030533 May 27 14:58:01.052420 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 158/293] 10.222.0.13 () {60 vars in 1163 bytes} [Fri May 27 14:58:01 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:01.058552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-477dcaef-4802-4f51-bdef-02ab2dd88e76 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Calling method '.version_select at 0x7fc777334ee0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:01.059964 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:01.059964 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:01.061531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-477dcaef-4802-4f51-bdef-02ab2dd88e76 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.062312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-477dcaef-4802-4f51-bdef-02ab2dd88e76 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.064310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-477dcaef-4802-4f51-bdef-02ab2dd88e76 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.064972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-477dcaef-4802-4f51-bdef-02ab2dd88e76 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.080581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-05f0d21b-f05d-4c7d-9108-b7838f80b7fd tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:01.081251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-05f0d21b-f05d-4c7d-9108-b7838f80b7fd tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:01.092088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05f0d21b-f05d-4c7d-9108-b7838f80b7fd tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.092984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05f0d21b-f05d-4c7d-9108-b7838f80b7fd tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.094692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05f0d21b-f05d-4c7d-9108-b7838f80b7fd tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.095359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05f0d21b-f05d-4c7d-9108-b7838f80b7fd tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.099412 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-477dcaef-4802-4f51-bdef-02ab2dd88e76 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.045001 May 27 14:58:01.100348 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 159/294] 10.222.0.13 () {58 vars in 1127 bytes} [Fri May 27 14:58:01 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:01.120826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8ca52059-5694-4e40-aadd-87db40be6eb9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:01.121571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8ca52059-5694-4e40-aadd-87db40be6eb9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:01.130683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ca52059-5694-4e40-aadd-87db40be6eb9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.131145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ca52059-5694-4e40-aadd-87db40be6eb9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.131926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ca52059-5694-4e40-aadd-87db40be6eb9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.132404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ca52059-5694-4e40-aadd-87db40be6eb9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.349373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8ca52059-5694-4e40-aadd-87db40be6eb9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:01.372269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8ca52059-5694-4e40-aadd-87db40be6eb9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:01.374032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8ca52059-5694-4e40-aadd-87db40be6eb9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:01.375532 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8ca52059-5694-4e40-aadd-87db40be6eb9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1567 microversion: 2.25 time: 0.274004 May 27 14:58:01.376301 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 160/295] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:01 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1567 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:01.381571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-70284b16-ee84-4638-ac6d-15b10ffb664b tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] Calling method '.version_select at 0x7fc7772ddee0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:01.382508 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:01.382508 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:01.383594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-70284b16-ee84-4638-ac6d-15b10ffb664b tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'ee6f1c4798cb4b6fa2a7627a964d93b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ae70477a4abcb8c2ab620b75981f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-70284b16-ee84-4638-ac6d-15b10ffb664b tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] Request method failure captured: May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOb3LMqOlWujHULoZFeDxmXkMD1RD809MaSghRw2LJO4ahwU7nEn7cNBDPScw-PleWlon4TDN4jkxImCUS0q6kU1dM2eDcO8Dy9njO0bZxboJHTuRSn5dyK30-X0f-zEA7V6VK2eIKo8YIROSsyj5wjLr87UkKM_QXayoPAXtDajPD4 May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: dab2ae70477a4abcb8c2ab620b75981f May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1456577872 May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:58:01.385506 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:58:01.386718 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dab2ae70477a4abcb8c2ab620b75981f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dab2ae70477a4abcb8c2ab620b75981f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dab2ae70477a4abcb8c2ab620b75981f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dab2ae70477a4abcb8c2ab620b75981f", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:01.386718 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1456577872 May 27 14:58:01.386718 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: dab2ae70477a4abcb8c2ab620b75981f May 27 14:58:01.386718 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1456577872 May 27 14:58:01.386718 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-HypervisorAdminNegativeTestJSON-1456577872-project May 27 14:58:01.386718 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:01.386718 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:01.386718 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: ee6f1c4798cb4b6fa2a7627a964d93b9 May 27 14:58:01.386718 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1456577872-project May 27 14:58:01.386718 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 14:58:01.386718 n-d-843621-1 devstack@n-api.service[119248]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 27 14:58:01.386718 n-d-843621-1 devstack@n-api.service[119248]: action_args: {} May 27 14:58:01.386718 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:01.387465 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:01.387465 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:01.387465 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:01.387465 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:01.387465 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:01.387465 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:01.387465 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:01.387465 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:01.387465 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:01.387465 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index May 27 14:58:01.387465 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._index(req) May 27 14:58:01.387465 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index May 27 14:58:01.387465 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) May 27 14:58:01.387465 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:58:01.387465 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:58:01.387465 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:58:01.387465 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:58:01.387465 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:01.387465 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:01.388580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:01.388580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:01.388580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:58:01.388580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:58:01.388580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:58:01.388580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:58:01.388580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:58:01.388580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:58:01.388580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 27 14:58:01.388580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:01.388580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:01.388580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:01.388580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:01.388580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:01.388580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:01.388580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:58:01.388580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:58:01.388580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 27 14:58:01.388580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:01.389778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-70284b16-ee84-4638-ac6d-15b10ffb664b tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:01.389778 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-70284b16-ee84-4638-ac6d-15b10ffb664b tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.009573 May 27 14:58:01.389778 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 161/296] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:58:01 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:01.394120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c1e80122-6e9e-4cef-8358-6368a9bdb5d9 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:01.394888 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:01.394888 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:01.402927 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-c1e80122-6e9e-4cef-8358-6368a9bdb5d9 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] HTTP exception thrown: Aggregate 14 could not be found. May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c1e80122-6e9e-4cef-8358-6368a9bdb5d9 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Request method failure captured: May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObO0ckQ2nsLhIRen8XLCGPk5Y5rYpIXVlIca0rDL7Ay3wJHrAZcu59HJAjN5sM0TNjanz8wL9IoTYoP7V7d-LqGSLl5s5esdw9Ec1T2rX-YOH23UvrZcOu_fjfggu9cZ-EED0SrZKkQf-QFsldhhLtwzqA_xEdncRaDswWwKew0Bt8 May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 3e3e23c1d0154c7cbfae683dee503e77 May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AggregatesAdminTestJSON-971242207 May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:58:01.404490 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:58:01.405963 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3e3e23c1d0154c7cbfae683dee503e77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3e3e23c1d0154c7cbfae683dee503e77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3e3e23c1d0154c7cbfae683dee503e77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3e3e23c1d0154c7cbfae683dee503e77", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:01.405963 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AggregatesAdminTestJSON-971242207 May 27 14:58:01.405963 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 3e3e23c1d0154c7cbfae683dee503e77 May 27 14:58:01.405963 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-971242207 May 27 14:58:01.405963 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AggregatesAdminTestJSON-971242207-project-admin May 27 14:58:01.405963 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:01.405963 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:01.405963 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: ad333b6e466f4e5f8e1c98fd2b82cdb0 May 27 14:58:01.405963 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AggregatesAdminTestJSON-971242207-project-admin May 27 14:58:01.405963 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:58:01.405963 n-d-843621-1 devstack@n-api.service[119248]: exception: Aggregate 14 could not be found. May 27 14:58:01.405963 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '14'} May 27 14:58:01.405963 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:01.406745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:01.406745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 27 14:58:01.406745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 27 14:58:01.406745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 27 14:58:01.406745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 27 14:58:01.406745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:58:01.406745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:58:01.406745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 27 14:58:01.406745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 27 14:58:01.406745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 14:58:01.406745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 14:58:01.406745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 27 14:58:01.406745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 27 14:58:01.406745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. May 27 14:58:01.406745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:01.406745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:01.406745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:01.406745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:01.406745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:01.407883 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:01.407883 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:01.407883 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:01.407883 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:01.407883 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:01.407883 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 27 14:58:01.407883 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 14:58:01.407883 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. May 27 14:58:01.407883 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:01.407883 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:01.407883 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:01.407883 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:01.407883 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:01.407883 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:01.407883 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:01.407883 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:01.407883 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. May 27 14:58:01.407883 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:01.409240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c1e80122-6e9e-4cef-8358-6368a9bdb5d9 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:01.409240 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c1e80122-6e9e-4cef-8358-6368a9bdb5d9 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.017756 May 27 14:58:01.409240 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 162/297] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 14:58:01 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 14:58:01.411589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-76202484-423b-4459-b635-e52dbb4675da tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:01.413939 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:01.413939 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:01.430355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-76202484-423b-4459-b635-e52dbb4675da tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.431251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-76202484-423b-4459-b635-e52dbb4675da tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.437535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-76202484-423b-4459-b635-e52dbb4675da tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.438267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-76202484-423b-4459-b635-e52dbb4675da tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.441746 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-05f0d21b-f05d-4c7d-9108-b7838f80b7fd tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1611 microversion: 2.1 time: 0.613925 May 27 14:58:01.447435 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.compute.aggregates [None req-76202484-423b-4459-b635-e52dbb4675da tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. May 27 14:58:01.447975 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-76202484-423b-4459-b635-e52dbb4675da tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-76202484-423b-4459-b635-e52dbb4675da tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Request method failure captured: May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 42 May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObN7rp0I6xVu3rCSiCFDO27jEzcY80JU-7RphQXeYBWB9VBfn8y2OOFLmaSS9MqF8b0UY8dDCkuHdTzofW3qnEfoS67XNRe1S2pYx3kn61UaZIvWc8fDaF8cF4WxvPo1MgxAHoFQaA93SXqqE0b0O0_is3xZ-i2TKMLpSgPEMOuG1k May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: b7e6fccd7ebd4f25a4f74f11f00b29b8 May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:58:01.450259 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:58:01.451435 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b7e6fccd7ebd4f25a4f74f11f00b29b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b7e6fccd7ebd4f25a4f74f11f00b29b8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:01.451435 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:58:01.451435 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: b7e6fccd7ebd4f25a4f74f11f00b29b8 May 27 14:58:01.451435 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-294094421 May 27 14:58:01.451435 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin May 27 14:58:01.451435 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:01.451435 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:01.451435 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: aaecea53d6174f69af450ef16cb2a3ad May 27 14:58:01.451435 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin May 27 14:58:01.451435 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:58:01.451435 n-d-843621-1 devstack@n-api.service[119248]: {"remove_host": {"host": "nonexist_host"}} May 27 14:58:01.451435 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:58:01.451435 n-d-843621-1 devstack@n-api.service[119248]: exception: Cannot remove host nonexist_host in aggregate 15 May 27 14:58:01.452124 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} May 27 14:58:01.452124 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:01.452124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:01.452124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host May 27 14:58:01.452124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 27 14:58:01.452124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:58:01.452124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:58:01.452124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 27 14:58:01.452124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 27 14:58:01.452124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 14:58:01.452124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 14:58:01.452124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 27 14:58:01.452124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 27 14:58:01.452124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell May 27 14:58:01.452124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:01.452124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:01.452124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:01.452124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:01.452124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host May 27 14:58:01.452124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) May 27 14:58:01.453199 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 27 14:58:01.453199 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 27 14:58:01.453199 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 27 14:58:01.453199 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:01.453199 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:01.453199 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:01.453199 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:01.453199 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host May 27 14:58:01.453199 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) May 27 14:58:01.453199 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 27 14:58:01.453199 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 27 14:58:01.453199 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:01.453199 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:01.453199 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:01.453199 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:01.453199 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 27 14:58:01.453199 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 27 14:58:01.453199 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate May 27 14:58:01.453199 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) May 27 14:58:01.453199 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:01.454983 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:01.456111 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:01.456111 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:01.456111 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:01.456111 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:01.456111 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 May 27 14:58:01.456111 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:01.456111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-76202484-423b-4459-b635-e52dbb4675da tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:01.456111 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-76202484-423b-4459-b635-e52dbb4675da tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.043535 May 27 14:58:01.456111 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 163/298] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 14:58:01 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 14:58:01.456601 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 136/299] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:00 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1611 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:01.460753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3c510746-2598-48b4-a3f9-a97a1dc0bfa9 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:01.460983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1a1f893d-5d3a-419e-bed4-adaf472cd355 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Calling method '.version_select at 0x7fc7772dd940>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:01.461473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3c510746-2598-48b4-a3f9-a97a1dc0bfa9 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: a3017e23-0753-457e-8f51-8f1586807499] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:01.464071 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:01.464071 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:01.465731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a1f893d-5d3a-419e-bed4-adaf472cd355 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.466191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a1f893d-5d3a-419e-bed4-adaf472cd355 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.467400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a1f893d-5d3a-419e-bed4-adaf472cd355 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.468067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a1f893d-5d3a-419e-bed4-adaf472cd355 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.468316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3c510746-2598-48b4-a3f9-a97a1dc0bfa9 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.468830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3c510746-2598-48b4-a3f9-a97a1dc0bfa9 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.469617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3c510746-2598-48b4-a3f9-a97a1dc0bfa9 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.470057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3c510746-2598-48b4-a3f9-a97a1dc0bfa9 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.504563 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1a1f893d-5d3a-419e-bed4-adaf472cd355 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.050532 May 27 14:58:01.508804 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 164/300] 10.222.0.13 () {58 vars in 1154 bytes} [Fri May 27 14:58:01 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:01.515284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-22f9c59a-585b-405f-bbc7-ee2e8c9e5943 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:01.515910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-22f9c59a-585b-405f-bbc7-ee2e8c9e5943 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:01.522257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22f9c59a-585b-405f-bbc7-ee2e8c9e5943 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.522720 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22f9c59a-585b-405f-bbc7-ee2e8c9e5943 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.523765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22f9c59a-585b-405f-bbc7-ee2e8c9e5943 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.524210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22f9c59a-585b-405f-bbc7-ee2e8c9e5943 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.536167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3c510746-2598-48b4-a3f9-a97a1dc0bfa9 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:01.544237 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3c510746-2598-48b4-a3f9-a97a1dc0bfa9 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499" status: 200 len: 1278 microversion: 2.1 time: 0.087983 May 27 14:58:01.544839 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 137/301] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:01 2022] GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499 => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:01.549467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-583c51fb-5537-4efb-bfa5-ce700cb3e4da tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] Calling method '.version_select at 0x7fc7776e2ee0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:01.550309 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:01.550309 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:01.551561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-583c51fb-5537-4efb-bfa5-ce700cb3e4da tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'ee6f1c4798cb4b6fa2a7627a964d93b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ae70477a4abcb8c2ab620b75981f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-583c51fb-5537-4efb-bfa5-ce700cb3e4da tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] Request method failure captured: May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOb3LMqOlWujHULoZFeDxmXkMD1RD809MaSghRw2LJO4ahwU7nEn7cNBDPScw-PleWlon4TDN4jkxImCUS0q6kU1dM2eDcO8Dy9njO0bZxboJHTuRSn5dyK30-X0f-zEA7V6VK2eIKo8YIROSsyj5wjLr87UkKM_QXayoPAXtDajPD4 May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: dab2ae70477a4abcb8c2ab620b75981f May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1456577872 May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:58:01.553471 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:58:01.554707 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dab2ae70477a4abcb8c2ab620b75981f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dab2ae70477a4abcb8c2ab620b75981f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dab2ae70477a4abcb8c2ab620b75981f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dab2ae70477a4abcb8c2ab620b75981f", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:01.554707 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1456577872 May 27 14:58:01.554707 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: dab2ae70477a4abcb8c2ab620b75981f May 27 14:58:01.554707 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1456577872 May 27 14:58:01.554707 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-HypervisorAdminNegativeTestJSON-1456577872-project May 27 14:58:01.554707 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:01.554707 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:01.554707 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: ee6f1c4798cb4b6fa2a7627a964d93b9 May 27 14:58:01.554707 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1456577872-project May 27 14:58:01.554707 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 14:58:01.554707 n-d-843621-1 devstack@n-api.service[119249]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 27 14:58:01.554707 n-d-843621-1 devstack@n-api.service[119249]: action_args: {} May 27 14:58:01.554707 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:01.555494 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:01.555494 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:01.555494 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:01.555494 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:01.555494 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:01.555494 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:01.555494 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:01.555494 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:01.555494 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:01.555494 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics May 27 14:58:01.555494 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) May 27 14:58:01.555494 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:58:01.555494 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:58:01.555494 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:58:01.555494 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:58:01.555494 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:01.555494 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:01.555494 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:01.555494 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:01.556611 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:58:01.556611 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:58:01.556611 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:58:01.556611 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:58:01.556611 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:58:01.556611 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:58:01.556611 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 27 14:58:01.556611 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:01.556611 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:01.556611 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:01.556611 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:01.556611 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:01.556611 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:01.556611 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:58:01.556611 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:58:01.556611 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 27 14:58:01.556611 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:01.558310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-583c51fb-5537-4efb-bfa5-ce700cb3e4da tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:01.559452 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-583c51fb-5537-4efb-bfa5-ce700cb3e4da tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.013313 May 27 14:58:01.560002 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 138/302] 10.222.0.13 () {58 vars in 1178 bytes} [Fri May 27 14:58:01 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:01.569082 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7d8d4a34-4dee-49ed-b897-de6da3abc62d tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:01.569930 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:01.569930 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:01.585471 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-7d8d4a34-4dee-49ed-b897-de6da3abc62d tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] HTTP exception thrown: Aggregate 14 could not be found. May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7d8d4a34-4dee-49ed-b897-de6da3abc62d tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Request method failure captured: May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikObO0ckQ2nsLhIRen8XLCGPk5Y5rYpIXVlIca0rDL7Ay3wJHrAZcu59HJAjN5sM0TNjanz8wL9IoTYoP7V7d-LqGSLl5s5esdw9Ec1T2rX-YOH23UvrZcOu_fjfggu9cZ-EED0SrZKkQf-QFsldhhLtwzqA_xEdncRaDswWwKew0Bt8 May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 3e3e23c1d0154c7cbfae683dee503e77 May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-AggregatesAdminTestJSON-971242207 May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,admin,member May 27 14:58:01.588128 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,admin,member May 27 14:58:01.589415 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3e3e23c1d0154c7cbfae683dee503e77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3e3e23c1d0154c7cbfae683dee503e77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3e3e23c1d0154c7cbfae683dee503e77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3e3e23c1d0154c7cbfae683dee503e77", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:01.589415 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-AggregatesAdminTestJSON-971242207 May 27 14:58:01.589415 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 3e3e23c1d0154c7cbfae683dee503e77 May 27 14:58:01.589415 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-971242207 May 27 14:58:01.589415 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-AggregatesAdminTestJSON-971242207-project-admin May 27 14:58:01.589415 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:01.589415 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:01.589415 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: ad333b6e466f4e5f8e1c98fd2b82cdb0 May 27 14:58:01.589415 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-AggregatesAdminTestJSON-971242207-project-admin May 27 14:58:01.589415 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 14:58:01.589415 n-d-843621-1 devstack@n-api.service[119249]: exception: Aggregate 14 could not be found. May 27 14:58:01.589415 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '14'} May 27 14:58:01.589415 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:01.590177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:01.590177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 27 14:58:01.590177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 27 14:58:01.590177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 27 14:58:01.590177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 27 14:58:01.590177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:01.590177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:01.590177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:01.590177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:01.590177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 27 14:58:01.590177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 27 14:58:01.590177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 27 14:58:01.590177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 27 14:58:01.590177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:58:01.590177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:58:01.590177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 27 14:58:01.590177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 27 14:58:01.590177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 14:58:01.590177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:01.591998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:01.593182 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:01.593182 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:01.593182 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:01.593182 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. May 27 14:58:01.593182 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:01.593182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7d8d4a34-4dee-49ed-b897-de6da3abc62d tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:01.593182 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7d8d4a34-4dee-49ed-b897-de6da3abc62d tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.024327 May 27 14:58:01.594886 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 139/303] 10.222.0.13 () {58 vars in 1154 bytes} [Fri May 27 14:58:01 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 14:58:01.599846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c2e9eb8e-8140-4718-b491-79f3c406ce9b tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:01.600423 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c2e9eb8e-8140-4718-b491-79f3c406ce9b tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:01.608150 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2e9eb8e-8140-4718-b491-79f3c406ce9b tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.608591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2e9eb8e-8140-4718-b491-79f3c406ce9b tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.609782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2e9eb8e-8140-4718-b491-79f3c406ce9b tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.610194 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2e9eb8e-8140-4718-b491-79f3c406ce9b tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.681326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-22f9c59a-585b-405f-bbc7-ee2e8c9e5943 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:01.689381 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-22f9c59a-585b-405f-bbc7-ee2e8c9e5943 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad" status: 200 len: 1318 microversion: 2.1 time: 0.183140 May 27 14:58:01.698949 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 165/304] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:01 2022] GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:01.699120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c2e9eb8e-8140-4718-b491-79f3c406ce9b tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e44d8b3024bf49b3882dc6b50191b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56227f97234624a6b21b3b72b1fefc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:01.699120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c2e9eb8e-8140-4718-b491-79f3c406ce9b tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] flavor_id is None. Assuming migration. {{(pid=119249) resize /opt/stack/nova/nova/compute/api.py:4142}} May 27 14:58:01.699120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c2e9eb8e-8140-4718-b491-79f3c406ce9b tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119249) resize /opt/stack/nova/nova/compute/api.py:4166}} May 27 14:58:01.699401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-15d1a02e-4e82-436e-add4-c2419cd3cd40 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:01.699401 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:01.699401 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:01.718995 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-15d1a02e-4e82-436e-add4-c2419cd3cd40 tempest-AggregatesAdminNegativeTestJSON-294094421 tempest-AggregatesAdminNegativeTestJSON-294094421-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.027579 May 27 14:58:01.720635 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 166/305] 10.222.0.13 () {58 vars in 1154 bytes} [Fri May 27 14:58:01 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 27 14:58:01.725558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7787df84-5d83-41c4-ab20-44d658d88bf1 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Calling method '.version_select at 0x7fc7772dd0d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:01.726645 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:01.726645 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:01.727809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7787df84-5d83-41c4-ab20-44d658d88bf1 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.728265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7787df84-5d83-41c4-ab20-44d658d88bf1 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.729100 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7787df84-5d83-41c4-ab20-44d658d88bf1 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.729535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7787df84-5d83-41c4-ab20-44d658d88bf1 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.759881 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7787df84-5d83-41c4-ab20-44d658d88bf1 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.037639 May 27 14:58:01.760553 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 167/306] 10.222.0.13 () {58 vars in 1127 bytes} [Fri May 27 14:58:01 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:01.898804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e3e295f6-e9a0-4a9c-8584-c31fe95e47fb tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] Calling method '.version_select at 0x7fc777542160>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:01.900310 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:01.900310 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:01.902334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3e295f6-e9a0-4a9c-8584-c31fe95e47fb tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.903150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3e295f6-e9a0-4a9c-8584-c31fe95e47fb tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.931744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3e295f6-e9a0-4a9c-8584-c31fe95e47fb tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.932211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3e295f6-e9a0-4a9c-8584-c31fe95e47fb tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.942354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:DELETE=10 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:01.946407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3e295f6-e9a0-4a9c-8584-c31fe95e47fb tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:01.956814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3e295f6-e9a0-4a9c-8584-c31fe95e47fb tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:01.982689 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e3e295f6-e9a0-4a9c-8584-c31fe95e47fb tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.220486 May 27 14:58:01.988899 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 168/307] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:58:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:01.989058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-14a8b008-f1c9-4ef8-8578-1e5bdeba5c59 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1460565560"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:01.990701 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:01.990701 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:01.991307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.aggregate [None req-14a8b008-f1c9-4ef8-8578-1e5bdeba5c59 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Generated uuid d40f61b2-c6fa-4bc8-9e1b-743e578d908f for aggregate {{(pid=119248) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 27 14:58:02.018965 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-14a8b008-f1c9-4ef8-8578-1e5bdeba5c59 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.033967 May 27 14:58:02.021154 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 169/308] 10.222.0.13 () {60 vars in 1163 bytes} [Fri May 27 14:58:01 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:02.027368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-65c24b3e-6dc4-41b0-8d52-888e0bce20a4 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Calling method '.version_select at 0x7fc77749c0d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:02.028443 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:02.028443 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:02.036000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-65c24b3e-6dc4-41b0-8d52-888e0bce20a4 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:02.036757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-65c24b3e-6dc4-41b0-8d52-888e0bce20a4 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:02.055644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-65c24b3e-6dc4-41b0-8d52-888e0bce20a4 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:02.056834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-65c24b3e-6dc4-41b0-8d52-888e0bce20a4 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:02.070510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:02.080264 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-65c24b3e-6dc4-41b0-8d52-888e0bce20a4 tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/n-h2-843621-1" status: 200 len: 598 microversion: 2.1 time: 0.057486 May 27 14:58:02.090221 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 170/309] 10.222.0.13 () {58 vars in 1169 bytes} [Fri May 27 14:58:02 2022] GET /compute/v2.1/os-hosts/n-h2-843621-1 => generated 598 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:02.096122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bc534eab-353e-49ac-8540-edcb6d04f352 tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] Calling method '.version_select at 0x7fc77749c280>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:02.097449 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:02.097449 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:02.098984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bc534eab-353e-49ac-8540-edcb6d04f352 tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'ee6f1c4798cb4b6fa2a7627a964d93b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ae70477a4abcb8c2ab620b75981f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bc534eab-353e-49ac-8540-edcb6d04f352 tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] Request method failure captured: May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOb3LMqOlWujHULoZFeDxmXkMD1RD809MaSghRw2LJO4ahwU7nEn7cNBDPScw-PleWlon4TDN4jkxImCUS0q6kU1dM2eDcO8Dy9njO0bZxboJHTuRSn5dyK30-X0f-zEA7V6VK2eIKo8YIROSsyj5wjLr87UkKM_QXayoPAXtDajPD4 May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: dab2ae70477a4abcb8c2ab620b75981f May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1456577872 May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:58:02.101032 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:58:02.102237 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dab2ae70477a4abcb8c2ab620b75981f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dab2ae70477a4abcb8c2ab620b75981f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dab2ae70477a4abcb8c2ab620b75981f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dab2ae70477a4abcb8c2ab620b75981f", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:02.102237 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1456577872 May 27 14:58:02.102237 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: dab2ae70477a4abcb8c2ab620b75981f May 27 14:58:02.102237 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1456577872 May 27 14:58:02.102237 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-HypervisorAdminNegativeTestJSON-1456577872-project May 27 14:58:02.102237 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:02.102237 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:02.102237 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: ee6f1c4798cb4b6fa2a7627a964d93b9 May 27 14:58:02.102237 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1456577872-project May 27 14:58:02.102237 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 14:58:02.102237 n-d-843621-1 devstack@n-api.service[119248]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 27 14:58:02.102237 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '1'} May 27 14:58:02.102237 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:02.102971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:02.102971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:02.102971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:02.102971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:02.102971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:02.102971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:02.102971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:02.102971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:02.102971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:02.102971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime May 27 14:58:02.102971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) May 27 14:58:02.102971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:58:02.102971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:58:02.102971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:58:02.102971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:58:02.102971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:02.102971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:02.102971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:02.102971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:02.103976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:58:02.103976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:58:02.103976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:58:02.103976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:58:02.103976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:58:02.103976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:58:02.103976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 27 14:58:02.103976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:02.103976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:02.103976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:02.103976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:02.103976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:02.103976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:02.103976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:58:02.103976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:58:02.103976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 27 14:58:02.103976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:02.106079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bc534eab-353e-49ac-8540-edcb6d04f352 tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:02.107165 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bc534eab-353e-49ac-8540-edcb6d04f352 tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.015550 May 27 14:58:02.108890 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 171/310] 10.222.0.13 () {58 vars in 1172 bytes} [Fri May 27 14:58:02 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:02.115832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6dd3de5f-c3de-4a00-90b5-491358a40fed tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:02.117000 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:02.117000 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:02.127878 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6dd3de5f-c3de-4a00-90b5-491358a40fed tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.017507 May 27 14:58:02.129309 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 172/311] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 14:58:02 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:02.136190 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d879e412-6cb7-4163-a906-5b03484a7bfe tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Calling method '.version_select at 0x7fc77771dc10>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:02.138016 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:02.138016 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:02.145755 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d879e412-6cb7-4163-a906-5b03484a7bfe tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:02.146696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d879e412-6cb7-4163-a906-5b03484a7bfe tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:02.170924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d879e412-6cb7-4163-a906-5b03484a7bfe tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:02.171724 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d879e412-6cb7-4163-a906-5b03484a7bfe tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:02.200416 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d879e412-6cb7-4163-a906-5b03484a7bfe tempest-HostsAdminTestJSON-862798447 tempest-HostsAdminTestJSON-862798447-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/n-h1-843621-1" status: 200 len: 598 microversion: 2.1 time: 0.069733 May 27 14:58:02.203083 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 173/312] 10.222.0.13 () {58 vars in 1169 bytes} [Fri May 27 14:58:02 2022] GET /compute/v2.1/os-hosts/n-h1-843621-1 => generated 598 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:02.213114 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c2e9eb8e-8140-4718-b491-79f3c406ce9b tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5/action" status: 202 len: 0 microversion: 2.1 time: 0.614577 May 27 14:58:02.214020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-68d0836f-c5d1-4f0d-ad9a-874becc4b36f tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] Calling method '.version_select at 0x7fc77749c280>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:02.214842 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:02.214842 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:02.215728 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-68d0836f-c5d1-4f0d-ad9a-874becc4b36f tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] HTTP exception thrown: Hypervisor with ID '3426f974-6db1-48b8-8311-922cf7579b99' could not be found. May 27 14:58:02.219092 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 140/313] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 14:58:01 2022] POST /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5/action => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:58:02.225217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-102dc03a-5c49-400b-9318-0774b4e508fb tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:02.226763 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:02.226763 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-68d0836f-c5d1-4f0d-ad9a-874becc4b36f tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] Request method failure captured: May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-hypervisors/3426f974-6db1-48b8-8311-922cf7579b99/uptime HTTP/1.1 May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOb4zTjpm_27XCtJXAmJfO1vtX-dnm9jxgvO80W0_El6rUwx4gsSyvr-CGaOrADbYCTILOcq0m_qEjxGeIAopu0JVAIf-t3NkX5a56g7B1l189IbRVh3EmB6e0xKhFPf9H5jHWEXnBviWEfFX1N-US5rb5LJ6bEVofKnlGgj0P6zDrA May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: b74d39bfd9f44fafa4eb2c8bb4482bda May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1690777716 May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:58:02.239026 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:58:02.240603 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b74d39bfd9f44fafa4eb2c8bb4482bda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b74d39bfd9f44fafa4eb2c8bb4482bda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b74d39bfd9f44fafa4eb2c8bb4482bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b74d39bfd9f44fafa4eb2c8bb4482bda", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:02.240603 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1690777716 May 27 14:58:02.240603 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: b74d39bfd9f44fafa4eb2c8bb4482bda May 27 14:58:02.240603 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1690777716 May 27 14:58:02.240603 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin May 27 14:58:02.240603 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:02.240603 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:02.240603 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 4d37571d0e6147f6a49c305f30301eba May 27 14:58:02.240603 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin May 27 14:58:02.240603 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 14:58:02.240603 n-d-843621-1 devstack@n-api.service[119248]: exception: Hypervisor with ID '3426f974-6db1-48b8-8311-922cf7579b99' could not be found. May 27 14:58:02.240603 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '3426f974-6db1-48b8-8311-922cf7579b99'} May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi value = int(str(value)) May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '3426f974-6db1-48b8-8311-922cf7579b99' May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise ValueError(msg) May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer May 27 14:58:02.241448 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '3426f974-6db1-48b8-8311-922cf7579b99' could not be found. May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:02.242667 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:02.245366 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:02.245366 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:02.245366 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:02.245366 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:02.245366 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:02.245366 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '3426f974-6db1-48b8-8311-922cf7579b99' could not be found. May 27 14:58:02.245366 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:02.245366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-68d0836f-c5d1-4f0d-ad9a-874becc4b36f tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] Returning 404 to user: Hypervisor with ID '3426f974-6db1-48b8-8311-922cf7579b99' could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:02.245366 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-68d0836f-c5d1-4f0d-ad9a-874becc4b36f tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/3426f974-6db1-48b8-8311-922cf7579b99/uptime" status: 404 len: 123 microversion: 2.1 time: 0.035321 May 27 14:58:02.246745 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 174/314] 10.222.0.13 () {58 vars in 1277 bytes} [Fri May 27 14:58:02 2022] GET /compute/v2.1/os-hypervisors/3426f974-6db1-48b8-8311-922cf7579b99/uptime => generated 123 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:02.252343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-46a919f2-5c8e-428c-8fff-f2a19d081072 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:02.252994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-46a919f2-5c8e-428c-8fff-f2a19d081072 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:02.266216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-46a919f2-5c8e-428c-8fff-f2a19d081072 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:02.266959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-46a919f2-5c8e-428c-8fff-f2a19d081072 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:02.267971 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-46a919f2-5c8e-428c-8fff-f2a19d081072 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:02.268572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-46a919f2-5c8e-428c-8fff-f2a19d081072 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:02.283743 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-102dc03a-5c49-400b-9318-0774b4e508fb tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.065467 May 27 14:58:02.290893 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 141/315] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 14:58:02 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:02.314537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ecf8933a-9bd6-44bf-b7a3-113da937997e tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] Calling method '.version_select at 0x7fc7775bb670>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:02.315719 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:02.315719 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:02.318179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecf8933a-9bd6-44bf-b7a3-113da937997e tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:02.319348 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecf8933a-9bd6-44bf-b7a3-113da937997e tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:02.338169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecf8933a-9bd6-44bf-b7a3-113da937997e tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:02.339153 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecf8933a-9bd6-44bf-b7a3-113da937997e tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:02.354247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecf8933a-9bd6-44bf-b7a3-113da937997e tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:02.355123 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecf8933a-9bd6-44bf-b7a3-113da937997e tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:02.370019 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ecf8933a-9bd6-44bf-b7a3-113da937997e tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.075644 May 27 14:58:02.371226 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 142/316] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:58:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:02.376799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-71363770-3a10-463b-98a1-3a56f9dc2a15 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:02.378518 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:02.378518 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:02.388659 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-71363770-3a10-463b-98a1-3a56f9dc2a15 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.015762 May 27 14:58:02.389593 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 143/317] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 14:58:02 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:02.395458 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3886003a-3c4c-4fb0-8323-61e012c526e4 tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] Calling method '.version_select at 0x7fc777488f70>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:02.396656 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:02.396656 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:02.398115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3886003a-3c4c-4fb0-8323-61e012c526e4 tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'ee6f1c4798cb4b6fa2a7627a964d93b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dab2ae70477a4abcb8c2ab620b75981f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3886003a-3c4c-4fb0-8323-61e012c526e4 tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] Request method failure captured: May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOb3LMqOlWujHULoZFeDxmXkMD1RD809MaSghRw2LJO4ahwU7nEn7cNBDPScw-PleWlon4TDN4jkxImCUS0q6kU1dM2eDcO8Dy9njO0bZxboJHTuRSn5dyK30-X0f-zEA7V6VK2eIKo8YIROSsyj5wjLr87UkKM_QXayoPAXtDajPD4 May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: dab2ae70477a4abcb8c2ab620b75981f May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1456577872 May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:58:02.400391 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:58:02.401636 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dab2ae70477a4abcb8c2ab620b75981f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dab2ae70477a4abcb8c2ab620b75981f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dab2ae70477a4abcb8c2ab620b75981f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dab2ae70477a4abcb8c2ab620b75981f", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:02.401636 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1456577872 May 27 14:58:02.401636 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: dab2ae70477a4abcb8c2ab620b75981f May 27 14:58:02.401636 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1456577872 May 27 14:58:02.401636 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-HypervisorAdminNegativeTestJSON-1456577872-project May 27 14:58:02.401636 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:02.401636 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:02.401636 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: ee6f1c4798cb4b6fa2a7627a964d93b9 May 27 14:58:02.401636 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1456577872-project May 27 14:58:02.401636 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 14:58:02.401636 n-d-843621-1 devstack@n-api.service[119249]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 27 14:58:02.401636 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '1'} May 27 14:58:02.401636 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:02.402402 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:02.402402 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:02.402402 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:02.402402 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:02.402402 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:02.402402 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:02.402402 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:02.402402 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:02.402402 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:02.402402 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show May 27 14:58:02.402402 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 27 14:58:02.402402 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show May 27 14:58:02.402402 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) May 27 14:58:02.402402 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:58:02.402402 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:58:02.402402 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:58:02.402402 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:58:02.402402 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:02.402402 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:02.403415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:02.403415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:02.403415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:58:02.403415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:58:02.403415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:58:02.403415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:58:02.403415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:58:02.403415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:58:02.403415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 27 14:58:02.403415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:02.403415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:02.403415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:02.403415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:02.403415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:02.403415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:02.403415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:58:02.403415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:58:02.403415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 27 14:58:02.403415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:02.406370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3886003a-3c4c-4fb0-8323-61e012c526e4 tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:02.407486 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3886003a-3c4c-4fb0-8323-61e012c526e4 tempest-HypervisorAdminNegativeTestJSON-1456577872 tempest-HypervisorAdminNegativeTestJSON-1456577872-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.016304 May 27 14:58:02.408616 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 144/318] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 14:58:02 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:02.414128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8a55f08c-a922-4e57-a340-f89fcf817623 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:02.416845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8a55f08c-a922-4e57-a340-f89fcf817623 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:02.424043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a55f08c-a922-4e57-a340-f89fcf817623 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:02.425152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a55f08c-a922-4e57-a340-f89fcf817623 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:02.426627 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a55f08c-a922-4e57-a340-f89fcf817623 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:02.427462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a55f08c-a922-4e57-a340-f89fcf817623 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:02.873579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-46a919f2-5c8e-428c-8fff-f2a19d081072 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:02.883628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8a55f08c-a922-4e57-a340-f89fcf817623 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:02.887971 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-46a919f2-5c8e-428c-8fff-f2a19d081072 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1469 microversion: 2.1 time: 0.640269 May 27 14:58:02.898447 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 175/319] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:02 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1469 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:02.898447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-206a88e5-4c9b-45f5-bb50-cc64b74a9119 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:02.898447 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:02.898447 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:02.917880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8a55f08c-a922-4e57-a340-f89fcf817623 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:02.919608 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8a55f08c-a922-4e57-a340-f89fcf817623 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:02.920861 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8a55f08c-a922-4e57-a340-f89fcf817623 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1567 microversion: 2.25 time: 0.510981 May 27 14:58:02.921930 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 145/320] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:02 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1567 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:02.926344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-65a60f40-7839-4e05-875a-34fa4879f173 tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] Calling method '.version_select at 0x7fc777674f70>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:02.927319 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:02.927319 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:02.928422 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-65a60f40-7839-4e05-875a-34fa4879f173 tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] HTTP exception thrown: Hypervisor with ID '108c2b19-945e-4c5c-a4fe-8c805dd8ba54' could not be found. May 27 14:58:02.933614 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-206a88e5-4c9b-45f5-bb50-cc64b74a9119 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.043060 May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-65a60f40-7839-4e05-875a-34fa4879f173 tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] Request method failure captured: May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-hypervisors/108c2b19-945e-4c5c-a4fe-8c805dd8ba54 HTTP/1.1 May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOb4zTjpm_27XCtJXAmJfO1vtX-dnm9jxgvO80W0_El6rUwx4gsSyvr-CGaOrADbYCTILOcq0m_qEjxGeIAopu0JVAIf-t3NkX5a56g7B1l189IbRVh3EmB6e0xKhFPf9H5jHWEXnBviWEfFX1N-US5rb5LJ6bEVofKnlGgj0P6zDrA May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: b74d39bfd9f44fafa4eb2c8bb4482bda May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1690777716 May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,admin,member May 27 14:58:02.934985 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,admin,member May 27 14:58:02.936142 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b74d39bfd9f44fafa4eb2c8bb4482bda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b74d39bfd9f44fafa4eb2c8bb4482bda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b74d39bfd9f44fafa4eb2c8bb4482bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b74d39bfd9f44fafa4eb2c8bb4482bda", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:02.936142 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1690777716 May 27 14:58:02.936142 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: b74d39bfd9f44fafa4eb2c8bb4482bda May 27 14:58:02.936142 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1690777716 May 27 14:58:02.936142 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin May 27 14:58:02.936142 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:02.936142 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:02.936142 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 4d37571d0e6147f6a49c305f30301eba May 27 14:58:02.936142 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin May 27 14:58:02.936142 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 14:58:02.936142 n-d-843621-1 devstack@n-api.service[119249]: exception: Hypervisor with ID '108c2b19-945e-4c5c-a4fe-8c805dd8ba54' could not be found. May 27 14:58:02.936142 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '108c2b19-945e-4c5c-a4fe-8c805dd8ba54'} May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi value = int(str(value)) May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '108c2b19-945e-4c5c-a4fe-8c805dd8ba54' May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise ValueError(msg) May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer May 27 14:58:02.936893 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) May 27 14:58:02.938024 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer May 27 14:58:02.938024 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:02.938024 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:02.938024 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:02.938024 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:02.938024 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:02.938024 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:02.938024 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:02.938024 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:02.938024 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:02.938024 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:02.938024 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:02.938024 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:02.938024 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show May 27 14:58:02.938024 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 27 14:58:02.938024 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show May 27 14:58:02.938024 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) May 27 14:58:02.938024 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id May 27 14:58:02.938024 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 27 14:58:02.938024 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '108c2b19-945e-4c5c-a4fe-8c805dd8ba54' could not be found. May 27 14:58:02.939070 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:02.939070 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:02.939070 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:02.939070 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:02.939070 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:02.939070 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:02.939070 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:02.939070 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:02.939070 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '108c2b19-945e-4c5c-a4fe-8c805dd8ba54' could not be found. May 27 14:58:02.939070 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:02.939594 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 176/321] 10.222.0.13 () {58 vars in 1154 bytes} [Fri May 27 14:58:02 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 27 14:58:02.941289 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-65a60f40-7839-4e05-875a-34fa4879f173 tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] Returning 404 to user: Hypervisor with ID '108c2b19-945e-4c5c-a4fe-8c805dd8ba54' could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:02.942728 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-65a60f40-7839-4e05-875a-34fa4879f173 tempest-HypervisorAdminNegativeTestJSON-1690777716 tempest-HypervisorAdminNegativeTestJSON-1690777716-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/108c2b19-945e-4c5c-a4fe-8c805dd8ba54" status: 404 len: 123 microversion: 2.1 time: 0.019709 May 27 14:58:02.945305 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 146/322] 10.222.0.13 () {58 vars in 1256 bytes} [Fri May 27 14:58:02 2022] GET /compute/v2.1/os-hypervisors/108c2b19-945e-4c5c-a4fe-8c805dd8ba54 => generated 123 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:02.956095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f4ac42c5-8b2e-44de-b830-c36e94fd78f7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:02.959394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f4ac42c5-8b2e-44de-b830-c36e94fd78f7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: a3017e23-0753-457e-8f51-8f1586807499] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:02.973577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-3f17f585-483d-48c2-82aa-d0dd0c3e82a2 req-ddec5688-4d54-4871-b267-e494c4fcd4ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad32218c-901a-44e3-92e3-5aeb695c4cc8", "name": "network-vif-unplugged", "status": "completed", "tag": "1d06f984-6b2c-4b79-8cfb-73890966fc2a"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:02.982393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4ac42c5-8b2e-44de-b830-c36e94fd78f7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:02.982930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4ac42c5-8b2e-44de-b830-c36e94fd78f7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:02.983830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4ac42c5-8b2e-44de-b830-c36e94fd78f7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:02.985040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4ac42c5-8b2e-44de-b830-c36e94fd78f7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:02.987330 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3f17f585-483d-48c2-82aa-d0dd0c3e82a2 req-ddec5688-4d54-4871-b267-e494c4fcd4ad service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:02.988555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3f17f585-483d-48c2-82aa-d0dd0c3e82a2 req-ddec5688-4d54-4871-b267-e494c4fcd4ad service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:03.022885 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-3f17f585-483d-48c2-82aa-d0dd0c3e82a2 req-ddec5688-4d54-4871-b267-e494c4fcd4ad service nova] Creating event network-vif-unplugged:1d06f984-6b2c-4b79-8cfb-73890966fc2a for instance ad32218c-901a-44e3-92e3-5aeb695c4cc8 on n-h2-843621-1 May 27 14:58:03.045982 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-3f17f585-483d-48c2-82aa-d0dd0c3e82a2 req-ddec5688-4d54-4871-b267-e494c4fcd4ad service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105471 May 27 14:58:03.046786 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 177/323] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:03.057003 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-333abbcf-cde2-46f7-86d8-052805e21496 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:03.058184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-333abbcf-cde2-46f7-86d8-052805e21496 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:03.086109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-333abbcf-cde2-46f7-86d8-052805e21496 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:03.086918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-333abbcf-cde2-46f7-86d8-052805e21496 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:03.088412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-333abbcf-cde2-46f7-86d8-052805e21496 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:03.089028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-333abbcf-cde2-46f7-86d8-052805e21496 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:03.434790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f4ac42c5-8b2e-44de-b830-c36e94fd78f7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:03.458668 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f4ac42c5-8b2e-44de-b830-c36e94fd78f7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499" status: 200 len: 1320 microversion: 2.1 time: 0.508582 May 27 14:58:03.459294 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 147/324] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:02 2022] GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499 => generated 1320 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:03.473304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-92b19cde-3410-4b9e-91f6-f2977ea55c05 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1486940920", "availability_zone": "tempest-test_az-1977573362"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:03.484553 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:03.484553 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:03.486823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.aggregate [None req-92b19cde-3410-4b9e-91f6-f2977ea55c05 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Generated uuid f9bcdb8b-f08f-4aa1-88f3-a6fde0256fc3 for aggregate {{(pid=119249) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 27 14:58:03.489785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-333abbcf-cde2-46f7-86d8-052805e21496 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:03.498513 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-333abbcf-cde2-46f7-86d8-052805e21496 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad" status: 200 len: 1468 microversion: 2.1 time: 0.450275 May 27 14:58:03.514721 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 178/325] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:03 2022] GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad => generated 1468 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:03.553637 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-92b19cde-3410-4b9e-91f6-f2977ea55c05 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.092091 May 27 14:58:03.556302 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 148/326] 10.222.0.13 () {60 vars in 1164 bytes} [Fri May 27 14:58:03 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:03.569147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-92265b4c-ff1b-4d03-8f4d-f132e42a3c55 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1486940920_new", "availability_zone": "tempest-test_az-1977573362_new"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:03.690092 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:03.690092 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:03.745433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-92265b4c-ff1b-4d03-8f4d-f132e42a3c55 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:03.746333 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-92265b4c-ff1b-4d03-8f4d-f132e42a3c55 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:03.843273 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-92265b4c-ff1b-4d03-8f4d-f132e42a3c55 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 337 microversion: 2.1 time: 0.281509 May 27 14:58:03.843925 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 149/327] 10.222.0.13 () {60 vars in 1172 bytes} [Fri May 27 14:58:03 2022] PUT /compute/v2.1/os-aggregates/17 => generated 337 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 14:58:03.869923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6316eeb2-885e-4597-a7f3-f5137fdb15d2 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:03.874393 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:03.874393 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:03.898662 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6316eeb2-885e-4597-a7f3-f5137fdb15d2 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.046453 May 27 14:58:03.899417 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 150/328] 10.222.0.13 () {58 vars in 1142 bytes} [Fri May 27 14:58:03 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:03.912393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-31061e9b-0ad6-4e2a-a309-17b771829789 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:03.919014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-31061e9b-0ad6-4e2a-a309-17b771829789 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:03.935331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-31061e9b-0ad6-4e2a-a309-17b771829789 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:03.935790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-31061e9b-0ad6-4e2a-a309-17b771829789 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:03.936577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-31061e9b-0ad6-4e2a-a309-17b771829789 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:03.937052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-31061e9b-0ad6-4e2a-a309-17b771829789 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:03.982162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-08eac9d6-ea20-4c71-a145-10d0d05d03b9 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1891776446", "block_migration": true, "disk_over_commit": false}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:03.984230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-08eac9d6-ea20-4c71-a145-10d0d05d03b9 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] [instance: ae05ce87-e077-487e-906e-824915f604ad] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:04.000816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08eac9d6-ea20-4c71-a145-10d0d05d03b9 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:04.002975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08eac9d6-ea20-4c71-a145-10d0d05d03b9 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:04.005242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08eac9d6-ea20-4c71-a145-10d0d05d03b9 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:04.016313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08eac9d6-ea20-4c71-a145-10d0d05d03b9 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:04.242500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-08eac9d6-ea20-4c71-a145-10d0d05d03b9 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lazy-loading 'flavor' on Instance uuid ae05ce87-e077-487e-906e-824915f604ad {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:58:04.317187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-31061e9b-0ad6-4e2a-a309-17b771829789 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:04.326974 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-31061e9b-0ad6-4e2a-a309-17b771829789 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1469 microversion: 2.1 time: 0.422812 May 27 14:58:04.344853 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 151/329] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:03 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1469 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:04.373300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-01f16c65-3606-4c57-b5f4-348a12653906 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:04.376621 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:04.376621 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:04.381215 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-08eac9d6-ea20-4c71-a145-10d0d05d03b9 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] [instance: ae05ce87-e077-487e-906e-824915f604ad] Going to try to live migrate instance to tempest-host-1891776446 {{(pid=119248) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 27 14:58:04.393013 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-08eac9d6-ea20-4c71-a145-10d0d05d03b9 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] HTTP exception thrown: Compute host tempest-host-1891776446 could not be found. May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-08eac9d6-ea20-4c71-a145-10d0d05d03b9 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Request method failure captured: May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad/action HTTP/1.1 May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 107 May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObndzlkEjKsr0bzvH9xNC4Sqh44uXt_35xAPDV3B-YyHxA7f2Hh9xGkRmz_mGG_EulworP4gskoHyoXWspuY4KBn_9tL0AvoYmx2VRUrp_GDQJycVH4hp17wBqjDnj_ZO3MApmoq3m2aS0Z9uncP4OBgynbEA5xLhmi9VmUJujYYPk May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 67139342377d4aa699892c2ff4e0e75f May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-LiveMigrationNegativeTest-894384242 May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:58:04.397654 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:58:04.398939 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/67139342377d4aa699892c2ff4e0e75f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/67139342377d4aa699892c2ff4e0e75f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/67139342377d4aa699892c2ff4e0e75f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_67139342377d4aa699892c2ff4e0e75f", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:04.398939 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-LiveMigrationNegativeTest-894384242 May 27 14:58:04.398939 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 67139342377d4aa699892c2ff4e0e75f May 27 14:58:04.398939 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-894384242 May 27 14:58:04.398939 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-LiveMigrationNegativeTest-894384242-project-admin May 27 14:58:04.398939 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:04.398939 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:04.398939 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: ddf9c2bf5533479c8ac4846381f1739d May 27 14:58:04.398939 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-LiveMigrationNegativeTest-894384242-project-admin May 27 14:58:04.398939 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:58:04.398939 n-d-843621-1 devstack@n-api.service[119248]: {"os-migrateLive": {"host": "tempest-host-1891776446", "block_migration": true, "disk_over_commit": false}} May 27 14:58:04.398939 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:58:04.399801 n-d-843621-1 devstack@n-api.service[119248]: exception: Compute host tempest-host-1891776446 could not be found. May 27 14:58:04.399801 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'ae05ce87-e077-487e-906e-824915f604ad', 'body': {'os-migrateLive': {'host': 'tempest-host-1891776446', 'block_migration': True, 'disk_over_commit': False}}} May 27 14:58:04.399801 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:04.399801 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:04.399801 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live May 27 14:58:04.399801 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, May 27 14:58:04.399801 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 27 14:58:04.399801 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 14:58:04.399801 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 27 14:58:04.399801 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 27 14:58:04.399801 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 27 14:58:04.399801 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 14:58:04.399801 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 27 14:58:04.399801 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 27 14:58:04.399801 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 27 14:58:04.399801 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 14:58:04.399801 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 27 14:58:04.399801 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 14:58:04.399801 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 14:58:04.400971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 14:58:04.400971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 14:58:04.400971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 14:58:04.400971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate May 27 14:58:04.400971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) May 27 14:58:04.400971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:58:04.400971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:58:04.400971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host May 27 14:58:04.400971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, May 27 14:58:04.400971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper May 27 14:58:04.400971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:04.400971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host May 27 14:58:04.400971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) May 27 14:58:04.400971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper May 27 14:58:04.400971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) May 27 14:58:04.400971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host May 27 14:58:04.400971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) May 27 14:58:04.400971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1891776446 could not be found. May 27 14:58:04.400971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:04.402126 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:04.402126 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:04.402126 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:04.402126 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:04.402126 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:04.402126 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:04.402126 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:04.402126 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:04.402126 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:04.402126 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:58:04.402126 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:58:04.402126 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:58:04.402126 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:58:04.402126 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:58:04.402126 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:58:04.402126 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 27 14:58:04.402126 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live May 27 14:58:04.402126 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 14:58:04.402126 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1891776446 could not be found. May 27 14:58:04.402126 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:04.403342 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:04.403342 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:04.403342 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:04.403342 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:04.403342 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:04.403342 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:04.403342 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:04.403342 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1891776446 could not be found. May 27 14:58:04.403342 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:04.405408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-08eac9d6-ea20-4c71-a145-10d0d05d03b9 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Returning 400 to user: Compute host tempest-host-1891776446 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:04.407077 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-08eac9d6-ea20-4c71-a145-10d0d05d03b9 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad/action" status: 400 len: 100 microversion: 2.1 time: 0.891065 May 27 14:58:04.408146 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 179/330] 10.222.0.13 () {60 vars in 1278 bytes} [Fri May 27 14:58:03 2022] POST /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad/action => generated 100 bytes in 893 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 14:58:04.413715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d257462a-317c-462a-91ef-cdb074e0f35f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:04.415687 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d257462a-317c-462a-91ef-cdb074e0f35f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:04.426510 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-01f16c65-3606-4c57-b5f4-348a12653906 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.077870 May 27 14:58:04.427177 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 152/331] 10.222.0.13 () {58 vars in 1154 bytes} [Fri May 27 14:58:04 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 27 14:58:04.434013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e3aaea82-beef-4b1c-b872-845a4bb28730 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:04.434719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e3aaea82-beef-4b1c-b872-845a4bb28730 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:04.438605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d257462a-317c-462a-91ef-cdb074e0f35f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:04.438995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d257462a-317c-462a-91ef-cdb074e0f35f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:04.442515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d257462a-317c-462a-91ef-cdb074e0f35f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:04.442756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3aaea82-beef-4b1c-b872-845a4bb28730 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:04.443229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d257462a-317c-462a-91ef-cdb074e0f35f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:04.443818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3aaea82-beef-4b1c-b872-845a4bb28730 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:04.444825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3aaea82-beef-4b1c-b872-845a4bb28730 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:04.445551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3aaea82-beef-4b1c-b872-845a4bb28730 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:05.105863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d257462a-317c-462a-91ef-cdb074e0f35f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:05.111215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e3aaea82-beef-4b1c-b872-845a4bb28730 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:05.116791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d257462a-317c-462a-91ef-cdb074e0f35f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:05.119088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d257462a-317c-462a-91ef-cdb074e0f35f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:05.119494 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e3aaea82-beef-4b1c-b872-845a4bb28730 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad" status: 200 len: 1468 microversion: 2.1 time: 0.691028 May 27 14:58:05.120073 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 153/332] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:04 2022] GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad => generated 1468 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:05.121454 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d257462a-317c-462a-91ef-cdb074e0f35f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1567 microversion: 2.25 time: 0.711955 May 27 14:58:05.122957 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 180/333] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:04 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1567 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:05.127674 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e9c02b89-6194-483a-b23b-c692f88847c1 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:05.128358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e9c02b89-6194-483a-b23b-c692f88847c1 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: a3017e23-0753-457e-8f51-8f1586807499] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:05.137703 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-468f3f69-354e-4d49-b34b-ff9b1c56818d tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1734290801"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:05.139177 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:05.139177 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:05.142236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.aggregate [None req-468f3f69-354e-4d49-b34b-ff9b1c56818d tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Generated uuid 1f2991a8-5bc7-4061-a6be-ab499258a04f for aggregate {{(pid=119249) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 27 14:58:05.143557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e9c02b89-6194-483a-b23b-c692f88847c1 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:05.144269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e9c02b89-6194-483a-b23b-c692f88847c1 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:05.145599 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e9c02b89-6194-483a-b23b-c692f88847c1 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:05.146266 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e9c02b89-6194-483a-b23b-c692f88847c1 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:05.189186 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-468f3f69-354e-4d49-b34b-ff9b1c56818d tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.068012 May 27 14:58:05.189796 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 154/334] 10.222.0.13 () {60 vars in 1163 bytes} [Fri May 27 14:58:05 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:05.199560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-64d0985b-ba65-44b1-9e39-faef171c650e req-a4f8a42a-53e2-4478-b6b4-d7a6ff93f50e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad32218c-901a-44e3-92e3-5aeb695c4cc8", "tag": "1d06f984-6b2c-4b79-8cfb-73890966fc2a"}, {"name": "network-changed", "server_uuid": "a3017e23-0753-457e-8f51-8f1586807499", "tag": "b8a6a96c-7199-4f1c-b267-e54b0266f9f9"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:05.210602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-64d0985b-ba65-44b1-9e39-faef171c650e req-a4f8a42a-53e2-4478-b6b4-d7a6ff93f50e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:05.211848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-64d0985b-ba65-44b1-9e39-faef171c650e req-a4f8a42a-53e2-4478-b6b4-d7a6ff93f50e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:05.236225 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-64d0985b-ba65-44b1-9e39-faef171c650e req-a4f8a42a-53e2-4478-b6b4-d7a6ff93f50e service nova] Creating event network-changed:1d06f984-6b2c-4b79-8cfb-73890966fc2a for instance ad32218c-901a-44e3-92e3-5aeb695c4cc8 on n-h2-843621-1 May 27 14:58:05.237057 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-64d0985b-ba65-44b1-9e39-faef171c650e req-a4f8a42a-53e2-4478-b6b4-d7a6ff93f50e service nova] Creating event network-changed:b8a6a96c-7199-4f1c-b267-e54b0266f9f9 for instance a3017e23-0753-457e-8f51-8f1586807499 on n-h2-843621-1 May 27 14:58:05.244036 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-64d0985b-ba65-44b1-9e39-faef171c650e req-a4f8a42a-53e2-4478-b6b4-d7a6ff93f50e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.052231 May 27 14:58:05.248376 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 155/335] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:05.253531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-02bba9a3-806e-4291-9f32-31aaf91169af tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:05.254296 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:05.254296 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:05.263567 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-02bba9a3-806e-4291-9f32-31aaf91169af tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.012259 May 27 14:58:05.263567 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 156/336] 10.222.0.13 () {58 vars in 1142 bytes} [Fri May 27 14:58:05 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:05.283483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f7414dce-38c7-4f29-8c09-29730952dd32 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:05.284221 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:05.284221 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:05.331804 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f7414dce-38c7-4f29-8c09-29730952dd32 tempest-AggregatesAdminTestJSON-971242207 tempest-AggregatesAdminTestJSON-971242207-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.058647 May 27 14:58:05.332714 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 157/337] 10.222.0.13 () {58 vars in 1154 bytes} [Fri May 27 14:58:05 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 27 14:58:05.339967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-db6d4d92-0ff5-4028-8673-017d86b576de tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-630964732", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:05.393274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e9c02b89-6194-483a-b23b-c692f88847c1 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:05.405118 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e9c02b89-6194-483a-b23b-c692f88847c1 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499" status: 200 len: 1320 microversion: 2.1 time: 0.277288 May 27 14:58:05.406899 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 181/338] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:05 2022] GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499 => generated 1320 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:05.414574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9213b7e8-621e-46c5-b5b9-a3eb5cbcb53b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:05.415123 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9213b7e8-621e-46c5-b5b9-a3eb5cbcb53b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:05.430699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9213b7e8-621e-46c5-b5b9-a3eb5cbcb53b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:05.431165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9213b7e8-621e-46c5-b5b9-a3eb5cbcb53b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:05.432495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9213b7e8-621e-46c5-b5b9-a3eb5cbcb53b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:05.432975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-db6d4d92-0ff5-4028-8673-017d86b576de tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] validate_networks() for None {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 14:58:05.433308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9213b7e8-621e-46c5-b5b9-a3eb5cbcb53b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:05.456713 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-9213b7e8-621e-46c5-b5b9-a3eb5cbcb53b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] HTTP exception thrown: Instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 could not be found. May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9213b7e8-621e-46c5-b5b9-a3eb5cbcb53b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Request method failure captured: May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 HTTP/1.1 May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObLX5sdBha_C7JLSos0YeUwwH2YZBHxubjOyc7lwlex3uxb6u5qpJUZAyywzO9NxxR0ip5emWe8aTII8XZkgWn5hMxr23Hc5izgHfMiIeNnEUozZ_gVMDh39vJd7qYQmtE9XlYgZQO1p8DzeB7JNE9aDCf58bOhsHH0mlwaUUfnZb0 May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 2e8ad802697947bbbd44c9a3eff36880 May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AggregatesAdminTestJSON-2063592965 May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:58:05.458459 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:58:05.459717 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e8ad802697947bbbd44c9a3eff36880"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e8ad802697947bbbd44c9a3eff36880"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2e8ad802697947bbbd44c9a3eff36880"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2e8ad802697947bbbd44c9a3eff36880", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:05.459717 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AggregatesAdminTestJSON-2063592965 May 27 14:58:05.459717 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 2e8ad802697947bbbd44c9a3eff36880 May 27 14:58:05.459717 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2063592965 May 27 14:58:05.459717 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AggregatesAdminTestJSON-2063592965-project May 27 14:58:05.459717 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:05.459717 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:05.459717 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 852d9fd26d404e0b8ff560657e187c7a May 27 14:58:05.459717 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AggregatesAdminTestJSON-2063592965-project May 27 14:58:05.459717 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:58:05.459717 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 could not be found. May 27 14:58:05.459717 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8'} May 27 14:58:05.460478 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:05.460478 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:05.460478 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 14:58:05.460478 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 14:58:05.460478 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 14:58:05.460478 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 14:58:05.460478 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 14:58:05.460478 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 14:58:05.460478 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 14:58:05.460478 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 14:58:05.460478 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 could not be found. May 27 14:58:05.460478 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:05.460478 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:05.460478 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:05.460478 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:05.460478 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:05.460478 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:05.460478 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:05.460478 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:05.460478 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:05.461593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:05.461593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 14:58:05.461593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 14:58:05.461593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 14:58:05.461593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 14:58:05.461593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 14:58:05.461593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 14:58:05.461593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 14:58:05.461593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 14:58:05.461593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 could not be found. May 27 14:58:05.461593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:05.461593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:05.461593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:05.461593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:05.461593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:05.461593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:05.461593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:05.461593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:05.461593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 could not be found. May 27 14:58:05.461593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:05.464768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9213b7e8-621e-46c5-b5b9-a3eb5cbcb53b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Returning 404 to user: Instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:05.466032 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9213b7e8-621e-46c5-b5b9-a3eb5cbcb53b tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 404 len: 111 microversion: 2.1 time: 0.058089 May 27 14:58:05.467026 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 182/339] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 14:58:05 2022] DELETE /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:05.474885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e36936ce-6542-4281-a724-d37e069e89b5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:05.475790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e36936ce-6542-4281-a724-d37e069e89b5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:05.482326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e36936ce-6542-4281-a724-d37e069e89b5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:05.483126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e36936ce-6542-4281-a724-d37e069e89b5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:05.484154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e36936ce-6542-4281-a724-d37e069e89b5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:05.484814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e36936ce-6542-4281-a724-d37e069e89b5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:05.789606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e36936ce-6542-4281-a724-d37e069e89b5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:05.798518 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e36936ce-6542-4281-a724-d37e069e89b5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1469 microversion: 2.1 time: 0.327329 May 27 14:58:05.814892 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 183/340] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:05 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1469 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:05.822005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-63ea1e91-d155-437f-a330-bdc4f589b076 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:05.825327 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-63ea1e91-d155-437f-a330-bdc4f589b076 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] [instance: 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:05.844319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63ea1e91-d155-437f-a330-bdc4f589b076 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:05.845117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63ea1e91-d155-437f-a330-bdc4f589b076 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:05.846137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63ea1e91-d155-437f-a330-bdc4f589b076 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:05.846795 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63ea1e91-d155-437f-a330-bdc4f589b076 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:05.888026 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-63ea1e91-d155-437f-a330-bdc4f589b076 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] HTTP exception thrown: Instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 could not be found. May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-63ea1e91-d155-437f-a330-bdc4f589b076 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Request method failure captured: May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 HTTP/1.1 May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObLX5sdBha_C7JLSos0YeUwwH2YZBHxubjOyc7lwlex3uxb6u5qpJUZAyywzO9NxxR0ip5emWe8aTII8XZkgWn5hMxr23Hc5izgHfMiIeNnEUozZ_gVMDh39vJd7qYQmtE9XlYgZQO1p8DzeB7JNE9aDCf58bOhsHH0mlwaUUfnZb0 May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 2e8ad802697947bbbd44c9a3eff36880 May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AggregatesAdminTestJSON-2063592965 May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:58:05.889656 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:58:05.890960 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e8ad802697947bbbd44c9a3eff36880"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e8ad802697947bbbd44c9a3eff36880"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2e8ad802697947bbbd44c9a3eff36880"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2e8ad802697947bbbd44c9a3eff36880", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:05.890960 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AggregatesAdminTestJSON-2063592965 May 27 14:58:05.890960 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 2e8ad802697947bbbd44c9a3eff36880 May 27 14:58:05.890960 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2063592965 May 27 14:58:05.890960 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AggregatesAdminTestJSON-2063592965-project May 27 14:58:05.890960 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:05.890960 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:05.890960 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 852d9fd26d404e0b8ff560657e187c7a May 27 14:58:05.890960 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AggregatesAdminTestJSON-2063592965-project May 27 14:58:05.890960 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:58:05.890960 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 could not be found. May 27 14:58:05.890960 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8'} May 27 14:58:05.891601 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:05.891601 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:05.891601 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 14:58:05.891601 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 14:58:05.891601 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 14:58:05.891601 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 14:58:05.891601 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 14:58:05.891601 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 14:58:05.891601 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 14:58:05.891601 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 14:58:05.891601 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 could not be found. May 27 14:58:05.891601 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:05.891601 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:05.891601 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:05.891601 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:05.891601 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:05.891601 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:05.891601 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:05.891601 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:05.891601 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:05.893544 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:05.893544 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 14:58:05.893544 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 14:58:05.893544 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 14:58:05.893544 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 14:58:05.893544 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 14:58:05.893544 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 14:58:05.893544 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 could not be found. May 27 14:58:05.893544 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:05.893544 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:05.893544 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:05.893544 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:05.893544 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:05.893544 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:05.893544 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:05.893544 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:05.893544 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 could not be found. May 27 14:58:05.893544 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:05.896324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-63ea1e91-d155-437f-a330-bdc4f589b076 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] Returning 404 to user: Instance 0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:05.897675 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-63ea1e91-d155-437f-a330-bdc4f589b076 tempest-AggregatesAdminTestJSON-2063592965 tempest-AggregatesAdminTestJSON-2063592965-project] 10.222.0.13 "GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8" status: 404 len: 111 microversion: 2.1 time: 0.081238 May 27 14:58:05.902006 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 184/341] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:05 2022] GET /compute/v2.1/servers/0fd6cb8b-f0d0-4a6f-989f-4b9571a88fb8 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:05.906399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-db6d4d92-0ff5-4028-8673-017d86b576de tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:58:05.907762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-db6d4d92-0ff5-4028-8673-017d86b576de tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:58:05.908433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-db6d4d92-0ff5-4028-8673-017d86b576de tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:58:05.909131 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-db6d4d92-0ff5-4028-8673-017d86b576de tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:58:05.910100 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-db6d4d92-0ff5-4028-8673-017d86b576de tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:58:05.921642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db6d4d92-0ff5-4028-8673-017d86b576de tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:05.922341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db6d4d92-0ff5-4028-8673-017d86b576de tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:05.923363 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db6d4d92-0ff5-4028-8673-017d86b576de tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:05.923884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db6d4d92-0ff5-4028-8673-017d86b576de tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:05.945180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-db6d4d92-0ff5-4028-8673-017d86b576de tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Getting quotas for project 12fde8a6988b483cab0e58f2b6a35615. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:58:05.952549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-db6d4d92-0ff5-4028-8673-017d86b576de tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Getting quotas for user 693e1381d34b4d58b657f2a0ea930190 and project 12fde8a6988b483cab0e58f2b6a35615. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:58:05.962774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-db6d4d92-0ff5-4028-8673-017d86b576de tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 14:58:05.971534 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-db6d4d92-0ff5-4028-8673-017d86b576de tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 14:58:06.043925 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-db6d4d92-0ff5-4028-8673-017d86b576de tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709420 May 27 14:58:06.045426 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 158/342] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:58:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 14:58:06.054705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c3208736-750e-41dd-9098-22ff9feed34e tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:06.055390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c3208736-750e-41dd-9098-22ff9feed34e tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:06.125434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c3208736-750e-41dd-9098-22ff9feed34e tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:06.141774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-425cbdbb-67e5-4348-b7a6-1f2edb33c011 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:06.142941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-425cbdbb-67e5-4348-b7a6-1f2edb33c011 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:06.147476 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c3208736-750e-41dd-9098-22ff9feed34e tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe" status: 200 len: 1218 microversion: 2.1 time: 0.082159 May 27 14:58:06.161262 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 185/343] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:06 2022] GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:58:06.180557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-425cbdbb-67e5-4348-b7a6-1f2edb33c011 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:06.183080 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-425cbdbb-67e5-4348-b7a6-1f2edb33c011 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:06.184590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-425cbdbb-67e5-4348-b7a6-1f2edb33c011 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:06.189073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-425cbdbb-67e5-4348-b7a6-1f2edb33c011 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:06.420205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-425cbdbb-67e5-4348-b7a6-1f2edb33c011 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:06.422953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-beb8f0f5-41ea-49b1-8e78-82a38db1e389 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:06.424169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-beb8f0f5-41ea-49b1-8e78-82a38db1e389 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: a3017e23-0753-457e-8f51-8f1586807499] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:06.431435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-425cbdbb-67e5-4348-b7a6-1f2edb33c011 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:06.434353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-425cbdbb-67e5-4348-b7a6-1f2edb33c011 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:06.435541 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-425cbdbb-67e5-4348-b7a6-1f2edb33c011 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1567 microversion: 2.25 time: 0.298853 May 27 14:58:06.436649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-beb8f0f5-41ea-49b1-8e78-82a38db1e389 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:06.437979 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 159/344] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:06 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1567 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 14:58:06.438444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-beb8f0f5-41ea-49b1-8e78-82a38db1e389 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:06.439256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-beb8f0f5-41ea-49b1-8e78-82a38db1e389 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:06.439704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-beb8f0f5-41ea-49b1-8e78-82a38db1e389 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:06.698045 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-beb8f0f5-41ea-49b1-8e78-82a38db1e389 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:06.707437 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-beb8f0f5-41ea-49b1-8e78-82a38db1e389 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499" status: 200 len: 1320 microversion: 2.1 time: 0.288628 May 27 14:58:06.717084 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 186/345] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:06 2022] GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499 => generated 1320 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:58:06.818848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7f8a0a60-d190-437f-b5be-684dd55ac838 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:06.819914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7f8a0a60-d190-437f-b5be-684dd55ac838 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:06.843183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f8a0a60-d190-437f-b5be-684dd55ac838 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:06.843683 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f8a0a60-d190-437f-b5be-684dd55ac838 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:06.846651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f8a0a60-d190-437f-b5be-684dd55ac838 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:06.847117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f8a0a60-d190-437f-b5be-684dd55ac838 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:07.103318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7f8a0a60-d190-437f-b5be-684dd55ac838 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:07.115037 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7f8a0a60-d190-437f-b5be-684dd55ac838 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1469 microversion: 2.1 time: 0.303384 May 27 14:58:07.119382 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 160/346] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:06 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1469 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:07.179700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3433d635-0242-4011-9273-65dd097866d2 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:07.181435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3433d635-0242-4011-9273-65dd097866d2 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:07.202449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3433d635-0242-4011-9273-65dd097866d2 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:07.202947 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3433d635-0242-4011-9273-65dd097866d2 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:07.206312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3433d635-0242-4011-9273-65dd097866d2 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:07.207541 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3433d635-0242-4011-9273-65dd097866d2 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:07.300719 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3433d635-0242-4011-9273-65dd097866d2 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:07.310975 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3433d635-0242-4011-9273-65dd097866d2 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe" status: 200 len: 1270 microversion: 2.1 time: 0.136150 May 27 14:58:07.312111 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 187/347] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:07 2022] GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe => generated 1270 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:07.458959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f8ef7c37-a10a-43a5-b1a6-7f4779f443a0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:07.459716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f8ef7c37-a10a-43a5-b1a6-7f4779f443a0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:07.466935 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f8ef7c37-a10a-43a5-b1a6-7f4779f443a0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:07.467587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f8ef7c37-a10a-43a5-b1a6-7f4779f443a0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:07.468646 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f8ef7c37-a10a-43a5-b1a6-7f4779f443a0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:07.469357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f8ef7c37-a10a-43a5-b1a6-7f4779f443a0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:07.691274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f8ef7c37-a10a-43a5-b1a6-7f4779f443a0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:07.704263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f8ef7c37-a10a-43a5-b1a6-7f4779f443a0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:07.706614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f8ef7c37-a10a-43a5-b1a6-7f4779f443a0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:07.708418 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f8ef7c37-a10a-43a5-b1a6-7f4779f443a0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1567 microversion: 2.25 time: 0.253091 May 27 14:58:07.726119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-11889d80-d49c-46d3-aa73-7fe31ee2f5d3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:07.728020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-11889d80-d49c-46d3-aa73-7fe31ee2f5d3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: a3017e23-0753-457e-8f51-8f1586807499] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:07.733176 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 161/348] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:07 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1567 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:07.737786 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-11889d80-d49c-46d3-aa73-7fe31ee2f5d3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:07.738993 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-11889d80-d49c-46d3-aa73-7fe31ee2f5d3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:07.742304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-11889d80-d49c-46d3-aa73-7fe31ee2f5d3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:07.750795 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-11889d80-d49c-46d3-aa73-7fe31ee2f5d3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:07.988068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-11889d80-d49c-46d3-aa73-7fe31ee2f5d3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:07.998969 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-11889d80-d49c-46d3-aa73-7fe31ee2f5d3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499" status: 200 len: 1320 microversion: 2.1 time: 0.276211 May 27 14:58:08.000206 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 188/349] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:07 2022] GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499 => generated 1320 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:08.134623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bb68f5ca-f6c1-4cc2-b4ca-597cad3f2ed6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:08.135327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bb68f5ca-f6c1-4cc2-b4ca-597cad3f2ed6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:08.147943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb68f5ca-f6c1-4cc2-b4ca-597cad3f2ed6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:08.150138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb68f5ca-f6c1-4cc2-b4ca-597cad3f2ed6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:08.152600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb68f5ca-f6c1-4cc2-b4ca-597cad3f2ed6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:08.154473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb68f5ca-f6c1-4cc2-b4ca-597cad3f2ed6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:08.166071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:08.328038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-437fadb3-d53a-450e-ad68-76ea5009bf95 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:08.328664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-437fadb3-d53a-450e-ad68-76ea5009bf95 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:08.340095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-437fadb3-d53a-450e-ad68-76ea5009bf95 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:08.340560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-437fadb3-d53a-450e-ad68-76ea5009bf95 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:08.346545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-437fadb3-d53a-450e-ad68-76ea5009bf95 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:08.348301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-437fadb3-d53a-450e-ad68-76ea5009bf95 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:08.561008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-437fadb3-d53a-450e-ad68-76ea5009bf95 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:08.572263 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-437fadb3-d53a-450e-ad68-76ea5009bf95 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe" status: 200 len: 1276 microversion: 2.1 time: 0.247474 May 27 14:58:08.585773 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 189/350] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:08 2022] GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe => generated 1276 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:58:08.614676 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bb68f5ca-f6c1-4cc2-b4ca-597cad3f2ed6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:08.624008 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bb68f5ca-f6c1-4cc2-b4ca-597cad3f2ed6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1474 microversion: 2.1 time: 0.494620 May 27 14:58:08.625755 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 162/351] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:08 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1474 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:08.733512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9a17a56f-8563-42e5-8617-1edc4cb4ddc8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:08.735096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9a17a56f-8563-42e5-8617-1edc4cb4ddc8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:08.743028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a17a56f-8563-42e5-8617-1edc4cb4ddc8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:08.744267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a17a56f-8563-42e5-8617-1edc4cb4ddc8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:08.745380 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a17a56f-8563-42e5-8617-1edc4cb4ddc8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:08.749353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a17a56f-8563-42e5-8617-1edc4cb4ddc8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:08.932281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9a17a56f-8563-42e5-8617-1edc4cb4ddc8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:08.941579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9a17a56f-8563-42e5-8617-1edc4cb4ddc8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:08.943175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9a17a56f-8563-42e5-8617-1edc4cb4ddc8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:08.944461 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9a17a56f-8563-42e5-8617-1edc4cb4ddc8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1567 microversion: 2.25 time: 0.215631 May 27 14:58:08.945109 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 190/352] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:08 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:09.020936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3465e368-a57a-4621-93d9-05c3ebfa9172 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:09.021506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3465e368-a57a-4621-93d9-05c3ebfa9172 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: a3017e23-0753-457e-8f51-8f1586807499] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:09.023817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:UPDATE=2,nova_api:DELETE=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:09.035405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3465e368-a57a-4621-93d9-05c3ebfa9172 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:09.048750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3465e368-a57a-4621-93d9-05c3ebfa9172 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:09.052799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3465e368-a57a-4621-93d9-05c3ebfa9172 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:09.053427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3465e368-a57a-4621-93d9-05c3ebfa9172 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:09.281603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3465e368-a57a-4621-93d9-05c3ebfa9172 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:09.299566 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3465e368-a57a-4621-93d9-05c3ebfa9172 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499" status: 200 len: 1320 microversion: 2.1 time: 0.284370 May 27 14:58:09.300374 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 163/353] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:09 2022] GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499 => generated 1320 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:09.593951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8cddb1b6-18b4-448e-b365-6d134109083d tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:09.594572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8cddb1b6-18b4-448e-b365-6d134109083d tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:09.601818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8cddb1b6-18b4-448e-b365-6d134109083d tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:09.603250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8cddb1b6-18b4-448e-b365-6d134109083d tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:09.604286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8cddb1b6-18b4-448e-b365-6d134109083d tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:09.604930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8cddb1b6-18b4-448e-b365-6d134109083d tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:09.689506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6bb89fcc-9db0-4737-bacc-65dfaa50880e tempest-HypervisorAdminV228Test-1583395338 tempest-HypervisorAdminV228Test-1583395338-project-admin] Calling method '.version_select at 0x7fc7772dd3a0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:09.690844 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:09.690844 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:09.693107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6bb89fcc-9db0-4737-bacc-65dfaa50880e tempest-HypervisorAdminV228Test-1583395338 tempest-HypervisorAdminV228Test-1583395338-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:09.693865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6bb89fcc-9db0-4737-bacc-65dfaa50880e tempest-HypervisorAdminV228Test-1583395338 tempest-HypervisorAdminV228Test-1583395338-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:09.725085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6bb89fcc-9db0-4737-bacc-65dfaa50880e tempest-HypervisorAdminV228Test-1583395338 tempest-HypervisorAdminV228Test-1583395338-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:09.726691 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6bb89fcc-9db0-4737-bacc-65dfaa50880e tempest-HypervisorAdminV228Test-1583395338 tempest-HypervisorAdminV228Test-1583395338-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:09.753857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6bb89fcc-9db0-4737-bacc-65dfaa50880e tempest-HypervisorAdminV228Test-1583395338 tempest-HypervisorAdminV228Test-1583395338-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:09.754474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6bb89fcc-9db0-4737-bacc-65dfaa50880e tempest-HypervisorAdminV228Test-1583395338 tempest-HypervisorAdminV228Test-1583395338-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:09.780318 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6bb89fcc-9db0-4737-bacc-65dfaa50880e tempest-HypervisorAdminV228Test-1583395338 tempest-HypervisorAdminV228Test-1583395338-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.493007 May 27 14:58:09.782962 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 191/354] 10.222.0.13 () {60 vars in 1186 bytes} [Fri May 27 14:58:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:58:09.795701 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5689db01-c663-4ef3-a586-75a5490b5257 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:09.797813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5689db01-c663-4ef3-a586-75a5490b5257 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:09.814384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5689db01-c663-4ef3-a586-75a5490b5257 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:09.815745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5689db01-c663-4ef3-a586-75a5490b5257 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:09.816895 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5689db01-c663-4ef3-a586-75a5490b5257 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:09.819174 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5689db01-c663-4ef3-a586-75a5490b5257 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:09.880452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8cddb1b6-18b4-448e-b365-6d134109083d tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:09.893275 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8cddb1b6-18b4-448e-b365-6d134109083d tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe" status: 200 len: 1318 microversion: 2.1 time: 0.304752 May 27 14:58:09.894405 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 164/355] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:09 2022] GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:58:09.930259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d7826c1a-1dbc-4887-8310-318bbd5f5ef3 tempest-HypervisorAdminV228Test-1583395338 tempest-HypervisorAdminV228Test-1583395338-project-admin] Calling method '.version_select at 0x7fc77733eb80>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:09.936319 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:09.936319 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:09.941008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d7826c1a-1dbc-4887-8310-318bbd5f5ef3 tempest-HypervisorAdminV228Test-1583395338 tempest-HypervisorAdminV228Test-1583395338-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:09.942408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d7826c1a-1dbc-4887-8310-318bbd5f5ef3 tempest-HypervisorAdminV228Test-1583395338 tempest-HypervisorAdminV228Test-1583395338-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:09.982407 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d7826c1a-1dbc-4887-8310-318bbd5f5ef3 tempest-HypervisorAdminV228Test-1583395338 tempest-HypervisorAdminV228Test-1583395338-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:09.983464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d7826c1a-1dbc-4887-8310-318bbd5f5ef3 tempest-HypervisorAdminV228Test-1583395338 tempest-HypervisorAdminV228Test-1583395338-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:10.001684 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d7826c1a-1dbc-4887-8310-318bbd5f5ef3 tempest-HypervisorAdminV228Test-1583395338 tempest-HypervisorAdminV228Test-1583395338-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.105886 May 27 14:58:10.004079 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 165/356] 10.222.0.13 () {60 vars in 1192 bytes} [Fri May 27 14:58:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:58:10.122804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5689db01-c663-4ef3-a586-75a5490b5257 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:10.132934 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5689db01-c663-4ef3-a586-75a5490b5257 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1474 microversion: 2.1 time: 0.348644 May 27 14:58:10.136081 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 192/357] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:09 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1474 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:10.155058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-a7745d67-9215-41ca-90ed-1c30922baade req-0ff1ecbd-cac2-4dd0-a000-50a8e027d6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcd481fb-2d54-4881-a697-db93d9623fbe", "tag": "66fc9523-073d-433b-8731-d04dec899a9e"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:10.168768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-a7745d67-9215-41ca-90ed-1c30922baade req-0ff1ecbd-cac2-4dd0-a000-50a8e027d6f4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:10.173277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-a7745d67-9215-41ca-90ed-1c30922baade req-0ff1ecbd-cac2-4dd0-a000-50a8e027d6f4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:10.194993 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-a7745d67-9215-41ca-90ed-1c30922baade req-0ff1ecbd-cac2-4dd0-a000-50a8e027d6f4 service nova] Creating event network-changed:66fc9523-073d-433b-8731-d04dec899a9e for instance dcd481fb-2d54-4881-a697-db93d9623fbe on n-h1-843621-1 May 27 14:58:10.208384 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-a7745d67-9215-41ca-90ed-1c30922baade req-0ff1ecbd-cac2-4dd0-a000-50a8e027d6f4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069582 May 27 14:58:10.210972 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 193/358] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:10.219291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cf4b26cc-404e-461e-9b2d-351ba7f4b5fc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:10.220280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cf4b26cc-404e-461e-9b2d-351ba7f4b5fc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:10.231491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cf4b26cc-404e-461e-9b2d-351ba7f4b5fc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:10.232579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cf4b26cc-404e-461e-9b2d-351ba7f4b5fc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:10.234071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cf4b26cc-404e-461e-9b2d-351ba7f4b5fc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:10.234711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cf4b26cc-404e-461e-9b2d-351ba7f4b5fc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:10.428641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ddac1667-145e-41f1-9fda-948633c7782e tempest-AZAdminNegativeTestJSON-907686221 tempest-AZAdminNegativeTestJSON-907686221-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:10.430414 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:10.430414 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:10.432330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ddac1667-145e-41f1-9fda-948633c7782e tempest-AZAdminNegativeTestJSON-907686221 tempest-AZAdminNegativeTestJSON-907686221-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '4dbcf3db6cea43ca9d665efe7be9f193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f74afb3d81c40c0904832fad631aecb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ddac1667-145e-41f1-9fda-948633c7782e tempest-AZAdminNegativeTestJSON-907686221 tempest-AZAdminNegativeTestJSON-907686221-project] Request method failure captured: May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOb_C-888Zy2WRWG9O_P85XwNMqmwIdULqOTTsJSa1Tt46xJM3v8Z-B--tuGG9cN118FuBeX4ALRhl4EIl9wgC_5ovExGQzCqvSMK7uwFmLLwJCaVzxhJnSPQ68FFpvKe-XAb15xJz44UlDmuHvYzN-hPnDPCZzfxPvPfxb-wNiYQSk May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 3f74afb3d81c40c0904832fad631aecb May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-AZAdminNegativeTestJSON-907686221 May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:58:10.434674 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:58:10.436015 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3f74afb3d81c40c0904832fad631aecb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3f74afb3d81c40c0904832fad631aecb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3f74afb3d81c40c0904832fad631aecb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3f74afb3d81c40c0904832fad631aecb", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:10.436015 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-AZAdminNegativeTestJSON-907686221 May 27 14:58:10.436015 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 3f74afb3d81c40c0904832fad631aecb May 27 14:58:10.436015 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-907686221 May 27 14:58:10.436015 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-AZAdminNegativeTestJSON-907686221-project May 27 14:58:10.436015 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:10.436015 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:10.436015 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 4dbcf3db6cea43ca9d665efe7be9f193 May 27 14:58:10.436015 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-AZAdminNegativeTestJSON-907686221-project May 27 14:58:10.436015 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 14:58:10.436015 n-d-843621-1 devstack@n-api.service[119249]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 27 14:58:10.436015 n-d-843621-1 devstack@n-api.service[119249]: action_args: {} May 27 14:58:10.436847 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:10.436847 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:10.436847 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:10.436847 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:10.436847 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:10.436847 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:10.436847 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:10.436847 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:10.436847 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail May 27 14:58:10.436847 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) May 27 14:58:10.436847 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:58:10.436847 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:58:10.436847 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:58:10.436847 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:58:10.436847 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:10.436847 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:10.436847 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:10.436847 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:10.436847 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:58:10.437942 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:58:10.437942 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:58:10.437942 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:58:10.437942 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:58:10.437942 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:58:10.437942 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 27 14:58:10.437942 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:10.437942 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:10.437942 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:10.437942 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:10.437942 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:10.437942 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:10.437942 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:58:10.437942 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:58:10.437942 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 27 14:58:10.437942 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:10.440110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ddac1667-145e-41f1-9fda-948633c7782e tempest-AZAdminNegativeTestJSON-907686221 tempest-AZAdminNegativeTestJSON-907686221-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:10.441738 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ddac1667-145e-41f1-9fda-948633c7782e tempest-AZAdminNegativeTestJSON-907686221 tempest-AZAdminNegativeTestJSON-907686221-project] 10.222.0.13 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.420515 May 27 14:58:10.451883 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 166/359] 10.222.0.13 () {58 vars in 1184 bytes} [Fri May 27 14:58:10 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 430 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:10.451978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cf4b26cc-404e-461e-9b2d-351ba7f4b5fc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:10.453728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-67624708-c9bf-49fa-9d18-d80ed39c6f59 req-f397d5ea-09de-42a2-8faa-55b2bd3850b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3017e23-0753-457e-8f51-8f1586807499", "name": "network-vif-plugged", "status": "completed", "tag": "b8a6a96c-7199-4f1c-b267-e54b0266f9f9"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:10.455316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:10.464296 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-67624708-c9bf-49fa-9d18-d80ed39c6f59 req-f397d5ea-09de-42a2-8faa-55b2bd3850b8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:10.464993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-67624708-c9bf-49fa-9d18-d80ed39c6f59 req-f397d5ea-09de-42a2-8faa-55b2bd3850b8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:10.467816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cf4b26cc-404e-461e-9b2d-351ba7f4b5fc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:10.472152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cf4b26cc-404e-461e-9b2d-351ba7f4b5fc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:10.473446 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cf4b26cc-404e-461e-9b2d-351ba7f4b5fc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1567 microversion: 2.25 time: 0.259730 May 27 14:58:10.474514 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 194/360] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:10 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:10.489040 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-67624708-c9bf-49fa-9d18-d80ed39c6f59 req-f397d5ea-09de-42a2-8faa-55b2bd3850b8 service nova] Creating event network-vif-plugged:b8a6a96c-7199-4f1c-b267-e54b0266f9f9 for instance a3017e23-0753-457e-8f51-8f1586807499 on n-h2-843621-1 May 27 14:58:10.489416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-76d75dd0-d91b-49e9-9d5b-3697f2879793 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:10.490035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-76d75dd0-d91b-49e9-9d5b-3697f2879793 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: a3017e23-0753-457e-8f51-8f1586807499] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:10.496924 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-67624708-c9bf-49fa-9d18-d80ed39c6f59 req-f397d5ea-09de-42a2-8faa-55b2bd3850b8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047379 May 27 14:58:10.498144 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 167/361] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:10.505947 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-76d75dd0-d91b-49e9-9d5b-3697f2879793 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:10.506268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-76d75dd0-d91b-49e9-9d5b-3697f2879793 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:10.507479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-76d75dd0-d91b-49e9-9d5b-3697f2879793 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:10.507827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-76d75dd0-d91b-49e9-9d5b-3697f2879793 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:10.680063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-76d75dd0-d91b-49e9-9d5b-3697f2879793 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:10.692859 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-76d75dd0-d91b-49e9-9d5b-3697f2879793 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499" status: 200 len: 1320 microversion: 2.1 time: 0.216031 May 27 14:58:10.693875 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 195/362] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:10 2022] GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499 => generated 1320 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:10.911837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e787a9ec-dcd4-4657-b6aa-52e26d84a1e5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:10.912993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e787a9ec-dcd4-4657-b6aa-52e26d84a1e5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:10.920469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e787a9ec-dcd4-4657-b6aa-52e26d84a1e5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:10.921178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e787a9ec-dcd4-4657-b6aa-52e26d84a1e5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:10.922112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e787a9ec-dcd4-4657-b6aa-52e26d84a1e5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:10.922824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e787a9ec-dcd4-4657-b6aa-52e26d84a1e5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:11.155700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a63f2998-b764-4d71-83f2-f1c0bed86884 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:11.156399 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a63f2998-b764-4d71-83f2-f1c0bed86884 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:11.171531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a63f2998-b764-4d71-83f2-f1c0bed86884 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:11.176833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a63f2998-b764-4d71-83f2-f1c0bed86884 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:11.177744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a63f2998-b764-4d71-83f2-f1c0bed86884 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:11.178208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a63f2998-b764-4d71-83f2-f1c0bed86884 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:11.186076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e787a9ec-dcd4-4657-b6aa-52e26d84a1e5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:11.200089 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e787a9ec-dcd4-4657-b6aa-52e26d84a1e5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe" status: 200 len: 1318 microversion: 2.1 time: 0.292328 May 27 14:58:11.201853 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 168/363] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:10 2022] GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:11.428537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a63f2998-b764-4d71-83f2-f1c0bed86884 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:11.450396 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a63f2998-b764-4d71-83f2-f1c0bed86884 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1474 microversion: 2.1 time: 0.301750 May 27 14:58:11.453787 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 196/364] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:11 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1474 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:11.494114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6b21eb0d-0998-4d18-abe4-4a10b4a77749 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:11.495348 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6b21eb0d-0998-4d18-abe4-4a10b4a77749 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:11.504611 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b21eb0d-0998-4d18-abe4-4a10b4a77749 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:11.505466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b21eb0d-0998-4d18-abe4-4a10b4a77749 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:11.506813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b21eb0d-0998-4d18-abe4-4a10b4a77749 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:11.507429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b21eb0d-0998-4d18-abe4-4a10b4a77749 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:11.710717 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-45316e16-2b1e-4ee8-b164-759f6102882e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:11.712367 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-45316e16-2b1e-4ee8-b164-759f6102882e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: a3017e23-0753-457e-8f51-8f1586807499] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:11.725805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45316e16-2b1e-4ee8-b164-759f6102882e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:11.726261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45316e16-2b1e-4ee8-b164-759f6102882e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:11.727039 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45316e16-2b1e-4ee8-b164-759f6102882e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:11.727513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45316e16-2b1e-4ee8-b164-759f6102882e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:11.755398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=10 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:11.809476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6b21eb0d-0998-4d18-abe4-4a10b4a77749 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:11.819392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6b21eb0d-0998-4d18-abe4-4a10b4a77749 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:11.822310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6b21eb0d-0998-4d18-abe4-4a10b4a77749 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:11.825410 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6b21eb0d-0998-4d18-abe4-4a10b4a77749 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1567 microversion: 2.25 time: 0.337119 May 27 14:58:11.836797 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 169/365] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:11 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1567 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:11.984917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-45316e16-2b1e-4ee8-b164-759f6102882e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:11.995461 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-45316e16-2b1e-4ee8-b164-759f6102882e tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499" status: 200 len: 1320 microversion: 2.1 time: 0.287563 May 27 14:58:11.996621 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 197/366] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:11 2022] GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499 => generated 1320 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:12.217758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-96bb9ea2-ecf6-4700-ab31-4e5467d1f937 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:12.218631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-96bb9ea2-ecf6-4700-ab31-4e5467d1f937 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:12.230831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96bb9ea2-ecf6-4700-ab31-4e5467d1f937 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:12.231334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96bb9ea2-ecf6-4700-ab31-4e5467d1f937 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:12.232160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96bb9ea2-ecf6-4700-ab31-4e5467d1f937 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:12.232629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96bb9ea2-ecf6-4700-ab31-4e5467d1f937 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:12.472997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eb11cd3c-0bb1-4f5e-8635-12102651d8b6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:12.472997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-eb11cd3c-0bb1-4f5e-8635-12102651d8b6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:12.478363 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb11cd3c-0bb1-4f5e-8635-12102651d8b6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:12.478791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb11cd3c-0bb1-4f5e-8635-12102651d8b6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:12.479602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb11cd3c-0bb1-4f5e-8635-12102651d8b6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:12.480217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb11cd3c-0bb1-4f5e-8635-12102651d8b6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:12.609238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-96bb9ea2-ecf6-4700-ab31-4e5467d1f937 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:12.617234 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-96bb9ea2-ecf6-4700-ab31-4e5467d1f937 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe" status: 200 len: 1318 microversion: 2.1 time: 0.403190 May 27 14:58:12.618162 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 170/367] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:12 2022] GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:12.776006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eb11cd3c-0bb1-4f5e-8635-12102651d8b6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:12.788422 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-eb11cd3c-0bb1-4f5e-8635-12102651d8b6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1474 microversion: 2.1 time: 0.321657 May 27 14:58:12.800830 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 198/368] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:12 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1474 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:12.844357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a574010b-81f4-4553-a249-2fb86fdd6e0f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:12.845060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a574010b-81f4-4553-a249-2fb86fdd6e0f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:12.856838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a574010b-81f4-4553-a249-2fb86fdd6e0f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:12.857565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a574010b-81f4-4553-a249-2fb86fdd6e0f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:12.866527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a574010b-81f4-4553-a249-2fb86fdd6e0f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:12.868108 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a574010b-81f4-4553-a249-2fb86fdd6e0f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:13.013393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-627a0aac-5c9a-4fbf-a473-4055a1bacbb3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:13.014009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-627a0aac-5c9a-4fbf-a473-4055a1bacbb3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: a3017e23-0753-457e-8f51-8f1586807499] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:13.025091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-627a0aac-5c9a-4fbf-a473-4055a1bacbb3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:13.028099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-627a0aac-5c9a-4fbf-a473-4055a1bacbb3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:13.029178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-627a0aac-5c9a-4fbf-a473-4055a1bacbb3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:13.030202 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-627a0aac-5c9a-4fbf-a473-4055a1bacbb3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:13.330663 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a574010b-81f4-4553-a249-2fb86fdd6e0f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:13.341273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a574010b-81f4-4553-a249-2fb86fdd6e0f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:13.349356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a574010b-81f4-4553-a249-2fb86fdd6e0f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:13.351043 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a574010b-81f4-4553-a249-2fb86fdd6e0f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1567 microversion: 2.25 time: 0.510747 May 27 14:58:13.352421 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 171/369] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:12 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1567 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:13.483247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-627a0aac-5c9a-4fbf-a473-4055a1bacbb3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:13.491038 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-627a0aac-5c9a-4fbf-a473-4055a1bacbb3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499" status: 200 len: 1470 microversion: 2.1 time: 0.482299 May 27 14:58:13.491631 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 199/370] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:13 2022] GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499 => generated 1470 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:58:13.509220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d9434e3f-1d18-4fa0-bff0-f65ccf247027 tempest-DeleteServersAdminTestJSON-1392015186 tempest-DeleteServersAdminTestJSON-1392015186-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:13.510399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d9434e3f-1d18-4fa0-bff0-f65ccf247027 tempest-DeleteServersAdminTestJSON-1392015186 tempest-DeleteServersAdminTestJSON-1392015186-project-admin] [instance: a3017e23-0753-457e-8f51-8f1586807499] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:13.521912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9434e3f-1d18-4fa0-bff0-f65ccf247027 tempest-DeleteServersAdminTestJSON-1392015186 tempest-DeleteServersAdminTestJSON-1392015186-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:13.522331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9434e3f-1d18-4fa0-bff0-f65ccf247027 tempest-DeleteServersAdminTestJSON-1392015186 tempest-DeleteServersAdminTestJSON-1392015186-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:13.523404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9434e3f-1d18-4fa0-bff0-f65ccf247027 tempest-DeleteServersAdminTestJSON-1392015186 tempest-DeleteServersAdminTestJSON-1392015186-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:13.524277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9434e3f-1d18-4fa0-bff0-f65ccf247027 tempest-DeleteServersAdminTestJSON-1392015186 tempest-DeleteServersAdminTestJSON-1392015186-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:13.634854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-838a0314-3210-41f7-b8c4-099f712d4a8f tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:13.635481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-838a0314-3210-41f7-b8c4-099f712d4a8f tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:13.643842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-838a0314-3210-41f7-b8c4-099f712d4a8f tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:13.644297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-838a0314-3210-41f7-b8c4-099f712d4a8f tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:13.648163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-838a0314-3210-41f7-b8c4-099f712d4a8f tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:13.651763 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-838a0314-3210-41f7-b8c4-099f712d4a8f tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:13.679091 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d9434e3f-1d18-4fa0-bff0-f65ccf247027 tempest-DeleteServersAdminTestJSON-1392015186 tempest-DeleteServersAdminTestJSON-1392015186-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499/action" status: 202 len: 0 microversion: 2.1 time: 0.174970 May 27 14:58:13.683111 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 172/371] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 14:58:13 2022] POST /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:58:13.688441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6288affa-e3fb-416b-9329-755bb8a44a35 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:13.689074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6288affa-e3fb-416b-9329-755bb8a44a35 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: a3017e23-0753-457e-8f51-8f1586807499] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:13.699476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6288affa-e3fb-416b-9329-755bb8a44a35 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:13.701205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6288affa-e3fb-416b-9329-755bb8a44a35 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:13.702985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6288affa-e3fb-416b-9329-755bb8a44a35 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:13.704807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6288affa-e3fb-416b-9329-755bb8a44a35 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:13.758012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6288affa-e3fb-416b-9329-755bb8a44a35 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:13.759414 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6288affa-e3fb-416b-9329-755bb8a44a35 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:13.760547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-6288affa-e3fb-416b-9329-755bb8a44a35 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lazy-loading 'fault' on Instance uuid a3017e23-0753-457e-8f51-8f1586807499 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:58:14.589100 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6288affa-e3fb-416b-9329-755bb8a44a35 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:14.597923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-838a0314-3210-41f7-b8c4-099f712d4a8f tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:14.601650 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6288affa-e3fb-416b-9329-755bb8a44a35 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499" status: 200 len: 1453 microversion: 2.1 time: 0.917004 May 27 14:58:14.602822 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 173/372] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:13 2022] GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499 => generated 1453 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:58:14.614712 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-838a0314-3210-41f7-b8c4-099f712d4a8f tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe" status: 200 len: 1318 microversion: 2.1 time: 0.983579 May 27 14:58:14.615539 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 200/373] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:13 2022] GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe => generated 1318 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:58:14.623496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0447409c-0a82-408a-836d-ac5408c2d60f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:14.623496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0447409c-0a82-408a-836d-ac5408c2d60f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:14.626535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-39c5829d-95a9-41c6-963b-1a175b107743 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:14.627209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-39c5829d-95a9-41c6-963b-1a175b107743 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:14.633642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0447409c-0a82-408a-836d-ac5408c2d60f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:14.635185 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0447409c-0a82-408a-836d-ac5408c2d60f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:14.636234 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0447409c-0a82-408a-836d-ac5408c2d60f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:14.636916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0447409c-0a82-408a-836d-ac5408c2d60f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:14.645916 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39c5829d-95a9-41c6-963b-1a175b107743 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:14.647174 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39c5829d-95a9-41c6-963b-1a175b107743 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:14.650122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39c5829d-95a9-41c6-963b-1a175b107743 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:14.650591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39c5829d-95a9-41c6-963b-1a175b107743 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:15.064812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0447409c-0a82-408a-836d-ac5408c2d60f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:15.072320 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0447409c-0a82-408a-836d-ac5408c2d60f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1474 microversion: 2.1 time: 0.468179 May 27 14:58:15.072908 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 174/374] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:14 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1474 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:15.085386 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-39c5829d-95a9-41c6-963b-1a175b107743 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:15.089235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7897eb9e-5bc1-4711-b10d-464ce5cbaae3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:15.090038 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7897eb9e-5bc1-4711-b10d-464ce5cbaae3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: a3017e23-0753-457e-8f51-8f1586807499] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:15.094215 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-39c5829d-95a9-41c6-963b-1a175b107743 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:15.095740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-39c5829d-95a9-41c6-963b-1a175b107743 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:15.098335 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7897eb9e-5bc1-4711-b10d-464ce5cbaae3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:15.099060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7897eb9e-5bc1-4711-b10d-464ce5cbaae3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:15.100306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7897eb9e-5bc1-4711-b10d-464ce5cbaae3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:15.101152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7897eb9e-5bc1-4711-b10d-464ce5cbaae3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:15.109213 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-39c5829d-95a9-41c6-963b-1a175b107743 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1567 microversion: 2.25 time: 0.490708 May 27 14:58:15.110488 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 201/375] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:14 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1567 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:15.154774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7897eb9e-5bc1-4711-b10d-464ce5cbaae3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: a3017e23-0753-457e-8f51-8f1586807499] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 14:58:15.303833 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7897eb9e-5bc1-4711-b10d-464ce5cbaae3 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499" status: 204 len: 0 microversion: 2.1 time: 0.221472 May 27 14:58:15.305770 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 175/376] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 14:58:15 2022] DELETE /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 14:58:15.314698 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-77758bd9-aa83-4258-a77e-41bef5518c71 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:15.315330 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-77758bd9-aa83-4258-a77e-41bef5518c71 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: a3017e23-0753-457e-8f51-8f1586807499] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:15.324604 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77758bd9-aa83-4258-a77e-41bef5518c71 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:15.326092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77758bd9-aa83-4258-a77e-41bef5518c71 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:15.327323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77758bd9-aa83-4258-a77e-41bef5518c71 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:15.327783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77758bd9-aa83-4258-a77e-41bef5518c71 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:15.411555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77758bd9-aa83-4258-a77e-41bef5518c71 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:15.412036 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77758bd9-aa83-4258-a77e-41bef5518c71 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:15.412752 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-77758bd9-aa83-4258-a77e-41bef5518c71 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lazy-loading 'fault' on Instance uuid a3017e23-0753-457e-8f51-8f1586807499 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:58:15.643997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0a20df4d-9dd0-4952-a060-2e949f2265d0 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:15.646036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0a20df4d-9dd0-4952-a060-2e949f2265d0 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:15.666193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a20df4d-9dd0-4952-a060-2e949f2265d0 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:15.666839 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a20df4d-9dd0-4952-a060-2e949f2265d0 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:15.667942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a20df4d-9dd0-4952-a060-2e949f2265d0 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:15.668545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a20df4d-9dd0-4952-a060-2e949f2265d0 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:15.936494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:15.948892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-77758bd9-aa83-4258-a77e-41bef5518c71 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:15.957784 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-77758bd9-aa83-4258-a77e-41bef5518c71 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499" status: 200 len: 1459 microversion: 2.1 time: 0.647494 May 27 14:58:15.958499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=8 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:15.966514 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 202/377] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:15 2022] GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499 => generated 1459 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:16.089957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cb3fbf07-49d1-4ddb-9ca7-f844d4f6c106 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:16.090771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cb3fbf07-49d1-4ddb-9ca7-f844d4f6c106 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:16.102017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb3fbf07-49d1-4ddb-9ca7-f844d4f6c106 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:16.102525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb3fbf07-49d1-4ddb-9ca7-f844d4f6c106 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:16.103328 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb3fbf07-49d1-4ddb-9ca7-f844d4f6c106 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:16.103777 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb3fbf07-49d1-4ddb-9ca7-f844d4f6c106 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:16.147071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=8 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:16.226672 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0a20df4d-9dd0-4952-a060-2e949f2265d0 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:16.243769 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0a20df4d-9dd0-4952-a060-2e949f2265d0 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe" status: 200 len: 1318 microversion: 2.1 time: 0.611786 May 27 14:58:16.257792 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 176/378] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:15 2022] GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:16.265860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-99cead4d-b3ed-4c36-ba37-8a7f430d69b0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:16.267945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-99cead4d-b3ed-4c36-ba37-8a7f430d69b0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:16.278538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99cead4d-b3ed-4c36-ba37-8a7f430d69b0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:16.280337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99cead4d-b3ed-4c36-ba37-8a7f430d69b0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:16.281406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99cead4d-b3ed-4c36-ba37-8a7f430d69b0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:16.282260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99cead4d-b3ed-4c36-ba37-8a7f430d69b0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:16.314518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:16.466330 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cb3fbf07-49d1-4ddb-9ca7-f844d4f6c106 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:16.476513 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cb3fbf07-49d1-4ddb-9ca7-f844d4f6c106 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1474 microversion: 2.1 time: 0.391037 May 27 14:58:16.477146 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 203/379] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:16 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1474 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:58:16.906710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-de6c704c-3026-4a45-ae5c-7f7d03cd1608 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Calling method '.version_select at 0x7fc777155940>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:16.907597 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:16.907597 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:16.908792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de6c704c-3026-4a45-ae5c-7f7d03cd1608 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:16.909517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de6c704c-3026-4a45-ae5c-7f7d03cd1608 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:16.923913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-99cead4d-b3ed-4c36-ba37-8a7f430d69b0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:16.926550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de6c704c-3026-4a45-ae5c-7f7d03cd1608 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:16.927262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de6c704c-3026-4a45-ae5c-7f7d03cd1608 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:16.934129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-99cead4d-b3ed-4c36-ba37-8a7f430d69b0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:16.936095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-99cead4d-b3ed-4c36-ba37-8a7f430d69b0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:16.937939 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-99cead4d-b3ed-4c36-ba37-8a7f430d69b0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1567 microversion: 2.25 time: 0.678335 May 27 14:58:16.939319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de6c704c-3026-4a45-ae5c-7f7d03cd1608 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:16.940025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de6c704c-3026-4a45-ae5c-7f7d03cd1608 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:16.947143 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-de6c704c-3026-4a45-ae5c-7f7d03cd1608 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.421364 May 27 14:58:16.947811 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 204/380] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:58:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 14:58:16.949302 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 177/381] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:16 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1567 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:17.015351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e71deb1c-a9b8-46f5-adb1-ec7dfa34f467 tempest-FlavorsAccessTestJSON-1339631349 tempest-FlavorsAccessTestJSON-1339631349-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-477853104", "id": 850308625, "os-flavor-access:is_public": "False"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:17.016946 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:17.016946 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:17.031009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5d7bf512-c936-45a9-ac36-566de7d80af0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1496417063", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:17.038354 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e71deb1c-a9b8-46f5-adb1-ec7dfa34f467 tempest-FlavorsAccessTestJSON-1339631349 tempest-FlavorsAccessTestJSON-1339631349-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.089255 May 27 14:58:17.039087 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 205/382] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:58:16 2022] POST /compute/v2.1/flavors => generated 427 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:17.101662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-5d7bf512-c936-45a9-ac36-566de7d80af0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] validate_networks() for None {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 14:58:17.217691 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e10c49c7-6e82-455f-a6c3-3a226ac3b08d tempest-HypervisorAdminNegativeUnderV252Test-395653941 tempest-HypervisorAdminNegativeUnderV252Test-395653941-project] Calling method '.version_select at 0x7fc777222310>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:17.220392 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:17.220392 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:17.221925 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e10c49c7-6e82-455f-a6c3-3a226ac3b08d tempest-HypervisorAdminNegativeUnderV252Test-395653941 tempest-HypervisorAdminNegativeUnderV252Test-395653941-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'd035467bfbee4403b3202d747c3b2b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a691e97db034458a531997643bce057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e10c49c7-6e82-455f-a6c3-3a226ac3b08d tempest-HypervisorAdminNegativeUnderV252Test-395653941 tempest-HypervisorAdminNegativeUnderV252Test-395653941-project] Request method failure captured: May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-hypervisors/n-h2-843621-1/search HTTP/1.1 May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOcGAuRGAOyoO_uM_6hsFaf5xpcW01J3TRGrJ1NhjdfqMgBzXZ8oS3CYiQ2WnnHlyzYG02lrz_oiAuE6Hs-3O3XMQ6gKwK04tamrqq7IouD6-ZX6mQ0hnLLquX_gIl26BPGYg0H5nIRfuSyt-wcIHaqkrITWgwHk1UG3yEn1OIi4C3E May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 1a691e97db034458a531997643bce057 May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-395653941 May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:58:17.225354 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:58:17.226621 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1a691e97db034458a531997643bce057"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1a691e97db034458a531997643bce057"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1a691e97db034458a531997643bce057"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1a691e97db034458a531997643bce057", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:17.226621 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-395653941 May 27 14:58:17.226621 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 1a691e97db034458a531997643bce057 May 27 14:58:17.226621 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-395653941 May 27 14:58:17.226621 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-395653941-project May 27 14:58:17.226621 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:17.226621 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:17.226621 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: d035467bfbee4403b3202d747c3b2b60 May 27 14:58:17.226621 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-395653941-project May 27 14:58:17.226621 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 14:58:17.226621 n-d-843621-1 devstack@n-api.service[119248]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 27 14:58:17.226621 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'n-h2-843621-1'} May 27 14:58:17.227516 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:17.227516 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:17.227516 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:17.227516 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:17.227516 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:17.227516 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:17.227516 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:17.227516 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:17.227516 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:17.227516 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:17.227516 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search May 27 14:58:17.227516 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) May 27 14:58:17.227516 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:58:17.227516 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:58:17.227516 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:58:17.227516 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:58:17.227516 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:17.227516 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:17.227516 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:17.228798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:17.228798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:58:17.228798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:58:17.228798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:58:17.228798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:58:17.228798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:58:17.228798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:58:17.228798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 27 14:58:17.228798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:17.228798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:17.228798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:17.228798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:17.228798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:17.228798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:17.228798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:58:17.228798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:58:17.228798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 27 14:58:17.228798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:17.232385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e10c49c7-6e82-455f-a6c3-3a226ac3b08d tempest-HypervisorAdminNegativeUnderV252Test-395653941 tempest-HypervisorAdminNegativeUnderV252Test-395653941-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:17.233717 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e10c49c7-6e82-455f-a6c3-3a226ac3b08d tempest-HypervisorAdminNegativeUnderV252Test-395653941 tempest-HypervisorAdminNegativeUnderV252Test-395653941-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/n-h2-843621-1/search" status: 403 len: 117 microversion: 2.1 time: 0.192837 May 27 14:58:17.234729 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 206/383] 10.222.0.13 () {58 vars in 1208 bytes} [Fri May 27 14:58:17 2022] GET /compute/v2.1/os-hypervisors/n-h2-843621-1/search => generated 117 bytes in 195 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:17.240355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9c0b5d0c-f8d9-445a-b63f-7fe080dc7561 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:17.242198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9c0b5d0c-f8d9-445a-b63f-7fe080dc7561 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: a3017e23-0753-457e-8f51-8f1586807499] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:17.246972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:17.250897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c0b5d0c-f8d9-445a-b63f-7fe080dc7561 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:17.253358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c0b5d0c-f8d9-445a-b63f-7fe080dc7561 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:17.254357 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c0b5d0c-f8d9-445a-b63f-7fe080dc7561 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:17.254971 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c0b5d0c-f8d9-445a-b63f-7fe080dc7561 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:17.303364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c0b5d0c-f8d9-445a-b63f-7fe080dc7561 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:17.304751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c0b5d0c-f8d9-445a-b63f-7fe080dc7561 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:17.305478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-9c0b5d0c-f8d9-445a-b63f-7fe080dc7561 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lazy-loading 'fault' on Instance uuid a3017e23-0753-457e-8f51-8f1586807499 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:58:17.437133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9c0b5d0c-f8d9-445a-b63f-7fe080dc7561 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7349483c684d7aa73c85844d1fda97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016d7f67e1704dc888371aa43be736e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:17.447611 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9c0b5d0c-f8d9-445a-b63f-7fe080dc7561 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499" status: 200 len: 1417 microversion: 2.1 time: 0.211067 May 27 14:58:17.448187 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 207/384] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:17 2022] GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499 => generated 1417 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:17.454503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4bd4910c-c6b0-4b3d-9293-da2d0198921f tempest-FlavorsAccessTestJSON-1339631349 tempest-FlavorsAccessTestJSON-1339631349-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7838b0f896db414aa635146cc7ebbd7d"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:17.455931 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:17.455931 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:17.551888 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4bd4910c-c6b0-4b3d-9293-da2d0198921f tempest-FlavorsAccessTestJSON-1339631349 tempest-FlavorsAccessTestJSON-1339631349-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/850308625/action" status: 200 len: 96 microversion: 2.1 time: 0.102086 May 27 14:58:17.552639 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 208/385] 10.222.0.13 () {60 vars in 1196 bytes} [Fri May 27 14:58:17 2022] POST /compute/v2.1/flavors/850308625/action => generated 96 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 14:58:17.558249 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-e67c0d5b-f2ed-45e7-a6f4-3aff36094bee req-b5015cc9-a61a-48e0-b5ac-18f3cca9ee47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3017e23-0753-457e-8f51-8f1586807499", "name": "network-vif-deleted", "tag": "b8a6a96c-7199-4f1c-b267-e54b0266f9f9"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:17.568076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e67c0d5b-f2ed-45e7-a6f4-3aff36094bee req-b5015cc9-a61a-48e0-b5ac-18f3cca9ee47 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:17.568538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e67c0d5b-f2ed-45e7-a6f4-3aff36094bee req-b5015cc9-a61a-48e0-b5ac-18f3cca9ee47 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:17.579915 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-e67c0d5b-f2ed-45e7-a6f4-3aff36094bee req-b5015cc9-a61a-48e0-b5ac-18f3cca9ee47 service nova] Creating event network-vif-deleted:b8a6a96c-7199-4f1c-b267-e54b0266f9f9 for instance a3017e23-0753-457e-8f51-8f1586807499 on n-h2-843621-1 May 27 14:58:17.585234 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-e67c0d5b-f2ed-45e7-a6f4-3aff36094bee req-b5015cc9-a61a-48e0-b5ac-18f3cca9ee47 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031294 May 27 14:58:17.585831 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 209/386] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:17.593138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eba9783e-fc28-4f5b-ab5e-1f3bfcdcf4ba tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Calling method '.version_select at 0x7fc777222ee0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:17.594232 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:17.594232 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:17.595537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eba9783e-fc28-4f5b-ab5e-1f3bfcdcf4ba tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:17.596012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eba9783e-fc28-4f5b-ab5e-1f3bfcdcf4ba tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:17.605354 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-eba9783e-fc28-4f5b-ab5e-1f3bfcdcf4ba tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eba9783e-fc28-4f5b-ab5e-1f3bfcdcf4ba tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Request method failure captured: May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOcIjOB4xaREp6M9GgeOF9vxKfTIzCx8nNtYjARV0OweL9bjBv1abPqBpRMEQptYXfT3byj_gXVDub4BUOjHvJu6_iFiGxTU3uHgXltIcFsq4wxgcTraSonNlRJWtyVsucdMxnlGOiZeQQGiJpd90APfEqRk68hkhd40r7M3_Djw61g May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 6e545983fb344964bf99aedf2849b3d2 May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-202217145 May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:58:17.607611 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:58:17.609561 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6e545983fb344964bf99aedf2849b3d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6e545983fb344964bf99aedf2849b3d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6e545983fb344964bf99aedf2849b3d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6e545983fb344964bf99aedf2849b3d2", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:17.609561 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-202217145 May 27 14:58:17.609561 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 6e545983fb344964bf99aedf2849b3d2 May 27 14:58:17.609561 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-202217145 May 27 14:58:17.609561 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin May 27 14:58:17.609561 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:17.609561 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:17.609561 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 91a6ce4e8c15412aa9790c8b792319db May 27 14:58:17.609561 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin May 27 14:58:17.609561 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 14:58:17.609561 n-d-843621-1 devstack@n-api.service[119248]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 27 14:58:17.609561 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'nonexistent_hypervisor_name'} May 27 14:58:17.610294 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:17.610294 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:17.610294 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:17.610294 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:17.610294 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:17.610294 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:17.610294 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:17.610294 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:17.610294 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:17.610294 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:17.610294 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search May 27 14:58:17.610294 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) May 27 14:58:17.610294 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern May 27 14:58:17.610294 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 27 14:58:17.610294 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 27 14:58:17.610294 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:17.610294 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:17.610294 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:17.610294 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:17.610294 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:17.612352 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:17.612352 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:17.612352 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:17.612352 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 27 14:58:17.612352 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:17.612352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eba9783e-fc28-4f5b-ab5e-1f3bfcdcf4ba tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:17.612352 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-eba9783e-fc28-4f5b-ab5e-1f3bfcdcf4ba tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.022594 May 27 14:58:17.612352 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 210/387] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 14:58:17 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:17.617618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d85421ea-12d5-44a3-af0d-4baa24ebeb18 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:17.618859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d85421ea-12d5-44a3-af0d-4baa24ebeb18 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:17.623668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-5d7bf512-c936-45a9-ac36-566de7d80af0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:58:17.624339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-5d7bf512-c936-45a9-ac36-566de7d80af0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:58:17.624861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-5d7bf512-c936-45a9-ac36-566de7d80af0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:58:17.625282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-5d7bf512-c936-45a9-ac36-566de7d80af0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:58:17.625703 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-5d7bf512-c936-45a9-ac36-566de7d80af0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:58:17.628699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d85421ea-12d5-44a3-af0d-4baa24ebeb18 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:17.629322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d85421ea-12d5-44a3-af0d-4baa24ebeb18 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:17.630269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d85421ea-12d5-44a3-af0d-4baa24ebeb18 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:17.630884 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d85421ea-12d5-44a3-af0d-4baa24ebeb18 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:17.637702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d7bf512-c936-45a9-ac36-566de7d80af0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:17.638411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d7bf512-c936-45a9-ac36-566de7d80af0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:17.642417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d7bf512-c936-45a9-ac36-566de7d80af0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:17.643077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d7bf512-c936-45a9-ac36-566de7d80af0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:17.672028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-5d7bf512-c936-45a9-ac36-566de7d80af0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Getting quotas for project 960898bbaeac4cd1b5394df898d419bd. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:58:17.678095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-5d7bf512-c936-45a9-ac36-566de7d80af0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Getting quotas for user 6d4174aebd284775894cc0047cf5247f and project 960898bbaeac4cd1b5394df898d419bd. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:58:17.694687 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5d7bf512-c936-45a9-ac36-566de7d80af0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 14:58:17.701719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5d7bf512-c936-45a9-ac36-566de7d80af0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] [instance: a7898281-77eb-40ed-8047-11d39b2ae6e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 14:58:17.770480 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5d7bf512-c936-45a9-ac36-566de7d80af0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.819955 May 27 14:58:17.771119 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 178/388] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:58:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 14:58:17.776929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0f41f31f-8fc6-4b58-8a5e-99a1d8a0f1fa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:17.777749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0f41f31f-8fc6-4b58-8a5e-99a1d8a0f1fa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:17.786036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0f41f31f-8fc6-4b58-8a5e-99a1d8a0f1fa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:17.786706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0f41f31f-8fc6-4b58-8a5e-99a1d8a0f1fa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:17.787669 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0f41f31f-8fc6-4b58-8a5e-99a1d8a0f1fa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:17.788269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0f41f31f-8fc6-4b58-8a5e-99a1d8a0f1fa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:17.873071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d85421ea-12d5-44a3-af0d-4baa24ebeb18 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:17.881610 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d85421ea-12d5-44a3-af0d-4baa24ebeb18 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe" status: 200 len: 1318 microversion: 2.1 time: 0.270431 May 27 14:58:17.882195 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 211/389] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:17 2022] GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:18.075188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0f41f31f-8fc6-4b58-8a5e-99a1d8a0f1fa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:18.090276 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0f41f31f-8fc6-4b58-8a5e-99a1d8a0f1fa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1474 microversion: 2.1 time: 0.316611 May 27 14:58:18.102117 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 179/390] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:17 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1474 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:18.116623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c8cc6c2a-3d57-447f-867a-171261fe37f9 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Calling method '.version_select at 0x7fc7772ae310>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:18.119025 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:18.119025 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:18.120265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c8cc6c2a-3d57-447f-867a-171261fe37f9 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:18.120757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c8cc6c2a-3d57-447f-867a-171261fe37f9 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:18.140010 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-da15f5de-b70a-4d2a-8e9f-25306d55adfe tempest-FlavorsAccessTestJSON-1897221354 tempest-FlavorsAccessTestJSON-1897221354-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:18.142845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c8cc6c2a-3d57-447f-867a-171261fe37f9 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:18.143522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c8cc6c2a-3d57-447f-867a-171261fe37f9 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:18.161450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c8cc6c2a-3d57-447f-867a-171261fe37f9 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:18.161963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c8cc6c2a-3d57-447f-867a-171261fe37f9 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:18.176425 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-da15f5de-b70a-4d2a-8e9f-25306d55adfe tempest-FlavorsAccessTestJSON-1897221354 tempest-FlavorsAccessTestJSON-1897221354-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.293150 May 27 14:58:18.178158 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 212/391] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:58:17 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:18.184736 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-45c15422-e5aa-4360-bf1a-2d650f839511 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:18.185137 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c8cc6c2a-3d57-447f-867a-171261fe37f9 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.080625 May 27 14:58:18.186310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-45c15422-e5aa-4360-bf1a-2d650f839511 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] [instance: a7898281-77eb-40ed-8047-11d39b2ae6e2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:18.191047 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 180/392] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:58:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:18.200402 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e3993c49-6e56-446a-8757-ffb65a08f9e2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:18.201072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e3993c49-6e56-446a-8757-ffb65a08f9e2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:18.210140 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3993c49-6e56-446a-8757-ffb65a08f9e2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:18.210893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3993c49-6e56-446a-8757-ffb65a08f9e2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:18.212181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3993c49-6e56-446a-8757-ffb65a08f9e2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:18.213237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3993c49-6e56-446a-8757-ffb65a08f9e2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:18.347234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-45c15422-e5aa-4360-bf1a-2d650f839511 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4174aebd284775894cc0047cf5247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960898bbaeac4cd1b5394df898d419bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:18.358265 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-45c15422-e5aa-4360-bf1a-2d650f839511 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] 10.222.0.13 "GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2" status: 200 len: 1223 microversion: 2.1 time: 0.176324 May 27 14:58:18.372580 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 213/393] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:18 2022] GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2 => generated 1223 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:18.382063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7fbd35d2-9397-476f-acc7-a812550fb11b tempest-FlavorsAccessTestJSON-1339631349 tempest-FlavorsAccessTestJSON-1339631349-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7838b0f896db414aa635146cc7ebbd7d"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:18.386594 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:18.386594 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:18.485649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e3993c49-6e56-446a-8757-ffb65a08f9e2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:18.498878 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e3993c49-6e56-446a-8757-ffb65a08f9e2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:18.503550 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e3993c49-6e56-446a-8757-ffb65a08f9e2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:18.506529 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7fbd35d2-9397-476f-acc7-a812550fb11b tempest-FlavorsAccessTestJSON-1339631349 tempest-FlavorsAccessTestJSON-1339631349-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/850308625/action" status: 200 len: 21 microversion: 2.1 time: 0.131691 May 27 14:58:18.506809 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e3993c49-6e56-446a-8757-ffb65a08f9e2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1557 microversion: 2.25 time: 0.313028 May 27 14:58:18.507541 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 181/394] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:18 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1557 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:18.519145 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 214/395] 10.222.0.13 () {60 vars in 1196 bytes} [Fri May 27 14:58:18 2022] POST /compute/v2.1/flavors/850308625/action => generated 21 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 14:58:18.523094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-13723170-d73b-4fbf-8ae0-df54edb88ce5 tempest-HypervisorAdminNegativeUnderV252Test-395653941 tempest-HypervisorAdminNegativeUnderV252Test-395653941-project] Calling method '.version_select at 0x7fc777155160>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:18.525873 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:18.525873 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:18.528073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-13723170-d73b-4fbf-8ae0-df54edb88ce5 tempest-HypervisorAdminNegativeUnderV252Test-395653941 tempest-HypervisorAdminNegativeUnderV252Test-395653941-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'd035467bfbee4403b3202d747c3b2b60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a691e97db034458a531997643bce057', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-13723170-d73b-4fbf-8ae0-df54edb88ce5 tempest-HypervisorAdminNegativeUnderV252Test-395653941 tempest-HypervisorAdminNegativeUnderV252Test-395653941-project] Request method failure captured: May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOcGAuRGAOyoO_uM_6hsFaf5xpcW01J3TRGrJ1NhjdfqMgBzXZ8oS3CYiQ2WnnHlyzYG02lrz_oiAuE6Hs-3O3XMQ6gKwK04tamrqq7IouD6-ZX6mQ0hnLLquX_gIl26BPGYg0H5nIRfuSyt-wcIHaqkrITWgwHk1UG3yEn1OIi4C3E May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 1a691e97db034458a531997643bce057 May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-395653941 May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:58:18.532188 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:58:18.533463 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1a691e97db034458a531997643bce057"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1a691e97db034458a531997643bce057"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1a691e97db034458a531997643bce057"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1a691e97db034458a531997643bce057", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:18.533463 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-395653941 May 27 14:58:18.533463 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 1a691e97db034458a531997643bce057 May 27 14:58:18.533463 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-395653941 May 27 14:58:18.533463 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-395653941-project May 27 14:58:18.533463 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:18.533463 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:18.533463 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: d035467bfbee4403b3202d747c3b2b60 May 27 14:58:18.533463 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-395653941-project May 27 14:58:18.533463 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 14:58:18.533463 n-d-843621-1 devstack@n-api.service[119248]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 27 14:58:18.533463 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '1'} May 27 14:58:18.533463 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:18.534289 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:18.534289 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:18.534289 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:18.534289 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:18.534289 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:18.534289 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:18.534289 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:18.534289 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:18.534289 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:18.534289 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers May 27 14:58:18.534289 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) May 27 14:58:18.534289 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:58:18.534289 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:58:18.534289 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:58:18.534289 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:58:18.534289 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:18.534289 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:18.534289 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:18.534289 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:18.535308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:58:18.535308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:58:18.535308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:58:18.535308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:58:18.535308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:58:18.535308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:58:18.535308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 27 14:58:18.535308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:18.535308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:18.535308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:18.535308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:18.535308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:18.535308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:18.535308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:58:18.535308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:58:18.535308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 27 14:58:18.535308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:18.536198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-13723170-d73b-4fbf-8ae0-df54edb88ce5 tempest-HypervisorAdminNegativeUnderV252Test-395653941 tempest-HypervisorAdminNegativeUnderV252Test-395653941-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:18.536198 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-13723170-d73b-4fbf-8ae0-df54edb88ce5 tempest-HypervisorAdminNegativeUnderV252Test-395653941 tempest-HypervisorAdminNegativeUnderV252Test-395653941-project] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.022489 May 27 14:58:18.536335 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 215/396] 10.222.0.13 () {58 vars in 1175 bytes} [Fri May 27 14:58:18 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:18.547787 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4cfb3446-cc0d-4f37-8676-ad3901e082a7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:18.549776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4cfb3446-cc0d-4f37-8676-ad3901e082a7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: a3017e23-0753-457e-8f51-8f1586807499] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:18.555257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-35c8e1e9-2e9d-4b46-9906-b8be8c08a93a tempest-FlavorsAccessTestJSON-1897221354 tempest-FlavorsAccessTestJSON-1897221354-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:18.569223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4cfb3446-cc0d-4f37-8676-ad3901e082a7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:18.579810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4cfb3446-cc0d-4f37-8676-ad3901e082a7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:18.587876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4cfb3446-cc0d-4f37-8676-ad3901e082a7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:18.588456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4cfb3446-cc0d-4f37-8676-ad3901e082a7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:18.598030 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-35c8e1e9-2e9d-4b46-9906-b8be8c08a93a tempest-FlavorsAccessTestJSON-1897221354 tempest-FlavorsAccessTestJSON-1897221354-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057971 May 27 14:58:18.600916 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 216/397] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:58:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:18.607044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e11a2428-6291-4a83-b442-476b19ca9fec tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '.version_select at 0x7fc777222820>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:18.610020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e11a2428-6291-4a83-b442-476b19ca9fec tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:18.610988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e11a2428-6291-4a83-b442-476b19ca9fec tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:18.641019 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-4cfb3446-cc0d-4f37-8676-ad3901e082a7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] HTTP exception thrown: Instance a3017e23-0753-457e-8f51-8f1586807499 could not be found. May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4cfb3446-cc0d-4f37-8676-ad3901e082a7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Request method failure captured: May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499 HTTP/1.1 May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikObLcIh_VTFFcY-B7AZUcpaZ8S9WNeS3jQSnR_9LWkTu7KV7tqEgaBZqxW6zm9w9SWRtByAjhS8V_1PsWjCneIFHyuWnBP-LrXBF3pu2lV1bFK06X-HJbGuUsOYT7BJQj2M_d41x-wJa4XI-TpVt-g94MDuuIKh6K9xthI_zGKaVofw May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 016d7f67e1704dc888371aa43be736e6 May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-DeleteServersAdminTestJSON-69833662 May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:58:18.643702 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:58:18.645381 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/016d7f67e1704dc888371aa43be736e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/016d7f67e1704dc888371aa43be736e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/016d7f67e1704dc888371aa43be736e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_016d7f67e1704dc888371aa43be736e6", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:18.645381 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-DeleteServersAdminTestJSON-69833662 May 27 14:58:18.645381 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 016d7f67e1704dc888371aa43be736e6 May 27 14:58:18.645381 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-69833662 May 27 14:58:18.645381 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-DeleteServersAdminTestJSON-69833662-project May 27 14:58:18.645381 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:18.645381 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:18.645381 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 8a7349483c684d7aa73c85844d1fda97 May 27 14:58:18.645381 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-DeleteServersAdminTestJSON-69833662-project May 27 14:58:18.645381 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 14:58:18.645381 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance a3017e23-0753-457e-8f51-8f1586807499 could not be found. May 27 14:58:18.645381 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'a3017e23-0753-457e-8f51-8f1586807499'} May 27 14:58:18.646356 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:18.646356 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:18.646356 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 14:58:18.646356 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 14:58:18.646356 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 14:58:18.646356 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 14:58:18.646356 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 14:58:18.646356 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 14:58:18.646356 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 14:58:18.646356 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 14:58:18.646356 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3017e23-0753-457e-8f51-8f1586807499 could not be found. May 27 14:58:18.646356 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:18.646356 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:18.646356 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:18.646356 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:18.646356 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:18.646356 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:18.646356 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:18.646356 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:18.646356 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:18.647842 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:18.647842 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 14:58:18.647842 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 14:58:18.647842 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 14:58:18.647842 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 14:58:18.647842 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 14:58:18.647842 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 14:58:18.647842 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3017e23-0753-457e-8f51-8f1586807499 could not be found. May 27 14:58:18.647842 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:18.647842 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:18.647842 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:18.647842 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:18.647842 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:18.647842 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:18.647842 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:18.647842 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:18.647842 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3017e23-0753-457e-8f51-8f1586807499 could not be found. May 27 14:58:18.647842 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:18.653132 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e11a2428-6291-4a83-b442-476b19ca9fec tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 860 microversion: 2.25 time: 0.050804 May 27 14:58:18.653763 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 217/398] 10.222.0.13 () {60 vars in 1183 bytes} [Fri May 27 14:58:18 2022] GET /compute/v2.1/os-migrations => generated 860 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:58:18.666416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2bc3642c-3c48-4fe9-bdd1-ae84b85be708 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Calling method '.version_select at 0x7fc777222790>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:18.666952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4cfb3446-cc0d-4f37-8676-ad3901e082a7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Returning 404 to user: Instance a3017e23-0753-457e-8f51-8f1586807499 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:18.668603 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:18.668603 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:18.670038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bc3642c-3c48-4fe9-bdd1-ae84b85be708 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:18.670320 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4cfb3446-cc0d-4f37-8676-ad3901e082a7 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499" status: 404 len: 111 microversion: 2.1 time: 0.151099 May 27 14:58:18.670822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bc3642c-3c48-4fe9-bdd1-ae84b85be708 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:18.677754 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-2bc3642c-3c48-4fe9-bdd1-ae84b85be708 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] HTTP exception thrown: No hypervisor matching '19bf5152-3f85-45ab-80e1-d68953f41693' could be found. May 27 14:58:18.677933 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 182/399] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:18 2022] GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2bc3642c-3c48-4fe9-bdd1-ae84b85be708 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Request method failure captured: May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-hypervisors/19bf5152-3f85-45ab-80e1-d68953f41693/servers HTTP/1.1 May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOcIjOB4xaREp6M9GgeOF9vxKfTIzCx8nNtYjARV0OweL9bjBv1abPqBpRMEQptYXfT3byj_gXVDub4BUOjHvJu6_iFiGxTU3uHgXltIcFsq4wxgcTraSonNlRJWtyVsucdMxnlGOiZeQQGiJpd90APfEqRk68hkhd40r7M3_Djw61g May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 6e545983fb344964bf99aedf2849b3d2 May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-202217145 May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:58:18.679455 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:58:18.680805 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6e545983fb344964bf99aedf2849b3d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6e545983fb344964bf99aedf2849b3d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6e545983fb344964bf99aedf2849b3d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6e545983fb344964bf99aedf2849b3d2", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:18.680805 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-202217145 May 27 14:58:18.680805 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 6e545983fb344964bf99aedf2849b3d2 May 27 14:58:18.680805 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-202217145 May 27 14:58:18.680805 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin May 27 14:58:18.680805 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:18.680805 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:18.680805 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 91a6ce4e8c15412aa9790c8b792319db May 27 14:58:18.680805 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin May 27 14:58:18.680805 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 14:58:18.680805 n-d-843621-1 devstack@n-api.service[119248]: exception: No hypervisor matching '19bf5152-3f85-45ab-80e1-d68953f41693' could be found. May 27 14:58:18.680805 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '19bf5152-3f85-45ab-80e1-d68953f41693'} May 27 14:58:18.681475 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:18.681475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:18.681475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:18.681475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:18.681475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:18.681475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:18.681475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:18.681475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:18.681475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:18.681475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:18.681475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers May 27 14:58:18.681475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) May 27 14:58:18.681475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern May 27 14:58:18.681475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 27 14:58:18.681475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '19bf5152-3f85-45ab-80e1-d68953f41693' could be found. May 27 14:58:18.681475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:18.681475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:18.681475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:18.681475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:18.682484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:18.682484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:18.682484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:18.682484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:18.682484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '19bf5152-3f85-45ab-80e1-d68953f41693' could be found. May 27 14:58:18.682484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:18.684924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2bc3642c-3c48-4fe9-bdd1-ae84b85be708 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] Returning 404 to user: No hypervisor matching '19bf5152-3f85-45ab-80e1-d68953f41693' could be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:18.686433 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2bc3642c-3c48-4fe9-bdd1-ae84b85be708 tempest-HypervisorAdminNegativeUnderV252Test-202217145 tempest-HypervisorAdminNegativeUnderV252Test-202217145-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/19bf5152-3f85-45ab-80e1-d68953f41693/servers" status: 404 len: 123 microversion: 2.1 time: 0.030473 May 27 14:58:18.687463 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 218/400] 10.222.0.13 () {58 vars in 1280 bytes} [Fri May 27 14:58:18 2022] GET /compute/v2.1/os-hypervisors/19bf5152-3f85-45ab-80e1-d68953f41693/servers => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:18.693339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e624166a-487a-44f6-b9b5-106daba85e3a tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:18.694676 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e624166a-487a-44f6-b9b5-106daba85e3a tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:18.696916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0f2fa73a-f41f-4b66-857e-c16830903737 tempest-FlavorsAccessTestJSON-1339631349 tempest-FlavorsAccessTestJSON-1339631349-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:18.697781 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:18.697781 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:18.706435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e624166a-487a-44f6-b9b5-106daba85e3a tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:18.707227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e624166a-487a-44f6-b9b5-106daba85e3a tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:18.709435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e624166a-487a-44f6-b9b5-106daba85e3a tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:18.710088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e624166a-487a-44f6-b9b5-106daba85e3a tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:18.773604 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0f2fa73a-f41f-4b66-857e-c16830903737 tempest-FlavorsAccessTestJSON-1339631349 tempest-FlavorsAccessTestJSON-1339631349-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/850308625" status: 202 len: 0 microversion: 2.1 time: 0.094440 May 27 14:58:18.776838 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 183/401] 10.222.0.13 () {58 vars in 1157 bytes} [Fri May 27 14:58:18 2022] DELETE /compute/v2.1/flavors/850308625 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:58:18.793330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-626984d0-58b2-49c5-acb8-700e95a227b6 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:18.795655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-626984d0-58b2-49c5-acb8-700e95a227b6 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: a3017e23-0753-457e-8f51-8f1586807499] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:18.812059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-626984d0-58b2-49c5-acb8-700e95a227b6 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:18.816183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-626984d0-58b2-49c5-acb8-700e95a227b6 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:18.817217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-626984d0-58b2-49c5-acb8-700e95a227b6 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:18.818133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-626984d0-58b2-49c5-acb8-700e95a227b6 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:18.847505 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-626984d0-58b2-49c5-acb8-700e95a227b6 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] HTTP exception thrown: Instance a3017e23-0753-457e-8f51-8f1586807499 could not be found. May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-626984d0-58b2-49c5-acb8-700e95a227b6 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Request method failure captured: May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499 HTTP/1.1 May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikObLcIh_VTFFcY-B7AZUcpaZ8S9WNeS3jQSnR_9LWkTu7KV7tqEgaBZqxW6zm9w9SWRtByAjhS8V_1PsWjCneIFHyuWnBP-LrXBF3pu2lV1bFK06X-HJbGuUsOYT7BJQj2M_d41x-wJa4XI-TpVt-g94MDuuIKh6K9xthI_zGKaVofw May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 016d7f67e1704dc888371aa43be736e6 May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-DeleteServersAdminTestJSON-69833662 May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:58:18.849680 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:58:18.850929 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/016d7f67e1704dc888371aa43be736e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/016d7f67e1704dc888371aa43be736e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/016d7f67e1704dc888371aa43be736e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_016d7f67e1704dc888371aa43be736e6", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:18.850929 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-DeleteServersAdminTestJSON-69833662 May 27 14:58:18.850929 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 016d7f67e1704dc888371aa43be736e6 May 27 14:58:18.850929 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-69833662 May 27 14:58:18.850929 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-DeleteServersAdminTestJSON-69833662-project May 27 14:58:18.850929 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:18.850929 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:18.850929 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 8a7349483c684d7aa73c85844d1fda97 May 27 14:58:18.850929 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-DeleteServersAdminTestJSON-69833662-project May 27 14:58:18.850929 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 14:58:18.850929 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance a3017e23-0753-457e-8f51-8f1586807499 could not be found. May 27 14:58:18.850929 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'a3017e23-0753-457e-8f51-8f1586807499'} May 27 14:58:18.851640 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:18.851640 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:18.851640 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 14:58:18.851640 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 14:58:18.851640 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 14:58:18.851640 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 14:58:18.851640 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 14:58:18.851640 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 14:58:18.851640 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 14:58:18.851640 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 14:58:18.851640 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3017e23-0753-457e-8f51-8f1586807499 could not be found. May 27 14:58:18.851640 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:18.851640 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:18.851640 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:18.851640 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:18.851640 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:18.851640 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:18.851640 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:18.851640 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:18.851640 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:18.852876 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:18.852876 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 14:58:18.852876 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 14:58:18.852876 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 14:58:18.852876 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 14:58:18.852876 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 14:58:18.852876 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 14:58:18.852876 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 14:58:18.852876 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 14:58:18.852876 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3017e23-0753-457e-8f51-8f1586807499 could not be found. May 27 14:58:18.852876 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:18.852876 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:18.852876 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:18.852876 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:18.852876 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:18.852876 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:18.852876 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:18.852876 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:18.852876 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3017e23-0753-457e-8f51-8f1586807499 could not be found. May 27 14:58:18.852876 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:18.855868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-626984d0-58b2-49c5-acb8-700e95a227b6 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Returning 404 to user: Instance a3017e23-0753-457e-8f51-8f1586807499 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:18.857237 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-626984d0-58b2-49c5-acb8-700e95a227b6 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499" status: 404 len: 111 microversion: 2.1 time: 0.077381 May 27 14:58:18.863193 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 184/402] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 14:58:18 2022] DELETE /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:18.872939 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4ebe04cd-6306-4be2-a85b-6aed94b9e475 tempest-FlavorsAccessTestJSON-1339631349 tempest-FlavorsAccessTestJSON-1339631349-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:18.898392 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4ebe04cd-6306-4be2-a85b-6aed94b9e475 tempest-FlavorsAccessTestJSON-1339631349 tempest-FlavorsAccessTestJSON-1339631349-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033742 May 27 14:58:18.899820 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 185/403] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:58:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:18.908202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-8faff299-aeba-4861-9f16-644e8b871fcc req-a65e8f2f-508e-4065-a805-94dab05599f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd481fb-2d54-4881-a697-db93d9623fbe", "name": "network-vif-plugged", "status": "completed", "tag": "66fc9523-073d-433b-8731-d04dec899a9e"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:18.925921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-8faff299-aeba-4861-9f16-644e8b871fcc req-a65e8f2f-508e-4065-a805-94dab05599f8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:18.926914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-8faff299-aeba-4861-9f16-644e8b871fcc req-a65e8f2f-508e-4065-a805-94dab05599f8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:18.942457 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-8faff299-aeba-4861-9f16-644e8b871fcc req-a65e8f2f-508e-4065-a805-94dab05599f8 service nova] Creating event network-vif-plugged:66fc9523-073d-433b-8731-d04dec899a9e for instance dcd481fb-2d54-4881-a697-db93d9623fbe on n-h1-843621-1 May 27 14:58:18.948463 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-8faff299-aeba-4861-9f16-644e8b871fcc req-a65e8f2f-508e-4065-a805-94dab05599f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046471 May 27 14:58:18.949737 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 186/404] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:18.955266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-380b53a6-50a9-49eb-81ca-48e4cab87bd0 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:18.956271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-380b53a6-50a9-49eb-81ca-48e4cab87bd0 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: a3017e23-0753-457e-8f51-8f1586807499] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:18.965237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-380b53a6-50a9-49eb-81ca-48e4cab87bd0 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:18.966256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-380b53a6-50a9-49eb-81ca-48e4cab87bd0 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:18.967155 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-380b53a6-50a9-49eb-81ca-48e4cab87bd0 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:18.968105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-380b53a6-50a9-49eb-81ca-48e4cab87bd0 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:18.984838 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-380b53a6-50a9-49eb-81ca-48e4cab87bd0 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] HTTP exception thrown: Instance a3017e23-0753-457e-8f51-8f1586807499 could not be found. May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-380b53a6-50a9-49eb-81ca-48e4cab87bd0 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Request method failure captured: May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499 HTTP/1.1 May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikObLcIh_VTFFcY-B7AZUcpaZ8S9WNeS3jQSnR_9LWkTu7KV7tqEgaBZqxW6zm9w9SWRtByAjhS8V_1PsWjCneIFHyuWnBP-LrXBF3pu2lV1bFK06X-HJbGuUsOYT7BJQj2M_d41x-wJa4XI-TpVt-g94MDuuIKh6K9xthI_zGKaVofw May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 016d7f67e1704dc888371aa43be736e6 May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-DeleteServersAdminTestJSON-69833662 May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:58:18.988169 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:58:18.989389 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/016d7f67e1704dc888371aa43be736e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/016d7f67e1704dc888371aa43be736e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/016d7f67e1704dc888371aa43be736e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_016d7f67e1704dc888371aa43be736e6", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:18.989389 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-DeleteServersAdminTestJSON-69833662 May 27 14:58:18.989389 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 016d7f67e1704dc888371aa43be736e6 May 27 14:58:18.989389 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-69833662 May 27 14:58:18.989389 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-DeleteServersAdminTestJSON-69833662-project May 27 14:58:18.989389 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:18.989389 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:18.989389 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 8a7349483c684d7aa73c85844d1fda97 May 27 14:58:18.989389 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-DeleteServersAdminTestJSON-69833662-project May 27 14:58:18.989389 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 14:58:18.989389 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance a3017e23-0753-457e-8f51-8f1586807499 could not be found. May 27 14:58:18.989389 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'a3017e23-0753-457e-8f51-8f1586807499'} May 27 14:58:18.990052 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:18.990052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:18.990052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 14:58:18.990052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 14:58:18.990052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 14:58:18.990052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 14:58:18.990052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 14:58:18.990052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 14:58:18.990052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 14:58:18.990052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 14:58:18.990052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3017e23-0753-457e-8f51-8f1586807499 could not be found. May 27 14:58:18.990052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:18.990052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:18.990052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:18.990052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:18.990052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:18.990052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:18.990052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:18.990052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:18.990052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:18.991096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:18.991096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 14:58:18.991096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 14:58:18.991096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 14:58:18.991096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 14:58:18.991096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 14:58:18.991096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 14:58:18.991096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3017e23-0753-457e-8f51-8f1586807499 could not be found. May 27 14:58:18.991096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:18.991096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:18.991096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:18.991096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:18.991096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:18.991096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:18.991096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:18.991096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:18.991096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3017e23-0753-457e-8f51-8f1586807499 could not be found. May 27 14:58:18.991096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:18.994144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-380b53a6-50a9-49eb-81ca-48e4cab87bd0 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Returning 404 to user: Instance a3017e23-0753-457e-8f51-8f1586807499 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:18.995220 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-380b53a6-50a9-49eb-81ca-48e4cab87bd0 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499" status: 404 len: 111 microversion: 2.1 time: 0.044212 May 27 14:58:19.000208 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 187/405] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:18 2022] GET /compute/v2.1/servers/a3017e23-0753-457e-8f51-8f1586807499 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:19.005519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4b46dd0f-1202-4119-a7f3-71bde30ec073 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:19.005673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-e624166a-487a-44f6-b9b5-106daba85e3a tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lazy-loading 'services' on Instance uuid ad32218c-901a-44e3-92e3-5aeb695c4cc8 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:58:19.006609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4b46dd0f-1202-4119-a7f3-71bde30ec073 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:19.014713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b46dd0f-1202-4119-a7f3-71bde30ec073 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:19.015455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b46dd0f-1202-4119-a7f3-71bde30ec073 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:19.016455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b46dd0f-1202-4119-a7f3-71bde30ec073 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:19.017139 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b46dd0f-1202-4119-a7f3-71bde30ec073 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:19.046117 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e624166a-487a-44f6-b9b5-106daba85e3a tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 2049 microversion: 2.25 time: 0.357295 May 27 14:58:19.046803 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 219/406] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:18 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 2049 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:19.074103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-85a6fc93-2940-41c9-bc00-00813a2fb708 tempest-FlavorsAccessTestJSON-1339631349 tempest-FlavorsAccessTestJSON-1339631349-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1786375415", "id": 939574150, "os-flavor-access:is_public": "False"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:19.084590 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:19.084590 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:19.129577 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-85a6fc93-2940-41c9-bc00-00813a2fb708 tempest-FlavorsAccessTestJSON-1339631349 tempest-FlavorsAccessTestJSON-1339631349-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.069880 May 27 14:58:19.133112 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 220/407] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:58:19 2022] POST /compute/v2.1/flavors => generated 428 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:19.145378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d2b25ac4-6032-4373-9d72-cf3c5caa2554 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:19.147631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d2b25ac4-6032-4373-9d72-cf3c5caa2554 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:19.175060 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2b25ac4-6032-4373-9d72-cf3c5caa2554 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:19.177813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2b25ac4-6032-4373-9d72-cf3c5caa2554 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:19.179456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2b25ac4-6032-4373-9d72-cf3c5caa2554 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:19.180747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2b25ac4-6032-4373-9d72-cf3c5caa2554 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:19.216567 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-d2b25ac4-6032-4373-9d72-cf3c5caa2554 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] HTTP exception thrown: Instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc could not be found. May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d2b25ac4-6032-4373-9d72-cf3c5caa2554 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Request method failure captured: May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc HTTP/1.1 May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObLcIh_VTFFcY-B7AZUcpaZ8S9WNeS3jQSnR_9LWkTu7KV7tqEgaBZqxW6zm9w9SWRtByAjhS8V_1PsWjCneIFHyuWnBP-LrXBF3pu2lV1bFK06X-HJbGuUsOYT7BJQj2M_d41x-wJa4XI-TpVt-g94MDuuIKh6K9xthI_zGKaVofw May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 016d7f67e1704dc888371aa43be736e6 May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-DeleteServersAdminTestJSON-69833662 May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:58:19.220484 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:58:19.222756 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/016d7f67e1704dc888371aa43be736e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/016d7f67e1704dc888371aa43be736e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/016d7f67e1704dc888371aa43be736e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_016d7f67e1704dc888371aa43be736e6", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:19.222756 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-DeleteServersAdminTestJSON-69833662 May 27 14:58:19.222756 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 016d7f67e1704dc888371aa43be736e6 May 27 14:58:19.222756 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-69833662 May 27 14:58:19.222756 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-DeleteServersAdminTestJSON-69833662-project May 27 14:58:19.222756 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:19.222756 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:19.222756 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 8a7349483c684d7aa73c85844d1fda97 May 27 14:58:19.222756 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-DeleteServersAdminTestJSON-69833662-project May 27 14:58:19.222756 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:58:19.222756 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc could not be found. May 27 14:58:19.222756 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '6308b60c-6cce-4b7b-a8ec-a683a03f0fcc'} May 27 14:58:19.224072 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:19.224072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:19.224072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 14:58:19.224072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 14:58:19.224072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 14:58:19.224072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 14:58:19.224072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 14:58:19.224072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 14:58:19.224072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 14:58:19.224072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 14:58:19.224072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc could not be found. May 27 14:58:19.224072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:19.224072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:19.224072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:19.224072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:19.224072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:19.224072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:19.224072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:19.224072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:19.224072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:19.226207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:19.226207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 14:58:19.226207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 14:58:19.226207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 14:58:19.226207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 14:58:19.226207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 14:58:19.226207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 14:58:19.226207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 14:58:19.226207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 14:58:19.226207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc could not be found. May 27 14:58:19.226207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:19.226207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:19.226207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:19.226207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:19.226207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:19.226207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:19.226207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:19.226207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:19.226207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc could not be found. May 27 14:58:19.226207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:19.233097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d2b25ac4-6032-4373-9d72-cf3c5caa2554 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Returning 404 to user: Instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:19.233097 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d2b25ac4-6032-4373-9d72-cf3c5caa2554 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 404 len: 111 microversion: 2.1 time: 0.087179 May 27 14:58:19.233097 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 221/408] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 14:58:19 2022] DELETE /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:19.254325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8070f2a1-7b2b-4b1c-8607-730c64ba25b6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:19.256830 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8070f2a1-7b2b-4b1c-8607-730c64ba25b6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:19.269287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8070f2a1-7b2b-4b1c-8607-730c64ba25b6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:19.273817 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8070f2a1-7b2b-4b1c-8607-730c64ba25b6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:19.279181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8070f2a1-7b2b-4b1c-8607-730c64ba25b6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:19.279681 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8070f2a1-7b2b-4b1c-8607-730c64ba25b6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:19.428322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4b46dd0f-1202-4119-a7f3-71bde30ec073 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:19.455067 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4b46dd0f-1202-4119-a7f3-71bde30ec073 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe" status: 200 len: 1318 microversion: 2.1 time: 0.453148 May 27 14:58:19.455664 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 188/409] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:19 2022] GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:19.471186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d4cf0f96-a7b5-4317-bb0a-2b5654f750a6 tempest-FlavorsAccessTestJSON-1339631349 tempest-FlavorsAccessTestJSON-1339631349-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:19.472352 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:19.472352 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:19.496161 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d4cf0f96-a7b5-4317-bb0a-2b5654f750a6 tempest-FlavorsAccessTestJSON-1339631349 tempest-FlavorsAccessTestJSON-1339631349-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/939574150/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.036029 May 27 14:58:19.499295 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 189/410] 10.222.0.13 () {58 vars in 1205 bytes} [Fri May 27 14:58:19 2022] GET /compute/v2.1/flavors/939574150/os-flavor-access => generated 21 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 14:58:19.508050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7617c4f5-2387-44c2-860a-deaf7fdeb416 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:19.510582 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7617c4f5-2387-44c2-860a-deaf7fdeb416 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] [instance: 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:19.527671 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7617c4f5-2387-44c2-860a-deaf7fdeb416 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:19.528338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7617c4f5-2387-44c2-860a-deaf7fdeb416 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:19.533086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7617c4f5-2387-44c2-860a-deaf7fdeb416 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:19.533886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7617c4f5-2387-44c2-860a-deaf7fdeb416 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:19.558437 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-7617c4f5-2387-44c2-860a-deaf7fdeb416 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] HTTP exception thrown: Instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc could not be found. May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7617c4f5-2387-44c2-860a-deaf7fdeb416 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Request method failure captured: May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc HTTP/1.1 May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikObLcIh_VTFFcY-B7AZUcpaZ8S9WNeS3jQSnR_9LWkTu7KV7tqEgaBZqxW6zm9w9SWRtByAjhS8V_1PsWjCneIFHyuWnBP-LrXBF3pu2lV1bFK06X-HJbGuUsOYT7BJQj2M_d41x-wJa4XI-TpVt-g94MDuuIKh6K9xthI_zGKaVofw May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 016d7f67e1704dc888371aa43be736e6 May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-DeleteServersAdminTestJSON-69833662 May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:58:19.563375 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:58:19.564987 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/016d7f67e1704dc888371aa43be736e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/016d7f67e1704dc888371aa43be736e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/016d7f67e1704dc888371aa43be736e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_016d7f67e1704dc888371aa43be736e6", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:19.564987 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-DeleteServersAdminTestJSON-69833662 May 27 14:58:19.564987 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 016d7f67e1704dc888371aa43be736e6 May 27 14:58:19.564987 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-69833662 May 27 14:58:19.564987 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-DeleteServersAdminTestJSON-69833662-project May 27 14:58:19.564987 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:19.564987 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:19.564987 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 8a7349483c684d7aa73c85844d1fda97 May 27 14:58:19.564987 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-DeleteServersAdminTestJSON-69833662-project May 27 14:58:19.564987 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 14:58:19.564987 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc could not be found. May 27 14:58:19.564987 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '6308b60c-6cce-4b7b-a8ec-a683a03f0fcc'} May 27 14:58:19.565643 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:19.565643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:19.565643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 14:58:19.565643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 14:58:19.565643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 14:58:19.565643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 14:58:19.565643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 14:58:19.565643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 14:58:19.565643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 14:58:19.565643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 14:58:19.565643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc could not be found. May 27 14:58:19.565643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:19.565643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:19.565643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:19.565643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:19.565643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:19.565643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:19.565643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:19.565643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:19.565643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:19.566711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:19.566711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 14:58:19.566711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 14:58:19.566711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 14:58:19.566711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 14:58:19.566711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 14:58:19.566711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 14:58:19.566711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc could not be found. May 27 14:58:19.566711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:19.566711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:19.566711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:19.566711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:19.566711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:19.566711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:19.566711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:19.566711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:19.566711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc could not be found. May 27 14:58:19.566711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:19.570000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7617c4f5-2387-44c2-860a-deaf7fdeb416 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] Returning 404 to user: Instance 6308b60c-6cce-4b7b-a8ec-a683a03f0fcc could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:19.581946 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7617c4f5-2387-44c2-860a-deaf7fdeb416 tempest-DeleteServersAdminTestJSON-69833662 tempest-DeleteServersAdminTestJSON-69833662-project] 10.222.0.13 "GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc" status: 404 len: 111 microversion: 2.1 time: 0.081326 May 27 14:58:19.583183 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 190/411] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:19 2022] GET /compute/v2.1/servers/6308b60c-6cce-4b7b-a8ec-a683a03f0fcc => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:19.600001 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-21a04b3f-27b8-4af8-b48a-470e719cb249 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1509882093", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "0ccca6c3-83b2-4106-9cbd-795a4836060e"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:19.605078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8070f2a1-7b2b-4b1c-8607-730c64ba25b6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:19.612332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:19.627334 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8070f2a1-7b2b-4b1c-8607-730c64ba25b6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1474 microversion: 2.1 time: 0.389833 May 27 14:58:19.629981 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 222/412] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:19 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1474 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:19.643859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3c89d29f-561f-4c6b-95db-087fe9e88acb tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:19.646105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3c89d29f-561f-4c6b-95db-087fe9e88acb tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] [instance: a7898281-77eb-40ed-8047-11d39b2ae6e2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:19.662329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c89d29f-561f-4c6b-95db-087fe9e88acb tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:19.665355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c89d29f-561f-4c6b-95db-087fe9e88acb tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:19.669062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c89d29f-561f-4c6b-95db-087fe9e88acb tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:19.669951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c89d29f-561f-4c6b-95db-087fe9e88acb tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:19.684276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-21a04b3f-27b8-4af8-b48a-470e719cb249 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] validate_networks() for [('0ccca6c3-83b2-4106-9cbd-795a4836060e', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 14:58:19.845108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3c89d29f-561f-4c6b-95db-087fe9e88acb tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4174aebd284775894cc0047cf5247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960898bbaeac4cd1b5394df898d419bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:19.865423 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3c89d29f-561f-4c6b-95db-087fe9e88acb tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] 10.222.0.13 "GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2" status: 200 len: 1283 microversion: 2.1 time: 0.230119 May 27 14:58:19.876633 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 223/413] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:19 2022] GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2 => generated 1283 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:19.882470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-719b9320-9963-4b5e-8bfb-7bee05a28789 tempest-FlavorsAccessTestJSON-1339631349 tempest-FlavorsAccessTestJSON-1339631349-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:19.884270 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:19.884270 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:19.905534 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-719b9320-9963-4b5e-8bfb-7bee05a28789 tempest-FlavorsAccessTestJSON-1339631349 tempest-FlavorsAccessTestJSON-1339631349-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/939574150" status: 202 len: 0 microversion: 2.1 time: 0.027252 May 27 14:58:19.910113 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 224/414] 10.222.0.13 () {58 vars in 1157 bytes} [Fri May 27 14:58:19 2022] DELETE /compute/v2.1/flavors/939574150 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:58:19.916286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b79d7ad7-5e46-40ba-a464-2e03d6cee2a0 tempest-FlavorsAccessTestJSON-1339631349 tempest-FlavorsAccessTestJSON-1339631349-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:19.940239 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b79d7ad7-5e46-40ba-a464-2e03d6cee2a0 tempest-FlavorsAccessTestJSON-1339631349 tempest-FlavorsAccessTestJSON-1339631349-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028661 May 27 14:58:19.952943 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 225/415] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:58:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:20.473927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-32569bb1-c9d4-4a74-a180-61707f2af00e tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:20.474778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-32569bb1-c9d4-4a74-a180-61707f2af00e tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:20.488035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32569bb1-c9d4-4a74-a180-61707f2af00e tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:20.488495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32569bb1-c9d4-4a74-a180-61707f2af00e tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:20.491030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32569bb1-c9d4-4a74-a180-61707f2af00e tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:20.491631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32569bb1-c9d4-4a74-a180-61707f2af00e tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:20.827389 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-32569bb1-c9d4-4a74-a180-61707f2af00e tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:20.835573 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-32569bb1-c9d4-4a74-a180-61707f2af00e tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe" status: 200 len: 1318 microversion: 2.1 time: 0.366434 May 27 14:58:20.840293 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 226/416] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:20 2022] GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:58:20.845151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a4097aee-d550-4160-8405-2cc630cc56ba tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:20.853103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-21a04b3f-27b8-4af8-b48a-470e719cb249 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:58:20.854033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-21a04b3f-27b8-4af8-b48a-470e719cb249 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:58:20.854685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-21a04b3f-27b8-4af8-b48a-470e719cb249 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:58:20.855250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-21a04b3f-27b8-4af8-b48a-470e719cb249 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:58:20.855803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-21a04b3f-27b8-4af8-b48a-470e719cb249 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:58:20.863422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a4097aee-d550-4160-8405-2cc630cc56ba tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:20.874331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21a04b3f-27b8-4af8-b48a-470e719cb249 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:20.876543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21a04b3f-27b8-4af8-b48a-470e719cb249 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:20.878781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4097aee-d550-4160-8405-2cc630cc56ba tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:20.879883 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21a04b3f-27b8-4af8-b48a-470e719cb249 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:20.880510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4097aee-d550-4160-8405-2cc630cc56ba tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:20.882088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21a04b3f-27b8-4af8-b48a-470e719cb249 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:20.883835 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4097aee-d550-4160-8405-2cc630cc56ba tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:20.892041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4097aee-d550-4160-8405-2cc630cc56ba tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:20.937372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-21a04b3f-27b8-4af8-b48a-470e719cb249 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Getting quotas for project 0dbdeb12b89c475cba7fef0ab845dada. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:58:20.945745 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-21a04b3f-27b8-4af8-b48a-470e719cb249 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Getting quotas for user 4284d5f7a29045d18393bde2961a904b and project 0dbdeb12b89c475cba7fef0ab845dada. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:58:20.951827 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:20.983277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-21a04b3f-27b8-4af8-b48a-470e719cb249 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 14:58:20.985646 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-21a04b3f-27b8-4af8-b48a-470e719cb249 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 14:58:21.063036 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-21a04b3f-27b8-4af8-b48a-470e719cb249 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.478553 May 27 14:58:21.069355 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 191/417] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 27 14:58:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 14:58:21.075381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f5b2564b-f2fe-4fc8-8b9b-7eaed6365659 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:21.076013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f5b2564b-f2fe-4fc8-8b9b-7eaed6365659 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] [instance: a7898281-77eb-40ed-8047-11d39b2ae6e2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:21.083025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f5b2564b-f2fe-4fc8-8b9b-7eaed6365659 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:21.083782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f5b2564b-f2fe-4fc8-8b9b-7eaed6365659 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:21.084758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f5b2564b-f2fe-4fc8-8b9b-7eaed6365659 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:21.085429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f5b2564b-f2fe-4fc8-8b9b-7eaed6365659 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:21.222572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f5b2564b-f2fe-4fc8-8b9b-7eaed6365659 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4174aebd284775894cc0047cf5247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960898bbaeac4cd1b5394df898d419bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:21.231986 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f5b2564b-f2fe-4fc8-8b9b-7eaed6365659 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] 10.222.0.13 "GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2" status: 200 len: 1281 microversion: 2.1 time: 0.161175 May 27 14:58:21.232391 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 192/418] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:21 2022] GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2 => generated 1281 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:21.249059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-35700bc2-111f-4527-b6d7-7b720cad15bd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:21.249984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-35700bc2-111f-4527-b6d7-7b720cad15bd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:21.262326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a4097aee-d550-4160-8405-2cc630cc56ba tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:21.278921 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a4097aee-d550-4160-8405-2cc630cc56ba tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1474 microversion: 2.1 time: 0.436672 May 27 14:58:21.280813 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 227/419] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:20 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1474 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:21.356148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-35700bc2-111f-4527-b6d7-7b720cad15bd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:21.365084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-35700bc2-111f-4527-b6d7-7b720cad15bd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:21.367679 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-35700bc2-111f-4527-b6d7-7b720cad15bd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:21.369406 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-35700bc2-111f-4527-b6d7-7b720cad15bd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1262 microversion: 2.25 time: 0.135993 May 27 14:58:21.370285 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 193/420] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:21 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1262 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:21.857973 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dfaee575-4a1a-42a8-950a-8a8f65fb0b02 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:21.858601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dfaee575-4a1a-42a8-950a-8a8f65fb0b02 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:21.870771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dfaee575-4a1a-42a8-950a-8a8f65fb0b02 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:21.871396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dfaee575-4a1a-42a8-950a-8a8f65fb0b02 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:21.876425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dfaee575-4a1a-42a8-950a-8a8f65fb0b02 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:21.877082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dfaee575-4a1a-42a8-950a-8a8f65fb0b02 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:22.122403 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dfaee575-4a1a-42a8-950a-8a8f65fb0b02 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:22.139306 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dfaee575-4a1a-42a8-950a-8a8f65fb0b02 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe" status: 200 len: 1468 microversion: 2.1 time: 0.285710 May 27 14:58:22.153752 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 228/421] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:21 2022] GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe => generated 1468 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:22.157463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ebc8e169-0660-436c-9114-172d53d40be1 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:22.158017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ebc8e169-0660-436c-9114-172d53d40be1 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:22.173027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ebc8e169-0660-436c-9114-172d53d40be1 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:22.173513 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ebc8e169-0660-436c-9114-172d53d40be1 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:22.174254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ebc8e169-0660-436c-9114-172d53d40be1 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:22.176635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ebc8e169-0660-436c-9114-172d53d40be1 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:22.213300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-ebc8e169-0660-436c-9114-172d53d40be1 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lazy-loading 'flavor' on Instance uuid dcd481fb-2d54-4881-a697-db93d9623fbe {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:58:22.254343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0ba2d1d7-0328-4309-ab77-43b2096f8cf7 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:22.255095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0ba2d1d7-0328-4309-ab77-43b2096f8cf7 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] [instance: a7898281-77eb-40ed-8047-11d39b2ae6e2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:22.267654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ba2d1d7-0328-4309-ab77-43b2096f8cf7 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:22.270133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ba2d1d7-0328-4309-ab77-43b2096f8cf7 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:22.273190 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ba2d1d7-0328-4309-ab77-43b2096f8cf7 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:22.273688 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ba2d1d7-0328-4309-ab77-43b2096f8cf7 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:22.328686 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ebc8e169-0660-436c-9114-172d53d40be1 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe/action" status: 202 len: 0 microversion: 2.1 time: 0.174840 May 27 14:58:22.330491 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 194/422] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 14:58:22 2022] POST /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:58:22.340601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f1dcbaa4-100d-4384-a9ed-a62c103bb3f8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:22.341845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f1dcbaa4-100d-4384-a9ed-a62c103bb3f8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:22.349864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1dcbaa4-100d-4384-a9ed-a62c103bb3f8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:22.350557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1dcbaa4-100d-4384-a9ed-a62c103bb3f8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:22.351545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1dcbaa4-100d-4384-a9ed-a62c103bb3f8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:22.352199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1dcbaa4-100d-4384-a9ed-a62c103bb3f8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:22.423197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0ba2d1d7-0328-4309-ab77-43b2096f8cf7 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4174aebd284775894cc0047cf5247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960898bbaeac4cd1b5394df898d419bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:22.449137 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0ba2d1d7-0328-4309-ab77-43b2096f8cf7 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] 10.222.0.13 "GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2" status: 200 len: 1281 microversion: 2.1 time: 0.203336 May 27 14:58:22.452140 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 229/423] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:22 2022] GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2 => generated 1281 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:58:22.462543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4bb51165-030d-442b-9d5d-f27c50f5827c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:22.464040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4bb51165-030d-442b-9d5d-f27c50f5827c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:22.475922 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4bb51165-030d-442b-9d5d-f27c50f5827c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:22.476628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4bb51165-030d-442b-9d5d-f27c50f5827c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:22.481725 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4bb51165-030d-442b-9d5d-f27c50f5827c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:22.483228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4bb51165-030d-442b-9d5d-f27c50f5827c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:22.905159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4bb51165-030d-442b-9d5d-f27c50f5827c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:22.919713 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4bb51165-030d-442b-9d5d-f27c50f5827c tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe" status: 200 len: 1476 microversion: 2.1 time: 0.464674 May 27 14:58:22.921550 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 230/424] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:22 2022] GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe => generated 1476 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:22.938116 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6b1134f6-8923-4b31-9d04-8550c625961f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:22.939871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6b1134f6-8923-4b31-9d04-8550c625961f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:22.958888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b1134f6-8923-4b31-9d04-8550c625961f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:22.962152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b1134f6-8923-4b31-9d04-8550c625961f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:22.965295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b1134f6-8923-4b31-9d04-8550c625961f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:22.967617 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b1134f6-8923-4b31-9d04-8550c625961f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:23.115433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f1dcbaa4-100d-4384-a9ed-a62c103bb3f8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:23.141549 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f1dcbaa4-100d-4384-a9ed-a62c103bb3f8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1474 microversion: 2.1 time: 0.808245 May 27 14:58:23.141848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6b1134f6-8923-4b31-9d04-8550c625961f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:23.143346 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 195/425] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:22 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1474 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:23.151914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6b1134f6-8923-4b31-9d04-8550c625961f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:23.157428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6b1134f6-8923-4b31-9d04-8550c625961f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:23.159372 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6b1134f6-8923-4b31-9d04-8550c625961f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1320 microversion: 2.25 time: 0.235342 May 27 14:58:23.164371 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 231/426] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:22 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1320 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:23.468304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d69efd7f-fe30-4093-8d6c-73b2d97f2259 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:23.469813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d69efd7f-fe30-4093-8d6c-73b2d97f2259 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] [instance: a7898281-77eb-40ed-8047-11d39b2ae6e2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:23.488204 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d69efd7f-fe30-4093-8d6c-73b2d97f2259 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:23.488965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d69efd7f-fe30-4093-8d6c-73b2d97f2259 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:23.492154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d69efd7f-fe30-4093-8d6c-73b2d97f2259 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:23.494264 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d69efd7f-fe30-4093-8d6c-73b2d97f2259 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:23.833314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d69efd7f-fe30-4093-8d6c-73b2d97f2259 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4174aebd284775894cc0047cf5247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960898bbaeac4cd1b5394df898d419bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:23.850395 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d69efd7f-fe30-4093-8d6c-73b2d97f2259 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] 10.222.0.13 "GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2" status: 200 len: 1323 microversion: 2.1 time: 0.386547 May 27 14:58:23.862457 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 196/427] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:23 2022] GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2 => generated 1323 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:23.939811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d7557389-4d19-4f77-98b6-83d4c02c95e4 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:23.942134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d7557389-4d19-4f77-98b6-83d4c02c95e4 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:23.952161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7557389-4d19-4f77-98b6-83d4c02c95e4 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:23.953004 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7557389-4d19-4f77-98b6-83d4c02c95e4 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:23.954111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7557389-4d19-4f77-98b6-83d4c02c95e4 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:23.954761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7557389-4d19-4f77-98b6-83d4c02c95e4 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:24.161967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e9c8461f-f934-4442-afab-a464302d33b3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:24.162598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e9c8461f-f934-4442-afab-a464302d33b3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:24.178106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9c8461f-f934-4442-afab-a464302d33b3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:24.178649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9c8461f-f934-4442-afab-a464302d33b3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:24.179509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9c8461f-f934-4442-afab-a464302d33b3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:24.181489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9c8461f-f934-4442-afab-a464302d33b3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:24.199782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d7557389-4d19-4f77-98b6-83d4c02c95e4 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:24.215785 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d7557389-4d19-4f77-98b6-83d4c02c95e4 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe" status: 200 len: 1459 microversion: 2.1 time: 0.281013 May 27 14:58:24.230245 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 232/428] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:23 2022] GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe => generated 1459 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:24.245456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-12696c76-aaf9-47b0-9b15-4bbc55728059 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:24.246350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-12696c76-aaf9-47b0-9b15-4bbc55728059 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:24.268252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12696c76-aaf9-47b0-9b15-4bbc55728059 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:24.269016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12696c76-aaf9-47b0-9b15-4bbc55728059 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:24.270138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12696c76-aaf9-47b0-9b15-4bbc55728059 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:24.270791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12696c76-aaf9-47b0-9b15-4bbc55728059 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:24.781127 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e9c8461f-f934-4442-afab-a464302d33b3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:24.795598 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e9c8461f-f934-4442-afab-a464302d33b3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1474 microversion: 2.1 time: 0.635870 May 27 14:58:24.797554 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 197/429] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:24 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1474 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:24.802890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a32d08a0-7d89-4c54-af76-f17d69f6b4d8 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:24.804191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a32d08a0-7d89-4c54-af76-f17d69f6b4d8 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:24.827313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a32d08a0-7d89-4c54-af76-f17d69f6b4d8 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:24.829961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a32d08a0-7d89-4c54-af76-f17d69f6b4d8 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:24.833837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a32d08a0-7d89-4c54-af76-f17d69f6b4d8 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:24.834557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a32d08a0-7d89-4c54-af76-f17d69f6b4d8 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:24.879542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-12696c76-aaf9-47b0-9b15-4bbc55728059 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:24.888644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-12696c76-aaf9-47b0-9b15-4bbc55728059 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:24.890201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-12696c76-aaf9-47b0-9b15-4bbc55728059 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:24.894940 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-12696c76-aaf9-47b0-9b15-4bbc55728059 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1362 microversion: 2.25 time: 0.663433 May 27 14:58:24.909309 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 233/430] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:24 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1362 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:24.914286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ed9a8c9f-8038-4b2d-b68f-4ddcfeca5004 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:24.915720 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ed9a8c9f-8038-4b2d-b68f-4ddcfeca5004 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] [instance: a7898281-77eb-40ed-8047-11d39b2ae6e2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:24.922825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed9a8c9f-8038-4b2d-b68f-4ddcfeca5004 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:24.923585 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed9a8c9f-8038-4b2d-b68f-4ddcfeca5004 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:24.925212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed9a8c9f-8038-4b2d-b68f-4ddcfeca5004 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:24.925926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed9a8c9f-8038-4b2d-b68f-4ddcfeca5004 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:25.292713 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ed9a8c9f-8038-4b2d-b68f-4ddcfeca5004 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4174aebd284775894cc0047cf5247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960898bbaeac4cd1b5394df898d419bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:25.304006 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ed9a8c9f-8038-4b2d-b68f-4ddcfeca5004 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] 10.222.0.13 "GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2" status: 200 len: 1323 microversion: 2.1 time: 0.393263 May 27 14:58:25.309642 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 234/431] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:24 2022] GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2 => generated 1323 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:25.325354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-9805b7eb-bc09-4774-bd8a-6e298948ddfa req-9999293d-8a82-4441-8315-e59a0e47e2bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7898281-77eb-40ed-8047-11d39b2ae6e2", "tag": "9443d9f4-fcf4-4a68-a375-58b54cfa47fe"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:25.361384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9805b7eb-bc09-4774-bd8a-6e298948ddfa req-9999293d-8a82-4441-8315-e59a0e47e2bd service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:25.369400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9805b7eb-bc09-4774-bd8a-6e298948ddfa req-9999293d-8a82-4441-8315-e59a0e47e2bd service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:25.416175 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-9805b7eb-bc09-4774-bd8a-6e298948ddfa req-9999293d-8a82-4441-8315-e59a0e47e2bd service nova] Creating event network-changed:9443d9f4-fcf4-4a68-a375-58b54cfa47fe for instance a7898281-77eb-40ed-8047-11d39b2ae6e2 on n-h2-843621-1 May 27 14:58:25.434188 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-9805b7eb-bc09-4774-bd8a-6e298948ddfa req-9999293d-8a82-4441-8315-e59a0e47e2bd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112620 May 27 14:58:25.440255 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 235/432] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 14:58:25.817489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8f6718d7-9d83-44e9-8f17-3acfd2420a18 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:25.818639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8f6718d7-9d83-44e9-8f17-3acfd2420a18 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:25.832409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f6718d7-9d83-44e9-8f17-3acfd2420a18 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:25.834295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f6718d7-9d83-44e9-8f17-3acfd2420a18 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:25.836519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f6718d7-9d83-44e9-8f17-3acfd2420a18 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:25.840130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f6718d7-9d83-44e9-8f17-3acfd2420a18 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:25.912717 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a32d08a0-7d89-4c54-af76-f17d69f6b4d8 tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe" status: 200 len: 1610 microversion: 2.1 time: 1.111159 May 27 14:58:25.925787 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 198/433] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:24 2022] GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe => generated 1610 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:25.935862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-380e021d-8878-4f5d-8da0-ec8f3700c45a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:25.937669 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-380e021d-8878-4f5d-8da0-ec8f3700c45a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:25.952197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-380e021d-8878-4f5d-8da0-ec8f3700c45a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:25.952728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-380e021d-8878-4f5d-8da0-ec8f3700c45a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:25.954703 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-380e021d-8878-4f5d-8da0-ec8f3700c45a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:25.955157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-380e021d-8878-4f5d-8da0-ec8f3700c45a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:26.642987 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-380e021d-8878-4f5d-8da0-ec8f3700c45a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:26.659665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8f6718d7-9d83-44e9-8f17-3acfd2420a18 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:26.670974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-380e021d-8878-4f5d-8da0-ec8f3700c45a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:26.672331 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8f6718d7-9d83-44e9-8f17-3acfd2420a18 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1473 microversion: 2.1 time: 0.862180 May 27 14:58:26.677902 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 236/434] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:25 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1473 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:58:26.685307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-380e021d-8878-4f5d-8da0-ec8f3700c45a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:26.688327 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-380e021d-8878-4f5d-8da0-ec8f3700c45a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1362 microversion: 2.25 time: 0.760636 May 27 14:58:26.699200 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-78e1ac42-ba0e-40f4-af54-6ed5c338636e tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:26.700838 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 199/435] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:25 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1362 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:26.706111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c2af96a4-2b6d-49a9-9248-52197b68437b tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:26.707010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c2af96a4-2b6d-49a9-9248-52197b68437b tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] [instance: a7898281-77eb-40ed-8047-11d39b2ae6e2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:26.708079 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:26.708079 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:26.711288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78e1ac42-ba0e-40f4-af54-6ed5c338636e tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:26.712282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78e1ac42-ba0e-40f4-af54-6ed5c338636e tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:26.713131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78e1ac42-ba0e-40f4-af54-6ed5c338636e tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:26.713575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78e1ac42-ba0e-40f4-af54-6ed5c338636e tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:26.716862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2af96a4-2b6d-49a9-9248-52197b68437b tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:26.717547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2af96a4-2b6d-49a9-9248-52197b68437b tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:26.718564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2af96a4-2b6d-49a9-9248-52197b68437b tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:26.719393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2af96a4-2b6d-49a9-9248-52197b68437b tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:26.791078 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-78e1ac42-ba0e-40f4-af54-6ed5c338636e tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.111993 May 27 14:58:26.797779 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 237/436] 10.222.0.13 () {58 vars in 1175 bytes} [Fri May 27 14:58:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:26.803254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cfbd1c36-3cd6-444c-a050-36249ee89bca tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-843621-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:26.804927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cfbd1c36-3cd6-444c-a050-36249ee89bca tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:26.811554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cfbd1c36-3cd6-444c-a050-36249ee89bca tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:26.812511 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cfbd1c36-3cd6-444c-a050-36249ee89bca tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:26.813617 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cfbd1c36-3cd6-444c-a050-36249ee89bca tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:26.814317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cfbd1c36-3cd6-444c-a050-36249ee89bca tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:26.844608 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-cfbd1c36-3cd6-444c-a050-36249ee89bca tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Lazy-loading 'flavor' on Instance uuid dcd481fb-2d54-4881-a697-db93d9623fbe {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:58:26.863789 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-cfbd1c36-3cd6-444c-a050-36249ee89bca tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance dcd481fb-2d54-4881-a697-db93d9623fbe while it is in vm_state suspended May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cfbd1c36-3cd6-444c-a050-36249ee89bca tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Request method failure captured: May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe/action HTTP/1.1 May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 97 May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObndzlkEjKsr0bzvH9xNC4Sqh44uXt_35xAPDV3B-YyHxA7f2Hh9xGkRmz_mGG_EulworP4gskoHyoXWspuY4KBn_9tL0AvoYmx2VRUrp_GDQJycVH4hp17wBqjDnj_ZO3MApmoq3m2aS0Z9uncP4OBgynbEA5xLhmi9VmUJujYYPk May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 67139342377d4aa699892c2ff4e0e75f May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-LiveMigrationNegativeTest-894384242 May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:58:26.866146 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:58:26.867386 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/67139342377d4aa699892c2ff4e0e75f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/67139342377d4aa699892c2ff4e0e75f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/67139342377d4aa699892c2ff4e0e75f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_67139342377d4aa699892c2ff4e0e75f", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:26.867386 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-LiveMigrationNegativeTest-894384242 May 27 14:58:26.867386 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 67139342377d4aa699892c2ff4e0e75f May 27 14:58:26.867386 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-894384242 May 27 14:58:26.867386 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-LiveMigrationNegativeTest-894384242-project-admin May 27 14:58:26.867386 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:26.867386 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:26.867386 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: ddf9c2bf5533479c8ac4846381f1739d May 27 14:58:26.867386 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-LiveMigrationNegativeTest-894384242-project-admin May 27 14:58:26.867386 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:58:26.867386 n-d-843621-1 devstack@n-api.service[119248]: {"os-migrateLive": {"host": "n-h2-843621-1", "block_migration": true, "disk_over_commit": false}} May 27 14:58:26.867386 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:58:26.868117 n-d-843621-1 devstack@n-api.service[119248]: exception: Cannot 'os-migrateLive' instance dcd481fb-2d54-4881-a697-db93d9623fbe while it is in vm_state suspended May 27 14:58:26.868117 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'dcd481fb-2d54-4881-a697-db93d9623fbe', 'body': {'os-migrateLive': {'host': 'n-h2-843621-1', 'block_migration': True, 'disk_over_commit': False}}} May 27 14:58:26.868117 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:26.868117 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:26.868117 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live May 27 14:58:26.868117 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, May 27 14:58:26.868117 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 27 14:58:26.868117 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 14:58:26.868117 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 27 14:58:26.868117 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 27 14:58:26.868117 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 27 14:58:26.868117 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 14:58:26.868117 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 27 14:58:26.868117 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 27 14:58:26.868117 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 27 14:58:26.868117 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 14:58:26.868117 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 27 14:58:26.868117 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 14:58:26.869137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 14:58:26.869137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 14:58:26.869137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 14:58:26.869137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 14:58:26.869137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dcd481fb-2d54-4881-a697-db93d9623fbe in vm_state suspended. Cannot live_migrate while the instance is in this state. May 27 14:58:26.869137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:26.869137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:26.869137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:26.869137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:26.869137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:26.869137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:26.869137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:26.869137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:26.869137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:26.869137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:26.869137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:58:26.869137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:58:26.869137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:58:26.869137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:58:26.869137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:58:26.870276 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:58:26.870276 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 27 14:58:26.870276 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live May 27 14:58:26.870276 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 14:58:26.870276 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 14:58:26.870276 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 14:58:26.870276 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance dcd481fb-2d54-4881-a697-db93d9623fbe while it is in vm_state suspended May 27 14:58:26.870276 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:26.870276 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:26.870276 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:26.870276 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:26.870276 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:26.870276 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:26.870276 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:26.870276 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:26.870276 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance dcd481fb-2d54-4881-a697-db93d9623fbe while it is in vm_state suspended May 27 14:58:26.870276 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:26.873289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cfbd1c36-3cd6-444c-a050-36249ee89bca tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance dcd481fb-2d54-4881-a697-db93d9623fbe while it is in vm_state suspended {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:26.874415 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cfbd1c36-3cd6-444c-a050-36249ee89bca tempest-LiveMigrationNegativeTest-894384242 tempest-LiveMigrationNegativeTest-894384242-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe/action" status: 409 len: 155 microversion: 2.1 time: 0.075012 May 27 14:58:26.880605 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 238/437] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 14:58:26 2022] POST /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe/action => generated 155 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 14:58:26.888928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d376691a-0ded-459e-a6d2-84aa8d33d0af tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:26.889772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d376691a-0ded-459e-a6d2-84aa8d33d0af tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:26.906679 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d376691a-0ded-459e-a6d2-84aa8d33d0af tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:26.907495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d376691a-0ded-459e-a6d2-84aa8d33d0af tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:26.908513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d376691a-0ded-459e-a6d2-84aa8d33d0af tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:26.909203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d376691a-0ded-459e-a6d2-84aa8d33d0af tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:26.958385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d376691a-0ded-459e-a6d2-84aa8d33d0af tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 14:58:27.078605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c2af96a4-2b6d-49a9-9248-52197b68437b tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4174aebd284775894cc0047cf5247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960898bbaeac4cd1b5394df898d419bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:27.090014 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c2af96a4-2b6d-49a9-9248-52197b68437b tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] 10.222.0.13 "GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2" status: 200 len: 1323 microversion: 2.1 time: 0.387785 May 27 14:58:27.094392 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 200/438] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:26 2022] GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2 => generated 1323 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:27.120443 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-0e26f9dc-a2a5-4a66-830c-aff4e9bf09f6 req-a416744a-0a91-4648-b31b-e36cbf29c734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37dbb2d-08d2-4f90-9c36-d373a0dec9d5", "name": "network-vif-unplugged", "status": "completed", "tag": "a88e358c-7366-488d-b011-77c43429e37d"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:27.135860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0e26f9dc-a2a5-4a66-830c-aff4e9bf09f6 req-a416744a-0a91-4648-b31b-e36cbf29c734 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:27.136903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0e26f9dc-a2a5-4a66-830c-aff4e9bf09f6 req-a416744a-0a91-4648-b31b-e36cbf29c734 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:27.146099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:27.171291 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-0e26f9dc-a2a5-4a66-830c-aff4e9bf09f6 req-a416744a-0a91-4648-b31b-e36cbf29c734 service nova] Creating event network-vif-unplugged:a88e358c-7366-488d-b011-77c43429e37d for instance f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 on n-h2-843621-1 May 27 14:58:27.201503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [req-0e26f9dc-a2a5-4a66-830c-aff4e9bf09f6 req-a416744a-0a91-4648-b31b-e36cbf29c734 service nova] Instance f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119249) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 14:58:27.226784 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-0e26f9dc-a2a5-4a66-830c-aff4e9bf09f6 req-a416744a-0a91-4648-b31b-e36cbf29c734 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110341 May 27 14:58:27.229468 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 201/439] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 14:58:27.310947 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d376691a-0ded-459e-a6d2-84aa8d33d0af tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe" status: 204 len: 0 microversion: 2.1 time: 0.428615 May 27 14:58:27.312473 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 239/440] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 14:58:26 2022] DELETE /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 14:58:27.322547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e252e2a6-6294-4ce3-ad80-3ed4a92af2fe tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:27.323443 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e252e2a6-6294-4ce3-ad80-3ed4a92af2fe tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:27.340061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e252e2a6-6294-4ce3-ad80-3ed4a92af2fe tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:27.341166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e252e2a6-6294-4ce3-ad80-3ed4a92af2fe tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:27.342173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e252e2a6-6294-4ce3-ad80-3ed4a92af2fe tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:27.343766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e252e2a6-6294-4ce3-ad80-3ed4a92af2fe tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:27.495005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-1c25e0ef-fd78-49f5-95a1-4d174a265fc5 req-56b22ba7-786d-4dc5-a79f-2e47f3f74e44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3d494d-8dd1-49b1-a94a-d17aa943e4e4", "tag": "20c204bd-a0e4-4b3a-88e0-34bca47af413"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:27.522821 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-1c25e0ef-fd78-49f5-95a1-4d174a265fc5 req-56b22ba7-786d-4dc5-a79f-2e47f3f74e44 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:27.523334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-1c25e0ef-fd78-49f5-95a1-4d174a265fc5 req-56b22ba7-786d-4dc5-a79f-2e47f3f74e44 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:27.564258 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-1c25e0ef-fd78-49f5-95a1-4d174a265fc5 req-56b22ba7-786d-4dc5-a79f-2e47f3f74e44 service nova] Creating event network-changed:20c204bd-a0e4-4b3a-88e0-34bca47af413 for instance ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 on n-h2-843621-1 May 27 14:58:27.590080 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-1c25e0ef-fd78-49f5-95a1-4d174a265fc5 req-56b22ba7-786d-4dc5-a79f-2e47f3f74e44 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101672 May 27 14:58:27.590850 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 240/441] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 27 14:58:27.691487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d99cbe35-ef6b-4d88-83c6-8fb282f30f27 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:27.692201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d99cbe35-ef6b-4d88-83c6-8fb282f30f27 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:27.707959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d99cbe35-ef6b-4d88-83c6-8fb282f30f27 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:27.710306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d99cbe35-ef6b-4d88-83c6-8fb282f30f27 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:27.711503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d99cbe35-ef6b-4d88-83c6-8fb282f30f27 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:27.721082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d99cbe35-ef6b-4d88-83c6-8fb282f30f27 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:27.786300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e252e2a6-6294-4ce3-ad80-3ed4a92af2fe tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:27.801201 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e252e2a6-6294-4ce3-ad80-3ed4a92af2fe tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe" status: 200 len: 1465 microversion: 2.1 time: 0.483923 May 27 14:58:27.801796 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 202/442] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:27 2022] GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe => generated 1465 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:58:27.824199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1535cd32-00f3-4910-828b-56699b5eaf6d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:27.825113 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1535cd32-00f3-4910-828b-56699b5eaf6d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:27.849032 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1535cd32-00f3-4910-828b-56699b5eaf6d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:27.849585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1535cd32-00f3-4910-828b-56699b5eaf6d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:27.850393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1535cd32-00f3-4910-828b-56699b5eaf6d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:27.851019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1535cd32-00f3-4910-828b-56699b5eaf6d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:28.308068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d99cbe35-ef6b-4d88-83c6-8fb282f30f27 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:28.313147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:28.328442 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d99cbe35-ef6b-4d88-83c6-8fb282f30f27 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1473 microversion: 2.1 time: 0.642116 May 27 14:58:28.331245 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 241/443] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:27 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1473 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:28.341873 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-05cc4cdf-c745-4678-87dc-f46f816a0fb0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:28.342709 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-05cc4cdf-c745-4678-87dc-f46f816a0fb0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] [instance: a7898281-77eb-40ed-8047-11d39b2ae6e2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:28.364728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:28.384855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05cc4cdf-c745-4678-87dc-f46f816a0fb0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:28.385491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05cc4cdf-c745-4678-87dc-f46f816a0fb0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:28.386281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05cc4cdf-c745-4678-87dc-f46f816a0fb0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:28.386721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05cc4cdf-c745-4678-87dc-f46f816a0fb0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:28.479559 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1535cd32-00f3-4910-828b-56699b5eaf6d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:28.500343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1535cd32-00f3-4910-828b-56699b5eaf6d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:28.506667 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1535cd32-00f3-4910-828b-56699b5eaf6d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:28.510003 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1535cd32-00f3-4910-828b-56699b5eaf6d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1362 microversion: 2.25 time: 0.702725 May 27 14:58:28.522521 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 203/444] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:27 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1362 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:28.807974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-05cc4cdf-c745-4678-87dc-f46f816a0fb0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4174aebd284775894cc0047cf5247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960898bbaeac4cd1b5394df898d419bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:28.822785 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-05cc4cdf-c745-4678-87dc-f46f816a0fb0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] 10.222.0.13 "GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2" status: 200 len: 1323 microversion: 2.1 time: 0.485871 May 27 14:58:28.832405 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 242/445] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:28 2022] GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2 => generated 1323 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:28.996005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-66cb38ba-d17d-4662-97e8-adfa147d2e9f tempest-QuotaClassesAdminTestJSON-2024589883 tempest-QuotaClassesAdminTestJSON-2024589883-project-admin] Calling method '.version_select at 0x7fc7772379d0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:28.998965 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:28.998965 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:29.045248 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-66cb38ba-d17d-4662-97e8-adfa147d2e9f tempest-QuotaClassesAdminTestJSON-2024589883 tempest-QuotaClassesAdminTestJSON-2024589883-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.507857 May 27 14:58:29.052947 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 204/446] 10.222.0.13 () {58 vars in 1184 bytes} [Fri May 27 14:58:28 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 14:58:29.060079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-080425a0-214b-4f09-98a8-80f0dd6cbee5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:29.062965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-080425a0-214b-4f09-98a8-80f0dd6cbee5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:29.074839 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-080425a0-214b-4f09-98a8-80f0dd6cbee5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:29.075873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-080425a0-214b-4f09-98a8-80f0dd6cbee5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:29.076979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-080425a0-214b-4f09-98a8-80f0dd6cbee5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:29.079533 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-080425a0-214b-4f09-98a8-80f0dd6cbee5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:29.085902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fbc4a193-e8ea-4731-84c6-bf5d114b15b7 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Calling method '.version_select at 0x7fc77710e0d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:29.088063 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:29.088063 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:29.089580 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fbc4a193-e8ea-4731-84c6-bf5d114b15b7 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:29.090034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fbc4a193-e8ea-4731-84c6-bf5d114b15b7 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:29.090840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fbc4a193-e8ea-4731-84c6-bf5d114b15b7 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:29.091275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fbc4a193-e8ea-4731-84c6-bf5d114b15b7 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:29.134850 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fbc4a193-e8ea-4731-84c6-bf5d114b15b7 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.300462 May 27 14:58:29.136904 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 243/447] 10.222.0.13 () {58 vars in 1127 bytes} [Fri May 27 14:58:28 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:29.142266 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6d4b8d94-1219-4455-b4f3-874ed66e7e05 tempest-QuotaClassesAdminTestJSON-2024589883 tempest-QuotaClassesAdminTestJSON-2024589883-project-admin] Action: 'update', calling method: .version_select at 0x7fc77710eb80>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:29.147610 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:29.147610 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:29.224598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=4,nova_api:UPDATE=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:29.715613 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-080425a0-214b-4f09-98a8-80f0dd6cbee5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:29.732564 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-080425a0-214b-4f09-98a8-80f0dd6cbee5 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe" status: 200 len: 1465 microversion: 2.1 time: 0.680738 May 27 14:58:29.735555 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 205/448] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:29 2022] GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe => generated 1465 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:29.791030 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6d4b8d94-1219-4455-b4f3-874ed66e7e05 tempest-QuotaClassesAdminTestJSON-2024589883 tempest-QuotaClassesAdminTestJSON-2024589883-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.652546 May 27 14:58:29.792137 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 244/449] 10.222.0.13 () {60 vars in 1205 bytes} [Fri May 27 14:58:29 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:29.797657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-6549fa5c-164b-47e9-8136-0cce123f869b req-bd26b4fc-0cc1-456d-b7a1-332b7d5ca1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f37dbb2d-08d2-4f90-9c36-d373a0dec9d5", "tag": "a88e358c-7366-488d-b011-77c43429e37d"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:29.809085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-6549fa5c-164b-47e9-8136-0cce123f869b req-bd26b4fc-0cc1-456d-b7a1-332b7d5ca1a4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:29.810251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-6549fa5c-164b-47e9-8136-0cce123f869b req-bd26b4fc-0cc1-456d-b7a1-332b7d5ca1a4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:29.845369 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-6549fa5c-164b-47e9-8136-0cce123f869b req-bd26b4fc-0cc1-456d-b7a1-332b7d5ca1a4 service nova] Creating event network-changed:a88e358c-7366-488d-b011-77c43429e37d for instance f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 on n-h2-843621-1 May 27 14:58:29.865203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [req-6549fa5c-164b-47e9-8136-0cce123f869b req-bd26b4fc-0cc1-456d-b7a1-332b7d5ca1a4 service nova] Instance f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119248) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 14:58:29.885618 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-6549fa5c-164b-47e9-8136-0cce123f869b req-bd26b4fc-0cc1-456d-b7a1-332b7d5ca1a4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092034 May 27 14:58:29.890485 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 245/450] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:29.900608 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e68638bd-1df5-438b-95e9-b24683fb9fd5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:29.903908 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e68638bd-1df5-438b-95e9-b24683fb9fd5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:29.922767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e68638bd-1df5-438b-95e9-b24683fb9fd5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:29.926407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e68638bd-1df5-438b-95e9-b24683fb9fd5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:29.929098 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e68638bd-1df5-438b-95e9-b24683fb9fd5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:29.930100 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e68638bd-1df5-438b-95e9-b24683fb9fd5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:30.095445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3505631f-deed-4917-a6ff-6c6e38b013b8 tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Calling method '.version_select at 0x7fc777237b80>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:30.096785 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:30.096785 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:30.098627 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3505631f-deed-4917-a6ff-6c6e38b013b8 tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '2e28e6d86e7d452e8e5f156eb0c4f04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a028aa3c1742848c50decb8d5d1342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3505631f-deed-4917-a6ff-6c6e38b013b8 tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Request method failure captured: May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-hosts HTTP/1.1 May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOcS8jQjkEfqyQxvX-grg1-h7X8abUg77Z0QKET7hpQvwA3V8ylHHg3gL2WAMkT49mg0qlYcL2tt1Zqms7c7L-n6hCh-6FLVEMGQvtCbCCuN5r640SWZsdiDDtULTxbuto6kY_DeuaXT0WuvFr8qT9KCTgrN3EhL5h0uYFkcykE3zAE May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 56a028aa3c1742848c50decb8d5d1342 May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1480510465 May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:58:30.100893 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:58:30.102880 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/56a028aa3c1742848c50decb8d5d1342"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/56a028aa3c1742848c50decb8d5d1342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/56a028aa3c1742848c50decb8d5d1342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_56a028aa3c1742848c50decb8d5d1342", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:30.102880 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1480510465 May 27 14:58:30.102880 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 56a028aa3c1742848c50decb8d5d1342 May 27 14:58:30.102880 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1480510465 May 27 14:58:30.102880 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-HostsAdminNegativeTestJSON-1480510465-project May 27 14:58:30.102880 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:30.102880 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:30.102880 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 2e28e6d86e7d452e8e5f156eb0c4f04a May 27 14:58:30.102880 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1480510465-project May 27 14:58:30.102880 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 14:58:30.102880 n-d-843621-1 devstack@n-api.service[119249]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 27 14:58:30.102880 n-d-843621-1 devstack@n-api.service[119249]: action_args: {} May 27 14:58:30.102880 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:30.103787 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:30.103787 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:30.103787 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:30.103787 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:30.103787 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:30.103787 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:30.103787 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:30.103787 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 14:58:30.103787 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:58:30.103787 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:30.103787 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:30.103787 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index May 27 14:58:30.103787 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', May 27 14:58:30.103787 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:58:30.103787 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:58:30.103787 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:58:30.103787 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:58:30.103787 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:30.103787 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:30.105025 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:30.105025 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:30.105025 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:58:30.105025 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:58:30.105025 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:58:30.105025 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:58:30.105025 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:58:30.105025 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:58:30.105025 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 27 14:58:30.105025 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:30.105025 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:30.105025 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:30.105025 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:30.105025 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:30.105025 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:30.105025 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:58:30.105025 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:58:30.105025 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 27 14:58:30.105025 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:30.107103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3505631f-deed-4917-a6ff-6c6e38b013b8 tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:30.108145 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3505631f-deed-4917-a6ff-6c6e38b013b8 tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] 10.222.0.13 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.370588 May 27 14:58:30.114367 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 206/451] 10.222.0.13 () {58 vars in 1127 bytes} [Fri May 27 14:58:29 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 378 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:30.120387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2261260f-3b37-4e73-86ff-dca57b0012f6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:30.121322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2261260f-3b37-4e73-86ff-dca57b0012f6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:30.136452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2261260f-3b37-4e73-86ff-dca57b0012f6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:30.137636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2261260f-3b37-4e73-86ff-dca57b0012f6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:30.138918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2261260f-3b37-4e73-86ff-dca57b0012f6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:30.139846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2261260f-3b37-4e73-86ff-dca57b0012f6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:30.562722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2261260f-3b37-4e73-86ff-dca57b0012f6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:30.576137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e68638bd-1df5-438b-95e9-b24683fb9fd5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:30.588818 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e68638bd-1df5-438b-95e9-b24683fb9fd5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1473 microversion: 2.1 time: 0.694651 May 27 14:58:30.589646 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 246/452] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:29 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1473 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:30.594611 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2261260f-3b37-4e73-86ff-dca57b0012f6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:30.597343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2261260f-3b37-4e73-86ff-dca57b0012f6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:30.603157 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2261260f-3b37-4e73-86ff-dca57b0012f6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1362 microversion: 2.25 time: 0.484817 May 27 14:58:30.604081 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 207/453] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:30 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1362 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:30.631028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c212bdd9-332c-4e3a-8fbe-816f8217974d tempest-QuotaClassesAdminTestJSON-2024589883 tempest-QuotaClassesAdminTestJSON-2024589883-project-admin] Calling method '.version_select at 0x7fc777222d30>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:30.633523 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:30.633523 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:30.652421 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c212bdd9-332c-4e3a-8fbe-816f8217974d tempest-QuotaClassesAdminTestJSON-2024589883 tempest-QuotaClassesAdminTestJSON-2024589883-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.060220 May 27 14:58:30.663673 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 247/454] 10.222.0.13 () {58 vars in 1184 bytes} [Fri May 27 14:58:30 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:30.670299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-422a64d2-d9ea-4230-81d8-fa623c9e14b0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:30.673033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-422a64d2-d9ea-4230-81d8-fa623c9e14b0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] [instance: a7898281-77eb-40ed-8047-11d39b2ae6e2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:30.685849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-422a64d2-d9ea-4230-81d8-fa623c9e14b0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:30.686102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-422a64d2-d9ea-4230-81d8-fa623c9e14b0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:30.687078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-422a64d2-d9ea-4230-81d8-fa623c9e14b0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:30.687544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-422a64d2-d9ea-4230-81d8-fa623c9e14b0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:30.872094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7cfeb195-d9a0-4b9a-92bd-9b4105ca62b3 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-476944930", "id": 1343190976, "os-flavor-access:is_public": "False"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:30.874288 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:30.874288 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:30.907499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:30.912947 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7cfeb195-d9a0-4b9a-92bd-9b4105ca62b3 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.307758 May 27 14:58:30.914088 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 208/455] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:58:30 2022] POST /compute/v2.1/flavors => generated 438 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:30.919631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1024213b-e67f-47a9-b40f-d4caedd49232 tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Calling method '.version_select at 0x7fc7772addc0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:30.920719 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:30.920719 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:30.922562 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1024213b-e67f-47a9-b40f-d4caedd49232 tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '2e28e6d86e7d452e8e5f156eb0c4f04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a028aa3c1742848c50decb8d5d1342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1024213b-e67f-47a9-b40f-d4caedd49232 tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Request method failure captured: May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-hosts/n-d-843621-1/reboot HTTP/1.1 May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOcS8jQjkEfqyQxvX-grg1-h7X8abUg77Z0QKET7hpQvwA3V8ylHHg3gL2WAMkT49mg0qlYcL2tt1Zqms7c7L-n6hCh-6FLVEMGQvtCbCCuN5r640SWZsdiDDtULTxbuto6kY_DeuaXT0WuvFr8qT9KCTgrN3EhL5h0uYFkcykE3zAE May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 56a028aa3c1742848c50decb8d5d1342 May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1480510465 May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:58:30.925042 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:58:30.928388 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/56a028aa3c1742848c50decb8d5d1342"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/56a028aa3c1742848c50decb8d5d1342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/56a028aa3c1742848c50decb8d5d1342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_56a028aa3c1742848c50decb8d5d1342", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:30.928388 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1480510465 May 27 14:58:30.928388 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 56a028aa3c1742848c50decb8d5d1342 May 27 14:58:30.928388 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1480510465 May 27 14:58:30.928388 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-HostsAdminNegativeTestJSON-1480510465-project May 27 14:58:30.928388 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:30.928388 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:30.928388 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 2e28e6d86e7d452e8e5f156eb0c4f04a May 27 14:58:30.928388 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1480510465-project May 27 14:58:30.928388 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 14:58:30.928388 n-d-843621-1 devstack@n-api.service[119249]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 27 14:58:30.928388 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'n-d-843621-1'} May 27 14:58:30.928388 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:30.929443 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:30.929443 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:30.929443 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:30.929443 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:30.929443 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:30.929443 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:30.929443 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:30.929443 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:30.929443 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:30.929443 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot May 27 14:58:30.929443 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', May 27 14:58:30.929443 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:58:30.929443 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:58:30.929443 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:58:30.929443 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:58:30.929443 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:30.929443 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:30.929443 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:30.929443 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:30.931890 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:58:30.931890 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:58:30.931890 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:58:30.931890 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:58:30.931890 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:58:30.931890 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:58:30.931890 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 27 14:58:30.931890 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:30.931890 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:30.931890 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:30.931890 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:30.931890 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:30.931890 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:30.931890 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:58:30.931890 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:58:30.931890 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 27 14:58:30.931890 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:30.933665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1024213b-e67f-47a9-b40f-d4caedd49232 tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:30.933665 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1024213b-e67f-47a9-b40f-d4caedd49232 tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] 10.222.0.13 "GET /compute/v2.1/os-hosts/n-d-843621-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.011138 May 27 14:58:30.933912 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 209/456] 10.222.0.13 () {58 vars in 1187 bytes} [Fri May 27 14:58:30 2022] GET /compute/v2.1/os-hosts/n-d-843621-1/reboot => generated 111 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:30.939345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5bc88f69-91fc-4b53-bd9c-55d3bae21ad4 tempest-QuotaClassesAdminTestJSON-2024589883 tempest-QuotaClassesAdminTestJSON-2024589883-project-admin] Action: 'update', calling method: .version_select at 0x7fc7771ea3a0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:30.944102 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:30.944102 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:31.156133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-422a64d2-d9ea-4230-81d8-fa623c9e14b0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4174aebd284775894cc0047cf5247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960898bbaeac4cd1b5394df898d419bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:31.161993 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5bc88f69-91fc-4b53-bd9c-55d3bae21ad4 tempest-QuotaClassesAdminTestJSON-2024589883 tempest-QuotaClassesAdminTestJSON-2024589883-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.226916 May 27 14:58:31.164520 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 210/457] 10.222.0.13 () {60 vars in 1205 bytes} [Fri May 27 14:58:30 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:31.175864 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-422a64d2-d9ea-4230-81d8-fa623c9e14b0 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] 10.222.0.13 "GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2" status: 200 len: 1323 microversion: 2.1 time: 0.509449 May 27 14:58:31.176891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0fda16ac-521e-422d-88c7-46f7054289c2 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:31.177831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0fda16ac-521e-422d-88c7-46f7054289c2 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:31.178288 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 248/458] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:30 2022] GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2 => generated 1323 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:31.187044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2b38db29-63c0-4794-95ec-b2f68bc75379 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9b49665b90464c9184d71d37eb93bc06"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:31.192518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0fda16ac-521e-422d-88c7-46f7054289c2 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:31.193006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0fda16ac-521e-422d-88c7-46f7054289c2 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:31.194861 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:31.194861 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:31.200158 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0fda16ac-521e-422d-88c7-46f7054289c2 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:31.200803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0fda16ac-521e-422d-88c7-46f7054289c2 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:31.363230 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0fda16ac-521e-422d-88c7-46f7054289c2 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:31.374653 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0fda16ac-521e-422d-88c7-46f7054289c2 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe" status: 200 len: 1423 microversion: 2.1 time: 0.204765 May 27 14:58:31.376995 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 211/459] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:31 2022] GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe => generated 1423 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:31.382143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f680eb36-a121-4e2d-8b30-4f8991ccfb03 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Calling method '.version_select at 0x7fc7771ea550>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:31.383233 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:31.383233 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:31.392920 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-f680eb36-a121-4e2d-8b30-4f8991ccfb03 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f680eb36-a121-4e2d-8b30-4f8991ccfb03 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Request method failure captured: May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOcUVV9Sg9IHqHIpzBuyD_u52PIYj1_BCtLmBi2xK_UlgqKDpxD_hGEmQyhKxlpzjInogVijaQLdyblSKoTcmOeHbyWzlgs62-L0bgRkGBN__ED-gvN2BT1MeyUxQPRMXojTssN45AbVM2Zd2taXZ3Q8ym7J3pb_j_VwbgVPZerEKAg May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 7335f0b7bbd44f6eaaf319b5f81a4196 May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,admin,member May 27 14:58:31.395631 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,admin,member May 27 14:58:31.396868 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7335f0b7bbd44f6eaaf319b5f81a4196", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:31.396868 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:31.396868 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 7335f0b7bbd44f6eaaf319b5f81a4196 May 27 14:58:31.396868 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:31.396868 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-HostsAdminNegativeTestJSON-1263435792-project-admin May 27 14:58:31.396868 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:31.396868 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:31.396868 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 45d8e05fd04846938b19f27541988377 May 27 14:58:31.396868 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1263435792-project-admin May 27 14:58:31.396868 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 14:58:31.396868 n-d-843621-1 devstack@n-api.service[119249]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:31.396868 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'nonexistent_hostname'} May 27 14:58:31.396868 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:31.397595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.397595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 27 14:58:31.397595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 27 14:58:31.397595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 27 14:58:31.397595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 27 14:58:31.397595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:31.397595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:31.397595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:31.397595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:31.397595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 27 14:58:31.397595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 27 14:58:31.397595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 27 14:58:31.397595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 27 14:58:31.397595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:58:31.397595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:58:31.397595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 27 14:58:31.397595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 27 14:58:31.397595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 14:58:31.397595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 14:58:31.398625 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 27 14:58:31.398625 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 27 14:58:31.398625 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:31.398625 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.398625 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:31.398625 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.398625 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.398625 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:31.398625 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:31.398625 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:31.398625 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:31.398625 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:31.398625 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:31.398625 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:31.398625 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:31.398625 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot May 27 14:58:31.398625 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") May 27 14:58:31.398625 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 27 14:58:31.398625 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 14:58:31.400197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:31.400197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.400197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:31.400197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.400197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.400197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:31.400197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:31.400197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:31.400197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:31.400197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:31.400197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.402448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f680eb36-a121-4e2d-8b30-4f8991ccfb03 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:31.402930 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2b38db29-63c0-4794-95ec-b2f68bc75379 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1343190976/action" status: 200 len: 97 microversion: 2.1 time: 0.222945 May 27 14:58:31.404120 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f680eb36-a121-4e2d-8b30-4f8991ccfb03 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.025950 May 27 14:58:31.404952 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 212/460] 10.222.0.13 () {58 vars in 1211 bytes} [Fri May 27 14:58:31 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 14:58:31.405687 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 249/461] 10.222.0.13 () {60 vars in 1199 bytes} [Fri May 27 14:58:31 2022] POST /compute/v2.1/flavors/1343190976/action => generated 97 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 14:58:31.415930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9ca1e3f1-4955-439e-8a5c-db95491444e6 tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Calling method '.version_select at 0x7fc777232ca0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:31.417200 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:31.417200 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:31.418592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9ca1e3f1-4955-439e-8a5c-db95491444e6 tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '2e28e6d86e7d452e8e5f156eb0c4f04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a028aa3c1742848c50decb8d5d1342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:31.419017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3f6aab9c-818d-4c21-854c-9e9aabf77800 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9b49665b90464c9184d71d37eb93bc06"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9ca1e3f1-4955-439e-8a5c-db95491444e6 tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Request method failure captured: May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-hosts/n-d-843621-1 HTTP/1.1 May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOcS8jQjkEfqyQxvX-grg1-h7X8abUg77Z0QKET7hpQvwA3V8ylHHg3gL2WAMkT49mg0qlYcL2tt1Zqms7c7L-n6hCh-6FLVEMGQvtCbCCuN5r640SWZsdiDDtULTxbuto6kY_DeuaXT0WuvFr8qT9KCTgrN3EhL5h0uYFkcykE3zAE May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 56a028aa3c1742848c50decb8d5d1342 May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1480510465 May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:58:31.420792 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:58:31.422065 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/56a028aa3c1742848c50decb8d5d1342"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/56a028aa3c1742848c50decb8d5d1342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/56a028aa3c1742848c50decb8d5d1342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_56a028aa3c1742848c50decb8d5d1342", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:31.422065 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1480510465 May 27 14:58:31.422065 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 56a028aa3c1742848c50decb8d5d1342 May 27 14:58:31.422065 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1480510465 May 27 14:58:31.422065 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-HostsAdminNegativeTestJSON-1480510465-project May 27 14:58:31.422065 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:31.422065 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:31.422065 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 2e28e6d86e7d452e8e5f156eb0c4f04a May 27 14:58:31.422065 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1480510465-project May 27 14:58:31.422065 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 14:58:31.422065 n-d-843621-1 devstack@n-api.service[119249]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 27 14:58:31.422065 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'n-d-843621-1'} May 27 14:58:31.422065 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:31.422843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.422843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:31.422843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:31.422843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:31.422843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:31.422843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:31.422843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:31.422843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:31.422843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:31.422843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show May 27 14:58:31.422843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', May 27 14:58:31.422843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:58:31.422843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:58:31.422843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:58:31.422843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:58:31.422843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:31.422843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:31.422843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:31.422843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:31.423851 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:58:31.423851 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:58:31.423851 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:58:31.423851 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:58:31.423851 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:58:31.423851 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:58:31.423851 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 27 14:58:31.423851 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.423851 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:31.423851 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.423851 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.423851 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:31.423851 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:31.423851 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:58:31.423851 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:58:31.423851 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 27 14:58:31.423851 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.428058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9ca1e3f1-4955-439e-8a5c-db95491444e6 tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:31.429135 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9ca1e3f1-4955-439e-8a5c-db95491444e6 tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] 10.222.0.13 "GET /compute/v2.1/os-hosts/n-d-843621-1" status: 403 len: 109 microversion: 2.1 time: 0.019162 May 27 14:58:31.430744 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 213/462] 10.222.0.13 () {58 vars in 1166 bytes} [Fri May 27 14:58:31 2022] GET /compute/v2.1/os-hosts/n-d-843621-1 => generated 109 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:31.460009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0bf37fb7-fe21-4d1c-a5a1-6a67599ece3d tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Calling method '.version_select at 0x7fc777232ca0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:31.470691 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-0bf37fb7-fe21-4d1c-a5a1-6a67599ece3d tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0bf37fb7-fe21-4d1c-a5a1-6a67599ece3d tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Request method failure captured: May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOcUVV9Sg9IHqHIpzBuyD_u52PIYj1_BCtLmBi2xK_UlgqKDpxD_hGEmQyhKxlpzjInogVijaQLdyblSKoTcmOeHbyWzlgs62-L0bgRkGBN__ED-gvN2BT1MeyUxQPRMXojTssN45AbVM2Zd2taXZ3Q8ym7J3pb_j_VwbgVPZerEKAg May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 7335f0b7bbd44f6eaaf319b5f81a4196 May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,admin,member May 27 14:58:31.472397 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,admin,member May 27 14:58:31.473745 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7335f0b7bbd44f6eaaf319b5f81a4196", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:31.473745 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:31.473745 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 7335f0b7bbd44f6eaaf319b5f81a4196 May 27 14:58:31.473745 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:31.473745 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-HostsAdminNegativeTestJSON-1263435792-project-admin May 27 14:58:31.473745 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:31.473745 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:31.473745 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 45d8e05fd04846938b19f27541988377 May 27 14:58:31.473745 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1263435792-project-admin May 27 14:58:31.473745 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 14:58:31.473745 n-d-843621-1 devstack@n-api.service[119249]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:31.473745 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'nonexistent_hostname'} May 27 14:58:31.473745 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:31.474438 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.474438 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show May 27 14:58:31.474438 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 27 14:58:31.474438 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:58:31.474438 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:58:31.474438 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 27 14:58:31.474438 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 27 14:58:31.474438 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 14:58:31.474438 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 14:58:31.474438 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 27 14:58:31.474438 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 27 14:58:31.474438 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:31.474438 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.474438 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:31.474438 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.474438 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.474438 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:31.474438 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:31.474438 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:31.475870 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:31.475870 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:31.475870 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:31.475870 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:31.475870 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:31.475870 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show May 27 14:58:31.475870 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 14:58:31.475870 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:31.475870 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.475870 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:31.475870 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.475870 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.475870 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:31.475870 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:31.475870 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:31.475870 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:31.475870 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:31.475870 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.477023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0bf37fb7-fe21-4d1c-a5a1-6a67599ece3d tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:31.477023 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0bf37fb7-fe21-4d1c-a5a1-6a67599ece3d tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.024180 May 27 14:58:31.477023 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 214/463] 10.222.0.13 () {58 vars in 1190 bytes} [Fri May 27 14:58:31 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 14:58:31.484397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0f6646e6-235e-4a61-ad6f-224c031f6f4b tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Calling method '.version_select at 0x7fc7771eae50>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:31.485463 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:31.485463 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:31.487143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0f6646e6-235e-4a61-ad6f-224c031f6f4b tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '2e28e6d86e7d452e8e5f156eb0c4f04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a028aa3c1742848c50decb8d5d1342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0f6646e6-235e-4a61-ad6f-224c031f6f4b tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Request method failure captured: May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-hosts/n-d-843621-1/shutdown HTTP/1.1 May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOcS8jQjkEfqyQxvX-grg1-h7X8abUg77Z0QKET7hpQvwA3V8ylHHg3gL2WAMkT49mg0qlYcL2tt1Zqms7c7L-n6hCh-6FLVEMGQvtCbCCuN5r640SWZsdiDDtULTxbuto6kY_DeuaXT0WuvFr8qT9KCTgrN3EhL5h0uYFkcykE3zAE May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 56a028aa3c1742848c50decb8d5d1342 May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1480510465 May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:58:31.490230 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:58:31.491411 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/56a028aa3c1742848c50decb8d5d1342"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/56a028aa3c1742848c50decb8d5d1342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/56a028aa3c1742848c50decb8d5d1342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_56a028aa3c1742848c50decb8d5d1342", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:31.491411 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1480510465 May 27 14:58:31.491411 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 56a028aa3c1742848c50decb8d5d1342 May 27 14:58:31.491411 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1480510465 May 27 14:58:31.491411 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-HostsAdminNegativeTestJSON-1480510465-project May 27 14:58:31.491411 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:31.491411 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:31.491411 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 2e28e6d86e7d452e8e5f156eb0c4f04a May 27 14:58:31.491411 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1480510465-project May 27 14:58:31.491411 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 14:58:31.491411 n-d-843621-1 devstack@n-api.service[119249]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 27 14:58:31.491411 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'n-d-843621-1'} May 27 14:58:31.491411 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:31.492106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.492106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:31.492106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:31.492106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:31.492106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:31.492106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:31.492106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:31.492106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:31.492106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:31.492106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown May 27 14:58:31.492106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', May 27 14:58:31.492106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:58:31.492106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:58:31.492106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:58:31.492106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:58:31.492106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:31.492106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:31.492106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:31.492106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:31.494856 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:58:31.494856 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:58:31.494856 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:58:31.494856 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:58:31.494856 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:58:31.494856 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:58:31.494856 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 27 14:58:31.494856 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.494856 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:31.494856 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.494856 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.494856 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:31.494856 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:31.494856 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:58:31.494856 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:58:31.494856 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 27 14:58:31.494856 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.498631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0f6646e6-235e-4a61-ad6f-224c031f6f4b tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:31.499970 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0f6646e6-235e-4a61-ad6f-224c031f6f4b tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] 10.222.0.13 "GET /compute/v2.1/os-hosts/n-d-843621-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.020211 May 27 14:58:31.517165 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 215/464] 10.222.0.13 () {58 vars in 1193 bytes} [Fri May 27 14:58:31 2022] GET /compute/v2.1/os-hosts/n-d-843621-1/shutdown => generated 113 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 27 14:58:31.530708 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8309d17c-ef04-4c89-b2f8-f4fdc11e8bb8 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Calling method '.version_select at 0x7fc77733e940>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:31.544232 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-8309d17c-ef04-4c89-b2f8-f4fdc11e8bb8 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8309d17c-ef04-4c89-b2f8-f4fdc11e8bb8 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Request method failure captured: May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOcUVV9Sg9IHqHIpzBuyD_u52PIYj1_BCtLmBi2xK_UlgqKDpxD_hGEmQyhKxlpzjInogVijaQLdyblSKoTcmOeHbyWzlgs62-L0bgRkGBN__ED-gvN2BT1MeyUxQPRMXojTssN45AbVM2Zd2taXZ3Q8ym7J3pb_j_VwbgVPZerEKAg May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 7335f0b7bbd44f6eaaf319b5f81a4196 May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,admin,member May 27 14:58:31.547742 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,admin,member May 27 14:58:31.548880 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7335f0b7bbd44f6eaaf319b5f81a4196", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:31.548880 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:31.548880 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 7335f0b7bbd44f6eaaf319b5f81a4196 May 27 14:58:31.548880 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:31.548880 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-HostsAdminNegativeTestJSON-1263435792-project-admin May 27 14:58:31.548880 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:31.548880 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:31.548880 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 45d8e05fd04846938b19f27541988377 May 27 14:58:31.548880 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1263435792-project-admin May 27 14:58:31.548880 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 14:58:31.548880 n-d-843621-1 devstack@n-api.service[119249]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:31.548880 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'nonexistent_hostname'} May 27 14:58:31.548880 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:31.549924 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.549924 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 27 14:58:31.549924 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 27 14:58:31.549924 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 27 14:58:31.549924 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 27 14:58:31.549924 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:31.549924 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:31.549924 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:31.549924 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:31.549924 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 27 14:58:31.549924 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 27 14:58:31.549924 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 27 14:58:31.549924 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 27 14:58:31.549924 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:58:31.549924 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:58:31.549924 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 27 14:58:31.549924 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 27 14:58:31.549924 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 14:58:31.549924 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 14:58:31.552634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 27 14:58:31.552634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 27 14:58:31.552634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:31.552634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.552634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:31.552634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.552634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.552634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:31.552634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:31.552634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:31.552634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:31.552634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:31.552634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:31.552634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:31.552634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:31.552634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown May 27 14:58:31.552634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") May 27 14:58:31.552634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 27 14:58:31.552634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 14:58:31.555592 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:31.555592 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.555592 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:31.555592 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.555592 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.555592 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:31.555592 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:31.555592 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:31.555592 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:31.555592 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:31.555592 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.555592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8309d17c-ef04-4c89-b2f8-f4fdc11e8bb8 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:31.555592 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8309d17c-ef04-4c89-b2f8-f4fdc11e8bb8 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.031732 May 27 14:58:31.560385 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 216/465] 10.222.0.13 () {58 vars in 1217 bytes} [Fri May 27 14:58:31 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 14:58:31.571323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cc6a1bce-2653-4abf-b988-9a5f8664e9fe tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Calling method '.version_select at 0x7fc7771eadc0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:31.572219 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:31.572219 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:31.573493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cc6a1bce-2653-4abf-b988-9a5f8664e9fe tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '2e28e6d86e7d452e8e5f156eb0c4f04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a028aa3c1742848c50decb8d5d1342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:31.573855 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-3f6aab9c-818d-4c21-854c-9e9aabf77800 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] HTTP exception thrown: Flavor access already exists for flavor 32 and project 9b49665b90464c9184d71d37eb93bc06 combination. May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cc6a1bce-2653-4abf-b988-9a5f8664e9fe tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Request method failure captured: May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-hosts/n-d-843621-1/startup HTTP/1.1 May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOcS8jQjkEfqyQxvX-grg1-h7X8abUg77Z0QKET7hpQvwA3V8ylHHg3gL2WAMkT49mg0qlYcL2tt1Zqms7c7L-n6hCh-6FLVEMGQvtCbCCuN5r640SWZsdiDDtULTxbuto6kY_DeuaXT0WuvFr8qT9KCTgrN3EhL5h0uYFkcykE3zAE May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 56a028aa3c1742848c50decb8d5d1342 May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1480510465 May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:58:31.574996 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:58:31.576426 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/56a028aa3c1742848c50decb8d5d1342"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/56a028aa3c1742848c50decb8d5d1342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/56a028aa3c1742848c50decb8d5d1342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_56a028aa3c1742848c50decb8d5d1342", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:31.576426 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1480510465 May 27 14:58:31.576426 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 56a028aa3c1742848c50decb8d5d1342 May 27 14:58:31.576426 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1480510465 May 27 14:58:31.576426 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-HostsAdminNegativeTestJSON-1480510465-project May 27 14:58:31.576426 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:31.576426 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:31.576426 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 2e28e6d86e7d452e8e5f156eb0c4f04a May 27 14:58:31.576426 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1480510465-project May 27 14:58:31.576426 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 14:58:31.576426 n-d-843621-1 devstack@n-api.service[119249]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 27 14:58:31.576426 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'n-d-843621-1'} May 27 14:58:31.576426 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:31.577369 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.577369 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:31.577369 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:31.577369 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:31.577369 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:31.577369 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:31.577369 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:31.577369 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:31.577369 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:31.577369 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup May 27 14:58:31.577369 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', May 27 14:58:31.577369 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:58:31.577369 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:58:31.577369 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:58:31.577369 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:58:31.577369 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:31.577369 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:31.577369 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:31.577369 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:31.581889 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:58:31.581889 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:58:31.581889 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:58:31.581889 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:58:31.581889 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:58:31.581889 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:58:31.581889 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 27 14:58:31.581889 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.581889 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:31.581889 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.581889 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.581889 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:31.581889 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:31.581889 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:58:31.581889 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:58:31.581889 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 27 14:58:31.581889 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.582837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cc6a1bce-2653-4abf-b988-9a5f8664e9fe tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:31.582837 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cc6a1bce-2653-4abf-b988-9a5f8664e9fe tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] 10.222.0.13 "GET /compute/v2.1/os-hosts/n-d-843621-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.014977 May 27 14:58:31.582962 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 217/466] 10.222.0.13 () {58 vars in 1190 bytes} [Fri May 27 14:58:31 2022] GET /compute/v2.1/os-hosts/n-d-843621-1/startup => generated 110 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:31.591520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e103ac33-ea01-4ee4-9f5a-b7a420833279 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Calling method '.version_select at 0x7fc7771db700>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3f6aab9c-818d-4c21-854c-9e9aabf77800 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Request method failure captured: May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/flavors/1343190976/action HTTP/1.1 May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 67 May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOcUt_VdW2ZGkHfz4ffPpoXK-ov1_FeTmlpZBRwVMhGMZU6MObwWEhKOLkiz4SQwQQhLS6SyzQIkNTK4jyWuJ1UiHTklrGQCGMl5IEsnZankJCIUVcLybu9Owyx4AvbnLqjZvp4GRakYlF8feF3c8kzTkcizPT0W0wzeo8wcOCViqs0 May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: cab41c249ae3486eb70af7dd19dcf564 May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-973620264 May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:58:31.595256 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:58:31.596703 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cab41c249ae3486eb70af7dd19dcf564"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cab41c249ae3486eb70af7dd19dcf564"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/cab41c249ae3486eb70af7dd19dcf564"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_cab41c249ae3486eb70af7dd19dcf564", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:31.596703 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-973620264 May 27 14:58:31.596703 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: cab41c249ae3486eb70af7dd19dcf564 May 27 14:58:31.596703 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-973620264 May 27 14:58:31.596703 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin May 27 14:58:31.596703 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:31.596703 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:31.596703 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 6699dd79b5ed4c81b17c681bbd293c8b May 27 14:58:31.596703 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin May 27 14:58:31.596703 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:58:31.596703 n-d-843621-1 devstack@n-api.service[119248]: {"addTenantAccess": {"tenant": "9b49665b90464c9184d71d37eb93bc06"}} May 27 14:58:31.596703 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:58:31.597698 n-d-843621-1 devstack@n-api.service[119248]: exception: Flavor access already exists for flavor 32 and project 9b49665b90464c9184d71d37eb93bc06 combination. May 27 14:58:31.597698 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '1343190976', 'body': {'addTenantAccess': {'tenant': '9b49665b90464c9184d71d37eb93bc06'}}} May 27 14:58:31.597698 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:31.597698 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.597698 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 14:58:31.597698 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 27 14:58:31.597698 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 14:58:31.597698 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 27 14:58:31.597698 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 14:58:31.597698 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = self._query(query) May 27 14:58:31.597698 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 14:58:31.597698 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi conn.query(q) May 27 14:58:31.597698 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 14:58:31.597698 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 14:58:31.597698 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 14:58:31.597698 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result.read() May 27 14:58:31.597698 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 14:58:31.597698 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 27 14:58:31.598861 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 14:58:31.598861 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 27 14:58:31.598861 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 14:58:31.598861 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 27 14:58:31.598861 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 14:58:31.598861 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 27 14:58:31.598861 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '32-9b49665b90464c9184d71d37eb93bc06' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") May 27 14:58:31.598861 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:31.598861 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 27 14:58:31.598861 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:31.598861 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.598861 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project May 27 14:58:31.598861 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi project.save(context.session) May 27 14:58:31.598861 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 27 14:58:31.598861 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi session.flush() May 27 14:58:31.598861 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 14:58:31.598861 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._flush(objects) May 27 14:58:31.598861 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 14:58:31.598861 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 27 14:58:31.600432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 14:58:31.600432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi compat.raise_( May 27 14:58:31.600432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 14:58:31.600432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception May 27 14:58:31.600432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 14:58:31.600432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi flush_context.execute() May 27 14:58:31.600432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 14:58:31.600432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi rec.execute(self) May 27 14:58:31.600432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 14:58:31.600432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 27 14:58:31.600432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 14:58:31.600432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 27 14:58:31.600432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 27 14:58:31.600432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 27 14:58:31.600432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 14:58:31.600432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 27 14:58:31.600432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 14:58:31.600432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 27 14:58:31.601585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 14:58:31.601585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 27 14:58:31.601585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 14:58:31.601585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 27 14:58:31.601585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 14:58:31.601585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 14:58:31.601585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 14:58:31.601585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception May 27 14:58:31.601585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 14:58:31.601585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 27 14:58:31.601585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 14:58:31.601585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 27 14:58:31.601585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 14:58:31.601585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = self._query(query) May 27 14:58:31.601585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 14:58:31.601585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi conn.query(q) May 27 14:58:31.601585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 14:58:31.601585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 14:58:31.602855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 14:58:31.602855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result.read() May 27 14:58:31.602855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 14:58:31.602855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 27 14:58:31.602855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 14:58:31.602855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 27 14:58:31.602855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 14:58:31.602855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 27 14:58:31.602855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 14:58:31.602855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 27 14:58:31.602855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '32-9b49665b90464c9184d71d37eb93bc06' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") May 27 14:58:31.602855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] May 27 14:58:31.602855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 27, 14, 58, 31, 566186), 'updated_at': None, 'flavor_id': 32, 'project_id': '9b49665b90464c9184d71d37eb93bc06'}] May 27 14:58:31.602855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 14:58:31.602855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:31.602855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:31.602855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:31.604026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.604026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access May 27 14:58:31.604026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) May 27 14:58:31.604026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 27 14:58:31.604026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 27 14:58:31.604026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access May 27 14:58:31.604026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._add_access(project_id) May 27 14:58:31.604026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access May 27 14:58:31.604026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) May 27 14:58:31.604026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project May 27 14:58:31.604026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) May 27 14:58:31.604026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 14:58:31.604026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 14:58:31.604026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project May 27 14:58:31.604026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, May 27 14:58:31.604026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 32 and project 9b49665b90464c9184d71d37eb93bc06 combination. May 27 14:58:31.604026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:31.604026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:31.604026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:31.605286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.605286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:31.605286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:31.605286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:31.605286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:31.605286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:31.605286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:31.605286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:58:31.605286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:58:31.605286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access May 27 14:58:31.605286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) May 27 14:58:31.605286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 32 and project 9b49665b90464c9184d71d37eb93bc06 combination. May 27 14:58:31.605286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:31.605286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:31.605286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:31.605286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.605286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:31.605286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:31.605286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:31.605286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:31.607226 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 32 and project 9b49665b90464c9184d71d37eb93bc06 combination. May 27 14:58:31.607226 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:31.607226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3f6aab9c-818d-4c21-854c-9e9aabf77800 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Returning 409 to user: Flavor access already exists for flavor 32 and project 9b49665b90464c9184d71d37eb93bc06 combination. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:31.608634 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3f6aab9c-818d-4c21-854c-9e9aabf77800 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1343190976/action" status: 409 len: 152 microversion: 2.1 time: 0.195411 May 27 14:58:31.612037 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 250/467] 10.222.0.13 () {60 vars in 1199 bytes} [Fri May 27 14:58:31 2022] POST /compute/v2.1/flavors/1343190976/action => generated 152 bytes in 201 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 14:58:31.614498 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-e103ac33-ea01-4ee4-9f5a-b7a420833279 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e103ac33-ea01-4ee4-9f5a-b7a420833279 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Request method failure captured: May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOcUVV9Sg9IHqHIpzBuyD_u52PIYj1_BCtLmBi2xK_UlgqKDpxD_hGEmQyhKxlpzjInogVijaQLdyblSKoTcmOeHbyWzlgs62-L0bgRkGBN__ED-gvN2BT1MeyUxQPRMXojTssN45AbVM2Zd2taXZ3Q8ym7J3pb_j_VwbgVPZerEKAg May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 7335f0b7bbd44f6eaaf319b5f81a4196 May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,admin,member May 27 14:58:31.616552 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,admin,member May 27 14:58:31.618522 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7335f0b7bbd44f6eaaf319b5f81a4196", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:31.618522 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:31.618522 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 7335f0b7bbd44f6eaaf319b5f81a4196 May 27 14:58:31.618522 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:31.618522 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-HostsAdminNegativeTestJSON-1263435792-project-admin May 27 14:58:31.618522 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:31.618522 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:31.618522 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 45d8e05fd04846938b19f27541988377 May 27 14:58:31.618522 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1263435792-project-admin May 27 14:58:31.618522 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 14:58:31.618522 n-d-843621-1 devstack@n-api.service[119249]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:31.618522 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'nonexistent_hostname'} May 27 14:58:31.618522 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:31.620014 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.620014 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 27 14:58:31.620014 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 27 14:58:31.620014 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 27 14:58:31.620014 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 27 14:58:31.620014 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:31.620014 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:31.620014 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:31.620014 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:31.620014 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 27 14:58:31.620014 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 27 14:58:31.620014 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 27 14:58:31.620014 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 27 14:58:31.620014 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:58:31.620014 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:58:31.620014 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 27 14:58:31.620014 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 27 14:58:31.620014 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 14:58:31.620014 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 14:58:31.621559 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 27 14:58:31.621559 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 27 14:58:31.621559 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:31.621559 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.621559 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:31.621559 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.621559 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.621559 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:31.621559 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:31.621559 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:31.621559 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:31.621559 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:31.621559 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:31.621559 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:31.621559 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:31.621559 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup May 27 14:58:31.621559 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") May 27 14:58:31.621559 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 27 14:58:31.621559 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 14:58:31.622826 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:31.622826 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.622826 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:31.622826 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.622826 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:31.622826 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:31.622826 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:31.622826 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:31.622826 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:31.622826 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:31.622826 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:31.625846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e103ac33-ea01-4ee4-9f5a-b7a420833279 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:31.627290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-77bc16b3-0ddc-492c-9c7a-710e326aa96f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:31.628547 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e103ac33-ea01-4ee4-9f5a-b7a420833279 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.041703 May 27 14:58:31.629206 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 218/468] 10.222.0.13 () {58 vars in 1214 bytes} [Fri May 27 14:58:31 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 14:58:31.634555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-77bc16b3-0ddc-492c-9c7a-710e326aa96f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:31.644312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c66ba1bd-cd5f-487c-9e82-b31ddfd780e1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:31.647498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c66ba1bd-cd5f-487c-9e82-b31ddfd780e1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:31.650951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77bc16b3-0ddc-492c-9c7a-710e326aa96f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:31.651512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77bc16b3-0ddc-492c-9c7a-710e326aa96f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:31.652515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77bc16b3-0ddc-492c-9c7a-710e326aa96f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:31.653088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77bc16b3-0ddc-492c-9c7a-710e326aa96f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:31.667177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c66ba1bd-cd5f-487c-9e82-b31ddfd780e1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:31.667933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c66ba1bd-cd5f-487c-9e82-b31ddfd780e1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:31.669246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c66ba1bd-cd5f-487c-9e82-b31ddfd780e1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:31.669745 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c66ba1bd-cd5f-487c-9e82-b31ddfd780e1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:31.958485 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-77bc16b3-0ddc-492c-9c7a-710e326aa96f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:31.968529 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-77bc16b3-0ddc-492c-9c7a-710e326aa96f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1471 microversion: 2.1 time: 0.354913 May 27 14:58:31.969842 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 251/469] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:31 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1471 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:31.975536 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-568608ee-9c32-4c5b-8a7b-1a0aac82249a tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9b49665b90464c9184d71d37eb93bc06"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:31.977685 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:31.977685 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:32.020820 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c66ba1bd-cd5f-487c-9e82-b31ddfd780e1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:32.038548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c66ba1bd-cd5f-487c-9e82-b31ddfd780e1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:32.041732 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c66ba1bd-cd5f-487c-9e82-b31ddfd780e1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:32.045574 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c66ba1bd-cd5f-487c-9e82-b31ddfd780e1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1362 microversion: 2.25 time: 0.408612 May 27 14:58:32.048413 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 219/470] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:31 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1362 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:32.069225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9e033d39-a5e3-4e1f-9859-73e3644fba4c tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Action: 'update', calling method: .version_select at 0x7fc7772ada60>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9e033d39-a5e3-4e1f-9859-73e3644fba4c tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Request method failure captured: May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: request: PUT /compute/v2.1/os-hosts/n-d-843621-1 HTTP/1.1 May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 51 May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOcUVV9Sg9IHqHIpzBuyD_u52PIYj1_BCtLmBi2xK_UlgqKDpxD_hGEmQyhKxlpzjInogVijaQLdyblSKoTcmOeHbyWzlgs62-L0bgRkGBN__ED-gvN2BT1MeyUxQPRMXojTssN45AbVM2Zd2taXZ3Q8ym7J3pb_j_VwbgVPZerEKAg May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 7335f0b7bbd44f6eaaf319b5f81a4196 May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,admin,member May 27 14:58:32.082983 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,admin,member May 27 14:58:32.084562 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7335f0b7bbd44f6eaaf319b5f81a4196", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:32.084562 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:32.084562 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 7335f0b7bbd44f6eaaf319b5f81a4196 May 27 14:58:32.084562 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:32.084562 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-HostsAdminNegativeTestJSON-1263435792-project-admin May 27 14:58:32.084562 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:32.084562 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:32.084562 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 45d8e05fd04846938b19f27541988377 May 27 14:58:32.084562 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1263435792-project-admin May 27 14:58:32.084562 n-d-843621-1 devstack@n-api.service[119249]: May 27 14:58:32.084562 n-d-843621-1 devstack@n-api.service[119249]: {"status": "enable", "maintenance_mode": "invalid"} May 27 14:58:32.084562 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 14:58:32.084562 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'n-d-843621-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise error May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'disable', May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'Enable', May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'Disable', May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'ENABLE', May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi On instance: May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'invalid' May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:32.085458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:32.087098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:32.087098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:32.087098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:32.087098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:32.087098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:32.087098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:32.087098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:32.087098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 14:58:32.087098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 14:58:32.087098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 14:58:32.087098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 14:58:32.087098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 14:58:32.087098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 14:58:32.087098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 27 14:58:32.087098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:32.087098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:32.087098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:32.087098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:32.087098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:32.088348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:32.088348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 14:58:32.088348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 14:58:32.088348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 27 14:58:32.088348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:32.093242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9e033d39-a5e3-4e1f-9859-73e3644fba4c tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:32.094703 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9e033d39-a5e3-4e1f-9859-73e3644fba4c tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-hosts/n-d-843621-1" status: 400 len: 199 microversion: 2.1 time: 0.045041 May 27 14:58:32.096824 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 220/471] 10.222.0.13 () {60 vars in 1186 bytes} [Fri May 27 14:58:32 2022] PUT /compute/v2.1/os-hosts/n-d-843621-1 => generated 199 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 14:58:32.108515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-61693d1e-9860-4cd3-bd32-23618382ab04 req-4e2992ad-ae2f-41b4-a376-82da2669fc86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd481fb-2d54-4881-a697-db93d9623fbe", "name": "network-vif-deleted", "tag": "66fc9523-073d-433b-8731-d04dec899a9e"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:32.132894 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-61693d1e-9860-4cd3-bd32-23618382ab04 req-4e2992ad-ae2f-41b4-a376-82da2669fc86 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:32.136630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-61693d1e-9860-4cd3-bd32-23618382ab04 req-4e2992ad-ae2f-41b4-a376-82da2669fc86 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:32.156932 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-61693d1e-9860-4cd3-bd32-23618382ab04 req-4e2992ad-ae2f-41b4-a376-82da2669fc86 service nova] Creating event network-vif-deleted:66fc9523-073d-433b-8731-d04dec899a9e for instance dcd481fb-2d54-4881-a697-db93d9623fbe on n-h1-843621-1 May 27 14:58:32.173615 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-61693d1e-9860-4cd3-bd32-23618382ab04 req-4e2992ad-ae2f-41b4-a376-82da2669fc86 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075289 May 27 14:58:32.179271 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 221/472] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:32.196521 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-608513b5-86cb-4788-b10e-280abf012bae tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Action: 'update', calling method: .version_select at 0x7fc777232ca0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-608513b5-86cb-4788-b10e-280abf012bae tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Request method failure captured: May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: request: PUT /compute/v2.1/os-hosts/n-d-843621-1 HTTP/1.1 May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 51 May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOcUVV9Sg9IHqHIpzBuyD_u52PIYj1_BCtLmBi2xK_UlgqKDpxD_hGEmQyhKxlpzjInogVijaQLdyblSKoTcmOeHbyWzlgs62-L0bgRkGBN__ED-gvN2BT1MeyUxQPRMXojTssN45AbVM2Zd2taXZ3Q8ym7J3pb_j_VwbgVPZerEKAg May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 7335f0b7bbd44f6eaaf319b5f81a4196 May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,admin,member May 27 14:58:32.199233 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,admin,member May 27 14:58:32.200663 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7335f0b7bbd44f6eaaf319b5f81a4196", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:32.200663 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:32.200663 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 7335f0b7bbd44f6eaaf319b5f81a4196 May 27 14:58:32.200663 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:32.200663 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-HostsAdminNegativeTestJSON-1263435792-project-admin May 27 14:58:32.200663 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:32.200663 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:32.200663 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 45d8e05fd04846938b19f27541988377 May 27 14:58:32.200663 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1263435792-project-admin May 27 14:58:32.200663 n-d-843621-1 devstack@n-api.service[119249]: May 27 14:58:32.200663 n-d-843621-1 devstack@n-api.service[119249]: {"status": "invalid", "maintenance_mode": "enable"} May 27 14:58:32.200663 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 14:58:32.200663 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'n-d-843621-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise error May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'disable', May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'Enable', May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'Disable', May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'ENABLE', May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi On instance: May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'invalid' May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:32.201556 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:32.203143 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:32.203143 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:32.203143 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:32.203143 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:32.203143 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:32.203143 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:32.203143 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:32.203143 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 14:58:32.203143 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 14:58:32.203143 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 14:58:32.203143 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 14:58:32.203143 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 14:58:32.203143 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 14:58:32.203143 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 27 14:58:32.203143 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:32.203143 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:32.203143 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:32.203143 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:32.203143 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:32.204370 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:32.204370 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 14:58:32.204370 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 14:58:32.204370 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 27 14:58:32.204370 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:32.204370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-608513b5-86cb-4788-b10e-280abf012bae tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:32.204370 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-608513b5-86cb-4788-b10e-280abf012bae tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-hosts/n-d-843621-1" status: 400 len: 189 microversion: 2.1 time: 0.019222 May 27 14:58:32.204370 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 222/473] 10.222.0.13 () {60 vars in 1186 bytes} [Fri May 27 14:58:32 2022] PUT /compute/v2.1/os-hosts/n-d-843621-1 => generated 189 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 14:58:32.217475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aeadac53-7c69-462d-80fc-d25c83a66af2 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:32.218938 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-aeadac53-7c69-462d-80fc-d25c83a66af2 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] [instance: a7898281-77eb-40ed-8047-11d39b2ae6e2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:32.237649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aeadac53-7c69-462d-80fc-d25c83a66af2 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:32.238120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aeadac53-7c69-462d-80fc-d25c83a66af2 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:32.241173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aeadac53-7c69-462d-80fc-d25c83a66af2 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:32.241670 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aeadac53-7c69-462d-80fc-d25c83a66af2 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:32.327774 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-568608ee-9c32-4c5b-8a7b-1a0aac82249a tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1343190976/action" status: 200 len: 21 microversion: 2.1 time: 0.356359 May 27 14:58:32.339746 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 252/474] 10.222.0.13 () {60 vars in 1199 bytes} [Fri May 27 14:58:31 2022] POST /compute/v2.1/flavors/1343190976/action => generated 21 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 14:58:32.353844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0a86094d-426a-49a5-b626-01f2264a4708 tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Action: 'update', calling method: .version_select at 0x7fc77710eb80>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:32.366006 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:32.366006 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:32.368271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0a86094d-426a-49a5-b626-01f2264a4708 tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '2e28e6d86e7d452e8e5f156eb0c4f04a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a028aa3c1742848c50decb8d5d1342', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0a86094d-426a-49a5-b626-01f2264a4708 tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Request method failure captured: May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: request: PUT /compute/v2.1/os-hosts/n-d-843621-1 HTTP/1.1 May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 50 May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOcS8jQjkEfqyQxvX-grg1-h7X8abUg77Z0QKET7hpQvwA3V8ylHHg3gL2WAMkT49mg0qlYcL2tt1Zqms7c7L-n6hCh-6FLVEMGQvtCbCCuN5r640SWZsdiDDtULTxbuto6kY_DeuaXT0WuvFr8qT9KCTgrN3EhL5h0uYFkcykE3zAE May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 56a028aa3c1742848c50decb8d5d1342 May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1480510465 May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:58:32.375266 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:58:32.376812 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/56a028aa3c1742848c50decb8d5d1342"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/56a028aa3c1742848c50decb8d5d1342"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/56a028aa3c1742848c50decb8d5d1342"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_56a028aa3c1742848c50decb8d5d1342", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:32.376812 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1480510465 May 27 14:58:32.376812 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 56a028aa3c1742848c50decb8d5d1342 May 27 14:58:32.376812 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1480510465 May 27 14:58:32.376812 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-HostsAdminNegativeTestJSON-1480510465-project May 27 14:58:32.376812 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:32.376812 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:32.376812 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 2e28e6d86e7d452e8e5f156eb0c4f04a May 27 14:58:32.376812 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1480510465-project May 27 14:58:32.376812 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:58:32.376812 n-d-843621-1 devstack@n-api.service[119248]: {"status": "enable", "maintenance_mode": "enable"} May 27 14:58:32.376812 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 14:58:32.376812 n-d-843621-1 devstack@n-api.service[119248]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 27 14:58:32.376812 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'n-d-843621-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} May 27 14:58:32.377747 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:32.377747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:32.377747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:32.377747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:32.377747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:32.377747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:32.377747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:32.377747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:32.377747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:32.377747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:32.377747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:58:32.377747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:58:32.377747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update May 27 14:58:32.377747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', May 27 14:58:32.377747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:58:32.377747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:58:32.377747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:58:32.377747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:58:32.377747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:32.377747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:32.379030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:32.379030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:32.379030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:58:32.379030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:58:32.379030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:58:32.379030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:58:32.379030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:58:32.379030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:58:32.379030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 27 14:58:32.379030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:32.379030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:32.379030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:32.379030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:32.379030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:32.379030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:32.379030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:58:32.379030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:58:32.379030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 27 14:58:32.379030 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:32.382351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0a86094d-426a-49a5-b626-01f2264a4708 tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:32.384783 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0a86094d-426a-49a5-b626-01f2264a4708 tempest-HostsAdminNegativeTestJSON-1480510465 tempest-HostsAdminNegativeTestJSON-1480510465-project] 10.222.0.13 "PUT /compute/v2.1/os-hosts/n-d-843621-1" status: 403 len: 111 microversion: 2.1 time: 0.043045 May 27 14:58:32.388081 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 253/475] 10.222.0.13 () {60 vars in 1186 bytes} [Fri May 27 14:58:32 2022] PUT /compute/v2.1/os-hosts/n-d-843621-1 => generated 111 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:32.401237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e2b7582c-3270-4265-980b-97d642732d50 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:32.405543 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:32.405543 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:32.454260 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e2b7582c-3270-4265-980b-97d642732d50 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1343190976" status: 202 len: 0 microversion: 2.1 time: 0.064590 May 27 14:58:32.455846 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 254/476] 10.222.0.13 () {58 vars in 1160 bytes} [Fri May 27 14:58:32 2022] DELETE /compute/v2.1/flavors/1343190976 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:58:32.463985 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b0532931-6693-4856-845d-f803a640e3eb tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:32.464739 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b0532931-6693-4856-845d-f803a640e3eb tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: dcd481fb-2d54-4881-a697-db93d9623fbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:32.474966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b0532931-6693-4856-845d-f803a640e3eb tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:32.475666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b0532931-6693-4856-845d-f803a640e3eb tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:32.476612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b0532931-6693-4856-845d-f803a640e3eb tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:32.478668 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b0532931-6693-4856-845d-f803a640e3eb tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:32.522561 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-b0532931-6693-4856-845d-f803a640e3eb tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] HTTP exception thrown: Instance dcd481fb-2d54-4881-a697-db93d9623fbe could not be found. May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b0532931-6693-4856-845d-f803a640e3eb tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Request method failure captured: May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe HTTP/1.1 May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObmKL3Ihh4PB7mJ2Fw61w4TBssZUJYFlCn9W9sK7xWIJb-Q16NbL4vZwpxYXBWXwRUAVdivIb2kvYbnr9-0okXRLjDUq09uebbwYlF4oLTg6Cp8m67szSNM12sVPO0UJJmOsE5LbZywyNbI50Zlwxn0Y8ulGelGb7r-ierZTokEUaw May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 12fde8a6988b483cab0e58f2b6a35615 May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-LiveMigrationNegativeTest-1025188827 May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:58:32.528013 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:58:32.529524 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/12fde8a6988b483cab0e58f2b6a35615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/12fde8a6988b483cab0e58f2b6a35615"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/12fde8a6988b483cab0e58f2b6a35615"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_12fde8a6988b483cab0e58f2b6a35615", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:32.529524 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-LiveMigrationNegativeTest-1025188827 May 27 14:58:32.529524 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 12fde8a6988b483cab0e58f2b6a35615 May 27 14:58:32.529524 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1025188827 May 27 14:58:32.529524 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-LiveMigrationNegativeTest-1025188827-project May 27 14:58:32.529524 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:32.529524 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:32.529524 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 693e1381d34b4d58b657f2a0ea930190 May 27 14:58:32.529524 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-LiveMigrationNegativeTest-1025188827-project May 27 14:58:32.529524 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:58:32.529524 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance dcd481fb-2d54-4881-a697-db93d9623fbe could not be found. May 27 14:58:32.529524 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'dcd481fb-2d54-4881-a697-db93d9623fbe'} May 27 14:58:32.530201 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:32.530201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:32.530201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 14:58:32.530201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 14:58:32.530201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 14:58:32.530201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 14:58:32.530201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 14:58:32.530201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 14:58:32.530201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 14:58:32.530201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 14:58:32.530201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcd481fb-2d54-4881-a697-db93d9623fbe could not be found. May 27 14:58:32.530201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:32.530201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:32.530201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:32.530201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:32.530201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:32.530201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:32.530201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:32.530201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:32.530201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:32.531417 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:32.531417 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 14:58:32.531417 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 14:58:32.531417 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 14:58:32.531417 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 14:58:32.531417 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 14:58:32.531417 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 14:58:32.531417 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcd481fb-2d54-4881-a697-db93d9623fbe could not be found. May 27 14:58:32.531417 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:32.531417 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:32.531417 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:32.531417 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:32.531417 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:32.531417 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:32.531417 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:32.531417 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:32.531417 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcd481fb-2d54-4881-a697-db93d9623fbe could not be found. May 27 14:58:32.531417 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:32.548918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b0532931-6693-4856-845d-f803a640e3eb tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Returning 404 to user: Instance dcd481fb-2d54-4881-a697-db93d9623fbe could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:32.551957 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b0532931-6693-4856-845d-f803a640e3eb tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe" status: 404 len: 111 microversion: 2.1 time: 0.093727 May 27 14:58:32.553944 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 255/477] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:32 2022] GET /compute/v2.1/servers/dcd481fb-2d54-4881-a697-db93d9623fbe => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:32.564123 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d56050d5-980a-4c95-936d-2d7ed7c8b510 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Action: 'update', calling method: .version_select at 0x7fc77703fd30>, body: {"status": null, "maintenance_mode": null} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d56050d5-980a-4c95-936d-2d7ed7c8b510 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Request method failure captured: May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: request: PUT /compute/v2.1/os-hosts/n-d-843621-1 HTTP/1.1 May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 42 May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOcUVV9Sg9IHqHIpzBuyD_u52PIYj1_BCtLmBi2xK_UlgqKDpxD_hGEmQyhKxlpzjInogVijaQLdyblSKoTcmOeHbyWzlgs62-L0bgRkGBN__ED-gvN2BT1MeyUxQPRMXojTssN45AbVM2Zd2taXZ3Q8ym7J3pb_j_VwbgVPZerEKAg May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 7335f0b7bbd44f6eaaf319b5f81a4196 May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:58:32.568099 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:58:32.569386 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7335f0b7bbd44f6eaaf319b5f81a4196", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:32.569386 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:32.569386 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 7335f0b7bbd44f6eaaf319b5f81a4196 May 27 14:58:32.569386 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:32.569386 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-HostsAdminNegativeTestJSON-1263435792-project-admin May 27 14:58:32.569386 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:32.569386 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:32.569386 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 45d8e05fd04846938b19f27541988377 May 27 14:58:32.569386 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1263435792-project-admin May 27 14:58:32.569386 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:58:32.569386 n-d-843621-1 devstack@n-api.service[119248]: {"status": null, "maintenance_mode": null} May 27 14:58:32.569386 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 14:58:32.569386 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 27 14:58:32.569386 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'n-d-843621-1', 'body': {'status': None, 'maintenance_mode': None}} May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'disable', May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'Enable', May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'Disable', May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'ENABLE', May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance: May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi None May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:32.570157 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:32.571517 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:32.571517 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:32.571517 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:32.571517 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:32.571517 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:32.571517 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:32.571517 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 14:58:32.571517 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 14:58:32.571517 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 14:58:32.571517 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 14:58:32.571517 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 14:58:32.571517 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 14:58:32.571517 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 27 14:58:32.571517 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:32.571517 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:32.571517 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:32.571517 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:32.571517 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:32.571517 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:32.572539 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 14:58:32.572539 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 14:58:32.572539 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 27 14:58:32.572539 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:32.572539 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d56050d5-980a-4c95-936d-2d7ed7c8b510 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:32.572539 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d56050d5-980a-4c95-936d-2d7ed7c8b510 tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-hosts/n-d-843621-1" status: 400 len: 127 microversion: 2.1 time: 0.013574 May 27 14:58:32.572539 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 256/478] 10.222.0.13 () {60 vars in 1186 bytes} [Fri May 27 14:58:32 2022] PUT /compute/v2.1/os-hosts/n-d-843621-1 => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 14:58:32.582376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2e2984ac-1663-4b42-8fea-bc6d616e22a7 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:32.607032 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2e2984ac-1663-4b42-8fea-bc6d616e22a7 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033432 May 27 14:58:32.621073 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 257/479] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:58:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:32.627857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ad666b63-1379-4ddc-ac65-1cd478252924 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:32.628459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ad666b63-1379-4ddc-ac65-1cd478252924 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:32.638718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad666b63-1379-4ddc-ac65-1cd478252924 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:32.639200 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad666b63-1379-4ddc-ac65-1cd478252924 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:32.640611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad666b63-1379-4ddc-ac65-1cd478252924 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:32.641543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad666b63-1379-4ddc-ac65-1cd478252924 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:32.679378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ad666b63-1379-4ddc-ac65-1cd478252924 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 14:58:32.794859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=13,nova_api:UPDATE=11,nova_api:DELETE=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:32.823806 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ad666b63-1379-4ddc-ac65-1cd478252924 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad" status: 204 len: 0 microversion: 2.1 time: 0.199704 May 27 14:58:32.826231 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 258/480] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 14:58:32 2022] DELETE /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 14:58:32.833620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dff89413-0dba-455f-b35c-49381d3c4afd tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Action: 'update', calling method: .version_select at 0x7fc777679430>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:32.837046 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:32.837046 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:32.837947 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.hosts [None req-dff89413-0dba-455f-b35c-49381d3c4afd tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Enabling host nonexistent_hostname. May 27 14:58:32.849134 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-dff89413-0dba-455f-b35c-49381d3c4afd tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dff89413-0dba-455f-b35c-49381d3c4afd tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Request method failure captured: May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 50 May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOcUVV9Sg9IHqHIpzBuyD_u52PIYj1_BCtLmBi2xK_UlgqKDpxD_hGEmQyhKxlpzjInogVijaQLdyblSKoTcmOeHbyWzlgs62-L0bgRkGBN__ED-gvN2BT1MeyUxQPRMXojTssN45AbVM2Zd2taXZ3Q8ym7J3pb_j_VwbgVPZerEKAg May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 7335f0b7bbd44f6eaaf319b5f81a4196 May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 14:58:32.851720 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 14:58:32.853541 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7335f0b7bbd44f6eaaf319b5f81a4196"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7335f0b7bbd44f6eaaf319b5f81a4196", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:32.853541 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:32.853541 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 7335f0b7bbd44f6eaaf319b5f81a4196 May 27 14:58:32.853541 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1263435792 May 27 14:58:32.853541 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-HostsAdminNegativeTestJSON-1263435792-project-admin May 27 14:58:32.853541 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:32.853541 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:32.853541 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 45d8e05fd04846938b19f27541988377 May 27 14:58:32.853541 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1263435792-project-admin May 27 14:58:32.853541 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:58:32.853541 n-d-843621-1 devstack@n-api.service[119248]: {"status": "enable", "maintenance_mode": "enable"} May 27 14:58:32.853541 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 14:58:32.853541 n-d-843621-1 devstack@n-api.service[119248]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:32.853541 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} May 27 14:58:32.854304 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:32.854304 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:32.854304 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status May 27 14:58:32.854304 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) May 27 14:58:32.854304 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 27 14:58:32.854304 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 27 14:58:32.854304 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:32.854304 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:32.854304 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:32.854304 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:32.854304 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 27 14:58:32.854304 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 27 14:58:32.854304 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 27 14:58:32.854304 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 27 14:58:32.854304 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:58:32.854304 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:58:32.854304 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 27 14:58:32.854304 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 27 14:58:32.855392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 14:58:32.855392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 14:58:32.855392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 27 14:58:32.855392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 27 14:58:32.855392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:32.855392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:32.855392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:32.855392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:32.855392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:32.855392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:32.855392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:32.855392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:32.855392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:32.855392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:58:32.855392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:58:32.855392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:32.855392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:32.855392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:58:32.855392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:58:32.855392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update May 27 14:58:32.856473 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) May 27 14:58:32.856473 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status May 27 14:58:32.856473 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 14:58:32.856473 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:32.856473 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:32.856473 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:32.856473 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:32.856473 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:32.856473 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:32.856473 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:32.856473 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:32.856473 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:32.856473 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 27 14:58:32.856473 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:32.856473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dff89413-0dba-455f-b35c-49381d3c4afd tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:32.857325 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dff89413-0dba-455f-b35c-49381d3c4afd tempest-HostsAdminNegativeTestJSON-1263435792 tempest-HostsAdminNegativeTestJSON-1263435792-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.027325 May 27 14:58:32.857325 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 259/481] 10.222.0.13 () {60 vars in 1210 bytes} [Fri May 27 14:58:32 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 14:58:32.864405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-76f47998-2ea7-47fb-89ae-c168a2a8c465 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1662530958", "id": 247185778, "os-flavor-access:is_public": "True"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:32.866670 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:32.866670 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:32.888908 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-76f47998-2ea7-47fb-89ae-c168a2a8c465 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.030311 May 27 14:58:32.895051 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 260/482] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:58:32 2022] POST /compute/v2.1/flavors => generated 435 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:32.902246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0fb1688e-7f75-4ab8-86da-fc638ddaf3db tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:32.903032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0fb1688e-7f75-4ab8-86da-fc638ddaf3db tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:32.911304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0fb1688e-7f75-4ab8-86da-fc638ddaf3db tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:32.911759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0fb1688e-7f75-4ab8-86da-fc638ddaf3db tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:32.912543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0fb1688e-7f75-4ab8-86da-fc638ddaf3db tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:32.913097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0fb1688e-7f75-4ab8-86da-fc638ddaf3db tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:32.928339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-aeadac53-7c69-462d-80fc-d25c83a66af2 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4174aebd284775894cc0047cf5247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960898bbaeac4cd1b5394df898d419bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:32.938621 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-aeadac53-7c69-462d-80fc-d25c83a66af2 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] 10.222.0.13 "GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2" status: 200 len: 1323 microversion: 2.1 time: 0.736343 May 27 14:58:32.939426 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 223/483] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:32 2022] GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2 => generated 1323 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:32.945007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-51d4ad79-7001-43e1-b2d6-6e69b007fd4b tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:32.947188 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:32.947188 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:32.967401 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-51d4ad79-7001-43e1-b2d6-6e69b007fd4b tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] HTTP exception thrown: Access list not available for public flavors. May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-51d4ad79-7001-43e1-b2d6-6e69b007fd4b tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Request method failure captured: May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/flavors/247185778/os-flavor-access HTTP/1.1 May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOcUt_VdW2ZGkHfz4ffPpoXK-ov1_FeTmlpZBRwVMhGMZU6MObwWEhKOLkiz4SQwQQhLS6SyzQIkNTK4jyWuJ1UiHTklrGQCGMl5IEsnZankJCIUVcLybu9Owyx4AvbnLqjZvp4GRakYlF8feF3c8kzTkcizPT0W0wzeo8wcOCViqs0 May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: cab41c249ae3486eb70af7dd19dcf564 May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-973620264 May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,admin,member May 27 14:58:32.969325 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,admin,member May 27 14:58:32.970546 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cab41c249ae3486eb70af7dd19dcf564"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cab41c249ae3486eb70af7dd19dcf564"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/cab41c249ae3486eb70af7dd19dcf564"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_cab41c249ae3486eb70af7dd19dcf564", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:32.970546 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-973620264 May 27 14:58:32.970546 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: cab41c249ae3486eb70af7dd19dcf564 May 27 14:58:32.970546 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-973620264 May 27 14:58:32.970546 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin May 27 14:58:32.970546 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:32.970546 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:32.970546 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 6699dd79b5ed4c81b17c681bbd293c8b May 27 14:58:32.970546 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin May 27 14:58:32.970546 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 14:58:32.970546 n-d-843621-1 devstack@n-api.service[119249]: exception: Access list not available for public flavors. May 27 14:58:32.970546 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'flavor_id': '247185778'} May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. May 27 14:58:32.971202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:32.976169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-51d4ad79-7001-43e1-b2d6-6e69b007fd4b tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:32.978671 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-51d4ad79-7001-43e1-b2d6-6e69b007fd4b tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/247185778/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.038002 May 27 14:58:32.980202 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 224/484] 10.222.0.13 () {58 vars in 1205 bytes} [Fri May 27 14:58:32 2022] GET /compute/v2.1/flavors/247185778/os-flavor-access => generated 91 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 14:58:32.991375 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5e68b0f3-0396-4fda-9e8e-1eaa38b1465a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:32.994235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5e68b0f3-0396-4fda-9e8e-1eaa38b1465a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:33.026393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e68b0f3-0396-4fda-9e8e-1eaa38b1465a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:33.027027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e68b0f3-0396-4fda-9e8e-1eaa38b1465a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:33.030333 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e68b0f3-0396-4fda-9e8e-1eaa38b1465a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:33.031162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e68b0f3-0396-4fda-9e8e-1eaa38b1465a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:33.325445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0fb1688e-7f75-4ab8-86da-fc638ddaf3db tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:33.337339 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0fb1688e-7f75-4ab8-86da-fc638ddaf3db tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad" status: 200 len: 1474 microversion: 2.1 time: 0.441133 May 27 14:58:33.345418 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 261/485] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:32 2022] GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad => generated 1474 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:33.350278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e04afba3-63f4-404b-98ed-099df5ab8971 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:33.351048 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:33.351048 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:33.395344 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e04afba3-63f4-404b-98ed-099df5ab8971 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/247185778" status: 202 len: 0 microversion: 2.1 time: 0.048616 May 27 14:58:33.396245 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 262/486] 10.222.0.13 () {58 vars in 1157 bytes} [Fri May 27 14:58:33 2022] DELETE /compute/v2.1/flavors/247185778 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:58:33.402882 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-c2c9cc91-d4e9-4f18-89f8-0f7b3aa66a99 req-92c6b5aa-0a36-4bf3-bd0b-c0d41dd655d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7898281-77eb-40ed-8047-11d39b2ae6e2", "name": "network-vif-plugged", "status": "completed", "tag": "9443d9f4-fcf4-4a68-a375-58b54cfa47fe"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:33.419505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5e68b0f3-0396-4fda-9e8e-1eaa38b1465a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:33.432446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c2c9cc91-d4e9-4f18-89f8-0f7b3aa66a99 req-92c6b5aa-0a36-4bf3-bd0b-c0d41dd655d4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:33.432930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c2c9cc91-d4e9-4f18-89f8-0f7b3aa66a99 req-92c6b5aa-0a36-4bf3-bd0b-c0d41dd655d4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:33.433306 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5e68b0f3-0396-4fda-9e8e-1eaa38b1465a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1468 microversion: 2.1 time: 0.449605 May 27 14:58:33.444816 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 225/487] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:32 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1468 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:33.455672 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2e43dca3-2c6d-4679-beae-0f89f606e4be tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:33.458455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2e43dca3-2c6d-4679-beae-0f89f606e4be tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:33.472878 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e43dca3-2c6d-4679-beae-0f89f606e4be tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:33.474105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e43dca3-2c6d-4679-beae-0f89f606e4be tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:33.478540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e43dca3-2c6d-4679-beae-0f89f606e4be tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:33.479754 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e43dca3-2c6d-4679-beae-0f89f606e4be tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:33.485469 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-c2c9cc91-d4e9-4f18-89f8-0f7b3aa66a99 req-92c6b5aa-0a36-4bf3-bd0b-c0d41dd655d4 service nova] Creating event network-vif-plugged:9443d9f4-fcf4-4a68-a375-58b54cfa47fe for instance a7898281-77eb-40ed-8047-11d39b2ae6e2 on n-h2-843621-1 May 27 14:58:33.502579 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-c2c9cc91-d4e9-4f18-89f8-0f7b3aa66a99 req-92c6b5aa-0a36-4bf3-bd0b-c0d41dd655d4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101815 May 27 14:58:33.504104 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 263/488] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:33.522208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3d75534d-4fbc-41d7-b13a-bbe71075cdd9 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:33.571804 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3d75534d-4fbc-41d7-b13a-bbe71075cdd9 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063985 May 27 14:58:33.573178 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 264/489] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:58:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:33.589977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-03cf3f9c-7630-48f2-8614-2534d0cb5fca tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:33.599080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-03cf3f9c-7630-48f2-8614-2534d0cb5fca tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:33.626844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03cf3f9c-7630-48f2-8614-2534d0cb5fca tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:33.628560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03cf3f9c-7630-48f2-8614-2534d0cb5fca tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:33.637294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03cf3f9c-7630-48f2-8614-2534d0cb5fca tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:33.638152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03cf3f9c-7630-48f2-8614-2534d0cb5fca tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:33.756430 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-03cf3f9c-7630-48f2-8614-2534d0cb5fca tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "POST /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5/action" status: 204 len: 0 microversion: 2.1 time: 0.181302 May 27 14:58:33.760812 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 265/490] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 14:58:33 2022] POST /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5/action => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 14:58:33.779722 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2a2c9eb7-ac1c-4e2b-bf82-9e3517904d80 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1428600350", "id": 791451358, "os-flavor-access:is_public": "False"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:33.784207 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:33.784207 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:33.818852 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2a2c9eb7-ac1c-4e2b-bf82-9e3517904d80 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.056606 May 27 14:58:33.820241 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 266/491] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:58:33 2022] POST /compute/v2.1/flavors => generated 436 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:33.843548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d586a85e-3588-4562-b7ad-299196240093 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:33.844320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d586a85e-3588-4562-b7ad-299196240093 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:33.875823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d586a85e-3588-4562-b7ad-299196240093 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:33.877065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d586a85e-3588-4562-b7ad-299196240093 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:33.880894 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d586a85e-3588-4562-b7ad-299196240093 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:33.884413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d586a85e-3588-4562-b7ad-299196240093 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:34.134713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2e43dca3-2c6d-4679-beae-0f89f606e4be tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:34.148461 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2e43dca3-2c6d-4679-beae-0f89f606e4be tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:34.152082 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2e43dca3-2c6d-4679-beae-0f89f606e4be tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:34.154543 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2e43dca3-2c6d-4679-beae-0f89f606e4be tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1362 microversion: 2.25 time: 0.714970 May 27 14:58:34.158073 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 226/492] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:33 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1362 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:34.438761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d586a85e-3588-4562-b7ad-299196240093 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:34.451370 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d586a85e-3588-4562-b7ad-299196240093 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1468 microversion: 2.1 time: 0.630340 May 27 14:58:34.454240 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 267/493] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:33 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1468 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:34.473495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-12c73ba0-54a9-4f32-a9e2-ded192aae0c1 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:34.475292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-12c73ba0-54a9-4f32-a9e2-ded192aae0c1 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] [instance: a7898281-77eb-40ed-8047-11d39b2ae6e2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:34.491090 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12c73ba0-54a9-4f32-a9e2-ded192aae0c1 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:34.493756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12c73ba0-54a9-4f32-a9e2-ded192aae0c1 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:34.495994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12c73ba0-54a9-4f32-a9e2-ded192aae0c1 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:34.496861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12c73ba0-54a9-4f32-a9e2-ded192aae0c1 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:34.714222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-09db9054-a44b-451b-8ff0-0a3dc37fb775 tempest-FlavorsAccessNegativeTestJSON-955124031 tempest-FlavorsAccessNegativeTestJSON-955124031-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9b49665b90464c9184d71d37eb93bc06"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:34.717312 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:34.717312 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:34.718753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-09db9054-a44b-451b-8ff0-0a3dc37fb775 tempest-FlavorsAccessNegativeTestJSON-955124031 tempest-FlavorsAccessNegativeTestJSON-955124031-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '0adc6da848f3475d9e700dd0d33ce6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49665b90464c9184d71d37eb93bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-09db9054-a44b-451b-8ff0-0a3dc37fb775 tempest-FlavorsAccessNegativeTestJSON-955124031 tempest-FlavorsAccessNegativeTestJSON-955124031-project] Request method failure captured: May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/flavors/791451358/action HTTP/1.1 May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 67 May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOcSha51reBt8ACKENkINaoHHVT__gWsYLZCHojo1liKa0zJB40iZOw2KYzR3WIteGIUe0z1jY8ex_4KM-oItdD0qCEt_OtjyfJYhvoI3BgyaM7kYNbF-tue-bj0SlOSMI9Tes2r1ltU05xo-oecpvRaU2bvIGh4IIh5MV-4-hj7G_4 May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 9b49665b90464c9184d71d37eb93bc06 May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-955124031 May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:58:34.722777 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:58:34.724229 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9b49665b90464c9184d71d37eb93bc06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9b49665b90464c9184d71d37eb93bc06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9b49665b90464c9184d71d37eb93bc06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9b49665b90464c9184d71d37eb93bc06", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:34.724229 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-955124031 May 27 14:58:34.724229 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 9b49665b90464c9184d71d37eb93bc06 May 27 14:58:34.724229 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-955124031 May 27 14:58:34.724229 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-FlavorsAccessNegativeTestJSON-955124031-project May 27 14:58:34.724229 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:34.724229 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:34.724229 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 0adc6da848f3475d9e700dd0d33ce6f6 May 27 14:58:34.724229 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-955124031-project May 27 14:58:34.724229 n-d-843621-1 devstack@n-api.service[119249]: May 27 14:58:34.724229 n-d-843621-1 devstack@n-api.service[119249]: {"addTenantAccess": {"tenant": "9b49665b90464c9184d71d37eb93bc06"}} May 27 14:58:34.724229 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 14:58:34.725072 n-d-843621-1 devstack@n-api.service[119249]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 27 14:58:34.725072 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '791451358', 'body': {'addTenantAccess': {'tenant': '9b49665b90464c9184d71d37eb93bc06'}}} May 27 14:58:34.725072 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:34.725072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:34.725072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:34.725072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:34.725072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:34.725072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:34.725072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:34.725072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:34.725072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:58:34.725072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:58:34.725072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access May 27 14:58:34.725072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) May 27 14:58:34.725072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:58:34.725072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:58:34.725072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:58:34.725072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:58:34.725072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:34.726260 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:34.726260 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:34.726260 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:34.726260 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:58:34.726260 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:58:34.726260 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:58:34.726260 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:58:34.726260 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:58:34.726260 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:58:34.726260 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 27 14:58:34.726260 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:34.726260 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:34.726260 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:34.726260 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:34.726260 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:34.726260 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:34.726260 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:58:34.726260 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:58:34.726260 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 27 14:58:34.726260 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:34.729336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-09db9054-a44b-451b-8ff0-0a3dc37fb775 tempest-FlavorsAccessNegativeTestJSON-955124031 tempest-FlavorsAccessNegativeTestJSON-955124031-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:34.731607 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-09db9054-a44b-451b-8ff0-0a3dc37fb775 tempest-FlavorsAccessNegativeTestJSON-955124031 tempest-FlavorsAccessNegativeTestJSON-955124031-project] 10.222.0.13 "POST /compute/v2.1/flavors/791451358/action" status: 403 len: 130 microversion: 2.1 time: 0.572211 May 27 14:58:34.735572 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 227/494] 10.222.0.13 () {60 vars in 1196 bytes} [Fri May 27 14:58:34 2022] POST /compute/v2.1/flavors/791451358/action => generated 130 bytes in 577 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:34.759036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c9da0bb0-a42b-4fcf-91b5-7b47a12afefc tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:34.764057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c9da0bb0-a42b-4fcf-91b5-7b47a12afefc tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:34.793949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9da0bb0-a42b-4fcf-91b5-7b47a12afefc tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:34.794677 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9da0bb0-a42b-4fcf-91b5-7b47a12afefc tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:34.797162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9da0bb0-a42b-4fcf-91b5-7b47a12afefc tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:34.800587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9da0bb0-a42b-4fcf-91b5-7b47a12afefc tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:35.453410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-12c73ba0-54a9-4f32-a9e2-ded192aae0c1 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4174aebd284775894cc0047cf5247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960898bbaeac4cd1b5394df898d419bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:35.467938 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-12c73ba0-54a9-4f32-a9e2-ded192aae0c1 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] 10.222.0.13 "GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2" status: 200 len: 1323 microversion: 2.1 time: 1.012809 May 27 14:58:35.479112 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 268/495] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:34 2022] GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2 => generated 1323 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:35.479112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-372dcabe-1961-4dbf-a0bd-1d47354a1619 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:35.479112 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:35.479112 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:35.516528 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-372dcabe-1961-4dbf-a0bd-1d47354a1619 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/791451358" status: 202 len: 0 microversion: 2.1 time: 0.043704 May 27 14:58:35.517828 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 269/496] 10.222.0.13 () {58 vars in 1157 bytes} [Fri May 27 14:58:35 2022] DELETE /compute/v2.1/flavors/791451358 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:58:35.532433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2dad4746-42e5-416f-b912-8c35fb422ebd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:35.533164 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2dad4746-42e5-416f-b912-8c35fb422ebd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:35.547670 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2dad4746-42e5-416f-b912-8c35fb422ebd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:35.550043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2dad4746-42e5-416f-b912-8c35fb422ebd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:35.551690 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2dad4746-42e5-416f-b912-8c35fb422ebd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:35.552711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2dad4746-42e5-416f-b912-8c35fb422ebd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:35.637309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c9da0bb0-a42b-4fcf-91b5-7b47a12afefc tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e1381d34b4d58b657f2a0ea930190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fde8a6988b483cab0e58f2b6a35615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:35.650134 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c9da0bb0-a42b-4fcf-91b5-7b47a12afefc tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad" status: 200 len: 1474 microversion: 2.1 time: 0.912953 May 27 14:58:35.681036 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 228/497] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:34 2022] GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad => generated 1474 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:35.709727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-707cea3d-371e-4885-b6f2-cdee3adbf5cf tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:35.711232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-707cea3d-371e-4885-b6f2-cdee3adbf5cf tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:35.735228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-707cea3d-371e-4885-b6f2-cdee3adbf5cf tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:35.735812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-707cea3d-371e-4885-b6f2-cdee3adbf5cf tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:35.742885 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-707cea3d-371e-4885-b6f2-cdee3adbf5cf tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:35.766665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-707cea3d-371e-4885-b6f2-cdee3adbf5cf tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:36.260592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2dad4746-42e5-416f-b912-8c35fb422ebd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:36.270880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-707cea3d-371e-4885-b6f2-cdee3adbf5cf tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:36.284057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2dad4746-42e5-416f-b912-8c35fb422ebd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:36.295351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2dad4746-42e5-416f-b912-8c35fb422ebd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:36.301201 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-707cea3d-371e-4885-b6f2-cdee3adbf5cf tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1468 microversion: 2.1 time: 0.594319 May 27 14:58:36.302305 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 229/498] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:35 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1468 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:36.303100 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2dad4746-42e5-416f-b912-8c35fb422ebd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1362 microversion: 2.25 time: 0.780661 May 27 14:58:36.305199 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 270/499] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:35 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1362 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:36.318458 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-61a15354-b0cc-43b8-8023-650063cbb893 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:36.329716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-5e5a865c-96c7-4891-ae37-57088c13bcfd req-e5664677-1039-485f-aa61-7e0ffeae2186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae05ce87-e077-487e-906e-824915f604ad", "name": "network-vif-deleted", "tag": "22359590-0f71-41f7-9cb3-b11408fae17d"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:36.390232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-5e5a865c-96c7-4891-ae37-57088c13bcfd req-e5664677-1039-485f-aa61-7e0ffeae2186 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:36.390526 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-61a15354-b0cc-43b8-8023-650063cbb893 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.085403 May 27 14:58:36.391337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-5e5a865c-96c7-4891-ae37-57088c13bcfd req-e5664677-1039-485f-aa61-7e0ffeae2186 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:36.401772 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 230/500] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:58:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:36.412207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-1d4b6406-e011-47aa-8a12-3093d5e99c6e req-e07a32b8-10bd-41cf-8b1a-3ea536ec8a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37dbb2d-08d2-4f90-9c36-d373a0dec9d5", "name": "network-vif-plugged", "status": "completed", "tag": "a88e358c-7366-488d-b011-77c43429e37d"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:36.425092 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-5e5a865c-96c7-4891-ae37-57088c13bcfd req-e5664677-1039-485f-aa61-7e0ffeae2186 service nova] Creating event network-vif-deleted:22359590-0f71-41f7-9cb3-b11408fae17d for instance ae05ce87-e077-487e-906e-824915f604ad on n-h1-843621-1 May 27 14:58:36.433341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-1d4b6406-e011-47aa-8a12-3093d5e99c6e req-e07a32b8-10bd-41cf-8b1a-3ea536ec8a04 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:36.435242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-1d4b6406-e011-47aa-8a12-3093d5e99c6e req-e07a32b8-10bd-41cf-8b1a-3ea536ec8a04 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:36.452642 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-5e5a865c-96c7-4891-ae37-57088c13bcfd req-e5664677-1039-485f-aa61-7e0ffeae2186 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134143 May 27 14:58:36.456742 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 271/501] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:36.475994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-93e76764-b21f-461e-9174-aafd269e0cac tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1150456586", "id": 1091633745, "os-flavor-access:is_public": "False"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:36.484323 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:36.484323 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:36.488252 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-1d4b6406-e011-47aa-8a12-3093d5e99c6e req-e07a32b8-10bd-41cf-8b1a-3ea536ec8a04 service nova] Creating event network-vif-plugged:a88e358c-7366-488d-b011-77c43429e37d for instance f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 on n-h2-843621-1 May 27 14:58:36.500101 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-1d4b6406-e011-47aa-8a12-3093d5e99c6e req-e07a32b8-10bd-41cf-8b1a-3ea536ec8a04 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094995 May 27 14:58:36.501789 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 231/502] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:36.516954 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8b368193-ac5a-482b-b281-b8ebe89fb0af tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:36.518252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8b368193-ac5a-482b-b281-b8ebe89fb0af tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] [instance: a7898281-77eb-40ed-8047-11d39b2ae6e2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:36.526036 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-93e76764-b21f-461e-9174-aafd269e0cac tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.065542 May 27 14:58:36.526979 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 272/503] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:58:36 2022] POST /compute/v2.1/flavors => generated 439 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:36.541696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:UPDATE=12 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:36.544600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-18dd71f5-3ffe-4396-801f-991346a1782d tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9b49665b90464c9184d71d37eb93bc06"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:36.546014 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:36.546014 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:36.547354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b368193-ac5a-482b-b281-b8ebe89fb0af tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:36.549514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b368193-ac5a-482b-b281-b8ebe89fb0af tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:36.552013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b368193-ac5a-482b-b281-b8ebe89fb0af tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:36.553412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b368193-ac5a-482b-b281-b8ebe89fb0af tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:36.975116 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8b368193-ac5a-482b-b281-b8ebe89fb0af tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4174aebd284775894cc0047cf5247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960898bbaeac4cd1b5394df898d419bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:36.986388 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8b368193-ac5a-482b-b281-b8ebe89fb0af tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] 10.222.0.13 "GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2" status: 200 len: 1472 microversion: 2.1 time: 0.481927 May 27 14:58:36.988971 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 232/504] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:36 2022] GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2 => generated 1472 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:37.002889 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-afb65823-cc7d-4912-a512-a71d5ab74380 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:37.004278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-afb65823-cc7d-4912-a512-a71d5ab74380 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] [instance: ae05ce87-e077-487e-906e-824915f604ad] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:37.018991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afb65823-cc7d-4912-a512-a71d5ab74380 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:37.020225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afb65823-cc7d-4912-a512-a71d5ab74380 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:37.023066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afb65823-cc7d-4912-a512-a71d5ab74380 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:37.024771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afb65823-cc7d-4912-a512-a71d5ab74380 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:37.064936 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-afb65823-cc7d-4912-a512-a71d5ab74380 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] HTTP exception thrown: Instance ae05ce87-e077-487e-906e-824915f604ad could not be found. May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-afb65823-cc7d-4912-a512-a71d5ab74380 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Request method failure captured: May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad HTTP/1.1 May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikObmKL3Ihh4PB7mJ2Fw61w4TBssZUJYFlCn9W9sK7xWIJb-Q16NbL4vZwpxYXBWXwRUAVdivIb2kvYbnr9-0okXRLjDUq09uebbwYlF4oLTg6Cp8m67szSNM12sVPO0UJJmOsE5LbZywyNbI50Zlwxn0Y8ulGelGb7r-ierZTokEUaw May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 12fde8a6988b483cab0e58f2b6a35615 May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-LiveMigrationNegativeTest-1025188827 May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:58:37.068315 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:58:37.069843 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/12fde8a6988b483cab0e58f2b6a35615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/12fde8a6988b483cab0e58f2b6a35615"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/12fde8a6988b483cab0e58f2b6a35615"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_12fde8a6988b483cab0e58f2b6a35615", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:37.069843 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-LiveMigrationNegativeTest-1025188827 May 27 14:58:37.069843 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 12fde8a6988b483cab0e58f2b6a35615 May 27 14:58:37.069843 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1025188827 May 27 14:58:37.069843 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-LiveMigrationNegativeTest-1025188827-project May 27 14:58:37.069843 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:37.069843 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:37.069843 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 693e1381d34b4d58b657f2a0ea930190 May 27 14:58:37.069843 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-LiveMigrationNegativeTest-1025188827-project May 27 14:58:37.069843 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 14:58:37.069843 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance ae05ce87-e077-487e-906e-824915f604ad could not be found. May 27 14:58:37.069843 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'ae05ce87-e077-487e-906e-824915f604ad'} May 27 14:58:37.071676 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:37.071676 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:37.071676 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 14:58:37.071676 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 14:58:37.071676 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 14:58:37.071676 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 14:58:37.071676 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 14:58:37.071676 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 14:58:37.071676 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 14:58:37.071676 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 14:58:37.071676 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae05ce87-e077-487e-906e-824915f604ad could not be found. May 27 14:58:37.071676 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:37.071676 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:37.071676 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:37.071676 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:37.071676 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:37.071676 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:37.071676 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:37.071676 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:37.071676 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:37.073110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:37.073110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 14:58:37.073110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 14:58:37.073110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 14:58:37.073110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 14:58:37.073110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 14:58:37.073110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 14:58:37.073110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae05ce87-e077-487e-906e-824915f604ad could not be found. May 27 14:58:37.073110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:37.073110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:37.073110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:37.073110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:37.073110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:37.073110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:37.073110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:37.073110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:37.073110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae05ce87-e077-487e-906e-824915f604ad could not be found. May 27 14:58:37.073110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:37.078383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-afb65823-cc7d-4912-a512-a71d5ab74380 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] Returning 404 to user: Instance ae05ce87-e077-487e-906e-824915f604ad could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:37.079478 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-afb65823-cc7d-4912-a512-a71d5ab74380 tempest-LiveMigrationNegativeTest-1025188827 tempest-LiveMigrationNegativeTest-1025188827-project] 10.222.0.13 "GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad" status: 404 len: 111 microversion: 2.1 time: 0.089253 May 27 14:58:37.081034 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 233/505] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:36 2022] GET /compute/v2.1/servers/ae05ce87-e077-487e-906e-824915f604ad => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:37.087079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4eea0ca5-cc6d-4494-bec5-2f3e926eab8f tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:37.087955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4eea0ca5-cc6d-4494-bec5-2f3e926eab8f tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] [instance: a7898281-77eb-40ed-8047-11d39b2ae6e2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:37.095841 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4eea0ca5-cc6d-4494-bec5-2f3e926eab8f tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:37.096556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4eea0ca5-cc6d-4494-bec5-2f3e926eab8f tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:37.097521 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4eea0ca5-cc6d-4494-bec5-2f3e926eab8f tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:37.099083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4eea0ca5-cc6d-4494-bec5-2f3e926eab8f tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:37.143132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4eea0ca5-cc6d-4494-bec5-2f3e926eab8f tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '6d4174aebd284775894cc0047cf5247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960898bbaeac4cd1b5394df898d419bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4eea0ca5-cc6d-4494-bec5-2f3e926eab8f tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Request method failure captured: May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2/diagnostics HTTP/1.1 May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOcGm2OK8VostQo9DcQ7r4sLSD6bccXO6Y745NmC71sUa8yCXIE3leTmQeYM96vkJLrWN04Ea3gveW9D8X-ANKriIC-gqOWJC9H_prvsN1aMcLjcZqYXT1rwZcYWyxPKtEWPyJ7nz5CsHBGHCvFjahU_dfGlIre9Aze0vNE2Mf6GPWc May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 960898bbaeac4cd1b5394df898d419bd May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-111510493 May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:58:37.145379 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:58:37.146848 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/960898bbaeac4cd1b5394df898d419bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/960898bbaeac4cd1b5394df898d419bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/960898bbaeac4cd1b5394df898d419bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_960898bbaeac4cd1b5394df898d419bd", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:37.146848 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-111510493 May 27 14:58:37.146848 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 960898bbaeac4cd1b5394df898d419bd May 27 14:58:37.146848 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-111510493 May 27 14:58:37.146848 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerDiagnosticsNegativeTest-111510493-project May 27 14:58:37.146848 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:37.146848 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:37.146848 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 6d4174aebd284775894cc0047cf5247f May 27 14:58:37.146848 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-111510493-project May 27 14:58:37.146848 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 14:58:37.146848 n-d-843621-1 devstack@n-api.service[119249]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 27 14:58:37.147648 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'server_id': 'a7898281-77eb-40ed-8047-11d39b2ae6e2'} May 27 14:58:37.147648 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:37.147648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:37.147648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:37.147648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:37.147648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:37.147648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:37.147648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:37.147648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:37.147648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index May 27 14:58:37.147648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, May 27 14:58:37.147648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:58:37.147648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:58:37.147648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:58:37.147648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:58:37.147648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:37.147648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:37.147648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:37.147648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:37.147648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:58:37.150930 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:58:37.150930 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:58:37.150930 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:58:37.150930 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:58:37.150930 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:58:37.150930 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 27 14:58:37.150930 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:37.150930 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:37.150930 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:37.150930 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:37.150930 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:37.150930 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:37.150930 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:58:37.150930 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:58:37.150930 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 27 14:58:37.150930 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:37.153424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4eea0ca5-cc6d-4494-bec5-2f3e926eab8f tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:37.154466 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4eea0ca5-cc6d-4494-bec5-2f3e926eab8f tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] 10.222.0.13 "GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.072282 May 27 14:58:37.155580 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 234/506] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 14:58:37 2022] GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2/diagnostics => generated 117 bytes in 74 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:37.171886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ff942950-269a-42d0-bca6-abac62af3a2c tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:37.172658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ff942950-269a-42d0-bca6-abac62af3a2c tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] [instance: a7898281-77eb-40ed-8047-11d39b2ae6e2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:37.180971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff942950-269a-42d0-bca6-abac62af3a2c tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:37.187792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff942950-269a-42d0-bca6-abac62af3a2c tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:37.189765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff942950-269a-42d0-bca6-abac62af3a2c tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:37.190761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff942950-269a-42d0-bca6-abac62af3a2c tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:37.254786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ff942950-269a-42d0-bca6-abac62af3a2c tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] [instance: a7898281-77eb-40ed-8047-11d39b2ae6e2] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 14:58:37.292707 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-18dd71f5-3ffe-4396-801f-991346a1782d tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1091633745/action" status: 200 len: 97 microversion: 2.1 time: 0.755500 May 27 14:58:37.293924 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 273/507] 10.222.0.13 () {60 vars in 1199 bytes} [Fri May 27 14:58:36 2022] POST /compute/v2.1/flavors/1091633745/action => generated 97 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 14:58:37.310279 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-845b9d02-5232-4cb9-9c3a-bdde2ad6cdcc tempest-FlavorsAccessNegativeTestJSON-955124031 tempest-FlavorsAccessNegativeTestJSON-955124031-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9b49665b90464c9184d71d37eb93bc06"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:37.312139 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:37.312139 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:37.313536 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-845b9d02-5232-4cb9-9c3a-bdde2ad6cdcc tempest-FlavorsAccessNegativeTestJSON-955124031 tempest-FlavorsAccessNegativeTestJSON-955124031-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '0adc6da848f3475d9e700dd0d33ce6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b49665b90464c9184d71d37eb93bc06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-845b9d02-5232-4cb9-9c3a-bdde2ad6cdcc tempest-FlavorsAccessNegativeTestJSON-955124031 tempest-FlavorsAccessNegativeTestJSON-955124031-project] Request method failure captured: May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/flavors/1091633745/action HTTP/1.1 May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 70 May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOcSha51reBt8ACKENkINaoHHVT__gWsYLZCHojo1liKa0zJB40iZOw2KYzR3WIteGIUe0z1jY8ex_4KM-oItdD0qCEt_OtjyfJYhvoI3BgyaM7kYNbF-tue-bj0SlOSMI9Tes2r1ltU05xo-oecpvRaU2bvIGh4IIh5MV-4-hj7G_4 May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 9b49665b90464c9184d71d37eb93bc06 May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-955124031 May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:58:37.315814 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:58:37.317318 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9b49665b90464c9184d71d37eb93bc06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9b49665b90464c9184d71d37eb93bc06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9b49665b90464c9184d71d37eb93bc06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9b49665b90464c9184d71d37eb93bc06", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:37.317318 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-955124031 May 27 14:58:37.317318 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 9b49665b90464c9184d71d37eb93bc06 May 27 14:58:37.317318 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-955124031 May 27 14:58:37.317318 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-FlavorsAccessNegativeTestJSON-955124031-project May 27 14:58:37.317318 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:37.317318 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:37.317318 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 0adc6da848f3475d9e700dd0d33ce6f6 May 27 14:58:37.317318 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-955124031-project May 27 14:58:37.317318 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:58:37.317318 n-d-843621-1 devstack@n-api.service[119248]: {"removeTenantAccess": {"tenant": "9b49665b90464c9184d71d37eb93bc06"}} May 27 14:58:37.317318 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:58:37.318048 n-d-843621-1 devstack@n-api.service[119248]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 27 14:58:37.318048 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '1091633745', 'body': {'removeTenantAccess': {'tenant': '9b49665b90464c9184d71d37eb93bc06'}}} May 27 14:58:37.318048 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:37.318048 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:37.318048 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:37.318048 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:37.318048 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:37.318048 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:37.318048 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:37.318048 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:37.318048 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:58:37.318048 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:58:37.318048 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access May 27 14:58:37.318048 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi context.can( May 27 14:58:37.318048 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:58:37.318048 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:58:37.318048 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:58:37.318048 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:58:37.318048 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:37.318048 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:37.319256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:37.319256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:37.319256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:58:37.319256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:58:37.319256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:58:37.319256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:58:37.319256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:58:37.319256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:58:37.319256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 27 14:58:37.319256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:37.319256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:37.319256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:37.319256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:37.319256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:37.319256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:37.319256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:58:37.319256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:58:37.319256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 27 14:58:37.319256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:37.323665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-845b9d02-5232-4cb9-9c3a-bdde2ad6cdcc tempest-FlavorsAccessNegativeTestJSON-955124031 tempest-FlavorsAccessNegativeTestJSON-955124031-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:37.332327 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-845b9d02-5232-4cb9-9c3a-bdde2ad6cdcc tempest-FlavorsAccessNegativeTestJSON-955124031 tempest-FlavorsAccessNegativeTestJSON-955124031-project] 10.222.0.13 "POST /compute/v2.1/flavors/1091633745/action" status: 403 len: 133 microversion: 2.1 time: 0.032601 May 27 14:58:37.333591 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 274/508] 10.222.0.13 () {60 vars in 1199 bytes} [Fri May 27 14:58:37 2022] POST /compute/v2.1/flavors/1091633745/action => generated 133 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:37.340596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f0bb1d19-f332-4433-a200-e2b1a7f5b2a8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:37.341684 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f0bb1d19-f332-4433-a200-e2b1a7f5b2a8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:37.352424 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f0bb1d19-f332-4433-a200-e2b1a7f5b2a8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:37.353929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f0bb1d19-f332-4433-a200-e2b1a7f5b2a8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:37.356421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f0bb1d19-f332-4433-a200-e2b1a7f5b2a8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:37.357115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f0bb1d19-f332-4433-a200-e2b1a7f5b2a8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:37.387888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:37.464589 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ff942950-269a-42d0-bca6-abac62af3a2c tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2" status: 204 len: 0 microversion: 2.1 time: 0.299230 May 27 14:58:37.465623 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 235/509] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 14:58:37 2022] DELETE /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 14:58:37.470996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bb1f1be5-83b1-4e27-971b-f2be4902d5af tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:37.471759 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bb1f1be5-83b1-4e27-971b-f2be4902d5af tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:37.492339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb1f1be5-83b1-4e27-971b-f2be4902d5af tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:37.493241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb1f1be5-83b1-4e27-971b-f2be4902d5af tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:37.494029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb1f1be5-83b1-4e27-971b-f2be4902d5af tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:37.498982 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb1f1be5-83b1-4e27-971b-f2be4902d5af tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:37.709461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f0bb1d19-f332-4433-a200-e2b1a7f5b2a8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:37.722765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f0bb1d19-f332-4433-a200-e2b1a7f5b2a8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:37.724289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f0bb1d19-f332-4433-a200-e2b1a7f5b2a8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:37.729598 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f0bb1d19-f332-4433-a200-e2b1a7f5b2a8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1362 microversion: 2.25 time: 0.394585 May 27 14:58:37.730138 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 275/510] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:37 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1362 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:37.745943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3209b7e2-a3c1-4e05-82a7-d8144530ce3f tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9b49665b90464c9184d71d37eb93bc06"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:37.747872 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:37.747872 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:37.837509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bb1f1be5-83b1-4e27-971b-f2be4902d5af tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:37.845812 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bb1f1be5-83b1-4e27-971b-f2be4902d5af tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1460 microversion: 2.1 time: 0.378907 May 27 14:58:37.846389 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 236/511] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:37 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1460 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:37.854377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3a17d215-9db3-4d01-9a2b-e9dd1cf85c82 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:37.863592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3a17d215-9db3-4d01-9a2b-e9dd1cf85c82 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] [instance: a7898281-77eb-40ed-8047-11d39b2ae6e2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:37.873242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a17d215-9db3-4d01-9a2b-e9dd1cf85c82 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:37.874006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a17d215-9db3-4d01-9a2b-e9dd1cf85c82 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:37.875495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a17d215-9db3-4d01-9a2b-e9dd1cf85c82 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:37.876138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a17d215-9db3-4d01-9a2b-e9dd1cf85c82 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:38.162710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3a17d215-9db3-4d01-9a2b-e9dd1cf85c82 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4174aebd284775894cc0047cf5247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960898bbaeac4cd1b5394df898d419bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:38.179565 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3a17d215-9db3-4d01-9a2b-e9dd1cf85c82 tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] 10.222.0.13 "GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2" status: 200 len: 1478 microversion: 2.1 time: 0.326676 May 27 14:58:38.180287 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 237/512] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:37 2022] GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2 => generated 1478 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:38.200068 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6219939c-bcf1-4311-b49b-181c79a4ca65 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:38.200528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6219939c-bcf1-4311-b49b-181c79a4ca65 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:38.222270 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6219939c-bcf1-4311-b49b-181c79a4ca65 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:38.222829 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6219939c-bcf1-4311-b49b-181c79a4ca65 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:38.223514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6219939c-bcf1-4311-b49b-181c79a4ca65 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:38.223984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6219939c-bcf1-4311-b49b-181c79a4ca65 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:38.486811 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6219939c-bcf1-4311-b49b-181c79a4ca65 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1611 microversion: 2.1 time: 0.296638 May 27 14:58:38.498903 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 238/513] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:38 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1611 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:38.547686 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3209b7e2-a3c1-4e05-82a7-d8144530ce3f tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1091633745/action" status: 200 len: 21 microversion: 2.1 time: 0.814537 May 27 14:58:38.554078 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 276/514] 10.222.0.13 () {60 vars in 1199 bytes} [Fri May 27 14:58:37 2022] POST /compute/v2.1/flavors/1091633745/action => generated 21 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 14:58:38.563527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a821cfbb-e4ef-474e-b22b-d865391bca59 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Calling method '.version_select at 0x7fc77703f700>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:38.567555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a821cfbb-e4ef-474e-b22b-d865391bca59 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:38.568013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a821cfbb-e4ef-474e-b22b-d865391bca59 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:38.579064 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a821cfbb-e4ef-474e-b22b-d865391bca59 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.023134 May 27 14:58:38.579727 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 277/515] 10.222.0.13 () {58 vars in 1142 bytes} [Fri May 27 14:58:38 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:38.584611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-683a4068-1528-422b-bd84-1fd8906e8d64 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:38.585390 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:38.585390 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:38.624332 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-683a4068-1528-422b-bd84-1fd8906e8d64 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1091633745" status: 202 len: 0 microversion: 2.1 time: 0.041565 May 27 14:58:38.626457 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 278/516] 10.222.0.13 () {58 vars in 1160 bytes} [Fri May 27 14:58:38 2022] DELETE /compute/v2.1/flavors/1091633745 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:58:38.638034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-5b37235a-b69d-452e-9b24-c04f7619a8ab req-cdf1792f-5f20-4d7c-9178-5e6752d344e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3d494d-8dd1-49b1-a94a-d17aa943e4e4", "name": "network-vif-plugged", "status": "completed", "tag": "20c204bd-a0e4-4b3a-88e0-34bca47af413"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:38.652631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-5b37235a-b69d-452e-9b24-c04f7619a8ab req-cdf1792f-5f20-4d7c-9178-5e6752d344e1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:38.653456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-5b37235a-b69d-452e-9b24-c04f7619a8ab req-cdf1792f-5f20-4d7c-9178-5e6752d344e1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:38.668555 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-5b37235a-b69d-452e-9b24-c04f7619a8ab req-cdf1792f-5f20-4d7c-9178-5e6752d344e1 service nova] Creating event network-vif-plugged:20c204bd-a0e4-4b3a-88e0-34bca47af413 for instance ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 on n-h2-843621-1 May 27 14:58:38.675279 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-5b37235a-b69d-452e-9b24-c04f7619a8ab req-cdf1792f-5f20-4d7c-9178-5e6752d344e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046457 May 27 14:58:38.676100 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 279/517] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:38.682159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9aa48221-9608-4caa-9005-5ddc250530c5 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:38.703421 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9aa48221-9608-4caa-9005-5ddc250530c5 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025627 May 27 14:58:38.704711 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 280/518] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:58:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:38.724908 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7947e974-773f-4da0-b97a-981b6e5195ea tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-206281294", "id": 1281017600, "os-flavor-access:is_public": "False"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:38.729111 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:38.729111 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:38.759363 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7947e974-773f-4da0-b97a-981b6e5195ea tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.042756 May 27 14:58:38.760365 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 281/519] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:58:38 2022] POST /compute/v2.1/flavors => generated 438 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:38.768597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4d4341c4-fda1-4239-a305-90c9da5dc3a8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:38.771246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4d4341c4-fda1-4239-a305-90c9da5dc3a8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:38.785040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d4341c4-fda1-4239-a305-90c9da5dc3a8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:38.785460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d4341c4-fda1-4239-a305-90c9da5dc3a8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:38.786317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d4341c4-fda1-4239-a305-90c9da5dc3a8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:38.788165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d4341c4-fda1-4239-a305-90c9da5dc3a8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:38.811451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:38.875227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-eb66ffb4-0b07-4909-b562-6c010dfce190 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:38.877439 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:38.877439 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:38.879257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb66ffb4-0b07-4909-b562-6c010dfce190 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:38.879725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb66ffb4-0b07-4909-b562-6c010dfce190 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:38.880544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb66ffb4-0b07-4909-b562-6c010dfce190 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:38.882993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb66ffb4-0b07-4909-b562-6c010dfce190 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:38.918531 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-eb66ffb4-0b07-4909-b562-6c010dfce190 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.428152 May 27 14:58:38.919163 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 239/520] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 14:58:38 2022] GET /compute/v2.1/os-services => generated 944 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:38.926590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fddf3975-21dc-472e-a6dd-9107325e56e6 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5a1b9b58b1a64f67b7ebb324a90fe021"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:38.928791 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:38.928791 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:39.074514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4d4341c4-fda1-4239-a305-90c9da5dc3a8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:39.084226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4d4341c4-fda1-4239-a305-90c9da5dc3a8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:39.087986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4d4341c4-fda1-4239-a305-90c9da5dc3a8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:39.089687 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4d4341c4-fda1-4239-a305-90c9da5dc3a8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1362 microversion: 2.25 time: 0.326225 May 27 14:58:39.100694 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 282/521] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:38 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:39.106471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-98b06c2d-a1d2-4d78-b422-5f49deb0d974 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:39.107936 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:39.107936 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:39.109478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98b06c2d-a1d2-4d78-b422-5f49deb0d974 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:39.110519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98b06c2d-a1d2-4d78-b422-5f49deb0d974 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:39.111501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98b06c2d-a1d2-4d78-b422-5f49deb0d974 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:39.112357 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98b06c2d-a1d2-4d78-b422-5f49deb0d974 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:39.113185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:39.142879 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-98b06c2d-a1d2-4d78-b422-5f49deb0d974 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.040858 May 27 14:58:39.144039 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 283/522] 10.222.0.13 () {58 vars in 1169 bytes} [Fri May 27 14:58:39 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:39.149334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d7fb8bb8-d2b8-4075-913c-bff37b8b75d2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-50656946", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:39.214741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-d7fb8bb8-d2b8-4075-913c-bff37b8b75d2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] validate_networks() for None {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 14:58:39.537911 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-fddf3975-21dc-472e-a6dd-9107325e56e6 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] HTTP exception thrown: Flavor access not found for 36 / 5a1b9b58b1a64f67b7ebb324a90fe021 combination. May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fddf3975-21dc-472e-a6dd-9107325e56e6 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Request method failure captured: May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/flavors/1281017600/action HTTP/1.1 May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 70 May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOcUt_VdW2ZGkHfz4ffPpoXK-ov1_FeTmlpZBRwVMhGMZU6MObwWEhKOLkiz4SQwQQhLS6SyzQIkNTK4jyWuJ1UiHTklrGQCGMl5IEsnZankJCIUVcLybu9Owyx4AvbnLqjZvp4GRakYlF8feF3c8kzTkcizPT0W0wzeo8wcOCViqs0 May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: cab41c249ae3486eb70af7dd19dcf564 May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-973620264 May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,admin,member May 27 14:58:39.541024 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,admin,member May 27 14:58:39.542349 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cab41c249ae3486eb70af7dd19dcf564"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cab41c249ae3486eb70af7dd19dcf564"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/cab41c249ae3486eb70af7dd19dcf564"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_cab41c249ae3486eb70af7dd19dcf564", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:39.542349 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-973620264 May 27 14:58:39.542349 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: cab41c249ae3486eb70af7dd19dcf564 May 27 14:58:39.542349 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-973620264 May 27 14:58:39.542349 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin May 27 14:58:39.542349 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:39.542349 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:39.542349 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 6699dd79b5ed4c81b17c681bbd293c8b May 27 14:58:39.542349 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin May 27 14:58:39.542349 n-d-843621-1 devstack@n-api.service[119249]: May 27 14:58:39.542349 n-d-843621-1 devstack@n-api.service[119249]: {"removeTenantAccess": {"tenant": "5a1b9b58b1a64f67b7ebb324a90fe021"}} May 27 14:58:39.542349 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 14:58:39.543054 n-d-843621-1 devstack@n-api.service[119249]: exception: Flavor access not found for 36 / 5a1b9b58b1a64f67b7ebb324a90fe021 combination. May 27 14:58:39.543054 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '1281017600', 'body': {'removeTenantAccess': {'tenant': '5a1b9b58b1a64f67b7ebb324a90fe021'}}} May 27 14:58:39.543054 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:39.543054 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:39.543054 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access May 27 14:58:39.543054 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) May 27 14:58:39.543054 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 27 14:58:39.543054 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 27 14:58:39.543054 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access May 27 14:58:39.543054 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) May 27 14:58:39.543054 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access May 27 14:58:39.543054 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) May 27 14:58:39.543054 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project May 27 14:58:39.543054 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) May 27 14:58:39.543054 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 14:58:39.543054 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 14:58:39.543054 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project May 27 14:58:39.543054 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, May 27 14:58:39.544096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 36 / 5a1b9b58b1a64f67b7ebb324a90fe021 combination. May 27 14:58:39.544096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:39.544096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:39.544096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:39.544096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:39.544096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:39.544096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:39.544096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:39.544096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:39.544096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:39.544096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:39.544096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:58:39.544096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:58:39.544096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access May 27 14:58:39.544096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 14:58:39.544096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 36 / 5a1b9b58b1a64f67b7ebb324a90fe021 combination. May 27 14:58:39.544096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:39.544096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:39.544096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:39.544096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:39.545314 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:39.545314 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:39.545314 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:39.545314 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:39.545314 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 36 / 5a1b9b58b1a64f67b7ebb324a90fe021 combination. May 27 14:58:39.545314 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:39.548560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fddf3975-21dc-472e-a6dd-9107325e56e6 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Returning 404 to user: Flavor access not found for 36 / 5a1b9b58b1a64f67b7ebb324a90fe021 combination. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:39.550284 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fddf3975-21dc-472e-a6dd-9107325e56e6 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors/1281017600/action" status: 404 len: 124 microversion: 2.1 time: 0.629861 May 27 14:58:39.551094 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 240/523] 10.222.0.13 () {60 vars in 1199 bytes} [Fri May 27 14:58:38 2022] POST /compute/v2.1/flavors/1281017600/action => generated 124 bytes in 631 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:39.618670 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-d7fb8bb8-d2b8-4075-913c-bff37b8b75d2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:58:39.618985 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-d7fb8bb8-d2b8-4075-913c-bff37b8b75d2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:58:39.619651 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-d7fb8bb8-d2b8-4075-913c-bff37b8b75d2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:58:39.620210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-d7fb8bb8-d2b8-4075-913c-bff37b8b75d2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:58:39.620963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-d7fb8bb8-d2b8-4075-913c-bff37b8b75d2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:58:39.636193 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7fb8bb8-d2b8-4075-913c-bff37b8b75d2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:39.640101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7fb8bb8-d2b8-4075-913c-bff37b8b75d2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:39.643594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7fb8bb8-d2b8-4075-913c-bff37b8b75d2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:39.644231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7fb8bb8-d2b8-4075-913c-bff37b8b75d2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:39.693195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-d7fb8bb8-d2b8-4075-913c-bff37b8b75d2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Getting quotas for project 7369228028774765965f3cf001f8806a. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:58:39.709286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-d7fb8bb8-d2b8-4075-913c-bff37b8b75d2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Getting quotas for user a5a825c2385e490d81ddcbc2de76980d and project 7369228028774765965f3cf001f8806a. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:58:39.710460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-58ca3756-d757-4e6d-9337-1896066a2c23 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:39.739258 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-58ca3756-d757-4e6d-9337-1896066a2c23 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.186874 May 27 14:58:39.743535 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 241/524] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 14:58:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:39.751637 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d7fb8bb8-d2b8-4075-913c-bff37b8b75d2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 14:58:39.756705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c1dc12cf-235a-492f-853d-8037f6a800be tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:39.758673 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:39.758673 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:39.763161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d7fb8bb8-d2b8-4075-913c-bff37b8b75d2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 14:58:39.771255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1dc12cf-235a-492f-853d-8037f6a800be tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:39.771735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1dc12cf-235a-492f-853d-8037f6a800be tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:39.772892 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1dc12cf-235a-492f-853d-8037f6a800be tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:39.773693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1dc12cf-235a-492f-853d-8037f6a800be tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:39.837109 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c1dc12cf-235a-492f-853d-8037f6a800be tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.091956 May 27 14:58:39.844733 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 242/525] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 14:58:39 2022] GET /compute/v2.1/os-services => generated 944 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:39.852383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-74696a03-9501-48a5-bf2d-000b075082fa tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:39.853424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-74696a03-9501-48a5-bf2d-000b075082fa tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] [instance: a7898281-77eb-40ed-8047-11d39b2ae6e2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:39.868137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-74696a03-9501-48a5-bf2d-000b075082fa tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:39.870725 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d7fb8bb8-d2b8-4075-913c-bff37b8b75d2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725368 May 27 14:58:39.871342 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 284/526] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:58:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 14:58:39.874148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-74696a03-9501-48a5-bf2d-000b075082fa tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:39.875115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-74696a03-9501-48a5-bf2d-000b075082fa tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:39.875590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-74696a03-9501-48a5-bf2d-000b075082fa tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:39.884313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-98eb69f8-a0a8-465e-ac48-97325109a8b3 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:39.885317 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:39.885317 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:39.911548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=8,nova_api:DELETE=12 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:39.959351 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-98eb69f8-a0a8-465e-ac48-97325109a8b3 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1281017600" status: 202 len: 0 microversion: 2.1 time: 0.084934 May 27 14:58:39.964087 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 285/527] 10.222.0.13 () {58 vars in 1160 bytes} [Fri May 27 14:58:39 2022] DELETE /compute/v2.1/flavors/1281017600 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:58:40.488747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a5835328-be77-418c-a213-1c6e08dcfd90 tempest-ServersWithSpecificFlavorTestJSON-850585455 tempest-ServersWithSpecificFlavorTestJSON-850585455-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-593745726", "id": 2059620199, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:40.493441 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:40.493441 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:40.537378 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a5835328-be77-418c-a213-1c6e08dcfd90 tempest-ServersWithSpecificFlavorTestJSON-850585455 tempest-ServersWithSpecificFlavorTestJSON-850585455-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.569750 May 27 14:58:40.542682 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 286/528] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:58:39 2022] POST /compute/v2.1/flavors => generated 424 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:40.559677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1b625dd2-a06a-42de-8d84-1e8a74feed71 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:40.571935 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:40.571935 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:40.573390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b625dd2-a06a-42de-8d84-1e8a74feed71 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:40.573850 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b625dd2-a06a-42de-8d84-1e8a74feed71 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:40.574884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-74696a03-9501-48a5-bf2d-000b075082fa tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d4174aebd284775894cc0047cf5247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960898bbaeac4cd1b5394df898d419bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:40.579651 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b625dd2-a06a-42de-8d84-1e8a74feed71 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:40.580111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b625dd2-a06a-42de-8d84-1e8a74feed71 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:40.597776 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-74696a03-9501-48a5-bf2d-000b075082fa tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] 10.222.0.13 "GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2" status: 200 len: 1478 microversion: 2.1 time: 0.753363 May 27 14:58:40.599467 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 243/529] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:39 2022] GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2 => generated 1478 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:40.607796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ea35f9b3-0218-41ac-bc96-f5a8c8fb387b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:40.608639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ea35f9b3-0218-41ac-bc96-f5a8c8fb387b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:40.653427 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1b625dd2-a06a-42de-8d84-1e8a74feed71 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=n-d-843621-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.101669 May 27 14:58:40.654058 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 287/530] 10.222.0.13 () {58 vars in 1193 bytes} [Fri May 27 14:58:40 2022] GET /compute/v2.1/os-services?host=n-d-843621-1&binary=xxx => generated 16 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 14:58:40.662903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5b216f41-e435-4135-801d-5605ea5d9ff8 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:40.686746 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ea35f9b3-0218-41ac-bc96-f5a8c8fb387b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:40.695703 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ea35f9b3-0218-41ac-bc96-f5a8c8fb387b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1211 microversion: 2.1 time: 0.094028 May 27 14:58:40.697454 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 244/531] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:40 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:40.713168 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5b216f41-e435-4135-801d-5605ea5d9ff8 tempest-FlavorsAccessNegativeTestJSON-973620264 tempest-FlavorsAccessNegativeTestJSON-973620264-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.057741 May 27 14:58:40.714324 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 288/532] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:58:40 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:40.719293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-36a246d0-e4f6-4299-8ebc-a313f553ea12 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:40.720516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-36a246d0-e4f6-4299-8ebc-a313f553ea12 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:40.730177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-36a246d0-e4f6-4299-8ebc-a313f553ea12 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:40.731066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-36a246d0-e4f6-4299-8ebc-a313f553ea12 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:40.732023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-36a246d0-e4f6-4299-8ebc-a313f553ea12 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:40.732792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-36a246d0-e4f6-4299-8ebc-a313f553ea12 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:40.951545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-36a246d0-e4f6-4299-8ebc-a313f553ea12 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:40.970934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-36a246d0-e4f6-4299-8ebc-a313f553ea12 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:40.974262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-36a246d0-e4f6-4299-8ebc-a313f553ea12 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:40.978798 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-36a246d0-e4f6-4299-8ebc-a313f553ea12 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1557 microversion: 2.25 time: 0.262811 May 27 14:58:40.983418 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 289/533] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:40 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1557 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:40.994686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-2e4d77f2-6602-41c2-9c95-a32eef2e575e req-9223a323-3d06-45c9-b600-17f864c595c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7898281-77eb-40ed-8047-11d39b2ae6e2", "name": "network-vif-deleted", "tag": "9443d9f4-fcf4-4a68-a375-58b54cfa47fe"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:41.006750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2e4d77f2-6602-41c2-9c95-a32eef2e575e req-9223a323-3d06-45c9-b600-17f864c595c1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.008838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2e4d77f2-6602-41c2-9c95-a32eef2e575e req-9223a323-3d06-45c9-b600-17f864c595c1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.047619 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-2e4d77f2-6602-41c2-9c95-a32eef2e575e req-9223a323-3d06-45c9-b600-17f864c595c1 service nova] Creating event network-vif-deleted:9443d9f4-fcf4-4a68-a375-58b54cfa47fe for instance a7898281-77eb-40ed-8047-11d39b2ae6e2 on n-h2-843621-1 May 27 14:58:41.059766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-63e5e614-13da-4770-8355-75458bff62b1 tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Calling method '.version_select at 0x7fc777232700>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:41.061292 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:41.061292 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:41.062828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63e5e614-13da-4770-8355-75458bff62b1 tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.063454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63e5e614-13da-4770-8355-75458bff62b1 tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.067413 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-2e4d77f2-6602-41c2-9c95-a32eef2e575e req-9223a323-3d06-45c9-b600-17f864c595c1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079400 May 27 14:58:41.069922 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 290/534] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:41.089915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-519b0654-921f-436e-825e-8e4abf678311 tempest-ServersWithSpecificFlavorTestJSON-850585455 tempest-ServersWithSpecificFlavorTestJSON-850585455-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:41.107980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63e5e614-13da-4770-8355-75458bff62b1 tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.108468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63e5e614-13da-4770-8355-75458bff62b1 tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.121353 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-519b0654-921f-436e-825e-8e4abf678311 tempest-ServersWithSpecificFlavorTestJSON-850585455 tempest-ServersWithSpecificFlavorTestJSON-850585455-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.049014 May 27 14:58:41.127221 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 291/535] 10.222.0.13 () {58 vars in 1181 bytes} [Fri May 27 14:58:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 14:58:41.139342 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4954ad18-f587-49a0-8b5e-1dd23de85bff tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:41.153907 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:41.153907 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:41.157832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4954ad18-f587-49a0-8b5e-1dd23de85bff tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.162778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4954ad18-f587-49a0-8b5e-1dd23de85bff tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.167667 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4954ad18-f587-49a0-8b5e-1dd23de85bff tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.169017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4954ad18-f587-49a0-8b5e-1dd23de85bff tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.196046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63e5e614-13da-4770-8355-75458bff62b1 tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.196730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63e5e614-13da-4770-8355-75458bff62b1 tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.219012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63e5e614-13da-4770-8355-75458bff62b1 tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.221354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63e5e614-13da-4770-8355-75458bff62b1 tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.233787 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4954ad18-f587-49a0-8b5e-1dd23de85bff tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.101874 May 27 14:58:41.235189 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 292/536] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 14:58:41 2022] GET /compute/v2.1/os-services => generated 944 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:41.240126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f7554385-1f73-446d-8684-1f809d77986d tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:41.241350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f7554385-1f73-446d-8684-1f809d77986d tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:41.262889 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7554385-1f73-446d-8684-1f809d77986d tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.263721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7554385-1f73-446d-8684-1f809d77986d tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.265013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7554385-1f73-446d-8684-1f809d77986d tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.265468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7554385-1f73-446d-8684-1f809d77986d tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.269818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63e5e614-13da-4770-8355-75458bff62b1 tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.270501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63e5e614-13da-4770-8355-75458bff62b1 tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.278716 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-63e5e614-13da-4770-8355-75458bff62b1 tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.579974 May 27 14:58:41.279748 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 245/537] 10.222.0.13 () {60 vars in 1242 bytes} [Fri May 27 14:58:40 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:41.284639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7ad269e2-6c00-4cbb-9f06-1941821dea81 tempest-ServersWithSpecificFlavorTestJSON-850585455 tempest-ServersWithSpecificFlavorTestJSON-850585455-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1265614469", "id": 1271826021, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:41.286683 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:41.286683 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:41.307491 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7ad269e2-6c00-4cbb-9f06-1941821dea81 tempest-ServersWithSpecificFlavorTestJSON-850585455 tempest-ServersWithSpecificFlavorTestJSON-850585455-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.025636 May 27 14:58:41.315503 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 246/538] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:58:41 2022] POST /compute/v2.1/flavors => generated 425 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:41.322089 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-736b3249-89b5-4743-8eff-e8e3d3fcb816 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:41.323977 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:41.323977 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:41.327233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-736b3249-89b5-4743-8eff-e8e3d3fcb816 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.328187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-736b3249-89b5-4743-8eff-e8e3d3fcb816 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.330307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-736b3249-89b5-4743-8eff-e8e3d3fcb816 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.331102 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-736b3249-89b5-4743-8eff-e8e3d3fcb816 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.385548 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-736b3249-89b5-4743-8eff-e8e3d3fcb816 tempest-ServicesAdminNegativeTestJSON-1090001109 tempest-ServicesAdminNegativeTestJSON-1090001109-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.1 time: 0.067521 May 27 14:58:41.386883 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 247/539] 10.222.0.13 () {58 vars in 1197 bytes} [Fri May 27 14:58:41 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 14:58:41.397341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-644a2f9c-d874-47a6-a733-06ab9214192f tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Calling method '.version_select at 0x7fc777150c10>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:41.400881 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:41.400881 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:41.402586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-644a2f9c-d874-47a6-a733-06ab9214192f tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.403204 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-644a2f9c-d874-47a6-a733-06ab9214192f tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.473403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-644a2f9c-d874-47a6-a733-06ab9214192f tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.473938 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-644a2f9c-d874-47a6-a733-06ab9214192f tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.541477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-644a2f9c-d874-47a6-a733-06ab9214192f tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.541934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-644a2f9c-d874-47a6-a733-06ab9214192f tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.604946 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-644a2f9c-d874-47a6-a733-06ab9214192f tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.605537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-644a2f9c-d874-47a6-a733-06ab9214192f tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.652990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-f7554385-1f73-446d-8684-1f809d77986d tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lazy-loading 'services' on Instance uuid ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:58:41.679169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-644a2f9c-d874-47a6-a733-06ab9214192f tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.686925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-644a2f9c-d874-47a6-a733-06ab9214192f tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.694795 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-644a2f9c-d874-47a6-a733-06ab9214192f tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 607 microversion: 2.53 time: 0.306581 May 27 14:58:41.699730 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 248/540] 10.222.0.13 () {60 vars in 1221 bytes} [Fri May 27 14:58:41 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 607 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:58:41.707276 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f7554385-1f73-446d-8684-1f809d77986d tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 2050 microversion: 2.25 time: 0.468743 May 27 14:58:41.707990 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 293/541] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:41 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 2050 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:41.724967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fe34cc87-bd77-4e0e-b5c6-778df8de537f tempest-ServersWithSpecificFlavorTestJSON-850585455 tempest-ServersWithSpecificFlavorTestJSON-850585455-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:41.749254 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fe34cc87-bd77-4e0e-b5c6-778df8de537f tempest-ServersWithSpecificFlavorTestJSON-850585455 tempest-ServersWithSpecificFlavorTestJSON-850585455-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.048183 May 27 14:58:41.750463 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 249/542] 10.222.0.13 () {58 vars in 1181 bytes} [Fri May 27 14:58:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 14:58:41.757646 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-172a1f5d-9e97-43b6-9e14-ae2bdc6f0fae tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:41.759170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-172a1f5d-9e97-43b6-9e14-ae2bdc6f0fae tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] [instance: a7898281-77eb-40ed-8047-11d39b2ae6e2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:41.768174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-172a1f5d-9e97-43b6-9e14-ae2bdc6f0fae tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.769063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-172a1f5d-9e97-43b6-9e14-ae2bdc6f0fae tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.770084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-172a1f5d-9e97-43b6-9e14-ae2bdc6f0fae tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.771683 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-172a1f5d-9e97-43b6-9e14-ae2bdc6f0fae tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.816799 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-172a1f5d-9e97-43b6-9e14-ae2bdc6f0fae tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] HTTP exception thrown: Instance a7898281-77eb-40ed-8047-11d39b2ae6e2 could not be found. May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-172a1f5d-9e97-43b6-9e14-ae2bdc6f0fae tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Request method failure captured: May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2 HTTP/1.1 May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOcGm2OK8VostQo9DcQ7r4sLSD6bccXO6Y745NmC71sUa8yCXIE3leTmQeYM96vkJLrWN04Ea3gveW9D8X-ANKriIC-gqOWJC9H_prvsN1aMcLjcZqYXT1rwZcYWyxPKtEWPyJ7nz5CsHBGHCvFjahU_dfGlIre9Aze0vNE2Mf6GPWc May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 960898bbaeac4cd1b5394df898d419bd May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-111510493 May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:58:41.819950 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:58:41.821865 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/960898bbaeac4cd1b5394df898d419bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/960898bbaeac4cd1b5394df898d419bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/960898bbaeac4cd1b5394df898d419bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_960898bbaeac4cd1b5394df898d419bd", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:41.821865 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-111510493 May 27 14:58:41.821865 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 960898bbaeac4cd1b5394df898d419bd May 27 14:58:41.821865 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-111510493 May 27 14:58:41.821865 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerDiagnosticsNegativeTest-111510493-project May 27 14:58:41.821865 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:58:41.821865 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:58:41.821865 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 6d4174aebd284775894cc0047cf5247f May 27 14:58:41.821865 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-111510493-project May 27 14:58:41.821865 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 14:58:41.821865 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance a7898281-77eb-40ed-8047-11d39b2ae6e2 could not be found. May 27 14:58:41.821865 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'a7898281-77eb-40ed-8047-11d39b2ae6e2'} May 27 14:58:41.822555 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:41.822555 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:41.822555 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 14:58:41.822555 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 14:58:41.822555 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 14:58:41.822555 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 14:58:41.822555 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 14:58:41.822555 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 14:58:41.822555 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 14:58:41.822555 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 14:58:41.822555 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7898281-77eb-40ed-8047-11d39b2ae6e2 could not be found. May 27 14:58:41.822555 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:41.822555 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:41.822555 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:41.822555 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:41.822555 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:41.822555 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:41.822555 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:41.822555 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:41.822555 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:41.823670 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:41.823670 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 14:58:41.823670 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 14:58:41.823670 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 14:58:41.823670 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 14:58:41.823670 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 14:58:41.823670 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 14:58:41.823670 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7898281-77eb-40ed-8047-11d39b2ae6e2 could not be found. May 27 14:58:41.823670 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:41.823670 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:41.823670 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:41.823670 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:41.823670 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:41.823670 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:41.823670 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:58:41.823670 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:58:41.823670 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7898281-77eb-40ed-8047-11d39b2ae6e2 could not be found. May 27 14:58:41.823670 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:58:41.841771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-172a1f5d-9e97-43b6-9e14-ae2bdc6f0fae tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] Returning 404 to user: Instance a7898281-77eb-40ed-8047-11d39b2ae6e2 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:41.844201 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-172a1f5d-9e97-43b6-9e14-ae2bdc6f0fae tempest-ServerDiagnosticsNegativeTest-111510493 tempest-ServerDiagnosticsNegativeTest-111510493-project] 10.222.0.13 "GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2" status: 404 len: 111 microversion: 2.1 time: 0.092492 May 27 14:58:41.848092 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 250/543] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:41 2022] GET /compute/v2.1/servers/a7898281-77eb-40ed-8047-11d39b2ae6e2 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:41.869271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d6dbfb34-dd17-41bc-b98f-b9b7ffd7b9d7 tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Calling method '.version_select at 0x7fc7771d29d0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:41.873255 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:41.873255 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:41.877485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6dbfb34-dd17-41bc-b98f-b9b7ffd7b9d7 tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.883894 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6dbfb34-dd17-41bc-b98f-b9b7ffd7b9d7 tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.967211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6dbfb34-dd17-41bc-b98f-b9b7ffd7b9d7 tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:41.970914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6dbfb34-dd17-41bc-b98f-b9b7ffd7b9d7 tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:41.994801 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d6dbfb34-dd17-41bc-b98f-b9b7ffd7b9d7 tempest-HypervisorAdminV253TestBase-1516106225 tempest-HypervisorAdminV253TestBase-1516106225-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors/4168281e-d8f8-4a85-ade5-b378de326df3" status: 200 len: 792 microversion: 2.53 time: 0.144015 May 27 14:58:42.009540 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 251/544] 10.222.0.13 () {60 vars in 1297 bytes} [Fri May 27 14:58:41 2022] GET /compute/v2.1/os-hypervisors/4168281e-d8f8-4a85-ade5-b378de326df3 => generated 792 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:58:42.014199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-97756715-fffe-4bea-8ef7-c68d18b0e4ae tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:42.016484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-97756715-fffe-4bea-8ef7-c68d18b0e4ae tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:42.023039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-97756715-fffe-4bea-8ef7-c68d18b0e4ae tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:42.024157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-97756715-fffe-4bea-8ef7-c68d18b0e4ae tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:42.025636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-97756715-fffe-4bea-8ef7-c68d18b0e4ae tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:42.026182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-97756715-fffe-4bea-8ef7-c68d18b0e4ae tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:42.244917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-97756715-fffe-4bea-8ef7-c68d18b0e4ae tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:42.255817 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-97756715-fffe-4bea-8ef7-c68d18b0e4ae tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1281 microversion: 2.1 time: 0.248886 May 27 14:58:42.259237 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 252/545] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:42 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1281 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:42.270336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1474ced0-b73c-475d-a7c4-3c1096143967 tempest-ServicesAdminNegativeTestJSON-542500786 tempest-ServicesAdminNegativeTestJSON-542500786-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:42.272357 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:42.272357 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:58:42.274438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1474ced0-b73c-475d-a7c4-3c1096143967 tempest-ServicesAdminNegativeTestJSON-542500786 tempest-ServicesAdminNegativeTestJSON-542500786-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a898724ae35547909d7b978b9c271bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a8b0c7ea34b779a64b4105d46b688', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1474ced0-b73c-475d-a7c4-3c1096143967 tempest-ServicesAdminNegativeTestJSON-542500786 tempest-ServicesAdminNegativeTestJSON-542500786-project] Request method failure captured: May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-services HTTP/1.1 May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOcc1UPClH9lCvO2R5CQ9p4yCQwRd6Ruy0jzqGnYv9BdzSYObcR0a8371xCHYcEhqv565bJF1lcOyCNE-AzBHEus7_vnReJugSQHaBS-q9X_HlBluCQ5DPmDcK2PlJb3Y3f0MlfEk04oLNfuKeehnNDNo1tVuWm_aBO4nNalWlcj11k May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 9b9a8b0c7ea34b779a64b4105d46b688 May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-542500786 May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:58:42.278093 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:58:42.279430 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9b9a8b0c7ea34b779a64b4105d46b688"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9b9a8b0c7ea34b779a64b4105d46b688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9b9a8b0c7ea34b779a64b4105d46b688"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9b9a8b0c7ea34b779a64b4105d46b688", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:58:42.279430 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-542500786 May 27 14:58:42.279430 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 9b9a8b0c7ea34b779a64b4105d46b688 May 27 14:58:42.279430 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-542500786 May 27 14:58:42.279430 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServicesAdminNegativeTestJSON-542500786-project May 27 14:58:42.279430 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:58:42.279430 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:58:42.279430 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: a898724ae35547909d7b978b9c271bd0 May 27 14:58:42.279430 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-542500786-project May 27 14:58:42.279430 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:58:42.279430 n-d-843621-1 devstack@n-api.service[119248]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. May 27 14:58:42.279430 n-d-843621-1 devstack@n-api.service[119248]: action_args: {} May 27 14:58:42.280124 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:58:42.280124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:42.280124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:42.280124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:42.280124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:58:42.280124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:58:42.280124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 14:58:42.280124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:58:42.280124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 14:58:42.280124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:58:42.280124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:58:42.280124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:58:42.280124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index May 27 14:58:42.280124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) May 27 14:58:42.280124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:58:42.280124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:58:42.280124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:58:42.280124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:58:42.280124 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:58:42.281242 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:58:42.281242 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:58:42.281242 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:58:42.281242 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:58:42.281242 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:58:42.281242 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:58:42.281242 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:58:42.281242 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:58:42.281242 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:58:42.281242 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. May 27 14:58:42.281242 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:42.281242 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:58:42.281242 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:42.281242 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:58:42.281242 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:58:42.281242 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:58:42.281242 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:58:42.281242 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:58:42.281242 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. May 27 14:58:42.281242 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:58:42.283525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cc878dac-140a-419e-bf76-104a0dbc758b tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:42.284464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cc878dac-140a-419e-bf76-104a0dbc758b tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:42.285190 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1474ced0-b73c-475d-a7c4-3c1096143967 tempest-ServicesAdminNegativeTestJSON-542500786 tempest-ServicesAdminNegativeTestJSON-542500786-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:58:42.290503 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1474ced0-b73c-475d-a7c4-3c1096143967 tempest-ServicesAdminNegativeTestJSON-542500786 tempest-ServicesAdminNegativeTestJSON-542500786-project] 10.222.0.13 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.564320 May 27 14:58:42.291378 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 294/546] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 14:58:41 2022] GET /compute/v2.1/os-services => generated 112 bytes in 583 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:58:42.301979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc878dac-140a-419e-bf76-104a0dbc758b tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:42.303879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc878dac-140a-419e-bf76-104a0dbc758b tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:42.305721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc878dac-140a-419e-bf76-104a0dbc758b tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:42.306178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc878dac-140a-419e-bf76-104a0dbc758b tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:42.306590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4ad9582f-5884-4689-be54-bb627ad1a9a7 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Action: 'create', calling method: .version_select at 0x7fc777078430>, body: {"keypair": {"name": "tempest-keypair-1551296994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6J2yLzXikxE9xKVaPNhhyY/rMArZbHVehzcUbkwzi9uQFLoLBAGdqyHQm33S5yfwGvlPd54a0DOiW4u7sDe06FrMaSaKIdphlkcpFgYKTTVTCaLEg74pC7858G6yf+mQ=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:42.382889 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-4ad9582f-5884-4689-be54-bb627ad1a9a7 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Getting quotas for project 9da838f02f184e8d9040897b31dd7d75. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:58:42.417189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-4ad9582f-5884-4689-be54-bb627ad1a9a7 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Getting quotas for user 3e08df96180b4456a5f2bf09741f43b5 and project 9da838f02f184e8d9040897b31dd7d75. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:58:42.490638 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4ad9582f-5884-4689-be54-bb627ad1a9a7 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.195682 May 27 14:58:42.490638 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 295/547] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 14:58:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:42.906869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-cc878dac-140a-419e-bf76-104a0dbc758b tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lazy-loading 'services' on Instance uuid ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:58:43.027593 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cc878dac-140a-419e-bf76-104a0dbc758b tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 2050 microversion: 2.25 time: 0.767025 May 27 14:58:43.046967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-03e162f2-b9cb-47b7-b60e-c0aeee66be79 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:43.050074 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03e162f2-b9cb-47b7-b60e-c0aeee66be79 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:43.050519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03e162f2-b9cb-47b7-b60e-c0aeee66be79 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:43.051561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03e162f2-b9cb-47b7-b60e-c0aeee66be79 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:43.052041 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 253/548] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:42 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 2050 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:43.052656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03e162f2-b9cb-47b7-b60e-c0aeee66be79 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:43.122628 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-03e162f2-b9cb-47b7-b60e-c0aeee66be79 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.079849 May 27 14:58:43.135210 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e77864a7-bc45-42bd-8ec2-d64204b551d7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:43.135553 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 296/549] 10.222.0.13 () {60 vars in 1216 bytes} [Fri May 27 14:58:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:58:43.136307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e77864a7-bc45-42bd-8ec2-d64204b551d7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:43.143271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e77864a7-bc45-42bd-8ec2-d64204b551d7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:43.144359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e77864a7-bc45-42bd-8ec2-d64204b551d7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:43.145408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e77864a7-bc45-42bd-8ec2-d64204b551d7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:43.146066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e77864a7-bc45-42bd-8ec2-d64204b551d7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:43.266320 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e77864a7-bc45-42bd-8ec2-d64204b551d7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4/action" status: 202 len: 0 microversion: 2.25 time: 0.135654 May 27 14:58:43.271154 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 254/550] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 27 14:58:43 2022] POST /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 27 14:58:43.280254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ff7f58ee-b214-440e-a38d-5809e844c3dc tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:43.281614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-63b2baae-9a88-4a11-bb15-a40880064fa3 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:43.281900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ff7f58ee-b214-440e-a38d-5809e844c3dc tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:43.283662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-63b2baae-9a88-4a11-bb15-a40880064fa3 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:43.289917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff7f58ee-b214-440e-a38d-5809e844c3dc tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:43.290764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff7f58ee-b214-440e-a38d-5809e844c3dc tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:43.291773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff7f58ee-b214-440e-a38d-5809e844c3dc tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:43.292405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff7f58ee-b214-440e-a38d-5809e844c3dc tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:43.303547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63b2baae-9a88-4a11-bb15-a40880064fa3 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:43.305527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63b2baae-9a88-4a11-bb15-a40880064fa3 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:43.306569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63b2baae-9a88-4a11-bb15-a40880064fa3 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:43.309750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63b2baae-9a88-4a11-bb15-a40880064fa3 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:43.710422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ff7f58ee-b214-440e-a38d-5809e844c3dc tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:43.724389 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ff7f58ee-b214-440e-a38d-5809e844c3dc tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1269 microversion: 2.1 time: 0.446171 May 27 14:58:43.733319 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 297/551] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:43 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1269 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:44.059573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-63b2baae-9a88-4a11-bb15-a40880064fa3 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lazy-loading 'services' on Instance uuid ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:58:44.098958 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-63b2baae-9a88-4a11-bb15-a40880064fa3 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 2055 microversion: 2.25 time: 0.825520 May 27 14:58:44.100690 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 255/552] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:43 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 2055 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:44.758501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bf186750-1fb3-4bcd-8604-da8434386b06 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:44.761268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bf186750-1fb3-4bcd-8604-da8434386b06 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:44.771828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf186750-1fb3-4bcd-8604-da8434386b06 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:44.772640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf186750-1fb3-4bcd-8604-da8434386b06 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:44.773845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf186750-1fb3-4bcd-8604-da8434386b06 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:44.775506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf186750-1fb3-4bcd-8604-da8434386b06 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:44.779838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:44.800982 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f7c7b0bd-82aa-45cc-905c-ef8f1acb61bf tempest-SecurityGroupsTestAdminJSON-902878978 tempest-SecurityGroupsTestAdminJSON-902878978-project] Action: 'create', calling method: .version_select at 0x7fc77712cdc0>, body: {"security_group": {"name": "tempest-securitygroup-713800991", "description": "tempest-description-812823135"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:45.303585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bf186750-1fb3-4bcd-8604-da8434386b06 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:45.323897 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bf186750-1fb3-4bcd-8604-da8434386b06 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1311 microversion: 2.1 time: 0.572116 May 27 14:58:45.350678 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 256/553] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:44 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1311 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:45.360117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-484ad87e-4fdc-4fe9-a264-03fec1fd7ba7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:45.361119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-484ad87e-4fdc-4fe9-a264-03fec1fd7ba7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:45.377224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-484ad87e-4fdc-4fe9-a264-03fec1fd7ba7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:45.377675 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-484ad87e-4fdc-4fe9-a264-03fec1fd7ba7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:45.387961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-484ad87e-4fdc-4fe9-a264-03fec1fd7ba7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:45.388430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-484ad87e-4fdc-4fe9-a264-03fec1fd7ba7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:45.973944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-484ad87e-4fdc-4fe9-a264-03fec1fd7ba7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lazy-loading 'services' on Instance uuid ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:58:46.018197 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-484ad87e-4fdc-4fe9-a264-03fec1fd7ba7 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 2035 microversion: 2.25 time: 0.664293 May 27 14:58:46.023245 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 257/554] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:45 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 2035 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:46.040773 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-43d3fb0d-4b1f-4947-afa0-91ba4256170f tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843621-1", "block_migration": "auto"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:46.042073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-43d3fb0d-4b1f-4947-afa0-91ba4256170f tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:46.058162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43d3fb0d-4b1f-4947-afa0-91ba4256170f tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:46.060073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43d3fb0d-4b1f-4947-afa0-91ba4256170f tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:46.063243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43d3fb0d-4b1f-4947-afa0-91ba4256170f tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:46.063744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43d3fb0d-4b1f-4947-afa0-91ba4256170f tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:46.118065 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-43d3fb0d-4b1f-4947-afa0-91ba4256170f tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lazy-loading 'flavor' on Instance uuid ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:58:46.141218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-43d3fb0d-4b1f-4947-afa0-91ba4256170f tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Going to try to live migrate instance to n-h1-843621-1 {{(pid=119249) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 27 14:58:46.257254 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f7c7b0bd-82aa-45cc-905c-ef8f1acb61bf tempest-SecurityGroupsTestAdminJSON-902878978 tempest-SecurityGroupsTestAdminJSON-902878978-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.847078 May 27 14:58:46.269574 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 298/555] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 14:58:44 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:46.280577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f3c4c1da-b08d-4030-b98e-fe71972709a0 tempest-SecurityGroupsTestAdminJSON-902878978 tempest-SecurityGroupsTestAdminJSON-902878978-project] Action: 'create', calling method: .version_select at 0x7fc777078040>, body: {"security_group": {"name": "tempest-securitygroup-906924246", "description": "tempest-description-646129755"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:47.029447 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f3c4c1da-b08d-4030-b98e-fe71972709a0 tempest-SecurityGroupsTestAdminJSON-902878978 tempest-SecurityGroupsTestAdminJSON-902878978-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.757082 May 27 14:58:47.030312 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 299/556] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 14:58:46 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:47.043853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-63b89077-82fa-4644-b70b-89fd31849499 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:47.044766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-63b89077-82fa-4644-b70b-89fd31849499 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:47.057882 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63b89077-82fa-4644-b70b-89fd31849499 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:47.059008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63b89077-82fa-4644-b70b-89fd31849499 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:47.060030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63b89077-82fa-4644-b70b-89fd31849499 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:47.060704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63b89077-82fa-4644-b70b-89fd31849499 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:47.801381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-63b89077-82fa-4644-b70b-89fd31849499 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:47.826113 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-63b89077-82fa-4644-b70b-89fd31849499 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1311 microversion: 2.1 time: 0.792632 May 27 14:58:47.827006 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 300/557] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:47 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1311 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:48.190136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-df733096-5a31-42ef-84a4-1a33edf252e6 tempest-SecurityGroupsTestAdminJSON-328945485 tempest-SecurityGroupsTestAdminJSON-328945485-project-admin] Action: 'create', calling method: .version_select at 0x7fc777222d30>, body: {"security_group": {"name": "tempest-securitygroup-142139940", "description": "tempest-description-2064338547"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:48.488532 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-df733096-5a31-42ef-84a4-1a33edf252e6 tempest-SecurityGroupsTestAdminJSON-328945485 tempest-SecurityGroupsTestAdminJSON-328945485-project-admin] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.652707 May 27 14:58:48.489345 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 301/558] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 14:58:47 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:48.497401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-9e6734d7-22b5-4ef2-a135-92de992f768c req-8e691d48-d253-4edc-919c-8fabf819e49b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701f3802-4b28-473a-b3f1-5f2a43e1ebe7", "tag": "d311ed01-b43c-4481-918e-786b3710c187"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:48.508696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9e6734d7-22b5-4ef2-a135-92de992f768c req-8e691d48-d253-4edc-919c-8fabf819e49b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:48.509144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9e6734d7-22b5-4ef2-a135-92de992f768c req-8e691d48-d253-4edc-919c-8fabf819e49b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:48.520473 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-9e6734d7-22b5-4ef2-a135-92de992f768c req-8e691d48-d253-4edc-919c-8fabf819e49b service nova] Creating event network-changed:d311ed01-b43c-4481-918e-786b3710c187 for instance 701f3802-4b28-473a-b3f1-5f2a43e1ebe7 on n-h1-843621-1 May 27 14:58:48.526433 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-9e6734d7-22b5-4ef2-a135-92de992f768c req-8e691d48-d253-4edc-919c-8fabf819e49b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034862 May 27 14:58:48.527288 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 302/559] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:48.537613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a7b09ee1-25ac-4692-8bcc-7a41585f997e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-618225594", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "1271826021", "adminPass": "***", "networks": [{"uuid": "52754353-fb43-4bd4-bf34-848290b2913d"}], "security_groups": [{"name": "tempest-securitygroup--1571389468"}], "key_name": "tempest-keypair-1551296994", "user_data": "}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:48.672920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-a7b09ee1-25ac-4692-8bcc-7a41585f997e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] validate_networks() for [('52754353-fb43-4bd4-bf34-848290b2913d', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 14:58:49.095898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a7b09ee1-25ac-4692-8bcc-7a41585f997e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:58:49.096469 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a7b09ee1-25ac-4692-8bcc-7a41585f997e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:58:49.096816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a7b09ee1-25ac-4692-8bcc-7a41585f997e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:58:49.097653 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a7b09ee1-25ac-4692-8bcc-7a41585f997e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:58:49.098235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a7b09ee1-25ac-4692-8bcc-7a41585f997e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:58:49.107608 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a7b09ee1-25ac-4692-8bcc-7a41585f997e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:49.108442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a7b09ee1-25ac-4692-8bcc-7a41585f997e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:49.109281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a7b09ee1-25ac-4692-8bcc-7a41585f997e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:49.109718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a7b09ee1-25ac-4692-8bcc-7a41585f997e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:49.130797 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-a7b09ee1-25ac-4692-8bcc-7a41585f997e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Getting quotas for project 9da838f02f184e8d9040897b31dd7d75. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:58:49.136799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-a7b09ee1-25ac-4692-8bcc-7a41585f997e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Getting quotas for user 3e08df96180b4456a5f2bf09741f43b5 and project 9da838f02f184e8d9040897b31dd7d75. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:58:49.149721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a7b09ee1-25ac-4692-8bcc-7a41585f997e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 14:58:49.152082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a7b09ee1-25ac-4692-8bcc-7a41585f997e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 4be00dd7-101a-436f-90e9-b8fcbd0cf00b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 14:58:49.207249 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a7b09ee1-25ac-4692-8bcc-7a41585f997e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.677888 May 27 14:58:49.208204 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 303/560] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:58:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 14:58:49.490178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cc6837f6-7db8-42d9-98a9-0e67046fc793 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:49.504156 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cc6837f6-7db8-42d9-98a9-0e67046fc793 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.294601 May 27 14:58:49.506913 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 304/561] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 14:58:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:49.515019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b4528cf2-cfec-47f9-8ea9-7ea323f27c9d tempest-SecurityGroupsTestAdminJSON-328945485 tempest-SecurityGroupsTestAdminJSON-328945485-project-admin] Action: 'create', calling method: .version_select at 0x7fc7770789d0>, body: {"security_group": {"name": "tempest-securitygroup-537660106", "description": "tempest-description-1682642456"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:49.661576 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-43d3fb0d-4b1f-4947-afa0-91ba4256170f tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4/action" status: 202 len: 0 microversion: 2.25 time: 3.624995 May 27 14:58:49.663500 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 258/562] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 27 14:58:46 2022] POST /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4/action => generated 0 bytes in 3628 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 27 14:58:49.671259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-56a738e7-b0b2-4799-9d95-f278cf219e9d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:49.672405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-56a738e7-b0b2-4799-9d95-f278cf219e9d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:49.714767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56a738e7-b0b2-4799-9d95-f278cf219e9d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:49.715983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56a738e7-b0b2-4799-9d95-f278cf219e9d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:49.719492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56a738e7-b0b2-4799-9d95-f278cf219e9d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:49.719953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56a738e7-b0b2-4799-9d95-f278cf219e9d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:49.791102 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b4528cf2-cfec-47f9-8ea9-7ea323f27c9d tempest-SecurityGroupsTestAdminJSON-328945485 tempest-SecurityGroupsTestAdminJSON-328945485-project-admin] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.280823 May 27 14:58:49.792639 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 305/563] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 14:58:49 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:49.802835 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-871b9473-2d0e-4e1a-a2ec-7b432fe6983c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:49.803524 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-871b9473-2d0e-4e1a-a2ec-7b432fe6983c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 4be00dd7-101a-436f-90e9-b8fcbd0cf00b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:49.819501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-871b9473-2d0e-4e1a-a2ec-7b432fe6983c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:49.819966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-871b9473-2d0e-4e1a-a2ec-7b432fe6983c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:49.821357 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-871b9473-2d0e-4e1a-a2ec-7b432fe6983c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:49.821802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-871b9473-2d0e-4e1a-a2ec-7b432fe6983c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:49.968475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-871b9473-2d0e-4e1a-a2ec-7b432fe6983c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:49.975196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-56a738e7-b0b2-4799-9d95-f278cf219e9d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:49.979941 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-871b9473-2d0e-4e1a-a2ec-7b432fe6983c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b" status: 200 len: 1268 microversion: 2.1 time: 0.184455 May 27 14:58:49.981328 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 306/564] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:49 2022] GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:49.982898 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-56a738e7-b0b2-4799-9d95-f278cf219e9d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1311 microversion: 2.1 time: 0.317649 May 27 14:58:49.993779 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 259/565] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:49 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1311 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:49.997462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a39dfb37-562f-48ea-96a5-bd34d748ec15 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:49.999152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4c5d7b66-7d9b-4c13-9353-d5a409abb295 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:49.999934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4c5d7b66-7d9b-4c13-9353-d5a409abb295 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:50.006874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4c5d7b66-7d9b-4c13-9353-d5a409abb295 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:50.010884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4c5d7b66-7d9b-4c13-9353-d5a409abb295 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:50.011865 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4c5d7b66-7d9b-4c13-9353-d5a409abb295 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:50.012844 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4c5d7b66-7d9b-4c13-9353-d5a409abb295 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:50.046165 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a39dfb37-562f-48ea-96a5-bd34d748ec15 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] 10.222.0.13 "GET /compute/v2.1/flavors" status: 200 len: 3081 microversion: 2.1 time: 0.061955 May 27 14:58:50.046914 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 307/566] 10.222.0.13 () {58 vars in 1124 bytes} [Fri May 27 14:58:49 2022] GET /compute/v2.1/flavors => generated 3081 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:50.067733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-402ec315-4e6b-42eb-98b7-cca6f4ee4683 tempest-SecurityGroupsTestAdminJSON-328945485 tempest-SecurityGroupsTestAdminJSON-328945485-project-admin] Calling method '.version_select at 0x7fc7776793a0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:50.266361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4c5d7b66-7d9b-4c13-9353-d5a409abb295 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:50.275890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4c5d7b66-7d9b-4c13-9353-d5a409abb295 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:50.277769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4c5d7b66-7d9b-4c13-9353-d5a409abb295 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:50.279179 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4c5d7b66-7d9b-4c13-9353-d5a409abb295 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1567 microversion: 2.25 time: 0.284034 May 27 14:58:50.290773 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 260/567] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:49 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1567 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:50.691897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=20 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:50.829929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e74f102b-c7a5-4102-9a28-a5cd272e7b0d tempest-FlavorsV261TestJSON-227347135 tempest-FlavorsV261TestJSON-227347135-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-909492709", "id": 413954466, "os-flavor-access:is_public": "True"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:50.831837 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:50.831837 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:50.864262 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e74f102b-c7a5-4102-9a28-a5cd272e7b0d tempest-FlavorsV261TestJSON-227347135 tempest-FlavorsV261TestJSON-227347135-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.572069 May 27 14:58:50.865271 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 261/568] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 27 14:58:50 2022] POST /compute/v2.1/flavors => generated 464 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:58:50.870793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c9b3c11d-0e6a-4611-b296-7f3f48d90510 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:50.884644 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c9b3c11d-0e6a-4611-b296-7f3f48d90510 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018094 May 27 14:58:50.885896 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 262/569] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 14:58:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:51.072160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e407be94-13bb-4e8d-bf09-eacc52997171 tempest-FlavorsV261TestJSON-241726786 tempest-FlavorsV261TestJSON-241726786-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:51.082479 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e407be94-13bb-4e8d-bf09-eacc52997171 tempest-FlavorsV261TestJSON-241726786 tempest-FlavorsV261TestJSON-241726786-project] 10.222.0.13 "GET /compute/v2.1/flavors/413954466" status: 200 len: 464 microversion: 2.61 time: 0.195366 May 27 14:58:51.083296 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 263/570] 10.222.0.13 () {60 vars in 1195 bytes} [Fri May 27 14:58:50 2022] GET /compute/v2.1/flavors/413954466 => generated 464 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:58:51.144918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ebe5fc27-854c-4dca-b046-421617650507 tempest-InstanceUsageAuditLogTestJSON-556839507 tempest-InstanceUsageAuditLogTestJSON-556839507-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:51.145751 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:51.145751 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:51.166023 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ebe5fc27-854c-4dca-b046-421617650507 tempest-InstanceUsageAuditLogTestJSON-556839507 tempest-InstanceUsageAuditLogTestJSON-556839507-project-admin] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log/2022-05-27 14:58:50" status: 200 len: 318 microversion: 2.1 time: 0.081506 May 27 14:58:51.166592 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 264/571] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 14:58:51 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-05-27%2014%3A58%3A50 => generated 318 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:51.173305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-49b147e4-43dc-46bb-84ed-678c1f2da0cb tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:51.187114 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-49b147e4-43dc-46bb-84ed-678c1f2da0cb tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018933 May 27 14:58:51.187999 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 265/572] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 14:58:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:51.249695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-84a2db42-a0f8-4409-b255-f849bcb1d3d5 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-180276991", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": "none"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:51.258313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:51.311152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-84a2db42-a0f8-4409-b255-f849bcb1d3d5 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:58:51.311661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-84a2db42-a0f8-4409-b255-f849bcb1d3d5 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:58:51.312203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-84a2db42-a0f8-4409-b255-f849bcb1d3d5 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:58:51.312958 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-84a2db42-a0f8-4409-b255-f849bcb1d3d5 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:58:51.314070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-84a2db42-a0f8-4409-b255-f849bcb1d3d5 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:58:51.323932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84a2db42-a0f8-4409-b255-f849bcb1d3d5 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:51.324590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84a2db42-a0f8-4409-b255-f849bcb1d3d5 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:51.325513 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84a2db42-a0f8-4409-b255-f849bcb1d3d5 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:51.325961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84a2db42-a0f8-4409-b255-f849bcb1d3d5 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:51.343686 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-84a2db42-a0f8-4409-b255-f849bcb1d3d5 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Getting quotas for project c1072ffed312450eb8ca8d61c6798b9b. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:58:51.349515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-84a2db42-a0f8-4409-b255-f849bcb1d3d5 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Getting quotas for user 4acfabdbb3e944dcac265f4207a2649c and project c1072ffed312450eb8ca8d61c6798b9b. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:58:51.376644 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-84a2db42-a0f8-4409-b255-f849bcb1d3d5 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 14:58:51.380048 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-84a2db42-a0f8-4409-b255-f849bcb1d3d5 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 14:58:51.433811 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-84a2db42-a0f8-4409-b255-f849bcb1d3d5 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.244425 May 27 14:58:51.434452 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 266/573] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 27 14:58:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 246 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 14:58:51.443326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f6eac090-aeae-494b-b03d-2d5d9751b18c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:51.444337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f6eac090-aeae-494b-b03d-2d5d9751b18c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 4be00dd7-101a-436f-90e9-b8fcbd0cf00b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:51.454154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6eac090-aeae-494b-b03d-2d5d9751b18c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:51.454339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6eac090-aeae-494b-b03d-2d5d9751b18c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:51.455726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6eac090-aeae-494b-b03d-2d5d9751b18c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:51.456172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6eac090-aeae-494b-b03d-2d5d9751b18c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:51.572054 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f6eac090-aeae-494b-b03d-2d5d9751b18c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:51.596834 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f6eac090-aeae-494b-b03d-2d5d9751b18c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b" status: 200 len: 1322 microversion: 2.1 time: 0.161084 May 27 14:58:51.599773 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 267/574] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:51 2022] GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:51.604878 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8bd23ca5-d217-460c-9d53-bfb42704af9f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:51.605503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8bd23ca5-d217-460c-9d53-bfb42704af9f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:51.613874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8bd23ca5-d217-460c-9d53-bfb42704af9f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:51.614330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8bd23ca5-d217-460c-9d53-bfb42704af9f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:51.615107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8bd23ca5-d217-460c-9d53-bfb42704af9f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:51.615549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8bd23ca5-d217-460c-9d53-bfb42704af9f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:51.989518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8bd23ca5-d217-460c-9d53-bfb42704af9f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:51.998165 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8bd23ca5-d217-460c-9d53-bfb42704af9f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1311 microversion: 2.1 time: 0.397385 May 27 14:58:51.998943 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 268/575] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:51 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1311 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:52.004313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7743bf5d-3767-49d9-9ec8-53afb99618c6 tempest-FlavorsV261TestJSON-227347135 tempest-FlavorsV261TestJSON-227347135-project-admin] Action: 'update', calling method: .version_select at 0x7fc77daaf790>, body: {"flavor": {"description": "new"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:52.015962 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:52.015962 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:52.052373 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7743bf5d-3767-49d9-9ec8-53afb99618c6 tempest-FlavorsV261TestJSON-227347135 tempest-FlavorsV261TestJSON-227347135-project-admin] 10.222.0.13 "PUT /compute/v2.1/flavors/413954466" status: 200 len: 465 microversion: 2.61 time: 0.052215 May 27 14:58:52.053039 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 269/576] 10.222.0.13 () {62 vars in 1215 bytes} [Fri May 27 14:58:51 2022] PUT /compute/v2.1/flavors/413954466 => generated 465 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:58:52.058188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3cc3d408-cbec-43da-a93e-84e0f1237a6d tempest-InstanceUsageAuditLogTestJSON-556839507 tempest-InstanceUsageAuditLogTestJSON-556839507-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:52.059465 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:52.059465 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:52.074845 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3cc3d408-cbec-43da-a93e-84e0f1237a6d tempest-InstanceUsageAuditLogTestJSON-556839507 tempest-InstanceUsageAuditLogTestJSON-556839507-project-admin] 10.222.0.13 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.019889 May 27 14:58:52.076029 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 270/577] 10.222.0.13 () {58 vars in 1184 bytes} [Fri May 27 14:58:52 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:52.083253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-76280d0d-5877-4d3c-8bb8-f74fd528b912 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:52.113568 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-76280d0d-5877-4d3c-8bb8-f74fd528b912 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3623 microversion: 2.1 time: 0.036246 May 27 14:58:52.114410 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 271/578] 10.222.0.13 () {58 vars in 1164 bytes} [Fri May 27 14:58:52 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3623 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:52.119124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f4c5c069-4e59-4e8a-b8e4-f9abac7b8d55 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:52.119902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f4c5c069-4e59-4e8a-b8e4-f9abac7b8d55 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:52.127822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4c5c069-4e59-4e8a-b8e4-f9abac7b8d55 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:52.128785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4c5c069-4e59-4e8a-b8e4-f9abac7b8d55 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:52.129718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4c5c069-4e59-4e8a-b8e4-f9abac7b8d55 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:52.130311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4c5c069-4e59-4e8a-b8e4-f9abac7b8d55 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:52.381904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f4c5c069-4e59-4e8a-b8e4-f9abac7b8d55 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:52.391957 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f4c5c069-4e59-4e8a-b8e4-f9abac7b8d55 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:52.394205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f4c5c069-4e59-4e8a-b8e4-f9abac7b8d55 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:52.396178 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f4c5c069-4e59-4e8a-b8e4-f9abac7b8d55 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1567 microversion: 2.25 time: 0.280662 May 27 14:58:52.397223 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 272/579] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:52 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1567 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:52.416730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-28b838ad-d304-4c5e-8142-45828fbc4a22 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:52.419428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-28b838ad-d304-4c5e-8142-45828fbc4a22 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:52.427138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-28b838ad-d304-4c5e-8142-45828fbc4a22 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:52.427801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-28b838ad-d304-4c5e-8142-45828fbc4a22 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:52.428643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-28b838ad-d304-4c5e-8142-45828fbc4a22 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:52.429796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-28b838ad-d304-4c5e-8142-45828fbc4a22 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:52.847837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-28b838ad-d304-4c5e-8142-45828fbc4a22 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:52.867665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-28b838ad-d304-4c5e-8142-45828fbc4a22 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:52.870416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-28b838ad-d304-4c5e-8142-45828fbc4a22 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:52.907227 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-28b838ad-d304-4c5e-8142-45828fbc4a22 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "PUT /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1410 microversion: 2.75 time: 0.481025 May 27 14:58:52.907916 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 273/580] 10.222.0.13 () {62 vars in 1296 bytes} [Fri May 27 14:58:52 2022] PUT /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1410 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:52.925855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-1cc4a6fc-8d07-49bc-a042-7aed535ecec9 req-a375e05f-77ff-4eac-a2c8-d8beda561cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3d494d-8dd1-49b1-a94a-d17aa943e4e4", "name": "network-vif-unplugged", "status": "completed", "tag": "20c204bd-a0e4-4b3a-88e0-34bca47af413"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:52.940991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-1cc4a6fc-8d07-49bc-a042-7aed535ecec9 req-a375e05f-77ff-4eac-a2c8-d8beda561cf8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:52.941435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-1cc4a6fc-8d07-49bc-a042-7aed535ecec9 req-a375e05f-77ff-4eac-a2c8-d8beda561cf8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:52.958358 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-1cc4a6fc-8d07-49bc-a042-7aed535ecec9 req-a375e05f-77ff-4eac-a2c8-d8beda561cf8 service nova] Creating event network-vif-unplugged:20c204bd-a0e4-4b3a-88e0-34bca47af413 for instance ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 on n-h2-843621-1 May 27 14:58:52.969601 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-1cc4a6fc-8d07-49bc-a042-7aed535ecec9 req-a375e05f-77ff-4eac-a2c8-d8beda561cf8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058197 May 27 14:58:52.971167 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 274/581] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:52.985814 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a606346c-6877-4c05-ba13-d0b40ee5196a tempest-FlavorsV261TestJSON-241726786 tempest-FlavorsV261TestJSON-241726786-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:53.031474 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a606346c-6877-4c05-ba13-d0b40ee5196a tempest-FlavorsV261TestJSON-241726786 tempest-FlavorsV261TestJSON-241726786-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 7155 microversion: 2.61 time: 0.057038 May 27 14:58:53.033859 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 275/582] 10.222.0.13 () {60 vars in 1186 bytes} [Fri May 27 14:58:52 2022] GET /compute/v2.1/flavors/detail => generated 7155 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:53.039101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0a8ad5e9-ab95-489a-950c-60bdd13c8b5e tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:53.053091 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0a8ad5e9-ab95-489a-950c-60bdd13c8b5e tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017453 May 27 14:58:53.062216 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 276/583] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 14:58:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:53.069262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8d004cea-111f-4659-b1fa-27812d8be1c3 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:53.071965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8d004cea-111f-4659-b1fa-27812d8be1c3 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 4be00dd7-101a-436f-90e9-b8fcbd0cf00b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:53.091540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d004cea-111f-4659-b1fa-27812d8be1c3 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:53.093315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d004cea-111f-4659-b1fa-27812d8be1c3 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:53.095259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d004cea-111f-4659-b1fa-27812d8be1c3 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:53.095987 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d004cea-111f-4659-b1fa-27812d8be1c3 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:53.386610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8d004cea-111f-4659-b1fa-27812d8be1c3 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:53.403345 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8d004cea-111f-4659-b1fa-27812d8be1c3 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b" status: 200 len: 1390 microversion: 2.1 time: 0.339207 May 27 14:58:53.404371 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 277/584] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:53 2022] GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b => generated 1390 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:53.410589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-77b936aa-be85-4b6d-b8a7-ec9c4beea58d tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:53.411697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-77b936aa-be85-4b6d-b8a7-ec9c4beea58d tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:53.420003 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-77b936aa-be85-4b6d-b8a7-ec9c4beea58d tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:53.420637 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-77b936aa-be85-4b6d-b8a7-ec9c4beea58d tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:53.421923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-77b936aa-be85-4b6d-b8a7-ec9c4beea58d tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:53.422746 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-77b936aa-be85-4b6d-b8a7-ec9c4beea58d tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:53.513959 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-402ec315-4e6b-42eb-98b7-cca6f4ee4683 tempest-SecurityGroupsTestAdminJSON-328945485 tempest-SecurityGroupsTestAdminJSON-328945485-project-admin] 10.222.0.13 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8994 microversion: 2.1 time: 3.459991 May 27 14:58:53.515206 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 308/585] 10.222.0.13 () {58 vars in 1190 bytes} [Fri May 27 14:58:50 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8994 bytes in 3466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:53.541069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b3009489-22c1-45b0-aaea-13dbcae88775 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:53.544569 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b3009489-22c1-45b0-aaea-13dbcae88775 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:53.548410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-77b936aa-be85-4b6d-b8a7-ec9c4beea58d tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:53.561575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b3009489-22c1-45b0-aaea-13dbcae88775 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:53.562247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b3009489-22c1-45b0-aaea-13dbcae88775 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:53.565275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b3009489-22c1-45b0-aaea-13dbcae88775 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:53.565826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b3009489-22c1-45b0-aaea-13dbcae88775 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:53.566862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-77b936aa-be85-4b6d-b8a7-ec9c4beea58d tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:53.569121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-77b936aa-be85-4b6d-b8a7-ec9c4beea58d tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:53.575941 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-77b936aa-be85-4b6d-b8a7-ec9c4beea58d tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1416 microversion: 2.75 time: 0.170152 May 27 14:58:53.589593 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 278/586] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:53 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1416 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:53.595379 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7aef5620-510c-4529-9c73-0a9a7aba31a3 tempest-FlavorsV261TestJSON-241726786 tempest-FlavorsV261TestJSON-241726786-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:53.621860 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7aef5620-510c-4529-9c73-0a9a7aba31a3 tempest-FlavorsV261TestJSON-241726786 tempest-FlavorsV261TestJSON-241726786-project] 10.222.0.13 "GET /compute/v2.1/flavors" status: 200 len: 3682 microversion: 2.61 time: 0.031032 May 27 14:58:53.622464 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 279/587] 10.222.0.13 () {60 vars in 1165 bytes} [Fri May 27 14:58:53 2022] GET /compute/v2.1/flavors => generated 3682 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:53.631495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7c672754-410b-484b-88b2-a8b1ac3e3023 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:53.658968 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7c672754-410b-484b-88b2-a8b1ac3e3023 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.035285 May 27 14:58:53.659554 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 280/588] 10.222.0.13 () {58 vars in 1168 bytes} [Fri May 27 14:58:53 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:53.664659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f89adfcb-f262-4ae3-84c5-a46bb0a3ec82 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:53.665289 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f89adfcb-f262-4ae3-84c5-a46bb0a3ec82 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:53.671892 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f89adfcb-f262-4ae3-84c5-a46bb0a3ec82 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:53.672345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f89adfcb-f262-4ae3-84c5-a46bb0a3ec82 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:53.673319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f89adfcb-f262-4ae3-84c5-a46bb0a3ec82 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:53.673609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f89adfcb-f262-4ae3-84c5-a46bb0a3ec82 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:54.259282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b3009489-22c1-45b0-aaea-13dbcae88775 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:54.267492 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b3009489-22c1-45b0-aaea-13dbcae88775 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1311 microversion: 2.1 time: 0.749226 May 27 14:58:54.268088 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 309/589] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:53 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1311 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:54.281317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e3758dde-6590-496d-994a-b4a67fc75dd4 tempest-SecurityGroupsTestAdminJSON-902878978 tempest-SecurityGroupsTestAdminJSON-902878978-project] Calling method '.version_select at 0x7fc77712cca0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:54.317212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f89adfcb-f262-4ae3-84c5-a46bb0a3ec82 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:54.327756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f89adfcb-f262-4ae3-84c5-a46bb0a3ec82 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:54.329384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f89adfcb-f262-4ae3-84c5-a46bb0a3ec82 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:54.330798 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f89adfcb-f262-4ae3-84c5-a46bb0a3ec82 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1567 microversion: 2.25 time: 0.670332 May 27 14:58:54.331848 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 281/590] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:53 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1567 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:54.346999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e228e531-2003-49d0-b99e-4b00049347e3 tempest-FlavorsV261TestJSON-227347135 tempest-FlavorsV261TestJSON-227347135-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:54.348123 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:58:54.348123 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:58:54.370192 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e228e531-2003-49d0-b99e-4b00049347e3 tempest-FlavorsV261TestJSON-227347135 tempest-FlavorsV261TestJSON-227347135-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/413954466" status: 202 len: 0 microversion: 2.61 time: 0.026793 May 27 14:58:54.371083 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 282/591] 10.222.0.13 () {60 vars in 1198 bytes} [Fri May 27 14:58:54 2022] DELETE /compute/v2.1/flavors/413954466 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 14:58:54.380464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-afd7e2c9-a4e4-472e-ab49-ffdcad3bac2e tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:54.397640 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-afd7e2c9-a4e4-472e-ab49-ffdcad3bac2e tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.021443 May 27 14:58:54.398894 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 283/592] 10.222.0.13 () {58 vars in 1160 bytes} [Fri May 27 14:58:54 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:54.410672 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-2e135f44-871c-4249-8038-c3424405668e req-3e2cb4b3-c14c-4423-8cad-4cf38566f04d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be00dd7-101a-436f-90e9-b8fcbd0cf00b", "tag": "13e3d81c-851f-40aa-8269-fa720646581f"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:54.428202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2e135f44-871c-4249-8038-c3424405668e req-3e2cb4b3-c14c-4423-8cad-4cf38566f04d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:54.428967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2e135f44-871c-4249-8038-c3424405668e req-3e2cb4b3-c14c-4423-8cad-4cf38566f04d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:54.445907 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-2e135f44-871c-4249-8038-c3424405668e req-3e2cb4b3-c14c-4423-8cad-4cf38566f04d service nova] Creating event network-changed:13e3d81c-851f-40aa-8269-fa720646581f for instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b on n-h2-843621-1 May 27 14:58:54.451911 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-2e135f44-871c-4249-8038-c3424405668e req-3e2cb4b3-c14c-4423-8cad-4cf38566f04d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051534 May 27 14:58:54.453562 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 284/593] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:54.464051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fc3d494b-5cc1-4026-a222-180e40ac6590 tempest-FlavorsV261TestJSON-227347135 tempest-FlavorsV261TestJSON-227347135-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:54.509390 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fc3d494b-5cc1-4026-a222-180e40ac6590 tempest-FlavorsV261TestJSON-227347135 tempest-FlavorsV261TestJSON-227347135-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 6700 microversion: 2.61 time: 0.053266 May 27 14:58:54.512821 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 285/594] 10.222.0.13 () {60 vars in 1186 bytes} [Fri May 27 14:58:54 2022] GET /compute/v2.1/flavors/detail => generated 6700 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:54.518201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c3f1d341-4406-4ee4-8348-347ac2ff9a9a tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:54.539523 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c3f1d341-4406-4ee4-8348-347ac2ff9a9a tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024897 May 27 14:58:54.540200 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 286/595] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 14:58:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:54.553186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-09b88089-7d38-4641-a4bf-973017d79e88 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:54.555713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-09b88089-7d38-4641-a4bf-973017d79e88 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 4be00dd7-101a-436f-90e9-b8fcbd0cf00b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:54.570915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09b88089-7d38-4641-a4bf-973017d79e88 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:54.571452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09b88089-7d38-4641-a4bf-973017d79e88 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:54.575019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09b88089-7d38-4641-a4bf-973017d79e88 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:54.575490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09b88089-7d38-4641-a4bf-973017d79e88 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:54.841783 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e3758dde-6590-496d-994a-b4a67fc75dd4 tempest-SecurityGroupsTestAdminJSON-902878978 tempest-SecurityGroupsTestAdminJSON-902878978-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 0.572506 May 27 14:58:54.853764 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 310/596] 10.222.0.13 () {58 vars in 1190 bytes} [Fri May 27 14:58:54 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:54.859944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8e249b00-cbbb-4a86-91d6-09e219b86d94 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:54.887043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-09b88089-7d38-4641-a4bf-973017d79e88 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:54.894915 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-09b88089-7d38-4641-a4bf-973017d79e88 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b" status: 200 len: 1390 microversion: 2.1 time: 0.353615 May 27 14:58:54.895809 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 287/597] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:54 2022] GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b => generated 1390 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:54.908913 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8e249b00-cbbb-4a86-91d6-09e219b86d94 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.053530 May 27 14:58:54.909609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9c600987-2a04-4746-9b4a-59c144626dc2 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:54.909843 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 311/598] 10.222.0.13 () {58 vars in 1166 bytes} [Fri May 27 14:58:54 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:54.910755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9c600987-2a04-4746-9b4a-59c144626dc2 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:54.921325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-2ea7d890-b46e-409e-a66c-4485c87e7bf9 req-54298dd5-2dcc-48bc-b0d3-f41f25e05c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701f3802-4b28-473a-b3f1-5f2a43e1ebe7", "name": "network-vif-plugged", "status": "completed", "tag": "d311ed01-b43c-4481-918e-786b3710c187"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:54.922499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9c600987-2a04-4746-9b4a-59c144626dc2 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:54.923161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9c600987-2a04-4746-9b4a-59c144626dc2 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:54.924196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9c600987-2a04-4746-9b4a-59c144626dc2 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:54.925013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9c600987-2a04-4746-9b4a-59c144626dc2 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:54.930737 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2ea7d890-b46e-409e-a66c-4485c87e7bf9 req-54298dd5-2dcc-48bc-b0d3-f41f25e05c4d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:54.931185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2ea7d890-b46e-409e-a66c-4485c87e7bf9 req-54298dd5-2dcc-48bc-b0d3-f41f25e05c4d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:54.947067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:54.952236 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-2ea7d890-b46e-409e-a66c-4485c87e7bf9 req-54298dd5-2dcc-48bc-b0d3-f41f25e05c4d service nova] Creating event network-vif-plugged:d311ed01-b43c-4481-918e-786b3710c187 for instance 701f3802-4b28-473a-b3f1-5f2a43e1ebe7 on n-h1-843621-1 May 27 14:58:54.959589 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-2ea7d890-b46e-409e-a66c-4485c87e7bf9 req-54298dd5-2dcc-48bc-b0d3-f41f25e05c4d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047984 May 27 14:58:54.961298 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 312/599] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:54.967904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9d4704e5-e5a0-4122-9193-401c0e455748 tempest-SecurityGroupsTestAdminJSON-328945485 tempest-SecurityGroupsTestAdminJSON-328945485-project-admin] Calling method '.version_select at 0x7fc777222af0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:55.016181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9c600987-2a04-4746-9b4a-59c144626dc2 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:55.030413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9c600987-2a04-4746-9b4a-59c144626dc2 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:55.033207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9c600987-2a04-4746-9b4a-59c144626dc2 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:55.052074 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9c600987-2a04-4746-9b4a-59c144626dc2 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1416 microversion: 2.75 time: 0.154903 May 27 14:58:55.053136 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 288/600] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:54 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1416 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:55.057880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7d4b7a4e-e9a9-44a9-bb3e-a7541d58f91f tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:55.066208 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7d4b7a4e-e9a9-44a9-bb3e-a7541d58f91f tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011873 May 27 14:58:55.073063 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 289/601] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 14:58:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:55.078402 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-310c32da-ce2d-42f0-b833-9471a6681525 req-408a7a74-2a89-45aa-9707-429fe12e3644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3d494d-8dd1-49b1-a94a-d17aa943e4e4", "tag": "20c204bd-a0e4-4b3a-88e0-34bca47af413"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:55.088387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-310c32da-ce2d-42f0-b833-9471a6681525 req-408a7a74-2a89-45aa-9707-429fe12e3644 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:55.089056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-310c32da-ce2d-42f0-b833-9471a6681525 req-408a7a74-2a89-45aa-9707-429fe12e3644 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:55.102907 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-310c32da-ce2d-42f0-b833-9471a6681525 req-408a7a74-2a89-45aa-9707-429fe12e3644 service nova] Creating event network-changed:20c204bd-a0e4-4b3a-88e0-34bca47af413 for instance ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 on n-h2-843621-1 May 27 14:58:55.108805 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-310c32da-ce2d-42f0-b833-9471a6681525 req-408a7a74-2a89-45aa-9707-429fe12e3644 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034270 May 27 14:58:55.110667 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 290/602] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:55.117851 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e0b21e7f-be63-4b24-8abd-47071b607418 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:55.142155 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e0b21e7f-be63-4b24-8abd-47071b607418 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] 10.222.0.13 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.030119 May 27 14:58:55.143591 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 291/603] 10.222.0.13 () {58 vars in 1143 bytes} [Fri May 27 14:58:55 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:55.158351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7c148c97-3bfa-4537-8836-67a5931c7fe9 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:55.175044 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7c148c97-3bfa-4537-8836-67a5931c7fe9 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020403 May 27 14:58:55.176533 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 292/604] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 14:58:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 14:58:55.188434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dedd4a0e-1a53-44a3-b143-4915055405b7 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:55.204469 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dedd4a0e-1a53-44a3-b143-4915055405b7 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] 10.222.0.13 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.021114 May 27 14:58:55.205358 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 293/605] 10.222.0.13 () {58 vars in 1147 bytes} [Fri May 27 14:58:55 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:58:55.219090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e774b603-6348-4e1b-b419-0f0082f002f4 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:55.233557 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e774b603-6348-4e1b-b419-0f0082f002f4 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] 10.222.0.13 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.020243 May 27 14:58:55.234171 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 294/606] 10.222.0.13 () {58 vars in 1139 bytes} [Fri May 27 14:58:55 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:55.249050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5863f6bc-179d-47df-a22a-0511b9e3da13 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:55.257073 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5863f6bc-179d-47df-a22a-0511b9e3da13 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012148 May 27 14:58:55.258395 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 295/607] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 14:58:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:55.260640 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9d4704e5-e5a0-4122-9193-401c0e455748 tempest-SecurityGroupsTestAdminJSON-328945485 tempest-SecurityGroupsTestAdminJSON-328945485-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/f6448cdb-6d0c-447a-88c3-12e8489af0a3" status: 202 len: 0 microversion: 2.1 time: 0.297868 May 27 14:58:55.261724 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 313/608] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 14:58:54 2022] DELETE /compute/v2.1/os-security-groups/f6448cdb-6d0c-447a-88c3-12e8489af0a3 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:58:55.270008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dc1644fa-68d5-42fc-ad99-c7de209a5fba tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:55.272846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-058fec00-8556-465b-866e-b0ca93a903d5 tempest-SecurityGroupsTestAdminJSON-328945485 tempest-SecurityGroupsTestAdminJSON-328945485-project-admin] Calling method '.version_select at 0x7fc77712c700>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:55.327532 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dc1644fa-68d5-42fc-ad99-c7de209a5fba tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] 10.222.0.13 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.061513 May 27 14:58:55.328690 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 296/609] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:58:55 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:55.336595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ed5db59a-0097-4c26-b011-a54611d7029e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:55.337940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ed5db59a-0097-4c26-b011-a54611d7029e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:55.347496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ed5db59a-0097-4c26-b011-a54611d7029e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:55.348290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ed5db59a-0097-4c26-b011-a54611d7029e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:55.348898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ed5db59a-0097-4c26-b011-a54611d7029e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:55.349353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ed5db59a-0097-4c26-b011-a54611d7029e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:55.581024 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ed5db59a-0097-4c26-b011-a54611d7029e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:55.592948 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ed5db59a-0097-4c26-b011-a54611d7029e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1311 microversion: 2.1 time: 0.262777 May 27 14:58:55.594233 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 297/610] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:55 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1311 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:55.598261 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-058fec00-8556-465b-866e-b0ca93a903d5 tempest-SecurityGroupsTestAdminJSON-328945485 tempest-SecurityGroupsTestAdminJSON-328945485-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/38445d51-32e3-4acd-84ac-b151414dd776" status: 202 len: 0 microversion: 2.1 time: 0.332070 May 27 14:58:55.599446 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 314/611] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 14:58:55 2022] DELETE /compute/v2.1/os-security-groups/38445d51-32e3-4acd-84ac-b151414dd776 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:58:55.605206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-024acc9b-4fe3-478d-81f5-fb0df2f2049c tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:55.606006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0ca24fd0-95a9-4fa0-804b-d56637daf026 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:55.609193 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0ca24fd0-95a9-4fa0-804b-d56637daf026 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:55.634953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ca24fd0-95a9-4fa0-804b-d56637daf026 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:55.638573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ca24fd0-95a9-4fa0-804b-d56637daf026 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:55.641004 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ca24fd0-95a9-4fa0-804b-d56637daf026 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:55.641622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ca24fd0-95a9-4fa0-804b-d56637daf026 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:55.649441 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-024acc9b-4fe3-478d-81f5-fb0df2f2049c tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.053824 May 27 14:58:55.650207 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 298/612] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 14:58:55 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:55.654723 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-deaa49f3-82c1-465c-9843-a21a58dc47cb tempest-SecurityGroupsTestAdminJSON-902878978 tempest-SecurityGroupsTestAdminJSON-902878978-project] Calling method '.version_select at 0x7fc7771500d0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:55.844932 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0ca24fd0-95a9-4fa0-804b-d56637daf026 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:55.858294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0ca24fd0-95a9-4fa0-804b-d56637daf026 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:55.871874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0ca24fd0-95a9-4fa0-804b-d56637daf026 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:55.875018 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0ca24fd0-95a9-4fa0-804b-d56637daf026 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1567 microversion: 2.25 time: 0.273252 May 27 14:58:55.886757 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 315/613] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:55 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1567 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:55.886757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e7ccc126-8455-471a-b729-cddc090f21b4 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:55.899125 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e7ccc126-8455-471a-b729-cddc090f21b4 tempest-FlavorsV2TestJSON-674142504 tempest-FlavorsV2TestJSON-674142504-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015580 May 27 14:58:55.899363 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 316/614] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 14:58:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:55.917322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3ca19ee7-a9a6-4498-90c2-8b642c9ba471 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:55.917976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3ca19ee7-a9a6-4498-90c2-8b642c9ba471 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 4be00dd7-101a-436f-90e9-b8fcbd0cf00b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:55.924070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3ca19ee7-a9a6-4498-90c2-8b642c9ba471 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:55.924521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3ca19ee7-a9a6-4498-90c2-8b642c9ba471 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:55.925542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3ca19ee7-a9a6-4498-90c2-8b642c9ba471 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:55.926224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3ca19ee7-a9a6-4498-90c2-8b642c9ba471 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:56.120075 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-deaa49f3-82c1-465c-9843-a21a58dc47cb tempest-SecurityGroupsTestAdminJSON-902878978 tempest-SecurityGroupsTestAdminJSON-902878978-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/ce0f778c-a0ac-4176-bc69-4b9541d68606" status: 202 len: 0 microversion: 2.1 time: 0.468786 May 27 14:58:56.121791 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 299/615] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 14:58:55 2022] DELETE /compute/v2.1/os-security-groups/ce0f778c-a0ac-4176-bc69-4b9541d68606 => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:58:56.127079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1ef686bb-8b5a-4e18-aacf-b3c5c5c1dc8e tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:56.128100 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1ef686bb-8b5a-4e18-aacf-b3c5c5c1dc8e tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:56.144730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ef686bb-8b5a-4e18-aacf-b3c5c5c1dc8e tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:56.145583 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ef686bb-8b5a-4e18-aacf-b3c5c5c1dc8e tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:56.146793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ef686bb-8b5a-4e18-aacf-b3c5c5c1dc8e tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:56.147255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ef686bb-8b5a-4e18-aacf-b3c5c5c1dc8e tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:56.298932 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3ca19ee7-a9a6-4498-90c2-8b642c9ba471 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:56.307764 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3ca19ee7-a9a6-4498-90c2-8b642c9ba471 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b" status: 200 len: 1390 microversion: 2.1 time: 0.394678 May 27 14:58:56.308424 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 317/616] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:55 2022] GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b => generated 1390 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:56.315945 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d073f8bc-0e0e-47a5-8e84-22a4e284c995 tempest-SecurityGroupsTestAdminJSON-902878978 tempest-SecurityGroupsTestAdminJSON-902878978-project] Calling method '.version_select at 0x7fc7772ddd30>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:56.334292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1ef686bb-8b5a-4e18-aacf-b3c5c5c1dc8e tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:56.347676 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1ef686bb-8b5a-4e18-aacf-b3c5c5c1dc8e tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:56.352569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1ef686bb-8b5a-4e18-aacf-b3c5c5c1dc8e tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:56.367995 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1ef686bb-8b5a-4e18-aacf-b3c5c5c1dc8e tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1416 microversion: 2.75 time: 0.244772 May 27 14:58:56.369750 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 300/617] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:56 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1416 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:56.612409 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-278e046a-d649-4b41-b398-6b142f2b2b3a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:56.613943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-278e046a-d649-4b41-b398-6b142f2b2b3a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:56.633982 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-278e046a-d649-4b41-b398-6b142f2b2b3a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:56.635527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-278e046a-d649-4b41-b398-6b142f2b2b3a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:56.636700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-278e046a-d649-4b41-b398-6b142f2b2b3a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:56.638915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-278e046a-d649-4b41-b398-6b142f2b2b3a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:56.834077 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d073f8bc-0e0e-47a5-8e84-22a4e284c995 tempest-SecurityGroupsTestAdminJSON-902878978 tempest-SecurityGroupsTestAdminJSON-902878978-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/831fde8c-fb2e-4c54-a332-fc75add0a5c5" status: 202 len: 0 microversion: 2.1 time: 0.523655 May 27 14:58:56.838931 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 318/618] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 14:58:56 2022] DELETE /compute/v2.1/os-security-groups/831fde8c-fb2e-4c54-a332-fc75add0a5c5 => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:58:57.005834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-278e046a-d649-4b41-b398-6b142f2b2b3a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:57.013895 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-278e046a-d649-4b41-b398-6b142f2b2b3a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1311 microversion: 2.1 time: 0.406929 May 27 14:58:57.025100 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 301/619] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:56 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1311 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:57.031222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-69e4f5cb-0fdf-41d5-b42f-129065d5d03e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:57.031932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-69e4f5cb-0fdf-41d5-b42f-129065d5d03e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:57.037790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:57.040685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69e4f5cb-0fdf-41d5-b42f-129065d5d03e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:57.041279 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69e4f5cb-0fdf-41d5-b42f-129065d5d03e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:57.042085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69e4f5cb-0fdf-41d5-b42f-129065d5d03e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:57.042534 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69e4f5cb-0fdf-41d5-b42f-129065d5d03e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:57.104762 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-368b7e15-fc15-4c20-8624-9130057b51ed tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Calling method '.version_select at 0x7fc77703fdc0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:57.335249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-69e4f5cb-0fdf-41d5-b42f-129065d5d03e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:57.353106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-69e4f5cb-0fdf-41d5-b42f-129065d5d03e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:57.355505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-69e4f5cb-0fdf-41d5-b42f-129065d5d03e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:57.357099 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-69e4f5cb-0fdf-41d5-b42f-129065d5d03e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1567 microversion: 2.25 time: 0.330750 May 27 14:58:57.371460 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 302/620] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:57 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1567 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:57.385757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f0e97540-ed4a-4162-ae6d-927c554dc334 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:57.386403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f0e97540-ed4a-4162-ae6d-927c554dc334 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 4be00dd7-101a-436f-90e9-b8fcbd0cf00b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:57.392030 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-368b7e15-fc15-4c20-8624-9130057b51ed tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/c7eaab02e19b42cf92822080282a96bf" status: 200 len: 371 microversion: 2.1 time: 0.555511 May 27 14:58:57.397967 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 319/621] 10.222.0.13 () {58 vars in 1241 bytes} [Fri May 27 14:58:56 2022] GET /compute/v2.1/os-quota-sets/c7eaab02e19b42cf92822080282a96bf => generated 371 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:57.397967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1360af71-f638-4289-84d4-f15ae939fa40 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:57.399708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1360af71-f638-4289-84d4-f15ae939fa40 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:57.405566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0e97540-ed4a-4162-ae6d-927c554dc334 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:57.405770 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1360af71-f638-4289-84d4-f15ae939fa40 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:57.406255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1360af71-f638-4289-84d4-f15ae939fa40 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:57.407112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1360af71-f638-4289-84d4-f15ae939fa40 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:57.407631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1360af71-f638-4289-84d4-f15ae939fa40 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:57.407749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0e97540-ed4a-4162-ae6d-927c554dc334 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:57.408536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0e97540-ed4a-4162-ae6d-927c554dc334 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:57.409015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0e97540-ed4a-4162-ae6d-927c554dc334 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:57.606051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1360af71-f638-4289-84d4-f15ae939fa40 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:57.616234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1360af71-f638-4289-84d4-f15ae939fa40 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:57.618742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1360af71-f638-4289-84d4-f15ae939fa40 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:57.632463 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1360af71-f638-4289-84d4-f15ae939fa40 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1416 microversion: 2.75 time: 0.238186 May 27 14:58:57.634357 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 320/622] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:57 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1416 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:57.639460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1a737039-d6f6-4917-8417-244f185cde51 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Action: 'update', calling method: .version_select at 0x7fc77712c4c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:57.753930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a737039-d6f6-4917-8417-244f185cde51 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:57.754625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a737039-d6f6-4917-8417-244f185cde51 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:57.755702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a737039-d6f6-4917-8417-244f185cde51 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:57.756496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a737039-d6f6-4917-8417-244f185cde51 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:57.781197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f0e97540-ed4a-4162-ae6d-927c554dc334 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:57.795147 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f0e97540-ed4a-4162-ae6d-927c554dc334 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b" status: 200 len: 1390 microversion: 2.1 time: 0.422482 May 27 14:58:57.810410 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 303/623] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:57 2022] GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b => generated 1390 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:57.866272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:57.904166 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1a737039-d6f6-4917-8417-244f185cde51 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/c7eaab02e19b42cf92822080282a96bf" status: 200 len: 328 microversion: 2.1 time: 0.267218 May 27 14:58:57.905752 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 321/624] 10.222.0.13 () {60 vars in 1261 bytes} [Fri May 27 14:58:57 2022] PUT /compute/v2.1/os-quota-sets/c7eaab02e19b42cf92822080282a96bf => generated 328 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:57.916130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-504a5731-3165-418e-98c1-f8b3300714b7 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:57.933888 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-504a5731-3165-418e-98c1-f8b3300714b7 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-quota-sets/c7eaab02e19b42cf92822080282a96bf" status: 202 len: 0 microversion: 2.1 time: 0.021082 May 27 14:58:57.937599 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 304/625] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 14:58:57 2022] DELETE /compute/v2.1/os-quota-sets/c7eaab02e19b42cf92822080282a96bf => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:58:57.951921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7fdfa64f-e184-4aa2-a768-3590ab3433c8 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Calling method '.version_select at 0x7fc7770788b0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:58.032493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-433d195a-bafc-4168-a87b-cef201fb348d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:58.033389 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-433d195a-bafc-4168-a87b-cef201fb348d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:58.041881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-433d195a-bafc-4168-a87b-cef201fb348d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:58.042648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-433d195a-bafc-4168-a87b-cef201fb348d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:58.043861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-433d195a-bafc-4168-a87b-cef201fb348d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:58.044553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-433d195a-bafc-4168-a87b-cef201fb348d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:58.243375 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-433d195a-bafc-4168-a87b-cef201fb348d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:58.253214 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-433d195a-bafc-4168-a87b-cef201fb348d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1311 microversion: 2.1 time: 0.225640 May 27 14:58:58.254349 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 305/626] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:58 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1311 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:58.376025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-600e007f-0f4c-43d8-9638-b2330f5f7730 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:58.376650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-600e007f-0f4c-43d8-9638-b2330f5f7730 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:58.386799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-600e007f-0f4c-43d8-9638-b2330f5f7730 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:58.387501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-600e007f-0f4c-43d8-9638-b2330f5f7730 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:58.388688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-600e007f-0f4c-43d8-9638-b2330f5f7730 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:58.390243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-600e007f-0f4c-43d8-9638-b2330f5f7730 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:58.439866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=67,nova_cell0:UPDATE=12 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:58.451770 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7fdfa64f-e184-4aa2-a768-3590ab3433c8 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/c7eaab02e19b42cf92822080282a96bf" status: 200 len: 371 microversion: 2.1 time: 0.507000 May 27 14:58:58.457893 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 322/627] 10.222.0.13 () {58 vars in 1241 bytes} [Fri May 27 14:58:57 2022] GET /compute/v2.1/os-quota-sets/c7eaab02e19b42cf92822080282a96bf => generated 371 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:58.557098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-600e007f-0f4c-43d8-9638-b2330f5f7730 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:58.566845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-600e007f-0f4c-43d8-9638-b2330f5f7730 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:58.568392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-600e007f-0f4c-43d8-9638-b2330f5f7730 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:58.569620 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-600e007f-0f4c-43d8-9638-b2330f5f7730 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1567 microversion: 2.25 time: 0.198246 May 27 14:58:58.570741 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 306/628] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:58 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 14:58:58.654014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-356e6332-7027-43ea-ad2e-22a1c3e3972c tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:58.654650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-356e6332-7027-43ea-ad2e-22a1c3e3972c tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:58.662140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-356e6332-7027-43ea-ad2e-22a1c3e3972c tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:58.663065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-356e6332-7027-43ea-ad2e-22a1c3e3972c tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:58.664508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-356e6332-7027-43ea-ad2e-22a1c3e3972c tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:58.666097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-356e6332-7027-43ea-ad2e-22a1c3e3972c tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:58.737972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-356e6332-7027-43ea-ad2e-22a1c3e3972c tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:58.747708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-356e6332-7027-43ea-ad2e-22a1c3e3972c tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:58.749453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-356e6332-7027-43ea-ad2e-22a1c3e3972c tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:58.755155 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-356e6332-7027-43ea-ad2e-22a1c3e3972c tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1416 microversion: 2.75 time: 0.105598 May 27 14:58:58.756143 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 323/629] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:58 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1416 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:58.787544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-204746c9-7607-4b1a-8a42-3edb173df23f tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Calling method '.version_select at 0x7fc7772ae040>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:58.815589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8ce83dbb-2318-4651-8d37-cc620abacdd0 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:58.816605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8ce83dbb-2318-4651-8d37-cc620abacdd0 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 4be00dd7-101a-436f-90e9-b8fcbd0cf00b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:58.823894 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ce83dbb-2318-4651-8d37-cc620abacdd0 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:58.824471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ce83dbb-2318-4651-8d37-cc620abacdd0 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:58.825326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ce83dbb-2318-4651-8d37-cc620abacdd0 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:58.825966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ce83dbb-2318-4651-8d37-cc620abacdd0 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:58.972046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8ce83dbb-2318-4651-8d37-cc620abacdd0 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:58.980266 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8ce83dbb-2318-4651-8d37-cc620abacdd0 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b" status: 200 len: 1390 microversion: 2.1 time: 0.169585 May 27 14:58:58.980958 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 324/630] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:58 2022] GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:58:59.249342 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-204746c9-7607-4b1a-8a42-3edb173df23f tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/125b7d2f1ff14538be51d5180d269f47/defaults" status: 200 len: 371 microversion: 2.1 time: 0.466051 May 27 14:58:59.249916 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 307/631] 10.222.0.13 () {58 vars in 1268 bytes} [Fri May 27 14:58:58 2022] GET /compute/v2.1/os-quota-sets/125b7d2f1ff14538be51d5180d269f47/defaults => generated 371 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:58:59.269904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ad76e5a5-7307-4cee-835f-a8c0d5e46c93 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:59.270715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ad76e5a5-7307-4cee-835f-a8c0d5e46c93 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:59.277439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad76e5a5-7307-4cee-835f-a8c0d5e46c93 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:59.278163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad76e5a5-7307-4cee-835f-a8c0d5e46c93 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:59.279094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad76e5a5-7307-4cee-835f-a8c0d5e46c93 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:59.279684 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad76e5a5-7307-4cee-835f-a8c0d5e46c93 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:59.431626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ad76e5a5-7307-4cee-835f-a8c0d5e46c93 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:59.439189 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ad76e5a5-7307-4cee-835f-a8c0d5e46c93 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1311 microversion: 2.1 time: 0.172986 May 27 14:58:59.449168 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 325/632] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:59 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1311 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:58:59.588870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-632b726b-517d-4801-9029-248109799338 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:59.590524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-632b726b-517d-4801-9029-248109799338 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:59.598529 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-632b726b-517d-4801-9029-248109799338 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:59.599219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-632b726b-517d-4801-9029-248109799338 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:59.600184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-632b726b-517d-4801-9029-248109799338 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:59.601890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-632b726b-517d-4801-9029-248109799338 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:59.740197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-632b726b-517d-4801-9029-248109799338 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:59.749104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-632b726b-517d-4801-9029-248109799338 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:59.751342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-632b726b-517d-4801-9029-248109799338 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:59.752612 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-632b726b-517d-4801-9029-248109799338 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1567 microversion: 2.25 time: 0.169336 May 27 14:58:59.764199 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 308/633] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:59 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:59.776570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3d859ba4-7393-466e-a010-ac6075dc9593 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:59.777487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3d859ba4-7393-466e-a010-ac6075dc9593 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:58:59.783899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d859ba4-7393-466e-a010-ac6075dc9593 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:59.784532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d859ba4-7393-466e-a010-ac6075dc9593 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:59.785344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d859ba4-7393-466e-a010-ac6075dc9593 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:58:59.785788 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d859ba4-7393-466e-a010-ac6075dc9593 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:58:59.798925 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:58:59.866571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3d859ba4-7393-466e-a010-ac6075dc9593 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:59.877287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3d859ba4-7393-466e-a010-ac6075dc9593 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:59.879036 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3d859ba4-7393-466e-a010-ac6075dc9593 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:58:59.884218 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3d859ba4-7393-466e-a010-ac6075dc9593 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1416 microversion: 2.75 time: 0.112312 May 27 14:58:59.884989 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 326/634] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:58:59 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1416 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:58:59.954101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0519f8d9-5631-486b-b2b2-610e8f85ec84 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Action: 'update', calling method: .version_select at 0x7fc7772c4790>, body: {"quota_set": {"ram": "5120"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:58:59.998772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-649a1eb7-a860-4115-82ee-132231e517bd tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:58:59.999617 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-649a1eb7-a860-4115-82ee-132231e517bd tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 4be00dd7-101a-436f-90e9-b8fcbd0cf00b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:00.011319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-649a1eb7-a860-4115-82ee-132231e517bd tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:00.011823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-649a1eb7-a860-4115-82ee-132231e517bd tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:00.012990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-649a1eb7-a860-4115-82ee-132231e517bd tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:00.013469 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-649a1eb7-a860-4115-82ee-132231e517bd tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:00.171552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-649a1eb7-a860-4115-82ee-132231e517bd tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:00.180410 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-649a1eb7-a860-4115-82ee-132231e517bd tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b" status: 200 len: 1390 microversion: 2.1 time: 0.186760 May 27 14:59:00.181471 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 327/635] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:58:59 2022] GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b => generated 1390 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:00.243390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-08decb41-ada6-4e15-9d14-2d7525e17326 req-8b2116c7-8af6-4448-881c-9b4ffc23d90e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be00dd7-101a-436f-90e9-b8fcbd0cf00b", "name": "network-vif-plugged", "status": "completed", "tag": "13e3d81c-851f-40aa-8269-fa720646581f"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:00.256948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-08decb41-ada6-4e15-9d14-2d7525e17326 req-8b2116c7-8af6-4448-881c-9b4ffc23d90e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:00.258046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-08decb41-ada6-4e15-9d14-2d7525e17326 req-8b2116c7-8af6-4448-881c-9b4ffc23d90e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:00.294064 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-08decb41-ada6-4e15-9d14-2d7525e17326 req-8b2116c7-8af6-4448-881c-9b4ffc23d90e service nova] Creating event network-vif-plugged:13e3d81c-851f-40aa-8269-fa720646581f for instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b on n-h2-843621-1 May 27 14:59:00.305320 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-08decb41-ada6-4e15-9d14-2d7525e17326 req-8b2116c7-8af6-4448-881c-9b4ffc23d90e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065396 May 27 14:59:00.311761 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 328/636] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 14:59:00.455950 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-521ee021-81a1-46f5-b771-857b2e065fc7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:00.456843 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-521ee021-81a1-46f5-b771-857b2e065fc7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:00.473787 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-521ee021-81a1-46f5-b771-857b2e065fc7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:00.474735 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-521ee021-81a1-46f5-b771-857b2e065fc7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:00.487725 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-521ee021-81a1-46f5-b771-857b2e065fc7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:00.490495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-521ee021-81a1-46f5-b771-857b2e065fc7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:00.515604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0519f8d9-5631-486b-b2b2-610e8f85ec84 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:00.516276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0519f8d9-5631-486b-b2b2-610e8f85ec84 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:00.517216 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0519f8d9-5631-486b-b2b2-610e8f85ec84 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:00.517839 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0519f8d9-5631-486b-b2b2-610e8f85ec84 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:00.606771 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0519f8d9-5631-486b-b2b2-610e8f85ec84 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/e2a0848ecf604653943870e5e2923052" status: 200 len: 328 microversion: 2.1 time: 0.656414 May 27 14:59:00.612329 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 309/637] 10.222.0.13 () {60 vars in 1261 bytes} [Fri May 27 14:58:59 2022] PUT /compute/v2.1/os-quota-sets/e2a0848ecf604653943870e5e2923052 => generated 328 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:00.624060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9007feb6-9dc5-4ad7-80e7-3b356883cba7 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Calling method '.version_select at 0x7fc7772ae430>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:00.694397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-521ee021-81a1-46f5-b771-857b2e065fc7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:00.704255 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-521ee021-81a1-46f5-b771-857b2e065fc7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1311 microversion: 2.1 time: 0.252409 May 27 14:59:00.706315 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 329/638] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:00 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1311 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:59:00.898966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9007feb6-9dc5-4ad7-80e7-3b356883cba7 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:00.899710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9007feb6-9dc5-4ad7-80e7-3b356883cba7 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:00.900924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9007feb6-9dc5-4ad7-80e7-3b356883cba7 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:00.901636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9007feb6-9dc5-4ad7-80e7-3b356883cba7 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:00.925957 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9007feb6-9dc5-4ad7-80e7-3b356883cba7 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/e2a0848ecf604653943870e5e2923052/detail" status: 200 len: 916 microversion: 2.1 time: 0.308206 May 27 14:59:00.927336 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 310/639] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 14:59:00 2022] GET /compute/v2.1/os-quota-sets/e2a0848ecf604653943870e5e2923052/detail => generated 916 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:00.930524 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c4471f72-47ae-4794-9b66-c4075a4e7c84 tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] Action: 'create', calling method: .version_select at 0x7fc7772ddd30>, body: {"keypair": {"name": "tempest-keypair-2039290699", "type": "ssh", "user_id": "9c4c9d66c83a45e093912624041af744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImTFQ/bbjsJ5S/JQAbs7c6Aqg26DcBeiAvAP5w+5Zn95ruwmRXbiiMqbsvJ1n8G7aJ8NJiwQsCLUSZ1ZYCU8GMltbO5Xcn6IFBgyDmZWhbNInWanBymea6JEo6cYFIgsQ=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:00.932319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-99e7a420-6c40-4ae9-a9f6-92ca339876c2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:00.933038 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-99e7a420-6c40-4ae9-a9f6-92ca339876c2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:00.939765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99e7a420-6c40-4ae9-a9f6-92ca339876c2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:00.940316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99e7a420-6c40-4ae9-a9f6-92ca339876c2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:00.941203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99e7a420-6c40-4ae9-a9f6-92ca339876c2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:00.941857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99e7a420-6c40-4ae9-a9f6-92ca339876c2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:00.956570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-c4471f72-47ae-4794-9b66-c4075a4e7c84 tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] Getting quotas for project 7fce79a07d624ccab768f14961669448. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:59:00.964105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-c4471f72-47ae-4794-9b66-c4075a4e7c84 tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] Getting quotas for user 026145a41bf04e7397168f958e0c9b27 and project 7fce79a07d624ccab768f14961669448. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:59:01.002979 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c4471f72-47ae-4794-9b66-c4075a4e7c84 tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.284814 May 27 14:59:01.003802 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 330/640] 10.222.0.13 () {62 vars in 1199 bytes} [Fri May 27 14:59:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 286 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 14:59:01.011354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a23d5925-6973-4f3b-b3e6-d59e7d97d404 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:01.012577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a23d5925-6973-4f3b-b3e6-d59e7d97d404 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:01.022411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a23d5925-6973-4f3b-b3e6-d59e7d97d404 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:01.024834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a23d5925-6973-4f3b-b3e6-d59e7d97d404 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:01.026189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a23d5925-6973-4f3b-b3e6-d59e7d97d404 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:01.026777 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a23d5925-6973-4f3b-b3e6-d59e7d97d404 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:01.140569 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a23d5925-6973-4f3b-b3e6-d59e7d97d404 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:01.145166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-99e7a420-6c40-4ae9-a9f6-92ca339876c2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:01.155856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a23d5925-6973-4f3b-b3e6-d59e7d97d404 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:01.156244 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-99e7a420-6c40-4ae9-a9f6-92ca339876c2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:01.159171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-99e7a420-6c40-4ae9-a9f6-92ca339876c2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:01.160636 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-99e7a420-6c40-4ae9-a9f6-92ca339876c2 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1567 microversion: 2.25 time: 0.232056 May 27 14:59:01.161229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a23d5925-6973-4f3b-b3e6-d59e7d97d404 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:01.161438 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 311/641] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:00 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:01.172014 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a23d5925-6973-4f3b-b3e6-d59e7d97d404 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1416 microversion: 2.75 time: 0.166948 May 27 14:59:01.175714 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bef012a2-db6b-4377-b4e9-7b884eba994d tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] Action: 'create', calling method: .version_select at 0x7fc7776e28b0>, body: {"keypair": {"name": "tempest-keypair-273160268", "type": "ssh", "user_id": "9c4c9d66c83a45e093912624041af744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABe6IJPDcqq1Ihg2nFrmqhoxWBqxpvF9R8x0q7dltbT9xVxTZa3DkeQjeHloQFCb8E4keuiPpW4Dx2AAWMF50OjVNAjMz4UKv/zYQyWPCQmPdPA2jGvjKtapjDT7Qp++Q=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:01.176159 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 331/642] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:01 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1416 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:01.205472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-bef012a2-db6b-4377-b4e9-7b884eba994d tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] Getting quotas for project 7fce79a07d624ccab768f14961669448. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:59:01.206997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1d0f9a5e-5dce-4104-b3fb-bf647a2392fd tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:01.207598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1d0f9a5e-5dce-4104-b3fb-bf647a2392fd tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 4be00dd7-101a-436f-90e9-b8fcbd0cf00b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:01.213292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-bef012a2-db6b-4377-b4e9-7b884eba994d tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] Getting quotas for user 026145a41bf04e7397168f958e0c9b27 and project 7fce79a07d624ccab768f14961669448. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:59:01.215510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d0f9a5e-5dce-4104-b3fb-bf647a2392fd tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:01.215967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d0f9a5e-5dce-4104-b3fb-bf647a2392fd tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:01.224014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d0f9a5e-5dce-4104-b3fb-bf647a2392fd tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:01.224473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d0f9a5e-5dce-4104-b3fb-bf647a2392fd tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:01.259807 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bef012a2-db6b-4377-b4e9-7b884eba994d tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.096982 May 27 14:59:01.261290 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 312/643] 10.222.0.13 () {62 vars in 1199 bytes} [Fri May 27 14:59:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 14:59:01.273997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b9700850-e3fb-41cd-b36f-e602804ef0f3 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Action: 'update', calling method: .version_select at 0x7fc7775bd5e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:01.345606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9700850-e3fb-41cd-b36f-e602804ef0f3 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:01.346450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9700850-e3fb-41cd-b36f-e602804ef0f3 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:01.347715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9700850-e3fb-41cd-b36f-e602804ef0f3 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:01.348334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9700850-e3fb-41cd-b36f-e602804ef0f3 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:01.376866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=13 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:01.396061 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1d0f9a5e-5dce-4104-b3fb-bf647a2392fd tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:01.405475 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1d0f9a5e-5dce-4104-b3fb-bf647a2392fd tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b" status: 200 len: 1390 microversion: 2.1 time: 0.202580 May 27 14:59:01.406459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9700850-e3fb-41cd-b36f-e602804ef0f3 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:01.406624 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 332/644] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:01 2022] GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b => generated 1390 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:59:01.407520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9700850-e3fb-41cd-b36f-e602804ef0f3 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:01.408556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9700850-e3fb-41cd-b36f-e602804ef0f3 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:01.409291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9700850-e3fb-41cd-b36f-e602804ef0f3 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:01.412407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d2e8cb0f-5836-4ea9-b740-3e61563d8f8c tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] Calling method '.version_select at 0x7fc776f5e040>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:01.420581 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d2e8cb0f-5836-4ea9-b740-3e61563d8f8c tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-2039290699?user_id=9c4c9d66c83a45e093912624041af744" status: 200 len: 512 microversion: 2.10 time: 0.012738 May 27 14:59:01.421207 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 333/645] 10.222.0.13 () {60 vars in 1339 bytes} [Fri May 27 14:59:01 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2039290699?user_id=9c4c9d66c83a45e093912624041af744 => generated 512 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:59:01.435963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a94e4edf-4249-46d4-ae96-95bac434ea4e tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] Action: 'create', calling method: .version_select at 0x7fc77712c700>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1612317608", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlVZrwSJtULnrtgjIJeikOP8bZG3WGsGhn4ejzv6JYLujtqbSOxbPJLMjBsR5ukJjCIpmNLJvsfXBvl918gbM86IOCKPVd2WgsjXmpe+/x0c9EyxBVzSdwZD8zxMTlE1A=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:01.449670 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-a94e4edf-4249-46d4-ae96-95bac434ea4e tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] Getting quotas for project 7fce79a07d624ccab768f14961669448. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:59:01.456087 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-a94e4edf-4249-46d4-ae96-95bac434ea4e tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] Getting quotas for user 026145a41bf04e7397168f958e0c9b27 and project 7fce79a07d624ccab768f14961669448. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:59:01.485182 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a94e4edf-4249-46d4-ae96-95bac434ea4e tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.053411 May 27 14:59:01.486091 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 334/646] 10.222.0.13 () {62 vars in 1199 bytes} [Fri May 27 14:59:01 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 14:59:01.496776 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b35c924f-66a3-4c6b-a0fd-9cc3116178e4 tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] Calling method '.version_select at 0x7fc777024ee0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:01.497276 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b9700850-e3fb-41cd-b36f-e602804ef0f3 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/e2a0848ecf604653943870e5e2923052?user_id=5941c05580db4b5ba586058d453a0ebd" status: 200 len: 328 microversion: 2.1 time: 0.234749 May 27 14:59:01.500627 n-d-843621-1 devstack@n-api.service[119248]: WARNING oslo_db.sqlalchemy.utils [None req-b35c924f-66a3-4c6b-a0fd-9cc3116178e4 tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. May 27 14:59:01.504771 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 313/647] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 14:59:01 2022] PUT /compute/v2.1/os-quota-sets/e2a0848ecf604653943870e5e2923052?user_id=5941c05580db4b5ba586058d453a0ebd => generated 328 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:01.511802 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b35c924f-66a3-4c6b-a0fd-9cc3116178e4 tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] 10.222.0.13 "GET /compute/v2.1/os-keypairs?user_id=9c4c9d66c83a45e093912624041af744" status: 200 len: 725 microversion: 2.10 time: 0.018687 May 27 14:59:01.512370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-094186c1-6fb5-4233-ae04-c922aff158a2 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Calling method '.version_select at 0x7fc7771d29d0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:01.513100 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 335/648] 10.222.0.13 () {60 vars in 1258 bytes} [Fri May 27 14:59:01 2022] GET /compute/v2.1/os-keypairs?user_id=9c4c9d66c83a45e093912624041af744 => generated 725 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 14:59:01.535847 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1b7444ff-ba3f-40c3-8b59-eff01043b83b tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] Calling method '.version_select at 0x7fc777024700>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:01.559394 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1b7444ff-ba3f-40c3-8b59-eff01043b83b tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1612317608" status: 204 len: 0 microversion: 2.10 time: 0.029372 May 27 14:59:01.560755 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 336/649] 10.222.0.13 () {60 vars in 1324 bytes} [Fri May 27 14:59:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1612317608 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 14:59:01.572879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9ce87c5d-9502-46fe-839d-9d5779b1f385 tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] Calling method '.version_select at 0x7fc776f5e430>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:01.622361 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9ce87c5d-9502-46fe-839d-9d5779b1f385 tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-273160268?user_id=9c4c9d66c83a45e093912624041af744" status: 204 len: 0 microversion: 2.10 time: 0.054429 May 27 14:59:01.626461 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 337/650] 10.222.0.13 () {60 vars in 1339 bytes} [Fri May 27 14:59:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-273160268?user_id=9c4c9d66c83a45e093912624041af744 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 14:59:01.635108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0923ca00-fbb4-4d99-8bc1-bee00a0dbb6d tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] Calling method '.version_select at 0x7fc776f4fa60>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:01.635894 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-094186c1-6fb5-4233-ae04-c922aff158a2 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/e2a0848ecf604653943870e5e2923052?user_id=5941c05580db4b5ba586058d453a0ebd" status: 200 len: 370 microversion: 2.1 time: 0.129694 May 27 14:59:01.636984 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 314/651] 10.222.0.13 () {58 vars in 1322 bytes} [Fri May 27 14:59:01 2022] GET /compute/v2.1/os-quota-sets/e2a0848ecf604653943870e5e2923052?user_id=5941c05580db4b5ba586058d453a0ebd => generated 370 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:01.664842 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0923ca00-fbb4-4d99-8bc1-bee00a0dbb6d tempest-KeyPairsV210TestJSON-415023948 tempest-KeyPairsV210TestJSON-415023948-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2039290699?user_id=9c4c9d66c83a45e093912624041af744" status: 204 len: 0 microversion: 2.10 time: 0.036693 May 27 14:59:01.666017 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 338/652] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 14:59:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2039290699?user_id=9c4c9d66c83a45e093912624041af744 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 14:59:01.725370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0268ca04-7274-4072-8975-d90fa14f72f8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:01.726888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0268ca04-7274-4072-8975-d90fa14f72f8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:01.739625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0268ca04-7274-4072-8975-d90fa14f72f8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:01.741261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0268ca04-7274-4072-8975-d90fa14f72f8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:01.744031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0268ca04-7274-4072-8975-d90fa14f72f8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:01.744854 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0268ca04-7274-4072-8975-d90fa14f72f8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:01.926385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0268ca04-7274-4072-8975-d90fa14f72f8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:01.936523 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0268ca04-7274-4072-8975-d90fa14f72f8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1311 microversion: 2.1 time: 0.216528 May 27 14:59:01.937732 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 315/653] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:01 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1311 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:02.186165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-af80e11b-1597-4232-8904-0ec36d8c4b5b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:02.186794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-af80e11b-1597-4232-8904-0ec36d8c4b5b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:02.201748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ebc56322-d8da-4732-82dc-0c96afc83ebf tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:02.202382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ebc56322-d8da-4732-82dc-0c96afc83ebf tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:02.206534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af80e11b-1597-4232-8904-0ec36d8c4b5b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:02.208381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af80e11b-1597-4232-8904-0ec36d8c4b5b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:02.212262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af80e11b-1597-4232-8904-0ec36d8c4b5b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:02.214670 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af80e11b-1597-4232-8904-0ec36d8c4b5b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:02.223203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ebc56322-d8da-4732-82dc-0c96afc83ebf tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:02.223671 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ebc56322-d8da-4732-82dc-0c96afc83ebf tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:02.252977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ebc56322-d8da-4732-82dc-0c96afc83ebf tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:02.253532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ebc56322-d8da-4732-82dc-0c96afc83ebf tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:02.531464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ebc56322-d8da-4732-82dc-0c96afc83ebf tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:02.542488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ebc56322-d8da-4732-82dc-0c96afc83ebf tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:02.544644 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ebc56322-d8da-4732-82dc-0c96afc83ebf tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:02.552115 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ebc56322-d8da-4732-82dc-0c96afc83ebf tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1416 microversion: 2.75 time: 0.355762 May 27 14:59:02.553550 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 316/654] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:02 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1416 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 14:59:02.560238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9cc4fc11-ef63-428f-a3d1-46c1ec470187 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Calling method '.version_select at 0x7fc7777d51f0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:02.803457 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9cc4fc11-ef63-428f-a3d1-46c1ec470187 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/125b7d2f1ff14538be51d5180d269f47/defaults" status: 200 len: 371 microversion: 2.1 time: 0.247730 May 27 14:59:02.810204 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 317/655] 10.222.0.13 () {58 vars in 1268 bytes} [Fri May 27 14:59:02 2022] GET /compute/v2.1/os-quota-sets/125b7d2f1ff14538be51d5180d269f47/defaults => generated 371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:02.815409 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c18133ab-c8bd-4eb7-9ea5-acf9d8065157 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:02.816203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c18133ab-c8bd-4eb7-9ea5-acf9d8065157 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 4be00dd7-101a-436f-90e9-b8fcbd0cf00b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:02.823671 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c18133ab-c8bd-4eb7-9ea5-acf9d8065157 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:02.824279 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c18133ab-c8bd-4eb7-9ea5-acf9d8065157 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:02.825339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c18133ab-c8bd-4eb7-9ea5-acf9d8065157 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:02.825890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c18133ab-c8bd-4eb7-9ea5-acf9d8065157 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:03.025534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-af80e11b-1597-4232-8904-0ec36d8c4b5b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:03.038011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-af80e11b-1597-4232-8904-0ec36d8c4b5b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:03.040742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-af80e11b-1597-4232-8904-0ec36d8c4b5b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:03.042685 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-af80e11b-1597-4232-8904-0ec36d8c4b5b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1567 microversion: 2.25 time: 0.861045 May 27 14:59:03.043834 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 339/656] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:02 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1567 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:03.049666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-26abc777-de90-4094-99f4-86d32d3060d8 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Action: 'update', calling method: .version_select at 0x7fc776f5e310>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:03.145568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26abc777-de90-4094-99f4-86d32d3060d8 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:03.146028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26abc777-de90-4094-99f4-86d32d3060d8 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:03.146838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26abc777-de90-4094-99f4-86d32d3060d8 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:03.147283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26abc777-de90-4094-99f4-86d32d3060d8 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:03.250655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c18133ab-c8bd-4eb7-9ea5-acf9d8065157 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:03.275361 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c18133ab-c8bd-4eb7-9ea5-acf9d8065157 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b" status: 200 len: 1589 microversion: 2.1 time: 0.463479 May 27 14:59:03.277191 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 318/657] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:02 2022] GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b => generated 1589 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:03.286610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-35132154-aaf5-4b72-a731-2170aeaab2f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:03.288351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-35132154-aaf5-4b72-a731-2170aeaab2f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:03.306659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35132154-aaf5-4b72-a731-2170aeaab2f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:03.309014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35132154-aaf5-4b72-a731-2170aeaab2f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:03.311535 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35132154-aaf5-4b72-a731-2170aeaab2f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:03.312901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35132154-aaf5-4b72-a731-2170aeaab2f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:03.421096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:INSERT=11,nova_api:SELECT=86,nova_api:DELETE=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:03.666881 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-26abc777-de90-4094-99f4-86d32d3060d8 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/125b7d2f1ff14538be51d5180d269f47" status: 200 len: 329 microversion: 2.1 time: 0.621286 May 27 14:59:03.668311 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 340/658] 10.222.0.13 () {60 vars in 1262 bytes} [Fri May 27 14:59:03 2022] PUT /compute/v2.1/os-quota-sets/125b7d2f1ff14538be51d5180d269f47 => generated 329 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:03.670214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-35132154-aaf5-4b72-a731-2170aeaab2f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:03.678618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0dd551c3-ba39-4f0d-a9cf-b31fa68ea637 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:03.679174 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0dd551c3-ba39-4f0d-a9cf-b31fa68ea637 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 4be00dd7-101a-436f-90e9-b8fcbd0cf00b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:03.685277 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-35132154-aaf5-4b72-a731-2170aeaab2f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1311 microversion: 2.1 time: 0.406579 May 27 14:59:03.686520 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0dd551c3-ba39-4f0d-a9cf-b31fa68ea637 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:03.687060 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0dd551c3-ba39-4f0d-a9cf-b31fa68ea637 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:03.687863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0dd551c3-ba39-4f0d-a9cf-b31fa68ea637 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:03.688471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0dd551c3-ba39-4f0d-a9cf-b31fa68ea637 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:03.721112 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 319/659] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:03 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1311 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:03.727190 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ccaef65c-9a9b-44b6-8ce7-dadd51a6b022 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:03.727747 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ccaef65c-9a9b-44b6-8ce7-dadd51a6b022 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:03.766287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ccaef65c-9a9b-44b6-8ce7-dadd51a6b022 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:03.766761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ccaef65c-9a9b-44b6-8ce7-dadd51a6b022 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:03.767586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ccaef65c-9a9b-44b6-8ce7-dadd51a6b022 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:03.768039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ccaef65c-9a9b-44b6-8ce7-dadd51a6b022 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:03.900401 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0dd551c3-ba39-4f0d-a9cf-b31fa68ea637 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.230724 May 27 14:59:03.901055 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 341/660] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 14:59:03 2022] GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b/os-interface => generated 285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:03.911479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-72df0111-1379-4927-a3c7-3f86c1691624 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Action: 'update', calling method: .version_select at 0x7fc777024700>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:03.990262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ccaef65c-9a9b-44b6-8ce7-dadd51a6b022 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:04.003943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ccaef65c-9a9b-44b6-8ce7-dadd51a6b022 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:04.008509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ccaef65c-9a9b-44b6-8ce7-dadd51a6b022 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:04.021242 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ccaef65c-9a9b-44b6-8ce7-dadd51a6b022 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1437 microversion: 2.75 time: 0.298071 May 27 14:59:04.021946 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 320/661] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:03 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1437 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:04.045946 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f56cca37-e95f-407f-81c8-17f7a5b7674f tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "346e776e-8931-417f-87da-575810efb12b"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:04.047850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f56cca37-e95f-407f-81c8-17f7a5b7674f tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:04.059347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f56cca37-e95f-407f-81c8-17f7a5b7674f tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:04.064749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f56cca37-e95f-407f-81c8-17f7a5b7674f tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:04.065882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f56cca37-e95f-407f-81c8-17f7a5b7674f tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:04.066552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f56cca37-e95f-407f-81c8-17f7a5b7674f tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:04.076644 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:04.144502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72df0111-1379-4927-a3c7-3f86c1691624 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:04.145708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72df0111-1379-4927-a3c7-3f86c1691624 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:04.146811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72df0111-1379-4927-a3c7-3f86c1691624 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:04.164832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72df0111-1379-4927-a3c7-3f86c1691624 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:04.244337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f56cca37-e95f-407f-81c8-17f7a5b7674f tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:59:04.245917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f56cca37-e95f-407f-81c8-17f7a5b7674f tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:59:04.248083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f56cca37-e95f-407f-81c8-17f7a5b7674f tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:59:04.248590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f56cca37-e95f-407f-81c8-17f7a5b7674f tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:59:04.249130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f56cca37-e95f-407f-81c8-17f7a5b7674f tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:59:04.399548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f56cca37-e95f-407f-81c8-17f7a5b7674f tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:04.409270 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f56cca37-e95f-407f-81c8-17f7a5b7674f tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:04.409997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f56cca37-e95f-407f-81c8-17f7a5b7674f tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:04.410941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f56cca37-e95f-407f-81c8-17f7a5b7674f tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:04.411700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f56cca37-e95f-407f-81c8-17f7a5b7674f tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:04.654972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f56cca37-e95f-407f-81c8-17f7a5b7674f tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:04.670202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f56cca37-e95f-407f-81c8-17f7a5b7674f tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:04.674694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f56cca37-e95f-407f-81c8-17f7a5b7674f tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:04.680795 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:04.696271 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f56cca37-e95f-407f-81c8-17f7a5b7674f tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "POST /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f/action" status: 202 len: 1494 microversion: 2.75 time: 0.655143 May 27 14:59:04.699939 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 321/662] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 27 14:59:04 2022] POST /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f/action => generated 1494 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 27 14:59:04.711572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7c194847-07bc-4801-bbc2-9d31096f1d69 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:04.716140 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7c194847-07bc-4801-bbc2-9d31096f1d69 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:04.753098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7c194847-07bc-4801-bbc2-9d31096f1d69 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:04.757916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7c194847-07bc-4801-bbc2-9d31096f1d69 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:04.759537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7c194847-07bc-4801-bbc2-9d31096f1d69 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:04.763501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7c194847-07bc-4801-bbc2-9d31096f1d69 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:04.864528 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-72df0111-1379-4927-a3c7-3f86c1691624 tempest-QuotasAdminTestJSON-1785093809 tempest-QuotasAdminTestJSON-1785093809-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/125b7d2f1ff14538be51d5180d269f47" status: 200 len: 329 microversion: 2.1 time: 0.962382 May 27 14:59:04.873924 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 342/663] 10.222.0.13 () {60 vars in 1262 bytes} [Fri May 27 14:59:03 2022] PUT /compute/v2.1/os-quota-sets/125b7d2f1ff14538be51d5180d269f47 => generated 329 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:04.882780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2c26c618-6a80-4349-b364-6698039962c2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:04.883454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2c26c618-6a80-4349-b364-6698039962c2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:04.912565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2c26c618-6a80-4349-b364-6698039962c2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:04.914440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2c26c618-6a80-4349-b364-6698039962c2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:04.917474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2c26c618-6a80-4349-b364-6698039962c2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:04.918219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2c26c618-6a80-4349-b364-6698039962c2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:05.443946 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7c194847-07bc-4801-bbc2-9d31096f1d69 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:05.459899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7c194847-07bc-4801-bbc2-9d31096f1d69 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:05.461532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7c194847-07bc-4801-bbc2-9d31096f1d69 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:05.466569 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7c194847-07bc-4801-bbc2-9d31096f1d69 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1567 microversion: 2.25 time: 0.764874 May 27 14:59:05.478092 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 322/664] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:04 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1567 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:05.485170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8b56273f-3604-450f-bdaa-ba3a720020c6 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:05.488558 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8b56273f-3604-450f-bdaa-ba3a720020c6 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:05.503151 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b56273f-3604-450f-bdaa-ba3a720020c6 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:05.510627 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b56273f-3604-450f-bdaa-ba3a720020c6 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:05.511970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2c26c618-6a80-4349-b364-6698039962c2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:05.512495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b56273f-3604-450f-bdaa-ba3a720020c6 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:05.512495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b56273f-3604-450f-bdaa-ba3a720020c6 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:05.520488 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2c26c618-6a80-4349-b364-6698039962c2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1460 microversion: 2.1 time: 0.651045 May 27 14:59:05.525735 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 343/665] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:04 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1460 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:05.545977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-53f95609-6016-4106-a63d-a2ae23358795 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:05.547161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-53f95609-6016-4106-a63d-a2ae23358795 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:05.565874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53f95609-6016-4106-a63d-a2ae23358795 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:05.566415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53f95609-6016-4106-a63d-a2ae23358795 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:05.567408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53f95609-6016-4106-a63d-a2ae23358795 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:05.567957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53f95609-6016-4106-a63d-a2ae23358795 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:05.659274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8b56273f-3604-450f-bdaa-ba3a720020c6 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:05.669074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8b56273f-3604-450f-bdaa-ba3a720020c6 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:05.671042 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8b56273f-3604-450f-bdaa-ba3a720020c6 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:05.683844 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8b56273f-3604-450f-bdaa-ba3a720020c6 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1446 microversion: 2.75 time: 0.213700 May 27 14:59:05.691553 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 323/666] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:05 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1446 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:05.784607 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-53f95609-6016-4106-a63d-a2ae23358795 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:05.795796 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-53f95609-6016-4106-a63d-a2ae23358795 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Old instance type m1.heat2, new instance type m1.heat {{(pid=119248) resize /opt/stack/nova/nova/compute/api.py:4166}} May 27 14:59:05.803182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-53f95609-6016-4106-a63d-a2ae23358795 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:59:05.803442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-53f95609-6016-4106-a63d-a2ae23358795 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:59:05.804222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-53f95609-6016-4106-a63d-a2ae23358795 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:59:05.804354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-53f95609-6016-4106-a63d-a2ae23358795 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:59:05.804808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-53f95609-6016-4106-a63d-a2ae23358795 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:59:05.984119 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-53f95609-6016-4106-a63d-a2ae23358795 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "POST /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7/action" status: 202 len: 0 microversion: 2.1 time: 0.441960 May 27 14:59:05.987174 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 344/667] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 14:59:05 2022] POST /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:59:05.993590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-96822af3-7c8d-4fb9-a361-ade787530b23 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:05.994480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-96822af3-7c8d-4fb9-a361-ade787530b23 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:06.008342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96822af3-7c8d-4fb9-a361-ade787530b23 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:06.010338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96822af3-7c8d-4fb9-a361-ade787530b23 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:06.012144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96822af3-7c8d-4fb9-a361-ade787530b23 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:06.015859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96822af3-7c8d-4fb9-a361-ade787530b23 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:06.396439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-96822af3-7c8d-4fb9-a361-ade787530b23 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:06.409787 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-96822af3-7c8d-4fb9-a361-ade787530b23 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1469 microversion: 2.1 time: 0.420472 May 27 14:59:06.410652 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 324/668] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:05 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1469 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:06.487620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7c0a6663-dbed-4b17-b563-29708632ece5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:06.489189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7c0a6663-dbed-4b17-b563-29708632ece5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:06.508402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c0a6663-dbed-4b17-b563-29708632ece5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:06.508888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c0a6663-dbed-4b17-b563-29708632ece5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:06.509684 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c0a6663-dbed-4b17-b563-29708632ece5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:06.510118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c0a6663-dbed-4b17-b563-29708632ece5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:06.709919 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-52d59e5d-ebc7-45ca-b03c-26fe23520247 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:06.711283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-52d59e5d-ebc7-45ca-b03c-26fe23520247 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:06.723742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52d59e5d-ebc7-45ca-b03c-26fe23520247 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:06.724249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52d59e5d-ebc7-45ca-b03c-26fe23520247 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:06.728201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52d59e5d-ebc7-45ca-b03c-26fe23520247 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:06.728953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52d59e5d-ebc7-45ca-b03c-26fe23520247 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:07.183563 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-52d59e5d-ebc7-45ca-b03c-26fe23520247 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:07.193351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-52d59e5d-ebc7-45ca-b03c-26fe23520247 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:07.205569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-52d59e5d-ebc7-45ca-b03c-26fe23520247 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:07.215772 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-52d59e5d-ebc7-45ca-b03c-26fe23520247 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1446 microversion: 2.75 time: 0.509651 May 27 14:59:07.228627 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 325/669] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:06 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1446 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 14:59:07.378692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7c0a6663-dbed-4b17-b563-29708632ece5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:07.389509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7c0a6663-dbed-4b17-b563-29708632ece5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:07.393716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7c0a6663-dbed-4b17-b563-29708632ece5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:07.397182 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7c0a6663-dbed-4b17-b563-29708632ece5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1567 microversion: 2.25 time: 0.914804 May 27 14:59:07.398877 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 345/670] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:06 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1567 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:07.430532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-32e826c5-0b6a-419f-a49d-c2941c596a4a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:07.432071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-32e826c5-0b6a-419f-a49d-c2941c596a4a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:07.444231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32e826c5-0b6a-419f-a49d-c2941c596a4a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:07.445470 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32e826c5-0b6a-419f-a49d-c2941c596a4a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:07.447336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32e826c5-0b6a-419f-a49d-c2941c596a4a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:07.448011 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32e826c5-0b6a-419f-a49d-c2941c596a4a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:07.840248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-32e826c5-0b6a-419f-a49d-c2941c596a4a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:07.857496 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-32e826c5-0b6a-419f-a49d-c2941c596a4a tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1469 microversion: 2.1 time: 0.430942 May 27 14:59:07.858767 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 326/671] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:07 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1469 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:08.236333 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3b775d8b-c09d-4cd1-9edc-fb296a829ac8 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:08.237732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3b775d8b-c09d-4cd1-9edc-fb296a829ac8 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:08.247801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b775d8b-c09d-4cd1-9edc-fb296a829ac8 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:08.248935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b775d8b-c09d-4cd1-9edc-fb296a829ac8 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:08.249955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b775d8b-c09d-4cd1-9edc-fb296a829ac8 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:08.251893 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b775d8b-c09d-4cd1-9edc-fb296a829ac8 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:08.420343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8ad9777b-914b-4b57-ad4d-6160f4a99c66 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:08.421248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8ad9777b-914b-4b57-ad4d-6160f4a99c66 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:08.437284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ad9777b-914b-4b57-ad4d-6160f4a99c66 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:08.438418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ad9777b-914b-4b57-ad4d-6160f4a99c66 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:08.439736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ad9777b-914b-4b57-ad4d-6160f4a99c66 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:08.442196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ad9777b-914b-4b57-ad4d-6160f4a99c66 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:08.511820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3b775d8b-c09d-4cd1-9edc-fb296a829ac8 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:08.527203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3b775d8b-c09d-4cd1-9edc-fb296a829ac8 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:08.532248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3b775d8b-c09d-4cd1-9edc-fb296a829ac8 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:08.548437 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3b775d8b-c09d-4cd1-9edc-fb296a829ac8 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1446 microversion: 2.75 time: 0.312803 May 27 14:59:08.564218 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 346/672] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:08 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1446 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:08.747792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8ad9777b-914b-4b57-ad4d-6160f4a99c66 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:08.764862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8ad9777b-914b-4b57-ad4d-6160f4a99c66 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:08.766079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8ad9777b-914b-4b57-ad4d-6160f4a99c66 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:08.771476 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8ad9777b-914b-4b57-ad4d-6160f4a99c66 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1542 microversion: 2.25 time: 0.358145 May 27 14:59:08.773465 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 327/673] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:08 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1542 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:08.790730 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4e0a4c71-384d-4573-bcce-75cea3479c06 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '.version_select at 0x7fc776e8c8b0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:08.793282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e0a4c71-384d-4573-bcce-75cea3479c06 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:08.793736 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e0a4c71-384d-4573-bcce-75cea3479c06 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:08.812902 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4e0a4c71-384d-4573-bcce-75cea3479c06 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 1894 microversion: 2.25 time: 0.026292 May 27 14:59:08.827782 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 347/674] 10.222.0.13 () {60 vars in 1183 bytes} [Fri May 27 14:59:08 2022] GET /compute/v2.1/os-migrations => generated 1894 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:08.841629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3f16ff8c-72c1-4f32-8ecb-2dea910eabd8 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:08.845252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3f16ff8c-72c1-4f32-8ecb-2dea910eabd8 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:08.857942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f16ff8c-72c1-4f32-8ecb-2dea910eabd8 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:08.859425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f16ff8c-72c1-4f32-8ecb-2dea910eabd8 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:08.864337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f16ff8c-72c1-4f32-8ecb-2dea910eabd8 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:08.866515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f16ff8c-72c1-4f32-8ecb-2dea910eabd8 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:08.875482 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-12b95d09-effc-44de-bc5b-8e9185bb3d2b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:08.876336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-12b95d09-effc-44de-bc5b-8e9185bb3d2b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:08.878825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:INSERT=20,nova_api:SELECT=66,nova_api:UPDATE=14 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:08.887360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12b95d09-effc-44de-bc5b-8e9185bb3d2b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:08.888511 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12b95d09-effc-44de-bc5b-8e9185bb3d2b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:08.889654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12b95d09-effc-44de-bc5b-8e9185bb3d2b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:08.890334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12b95d09-effc-44de-bc5b-8e9185bb3d2b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:09.774941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-3f16ff8c-72c1-4f32-8ecb-2dea910eabd8 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lazy-loading 'services' on Instance uuid ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:59:09.813980 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3f16ff8c-72c1-4f32-8ecb-2dea910eabd8 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 2035 microversion: 2.25 time: 0.987140 May 27 14:59:09.814582 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 328/675] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:08 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 2035 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:09.919544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-12b95d09-effc-44de-bc5b-8e9185bb3d2b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:09.931091 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-12b95d09-effc-44de-bc5b-8e9185bb3d2b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1469 microversion: 2.1 time: 1.059430 May 27 14:59:09.934924 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 348/676] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:08 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1469 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:09.944776 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f4d2fb01-8f1e-417e-8211-3512b8fc4ddc tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:09.945553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f4d2fb01-8f1e-417e-8211-3512b8fc4ddc tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:09.961919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4d2fb01-8f1e-417e-8211-3512b8fc4ddc tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:09.962105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4d2fb01-8f1e-417e-8211-3512b8fc4ddc tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:09.965672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4d2fb01-8f1e-417e-8211-3512b8fc4ddc tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:09.966225 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4d2fb01-8f1e-417e-8211-3512b8fc4ddc tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:10.338261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c60f7952-1cac-46a7-a5d5-015e5e952c08 tempest-NetworksTest-1162853706 tempest-NetworksTest-1162853706-project-admin] Calling method '.version_select at 0x7fc7776e2ee0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:10.421479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f4d2fb01-8f1e-417e-8211-3512b8fc4ddc tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:10.431668 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f4d2fb01-8f1e-417e-8211-3512b8fc4ddc tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:10.433598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f4d2fb01-8f1e-417e-8211-3512b8fc4ddc tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:10.439597 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f4d2fb01-8f1e-417e-8211-3512b8fc4ddc tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1446 microversion: 2.75 time: 0.503514 May 27 14:59:10.441032 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 349/677] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:09 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1446 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:10.446222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a02fe42c-8bd5-4bce-b026-b48a8488ca7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1725823222", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "0ccca6c3-83b2-4106-9cbd-795a4836060e"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:10.508856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-a02fe42c-8bd5-4bce-b026-b48a8488ca7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] validate_networks() for [('0ccca6c3-83b2-4106-9cbd-795a4836060e', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 14:59:10.571438 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c60f7952-1cac-46a7-a5d5-015e5e952c08 tempest-NetworksTest-1162853706 tempest-NetworksTest-1162853706-project-admin] 10.222.0.13 "GET /compute/v2.1/os-networks" status: 200 len: 6079 microversion: 2.1 time: 0.744431 May 27 14:59:10.579976 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 329/678] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 14:59:09 2022] GET /compute/v2.1/os-networks => generated 6079 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:10.587537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-87e0f7fb-17ac-4f26-a210-f1060e9bbb11 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:10.588300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-87e0f7fb-17ac-4f26-a210-f1060e9bbb11 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 4be00dd7-101a-436f-90e9-b8fcbd0cf00b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:10.611203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87e0f7fb-17ac-4f26-a210-f1060e9bbb11 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:10.611923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87e0f7fb-17ac-4f26-a210-f1060e9bbb11 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:10.616005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87e0f7fb-17ac-4f26-a210-f1060e9bbb11 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:10.620060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87e0f7fb-17ac-4f26-a210-f1060e9bbb11 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:11.149477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-87e0f7fb-17ac-4f26-a210-f1060e9bbb11 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:11.161436 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-87e0f7fb-17ac-4f26-a210-f1060e9bbb11 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b" status: 200 len: 1589 microversion: 2.1 time: 0.580039 May 27 14:59:11.162660 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 330/679] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:10 2022] GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b => generated 1589 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:11.177593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-0d952bd1-fda4-4390-a145-b308a8ae6e99 req-af5aede7-79d2-4307-8151-ffd00932deec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be00dd7-101a-436f-90e9-b8fcbd0cf00b", "tag": "13e3d81c-851f-40aa-8269-fa720646581f"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:11.208035 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0d952bd1-fda4-4390-a145-b308a8ae6e99 req-af5aede7-79d2-4307-8151-ffd00932deec service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:11.210889 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0d952bd1-fda4-4390-a145-b308a8ae6e99 req-af5aede7-79d2-4307-8151-ffd00932deec service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:11.236948 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-0d952bd1-fda4-4390-a145-b308a8ae6e99 req-af5aede7-79d2-4307-8151-ffd00932deec service nova] Creating event network-changed:13e3d81c-851f-40aa-8269-fa720646581f for instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b on n-h2-843621-1 May 27 14:59:11.245145 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-0d952bd1-fda4-4390-a145-b308a8ae6e99 req-af5aede7-79d2-4307-8151-ffd00932deec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080420 May 27 14:59:11.246081 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 331/680] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:11.251372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fed53124-ab1c-41ed-a22c-037d5eb98655 tempest-NetworksTest-1162853706 tempest-NetworksTest-1162853706-project-admin] Calling method '.version_select at 0x7fc77c097820>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:11.425453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:11.631491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=44 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:12.172751 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fed53124-ab1c-41ed-a22c-037d5eb98655 tempest-NetworksTest-1162853706 tempest-NetworksTest-1162853706-project-admin] 10.222.0.13 "GET /compute/v2.1/os-networks/40c8a0ba-5936-492c-a22b-60fbf77c5793" status: 200 len: 652 microversion: 2.1 time: 0.925311 May 27 14:59:12.173926 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 332/681] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 14:59:11 2022] GET /compute/v2.1/os-networks/40c8a0ba-5936-492c-a22b-60fbf77c5793 => generated 652 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:12.184289 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5e2d9078-22de-4351-861f-d1f317cd339f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:12.186594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5e2d9078-22de-4351-861f-d1f317cd339f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:12.202890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e2d9078-22de-4351-861f-d1f317cd339f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:12.204865 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e2d9078-22de-4351-861f-d1f317cd339f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:12.207801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e2d9078-22de-4351-861f-d1f317cd339f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:12.208488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e2d9078-22de-4351-861f-d1f317cd339f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:12.623672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a02fe42c-8bd5-4bce-b026-b48a8488ca7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:59:12.625510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a02fe42c-8bd5-4bce-b026-b48a8488ca7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:59:12.626166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a02fe42c-8bd5-4bce-b026-b48a8488ca7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:59:12.626855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a02fe42c-8bd5-4bce-b026-b48a8488ca7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:59:12.627454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a02fe42c-8bd5-4bce-b026-b48a8488ca7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:59:12.663922 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a02fe42c-8bd5-4bce-b026-b48a8488ca7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:12.664389 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a02fe42c-8bd5-4bce-b026-b48a8488ca7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:12.668924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a02fe42c-8bd5-4bce-b026-b48a8488ca7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:12.669567 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a02fe42c-8bd5-4bce-b026-b48a8488ca7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:12.690983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=19 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:12.722614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-a02fe42c-8bd5-4bce-b026-b48a8488ca7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Getting quotas for project 0dbdeb12b89c475cba7fef0ab845dada. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:59:12.743932 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-a02fe42c-8bd5-4bce-b026-b48a8488ca7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Getting quotas for user 4284d5f7a29045d18393bde2961a904b and project 0dbdeb12b89c475cba7fef0ab845dada. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:59:12.745179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5e2d9078-22de-4351-861f-d1f317cd339f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:12.761284 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5e2d9078-22de-4351-861f-d1f317cd339f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1469 microversion: 2.1 time: 0.585881 May 27 14:59:12.763220 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 333/682] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:12 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1469 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:12.767548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a02fe42c-8bd5-4bce-b026-b48a8488ca7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 14:59:12.770524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-474ad311-3ac7-4ea3-85eb-a3c91f06e333 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:12.771523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-474ad311-3ac7-4ea3-85eb-a3c91f06e333 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:12.772115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a02fe42c-8bd5-4bce-b026-b48a8488ca7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 14:59:12.783471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-474ad311-3ac7-4ea3-85eb-a3c91f06e333 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:12.784964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-474ad311-3ac7-4ea3-85eb-a3c91f06e333 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:12.789670 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-474ad311-3ac7-4ea3-85eb-a3c91f06e333 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:12.790864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-474ad311-3ac7-4ea3-85eb-a3c91f06e333 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:12.916417 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a02fe42c-8bd5-4bce-b026-b48a8488ca7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.469318 May 27 14:59:12.917591 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 350/683] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 27 14:59:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2476 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 14:59:13.076454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-474ad311-3ac7-4ea3-85eb-a3c91f06e333 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:13.088753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-474ad311-3ac7-4ea3-85eb-a3c91f06e333 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:13.091253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-474ad311-3ac7-4ea3-85eb-a3c91f06e333 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:13.105791 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-474ad311-3ac7-4ea3-85eb-a3c91f06e333 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1446 microversion: 2.75 time: 0.339336 May 27 14:59:13.108609 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 334/684] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:12 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1446 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:13.134103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-896d81ce-a1ac-426d-81c3-cbdc9ae7cbfd tempest-NetworksTest-1162853706 tempest-NetworksTest-1162853706-project-admin] Calling method '.version_select at 0x7fc77c0d9a60>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:13.388108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-444a4d00-d1bf-407a-b066-f1313b00007a tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1961676145", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "2c791768-302b-4ee2-b186-40f52faf1f15"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:13.486529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-444a4d00-d1bf-407a-b066-f1313b00007a tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] validate_networks() for [('2c791768-302b-4ee2-b186-40f52faf1f15', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 14:59:13.786691 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-896d81ce-a1ac-426d-81c3-cbdc9ae7cbfd tempest-NetworksTest-1162853706 tempest-NetworksTest-1162853706-project-admin] 10.222.0.13 "GET /compute/v2.1/os-networks" status: 200 len: 6079 microversion: 2.1 time: 0.668537 May 27 14:59:13.787683 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 335/685] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 14:59:13 2022] GET /compute/v2.1/os-networks => generated 6079 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:13.796756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-40f98d13-7238-46bd-8713-396eaba4f5bf tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:13.797490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-40f98d13-7238-46bd-8713-396eaba4f5bf tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:13.828282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40f98d13-7238-46bd-8713-396eaba4f5bf tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:13.828900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40f98d13-7238-46bd-8713-396eaba4f5bf tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:13.829741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40f98d13-7238-46bd-8713-396eaba4f5bf tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:13.830183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40f98d13-7238-46bd-8713-396eaba4f5bf tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:14.111547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-40f98d13-7238-46bd-8713-396eaba4f5bf tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:14.129331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-40f98d13-7238-46bd-8713-396eaba4f5bf tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:14.130924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-40f98d13-7238-46bd-8713-396eaba4f5bf tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:14.136405 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-40f98d13-7238-46bd-8713-396eaba4f5bf tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1266 microversion: 2.25 time: 0.347515 May 27 14:59:14.137024 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 336/686] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:13 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1266 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:14.151704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c2ccbf6a-83f3-488b-bcec-a71a7d83f7e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:14.152335 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c2ccbf6a-83f3-488b-bcec-a71a7d83f7e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:14.166795 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2ccbf6a-83f3-488b-bcec-a71a7d83f7e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:14.167347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2ccbf6a-83f3-488b-bcec-a71a7d83f7e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:14.168157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2ccbf6a-83f3-488b-bcec-a71a7d83f7e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:14.168607 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2ccbf6a-83f3-488b-bcec-a71a7d83f7e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:15.179338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c2ccbf6a-83f3-488b-bcec-a71a7d83f7e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:15.190647 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c2ccbf6a-83f3-488b-bcec-a71a7d83f7e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1474 microversion: 2.1 time: 1.051069 May 27 14:59:15.193596 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 337/687] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:14 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1474 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:15.207014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6306fa63-bfd8-4c29-b50e-f9e7ca584d54 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:15.208023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6306fa63-bfd8-4c29-b50e-f9e7ca584d54 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:15.231794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6306fa63-bfd8-4c29-b50e-f9e7ca584d54 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:15.232691 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6306fa63-bfd8-4c29-b50e-f9e7ca584d54 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:15.234592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6306fa63-bfd8-4c29-b50e-f9e7ca584d54 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:15.235522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6306fa63-bfd8-4c29-b50e-f9e7ca584d54 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:15.386259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6306fa63-bfd8-4c29-b50e-f9e7ca584d54 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:15.393349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:15.401489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6306fa63-bfd8-4c29-b50e-f9e7ca584d54 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:15.403749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6306fa63-bfd8-4c29-b50e-f9e7ca584d54 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:15.426559 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6306fa63-bfd8-4c29-b50e-f9e7ca584d54 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1446 microversion: 2.75 time: 0.231584 May 27 14:59:15.432792 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 338/688] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:15 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1446 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:15.769088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1f9e7924-ce1d-442c-978d-60c218a286eb tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] Action: 'create', calling method: .version_select at 0x7fc77c0d9310>, body: {"pool": null} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:15.954031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-444a4d00-d1bf-407a-b066-f1313b00007a tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:59:15.955033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-444a4d00-d1bf-407a-b066-f1313b00007a tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:59:15.955789 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-444a4d00-d1bf-407a-b066-f1313b00007a tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:59:15.956623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-444a4d00-d1bf-407a-b066-f1313b00007a tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:59:15.957246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-444a4d00-d1bf-407a-b066-f1313b00007a tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:59:15.974768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-444a4d00-d1bf-407a-b066-f1313b00007a tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:15.976792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-444a4d00-d1bf-407a-b066-f1313b00007a tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:15.979935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-444a4d00-d1bf-407a-b066-f1313b00007a tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:15.980583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-444a4d00-d1bf-407a-b066-f1313b00007a tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:16.025786 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-444a4d00-d1bf-407a-b066-f1313b00007a tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Getting quotas for project 27d1e6c35bdd45a986acf3213f2a84bf. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:59:16.042240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-444a4d00-d1bf-407a-b066-f1313b00007a tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Getting quotas for user 7fd8811631894240aa46c7f87b3c8506 and project 27d1e6c35bdd45a986acf3213f2a84bf. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:59:16.066317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-444a4d00-d1bf-407a-b066-f1313b00007a tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 14:59:16.068506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-444a4d00-d1bf-407a-b066-f1313b00007a tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 14:59:16.160003 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-444a4d00-d1bf-407a-b066-f1313b00007a tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.240744 May 27 14:59:16.161255 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 351/689] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:59:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 14:59:16.170148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-891dbbcb-99aa-415e-b728-9c308a969ba0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:16.171542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-891dbbcb-99aa-415e-b728-9c308a969ba0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:16.181739 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-891dbbcb-99aa-415e-b728-9c308a969ba0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:16.182206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-891dbbcb-99aa-415e-b728-9c308a969ba0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:16.183011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-891dbbcb-99aa-415e-b728-9c308a969ba0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:16.183446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-891dbbcb-99aa-415e-b728-9c308a969ba0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:16.388798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-891dbbcb-99aa-415e-b728-9c308a969ba0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:16.391205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:16.408204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-891dbbcb-99aa-415e-b728-9c308a969ba0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:16.414572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-891dbbcb-99aa-415e-b728-9c308a969ba0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:16.417354 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-891dbbcb-99aa-415e-b728-9c308a969ba0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1320 microversion: 2.25 time: 0.254319 May 27 14:59:16.419567 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 352/690] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:16 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1320 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:16.434493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-aa71a28d-d9ff-4b07-a416-a5ee42c6b59f tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:16.440068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-aa71a28d-d9ff-4b07-a416-a5ee42c6b59f tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:16.601821 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-aa71a28d-d9ff-4b07-a416-a5ee42c6b59f tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:16.610310 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-aa71a28d-d9ff-4b07-a416-a5ee42c6b59f tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" status: 200 len: 1224 microversion: 2.1 time: 0.189273 May 27 14:59:16.612544 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 353/691] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:16 2022] GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa => generated 1224 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:16.629135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1f7994d8-b688-4d71-b75f-2b04951a794c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:16.630554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1f7994d8-b688-4d71-b75f-2b04951a794c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:16.640696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f7994d8-b688-4d71-b75f-2b04951a794c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:16.641500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f7994d8-b688-4d71-b75f-2b04951a794c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:16.642519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f7994d8-b688-4d71-b75f-2b04951a794c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:16.643257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f7994d8-b688-4d71-b75f-2b04951a794c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:17.195575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1f7994d8-b688-4d71-b75f-2b04951a794c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:17.209350 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1f7994d8-b688-4d71-b75f-2b04951a794c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1474 microversion: 2.1 time: 0.595306 May 27 14:59:17.211772 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 354/692] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:16 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1474 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:17.224849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cd1a6ca1-bf93-4527-afbe-d0199c4d3965 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:17.227697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cd1a6ca1-bf93-4527-afbe-d0199c4d3965 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:17.248448 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cd1a6ca1-bf93-4527-afbe-d0199c4d3965 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:17.250819 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cd1a6ca1-bf93-4527-afbe-d0199c4d3965 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:17.253077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cd1a6ca1-bf93-4527-afbe-d0199c4d3965 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:17.253721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cd1a6ca1-bf93-4527-afbe-d0199c4d3965 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:17.510592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cd1a6ca1-bf93-4527-afbe-d0199c4d3965 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:17.521811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cd1a6ca1-bf93-4527-afbe-d0199c4d3965 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:17.523940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cd1a6ca1-bf93-4527-afbe-d0199c4d3965 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:17.548260 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cd1a6ca1-bf93-4527-afbe-d0199c4d3965 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1446 microversion: 2.75 time: 0.335064 May 27 14:59:17.548903 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 355/693] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:17 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1446 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:17.556935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3d1f5a0b-ad03-418b-b6f1-4a6f838db32f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:17.561526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3d1f5a0b-ad03-418b-b6f1-4a6f838db32f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:17.576628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d1f5a0b-ad03-418b-b6f1-4a6f838db32f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:17.582778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d1f5a0b-ad03-418b-b6f1-4a6f838db32f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:17.584419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d1f5a0b-ad03-418b-b6f1-4a6f838db32f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:17.593453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d1f5a0b-ad03-418b-b6f1-4a6f838db32f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:18.164121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3d1f5a0b-ad03-418b-b6f1-4a6f838db32f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:18.177923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3d1f5a0b-ad03-418b-b6f1-4a6f838db32f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:18.179526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3d1f5a0b-ad03-418b-b6f1-4a6f838db32f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:18.180700 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3d1f5a0b-ad03-418b-b6f1-4a6f838db32f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1362 microversion: 2.25 time: 0.627634 May 27 14:59:18.199535 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 356/694] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:17 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1362 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:18.206799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7d38bb4b-8521-40ac-bf38-14cdd178b0f7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:18.207655 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7d38bb4b-8521-40ac-bf38-14cdd178b0f7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:18.216324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d38bb4b-8521-40ac-bf38-14cdd178b0f7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:18.217233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d38bb4b-8521-40ac-bf38-14cdd178b0f7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:18.218557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d38bb4b-8521-40ac-bf38-14cdd178b0f7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:18.220057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d38bb4b-8521-40ac-bf38-14cdd178b0f7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:18.349356 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7d38bb4b-8521-40ac-bf38-14cdd178b0f7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:18.362503 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7d38bb4b-8521-40ac-bf38-14cdd178b0f7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" status: 200 len: 1282 microversion: 2.1 time: 0.168929 May 27 14:59:18.364943 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 357/695] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:18 2022] GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa => generated 1282 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:18.377563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3df681f8-3317-4316-a67a-6052be277edd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:18.378475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3df681f8-3317-4316-a67a-6052be277edd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:18.391086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3df681f8-3317-4316-a67a-6052be277edd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:18.392508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3df681f8-3317-4316-a67a-6052be277edd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:18.393740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3df681f8-3317-4316-a67a-6052be277edd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:18.394794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3df681f8-3317-4316-a67a-6052be277edd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:20.020103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3df681f8-3317-4316-a67a-6052be277edd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:20.032286 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3df681f8-3317-4316-a67a-6052be277edd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1474 microversion: 2.1 time: 1.666056 May 27 14:59:20.036262 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 358/696] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:18 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1474 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:20.056047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b2a098ef-0f08-41e5-8b90-1066786139c1 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:20.058904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b2a098ef-0f08-41e5-8b90-1066786139c1 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:20.079029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2a098ef-0f08-41e5-8b90-1066786139c1 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:20.079792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2a098ef-0f08-41e5-8b90-1066786139c1 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:20.082786 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2a098ef-0f08-41e5-8b90-1066786139c1 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:20.083460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2a098ef-0f08-41e5-8b90-1066786139c1 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:20.595107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b2a098ef-0f08-41e5-8b90-1066786139c1 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:20.615924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b2a098ef-0f08-41e5-8b90-1066786139c1 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:20.618442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b2a098ef-0f08-41e5-8b90-1066786139c1 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:20.625791 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b2a098ef-0f08-41e5-8b90-1066786139c1 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1446 microversion: 2.75 time: 0.582134 May 27 14:59:20.629606 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 359/697] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:20 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1446 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:20.637429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-13918d4b-6a2b-4de5-8378-14fa0d147a39 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:20.652792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-13918d4b-6a2b-4de5-8378-14fa0d147a39 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:20.663366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-13918d4b-6a2b-4de5-8378-14fa0d147a39 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:20.663815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-13918d4b-6a2b-4de5-8378-14fa0d147a39 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:20.671947 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-13918d4b-6a2b-4de5-8378-14fa0d147a39 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:20.672641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-13918d4b-6a2b-4de5-8378-14fa0d147a39 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:21.140959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-13918d4b-6a2b-4de5-8378-14fa0d147a39 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:21.152700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-13918d4b-6a2b-4de5-8378-14fa0d147a39 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:21.154764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-13918d4b-6a2b-4de5-8378-14fa0d147a39 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:21.156203 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-13918d4b-6a2b-4de5-8378-14fa0d147a39 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1362 microversion: 2.25 time: 0.525335 May 27 14:59:21.168043 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1f9e7924-ce1d-442c-978d-60c218a286eb tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.733160 May 27 14:59:21.168655 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 360/698] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:20 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1362 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:21.170954 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 339/699] 10.222.0.13 () {60 vars in 1169 bytes} [Fri May 27 14:59:15 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:21.174479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-631d7e0a-c0ce-4c28-ba3a-1b5ac1f797df tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:21.175392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-631d7e0a-c0ce-4c28-ba3a-1b5ac1f797df tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:21.187770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-42b13fb2-a6e4-46df-9533-d76bbeef412b req-768f8907-edb4-408d-8e28-e5ee9294415a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18e4f7f7-6bda-4d0b-9685-74266d42efc0", "tag": "2c3a966d-ef56-4dbf-afab-504228aa5443"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:21.191248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-631d7e0a-c0ce-4c28-ba3a-1b5ac1f797df tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:21.191917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-631d7e0a-c0ce-4c28-ba3a-1b5ac1f797df tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:21.193362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-631d7e0a-c0ce-4c28-ba3a-1b5ac1f797df tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:21.194006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-631d7e0a-c0ce-4c28-ba3a-1b5ac1f797df tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:21.196606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-42b13fb2-a6e4-46df-9533-d76bbeef412b req-768f8907-edb4-408d-8e28-e5ee9294415a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:21.197183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-42b13fb2-a6e4-46df-9533-d76bbeef412b req-768f8907-edb4-408d-8e28-e5ee9294415a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:21.214888 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-42b13fb2-a6e4-46df-9533-d76bbeef412b req-768f8907-edb4-408d-8e28-e5ee9294415a service nova] Creating event network-changed:2c3a966d-ef56-4dbf-afab-504228aa5443 for instance 18e4f7f7-6bda-4d0b-9685-74266d42efc0 on n-h2-843621-1 May 27 14:59:21.227531 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-42b13fb2-a6e4-46df-9533-d76bbeef412b req-768f8907-edb4-408d-8e28-e5ee9294415a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054183 May 27 14:59:21.228938 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 340/700] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:21.234674 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-10ca984f-48b4-4e12-8e39-c9e403321d27 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:21.235704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-10ca984f-48b4-4e12-8e39-c9e403321d27 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:21.253692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10ca984f-48b4-4e12-8e39-c9e403321d27 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:21.254351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10ca984f-48b4-4e12-8e39-c9e403321d27 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:21.255846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10ca984f-48b4-4e12-8e39-c9e403321d27 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:21.256630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10ca984f-48b4-4e12-8e39-c9e403321d27 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:21.569000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-631d7e0a-c0ce-4c28-ba3a-1b5ac1f797df tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:21.586282 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-631d7e0a-c0ce-4c28-ba3a-1b5ac1f797df tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" status: 200 len: 1324 microversion: 2.1 time: 0.416371 May 27 14:59:21.587660 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 361/701] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:21 2022] GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa => generated 1324 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:21.608391 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fb8bc239-64e4-4434-8c2e-753b9deb799b tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] Calling method '.version_select at 0x7fc776f7e280>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:21.647172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-10ca984f-48b4-4e12-8e39-c9e403321d27 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:21.659728 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-10ca984f-48b4-4e12-8e39-c9e403321d27 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1474 microversion: 2.1 time: 0.429215 May 27 14:59:21.660398 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 341/702] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:21 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1474 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:21.666217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a668e9a6-19d1-42f7-a735-12c08db341bb tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:21.667366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a668e9a6-19d1-42f7-a735-12c08db341bb tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:21.674730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a668e9a6-19d1-42f7-a735-12c08db341bb tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:21.675698 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a668e9a6-19d1-42f7-a735-12c08db341bb tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:21.676939 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a668e9a6-19d1-42f7-a735-12c08db341bb tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:21.677616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a668e9a6-19d1-42f7-a735-12c08db341bb tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:21.968744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a668e9a6-19d1-42f7-a735-12c08db341bb tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:21.984962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a668e9a6-19d1-42f7-a735-12c08db341bb tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:21.988096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a668e9a6-19d1-42f7-a735-12c08db341bb tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:21.996602 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fb8bc239-64e4-4434-8c2e-753b9deb799b tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/324f5b8d-70fc-4ff2-a6c8-2a84e2592914" status: 200 len: 141 microversion: 2.1 time: 0.397375 May 27 14:59:21.997297 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 362/703] 10.222.0.13 () {58 vars in 1259 bytes} [Fri May 27 14:59:21 2022] GET /compute/v2.1/os-floating-ips/324f5b8d-70fc-4ff2-a6c8-2a84e2592914 => generated 141 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:22.017355 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a668e9a6-19d1-42f7-a735-12c08db341bb tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1446 microversion: 2.75 time: 0.355589 May 27 14:59:22.018851 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-0baeaa1a-637a-4027-ac7a-4955eb21a38f req-89f433b7-9e0b-4c65-8281-4ff4d995ed24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da2c6d0b-b6e3-43a9-870b-6f7493b08dfa", "tag": "77a08a17-7b75-4c05-a064-2f80d2e429a8"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:22.037213 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 342/704] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:21 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1446 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:22.041779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0baeaa1a-637a-4027-ac7a-4955eb21a38f req-89f433b7-9e0b-4c65-8281-4ff4d995ed24 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:22.045543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0baeaa1a-637a-4027-ac7a-4955eb21a38f req-89f433b7-9e0b-4c65-8281-4ff4d995ed24 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:22.063944 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-0baeaa1a-637a-4027-ac7a-4955eb21a38f req-89f433b7-9e0b-4c65-8281-4ff4d995ed24 service nova] Creating event network-changed:77a08a17-7b75-4c05-a064-2f80d2e429a8 for instance da2c6d0b-b6e3-43a9-870b-6f7493b08dfa on n-h2-843621-1 May 27 14:59:22.070109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6e330017-e893-46b1-a853-5f5da52c8e2e tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] Calling method '.version_select at 0x7fc777241670>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:22.091364 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-0baeaa1a-637a-4027-ac7a-4955eb21a38f req-89f433b7-9e0b-4c65-8281-4ff4d995ed24 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080007 May 27 14:59:22.094087 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 363/705] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:22.177132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4fc92647-e16c-4e0b-b4db-0a10c7626683 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:22.178448 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4fc92647-e16c-4e0b-b4db-0a10c7626683 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:22.201078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4fc92647-e16c-4e0b-b4db-0a10c7626683 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:22.208145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4fc92647-e16c-4e0b-b4db-0a10c7626683 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:22.209384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4fc92647-e16c-4e0b-b4db-0a10c7626683 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:22.211772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4fc92647-e16c-4e0b-b4db-0a10c7626683 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:22.393830 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6e330017-e893-46b1-a853-5f5da52c8e2e tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.344089 May 27 14:59:22.401698 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 343/706] 10.222.0.13 () {58 vars in 1148 bytes} [Fri May 27 14:59:22 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:22.408455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5bc710d4-0f32-4c8f-afd0-7958710c4c3d tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] Calling method '.version_select at 0x7fc7777d5040>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:22.489408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4fc92647-e16c-4e0b-b4db-0a10c7626683 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:22.505409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4fc92647-e16c-4e0b-b4db-0a10c7626683 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:22.509618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4fc92647-e16c-4e0b-b4db-0a10c7626683 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:22.517815 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4fc92647-e16c-4e0b-b4db-0a10c7626683 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1362 microversion: 2.25 time: 0.345888 May 27 14:59:22.528538 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 364/707] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:22 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 14:59:22.608004 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-325ca0a6-c005-4084-a3eb-763e1e52c3d6 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:22.608822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-325ca0a6-c005-4084-a3eb-763e1e52c3d6 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:22.621007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-325ca0a6-c005-4084-a3eb-763e1e52c3d6 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:22.622893 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-325ca0a6-c005-4084-a3eb-763e1e52c3d6 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:22.623781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-325ca0a6-c005-4084-a3eb-763e1e52c3d6 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:22.624206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-325ca0a6-c005-4084-a3eb-763e1e52c3d6 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:23.067952 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-325ca0a6-c005-4084-a3eb-763e1e52c3d6 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:23.079179 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-325ca0a6-c005-4084-a3eb-763e1e52c3d6 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" status: 200 len: 1324 microversion: 2.1 time: 0.478526 May 27 14:59:23.092836 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 365/708] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:22 2022] GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa => generated 1324 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:23.099191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-aa3fbe37-422b-49de-b5ee-020e5fbbd6f9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:23.099999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-aa3fbe37-422b-49de-b5ee-020e5fbbd6f9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:23.108453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aa3fbe37-422b-49de-b5ee-020e5fbbd6f9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:23.109012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aa3fbe37-422b-49de-b5ee-020e5fbbd6f9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:23.109798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aa3fbe37-422b-49de-b5ee-020e5fbbd6f9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:23.110413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aa3fbe37-422b-49de-b5ee-020e5fbbd6f9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:23.484814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-aa3fbe37-422b-49de-b5ee-020e5fbbd6f9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:23.497342 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-aa3fbe37-422b-49de-b5ee-020e5fbbd6f9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1474 microversion: 2.1 time: 0.403267 May 27 14:59:23.508764 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 366/709] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:23 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1474 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:23.514087 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-257dd5ad-12fd-4e36-80b4-fb18bc5cdd58 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:23.514923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-257dd5ad-12fd-4e36-80b4-fb18bc5cdd58 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:23.525991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-257dd5ad-12fd-4e36-80b4-fb18bc5cdd58 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:23.526639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-257dd5ad-12fd-4e36-80b4-fb18bc5cdd58 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:23.527590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-257dd5ad-12fd-4e36-80b4-fb18bc5cdd58 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:23.528370 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-257dd5ad-12fd-4e36-80b4-fb18bc5cdd58 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:23.860619 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-257dd5ad-12fd-4e36-80b4-fb18bc5cdd58 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:23.872236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-257dd5ad-12fd-4e36-80b4-fb18bc5cdd58 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:23.873809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-257dd5ad-12fd-4e36-80b4-fb18bc5cdd58 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:23.884019 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-257dd5ad-12fd-4e36-80b4-fb18bc5cdd58 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1446 microversion: 2.75 time: 0.373739 May 27 14:59:23.884613 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 367/710] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:23 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1446 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:24.083865 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5bc710d4-0f32-4c8f-afd0-7958710c4c3d tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/324f5b8d-70fc-4ff2-a6c8-2a84e2592914" status: 202 len: 0 microversion: 2.1 time: 1.674863 May 27 14:59:24.091185 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 344/711] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 14:59:22 2022] DELETE /compute/v2.1/os-floating-ips/324f5b8d-70fc-4ff2-a6c8-2a84e2592914 => generated 0 bytes in 1689 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:59:24.094480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-57e0819b-db1d-4aaf-af97-180dada6712d tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] Action: 'update', calling method: .version_select at 0x7fc77703fe50>, body: {"quota_set": {"ram": "5120"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:24.101394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ff64dae6-3ad5-47c8-9e77-0557489affd9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:24.105179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ff64dae6-3ad5-47c8-9e77-0557489affd9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:24.118528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff64dae6-3ad5-47c8-9e77-0557489affd9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:24.119319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff64dae6-3ad5-47c8-9e77-0557489affd9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:24.120339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff64dae6-3ad5-47c8-9e77-0557489affd9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:24.125010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff64dae6-3ad5-47c8-9e77-0557489affd9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:24.221773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57e0819b-db1d-4aaf-af97-180dada6712d tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:24.224337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57e0819b-db1d-4aaf-af97-180dada6712d tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:24.225270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57e0819b-db1d-4aaf-af97-180dada6712d tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:24.226492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57e0819b-db1d-4aaf-af97-180dada6712d tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:24.304654 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-57e0819b-db1d-4aaf-af97-180dada6712d tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/cd467d6b74aa4a0c9ac5e799acb48c41" status: 200 len: 240 microversion: 2.36 time: 0.406103 May 27 14:59:24.309447 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 368/712] 10.222.0.13 () {62 vars in 1302 bytes} [Fri May 27 14:59:23 2022] PUT /compute/v2.1/os-quota-sets/cd467d6b74aa4a0c9ac5e799acb48c41 => generated 240 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:59:24.316842 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ff64dae6-3ad5-47c8-9e77-0557489affd9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:24.319196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-31507660-1277-40c5-804a-78cfdd1fa1d4 tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] Action: 'create', calling method: .version_select at 0x7fc77712c700>, body: {"pool": null} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:24.328583 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ff64dae6-3ad5-47c8-9e77-0557489affd9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:24.336761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ff64dae6-3ad5-47c8-9e77-0557489affd9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:24.341765 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ff64dae6-3ad5-47c8-9e77-0557489affd9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1362 microversion: 2.25 time: 0.247913 May 27 14:59:24.342700 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 345/713] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:24 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:24.373627 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fc3eba5c-43b4-42b5-8896-1d8e7519180b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:24.374995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fc3eba5c-43b4-42b5-8896-1d8e7519180b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:24.383955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc3eba5c-43b4-42b5-8896-1d8e7519180b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:24.384738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc3eba5c-43b4-42b5-8896-1d8e7519180b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:24.385944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc3eba5c-43b4-42b5-8896-1d8e7519180b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:24.387039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc3eba5c-43b4-42b5-8896-1d8e7519180b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:24.651026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fc3eba5c-43b4-42b5-8896-1d8e7519180b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:24.662388 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fc3eba5c-43b4-42b5-8896-1d8e7519180b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" status: 200 len: 1324 microversion: 2.1 time: 0.290706 May 27 14:59:24.663910 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 346/714] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:24 2022] GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa => generated 1324 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:24.676097 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6cd3d06a-b67e-4d63-adaf-aa48aa3ceda5 tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] Calling method '.version_select at 0x7fc7771eaf70>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:24.811674 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6cd3d06a-b67e-4d63-adaf-aa48aa3ceda5 tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:24.812628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6cd3d06a-b67e-4d63-adaf-aa48aa3ceda5 tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:24.821850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6cd3d06a-b67e-4d63-adaf-aa48aa3ceda5 tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:24.822851 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6cd3d06a-b67e-4d63-adaf-aa48aa3ceda5 tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:24.886870 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6cd3d06a-b67e-4d63-adaf-aa48aa3ceda5 tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/cd467d6b74aa4a0c9ac5e799acb48c41/detail" status: 200 len: 672 microversion: 2.36 time: 0.221392 May 27 14:59:24.888130 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 347/715] 10.222.0.13 () {60 vars in 1303 bytes} [Fri May 27 14:59:24 2022] GET /compute/v2.1/os-quota-sets/cd467d6b74aa4a0c9ac5e799acb48c41/detail => generated 672 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:59:24.901692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-20ee6df9-59bb-4008-ad4f-35d975cbaf53 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:24.903404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-20ee6df9-59bb-4008-ad4f-35d975cbaf53 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:24.928469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20ee6df9-59bb-4008-ad4f-35d975cbaf53 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:24.928969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20ee6df9-59bb-4008-ad4f-35d975cbaf53 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:24.929881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20ee6df9-59bb-4008-ad4f-35d975cbaf53 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:24.930408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20ee6df9-59bb-4008-ad4f-35d975cbaf53 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:25.320609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-20ee6df9-59bb-4008-ad4f-35d975cbaf53 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:25.329839 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-20ee6df9-59bb-4008-ad4f-35d975cbaf53 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1474 microversion: 2.1 time: 0.439281 May 27 14:59:25.330427 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 348/716] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:24 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1474 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:25.335257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d628c9f0-c810-4d11-953f-cfd8b89ab66a tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:25.336023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d628c9f0-c810-4d11-953f-cfd8b89ab66a tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:25.346815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d628c9f0-c810-4d11-953f-cfd8b89ab66a tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:25.347468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d628c9f0-c810-4d11-953f-cfd8b89ab66a tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:25.350930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d628c9f0-c810-4d11-953f-cfd8b89ab66a tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:25.351670 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d628c9f0-c810-4d11-953f-cfd8b89ab66a tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:25.464957 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d628c9f0-c810-4d11-953f-cfd8b89ab66a tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:25.475149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d628c9f0-c810-4d11-953f-cfd8b89ab66a tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:25.477522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d628c9f0-c810-4d11-953f-cfd8b89ab66a tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:25.482851 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d628c9f0-c810-4d11-953f-cfd8b89ab66a tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1446 microversion: 2.75 time: 0.151197 May 27 14:59:25.483676 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 349/717] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:25 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1446 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:25.489133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5c0239df-df7e-443f-916d-b8fe45dc80e7 tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] Action: 'update', calling method: .version_select at 0x7fc777674310>, body: {"quota_set": {"ram": "2048"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:25.566044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c0239df-df7e-443f-916d-b8fe45dc80e7 tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:25.566713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c0239df-df7e-443f-916d-b8fe45dc80e7 tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:25.567784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c0239df-df7e-443f-916d-b8fe45dc80e7 tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:25.568375 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c0239df-df7e-443f-916d-b8fe45dc80e7 tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:25.607984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c0239df-df7e-443f-916d-b8fe45dc80e7 tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:25.608915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c0239df-df7e-443f-916d-b8fe45dc80e7 tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:25.609618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c0239df-df7e-443f-916d-b8fe45dc80e7 tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:25.610216 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c0239df-df7e-443f-916d-b8fe45dc80e7 tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:25.708068 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5c0239df-df7e-443f-916d-b8fe45dc80e7 tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/cd467d6b74aa4a0c9ac5e799acb48c41?user_id=afeb1451a34f41d5b4e2fcd63988b029" status: 200 len: 240 microversion: 2.36 time: 0.223139 May 27 14:59:25.708749 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 350/718] 10.222.0.13 () {62 vars in 1383 bytes} [Fri May 27 14:59:25 2022] PUT /compute/v2.1/os-quota-sets/cd467d6b74aa4a0c9ac5e799acb48c41?user_id=afeb1451a34f41d5b4e2fcd63988b029 => generated 240 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:59:25.720269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-048c097f-a61c-41e6-aa0f-582e2833d2c0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:25.720947 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-048c097f-a61c-41e6-aa0f-582e2833d2c0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:25.736174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-048c097f-a61c-41e6-aa0f-582e2833d2c0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:25.736640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-048c097f-a61c-41e6-aa0f-582e2833d2c0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:25.737797 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-048c097f-a61c-41e6-aa0f-582e2833d2c0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:25.738250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-048c097f-a61c-41e6-aa0f-582e2833d2c0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:26.010487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-048c097f-a61c-41e6-aa0f-582e2833d2c0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:26.020375 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-048c097f-a61c-41e6-aa0f-582e2833d2c0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:26.024526 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-048c097f-a61c-41e6-aa0f-582e2833d2c0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:26.025927 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-048c097f-a61c-41e6-aa0f-582e2833d2c0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1362 microversion: 2.25 time: 0.315826 May 27 14:59:26.037339 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 351/719] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:25 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:26.043130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-00505b16-fd55-451d-846c-b1e8a629f1ab tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:26.044021 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-00505b16-fd55-451d-846c-b1e8a629f1ab tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:26.050766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-00505b16-fd55-451d-846c-b1e8a629f1ab tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:26.051439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-00505b16-fd55-451d-846c-b1e8a629f1ab tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:26.052372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-00505b16-fd55-451d-846c-b1e8a629f1ab tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:26.052999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-00505b16-fd55-451d-846c-b1e8a629f1ab tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:26.502059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-00505b16-fd55-451d-846c-b1e8a629f1ab tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:26.512911 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-00505b16-fd55-451d-846c-b1e8a629f1ab tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" status: 200 len: 1324 microversion: 2.1 time: 0.473519 May 27 14:59:26.513500 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 352/720] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:26 2022] GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa => generated 1324 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:26.519577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fbce8921-e1c1-4681-a995-1c9c18451fbd tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] Calling method '.version_select at 0x7fc7772aeb80>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:26.587957 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-31507660-1277-40c5-804a-78cfdd1fa1d4 tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.275719 May 27 14:59:26.589027 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 369/721] 10.222.0.13 () {60 vars in 1169 bytes} [Fri May 27 14:59:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:26.595057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a25bd23c-982f-4ba8-985b-8984d5e5f35c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:26.595933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a25bd23c-982f-4ba8-985b-8984d5e5f35c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:26.602876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a25bd23c-982f-4ba8-985b-8984d5e5f35c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:26.603457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a25bd23c-982f-4ba8-985b-8984d5e5f35c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:26.604421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a25bd23c-982f-4ba8-985b-8984d5e5f35c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:26.605118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a25bd23c-982f-4ba8-985b-8984d5e5f35c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:26.650684 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fbce8921-e1c1-4681-a995-1c9c18451fbd tempest-QuotasAdminTestV236-764791204 tempest-QuotasAdminTestV236-764791204-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/cd467d6b74aa4a0c9ac5e799acb48c41?user_id=afeb1451a34f41d5b4e2fcd63988b029" status: 200 len: 282 microversion: 2.36 time: 0.135429 May 27 14:59:26.651277 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 353/722] 10.222.0.13 () {60 vars in 1363 bytes} [Fri May 27 14:59:26 2022] GET /compute/v2.1/os-quota-sets/cd467d6b74aa4a0c9ac5e799acb48c41?user_id=afeb1451a34f41d5b4e2fcd63988b029 => generated 282 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:59:26.661847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4fefbb86-b7d4-4ceb-ba42-9b4abc7a50a3 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:26.662677 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4fefbb86-b7d4-4ceb-ba42-9b4abc7a50a3 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:26.673164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4fefbb86-b7d4-4ceb-ba42-9b4abc7a50a3 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:26.673911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4fefbb86-b7d4-4ceb-ba42-9b4abc7a50a3 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:26.674942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4fefbb86-b7d4-4ceb-ba42-9b4abc7a50a3 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:26.675568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4fefbb86-b7d4-4ceb-ba42-9b4abc7a50a3 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:26.770720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4fefbb86-b7d4-4ceb-ba42-9b4abc7a50a3 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:26.790050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4fefbb86-b7d4-4ceb-ba42-9b4abc7a50a3 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:26.795481 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4fefbb86-b7d4-4ceb-ba42-9b4abc7a50a3 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:26.808574 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4fefbb86-b7d4-4ceb-ba42-9b4abc7a50a3 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1446 microversion: 2.75 time: 0.150558 May 27 14:59:26.811414 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 354/723] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:26 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1446 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:26.821303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9b89218f-f92d-4f3b-8514-cc4382b2586d tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] Calling method '.version_select at 0x7fc7772a6550>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:26.930067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a25bd23c-982f-4ba8-985b-8984d5e5f35c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:26.941188 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a25bd23c-982f-4ba8-985b-8984d5e5f35c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1474 microversion: 2.1 time: 0.350368 May 27 14:59:26.946852 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 370/724] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:26 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1474 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:27.045596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8885426c-47a9-4083-95e6-90c552b8b197 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:27.046218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8885426c-47a9-4083-95e6-90c552b8b197 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:27.057081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8885426c-47a9-4083-95e6-90c552b8b197 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:27.058833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8885426c-47a9-4083-95e6-90c552b8b197 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:27.059673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8885426c-47a9-4083-95e6-90c552b8b197 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:27.061091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8885426c-47a9-4083-95e6-90c552b8b197 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:27.414805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8885426c-47a9-4083-95e6-90c552b8b197 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:27.432509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8885426c-47a9-4083-95e6-90c552b8b197 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:27.435381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8885426c-47a9-4083-95e6-90c552b8b197 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:27.437256 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8885426c-47a9-4083-95e6-90c552b8b197 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1362 microversion: 2.25 time: 0.397760 May 27 14:59:27.451373 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 371/725] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:27 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 14:59:27.533624 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ff599910-938d-48ca-9c89-c0b3f2083dfd tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:27.534509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ff599910-938d-48ca-9c89-c0b3f2083dfd tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:27.550593 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff599910-938d-48ca-9c89-c0b3f2083dfd tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:27.551064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff599910-938d-48ca-9c89-c0b3f2083dfd tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:27.551878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff599910-938d-48ca-9c89-c0b3f2083dfd tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:27.554303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff599910-938d-48ca-9c89-c0b3f2083dfd tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:28.160507 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ff599910-938d-48ca-9c89-c0b3f2083dfd tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:28.173544 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ff599910-938d-48ca-9c89-c0b3f2083dfd tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" status: 200 len: 1324 microversion: 2.1 time: 0.645392 May 27 14:59:28.184027 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 372/726] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:27 2022] GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa => generated 1324 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:28.191176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1f01a7f7-dff2-40b7-bc89-017fee8b9610 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:28.192218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1f01a7f7-dff2-40b7-bc89-017fee8b9610 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:28.202002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f01a7f7-dff2-40b7-bc89-017fee8b9610 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:28.202538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f01a7f7-dff2-40b7-bc89-017fee8b9610 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:28.203331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f01a7f7-dff2-40b7-bc89-017fee8b9610 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:28.203870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f01a7f7-dff2-40b7-bc89-017fee8b9610 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:28.329484 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9b89218f-f92d-4f3b-8514-cc4382b2586d tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/f327573c-be1c-43de-9aad-749f91c26da3" status: 202 len: 0 microversion: 2.1 time: 1.516598 May 27 14:59:28.330270 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 355/727] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 14:59:26 2022] DELETE /compute/v2.1/os-floating-ips/f327573c-be1c-43de-9aad-749f91c26da3 => generated 0 bytes in 1518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 14:59:28.338658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-131c0f8a-a13e-43b6-b8cf-8e30ae66e783 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:28.339411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-131c0f8a-a13e-43b6-b8cf-8e30ae66e783 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:28.345134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:28.347651 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1f01a7f7-dff2-40b7-bc89-017fee8b9610 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:28.351110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-131c0f8a-a13e-43b6-b8cf-8e30ae66e783 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:28.351251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:28.351929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-131c0f8a-a13e-43b6-b8cf-8e30ae66e783 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:28.352964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-131c0f8a-a13e-43b6-b8cf-8e30ae66e783 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:28.353616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-131c0f8a-a13e-43b6-b8cf-8e30ae66e783 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:28.362881 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1f01a7f7-dff2-40b7-bc89-017fee8b9610 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:28.372483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1f01a7f7-dff2-40b7-bc89-017fee8b9610 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:28.387389 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1f01a7f7-dff2-40b7-bc89-017fee8b9610 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1446 microversion: 2.75 time: 0.201669 May 27 14:59:28.388313 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 373/728] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:28 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1446 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:28.393168 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-37aa86b4-ae4b-4b80-ac17-950db00b9be8 tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] Calling method '.version_select at 0x7fc776e8c310>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:28.514046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG neutronclient.v2_0.client [None req-37aa86b4-ae4b-4b80-ac17-950db00b9be8 tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f327573c-be1c-43de-9aad-749f91c26da3 could not be found", "detail": ""}} {{(pid=119248) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 14:59:28.514969 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-37aa86b4-ae4b-4b80-ac17-950db00b9be8 tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] HTTP exception thrown: Floating IP not found for ID f327573c-be1c-43de-9aad-749f91c26da3 May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-37aa86b4-ae4b-4b80-ac17-950db00b9be8 tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] Request method failure captured: May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-floating-ips/f327573c-be1c-43de-9aad-749f91c26da3 HTTP/1.1 May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOdC_MJ0xeZH1zuUTbH4NaK4mrZ0CsjOC6FfqwyNqoN0U_WWxsSrNjmlrh_wuZ0KJujZeiTXfQ7cLalOP_7hoihuz3-zHY-CSIuOgdDwDAaPFvDWB0e39puI1uBzEc__kjl579_53T-2EV4FEs3IP9DmulpDpDcjnzV4OkyWf94-L1s May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 151a105888794f5d800370f83755b542 May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-FloatingIPsTestJSON-379284246 May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:59:28.531878 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:59:28.533573 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/151a105888794f5d800370f83755b542"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/151a105888794f5d800370f83755b542"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/151a105888794f5d800370f83755b542"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_151a105888794f5d800370f83755b542", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:59:28.533573 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-FloatingIPsTestJSON-379284246 May 27 14:59:28.533573 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 151a105888794f5d800370f83755b542 May 27 14:59:28.533573 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-FloatingIPsTestJSON-379284246 May 27 14:59:28.533573 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-FloatingIPsTestJSON-379284246-project May 27 14:59:28.533573 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:59:28.533573 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:59:28.533573 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 28c762e8e470422681556f1c6f439e9c May 27 14:59:28.533573 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-FloatingIPsTestJSON-379284246-project May 27 14:59:28.533573 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 14:59:28.533573 n-d-843621-1 devstack@n-api.service[119248]: exception: Floating IP not found for ID f327573c-be1c-43de-9aad-749f91c26da3 May 27 14:59:28.533573 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'f327573c-be1c-43de-9aad-749f91c26da3'} May 27 14:59:28.533573 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:59:28.534551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:28.534551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip May 27 14:59:28.534551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 27 14:59:28.534551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 14:59:28.534551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 14:59:28.534551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 27 14:59:28.534551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 27 14:59:28.534551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 14:59:28.534551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 14:59:28.534551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 27 14:59:28.534551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 27 14:59:28.534551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 14:59:28.534551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 14:59:28.534551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 14:59:28.534551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 14:59:28.534551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 14:59:28.534551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 14:59:28.534551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 14:59:28.534551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 14:59:28.536055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 14:59:28.536055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 14:59:28.536055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 14:59:28.536055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 14:59:28.536055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 14:59:28.536055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 14:59:28.536055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f327573c-be1c-43de-9aad-749f91c26da3 could not be found May 27 14:59:28.536055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f39e82b-c486-424d-a533-c44415a8660e'] May 27 14:59:28.536055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:28.536055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:59:28.536055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:28.536055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:28.536055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show May 27 14:59:28.536055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 27 14:59:28.536055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip May 27 14:59:28.536055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 27 14:59:28.536055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f327573c-be1c-43de-9aad-749f91c26da3. May 27 14:59:28.536055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:28.536055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:59:28.536055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:28.538549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:28.538549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:59:28.538549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:59:28.538549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:59:28.538549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:59:28.538549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:59:28.538549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:59:28.538549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:59:28.538549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:59:28.538549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show May 27 14:59:28.538549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 27 14:59:28.538549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f327573c-be1c-43de-9aad-749f91c26da3 May 27 14:59:28.538549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:28.538549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:59:28.538549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:28.538549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:28.538549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:59:28.538549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:59:28.538549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:59:28.538549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:59:28.540391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f327573c-be1c-43de-9aad-749f91c26da3 May 27 14:59:28.540391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:28.541682 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-37aa86b4-ae4b-4b80-ac17-950db00b9be8 tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] Returning 404 to user: Floating IP not found for ID f327573c-be1c-43de-9aad-749f91c26da3 {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:59:28.543440 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-37aa86b4-ae4b-4b80-ac17-950db00b9be8 tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/f327573c-be1c-43de-9aad-749f91c26da3" status: 404 len: 111 microversion: 2.1 time: 0.153494 May 27 14:59:28.544328 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 374/729] 10.222.0.13 () {58 vars in 1259 bytes} [Fri May 27 14:59:28 2022] GET /compute/v2.1/os-floating-ips/f327573c-be1c-43de-9aad-749f91c26da3 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:59:28.551092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-131c0f8a-a13e-43b6-b8cf-8e30ae66e783 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:28.553082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ab50d549-3600-4169-852c-57e822d506d4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:28.553970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ab50d549-3600-4169-852c-57e822d506d4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:28.556083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:28.562583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab50d549-3600-4169-852c-57e822d506d4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:28.562825 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-131c0f8a-a13e-43b6-b8cf-8e30ae66e783 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1474 microversion: 2.1 time: 0.231068 May 27 14:59:28.563531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab50d549-3600-4169-852c-57e822d506d4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:28.564545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab50d549-3600-4169-852c-57e822d506d4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:28.565248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab50d549-3600-4169-852c-57e822d506d4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:28.573427 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 356/730] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:28 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1474 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:28.580039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2750149a-b3c3-4fdb-b450-846668193775 tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] Calling method '.version_select at 0x7fc7775bd5e0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:28.631063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG neutronclient.v2_0.client [None req-2750149a-b3c3-4fdb-b450-846668193775 tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f327573c-be1c-43de-9aad-749f91c26da3 could not be found", "detail": ""}} {{(pid=119249) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 14:59:28.632311 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-2750149a-b3c3-4fdb-b450-846668193775 tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] HTTP exception thrown: Floating IP not found for ID f327573c-be1c-43de-9aad-749f91c26da3 May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2750149a-b3c3-4fdb-b450-846668193775 tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] Request method failure captured: May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/os-floating-ips/f327573c-be1c-43de-9aad-749f91c26da3 HTTP/1.1 May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOdC_MJ0xeZH1zuUTbH4NaK4mrZ0CsjOC6FfqwyNqoN0U_WWxsSrNjmlrh_wuZ0KJujZeiTXfQ7cLalOP_7hoihuz3-zHY-CSIuOgdDwDAaPFvDWB0e39puI1uBzEc__kjl579_53T-2EV4FEs3IP9DmulpDpDcjnzV4OkyWf94-L1s May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 151a105888794f5d800370f83755b542 May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-FloatingIPsTestJSON-379284246 May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:59:28.637546 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:59:28.638839 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/151a105888794f5d800370f83755b542"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/151a105888794f5d800370f83755b542"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/151a105888794f5d800370f83755b542"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_151a105888794f5d800370f83755b542", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:59:28.638839 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-FloatingIPsTestJSON-379284246 May 27 14:59:28.638839 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 151a105888794f5d800370f83755b542 May 27 14:59:28.638839 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-FloatingIPsTestJSON-379284246 May 27 14:59:28.638839 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-FloatingIPsTestJSON-379284246-project May 27 14:59:28.638839 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:59:28.638839 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:59:28.638839 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 28c762e8e470422681556f1c6f439e9c May 27 14:59:28.638839 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-FloatingIPsTestJSON-379284246-project May 27 14:59:28.638839 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 14:59:28.638839 n-d-843621-1 devstack@n-api.service[119249]: exception: Floating IP not found for ID f327573c-be1c-43de-9aad-749f91c26da3 May 27 14:59:28.638839 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'f327573c-be1c-43de-9aad-749f91c26da3'} May 27 14:59:28.638839 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:59:28.639699 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:28.639699 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip May 27 14:59:28.639699 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 27 14:59:28.639699 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 14:59:28.639699 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 14:59:28.639699 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 27 14:59:28.639699 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 27 14:59:28.639699 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 14:59:28.639699 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 14:59:28.639699 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 27 14:59:28.639699 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 27 14:59:28.639699 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 14:59:28.639699 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 14:59:28.639699 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 14:59:28.639699 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 14:59:28.639699 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 14:59:28.639699 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 14:59:28.639699 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 14:59:28.639699 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 14:59:28.640835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 14:59:28.640835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 14:59:28.640835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 14:59:28.640835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 14:59:28.640835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 14:59:28.640835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 14:59:28.640835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f327573c-be1c-43de-9aad-749f91c26da3 could not be found May 27 14:59:28.640835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-517c114f-7195-4084-98bc-9980ce65e9ee'] May 27 14:59:28.640835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:59:28.640835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:59:28.640835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:59:28.640835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:28.640835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete May 27 14:59:28.640835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 27 14:59:28.640835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip May 27 14:59:28.640835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 27 14:59:28.640835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f327573c-be1c-43de-9aad-749f91c26da3. May 27 14:59:28.640835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:59:28.640835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:59:28.640835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:59:28.643134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:28.643134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:59:28.643134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:59:28.643134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:59:28.643134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:59:28.643134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:59:28.643134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:59:28.643134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:59:28.643134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:59:28.643134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete May 27 14:59:28.643134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 27 14:59:28.643134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f327573c-be1c-43de-9aad-749f91c26da3 May 27 14:59:28.643134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:59:28.643134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:59:28.643134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:59:28.643134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:28.643134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:59:28.643134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:59:28.643134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:59:28.643134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:59:28.645981 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f327573c-be1c-43de-9aad-749f91c26da3 May 27 14:59:28.645981 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:59:28.647271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2750149a-b3c3-4fdb-b450-846668193775 tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] Returning 404 to user: Floating IP not found for ID f327573c-be1c-43de-9aad-749f91c26da3 {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:59:28.649575 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2750149a-b3c3-4fdb-b450-846668193775 tempest-FloatingIPsTestJSON-379284246 tempest-FloatingIPsTestJSON-379284246-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/f327573c-be1c-43de-9aad-749f91c26da3" status: 404 len: 111 microversion: 2.1 time: 0.074515 May 27 14:59:28.650354 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 357/731] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 14:59:28 2022] DELETE /compute/v2.1/os-floating-ips/f327573c-be1c-43de-9aad-749f91c26da3 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 14:59:29.014451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ab50d549-3600-4169-852c-57e822d506d4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:29.032663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ab50d549-3600-4169-852c-57e822d506d4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:29.040530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ab50d549-3600-4169-852c-57e822d506d4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:29.041797 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ab50d549-3600-4169-852c-57e822d506d4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1362 microversion: 2.25 time: 0.493060 May 27 14:59:29.054670 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 375/732] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:28 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1362 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:29.190692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7412318c-8d3f-4d68-94ee-6d715c449937 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:29.191405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7412318c-8d3f-4d68-94ee-6d715c449937 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:29.201990 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7412318c-8d3f-4d68-94ee-6d715c449937 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:29.207232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7412318c-8d3f-4d68-94ee-6d715c449937 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:29.209383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7412318c-8d3f-4d68-94ee-6d715c449937 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:29.213127 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7412318c-8d3f-4d68-94ee-6d715c449937 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:29.414495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e768e49e-9fd3-43c1-9b56-17291aab327c tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:29.415570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e768e49e-9fd3-43c1-9b56-17291aab327c tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:29.425523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e768e49e-9fd3-43c1-9b56-17291aab327c tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:29.430432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e768e49e-9fd3-43c1-9b56-17291aab327c tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:29.431451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e768e49e-9fd3-43c1-9b56-17291aab327c tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:29.435836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e768e49e-9fd3-43c1-9b56-17291aab327c tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:29.970517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e768e49e-9fd3-43c1-9b56-17291aab327c tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:29.987655 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e768e49e-9fd3-43c1-9b56-17291aab327c tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:29.990093 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e768e49e-9fd3-43c1-9b56-17291aab327c tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:29.998341 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e768e49e-9fd3-43c1-9b56-17291aab327c tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1446 microversion: 2.75 time: 0.588385 May 27 14:59:30.006389 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 376/733] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:29 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1446 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:30.013396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-edc6c47d-01bc-4ea6-8444-4829d497bbef tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:30.015501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-edc6c47d-01bc-4ea6-8444-4829d497bbef tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:30.024739 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-edc6c47d-01bc-4ea6-8444-4829d497bbef tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:30.026386 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-edc6c47d-01bc-4ea6-8444-4829d497bbef tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:30.027587 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-edc6c47d-01bc-4ea6-8444-4829d497bbef tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:30.028421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-edc6c47d-01bc-4ea6-8444-4829d497bbef tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:30.118863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7412318c-8d3f-4d68-94ee-6d715c449937 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:30.137773 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7412318c-8d3f-4d68-94ee-6d715c449937 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" status: 200 len: 1324 microversion: 2.1 time: 0.950525 May 27 14:59:30.138647 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 358/734] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:29 2022] GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa => generated 1324 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:59:30.147837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-9884f752-f7ac-4c44-90c7-96b29cce24bf req-628adb91-f62b-466e-8666-383535a73041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e4f7f7-6bda-4d0b-9685-74266d42efc0", "name": "network-vif-plugged", "status": "completed", "tag": "2c3a966d-ef56-4dbf-afab-504228aa5443"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:30.158696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-9884f752-f7ac-4c44-90c7-96b29cce24bf req-628adb91-f62b-466e-8666-383535a73041 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:30.159531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-9884f752-f7ac-4c44-90c7-96b29cce24bf req-628adb91-f62b-466e-8666-383535a73041 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:30.198695 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-9884f752-f7ac-4c44-90c7-96b29cce24bf req-628adb91-f62b-466e-8666-383535a73041 service nova] Creating event network-vif-plugged:2c3a966d-ef56-4dbf-afab-504228aa5443 for instance 18e4f7f7-6bda-4d0b-9685-74266d42efc0 on n-h2-843621-1 May 27 14:59:30.214140 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-9884f752-f7ac-4c44-90c7-96b29cce24bf req-628adb91-f62b-466e-8666-383535a73041 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073889 May 27 14:59:30.217794 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 359/735] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:30.229593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7962313a-897c-411d-b01c-7fab82a30231 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:30.234358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7962313a-897c-411d-b01c-7fab82a30231 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:30.252373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7962313a-897c-411d-b01c-7fab82a30231 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:30.258691 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7962313a-897c-411d-b01c-7fab82a30231 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:30.259883 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7962313a-897c-411d-b01c-7fab82a30231 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:30.260764 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7962313a-897c-411d-b01c-7fab82a30231 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:30.536972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-edc6c47d-01bc-4ea6-8444-4829d497bbef tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:30.558186 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-edc6c47d-01bc-4ea6-8444-4829d497bbef tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1474 microversion: 2.1 time: 0.549623 May 27 14:59:30.559824 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 377/736] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:30 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1474 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:30.681059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7962313a-897c-411d-b01c-7fab82a30231 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:30.691144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7962313a-897c-411d-b01c-7fab82a30231 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:30.692769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7962313a-897c-411d-b01c-7fab82a30231 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:30.694668 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7962313a-897c-411d-b01c-7fab82a30231 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1362 microversion: 2.25 time: 0.475042 May 27 14:59:30.695388 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 360/737] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:30 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1362 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:31.032832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9b29cf52-a7ca-4c21-bb2c-94ea4aa7b1d4 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:31.038316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9b29cf52-a7ca-4c21-bb2c-94ea4aa7b1d4 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:31.086705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b29cf52-a7ca-4c21-bb2c-94ea4aa7b1d4 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:31.090779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b29cf52-a7ca-4c21-bb2c-94ea4aa7b1d4 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:31.092532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b29cf52-a7ca-4c21-bb2c-94ea4aa7b1d4 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:31.094890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b29cf52-a7ca-4c21-bb2c-94ea4aa7b1d4 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:31.160914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ae410c85-65d7-4c66-95e9-026d8d500a34 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:31.162171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ae410c85-65d7-4c66-95e9-026d8d500a34 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:31.194115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae410c85-65d7-4c66-95e9-026d8d500a34 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:31.195566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae410c85-65d7-4c66-95e9-026d8d500a34 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:31.199372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae410c85-65d7-4c66-95e9-026d8d500a34 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:31.205492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae410c85-65d7-4c66-95e9-026d8d500a34 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:31.288493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9b29cf52-a7ca-4c21-bb2c-94ea4aa7b1d4 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:31.300959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9b29cf52-a7ca-4c21-bb2c-94ea4aa7b1d4 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:31.307924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9b29cf52-a7ca-4c21-bb2c-94ea4aa7b1d4 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:31.314984 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9b29cf52-a7ca-4c21-bb2c-94ea4aa7b1d4 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1446 microversion: 2.75 time: 0.289395 May 27 14:59:31.333931 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 378/738] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:31 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1446 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:31.577691 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0ba56f18-a12c-4a35-b098-1366d82163ab tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:31.581366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0ba56f18-a12c-4a35-b098-1366d82163ab tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:31.598146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ba56f18-a12c-4a35-b098-1366d82163ab tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:31.599165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ba56f18-a12c-4a35-b098-1366d82163ab tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:31.602325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ba56f18-a12c-4a35-b098-1366d82163ab tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:31.604225 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ba56f18-a12c-4a35-b098-1366d82163ab tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:31.775806 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ae410c85-65d7-4c66-95e9-026d8d500a34 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:31.805186 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ae410c85-65d7-4c66-95e9-026d8d500a34 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" status: 200 len: 1324 microversion: 2.1 time: 0.652581 May 27 14:59:31.806281 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 361/739] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:31 2022] GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa => generated 1324 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:59:31.812622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-49a6c1af-e6b1-4742-a3cd-950f74fa40a9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:31.813515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-49a6c1af-e6b1-4742-a3cd-950f74fa40a9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:31.826802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-49a6c1af-e6b1-4742-a3cd-950f74fa40a9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:31.827680 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-49a6c1af-e6b1-4742-a3cd-950f74fa40a9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:31.829306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-49a6c1af-e6b1-4742-a3cd-950f74fa40a9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:31.831254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-49a6c1af-e6b1-4742-a3cd-950f74fa40a9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:32.143923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0ba56f18-a12c-4a35-b098-1366d82163ab tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:32.163837 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0ba56f18-a12c-4a35-b098-1366d82163ab tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1474 microversion: 2.1 time: 0.591513 May 27 14:59:32.165099 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 379/740] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:31 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1474 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:32.240447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-fe127ee9-d12b-4fcc-907d-82edd01b5ab0 req-25c118aa-55de-4274-9f2e-bfc4936b9531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da2c6d0b-b6e3-43a9-870b-6f7493b08dfa", "name": "network-vif-plugged", "status": "completed", "tag": "77a08a17-7b75-4c05-a064-2f80d2e429a8"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:32.264767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-fe127ee9-d12b-4fcc-907d-82edd01b5ab0 req-25c118aa-55de-4274-9f2e-bfc4936b9531 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:32.264767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-fe127ee9-d12b-4fcc-907d-82edd01b5ab0 req-25c118aa-55de-4274-9f2e-bfc4936b9531 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:32.283985 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-fe127ee9-d12b-4fcc-907d-82edd01b5ab0 req-25c118aa-55de-4274-9f2e-bfc4936b9531 service nova] Creating event network-vif-plugged:77a08a17-7b75-4c05-a064-2f80d2e429a8 for instance da2c6d0b-b6e3-43a9-870b-6f7493b08dfa on n-h2-843621-1 May 27 14:59:32.290331 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-fe127ee9-d12b-4fcc-907d-82edd01b5ab0 req-25c118aa-55de-4274-9f2e-bfc4936b9531 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054348 May 27 14:59:32.291657 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 380/741] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 14:59:32.328199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-49a6c1af-e6b1-4742-a3cd-950f74fa40a9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:32.339599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-49a6c1af-e6b1-4742-a3cd-950f74fa40a9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:32.345815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-49a6c1af-e6b1-4742-a3cd-950f74fa40a9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:32.347225 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-49a6c1af-e6b1-4742-a3cd-950f74fa40a9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1362 microversion: 2.25 time: 0.539646 May 27 14:59:32.348303 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 362/742] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:31 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1362 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:32.365167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0ecf6dd2-bd88-43ba-953d-a4f0866143f8 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:32.366741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0ecf6dd2-bd88-43ba-953d-a4f0866143f8 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:32.382027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ecf6dd2-bd88-43ba-953d-a4f0866143f8 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:32.382685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ecf6dd2-bd88-43ba-953d-a4f0866143f8 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:32.386102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ecf6dd2-bd88-43ba-953d-a4f0866143f8 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:32.386832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ecf6dd2-bd88-43ba-953d-a4f0866143f8 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:32.661210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0ecf6dd2-bd88-43ba-953d-a4f0866143f8 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:32.676909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0ecf6dd2-bd88-43ba-953d-a4f0866143f8 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:32.684323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0ecf6dd2-bd88-43ba-953d-a4f0866143f8 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:32.698630 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0ecf6dd2-bd88-43ba-953d-a4f0866143f8 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1452 microversion: 2.75 time: 0.364297 May 27 14:59:32.719474 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 381/743] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:32 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1452 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 14:59:32.824356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-af019b47-e1e6-4a3c-a627-27a0e010d70b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:32.825687 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-af019b47-e1e6-4a3c-a627-27a0e010d70b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:32.844851 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af019b47-e1e6-4a3c-a627-27a0e010d70b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:32.846010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af019b47-e1e6-4a3c-a627-27a0e010d70b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:32.851221 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af019b47-e1e6-4a3c-a627-27a0e010d70b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:32.851947 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af019b47-e1e6-4a3c-a627-27a0e010d70b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:33.145469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-af019b47-e1e6-4a3c-a627-27a0e010d70b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:33.149280 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:33.177400 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-af019b47-e1e6-4a3c-a627-27a0e010d70b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" status: 200 len: 1324 microversion: 2.1 time: 0.359099 May 27 14:59:33.198465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-51c54fd9-a55c-4ec9-a1c5-bf4af6813f02 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:33.199656 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 363/744] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:32 2022] GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa => generated 1324 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:33.200295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-51c54fd9-a55c-4ec9-a1c5-bf4af6813f02 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:33.207525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51c54fd9-a55c-4ec9-a1c5-bf4af6813f02 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:33.208303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51c54fd9-a55c-4ec9-a1c5-bf4af6813f02 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:33.211826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51c54fd9-a55c-4ec9-a1c5-bf4af6813f02 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:33.212546 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51c54fd9-a55c-4ec9-a1c5-bf4af6813f02 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:33.372046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8c31b363-37ef-4df2-b66a-5cbda9d0ae93 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:33.373930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8c31b363-37ef-4df2-b66a-5cbda9d0ae93 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:33.411330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c31b363-37ef-4df2-b66a-5cbda9d0ae93 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:33.412270 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c31b363-37ef-4df2-b66a-5cbda9d0ae93 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:33.420562 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c31b363-37ef-4df2-b66a-5cbda9d0ae93 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:33.421795 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c31b363-37ef-4df2-b66a-5cbda9d0ae93 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:33.737451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-51c54fd9-a55c-4ec9-a1c5-bf4af6813f02 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:33.750606 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-51c54fd9-a55c-4ec9-a1c5-bf4af6813f02 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1474 microversion: 2.1 time: 0.556207 May 27 14:59:33.777648 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 382/745] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:33 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1474 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:33.798136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-14e42932-85f2-49f1-bf87-7187a0d96bb6 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:33.803236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-14e42932-85f2-49f1-bf87-7187a0d96bb6 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:33.845501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-14e42932-85f2-49f1-bf87-7187a0d96bb6 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:33.849046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-14e42932-85f2-49f1-bf87-7187a0d96bb6 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:33.852141 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-14e42932-85f2-49f1-bf87-7187a0d96bb6 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:33.854468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-14e42932-85f2-49f1-bf87-7187a0d96bb6 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:33.959855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8c31b363-37ef-4df2-b66a-5cbda9d0ae93 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:33.972968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8c31b363-37ef-4df2-b66a-5cbda9d0ae93 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:33.985648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8c31b363-37ef-4df2-b66a-5cbda9d0ae93 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:33.987152 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8c31b363-37ef-4df2-b66a-5cbda9d0ae93 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1557 microversion: 2.25 time: 0.620975 May 27 14:59:33.987719 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 364/746] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:33 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1557 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:34.006930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6440fd43-a62f-40c4-9dd7-29ab63b29f78 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:34.007815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6440fd43-a62f-40c4-9dd7-29ab63b29f78 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:34.021869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6440fd43-a62f-40c4-9dd7-29ab63b29f78 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:34.023468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6440fd43-a62f-40c4-9dd7-29ab63b29f78 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:34.024696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6440fd43-a62f-40c4-9dd7-29ab63b29f78 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:34.025820 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6440fd43-a62f-40c4-9dd7-29ab63b29f78 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:34.061026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-14e42932-85f2-49f1-bf87-7187a0d96bb6 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:34.072688 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-14e42932-85f2-49f1-bf87-7187a0d96bb6 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:34.074237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-14e42932-85f2-49f1-bf87-7187a0d96bb6 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:34.100080 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-14e42932-85f2-49f1-bf87-7187a0d96bb6 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1452 microversion: 2.75 time: 0.319113 May 27 14:59:34.114161 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 383/747] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:33 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1452 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:34.250093 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=5 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:34.292819 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=99 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:34.346819 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bafd17f2-6da7-4964-be4e-b606dfa15274 tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Calling method '.version_select at 0x7fc7775393a0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:34.366783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-6440fd43-a62f-40c4-9dd7-29ab63b29f78 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lazy-loading 'services' on Instance uuid 18e4f7f7-6bda-4d0b-9685-74266d42efc0 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:59:34.405510 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6440fd43-a62f-40c4-9dd7-29ab63b29f78 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 2050 microversion: 2.25 time: 0.404284 May 27 14:59:34.408872 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 365/748] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:33 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 2050 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 14:59:34.419856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-331116e5-8e68-4a4f-b9ec-d95dba249fb7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:34.421379 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-331116e5-8e68-4a4f-b9ec-d95dba249fb7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:34.431685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-331116e5-8e68-4a4f-b9ec-d95dba249fb7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:34.432632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-331116e5-8e68-4a4f-b9ec-d95dba249fb7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:34.434771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-331116e5-8e68-4a4f-b9ec-d95dba249fb7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:34.435235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-331116e5-8e68-4a4f-b9ec-d95dba249fb7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:34.470338 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bafd17f2-6da7-4964-be4e-b606dfa15274 tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68" status: 200 len: 371 microversion: 2.1 time: 0.327775 May 27 14:59:34.482797 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 384/749] 10.222.0.13 () {58 vars in 1241 bytes} [Fri May 27 14:59:34 2022] GET /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68 => generated 371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:34.489498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e08bdf43-7687-4342-8a47-d0a7651d67f3 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:34.497904 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:59:34.497904 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 14:59:34.499820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e08bdf43-7687-4342-8a47-d0a7651d67f3 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:34.503580 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e08bdf43-7687-4342-8a47-d0a7651d67f3 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:34.504481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e08bdf43-7687-4342-8a47-d0a7651d67f3 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:34.504971 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e08bdf43-7687-4342-8a47-d0a7651d67f3 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:34.579092 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e08bdf43-7687-4342-8a47-d0a7651d67f3 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.094352 May 27 14:59:34.579720 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 385/750] 10.222.0.13 () {60 vars in 1216 bytes} [Fri May 27 14:59:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:59:34.587834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-80a5a729-7632-47d9-bdb6-12374bafc61e tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Action: 'update', calling method: .version_select at 0x7fc77703b8b0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:34.760939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-80a5a729-7632-47d9-bdb6-12374bafc61e tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:34.761658 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-80a5a729-7632-47d9-bdb6-12374bafc61e tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:34.764493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-80a5a729-7632-47d9-bdb6-12374bafc61e tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:34.765102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-80a5a729-7632-47d9-bdb6-12374bafc61e tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:34.795170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-331116e5-8e68-4a4f-b9ec-d95dba249fb7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:34.813540 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-331116e5-8e68-4a4f-b9ec-d95dba249fb7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" status: 200 len: 1521 microversion: 2.1 time: 0.396413 May 27 14:59:34.814824 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 366/751] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:34 2022] GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:34.820595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2bb2d914-b16d-42ee-b4cd-8a1b29fc7e40 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:34.821421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2bb2d914-b16d-42ee-b4cd-8a1b29fc7e40 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:34.830360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2bb2d914-b16d-42ee-b4cd-8a1b29fc7e40 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:34.831203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2bb2d914-b16d-42ee-b4cd-8a1b29fc7e40 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:34.832175 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2bb2d914-b16d-42ee-b4cd-8a1b29fc7e40 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:34.832805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2bb2d914-b16d-42ee-b4cd-8a1b29fc7e40 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:34.953858 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-80a5a729-7632-47d9-bdb6-12374bafc61e tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68" status: 200 len: 328 microversion: 2.1 time: 0.373043 May 27 14:59:34.973604 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 386/752] 10.222.0.13 () {60 vars in 1261 bytes} [Fri May 27 14:59:34 2022] PUT /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68 => generated 328 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:34.985465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d2d5c82e-3314-479a-93c1-d54c8fce392c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Action: 'create', calling method: .version_select at 0x7fc7775394c0>, body: {"pool": null} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:35.623550 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=7 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:35.799471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2bb2d914-b16d-42ee-b4cd-8a1b29fc7e40 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:35.810697 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2bb2d914-b16d-42ee-b4cd-8a1b29fc7e40 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1474 microversion: 2.1 time: 0.994654 May 27 14:59:35.817481 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 367/753] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:34 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1474 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:35.834315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-824b69bd-3f5f-48b4-8a85-9c77721318b3 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:35.834988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-824b69bd-3f5f-48b4-8a85-9c77721318b3 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:35.880405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-824b69bd-3f5f-48b4-8a85-9c77721318b3 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:35.884121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-824b69bd-3f5f-48b4-8a85-9c77721318b3 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:35.888976 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-824b69bd-3f5f-48b4-8a85-9c77721318b3 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:35.890912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-824b69bd-3f5f-48b4-8a85-9c77721318b3 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:36.206568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-824b69bd-3f5f-48b4-8a85-9c77721318b3 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:36.223605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-824b69bd-3f5f-48b4-8a85-9c77721318b3 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:36.230971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-824b69bd-3f5f-48b4-8a85-9c77721318b3 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:36.242438 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-824b69bd-3f5f-48b4-8a85-9c77721318b3 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1452 microversion: 2.75 time: 0.421282 May 27 14:59:36.243902 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 368/754] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:35 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1452 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:36.455838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-597f735a-2e91-4c9a-b9a9-380fe01f8602 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1395480401", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:36.594375 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-597f735a-2e91-4c9a-b9a9-380fe01f8602 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] validate_networks() for None {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 14:59:36.644595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=18 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:37.468427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-597f735a-2e91-4c9a-b9a9-380fe01f8602 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:59:37.469231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-597f735a-2e91-4c9a-b9a9-380fe01f8602 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:59:37.469870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-597f735a-2e91-4c9a-b9a9-380fe01f8602 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:59:37.470447 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-597f735a-2e91-4c9a-b9a9-380fe01f8602 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:59:37.471054 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-597f735a-2e91-4c9a-b9a9-380fe01f8602 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:59:37.488285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-597f735a-2e91-4c9a-b9a9-380fe01f8602 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:37.488779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-597f735a-2e91-4c9a-b9a9-380fe01f8602 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:37.489599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-597f735a-2e91-4c9a-b9a9-380fe01f8602 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:37.490037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-597f735a-2e91-4c9a-b9a9-380fe01f8602 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:37.568251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-597f735a-2e91-4c9a-b9a9-380fe01f8602 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Getting quotas for project a96c20488f8745faafe3bf6830b22d68. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:59:37.596440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-597f735a-2e91-4c9a-b9a9-380fe01f8602 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Getting quotas for user f6927a180d7a4d1f85d0c2965e3d204f and project a96c20488f8745faafe3bf6830b22d68. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:59:37.616838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.utils [None req-597f735a-2e91-4c9a-b9a9-380fe01f8602 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] cores quota exceeded for a96c20488f8745faafe3bf6830b22d68, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119249) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 27 14:59:37.618409 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-597f735a-2e91-4c9a-b9a9-380fe01f8602 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-597f735a-2e91-4c9a-b9a9-380fe01f8602 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Request method failure captured: May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 145 May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOdUybrdrY75kkTr1fttGTJN-MWlnX2fhwOBrn5JhhVzIpCjurlJOOwX3unBGOsU_di6Euaau3G9vdA4_CCenNmlZUnoYXiFVk0ss7bpgaJsd2nosRL1KeFImgdWxl16KpuZju0kFDSPogFBjHJ6RzXi6tSIOY4PwYosmLnKcu6jiw0 May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: a96c20488f8745faafe3bf6830b22d68 May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-QuotasAdminNegativeTest-1681613513 May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 14:59:37.625574 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 14:59:37.626876 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a96c20488f8745faafe3bf6830b22d68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a96c20488f8745faafe3bf6830b22d68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a96c20488f8745faafe3bf6830b22d68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a96c20488f8745faafe3bf6830b22d68", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:59:37.626876 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-QuotasAdminNegativeTest-1681613513 May 27 14:59:37.626876 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: a96c20488f8745faafe3bf6830b22d68 May 27 14:59:37.626876 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1681613513 May 27 14:59:37.626876 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-QuotasAdminNegativeTest-1681613513-project May 27 14:59:37.626876 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 14:59:37.626876 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 14:59:37.626876 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: f6927a180d7a4d1f85d0c2965e3d204f May 27 14:59:37.626876 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-QuotasAdminNegativeTest-1681613513-project May 27 14:59:37.626876 n-d-843621-1 devstack@n-api.service[119249]: May 27 14:59:37.626876 n-d-843621-1 devstack@n-api.service[119249]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1395480401", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} May 27 14:59:37.626876 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 14:59:37.627602 n-d-843621-1 devstack@n-api.service[119249]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 27 14:59:37.627602 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1395480401', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452'}}} May 27 14:59:37.627602 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:59:37.627602 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:37.627602 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 27 14:59:37.627602 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 27 14:59:37.627602 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:59:37.627602 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:59:37.627602 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 27 14:59:37.627602 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc May 27 14:59:37.627602 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 27 14:59:37.627602 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 27 14:59:37.627602 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:59:37.627602 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:59:37.627602 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 27 14:59:37.627602 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 27 14:59:37.627602 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 27 14:59:37.627602 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._create_instance( May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:59:37.628892 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:59:37.630275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:37.632140 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:59:37.632140 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:59:37.632140 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:59:37.632140 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:59:37.632140 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 27 14:59:37.632140 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 14:59:37.637647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-597f735a-2e91-4c9a-b9a9-380fe01f8602 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:59:37.638816 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-597f735a-2e91-4c9a-b9a9-380fe01f8602 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.392741 May 27 14:59:37.643215 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 369/755] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:59:36 2022] POST /compute/v2.1/servers => generated 111 bytes in 1398 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:59:37.654706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6a68bcc5-98f6-4c67-acce-04c1737493c0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:37.657936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6a68bcc5-98f6-4c67-acce-04c1737493c0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:37.668858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6a68bcc5-98f6-4c67-acce-04c1737493c0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:37.669573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6a68bcc5-98f6-4c67-acce-04c1737493c0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:37.675803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6a68bcc5-98f6-4c67-acce-04c1737493c0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:37.677510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6a68bcc5-98f6-4c67-acce-04c1737493c0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:38.677163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6a68bcc5-98f6-4c67-acce-04c1737493c0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:38.689469 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6a68bcc5-98f6-4c67-acce-04c1737493c0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1474 microversion: 2.1 time: 1.044692 May 27 14:59:38.694338 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 370/756] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:37 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1474 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:38.709039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-08e85ccb-825d-496b-87fe-3ccd3ffe6568 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:38.712926 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-08e85ccb-825d-496b-87fe-3ccd3ffe6568 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:38.730408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08e85ccb-825d-496b-87fe-3ccd3ffe6568 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:38.730861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08e85ccb-825d-496b-87fe-3ccd3ffe6568 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:38.731651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08e85ccb-825d-496b-87fe-3ccd3ffe6568 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:38.732091 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08e85ccb-825d-496b-87fe-3ccd3ffe6568 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:38.905937 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-08e85ccb-825d-496b-87fe-3ccd3ffe6568 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:38.916293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-08e85ccb-825d-496b-87fe-3ccd3ffe6568 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:38.924659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-08e85ccb-825d-496b-87fe-3ccd3ffe6568 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:38.940081 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-08e85ccb-825d-496b-87fe-3ccd3ffe6568 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1437 microversion: 2.75 time: 0.244093 May 27 14:59:38.940702 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 371/757] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:38 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1437 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:38.946340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cc95f8b3-2520-491f-aac7-9dc9e3bc6cfa tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Action: 'update', calling method: .version_select at 0x7fc77c0311f0>, body: {"quota_set": {"cores": 20}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:39.242511 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d2d5c82e-3314-479a-93c1-d54c8fce392c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.267711 May 27 14:59:39.243230 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 387/758] 10.222.0.13 () {60 vars in 1169 bytes} [Fri May 27 14:59:34 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:39.248803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8b439051-e640-44ce-8931-f963f511c860 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:39.248803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8b439051-e640-44ce-8931-f963f511c860 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 4be00dd7-101a-436f-90e9-b8fcbd0cf00b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:39.274420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b439051-e640-44ce-8931-f963f511c860 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:39.279445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b439051-e640-44ce-8931-f963f511c860 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:39.286731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b439051-e640-44ce-8931-f963f511c860 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:39.287691 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b439051-e640-44ce-8931-f963f511c860 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:39.347456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc95f8b3-2520-491f-aac7-9dc9e3bc6cfa tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:39.351411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc95f8b3-2520-491f-aac7-9dc9e3bc6cfa tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:39.353344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc95f8b3-2520-491f-aac7-9dc9e3bc6cfa tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:39.356028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc95f8b3-2520-491f-aac7-9dc9e3bc6cfa tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:39.380401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8b439051-e640-44ce-8931-f963f511c860 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 4be00dd7-101a-436f-90e9-b8fcbd0cf00b] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 14:59:39.509923 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cc95f8b3-2520-491f-aac7-9dc9e3bc6cfa tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68" status: 200 len: 329 microversion: 2.1 time: 0.567824 May 27 14:59:39.510825 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 372/759] 10.222.0.13 () {60 vars in 1261 bytes} [Fri May 27 14:59:38 2022] PUT /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68 => generated 329 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:39.574403 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8b439051-e640-44ce-8931-f963f511c860 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b" status: 204 len: 0 microversion: 2.1 time: 0.329569 May 27 14:59:39.577765 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 388/760] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 14:59:39 2022] DELETE /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 14:59:39.601036 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cb0023f3-4003-465d-93f6-b4b18ceab0db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1512525301", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "2c791768-302b-4ee2-b186-40f52faf1f15"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:39.711129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-cb0023f3-4003-465d-93f6-b4b18ceab0db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] validate_networks() for [('2c791768-302b-4ee2-b186-40f52faf1f15', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 14:59:39.796156 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8a2ef0e3-ac79-4daf-a7dc-c6350a0280a5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "346e776e-8931-417f-87da-575810efb12b"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:39.797813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8a2ef0e3-ac79-4daf-a7dc-c6350a0280a5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:39.811130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a2ef0e3-ac79-4daf-a7dc-c6350a0280a5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:39.811586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a2ef0e3-ac79-4daf-a7dc-c6350a0280a5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:39.819567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a2ef0e3-ac79-4daf-a7dc-c6350a0280a5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:39.819567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a2ef0e3-ac79-4daf-a7dc-c6350a0280a5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:39.959205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-8a2ef0e3-ac79-4daf-a7dc-c6350a0280a5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:59:39.961187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-8a2ef0e3-ac79-4daf-a7dc-c6350a0280a5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:59:39.961859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-8a2ef0e3-ac79-4daf-a7dc-c6350a0280a5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:59:39.962460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-8a2ef0e3-ac79-4daf-a7dc-c6350a0280a5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:59:39.962877 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-8a2ef0e3-ac79-4daf-a7dc-c6350a0280a5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:59:40.134084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8a2ef0e3-ac79-4daf-a7dc-c6350a0280a5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:40.157533 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a2ef0e3-ac79-4daf-a7dc-c6350a0280a5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:40.158230 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a2ef0e3-ac79-4daf-a7dc-c6350a0280a5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:40.159254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a2ef0e3-ac79-4daf-a7dc-c6350a0280a5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:40.159840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a2ef0e3-ac79-4daf-a7dc-c6350a0280a5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:40.496640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-8a2ef0e3-ac79-4daf-a7dc-c6350a0280a5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lazy-loading 'services' on Instance uuid 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:59:40.499551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-cb0023f3-4003-465d-93f6-b4b18ceab0db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:59:40.500949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-cb0023f3-4003-465d-93f6-b4b18ceab0db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:59:40.501763 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-cb0023f3-4003-465d-93f6-b4b18ceab0db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:59:40.502406 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-cb0023f3-4003-465d-93f6-b4b18ceab0db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:59:40.503140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-cb0023f3-4003-465d-93f6-b4b18ceab0db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:59:40.519704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb0023f3-4003-465d-93f6-b4b18ceab0db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:40.520866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb0023f3-4003-465d-93f6-b4b18ceab0db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:40.522547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb0023f3-4003-465d-93f6-b4b18ceab0db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:40.523233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb0023f3-4003-465d-93f6-b4b18ceab0db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:40.543468 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8a2ef0e3-ac79-4daf-a7dc-c6350a0280a5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f/action" status: 202 len: 1940 microversion: 2.75 time: 1.022977 May 27 14:59:40.558169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-cb0023f3-4003-465d-93f6-b4b18ceab0db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Getting quotas for project 27d1e6c35bdd45a986acf3213f2a84bf. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:59:40.561015 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 373/761] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 27 14:59:39 2022] POST /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f/action => generated 1940 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 27 14:59:40.564504 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-cb0023f3-4003-465d-93f6-b4b18ceab0db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Getting quotas for user 7fd8811631894240aa46c7f87b3c8506 and project 27d1e6c35bdd45a986acf3213f2a84bf. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:59:40.576371 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6f76f1c1-31e4-4140-ac2b-f3be2214acbe tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Calling method '.version_select at 0x7fc776f3c5e0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:40.606121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cb0023f3-4003-465d-93f6-b4b18ceab0db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 14:59:40.610358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cb0023f3-4003-465d-93f6-b4b18ceab0db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 14:59:40.735455 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cb0023f3-4003-465d-93f6-b4b18ceab0db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.156101 May 27 14:59:40.738871 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 389/762] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:59:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 14:59:40.751103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-31af17f2-3494-4bbf-a4ab-67b183cf0831 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:40.754057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-31af17f2-3494-4bbf-a4ab-67b183cf0831 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:40.765726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-31af17f2-3494-4bbf-a4ab-67b183cf0831 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:40.766322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-31af17f2-3494-4bbf-a4ab-67b183cf0831 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:40.768029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-31af17f2-3494-4bbf-a4ab-67b183cf0831 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:40.768591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-31af17f2-3494-4bbf-a4ab-67b183cf0831 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:41.119525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-31af17f2-3494-4bbf-a4ab-67b183cf0831 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:41.137270 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-31af17f2-3494-4bbf-a4ab-67b183cf0831 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1474 microversion: 2.1 time: 0.396685 May 27 14:59:41.139073 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 390/763] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:40 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1474 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:41.144500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3fa89e7d-0389-4925-8c79-1e858af2db18 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1770247464", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "2059620199", "adminPass": "***", "networks": [{"uuid": "52754353-fb43-4bd4-bf34-848290b2913d"}], "security_groups": [{"name": "tempest-securitygroup--1571389468"}], "key_name": "tempest-keypair-1551296994", "user_data": "}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:41.216786 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6f76f1c1-31e4-4140-ac2b-f3be2214acbe tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68" status: 200 len: 371 microversion: 2.1 time: 0.654150 May 27 14:59:41.218272 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 374/764] 10.222.0.13 () {58 vars in 1241 bytes} [Fri May 27 14:59:40 2022] GET /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68 => generated 371 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:41.255205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e0fede50-646b-4416-99f9-0980cb5b252a tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:41.255834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e0fede50-646b-4416-99f9-0980cb5b252a tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:41.288613 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0fede50-646b-4416-99f9-0980cb5b252a tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:41.308228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0fede50-646b-4416-99f9-0980cb5b252a tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:41.310943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0fede50-646b-4416-99f9-0980cb5b252a tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:41.338615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0fede50-646b-4416-99f9-0980cb5b252a tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:41.449601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-3fa89e7d-0389-4925-8c79-1e858af2db18 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] validate_networks() for [('52754353-fb43-4bd4-bf34-848290b2913d', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 14:59:41.789833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-e0fede50-646b-4416-99f9-0980cb5b252a tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lazy-loading 'services' on Instance uuid 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:59:41.857026 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e0fede50-646b-4416-99f9-0980cb5b252a tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1927 microversion: 2.75 time: 0.620132 May 27 14:59:41.868983 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 375/765] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:41 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1927 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:41.880091 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8fa7c9bf-42d5-4c61-a388-8526e2685484 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:41.883661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8fa7c9bf-42d5-4c61-a388-8526e2685484 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:41.898770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8fa7c9bf-42d5-4c61-a388-8526e2685484 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:41.901051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8fa7c9bf-42d5-4c61-a388-8526e2685484 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:41.902458 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8fa7c9bf-42d5-4c61-a388-8526e2685484 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:41.907130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8fa7c9bf-42d5-4c61-a388-8526e2685484 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:42.277254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8fa7c9bf-42d5-4c61-a388-8526e2685484 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:42.286980 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8fa7c9bf-42d5-4c61-a388-8526e2685484 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5" status: 200 len: 1228 microversion: 2.1 time: 0.416488 May 27 14:59:42.299563 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 376/766] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:41 2022] GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5 => generated 1228 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:42.312371 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1eda1117-d05e-45d2-bb08-19b251d3842d tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Action: 'update', calling method: .version_select at 0x7fc776ede8b0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:42.629462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1eda1117-d05e-45d2-bb08-19b251d3842d tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:42.629921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1eda1117-d05e-45d2-bb08-19b251d3842d tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:42.630774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1eda1117-d05e-45d2-bb08-19b251d3842d tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:42.631848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1eda1117-d05e-45d2-bb08-19b251d3842d tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:42.719585 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3fa89e7d-0389-4925-8c79-1e858af2db18 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:59:42.720159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3fa89e7d-0389-4925-8c79-1e858af2db18 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:59:42.720802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3fa89e7d-0389-4925-8c79-1e858af2db18 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:59:42.723176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3fa89e7d-0389-4925-8c79-1e858af2db18 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:59:42.723859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3fa89e7d-0389-4925-8c79-1e858af2db18 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:59:42.752352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3fa89e7d-0389-4925-8c79-1e858af2db18 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:42.753514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3fa89e7d-0389-4925-8c79-1e858af2db18 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:42.755352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3fa89e7d-0389-4925-8c79-1e858af2db18 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:42.756816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3fa89e7d-0389-4925-8c79-1e858af2db18 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:42.830648 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-3fa89e7d-0389-4925-8c79-1e858af2db18 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Getting quotas for project 9da838f02f184e8d9040897b31dd7d75. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:59:42.849311 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-3fa89e7d-0389-4925-8c79-1e858af2db18 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Getting quotas for user 3e08df96180b4456a5f2bf09741f43b5 and project 9da838f02f184e8d9040897b31dd7d75. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:59:42.851484 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1eda1117-d05e-45d2-bb08-19b251d3842d tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68" status: 200 len: 328 microversion: 2.1 time: 0.550580 May 27 14:59:42.852141 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 377/767] 10.222.0.13 () {60 vars in 1261 bytes} [Fri May 27 14:59:42 2022] PUT /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68 => generated 328 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:42.887157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-de100274-382b-4351-b921-d1551c728c0a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5397e9d-d731-466e-9f50-90c6d6d68bcf", "device": "/dev/xvdb"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:42.895601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-de100274-382b-4351-b921-d1551c728c0a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:42.903639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3fa89e7d-0389-4925-8c79-1e858af2db18 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 14:59:42.910728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3fa89e7d-0389-4925-8c79-1e858af2db18 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 14:59:42.920667 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de100274-382b-4351-b921-d1551c728c0a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:42.922607 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de100274-382b-4351-b921-d1551c728c0a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:42.927482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de100274-382b-4351-b921-d1551c728c0a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:42.929753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de100274-382b-4351-b921-d1551c728c0a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:43.048139 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3fa89e7d-0389-4925-8c79-1e858af2db18 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.905780 May 27 14:59:43.049753 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 391/768] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:59:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 14:59:43.061715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0d6341a0-0b4c-45df-b147-1e6143b4c616 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:43.062731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0d6341a0-0b4c-45df-b147-1e6143b4c616 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:43.078789 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0d6341a0-0b4c-45df-b147-1e6143b4c616 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:43.079487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0d6341a0-0b4c-45df-b147-1e6143b4c616 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:43.080513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0d6341a0-0b4c-45df-b147-1e6143b4c616 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:43.085054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0d6341a0-0b4c-45df-b147-1e6143b4c616 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:43.945067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:44.004204 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-de100274-382b-4351-b921-d1551c728c0a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "POST /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.150747 May 27 14:59:44.033493 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 378/769] 10.222.0.13 () {62 vars in 1363 bytes} [Fri May 27 14:59:42 2022] POST /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 194 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 14:59:44.059071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8424843b-d15e-47e8-b04a-1c049fb4b1b5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:44.072762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8424843b-d15e-47e8-b04a-1c049fb4b1b5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:44.114472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8424843b-d15e-47e8-b04a-1c049fb4b1b5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:44.119503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8424843b-d15e-47e8-b04a-1c049fb4b1b5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:44.124507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8424843b-d15e-47e8-b04a-1c049fb4b1b5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:44.125559 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8424843b-d15e-47e8-b04a-1c049fb4b1b5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:44.632383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-8424843b-d15e-47e8-b04a-1c049fb4b1b5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lazy-loading 'services' on Instance uuid 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:59:44.782396 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8424843b-d15e-47e8-b04a-1c049fb4b1b5 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1927 microversion: 2.75 time: 0.744826 May 27 14:59:44.798579 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 379/770] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:44 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1927 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:44.813917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0d6341a0-0b4c-45df-b147-1e6143b4c616 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:44.835632 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0d6341a0-0b4c-45df-b147-1e6143b4c616 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1473 microversion: 2.1 time: 1.782398 May 27 14:59:44.838880 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 392/771] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:43 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1473 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:44.848119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-47555266-f07f-4331-bf57-2ef37947845b tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1803574772", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:44.850810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-db679e01-0c8d-435b-98fb-9c565cfd5e9f tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:44.851549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-db679e01-0c8d-435b-98fb-9c565cfd5e9f tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:44.898419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db679e01-0c8d-435b-98fb-9c565cfd5e9f tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:44.898880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db679e01-0c8d-435b-98fb-9c565cfd5e9f tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:44.909136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db679e01-0c8d-435b-98fb-9c565cfd5e9f tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:44.917184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db679e01-0c8d-435b-98fb-9c565cfd5e9f tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:45.013004 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-47555266-f07f-4331-bf57-2ef37947845b tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] validate_networks() for None {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 14:59:45.554200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-db679e01-0c8d-435b-98fb-9c565cfd5e9f tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:45.574758 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-db679e01-0c8d-435b-98fb-9c565cfd5e9f tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982" status: 200 len: 1269 microversion: 2.1 time: 0.765546 May 27 14:59:45.575768 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 380/772] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:44 2022] GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 => generated 1269 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:45.598161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-15a729ba-b576-469f-a262-610af281c665 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:45.599271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-15a729ba-b576-469f-a262-610af281c665 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:45.603144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:45.612593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15a729ba-b576-469f-a262-610af281c665 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:45.622870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15a729ba-b576-469f-a262-610af281c665 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:45.624024 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15a729ba-b576-469f-a262-610af281c665 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:45.628585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15a729ba-b576-469f-a262-610af281c665 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:47.056919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-47555266-f07f-4331-bf57-2ef37947845b tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:59:47.057933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-47555266-f07f-4331-bf57-2ef37947845b tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:59:47.058841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-47555266-f07f-4331-bf57-2ef37947845b tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:59:47.059408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-47555266-f07f-4331-bf57-2ef37947845b tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:59:47.060056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-47555266-f07f-4331-bf57-2ef37947845b tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:59:47.076528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47555266-f07f-4331-bf57-2ef37947845b tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:47.088358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47555266-f07f-4331-bf57-2ef37947845b tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:47.090697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47555266-f07f-4331-bf57-2ef37947845b tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:47.101211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47555266-f07f-4331-bf57-2ef37947845b tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:47.130382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-15a729ba-b576-469f-a262-610af281c665 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:47.151539 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-15a729ba-b576-469f-a262-610af281c665 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5" status: 200 len: 1324 microversion: 2.1 time: 1.573768 May 27 14:59:47.152589 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 381/773] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:45 2022] GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5 => generated 1324 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:47.160747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-47555266-f07f-4331-bf57-2ef37947845b tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Getting quotas for project a96c20488f8745faafe3bf6830b22d68. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:59:47.167088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:47.167365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-78c605d5-6c0a-4187-8f67-4e5be816eb48 req-e9f1789c-a7fd-406f-8035-5798910ed39f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be00dd7-101a-436f-90e9-b8fcbd0cf00b", "name": "network-vif-deleted", "tag": "13e3d81c-851f-40aa-8269-fa720646581f"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:47.184794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-47555266-f07f-4331-bf57-2ef37947845b tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Getting quotas for user f6927a180d7a4d1f85d0c2965e3d204f and project a96c20488f8745faafe3bf6830b22d68. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:59:47.208577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.utils [None req-47555266-f07f-4331-bf57-2ef37947845b tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] instances quota exceeded for a96c20488f8745faafe3bf6830b22d68, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119248) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 27 14:59:47.210401 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-47555266-f07f-4331-bf57-2ef37947845b tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-47555266-f07f-4331-bf57-2ef37947845b tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Request method failure captured: May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 145 May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOdUybrdrY75kkTr1fttGTJN-MWlnX2fhwOBrn5JhhVzIpCjurlJOOwX3unBGOsU_di6Euaau3G9vdA4_CCenNmlZUnoYXiFVk0ss7bpgaJsd2nosRL1KeFImgdWxl16KpuZju0kFDSPogFBjHJ6RzXi6tSIOY4PwYosmLnKcu6jiw0 May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: a96c20488f8745faafe3bf6830b22d68 May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-QuotasAdminNegativeTest-1681613513 May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:59:47.216016 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:59:47.217445 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a96c20488f8745faafe3bf6830b22d68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a96c20488f8745faafe3bf6830b22d68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a96c20488f8745faafe3bf6830b22d68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a96c20488f8745faafe3bf6830b22d68", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:59:47.217445 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-QuotasAdminNegativeTest-1681613513 May 27 14:59:47.217445 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: a96c20488f8745faafe3bf6830b22d68 May 27 14:59:47.217445 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1681613513 May 27 14:59:47.217445 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-QuotasAdminNegativeTest-1681613513-project May 27 14:59:47.217445 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:59:47.217445 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:59:47.217445 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: f6927a180d7a4d1f85d0c2965e3d204f May 27 14:59:47.217445 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-QuotasAdminNegativeTest-1681613513-project May 27 14:59:47.217445 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:59:47.217445 n-d-843621-1 devstack@n-api.service[119248]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1803574772", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} May 27 14:59:47.217445 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:59:47.218200 n-d-843621-1 devstack@n-api.service[119248]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 27 14:59:47.218200 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1803574772', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452'}}} May 27 14:59:47.218200 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:59:47.218200 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:47.218200 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 27 14:59:47.218200 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 27 14:59:47.218200 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:59:47.218200 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:59:47.218200 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 27 14:59:47.218200 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc May 27 14:59:47.218200 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 27 14:59:47.218200 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 27 14:59:47.218200 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:59:47.218200 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:59:47.218200 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 27 14:59:47.218200 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 27 14:59:47.218200 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 27 14:59:47.218200 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._create_instance( May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:59:47.219302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:47.220555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:47.221839 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:59:47.221839 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:59:47.221839 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:59:47.221839 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:59:47.221839 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 27 14:59:47.221839 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:47.228323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-78c605d5-6c0a-4187-8f67-4e5be816eb48 req-e9f1789c-a7fd-406f-8035-5798910ed39f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:47.230163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-78c605d5-6c0a-4187-8f67-4e5be816eb48 req-e9f1789c-a7fd-406f-8035-5798910ed39f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:47.230384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-47555266-f07f-4331-bf57-2ef37947845b tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:59:47.231502 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-47555266-f07f-4331-bf57-2ef37947845b tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 2.391122 May 27 14:59:47.236756 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 393/774] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:59:44 2022] POST /compute/v2.1/servers => generated 119 bytes in 2397 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:59:47.242640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-0633ea25-1b7f-46a0-9c6a-5a212535ab81 req-8811e890-7d48-430c-ac4d-5ffdb1268bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701f3802-4b28-473a-b3f1-5f2a43e1ebe7", "name": "network-vif-unplugged", "status": "completed", "tag": "d311ed01-b43c-4481-918e-786b3710c187"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:47.251951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0633ea25-1b7f-46a0-9c6a-5a212535ab81 req-8811e890-7d48-430c-ac4d-5ffdb1268bf9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:47.253275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0633ea25-1b7f-46a0-9c6a-5a212535ab81 req-8811e890-7d48-430c-ac4d-5ffdb1268bf9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:47.267409 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-0633ea25-1b7f-46a0-9c6a-5a212535ab81 req-8811e890-7d48-430c-ac4d-5ffdb1268bf9 service nova] Creating event network-vif-unplugged:d311ed01-b43c-4481-918e-786b3710c187 for instance 701f3802-4b28-473a-b3f1-5f2a43e1ebe7 on n-h2-843621-1 May 27 14:59:47.278481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [req-0633ea25-1b7f-46a0-9c6a-5a212535ab81 req-8811e890-7d48-430c-ac4d-5ffdb1268bf9 service nova] Instance 701f3802-4b28-473a-b3f1-5f2a43e1ebe7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119248) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 14:59:47.286688 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-78c605d5-6c0a-4187-8f67-4e5be816eb48 req-e9f1789c-a7fd-406f-8035-5798910ed39f service nova] Creating event network-vif-deleted:13e3d81c-851f-40aa-8269-fa720646581f for instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b on n-h2-843621-1 May 27 14:59:47.296434 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-0633ea25-1b7f-46a0-9c6a-5a212535ab81 req-8811e890-7d48-430c-ac4d-5ffdb1268bf9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057842 May 27 14:59:47.298028 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 394/775] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:47.304338 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-75a663c2-e08b-4ef3-9478-a426b3c69fca tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:47.305556 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-75a663c2-e08b-4ef3-9478-a426b3c69fca tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:47.306349 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-78c605d5-6c0a-4187-8f67-4e5be816eb48 req-e9f1789c-a7fd-406f-8035-5798910ed39f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152412 May 27 14:59:47.316102 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 382/776] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:47.317288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75a663c2-e08b-4ef3-9478-a426b3c69fca tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:47.317996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75a663c2-e08b-4ef3-9478-a426b3c69fca tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:47.319882 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75a663c2-e08b-4ef3-9478-a426b3c69fca tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:47.320563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75a663c2-e08b-4ef3-9478-a426b3c69fca tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:47.337534 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-629c6298-820f-4b61-9aa3-38c68fa7ac19 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:47.338582 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-629c6298-820f-4b61-9aa3-38c68fa7ac19 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:47.385284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-629c6298-820f-4b61-9aa3-38c68fa7ac19 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:47.385891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-629c6298-820f-4b61-9aa3-38c68fa7ac19 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:47.388875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-629c6298-820f-4b61-9aa3-38c68fa7ac19 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:47.389342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-629c6298-820f-4b61-9aa3-38c68fa7ac19 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:47.682773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-75a663c2-e08b-4ef3-9478-a426b3c69fca tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lazy-loading 'services' on Instance uuid 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:59:47.729722 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:47.764044 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-75a663c2-e08b-4ef3-9478-a426b3c69fca tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1927 microversion: 2.75 time: 0.461052 May 27 14:59:47.776291 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 395/777] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:47 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1927 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:47.782778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-29c3b320-7251-43bd-97d5-e8099dfd48bc tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:47.786089 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-29c3b320-7251-43bd-97d5-e8099dfd48bc tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:47.806288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29c3b320-7251-43bd-97d5-e8099dfd48bc tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:47.807511 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29c3b320-7251-43bd-97d5-e8099dfd48bc tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:47.810255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29c3b320-7251-43bd-97d5-e8099dfd48bc tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:47.810799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29c3b320-7251-43bd-97d5-e8099dfd48bc tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:48.159775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-29c3b320-7251-43bd-97d5-e8099dfd48bc tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:48.175837 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-29c3b320-7251-43bd-97d5-e8099dfd48bc tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982" status: 200 len: 1323 microversion: 2.1 time: 0.409351 May 27 14:59:48.181295 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 396/778] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:47 2022] GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 => generated 1323 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:48.193875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-36e1a090-aec7-414d-8aae-aef2d407cbf0 tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Action: 'update', calling method: .version_select at 0x7fc7773fcc10>, body: {"quota_set": {"instances": 10}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:48.201289 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-629c6298-820f-4b61-9aa3-38c68fa7ac19 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:48.213973 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-629c6298-820f-4b61-9aa3-38c68fa7ac19 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1473 microversion: 2.1 time: 0.896097 May 27 14:59:48.219107 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 383/779] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:47 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1473 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:48.243756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0de65896-8c2b-4c77-a747-b10751bcd9a5 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:48.246722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0de65896-8c2b-4c77-a747-b10751bcd9a5 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:48.288461 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0de65896-8c2b-4c77-a747-b10751bcd9a5 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:48.289404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0de65896-8c2b-4c77-a747-b10751bcd9a5 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:48.298386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0de65896-8c2b-4c77-a747-b10751bcd9a5 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:48.299381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0de65896-8c2b-4c77-a747-b10751bcd9a5 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:48.419972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-36e1a090-aec7-414d-8aae-aef2d407cbf0 tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:48.420728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-36e1a090-aec7-414d-8aae-aef2d407cbf0 tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:48.421785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-36e1a090-aec7-414d-8aae-aef2d407cbf0 tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:48.422438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-36e1a090-aec7-414d-8aae-aef2d407cbf0 tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:48.510591 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-36e1a090-aec7-414d-8aae-aef2d407cbf0 tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68" status: 200 len: 329 microversion: 2.1 time: 0.327780 May 27 14:59:48.512188 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 397/780] 10.222.0.13 () {60 vars in 1261 bytes} [Fri May 27 14:59:48 2022] PUT /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68 => generated 329 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:48.534386 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-65b1dfe3-7c49-4c32-874a-ccd2be20b643 tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Calling method '.version_select at 0x7fc776d4a280>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:48.641304 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-65b1dfe3-7c49-4c32-874a-ccd2be20b643 tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68" status: 200 len: 371 microversion: 2.1 time: 0.117258 May 27 14:59:48.661853 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 398/781] 10.222.0.13 () {58 vars in 1241 bytes} [Fri May 27 14:59:48 2022] GET /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68 => generated 371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:48.668328 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6f35e1ab-b265-4dc2-a091-90a68dd1ae0c tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Action: 'update', calling method: .version_select at 0x7fc77703bf70>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:48.812721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f35e1ab-b265-4dc2-a091-90a68dd1ae0c tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:48.813453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f35e1ab-b265-4dc2-a091-90a68dd1ae0c tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:48.816038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f35e1ab-b265-4dc2-a091-90a68dd1ae0c tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:48.818034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f35e1ab-b265-4dc2-a091-90a68dd1ae0c tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:48.973192 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6f35e1ab-b265-4dc2-a091-90a68dd1ae0c tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68" status: 200 len: 325 microversion: 2.1 time: 0.308612 May 27 14:59:48.985369 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 399/782] 10.222.0.13 () {60 vars in 1261 bytes} [Fri May 27 14:59:48 2022] PUT /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68 => generated 325 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:49.006994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3920da2e-450c-4939-9be2-0ed18d04aee8 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:49.014235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3920da2e-450c-4939-9be2-0ed18d04aee8 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:49.029505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3920da2e-450c-4939-9be2-0ed18d04aee8 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:49.029979 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3920da2e-450c-4939-9be2-0ed18d04aee8 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:49.030779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3920da2e-450c-4939-9be2-0ed18d04aee8 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:49.031229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3920da2e-450c-4939-9be2-0ed18d04aee8 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:49.341550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-3920da2e-450c-4939-9be2-0ed18d04aee8 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lazy-loading 'services' on Instance uuid 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:59:49.393567 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3920da2e-450c-4939-9be2-0ed18d04aee8 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1927 microversion: 2.75 time: 0.401509 May 27 14:59:49.395387 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 400/783] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:48 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1927 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:49.400289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7ea6fba5-54bb-4be4-a664-da72b8149dc0 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1215841979", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:49.525920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-7ea6fba5-54bb-4be4-a664-da72b8149dc0 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] validate_networks() for None {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 14:59:50.018482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0de65896-8c2b-4c77-a747-b10751bcd9a5 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:50.038632 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0de65896-8c2b-4c77-a747-b10751bcd9a5 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5" status: 200 len: 1324 microversion: 2.1 time: 1.805547 May 27 14:59:50.043940 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 384/784] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:48 2022] GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5 => generated 1324 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:50.076190 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0b83d521-f95a-4d47-8411-47abdc592160 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:50.090218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0b83d521-f95a-4d47-8411-47abdc592160 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:50.117519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b83d521-f95a-4d47-8411-47abdc592160 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:50.126973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b83d521-f95a-4d47-8411-47abdc592160 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:50.133259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b83d521-f95a-4d47-8411-47abdc592160 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:50.136715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b83d521-f95a-4d47-8411-47abdc592160 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:50.723216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-7ea6fba5-54bb-4be4-a664-da72b8149dc0 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 14:59:50.723686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-7ea6fba5-54bb-4be4-a664-da72b8149dc0 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 14:59:50.724116 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-7ea6fba5-54bb-4be4-a664-da72b8149dc0 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 14:59:50.724536 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-7ea6fba5-54bb-4be4-a664-da72b8149dc0 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 14:59:50.727708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-7ea6fba5-54bb-4be4-a664-da72b8149dc0 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 14:59:50.747214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7ea6fba5-54bb-4be4-a664-da72b8149dc0 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:50.747836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7ea6fba5-54bb-4be4-a664-da72b8149dc0 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:50.748656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7ea6fba5-54bb-4be4-a664-da72b8149dc0 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:50.749127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7ea6fba5-54bb-4be4-a664-da72b8149dc0 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:50.799185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-7ea6fba5-54bb-4be4-a664-da72b8149dc0 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Getting quotas for project a96c20488f8745faafe3bf6830b22d68. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 14:59:50.809753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-7ea6fba5-54bb-4be4-a664-da72b8149dc0 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Getting quotas for user f6927a180d7a4d1f85d0c2965e3d204f and project a96c20488f8745faafe3bf6830b22d68. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 14:59:50.846866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.utils [None req-7ea6fba5-54bb-4be4-a664-da72b8149dc0 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] ram quota exceeded for a96c20488f8745faafe3bf6830b22d68, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119248) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 27 14:59:50.858218 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-7ea6fba5-54bb-4be4-a664-da72b8149dc0 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7ea6fba5-54bb-4be4-a664-da72b8149dc0 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Request method failure captured: May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 145 May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOdUybrdrY75kkTr1fttGTJN-MWlnX2fhwOBrn5JhhVzIpCjurlJOOwX3unBGOsU_di6Euaau3G9vdA4_CCenNmlZUnoYXiFVk0ss7bpgaJsd2nosRL1KeFImgdWxl16KpuZju0kFDSPogFBjHJ6RzXi6tSIOY4PwYosmLnKcu6jiw0 May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: a96c20488f8745faafe3bf6830b22d68 May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-QuotasAdminNegativeTest-1681613513 May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:59:50.868629 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:59:50.870269 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a96c20488f8745faafe3bf6830b22d68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a96c20488f8745faafe3bf6830b22d68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a96c20488f8745faafe3bf6830b22d68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a96c20488f8745faafe3bf6830b22d68", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:59:50.870269 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-QuotasAdminNegativeTest-1681613513 May 27 14:59:50.870269 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: a96c20488f8745faafe3bf6830b22d68 May 27 14:59:50.870269 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1681613513 May 27 14:59:50.870269 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-QuotasAdminNegativeTest-1681613513-project May 27 14:59:50.870269 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:59:50.870269 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:59:50.870269 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: f6927a180d7a4d1f85d0c2965e3d204f May 27 14:59:50.870269 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-QuotasAdminNegativeTest-1681613513-project May 27 14:59:50.870269 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:59:50.870269 n-d-843621-1 devstack@n-api.service[119248]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1215841979", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} May 27 14:59:50.870269 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 14:59:50.871262 n-d-843621-1 devstack@n-api.service[119248]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 27 14:59:50.871262 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1215841979', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452'}}} May 27 14:59:50.871262 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:59:50.871262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:50.871262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 27 14:59:50.871262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 27 14:59:50.871262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:59:50.871262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:59:50.871262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 27 14:59:50.871262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc May 27 14:59:50.871262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 27 14:59:50.871262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 27 14:59:50.871262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 14:59:50.871262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 14:59:50.871262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 27 14:59:50.871262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 27 14:59:50.871262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 27 14:59:50.871262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._create_instance( May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:59:50.872528 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:50.874040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:50.875507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:59:50.875507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:59:50.875507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 14:59:50.875507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 14:59:50.875507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 27 14:59:50.875507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:50.875955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0b83d521-f95a-4d47-8411-47abdc592160 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:50.882401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7ea6fba5-54bb-4be4-a664-da72b8149dc0 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:59:50.883374 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7ea6fba5-54bb-4be4-a664-da72b8149dc0 tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.486757 May 27 14:59:50.883979 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 401/785] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 14:59:49 2022] POST /compute/v2.1/servers => generated 110 bytes in 1488 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:59:50.885689 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0b83d521-f95a-4d47-8411-47abdc592160 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982" status: 200 len: 1391 microversion: 2.1 time: 0.836175 May 27 14:59:50.886257 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 385/786] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:50 2022] GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 => generated 1391 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:50.903161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-17767c2f-d99e-474f-aa99-4b150cba9379 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:50.904063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-17767c2f-d99e-474f-aa99-4b150cba9379 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:50.910198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-68026642-0337-4ff1-9bee-4dc388f2d9a6 req-680bcffe-88cf-4b65-abfb-7bce722c7803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701f3802-4b28-473a-b3f1-5f2a43e1ebe7", "tag": "d311ed01-b43c-4481-918e-786b3710c187"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:50.917224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-17767c2f-d99e-474f-aa99-4b150cba9379 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:50.917890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-17767c2f-d99e-474f-aa99-4b150cba9379 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:50.918922 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-17767c2f-d99e-474f-aa99-4b150cba9379 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:50.919552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-17767c2f-d99e-474f-aa99-4b150cba9379 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:50.933696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-68026642-0337-4ff1-9bee-4dc388f2d9a6 req-680bcffe-88cf-4b65-abfb-7bce722c7803 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:50.934154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-68026642-0337-4ff1-9bee-4dc388f2d9a6 req-680bcffe-88cf-4b65-abfb-7bce722c7803 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:51.000017 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-68026642-0337-4ff1-9bee-4dc388f2d9a6 req-680bcffe-88cf-4b65-abfb-7bce722c7803 service nova] Creating event network-changed:d311ed01-b43c-4481-918e-786b3710c187 for instance 701f3802-4b28-473a-b3f1-5f2a43e1ebe7 on n-h2-843621-1 May 27 14:59:51.028060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [req-68026642-0337-4ff1-9bee-4dc388f2d9a6 req-680bcffe-88cf-4b65-abfb-7bce722c7803 service nova] Instance 701f3802-4b28-473a-b3f1-5f2a43e1ebe7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119249) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 14:59:51.056921 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-68026642-0337-4ff1-9bee-4dc388f2d9a6 req-680bcffe-88cf-4b65-abfb-7bce722c7803 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160588 May 27 14:59:51.060882 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 386/787] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:51.071287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-93fd638d-9f64-4b11-a6de-9114de7506eb req-2165ff33-17c1-4cae-92aa-23c5dac51cad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b37ac407-852e-4ffa-995b-114d7d74bed5", "tag": "e938d86e-65f4-4b40-9216-916175c13d97"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:51.096848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-93fd638d-9f64-4b11-a6de-9114de7506eb req-2165ff33-17c1-4cae-92aa-23c5dac51cad service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:51.097591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-93fd638d-9f64-4b11-a6de-9114de7506eb req-2165ff33-17c1-4cae-92aa-23c5dac51cad service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:51.129627 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-93fd638d-9f64-4b11-a6de-9114de7506eb req-2165ff33-17c1-4cae-92aa-23c5dac51cad service nova] Creating event network-changed:e938d86e-65f4-4b40-9216-916175c13d97 for instance b37ac407-852e-4ffa-995b-114d7d74bed5 on n-h1-843621-1 May 27 14:59:51.156981 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-93fd638d-9f64-4b11-a6de-9114de7506eb req-2165ff33-17c1-4cae-92aa-23c5dac51cad service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093771 May 27 14:59:51.158129 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 387/788] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:51.171028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fd37737f-5813-48cf-b7c2-dc3ffb960fb1 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:51.172205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fd37737f-5813-48cf-b7c2-dc3ffb960fb1 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:51.192583 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd37737f-5813-48cf-b7c2-dc3ffb960fb1 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:51.199767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd37737f-5813-48cf-b7c2-dc3ffb960fb1 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:51.201117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd37737f-5813-48cf-b7c2-dc3ffb960fb1 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:51.201942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd37737f-5813-48cf-b7c2-dc3ffb960fb1 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:51.471895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-fd37737f-5813-48cf-b7c2-dc3ffb960fb1 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lazy-loading 'services' on Instance uuid 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:59:51.526866 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fd37737f-5813-48cf-b7c2-dc3ffb960fb1 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1927 microversion: 2.75 time: 0.367222 May 27 14:59:51.537391 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 388/789] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:51 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1927 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:51.547945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a37a18ff-de6e-457b-af67-139e5c830660 tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Action: 'update', calling method: .version_select at 0x7fc776d7f040>, body: {"quota_set": {"ram": 51200}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:51.653644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-17767c2f-d99e-474f-aa99-4b150cba9379 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:51.669951 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-17767c2f-d99e-474f-aa99-4b150cba9379 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1473 microversion: 2.1 time: 0.777621 May 27 14:59:51.680176 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 402/790] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:50 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1473 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:51.693316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ad017895-15c3-46b4-8557-c6a09e435ac8 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:51.700588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ad017895-15c3-46b4-8557-c6a09e435ac8 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:51.713610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad017895-15c3-46b4-8557-c6a09e435ac8 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:51.714612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad017895-15c3-46b4-8557-c6a09e435ac8 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:51.716475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad017895-15c3-46b4-8557-c6a09e435ac8 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:51.717277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad017895-15c3-46b4-8557-c6a09e435ac8 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:51.719253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a37a18ff-de6e-457b-af67-139e5c830660 tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:51.720099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a37a18ff-de6e-457b-af67-139e5c830660 tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:51.722296 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a37a18ff-de6e-457b-af67-139e5c830660 tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:51.725450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a37a18ff-de6e-457b-af67-139e5c830660 tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:51.925715 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a37a18ff-de6e-457b-af67-139e5c830660 tempest-QuotasAdminNegativeTest-748756973 tempest-QuotasAdminNegativeTest-748756973-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68" status: 200 len: 329 microversion: 2.1 time: 0.386868 May 27 14:59:51.932497 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 389/791] 10.222.0.13 () {60 vars in 1261 bytes} [Fri May 27 14:59:51 2022] PUT /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68 => generated 329 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:51.955380 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2baa8501-199a-4d87-963b-a1566611bf16 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:51.956489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2baa8501-199a-4d87-963b-a1566611bf16 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:51.976210 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2baa8501-199a-4d87-963b-a1566611bf16 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:51.980594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2baa8501-199a-4d87-963b-a1566611bf16 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:51.982733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2baa8501-199a-4d87-963b-a1566611bf16 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:51.983410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2baa8501-199a-4d87-963b-a1566611bf16 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:52.369776 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ad017895-15c3-46b4-8557-c6a09e435ac8 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:52.383408 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ad017895-15c3-46b4-8557-c6a09e435ac8 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5" status: 200 len: 1324 microversion: 2.1 time: 0.701261 May 27 14:59:52.388403 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 403/792] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:51 2022] GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5 => generated 1324 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:52.398507 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d6c647c9-a410-4220-bb72-b0e76b43c08a tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Action: 'update', calling method: .version_select at 0x7fc776e8c3a0>, body: {"quota_set": {"ram": 0}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:52.410591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d6c647c9-a410-4220-bb72-b0e76b43c08a tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'f6927a180d7a4d1f85d0c2965e3d204f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a96c20488f8745faafe3bf6830b22d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d6c647c9-a410-4220-bb72-b0e76b43c08a tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Request method failure captured: May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: request: PUT /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68 HTTP/1.1 May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 25 May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOdUybrdrY75kkTr1fttGTJN-MWlnX2fhwOBrn5JhhVzIpCjurlJOOwX3unBGOsU_di6Euaau3G9vdA4_CCenNmlZUnoYXiFVk0ss7bpgaJsd2nosRL1KeFImgdWxl16KpuZju0kFDSPogFBjHJ6RzXi6tSIOY4PwYosmLnKcu6jiw0 May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: a96c20488f8745faafe3bf6830b22d68 May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-QuotasAdminNegativeTest-1681613513 May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 14:59:52.417156 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 14:59:52.418906 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a96c20488f8745faafe3bf6830b22d68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a96c20488f8745faafe3bf6830b22d68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a96c20488f8745faafe3bf6830b22d68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a96c20488f8745faafe3bf6830b22d68", "adminURL": "http://10.222.0.13:8080"}]}] May 27 14:59:52.418906 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-QuotasAdminNegativeTest-1681613513 May 27 14:59:52.418906 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: a96c20488f8745faafe3bf6830b22d68 May 27 14:59:52.418906 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1681613513 May 27 14:59:52.418906 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-QuotasAdminNegativeTest-1681613513-project May 27 14:59:52.418906 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 14:59:52.418906 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 14:59:52.418906 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: f6927a180d7a4d1f85d0c2965e3d204f May 27 14:59:52.418906 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-QuotasAdminNegativeTest-1681613513-project May 27 14:59:52.418906 n-d-843621-1 devstack@n-api.service[119248]: May 27 14:59:52.418906 n-d-843621-1 devstack@n-api.service[119248]: {"quota_set": {"ram": 0}} May 27 14:59:52.418906 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 14:59:52.418906 n-d-843621-1 devstack@n-api.service[119248]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 27 14:59:52.418906 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'a96c20488f8745faafe3bf6830b22d68', 'body': {'quota_set': {'ram': 0}}} May 27 14:59:52.419937 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 14:59:52.419937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:52.419937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:59:52.419937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:59:52.419937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 14:59:52.419937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 14:59:52.419937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 14:59:52.419937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 14:59:52.419937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 14:59:52.419937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 14:59:52.419937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 14:59:52.419937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:59:52.419937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update May 27 14:59:52.419937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) May 27 14:59:52.419937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 14:59:52.419937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:59:52.419937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 14:59:52.419937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 14:59:52.419937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update May 27 14:59:52.421389 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) May 27 14:59:52.421389 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 14:59:52.421389 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 14:59:52.421389 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 14:59:52.421389 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 14:59:52.421389 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 14:59:52.421389 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 14:59:52.421389 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 14:59:52.421389 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 14:59:52.421389 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 14:59:52.421389 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 14:59:52.421389 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 14:59:52.421389 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 14:59:52.421389 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 14:59:52.421389 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 14:59:52.421389 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 27 14:59:52.421389 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:52.421389 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 14:59:52.421389 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:52.421389 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 14:59:52.422855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 14:59:52.422855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 14:59:52.422855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 14:59:52.422855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 14:59:52.422855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 27 14:59:52.422855 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 14:59:52.424434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d6c647c9-a410-4220-bb72-b0e76b43c08a tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 14:59:52.437257 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d6c647c9-a410-4220-bb72-b0e76b43c08a tempest-QuotasAdminNegativeTest-1681613513 tempest-QuotasAdminNegativeTest-1681613513-project] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68" status: 403 len: 116 microversion: 2.1 time: 0.043365 May 27 14:59:52.437899 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 404/793] 10.222.0.13 () {60 vars in 1261 bytes} [Fri May 27 14:59:52 2022] PUT /compute/v2.1/os-quota-sets/a96c20488f8745faafe3bf6830b22d68 => generated 116 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 14:59:52.526995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2baa8501-199a-4d87-963b-a1566611bf16 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:52.542000 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2baa8501-199a-4d87-963b-a1566611bf16 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982" status: 200 len: 1391 microversion: 2.1 time: 0.607932 May 27 14:59:52.556407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a1070af8-5928-4196-a1c1-010ee0cc927f tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:52.557134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a1070af8-5928-4196-a1c1-010ee0cc927f tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:52.566589 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 390/794] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:51 2022] GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 => generated 1391 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:52.570513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a1070af8-5928-4196-a1c1-010ee0cc927f tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:52.570861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a1070af8-5928-4196-a1c1-010ee0cc927f tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:52.578731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a1070af8-5928-4196-a1c1-010ee0cc927f tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:52.579558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a1070af8-5928-4196-a1c1-010ee0cc927f tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:52.697551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-98dc09bf-94af-4235-a0c1-86c46503e8e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:52.698187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-98dc09bf-94af-4235-a0c1-86c46503e8e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:52.704754 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98dc09bf-94af-4235-a0c1-86c46503e8e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:52.705236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98dc09bf-94af-4235-a0c1-86c46503e8e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:52.706006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98dc09bf-94af-4235-a0c1-86c46503e8e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:52.706467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98dc09bf-94af-4235-a0c1-86c46503e8e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:53.172529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-a1070af8-5928-4196-a1c1-010ee0cc927f tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lazy-loading 'services' on Instance uuid 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:59:53.239642 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a1070af8-5928-4196-a1c1-010ee0cc927f tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1927 microversion: 2.75 time: 0.687346 May 27 14:59:53.252884 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 405/795] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:52 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1927 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:53.380089 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-46ad71fc-6456-490b-b65d-61380f30cdbb req-638ec78a-32f0-440f-b0d9-537ca8dea10d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f621b08-4026-4bbd-923b-43a8630f6982", "tag": "fa2c5e8d-6006-41d2-861b-d0543e539801"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:53.402729 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-46ad71fc-6456-490b-b65d-61380f30cdbb req-638ec78a-32f0-440f-b0d9-537ca8dea10d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:53.403184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-46ad71fc-6456-490b-b65d-61380f30cdbb req-638ec78a-32f0-440f-b0d9-537ca8dea10d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:53.425404 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-46ad71fc-6456-490b-b65d-61380f30cdbb req-638ec78a-32f0-440f-b0d9-537ca8dea10d service nova] Creating event network-changed:fa2c5e8d-6006-41d2-861b-d0543e539801 for instance 3f621b08-4026-4bbd-923b-43a8630f6982 on n-h2-843621-1 May 27 14:59:53.442809 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-46ad71fc-6456-490b-b65d-61380f30cdbb req-638ec78a-32f0-440f-b0d9-537ca8dea10d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108791 May 27 14:59:53.444591 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 406/796] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 14:59:53.451677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0144393a-bf25-4339-9f53-7f01b17bcf6b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:53.465799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0144393a-bf25-4339-9f53-7f01b17bcf6b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:53.484658 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0144393a-bf25-4339-9f53-7f01b17bcf6b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:53.484943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0144393a-bf25-4339-9f53-7f01b17bcf6b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:53.485779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0144393a-bf25-4339-9f53-7f01b17bcf6b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:53.486408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0144393a-bf25-4339-9f53-7f01b17bcf6b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:53.647711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-98dc09bf-94af-4235-a0c1-86c46503e8e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:53.656961 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-98dc09bf-94af-4235-a0c1-86c46503e8e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1471 microversion: 2.1 time: 0.963724 May 27 14:59:53.671369 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 391/797] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:52 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1471 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 14:59:53.677339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-29f1eae7-42c4-45dc-861f-a98f56e09928 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:53.678887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-29f1eae7-42c4-45dc-861f-a98f56e09928 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:53.698849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-29f1eae7-42c4-45dc-861f-a98f56e09928 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:53.699340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-29f1eae7-42c4-45dc-861f-a98f56e09928 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:53.700417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-29f1eae7-42c4-45dc-861f-a98f56e09928 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:53.701148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-29f1eae7-42c4-45dc-861f-a98f56e09928 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:54.231713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-29f1eae7-42c4-45dc-861f-a98f56e09928 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:54.248189 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-29f1eae7-42c4-45dc-861f-a98f56e09928 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982" status: 200 len: 1391 microversion: 2.1 time: 0.568636 May 27 14:59:54.249142 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 392/798] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:53 2022] GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 => generated 1391 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:54.250272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0144393a-bf25-4339-9f53-7f01b17bcf6b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:54.278952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-053def48-8af7-47ef-8df0-f2d140341f6b tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:54.279942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-053def48-8af7-47ef-8df0-f2d140341f6b tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:54.290196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-053def48-8af7-47ef-8df0-f2d140341f6b tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:54.291697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-053def48-8af7-47ef-8df0-f2d140341f6b tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:54.293861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-053def48-8af7-47ef-8df0-f2d140341f6b tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:54.295172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-053def48-8af7-47ef-8df0-f2d140341f6b tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:54.313434 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0144393a-bf25-4339-9f53-7f01b17bcf6b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5" status: 200 len: 1324 microversion: 2.1 time: 0.866363 May 27 14:59:54.314373 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 407/799] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:53 2022] GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5 => generated 1324 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:54.681253 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f7bf6719-3379-4c07-80cf-c9f900910924 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:54.682903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f7bf6719-3379-4c07-80cf-c9f900910924 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:54.704837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7bf6719-3379-4c07-80cf-c9f900910924 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:54.705788 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7bf6719-3379-4c07-80cf-c9f900910924 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:54.707144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7bf6719-3379-4c07-80cf-c9f900910924 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:54.709066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7bf6719-3379-4c07-80cf-c9f900910924 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:54.831092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-053def48-8af7-47ef-8df0-f2d140341f6b tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lazy-loading 'services' on Instance uuid 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:59:54.871773 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-053def48-8af7-47ef-8df0-f2d140341f6b tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1927 microversion: 2.75 time: 0.596675 May 27 14:59:54.872711 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 393/800] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:54 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1927 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 14:59:55.265775 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f61fe1f7-47ba-4fff-8326-b4a01c41de7c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:55.266410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f61fe1f7-47ba-4fff-8326-b4a01c41de7c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:55.280405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f61fe1f7-47ba-4fff-8326-b4a01c41de7c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:55.280906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f61fe1f7-47ba-4fff-8326-b4a01c41de7c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:55.281701 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f61fe1f7-47ba-4fff-8326-b4a01c41de7c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:55.282154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f61fe1f7-47ba-4fff-8326-b4a01c41de7c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:55.720730 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f7bf6719-3379-4c07-80cf-c9f900910924 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:55.736595 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f7bf6719-3379-4c07-80cf-c9f900910924 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1468 microversion: 2.1 time: 1.059997 May 27 14:59:55.741018 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 408/801] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:54 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1468 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:55.754295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e66af91a-ee7f-4cb1-9639-ddd299360ea6 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:55.757018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e66af91a-ee7f-4cb1-9639-ddd299360ea6 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:55.803675 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e66af91a-ee7f-4cb1-9639-ddd299360ea6 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:55.804142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e66af91a-ee7f-4cb1-9639-ddd299360ea6 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:55.805127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e66af91a-ee7f-4cb1-9639-ddd299360ea6 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:55.805579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e66af91a-ee7f-4cb1-9639-ddd299360ea6 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:56.389391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f61fe1f7-47ba-4fff-8326-b4a01c41de7c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:56.399607 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f61fe1f7-47ba-4fff-8326-b4a01c41de7c tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982" status: 200 len: 1391 microversion: 2.1 time: 1.137719 May 27 14:59:56.405364 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 394/802] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:55 2022] GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 => generated 1391 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:56.414357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-250ce241-9db9-446b-a52d-a7a353dba90b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:56.415124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-250ce241-9db9-446b-a52d-a7a353dba90b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:56.430528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-250ce241-9db9-446b-a52d-a7a353dba90b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:56.431304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-250ce241-9db9-446b-a52d-a7a353dba90b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:56.432281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-250ce241-9db9-446b-a52d-a7a353dba90b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:56.432943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-250ce241-9db9-446b-a52d-a7a353dba90b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:56.538114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:59:56.559843 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e66af91a-ee7f-4cb1-9639-ddd299360ea6 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:56.570617 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e66af91a-ee7f-4cb1-9639-ddd299360ea6 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5" status: 200 len: 1324 microversion: 2.1 time: 0.827737 May 27 14:59:56.573195 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 409/803] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:55 2022] GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5 => generated 1324 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:56.580654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-51977440-a465-43da-be4c-db08d0a8fc5d tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:56.588195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-51977440-a465-43da-be4c-db08d0a8fc5d tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:56.600303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51977440-a465-43da-be4c-db08d0a8fc5d tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:56.601027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51977440-a465-43da-be4c-db08d0a8fc5d tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:56.601997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51977440-a465-43da-be4c-db08d0a8fc5d tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:56.607183 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51977440-a465-43da-be4c-db08d0a8fc5d tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:56.627241 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-250ce241-9db9-446b-a52d-a7a353dba90b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "POST /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7/action" status: 204 len: 0 microversion: 2.1 time: 0.220435 May 27 14:59:56.648116 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 395/804] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 14:59:56 2022] POST /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7/action => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 14:59:56.684910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-890eaaf1-5655-4881-a315-6b8ee8deb1a0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:56.685898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-890eaaf1-5655-4881-a315-6b8ee8deb1a0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:56.709047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-890eaaf1-5655-4881-a315-6b8ee8deb1a0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:56.709516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-890eaaf1-5655-4881-a315-6b8ee8deb1a0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:56.710295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-890eaaf1-5655-4881-a315-6b8ee8deb1a0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:56.711173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-890eaaf1-5655-4881-a315-6b8ee8deb1a0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:56.762238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-51977440-a465-43da-be4c-db08d0a8fc5d tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lazy-loading 'services' on Instance uuid 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:59:56.793518 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-51977440-a465-43da-be4c-db08d0a8fc5d tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1927 microversion: 2.75 time: 0.219029 May 27 14:59:56.805214 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 410/805] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:56 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1927 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:57.076010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-890eaaf1-5655-4881-a315-6b8ee8deb1a0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:57.091563 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-890eaaf1-5655-4881-a315-6b8ee8deb1a0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1468 microversion: 2.1 time: 0.433008 May 27 14:59:57.092768 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 396/806] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:56 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1468 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:57.422789 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b07b5093-ca9e-41c8-8eee-bb4809d9eaca tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:57.423642 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b07b5093-ca9e-41c8-8eee-bb4809d9eaca tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:57.435718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b07b5093-ca9e-41c8-8eee-bb4809d9eaca tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:57.436170 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b07b5093-ca9e-41c8-8eee-bb4809d9eaca tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:57.453000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b07b5093-ca9e-41c8-8eee-bb4809d9eaca tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:57.453485 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b07b5093-ca9e-41c8-8eee-bb4809d9eaca tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:57.521929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-99d0a891-b01e-4d96-a93d-a3683125c4a8 req-757bf4f7-f277-4754-a724-aefd4321d255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701f3802-4b28-473a-b3f1-5f2a43e1ebe7", "name": "network-vif-plugged", "status": "completed", "tag": "d311ed01-b43c-4481-918e-786b3710c187"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 14:59:57.539843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-99d0a891-b01e-4d96-a93d-a3683125c4a8 req-757bf4f7-f277-4754-a724-aefd4321d255 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:57.540283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-99d0a891-b01e-4d96-a93d-a3683125c4a8 req-757bf4f7-f277-4754-a724-aefd4321d255 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:57.580981 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-99d0a891-b01e-4d96-a93d-a3683125c4a8 req-757bf4f7-f277-4754-a724-aefd4321d255 service nova] Creating event network-vif-plugged:d311ed01-b43c-4481-918e-786b3710c187 for instance 701f3802-4b28-473a-b3f1-5f2a43e1ebe7 on n-h2-843621-1 May 27 14:59:57.589835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [req-99d0a891-b01e-4d96-a93d-a3683125c4a8 req-757bf4f7-f277-4754-a724-aefd4321d255 service nova] Instance 701f3802-4b28-473a-b3f1-5f2a43e1ebe7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119249) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 14:59:57.604411 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-99d0a891-b01e-4d96-a93d-a3683125c4a8 req-757bf4f7-f277-4754-a724-aefd4321d255 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086442 May 27 14:59:57.605617 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 397/807] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 14:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:57.612072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-efead678-ad6a-43ce-9e6b-74f60f6f2f7c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:57.613029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-efead678-ad6a-43ce-9e6b-74f60f6f2f7c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:57.620535 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efead678-ad6a-43ce-9e6b-74f60f6f2f7c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:57.621301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efead678-ad6a-43ce-9e6b-74f60f6f2f7c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:57.622246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efead678-ad6a-43ce-9e6b-74f60f6f2f7c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:57.622861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efead678-ad6a-43ce-9e6b-74f60f6f2f7c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:58.755231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-efead678-ad6a-43ce-9e6b-74f60f6f2f7c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:58.763486 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-efead678-ad6a-43ce-9e6b-74f60f6f2f7c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5" status: 200 len: 1324 microversion: 2.1 time: 1.156470 May 27 14:59:58.769466 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 398/808] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:57 2022] GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5 => generated 1324 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:58.781248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3de140cb-28cb-4d1a-8bce-b8d0e1aae713 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:58.792467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3de140cb-28cb-4d1a-8bce-b8d0e1aae713 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:58.820565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3de140cb-28cb-4d1a-8bce-b8d0e1aae713 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:58.823690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3de140cb-28cb-4d1a-8bce-b8d0e1aae713 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:58.830319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3de140cb-28cb-4d1a-8bce-b8d0e1aae713 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:58.831023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3de140cb-28cb-4d1a-8bce-b8d0e1aae713 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:58.891843 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b07b5093-ca9e-41c8-8eee-bb4809d9eaca tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 14:59:58.906553 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b07b5093-ca9e-41c8-8eee-bb4809d9eaca tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982" status: 200 len: 1391 microversion: 2.1 time: 1.489385 May 27 14:59:58.913619 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 411/809] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:57 2022] GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 => generated 1391 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 14:59:58.951093 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6ffb7f3e-e06b-4e43-9fb4-4bac23491979 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:58.954625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6ffb7f3e-e06b-4e43-9fb4-4bac23491979 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:58.984847 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ffb7f3e-e06b-4e43-9fb4-4bac23491979 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:58.985311 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ffb7f3e-e06b-4e43-9fb4-4bac23491979 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:58.991347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ffb7f3e-e06b-4e43-9fb4-4bac23491979 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:58.992686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ffb7f3e-e06b-4e43-9fb4-4bac23491979 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:59.019848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-3de140cb-28cb-4d1a-8bce-b8d0e1aae713 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lazy-loading 'services' on Instance uuid 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 14:59:59.076723 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3de140cb-28cb-4d1a-8bce-b8d0e1aae713 tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1927 microversion: 2.75 time: 0.302639 May 27 14:59:59.087265 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 399/810] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 14:59:58 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1927 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 14:59:59.281186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0118c513-8106-4f2c-b401-53928ee61bd7 tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:59.282561 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:59:59.282561 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:59:59.284028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0118c513-8106-4f2c-b401-53928ee61bd7 tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:59.284484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0118c513-8106-4f2c-b401-53928ee61bd7 tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:59.285343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0118c513-8106-4f2c-b401-53928ee61bd7 tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:59.285785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0118c513-8106-4f2c-b401-53928ee61bd7 tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:59.337816 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0118c513-8106-4f2c-b401-53928ee61bd7 tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.238407 May 27 14:59:59.345103 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 400/811] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 14:59:59 2022] GET /compute/v2.1/os-services => generated 944 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:59.355880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b8984302-9cda-4305-86a9-13a55992c121 tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:59.358001 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:59:59.358001 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:59:59.364691 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8984302-9cda-4305-86a9-13a55992c121 tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:59.365013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8984302-9cda-4305-86a9-13a55992c121 tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:59.365858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8984302-9cda-4305-86a9-13a55992c121 tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:59.366310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8984302-9cda-4305-86a9-13a55992c121 tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:59.437291 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b8984302-9cda-4305-86a9-13a55992c121 tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=n-d-843621-1" status: 200 len: 578 microversion: 2.1 time: 0.086415 May 27 14:59:59.446475 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 401/812] 10.222.0.13 () {58 vars in 1171 bytes} [Fri May 27 14:59:59 2022] GET /compute/v2.1/os-services?host=n-d-843621-1 => generated 578 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:59.458093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f04f4f22-32c9-48e9-82a2-d3f7eb505a2a tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:59.468110 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:59:59.468110 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:59:59.473371 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f04f4f22-32c9-48e9-82a2-d3f7eb505a2a tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:59.473371 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f04f4f22-32c9-48e9-82a2-d3f7eb505a2a tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:59.476765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f04f4f22-32c9-48e9-82a2-d3f7eb505a2a tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:59.477189 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f04f4f22-32c9-48e9-82a2-d3f7eb505a2a tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:59.602582 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f04f4f22-32c9-48e9-82a2-d3f7eb505a2a tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.148918 May 27 14:59:59.611536 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 402/813] 10.222.0.13 () {58 vars in 1175 bytes} [Fri May 27 14:59:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 14:59:59.630001 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f19144b5-31fc-4a71-b61c-210219ae2113 tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:59.635201 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:59:59.635201 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 14:59:59.640857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f19144b5-31fc-4a71-b61c-210219ae2113 tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:59.641828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f19144b5-31fc-4a71-b61c-210219ae2113 tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:59.642803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f19144b5-31fc-4a71-b61c-210219ae2113 tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:59.645425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f19144b5-31fc-4a71-b61c-210219ae2113 tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:59.684464 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f19144b5-31fc-4a71-b61c-210219ae2113 tempest-ServicesAdminTestJSON-833977280 tempest-ServicesAdminTestJSON-833977280-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.071475 May 27 14:59:59.685642 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 403/814] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 14:59:59 2022] GET /compute/v2.1/os-services => generated 944 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 14:59:59.781624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-09c1442f-25f0-4c17-9492-02910e47580c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 14:59:59.782317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-09c1442f-25f0-4c17-9492-02910e47580c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 14:59:59.794838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09c1442f-25f0-4c17-9492-02910e47580c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:59.795297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09c1442f-25f0-4c17-9492-02910e47580c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 14:59:59.796266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09c1442f-25f0-4c17-9492-02910e47580c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 14:59:59.796729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09c1442f-25f0-4c17-9492-02910e47580c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:00.029054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6ffb7f3e-e06b-4e43-9fb4-4bac23491979 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:00.043413 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6ffb7f3e-e06b-4e43-9fb4-4bac23491979 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1468 microversion: 2.1 time: 1.127385 May 27 15:00:00.048252 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 412/815] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:58 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1468 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:00.059286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e483d136-3dcc-41a7-aaab-806a1c22dad4 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:00.063457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e483d136-3dcc-41a7-aaab-806a1c22dad4 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:00.079042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e483d136-3dcc-41a7-aaab-806a1c22dad4 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:00.081211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e483d136-3dcc-41a7-aaab-806a1c22dad4 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:00.082668 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e483d136-3dcc-41a7-aaab-806a1c22dad4 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:00.085259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e483d136-3dcc-41a7-aaab-806a1c22dad4 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:00.776090 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=16 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:00.828975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=52 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:00.888887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-09c1442f-25f0-4c17-9492-02910e47580c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:00.915840 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-09c1442f-25f0-4c17-9492-02910e47580c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5" status: 200 len: 1324 microversion: 2.1 time: 1.138496 May 27 15:00:00.925939 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 404/816] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 14:59:59 2022] GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5 => generated 1324 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:00.930851 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e2fac6bb-5bd0-4b93-aae8-d4f4547f9b8a tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:00.931466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e2fac6bb-5bd0-4b93-aae8-d4f4547f9b8a tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:00.985291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e2fac6bb-5bd0-4b93-aae8-d4f4547f9b8a tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:00.989707 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e2fac6bb-5bd0-4b93-aae8-d4f4547f9b8a tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:01.009195 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e2fac6bb-5bd0-4b93-aae8-d4f4547f9b8a tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:01.010028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e2fac6bb-5bd0-4b93-aae8-d4f4547f9b8a tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:01.297940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-e2fac6bb-5bd0-4b93-aae8-d4f4547f9b8a tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lazy-loading 'services' on Instance uuid 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:00:01.367425 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e2fac6bb-5bd0-4b93-aae8-d4f4547f9b8a tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1927 microversion: 2.75 time: 0.440294 May 27 15:00:01.380503 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 405/817] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:00 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1927 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:00:01.395047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9036abf3-2d6b-41c4-9fac-54a4cb367739 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:01.402609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9036abf3-2d6b-41c4-9fac-54a4cb367739 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:01.443023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9036abf3-2d6b-41c4-9fac-54a4cb367739 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:01.444274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9036abf3-2d6b-41c4-9fac-54a4cb367739 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:01.445609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9036abf3-2d6b-41c4-9fac-54a4cb367739 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:01.447734 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9036abf3-2d6b-41c4-9fac-54a4cb367739 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:01.582750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e483d136-3dcc-41a7-aaab-806a1c22dad4 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:01.601056 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e483d136-3dcc-41a7-aaab-806a1c22dad4 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982" status: 200 len: 1391 microversion: 2.1 time: 1.551259 May 27 15:00:01.602394 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 413/818] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:00 2022] GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 => generated 1391 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:01.612690 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-51bc5831-f349-49dd-965a-82a929ffa81c req-006bd384-58e0-4d60-be90-35ea496444ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b37ac407-852e-4ffa-995b-114d7d74bed5", "name": "network-vif-plugged", "status": "completed", "tag": "e938d86e-65f4-4b40-9216-916175c13d97"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:01.632338 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-51bc5831-f349-49dd-965a-82a929ffa81c req-006bd384-58e0-4d60-be90-35ea496444ce service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:01.632822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-51bc5831-f349-49dd-965a-82a929ffa81c req-006bd384-58e0-4d60-be90-35ea496444ce service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:01.665723 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-51bc5831-f349-49dd-965a-82a929ffa81c req-006bd384-58e0-4d60-be90-35ea496444ce service nova] Creating event network-vif-plugged:e938d86e-65f4-4b40-9216-916175c13d97 for instance b37ac407-852e-4ffa-995b-114d7d74bed5 on n-h1-843621-1 May 27 15:00:01.685707 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-51bc5831-f349-49dd-965a-82a929ffa81c req-006bd384-58e0-4d60-be90-35ea496444ce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081946 May 27 15:00:01.688251 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 414/819] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:01.903274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=32 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:01.935275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a082d8ea-bbff-4918-9c12-000a54a374e7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:01.936521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a082d8ea-bbff-4918-9c12-000a54a374e7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:01.951780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a082d8ea-bbff-4918-9c12-000a54a374e7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:01.952537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a082d8ea-bbff-4918-9c12-000a54a374e7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:01.955547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a082d8ea-bbff-4918-9c12-000a54a374e7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:01.956186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a082d8ea-bbff-4918-9c12-000a54a374e7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:01.994301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9036abf3-2d6b-41c4-9fac-54a4cb367739 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:02.003384 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9036abf3-2d6b-41c4-9fac-54a4cb367739 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1460 microversion: 2.1 time: 0.621334 May 27 15:00:02.011344 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 406/820] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:01 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1460 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:02.039906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fee246b3-3407-435c-9202-11eeaea4c392 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:02.040555 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fee246b3-3407-435c-9202-11eeaea4c392 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:02.062134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fee246b3-3407-435c-9202-11eeaea4c392 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:02.062962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fee246b3-3407-435c-9202-11eeaea4c392 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:02.064019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fee246b3-3407-435c-9202-11eeaea4c392 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:02.068093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fee246b3-3407-435c-9202-11eeaea4c392 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:02.420807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fee246b3-3407-435c-9202-11eeaea4c392 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:02.438029 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fee246b3-3407-435c-9202-11eeaea4c392 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1460 microversion: 2.1 time: 0.412076 May 27 15:00:02.451326 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 407/821] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:02 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1460 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:02.461688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d42218b7-ed34-416f-bb3f-a27d2300040c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:02.462622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d42218b7-ed34-416f-bb3f-a27d2300040c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:02.471203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a082d8ea-bbff-4918-9c12-000a54a374e7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:02.481148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d42218b7-ed34-416f-bb3f-a27d2300040c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:02.485499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d42218b7-ed34-416f-bb3f-a27d2300040c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:02.486458 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d42218b7-ed34-416f-bb3f-a27d2300040c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:02.493542 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a082d8ea-bbff-4918-9c12-000a54a374e7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5" status: 200 len: 1324 microversion: 2.1 time: 0.554091 May 27 15:00:02.494292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d42218b7-ed34-416f-bb3f-a27d2300040c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:02.496867 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 415/822] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:01 2022] GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5 => generated 1324 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:02.505073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-61df88ff-c2f0-45b4-a275-7435fb081b3f tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Calling method '.version_select at 0x7fc7775390d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:02.517949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-61df88ff-c2f0-45b4-a275-7435fb081b3f tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:02.518412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-61df88ff-c2f0-45b4-a275-7435fb081b3f tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:02.542541 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-61df88ff-c2f0-45b4-a275-7435fb081b3f tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.042143 May 27 15:00:02.546746 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 416/823] 10.222.0.13 () {58 vars in 1142 bytes} [Fri May 27 15:00:02 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:02.575783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-20e66763-4353-42df-ba75-dcc07a7d0f4d tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:02.588625 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-20e66763-4353-42df-ba75-dcc07a7d0f4d tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017841 May 27 15:00:02.595318 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 417/824] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 15:00:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:02.608834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bb86dc1f-8ea7-4bd2-a3d6-1c6e1234f6e6 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-996775872", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:02.610869 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:00:02.610869 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:00:02.647845 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bb86dc1f-8ea7-4bd2-a3d6-1c6e1234f6e6 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.046411 May 27 15:00:02.649097 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 418/825] 10.222.0.13 () {60 vars in 1145 bytes} [Fri May 27 15:00:02 2022] POST /compute/v2.1/flavors => generated 498 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:02.662855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0515077c-a2f7-450f-8abd-ed2c119be308 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:02.663770 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0515077c-a2f7-450f-8abd-ed2c119be308 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:02.675928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:02.679986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0515077c-a2f7-450f-8abd-ed2c119be308 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:02.680842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0515077c-a2f7-450f-8abd-ed2c119be308 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:02.684884 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0515077c-a2f7-450f-8abd-ed2c119be308 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:02.685697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0515077c-a2f7-450f-8abd-ed2c119be308 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:02.753236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:02.777056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-d42218b7-ed34-416f-bb3f-a27d2300040c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lazy-loading 'services' on Instance uuid 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:00:02.811185 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d42218b7-ed34-416f-bb3f-a27d2300040c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1927 microversion: 2.75 time: 0.358266 May 27 15:00:02.811864 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 408/826] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:02 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1927 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:00:02.818308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f2d4531d-a2ab-44b4-a396-88cf882218c5 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:02.828263 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f2d4531d-a2ab-44b4-a396-88cf882218c5 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013556 May 27 15:00:02.829151 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 409/827] 10.222.0.13 () {58 vars in 1181 bytes} [Fri May 27 15:00:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:00:03.040280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0515077c-a2f7-450f-8abd-ed2c119be308 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:03.051444 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0515077c-a2f7-450f-8abd-ed2c119be308 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982" status: 200 len: 1391 microversion: 2.1 time: 0.401091 May 27 15:00:03.055971 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 419/828] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:02 2022] GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 => generated 1391 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:03.088429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f8269285-982c-4c1b-bba1-cb52704ea90d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1619899417", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "5b9cd6b6-29e3-47b2-8b98-d98ca88503f4"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:03.187992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-f8269285-982c-4c1b-bba1-cb52704ea90d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] validate_networks() for None {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:00:03.514464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fdae6541-71dd-4706-82a5-6e12df8d29e9 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:03.515100 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fdae6541-71dd-4706-82a5-6e12df8d29e9 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:03.563878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fdae6541-71dd-4706-82a5-6e12df8d29e9 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:03.564601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fdae6541-71dd-4706-82a5-6e12df8d29e9 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:03.571813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fdae6541-71dd-4706-82a5-6e12df8d29e9 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:03.572571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fdae6541-71dd-4706-82a5-6e12df8d29e9 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:03.684645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f8269285-982c-4c1b-bba1-cb52704ea90d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:00:03.685269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f8269285-982c-4c1b-bba1-cb52704ea90d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:00:03.686092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f8269285-982c-4c1b-bba1-cb52704ea90d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:00:03.686676 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f8269285-982c-4c1b-bba1-cb52704ea90d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:00:03.687531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f8269285-982c-4c1b-bba1-cb52704ea90d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:00:03.727808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f8269285-982c-4c1b-bba1-cb52704ea90d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:03.728279 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f8269285-982c-4c1b-bba1-cb52704ea90d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:03.729161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f8269285-982c-4c1b-bba1-cb52704ea90d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:03.729615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f8269285-982c-4c1b-bba1-cb52704ea90d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:03.837866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-f8269285-982c-4c1b-bba1-cb52704ea90d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Getting quotas for project 7369228028774765965f3cf001f8806a. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:00:03.851320 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-f8269285-982c-4c1b-bba1-cb52704ea90d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Getting quotas for user a5a825c2385e490d81ddcbc2de76980d and project 7369228028774765965f3cf001f8806a. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:00:03.911747 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:03.934863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f8269285-982c-4c1b-bba1-cb52704ea90d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:00:03.945680 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f8269285-982c-4c1b-bba1-cb52704ea90d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:00:03.991468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fdae6541-71dd-4706-82a5-6e12df8d29e9 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:04.003016 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fdae6541-71dd-4706-82a5-6e12df8d29e9 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5" status: 200 len: 1324 microversion: 2.1 time: 0.494013 May 27 15:00:04.007687 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 420/829] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:03 2022] GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5 => generated 1324 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:04.015891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-4f5a2515-14dc-4819-b485-ae61a21e2280 req-f36789a8-a6f5-4a53-86fe-2848cece23d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f621b08-4026-4bbd-923b-43a8630f6982", "name": "network-vif-plugged", "status": "completed", "tag": "fa2c5e8d-6006-41d2-861b-d0543e539801"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:04.039801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-4f5a2515-14dc-4819-b485-ae61a21e2280 req-f36789a8-a6f5-4a53-86fe-2848cece23d0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:04.040817 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-4f5a2515-14dc-4819-b485-ae61a21e2280 req-f36789a8-a6f5-4a53-86fe-2848cece23d0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:04.068966 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-4f5a2515-14dc-4819-b485-ae61a21e2280 req-f36789a8-a6f5-4a53-86fe-2848cece23d0 service nova] Creating event network-vif-plugged:fa2c5e8d-6006-41d2-861b-d0543e539801 for instance 3f621b08-4026-4bbd-923b-43a8630f6982 on n-h2-843621-1 May 27 15:00:04.084611 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-4f5a2515-14dc-4819-b485-ae61a21e2280 req-f36789a8-a6f5-4a53-86fe-2848cece23d0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074903 May 27 15:00:04.089344 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 421/830] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:04.094750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-87272b2a-250f-4891-9a47-940f24c373aa tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:04.097614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-87272b2a-250f-4891-9a47-940f24c373aa tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:04.117117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87272b2a-250f-4891-9a47-940f24c373aa tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:04.117977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87272b2a-250f-4891-9a47-940f24c373aa tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:04.118978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87272b2a-250f-4891-9a47-940f24c373aa tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:04.120754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87272b2a-250f-4891-9a47-940f24c373aa tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:04.121280 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f8269285-982c-4c1b-bba1-cb52704ea90d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.040285 May 27 15:00:04.149039 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 410/831] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:00:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:00:04.359388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-87272b2a-250f-4891-9a47-940f24c373aa tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lazy-loading 'services' on Instance uuid 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:00:04.419586 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-87272b2a-250f-4891-9a47-940f24c373aa tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1927 microversion: 2.75 time: 0.328667 May 27 15:00:04.423012 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 422/832] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:04 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1927 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:00:04.434837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c72c78e0-3caa-41eb-9b42-4f28a8516d0a tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:04.437524 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c72c78e0-3caa-41eb-9b42-4f28a8516d0a tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:04.459927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c72c78e0-3caa-41eb-9b42-4f28a8516d0a tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:04.461251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c72c78e0-3caa-41eb-9b42-4f28a8516d0a tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:04.463019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c72c78e0-3caa-41eb-9b42-4f28a8516d0a tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:04.465577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c72c78e0-3caa-41eb-9b42-4f28a8516d0a tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:04.793635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4a550396-4778-4595-83ee-0ab01e86cd26 tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] Action: 'create', calling method: .version_select at 0x7fc776d9c9d0>, body: {"pool": null} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:05.115601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c72c78e0-3caa-41eb-9b42-4f28a8516d0a tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:05.127976 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c72c78e0-3caa-41eb-9b42-4f28a8516d0a tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982" status: 200 len: 1391 microversion: 2.1 time: 0.703176 May 27 15:00:05.139324 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 423/833] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:04 2022] GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 => generated 1391 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:05.145842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-08f06aa8-9244-4570-bc11-b88f58fe8676 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:05.147388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-08f06aa8-9244-4570-bc11-b88f58fe8676 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:05.156626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08f06aa8-9244-4570-bc11-b88f58fe8676 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:05.157892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08f06aa8-9244-4570-bc11-b88f58fe8676 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:05.160567 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08f06aa8-9244-4570-bc11-b88f58fe8676 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:05.161493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08f06aa8-9244-4570-bc11-b88f58fe8676 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:05.264633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-08f06aa8-9244-4570-bc11-b88f58fe8676 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:05.279260 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-08f06aa8-9244-4570-bc11-b88f58fe8676 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1283 microversion: 2.1 time: 0.138147 May 27 15:00:05.313423 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 424/834] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:05 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1283 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:05.325391 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d8150b59-4a77-47e5-a8b7-a56785b9493c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:05.326320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d8150b59-4a77-47e5-a8b7-a56785b9493c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:05.339194 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8150b59-4a77-47e5-a8b7-a56785b9493c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:05.344370 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8150b59-4a77-47e5-a8b7-a56785b9493c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:05.345516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8150b59-4a77-47e5-a8b7-a56785b9493c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:05.346139 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8150b59-4a77-47e5-a8b7-a56785b9493c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:05.792282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d8150b59-4a77-47e5-a8b7-a56785b9493c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:05.807487 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d8150b59-4a77-47e5-a8b7-a56785b9493c tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5" status: 200 len: 1520 microversion: 2.1 time: 0.492732 May 27 15:00:05.809508 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 425/835] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:05 2022] GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5 => generated 1520 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:06.124218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1480b6dd-a492-43f8-b9da-ce9ced5aae4d tempest-FlavorsV2NegativeTest-1917588803 tempest-FlavorsV2NegativeTest-1917588803-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:06.143217 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1480b6dd-a492-43f8-b9da-ce9ced5aae4d tempest-FlavorsV2NegativeTest-1917588803 tempest-FlavorsV2NegativeTest-1917588803-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.330748 May 27 15:00:06.164513 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 426/836] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 15:00:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:06.172924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d9c0acea-a901-4287-98f6-26b3be6b0b5c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:06.174017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d9c0acea-a901-4287-98f6-26b3be6b0b5c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:06.195664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d9c0acea-a901-4287-98f6-26b3be6b0b5c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:06.197832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d9c0acea-a901-4287-98f6-26b3be6b0b5c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:06.202497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d9c0acea-a901-4287-98f6-26b3be6b0b5c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:06.203730 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d9c0acea-a901-4287-98f6-26b3be6b0b5c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:06.326129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-d9c0acea-a901-4287-98f6-26b3be6b0b5c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lazy-loading 'services' on Instance uuid 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:00:06.380426 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d9c0acea-a901-4287-98f6-26b3be6b0b5c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1927 microversion: 2.75 time: 0.201078 May 27 15:00:06.385125 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 427/837] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:06 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1927 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:00:06.404107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7c93a01f-4f39-4364-9724-f603c2c8abf7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Action: 'action', calling method: .version_select at 0x7fc77d72f5e0>, body: {"addFloatingIp": {"address": "172.25.2.41"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:06.405618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7c93a01f-4f39-4364-9724-f603c2c8abf7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:06.420380 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c93a01f-4f39-4364-9724-f603c2c8abf7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:06.420842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c93a01f-4f39-4364-9724-f603c2c8abf7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:06.421668 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c93a01f-4f39-4364-9724-f603c2c8abf7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:06.422126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c93a01f-4f39-4364-9724-f603c2c8abf7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:06.660277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c93a01f-4f39-4364-9724-f603c2c8abf7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Acquired lock "refresh_cache-da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" {{(pid=119248) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 15:00:08.659523 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4a550396-4778-4595-83ee-0ab01e86cd26 tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.508992 May 27 15:00:08.661005 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 411/838] 10.222.0.13 () {60 vars in 1169 bytes} [Fri May 27 15:00:04 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:08.666979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7964096b-679c-4ee0-a714-f91b11ea5b7e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:08.668796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7964096b-679c-4ee0-a714-f91b11ea5b7e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:08.682334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7964096b-679c-4ee0-a714-f91b11ea5b7e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:08.683322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7964096b-679c-4ee0-a714-f91b11ea5b7e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:08.687392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7964096b-679c-4ee0-a714-f91b11ea5b7e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:08.688084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7964096b-679c-4ee0-a714-f91b11ea5b7e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:09.221096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7964096b-679c-4ee0-a714-f91b11ea5b7e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:09.232071 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7964096b-679c-4ee0-a714-f91b11ea5b7e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982" status: 200 len: 1589 microversion: 2.1 time: 0.569835 May 27 15:00:09.233332 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 412/839] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:08 2022] GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 => generated 1589 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:09.241302 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-670f2bc6-d3b7-41b5-a8d6-d02aa4fd0077 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:09.242237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-670f2bc6-d3b7-41b5-a8d6-d02aa4fd0077 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:09.250022 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-670f2bc6-d3b7-41b5-a8d6-d02aa4fd0077 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:09.250479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-670f2bc6-d3b7-41b5-a8d6-d02aa4fd0077 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:09.251457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-670f2bc6-d3b7-41b5-a8d6-d02aa4fd0077 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:09.252013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-670f2bc6-d3b7-41b5-a8d6-d02aa4fd0077 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:09.383497 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-670f2bc6-d3b7-41b5-a8d6-d02aa4fd0077 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:09.392122 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-670f2bc6-d3b7-41b5-a8d6-d02aa4fd0077 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1337 microversion: 2.1 time: 0.157582 May 27 15:00:09.402768 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 413/840] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:09 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1337 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:09.408198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-84f72b86-76ac-42f9-9596-b6e3b308690d tempest-FlavorsV2NegativeTest-1917588803 tempest-FlavorsV2NegativeTest-1917588803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-272594017", "imageRef": "c48ef557-0fca-4c89-bd90-c9121e67ee35", "flavorRef": "452"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:09.462915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-84f72b86-76ac-42f9-9596-b6e3b308690d tempest-FlavorsV2NegativeTest-1917588803 tempest-FlavorsV2NegativeTest-1917588803-project] validate_networks() for None {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:00:10.247035 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-84f72b86-76ac-42f9-9596-b6e3b308690d tempest-FlavorsV2NegativeTest-1917588803 tempest-FlavorsV2NegativeTest-1917588803-project] HTTP exception thrown: Flavor's memory is too small for requested image. May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-84f72b86-76ac-42f9-9596-b6e3b308690d tempest-FlavorsV2NegativeTest-1917588803 tempest-FlavorsV2NegativeTest-1917588803-project] Request method failure captured: May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 142 May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOd0KvFrmlHY-ik9GMwpOlusLFiZkyf9OnKD_EPjokZMnGLVM4dkKF1ZkEo_Vhr0yjXt0Bx_hbdG_JnV7S-v5zjyAAXi3kCvUoz9XzQhNmSZg41EUl1M0ZVjsaBqOV8JWinOq-FVoScGLahPUTeNqj7cgZTCXBKV8NGVTiHb_z25Ngk May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: a85aef51d7af4375826f6fc26401e02c May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-FlavorsV2NegativeTest-1917588803 May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:00:10.251589 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:00:10.253759 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a85aef51d7af4375826f6fc26401e02c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a85aef51d7af4375826f6fc26401e02c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a85aef51d7af4375826f6fc26401e02c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a85aef51d7af4375826f6fc26401e02c", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:00:10.253759 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-FlavorsV2NegativeTest-1917588803 May 27 15:00:10.253759 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: a85aef51d7af4375826f6fc26401e02c May 27 15:00:10.253759 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1917588803 May 27 15:00:10.253759 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-FlavorsV2NegativeTest-1917588803-project May 27 15:00:10.253759 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:00:10.253759 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:00:10.253759 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 3504b936867d46bd99cc22df804661c8 May 27 15:00:10.253759 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-FlavorsV2NegativeTest-1917588803-project May 27 15:00:10.253759 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:00:10.253759 n-d-843621-1 devstack@n-api.service[119249]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-272594017", "imageRef": "c48ef557-0fca-4c89-bd90-c9121e67ee35", "flavorRef": "452"}} May 27 15:00:10.253759 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:00:10.253759 n-d-843621-1 devstack@n-api.service[119249]: exception: Flavor's memory is too small for requested image. May 27 15:00:10.254604 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-272594017', 'imageRef': 'c48ef557-0fca-4c89-bd90-c9121e67ee35', 'flavorRef': '452'}}} May 27 15:00:10.254604 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:00:10.254604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:10.254604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 27 15:00:10.254604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 27 15:00:10.254604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 27 15:00:10.254604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._create_instance( May 27 15:00:10.254604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance May 27 15:00:10.254604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, May 27 15:00:10.254604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild May 27 15:00:10.254604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, May 27 15:00:10.254604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image May 27 15:00:10.254604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( May 27 15:00:10.254604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus May 27 15:00:10.254604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() May 27 15:00:10.254604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. May 27 15:00:10.254604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:10.254604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:10.254604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:10.255975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:10.258728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:10.258728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:10.258728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:00:10.258728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:00:10.258728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. May 27 15:00:10.258728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:10.258728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-84f72b86-76ac-42f9-9596-b6e3b308690d tempest-FlavorsV2NegativeTest-1917588803 tempest-FlavorsV2NegativeTest-1917588803-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:00:10.258728 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-84f72b86-76ac-42f9-9596-b6e3b308690d tempest-FlavorsV2NegativeTest-1917588803 tempest-FlavorsV2NegativeTest-1917588803-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.849527 May 27 15:00:10.258728 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 414/841] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:00:09 2022] POST /compute/v2.1/servers => generated 93 bytes in 851 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 27 15:00:10.278450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-978a1cc6-17ef-4fe8-ae28-ac56dec1f7ef tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:10.279349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-978a1cc6-17ef-4fe8-ae28-ac56dec1f7ef tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:10.294453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-978a1cc6-17ef-4fe8-ae28-ac56dec1f7ef tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:10.295102 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-978a1cc6-17ef-4fe8-ae28-ac56dec1f7ef tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:10.298190 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-978a1cc6-17ef-4fe8-ae28-ac56dec1f7ef tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:10.298939 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-978a1cc6-17ef-4fe8-ae28-ac56dec1f7ef tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:10.617263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-978a1cc6-17ef-4fe8-ae28-ac56dec1f7ef tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lazy-loading 'services' on Instance uuid 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:00:10.647197 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-978a1cc6-17ef-4fe8-ae28-ac56dec1f7ef tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1933 microversion: 2.75 time: 0.390734 May 27 15:00:10.648478 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 415/842] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:10 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1933 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:00:10.665981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e0f28b47-2b60-4199-9629-2dc16509aeb1 tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] Action: 'create', calling method: .version_select at 0x7fc7771dbaf0>, body: {"pool": null} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:11.295026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-7c93a01f-4f39-4364-9724-f603c2c8abf7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Building network info cache for instance {{(pid=119248) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 27 15:00:13.071516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-7c93a01f-4f39-4364-9724-f603c2c8abf7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Updating instance_info_cache with network_info: [{"id": "77a08a17-7b75-4c05-a064-2f80d2e429a8", "address": "fa:16:3e:72:ff:a4", "network": {"id": "2c791768-302b-4ee2-b186-40f52faf1f15", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1339072895-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "27d1e6c35bdd45a986acf3213f2a84bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap77a08a17-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119248) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 27 15:00:13.087920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c93a01f-4f39-4364-9724-f603c2c8abf7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Releasing lock "refresh_cache-da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" {{(pid=119248) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 15:00:13.088962 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7c93a01f-4f39-4364-9724-f603c2c8abf7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "POST /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa/action" status: 202 len: 0 microversion: 2.1 time: 6.702773 May 27 15:00:13.089745 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 428/843] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:00:06 2022] POST /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa/action => generated 0 bytes in 6704 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 27 15:00:13.098310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-433fe8e6-dbbe-4ccb-be41-76d91b7a8840 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:13.098832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-433fe8e6-dbbe-4ccb-be41-76d91b7a8840 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:13.107008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-433fe8e6-dbbe-4ccb-be41-76d91b7a8840 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:13.107460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-433fe8e6-dbbe-4ccb-be41-76d91b7a8840 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:13.108239 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-433fe8e6-dbbe-4ccb-be41-76d91b7a8840 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:13.108751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-433fe8e6-dbbe-4ccb-be41-76d91b7a8840 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:13.250867 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-433fe8e6-dbbe-4ccb-be41-76d91b7a8840 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160131 May 27 15:00:13.251674 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 429/844] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 15:00:13 2022] GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:13.256502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-38c00e71-5499-46b4-9fa6-1b3c1ddad5f3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:13.257420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-38c00e71-5499-46b4-9fa6-1b3c1ddad5f3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:13.265011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-38c00e71-5499-46b4-9fa6-1b3c1ddad5f3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:13.265475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-38c00e71-5499-46b4-9fa6-1b3c1ddad5f3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:13.266263 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-38c00e71-5499-46b4-9fa6-1b3c1ddad5f3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:13.266771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-38c00e71-5499-46b4-9fa6-1b3c1ddad5f3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:13.736768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-38c00e71-5499-46b4-9fa6-1b3c1ddad5f3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:13.744832 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-38c00e71-5499-46b4-9fa6-1b3c1ddad5f3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1379 microversion: 2.1 time: 0.491970 May 27 15:00:13.745513 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 430/845] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:13 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1379 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:13.750145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-fd18eb74-f961-4149-93e3-0c1d2bf65613 req-4d751116-be67-419a-8bd7-a247b9c38ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da2c6d0b-b6e3-43a9-870b-6f7493b08dfa", "tag": "77a08a17-7b75-4c05-a064-2f80d2e429a8"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:13.759687 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-fd18eb74-f961-4149-93e3-0c1d2bf65613 req-4d751116-be67-419a-8bd7-a247b9c38ff4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:13.760133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-fd18eb74-f961-4149-93e3-0c1d2bf65613 req-4d751116-be67-419a-8bd7-a247b9c38ff4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:13.771719 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-fd18eb74-f961-4149-93e3-0c1d2bf65613 req-4d751116-be67-419a-8bd7-a247b9c38ff4 service nova] Creating event network-changed:77a08a17-7b75-4c05-a064-2f80d2e429a8 for instance da2c6d0b-b6e3-43a9-870b-6f7493b08dfa on n-h2-843621-1 May 27 15:00:13.776765 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-fd18eb74-f961-4149-93e3-0c1d2bf65613 req-4d751116-be67-419a-8bd7-a247b9c38ff4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030218 May 27 15:00:13.777648 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 431/846] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:13.780951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=18 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:13.897986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:13.967600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c01aa7cf-385c-4a18-b420-39f9df37d55b tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Action: 'create', calling method: .version_select at 0x7fc776cdcca0>, body: {"keypair": {"name": "tempest-keypair-1420042190", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN21WZ1Ni4N0NglqS1mzV/lYsqFMp9RAg1eaF0lWPeThI4ktxQ/WbtLtjCvGg0JNCtjt1LcJQNlLueFucR7TAUFUTm23S6kUmU5waF7PTe3nvMbuAHOap++5NXlG77hsFg=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:13.982561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-c01aa7cf-385c-4a18-b420-39f9df37d55b tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Getting quotas for project ea3ff9fdd7364a82ad3ed271a33da615. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:00:13.989148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-c01aa7cf-385c-4a18-b420-39f9df37d55b tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Getting quotas for user 590be802bea346fc9240befaae60ec9e and project ea3ff9fdd7364a82ad3ed271a33da615. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:00:14.015326 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c01aa7cf-385c-4a18-b420-39f9df37d55b tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.236496 May 27 15:00:14.015965 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 432/847] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:00:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:14.020422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e08f9d62-c17c-4b10-bf81-e775a9d7079c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:14.021369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e08f9d62-c17c-4b10-bf81-e775a9d7079c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:14.027696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e08f9d62-c17c-4b10-bf81-e775a9d7079c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:14.028150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e08f9d62-c17c-4b10-bf81-e775a9d7079c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:14.028989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e08f9d62-c17c-4b10-bf81-e775a9d7079c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:14.029423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e08f9d62-c17c-4b10-bf81-e775a9d7079c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:14.135270 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e0f28b47-2b60-4199-9629-2dc16509aeb1 tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.485315 May 27 15:00:14.136614 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 416/848] 10.222.0.13 () {60 vars in 1169 bytes} [Fri May 27 15:00:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:14.165901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-e08f9d62-c17c-4b10-bf81-e775a9d7079c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] Lazy-loading 'services' on Instance uuid 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:00:14.199692 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e08f9d62-c17c-4b10-bf81-e775a9d7079c tempest-ServersAdmin275Test-1225418939 tempest-ServersAdmin275Test-1225418939-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1918 microversion: 2.75 time: 0.182662 May 27 15:00:14.200963 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 433/849] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:14 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1918 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:00:14.219812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-99930f75-7758-43d7-ae89-b55da5601cb8 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Action: 'create', calling method: .version_select at 0x7fc776ede9d0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAti2bbwUx7Ab7ESwoq8pkgAI8vbaHujnCMyfyoVYhKD5lVSysh+5oMyLJ/T7WJZ6VJx1G/1mVryZKXe4ZvNMUkZAq2ZzQIJXAx6LymnADE3TAPFM5Zy8vy3XMtda/5BsA=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:14.220640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-182d75ed-abe5-41b2-88f6-decdfd5851db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.41"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:14.223269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-182d75ed-abe5-41b2-88f6-decdfd5851db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:14.227478 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-99930f75-7758-43d7-ae89-b55da5601cb8 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-99930f75-7758-43d7-ae89-b55da5601cb8 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Request method failure captured: May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 257 May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOd83QABh5awPtrXreYea-zAh7CyofBxfSAEWZDK-nBEeySvlDlMF8w3XXg3CiBS2msD9mWWUNyN6ixeeqKVHP1xxbySzEhXuU7WgEOMJQybaVnb6oJU4HlWTvFztMM2wmWbHasMEXjlMIFMDg59ikJcgtdBTk0NMxdGKenSP3ycmiY May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 4b6c6d7dd53844a48a9994286a6d75f2 May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:00:14.230026 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:00:14.231525 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4b6c6d7dd53844a48a9994286a6d75f2", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:00:14.231525 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:14.231525 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 4b6c6d7dd53844a48a9994286a6d75f2 May 27 15:00:14.231525 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:14.231525 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-KeyPairsNegativeTestJSON-1541294451-project May 27 15:00:14.231525 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:00:14.231525 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:00:14.231525 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: da5e5fb6980a4d1192433dc394657527 May 27 15:00:14.231525 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1541294451-project May 27 15:00:14.231525 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:00:14.231525 n-d-843621-1 devstack@n-api.service[119249]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAti2bbwUx7Ab7ESwoq8pkgAI8vbaHujnCMyfyoVYhKD5lVSysh+5oMyLJ/T7WJZ6VJx1G/1mVryZKXe4ZvNMUkZAq2ZzQIJXAx6LymnADE3TAPFM5Zy8vy3XMtda/5BsA=="}} May 27 15:00:14.231525 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:00:14.232440 n-d-843621-1 devstack@n-api.service[119249]: exception: Keypair data is invalid: Keypair name contains unsafe characters May 27 15:00:14.232440 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAti2bbwUx7Ab7ESwoq8pkgAI8vbaHujnCMyfyoVYhKD5lVSysh+5oMyLJ/T7WJZ6VJx1G/1mVryZKXe4ZvNMUkZAq2ZzQIJXAx6LymnADE3TAPFM5Zy8vy3XMtda/5BsA=='}}} May 27 15:00:14.232440 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:00:14.232440 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:14.232440 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 27 15:00:14.232440 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 27 15:00:14.232440 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 27 15:00:14.232440 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 27 15:00:14.232440 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 15:00:14.232440 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 15:00:14.232440 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 15:00:14.232440 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise self.value May 27 15:00:14.232440 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 27 15:00:14.232440 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 27 15:00:14.232440 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair May 27 15:00:14.232440 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) May 27 15:00:14.232440 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair May 27 15:00:14.232440 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 27 15:00:14.233933 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters May 27 15:00:14.233933 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:14.233933 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:14.233933 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:14.233933 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:14.233933 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:14.233933 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:14.233933 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:00:14.233933 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:00:14.233933 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:00:14.233933 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:00:14.233933 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:00:14.233933 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:00:14.233933 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:00:14.233933 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:00:14.233933 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:00:14.233933 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:00:14.233933 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 27 15:00:14.233933 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 27 15:00:14.233933 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 27 15:00:14.235359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 27 15:00:14.235359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters May 27 15:00:14.235359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:14.235359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:14.235359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:14.235359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:14.235359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:14.235359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:14.235359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:00:14.235359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:00:14.235359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters May 27 15:00:14.235359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:14.235359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-99930f75-7758-43d7-ae89-b55da5601cb8 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:00:14.235359 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-99930f75-7758-43d7-ae89-b55da5601cb8 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.093572 May 27 15:00:14.237322 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 417/850] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:00:14 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:00:14.243554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7a647e97-8762-434f-92ad-5b4d5afea6a5 tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] Action: 'create', calling method: .version_select at 0x7fc776cffaf0>, body: {"pool": null} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:14.245386 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-182d75ed-abe5-41b2-88f6-decdfd5851db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:14.246150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-182d75ed-abe5-41b2-88f6-decdfd5851db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:14.247434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-182d75ed-abe5-41b2-88f6-decdfd5851db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:14.248360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-182d75ed-abe5-41b2-88f6-decdfd5851db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:14.276575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-182d75ed-abe5-41b2-88f6-decdfd5851db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Acquired lock "refresh_cache-b37ac407-852e-4ffa-995b-114d7d74bed5" {{(pid=119248) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 15:00:17.321131 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7a647e97-8762-434f-92ad-5b4d5afea6a5 tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.082359 May 27 15:00:17.324077 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 418/851] 10.222.0.13 () {60 vars in 1169 bytes} [Fri May 27 15:00:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3086 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:17.331626 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-20ceb446-be7a-4aa8-adc9-73576eb2bbe2 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:17.332873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-20ceb446-be7a-4aa8-adc9-73576eb2bbe2 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:17.365748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20ceb446-be7a-4aa8-adc9-73576eb2bbe2 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:17.368124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20ceb446-be7a-4aa8-adc9-73576eb2bbe2 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:17.370090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20ceb446-be7a-4aa8-adc9-73576eb2bbe2 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:17.371563 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20ceb446-be7a-4aa8-adc9-73576eb2bbe2 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:17.406944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-20ceb446-be7a-4aa8-adc9-73576eb2bbe2 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:00:17.455833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:17.513971 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-20ceb446-be7a-4aa8-adc9-73576eb2bbe2 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 204 len: 0 microversion: 2.75 time: 0.188170 May 27 15:00:17.514674 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 419/852] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:00:17 2022] DELETE /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:00:17.526391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f544d76b-3187-4287-8693-3681c816c0db tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Action: 'create', calling method: .version_select at 0x7fc776dedca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1889251959", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:17.551440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-f544d76b-3187-4287-8693-3681c816c0db tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Getting quotas for project 4b6c6d7dd53844a48a9994286a6d75f2. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:00:17.557953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-f544d76b-3187-4287-8693-3681c816c0db tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Getting quotas for user da5e5fb6980a4d1192433dc394657527 and project 4b6c6d7dd53844a48a9994286a6d75f2. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:00:17.577173 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-f544d76b-3187-4287-8693-3681c816c0db tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f544d76b-3187-4287-8693-3681c816c0db tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Request method failure captured: May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 2167 May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOd83QABh5awPtrXreYea-zAh7CyofBxfSAEWZDK-nBEeySvlDlMF8w3XXg3CiBS2msD9mWWUNyN6ixeeqKVHP1xxbySzEhXuU7WgEOMJQybaVnb6oJU4HlWTvFztMM2wmWbHasMEXjlMIFMDg59ikJcgtdBTk0NMxdGKenSP3ycmiY May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 4b6c6d7dd53844a48a9994286a6d75f2 May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4b6c6d7dd53844a48a9994286a6d75f2", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 4b6c6d7dd53844a48a9994286a6d75f2 May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-KeyPairsNegativeTestJSON-1541294451-project May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: da5e5fb6980a4d1192433dc394657527 May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1541294451-project May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1889251959", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:00:17.583994 n-d-843621-1 devstack@n-api.service[119249]: exception: Keypair data is invalid: failed to generate fingerprint May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1889251959', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise self.value May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:00:17.586657 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:00:17.590131 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:00:17.590131 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:00:17.590131 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:00:17.590131 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:00:17.590131 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 27 15:00:17.590131 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 27 15:00:17.590131 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 27 15:00:17.590131 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 27 15:00:17.590131 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 27 15:00:17.590131 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:17.590131 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:17.590131 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:17.590131 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:17.590131 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:17.590131 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:17.590131 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:00:17.590131 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:00:17.590131 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 27 15:00:17.590131 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:17.592597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f544d76b-3187-4287-8693-3681c816c0db tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:00:17.593506 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f544d76b-3187-4287-8693-3681c816c0db tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.077776 May 27 15:00:17.594086 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 420/853] 10.222.0.13 () {60 vars in 1159 bytes} [Fri May 27 15:00:17 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 27 15:00:17.602554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ce54f365-89f3-4769-b902-aa23e36303f2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:17.603303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ce54f365-89f3-4769-b902-aa23e36303f2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:17.610335 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ce54f365-89f3-4769-b902-aa23e36303f2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:17.610795 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ce54f365-89f3-4769-b902-aa23e36303f2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:17.611628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ce54f365-89f3-4769-b902-aa23e36303f2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:17.612568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ce54f365-89f3-4769-b902-aa23e36303f2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:17.907593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ce54f365-89f3-4769-b902-aa23e36303f2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:17.921773 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.network.neutron [None req-182d75ed-abe5-41b2-88f6-decdfd5851db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] re-assign floating IP 172.25.2.41 from instance da2c6d0b-b6e3-43a9-870b-6f7493b08dfa May 27 15:00:17.924649 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ce54f365-89f3-4769-b902-aa23e36303f2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1379 microversion: 2.1 time: 0.329354 May 27 15:00:17.928662 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 421/854] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:17 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1379 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:17.933544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9a49bb0c-d406-4112-be1b-78257f25bba6 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1674730084", "imageRef": "1e18b535-71a1-4993-9390-55cfedb9e7da", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a91a9073-b586-4a8e-be9c-310b2d2c8dd7"}], "security_groups": [{"name": "tempest-securitygroup--1699906807"}], "key_name": "tempest-keypair-1420042190", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:17.968860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-182d75ed-abe5-41b2-88f6-decdfd5851db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Building network info cache for instance {{(pid=119248) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 27 15:00:18.097307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-9a49bb0c-d406-4112-be1b-78257f25bba6 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] validate_networks() for [('a91a9073-b586-4a8e-be9c-310b2d2c8dd7', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:00:18.747116 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-9a49bb0c-d406-4112-be1b-78257f25bba6 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:00:18.747660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-9a49bb0c-d406-4112-be1b-78257f25bba6 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:00:18.748001 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-9a49bb0c-d406-4112-be1b-78257f25bba6 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:00:18.748543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-9a49bb0c-d406-4112-be1b-78257f25bba6 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:00:18.748960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-182d75ed-abe5-41b2-88f6-decdfd5851db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Updating instance_info_cache with network_info: [{"id": "77a08a17-7b75-4c05-a064-2f80d2e429a8", "address": "fa:16:3e:72:ff:a4", "network": {"id": "2c791768-302b-4ee2-b186-40f52faf1f15", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1339072895-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "27d1e6c35bdd45a986acf3213f2a84bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap77a08a17-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119248) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 27 15:00:18.749121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-9a49bb0c-d406-4112-be1b-78257f25bba6 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:00:18.758530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-182d75ed-abe5-41b2-88f6-decdfd5851db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Building network info cache for instance {{(pid=119248) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 27 15:00:18.759098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a49bb0c-d406-4112-be1b-78257f25bba6 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:18.759556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a49bb0c-d406-4112-be1b-78257f25bba6 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:18.760355 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a49bb0c-d406-4112-be1b-78257f25bba6 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:18.760826 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a49bb0c-d406-4112-be1b-78257f25bba6 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:18.778257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-9a49bb0c-d406-4112-be1b-78257f25bba6 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Getting quotas for project ea3ff9fdd7364a82ad3ed271a33da615. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:00:18.786026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-9a49bb0c-d406-4112-be1b-78257f25bba6 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Getting quotas for user 590be802bea346fc9240befaae60ec9e and project ea3ff9fdd7364a82ad3ed271a33da615. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:00:18.803106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9a49bb0c-d406-4112-be1b-78257f25bba6 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:00:18.808489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9a49bb0c-d406-4112-be1b-78257f25bba6 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e18b535-71a1-4993-9390-55cfedb9e7da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:00:18.862266 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9a49bb0c-d406-4112-be1b-78257f25bba6 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.931997 May 27 15:00:18.867978 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 422/855] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:00:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:00:18.868397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-2f312d8a-7642-434c-930f-44ec731f18fc req-ae8dcc34-3f54-4ec4-973d-cc43541baa40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39985ed3-7d07-48db-80b4-c570f7422e1f", "tag": "ac6d5c81-c7de-49e1-a62d-df0fdf576229"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:18.876985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2f312d8a-7642-434c-930f-44ec731f18fc req-ae8dcc34-3f54-4ec4-973d-cc43541baa40 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:18.877705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2f312d8a-7642-434c-930f-44ec731f18fc req-ae8dcc34-3f54-4ec4-973d-cc43541baa40 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:18.890934 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-2f312d8a-7642-434c-930f-44ec731f18fc req-ae8dcc34-3f54-4ec4-973d-cc43541baa40 service nova] Creating event network-changed:ac6d5c81-c7de-49e1-a62d-df0fdf576229 for instance 39985ed3-7d07-48db-80b4-c570f7422e1f on n-h2-843621-1 May 27 15:00:18.897229 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-2f312d8a-7642-434c-930f-44ec731f18fc req-ae8dcc34-3f54-4ec4-973d-cc43541baa40 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032023 May 27 15:00:18.898280 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 423/856] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:18.903500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-46c85522-7be6-445b-9486-91bc3d384f4e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:18.905151 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-46c85522-7be6-445b-9486-91bc3d384f4e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:18.912971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-46c85522-7be6-445b-9486-91bc3d384f4e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:18.913900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-46c85522-7be6-445b-9486-91bc3d384f4e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:18.914756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-46c85522-7be6-445b-9486-91bc3d384f4e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:18.915511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-46c85522-7be6-445b-9486-91bc3d384f4e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:19.369728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-46c85522-7be6-445b-9486-91bc3d384f4e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:19.384327 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-46c85522-7be6-445b-9486-91bc3d384f4e tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982" status: 200 len: 1589 microversion: 2.1 time: 0.484741 May 27 15:00:19.384977 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 424/857] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:18 2022] GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 => generated 1589 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:19.399933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-eb5b949a-9ca6-4fc8-aa85-519b5b3b257a tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:19.400869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-eb5b949a-9ca6-4fc8-aa85-519b5b3b257a tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:19.408620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb5b949a-9ca6-4fc8-aa85-519b5b3b257a tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:19.409110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb5b949a-9ca6-4fc8-aa85-519b5b3b257a tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:19.409899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb5b949a-9ca6-4fc8-aa85-519b5b3b257a tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:19.410344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb5b949a-9ca6-4fc8-aa85-519b5b3b257a tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:19.548112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-182d75ed-abe5-41b2-88f6-decdfd5851db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Updating instance_info_cache with network_info: [{"id": "e938d86e-65f4-4b40-9216-916175c13d97", "address": "fa:16:3e:3c:c1:11", "network": {"id": "2c791768-302b-4ee2-b186-40f52faf1f15", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1339072895-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "27d1e6c35bdd45a986acf3213f2a84bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape938d86e-65", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119248) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 27 15:00:19.570240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-182d75ed-abe5-41b2-88f6-decdfd5851db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Releasing lock "refresh_cache-b37ac407-852e-4ffa-995b-114d7d74bed5" {{(pid=119248) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 15:00:19.571425 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-182d75ed-abe5-41b2-88f6-decdfd5851db tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "POST /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5/action" status: 202 len: 0 microversion: 2.1 time: 5.369040 May 27 15:00:19.572561 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 434/858] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:00:14 2022] POST /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5/action => generated 0 bytes in 5371 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 27 15:00:19.577881 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-894f9712-5ac3-4656-add8-25e2d1f94f24 tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] Action: 'create', calling method: .version_select at 0x7fc776cdc3a0>, body: {"pool": null} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:19.715328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-eb5b949a-9ca6-4fc8-aa85-519b5b3b257a tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lazy-loading 'services' on Instance uuid 18e4f7f7-6bda-4d0b-9685-74266d42efc0 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:00:19.740353 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-eb5b949a-9ca6-4fc8-aa85-519b5b3b257a tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 2128 microversion: 2.25 time: 0.352395 May 27 15:00:19.742303 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 425/859] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:19 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 2128 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:00:19.748248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bab7042e-3133-45d6-bcd6-a644c81a8638 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:19.748918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bab7042e-3133-45d6-bcd6-a644c81a8638 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:19.760615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bab7042e-3133-45d6-bcd6-a644c81a8638 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:19.761111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bab7042e-3133-45d6-bcd6-a644c81a8638 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:19.762498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bab7042e-3133-45d6-bcd6-a644c81a8638 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:19.762938 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bab7042e-3133-45d6-bcd6-a644c81a8638 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:19.808590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bab7042e-3133-45d6-bcd6-a644c81a8638 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:19.809348 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bab7042e-3133-45d6-bcd6-a644c81a8638 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:19.809813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-bab7042e-3133-45d6-bcd6-a644c81a8638 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lazy-loading 'fault' on Instance uuid 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:00:19.878933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bab7042e-3133-45d6-bcd6-a644c81a8638 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:19.887517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bab7042e-3133-45d6-bcd6-a644c81a8638 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:19.889065 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bab7042e-3133-45d6-bcd6-a644c81a8638 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acfabdbb3e944dcac265f4207a2649c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1072ffed312450eb8ca8d61c6798b9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:19.894321 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bab7042e-3133-45d6-bcd6-a644c81a8638 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 200 len: 1448 microversion: 2.75 time: 0.150801 May 27 15:00:19.894901 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 426/860] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:19 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 1448 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:00:19.900056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-71b1afa3-be30-4e54-a768-efe1df3aaca0 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Action: 'create', calling method: .version_select at 0x7fc776d64af0>, body: {"keypair": {"name": "tempest-keypair-1555262035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5Dd29Uv7G2xxiLtQ2kF9vjtzhPm8HSoeK5/RJ4c037EcRVxtYm0lRjYy6mci3tFxIpGlZRehKFcgy2MvFEMb1TYKTwnVTwEQIHOr4Ty89GW6ILbCLqSkn443VCSdUzvQ=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:19.918432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-71b1afa3-be30-4e54-a768-efe1df3aaca0 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Getting quotas for project 4b6c6d7dd53844a48a9994286a6d75f2. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:00:19.923445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-71b1afa3-be30-4e54-a768-efe1df3aaca0 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Getting quotas for user da5e5fb6980a4d1192433dc394657527 and project 4b6c6d7dd53844a48a9994286a6d75f2. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:00:19.954034 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-71b1afa3-be30-4e54-a768-efe1df3aaca0 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058079 May 27 15:00:19.954807 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 427/861] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:00:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:19.960716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f4ede848-64a9-4413-8c32-941342cab675 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:19.961346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f4ede848-64a9-4413-8c32-941342cab675 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:19.968745 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4ede848-64a9-4413-8c32-941342cab675 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:19.969342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4ede848-64a9-4413-8c32-941342cab675 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:19.970249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4ede848-64a9-4413-8c32-941342cab675 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:19.970900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4ede848-64a9-4413-8c32-941342cab675 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:20.063295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f4ede848-64a9-4413-8c32-941342cab675 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590be802bea346fc9240befaae60ec9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3ff9fdd7364a82ad3ed271a33da615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:20.073927 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f4ede848-64a9-4413-8c32-941342cab675 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 200 len: 1298 microversion: 2.1 time: 0.117754 May 27 15:00:20.074874 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 428/862] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:19 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 1298 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:20.080269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-76aad1a1-ccc3-4d35-b8d2-68a2138eab7b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:20.081095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-76aad1a1-ccc3-4d35-b8d2-68a2138eab7b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:20.088635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76aad1a1-ccc3-4d35-b8d2-68a2138eab7b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:20.089129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76aad1a1-ccc3-4d35-b8d2-68a2138eab7b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:20.089959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76aad1a1-ccc3-4d35-b8d2-68a2138eab7b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:20.090426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76aad1a1-ccc3-4d35-b8d2-68a2138eab7b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:20.295378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-76aad1a1-ccc3-4d35-b8d2-68a2138eab7b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:20.304048 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-76aad1a1-ccc3-4d35-b8d2-68a2138eab7b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1379 microversion: 2.1 time: 0.227711 May 27 15:00:20.306232 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 429/863] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:20 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1379 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:20.313084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-906cd225-2aee-43f1-b1d5-777fb79945b7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Action: 'action', calling method: .version_select at 0x7fc77d74e550>, body: {"removeFloatingIp": {"address": "172.25.2.41"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:20.608122 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-906cd225-2aee-43f1-b1d5-777fb79945b7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:20.616581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-906cd225-2aee-43f1-b1d5-777fb79945b7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:20.617068 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-906cd225-2aee-43f1-b1d5-777fb79945b7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:20.618008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-906cd225-2aee-43f1-b1d5-777fb79945b7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:20.618717 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-906cd225-2aee-43f1-b1d5-777fb79945b7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:21.135569 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-906cd225-2aee-43f1-b1d5-777fb79945b7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] HTTP exception thrown: Floating IP 172.25.2.41 is not associated with instance da2c6d0b-b6e3-43a9-870b-6f7493b08dfa. May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-906cd225-2aee-43f1-b1d5-777fb79945b7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Request method failure captured: May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa/action HTTP/1.1 May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 48 May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOc_KZXRiB_3V0Ut0CGPITzCZSFj3bXcxC_wJnHHonBMr3KV07i59OUsvME94axLWlSc8PCxTTNCzanIXU215iN3PWiBPaOYb8YkwFs7nQR-AosFaXRlYJ-QOpNMX0-mi9fYXdBmhGtefeujEm1_9pUfve-Q545yYEX-e9IB7M1W0YM May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 27d1e6c35bdd45a986acf3213f2a84bf May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1404390607 May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/27d1e6c35bdd45a986acf3213f2a84bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/27d1e6c35bdd45a986acf3213f2a84bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/27d1e6c35bdd45a986acf3213f2a84bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_27d1e6c35bdd45a986acf3213f2a84bf", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1404390607 May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 27d1e6c35bdd45a986acf3213f2a84bf May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1404390607 May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-FloatingIPsAssociationTestJSON-1404390607-project May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 7fd8811631894240aa46c7f87b3c8506 May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1404390607-project May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: {"removeFloatingIp": {"address": "172.25.2.41"}} May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: exception: Floating IP 172.25.2.41 is not associated with instance da2c6d0b-b6e3-43a9-870b-6f7493b08dfa. May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'da2c6d0b-b6e3-43a9-870b-6f7493b08dfa', 'body': {'removeFloatingIp': {'address': '172.25.2.41'}}} May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.41 is not associated with instance da2c6d0b-b6e3-43a9-870b-6f7493b08dfa. May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.41 is not associated with instance da2c6d0b-b6e3-43a9-870b-6f7493b08dfa. May 27 15:00:21.137776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:21.143631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-906cd225-2aee-43f1-b1d5-777fb79945b7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Returning 409 to user: Floating IP 172.25.2.41 is not associated with instance da2c6d0b-b6e3-43a9-870b-6f7493b08dfa. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:00:21.144747 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-906cd225-2aee-43f1-b1d5-777fb79945b7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "POST /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa/action" status: 409 len: 145 microversion: 2.1 time: 0.837268 May 27 15:00:21.145862 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 430/864] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:00:20 2022] POST /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa/action => generated 145 bytes in 839 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:00:21.150768 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-10b40ef1-a809-4826-986c-cb678132a2bf req-4412aebd-898f-450a-bd28-b0ffff323797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39985ed3-7d07-48db-80b4-c570f7422e1f", "name": "network-vif-plugged", "status": "completed", "tag": "ac6d5c81-c7de-49e1-a62d-df0fdf576229"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:21.176761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-10b40ef1-a809-4826-986c-cb678132a2bf req-4412aebd-898f-450a-bd28-b0ffff323797 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:21.177963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-10b40ef1-a809-4826-986c-cb678132a2bf req-4412aebd-898f-450a-bd28-b0ffff323797 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:21.194812 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-10b40ef1-a809-4826-986c-cb678132a2bf req-4412aebd-898f-450a-bd28-b0ffff323797 service nova] Creating event network-vif-plugged:ac6d5c81-c7de-49e1-a62d-df0fdf576229 for instance 39985ed3-7d07-48db-80b4-c570f7422e1f on n-h2-843621-1 May 27 15:00:21.204312 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-10b40ef1-a809-4826-986c-cb678132a2bf req-4412aebd-898f-450a-bd28-b0ffff323797 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056690 May 27 15:00:21.215836 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 431/865] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:21.223197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-13144d26-b178-4c04-9166-447ee41c9c15 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843621-1", "block_migration": "auto"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:21.225682 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-13144d26-b178-4c04-9166-447ee41c9c15 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:21.245078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13144d26-b178-4c04-9166-447ee41c9c15 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:21.246899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13144d26-b178-4c04-9166-447ee41c9c15 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:21.248925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13144d26-b178-4c04-9166-447ee41c9c15 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:21.249657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13144d26-b178-4c04-9166-447ee41c9c15 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:21.321531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-13144d26-b178-4c04-9166-447ee41c9c15 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lazy-loading 'flavor' on Instance uuid 18e4f7f7-6bda-4d0b-9685-74266d42efc0 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:00:21.378749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-13144d26-b178-4c04-9166-447ee41c9c15 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Going to try to live migrate instance to n-h1-843621-1 {{(pid=119249) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 27 15:00:22.096114 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-894f9712-5ac3-4656-add8-25e2d1f94f24 tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.522218 May 27 15:00:22.096744 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 435/866] 10.222.0.13 () {60 vars in 1169 bytes} [Fri May 27 15:00:19 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:22.101721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-98877aef-96b1-4d4d-a330-c0abc2b76632 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Action: 'create', calling method: .version_select at 0x7fc776d4ae50>, body: {"keypair": {"name": "tempest-keypair-1555262035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMAyywKmw1cJjMEmN3aUOcde9vyTKZh0W05JgSxpu8gVMvGl2Njq5gSR3bRg0VusykMpAHFlYBJzCPYbaXbUd/pDyeAvkgRt/6K56BDnZiWfT4xjqE6AplmXsh8jRuh5w=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:22.122491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-98877aef-96b1-4d4d-a330-c0abc2b76632 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Getting quotas for project 4b6c6d7dd53844a48a9994286a6d75f2. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:00:22.128778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-98877aef-96b1-4d4d-a330-c0abc2b76632 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Getting quotas for user da5e5fb6980a4d1192433dc394657527 and project 4b6c6d7dd53844a48a9994286a6d75f2. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:00:22.196963 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-98877aef-96b1-4d4d-a330-c0abc2b76632 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] HTTP exception thrown: Key pair 'tempest-keypair-1555262035' already exists. May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-98877aef-96b1-4d4d-a330-c0abc2b76632 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Request method failure captured: May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 273 May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOd83QABh5awPtrXreYea-zAh7CyofBxfSAEWZDK-nBEeySvlDlMF8w3XXg3CiBS2msD9mWWUNyN6ixeeqKVHP1xxbySzEhXuU7WgEOMJQybaVnb6oJU4HlWTvFztMM2wmWbHasMEXjlMIFMDg59ikJcgtdBTk0NMxdGKenSP3ycmiY May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 4b6c6d7dd53844a48a9994286a6d75f2 May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4b6c6d7dd53844a48a9994286a6d75f2", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 4b6c6d7dd53844a48a9994286a6d75f2 May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-KeyPairsNegativeTestJSON-1541294451-project May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: da5e5fb6980a4d1192433dc394657527 May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1541294451-project May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: {"keypair": {"name": "tempest-keypair-1555262035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMAyywKmw1cJjMEmN3aUOcde9vyTKZh0W05JgSxpu8gVMvGl2Njq5gSR3bRg0VusykMpAHFlYBJzCPYbaXbUd/pDyeAvkgRt/6K56BDnZiWfT4xjqE6AplmXsh8jRuh5w=="}} May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: exception: Key pair 'tempest-keypair-1555262035' already exists. May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1555262035', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMAyywKmw1cJjMEmN3aUOcde9vyTKZh0W05JgSxpu8gVMvGl2Njq5gSR3bRg0VusykMpAHFlYBJzCPYbaXbUd/pDyeAvkgRt/6K56BDnZiWfT4xjqE6AplmXsh8jRuh5w=='}}} May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = self._query(query) May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi conn.query(q) May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result.read() May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'da5e5fb6980a4d1192433dc394657527-tempest-keypair-1555262035' for key 'key_pairs.uniq_key_pairs0user_id0name'") May 27 15:00:22.202158 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi kp.save(context.session) May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi session.flush() May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._flush(objects) May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi compat.raise_( May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi flush_context.execute() May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi rec.execute(self) May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = self._query(query) May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi conn.query(q) May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result.read() May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 27 15:00:22.206703 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'da5e5fb6980a4d1192433dc394657527-tempest-keypair-1555262035' for key 'key_pairs.uniq_key_pairs0user_id0name'") May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 27, 15, 0, 22, 180557), 'updated_at': None, 'name': 'tempest-keypair-1555262035', 'user_id': 'da5e5fb6980a4d1192433dc394657527', 'fingerprint': '8d:73:c8:ab:69:f4:38:07:dc:93:93:56:56:bf:bc:ac', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMAyywKmw1cJjMEmN3aUOcde9vyTKZh0W05JgSxpu8gVMvGl2Njq5gSR3bRg0VusykMpAHFlYBJzCPYbaXbUd/pDyeAvkgRt/6K56BDnZiWfT4xjqE6AplmXsh8jRuh5w==', 'type': 'ssh'}] May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi keypair.create() May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._create() May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1555262035' already exists. May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) May 27 15:00:22.212412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1555262035' already exists. May 27 15:00:22.217535 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:22.217535 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:22.217535 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:22.217535 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:22.217535 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:22.217535 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:22.217535 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:00:22.217535 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:00:22.217535 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1555262035' already exists. May 27 15:00:22.217535 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:22.217535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-98877aef-96b1-4d4d-a330-c0abc2b76632 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Returning 409 to user: Key pair 'tempest-keypair-1555262035' already exists. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:00:22.217535 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-98877aef-96b1-4d4d-a330-c0abc2b76632 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.105650 May 27 15:00:22.217535 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 436/867] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:00:22 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:00:22.217535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-11dddde4-ff97-4370-accd-129a8826fad7 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:22.217535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-11dddde4-ff97-4370-accd-129a8826fad7 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] [instance: 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:22.223803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-11dddde4-ff97-4370-accd-129a8826fad7 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:22.224727 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-11dddde4-ff97-4370-accd-129a8826fad7 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:22.225550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-11dddde4-ff97-4370-accd-129a8826fad7 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:22.225998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-11dddde4-ff97-4370-accd-129a8826fad7 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:22.260261 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-11dddde4-ff97-4370-accd-129a8826fad7 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] HTTP exception thrown: Instance 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f could not be found. May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-11dddde4-ff97-4370-accd-129a8826fad7 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Request method failure captured: May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f HTTP/1.1 May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOcpjjiAzkG1W6Q10oa3B8ATAq6_q65QTGC86HLc5eYmYzPaukSCsjzQfax7NKneuzuO9d4HasGX1YZt_gxyKmfyOsbQzdFJ12GeTSmhXijgeA-wxNBOloPpKTF4M0SmWZTtJNbr4JOqr2_KcU77AGZDDpjOBqoyCF2YKHNtr1hslZw May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-Openstack-Nova-Api-Version: 2.75 May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: c1072ffed312450eb8ca8d61c6798b9b May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersAdmin275Test-34232183 May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c1072ffed312450eb8ca8d61c6798b9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c1072ffed312450eb8ca8d61c6798b9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c1072ffed312450eb8ca8d61c6798b9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c1072ffed312450eb8ca8d61c6798b9b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersAdmin275Test-34232183 May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: c1072ffed312450eb8ca8d61c6798b9b May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersAdmin275Test-34232183 May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersAdmin275Test-34232183-project May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 4acfabdbb3e944dcac265f4207a2649c May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersAdmin275Test-34232183-project May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f could not be found. May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f'} May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f could not be found. May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f could not be found. May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:22.262128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:22.266922 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:22.266922 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:22.266922 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:22.266922 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:00:22.266922 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:00:22.266922 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f could not be found. May 27 15:00:22.266922 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:22.266922 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-11dddde4-ff97-4370-accd-129a8826fad7 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] Returning 404 to user: Instance 5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:00:22.266922 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-11dddde4-ff97-4370-accd-129a8826fad7 tempest-ServersAdmin275Test-34232183 tempest-ServersAdmin275Test-34232183-project] 10.222.0.13 "GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f" status: 404 len: 111 microversion: 2.75 time: 0.052831 May 27 15:00:22.269256 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 437/868] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:22 2022] GET /compute/v2.1/servers/5a99dfe2-cf3a-47f0-a20f-68c36ad2dd6f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:00:22.281699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-c0dd60cd-e38c-4a6d-a81b-bc4b5209cfb9 req-30bc7310-46f0-42ee-8fa2-8d4c24bbf656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f621b08-4026-4bbd-923b-43a8630f6982", "tag": "fa2c5e8d-6006-41d2-861b-d0543e539801"}, {"name": "network-changed", "server_uuid": "da2c6d0b-b6e3-43a9-870b-6f7493b08dfa", "tag": "77a08a17-7b75-4c05-a064-2f80d2e429a8"}, {"name": "network-changed", "server_uuid": "b37ac407-852e-4ffa-995b-114d7d74bed5", "tag": "e938d86e-65f4-4b40-9216-916175c13d97"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:22.313947 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c0dd60cd-e38c-4a6d-a81b-bc4b5209cfb9 req-30bc7310-46f0-42ee-8fa2-8d4c24bbf656 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:22.314714 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c0dd60cd-e38c-4a6d-a81b-bc4b5209cfb9 req-30bc7310-46f0-42ee-8fa2-8d4c24bbf656 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:22.344399 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-c0dd60cd-e38c-4a6d-a81b-bc4b5209cfb9 req-30bc7310-46f0-42ee-8fa2-8d4c24bbf656 service nova] Creating event network-changed:fa2c5e8d-6006-41d2-861b-d0543e539801 for instance 3f621b08-4026-4bbd-923b-43a8630f6982 on n-h2-843621-1 May 27 15:00:22.345464 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-c0dd60cd-e38c-4a6d-a81b-bc4b5209cfb9 req-30bc7310-46f0-42ee-8fa2-8d4c24bbf656 service nova] Creating event network-changed:77a08a17-7b75-4c05-a064-2f80d2e429a8 for instance da2c6d0b-b6e3-43a9-870b-6f7493b08dfa on n-h2-843621-1 May 27 15:00:22.346320 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-c0dd60cd-e38c-4a6d-a81b-bc4b5209cfb9 req-30bc7310-46f0-42ee-8fa2-8d4c24bbf656 service nova] Creating event network-changed:e938d86e-65f4-4b40-9216-916175c13d97 for instance b37ac407-852e-4ffa-995b-114d7d74bed5 on n-h1-843621-1 May 27 15:00:22.367609 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-c0dd60cd-e38c-4a6d-a81b-bc4b5209cfb9 req-30bc7310-46f0-42ee-8fa2-8d4c24bbf656 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.091693 May 27 15:00:22.369948 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 438/869] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:22.394453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1e4c60d9-d4c3-4451-9000-9a4f1f4ccaae tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:22.395354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1e4c60d9-d4c3-4451-9000-9a4f1f4ccaae tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:22.421531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e4c60d9-d4c3-4451-9000-9a4f1f4ccaae tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:22.424363 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e4c60d9-d4c3-4451-9000-9a4f1f4ccaae tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:22.425500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e4c60d9-d4c3-4451-9000-9a4f1f4ccaae tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:22.428227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e4c60d9-d4c3-4451-9000-9a4f1f4ccaae tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:22.450931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=2,nova_cell1:RELEASE=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:22.701066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1e4c60d9-d4c3-4451-9000-9a4f1f4ccaae tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590be802bea346fc9240befaae60ec9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3ff9fdd7364a82ad3ed271a33da615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:22.710468 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1e4c60d9-d4c3-4451-9000-9a4f1f4ccaae tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 200 len: 1372 microversion: 2.1 time: 0.336119 May 27 15:00:22.711166 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 439/870] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:22 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 1372 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:22.716198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-86d7a071-090d-47b2-9d44-020cfadef9ae tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Action: 'action', calling method: .version_select at 0x7fc77d72f670>, body: {"removeFloatingIp": {"address": "172.25.2.41"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:22.929665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-86d7a071-090d-47b2-9d44-020cfadef9ae tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:22.945144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-86d7a071-090d-47b2-9d44-020cfadef9ae tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:22.946031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-86d7a071-090d-47b2-9d44-020cfadef9ae tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:22.947046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-86d7a071-090d-47b2-9d44-020cfadef9ae tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:22.947503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-86d7a071-090d-47b2-9d44-020cfadef9ae tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:23.256019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-86d7a071-090d-47b2-9d44-020cfadef9ae tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Acquired lock "refresh_cache-b37ac407-852e-4ffa-995b-114d7d74bed5" {{(pid=119248) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 15:00:24.150900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-86d7a071-090d-47b2-9d44-020cfadef9ae tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Building network info cache for instance {{(pid=119248) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 27 15:00:24.882710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-86d7a071-090d-47b2-9d44-020cfadef9ae tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Updating instance_info_cache with network_info: [{"id": "e938d86e-65f4-4b40-9216-916175c13d97", "address": "fa:16:3e:3c:c1:11", "network": {"id": "2c791768-302b-4ee2-b186-40f52faf1f15", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1339072895-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "27d1e6c35bdd45a986acf3213f2a84bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape938d86e-65", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119248) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 27 15:00:24.903527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-86d7a071-090d-47b2-9d44-020cfadef9ae tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Releasing lock "refresh_cache-b37ac407-852e-4ffa-995b-114d7d74bed5" {{(pid=119248) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 15:00:24.904424 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-86d7a071-090d-47b2-9d44-020cfadef9ae tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "POST /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5/action" status: 202 len: 0 microversion: 2.1 time: 2.191838 May 27 15:00:24.907293 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 440/871] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:00:22 2022] POST /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5/action => generated 0 bytes in 2195 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 27 15:00:24.921143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a7505a78-9df1-4bf4-a69c-4cef3638896d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:24.926509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a7505a78-9df1-4bf4-a69c-4cef3638896d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:24.939984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a7505a78-9df1-4bf4-a69c-4cef3638896d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:24.940448 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a7505a78-9df1-4bf4-a69c-4cef3638896d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:24.941316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a7505a78-9df1-4bf4-a69c-4cef3638896d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:24.941763 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a7505a78-9df1-4bf4-a69c-4cef3638896d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:25.179749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a7505a78-9df1-4bf4-a69c-4cef3638896d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:25.194512 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a7505a78-9df1-4bf4-a69c-4cef3638896d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1528 microversion: 2.1 time: 0.285397 May 27 15:00:25.195718 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 441/872] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:24 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1528 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:25.202356 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8dde1cef-9697-458c-b1c1-993173e42d06 tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] Calling method '.version_select at 0x7fc776e8c3a0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:25.575200 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8dde1cef-9697-458c-b1c1-993173e42d06 tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/e7feeec8-2e8f-4402-bd74-a5a4afb940f9" status: 200 len: 140 microversion: 2.1 time: 0.378039 May 27 15:00:25.576078 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 442/873] 10.222.0.13 () {58 vars in 1259 bytes} [Fri May 27 15:00:25 2022] GET /compute/v2.1/os-floating-ips/e7feeec8-2e8f-4402-bd74-a5a4afb940f9 => generated 140 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:25.585834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8d18a0f9-76da-44dd-a5d2-aaebb0a1ea48 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Calling method '.version_select at 0x7fc7773f05e0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:25.623843 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8d18a0f9-76da-44dd-a5d2-aaebb0a1ea48 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1555262035" status: 202 len: 0 microversion: 2.1 time: 0.046391 May 27 15:00:25.624729 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 443/874] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 27 15:00:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1555262035 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:00:25.636699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c8c40f88-d2fd-4294-b65c-fd04fddc4cae tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:25.637441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c8c40f88-d2fd-4294-b65c-fd04fddc4cae tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:25.671273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8c40f88-d2fd-4294-b65c-fd04fddc4cae tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:25.674959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8c40f88-d2fd-4294-b65c-fd04fddc4cae tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:25.678562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8c40f88-d2fd-4294-b65c-fd04fddc4cae tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:25.681473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8c40f88-d2fd-4294-b65c-fd04fddc4cae tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:25.946179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c8c40f88-d2fd-4294-b65c-fd04fddc4cae tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590be802bea346fc9240befaae60ec9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3ff9fdd7364a82ad3ed271a33da615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:25.967784 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c8c40f88-d2fd-4294-b65c-fd04fddc4cae tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 200 len: 1372 microversion: 2.1 time: 0.341748 May 27 15:00:25.970398 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 444/875] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:25 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 1372 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:25.980385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-27cfd286-928f-474b-b580-d6048c5bb51e req-9a67ac03-6466-4db7-bb81-cd1e89e8c56a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b37ac407-852e-4ffa-995b-114d7d74bed5", "tag": "e938d86e-65f4-4b40-9216-916175c13d97"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:25.990004 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-27cfd286-928f-474b-b580-d6048c5bb51e req-9a67ac03-6466-4db7-bb81-cd1e89e8c56a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:25.991371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-27cfd286-928f-474b-b580-d6048c5bb51e req-9a67ac03-6466-4db7-bb81-cd1e89e8c56a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:26.003976 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-27cfd286-928f-474b-b580-d6048c5bb51e req-9a67ac03-6466-4db7-bb81-cd1e89e8c56a service nova] Creating event network-changed:e938d86e-65f4-4b40-9216-916175c13d97 for instance b37ac407-852e-4ffa-995b-114d7d74bed5 on n-h1-843621-1 May 27 15:00:26.009178 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-27cfd286-928f-474b-b580-d6048c5bb51e req-9a67ac03-6466-4db7-bb81-cd1e89e8c56a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037467 May 27 15:00:26.009862 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 445/876] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:26.015744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d015867b-da44-4b69-87c1-9e0b313f3861 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:26.016424 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d015867b-da44-4b69-87c1-9e0b313f3861 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:26.023154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d015867b-da44-4b69-87c1-9e0b313f3861 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:26.023688 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d015867b-da44-4b69-87c1-9e0b313f3861 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:26.024538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d015867b-da44-4b69-87c1-9e0b313f3861 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:26.025201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d015867b-da44-4b69-87c1-9e0b313f3861 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:26.055654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d015867b-da44-4b69-87c1-9e0b313f3861 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:00:26.159987 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d015867b-da44-4b69-87c1-9e0b313f3861 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5" status: 204 len: 0 microversion: 2.1 time: 0.147954 May 27 15:00:26.165809 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 446/877] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:00:26 2022] DELETE /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:00:26.173766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c2d7a689-9d18-44ec-95ca-e65989b50f2b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:26.174491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c2d7a689-9d18-44ec-95ca-e65989b50f2b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:26.182115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2d7a689-9d18-44ec-95ca-e65989b50f2b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:26.182115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2d7a689-9d18-44ec-95ca-e65989b50f2b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:26.182837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2d7a689-9d18-44ec-95ca-e65989b50f2b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:26.183174 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2d7a689-9d18-44ec-95ca-e65989b50f2b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:26.349609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c2d7a689-9d18-44ec-95ca-e65989b50f2b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:26.358784 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c2d7a689-9d18-44ec-95ca-e65989b50f2b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1528 microversion: 2.1 time: 0.195686 May 27 15:00:26.364782 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 447/878] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:26 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1528 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:26.366174 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-96119c67-2c30-40dc-8de7-6644689d0ae6 tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] Calling method '.version_select at 0x7fc776d55670>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:27.083513 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-96119c67-2c30-40dc-8de7-6644689d0ae6 tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/e7feeec8-2e8f-4402-bd74-a5a4afb940f9" status: 202 len: 0 microversion: 2.1 time: 0.722939 May 27 15:00:27.084469 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 448/879] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 15:00:26 2022] DELETE /compute/v2.1/os-floating-ips/e7feeec8-2e8f-4402-bd74-a5a4afb940f9 => generated 0 bytes in 724 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:00:27.089827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-54e97851-fd0b-4f3f-abdc-b93b33ddd823 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Action: 'create', calling method: .version_select at 0x7fc776cc5820>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtd22/CxYXH1wUd/w9yaYGsoP4J7iYm5h/LNPMhbpQvDK+U+7hm5E50DRH5DIRvbs1z0vv1WuPEMDfKdtj/eTbksjyqMuGYd4JwUNSNetY0yeyvreuQIRHCsdZOZ1Ubdg=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-54e97851-fd0b-4f3f-abdc-b93b33ddd823 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Request method failure captured: May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 247 May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOd83QABh5awPtrXreYea-zAh7CyofBxfSAEWZDK-nBEeySvlDlMF8w3XXg3CiBS2msD9mWWUNyN6ixeeqKVHP1xxbySzEhXuU7WgEOMJQybaVnb6oJU4HlWTvFztMM2wmWbHasMEXjlMIFMDg59ikJcgtdBTk0NMxdGKenSP3ycmiY May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 4b6c6d7dd53844a48a9994286a6d75f2 May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4b6c6d7dd53844a48a9994286a6d75f2", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 4b6c6d7dd53844a48a9994286a6d75f2 May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-KeyPairsNegativeTestJSON-1541294451-project May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: da5e5fb6980a4d1192433dc394657527 May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1541294451-project May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtd22/CxYXH1wUd/w9yaYGsoP4J7iYm5h/LNPMhbpQvDK+U+7hm5E50DRH5DIRvbs1z0vv1WuPEMDfKdtj/eTbksjyqMuGYd4JwUNSNetY0yeyvreuQIRHCsdZOZ1Ubdg=="}} May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid input for field/attribute name. Value: . '' is too short May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtd22/CxYXH1wUd/w9yaYGsoP4J7iYm5h/LNPMhbpQvDK+U+7hm5E50DRH5DIRvbs1z0vv1WuPEMDfKdtj/eTbksjyqMuGYd4JwUNSNetY0yeyvreuQIRHCsdZOZ1Ubdg=='}}} May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance['keypair']: May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi '' May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:00:27.092432 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:00:27.099221 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:00:27.099221 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:00:27.099221 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:00:27.099221 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:00:27.099221 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 27 15:00:27.099221 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:27.099221 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:27.099221 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:27.099221 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:27.099221 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:27.099221 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:27.099221 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:00:27.099221 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:00:27.099221 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 27 15:00:27.099221 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:27.099221 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-54e97851-fd0b-4f3f-abdc-b93b33ddd823 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:00:27.099221 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-54e97851-fd0b-4f3f-abdc-b93b33ddd823 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.008221 May 27 15:00:27.099221 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 449/880] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:00:27 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:00:27.100502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d07dedc5-8a2b-44be-9ea0-fbb4afebbe21 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.41"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:27.101154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d07dedc5-8a2b-44be-9ea0-fbb4afebbe21 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:27.107474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d07dedc5-8a2b-44be-9ea0-fbb4afebbe21 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:27.107931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d07dedc5-8a2b-44be-9ea0-fbb4afebbe21 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:27.108733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d07dedc5-8a2b-44be-9ea0-fbb4afebbe21 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:27.109176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d07dedc5-8a2b-44be-9ea0-fbb4afebbe21 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:27.137712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d07dedc5-8a2b-44be-9ea0-fbb4afebbe21 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Acquired lock "refresh_cache-da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" {{(pid=119248) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 15:00:28.513252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-d07dedc5-8a2b-44be-9ea0-fbb4afebbe21 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Building network info cache for instance {{(pid=119248) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 27 15:00:28.773443 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:29.199009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-d07dedc5-8a2b-44be-9ea0-fbb4afebbe21 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Updating instance_info_cache with network_info: [{"id": "77a08a17-7b75-4c05-a064-2f80d2e429a8", "address": "fa:16:3e:72:ff:a4", "network": {"id": "2c791768-302b-4ee2-b186-40f52faf1f15", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1339072895-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "27d1e6c35bdd45a986acf3213f2a84bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap77a08a17-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119248) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 27 15:00:29.212064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d07dedc5-8a2b-44be-9ea0-fbb4afebbe21 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Releasing lock "refresh_cache-da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" {{(pid=119248) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 15:00:29.212996 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d07dedc5-8a2b-44be-9ea0-fbb4afebbe21 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "POST /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa/action" status: 202 len: 0 microversion: 2.1 time: 2.117567 May 27 15:00:29.213605 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 450/881] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:00:27 2022] POST /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa/action => generated 0 bytes in 2119 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 27 15:00:29.218459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6afb90e6-8c14-4565-92f0-c6e5ed2df70c tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:29.219347 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:00:29.219347 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:00:29.239759 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6afb90e6-8c14-4565-92f0-c6e5ed2df70c tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/5b9cd6b6-29e3-47b2-8b98-d98ca88503f4" status: 202 len: 0 microversion: 2.1 time: 0.024911 May 27 15:00:29.240312 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 451/882] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:00:29 2022] DELETE /compute/v2.1/flavors/5b9cd6b6-29e3-47b2-8b98-d98ca88503f4 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:00:29.446701 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bf903015-772c-4ac3-933e-31e957e5c6aa tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1953911227", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:29.522869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-bf903015-772c-4ac3-933e-31e957e5c6aa tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] validate_networks() for None {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:00:29.767384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-bf903015-772c-4ac3-933e-31e957e5c6aa tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:00:29.768043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-bf903015-772c-4ac3-933e-31e957e5c6aa tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:00:29.768516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-bf903015-772c-4ac3-933e-31e957e5c6aa tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:00:29.769135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-bf903015-772c-4ac3-933e-31e957e5c6aa tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:00:29.769557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-bf903015-772c-4ac3-933e-31e957e5c6aa tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:00:29.772700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:29.779955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf903015-772c-4ac3-933e-31e957e5c6aa tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:29.780408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf903015-772c-4ac3-933e-31e957e5c6aa tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:29.781238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf903015-772c-4ac3-933e-31e957e5c6aa tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:29.781677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf903015-772c-4ac3-933e-31e957e5c6aa tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:29.800460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-bf903015-772c-4ac3-933e-31e957e5c6aa tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Getting quotas for project 686f487ff60742dca747020a97818dbb. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:00:29.806234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-bf903015-772c-4ac3-933e-31e957e5c6aa tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Getting quotas for user 5966aa558f434adda904f39536717363 and project 686f487ff60742dca747020a97818dbb. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:00:29.819937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bf903015-772c-4ac3-933e-31e957e5c6aa tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:00:29.822240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bf903015-772c-4ac3-933e-31e957e5c6aa tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:00:29.931284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=14 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:29.944143 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bf903015-772c-4ac3-933e-31e957e5c6aa tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693682 May 27 15:00:29.951863 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 452/883] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:00:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:00:29.956351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b03cb0ba-516c-46fa-9954-516fa4c22efb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:29.957016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b03cb0ba-516c-46fa-9954-516fa4c22efb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:29.991888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b03cb0ba-516c-46fa-9954-516fa4c22efb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:29.992705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b03cb0ba-516c-46fa-9954-516fa4c22efb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:29.994928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b03cb0ba-516c-46fa-9954-516fa4c22efb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:29.995495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b03cb0ba-516c-46fa-9954-516fa4c22efb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:30.167287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b03cb0ba-516c-46fa-9954-516fa4c22efb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590be802bea346fc9240befaae60ec9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3ff9fdd7364a82ad3ed271a33da615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:30.177564 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b03cb0ba-516c-46fa-9954-516fa4c22efb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 200 len: 1372 microversion: 2.1 time: 0.228298 May 27 15:00:30.180418 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 453/884] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:29 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 1372 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:30.192282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fc887bb1-fe0a-486e-aac1-ec2b80f2e86b tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] Calling method '.version_select at 0x7fc776cf1820>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:30.452531 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fc887bb1-fe0a-486e-aac1-ec2b80f2e86b tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.263653 May 27 15:00:30.454387 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 454/885] 10.222.0.13 () {58 vars in 1163 bytes} [Fri May 27 15:00:30 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:00:30.464320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f299f2fe-f2bd-4431-80c7-53c0e7b8f870 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Action: 'create', calling method: .version_select at 0x7fc776d4a9d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1469561560", "public_key": " "}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:30.480824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-f299f2fe-f2bd-4431-80c7-53c0e7b8f870 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Getting quotas for project 4b6c6d7dd53844a48a9994286a6d75f2. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:00:30.486597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-f299f2fe-f2bd-4431-80c7-53c0e7b8f870 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Getting quotas for user da5e5fb6980a4d1192433dc394657527 and project 4b6c6d7dd53844a48a9994286a6d75f2. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:00:30.505589 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-f299f2fe-f2bd-4431-80c7-53c0e7b8f870 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f299f2fe-f2bd-4431-80c7-53c0e7b8f870 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Request method failure captured: May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 95 May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOd83QABh5awPtrXreYea-zAh7CyofBxfSAEWZDK-nBEeySvlDlMF8w3XXg3CiBS2msD9mWWUNyN6ixeeqKVHP1xxbySzEhXuU7WgEOMJQybaVnb6oJU4HlWTvFztMM2wmWbHasMEXjlMIFMDg59ikJcgtdBTk0NMxdGKenSP3ycmiY May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 4b6c6d7dd53844a48a9994286a6d75f2 May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4b6c6d7dd53844a48a9994286a6d75f2", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 4b6c6d7dd53844a48a9994286a6d75f2 May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-KeyPairsNegativeTestJSON-1541294451-project May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: da5e5fb6980a4d1192433dc394657527 May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1541294451-project May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1469561560", "public_key": " "}} May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: exception: Keypair data is invalid: failed to generate fingerprint May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1469561560', 'public_key': ' '}}} May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:30.508312 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f299f2fe-f2bd-4431-80c7-53c0e7b8f870 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f299f2fe-f2bd-4431-80c7-53c0e7b8f870 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.054028 May 27 15:00:30.514999 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 455/886] 10.222.0.13 () {60 vars in 1157 bytes} [Fri May 27 15:00:30 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 27 15:00:30.521114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-2cbcd653-e83d-4a7e-95cb-71ff4e9cd928 req-b7f59eac-0653-4504-bfd9-fc2e94b3901b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da2c6d0b-b6e3-43a9-870b-6f7493b08dfa", "tag": "77a08a17-7b75-4c05-a064-2f80d2e429a8"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:30.526056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2cbcd653-e83d-4a7e-95cb-71ff4e9cd928 req-b7f59eac-0653-4504-bfd9-fc2e94b3901b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:30.526756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2cbcd653-e83d-4a7e-95cb-71ff4e9cd928 req-b7f59eac-0653-4504-bfd9-fc2e94b3901b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:30.540248 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-2cbcd653-e83d-4a7e-95cb-71ff4e9cd928 req-b7f59eac-0653-4504-bfd9-fc2e94b3901b service nova] Creating event network-changed:77a08a17-7b75-4c05-a064-2f80d2e429a8 for instance da2c6d0b-b6e3-43a9-870b-6f7493b08dfa on n-h2-843621-1 May 27 15:00:30.546347 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-2cbcd653-e83d-4a7e-95cb-71ff4e9cd928 req-b7f59eac-0653-4504-bfd9-fc2e94b3901b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034643 May 27 15:00:30.547545 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 456/887] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:30.553364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9f2bc06a-23d7-4e4a-8501-01c24b6c6f5a tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '.version_select at 0x7fc776c50670>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:30.752331 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9f2bc06a-23d7-4e4a-8501-01c24b6c6f5a tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/70ec15ae-7f84-4cdc-be02-7937e080ae96" status: 200 len: 184 microversion: 2.1 time: 0.203295 May 27 15:00:30.753433 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 457/888] 10.222.0.13 () {58 vars in 1259 bytes} [Fri May 27 15:00:30 2022] GET /compute/v2.1/os-floating-ips/70ec15ae-7f84-4cdc-be02-7937e080ae96 => generated 184 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:30.759581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee21ec4b-c02a-436e-9aa2-4523e1c3c06d tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:30.789955 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ee21ec4b-c02a-436e-9aa2-4523e1c3c06d tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.029428 May 27 15:00:30.802538 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 458/889] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 15:00:30 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:30.807855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7c3af5ae-3485-433d-8412-436ed884d73a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:30.809014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7c3af5ae-3485-433d-8412-436ed884d73a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:30.816108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c3af5ae-3485-433d-8412-436ed884d73a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:30.816858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c3af5ae-3485-433d-8412-436ed884d73a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:30.818541 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c3af5ae-3485-433d-8412-436ed884d73a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:30.819151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c3af5ae-3485-433d-8412-436ed884d73a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:30.883370 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7c3af5ae-3485-433d-8412-436ed884d73a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5966aa558f434adda904f39536717363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f487ff60742dca747020a97818dbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:30.890800 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7c3af5ae-3485-433d-8412-436ed884d73a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97" status: 200 len: 1218 microversion: 2.1 time: 0.086842 May 27 15:00:30.891374 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 459/890] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:30 2022] GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:30.896489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-19e025cf-ea51-4328-862a-c1de9cb19e93 tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] Calling method '.version_select at 0x7fc776cf19d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:31.088989 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-19e025cf-ea51-4328-862a-c1de9cb19e93 tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.196490 May 27 15:00:31.089742 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 460/891] 10.222.0.13 () {58 vars in 1148 bytes} [Fri May 27 15:00:30 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:31.094695 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4a9b3753-5e8c-4097-8422-ff90ee20b5d7 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Action: 'create', calling method: .version_select at 0x7fc776c50ee0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrvGJF30jy5xsAWBeoexXby2dQaSnlhTzHWPjxfQIHFitoedKzGGM0WRyC4s6ravS5Cr2JGcvz70UX53Snt2jl2RxoRNFPaGwN56WaH0t6ycfFswnamXhi7SjGG3twGKg=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4a9b3753-5e8c-4097-8422-ff90ee20b5d7 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Request method failure captured: May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 507 May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOd83QABh5awPtrXreYea-zAh7CyofBxfSAEWZDK-nBEeySvlDlMF8w3XXg3CiBS2msD9mWWUNyN6ixeeqKVHP1xxbySzEhXuU7WgEOMJQybaVnb6oJU4HlWTvFztMM2wmWbHasMEXjlMIFMDg59ikJcgtdBTk0NMxdGKenSP3ycmiY May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 4b6c6d7dd53844a48a9994286a6d75f2 May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4b6c6d7dd53844a48a9994286a6d75f2", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 4b6c6d7dd53844a48a9994286a6d75f2 May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-KeyPairsNegativeTestJSON-1541294451-project May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: da5e5fb6980a4d1192433dc394657527 May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1541294451-project May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrvGJF30jy5xsAWBeoexXby2dQaSnlhTzHWPjxfQIHFitoedKzGGM0WRyC4s6ravS5Cr2JGcvz70UX53Snt2jl2RxoRNFPaGwN56WaH0t6ycfFswnamXhi7SjGG3twGKg=="}} May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrvGJF30jy5xsAWBeoexXby2dQaSnlhTzHWPjxfQIHFitoedKzGGM0WRyC4s6ravS5Cr2JGcvz70UX53Snt2jl2RxoRNFPaGwN56WaH0t6ycfFswnamXhi7SjGG3twGKg=='}}} May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance['keypair']: May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' May 27 15:00:31.099742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4a9b3753-5e8c-4097-8422-ff90ee20b5d7 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4a9b3753-5e8c-4097-8422-ff90ee20b5d7 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.010387 May 27 15:00:31.105040 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 461/892] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:00:31 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:00:31.110469 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3f6960fe-7b1d-40a4-869c-e2371ef9cd44 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.41"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:31.247961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3f6960fe-7b1d-40a4-869c-e2371ef9cd44 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:31.254189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f6960fe-7b1d-40a4-869c-e2371ef9cd44 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:31.254639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f6960fe-7b1d-40a4-869c-e2371ef9cd44 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:31.256024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f6960fe-7b1d-40a4-869c-e2371ef9cd44 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:31.256464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f6960fe-7b1d-40a4-869c-e2371ef9cd44 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:31.402659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:31.450846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f6960fe-7b1d-40a4-869c-e2371ef9cd44 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Acquired lock "refresh_cache-da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" {{(pid=119248) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 15:00:31.509615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=69,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:32.048211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-3f6960fe-7b1d-40a4-869c-e2371ef9cd44 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Building network info cache for instance {{(pid=119248) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 27 15:00:32.521434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-3f6960fe-7b1d-40a4-869c-e2371ef9cd44 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Updating instance_info_cache with network_info: [{"id": "77a08a17-7b75-4c05-a064-2f80d2e429a8", "address": "fa:16:3e:72:ff:a4", "network": {"id": "2c791768-302b-4ee2-b186-40f52faf1f15", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1339072895-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "27d1e6c35bdd45a986acf3213f2a84bf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap77a08a17-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119248) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 27 15:00:32.533916 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f6960fe-7b1d-40a4-869c-e2371ef9cd44 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Releasing lock "refresh_cache-da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" {{(pid=119248) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 15:00:32.534824 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3f6960fe-7b1d-40a4-869c-e2371ef9cd44 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "POST /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa/action" status: 202 len: 0 microversion: 2.1 time: 1.432188 May 27 15:00:32.535444 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 462/893] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:00:31 2022] POST /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa/action => generated 0 bytes in 1433 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 27 15:00:32.542038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b2fd4341-412d-4aad-af2c-e25269c51684 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:32.543192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b2fd4341-412d-4aad-af2c-e25269c51684 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:32.549240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2fd4341-412d-4aad-af2c-e25269c51684 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:32.549691 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2fd4341-412d-4aad-af2c-e25269c51684 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:32.550523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2fd4341-412d-4aad-af2c-e25269c51684 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:32.550960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2fd4341-412d-4aad-af2c-e25269c51684 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:32.578757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b2fd4341-412d-4aad-af2c-e25269c51684 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:32.585031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b2fd4341-412d-4aad-af2c-e25269c51684 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Old instance type tempest-test_resize_flavor_-996775872, new instance type m1.heat {{(pid=119248) resize /opt/stack/nova/nova/compute/api.py:4166}} May 27 15:00:32.591292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b2fd4341-412d-4aad-af2c-e25269c51684 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:00:32.592349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b2fd4341-412d-4aad-af2c-e25269c51684 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:00:32.592862 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b2fd4341-412d-4aad-af2c-e25269c51684 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:00:32.593278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b2fd4341-412d-4aad-af2c-e25269c51684 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:00:32.593693 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b2fd4341-412d-4aad-af2c-e25269c51684 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:00:32.622896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=4,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:32.658935 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b2fd4341-412d-4aad-af2c-e25269c51684 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "POST /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f/action" status: 202 len: 0 microversion: 2.1 time: 0.121401 May 27 15:00:32.659824 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 463/894] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:00:32 2022] POST /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:00:32.665857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0947ecef-7749-46e0-9bb4-15331eb96806 tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] Calling method '.version_select at 0x7fc776e8c310>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:33.385325 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0947ecef-7749-46e0-9bb4-15331eb96806 tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/d7d6c45d-c518-420b-9519-8aaa1d4c6d10" status: 202 len: 0 microversion: 2.1 time: 0.724158 May 27 15:00:33.386266 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 464/895] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 15:00:32 2022] DELETE /compute/v2.1/os-floating-ips/d7d6c45d-c518-420b-9519-8aaa1d4c6d10 => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:00:33.390947 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fd0260d4-8349-44bd-ab84-07ebbac29bd0 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Action: 'create', calling method: .version_select at 0x7fc776cf1d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1533715696", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:33.406615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-fd0260d4-8349-44bd-ab84-07ebbac29bd0 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Getting quotas for project 4b6c6d7dd53844a48a9994286a6d75f2. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:00:33.411781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-fd0260d4-8349-44bd-ab84-07ebbac29bd0 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Getting quotas for user da5e5fb6980a4d1192433dc394657527 and project 4b6c6d7dd53844a48a9994286a6d75f2. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:00:33.429331 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-fd0260d4-8349-44bd-ab84-07ebbac29bd0 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fd0260d4-8349-44bd-ab84-07ebbac29bd0 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Request method failure captured: May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 118 May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOd83QABh5awPtrXreYea-zAh7CyofBxfSAEWZDK-nBEeySvlDlMF8w3XXg3CiBS2msD9mWWUNyN6ixeeqKVHP1xxbySzEhXuU7WgEOMJQybaVnb6oJU4HlWTvFztMM2wmWbHasMEXjlMIFMDg59ikJcgtdBTk0NMxdGKenSP3ycmiY May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 4b6c6d7dd53844a48a9994286a6d75f2 May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4b6c6d7dd53844a48a9994286a6d75f2", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 4b6c6d7dd53844a48a9994286a6d75f2 May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-KeyPairsNegativeTestJSON-1541294451-project May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: da5e5fb6980a4d1192433dc394657527 May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1541294451-project May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1533715696", "public_key": "ssh-rsa JUNK nova@ubuntu"}} May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: exception: Keypair data is invalid: failed to generate fingerprint May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1533715696', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ValueError: Invalid data May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 27 15:00:33.431782 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fd0260d4-8349-44bd-ab84-07ebbac29bd0 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:00:33.436407 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fd0260d4-8349-44bd-ab84-07ebbac29bd0 tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.045988 May 27 15:00:33.439107 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 465/896] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:00:33 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 27 15:00:33.444069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f0a96aad-fc96-4745-a269-fbe1d4624526 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:33.444848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f0a96aad-fc96-4745-a269-fbe1d4624526 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:33.451087 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f0a96aad-fc96-4745-a269-fbe1d4624526 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:33.451550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f0a96aad-fc96-4745-a269-fbe1d4624526 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:33.452323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f0a96aad-fc96-4745-a269-fbe1d4624526 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:33.452987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f0a96aad-fc96-4745-a269-fbe1d4624526 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:33.579710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f0a96aad-fc96-4745-a269-fbe1d4624526 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590be802bea346fc9240befaae60ec9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3ff9fdd7364a82ad3ed271a33da615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:33.588471 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f0a96aad-fc96-4745-a269-fbe1d4624526 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 200 len: 1372 microversion: 2.1 time: 0.148588 May 27 15:00:33.589146 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 466/897] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:33 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:33.593858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-846cda8c-3fee-4bcc-babb-ebd62c4278e3 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:33.595055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-846cda8c-3fee-4bcc-babb-ebd62c4278e3 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:33.604448 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-846cda8c-3fee-4bcc-babb-ebd62c4278e3 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:33.604942 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-846cda8c-3fee-4bcc-babb-ebd62c4278e3 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:33.605734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-846cda8c-3fee-4bcc-babb-ebd62c4278e3 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:33.606370 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-846cda8c-3fee-4bcc-babb-ebd62c4278e3 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:33.670833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-846cda8c-3fee-4bcc-babb-ebd62c4278e3 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5966aa558f434adda904f39536717363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f487ff60742dca747020a97818dbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:33.679002 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-846cda8c-3fee-4bcc-babb-ebd62c4278e3 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97" status: 200 len: 1218 microversion: 2.1 time: 0.088985 May 27 15:00:33.679558 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 467/898] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:33 2022] GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:33.683941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d7623ab5-5b83-4e89-b59b-9e8df70615d3 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:33.684430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d7623ab5-5b83-4e89-b59b-9e8df70615d3 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:33.690026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7623ab5-5b83-4e89-b59b-9e8df70615d3 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:33.690477 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7623ab5-5b83-4e89-b59b-9e8df70615d3 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:33.691231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7623ab5-5b83-4e89-b59b-9e8df70615d3 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:33.691666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7623ab5-5b83-4e89-b59b-9e8df70615d3 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:33.715200 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d7623ab5-5b83-4e89-b59b-9e8df70615d3 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:00:33.761390 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.compute.api [None req-d7623ab5-5b83-4e89-b59b-9e8df70615d3 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Instance is already in deleting state, ignoring this request May 27 15:00:33.762197 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d7623ab5-5b83-4e89-b59b-9e8df70615d3 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5" status: 204 len: 0 microversion: 2.1 time: 0.081735 May 27 15:00:33.762746 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 468/899] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:00:33 2022] DELETE /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:00:33.767041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-c177d8a0-0f55-46ef-a01b-249aa340ec82 req-0287d24e-4287-4a5a-bc66-24079956b80b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da2c6d0b-b6e3-43a9-870b-6f7493b08dfa", "tag": "77a08a17-7b75-4c05-a064-2f80d2e429a8"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:33.774569 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c177d8a0-0f55-46ef-a01b-249aa340ec82 req-0287d24e-4287-4a5a-bc66-24079956b80b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:33.775013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c177d8a0-0f55-46ef-a01b-249aa340ec82 req-0287d24e-4287-4a5a-bc66-24079956b80b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:33.785433 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-c177d8a0-0f55-46ef-a01b-249aa340ec82 req-0287d24e-4287-4a5a-bc66-24079956b80b service nova] Creating event network-changed:77a08a17-7b75-4c05-a064-2f80d2e429a8 for instance da2c6d0b-b6e3-43a9-870b-6f7493b08dfa on n-h2-843621-1 May 27 15:00:33.793053 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-c177d8a0-0f55-46ef-a01b-249aa340ec82 req-0287d24e-4287-4a5a-bc66-24079956b80b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028362 May 27 15:00:33.794121 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 469/900] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:33.799435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a43df299-79a6-4e94-bc86-3d05eec2ff38 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:33.800325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a43df299-79a6-4e94-bc86-3d05eec2ff38 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:33.816589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a43df299-79a6-4e94-bc86-3d05eec2ff38 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:33.817136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a43df299-79a6-4e94-bc86-3d05eec2ff38 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:33.817952 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a43df299-79a6-4e94-bc86-3d05eec2ff38 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:33.818398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a43df299-79a6-4e94-bc86-3d05eec2ff38 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:33.952112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a43df299-79a6-4e94-bc86-3d05eec2ff38 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:33.959786 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a43df299-79a6-4e94-bc86-3d05eec2ff38 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1537 microversion: 2.1 time: 0.164582 May 27 15:00:33.960365 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 470/901] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:33 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1537 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:33.964955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8ea33363-4deb-4d1a-919c-d472b42bc651 tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] Calling method '.version_select at 0x7fc776cf14c0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:34.612963 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8ea33363-4deb-4d1a-919c-d472b42bc651 tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/1f449854-6639-452f-912f-3526679e6751" status: 202 len: 0 microversion: 2.1 time: 0.651403 May 27 15:00:34.613548 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 471/902] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 15:00:33 2022] DELETE /compute/v2.1/os-floating-ips/1f449854-6639-452f-912f-3526679e6751 => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:00:34.618122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2b0fa0f7-a60b-4d28-a325-99e44b3fd93c tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Calling method '.version_select at 0x7fc776c3ec10>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:34.628613 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-2b0fa0f7-a60b-4d28-a325-99e44b3fd93c tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1828775471 not found for user da5e5fb6980a4d1192433dc394657527 May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2b0fa0f7-a60b-4d28-a325-99e44b3fd93c tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Request method failure captured: May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1828775471 HTTP/1.1 May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOd83QABh5awPtrXreYea-zAh7CyofBxfSAEWZDK-nBEeySvlDlMF8w3XXg3CiBS2msD9mWWUNyN6ixeeqKVHP1xxbySzEhXuU7WgEOMJQybaVnb6oJU4HlWTvFztMM2wmWbHasMEXjlMIFMDg59ikJcgtdBTk0NMxdGKenSP3ycmiY May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 4b6c6d7dd53844a48a9994286a6d75f2 May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4b6c6d7dd53844a48a9994286a6d75f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4b6c6d7dd53844a48a9994286a6d75f2", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 4b6c6d7dd53844a48a9994286a6d75f2 May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1541294451 May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-KeyPairsNegativeTestJSON-1541294451-project May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: da5e5fb6980a4d1192433dc394657527 May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1541294451-project May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: exception: Keypair tempest-keypair-non-existent-1828775471 not found for user da5e5fb6980a4d1192433dc394657527 May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'tempest-keypair-non-existent-1828775471'} May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1828775471 not found for user da5e5fb6980a4d1192433dc394657527 May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:34.631081 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req, id) May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1828775471 not found for user da5e5fb6980a4d1192433dc394657527 May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1828775471 not found for user da5e5fb6980a4d1192433dc394657527 May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2b0fa0f7-a60b-4d28-a325-99e44b3fd93c tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1828775471 not found for user da5e5fb6980a4d1192433dc394657527 {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2b0fa0f7-a60b-4d28-a325-99e44b3fd93c tempest-KeyPairsNegativeTestJSON-1541294451 tempest-KeyPairsNegativeTestJSON-1541294451-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1828775471" status: 404 len: 145 microversion: 2.1 time: 0.017963 May 27 15:00:34.635113 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 472/903] 10.222.0.13 () {58 vars in 1259 bytes} [Fri May 27 15:00:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1828775471 => generated 145 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:00:34.638708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3e14999e-b431-44e9-9142-4ae6f5ec3e84 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:34.638936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3e14999e-b431-44e9-9142-4ae6f5ec3e84 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:34.644797 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e14999e-b431-44e9-9142-4ae6f5ec3e84 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:34.645250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e14999e-b431-44e9-9142-4ae6f5ec3e84 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:34.646711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e14999e-b431-44e9-9142-4ae6f5ec3e84 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:34.647155 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e14999e-b431-44e9-9142-4ae6f5ec3e84 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:34.863060 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3e14999e-b431-44e9-9142-4ae6f5ec3e84 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:34.873658 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3e14999e-b431-44e9-9142-4ae6f5ec3e84 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5" status: 200 len: 1526 microversion: 2.1 time: 0.239656 May 27 15:00:34.874358 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 473/904] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:34 2022] GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5 => generated 1526 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:34.888430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d3bdf1a5-cf4a-46eb-8ec9-05c3ab1fe6a4 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:34.889370 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d3bdf1a5-cf4a-46eb-8ec9-05c3ab1fe6a4 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:34.904233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d3bdf1a5-cf4a-46eb-8ec9-05c3ab1fe6a4 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:34.904723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d3bdf1a5-cf4a-46eb-8ec9-05c3ab1fe6a4 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:34.905511 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d3bdf1a5-cf4a-46eb-8ec9-05c3ab1fe6a4 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:34.905962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d3bdf1a5-cf4a-46eb-8ec9-05c3ab1fe6a4 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:35.473306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d3bdf1a5-cf4a-46eb-8ec9-05c3ab1fe6a4 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590be802bea346fc9240befaae60ec9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3ff9fdd7364a82ad3ed271a33da615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:35.482992 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d3bdf1a5-cf4a-46eb-8ec9-05c3ab1fe6a4 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 200 len: 1372 microversion: 2.1 time: 0.598128 May 27 15:00:35.483690 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 474/905] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:34 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 1372 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:35.504441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9abebea9-7c7a-490b-9a27-e9eb3ac136ce tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] Calling method '.version_select at 0x7fc776cf19d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:36.767324 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-13144d26-b178-4c04-9166-447ee41c9c15 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/action" status: 202 len: 0 microversion: 2.25 time: 15.548458 May 27 15:00:36.769429 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 432/906] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 27 15:00:21 2022] POST /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/action => generated 0 bytes in 15552 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 15:00:36.776898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-563b2eeb-c3ba-4525-ac3f-4550555e190c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:36.778569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-563b2eeb-c3ba-4525-ac3f-4550555e190c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:36.788704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-563b2eeb-c3ba-4525-ac3f-4550555e190c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:36.789912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-563b2eeb-c3ba-4525-ac3f-4550555e190c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:36.791327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-563b2eeb-c3ba-4525-ac3f-4550555e190c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:36.792145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-563b2eeb-c3ba-4525-ac3f-4550555e190c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:36.980515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-563b2eeb-c3ba-4525-ac3f-4550555e190c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5966aa558f434adda904f39536717363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f487ff60742dca747020a97818dbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:36.989973 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-563b2eeb-c3ba-4525-ac3f-4550555e190c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97" status: 200 len: 1272 microversion: 2.1 time: 0.217789 May 27 15:00:36.991404 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 433/907] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:36 2022] GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97 => generated 1272 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:36.997719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4326d0e8-25d3-4873-bab9-8ed2806d02b3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:36.998618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4326d0e8-25d3-4873-bab9-8ed2806d02b3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:37.000033 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9abebea9-7c7a-490b-9a27-e9eb3ac136ce tempest-FloatingIPDetailsTestJSON-687998363 tempest-FloatingIPDetailsTestJSON-687998363-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/04734be4-205f-4813-8409-841512066bb2" status: 202 len: 0 microversion: 2.1 time: 1.504058 May 27 15:00:37.000831 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 475/908] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 15:00:35 2022] DELETE /compute/v2.1/os-floating-ips/04734be4-205f-4813-8409-841512066bb2 => generated 0 bytes in 1517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:00:37.005993 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-236e0e05-cab0-40dd-bad8-11414d9b90b8 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:37.006680 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-236e0e05-cab0-40dd-bad8-11414d9b90b8 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:37.015131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-236e0e05-cab0-40dd-bad8-11414d9b90b8 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:37.015935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-236e0e05-cab0-40dd-bad8-11414d9b90b8 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:37.016992 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-236e0e05-cab0-40dd-bad8-11414d9b90b8 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:37.017658 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-236e0e05-cab0-40dd-bad8-11414d9b90b8 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:37.023233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4326d0e8-25d3-4873-bab9-8ed2806d02b3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:37.023712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4326d0e8-25d3-4873-bab9-8ed2806d02b3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:37.025849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4326d0e8-25d3-4873-bab9-8ed2806d02b3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:37.026386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4326d0e8-25d3-4873-bab9-8ed2806d02b3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:37.509118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-236e0e05-cab0-40dd-bad8-11414d9b90b8 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:37.518074 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-236e0e05-cab0-40dd-bad8-11414d9b90b8 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5" status: 200 len: 1526 microversion: 2.1 time: 0.516134 May 27 15:00:37.518655 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 476/909] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:37 2022] GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5 => generated 1526 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:37.523454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-ff3493b3-4495-4dfa-bae2-5e1fbb11b910 req-77495e78-c6f4-4997-b6b8-0853db66de66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ae8a942-8725-474d-a782-1faf50e606b3", "tag": "34f5db1a-cf77-4163-b1d7-8eace101a7e7"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:37.532304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-ff3493b3-4495-4dfa-bae2-5e1fbb11b910 req-77495e78-c6f4-4997-b6b8-0853db66de66 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:37.533229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-ff3493b3-4495-4dfa-bae2-5e1fbb11b910 req-77495e78-c6f4-4997-b6b8-0853db66de66 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:37.535694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4326d0e8-25d3-4873-bab9-8ed2806d02b3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:37.544829 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4326d0e8-25d3-4873-bab9-8ed2806d02b3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1537 microversion: 2.1 time: 0.552070 May 27 15:00:37.546008 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 434/910] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:36 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1537 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:37.556633 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-ff3493b3-4495-4dfa-bae2-5e1fbb11b910 req-77495e78-c6f4-4997-b6b8-0853db66de66 service nova] Creating event network-changed:34f5db1a-cf77-4163-b1d7-8eace101a7e7 for instance 1ae8a942-8725-474d-a782-1faf50e606b3 on n-h1-843621-1 May 27 15:00:37.559253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6b1625fb-fa39-48c4-be37-5b15522af875 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:37.560179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6b1625fb-fa39-48c4-be37-5b15522af875 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:37.564247 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-ff3493b3-4495-4dfa-bae2-5e1fbb11b910 req-77495e78-c6f4-4997-b6b8-0853db66de66 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043989 May 27 15:00:37.565606 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 477/911] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:37.569191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b1625fb-fa39-48c4-be37-5b15522af875 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:37.569884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b1625fb-fa39-48c4-be37-5b15522af875 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:37.570927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b1625fb-fa39-48c4-be37-5b15522af875 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:37.571512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b1625fb-fa39-48c4-be37-5b15522af875 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:37.574282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-144d9c96-14ab-460c-bac1-3e22612ef3a1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:37.575091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-144d9c96-14ab-460c-bac1-3e22612ef3a1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:37.582936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-144d9c96-14ab-460c-bac1-3e22612ef3a1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:37.583453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-144d9c96-14ab-460c-bac1-3e22612ef3a1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:37.585610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-144d9c96-14ab-460c-bac1-3e22612ef3a1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:37.586685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-144d9c96-14ab-460c-bac1-3e22612ef3a1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:38.002961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6b1625fb-fa39-48c4-be37-5b15522af875 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590be802bea346fc9240befaae60ec9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3ff9fdd7364a82ad3ed271a33da615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:38.011700 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6b1625fb-fa39-48c4-be37-5b15522af875 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 200 len: 1372 microversion: 2.1 time: 0.464285 May 27 15:00:38.012954 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 435/912] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:37 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 1372 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:38.022669 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-144d9c96-14ab-460c-bac1-3e22612ef3a1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:38.038666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-144d9c96-14ab-460c-bac1-3e22612ef3a1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:38.040106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-aad77a6c-2704-4d2c-881a-1becdc87267b req-3cda5020-a392-40f2-b659-839d4d9d69ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b37ac407-852e-4ffa-995b-114d7d74bed5", "name": "network-vif-deleted", "tag": "e938d86e-65f4-4b40-9216-916175c13d97"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:38.043799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-144d9c96-14ab-460c-bac1-3e22612ef3a1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:38.046642 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-144d9c96-14ab-460c-bac1-3e22612ef3a1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.478529 May 27 15:00:38.048569 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 478/913] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:37 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:00:38.057083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-aad77a6c-2704-4d2c-881a-1becdc87267b req-3cda5020-a392-40f2-b659-839d4d9d69ee service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:38.057588 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-aad77a6c-2704-4d2c-881a-1becdc87267b req-3cda5020-a392-40f2-b659-839d4d9d69ee service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:38.063017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-873960fe-f14b-4319-96a8-873777d1989d tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:38.063772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-873960fe-f14b-4319-96a8-873777d1989d tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:38.078733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-873960fe-f14b-4319-96a8-873777d1989d tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:38.079197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-873960fe-f14b-4319-96a8-873777d1989d tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:38.080001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-873960fe-f14b-4319-96a8-873777d1989d tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:38.084780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-873960fe-f14b-4319-96a8-873777d1989d tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:38.093544 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-aad77a6c-2704-4d2c-881a-1becdc87267b req-3cda5020-a392-40f2-b659-839d4d9d69ee service nova] Creating event network-vif-deleted:e938d86e-65f4-4b40-9216-916175c13d97 for instance b37ac407-852e-4ffa-995b-114d7d74bed5 on n-h1-843621-1 May 27 15:00:38.106140 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-aad77a6c-2704-4d2c-881a-1becdc87267b req-3cda5020-a392-40f2-b659-839d4d9d69ee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091268 May 27 15:00:38.108744 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 436/914] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:38.222250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-873960fe-f14b-4319-96a8-873777d1989d tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5966aa558f434adda904f39536717363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f487ff60742dca747020a97818dbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:38.235164 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-873960fe-f14b-4319-96a8-873777d1989d tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97" status: 200 len: 1272 microversion: 2.1 time: 0.184191 May 27 15:00:38.236177 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 479/915] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:38 2022] GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97 => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:38.536783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-062aab10-68d1-4b38-b5c6-87f971feb4b7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:38.537633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-062aab10-68d1-4b38-b5c6-87f971feb4b7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:38.545403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-062aab10-68d1-4b38-b5c6-87f971feb4b7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:38.546000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-062aab10-68d1-4b38-b5c6-87f971feb4b7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:38.546935 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-062aab10-68d1-4b38-b5c6-87f971feb4b7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:38.547511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-062aab10-68d1-4b38-b5c6-87f971feb4b7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:38.563482 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-216e8607-7e87-4226-a1a6-03ca1756e077 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:38.564112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-216e8607-7e87-4226-a1a6-03ca1756e077 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:38.577134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-216e8607-7e87-4226-a1a6-03ca1756e077 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:38.577599 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-216e8607-7e87-4226-a1a6-03ca1756e077 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:38.578385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-216e8607-7e87-4226-a1a6-03ca1756e077 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:38.578859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-216e8607-7e87-4226-a1a6-03ca1756e077 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:38.698525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-062aab10-68d1-4b38-b5c6-87f971feb4b7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:38.712063 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-062aab10-68d1-4b38-b5c6-87f971feb4b7 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5" status: 200 len: 1484 microversion: 2.1 time: 0.180219 May 27 15:00:38.713183 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 437/916] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:38 2022] GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5 => generated 1484 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:38.915870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-216e8607-7e87-4226-a1a6-03ca1756e077 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:38.923534 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-216e8607-7e87-4226-a1a6-03ca1756e077 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1542 microversion: 2.1 time: 0.364162 May 27 15:00:38.933912 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 480/917] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:38 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1542 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:39.031863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f0233a61-9c4f-49c8-ad33-63ab3369b9f9 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:39.033580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f0233a61-9c4f-49c8-ad33-63ab3369b9f9 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:39.043143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0233a61-9c4f-49c8-ad33-63ab3369b9f9 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:39.044132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0233a61-9c4f-49c8-ad33-63ab3369b9f9 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:39.045220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0233a61-9c4f-49c8-ad33-63ab3369b9f9 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:39.046950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0233a61-9c4f-49c8-ad33-63ab3369b9f9 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:39.066278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-24263416-0e3b-478b-b1cf-2a626d69f94a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:39.066985 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-24263416-0e3b-478b-b1cf-2a626d69f94a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:39.078240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24263416-0e3b-478b-b1cf-2a626d69f94a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:39.085381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24263416-0e3b-478b-b1cf-2a626d69f94a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:39.086478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24263416-0e3b-478b-b1cf-2a626d69f94a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:39.087264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24263416-0e3b-478b-b1cf-2a626d69f94a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:39.725797 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f0233a61-9c4f-49c8-ad33-63ab3369b9f9 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590be802bea346fc9240befaae60ec9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3ff9fdd7364a82ad3ed271a33da615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:39.734799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-24263416-0e3b-478b-b1cf-2a626d69f94a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:39.760439 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f0233a61-9c4f-49c8-ad33-63ab3369b9f9 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 200 len: 1372 microversion: 2.1 time: 0.734395 May 27 15:00:39.762007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-24263416-0e3b-478b-b1cf-2a626d69f94a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:39.772189 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 438/918] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:39 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 1372 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:39.776573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-24263416-0e3b-478b-b1cf-2a626d69f94a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:39.778972 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-24263416-0e3b-478b-b1cf-2a626d69f94a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.717970 May 27 15:00:39.783583 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 481/919] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:39 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:00:39.785599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-677b7134-adad-4bf0-8a93-94410a9b64f9 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:39.788860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-677b7134-adad-4bf0-8a93-94410a9b64f9 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:39.789446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:39.795928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-677b7134-adad-4bf0-8a93-94410a9b64f9 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:39.796749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-677b7134-adad-4bf0-8a93-94410a9b64f9 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:39.797303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1d963b04-b7c6-4f9d-a38d-3fdb303ff96b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:39.797887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-677b7134-adad-4bf0-8a93-94410a9b64f9 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:39.798556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-677b7134-adad-4bf0-8a93-94410a9b64f9 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:39.799450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1d963b04-b7c6-4f9d-a38d-3fdb303ff96b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:39.810803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d963b04-b7c6-4f9d-a38d-3fdb303ff96b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:39.811327 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d963b04-b7c6-4f9d-a38d-3fdb303ff96b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:39.812231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d963b04-b7c6-4f9d-a38d-3fdb303ff96b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:39.812692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d963b04-b7c6-4f9d-a38d-3fdb303ff96b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:39.955998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1d963b04-b7c6-4f9d-a38d-3fdb303ff96b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:39.973425 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1d963b04-b7c6-4f9d-a38d-3fdb303ff96b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5" status: 200 len: 1309 microversion: 2.1 time: 0.188526 May 27 15:00:39.974028 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 482/920] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:39 2022] GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5 => generated 1309 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:39.982765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a224fdbe-e120-49ef-860b-eeda2544753e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:39.982765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a224fdbe-e120-49ef-860b-eeda2544753e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:39.985227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a224fdbe-e120-49ef-860b-eeda2544753e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:39.985685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a224fdbe-e120-49ef-860b-eeda2544753e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:39.986779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a224fdbe-e120-49ef-860b-eeda2544753e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:39.986905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a224fdbe-e120-49ef-860b-eeda2544753e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:40.150513 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-677b7134-adad-4bf0-8a93-94410a9b64f9 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5966aa558f434adda904f39536717363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f487ff60742dca747020a97818dbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:40.164299 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-677b7134-adad-4bf0-8a93-94410a9b64f9 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97" status: 200 len: 1314 microversion: 2.1 time: 0.390330 May 27 15:00:40.165531 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 439/921] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:39 2022] GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:40.317232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a224fdbe-e120-49ef-860b-eeda2544753e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:40.333535 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a224fdbe-e120-49ef-860b-eeda2544753e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1542 microversion: 2.1 time: 0.358435 May 27 15:00:40.334550 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 483/922] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:39 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1542 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:40.779419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2c134d15-e4f2-4a76-8cd1-ebc900eda5a1 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:40.780453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2c134d15-e4f2-4a76-8cd1-ebc900eda5a1 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:40.793668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c134d15-e4f2-4a76-8cd1-ebc900eda5a1 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:40.796196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c134d15-e4f2-4a76-8cd1-ebc900eda5a1 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:40.797263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c134d15-e4f2-4a76-8cd1-ebc900eda5a1 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:40.797907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c134d15-e4f2-4a76-8cd1-ebc900eda5a1 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:40.801416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f00c62c3-9177-4fc6-8c86-5e0ed566bc55 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:40.802522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f00c62c3-9177-4fc6-8c86-5e0ed566bc55 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:40.813934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f00c62c3-9177-4fc6-8c86-5e0ed566bc55 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:40.814832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f00c62c3-9177-4fc6-8c86-5e0ed566bc55 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:40.818539 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f00c62c3-9177-4fc6-8c86-5e0ed566bc55 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:40.819541 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f00c62c3-9177-4fc6-8c86-5e0ed566bc55 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:41.221720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2c134d15-e4f2-4a76-8cd1-ebc900eda5a1 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590be802bea346fc9240befaae60ec9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3ff9fdd7364a82ad3ed271a33da615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:41.237604 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2c134d15-e4f2-4a76-8cd1-ebc900eda5a1 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 200 len: 1372 microversion: 2.1 time: 0.461662 May 27 15:00:41.247553 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 440/923] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:40 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 1372 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:41.252816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-40c6b155-51fa-42fe-910c-84527e8721aa tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:41.253449 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-40c6b155-51fa-42fe-910c-84527e8721aa tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: b37ac407-852e-4ffa-995b-114d7d74bed5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:41.274090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40c6b155-51fa-42fe-910c-84527e8721aa tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:41.274539 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40c6b155-51fa-42fe-910c-84527e8721aa tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:41.275344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40c6b155-51fa-42fe-910c-84527e8721aa tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:41.275794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40c6b155-51fa-42fe-910c-84527e8721aa tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:41.284116 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f00c62c3-9177-4fc6-8c86-5e0ed566bc55 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:41.292005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:41.298726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f00c62c3-9177-4fc6-8c86-5e0ed566bc55 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:41.302588 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-40c6b155-51fa-42fe-910c-84527e8721aa tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] HTTP exception thrown: Instance b37ac407-852e-4ffa-995b-114d7d74bed5 could not be found. May 27 15:00:41.304057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f00c62c3-9177-4fc6-8c86-5e0ed566bc55 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-40c6b155-51fa-42fe-910c-84527e8721aa tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Request method failure captured: May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5 HTTP/1.1 May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOc_KZXRiB_3V0Ut0CGPITzCZSFj3bXcxC_wJnHHonBMr3KV07i59OUsvME94axLWlSc8PCxTTNCzanIXU215iN3PWiBPaOYb8YkwFs7nQR-AosFaXRlYJ-QOpNMX0-mi9fYXdBmhGtefeujEm1_9pUfve-Q545yYEX-e9IB7M1W0YM May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 27d1e6c35bdd45a986acf3213f2a84bf May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1404390607 May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/27d1e6c35bdd45a986acf3213f2a84bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/27d1e6c35bdd45a986acf3213f2a84bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/27d1e6c35bdd45a986acf3213f2a84bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_27d1e6c35bdd45a986acf3213f2a84bf", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1404390607 May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 27d1e6c35bdd45a986acf3213f2a84bf May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1404390607 May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-FloatingIPsAssociationTestJSON-1404390607-project May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 7fd8811631894240aa46c7f87b3c8506 May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1404390607-project May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance b37ac407-852e-4ffa-995b-114d7d74bed5 could not be found. May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'b37ac407-852e-4ffa-995b-114d7d74bed5'} May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b37ac407-852e-4ffa-995b-114d7d74bed5 could not be found. May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b37ac407-852e-4ffa-995b-114d7d74bed5 could not be found. May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:41.304291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:41.309066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:41.309066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:41.309066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:41.309066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:41.309066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:00:41.309066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:00:41.309066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b37ac407-852e-4ffa-995b-114d7d74bed5 could not be found. May 27 15:00:41.309066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:41.309834 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f00c62c3-9177-4fc6-8c86-5e0ed566bc55 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.508990 May 27 15:00:41.318922 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-40c6b155-51fa-42fe-910c-84527e8721aa tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Returning 404 to user: Instance b37ac407-852e-4ffa-995b-114d7d74bed5 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:00:41.320276 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 484/924] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:40 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:00:41.324917 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-40c6b155-51fa-42fe-910c-84527e8721aa tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5" status: 404 len: 111 microversion: 2.1 time: 0.071336 May 27 15:00:41.325979 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 441/925] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:41 2022] GET /compute/v2.1/servers/b37ac407-852e-4ffa-995b-114d7d74bed5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:00:41.332220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bf73ceee-61d8-4093-a5a7-01371eaea742 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:41.334449 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8c96871f-6f21-4c2e-93f4-30f069d9e37a tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '.version_select at 0x7fc7772a6160>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:41.334829 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bf73ceee-61d8-4093-a5a7-01371eaea742 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:41.362446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf73ceee-61d8-4093-a5a7-01371eaea742 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:41.362912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf73ceee-61d8-4093-a5a7-01371eaea742 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:41.371197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf73ceee-61d8-4093-a5a7-01371eaea742 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:41.371686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf73ceee-61d8-4093-a5a7-01371eaea742 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:41.921242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bf73ceee-61d8-4093-a5a7-01371eaea742 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5966aa558f434adda904f39536717363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f487ff60742dca747020a97818dbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:41.931068 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bf73ceee-61d8-4093-a5a7-01371eaea742 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97" status: 200 len: 1314 microversion: 2.1 time: 0.609711 May 27 15:00:41.932779 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 485/926] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:41 2022] GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97 => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:41.938690 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4b5f863e-1a41-4df4-ba60-e2548f66ed76 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:41.960043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4b5f863e-1a41-4df4-ba60-e2548f66ed76 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:41.977966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b5f863e-1a41-4df4-ba60-e2548f66ed76 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:41.978460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b5f863e-1a41-4df4-ba60-e2548f66ed76 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:41.982559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b5f863e-1a41-4df4-ba60-e2548f66ed76 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:41.983011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b5f863e-1a41-4df4-ba60-e2548f66ed76 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:42.488577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4b5f863e-1a41-4df4-ba60-e2548f66ed76 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:42.498346 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4b5f863e-1a41-4df4-ba60-e2548f66ed76 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1542 microversion: 2.1 time: 0.564123 May 27 15:00:42.500730 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 486/927] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:41 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1542 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:42.522945 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e9343fd-b5e2-45c3-add0-eaa91b47aa7f tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:42.528337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e9343fd-b5e2-45c3-add0-eaa91b47aa7f tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:42.552631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e9343fd-b5e2-45c3-add0-eaa91b47aa7f tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:42.553115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e9343fd-b5e2-45c3-add0-eaa91b47aa7f tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:42.553909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e9343fd-b5e2-45c3-add0-eaa91b47aa7f tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:42.554356 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e9343fd-b5e2-45c3-add0-eaa91b47aa7f tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:42.986886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e9343fd-b5e2-45c3-add0-eaa91b47aa7f tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590be802bea346fc9240befaae60ec9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3ff9fdd7364a82ad3ed271a33da615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:43.001107 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e9343fd-b5e2-45c3-add0-eaa91b47aa7f tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 200 len: 1372 microversion: 2.1 time: 0.501139 May 27 15:00:43.001702 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 487/928] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:42 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 1372 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:43.025779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5f22f91e-f680-46ff-87d0-b154d74337b5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:43.026396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5f22f91e-f680-46ff-87d0-b154d74337b5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:43.044497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f22f91e-f680-46ff-87d0-b154d74337b5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:43.046466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f22f91e-f680-46ff-87d0-b154d74337b5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:43.047481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f22f91e-f680-46ff-87d0-b154d74337b5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:43.048097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f22f91e-f680-46ff-87d0-b154d74337b5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:43.296729 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5f22f91e-f680-46ff-87d0-b154d74337b5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:43.307630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5f22f91e-f680-46ff-87d0-b154d74337b5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:43.309191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5f22f91e-f680-46ff-87d0-b154d74337b5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:43.310403 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5f22f91e-f680-46ff-87d0-b154d74337b5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.288577 May 27 15:00:43.310970 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 488/929] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:43 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:00:43.321569 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-effdb2a7-0eb8-4919-8be4-3f66701b8f2c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:43.333128 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-effdb2a7-0eb8-4919-8be4-3f66701b8f2c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:43.346051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-effdb2a7-0eb8-4919-8be4-3f66701b8f2c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:43.346802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-effdb2a7-0eb8-4919-8be4-3f66701b8f2c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:43.347756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-effdb2a7-0eb8-4919-8be4-3f66701b8f2c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:43.348995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-effdb2a7-0eb8-4919-8be4-3f66701b8f2c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:43.418731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=22 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:44.034257 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8c96871f-6f21-4c2e-93f4-30f069d9e37a tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/70ec15ae-7f84-4cdc-be02-7937e080ae96" status: 202 len: 0 microversion: 2.1 time: 2.703198 May 27 15:00:44.037380 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 442/930] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 15:00:41 2022] DELETE /compute/v2.1/os-floating-ips/70ec15ae-7f84-4cdc-be02-7937e080ae96 => generated 0 bytes in 2707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:00:44.042397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8b46dfd0-58ea-4642-a2af-a0c42e7a8ec3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:44.043040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8b46dfd0-58ea-4642-a2af-a0c42e7a8ec3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:44.054273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b46dfd0-58ea-4642-a2af-a0c42e7a8ec3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:44.054729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b46dfd0-58ea-4642-a2af-a0c42e7a8ec3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:44.055531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b46dfd0-58ea-4642-a2af-a0c42e7a8ec3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:44.056031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b46dfd0-58ea-4642-a2af-a0c42e7a8ec3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:44.186875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-effdb2a7-0eb8-4919-8be4-3f66701b8f2c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5966aa558f434adda904f39536717363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f487ff60742dca747020a97818dbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:44.201277 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-effdb2a7-0eb8-4919-8be4-3f66701b8f2c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97" status: 200 len: 1314 microversion: 2.1 time: 0.888192 May 27 15:00:44.212043 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 489/931] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:43 2022] GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97 => generated 1314 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:44.218420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-56d5b661-8f25-4f62-af6b-b2cc3719fa46 req-edb8a38e-c4f5-4255-9457-4023cff664f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ae8a942-8725-474d-a782-1faf50e606b3", "name": "network-vif-plugged", "status": "completed", "tag": "34f5db1a-cf77-4163-b1d7-8eace101a7e7"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:44.229328 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-56d5b661-8f25-4f62-af6b-b2cc3719fa46 req-edb8a38e-c4f5-4255-9457-4023cff664f8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:44.230345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-56d5b661-8f25-4f62-af6b-b2cc3719fa46 req-edb8a38e-c4f5-4255-9457-4023cff664f8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:44.247165 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-56d5b661-8f25-4f62-af6b-b2cc3719fa46 req-edb8a38e-c4f5-4255-9457-4023cff664f8 service nova] Creating event network-vif-plugged:34f5db1a-cf77-4163-b1d7-8eace101a7e7 for instance 1ae8a942-8725-474d-a782-1faf50e606b3 on n-h1-843621-1 May 27 15:00:44.257885 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-56d5b661-8f25-4f62-af6b-b2cc3719fa46 req-edb8a38e-c4f5-4255-9457-4023cff664f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044199 May 27 15:00:44.259106 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 490/932] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:44.262254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8b46dfd0-58ea-4642-a2af-a0c42e7a8ec3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:44.266844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-c7f4012b-c96b-43bd-9945-fb52b1eb9d6b req-b3b232f6-fc30-425c-982f-7497cd578516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bced7f1-2fc9-401b-98fa-75a47d092a97", "tag": "d33cd803-d7a9-4b4e-a1dc-4e0fc0e3d290"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:44.271382 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8b46dfd0-58ea-4642-a2af-a0c42e7a8ec3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1542 microversion: 2.1 time: 0.232831 May 27 15:00:44.273482 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 443/933] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:44 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1542 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:44.278894 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7564bc33-390a-43f2-8b07-68e7e16ea018 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:44.279871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7564bc33-390a-43f2-8b07-68e7e16ea018 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:44.287201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7564bc33-390a-43f2-8b07-68e7e16ea018 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:44.288182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7564bc33-390a-43f2-8b07-68e7e16ea018 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:44.288881 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c7f4012b-c96b-43bd-9945-fb52b1eb9d6b req-b3b232f6-fc30-425c-982f-7497cd578516 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:44.289354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c7f4012b-c96b-43bd-9945-fb52b1eb9d6b req-b3b232f6-fc30-425c-982f-7497cd578516 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:44.289628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7564bc33-390a-43f2-8b07-68e7e16ea018 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:44.290225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7564bc33-390a-43f2-8b07-68e7e16ea018 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:44.327850 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-c7f4012b-c96b-43bd-9945-fb52b1eb9d6b req-b3b232f6-fc30-425c-982f-7497cd578516 service nova] Creating event network-changed:d33cd803-d7a9-4b4e-a1dc-4e0fc0e3d290 for instance 0bced7f1-2fc9-401b-98fa-75a47d092a97 on n-h1-843621-1 May 27 15:00:44.357780 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-c7f4012b-c96b-43bd-9945-fb52b1eb9d6b req-b3b232f6-fc30-425c-982f-7497cd578516 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096802 May 27 15:00:44.359764 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 491/934] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:44.376831 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9310dd6f-ef23-466f-8b0b-1f961323c130 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:44.381872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9310dd6f-ef23-466f-8b0b-1f961323c130 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:44.393779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9310dd6f-ef23-466f-8b0b-1f961323c130 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:44.394579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9310dd6f-ef23-466f-8b0b-1f961323c130 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:44.397302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9310dd6f-ef23-466f-8b0b-1f961323c130 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:44.398535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9310dd6f-ef23-466f-8b0b-1f961323c130 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:44.466319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9310dd6f-ef23-466f-8b0b-1f961323c130 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:00:44.653275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:44.694756 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9310dd6f-ef23-466f-8b0b-1f961323c130 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "DELETE /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" status: 204 len: 0 microversion: 2.1 time: 0.333386 May 27 15:00:44.695827 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 492/935] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:00:44 2022] DELETE /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:00:44.701966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-340a6558-0f64-4a02-89b8-89d42d9e596b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:44.704441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-340a6558-0f64-4a02-89b8-89d42d9e596b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:44.721438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-340a6558-0f64-4a02-89b8-89d42d9e596b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:44.722196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-340a6558-0f64-4a02-89b8-89d42d9e596b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:44.723187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-340a6558-0f64-4a02-89b8-89d42d9e596b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:44.724835 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-340a6558-0f64-4a02-89b8-89d42d9e596b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:44.816300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7564bc33-390a-43f2-8b07-68e7e16ea018 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590be802bea346fc9240befaae60ec9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3ff9fdd7364a82ad3ed271a33da615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:44.830330 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7564bc33-390a-43f2-8b07-68e7e16ea018 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 200 len: 1372 microversion: 2.1 time: 0.554991 May 27 15:00:44.830935 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 444/936] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:44 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 1372 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:44.843965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a9130cd8-5b42-44f9-88b7-85d86820e759 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:44.845243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a9130cd8-5b42-44f9-88b7-85d86820e759 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:44.853379 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a9130cd8-5b42-44f9-88b7-85d86820e759 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:44.854058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a9130cd8-5b42-44f9-88b7-85d86820e759 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:44.856191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a9130cd8-5b42-44f9-88b7-85d86820e759 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:44.856849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a9130cd8-5b42-44f9-88b7-85d86820e759 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:45.147368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-340a6558-0f64-4a02-89b8-89d42d9e596b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:45.163471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-340a6558-0f64-4a02-89b8-89d42d9e596b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:45.170256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-340a6558-0f64-4a02-89b8-89d42d9e596b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:45.171851 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-340a6558-0f64-4a02-89b8-89d42d9e596b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.474511 May 27 15:00:45.175806 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 493/937] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:44 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:00:45.188783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a9130cd8-5b42-44f9-88b7-85d86820e759 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:45.201051 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a9130cd8-5b42-44f9-88b7-85d86820e759 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" status: 200 len: 1527 microversion: 2.1 time: 0.362733 May 27 15:00:45.212952 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 445/938] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:44 2022] GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa => generated 1527 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:45.218913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-17c251a2-d0af-440a-8a33-36b9a82a706a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:45.220121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-17c251a2-d0af-440a-8a33-36b9a82a706a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:45.230180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-17c251a2-d0af-440a-8a33-36b9a82a706a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:45.233162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-17c251a2-d0af-440a-8a33-36b9a82a706a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:45.234913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-17c251a2-d0af-440a-8a33-36b9a82a706a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:45.235548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-17c251a2-d0af-440a-8a33-36b9a82a706a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:45.290650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9f44abac-49f1-4b99-9806-c59293fdc44f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:45.291331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9f44abac-49f1-4b99-9806-c59293fdc44f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:45.304534 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f44abac-49f1-4b99-9806-c59293fdc44f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:45.307446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f44abac-49f1-4b99-9806-c59293fdc44f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:45.308600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f44abac-49f1-4b99-9806-c59293fdc44f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:45.309290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f44abac-49f1-4b99-9806-c59293fdc44f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:45.986252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-17c251a2-d0af-440a-8a33-36b9a82a706a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5966aa558f434adda904f39536717363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f487ff60742dca747020a97818dbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:45.999785 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-17c251a2-d0af-440a-8a33-36b9a82a706a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97" status: 200 len: 1314 microversion: 2.1 time: 0.784554 May 27 15:00:46.004345 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 494/939] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:45 2022] GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97 => generated 1314 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:46.015678 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2b5c61d0-49ee-45ed-976e-956b3aa385a9 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:46.016503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2b5c61d0-49ee-45ed-976e-956b3aa385a9 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:46.028519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b5c61d0-49ee-45ed-976e-956b3aa385a9 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:46.029259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b5c61d0-49ee-45ed-976e-956b3aa385a9 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:46.036956 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b5c61d0-49ee-45ed-976e-956b3aa385a9 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:46.037755 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b5c61d0-49ee-45ed-976e-956b3aa385a9 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:46.059710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9f44abac-49f1-4b99-9806-c59293fdc44f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:46.072812 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9f44abac-49f1-4b99-9806-c59293fdc44f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1542 microversion: 2.1 time: 0.786816 May 27 15:00:46.073941 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 446/940] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:45 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1542 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:46.190730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-76502edc-7f96-4ef2-ae88-04dfa57dc809 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:46.192201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-76502edc-7f96-4ef2-ae88-04dfa57dc809 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:46.210668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76502edc-7f96-4ef2-ae88-04dfa57dc809 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:46.211129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76502edc-7f96-4ef2-ae88-04dfa57dc809 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:46.216045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76502edc-7f96-4ef2-ae88-04dfa57dc809 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:46.216578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76502edc-7f96-4ef2-ae88-04dfa57dc809 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:46.464476 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2b5c61d0-49ee-45ed-976e-956b3aa385a9 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590be802bea346fc9240befaae60ec9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3ff9fdd7364a82ad3ed271a33da615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:46.475130 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2b5c61d0-49ee-45ed-976e-956b3aa385a9 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 200 len: 1372 microversion: 2.1 time: 0.468943 May 27 15:00:46.479403 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 495/941] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:46 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 1372 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:46.487633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b8a607a8-92de-4d29-bf87-a3cf45d669c3 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:46.497037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b8a607a8-92de-4d29-bf87-a3cf45d669c3 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:46.548909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b8a607a8-92de-4d29-bf87-a3cf45d669c3 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:46.550001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b8a607a8-92de-4d29-bf87-a3cf45d669c3 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:46.550903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b8a607a8-92de-4d29-bf87-a3cf45d669c3 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:46.551387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b8a607a8-92de-4d29-bf87-a3cf45d669c3 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:46.746766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-76502edc-7f96-4ef2-ae88-04dfa57dc809 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:46.762511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-76502edc-7f96-4ef2-ae88-04dfa57dc809 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:46.764932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-76502edc-7f96-4ef2-ae88-04dfa57dc809 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:46.768826 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-76502edc-7f96-4ef2-ae88-04dfa57dc809 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.579726 May 27 15:00:46.772923 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 447/942] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:46 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:00:46.778295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a524a363-2315-499b-b665-675fc7fa8e89 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:46.779316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a524a363-2315-499b-b665-675fc7fa8e89 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:46.790047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a524a363-2315-499b-b665-675fc7fa8e89 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:46.790909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a524a363-2315-499b-b665-675fc7fa8e89 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:46.792061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a524a363-2315-499b-b665-675fc7fa8e89 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:46.793189 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a524a363-2315-499b-b665-675fc7fa8e89 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:46.848810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b8a607a8-92de-4d29-bf87-a3cf45d669c3 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:46.849329 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a524a363-2315-499b-b665-675fc7fa8e89 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:00:46.857616 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b8a607a8-92de-4d29-bf87-a3cf45d669c3 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" status: 200 len: 1527 microversion: 2.1 time: 0.377112 May 27 15:00:46.858248 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 496/943] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:46 2022] GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa => generated 1527 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:47.021957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b13d15e9-3bf2-4a3c-addb-3c74ee5f3c9a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:47.022768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b13d15e9-3bf2-4a3c-addb-3c74ee5f3c9a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:47.032767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b13d15e9-3bf2-4a3c-addb-3c74ee5f3c9a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:47.033240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b13d15e9-3bf2-4a3c-addb-3c74ee5f3c9a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:47.034076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b13d15e9-3bf2-4a3c-addb-3c74ee5f3c9a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:47.034530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b13d15e9-3bf2-4a3c-addb-3c74ee5f3c9a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:47.084475 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a524a363-2315-499b-b665-675fc7fa8e89 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982" status: 204 len: 0 microversion: 2.1 time: 0.308198 May 27 15:00:47.088454 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 448/944] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:00:46 2022] DELETE /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:00:47.121674 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ae026886-c676-4144-a695-ce78ec98263f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:47.122663 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ae026886-c676-4144-a695-ce78ec98263f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:47.133833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae026886-c676-4144-a695-ce78ec98263f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:47.136290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae026886-c676-4144-a695-ce78ec98263f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:47.139241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae026886-c676-4144-a695-ce78ec98263f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:47.140028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae026886-c676-4144-a695-ce78ec98263f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:47.444592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b13d15e9-3bf2-4a3c-addb-3c74ee5f3c9a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5966aa558f434adda904f39536717363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f487ff60742dca747020a97818dbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:47.461140 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b13d15e9-3bf2-4a3c-addb-3c74ee5f3c9a tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97" status: 200 len: 1314 microversion: 2.1 time: 0.442695 May 27 15:00:47.462780 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 497/945] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:47 2022] GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:00:47.476503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7e00a653-972e-4d17-ae92-dceef634d4bb tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:47.478989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7e00a653-972e-4d17-ae92-dceef634d4bb tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:47.497665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e00a653-972e-4d17-ae92-dceef634d4bb tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:47.500398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e00a653-972e-4d17-ae92-dceef634d4bb tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:47.501716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e00a653-972e-4d17-ae92-dceef634d4bb tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:47.504081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e00a653-972e-4d17-ae92-dceef634d4bb tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:47.539698 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ae026886-c676-4144-a695-ce78ec98263f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:47.563094 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ae026886-c676-4144-a695-ce78ec98263f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1542 microversion: 2.1 time: 0.470178 May 27 15:00:47.563693 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 449/946] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:47 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1542 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:47.577778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6d6fdb2b-06bd-4ff4-9584-810bb723a6ef tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:47.583374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6d6fdb2b-06bd-4ff4-9584-810bb723a6ef tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:47.596110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d6fdb2b-06bd-4ff4-9584-810bb723a6ef tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:47.599808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d6fdb2b-06bd-4ff4-9584-810bb723a6ef tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:47.600877 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d6fdb2b-06bd-4ff4-9584-810bb723a6ef tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:47.601688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d6fdb2b-06bd-4ff4-9584-810bb723a6ef tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:47.613598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:47.904385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7e00a653-972e-4d17-ae92-dceef634d4bb tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:47.919706 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7e00a653-972e-4d17-ae92-dceef634d4bb tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982" status: 200 len: 1714 microversion: 2.1 time: 0.454819 May 27 15:00:47.922428 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 498/947] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:47 2022] GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 => generated 1714 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:47.943770 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-3cc59306-9986-4259-9d9f-0a2011685284 req-ed5ee917-2cf8-4ec3-b61f-7d6f20ce9c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da2c6d0b-b6e3-43a9-870b-6f7493b08dfa", "name": "network-vif-deleted", "tag": "77a08a17-7b75-4c05-a064-2f80d2e429a8"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:47.963893 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3cc59306-9986-4259-9d9f-0a2011685284 req-ed5ee917-2cf8-4ec3-b61f-7d6f20ce9c1e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:47.966775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3cc59306-9986-4259-9d9f-0a2011685284 req-ed5ee917-2cf8-4ec3-b61f-7d6f20ce9c1e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:47.991254 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-3cc59306-9986-4259-9d9f-0a2011685284 req-ed5ee917-2cf8-4ec3-b61f-7d6f20ce9c1e service nova] Creating event network-vif-deleted:77a08a17-7b75-4c05-a064-2f80d2e429a8 for instance da2c6d0b-b6e3-43a9-870b-6f7493b08dfa on n-h2-843621-1 May 27 15:00:48.008860 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-3cc59306-9986-4259-9d9f-0a2011685284 req-ed5ee917-2cf8-4ec3-b61f-7d6f20ce9c1e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078848 May 27 15:00:48.008860 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 499/948] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:48.013001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-220c84b4-78bb-4409-8ea7-b45f36d8b0d9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:48.013702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-220c84b4-78bb-4409-8ea7-b45f36d8b0d9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:48.021065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-220c84b4-78bb-4409-8ea7-b45f36d8b0d9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:48.021513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-220c84b4-78bb-4409-8ea7-b45f36d8b0d9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:48.022306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-220c84b4-78bb-4409-8ea7-b45f36d8b0d9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:48.022737 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-220c84b4-78bb-4409-8ea7-b45f36d8b0d9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:48.029728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6d6fdb2b-06bd-4ff4-9584-810bb723a6ef tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590be802bea346fc9240befaae60ec9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3ff9fdd7364a82ad3ed271a33da615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:48.042937 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6d6fdb2b-06bd-4ff4-9584-810bb723a6ef tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 200 len: 1372 microversion: 2.1 time: 0.477089 May 27 15:00:48.044067 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 450/949] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:47 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 1372 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:48.049157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0b824b00-c368-4fff-a640-cbc402cb3d59 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:48.050200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0b824b00-c368-4fff-a640-cbc402cb3d59 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:48.067853 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b824b00-c368-4fff-a640-cbc402cb3d59 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:48.068521 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b824b00-c368-4fff-a640-cbc402cb3d59 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:48.069544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b824b00-c368-4fff-a640-cbc402cb3d59 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:48.070154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b824b00-c368-4fff-a640-cbc402cb3d59 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:48.220020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0b824b00-c368-4fff-a640-cbc402cb3d59 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8811631894240aa46c7f87b3c8506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d1e6c35bdd45a986acf3213f2a84bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:48.233463 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0b824b00-c368-4fff-a640-cbc402cb3d59 tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" status: 200 len: 1485 microversion: 2.1 time: 0.186895 May 27 15:00:48.244893 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 451/950] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:48 2022] GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa => generated 1485 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:48.380599 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-220c84b4-78bb-4409-8ea7-b45f36d8b0d9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:48.390790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-220c84b4-78bb-4409-8ea7-b45f36d8b0d9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:48.392329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-220c84b4-78bb-4409-8ea7-b45f36d8b0d9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:48.393868 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-220c84b4-78bb-4409-8ea7-b45f36d8b0d9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.384956 May 27 15:00:48.395894 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 500/951] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:48 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:00:48.479521 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-42f34eb0-7b67-4d19-97eb-c9c242205578 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:48.480250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-42f34eb0-7b67-4d19-97eb-c9c242205578 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:48.494134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42f34eb0-7b67-4d19-97eb-c9c242205578 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:48.495740 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42f34eb0-7b67-4d19-97eb-c9c242205578 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:48.497693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42f34eb0-7b67-4d19-97eb-c9c242205578 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:48.499761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42f34eb0-7b67-4d19-97eb-c9c242205578 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:48.582345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f45c31ab-5274-429b-bd44-fd28c95149e6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:48.584186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f45c31ab-5274-429b-bd44-fd28c95149e6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:48.599089 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f45c31ab-5274-429b-bd44-fd28c95149e6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:48.612981 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f45c31ab-5274-429b-bd44-fd28c95149e6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:48.614341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f45c31ab-5274-429b-bd44-fd28c95149e6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:48.620281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f45c31ab-5274-429b-bd44-fd28c95149e6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:48.884060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-42f34eb0-7b67-4d19-97eb-c9c242205578 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5966aa558f434adda904f39536717363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f487ff60742dca747020a97818dbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:48.893567 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-42f34eb0-7b67-4d19-97eb-c9c242205578 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97" status: 200 len: 1314 microversion: 2.1 time: 0.418545 May 27 15:00:48.895547 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 452/952] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:48 2022] GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:48.939730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e19cdd1e-3054-45a7-b969-6674c31c687d tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:48.940473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e19cdd1e-3054-45a7-b969-6674c31c687d tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:48.950776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e19cdd1e-3054-45a7-b969-6674c31c687d tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:48.957422 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e19cdd1e-3054-45a7-b969-6674c31c687d tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:48.958575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e19cdd1e-3054-45a7-b969-6674c31c687d tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:48.959250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e19cdd1e-3054-45a7-b969-6674c31c687d tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:49.185355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f45c31ab-5274-429b-bd44-fd28c95149e6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:49.190591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:49.199891 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f45c31ab-5274-429b-bd44-fd28c95149e6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1542 microversion: 2.1 time: 0.623454 May 27 15:00:49.200490 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 501/953] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:48 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1542 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:49.215041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b367a8dc-6e2a-4c96-929c-004e23938d59 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:49.219508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b367a8dc-6e2a-4c96-929c-004e23938d59 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:49.232288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b367a8dc-6e2a-4c96-929c-004e23938d59 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:49.238394 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b367a8dc-6e2a-4c96-929c-004e23938d59 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:49.239738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b367a8dc-6e2a-4c96-929c-004e23938d59 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:49.240758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b367a8dc-6e2a-4c96-929c-004e23938d59 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:49.345430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e19cdd1e-3054-45a7-b969-6674c31c687d tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:49.356451 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e19cdd1e-3054-45a7-b969-6674c31c687d tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982" status: 200 len: 1714 microversion: 2.1 time: 0.420472 May 27 15:00:49.358262 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 453/954] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:48 2022] GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 => generated 1714 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:00:49.373562 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d76deae7-a675-443e-8685-a01caab7810b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:49.377252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d76deae7-a675-443e-8685-a01caab7810b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] [instance: da2c6d0b-b6e3-43a9-870b-6f7493b08dfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:49.389209 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d76deae7-a675-443e-8685-a01caab7810b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:49.392370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d76deae7-a675-443e-8685-a01caab7810b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:49.393401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d76deae7-a675-443e-8685-a01caab7810b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:49.396315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d76deae7-a675-443e-8685-a01caab7810b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:49.427657 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-d76deae7-a675-443e-8685-a01caab7810b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] HTTP exception thrown: Instance da2c6d0b-b6e3-43a9-870b-6f7493b08dfa could not be found. May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d76deae7-a675-443e-8685-a01caab7810b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Request method failure captured: May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa HTTP/1.1 May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOc_KZXRiB_3V0Ut0CGPITzCZSFj3bXcxC_wJnHHonBMr3KV07i59OUsvME94axLWlSc8PCxTTNCzanIXU215iN3PWiBPaOYb8YkwFs7nQR-AosFaXRlYJ-QOpNMX0-mi9fYXdBmhGtefeujEm1_9pUfve-Q545yYEX-e9IB7M1W0YM May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 27d1e6c35bdd45a986acf3213f2a84bf May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1404390607 May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/27d1e6c35bdd45a986acf3213f2a84bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/27d1e6c35bdd45a986acf3213f2a84bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/27d1e6c35bdd45a986acf3213f2a84bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_27d1e6c35bdd45a986acf3213f2a84bf", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1404390607 May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 27d1e6c35bdd45a986acf3213f2a84bf May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1404390607 May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-FloatingIPsAssociationTestJSON-1404390607-project May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 7fd8811631894240aa46c7f87b3c8506 May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1404390607-project May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance da2c6d0b-b6e3-43a9-870b-6f7493b08dfa could not be found. May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'da2c6d0b-b6e3-43a9-870b-6f7493b08dfa'} May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da2c6d0b-b6e3-43a9-870b-6f7493b08dfa could not be found. May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da2c6d0b-b6e3-43a9-870b-6f7493b08dfa could not be found. May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:49.429431 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:49.433483 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:49.433483 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:49.433483 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:49.433483 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:49.433483 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:00:49.433483 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:00:49.433483 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da2c6d0b-b6e3-43a9-870b-6f7493b08dfa could not be found. May 27 15:00:49.433483 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:49.433483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d76deae7-a675-443e-8685-a01caab7810b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] Returning 404 to user: Instance da2c6d0b-b6e3-43a9-870b-6f7493b08dfa could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:00:49.433483 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d76deae7-a675-443e-8685-a01caab7810b tempest-FloatingIPsAssociationTestJSON-1404390607 tempest-FloatingIPsAssociationTestJSON-1404390607-project] 10.222.0.13 "GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa" status: 404 len: 111 microversion: 2.1 time: 0.065523 May 27 15:00:49.439617 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 454/955] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:49 2022] GET /compute/v2.1/servers/da2c6d0b-b6e3-43a9-870b-6f7493b08dfa => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:00:49.458599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-10a98d95-c76d-4f4d-bd80-2e91d06c9aef tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:49.459223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-10a98d95-c76d-4f4d-bd80-2e91d06c9aef tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:49.482882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10a98d95-c76d-4f4d-bd80-2e91d06c9aef tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:49.483424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10a98d95-c76d-4f4d-bd80-2e91d06c9aef tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:49.484118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10a98d95-c76d-4f4d-bd80-2e91d06c9aef tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:49.484564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10a98d95-c76d-4f4d-bd80-2e91d06c9aef tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:49.842630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b367a8dc-6e2a-4c96-929c-004e23938d59 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590be802bea346fc9240befaae60ec9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3ff9fdd7364a82ad3ed271a33da615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:49.878975 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b367a8dc-6e2a-4c96-929c-004e23938d59 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 200 len: 1559 microversion: 2.1 time: 0.675393 May 27 15:00:49.883348 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 502/956] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:49 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 1559 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:49.909458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a5bf690a-3ca4-4f91-b597-5d7557ae2f6a tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:49.911275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a5bf690a-3ca4-4f91-b597-5d7557ae2f6a tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:49.946827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a5bf690a-3ca4-4f91-b597-5d7557ae2f6a tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:49.949550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a5bf690a-3ca4-4f91-b597-5d7557ae2f6a tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:49.952597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a5bf690a-3ca4-4f91-b597-5d7557ae2f6a tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:49.957162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a5bf690a-3ca4-4f91-b597-5d7557ae2f6a tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:49.981124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-10a98d95-c76d-4f4d-bd80-2e91d06c9aef tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:49.998774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-10a98d95-c76d-4f4d-bd80-2e91d06c9aef tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:50.007390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-10a98d95-c76d-4f4d-bd80-2e91d06c9aef tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:50.010248 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-10a98d95-c76d-4f4d-bd80-2e91d06c9aef tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.568987 May 27 15:00:50.022749 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 455/957] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:49 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:00:50.028864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dd75769e-477e-46ee-9ccf-c41aebba87b4 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:50.029863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dd75769e-477e-46ee-9ccf-c41aebba87b4 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:50.038142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd75769e-477e-46ee-9ccf-c41aebba87b4 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:50.038979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd75769e-477e-46ee-9ccf-c41aebba87b4 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:50.040007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd75769e-477e-46ee-9ccf-c41aebba87b4 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:50.040721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd75769e-477e-46ee-9ccf-c41aebba87b4 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:50.796419 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a5bf690a-3ca4-4f91-b597-5d7557ae2f6a tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.897094 May 27 15:00:50.798863 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 503/958] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 15:00:49 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3/os-interface => generated 285 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:00:50.807276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9e060001-70b7-4af1-9ed1-7bfcab18d501 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:50.808291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9e060001-70b7-4af1-9ed1-7bfcab18d501 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:50.828239 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e060001-70b7-4af1-9ed1-7bfcab18d501 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:50.831042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e060001-70b7-4af1-9ed1-7bfcab18d501 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:50.832794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e060001-70b7-4af1-9ed1-7bfcab18d501 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:50.838352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e060001-70b7-4af1-9ed1-7bfcab18d501 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:50.972769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dd75769e-477e-46ee-9ccf-c41aebba87b4 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5966aa558f434adda904f39536717363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f487ff60742dca747020a97818dbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:50.988227 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dd75769e-477e-46ee-9ccf-c41aebba87b4 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97" status: 200 len: 1314 microversion: 2.1 time: 0.956590 May 27 15:00:51.002653 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 456/959] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:50 2022] GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97 => generated 1314 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:51.012536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9f83e277-c4d0-452a-aadf-6c32658c5362 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:51.013311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9f83e277-c4d0-452a-aadf-6c32658c5362 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:51.025585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f83e277-c4d0-452a-aadf-6c32658c5362 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:51.029224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f83e277-c4d0-452a-aadf-6c32658c5362 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:51.030467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f83e277-c4d0-452a-aadf-6c32658c5362 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:51.031181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f83e277-c4d0-452a-aadf-6c32658c5362 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:51.365808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9f83e277-c4d0-452a-aadf-6c32658c5362 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e08df96180b4456a5f2bf09741f43b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9da838f02f184e8d9040897b31dd7d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:51.376114 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9f83e277-c4d0-452a-aadf-6c32658c5362 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982" status: 200 len: 1646 microversion: 2.1 time: 0.372182 May 27 15:00:51.381609 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 457/960] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:51 2022] GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 => generated 1646 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:51.390626 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fb9e25da-4e3a-43cc-8c62-6f5aa3304559 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:51.398278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fb9e25da-4e3a-43cc-8c62-6f5aa3304559 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:51.416709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb9e25da-4e3a-43cc-8c62-6f5aa3304559 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:51.416709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb9e25da-4e3a-43cc-8c62-6f5aa3304559 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:51.417273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb9e25da-4e3a-43cc-8c62-6f5aa3304559 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:51.420179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb9e25da-4e3a-43cc-8c62-6f5aa3304559 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:52.331028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9e060001-70b7-4af1-9ed1-7bfcab18d501 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:52.346914 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9e060001-70b7-4af1-9ed1-7bfcab18d501 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1542 microversion: 2.1 time: 1.546762 May 27 15:00:52.348162 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 504/961] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:50 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1542 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:52.356880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-113283b9-8233-4b15-8335-dc291a31e3a5 req-ba2b12fc-a157-49b7-b394-e1f11f320d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bced7f1-2fc9-401b-98fa-75a47d092a97", "name": "network-vif-plugged", "status": "completed", "tag": "d33cd803-d7a9-4b4e-a1dc-4e0fc0e3d290"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:52.383518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-113283b9-8233-4b15-8335-dc291a31e3a5 req-ba2b12fc-a157-49b7-b394-e1f11f320d75 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:52.384063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-113283b9-8233-4b15-8335-dc291a31e3a5 req-ba2b12fc-a157-49b7-b394-e1f11f320d75 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:52.414237 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-113283b9-8233-4b15-8335-dc291a31e3a5 req-ba2b12fc-a157-49b7-b394-e1f11f320d75 service nova] Creating event network-vif-plugged:d33cd803-d7a9-4b4e-a1dc-4e0fc0e3d290 for instance 0bced7f1-2fc9-401b-98fa-75a47d092a97 on n-h1-843621-1 May 27 15:00:52.429316 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-113283b9-8233-4b15-8335-dc291a31e3a5 req-ba2b12fc-a157-49b7-b394-e1f11f320d75 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079608 May 27 15:00:52.430903 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 505/962] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:52.459762 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9172a808-cf22-4bb5-b3c7-be00d2a304f4 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:52.460711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9172a808-cf22-4bb5-b3c7-be00d2a304f4 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:52.512130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9172a808-cf22-4bb5-b3c7-be00d2a304f4 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:52.512590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9172a808-cf22-4bb5-b3c7-be00d2a304f4 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:52.513418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9172a808-cf22-4bb5-b3c7-be00d2a304f4 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:52.513859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9172a808-cf22-4bb5-b3c7-be00d2a304f4 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:52.759900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fb9e25da-4e3a-43cc-8c62-6f5aa3304559 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:52.771372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fb9e25da-4e3a-43cc-8c62-6f5aa3304559 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:52.780501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fb9e25da-4e3a-43cc-8c62-6f5aa3304559 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:52.782206 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fb9e25da-4e3a-43cc-8c62-6f5aa3304559 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 1.399274 May 27 15:00:52.785415 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 458/963] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:51 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:00:52.808904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-70163d6c-9b8e-493d-85e8-e7adabf23285 req-a0ed9d23-d43d-4c81-8c50-f8ff2f360c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f621b08-4026-4bbd-923b-43a8630f6982", "name": "network-vif-deleted", "tag": "fa2c5e8d-6006-41d2-861b-d0543e539801"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:52.828708 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-70163d6c-9b8e-493d-85e8-e7adabf23285 req-a0ed9d23-d43d-4c81-8c50-f8ff2f360c6c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:52.848571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-70163d6c-9b8e-493d-85e8-e7adabf23285 req-a0ed9d23-d43d-4c81-8c50-f8ff2f360c6c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:52.866975 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-70163d6c-9b8e-493d-85e8-e7adabf23285 req-a0ed9d23-d43d-4c81-8c50-f8ff2f360c6c service nova] Creating event network-vif-deleted:fa2c5e8d-6006-41d2-861b-d0543e539801 for instance 3f621b08-4026-4bbd-923b-43a8630f6982 on n-h2-843621-1 May 27 15:00:52.888058 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-70163d6c-9b8e-493d-85e8-e7adabf23285 req-a0ed9d23-d43d-4c81-8c50-f8ff2f360c6c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088940 May 27 15:00:52.889052 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 459/964] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:52.900914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-29c0ba68-3305-43e0-aa45-56252dab54e7 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:52.901656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-29c0ba68-3305-43e0-aa45-56252dab54e7 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:52.914830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-29c0ba68-3305-43e0-aa45-56252dab54e7 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:52.915287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-29c0ba68-3305-43e0-aa45-56252dab54e7 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:52.916070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-29c0ba68-3305-43e0-aa45-56252dab54e7 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:52.916511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-29c0ba68-3305-43e0-aa45-56252dab54e7 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:52.948652 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-29c0ba68-3305-43e0-aa45-56252dab54e7 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] HTTP exception thrown: Instance 3f621b08-4026-4bbd-923b-43a8630f6982 could not be found. May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-29c0ba68-3305-43e0-aa45-56252dab54e7 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Request method failure captured: May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 HTTP/1.1 May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOcPLRtlx8tdtLozUUnfgjTJtoCsRU0-gYC0FC6V8O3EXl5KqK3pIug3N2KmgrgQW6QXQgZMt5SlXf33IVfKqo69-yq3i3z2X9TAhyTXWOQd26AKrkBbGsO90Y87D4tCy8DSU2uPBxQuUidf0oHBGJQ3G_YoBXpn3J_CFOANFj3qxG4 May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 9da838f02f184e8d9040897b31dd7d75 May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9da838f02f184e8d9040897b31dd7d75", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 9da838f02f184e8d9040897b31dd7d75 May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1576944640-project May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 3e08df96180b4456a5f2bf09741f43b5 May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640-project May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 3f621b08-4026-4bbd-923b-43a8630f6982 could not be found. May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '3f621b08-4026-4bbd-923b-43a8630f6982'} May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f621b08-4026-4bbd-923b-43a8630f6982 could not be found. May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f621b08-4026-4bbd-923b-43a8630f6982 could not be found. May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:52.950410 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:52.955830 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:52.955830 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:52.955830 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:52.955830 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:52.955830 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:00:52.955830 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:00:52.955830 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f621b08-4026-4bbd-923b-43a8630f6982 could not be found. May 27 15:00:52.955830 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:52.955830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-29c0ba68-3305-43e0-aa45-56252dab54e7 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Returning 404 to user: Instance 3f621b08-4026-4bbd-923b-43a8630f6982 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:00:52.955830 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-29c0ba68-3305-43e0-aa45-56252dab54e7 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982" status: 404 len: 111 microversion: 2.1 time: 0.061671 May 27 15:00:52.966360 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 460/965] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:52 2022] GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:00:53.227866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9172a808-cf22-4bb5-b3c7-be00d2a304f4 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5966aa558f434adda904f39536717363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f487ff60742dca747020a97818dbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:53.248888 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9172a808-cf22-4bb5-b3c7-be00d2a304f4 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97" status: 200 len: 1314 microversion: 2.1 time: 0.808482 May 27 15:00:53.249878 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 506/966] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:52 2022] GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97 => generated 1314 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:53.254738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fec19079-c211-4b64-8f3c-b2104273e48f tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:53.255234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fec19079-c211-4b64-8f3c-b2104273e48f tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 4be00dd7-101a-436f-90e9-b8fcbd0cf00b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:53.271330 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fec19079-c211-4b64-8f3c-b2104273e48f tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:53.271793 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fec19079-c211-4b64-8f3c-b2104273e48f tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:53.272592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fec19079-c211-4b64-8f3c-b2104273e48f tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:53.277265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fec19079-c211-4b64-8f3c-b2104273e48f tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:53.307778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c804b25b-af57-4839-9d97-80ce4dae98c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-744017091", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "5b029644-79a0-4d20-9c9d-09c8d08d8d68"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:53.322560 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-fec19079-c211-4b64-8f3c-b2104273e48f tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] HTTP exception thrown: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fec19079-c211-4b64-8f3c-b2104273e48f tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Request method failure captured: May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b HTTP/1.1 May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOcPLRtlx8tdtLozUUnfgjTJtoCsRU0-gYC0FC6V8O3EXl5KqK3pIug3N2KmgrgQW6QXQgZMt5SlXf33IVfKqo69-yq3i3z2X9TAhyTXWOQd26AKrkBbGsO90Y87D4tCy8DSU2uPBxQuUidf0oHBGJQ3G_YoBXpn3J_CFOANFj3qxG4 May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 9da838f02f184e8d9040897b31dd7d75 May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9da838f02f184e8d9040897b31dd7d75", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 9da838f02f184e8d9040897b31dd7d75 May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1576944640-project May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 3e08df96180b4456a5f2bf09741f43b5 May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640-project May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '4be00dd7-101a-436f-90e9-b8fcbd0cf00b'} May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:00:53.337805 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:00:53.342971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. May 27 15:00:53.342971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:53.342971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:53.342971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:53.342971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:53.342971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:53.342971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:53.342971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:00:53.342971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:00:53.342971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. May 27 15:00:53.342971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:53.345049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fec19079-c211-4b64-8f3c-b2104273e48f tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Returning 404 to user: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:00:53.346221 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fec19079-c211-4b64-8f3c-b2104273e48f tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b" status: 404 len: 111 microversion: 2.1 time: 0.095133 May 27 15:00:53.351936 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 507/967] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:00:53 2022] DELETE /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:00:53.373205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4387ed20-eda1-4940-bbb1-341113ad3968 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:53.374968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4387ed20-eda1-4940-bbb1-341113ad3968 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:53.382006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4387ed20-eda1-4940-bbb1-341113ad3968 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:53.386732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4387ed20-eda1-4940-bbb1-341113ad3968 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:53.387829 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4387ed20-eda1-4940-bbb1-341113ad3968 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:53.388513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4387ed20-eda1-4940-bbb1-341113ad3968 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:53.433311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-c804b25b-af57-4839-9d97-80ce4dae98c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] validate_networks() for [('5b029644-79a0-4d20-9c9d-09c8d08d8d68', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:00:54.058849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4387ed20-eda1-4940-bbb1-341113ad3968 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:54.074571 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4387ed20-eda1-4940-bbb1-341113ad3968 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1542 microversion: 2.1 time: 0.714433 May 27 15:00:54.078381 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 508/968] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:53 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1542 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:54.095859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cff983e7-b34b-49d2-afc8-95afb12b8e1a tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:54.096946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cff983e7-b34b-49d2-afc8-95afb12b8e1a tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 4be00dd7-101a-436f-90e9-b8fcbd0cf00b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:54.116041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cff983e7-b34b-49d2-afc8-95afb12b8e1a tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:54.117227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cff983e7-b34b-49d2-afc8-95afb12b8e1a tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:54.121881 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cff983e7-b34b-49d2-afc8-95afb12b8e1a tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:54.122621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cff983e7-b34b-49d2-afc8-95afb12b8e1a tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:54.186599 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-cff983e7-b34b-49d2-afc8-95afb12b8e1a tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] HTTP exception thrown: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cff983e7-b34b-49d2-afc8-95afb12b8e1a tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Request method failure captured: May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b HTTP/1.1 May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOcPLRtlx8tdtLozUUnfgjTJtoCsRU0-gYC0FC6V8O3EXl5KqK3pIug3N2KmgrgQW6QXQgZMt5SlXf33IVfKqo69-yq3i3z2X9TAhyTXWOQd26AKrkBbGsO90Y87D4tCy8DSU2uPBxQuUidf0oHBGJQ3G_YoBXpn3J_CFOANFj3qxG4 May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 9da838f02f184e8d9040897b31dd7d75 May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9da838f02f184e8d9040897b31dd7d75", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 9da838f02f184e8d9040897b31dd7d75 May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1576944640-project May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 3e08df96180b4456a5f2bf09741f43b5 May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640-project May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '4be00dd7-101a-436f-90e9-b8fcbd0cf00b'} May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:54.196007 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:54.199987 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:54.199987 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:54.199987 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:54.199987 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:54.199987 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:00:54.199987 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:00:54.199987 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. May 27 15:00:54.199987 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:54.217960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cff983e7-b34b-49d2-afc8-95afb12b8e1a tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Returning 404 to user: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:00:54.220261 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cff983e7-b34b-49d2-afc8-95afb12b8e1a tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b" status: 404 len: 111 microversion: 2.1 time: 0.139725 May 27 15:00:54.221571 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 509/969] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:54 2022] GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:00:54.230459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4bc1c199-0f56-44b2-bf5b-d4c42b3899b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:54.234518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4bc1c199-0f56-44b2-bf5b-d4c42b3899b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:54.254223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4bc1c199-0f56-44b2-bf5b-d4c42b3899b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:54.255349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4bc1c199-0f56-44b2-bf5b-d4c42b3899b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:54.260250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4bc1c199-0f56-44b2-bf5b-d4c42b3899b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:54.263754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4bc1c199-0f56-44b2-bf5b-d4c42b3899b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:54.823056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-c804b25b-af57-4839-9d97-80ce4dae98c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:00:54.825276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-c804b25b-af57-4839-9d97-80ce4dae98c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:00:54.826971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-c804b25b-af57-4839-9d97-80ce4dae98c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:00:54.827658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-c804b25b-af57-4839-9d97-80ce4dae98c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:00:54.828296 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-c804b25b-af57-4839-9d97-80ce4dae98c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:00:54.852911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c804b25b-af57-4839-9d97-80ce4dae98c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:54.855731 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c804b25b-af57-4839-9d97-80ce4dae98c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:54.856886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c804b25b-af57-4839-9d97-80ce4dae98c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:54.860468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c804b25b-af57-4839-9d97-80ce4dae98c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:54.887061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-c804b25b-af57-4839-9d97-80ce4dae98c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Getting quotas for project 1ee754951c48459888c45e9e8ec10dce. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:00:54.894045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-c804b25b-af57-4839-9d97-80ce4dae98c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Getting quotas for user c118a948fbea4575813842ca30613064 and project 1ee754951c48459888c45e9e8ec10dce. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:00:54.910667 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c804b25b-af57-4839-9d97-80ce4dae98c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:00:54.914979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c804b25b-af57-4839-9d97-80ce4dae98c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:00:54.947409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4bc1c199-0f56-44b2-bf5b-d4c42b3899b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:54.967646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4bc1c199-0f56-44b2-bf5b-d4c42b3899b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:54.973430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4bc1c199-0f56-44b2-bf5b-d4c42b3899b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:54.975550 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4bc1c199-0f56-44b2-bf5b-d4c42b3899b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.749064 May 27 15:00:54.993109 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 510/970] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:54 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:00:54.999745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c89b9343-57c4-4a20-998d-bb69f9f07877 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '.version_select at 0x7fc776cdcaf0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:55.045294 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c89b9343-57c4-4a20-998d-bb69f9f07877 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551296994" status: 202 len: 0 microversion: 2.1 time: 0.049096 May 27 15:00:55.046217 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 511/971] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 27 15:00:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551296994 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:00:55.053640 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c804b25b-af57-4839-9d97-80ce4dae98c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.085987 May 27 15:00:55.060937 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 461/972] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:00:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:00:55.068175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2ac075ee-291f-4373-96a0-81b44925d2bd tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:55.068914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2ac075ee-291f-4373-96a0-81b44925d2bd tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:55.073427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-02fefab6-0a0b-4701-8ca2-e8826a64f02f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:55.074074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-02fefab6-0a0b-4701-8ca2-e8826a64f02f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:55.091535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ac075ee-291f-4373-96a0-81b44925d2bd tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:55.092175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ac075ee-291f-4373-96a0-81b44925d2bd tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:55.093349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ac075ee-291f-4373-96a0-81b44925d2bd tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:55.093774 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ac075ee-291f-4373-96a0-81b44925d2bd tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:55.741083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-02fefab6-0a0b-4701-8ca2-e8826a64f02f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:55.791226 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-02fefab6-0a0b-4701-8ca2-e8826a64f02f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25" status: 200 len: 1207 microversion: 2.1 time: 0.703071 May 27 15:00:55.810610 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 462/973] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:55 2022] GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 => generated 1207 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:55.830374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-28431467-c25b-468b-b22b-e6389265e694 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:55.831277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-28431467-c25b-468b-b22b-e6389265e694 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:55.862371 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-28431467-c25b-468b-b22b-e6389265e694 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:55.864567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-28431467-c25b-468b-b22b-e6389265e694 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:55.869270 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-28431467-c25b-468b-b22b-e6389265e694 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:55.876507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-28431467-c25b-468b-b22b-e6389265e694 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:55.888617 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2ac075ee-291f-4373-96a0-81b44925d2bd tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5966aa558f434adda904f39536717363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f487ff60742dca747020a97818dbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:55.897604 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2ac075ee-291f-4373-96a0-81b44925d2bd tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97" status: 200 len: 1464 microversion: 2.1 time: 0.847430 May 27 15:00:55.914026 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 512/974] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:55 2022] GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97 => generated 1464 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:56.258721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-48f8bdf1-c720-4ec8-a1d4-3abf6b719923 tempest-TenantUsagesTestJSON-1781264819 tempest-TenantUsagesTestJSON-1781264819-project-admin] Calling method '.version_select at 0x7fc776d55ee0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:56.285057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48f8bdf1-c720-4ec8-a1d4-3abf6b719923 tempest-TenantUsagesTestJSON-1781264819 tempest-TenantUsagesTestJSON-1781264819-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:56.286542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48f8bdf1-c720-4ec8-a1d4-3abf6b719923 tempest-TenantUsagesTestJSON-1781264819 tempest-TenantUsagesTestJSON-1781264819-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:56.339996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48f8bdf1-c720-4ec8-a1d4-3abf6b719923 tempest-TenantUsagesTestJSON-1781264819 tempest-TenantUsagesTestJSON-1781264819-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:56.340462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48f8bdf1-c720-4ec8-a1d4-3abf6b719923 tempest-TenantUsagesTestJSON-1781264819 tempest-TenantUsagesTestJSON-1781264819-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:56.393774 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-48f8bdf1-c720-4ec8-a1d4-3abf6b719923 tempest-TenantUsagesTestJSON-1781264819 tempest-TenantUsagesTestJSON-1781264819-project-admin] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage/686f487ff60742dca747020a97818dbb?start=2022-05-26T15%3A00%3A55.909525&end=2022-05-28T15%3A00%3A55.909525" status: 200 len: 695 microversion: 2.1 time: 0.478252 May 27 15:00:56.406939 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 513/975] 10.222.0.13 () {58 vars in 1411 bytes} [Fri May 27 15:00:55 2022] GET /compute/v2.1/os-simple-tenant-usage/686f487ff60742dca747020a97818dbb?start=2022-05-26T15%3A00%3A55.909525&end=2022-05-28T15%3A00%3A55.909525 => generated 695 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:56.422094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a2e54ead-76c9-4a98-9920-339906ec5507 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:56.422734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a2e54ead-76c9-4a98-9920-339906ec5507 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:56.438080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a2e54ead-76c9-4a98-9920-339906ec5507 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:56.438545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a2e54ead-76c9-4a98-9920-339906ec5507 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:56.439338 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a2e54ead-76c9-4a98-9920-339906ec5507 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:56.439782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a2e54ead-76c9-4a98-9920-339906ec5507 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:57.248124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-28431467-c25b-468b-b22b-e6389265e694 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:57.268985 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-28431467-c25b-468b-b22b-e6389265e694 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1541 microversion: 2.1 time: 1.453842 May 27 15:00:57.273498 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 463/976] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:55 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1541 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:57.286553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-b8e90a45-6431-49d9-9c53-bbbca63334d0 req-ef4bee8f-2a2b-4304-a60b-ec503eccc666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ae8a942-8725-474d-a782-1faf50e606b3", "tag": "34f5db1a-cf77-4163-b1d7-8eace101a7e7"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:57.312600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b8e90a45-6431-49d9-9c53-bbbca63334d0 req-ef4bee8f-2a2b-4304-a60b-ec503eccc666 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:57.313506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b8e90a45-6431-49d9-9c53-bbbca63334d0 req-ef4bee8f-2a2b-4304-a60b-ec503eccc666 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:57.329990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a2e54ead-76c9-4a98-9920-339906ec5507 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:57.342855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a2e54ead-76c9-4a98-9920-339906ec5507 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:57.364082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a2e54ead-76c9-4a98-9920-339906ec5507 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:57.371469 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a2e54ead-76c9-4a98-9920-339906ec5507 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.956745 May 27 15:00:57.372581 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 514/977] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:56 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:00:57.377462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e09e3d53-d641-402f-a07a-7581ce5a186c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Calling method '.version_select at 0x7fc776c3e0d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:57.384855 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-b8e90a45-6431-49d9-9c53-bbbca63334d0 req-ef4bee8f-2a2b-4304-a60b-ec503eccc666 service nova] Creating event network-changed:34f5db1a-cf77-4163-b1d7-8eace101a7e7 for instance 1ae8a942-8725-474d-a782-1faf50e606b3 on n-h1-843621-1 May 27 15:00:57.406022 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-b8e90a45-6431-49d9-9c53-bbbca63334d0 req-ef4bee8f-2a2b-4304-a60b-ec503eccc666 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130828 May 27 15:00:57.406650 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 464/978] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:57.409992 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e09e3d53-d641-402f-a07a-7581ce5a186c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:57.411557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e09e3d53-d641-402f-a07a-7581ce5a186c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:57.428104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e09e3d53-d641-402f-a07a-7581ce5a186c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:57.429184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e09e3d53-d641-402f-a07a-7581ce5a186c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:57.432302 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f0e91391-cfd1-404f-b14e-ebeb3cbe7dd3 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:57.437123 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f0e91391-cfd1-404f-b14e-ebeb3cbe7dd3 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:57.459265 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e09e3d53-d641-402f-a07a-7581ce5a186c tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage/686f487ff60742dca747020a97818dbb?start=2022-05-26T15%3A00%3A55.909525&end=2022-05-28T15%3A00%3A55.909525" status: 200 len: 695 microversion: 2.1 time: 0.085340 May 27 15:00:57.463513 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0e91391-cfd1-404f-b14e-ebeb3cbe7dd3 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:57.464384 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 515/979] 10.222.0.13 () {58 vars in 1411 bytes} [Fri May 27 15:00:57 2022] GET /compute/v2.1/os-simple-tenant-usage/686f487ff60742dca747020a97818dbb?start=2022-05-26T15%3A00%3A55.909525&end=2022-05-28T15%3A00%3A55.909525 => generated 695 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:00:57.476968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0e91391-cfd1-404f-b14e-ebeb3cbe7dd3 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:57.479729 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5ef6f1bb-3254-4ba7-ab89-3a50125d8146 tempest-TenantUsagesTestJSON-1781264819 tempest-TenantUsagesTestJSON-1781264819-project-admin] Calling method '.version_select at 0x7fc776d4a9d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:57.480297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0e91391-cfd1-404f-b14e-ebeb3cbe7dd3 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:57.482044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0e91391-cfd1-404f-b14e-ebeb3cbe7dd3 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:57.499030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ef6f1bb-3254-4ba7-ab89-3a50125d8146 tempest-TenantUsagesTestJSON-1781264819 tempest-TenantUsagesTestJSON-1781264819-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:57.499870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ef6f1bb-3254-4ba7-ab89-3a50125d8146 tempest-TenantUsagesTestJSON-1781264819 tempest-TenantUsagesTestJSON-1781264819-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:57.542321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ef6f1bb-3254-4ba7-ab89-3a50125d8146 tempest-TenantUsagesTestJSON-1781264819 tempest-TenantUsagesTestJSON-1781264819-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:57.543643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ef6f1bb-3254-4ba7-ab89-3a50125d8146 tempest-TenantUsagesTestJSON-1781264819 tempest-TenantUsagesTestJSON-1781264819-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:57.704964 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5ef6f1bb-3254-4ba7-ab89-3a50125d8146 tempest-TenantUsagesTestJSON-1781264819 tempest-TenantUsagesTestJSON-1781264819-project-admin] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-26T15%3A00%3A55.909525&end=2022-05-28T15%3A00%3A55.909525&detailed=1" status: 200 len: 10704 microversion: 2.1 time: 0.228611 May 27 15:00:57.709252 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 516/980] 10.222.0.13 () {58 vars in 1334 bytes} [Fri May 27 15:00:57 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-26T15%3A00%3A55.909525&end=2022-05-28T15%3A00%3A55.909525&detailed=1 => generated 10704 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:00:57.728595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eeb99c85-fa1a-41ad-a10a-14c67a37f3a7 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:57.729641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-eeb99c85-fa1a-41ad-a10a-14c67a37f3a7 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:57.752308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eeb99c85-fa1a-41ad-a10a-14c67a37f3a7 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:57.758674 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eeb99c85-fa1a-41ad-a10a-14c67a37f3a7 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:57.762664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eeb99c85-fa1a-41ad-a10a-14c67a37f3a7 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:57.764369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eeb99c85-fa1a-41ad-a10a-14c67a37f3a7 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:57.793530 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f0e91391-cfd1-404f-b14e-ebeb3cbe7dd3 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:57.807824 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f0e91391-cfd1-404f-b14e-ebeb3cbe7dd3 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25" status: 200 len: 1265 microversion: 2.1 time: 0.391485 May 27 15:00:57.812971 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 465/981] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:57 2022] GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 => generated 1265 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:57.827363 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-eeb99c85-fa1a-41ad-a10a-14c67a37f3a7 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:00:58.063547 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-eeb99c85-fa1a-41ad-a10a-14c67a37f3a7 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97" status: 204 len: 0 microversion: 2.1 time: 0.338637 May 27 15:00:58.064479 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 517/982] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:00:57 2022] DELETE /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:00:58.075855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-54887f75-cd51-467b-a4a6-2a704d57ada8 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:58.076560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-54887f75-cd51-467b-a4a6-2a704d57ada8 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:58.090122 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54887f75-cd51-467b-a4a6-2a704d57ada8 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:58.090476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54887f75-cd51-467b-a4a6-2a704d57ada8 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:58.091204 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54887f75-cd51-467b-a4a6-2a704d57ada8 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:58.095016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54887f75-cd51-467b-a4a6-2a704d57ada8 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:58.248727 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1b66f085-c29b-4b8f-ae34-f33f8fb2265d tempest-ServersWithSpecificFlavorTestJSON-850585455 tempest-ServersWithSpecificFlavorTestJSON-850585455-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:58.249905 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:00:58.249905 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:00:58.293480 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1b66f085-c29b-4b8f-ae34-f33f8fb2265d tempest-ServersWithSpecificFlavorTestJSON-850585455 tempest-ServersWithSpecificFlavorTestJSON-850585455-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1271826021" status: 202 len: 0 microversion: 2.1 time: 0.049196 May 27 15:00:58.294305 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 518/983] 10.222.0.13 () {58 vars in 1160 bytes} [Fri May 27 15:00:58 2022] DELETE /compute/v2.1/flavors/1271826021 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:00:58.299923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f607aab3-5cf3-454b-b1f1-ace130edbbb4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:58.300930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f607aab3-5cf3-454b-b1f1-ace130edbbb4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:58.313350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f607aab3-5cf3-454b-b1f1-ace130edbbb4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:58.315451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f607aab3-5cf3-454b-b1f1-ace130edbbb4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:58.318075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f607aab3-5cf3-454b-b1f1-ace130edbbb4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:58.319826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f607aab3-5cf3-454b-b1f1-ace130edbbb4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:58.429968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-54887f75-cd51-467b-a4a6-2a704d57ada8 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5966aa558f434adda904f39536717363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f487ff60742dca747020a97818dbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:58.447473 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-54887f75-cd51-467b-a4a6-2a704d57ada8 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97" status: 200 len: 1470 microversion: 2.1 time: 0.377012 May 27 15:00:58.449820 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 466/984] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:58 2022] GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97 => generated 1470 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:58.467773 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-92f58035-9fdd-49c8-945a-208cd11b888e tempest-ServersWithSpecificFlavorTestJSON-850585455 tempest-ServersWithSpecificFlavorTestJSON-850585455-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:58.506545 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-92f58035-9fdd-49c8-945a-208cd11b888e tempest-ServersWithSpecificFlavorTestJSON-850585455 tempest-ServersWithSpecificFlavorTestJSON-850585455-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.055425 May 27 15:00:58.513666 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 467/985] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 15:00:58 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:58.524621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bb3b94cc-a0eb-420e-97bf-5679d9a207ec tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:58.529513 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bb3b94cc-a0eb-420e-97bf-5679d9a207ec tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:58.538121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb3b94cc-a0eb-420e-97bf-5679d9a207ec tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:58.538489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb3b94cc-a0eb-420e-97bf-5679d9a207ec tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:58.539643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb3b94cc-a0eb-420e-97bf-5679d9a207ec tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:58.556920 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb3b94cc-a0eb-420e-97bf-5679d9a207ec tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:58.877756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f607aab3-5cf3-454b-b1f1-ace130edbbb4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:58.889445 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f607aab3-5cf3-454b-b1f1-ace130edbbb4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1541 microversion: 2.1 time: 0.593865 May 27 15:00:58.890037 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 519/986] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:58 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1541 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:58.915037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d7ca839e-f412-47b5-8e22-dcf304fde8b9 tempest-ServersWithSpecificFlavorTestJSON-850585455 tempest-ServersWithSpecificFlavorTestJSON-850585455-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:58.917385 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:00:58.917385 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:00:58.952114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bb3b94cc-a0eb-420e-97bf-5679d9a207ec tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:58.968739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bb3b94cc-a0eb-420e-97bf-5679d9a207ec tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:58.971329 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bb3b94cc-a0eb-420e-97bf-5679d9a207ec tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:58.975388 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d7ca839e-f412-47b5-8e22-dcf304fde8b9 tempest-ServersWithSpecificFlavorTestJSON-850585455 tempest-ServersWithSpecificFlavorTestJSON-850585455-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/2059620199" status: 202 len: 0 microversion: 2.1 time: 0.080151 May 27 15:00:58.977274 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 520/987] 10.222.0.13 () {58 vars in 1160 bytes} [Fri May 27 15:00:58 2022] DELETE /compute/v2.1/flavors/2059620199 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:00:58.993911 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bb3b94cc-a0eb-420e-97bf-5679d9a207ec tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.459919 May 27 15:00:58.995652 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 468/988] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:00:58 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:00:59.004845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e3b23ab3-ea4a-4078-9fe8-d7d8be317a9a tempest-ServersWithSpecificFlavorTestJSON-850585455 tempest-ServersWithSpecificFlavorTestJSON-850585455-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:59.006601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ded21579-59f3-47ce-8513-0b9d756a7511 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:59.008545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ded21579-59f3-47ce-8513-0b9d756a7511 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:59.030338 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ded21579-59f3-47ce-8513-0b9d756a7511 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:59.034163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ded21579-59f3-47ce-8513-0b9d756a7511 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:59.037426 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ded21579-59f3-47ce-8513-0b9d756a7511 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:59.037907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ded21579-59f3-47ce-8513-0b9d756a7511 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:59.048266 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e3b23ab3-ea4a-4078-9fe8-d7d8be317a9a tempest-ServersWithSpecificFlavorTestJSON-850585455 tempest-ServersWithSpecificFlavorTestJSON-850585455-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051221 May 27 15:00:59.052716 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 469/989] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 15:00:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:59.074638 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d2b16b1e-37cd-431b-a784-2ccd010f12ef tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:59.075398 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d2b16b1e-37cd-431b-a784-2ccd010f12ef tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:59.088417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d2b16b1e-37cd-431b-a784-2ccd010f12ef tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:59.091675 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d2b16b1e-37cd-431b-a784-2ccd010f12ef tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:59.092742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d2b16b1e-37cd-431b-a784-2ccd010f12ef tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:59.093344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d2b16b1e-37cd-431b-a784-2ccd010f12ef tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:59.134550 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-d2b16b1e-37cd-431b-a784-2ccd010f12ef tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] HTTP exception thrown: Instance 3f621b08-4026-4bbd-923b-43a8630f6982 could not be found. May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d2b16b1e-37cd-431b-a784-2ccd010f12ef tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Request method failure captured: May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 HTTP/1.1 May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOcPLRtlx8tdtLozUUnfgjTJtoCsRU0-gYC0FC6V8O3EXl5KqK3pIug3N2KmgrgQW6QXQgZMt5SlXf33IVfKqo69-yq3i3z2X9TAhyTXWOQd26AKrkBbGsO90Y87D4tCy8DSU2uPBxQuUidf0oHBGJQ3G_YoBXpn3J_CFOANFj3qxG4 May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 9da838f02f184e8d9040897b31dd7d75 May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9da838f02f184e8d9040897b31dd7d75", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 9da838f02f184e8d9040897b31dd7d75 May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1576944640-project May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 3e08df96180b4456a5f2bf09741f43b5 May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640-project May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 3f621b08-4026-4bbd-923b-43a8630f6982 could not be found. May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '3f621b08-4026-4bbd-923b-43a8630f6982'} May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f621b08-4026-4bbd-923b-43a8630f6982 could not be found. May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:00:59.138401 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:00:59.142395 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f621b08-4026-4bbd-923b-43a8630f6982 could not be found. May 27 15:00:59.142395 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:59.142395 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:59.142395 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:59.142395 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:59.142395 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:59.142395 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:59.142395 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:00:59.142395 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:00:59.142395 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f621b08-4026-4bbd-923b-43a8630f6982 could not be found. May 27 15:00:59.142395 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:59.142395 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d2b16b1e-37cd-431b-a784-2ccd010f12ef tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Returning 404 to user: Instance 3f621b08-4026-4bbd-923b-43a8630f6982 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:00:59.142395 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d2b16b1e-37cd-431b-a784-2ccd010f12ef tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982" status: 404 len: 111 microversion: 2.1 time: 0.070838 May 27 15:00:59.151249 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 470/990] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:00:59 2022] DELETE /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:00:59.161805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f6fac891-8e89-4c40-b761-db032c451dd0 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:59.162435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f6fac891-8e89-4c40-b761-db032c451dd0 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 3f621b08-4026-4bbd-923b-43a8630f6982] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:59.174770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6fac891-8e89-4c40-b761-db032c451dd0 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:59.175228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6fac891-8e89-4c40-b761-db032c451dd0 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:59.183149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6fac891-8e89-4c40-b761-db032c451dd0 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:59.183655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6fac891-8e89-4c40-b761-db032c451dd0 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:59.219028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ded21579-59f3-47ce-8513-0b9d756a7511 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:00:59.229032 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-f6fac891-8e89-4c40-b761-db032c451dd0 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] HTTP exception thrown: Instance 3f621b08-4026-4bbd-923b-43a8630f6982 could not be found. May 27 15:00:59.230828 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ded21579-59f3-47ce-8513-0b9d756a7511 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25" status: 200 len: 1265 microversion: 2.1 time: 0.251839 May 27 15:00:59.231467 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 521/991] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:58 2022] GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f6fac891-8e89-4c40-b761-db032c451dd0 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Request method failure captured: May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 HTTP/1.1 May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOcPLRtlx8tdtLozUUnfgjTJtoCsRU0-gYC0FC6V8O3EXl5KqK3pIug3N2KmgrgQW6QXQgZMt5SlXf33IVfKqo69-yq3i3z2X9TAhyTXWOQd26AKrkBbGsO90Y87D4tCy8DSU2uPBxQuUidf0oHBGJQ3G_YoBXpn3J_CFOANFj3qxG4 May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 9da838f02f184e8d9040897b31dd7d75 May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9da838f02f184e8d9040897b31dd7d75", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 9da838f02f184e8d9040897b31dd7d75 May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1576944640-project May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 3e08df96180b4456a5f2bf09741f43b5 May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640-project May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 3f621b08-4026-4bbd-923b-43a8630f6982 could not be found. May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '3f621b08-4026-4bbd-923b-43a8630f6982'} May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f621b08-4026-4bbd-923b-43a8630f6982 could not be found. May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f621b08-4026-4bbd-923b-43a8630f6982 could not be found. May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:59.234004 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:59.238134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:59.238134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:59.238134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:59.238134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:59.238134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:00:59.238134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:00:59.238134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f621b08-4026-4bbd-923b-43a8630f6982 could not be found. May 27 15:00:59.238134 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:59.238134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f6fac891-8e89-4c40-b761-db032c451dd0 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Returning 404 to user: Instance 3f621b08-4026-4bbd-923b-43a8630f6982 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:00:59.238134 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f6fac891-8e89-4c40-b761-db032c451dd0 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982" status: 404 len: 111 microversion: 2.1 time: 0.084295 May 27 15:00:59.241937 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 471/992] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:59 2022] GET /compute/v2.1/servers/3f621b08-4026-4bbd-923b-43a8630f6982 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:00:59.250483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d86aa2b5-f74a-4d3c-861f-f4d692c38758 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:59.253586 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d86aa2b5-f74a-4d3c-861f-f4d692c38758 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 4be00dd7-101a-436f-90e9-b8fcbd0cf00b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:59.282484 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d86aa2b5-f74a-4d3c-861f-f4d692c38758 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:59.283307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d86aa2b5-f74a-4d3c-861f-f4d692c38758 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:59.286325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d86aa2b5-f74a-4d3c-861f-f4d692c38758 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:59.293529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d86aa2b5-f74a-4d3c-861f-f4d692c38758 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:59.337499 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-d86aa2b5-f74a-4d3c-861f-f4d692c38758 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] HTTP exception thrown: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d86aa2b5-f74a-4d3c-861f-f4d692c38758 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Request method failure captured: May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b HTTP/1.1 May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOcPLRtlx8tdtLozUUnfgjTJtoCsRU0-gYC0FC6V8O3EXl5KqK3pIug3N2KmgrgQW6QXQgZMt5SlXf33IVfKqo69-yq3i3z2X9TAhyTXWOQd26AKrkBbGsO90Y87D4tCy8DSU2uPBxQuUidf0oHBGJQ3G_YoBXpn3J_CFOANFj3qxG4 May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 9da838f02f184e8d9040897b31dd7d75 May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9da838f02f184e8d9040897b31dd7d75", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 9da838f02f184e8d9040897b31dd7d75 May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1576944640-project May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 3e08df96180b4456a5f2bf09741f43b5 May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640-project May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '4be00dd7-101a-436f-90e9-b8fcbd0cf00b'} May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:00:59.339354 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:00:59.343902 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. May 27 15:00:59.343902 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:59.343902 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:59.343902 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:59.343902 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:59.343902 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:59.343902 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:59.343902 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:00:59.343902 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:00:59.343902 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. May 27 15:00:59.343902 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:00:59.343902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d86aa2b5-f74a-4d3c-861f-f4d692c38758 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Returning 404 to user: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:00:59.343902 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d86aa2b5-f74a-4d3c-861f-f4d692c38758 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b" status: 404 len: 111 microversion: 2.1 time: 0.097609 May 27 15:00:59.343902 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 522/993] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:00:59 2022] DELETE /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:00:59.368136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-11e757f9-a04e-4ce7-b3aa-9eca5abd1068 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:59.368715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-11e757f9-a04e-4ce7-b3aa-9eca5abd1068 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] [instance: 4be00dd7-101a-436f-90e9-b8fcbd0cf00b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:59.372026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:00:59.377166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11e757f9-a04e-4ce7-b3aa-9eca5abd1068 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:59.377637 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11e757f9-a04e-4ce7-b3aa-9eca5abd1068 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:59.378425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11e757f9-a04e-4ce7-b3aa-9eca5abd1068 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:59.378873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11e757f9-a04e-4ce7-b3aa-9eca5abd1068 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:59.395304 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-11e757f9-a04e-4ce7-b3aa-9eca5abd1068 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] HTTP exception thrown: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-11e757f9-a04e-4ce7-b3aa-9eca5abd1068 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Request method failure captured: May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b HTTP/1.1 May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOcPLRtlx8tdtLozUUnfgjTJtoCsRU0-gYC0FC6V8O3EXl5KqK3pIug3N2KmgrgQW6QXQgZMt5SlXf33IVfKqo69-yq3i3z2X9TAhyTXWOQd26AKrkBbGsO90Y87D4tCy8DSU2uPBxQuUidf0oHBGJQ3G_YoBXpn3J_CFOANFj3qxG4 May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 9da838f02f184e8d9040897b31dd7d75 May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9da838f02f184e8d9040897b31dd7d75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9da838f02f184e8d9040897b31dd7d75", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 9da838f02f184e8d9040897b31dd7d75 May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640 May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1576944640-project May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 3e08df96180b4456a5f2bf09741f43b5 May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1576944640-project May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '4be00dd7-101a-436f-90e9-b8fcbd0cf00b'} May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:59.397582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:00:59.402049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:59.402049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:00:59.402049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:00:59.402049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:00:59.402049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:00:59.402049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:00:59.402049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. May 27 15:00:59.402049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:00:59.405452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-11e757f9-a04e-4ce7-b3aa-9eca5abd1068 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] Returning 404 to user: Instance 4be00dd7-101a-436f-90e9-b8fcbd0cf00b could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:00:59.406567 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-11e757f9-a04e-4ce7-b3aa-9eca5abd1068 tempest-ServersWithSpecificFlavorTestJSON-1576944640 tempest-ServersWithSpecificFlavorTestJSON-1576944640-project] 10.222.0.13 "GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b" status: 404 len: 111 microversion: 2.1 time: 0.060875 May 27 15:00:59.407352 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 472/994] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:59 2022] GET /compute/v2.1/servers/4be00dd7-101a-436f-90e9-b8fcbd0cf00b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:00:59.464943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-263d4307-f084-4e77-830b-b4e3f98a4231 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:59.465679 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-263d4307-f084-4e77-830b-b4e3f98a4231 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:00:59.479633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-263d4307-f084-4e77-830b-b4e3f98a4231 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:59.480021 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-263d4307-f084-4e77-830b-b4e3f98a4231 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:59.482180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-263d4307-f084-4e77-830b-b4e3f98a4231 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:59.482630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-263d4307-f084-4e77-830b-b4e3f98a4231 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:59.874028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-4f41498b-d65e-4fad-9040-49fbe4fa408b req-22e0f81d-dfd1-4cfa-b9b0-16bf613e5c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39985ed3-7d07-48db-80b4-c570f7422e1f", "name": "network-vif-unplugged", "status": "completed", "tag": "ac6d5c81-c7de-49e1-a62d-df0fdf576229"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:00:59.896229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4f41498b-d65e-4fad-9040-49fbe4fa408b req-22e0f81d-dfd1-4cfa-b9b0-16bf613e5c5d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:00:59.897615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4f41498b-d65e-4fad-9040-49fbe4fa408b req-22e0f81d-dfd1-4cfa-b9b0-16bf613e5c5d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:00:59.930848 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-4f41498b-d65e-4fad-9040-49fbe4fa408b req-22e0f81d-dfd1-4cfa-b9b0-16bf613e5c5d service nova] Creating event network-vif-unplugged:ac6d5c81-c7de-49e1-a62d-df0fdf576229 for instance 39985ed3-7d07-48db-80b4-c570f7422e1f on n-h1-843621-1 May 27 15:00:59.946329 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [req-4f41498b-d65e-4fad-9040-49fbe4fa408b req-22e0f81d-dfd1-4cfa-b9b0-16bf613e5c5d service nova] Instance 39985ed3-7d07-48db-80b4-c570f7422e1f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119249) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 15:00:59.970730 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-4f41498b-d65e-4fad-9040-49fbe4fa408b req-22e0f81d-dfd1-4cfa-b9b0-16bf613e5c5d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100837 May 27 15:00:59.976084 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 473/995] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:00:59.992648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-57715976-2b33-4abb-819d-83ca4247a30b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:00:59.993412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-57715976-2b33-4abb-819d-83ca4247a30b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:00.010447 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57715976-2b33-4abb-819d-83ca4247a30b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:00.010979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57715976-2b33-4abb-819d-83ca4247a30b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:00.011822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57715976-2b33-4abb-819d-83ca4247a30b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:00.012274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57715976-2b33-4abb-819d-83ca4247a30b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:00.281565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-263d4307-f084-4e77-830b-b4e3f98a4231 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5966aa558f434adda904f39536717363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f487ff60742dca747020a97818dbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:00.290988 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-263d4307-f084-4e77-830b-b4e3f98a4231 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97" status: 200 len: 1470 microversion: 2.1 time: 0.830059 May 27 15:01:00.295311 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 523/996] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:59 2022] GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97 => generated 1470 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:00.326584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0436b646-9dea-4c24-bc4d-f95e07b365b9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:00.327956 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0436b646-9dea-4c24-bc4d-f95e07b365b9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:00.336772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0436b646-9dea-4c24-bc4d-f95e07b365b9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:00.341281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0436b646-9dea-4c24-bc4d-f95e07b365b9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:00.342448 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0436b646-9dea-4c24-bc4d-f95e07b365b9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:00.343111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0436b646-9dea-4c24-bc4d-f95e07b365b9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:00.788228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-57715976-2b33-4abb-819d-83ca4247a30b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:00.799254 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-57715976-2b33-4abb-819d-83ca4247a30b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1541 microversion: 2.1 time: 0.821821 May 27 15:01:00.801091 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 474/997] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:00:59 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1541 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:00.811636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9cf4ffad-d0f3-44cb-89a0-22af98337e2c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:00.813966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9cf4ffad-d0f3-44cb-89a0-22af98337e2c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:00.831175 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9cf4ffad-d0f3-44cb-89a0-22af98337e2c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:00.834914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9cf4ffad-d0f3-44cb-89a0-22af98337e2c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:00.836571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9cf4ffad-d0f3-44cb-89a0-22af98337e2c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:00.838109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9cf4ffad-d0f3-44cb-89a0-22af98337e2c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:00.872470 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:00.986027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9cf4ffad-d0f3-44cb-89a0-22af98337e2c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:01.001292 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9cf4ffad-d0f3-44cb-89a0-22af98337e2c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25" status: 200 len: 1265 microversion: 2.1 time: 0.198783 May 27 15:01:01.002232 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 475/998] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:00 2022] GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:01.102827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0436b646-9dea-4c24-bc4d-f95e07b365b9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:01.125115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:01.128974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0436b646-9dea-4c24-bc4d-f95e07b365b9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:01.132899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0436b646-9dea-4c24-bc4d-f95e07b365b9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:01.135082 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0436b646-9dea-4c24-bc4d-f95e07b365b9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.827711 May 27 15:01:01.141158 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 524/999] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:00 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:01.313067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-01b6a956-6387-423a-b3ce-02e61ac512dc tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:01.313702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-01b6a956-6387-423a-b3ce-02e61ac512dc tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:01.333518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01b6a956-6387-423a-b3ce-02e61ac512dc tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:01.334002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01b6a956-6387-423a-b3ce-02e61ac512dc tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:01.334860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01b6a956-6387-423a-b3ce-02e61ac512dc tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:01.335334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01b6a956-6387-423a-b3ce-02e61ac512dc tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:01.816421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ceb46330-62c3-4f83-9d5e-9db58e87971f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:01.818188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ceb46330-62c3-4f83-9d5e-9db58e87971f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:01.846484 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ceb46330-62c3-4f83-9d5e-9db58e87971f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:01.846974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ceb46330-62c3-4f83-9d5e-9db58e87971f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:01.847773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ceb46330-62c3-4f83-9d5e-9db58e87971f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:01.848262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ceb46330-62c3-4f83-9d5e-9db58e87971f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:01.934550 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-01b6a956-6387-423a-b3ce-02e61ac512dc tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5966aa558f434adda904f39536717363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f487ff60742dca747020a97818dbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:01.947696 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-01b6a956-6387-423a-b3ce-02e61ac512dc tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97" status: 200 len: 1470 microversion: 2.1 time: 0.638453 May 27 15:01:01.954012 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 476/1000] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:01 2022] GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97 => generated 1470 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:02.019139 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-27c9933a-4e34-4c25-ba77-c5fc1f49267f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:02.020609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-27c9933a-4e34-4c25-ba77-c5fc1f49267f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:02.034883 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-27c9933a-4e34-4c25-ba77-c5fc1f49267f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:02.035380 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-27c9933a-4e34-4c25-ba77-c5fc1f49267f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:02.036190 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-27c9933a-4e34-4c25-ba77-c5fc1f49267f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:02.036741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-27c9933a-4e34-4c25-ba77-c5fc1f49267f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:02.255279 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ceb46330-62c3-4f83-9d5e-9db58e87971f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:02.265836 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ceb46330-62c3-4f83-9d5e-9db58e87971f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1541 microversion: 2.1 time: 0.453250 May 27 15:01:02.267279 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 525/1001] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:01 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1541 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:02.273597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5336a903-2bde-4198-9775-a057bf7682e4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:02.275142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5336a903-2bde-4198-9775-a057bf7682e4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:02.284859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5336a903-2bde-4198-9775-a057bf7682e4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:02.286192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5336a903-2bde-4198-9775-a057bf7682e4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:02.287310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5336a903-2bde-4198-9775-a057bf7682e4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:02.287907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5336a903-2bde-4198-9775-a057bf7682e4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:02.322535 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-27c9933a-4e34-4c25-ba77-c5fc1f49267f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:02.333387 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-27c9933a-4e34-4c25-ba77-c5fc1f49267f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25" status: 200 len: 1307 microversion: 2.1 time: 0.318893 May 27 15:01:02.334582 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 477/1002] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:02 2022] GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 => generated 1307 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:02.542937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5336a903-2bde-4198-9775-a057bf7682e4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:02.554321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5336a903-2bde-4198-9775-a057bf7682e4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:02.556408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5336a903-2bde-4198-9775-a057bf7682e4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:02.557900 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5336a903-2bde-4198-9775-a057bf7682e4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.289353 May 27 15:01:02.559068 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 526/1003] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:02 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:02.878123 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-7e624781-b428-4265-857f-dbf76f43b346 req-e55f8f74-d0ab-41b3-a14e-0a5ecb66e5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39985ed3-7d07-48db-80b4-c570f7422e1f", "tag": "ac6d5c81-c7de-49e1-a62d-df0fdf576229"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:02.902215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-7e624781-b428-4265-857f-dbf76f43b346 req-e55f8f74-d0ab-41b3-a14e-0a5ecb66e5c3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:02.902918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-7e624781-b428-4265-857f-dbf76f43b346 req-e55f8f74-d0ab-41b3-a14e-0a5ecb66e5c3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:02.925498 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-7e624781-b428-4265-857f-dbf76f43b346 req-e55f8f74-d0ab-41b3-a14e-0a5ecb66e5c3 service nova] Creating event network-changed:ac6d5c81-c7de-49e1-a62d-df0fdf576229 for instance 39985ed3-7d07-48db-80b4-c570f7422e1f on n-h1-843621-1 May 27 15:01:02.952373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [req-7e624781-b428-4265-857f-dbf76f43b346 req-e55f8f74-d0ab-41b3-a14e-0a5ecb66e5c3 service nova] Instance 39985ed3-7d07-48db-80b4-c570f7422e1f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119249) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 15:01:02.974982 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-960312b0-8a64-4056-8070-a7cb34e58ba1 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:02.976567 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-960312b0-8a64-4056-8070-a7cb34e58ba1 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:02.977701 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-7e624781-b428-4265-857f-dbf76f43b346 req-e55f8f74-d0ab-41b3-a14e-0a5ecb66e5c3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103117 May 27 15:01:02.978871 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 478/1004] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:03.000768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-960312b0-8a64-4056-8070-a7cb34e58ba1 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:03.001893 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-960312b0-8a64-4056-8070-a7cb34e58ba1 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:03.002966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-960312b0-8a64-4056-8070-a7cb34e58ba1 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:03.011283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-960312b0-8a64-4056-8070-a7cb34e58ba1 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:03.167338 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-960312b0-8a64-4056-8070-a7cb34e58ba1 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5966aa558f434adda904f39536717363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f487ff60742dca747020a97818dbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:03.176720 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-960312b0-8a64-4056-8070-a7cb34e58ba1 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97" status: 200 len: 1428 microversion: 2.1 time: 0.209749 May 27 15:01:03.192784 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 527/1005] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:02 2022] GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97 => generated 1428 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:03.284879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f17f3c42-11ae-4c2c-90ed-6b1d953e8ae9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:03.285908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f17f3c42-11ae-4c2c-90ed-6b1d953e8ae9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:03.304640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f17f3c42-11ae-4c2c-90ed-6b1d953e8ae9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:03.305137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f17f3c42-11ae-4c2c-90ed-6b1d953e8ae9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:03.306021 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f17f3c42-11ae-4c2c-90ed-6b1d953e8ae9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:03.306459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f17f3c42-11ae-4c2c-90ed-6b1d953e8ae9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:03.350430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8a2a15c8-4a2c-4488-8111-32a1c705a45f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:03.351302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8a2a15c8-4a2c-4488-8111-32a1c705a45f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:03.360290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a2a15c8-4a2c-4488-8111-32a1c705a45f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:03.374550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a2a15c8-4a2c-4488-8111-32a1c705a45f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:03.375673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a2a15c8-4a2c-4488-8111-32a1c705a45f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:03.378871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a2a15c8-4a2c-4488-8111-32a1c705a45f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:03.885313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f17f3c42-11ae-4c2c-90ed-6b1d953e8ae9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:03.893767 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f17f3c42-11ae-4c2c-90ed-6b1d953e8ae9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1541 microversion: 2.1 time: 0.614070 May 27 15:01:03.894753 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 479/1006] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:03 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1541 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:03.900107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3bc03ebc-c9b5-42f8-bd24-e07d6ec00953 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:03.900850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3bc03ebc-c9b5-42f8-bd24-e07d6ec00953 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:03.907228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3bc03ebc-c9b5-42f8-bd24-e07d6ec00953 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:03.907997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3bc03ebc-c9b5-42f8-bd24-e07d6ec00953 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:03.909069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3bc03ebc-c9b5-42f8-bd24-e07d6ec00953 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:03.909843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3bc03ebc-c9b5-42f8-bd24-e07d6ec00953 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:03.939410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8a2a15c8-4a2c-4488-8111-32a1c705a45f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:03.951585 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8a2a15c8-4a2c-4488-8111-32a1c705a45f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25" status: 200 len: 1307 microversion: 2.1 time: 0.604869 May 27 15:01:03.954103 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 528/1007] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:03 2022] GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 => generated 1307 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:04.208140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-26b49776-45f0-472c-beee-d5240f4a3ce5 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:04.208975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-26b49776-45f0-472c-beee-d5240f4a3ce5 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] [instance: 0bced7f1-2fc9-401b-98fa-75a47d092a97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:04.224213 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26b49776-45f0-472c-beee-d5240f4a3ce5 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:04.224213 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26b49776-45f0-472c-beee-d5240f4a3ce5 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:04.224970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26b49776-45f0-472c-beee-d5240f4a3ce5 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:04.230110 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26b49776-45f0-472c-beee-d5240f4a3ce5 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:04.244305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3bc03ebc-c9b5-42f8-bd24-e07d6ec00953 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:04.253952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3bc03ebc-c9b5-42f8-bd24-e07d6ec00953 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:04.260213 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-26b49776-45f0-472c-beee-d5240f4a3ce5 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] HTTP exception thrown: Instance 0bced7f1-2fc9-401b-98fa-75a47d092a97 could not be found. May 27 15:01:04.260404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3bc03ebc-c9b5-42f8-bd24-e07d6ec00953 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:04.261522 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3bc03ebc-c9b5-42f8-bd24-e07d6ec00953 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.365578 May 27 15:01:04.262077 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 480/1008] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:03 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-26b49776-45f0-472c-beee-d5240f4a3ce5 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Request method failure captured: May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97 HTTP/1.1 May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOeJThg1-8G0js_9MTKuv6L0W_cvVeimuGuUQHTpFYkv8mzXyfLGZBQ_Ce8zCg7cpILXJPk2IJSFEsR0vst-ciQpDcmFjo4Kz5SybuGXM2xoQcdE_apOKbFgunN5Kh84YsSDm-00ApftbEcnRhfRpOcewADwCMsMpzh0h4Ffdhc8WoM May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 686f487ff60742dca747020a97818dbb May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-TenantUsagesTestJSON-1807823008 May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/686f487ff60742dca747020a97818dbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/686f487ff60742dca747020a97818dbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/686f487ff60742dca747020a97818dbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_686f487ff60742dca747020a97818dbb", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-TenantUsagesTestJSON-1807823008 May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 686f487ff60742dca747020a97818dbb May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1807823008 May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-TenantUsagesTestJSON-1807823008-project May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 5966aa558f434adda904f39536717363 May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-TenantUsagesTestJSON-1807823008-project May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 0bced7f1-2fc9-401b-98fa-75a47d092a97 could not be found. May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '0bced7f1-2fc9-401b-98fa-75a47d092a97'} May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bced7f1-2fc9-401b-98fa-75a47d092a97 could not be found. May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bced7f1-2fc9-401b-98fa-75a47d092a97 could not be found. May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:01:04.271332 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:01:04.275543 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:01:04.275543 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:01:04.275543 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:01:04.275543 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:01:04.275543 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:01:04.275543 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bced7f1-2fc9-401b-98fa-75a47d092a97 could not be found. May 27 15:01:04.275543 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:01:04.278205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-26b49776-45f0-472c-beee-d5240f4a3ce5 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] Returning 404 to user: Instance 0bced7f1-2fc9-401b-98fa-75a47d092a97 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:01:04.280199 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-26b49776-45f0-472c-beee-d5240f4a3ce5 tempest-TenantUsagesTestJSON-1807823008 tempest-TenantUsagesTestJSON-1807823008-project] 10.222.0.13 "GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97" status: 404 len: 111 microversion: 2.1 time: 0.085237 May 27 15:01:04.281325 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 529/1009] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:04 2022] GET /compute/v2.1/servers/0bced7f1-2fc9-401b-98fa-75a47d092a97 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:01:04.911983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d219e903-f12f-4eb8-95a9-605685841599 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:04.912609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d219e903-f12f-4eb8-95a9-605685841599 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:04.919821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:04.922350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d219e903-f12f-4eb8-95a9-605685841599 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:04.923809 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d219e903-f12f-4eb8-95a9-605685841599 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:04.924912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d219e903-f12f-4eb8-95a9-605685841599 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:04.925612 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d219e903-f12f-4eb8-95a9-605685841599 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:04.971001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8bc10b70-a8dc-490f-bbba-45cfb1d3313b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:04.972345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8bc10b70-a8dc-490f-bbba-45cfb1d3313b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:04.979986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8bc10b70-a8dc-490f-bbba-45cfb1d3313b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:04.980691 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8bc10b70-a8dc-490f-bbba-45cfb1d3313b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:04.981603 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8bc10b70-a8dc-490f-bbba-45cfb1d3313b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:04.982162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8bc10b70-a8dc-490f-bbba-45cfb1d3313b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:05.647809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8bc10b70-a8dc-490f-bbba-45cfb1d3313b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:05.659065 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8bc10b70-a8dc-490f-bbba-45cfb1d3313b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25" status: 200 len: 1307 microversion: 2.1 time: 0.693095 May 27 15:01:05.671224 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 530/1010] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:04 2022] GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 => generated 1307 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:01:05.676660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-915551d9-0fe2-4ac8-981c-a9bb59a0b8dc req-9b3322c3-2ed2-4b50-ada7-05b8b8cf3600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bced7f1-2fc9-401b-98fa-75a47d092a97", "name": "network-vif-deleted", "tag": "d33cd803-d7a9-4b4e-a1dc-4e0fc0e3d290"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:05.681963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d219e903-f12f-4eb8-95a9-605685841599 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:05.686061 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=7 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:05.690124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-915551d9-0fe2-4ac8-981c-a9bb59a0b8dc req-9b3322c3-2ed2-4b50-ada7-05b8b8cf3600 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:05.692164 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-915551d9-0fe2-4ac8-981c-a9bb59a0b8dc req-9b3322c3-2ed2-4b50-ada7-05b8b8cf3600 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:05.696199 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d219e903-f12f-4eb8-95a9-605685841599 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1541 microversion: 2.1 time: 0.789191 May 27 15:01:05.697153 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 481/1011] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:04 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1541 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:05.702138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fdf605b9-5aa5-4536-afc2-a7b73de8a0d1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:05.706803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fdf605b9-5aa5-4536-afc2-a7b73de8a0d1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:05.714008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fdf605b9-5aa5-4536-afc2-a7b73de8a0d1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:05.714734 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fdf605b9-5aa5-4536-afc2-a7b73de8a0d1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:05.715721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fdf605b9-5aa5-4536-afc2-a7b73de8a0d1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:05.716321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fdf605b9-5aa5-4536-afc2-a7b73de8a0d1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:05.721840 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-915551d9-0fe2-4ac8-981c-a9bb59a0b8dc req-9b3322c3-2ed2-4b50-ada7-05b8b8cf3600 service nova] Creating event network-vif-deleted:d33cd803-d7a9-4b4e-a1dc-4e0fc0e3d290 for instance 0bced7f1-2fc9-401b-98fa-75a47d092a97 on n-h1-843621-1 May 27 15:01:05.730636 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-915551d9-0fe2-4ac8-981c-a9bb59a0b8dc req-9b3322c3-2ed2-4b50-ada7-05b8b8cf3600 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056298 May 27 15:01:05.732009 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 531/1012] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:05.763709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=8 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:05.969653 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fdf605b9-5aa5-4536-afc2-a7b73de8a0d1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:05.983464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fdf605b9-5aa5-4536-afc2-a7b73de8a0d1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:05.985792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fdf605b9-5aa5-4536-afc2-a7b73de8a0d1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:05.987551 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fdf605b9-5aa5-4536-afc2-a7b73de8a0d1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.288867 May 27 15:01:05.988372 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 482/1013] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:05 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:06.684800 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d2c35e39-dd16-45f3-8720-9e20ca231aea tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:06.686071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d2c35e39-dd16-45f3-8720-9e20ca231aea tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:06.707577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2c35e39-dd16-45f3-8720-9e20ca231aea tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:06.708276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2c35e39-dd16-45f3-8720-9e20ca231aea tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:06.714143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8d9b3366-0216-491a-bdc2-f1d006b010f9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:06.714762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8d9b3366-0216-491a-bdc2-f1d006b010f9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:06.720274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2c35e39-dd16-45f3-8720-9e20ca231aea tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:06.726158 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2c35e39-dd16-45f3-8720-9e20ca231aea tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:06.729525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d9b3366-0216-491a-bdc2-f1d006b010f9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:06.730063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d9b3366-0216-491a-bdc2-f1d006b010f9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:06.731393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d9b3366-0216-491a-bdc2-f1d006b010f9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:06.733070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d9b3366-0216-491a-bdc2-f1d006b010f9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:07.238264 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8d9b3366-0216-491a-bdc2-f1d006b010f9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:07.247249 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d2c35e39-dd16-45f3-8720-9e20ca231aea tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:07.259643 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8d9b3366-0216-491a-bdc2-f1d006b010f9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1473 microversion: 2.1 time: 0.549224 May 27 15:01:07.264089 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d2c35e39-dd16-45f3-8720-9e20ca231aea tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25" status: 200 len: 1307 microversion: 2.1 time: 0.590199 May 27 15:01:07.265596 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 483/1014] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:06 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1473 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:07.280055 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 532/1015] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:06 2022] GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 => generated 1307 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:07.283341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9fb2fe89-8124-485d-946a-fbdc5e130162 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:07.283969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9fb2fe89-8124-485d-946a-fbdc5e130162 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:07.310332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9fb2fe89-8124-485d-946a-fbdc5e130162 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:07.310790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9fb2fe89-8124-485d-946a-fbdc5e130162 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:07.311588 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9fb2fe89-8124-485d-946a-fbdc5e130162 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:07.312040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9fb2fe89-8124-485d-946a-fbdc5e130162 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:07.808817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9fb2fe89-8124-485d-946a-fbdc5e130162 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:07.822431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9fb2fe89-8124-485d-946a-fbdc5e130162 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:07.831303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9fb2fe89-8124-485d-946a-fbdc5e130162 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:07.833100 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9fb2fe89-8124-485d-946a-fbdc5e130162 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.566462 May 27 15:01:07.833670 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 484/1016] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:07 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:07.891284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-1b199f4d-bd15-4dc4-a5ac-035e00f679ca req-eef2d511-1269-4c7d-b4e5-efe6818163b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25", "tag": "4e83a9ed-eea8-4580-a697-0ad1b8d1d61b"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:07.906091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:07.913237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-1b199f4d-bd15-4dc4-a5ac-035e00f679ca req-eef2d511-1269-4c7d-b4e5-efe6818163b8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:07.915097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-1b199f4d-bd15-4dc4-a5ac-035e00f679ca req-eef2d511-1269-4c7d-b4e5-efe6818163b8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:07.955516 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-1b199f4d-bd15-4dc4-a5ac-035e00f679ca req-eef2d511-1269-4c7d-b4e5-efe6818163b8 service nova] Creating event network-changed:4e83a9ed-eea8-4580-a697-0ad1b8d1d61b for instance bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 on n-h2-843621-1 May 27 15:01:07.977996 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-1b199f4d-bd15-4dc4-a5ac-035e00f679ca req-eef2d511-1269-4c7d-b4e5-efe6818163b8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089021 May 27 15:01:07.993595 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 533/1017] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:01:08.276968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f2001816-7427-48ee-a3c6-730cb62748ab tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:08.278188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f2001816-7427-48ee-a3c6-730cb62748ab tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:08.295334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c22aba8c-b19e-4775-af2d-1b31923dc313 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:08.296197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c22aba8c-b19e-4775-af2d-1b31923dc313 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:08.298516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2001816-7427-48ee-a3c6-730cb62748ab tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:08.298980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2001816-7427-48ee-a3c6-730cb62748ab tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:08.299768 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2001816-7427-48ee-a3c6-730cb62748ab tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:08.300207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2001816-7427-48ee-a3c6-730cb62748ab tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:08.315905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c22aba8c-b19e-4775-af2d-1b31923dc313 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:08.319431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c22aba8c-b19e-4775-af2d-1b31923dc313 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:08.327373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c22aba8c-b19e-4775-af2d-1b31923dc313 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:08.328402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c22aba8c-b19e-4775-af2d-1b31923dc313 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:08.864385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c22aba8c-b19e-4775-af2d-1b31923dc313 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:08.883300 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c22aba8c-b19e-4775-af2d-1b31923dc313 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25" status: 200 len: 1307 microversion: 2.1 time: 0.592408 May 27 15:01:08.889387 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 534/1018] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:08 2022] GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 => generated 1307 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:01:08.915537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eac3dd56-8fe3-4030-8202-d05ac75d9b60 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:08.933900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-eac3dd56-8fe3-4030-8202-d05ac75d9b60 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:08.945705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f2001816-7427-48ee-a3c6-730cb62748ab tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:08.953715 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f2001816-7427-48ee-a3c6-730cb62748ab tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1473 microversion: 2.1 time: 0.680815 May 27 15:01:08.954296 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 485/1019] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:08 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1473 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:08.989867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eac3dd56-8fe3-4030-8202-d05ac75d9b60 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:08.991587 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eac3dd56-8fe3-4030-8202-d05ac75d9b60 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:08.995904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eac3dd56-8fe3-4030-8202-d05ac75d9b60 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:08.998039 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eac3dd56-8fe3-4030-8202-d05ac75d9b60 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:09.572279 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eac3dd56-8fe3-4030-8202-d05ac75d9b60 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:09.590266 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eac3dd56-8fe3-4030-8202-d05ac75d9b60 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:09.592617 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eac3dd56-8fe3-4030-8202-d05ac75d9b60 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:09.597605 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-eac3dd56-8fe3-4030-8202-d05ac75d9b60 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.706243 May 27 15:01:09.602281 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 535/1020] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:08 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:09.868264 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-002853ec-6e4e-4762-8470-4a2249c1bfb7 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776d3fca0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:09.906882 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-68a4daa0-4a4c-4d70-a674-6a851ca3cc02 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:09.908091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-68a4daa0-4a4c-4d70-a674-6a851ca3cc02 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:09.918897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68a4daa0-4a4c-4d70-a674-6a851ca3cc02 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:09.920636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68a4daa0-4a4c-4d70-a674-6a851ca3cc02 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:09.921859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68a4daa0-4a4c-4d70-a674-6a851ca3cc02 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:09.922901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68a4daa0-4a4c-4d70-a674-6a851ca3cc02 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:09.991352 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-002853ec-6e4e-4762-8470-4a2249c1bfb7 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/d375f728-f963-4882-aa81-3efbc860b2f3" status: 200 len: 660 microversion: 2.1 time: 0.122327 May 27 15:01:09.992653 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 486/1021] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:09 2022] GET /compute/v2.1/images/d375f728-f963-4882-aa81-3efbc860b2f3 => generated 660 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:10.005217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4966305e-b8fe-4aa1-9aa4-b38cea43b7e1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:10.006034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4966305e-b8fe-4aa1-9aa4-b38cea43b7e1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:10.020311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4966305e-b8fe-4aa1-9aa4-b38cea43b7e1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:10.022031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4966305e-b8fe-4aa1-9aa4-b38cea43b7e1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:10.023102 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4966305e-b8fe-4aa1-9aa4-b38cea43b7e1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:10.023929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4966305e-b8fe-4aa1-9aa4-b38cea43b7e1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:10.568023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-68a4daa0-4a4c-4d70-a674-6a851ca3cc02 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:10.582423 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-68a4daa0-4a4c-4d70-a674-6a851ca3cc02 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25" status: 200 len: 1307 microversion: 2.1 time: 0.680043 May 27 15:01:10.583663 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 536/1022] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:09 2022] GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 => generated 1307 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:10.598478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b4a98ee0-deb2-4cd6-a513-a0623a31fa79 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776badca0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:10.670231 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b4a98ee0-deb2-4cd6-a513-a0623a31fa79 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/d375f728-f963-4882-aa81-3efbc860b2f3" status: 200 len: 660 microversion: 2.1 time: 0.085137 May 27 15:01:10.679627 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 537/1023] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:10 2022] GET /compute/v2.1/images/d375f728-f963-4882-aa81-3efbc860b2f3 => generated 660 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:10.687849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4966305e-b8fe-4aa1-9aa4-b38cea43b7e1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:10.698737 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1a739752-d943-45f9-97f6-f91c5b984032 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:10.700652 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4966305e-b8fe-4aa1-9aa4-b38cea43b7e1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1470 microversion: 2.1 time: 0.705124 May 27 15:01:10.702334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1a739752-d943-45f9-97f6-f91c5b984032 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:10.718349 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 487/1024] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:09 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1470 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:10.726018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-69aeab4f-debb-43f2-8545-09cca1485983 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:10.731426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-69aeab4f-debb-43f2-8545-09cca1485983 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:10.741587 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a739752-d943-45f9-97f6-f91c5b984032 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:10.743771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a739752-d943-45f9-97f6-f91c5b984032 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:10.745542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69aeab4f-debb-43f2-8545-09cca1485983 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:10.745705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a739752-d943-45f9-97f6-f91c5b984032 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:10.746819 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a739752-d943-45f9-97f6-f91c5b984032 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:10.747344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69aeab4f-debb-43f2-8545-09cca1485983 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:10.748511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69aeab4f-debb-43f2-8545-09cca1485983 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:10.750042 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69aeab4f-debb-43f2-8545-09cca1485983 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:10.812438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69aeab4f-debb-43f2-8545-09cca1485983 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:10.813233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69aeab4f-debb-43f2-8545-09cca1485983 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:10.814376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69aeab4f-debb-43f2-8545-09cca1485983 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:10.815768 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69aeab4f-debb-43f2-8545-09cca1485983 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:10.875045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-69aeab4f-debb-43f2-8545-09cca1485983 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Getting quotas for project 7369228028774765965f3cf001f8806a. Resources: {'ram', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:01:10.888554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-69aeab4f-debb-43f2-8545-09cca1485983 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Getting quotas for user a5a825c2385e490d81ddcbc2de76980d and project 7369228028774765965f3cf001f8806a. Resources: {'ram', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:01:11.168391 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1a739752-d943-45f9-97f6-f91c5b984032 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:11.189474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1a739752-d943-45f9-97f6-f91c5b984032 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:11.194062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1a739752-d943-45f9-97f6-f91c5b984032 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:11.199195 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1a739752-d943-45f9-97f6-f91c5b984032 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.516659 May 27 15:01:11.201714 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 538/1025] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:10 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:11.215717 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-69aeab4f-debb-43f2-8545-09cca1485983 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "POST /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f/action" status: 202 len: 0 microversion: 2.1 time: 0.495609 May 27 15:01:11.231606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fc7b8a58-0bc1-4665-b876-1eb0ca5a1a1d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:11.234756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fc7b8a58-0bc1-4665-b876-1eb0ca5a1a1d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:11.239015 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 488/1026] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:01:10 2022] POST /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:01:11.266183 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fc7b8a58-0bc1-4665-b876-1eb0ca5a1a1d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:11.271364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fc7b8a58-0bc1-4665-b876-1eb0ca5a1a1d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:11.276917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fc7b8a58-0bc1-4665-b876-1eb0ca5a1a1d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:11.278378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fc7b8a58-0bc1-4665-b876-1eb0ca5a1a1d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:11.600279 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-43c5e743-56a6-43b2-9b14-3c77eae10452 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:11.601010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-43c5e743-56a6-43b2-9b14-3c77eae10452 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:11.633262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43c5e743-56a6-43b2-9b14-3c77eae10452 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:11.633910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43c5e743-56a6-43b2-9b14-3c77eae10452 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:11.634742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43c5e743-56a6-43b2-9b14-3c77eae10452 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:11.635390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43c5e743-56a6-43b2-9b14-3c77eae10452 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:12.012428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fc7b8a58-0bc1-4665-b876-1eb0ca5a1a1d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:12.029467 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fc7b8a58-0bc1-4665-b876-1eb0ca5a1a1d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1469 microversion: 2.1 time: 0.802110 May 27 15:01:12.032483 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 539/1027] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:11 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1469 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:12.190362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-b0a508b0-0bfc-4c41-8143-c8a97ef7c1cf req-f9d714d5-e77b-40aa-a0ae-f30a331fe45c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39985ed3-7d07-48db-80b4-c570f7422e1f", "name": "network-vif-plugged", "status": "completed", "tag": "ac6d5c81-c7de-49e1-a62d-df0fdf576229"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:12.206713 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-b0a508b0-0bfc-4c41-8143-c8a97ef7c1cf req-f9d714d5-e77b-40aa-a0ae-f30a331fe45c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:12.213494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-b0a508b0-0bfc-4c41-8143-c8a97ef7c1cf req-f9d714d5-e77b-40aa-a0ae-f30a331fe45c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:12.260218 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-b0a508b0-0bfc-4c41-8143-c8a97ef7c1cf req-f9d714d5-e77b-40aa-a0ae-f30a331fe45c service nova] Creating event network-vif-plugged:ac6d5c81-c7de-49e1-a62d-df0fdf576229 for instance 39985ed3-7d07-48db-80b4-c570f7422e1f on n-h1-843621-1 May 27 15:01:12.269579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [req-b0a508b0-0bfc-4c41-8143-c8a97ef7c1cf req-f9d714d5-e77b-40aa-a0ae-f30a331fe45c service nova] Instance 39985ed3-7d07-48db-80b4-c570f7422e1f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119248) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 15:01:12.283936 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-b0a508b0-0bfc-4c41-8143-c8a97ef7c1cf req-f9d714d5-e77b-40aa-a0ae-f30a331fe45c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097268 May 27 15:01:12.286396 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 540/1028] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:12.294514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-be2a2f05-d5e6-4f76-a962-78490ccc9b57 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:12.300148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-be2a2f05-d5e6-4f76-a962-78490ccc9b57 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:12.313471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be2a2f05-d5e6-4f76-a962-78490ccc9b57 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:12.314761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be2a2f05-d5e6-4f76-a962-78490ccc9b57 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:12.316027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be2a2f05-d5e6-4f76-a962-78490ccc9b57 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:12.316915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be2a2f05-d5e6-4f76-a962-78490ccc9b57 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:12.457515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-43c5e743-56a6-43b2-9b14-3c77eae10452 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:12.473974 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-43c5e743-56a6-43b2-9b14-3c77eae10452 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25" status: 200 len: 1307 microversion: 2.1 time: 0.875400 May 27 15:01:12.484738 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 489/1029] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:11 2022] GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 => generated 1307 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:01:12.486968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-3cd6c237-fb74-4a90-a38a-c0b5b99e687b req-4430ac00-2b95-46ed-8f4e-6cb42adc4a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e4f7f7-6bda-4d0b-9685-74266d42efc0", "name": "network-vif-unplugged", "status": "completed", "tag": "2c3a966d-ef56-4dbf-afab-504228aa5443"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:12.520243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3cd6c237-fb74-4a90-a38a-c0b5b99e687b req-4430ac00-2b95-46ed-8f4e-6cb42adc4a55 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:12.523503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3cd6c237-fb74-4a90-a38a-c0b5b99e687b req-4430ac00-2b95-46ed-8f4e-6cb42adc4a55 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:12.565939 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-3cd6c237-fb74-4a90-a38a-c0b5b99e687b req-4430ac00-2b95-46ed-8f4e-6cb42adc4a55 service nova] Creating event network-vif-unplugged:2c3a966d-ef56-4dbf-afab-504228aa5443 for instance 18e4f7f7-6bda-4d0b-9685-74266d42efc0 on n-h2-843621-1 May 27 15:01:12.585095 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-3cd6c237-fb74-4a90-a38a-c0b5b99e687b req-4430ac00-2b95-46ed-8f4e-6cb42adc4a55 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100058 May 27 15:01:12.586306 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 490/1030] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:12.822776 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-be2a2f05-d5e6-4f76-a962-78490ccc9b57 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:12.837841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-be2a2f05-d5e6-4f76-a962-78490ccc9b57 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:12.842456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-be2a2f05-d5e6-4f76-a962-78490ccc9b57 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:12.846382 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-be2a2f05-d5e6-4f76-a962-78490ccc9b57 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.555605 May 27 15:01:12.847179 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 541/1031] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:12 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:12.916763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8c5c24b0-7cbd-4652-b956-98683d11a845 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776c79a60>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:12.983135 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8c5c24b0-7cbd-4652-b956-98683d11a845 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/4c3339da-8c0b-454c-ad21-4759cd025c38" status: 200 len: 662 microversion: 2.1 time: 0.071245 May 27 15:01:12.984050 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 491/1032] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:12 2022] GET /compute/v2.1/images/4c3339da-8c0b-454c-ad21-4759cd025c38 => generated 662 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:13.000995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-264c3eaa-988b-47f3-8a4d-2ef5c04a3256 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776e8cc10>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:13.051259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-861b5253-3365-4d25-86d3-96f77d38503e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:13.052132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-861b5253-3365-4d25-86d3-96f77d38503e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:13.061887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-861b5253-3365-4d25-86d3-96f77d38503e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:13.062699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-861b5253-3365-4d25-86d3-96f77d38503e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:13.064330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-861b5253-3365-4d25-86d3-96f77d38503e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:13.064798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-861b5253-3365-4d25-86d3-96f77d38503e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:13.070316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:13.076215 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-264c3eaa-988b-47f3-8a4d-2ef5c04a3256 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/4c3339da-8c0b-454c-ad21-4759cd025c38" status: 200 len: 662 microversion: 2.1 time: 0.083989 May 27 15:01:13.084130 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 542/1033] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:12 2022] GET /compute/v2.1/images/4c3339da-8c0b-454c-ad21-4759cd025c38 => generated 662 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:13.315026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-861b5253-3365-4d25-86d3-96f77d38503e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:13.327159 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-861b5253-3365-4d25-86d3-96f77d38503e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1469 microversion: 2.1 time: 0.280582 May 27 15:01:13.329396 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 492/1034] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:13 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1469 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:01:13.493374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ff737f50-5861-4b60-942d-cb4b8d915c37 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:13.495119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ff737f50-5861-4b60-942d-cb4b8d915c37 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:13.506710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff737f50-5861-4b60-942d-cb4b8d915c37 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:13.509231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff737f50-5861-4b60-942d-cb4b8d915c37 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:13.510240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff737f50-5861-4b60-942d-cb4b8d915c37 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:13.513379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff737f50-5861-4b60-942d-cb4b8d915c37 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:13.868423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ff737f50-5861-4b60-942d-cb4b8d915c37 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:13.873980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f09c1c2d-e2f9-4480-8178-0b7b12bee0e0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:13.874745 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f09c1c2d-e2f9-4480-8178-0b7b12bee0e0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:13.886637 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ff737f50-5861-4b60-942d-cb4b8d915c37 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25" status: 200 len: 1307 microversion: 2.1 time: 0.395711 May 27 15:01:13.888698 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 543/1035] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:13 2022] GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 => generated 1307 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:13.889428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f09c1c2d-e2f9-4480-8178-0b7b12bee0e0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:13.890170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f09c1c2d-e2f9-4480-8178-0b7b12bee0e0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:13.892372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f09c1c2d-e2f9-4480-8178-0b7b12bee0e0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:13.893152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f09c1c2d-e2f9-4480-8178-0b7b12bee0e0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:14.346551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bfb60ac3-3f14-4a02-94a7-2537e78a21c1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:14.347701 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bfb60ac3-3f14-4a02-94a7-2537e78a21c1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:14.358368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bfb60ac3-3f14-4a02-94a7-2537e78a21c1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:14.361996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bfb60ac3-3f14-4a02-94a7-2537e78a21c1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:14.367680 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bfb60ac3-3f14-4a02-94a7-2537e78a21c1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:14.370674 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bfb60ac3-3f14-4a02-94a7-2537e78a21c1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:14.757005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f09c1c2d-e2f9-4480-8178-0b7b12bee0e0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:14.783027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f09c1c2d-e2f9-4480-8178-0b7b12bee0e0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:14.786465 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f09c1c2d-e2f9-4480-8178-0b7b12bee0e0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:14.790378 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f09c1c2d-e2f9-4480-8178-0b7b12bee0e0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.928370 May 27 15:01:14.793599 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 493/1036] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:13 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:01:15.035420 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fb3deb23-b191-45e6-acc3-27484134710e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-485206648", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "074e6ca5-e288-4e55-93f1-c94259613f42"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:15.114656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-fb3deb23-b191-45e6-acc3-27484134710e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] validate_networks() for [('074e6ca5-e288-4e55-93f1-c94259613f42', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:01:15.362275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bfb60ac3-3f14-4a02-94a7-2537e78a21c1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:15.374592 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bfb60ac3-3f14-4a02-94a7-2537e78a21c1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1469 microversion: 2.1 time: 1.031465 May 27 15:01:15.375337 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 544/1037] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:14 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1469 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:01:15.381355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-d305462a-7d63-4aef-92e3-9067972c39ed req-e4966cf8-78b2-4e27-8703-df3bc00bbd61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25", "name": "network-vif-plugged", "status": "completed", "tag": "4e83a9ed-eea8-4580-a697-0ad1b8d1d61b"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:15.391589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d305462a-7d63-4aef-92e3-9067972c39ed req-e4966cf8-78b2-4e27-8703-df3bc00bbd61 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:15.392184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d305462a-7d63-4aef-92e3-9067972c39ed req-e4966cf8-78b2-4e27-8703-df3bc00bbd61 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:15.404407 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-d305462a-7d63-4aef-92e3-9067972c39ed req-e4966cf8-78b2-4e27-8703-df3bc00bbd61 service nova] Creating event network-vif-plugged:4e83a9ed-eea8-4580-a697-0ad1b8d1d61b for instance bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 on n-h2-843621-1 May 27 15:01:15.410889 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-d305462a-7d63-4aef-92e3-9067972c39ed req-e4966cf8-78b2-4e27-8703-df3bc00bbd61 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034200 May 27 15:01:15.411627 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 545/1038] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:15.418520 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-4191d7e4-93eb-4d7e-9e74-9e8e2b8650bc req-d928b903-4d62-49e1-a5d4-54f47f7c05e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18e4f7f7-6bda-4d0b-9685-74266d42efc0", "tag": "2c3a966d-ef56-4dbf-afab-504228aa5443"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:15.428450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-4191d7e4-93eb-4d7e-9e74-9e8e2b8650bc req-d928b903-4d62-49e1-a5d4-54f47f7c05e5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:15.429382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-4191d7e4-93eb-4d7e-9e74-9e8e2b8650bc req-d928b903-4d62-49e1-a5d4-54f47f7c05e5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:15.451901 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-4191d7e4-93eb-4d7e-9e74-9e8e2b8650bc req-d928b903-4d62-49e1-a5d4-54f47f7c05e5 service nova] Creating event network-changed:2c3a966d-ef56-4dbf-afab-504228aa5443 for instance 18e4f7f7-6bda-4d0b-9685-74266d42efc0 on n-h2-843621-1 May 27 15:01:15.459867 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-4191d7e4-93eb-4d7e-9e74-9e8e2b8650bc req-d928b903-4d62-49e1-a5d4-54f47f7c05e5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046548 May 27 15:01:15.461049 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 546/1039] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:15.468264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3a5850b7-163d-4d5b-a563-de33577294a7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:15.469211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3a5850b7-163d-4d5b-a563-de33577294a7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:15.516965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a5850b7-163d-4d5b-a563-de33577294a7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:15.517716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a5850b7-163d-4d5b-a563-de33577294a7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:15.518722 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a5850b7-163d-4d5b-a563-de33577294a7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:15.519897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a5850b7-163d-4d5b-a563-de33577294a7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:15.533911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:15.931465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3a5850b7-163d-4d5b-a563-de33577294a7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:15.942980 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3a5850b7-163d-4d5b-a563-de33577294a7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25" status: 200 len: 1307 microversion: 2.1 time: 0.478706 May 27 15:01:15.944007 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 547/1040] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:15 2022] GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 => generated 1307 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:15.949588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fb5e070d-ee6c-452e-b869-5564a2df064d tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776c50430>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:16.023654 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fb5e070d-ee6c-452e-b869-5564a2df064d tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/6042ce3e-12b5-4af7-82f6-90882e320280" status: 200 len: 662 microversion: 2.1 time: 0.078215 May 27 15:01:16.031563 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 548/1041] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:15 2022] GET /compute/v2.1/images/6042ce3e-12b5-4af7-82f6-90882e320280 => generated 662 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:16.036609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c53aa7cf-2a70-476a-8495-1115c4d478eb tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:16.037481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c53aa7cf-2a70-476a-8495-1115c4d478eb tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:16.049569 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c53aa7cf-2a70-476a-8495-1115c4d478eb tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:16.050028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c53aa7cf-2a70-476a-8495-1115c4d478eb tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:16.050994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c53aa7cf-2a70-476a-8495-1115c4d478eb tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:16.051550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c53aa7cf-2a70-476a-8495-1115c4d478eb tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:16.065738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-fb3deb23-b191-45e6-acc3-27484134710e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:01:16.071617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-fb3deb23-b191-45e6-acc3-27484134710e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:01:16.072164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-fb3deb23-b191-45e6-acc3-27484134710e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:01:16.072575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-fb3deb23-b191-45e6-acc3-27484134710e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:01:16.073061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-fb3deb23-b191-45e6-acc3-27484134710e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:01:16.085369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb3deb23-b191-45e6-acc3-27484134710e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:16.086127 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb3deb23-b191-45e6-acc3-27484134710e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:16.087284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb3deb23-b191-45e6-acc3-27484134710e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:16.087911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb3deb23-b191-45e6-acc3-27484134710e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:16.117109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-fb3deb23-b191-45e6-acc3-27484134710e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Getting quotas for project be47565a2f034bbd8f81292196597473. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:01:16.124869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-fb3deb23-b191-45e6-acc3-27484134710e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Getting quotas for user f37aeba85d8b4c1282ac1b470836bae6 and project be47565a2f034bbd8f81292196597473. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:01:16.142055 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fb3deb23-b191-45e6-acc3-27484134710e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:01:16.144758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fb3deb23-b191-45e6-acc3-27484134710e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:01:16.240184 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fb3deb23-b191-45e6-acc3-27484134710e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.444522 May 27 15:01:16.246433 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 494/1042] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:01:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:01:16.253180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bab58c8e-ccab-4adc-9981-15cd3f571c50 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776c37c10>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:16.318937 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bab58c8e-ccab-4adc-9981-15cd3f571c50 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/6042ce3e-12b5-4af7-82f6-90882e320280" status: 200 len: 662 microversion: 2.1 time: 0.071063 May 27 15:01:16.335438 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 495/1043] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:16 2022] GET /compute/v2.1/images/6042ce3e-12b5-4af7-82f6-90882e320280 => generated 662 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:16.348165 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cc64346b-00fd-4f56-bac8-3b39362ccfcd tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:16.365317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cc64346b-00fd-4f56-bac8-3b39362ccfcd tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:16.695733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cc64346b-00fd-4f56-bac8-3b39362ccfcd tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37aeba85d8b4c1282ac1b470836bae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be47565a2f034bbd8f81292196597473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:16.704064 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cc64346b-00fd-4f56-bac8-3b39362ccfcd tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3" status: 200 len: 1217 microversion: 2.1 time: 0.367318 May 27 15:01:16.704642 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 496/1044] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:16 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3 => generated 1217 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:16.710961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4b15d853-5d5c-42f6-bad2-4522ef048964 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:16.711583 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4b15d853-5d5c-42f6-bad2-4522ef048964 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:16.739578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b15d853-5d5c-42f6-bad2-4522ef048964 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:16.740058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b15d853-5d5c-42f6-bad2-4522ef048964 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:16.741187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b15d853-5d5c-42f6-bad2-4522ef048964 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:16.741821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b15d853-5d5c-42f6-bad2-4522ef048964 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:16.820241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c53aa7cf-2a70-476a-8495-1115c4d478eb tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:16.838376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c53aa7cf-2a70-476a-8495-1115c4d478eb tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:16.841424 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c53aa7cf-2a70-476a-8495-1115c4d478eb tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:16.842685 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c53aa7cf-2a70-476a-8495-1115c4d478eb tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.809873 May 27 15:01:16.848529 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 549/1045] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:16 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:16.877057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c54e261e-73d3-45dc-b203-3e3741f7fa4e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1581903805", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:16.984512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-c54e261e-73d3-45dc-b203-3e3741f7fa4e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] validate_networks() for None {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:01:17.409546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4b15d853-5d5c-42f6-bad2-4522ef048964 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:17.429908 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4b15d853-5d5c-42f6-bad2-4522ef048964 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1535 microversion: 2.1 time: 0.724165 May 27 15:01:17.431247 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 497/1046] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:16 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1535 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:17.456054 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-49af19bb-b87d-4ac5-819c-44b49197a7ef tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:17.459767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-49af19bb-b87d-4ac5-819c-44b49197a7ef tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:17.496597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-49af19bb-b87d-4ac5-819c-44b49197a7ef tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:17.498283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-49af19bb-b87d-4ac5-819c-44b49197a7ef tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:17.503293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-49af19bb-b87d-4ac5-819c-44b49197a7ef tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:17.505029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-49af19bb-b87d-4ac5-819c-44b49197a7ef tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:17.757142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-c54e261e-73d3-45dc-b203-3e3741f7fa4e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:01:17.757770 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-c54e261e-73d3-45dc-b203-3e3741f7fa4e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:01:17.758579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-c54e261e-73d3-45dc-b203-3e3741f7fa4e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:01:17.759293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-c54e261e-73d3-45dc-b203-3e3741f7fa4e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:01:17.760206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-c54e261e-73d3-45dc-b203-3e3741f7fa4e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:01:17.772327 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c54e261e-73d3-45dc-b203-3e3741f7fa4e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:17.773077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c54e261e-73d3-45dc-b203-3e3741f7fa4e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:17.774450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c54e261e-73d3-45dc-b203-3e3741f7fa4e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:17.775074 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c54e261e-73d3-45dc-b203-3e3741f7fa4e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:17.803258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-c54e261e-73d3-45dc-b203-3e3741f7fa4e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Getting quotas for project 322433b59fd84c6eadc41b4d21f0601b. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:01:17.828215 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-c54e261e-73d3-45dc-b203-3e3741f7fa4e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Getting quotas for user 6b0b310046184dd49ba35d33ac2e958d and project 322433b59fd84c6eadc41b4d21f0601b. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:01:17.854428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c54e261e-73d3-45dc-b203-3e3741f7fa4e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:01:17.858920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c54e261e-73d3-45dc-b203-3e3741f7fa4e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 73173e14-0308-44e3-adc9-8bbd5509246c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:01:17.899671 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-49af19bb-b87d-4ac5-819c-44b49197a7ef tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:17.908622 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-49af19bb-b87d-4ac5-819c-44b49197a7ef tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25" status: 200 len: 1487 microversion: 2.1 time: 0.468046 May 27 15:01:17.927322 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 498/1047] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:17 2022] GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 => generated 1487 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:17.932120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-3bd88064-5e91-4de5-a4b2-e3b2b3d506a4 req-84fbe730-6e42-490b-9164-258c375af173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39985ed3-7d07-48db-80b4-c570f7422e1f", "name": "network-vif-unplugged", "status": "completed", "tag": "ac6d5c81-c7de-49e1-a62d-df0fdf576229"}, {"name": "network-changed", "server_uuid": "39985ed3-7d07-48db-80b4-c570f7422e1f", "tag": "ac6d5c81-c7de-49e1-a62d-df0fdf576229"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:17.932619 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c54e261e-73d3-45dc-b203-3e3741f7fa4e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082294 May 27 15:01:17.945194 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 550/1048] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:01:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:01:17.951330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3bd88064-5e91-4de5-a4b2-e3b2b3d506a4 req-84fbe730-6e42-490b-9164-258c375af173 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:17.958388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3bd88064-5e91-4de5-a4b2-e3b2b3d506a4 req-84fbe730-6e42-490b-9164-258c375af173 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:17.970297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4e007a3f-3d6a-4823-8992-384676be788b tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:17.971518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4e007a3f-3d6a-4823-8992-384676be788b tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:17.981199 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-3bd88064-5e91-4de5-a4b2-e3b2b3d506a4 req-84fbe730-6e42-490b-9164-258c375af173 service nova] Creating event network-vif-unplugged:ac6d5c81-c7de-49e1-a62d-df0fdf576229 for instance 39985ed3-7d07-48db-80b4-c570f7422e1f on n-h2-843621-1 May 27 15:01:17.982038 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-3bd88064-5e91-4de5-a4b2-e3b2b3d506a4 req-84fbe730-6e42-490b-9164-258c375af173 service nova] Creating event network-changed:ac6d5c81-c7de-49e1-a62d-df0fdf576229 for instance 39985ed3-7d07-48db-80b4-c570f7422e1f on n-h2-843621-1 May 27 15:01:17.996528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [req-3bd88064-5e91-4de5-a4b2-e3b2b3d506a4 req-84fbe730-6e42-490b-9164-258c375af173 service nova] Instance 39985ed3-7d07-48db-80b4-c570f7422e1f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119249) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 15:01:17.999220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e007a3f-3d6a-4823-8992-384676be788b tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:18.002827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e007a3f-3d6a-4823-8992-384676be788b tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:18.004446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e007a3f-3d6a-4823-8992-384676be788b tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:18.005188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e007a3f-3d6a-4823-8992-384676be788b tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:18.039712 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-3bd88064-5e91-4de5-a4b2-e3b2b3d506a4 req-84fbe730-6e42-490b-9164-258c375af173 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.111024 May 27 15:01:18.045725 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 499/1049] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:18.053149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aeeb826d-68a3-458f-a238-b3c3c96b0883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:18.067672 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-aeeb826d-68a3-458f-a238-b3c3c96b0883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:18.080574 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aeeb826d-68a3-458f-a238-b3c3c96b0883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:18.092090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aeeb826d-68a3-458f-a238-b3c3c96b0883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:18.093945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aeeb826d-68a3-458f-a238-b3c3c96b0883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:18.095207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aeeb826d-68a3-458f-a238-b3c3c96b0883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:18.156304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4e007a3f-3d6a-4823-8992-384676be788b tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37aeba85d8b4c1282ac1b470836bae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be47565a2f034bbd8f81292196597473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:18.165986 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4e007a3f-3d6a-4823-8992-384676be788b tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3" status: 200 len: 1277 microversion: 2.1 time: 0.219263 May 27 15:01:18.166493 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 551/1050] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:17 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3 => generated 1277 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:18.183096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-10cbf738-6eea-403a-8e15-8249081259ef tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:18.183854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-10cbf738-6eea-403a-8e15-8249081259ef tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:18.191137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10cbf738-6eea-403a-8e15-8249081259ef tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:18.191781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10cbf738-6eea-403a-8e15-8249081259ef tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:18.193014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10cbf738-6eea-403a-8e15-8249081259ef tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:18.193620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10cbf738-6eea-403a-8e15-8249081259ef tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:18.369524 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-10cbf738-6eea-403a-8e15-8249081259ef tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "POST /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25/action" status: 202 len: 0 microversion: 2.1 time: 0.197833 May 27 15:01:18.376735 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 552/1051] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:01:18 2022] POST /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:01:18.388813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8f2a1c3c-0c71-4556-bc44-b4a9a85ea64b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1862788460", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:18.495724 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-8f2a1c3c-0c71-4556-bc44-b4a9a85ea64b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] validate_networks() for None {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:01:18.663672 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-aeeb826d-68a3-458f-a238-b3c3c96b0883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:18.677257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-aeeb826d-68a3-458f-a238-b3c3c96b0883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:18.679031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-aeeb826d-68a3-458f-a238-b3c3c96b0883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:18.682023 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-aeeb826d-68a3-458f-a238-b3c3c96b0883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.634861 May 27 15:01:18.683959 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 500/1052] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:18 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:18.699263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5f500f0e-85f0-4a32-acc9-7469e708b103 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:18.699894 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5f500f0e-85f0-4a32-acc9-7469e708b103 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:18.709409 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5f500f0e-85f0-4a32-acc9-7469e708b103 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:18.709871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5f500f0e-85f0-4a32-acc9-7469e708b103 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:18.710662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5f500f0e-85f0-4a32-acc9-7469e708b103 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:18.711109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5f500f0e-85f0-4a32-acc9-7469e708b103 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:18.998125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-8f2a1c3c-0c71-4556-bc44-b4a9a85ea64b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:01:18.998592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-8f2a1c3c-0c71-4556-bc44-b4a9a85ea64b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:01:18.998833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-8f2a1c3c-0c71-4556-bc44-b4a9a85ea64b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:01:18.999430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-8f2a1c3c-0c71-4556-bc44-b4a9a85ea64b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:01:18.999847 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-8f2a1c3c-0c71-4556-bc44-b4a9a85ea64b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:01:19.013377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f2a1c3c-0c71-4556-bc44-b4a9a85ea64b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:19.013840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f2a1c3c-0c71-4556-bc44-b4a9a85ea64b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:19.021498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f2a1c3c-0c71-4556-bc44-b4a9a85ea64b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:19.022764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f2a1c3c-0c71-4556-bc44-b4a9a85ea64b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:19.049251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-8f2a1c3c-0c71-4556-bc44-b4a9a85ea64b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Getting quotas for project 322433b59fd84c6eadc41b4d21f0601b. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:01:19.061431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-8f2a1c3c-0c71-4556-bc44-b4a9a85ea64b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Getting quotas for user 6b0b310046184dd49ba35d33ac2e958d and project 322433b59fd84c6eadc41b4d21f0601b. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:01:19.063871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5f500f0e-85f0-4a32-acc9-7469e708b103 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:19.075181 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5f500f0e-85f0-4a32-acc9-7469e708b103 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25" status: 200 len: 1472 microversion: 2.1 time: 0.389968 May 27 15:01:19.079189 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 501/1053] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:18 2022] GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 => generated 1472 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:19.083335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8f2a1c3c-0c71-4556-bc44-b4a9a85ea64b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:01:19.089191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8f2a1c3c-0c71-4556-bc44-b4a9a85ea64b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:01:19.092834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e1258849-112e-4e73-a697-0885fbf87971 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:19.093472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e1258849-112e-4e73-a697-0885fbf87971 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:19.105822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1258849-112e-4e73-a697-0885fbf87971 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:19.107258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1258849-112e-4e73-a697-0885fbf87971 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:19.114369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1258849-112e-4e73-a697-0885fbf87971 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:19.118437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1258849-112e-4e73-a697-0885fbf87971 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:19.172364 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8f2a1c3c-0c71-4556-bc44-b4a9a85ea64b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.794005 May 27 15:01:19.173630 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 553/1054] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:01:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:01:19.187908 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b6a1f19e-fd67-48be-8253-c8bf5ddf09cb tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-304487490"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:19.189141 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b6a1f19e-fd67-48be-8253-c8bf5ddf09cb tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:19.198844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b6a1f19e-fd67-48be-8253-c8bf5ddf09cb tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:19.199316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b6a1f19e-fd67-48be-8253-c8bf5ddf09cb tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:19.200643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b6a1f19e-fd67-48be-8253-c8bf5ddf09cb tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:19.201888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b6a1f19e-fd67-48be-8253-c8bf5ddf09cb tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:19.449164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e1258849-112e-4e73-a697-0885fbf87971 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:19.458451 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e1258849-112e-4e73-a697-0885fbf87971 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1535 microversion: 2.1 time: 0.378171 May 27 15:01:19.459223 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 502/1055] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:19 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1535 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:19.467864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-48f7b0a1-7d57-4f0b-9b44-742406e84f42 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:19.482372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-48f7b0a1-7d57-4f0b-9b44-742406e84f42 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:19.679568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-48f7b0a1-7d57-4f0b-9b44-742406e84f42 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:19.695299 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-48f7b0a1-7d57-4f0b-9b44-742406e84f42 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 1218 microversion: 2.1 time: 0.229616 May 27 15:01:19.698555 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 503/1056] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:19 2022] GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 1218 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:19.707771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-abab5552-02e0-4545-b2b8-821b92946979 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:19.710431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-abab5552-02e0-4545-b2b8-821b92946979 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:19.729635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-abab5552-02e0-4545-b2b8-821b92946979 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:19.730106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-abab5552-02e0-4545-b2b8-821b92946979 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:19.730909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-abab5552-02e0-4545-b2b8-821b92946979 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:19.733666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-abab5552-02e0-4545-b2b8-821b92946979 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:19.807106 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b6a1f19e-fd67-48be-8253-c8bf5ddf09cb tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "POST /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25/action" status: 202 len: 0 microversion: 2.1 time: 0.625087 May 27 15:01:19.810554 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 554/1057] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:01:19 2022] POST /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25/action => generated 0 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 27 15:01:19.819608 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a169cd36-6e1b-4f28-be05-85d518f36ea0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:19.823622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-abab5552-02e0-4545-b2b8-821b92946979 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37aeba85d8b4c1282ac1b470836bae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be47565a2f034bbd8f81292196597473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:19.824950 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a169cd36-6e1b-4f28-be05-85d518f36ea0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:19.836447 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-abab5552-02e0-4545-b2b8-821b92946979 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3" status: 200 len: 1275 microversion: 2.1 time: 0.134381 May 27 15:01:19.841316 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 504/1058] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:19 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3 => generated 1275 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:19.845318 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a169cd36-6e1b-4f28-be05-85d518f36ea0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:19.848936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a169cd36-6e1b-4f28-be05-85d518f36ea0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:19.850267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a169cd36-6e1b-4f28-be05-85d518f36ea0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:19.856889 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a169cd36-6e1b-4f28-be05-85d518f36ea0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:19.866991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-295a5bf2-ee2d-4191-905b-9997ab23d071 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776c53700>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:19.965696 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-295a5bf2-ee2d-4191-905b-9997ab23d071 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1411 microversion: 2.1 time: 0.121814 May 27 15:01:19.966939 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 505/1059] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:19 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1411 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:20.090493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a169cd36-6e1b-4f28-be05-85d518f36ea0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:20.101462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a169cd36-6e1b-4f28-be05-85d518f36ea0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:20.104045 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a169cd36-6e1b-4f28-be05-85d518f36ea0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:20.106447 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a169cd36-6e1b-4f28-be05-85d518f36ea0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.293752 May 27 15:01:20.106597 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 555/1060] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:19 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:20.485910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1297901d-08cb-4f91-8350-e4386d06d00e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:20.497552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1297901d-08cb-4f91-8350-e4386d06d00e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:20.526403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1297901d-08cb-4f91-8350-e4386d06d00e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:20.528695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1297901d-08cb-4f91-8350-e4386d06d00e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:20.530881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1297901d-08cb-4f91-8350-e4386d06d00e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:20.531692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1297901d-08cb-4f91-8350-e4386d06d00e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:20.714432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1297901d-08cb-4f91-8350-e4386d06d00e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:20.715491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-12e2c175-8851-4516-857e-7c69b746b155 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:20.716135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-12e2c175-8851-4516-857e-7c69b746b155 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:20.726460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12e2c175-8851-4516-857e-7c69b746b155 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:20.726923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12e2c175-8851-4516-857e-7c69b746b155 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:20.728927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12e2c175-8851-4516-857e-7c69b746b155 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:20.729581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12e2c175-8851-4516-857e-7c69b746b155 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:20.733072 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1297901d-08cb-4f91-8350-e4386d06d00e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1535 microversion: 2.1 time: 0.256772 May 27 15:01:20.749140 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 506/1061] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:20 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1535 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:20.810756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-12e2c175-8851-4516-857e-7c69b746b155 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:20.820507 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-12e2c175-8851-4516-857e-7c69b746b155 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 1222 microversion: 2.1 time: 0.108751 May 27 15:01:20.822094 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 556/1062] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:20 2022] GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 1222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:20.865777 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-243eeb90-d6b7-4454-aaa8-f8d75c9c2623 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:20.866824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-243eeb90-d6b7-4454-aaa8-f8d75c9c2623 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:20.890896 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-243eeb90-d6b7-4454-aaa8-f8d75c9c2623 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:20.892059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-243eeb90-d6b7-4454-aaa8-f8d75c9c2623 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:20.893434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-243eeb90-d6b7-4454-aaa8-f8d75c9c2623 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:20.895730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-243eeb90-d6b7-4454-aaa8-f8d75c9c2623 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:20.980885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c0be8dd8-e22f-42ab-bf86-5b9af1ceb5ed tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776b61310>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:21.049550 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c0be8dd8-e22f-42ab-bf86-5b9af1ceb5ed tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1411 microversion: 2.1 time: 0.073378 May 27 15:01:21.050283 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 557/1063] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:20 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1411 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:21.125269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2a067542-6327-412f-b3eb-fc9d5a825374 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:21.126879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2a067542-6327-412f-b3eb-fc9d5a825374 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:21.131796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-243eeb90-d6b7-4454-aaa8-f8d75c9c2623 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37aeba85d8b4c1282ac1b470836bae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be47565a2f034bbd8f81292196597473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:21.139927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a067542-6327-412f-b3eb-fc9d5a825374 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:21.140828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a067542-6327-412f-b3eb-fc9d5a825374 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:21.141969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a067542-6327-412f-b3eb-fc9d5a825374 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:21.145387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a067542-6327-412f-b3eb-fc9d5a825374 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:21.155383 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-243eeb90-d6b7-4454-aaa8-f8d75c9c2623 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3" status: 200 len: 1317 microversion: 2.1 time: 0.293338 May 27 15:01:21.156549 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 507/1064] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:20 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3 => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:21.562627 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2a067542-6327-412f-b3eb-fc9d5a825374 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:21.574582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2a067542-6327-412f-b3eb-fc9d5a825374 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:21.576550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2a067542-6327-412f-b3eb-fc9d5a825374 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:21.578309 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2a067542-6327-412f-b3eb-fc9d5a825374 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.457007 May 27 15:01:21.579620 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 558/1065] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:21 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:01:21.591436 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-38b87bcf-a1f5-4ec1-8563-6cd52e2e4f1a req-2511afb6-7cd3-4aa5-a9b2-663f4e88dd3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1699aaf-d186-4cde-ac8c-318a335635b3", "tag": "c4f42381-866f-40f4-907d-639a893e5639"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:21.602702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-38b87bcf-a1f5-4ec1-8563-6cd52e2e4f1a req-2511afb6-7cd3-4aa5-a9b2-663f4e88dd3a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:21.603727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-38b87bcf-a1f5-4ec1-8563-6cd52e2e4f1a req-2511afb6-7cd3-4aa5-a9b2-663f4e88dd3a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:21.619324 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-38b87bcf-a1f5-4ec1-8563-6cd52e2e4f1a req-2511afb6-7cd3-4aa5-a9b2-663f4e88dd3a service nova] Creating event network-changed:c4f42381-866f-40f4-907d-639a893e5639 for instance c1699aaf-d186-4cde-ac8c-318a335635b3 on n-h1-843621-1 May 27 15:01:21.626050 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-38b87bcf-a1f5-4ec1-8563-6cd52e2e4f1a req-2511afb6-7cd3-4aa5-a9b2-663f4e88dd3a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038406 May 27 15:01:21.626972 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 508/1066] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:21.753292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4b03ef2a-02e7-4e2e-85a5-6b63a11a1111 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:21.753962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4b03ef2a-02e7-4e2e-85a5-6b63a11a1111 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:21.763109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b03ef2a-02e7-4e2e-85a5-6b63a11a1111 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:21.763568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b03ef2a-02e7-4e2e-85a5-6b63a11a1111 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:21.764364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b03ef2a-02e7-4e2e-85a5-6b63a11a1111 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:21.764846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b03ef2a-02e7-4e2e-85a5-6b63a11a1111 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:21.838983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fa71f358-941b-4ab0-825f-13766fdc598b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:21.839706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fa71f358-941b-4ab0-825f-13766fdc598b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:21.860747 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa71f358-941b-4ab0-825f-13766fdc598b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:21.861322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa71f358-941b-4ab0-825f-13766fdc598b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:21.862435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa71f358-941b-4ab0-825f-13766fdc598b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:21.863452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa71f358-941b-4ab0-825f-13766fdc598b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:22.060603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fa71f358-941b-4ab0-825f-13766fdc598b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:22.075000 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fa71f358-941b-4ab0-825f-13766fdc598b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 1278 microversion: 2.1 time: 0.241107 May 27 15:01:22.075602 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 509/1067] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:21 2022] GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 1278 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:01:22.080069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9d9aa8b2-76f1-4d04-8e0e-71c3e46696b2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776d29dc0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:22.149560 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9d9aa8b2-76f1-4d04-8e0e-71c3e46696b2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1411 microversion: 2.1 time: 0.072351 May 27 15:01:22.150829 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 510/1068] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:22 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1411 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:22.171879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-11989d5c-81a3-4949-ae79-9be566caa30a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:22.172506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-11989d5c-81a3-4949-ae79-9be566caa30a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:22.174647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:22.182729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11989d5c-81a3-4949-ae79-9be566caa30a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:22.183441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11989d5c-81a3-4949-ae79-9be566caa30a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:22.184248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11989d5c-81a3-4949-ae79-9be566caa30a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:22.184710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11989d5c-81a3-4949-ae79-9be566caa30a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:22.198340 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4b03ef2a-02e7-4e2e-85a5-6b63a11a1111 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:22.210077 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4b03ef2a-02e7-4e2e-85a5-6b63a11a1111 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1528 microversion: 2.1 time: 0.461000 May 27 15:01:22.213702 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 559/1069] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:21 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1528 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:22.253986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0706a51b-0d2e-4b67-9872-9fc4f927451d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:22.254909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0706a51b-0d2e-4b67-9872-9fc4f927451d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:22.268988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0706a51b-0d2e-4b67-9872-9fc4f927451d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:22.270344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0706a51b-0d2e-4b67-9872-9fc4f927451d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:22.271408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0706a51b-0d2e-4b67-9872-9fc4f927451d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:22.272070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0706a51b-0d2e-4b67-9872-9fc4f927451d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:22.562218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-11989d5c-81a3-4949-ae79-9be566caa30a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37aeba85d8b4c1282ac1b470836bae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be47565a2f034bbd8f81292196597473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:22.597848 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-11989d5c-81a3-4949-ae79-9be566caa30a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3" status: 200 len: 1317 microversion: 2.1 time: 0.427080 May 27 15:01:22.599254 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 511/1070] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:22 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3 => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:01:22.608256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-353db04d-8cfa-46fd-9305-d1019791817c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:22.609363 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-353db04d-8cfa-46fd-9305-d1019791817c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:22.619688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-353db04d-8cfa-46fd-9305-d1019791817c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:22.620328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-353db04d-8cfa-46fd-9305-d1019791817c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:22.621470 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-353db04d-8cfa-46fd-9305-d1019791817c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:22.622224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-353db04d-8cfa-46fd-9305-d1019791817c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:22.719318 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0706a51b-0d2e-4b67-9872-9fc4f927451d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:22.728514 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0706a51b-0d2e-4b67-9872-9fc4f927451d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1528 microversion: 2.1 time: 0.501965 May 27 15:01:22.729120 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 560/1071] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:22 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1528 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:22.762946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a0dfddde-330a-4179-84d4-46666639d142 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:22.766646 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:01:22.766646 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:01:22.782667 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-a0dfddde-330a-4179-84d4-46666639d142 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] HTTP exception thrown: Flavor 5b9cd6b6-29e3-47b2-8b98-d98ca88503f4 could not be found. May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a0dfddde-330a-4179-84d4-46666639d142 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Request method failure captured: May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/flavors/5b9cd6b6-29e3-47b2-8b98-d98ca88503f4 HTTP/1.1 May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObbHpJd2ct9mCuANzhb1txG8yzukOzwbVujTM-bPqdTbYdMnIQFoO91U1htf6mIAQ-q0bngsAx_gxaaiLKR-5C2FWo3yUXv9eM0vhpfrO9hPmnWjG19DGYWsrCQKEko3nW__aYHMDiIgI6L0Vc_Xp5vEEMPzh_gwZEsS0EQcSri4Bg May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 5f56227f97234624a6b21b3b72b1fefc May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-MigrationsAdminTest-385248573 May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5f56227f97234624a6b21b3b72b1fefc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5f56227f97234624a6b21b3b72b1fefc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5f56227f97234624a6b21b3b72b1fefc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5f56227f97234624a6b21b3b72b1fefc", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-MigrationsAdminTest-385248573 May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 5f56227f97234624a6b21b3b72b1fefc May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-MigrationsAdminTest-385248573 May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-MigrationsAdminTest-385248573-project-admin May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: e44d8b3024bf49b3882dc6b50191b3bf May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-MigrationsAdminTest-385248573-project-admin May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: exception: Flavor 5b9cd6b6-29e3-47b2-8b98-d98ca88503f4 could not be found. May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '5b9cd6b6-29e3-47b2-8b98-d98ca88503f4'} May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi flavor.destroy() May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 5b9cd6b6-29e3-47b2-8b98-d98ca88503f4 could not be found. May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 5b9cd6b6-29e3-47b2-8b98-d98ca88503f4 could not be found. May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:01:22.785912 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:01:22.791402 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:01:22.791402 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:01:22.791402 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:01:22.791402 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:01:22.791402 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:01:22.791402 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:01:22.791402 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 5b9cd6b6-29e3-47b2-8b98-d98ca88503f4 could not be found. May 27 15:01:22.791402 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:01:22.791402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a0dfddde-330a-4179-84d4-46666639d142 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Returning 404 to user: Flavor 5b9cd6b6-29e3-47b2-8b98-d98ca88503f4 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:01:22.791402 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a0dfddde-330a-4179-84d4-46666639d142 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/5b9cd6b6-29e3-47b2-8b98-d98ca88503f4" status: 404 len: 109 microversion: 2.1 time: 0.038372 May 27 15:01:22.791402 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 561/1072] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:01:22 2022] DELETE /compute/v2.1/flavors/5b9cd6b6-29e3-47b2-8b98-d98ca88503f4 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:01:22.938574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4a6a585c-ca47-404b-a371-8f877c6f43f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2018108432", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:23.013368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-353db04d-8cfa-46fd-9305-d1019791817c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:23.028457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-4a6a585c-ca47-404b-a371-8f877c6f43f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] validate_networks() for None {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:01:23.036580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-353db04d-8cfa-46fd-9305-d1019791817c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:23.038273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-353db04d-8cfa-46fd-9305-d1019791817c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:23.040362 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-353db04d-8cfa-46fd-9305-d1019791817c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.439164 May 27 15:01:23.041118 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 512/1073] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:22 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:23.096505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-acdea09d-d032-4da0-8a59-5da2a018fafe tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:23.098161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-acdea09d-d032-4da0-8a59-5da2a018fafe tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:23.107922 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-acdea09d-d032-4da0-8a59-5da2a018fafe tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:23.108803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-acdea09d-d032-4da0-8a59-5da2a018fafe tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:23.112549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-acdea09d-d032-4da0-8a59-5da2a018fafe tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:23.115459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-acdea09d-d032-4da0-8a59-5da2a018fafe tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:23.574419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-acdea09d-d032-4da0-8a59-5da2a018fafe tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:23.608542 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-acdea09d-d032-4da0-8a59-5da2a018fafe tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 1276 microversion: 2.1 time: 0.509820 May 27 15:01:23.611136 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 513/1074] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:23 2022] GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 1276 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:01:23.624807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-de7df91f-654e-4141-8449-c57ba746e106 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776be3820>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:23.757141 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-de7df91f-654e-4141-8449-c57ba746e106 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1411 microversion: 2.1 time: 0.142811 May 27 15:01:23.758699 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 514/1075] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:23 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1411 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:23.821492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b9fc84bb-7569-4e3e-ae89-df8c370a0b92 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:23.822986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b9fc84bb-7569-4e3e-ae89-df8c370a0b92 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:23.849279 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9fc84bb-7569-4e3e-ae89-df8c370a0b92 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:23.867349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9fc84bb-7569-4e3e-ae89-df8c370a0b92 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:23.868831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9fc84bb-7569-4e3e-ae89-df8c370a0b92 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:23.871002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9fc84bb-7569-4e3e-ae89-df8c370a0b92 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:24.022852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-4a6a585c-ca47-404b-a371-8f877c6f43f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:01:24.023379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-4a6a585c-ca47-404b-a371-8f877c6f43f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:01:24.024149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-4a6a585c-ca47-404b-a371-8f877c6f43f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:01:24.024863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-4a6a585c-ca47-404b-a371-8f877c6f43f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:01:24.025503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-4a6a585c-ca47-404b-a371-8f877c6f43f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:01:24.057301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a6a585c-ca47-404b-a371-8f877c6f43f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:24.058622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a6a585c-ca47-404b-a371-8f877c6f43f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:24.060334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a6a585c-ca47-404b-a371-8f877c6f43f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:24.062838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a6a585c-ca47-404b-a371-8f877c6f43f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:24.123535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-4a6a585c-ca47-404b-a371-8f877c6f43f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Getting quotas for project 7369228028774765965f3cf001f8806a. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:01:24.147919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-4a6a585c-ca47-404b-a371-8f877c6f43f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Getting quotas for user a5a825c2385e490d81ddcbc2de76980d and project 7369228028774765965f3cf001f8806a. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:01:24.212865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4a6a585c-ca47-404b-a371-8f877c6f43f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:01:24.220634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4a6a585c-ca47-404b-a371-8f877c6f43f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:01:24.384465 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4a6a585c-ca47-404b-a371-8f877c6f43f0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.449609 May 27 15:01:24.388376 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 562/1076] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:01:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:01:24.413067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b9fc84bb-7569-4e3e-ae89-df8c370a0b92 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37aeba85d8b4c1282ac1b470836bae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be47565a2f034bbd8f81292196597473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:24.424572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-50546561-7f71-4e45-b6ab-a7703aa88818 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:24.430148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-50546561-7f71-4e45-b6ab-a7703aa88818 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:24.431284 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b9fc84bb-7569-4e3e-ae89-df8c370a0b92 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3" status: 200 len: 1317 microversion: 2.1 time: 0.662657 May 27 15:01:24.440997 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 515/1077] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:23 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3 => generated 1317 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:24.454915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-998d0d5e-54af-4ea8-80eb-bebdf4b50650 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:24.455550 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-998d0d5e-54af-4ea8-80eb-bebdf4b50650 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:24.459104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-50546561-7f71-4e45-b6ab-a7703aa88818 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:24.460107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-50546561-7f71-4e45-b6ab-a7703aa88818 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:24.463138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-50546561-7f71-4e45-b6ab-a7703aa88818 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:24.463929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-50546561-7f71-4e45-b6ab-a7703aa88818 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:24.604224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-998d0d5e-54af-4ea8-80eb-bebdf4b50650 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:24.617992 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-998d0d5e-54af-4ea8-80eb-bebdf4b50650 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1213 microversion: 2.1 time: 0.173299 May 27 15:01:24.620149 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 516/1078] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:24 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1213 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:24.662036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c9b3d865-a22a-42fa-8230-f6a53205676c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:24.668602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c9b3d865-a22a-42fa-8230-f6a53205676c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:24.694748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9b3d865-a22a-42fa-8230-f6a53205676c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:24.700990 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9b3d865-a22a-42fa-8230-f6a53205676c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:24.704907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9b3d865-a22a-42fa-8230-f6a53205676c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:24.711167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9b3d865-a22a-42fa-8230-f6a53205676c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:24.824129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:24.901410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-50546561-7f71-4e45-b6ab-a7703aa88818 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:24.919382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-50546561-7f71-4e45-b6ab-a7703aa88818 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:24.924796 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-50546561-7f71-4e45-b6ab-a7703aa88818 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:24.926999 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-50546561-7f71-4e45-b6ab-a7703aa88818 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.535316 May 27 15:01:24.948317 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 563/1079] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:24 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:24.956287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c38f45fd-247a-4ea6-ba4d-dfdb038689f7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776bade50>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:25.311010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c9b3d865-a22a-42fa-8230-f6a53205676c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:25.358587 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c9b3d865-a22a-42fa-8230-f6a53205676c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 1318 microversion: 2.1 time: 0.682909 May 27 15:01:25.360955 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 517/1080] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:24 2022] GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 1318 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:25.448248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b0de391a-3008-40e5-ad65-fb1bdb0bb00d tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:25.448921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b0de391a-3008-40e5-ad65-fb1bdb0bb00d tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:25.464871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b0de391a-3008-40e5-ad65-fb1bdb0bb00d tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:25.465747 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b0de391a-3008-40e5-ad65-fb1bdb0bb00d tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:25.468992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b0de391a-3008-40e5-ad65-fb1bdb0bb00d tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:25.472866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b0de391a-3008-40e5-ad65-fb1bdb0bb00d tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:26.098805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=5 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:26.468983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b0de391a-3008-40e5-ad65-fb1bdb0bb00d tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37aeba85d8b4c1282ac1b470836bae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be47565a2f034bbd8f81292196597473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:26.503057 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b0de391a-3008-40e5-ad65-fb1bdb0bb00d tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3" status: 200 len: 1317 microversion: 2.1 time: 1.055508 May 27 15:01:26.504743 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 518/1081] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:25 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3 => generated 1317 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:01:26.527967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-865fda13-b3f1-4ac6-b9e5-aae06da3ad4b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:26.530186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-865fda13-b3f1-4ac6-b9e5-aae06da3ad4b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:26.560253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-865fda13-b3f1-4ac6-b9e5-aae06da3ad4b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:26.561052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-865fda13-b3f1-4ac6-b9e5-aae06da3ad4b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:26.565154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-865fda13-b3f1-4ac6-b9e5-aae06da3ad4b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:26.570098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-865fda13-b3f1-4ac6-b9e5-aae06da3ad4b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:26.780710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-865fda13-b3f1-4ac6-b9e5-aae06da3ad4b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:26.798318 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-865fda13-b3f1-4ac6-b9e5-aae06da3ad4b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1273 microversion: 2.1 time: 0.289952 May 27 15:01:26.799785 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 519/1082] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:26 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1273 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:26.806027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-66e31c6f-a1d5-4c72-b55e-e0f219a2a1b7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:26.806549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-66e31c6f-a1d5-4c72-b55e-e0f219a2a1b7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:26.825693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66e31c6f-a1d5-4c72-b55e-e0f219a2a1b7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:26.832719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66e31c6f-a1d5-4c72-b55e-e0f219a2a1b7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:26.833915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66e31c6f-a1d5-4c72-b55e-e0f219a2a1b7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:26.834645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66e31c6f-a1d5-4c72-b55e-e0f219a2a1b7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:27.237517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-66e31c6f-a1d5-4c72-b55e-e0f219a2a1b7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:27.257466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-66e31c6f-a1d5-4c72-b55e-e0f219a2a1b7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:27.259968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-66e31c6f-a1d5-4c72-b55e-e0f219a2a1b7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:27.261562 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-66e31c6f-a1d5-4c72-b55e-e0f219a2a1b7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.460211 May 27 15:01:27.262515 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 520/1083] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:26 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:27.297384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9232b585-438d-482b-ade1-a9b949c40d82 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:27.298340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9232b585-438d-482b-ade1-a9b949c40d82 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:27.313483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9232b585-438d-482b-ade1-a9b949c40d82 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:27.317469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9232b585-438d-482b-ade1-a9b949c40d82 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:27.318778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9232b585-438d-482b-ade1-a9b949c40d82 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:27.319382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9232b585-438d-482b-ade1-a9b949c40d82 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:27.782076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9232b585-438d-482b-ade1-a9b949c40d82 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:27.801243 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9232b585-438d-482b-ade1-a9b949c40d82 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 1318 microversion: 2.1 time: 0.535636 May 27 15:01:27.802978 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 521/1084] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:27 2022] GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:27.822169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-d0839377-61f0-407f-ad90-a4a93f2b8dd4 req-6733ac9b-82e3-45ac-8a0e-35c27c1d0f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39985ed3-7d07-48db-80b4-c570f7422e1f", "name": "network-vif-plugged", "status": "completed", "tag": "ac6d5c81-c7de-49e1-a62d-df0fdf576229"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:27.833273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d0839377-61f0-407f-ad90-a4a93f2b8dd4 req-6733ac9b-82e3-45ac-8a0e-35c27c1d0f8c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:27.834114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d0839377-61f0-407f-ad90-a4a93f2b8dd4 req-6733ac9b-82e3-45ac-8a0e-35c27c1d0f8c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:27.850149 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-d0839377-61f0-407f-ad90-a4a93f2b8dd4 req-6733ac9b-82e3-45ac-8a0e-35c27c1d0f8c service nova] Creating event network-vif-plugged:ac6d5c81-c7de-49e1-a62d-df0fdf576229 for instance 39985ed3-7d07-48db-80b4-c570f7422e1f on n-h2-843621-1 May 27 15:01:27.857667 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-d0839377-61f0-407f-ad90-a4a93f2b8dd4 req-6733ac9b-82e3-45ac-8a0e-35c27c1d0f8c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052687 May 27 15:01:27.861031 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 522/1085] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:27.870880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-3879f405-b523-4ff4-bcb3-c4280b0bba0e req-3b04ae0b-c1a2-4517-8dd8-d89375a3cab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73173e14-0308-44e3-adc9-8bbd5509246c", "tag": "f1f01d43-89a5-406d-9090-8469b79684bd"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:27.885651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3879f405-b523-4ff4-bcb3-c4280b0bba0e req-3b04ae0b-c1a2-4517-8dd8-d89375a3cab5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:27.886666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3879f405-b523-4ff4-bcb3-c4280b0bba0e req-3b04ae0b-c1a2-4517-8dd8-d89375a3cab5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:27.901720 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-3879f405-b523-4ff4-bcb3-c4280b0bba0e req-3b04ae0b-c1a2-4517-8dd8-d89375a3cab5 service nova] Creating event network-changed:f1f01d43-89a5-406d-9090-8469b79684bd for instance 73173e14-0308-44e3-adc9-8bbd5509246c on n-h2-843621-1 May 27 15:01:27.911015 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-3879f405-b523-4ff4-bcb3-c4280b0bba0e req-3b04ae0b-c1a2-4517-8dd8-d89375a3cab5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046876 May 27 15:01:27.912908 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 523/1086] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:27.923643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8250e1f6-6592-4147-8d69-92ad05a1f87a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:27.924770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8250e1f6-6592-4147-8d69-92ad05a1f87a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:27.939075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8250e1f6-6592-4147-8d69-92ad05a1f87a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:27.940553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8250e1f6-6592-4147-8d69-92ad05a1f87a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:27.942461 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8250e1f6-6592-4147-8d69-92ad05a1f87a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:27.943173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8250e1f6-6592-4147-8d69-92ad05a1f87a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:28.440415 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c38f45fd-247a-4ea6-ba4d-dfdb038689f7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1411 microversion: 2.1 time: 3.489059 May 27 15:01:28.442842 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 564/1087] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:24 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1411 bytes in 3494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:28.453035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9acd0665-1e5d-4574-9eea-83ecf11517e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:28.456332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9acd0665-1e5d-4574-9eea-83ecf11517e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:28.461746 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8250e1f6-6592-4147-8d69-92ad05a1f87a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37aeba85d8b4c1282ac1b470836bae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be47565a2f034bbd8f81292196597473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:28.462141 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:28.466727 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9acd0665-1e5d-4574-9eea-83ecf11517e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:28.467500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9acd0665-1e5d-4574-9eea-83ecf11517e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:28.468892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9acd0665-1e5d-4574-9eea-83ecf11517e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:28.469736 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9acd0665-1e5d-4574-9eea-83ecf11517e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:28.471944 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8250e1f6-6592-4147-8d69-92ad05a1f87a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3" status: 200 len: 1317 microversion: 2.1 time: 0.557109 May 27 15:01:28.479312 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 524/1088] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:27 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3 => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:28.496706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bc78e75e-a1ac-4201-a323-d05bb6b65094 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:28.497826 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bc78e75e-a1ac-4201-a323-d05bb6b65094 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:28.528558 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc78e75e-a1ac-4201-a323-d05bb6b65094 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:28.541569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc78e75e-a1ac-4201-a323-d05bb6b65094 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:28.543040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc78e75e-a1ac-4201-a323-d05bb6b65094 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:28.543678 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc78e75e-a1ac-4201-a323-d05bb6b65094 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:28.655894 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9acd0665-1e5d-4574-9eea-83ecf11517e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:28.677341 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9acd0665-1e5d-4574-9eea-83ecf11517e9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1271 microversion: 2.1 time: 0.228217 May 27 15:01:28.677984 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 565/1089] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:28 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1271 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:28.820634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fd247110-db29-4f17-897b-628ecd02319c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:28.823358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fd247110-db29-4f17-897b-628ecd02319c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:28.835599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bc78e75e-a1ac-4201-a323-d05bb6b65094 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:28.846291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd247110-db29-4f17-897b-628ecd02319c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:28.846748 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd247110-db29-4f17-897b-628ecd02319c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:28.847798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd247110-db29-4f17-897b-628ecd02319c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:28.848304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd247110-db29-4f17-897b-628ecd02319c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:28.853243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bc78e75e-a1ac-4201-a323-d05bb6b65094 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:28.855849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bc78e75e-a1ac-4201-a323-d05bb6b65094 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:28.858175 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bc78e75e-a1ac-4201-a323-d05bb6b65094 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.376969 May 27 15:01:28.860058 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 525/1090] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:28 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:29.233898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fd247110-db29-4f17-897b-628ecd02319c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:29.275591 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fd247110-db29-4f17-897b-628ecd02319c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 1318 microversion: 2.1 time: 0.446426 May 27 15:01:29.282849 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 566/1091] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:28 2022] GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:29.466462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2105d5a8-1fd8-4eac-8880-6239202c013d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776be35e0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:29.509678 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-929519fc-85c3-4715-95e6-29ef07c9f785 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:29.510322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-929519fc-85c3-4715-95e6-29ef07c9f785 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:29.537417 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-929519fc-85c3-4715-95e6-29ef07c9f785 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:29.544498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-929519fc-85c3-4715-95e6-29ef07c9f785 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:29.550921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-929519fc-85c3-4715-95e6-29ef07c9f785 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:29.551880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-929519fc-85c3-4715-95e6-29ef07c9f785 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:29.595064 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2105d5a8-1fd8-4eac-8880-6239202c013d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1411 microversion: 2.1 time: 0.140052 May 27 15:01:29.619052 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 526/1092] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:29 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1411 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:29.637934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:29.707933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-543e2d96-c885-4af6-b726-ec0db5e231b0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:29.709373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-543e2d96-c885-4af6-b726-ec0db5e231b0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:29.729589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-543e2d96-c885-4af6-b726-ec0db5e231b0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:29.730478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-543e2d96-c885-4af6-b726-ec0db5e231b0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:29.731556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-543e2d96-c885-4af6-b726-ec0db5e231b0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:29.735791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-543e2d96-c885-4af6-b726-ec0db5e231b0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:30.440378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-543e2d96-c885-4af6-b726-ec0db5e231b0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:30.451828 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-543e2d96-c885-4af6-b726-ec0db5e231b0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1271 microversion: 2.1 time: 0.755423 May 27 15:01:30.453853 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 527/1093] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:29 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1271 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:30.471285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d967934b-5599-4eb8-8361-bc1acbe0c1fb tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:30.473855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d967934b-5599-4eb8-8361-bc1acbe0c1fb tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:30.497530 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d967934b-5599-4eb8-8361-bc1acbe0c1fb tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:30.498278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d967934b-5599-4eb8-8361-bc1acbe0c1fb tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:30.499252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d967934b-5599-4eb8-8361-bc1acbe0c1fb tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:30.499844 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d967934b-5599-4eb8-8361-bc1acbe0c1fb tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:30.636460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-929519fc-85c3-4715-95e6-29ef07c9f785 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37aeba85d8b4c1282ac1b470836bae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be47565a2f034bbd8f81292196597473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:30.651986 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-929519fc-85c3-4715-95e6-29ef07c9f785 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3" status: 200 len: 1317 microversion: 2.1 time: 1.158973 May 27 15:01:30.652601 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 567/1094] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:29 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3 => generated 1317 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:30.691481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-3a675b22-dd61-4276-a4a0-ccc8d8e436a6 req-0afb4d4b-01bd-4d90-b164-1133799c9762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25", "name": "network-vif-plugged", "status": "completed", "tag": "4e83a9ed-eea8-4580-a697-0ad1b8d1d61b"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:30.708407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3a675b22-dd61-4276-a4a0-ccc8d8e436a6 req-0afb4d4b-01bd-4d90-b164-1133799c9762 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:30.718663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3a675b22-dd61-4276-a4a0-ccc8d8e436a6 req-0afb4d4b-01bd-4d90-b164-1133799c9762 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:30.755330 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-3a675b22-dd61-4276-a4a0-ccc8d8e436a6 req-0afb4d4b-01bd-4d90-b164-1133799c9762 service nova] Creating event network-vif-plugged:4e83a9ed-eea8-4580-a697-0ad1b8d1d61b for instance bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 on n-h2-843621-1 May 27 15:01:30.764313 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-3a675b22-dd61-4276-a4a0-ccc8d8e436a6 req-0afb4d4b-01bd-4d90-b164-1133799c9762 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095160 May 27 15:01:30.766305 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 568/1095] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:30.775270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bdc9313d-a040-4ad3-8179-5f527fcb9035 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:30.782501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bdc9313d-a040-4ad3-8179-5f527fcb9035 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:30.795119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bdc9313d-a040-4ad3-8179-5f527fcb9035 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:30.795873 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bdc9313d-a040-4ad3-8179-5f527fcb9035 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:30.797641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bdc9313d-a040-4ad3-8179-5f527fcb9035 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:30.799388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bdc9313d-a040-4ad3-8179-5f527fcb9035 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:30.927439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d967934b-5599-4eb8-8361-bc1acbe0c1fb tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:30.944885 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d967934b-5599-4eb8-8361-bc1acbe0c1fb tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:30.946785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d967934b-5599-4eb8-8361-bc1acbe0c1fb tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:30.951627 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d967934b-5599-4eb8-8361-bc1acbe0c1fb tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.496337 May 27 15:01:30.957268 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 528/1096] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:30 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:30.969229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-1067d895-7d5e-4eba-84fd-524c708210b8 req-6aa49cf9-7f78-49b3-96ea-ea695da451ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30fca3d4-3998-4aa2-b00c-ba71724fdfbe", "tag": "f270cafa-0002-4b22-940b-89a2575c17f8"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:30.988240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-1067d895-7d5e-4eba-84fd-524c708210b8 req-6aa49cf9-7f78-49b3-96ea-ea695da451ad service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:30.991136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-1067d895-7d5e-4eba-84fd-524c708210b8 req-6aa49cf9-7f78-49b3-96ea-ea695da451ad service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:31.021717 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-1067d895-7d5e-4eba-84fd-524c708210b8 req-6aa49cf9-7f78-49b3-96ea-ea695da451ad service nova] Creating event network-changed:f270cafa-0002-4b22-940b-89a2575c17f8 for instance 30fca3d4-3998-4aa2-b00c-ba71724fdfbe on n-h2-843621-1 May 27 15:01:31.038452 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-1067d895-7d5e-4eba-84fd-524c708210b8 req-6aa49cf9-7f78-49b3-96ea-ea695da451ad service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079439 May 27 15:01:31.040905 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 529/1097] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:31.057014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-90a1514e-0957-4131-bff6-13fc23c1e0e3 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776bcaa60>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:31.135417 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-90a1514e-0957-4131-bff6-13fc23c1e0e3 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1411 microversion: 2.1 time: 0.093046 May 27 15:01:31.136328 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 530/1098] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:31 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1411 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:31.243050 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bdc9313d-a040-4ad3-8179-5f527fcb9035 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:31.252233 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bdc9313d-a040-4ad3-8179-5f527fcb9035 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 1318 microversion: 2.1 time: 0.484385 May 27 15:01:31.258521 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 569/1099] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:30 2022] GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:31.473009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-287bc8e7-cd5b-4b5d-be99-0a7f878999d3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:31.473848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-287bc8e7-cd5b-4b5d-be99-0a7f878999d3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:31.507272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-287bc8e7-cd5b-4b5d-be99-0a7f878999d3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:31.508069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-287bc8e7-cd5b-4b5d-be99-0a7f878999d3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:31.509206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-287bc8e7-cd5b-4b5d-be99-0a7f878999d3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:31.509697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-287bc8e7-cd5b-4b5d-be99-0a7f878999d3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:31.673605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d58a7d08-66e0-4622-a46e-c6c57465c4b9 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:31.676129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d58a7d08-66e0-4622-a46e-c6c57465c4b9 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:31.688266 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d58a7d08-66e0-4622-a46e-c6c57465c4b9 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:31.691546 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d58a7d08-66e0-4622-a46e-c6c57465c4b9 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:31.692648 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d58a7d08-66e0-4622-a46e-c6c57465c4b9 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:31.694399 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d58a7d08-66e0-4622-a46e-c6c57465c4b9 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:32.066623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-287bc8e7-cd5b-4b5d-be99-0a7f878999d3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:32.078615 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-287bc8e7-cd5b-4b5d-be99-0a7f878999d3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1313 microversion: 2.1 time: 0.612322 May 27 15:01:32.079835 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 531/1100] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:31 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1313 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:32.092059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f7e5ab74-7722-486d-a202-83a9893179a5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:32.093201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f7e5ab74-7722-486d-a202-83a9893179a5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:32.112785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f7e5ab74-7722-486d-a202-83a9893179a5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:32.113571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f7e5ab74-7722-486d-a202-83a9893179a5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:32.114685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f7e5ab74-7722-486d-a202-83a9893179a5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:32.115401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f7e5ab74-7722-486d-a202-83a9893179a5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:32.206359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d58a7d08-66e0-4622-a46e-c6c57465c4b9 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37aeba85d8b4c1282ac1b470836bae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be47565a2f034bbd8f81292196597473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:32.215092 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d58a7d08-66e0-4622-a46e-c6c57465c4b9 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3" status: 200 len: 1317 microversion: 2.1 time: 0.545473 May 27 15:01:32.218672 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 570/1101] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:31 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3 => generated 1317 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:32.231221 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d71506bb-4b63-4cdd-9f92-488528b639fc tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776d4ad30>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:32.332406 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d71506bb-4b63-4cdd-9f92-488528b639fc tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1411 microversion: 2.1 time: 0.111699 May 27 15:01:32.333346 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 571/1102] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:32 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1411 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:32.338179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-923024fe-9922-4c41-bdd1-885aefb722cd tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:32.345503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-923024fe-9922-4c41-bdd1-885aefb722cd tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:32.381465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-923024fe-9922-4c41-bdd1-885aefb722cd tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:32.381935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-923024fe-9922-4c41-bdd1-885aefb722cd tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:32.389083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-923024fe-9922-4c41-bdd1-885aefb722cd tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:32.389805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-923024fe-9922-4c41-bdd1-885aefb722cd tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:32.744995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f7e5ab74-7722-486d-a202-83a9893179a5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:32.772885 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f7e5ab74-7722-486d-a202-83a9893179a5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:32.781365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f7e5ab74-7722-486d-a202-83a9893179a5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:32.784268 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f7e5ab74-7722-486d-a202-83a9893179a5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.700661 May 27 15:01:32.786882 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 532/1103] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:32 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:32.835767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-bf721e26-55ff-4781-8cbf-3c0a8684623f req-2759c694-ee6a-4846-ab0b-ecf4653e2305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73173e14-0308-44e3-adc9-8bbd5509246c", "name": "network-vif-plugged", "status": "completed", "tag": "f1f01d43-89a5-406d-9090-8469b79684bd"}, {"server_uuid": "c1699aaf-d186-4cde-ac8c-318a335635b3", "name": "network-vif-plugged", "status": "completed", "tag": "c4f42381-866f-40f4-907d-639a893e5639"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:32.877475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-bf721e26-55ff-4781-8cbf-3c0a8684623f req-2759c694-ee6a-4846-ab0b-ecf4653e2305 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:32.883362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-923024fe-9922-4c41-bdd1-885aefb722cd tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:32.889325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-bf721e26-55ff-4781-8cbf-3c0a8684623f req-2759c694-ee6a-4846-ab0b-ecf4653e2305 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:32.906951 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-923024fe-9922-4c41-bdd1-885aefb722cd tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 1318 microversion: 2.1 time: 0.571875 May 27 15:01:32.910883 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 572/1104] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:32 2022] GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 1318 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:32.938800 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-bf721e26-55ff-4781-8cbf-3c0a8684623f req-2759c694-ee6a-4846-ab0b-ecf4653e2305 service nova] Creating event network-vif-plugged:f1f01d43-89a5-406d-9090-8469b79684bd for instance 73173e14-0308-44e3-adc9-8bbd5509246c on n-h2-843621-1 May 27 15:01:32.939534 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-bf721e26-55ff-4781-8cbf-3c0a8684623f req-2759c694-ee6a-4846-ab0b-ecf4653e2305 service nova] Creating event network-vif-plugged:c4f42381-866f-40f4-907d-639a893e5639 for instance c1699aaf-d186-4cde-ac8c-318a335635b3 on n-h1-843621-1 May 27 15:01:32.955568 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-bf721e26-55ff-4781-8cbf-3c0a8684623f req-2759c694-ee6a-4846-ab0b-ecf4653e2305 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.126309 May 27 15:01:32.957038 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 533/1105] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:33.099267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8b5cf5ca-6001-4ca7-99a0-fc76650e1b86 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:33.100207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8b5cf5ca-6001-4ca7-99a0-fc76650e1b86 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:33.132406 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b5cf5ca-6001-4ca7-99a0-fc76650e1b86 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:33.133152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b5cf5ca-6001-4ca7-99a0-fc76650e1b86 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:33.134176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b5cf5ca-6001-4ca7-99a0-fc76650e1b86 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:33.135112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b5cf5ca-6001-4ca7-99a0-fc76650e1b86 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:33.235956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e406860a-1ca6-4ca1-bb69-f3182092bcb9 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:33.236759 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e406860a-1ca6-4ca1-bb69-f3182092bcb9 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:33.263824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e406860a-1ca6-4ca1-bb69-f3182092bcb9 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:33.264180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e406860a-1ca6-4ca1-bb69-f3182092bcb9 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:33.265018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e406860a-1ca6-4ca1-bb69-f3182092bcb9 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:33.279083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e406860a-1ca6-4ca1-bb69-f3182092bcb9 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:33.695272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8b5cf5ca-6001-4ca7-99a0-fc76650e1b86 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:33.708266 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8b5cf5ca-6001-4ca7-99a0-fc76650e1b86 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1313 microversion: 2.1 time: 0.614262 May 27 15:01:33.729190 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 573/1106] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:33 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1313 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:33.742827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-25efa658-678e-4b58-bad1-4c02dfaf5284 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc77709ae50>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:33.770482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e406860a-1ca6-4ca1-bb69-f3182092bcb9 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37aeba85d8b4c1282ac1b470836bae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be47565a2f034bbd8f81292196597473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:33.787658 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e406860a-1ca6-4ca1-bb69-f3182092bcb9 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3" status: 200 len: 1317 microversion: 2.1 time: 0.556523 May 27 15:01:33.796863 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 534/1107] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:33 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3 => generated 1317 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:33.806705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b81a82ff-9a34-41f2-b467-b6f3bb656470 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:33.807334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b81a82ff-9a34-41f2-b467-b6f3bb656470 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:33.831126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b81a82ff-9a34-41f2-b467-b6f3bb656470 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:33.832039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b81a82ff-9a34-41f2-b467-b6f3bb656470 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:33.832899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b81a82ff-9a34-41f2-b467-b6f3bb656470 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:33.833446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b81a82ff-9a34-41f2-b467-b6f3bb656470 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:33.886075 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-25efa658-678e-4b58-bad1-4c02dfaf5284 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1411 microversion: 2.1 time: 0.154713 May 27 15:01:33.888263 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 574/1108] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:33 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1411 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:33.952484 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a4044cdd-d51d-4e77-905e-6f781a069a1e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:33.953244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a4044cdd-d51d-4e77-905e-6f781a069a1e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:33.975015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4044cdd-d51d-4e77-905e-6f781a069a1e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:33.975486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4044cdd-d51d-4e77-905e-6f781a069a1e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:33.982720 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4044cdd-d51d-4e77-905e-6f781a069a1e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:33.983198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4044cdd-d51d-4e77-905e-6f781a069a1e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:34.098181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:34.186984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=18 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:34.480522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b81a82ff-9a34-41f2-b467-b6f3bb656470 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:34.490361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b81a82ff-9a34-41f2-b467-b6f3bb656470 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:34.497448 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a4044cdd-d51d-4e77-905e-6f781a069a1e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:34.507082 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a4044cdd-d51d-4e77-905e-6f781a069a1e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 1318 microversion: 2.1 time: 0.571836 May 27 15:01:34.509956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b81a82ff-9a34-41f2-b467-b6f3bb656470 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:34.513248 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b81a82ff-9a34-41f2-b467-b6f3bb656470 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.709952 May 27 15:01:34.513956 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 575/1109] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:33 2022] GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 1318 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:34.526693 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 535/1110] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:33 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:34.666261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-3b1a0555-2c04-4829-aae7-601100d8c467 req-cd75e1b0-92de-4564-aacf-f51ff7d48288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b5bcd82-1317-4a81-ab42-a18a58cca922", "tag": "b0bc61de-2df1-4e1c-927e-67f3048f9a5d"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:34.703354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3b1a0555-2c04-4829-aae7-601100d8c467 req-cd75e1b0-92de-4564-aacf-f51ff7d48288 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:34.719583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3b1a0555-2c04-4829-aae7-601100d8c467 req-cd75e1b0-92de-4564-aacf-f51ff7d48288 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:34.747623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bd57f026-ec7b-4495-a03a-d3b66863aaf6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:34.749774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bd57f026-ec7b-4495-a03a-d3b66863aaf6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:34.772135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=12 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:34.777091 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-3b1a0555-2c04-4829-aae7-601100d8c467 req-cd75e1b0-92de-4564-aacf-f51ff7d48288 service nova] Creating event network-changed:b0bc61de-2df1-4e1c-927e-67f3048f9a5d for instance 5b5bcd82-1317-4a81-ab42-a18a58cca922 on n-h1-843621-1 May 27 15:01:34.779976 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd57f026-ec7b-4495-a03a-d3b66863aaf6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:34.781828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd57f026-ec7b-4495-a03a-d3b66863aaf6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:34.786967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd57f026-ec7b-4495-a03a-d3b66863aaf6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:34.787986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd57f026-ec7b-4495-a03a-d3b66863aaf6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:34.795161 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-3b1a0555-2c04-4829-aae7-601100d8c467 req-cd75e1b0-92de-4564-aacf-f51ff7d48288 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132696 May 27 15:01:34.799298 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 576/1111] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:34.816249 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-87ddf0d9-fe85-4087-bb77-5a18217e4df4 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:34.817298 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-87ddf0d9-fe85-4087-bb77-5a18217e4df4 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:34.870186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87ddf0d9-fe85-4087-bb77-5a18217e4df4 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:34.875610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87ddf0d9-fe85-4087-bb77-5a18217e4df4 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:34.883026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87ddf0d9-fe85-4087-bb77-5a18217e4df4 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:34.884998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87ddf0d9-fe85-4087-bb77-5a18217e4df4 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:35.297901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bd57f026-ec7b-4495-a03a-d3b66863aaf6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:35.307068 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bd57f026-ec7b-4495-a03a-d3b66863aaf6 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1313 microversion: 2.1 time: 0.564814 May 27 15:01:35.317819 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 536/1112] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:34 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1313 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:35.322665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b6f990d1-956f-45af-beac-a2b529ba7aaf tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776c60670>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:35.398742 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b6f990d1-956f-45af-beac-a2b529ba7aaf tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1411 microversion: 2.1 time: 0.079674 May 27 15:01:35.399708 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 537/1113] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:35 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1411 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:35.427647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-87ddf0d9-fe85-4087-bb77-5a18217e4df4 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37aeba85d8b4c1282ac1b470836bae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be47565a2f034bbd8f81292196597473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:35.436079 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-87ddf0d9-fe85-4087-bb77-5a18217e4df4 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3" status: 200 len: 1317 microversion: 2.1 time: 0.632991 May 27 15:01:35.443857 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 577/1114] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:34 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3 => generated 1317 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:35.533528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7cc14781-6fd2-4e91-b324-1f6b01c7c8df tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:35.534169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6cc5676e-7930-4baf-b11a-79cb83a0359b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:35.535147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6cc5676e-7930-4baf-b11a-79cb83a0359b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:35.553518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7cc14781-6fd2-4e91-b324-1f6b01c7c8df tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:35.560470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7cc14781-6fd2-4e91-b324-1f6b01c7c8df tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:35.562435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6cc5676e-7930-4baf-b11a-79cb83a0359b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:35.562564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7cc14781-6fd2-4e91-b324-1f6b01c7c8df tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:35.562899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6cc5676e-7930-4baf-b11a-79cb83a0359b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:35.563684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6cc5676e-7930-4baf-b11a-79cb83a0359b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:35.564125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6cc5676e-7930-4baf-b11a-79cb83a0359b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:35.565009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7cc14781-6fd2-4e91-b324-1f6b01c7c8df tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:35.574487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7cc14781-6fd2-4e91-b324-1f6b01c7c8df tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:36.400600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7cc14781-6fd2-4e91-b324-1f6b01c7c8df tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:36.413941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7cc14781-6fd2-4e91-b324-1f6b01c7c8df tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:36.415969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7cc14781-6fd2-4e91-b324-1f6b01c7c8df tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:36.417614 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7cc14781-6fd2-4e91-b324-1f6b01c7c8df tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.888083 May 27 15:01:36.435863 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 578/1115] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:35 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:01:36.443538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9cec2133-6962-465d-9f4e-dd547154a182 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:36.444548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9cec2133-6962-465d-9f4e-dd547154a182 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:36.445087 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6cc5676e-7930-4baf-b11a-79cb83a0359b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:36.453933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cec2133-6962-465d-9f4e-dd547154a182 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:36.454768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cec2133-6962-465d-9f4e-dd547154a182 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:36.455826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cec2133-6962-465d-9f4e-dd547154a182 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:36.457466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cec2133-6962-465d-9f4e-dd547154a182 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:36.463906 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6cc5676e-7930-4baf-b11a-79cb83a0359b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 1318 microversion: 2.1 time: 0.931916 May 27 15:01:36.464586 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 538/1116] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:35 2022] GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 1318 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:36.488072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-78a7a5f5-5596-498c-be03-915a1701aca5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776cff8b0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:36.571898 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-78a7a5f5-5596-498c-be03-915a1701aca5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1411 microversion: 2.1 time: 0.099403 May 27 15:01:36.572486 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 539/1117] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:36 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1411 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:36.577221 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-158395ca-ef98-43d7-a089-2668399771e3 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:36.597534 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-158395ca-ef98-43d7-a089-2668399771e3 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:36.620532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-158395ca-ef98-43d7-a089-2668399771e3 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:36.623097 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-158395ca-ef98-43d7-a089-2668399771e3 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:36.624640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-158395ca-ef98-43d7-a089-2668399771e3 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:36.628456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-158395ca-ef98-43d7-a089-2668399771e3 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:36.951331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9cec2133-6962-465d-9f4e-dd547154a182 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:36.963673 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9cec2133-6962-465d-9f4e-dd547154a182 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1313 microversion: 2.1 time: 0.525694 May 27 15:01:36.965959 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 579/1118] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:36 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1313 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:37.031787 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-158395ca-ef98-43d7-a089-2668399771e3 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37aeba85d8b4c1282ac1b470836bae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be47565a2f034bbd8f81292196597473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:37.035821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:37.043991 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-158395ca-ef98-43d7-a089-2668399771e3 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3" status: 200 len: 1508 microversion: 2.1 time: 0.470392 May 27 15:01:37.045211 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 540/1119] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:36 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3 => generated 1508 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:37.441597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b2529973-0e22-4ed5-8f27-637874395f2e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:37.442802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b2529973-0e22-4ed5-8f27-637874395f2e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:37.454377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2529973-0e22-4ed5-8f27-637874395f2e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:37.461341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2529973-0e22-4ed5-8f27-637874395f2e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:37.466087 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2529973-0e22-4ed5-8f27-637874395f2e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:37.467335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2529973-0e22-4ed5-8f27-637874395f2e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:37.484115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9fa38586-84fb-436a-b987-f08e14e95147 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:37.485858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9fa38586-84fb-436a-b987-f08e14e95147 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:37.518143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9fa38586-84fb-436a-b987-f08e14e95147 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:37.523060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9fa38586-84fb-436a-b987-f08e14e95147 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:37.524429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9fa38586-84fb-436a-b987-f08e14e95147 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:37.526837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9fa38586-84fb-436a-b987-f08e14e95147 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:37.991307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9fa38586-84fb-436a-b987-f08e14e95147 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:38.000641 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9fa38586-84fb-436a-b987-f08e14e95147 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 1318 microversion: 2.1 time: 0.521682 May 27 15:01:38.003843 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 541/1120] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:37 2022] GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 1318 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:01:38.009563 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b670ef1c-4f66-4a9a-9351-a364330a798e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776c37dc0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:38.049280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b2529973-0e22-4ed5-8f27-637874395f2e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:38.069537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b2529973-0e22-4ed5-8f27-637874395f2e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:38.071251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b2529973-0e22-4ed5-8f27-637874395f2e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:38.072469 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b2529973-0e22-4ed5-8f27-637874395f2e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.636221 May 27 15:01:38.076055 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 580/1121] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:37 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:38.081106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-640317cf-bafd-431e-8067-4f514a066542 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:38.116596 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b670ef1c-4f66-4a9a-9351-a364330a798e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1411 microversion: 2.1 time: 0.110825 May 27 15:01:38.117794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-640317cf-bafd-431e-8067-4f514a066542 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:38.133749 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 542/1122] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:38 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1411 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:38.138665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-640317cf-bafd-431e-8067-4f514a066542 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:38.145328 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-640317cf-bafd-431e-8067-4f514a066542 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:38.146373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-640317cf-bafd-431e-8067-4f514a066542 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:38.146968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-640317cf-bafd-431e-8067-4f514a066542 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:38.461355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-640317cf-bafd-431e-8067-4f514a066542 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:38.472636 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-640317cf-bafd-431e-8067-4f514a066542 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1313 microversion: 2.1 time: 0.394585 May 27 15:01:38.475768 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 581/1123] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:38 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:38.820732 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-b1bf63fa-ed2a-4850-84cf-63a561d724db req-5203dd4b-ffd9-4e28-b147-edc6a8fc5d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30fca3d4-3998-4aa2-b00c-ba71724fdfbe", "name": "network-vif-plugged", "status": "completed", "tag": "f270cafa-0002-4b22-940b-89a2575c17f8"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:38.844762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b1bf63fa-ed2a-4850-84cf-63a561d724db req-5203dd4b-ffd9-4e28-b147-edc6a8fc5d8b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:38.845424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b1bf63fa-ed2a-4850-84cf-63a561d724db req-5203dd4b-ffd9-4e28-b147-edc6a8fc5d8b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:38.871137 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-b1bf63fa-ed2a-4850-84cf-63a561d724db req-5203dd4b-ffd9-4e28-b147-edc6a8fc5d8b service nova] Creating event network-vif-plugged:f270cafa-0002-4b22-940b-89a2575c17f8 for instance 30fca3d4-3998-4aa2-b00c-ba71724fdfbe on n-h2-843621-1 May 27 15:01:38.883118 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-b1bf63fa-ed2a-4850-84cf-63a561d724db req-5203dd4b-ffd9-4e28-b147-edc6a8fc5d8b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067148 May 27 15:01:38.884326 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 543/1124] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:39.020892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-685f66d9-e263-4e67-b6b9-fe3efb22040e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:39.021565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-685f66d9-e263-4e67-b6b9-fe3efb22040e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:39.031521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-685f66d9-e263-4e67-b6b9-fe3efb22040e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:39.032801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-685f66d9-e263-4e67-b6b9-fe3efb22040e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:39.033592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-685f66d9-e263-4e67-b6b9-fe3efb22040e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:39.034233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-685f66d9-e263-4e67-b6b9-fe3efb22040e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:39.091577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-43faf3a8-03b2-4f2c-a6e2-ea5069114bdc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:39.092651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-43faf3a8-03b2-4f2c-a6e2-ea5069114bdc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:39.102414 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43faf3a8-03b2-4f2c-a6e2-ea5069114bdc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:39.107026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43faf3a8-03b2-4f2c-a6e2-ea5069114bdc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:39.110593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43faf3a8-03b2-4f2c-a6e2-ea5069114bdc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:39.113347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43faf3a8-03b2-4f2c-a6e2-ea5069114bdc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:39.735142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-43faf3a8-03b2-4f2c-a6e2-ea5069114bdc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:39.751277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-43faf3a8-03b2-4f2c-a6e2-ea5069114bdc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:39.757622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-43faf3a8-03b2-4f2c-a6e2-ea5069114bdc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:39.762045 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-43faf3a8-03b2-4f2c-a6e2-ea5069114bdc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.674578 May 27 15:01:39.769701 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-685f66d9-e263-4e67-b6b9-fe3efb22040e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:39.774423 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 544/1125] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:39 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:01:39.781786 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-685f66d9-e263-4e67-b6b9-fe3efb22040e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 1318 microversion: 2.1 time: 0.766352 May 27 15:01:39.784884 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 582/1126] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:39 2022] GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 1318 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:39.791113 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-45fcdfc7-830f-4a4b-b3b1-1188be39ebac tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776d64ee0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:39.796755 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f5ae28fe-3801-4c93-b4e4-06bb1e6c081b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:39.797558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f5ae28fe-3801-4c93-b4e4-06bb1e6c081b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:39.812699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f5ae28fe-3801-4c93-b4e4-06bb1e6c081b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:39.813329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f5ae28fe-3801-4c93-b4e4-06bb1e6c081b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:39.814264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f5ae28fe-3801-4c93-b4e4-06bb1e6c081b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:39.815102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f5ae28fe-3801-4c93-b4e4-06bb1e6c081b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:39.883258 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-45fcdfc7-830f-4a4b-b3b1-1188be39ebac tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1411 microversion: 2.1 time: 0.104012 May 27 15:01:39.889983 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 545/1127] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:39 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1411 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:40.171169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f5ae28fe-3801-4c93-b4e4-06bb1e6c081b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:40.183650 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f5ae28fe-3801-4c93-b4e4-06bb1e6c081b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1313 microversion: 2.1 time: 0.396490 May 27 15:01:40.186473 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 583/1128] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:39 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:40.781245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4079fe1e-6d29-4c11-a57a-c6c3e93d5701 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:40.782184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4079fe1e-6d29-4c11-a57a-c6c3e93d5701 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:40.800078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4079fe1e-6d29-4c11-a57a-c6c3e93d5701 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:40.806148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4079fe1e-6d29-4c11-a57a-c6c3e93d5701 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:40.808111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4079fe1e-6d29-4c11-a57a-c6c3e93d5701 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:40.810561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8915d731-f31d-466b-84fc-75fee73f4e12 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:40.812222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8915d731-f31d-466b-84fc-75fee73f4e12 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:40.814560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4079fe1e-6d29-4c11-a57a-c6c3e93d5701 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:40.822118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8915d731-f31d-466b-84fc-75fee73f4e12 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:40.822929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8915d731-f31d-466b-84fc-75fee73f4e12 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:40.823967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8915d731-f31d-466b-84fc-75fee73f4e12 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:40.824663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8915d731-f31d-466b-84fc-75fee73f4e12 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:41.167101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8915d731-f31d-466b-84fc-75fee73f4e12 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:41.176627 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8915d731-f31d-466b-84fc-75fee73f4e12 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 1318 microversion: 2.1 time: 0.380806 May 27 15:01:41.190439 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 584/1129] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:40 2022] GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:01:41.201673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4079fe1e-6d29-4c11-a57a-c6c3e93d5701 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:41.209007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2abb5b77-f321-4b9e-bdc1-6ebd03544c9e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776c504c0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:41.213241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4079fe1e-6d29-4c11-a57a-c6c3e93d5701 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:41.215406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4079fe1e-6d29-4c11-a57a-c6c3e93d5701 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:41.225521 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4079fe1e-6d29-4c11-a57a-c6c3e93d5701 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1645 microversion: 2.25 time: 0.444562 May 27 15:01:41.226768 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 546/1130] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:40 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1645 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:41.241780 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fa059f76-00e4-411a-89a7-a26a9b6ce10b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:41.242864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fa059f76-00e4-411a-89a7-a26a9b6ce10b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:41.251479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa059f76-00e4-411a-89a7-a26a9b6ce10b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:41.252263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa059f76-00e4-411a-89a7-a26a9b6ce10b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:41.253560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa059f76-00e4-411a-89a7-a26a9b6ce10b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:41.254241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa059f76-00e4-411a-89a7-a26a9b6ce10b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:41.334980 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2abb5b77-f321-4b9e-bdc1-6ebd03544c9e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1411 microversion: 2.1 time: 0.142696 May 27 15:01:41.340912 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 585/1131] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:41 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1411 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:41.567892 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fa059f76-00e4-411a-89a7-a26a9b6ce10b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:41.588635 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fa059f76-00e4-411a-89a7-a26a9b6ce10b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1313 microversion: 2.1 time: 0.359143 May 27 15:01:41.606257 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 547/1132] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:41 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:41.893011 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7d59778e-e96b-446d-b998-4cc4d0193262 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "147c0061-da02-429d-a9b0-897c842b78a7"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:41.895003 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7d59778e-e96b-446d-b998-4cc4d0193262 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:41.908089 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d59778e-e96b-446d-b998-4cc4d0193262 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:41.908911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d59778e-e96b-446d-b998-4cc4d0193262 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:41.911342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d59778e-e96b-446d-b998-4cc4d0193262 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:41.911979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d59778e-e96b-446d-b998-4cc4d0193262 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:41.950182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-61b05f1d-daff-413b-8139-901dd48d9147 tempest-QuotaClassesAdmin257Test-1669514378 tempest-QuotaClassesAdmin257Test-1669514378-project-admin] Calling method '.version_select at 0x7fc776cf1160>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:41.956880 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:01:41.956880 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:01:41.969449 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-61b05f1d-daff-413b-8139-901dd48d9147 tempest-QuotaClassesAdmin257Test-1669514378 tempest-QuotaClassesAdmin257Test-1669514378-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.357391 May 27 15:01:41.981466 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 586/1133] 10.222.0.13 () {60 vars in 1225 bytes} [Fri May 27 15:01:41 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:01:41.986724 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ff1010e5-5b8c-4b06-b0bf-da6dc00807e9 tempest-QuotaClassesAdmin257Test-1669514378 tempest-QuotaClassesAdmin257Test-1669514378-project-admin] Action: 'update', calling method: .version_select at 0x7fc776cf18b0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:41.989667 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:01:41.989667 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:01:42.271344 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ff1010e5-5b8c-4b06-b0bf-da6dc00807e9 tempest-QuotaClassesAdmin257Test-1669514378 tempest-QuotaClassesAdmin257Test-1669514378-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.288282 May 27 15:01:42.276708 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 587/1134] 10.222.0.13 () {62 vars in 1246 bytes} [Fri May 27 15:01:41 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:01:42.285875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-57f017d1-d8e0-4325-9fe8-379ec3372256 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:42.286777 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-57f017d1-d8e0-4325-9fe8-379ec3372256 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:42.298864 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57f017d1-d8e0-4325-9fe8-379ec3372256 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:42.299589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57f017d1-d8e0-4325-9fe8-379ec3372256 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:42.300744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57f017d1-d8e0-4325-9fe8-379ec3372256 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:42.301306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57f017d1-d8e0-4325-9fe8-379ec3372256 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:42.645209 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7d59778e-e96b-446d-b998-4cc4d0193262 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "POST /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.746632 May 27 15:01:42.646224 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 548/1135] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 15:01:41 2022] POST /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments => generated 194 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:01:42.689902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-63146c67-9732-453d-80a1-05934859f333 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:42.700366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-63146c67-9732-453d-80a1-05934859f333 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:42.722238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63146c67-9732-453d-80a1-05934859f333 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:42.722726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63146c67-9732-453d-80a1-05934859f333 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:42.724658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63146c67-9732-453d-80a1-05934859f333 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:42.725528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63146c67-9732-453d-80a1-05934859f333 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:42.802569 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-57f017d1-d8e0-4325-9fe8-379ec3372256 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:42.818710 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-57f017d1-d8e0-4325-9fe8-379ec3372256 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 1467 microversion: 2.1 time: 0.544264 May 27 15:01:42.820793 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 588/1136] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:42 2022] GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 1467 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:42.836144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4bf9b963-cbec-4759-8bce-e7e46fef9a41 tempest-QuotaClassesAdmin257Test-1669514378 tempest-QuotaClassesAdmin257Test-1669514378-project-admin] Calling method '.version_select at 0x7fc776c3e0d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:42.838590 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:01:42.838590 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:01:42.864589 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4bf9b963-cbec-4759-8bce-e7e46fef9a41 tempest-QuotaClassesAdmin257Test-1669514378 tempest-QuotaClassesAdmin257Test-1669514378-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.042096 May 27 15:01:42.875011 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 589/1137] 10.222.0.13 () {60 vars in 1225 bytes} [Fri May 27 15:01:42 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:01:42.881881 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9b8917cd-46e0-414a-816e-14a7dc9fe3f8 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776badaf0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:42.968803 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9b8917cd-46e0-414a-816e-14a7dc9fe3f8 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1411 microversion: 2.1 time: 0.092365 May 27 15:01:42.976317 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 590/1138] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:42 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1411 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:42.988929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cdf4e6ee-f48a-4ba3-96a8-4396f8efce8d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:42.989969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cdf4e6ee-f48a-4ba3-96a8-4396f8efce8d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:42.999888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cdf4e6ee-f48a-4ba3-96a8-4396f8efce8d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:43.008167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cdf4e6ee-f48a-4ba3-96a8-4396f8efce8d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:43.009471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cdf4e6ee-f48a-4ba3-96a8-4396f8efce8d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:43.010112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cdf4e6ee-f48a-4ba3-96a8-4396f8efce8d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:43.023761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-63146c67-9732-453d-80a1-05934859f333 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:43.034623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-63146c67-9732-453d-80a1-05934859f333 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:43.036694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-63146c67-9732-453d-80a1-05934859f333 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:43.042115 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-63146c67-9732-453d-80a1-05934859f333 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1635 microversion: 2.25 time: 0.394613 May 27 15:01:43.043275 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 549/1139] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:42 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1635 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:43.048465 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-be191f30-acdd-493b-87ab-f550067c9331 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:43.049369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-be191f30-acdd-493b-87ab-f550067c9331 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 73173e14-0308-44e3-adc9-8bbd5509246c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:43.056552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be191f30-acdd-493b-87ab-f550067c9331 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:43.057645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be191f30-acdd-493b-87ab-f550067c9331 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:43.058716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be191f30-acdd-493b-87ab-f550067c9331 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:43.059405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be191f30-acdd-493b-87ab-f550067c9331 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:43.460600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-be191f30-acdd-493b-87ab-f550067c9331 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:43.473594 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-be191f30-acdd-493b-87ab-f550067c9331 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c" status: 200 len: 1468 microversion: 2.1 time: 0.428920 May 27 15:01:43.478897 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 550/1140] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:43 2022] GET /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c => generated 1468 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:43.488854 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-92fd29ae-21bf-4aa9-a90b-2a3ee009e0b6 tempest-QuotaClassesAdmin257Test-1669514378 tempest-QuotaClassesAdmin257Test-1669514378-project-admin] Action: 'update', calling method: .version_select at 0x7fc776bf6790>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:43.508060 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:01:43.508060 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 15:01:43.556733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cdf4e6ee-f48a-4ba3-96a8-4396f8efce8d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:43.567278 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cdf4e6ee-f48a-4ba3-96a8-4396f8efce8d tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1313 microversion: 2.1 time: 0.596388 May 27 15:01:43.573504 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 591/1141] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:42 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1313 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:43.589359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5ecd82f9-5a97-415f-bf4b-e3482797658f tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '.version_select at 0x7fc776bad0d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:43.593282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ecd82f9-5a97-415f-bf4b-e3482797658f tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:43.594558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ecd82f9-5a97-415f-bf4b-e3482797658f tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:43.609889 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5ecd82f9-5a97-415f-bf4b-e3482797658f tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 2541 microversion: 2.25 time: 0.034497 May 27 15:01:43.611170 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 592/1142] 10.222.0.13 () {60 vars in 1183 bytes} [Fri May 27 15:01:43 2022] GET /compute/v2.1/os-migrations => generated 2541 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:43.626168 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4b76a185-dd79-4293-b0ed-53ae7fb24ec3 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-211522058"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:43.627568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4b76a185-dd79-4293-b0ed-53ae7fb24ec3 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 73173e14-0308-44e3-adc9-8bbd5509246c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:43.641554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b76a185-dd79-4293-b0ed-53ae7fb24ec3 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:43.642372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b76a185-dd79-4293-b0ed-53ae7fb24ec3 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:43.644574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b76a185-dd79-4293-b0ed-53ae7fb24ec3 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:43.645202 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b76a185-dd79-4293-b0ed-53ae7fb24ec3 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:43.645959 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-92fd29ae-21bf-4aa9-a90b-2a3ee009e0b6 tempest-QuotaClassesAdmin257Test-1669514378 tempest-QuotaClassesAdmin257Test-1669514378-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.163613 May 27 15:01:43.657511 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 551/1143] 10.222.0.13 () {62 vars in 1246 bytes} [Fri May 27 15:01:43 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:01:43.674552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-40dd1194-5692-4d3d-ab8c-bb3e8d114e7e tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:43.679704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-40dd1194-5692-4d3d-ab8c-bb3e8d114e7e tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:43.704173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:43.704991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40dd1194-5692-4d3d-ab8c-bb3e8d114e7e tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:43.705734 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40dd1194-5692-4d3d-ab8c-bb3e8d114e7e tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:43.709294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40dd1194-5692-4d3d-ab8c-bb3e8d114e7e tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:43.711569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40dd1194-5692-4d3d-ab8c-bb3e8d114e7e tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:44.082295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-40dd1194-5692-4d3d-ab8c-bb3e8d114e7e tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lazy-loading 'services' on Instance uuid 18e4f7f7-6bda-4d0b-9685-74266d42efc0 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:01:44.114732 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-40dd1194-5692-4d3d-ab8c-bb3e8d114e7e tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 2128 microversion: 2.25 time: 0.445013 May 27 15:01:44.130765 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 552/1144] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:43 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 2128 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:44.142660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-07bebfbb-e421-450c-b496-2c22399263c6 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776bfaee0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:44.453009 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-07bebfbb-e421-450c-b496-2c22399263c6 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1411 microversion: 2.1 time: 0.320243 May 27 15:01:44.455329 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 553/1145] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:44 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1411 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:44.481477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0bcba10e-fd48-4dc9-aa74-f16d9444e330 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:44.486211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0bcba10e-fd48-4dc9-aa74-f16d9444e330 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:44.516623 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4b76a185-dd79-4293-b0ed-53ae7fb24ec3 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "POST /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c/action" status: 202 len: 0 microversion: 2.1 time: 0.892792 May 27 15:01:44.529040 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 593/1146] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:01:43 2022] POST /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c/action => generated 0 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 27 15:01:44.542012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0bcba10e-fd48-4dc9-aa74-f16d9444e330 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:44.542795 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0bcba10e-fd48-4dc9-aa74-f16d9444e330 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:44.543941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0bcba10e-fd48-4dc9-aa74-f16d9444e330 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:44.545237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c3b4d763-462f-4feb-a0b0-61ba141da4b1 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776cdcdc0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:44.548284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0bcba10e-fd48-4dc9-aa74-f16d9444e330 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:44.734339 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c3b4d763-462f-4feb-a0b0-61ba141da4b1 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25" status: 200 len: 1452 microversion: 2.1 time: 0.203815 May 27 15:01:44.735508 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 594/1147] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:44 2022] GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25 => generated 1452 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:44.747884 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b5c4e9b2-782b-4ccf-b28f-db79053eaddd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:44.748914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b5c4e9b2-782b-4ccf-b28f-db79053eaddd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:44.775754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5c4e9b2-782b-4ccf-b28f-db79053eaddd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:44.776750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5c4e9b2-782b-4ccf-b28f-db79053eaddd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:44.778980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5c4e9b2-782b-4ccf-b28f-db79053eaddd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:44.781004 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5c4e9b2-782b-4ccf-b28f-db79053eaddd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:45.113326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-0bcba10e-fd48-4dc9-aa74-f16d9444e330 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lazy-loading 'services' on Instance uuid 18e4f7f7-6bda-4d0b-9685-74266d42efc0 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:01:45.141282 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0bcba10e-fd48-4dc9-aa74-f16d9444e330 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 2128 microversion: 2.25 time: 0.681342 May 27 15:01:45.145755 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 554/1148] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:01:44 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 2128 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:01:45.168845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-98ce900e-d277-49aa-bc01-98bf44ec250a req-66327a9f-330f-4e99-998f-207ef5a368ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5bcd82-1317-4a81-ab42-a18a58cca922", "name": "network-vif-plugged", "status": "completed", "tag": "b0bc61de-2df1-4e1c-927e-67f3048f9a5d"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:45.199752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-98ce900e-d277-49aa-bc01-98bf44ec250a req-66327a9f-330f-4e99-998f-207ef5a368ff service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:45.200603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-98ce900e-d277-49aa-bc01-98bf44ec250a req-66327a9f-330f-4e99-998f-207ef5a368ff service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:45.243570 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-98ce900e-d277-49aa-bc01-98bf44ec250a req-66327a9f-330f-4e99-998f-207ef5a368ff service nova] Creating event network-vif-plugged:b0bc61de-2df1-4e1c-927e-67f3048f9a5d for instance 5b5bcd82-1317-4a81-ab42-a18a58cca922 on n-h1-843621-1 May 27 15:01:45.260123 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-98ce900e-d277-49aa-bc01-98bf44ec250a req-66327a9f-330f-4e99-998f-207ef5a368ff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112823 May 27 15:01:45.262712 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 555/1149] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:45.296958 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5b2b8823-43ba-436e-9078-e1788cb605e6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:45.297882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5b2b8823-43ba-436e-9078-e1788cb605e6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:45.309137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5b2b8823-43ba-436e-9078-e1788cb605e6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:45.312800 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5b2b8823-43ba-436e-9078-e1788cb605e6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:45.316174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5b2b8823-43ba-436e-9078-e1788cb605e6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:45.321024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b5c4e9b2-782b-4ccf-b28f-db79053eaddd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:45.329784 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b5c4e9b2-782b-4ccf-b28f-db79053eaddd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1313 microversion: 2.1 time: 0.592998 May 27 15:01:45.330376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5b2b8823-43ba-436e-9078-e1788cb605e6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:45.346701 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 595/1150] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:44 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:45.468741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a98c773f-b7f6-4657-ab8f-6b058eadac6e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776badca0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:45.559724 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a98c773f-b7f6-4657-ab8f-6b058eadac6e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1411 microversion: 2.1 time: 0.094984 May 27 15:01:45.560368 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 596/1151] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:45 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1411 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:01:45.691864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-5b2b8823-43ba-436e-9078-e1788cb605e6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lazy-loading 'services' on Instance uuid 18e4f7f7-6bda-4d0b-9685-74266d42efc0 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:01:45.752402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-69365967-e188-4e7f-83bb-06cd8efb465e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776b05ee0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:45.861733 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-69365967-e188-4e7f-83bb-06cd8efb465e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25" status: 200 len: 1452 microversion: 2.1 time: 0.117897 May 27 15:01:45.870543 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 597/1152] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:45 2022] GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25 => generated 1452 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:45.975712 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5b2b8823-43ba-436e-9078-e1788cb605e6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "DELETE /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments/b5397e9d-d731-466e-9f50-90c6d6d68bcf" status: 202 len: 0 microversion: 2.25 time: 0.682542 May 27 15:01:45.976886 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 556/1153] 10.222.0.13 () {60 vars in 1456 bytes} [Fri May 27 15:01:45 2022] DELETE /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments/b5397e9d-d731-466e-9f50-90c6d6d68bcf => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 15:01:45.987365 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9a7589f6-54ba-4bab-bdcd-04e6e63400db tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:45.989335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9a7589f6-54ba-4bab-bdcd-04e6e63400db tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:46.011968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a7589f6-54ba-4bab-bdcd-04e6e63400db tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:46.016341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a7589f6-54ba-4bab-bdcd-04e6e63400db tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:46.021273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a7589f6-54ba-4bab-bdcd-04e6e63400db tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:46.022652 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a7589f6-54ba-4bab-bdcd-04e6e63400db tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:46.129066 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9a7589f6-54ba-4bab-bdcd-04e6e63400db tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.145440 May 27 15:01:46.131144 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 598/1154] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:01:45 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:01:46.361453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-59e378b4-7dae-425e-80fc-eddaa1410156 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:46.363799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-59e378b4-7dae-425e-80fc-eddaa1410156 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:46.380956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-59e378b4-7dae-425e-80fc-eddaa1410156 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:46.381701 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-59e378b4-7dae-425e-80fc-eddaa1410156 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:46.383011 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-59e378b4-7dae-425e-80fc-eddaa1410156 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:46.385177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-59e378b4-7dae-425e-80fc-eddaa1410156 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:46.577096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ed30c549-9b37-49d8-980b-0502c344c86a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776c50430>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:46.608358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-59e378b4-7dae-425e-80fc-eddaa1410156 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:46.629470 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-59e378b4-7dae-425e-80fc-eddaa1410156 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1313 microversion: 2.1 time: 0.277982 May 27 15:01:46.655037 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ed30c549-9b37-49d8-980b-0502c344c86a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1411 microversion: 2.1 time: 0.083421 May 27 15:01:46.662718 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 557/1155] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:46 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:46.665197 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 599/1156] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:46 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1411 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:46.879421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-25742926-4ac3-4591-9c7d-90424806001a tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776b96ca0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:46.977913 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-25742926-4ac3-4591-9c7d-90424806001a tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25" status: 200 len: 1452 microversion: 2.1 time: 0.103280 May 27 15:01:46.991524 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 558/1157] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:46 2022] GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25 => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:47.154231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bc0bcb6c-4cd4-4276-a9b2-2c78a0e72bee tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:47.157570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bc0bcb6c-4cd4-4276-a9b2-2c78a0e72bee tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:47.191277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc0bcb6c-4cd4-4276-a9b2-2c78a0e72bee tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:47.196345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc0bcb6c-4cd4-4276-a9b2-2c78a0e72bee tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:47.203646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc0bcb6c-4cd4-4276-a9b2-2c78a0e72bee tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:47.208885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc0bcb6c-4cd4-4276-a9b2-2c78a0e72bee tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:47.318720 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bc0bcb6c-4cd4-4276-a9b2-2c78a0e72bee tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.182025 May 27 15:01:47.321966 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 600/1158] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:01:47 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:01:47.647539 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-786f9b3f-672d-49ed-a3c2-bdc2d38bc45e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:47.649264 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-786f9b3f-672d-49ed-a3c2-bdc2d38bc45e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:47.665525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-786f9b3f-672d-49ed-a3c2-bdc2d38bc45e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:47.671113 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-786f9b3f-672d-49ed-a3c2-bdc2d38bc45e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:47.677702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fe8385df-e91c-4582-86e3-b5f51581fa9d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776cf13a0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:47.678889 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-786f9b3f-672d-49ed-a3c2-bdc2d38bc45e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:47.679801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-786f9b3f-672d-49ed-a3c2-bdc2d38bc45e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:47.851102 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fe8385df-e91c-4582-86e3-b5f51581fa9d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1411 microversion: 2.1 time: 0.184256 May 27 15:01:47.855926 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 601/1159] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:47 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1411 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:48.017822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d5db668c-be92-4c67-abc6-8f45c3ae3ffc tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776b055e0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:48.170860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-786f9b3f-672d-49ed-a3c2-bdc2d38bc45e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:48.192140 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-786f9b3f-672d-49ed-a3c2-bdc2d38bc45e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1462 microversion: 2.1 time: 0.549117 May 27 15:01:48.193126 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 559/1160] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:47 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1462 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:48.226789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-86f0a4c6-71ee-467a-9e84-0c08b606d412 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:48.227656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-86f0a4c6-71ee-467a-9e84-0c08b606d412 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:48.238578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-86f0a4c6-71ee-467a-9e84-0c08b606d412 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:48.239167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-86f0a4c6-71ee-467a-9e84-0c08b606d412 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:48.240235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-86f0a4c6-71ee-467a-9e84-0c08b606d412 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:48.240948 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-86f0a4c6-71ee-467a-9e84-0c08b606d412 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:48.310963 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d5db668c-be92-4c67-abc6-8f45c3ae3ffc tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25" status: 200 len: 1452 microversion: 2.1 time: 0.309118 May 27 15:01:48.330201 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 602/1161] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:48 2022] GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25 => generated 1452 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:48.344729 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-420d3917-1cb2-466e-b771-ea98e167f740 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:48.350604 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-420d3917-1cb2-466e-b771-ea98e167f740 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:48.371126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-420d3917-1cb2-466e-b771-ea98e167f740 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:48.374423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-420d3917-1cb2-466e-b771-ea98e167f740 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:48.379032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-420d3917-1cb2-466e-b771-ea98e167f740 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:48.389747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-420d3917-1cb2-466e-b771-ea98e167f740 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:48.514479 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-420d3917-1cb2-466e-b771-ea98e167f740 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.178757 May 27 15:01:48.515767 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 603/1162] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:01:48 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:01:48.746187 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-86f0a4c6-71ee-467a-9e84-0c08b606d412 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1613 microversion: 2.1 time: 0.531106 May 27 15:01:48.748121 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 560/1163] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:48 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1613 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:01:48.768059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b43d7469-6f33-45e6-a23f-c5c322512c9c tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:48.769172 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b43d7469-6f33-45e6-a23f-c5c322512c9c tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:48.783580 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b43d7469-6f33-45e6-a23f-c5c322512c9c tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:48.784587 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b43d7469-6f33-45e6-a23f-c5c322512c9c tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:48.793795 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b43d7469-6f33-45e6-a23f-c5c322512c9c tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:48.794276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b43d7469-6f33-45e6-a23f-c5c322512c9c tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:48.898271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-32f3c705-7a42-4eb9-a326-638fe1d4235d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776bcaa60>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:49.003872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b43d7469-6f33-45e6-a23f-c5c322512c9c tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e44d8b3024bf49b3882dc6b50191b3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56227f97234624a6b21b3b72b1fefc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:49.005127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b43d7469-6f33-45e6-a23f-c5c322512c9c tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] flavor_id is None. Assuming migration. {{(pid=119248) resize /opt/stack/nova/nova/compute/api.py:4142}} May 27 15:01:49.005990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b43d7469-6f33-45e6-a23f-c5c322512c9c tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119248) resize /opt/stack/nova/nova/compute/api.py:4166}} May 27 15:01:50.375851 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b43d7469-6f33-45e6-a23f-c5c322512c9c tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922/action" status: 202 len: 0 microversion: 2.1 time: 1.612389 May 27 15:01:50.386586 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 604/1164] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:01:48 2022] POST /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922/action => generated 0 bytes in 1624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:01:50.411739 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-82a247bb-f24f-44d6-ba4c-708631fa0625 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776d4a820>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:51.797648 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-32f3c705-7a42-4eb9-a326-638fe1d4235d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1420 microversion: 2.1 time: 2.931609 May 27 15:01:51.798557 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 561/1165] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:48 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1420 bytes in 2933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:51.811318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cf5da473-2539-4f8f-a1f9-aad969445c8f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:51.812663 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cf5da473-2539-4f8f-a1f9-aad969445c8f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:51.828621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cf5da473-2539-4f8f-a1f9-aad969445c8f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:51.831835 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-82a247bb-f24f-44d6-ba4c-708631fa0625 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25" status: 200 len: 1452 microversion: 2.1 time: 1.442928 May 27 15:01:51.832429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cf5da473-2539-4f8f-a1f9-aad969445c8f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:51.833394 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 605/1166] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:50 2022] GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25 => generated 1452 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:51.833553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cf5da473-2539-4f8f-a1f9-aad969445c8f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:51.837004 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cf5da473-2539-4f8f-a1f9-aad969445c8f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:51.842855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f14b8654-49ce-422f-84ec-5a72bdc0ddfa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:51.844025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f14b8654-49ce-422f-84ec-5a72bdc0ddfa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:51.877585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:51.903500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f14b8654-49ce-422f-84ec-5a72bdc0ddfa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:51.907505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f14b8654-49ce-422f-84ec-5a72bdc0ddfa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:51.909516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f14b8654-49ce-422f-84ec-5a72bdc0ddfa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:51.913165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f14b8654-49ce-422f-84ec-5a72bdc0ddfa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:51.923674 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cf5da473-2539-4f8f-a1f9-aad969445c8f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.123796 May 27 15:01:51.926895 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 562/1167] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:01:51 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:01:51.938902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-583b8949-5963-4531-8084-b0cd25d83e90 req-93d94098-6ff5-41fa-ae24-fb3c4e01727a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73173e14-0308-44e3-adc9-8bbd5509246c", "name": "network-vif-plugged", "status": "completed", "tag": "f1f01d43-89a5-406d-9090-8469b79684bd"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:51.947481 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=7 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:51.970654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-583b8949-5963-4531-8084-b0cd25d83e90 req-93d94098-6ff5-41fa-ae24-fb3c4e01727a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:51.971951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-583b8949-5963-4531-8084-b0cd25d83e90 req-93d94098-6ff5-41fa-ae24-fb3c4e01727a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:51.995949 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-583b8949-5963-4531-8084-b0cd25d83e90 req-93d94098-6ff5-41fa-ae24-fb3c4e01727a service nova] Creating event network-vif-plugged:f1f01d43-89a5-406d-9090-8469b79684bd for instance 73173e14-0308-44e3-adc9-8bbd5509246c on n-h2-843621-1 May 27 15:01:52.009717 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-583b8949-5963-4531-8084-b0cd25d83e90 req-93d94098-6ff5-41fa-ae24-fb3c4e01727a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081314 May 27 15:01:52.015715 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 563/1168] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:52.196820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f14b8654-49ce-422f-84ec-5a72bdc0ddfa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:52.236878 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f14b8654-49ce-422f-84ec-5a72bdc0ddfa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1471 microversion: 2.1 time: 0.387044 May 27 15:01:52.238627 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 606/1169] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:51 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1471 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:52.271449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-adc23f8f-8c15-4c29-98a9-5705426319e9 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776c50940>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:52.330415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ce07e23d-0bef-429b-bcd5-ac1094b0b161 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-645074432", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:52.482525 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-adc23f8f-8c15-4c29-98a9-5705426319e9 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 200 len: 1420 microversion: 2.1 time: 0.239058 May 27 15:01:52.483301 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 607/1170] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:52 2022] GET /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:52.495801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-ce07e23d-0bef-429b-bcd5-ac1094b0b161 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] validate_networks() for None {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:01:52.515715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-69bd77a9-cb29-4426-a684-1567a628a2fb tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776cf1ee0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:52.861425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:53.470357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ce07e23d-0bef-429b-bcd5-ac1094b0b161 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:01:53.470865 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ce07e23d-0bef-429b-bcd5-ac1094b0b161 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:01:53.471823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ce07e23d-0bef-429b-bcd5-ac1094b0b161 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:01:53.471823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ce07e23d-0bef-429b-bcd5-ac1094b0b161 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:01:53.472097 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ce07e23d-0bef-429b-bcd5-ac1094b0b161 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:01:53.484559 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ce07e23d-0bef-429b-bcd5-ac1094b0b161 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:53.485075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ce07e23d-0bef-429b-bcd5-ac1094b0b161 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:53.485962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ce07e23d-0bef-429b-bcd5-ac1094b0b161 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:53.486388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ce07e23d-0bef-429b-bcd5-ac1094b0b161 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:53.510894 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-ce07e23d-0bef-429b-bcd5-ac1094b0b161 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for project a081b119396543ad8ac9421acc677175. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:01:53.535962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-ce07e23d-0bef-429b-bcd5-ac1094b0b161 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for user f426b883acdc49f8b0c4a9ba68e4572b and project a081b119396543ad8ac9421acc677175. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:01:53.562241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ce07e23d-0bef-429b-bcd5-ac1094b0b161 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:01:53.566250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ce07e23d-0bef-429b-bcd5-ac1094b0b161 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:01:53.649203 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ce07e23d-0bef-429b-bcd5-ac1094b0b161 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.631248 May 27 15:01:53.656962 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 564/1171] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:01:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:01:53.666735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d957a6e9-97c6-449b-bd6b-c45afe6723fa tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776c60670>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:54.138162 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-69bd77a9-cb29-4426-a684-1567a628a2fb tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "DELETE /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 204 len: 0 microversion: 2.1 time: 1.632573 May 27 15:01:54.145687 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 608/1172] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:52 2022] DELETE /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 0 bytes in 1639 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:01:54.154216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-73573349-387a-4174-88e6-e7afd126d499 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:54.171402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-73573349-387a-4174-88e6-e7afd126d499 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:54.194170 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73573349-387a-4174-88e6-e7afd126d499 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:54.196455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73573349-387a-4174-88e6-e7afd126d499 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:54.200235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73573349-387a-4174-88e6-e7afd126d499 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:54.202028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73573349-387a-4174-88e6-e7afd126d499 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:54.212690 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d957a6e9-97c6-449b-bd6b-c45afe6723fa tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25" status: 200 len: 1452 microversion: 2.1 time: 0.559962 May 27 15:01:54.214668 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 565/1173] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:53 2022] GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25 => generated 1452 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:54.225447 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-91db9bf1-878a-4d91-aa5d-0ed7d171e3a3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:54.226911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-91db9bf1-878a-4d91-aa5d-0ed7d171e3a3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:54.238053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-91db9bf1-878a-4d91-aa5d-0ed7d171e3a3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:54.239573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-91db9bf1-878a-4d91-aa5d-0ed7d171e3a3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:54.241300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-91db9bf1-878a-4d91-aa5d-0ed7d171e3a3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:54.242172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-91db9bf1-878a-4d91-aa5d-0ed7d171e3a3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:54.278700 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-73573349-387a-4174-88e6-e7afd126d499 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.131458 May 27 15:01:54.287570 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 609/1174] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:01:54 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:01:54.298541 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-11ad2606-68d2-441b-8eec-c2939f67c682 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:54.299205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-11ad2606-68d2-441b-8eec-c2939f67c682 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:54.480627 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-11ad2606-68d2-441b-8eec-c2939f67c682 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:54.492747 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-11ad2606-68d2-441b-8eec-c2939f67c682 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1216 microversion: 2.1 time: 0.203719 May 27 15:01:54.493699 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 610/1175] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:54 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1216 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:54.498631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-18743307-e9c6-4403-824a-23d812de0b85 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:54.503420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-18743307-e9c6-4403-824a-23d812de0b85 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:54.510131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18743307-e9c6-4403-824a-23d812de0b85 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:54.510975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18743307-e9c6-4403-824a-23d812de0b85 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:54.529332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18743307-e9c6-4403-824a-23d812de0b85 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:54.531065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18743307-e9c6-4403-824a-23d812de0b85 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:54.595416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-18743307-e9c6-4403-824a-23d812de0b85 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:01:54.641836 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-91db9bf1-878a-4d91-aa5d-0ed7d171e3a3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:54.655283 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-91db9bf1-878a-4d91-aa5d-0ed7d171e3a3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1471 microversion: 2.1 time: 0.438769 May 27 15:01:54.657114 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 566/1176] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:54 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1471 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:54.782314 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-18743307-e9c6-4403-824a-23d812de0b85 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25" status: 204 len: 0 microversion: 2.1 time: 0.287047 May 27 15:01:54.784354 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 611/1177] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:01:54 2022] DELETE /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:01:54.936706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2c6595f7-1346-47e5-8b66-d932948ee1d7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1219896700", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "5b029644-79a0-4d20-9c9d-09c8d08d8d68"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:55.073529 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-2c6595f7-1346-47e5-8b66-d932948ee1d7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] validate_networks() for [('5b029644-79a0-4d20-9c9d-09c8d08d8d68', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:01:55.234031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f465c793-b5eb-4b35-bb97-0a461f8a7482 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776b61310>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:55.365965 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f465c793-b5eb-4b35-bb97-0a461f8a7482 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25" status: 200 len: 1452 microversion: 2.1 time: 0.117864 May 27 15:01:55.372100 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 612/1178] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:55 2022] GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25 => generated 1452 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:55.379006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-100fd9fc-6160-4753-9f68-1282fc0be217 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:55.380401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-100fd9fc-6160-4753-9f68-1282fc0be217 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:55.389522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-100fd9fc-6160-4753-9f68-1282fc0be217 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:55.390443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-100fd9fc-6160-4753-9f68-1282fc0be217 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:55.392512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-100fd9fc-6160-4753-9f68-1282fc0be217 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:55.393702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-100fd9fc-6160-4753-9f68-1282fc0be217 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:55.434957 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-100fd9fc-6160-4753-9f68-1282fc0be217 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.060621 May 27 15:01:55.435960 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 613/1179] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:01:55 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:01:55.529258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-182aa4b7-d362-4bd1-bddd-17ae64c9d83e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:55.530154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-182aa4b7-d362-4bd1-bddd-17ae64c9d83e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:55.541470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-182aa4b7-d362-4bd1-bddd-17ae64c9d83e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:55.542555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-182aa4b7-d362-4bd1-bddd-17ae64c9d83e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:55.543686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-182aa4b7-d362-4bd1-bddd-17ae64c9d83e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:55.544388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-182aa4b7-d362-4bd1-bddd-17ae64c9d83e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:55.656131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-182aa4b7-d362-4bd1-bddd-17ae64c9d83e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:55.668020 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-182aa4b7-d362-4bd1-bddd-17ae64c9d83e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1220 microversion: 2.1 time: 0.146300 May 27 15:01:55.669584 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 614/1180] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:55 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1220 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:55.687310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-62160b9d-56c3-4b34-ad4b-706b89900d0b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:55.688773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-62160b9d-56c3-4b34-ad4b-706b89900d0b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:55.698316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=8,nova_api:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:55.700479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62160b9d-56c3-4b34-ad4b-706b89900d0b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:55.701745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62160b9d-56c3-4b34-ad4b-706b89900d0b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:55.704597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62160b9d-56c3-4b34-ad4b-706b89900d0b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:55.706281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62160b9d-56c3-4b34-ad4b-706b89900d0b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:55.918909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-2c6595f7-1346-47e5-8b66-d932948ee1d7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:01:55.919758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-2c6595f7-1346-47e5-8b66-d932948ee1d7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:01:55.920712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-2c6595f7-1346-47e5-8b66-d932948ee1d7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:01:55.921453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-2c6595f7-1346-47e5-8b66-d932948ee1d7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:01:55.922106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-2c6595f7-1346-47e5-8b66-d932948ee1d7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:01:55.946355 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c6595f7-1346-47e5-8b66-d932948ee1d7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:55.946811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c6595f7-1346-47e5-8b66-d932948ee1d7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:55.948540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c6595f7-1346-47e5-8b66-d932948ee1d7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:55.951517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c6595f7-1346-47e5-8b66-d932948ee1d7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:55.999447 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-2c6595f7-1346-47e5-8b66-d932948ee1d7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Getting quotas for project 1ee754951c48459888c45e9e8ec10dce. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:01:56.014008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-2c6595f7-1346-47e5-8b66-d932948ee1d7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Getting quotas for user c118a948fbea4575813842ca30613064 and project 1ee754951c48459888c45e9e8ec10dce. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:01:56.033697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-62160b9d-56c3-4b34-ad4b-706b89900d0b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:56.058494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2c6595f7-1346-47e5-8b66-d932948ee1d7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:01:56.059443 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-62160b9d-56c3-4b34-ad4b-706b89900d0b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1476 microversion: 2.1 time: 0.379261 May 27 15:01:56.062603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2c6595f7-1346-47e5-8b66-d932948ee1d7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:01:56.083967 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 615/1181] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:55 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1476 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:56.196137 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2c6595f7-1346-47e5-8b66-d932948ee1d7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.263706 May 27 15:01:56.211154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ba9fe540-4529-45b8-8a7d-3ec25201827e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:56.211950 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ba9fe540-4529-45b8-8a7d-3ec25201827e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:56.213110 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 567/1182] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:01:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:01:56.331018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ba9fe540-4529-45b8-8a7d-3ec25201827e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:56.342586 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ba9fe540-4529-45b8-8a7d-3ec25201827e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1208 microversion: 2.1 time: 0.137695 May 27 15:01:56.353131 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 616/1183] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:56 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1208 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:56.393297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7cbad61a-9e5e-4cf3-b66d-2101585c5e4b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776b93040>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:56.449545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0750653e-6ac5-4fd2-8413-d2bca484b6aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:56.452031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0750653e-6ac5-4fd2-8413-d2bca484b6aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:56.478990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0750653e-6ac5-4fd2-8413-d2bca484b6aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:56.485731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0750653e-6ac5-4fd2-8413-d2bca484b6aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:56.486731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0750653e-6ac5-4fd2-8413-d2bca484b6aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:56.487401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0750653e-6ac5-4fd2-8413-d2bca484b6aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:56.494596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:01:56.532609 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7cbad61a-9e5e-4cf3-b66d-2101585c5e4b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25" status: 200 len: 1452 microversion: 2.1 time: 0.146775 May 27 15:01:56.537326 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 568/1184] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:56 2022] GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:56.582935 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0750653e-6ac5-4fd2-8413-d2bca484b6aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.137266 May 27 15:01:56.583944 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 617/1185] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:01:56 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:01:56.686636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fe1f251c-3fd0-4afe-b9a7-718e73810ea9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:56.687803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fe1f251c-3fd0-4afe-b9a7-718e73810ea9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:56.701546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe1f251c-3fd0-4afe-b9a7-718e73810ea9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:56.701999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe1f251c-3fd0-4afe-b9a7-718e73810ea9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:56.704511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe1f251c-3fd0-4afe-b9a7-718e73810ea9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:56.705448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe1f251c-3fd0-4afe-b9a7-718e73810ea9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:56.859992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fe1f251c-3fd0-4afe-b9a7-718e73810ea9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:56.874296 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fe1f251c-3fd0-4afe-b9a7-718e73810ea9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1212 microversion: 2.1 time: 0.192003 May 27 15:01:56.876119 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 569/1186] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:56 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1212 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:57.092389 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8a95f2f1-2ed8-48df-97a7-a3f89797773c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:57.095322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8a95f2f1-2ed8-48df-97a7-a3f89797773c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:57.110974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a95f2f1-2ed8-48df-97a7-a3f89797773c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:57.114272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a95f2f1-2ed8-48df-97a7-a3f89797773c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:57.121728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a95f2f1-2ed8-48df-97a7-a3f89797773c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:57.122764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a95f2f1-2ed8-48df-97a7-a3f89797773c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:57.365788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5f314e5f-2e17-41a0-87f7-0f11bf4150f5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:57.367327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5f314e5f-2e17-41a0-87f7-0f11bf4150f5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:57.401830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5f314e5f-2e17-41a0-87f7-0f11bf4150f5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:57.407184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5f314e5f-2e17-41a0-87f7-0f11bf4150f5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:57.411206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5f314e5f-2e17-41a0-87f7-0f11bf4150f5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:57.412610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5f314e5f-2e17-41a0-87f7-0f11bf4150f5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:57.429553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8a95f2f1-2ed8-48df-97a7-a3f89797773c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:57.452353 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8a95f2f1-2ed8-48df-97a7-a3f89797773c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1476 microversion: 2.1 time: 0.364891 May 27 15:01:57.462782 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 618/1187] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:57 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1476 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:01:57.551337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-74b1cbb3-c4ec-4325-8fbb-bd1ceecd85a5 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776b055e0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:57.626845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5f314e5f-2e17-41a0-87f7-0f11bf4150f5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:57.639289 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5f314e5f-2e17-41a0-87f7-0f11bf4150f5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1212 microversion: 2.1 time: 0.281514 May 27 15:01:57.650133 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 570/1188] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:57 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1212 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:57.656083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-653b62b2-30ca-4139-a2e7-1e7b288df8b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:57.657487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-653b62b2-30ca-4139-a2e7-1e7b288df8b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:57.665509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-653b62b2-30ca-4139-a2e7-1e7b288df8b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:57.666341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-653b62b2-30ca-4139-a2e7-1e7b288df8b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:57.667506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-653b62b2-30ca-4139-a2e7-1e7b288df8b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:57.668243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-653b62b2-30ca-4139-a2e7-1e7b288df8b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:57.713794 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-74b1cbb3-c4ec-4325-8fbb-bd1ceecd85a5 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25" status: 200 len: 1452 microversion: 2.1 time: 0.167761 May 27 15:01:57.720271 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 619/1189] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:57 2022] GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:57.730620 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-653b62b2-30ca-4139-a2e7-1e7b288df8b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.078671 May 27 15:01:57.731759 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 571/1190] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:01:57 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:01:57.904270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4aa61fe7-9b44-40e3-837d-c46679679b74 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:57.905450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4aa61fe7-9b44-40e3-837d-c46679679b74 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:57.930227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4aa61fe7-9b44-40e3-837d-c46679679b74 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:57.932529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4aa61fe7-9b44-40e3-837d-c46679679b74 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:57.934772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4aa61fe7-9b44-40e3-837d-c46679679b74 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:57.937744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4aa61fe7-9b44-40e3-837d-c46679679b74 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:58.103008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4aa61fe7-9b44-40e3-837d-c46679679b74 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:58.118842 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4aa61fe7-9b44-40e3-837d-c46679679b74 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1286 microversion: 2.1 time: 0.218701 May 27 15:01:58.119826 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 620/1191] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:57 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1286 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:58.171659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-bae4ccf7-ed48-4b3f-8608-79ac1f2f7b1f req-2a8a1c41-3b7f-4a11-844e-07e9da9a668b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25", "name": "network-vif-deleted", "tag": "4e83a9ed-eea8-4580-a697-0ad1b8d1d61b"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:01:58.183027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-bae4ccf7-ed48-4b3f-8608-79ac1f2f7b1f req-2a8a1c41-3b7f-4a11-844e-07e9da9a668b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:58.183879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-bae4ccf7-ed48-4b3f-8608-79ac1f2f7b1f req-2a8a1c41-3b7f-4a11-844e-07e9da9a668b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:58.204284 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-bae4ccf7-ed48-4b3f-8608-79ac1f2f7b1f req-2a8a1c41-3b7f-4a11-844e-07e9da9a668b service nova] Creating event network-vif-deleted:4e83a9ed-eea8-4580-a697-0ad1b8d1d61b for instance bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 on n-h2-843621-1 May 27 15:01:58.213085 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-bae4ccf7-ed48-4b3f-8608-79ac1f2f7b1f req-2a8a1c41-3b7f-4a11-844e-07e9da9a668b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045218 May 27 15:01:58.214893 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 572/1192] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:01:58.490779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ae5f1d47-712c-43f5-9e68-f18e7d33c9c1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:58.495646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ae5f1d47-712c-43f5-9e68-f18e7d33c9c1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:58.556823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ae5f1d47-712c-43f5-9e68-f18e7d33c9c1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:58.558544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ae5f1d47-712c-43f5-9e68-f18e7d33c9c1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:58.563162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ae5f1d47-712c-43f5-9e68-f18e7d33c9c1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:58.563882 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ae5f1d47-712c-43f5-9e68-f18e7d33c9c1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:58.669520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a754cb84-7806-4221-9cc7-14b1a1bfada8 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:58.673054 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a754cb84-7806-4221-9cc7-14b1a1bfada8 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:58.690188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a754cb84-7806-4221-9cc7-14b1a1bfada8 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:58.695136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a754cb84-7806-4221-9cc7-14b1a1bfada8 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:58.696157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a754cb84-7806-4221-9cc7-14b1a1bfada8 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:58.699537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a754cb84-7806-4221-9cc7-14b1a1bfada8 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:58.934606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a754cb84-7806-4221-9cc7-14b1a1bfada8 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:58.951631 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a754cb84-7806-4221-9cc7-14b1a1bfada8 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1268 microversion: 2.1 time: 0.296157 May 27 15:01:58.955241 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 573/1193] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:58 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1268 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:01:58.971956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a1d314bc-3907-45a1-b76b-5d2fe8ef1bab tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776acaca0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:59.066721 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a1d314bc-3907-45a1-b76b-5d2fe8ef1bab tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25" status: 200 len: 1452 microversion: 2.1 time: 0.109305 May 27 15:01:59.068068 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 574/1194] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:01:58 2022] GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:59.087158 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2e8e64df-3458-4ddf-9768-a0ec82d40311 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:59.089674 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2e8e64df-3458-4ddf-9768-a0ec82d40311 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:59.113240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e8e64df-3458-4ddf-9768-a0ec82d40311 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:59.115801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e8e64df-3458-4ddf-9768-a0ec82d40311 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:59.119162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e8e64df-3458-4ddf-9768-a0ec82d40311 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:59.120719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e8e64df-3458-4ddf-9768-a0ec82d40311 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:59.227183 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ae5f1d47-712c-43f5-9e68-f18e7d33c9c1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:59.237091 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2e8e64df-3458-4ddf-9768-a0ec82d40311 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.167454 May 27 15:01:59.239370 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ae5f1d47-712c-43f5-9e68-f18e7d33c9c1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1476 microversion: 2.1 time: 0.762022 May 27 15:01:59.241871 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 575/1195] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:01:59 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:01:59.248985 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 621/1196] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:58 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1476 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:59.269168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3944d753-e1fb-4b08-bfa1-33a9c4a3f423 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:59.270282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3944d753-e1fb-4b08-bfa1-33a9c4a3f423 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:59.301522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3944d753-e1fb-4b08-bfa1-33a9c4a3f423 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:59.302162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3944d753-e1fb-4b08-bfa1-33a9c4a3f423 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:59.302997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3944d753-e1fb-4b08-bfa1-33a9c4a3f423 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:59.303557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3944d753-e1fb-4b08-bfa1-33a9c4a3f423 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:59.515604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3944d753-e1fb-4b08-bfa1-33a9c4a3f423 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:01:59.531212 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3944d753-e1fb-4b08-bfa1-33a9c4a3f423 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1274 microversion: 2.1 time: 0.285429 May 27 15:01:59.533105 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 576/1197] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:59 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1274 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:01:59.971950 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-38c1bafc-d5ce-46b3-90d9-2e2c9e568d90 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:01:59.972849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-38c1bafc-d5ce-46b3-90d9-2e2c9e568d90 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:01:59.984384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-38c1bafc-d5ce-46b3-90d9-2e2c9e568d90 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:59.984885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-38c1bafc-d5ce-46b3-90d9-2e2c9e568d90 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:01:59.985661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-38c1bafc-d5ce-46b3-90d9-2e2c9e568d90 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:01:59.986099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-38c1bafc-d5ce-46b3-90d9-2e2c9e568d90 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:00.081721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2957a819-bd64-4330-b61c-3e83c94bdafd tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776b815e0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:00.175416 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2957a819-bd64-4330-b61c-3e83c94bdafd tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25" status: 200 len: 1452 microversion: 2.1 time: 0.098999 May 27 15:02:00.180316 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 577/1198] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:00 2022] GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25 => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:00.266605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9a1419ef-6744-42d4-80ba-d28b80d8415b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:00.267480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9a1419ef-6744-42d4-80ba-d28b80d8415b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:00.281636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a1419ef-6744-42d4-80ba-d28b80d8415b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:00.282429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a1419ef-6744-42d4-80ba-d28b80d8415b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:00.291222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a1419ef-6744-42d4-80ba-d28b80d8415b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:00.292423 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a1419ef-6744-42d4-80ba-d28b80d8415b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:00.482728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-38c1bafc-d5ce-46b3-90d9-2e2c9e568d90 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:00.497088 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-38c1bafc-d5ce-46b3-90d9-2e2c9e568d90 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1308 microversion: 2.1 time: 0.529322 May 27 15:02:00.508449 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 622/1199] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:01:59 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1308 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:00.513958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5e8684f0-4f6b-4624-b515-81f8d1b5a4f5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:00.515219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5e8684f0-4f6b-4624-b515-81f8d1b5a4f5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:00.532855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5e8684f0-4f6b-4624-b515-81f8d1b5a4f5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:00.536091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5e8684f0-4f6b-4624-b515-81f8d1b5a4f5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:00.537701 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5e8684f0-4f6b-4624-b515-81f8d1b5a4f5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:00.540034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5e8684f0-4f6b-4624-b515-81f8d1b5a4f5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:00.630738 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5e8684f0-4f6b-4624-b515-81f8d1b5a4f5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.120813 May 27 15:02:00.631672 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 623/1200] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:02:00 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:02:00.636553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-18f69cbb-55d5-4837-82a0-f76157d96ea4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:00.637344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-18f69cbb-55d5-4837-82a0-f76157d96ea4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:00.648906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9a1419ef-6744-42d4-80ba-d28b80d8415b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:00.651853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18f69cbb-55d5-4837-82a0-f76157d96ea4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:00.652417 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18f69cbb-55d5-4837-82a0-f76157d96ea4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:00.655426 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18f69cbb-55d5-4837-82a0-f76157d96ea4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:00.655989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18f69cbb-55d5-4837-82a0-f76157d96ea4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:00.678880 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9a1419ef-6744-42d4-80ba-d28b80d8415b tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1476 microversion: 2.1 time: 0.422749 May 27 15:02:00.690789 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 578/1201] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:00 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1476 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:01.053811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-18f69cbb-55d5-4837-82a0-f76157d96ea4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:01.067503 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-18f69cbb-55d5-4837-82a0-f76157d96ea4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1316 microversion: 2.1 time: 0.434634 May 27 15:02:01.070122 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 624/1202] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:00 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:01.197280 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9bc2ab58-89c1-4c0f-a568-ff83f9c43117 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776b813a0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:01.309245 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9bc2ab58-89c1-4c0f-a568-ff83f9c43117 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25" status: 200 len: 1452 microversion: 2.1 time: 0.119523 May 27 15:02:01.310224 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 579/1203] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:01 2022] GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25 => generated 1452 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:01.515003 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-23158b97-fcde-4380-91d5-410bebeb8ac6 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:01.516283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-23158b97-fcde-4380-91d5-410bebeb8ac6 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:01.534342 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23158b97-fcde-4380-91d5-410bebeb8ac6 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:01.540241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23158b97-fcde-4380-91d5-410bebeb8ac6 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:01.544246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23158b97-fcde-4380-91d5-410bebeb8ac6 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:01.548348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23158b97-fcde-4380-91d5-410bebeb8ac6 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:01.662891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b93e4c02-3263-496f-a80b-2a3bd3bcb36b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:01.667052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b93e4c02-3263-496f-a80b-2a3bd3bcb36b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:01.686025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b93e4c02-3263-496f-a80b-2a3bd3bcb36b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:01.687391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b93e4c02-3263-496f-a80b-2a3bd3bcb36b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:01.688471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b93e4c02-3263-496f-a80b-2a3bd3bcb36b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:01.689133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b93e4c02-3263-496f-a80b-2a3bd3bcb36b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:01.740996 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b93e4c02-3263-496f-a80b-2a3bd3bcb36b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.100731 May 27 15:02:01.764874 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 580/1204] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:02:01 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:02:01.770859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-41dfca9e-2ce1-4991-a286-06a076ee29e7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:01.785430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-41dfca9e-2ce1-4991-a286-06a076ee29e7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:01.794095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-41dfca9e-2ce1-4991-a286-06a076ee29e7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:01.794873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-41dfca9e-2ce1-4991-a286-06a076ee29e7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:01.795842 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-41dfca9e-2ce1-4991-a286-06a076ee29e7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:01.796456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-41dfca9e-2ce1-4991-a286-06a076ee29e7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:02.148249 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-23158b97-fcde-4380-91d5-410bebeb8ac6 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:02.172173 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-23158b97-fcde-4380-91d5-410bebeb8ac6 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1308 microversion: 2.1 time: 0.660913 May 27 15:02:02.175591 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 625/1205] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:01 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1308 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:02.188563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c7c7d918-ece1-4811-86cf-ed9bfae92177 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:02.189812 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c7c7d918-ece1-4811-86cf-ed9bfae92177 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:02.207375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c7c7d918-ece1-4811-86cf-ed9bfae92177 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:02.211768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c7c7d918-ece1-4811-86cf-ed9bfae92177 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:02.213795 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c7c7d918-ece1-4811-86cf-ed9bfae92177 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:02.215952 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c7c7d918-ece1-4811-86cf-ed9bfae92177 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:02.285314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-41dfca9e-2ce1-4991-a286-06a076ee29e7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:02.297869 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-41dfca9e-2ce1-4991-a286-06a076ee29e7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1476 microversion: 2.1 time: 0.530624 May 27 15:02:02.299269 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 581/1206] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:01 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1476 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:02.324319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a7dd0bf2-1d4e-4acb-9098-93676aff37ff tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776c60670>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:02.422441 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a7dd0bf2-1d4e-4acb-9098-93676aff37ff tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25" status: 200 len: 1452 microversion: 2.1 time: 0.102135 May 27 15:02:02.428611 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 582/1207] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:02 2022] GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:02.632274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-7bc25964-cdee-4c32-b683-eaec91790852 req-9d8c58b2-2e0f-4601-9666-4c6b3324133a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a72bd3cf-9b54-4d56-ab10-9f2a602a15f5", "tag": "b633ef09-5eca-4f03-95aa-8ed44cb2e4c0"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:02.683102 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-7bc25964-cdee-4c32-b683-eaec91790852 req-9d8c58b2-2e0f-4601-9666-4c6b3324133a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:02.684553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-7bc25964-cdee-4c32-b683-eaec91790852 req-9d8c58b2-2e0f-4601-9666-4c6b3324133a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:02.718404 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-7bc25964-cdee-4c32-b683-eaec91790852 req-9d8c58b2-2e0f-4601-9666-4c6b3324133a service nova] Creating event network-changed:b633ef09-5eca-4f03-95aa-8ed44cb2e4c0 for instance a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 on n-h2-843621-1 May 27 15:02:02.731676 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c7c7d918-ece1-4811-86cf-ed9bfae92177 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:02.741064 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-7bc25964-cdee-4c32-b683-eaec91790852 req-9d8c58b2-2e0f-4601-9666-4c6b3324133a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114897 May 27 15:02:02.743971 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 583/1208] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:02.751113 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c7c7d918-ece1-4811-86cf-ed9bfae92177 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1316 microversion: 2.1 time: 0.573686 May 27 15:02:02.757237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-56d7b0f4-95de-4567-b287-5204c64aeae1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:02.758596 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-56d7b0f4-95de-4567-b287-5204c64aeae1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:02.772186 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 626/1209] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:02 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1316 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:02.778456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56d7b0f4-95de-4567-b287-5204c64aeae1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:02.779590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56d7b0f4-95de-4567-b287-5204c64aeae1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:02.780618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56d7b0f4-95de-4567-b287-5204c64aeae1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:02.781271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56d7b0f4-95de-4567-b287-5204c64aeae1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:02.870357 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-56d7b0f4-95de-4567-b287-5204c64aeae1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.118018 May 27 15:02:02.871262 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 584/1210] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:02:02 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:02:03.181301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-94cafbd4-eb95-40c8-bb8d-6447f2b6dfd1 req-ced67c56-156c-4437-ae1b-2808913f82aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44417337-ef8b-407b-aafd-7f00dfc5b4d8", "tag": "452a5598-4173-4a88-8db6-c8043089f346"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:03.197506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2c8b4254-6d48-4ec0-b855-e4b19017a5bf tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:03.201178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-94cafbd4-eb95-40c8-bb8d-6447f2b6dfd1 req-ced67c56-156c-4437-ae1b-2808913f82aa service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:03.202211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-94cafbd4-eb95-40c8-bb8d-6447f2b6dfd1 req-ced67c56-156c-4437-ae1b-2808913f82aa service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:03.202889 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2c8b4254-6d48-4ec0-b855-e4b19017a5bf tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:03.229884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c8b4254-6d48-4ec0-b855-e4b19017a5bf tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:03.238587 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-94cafbd4-eb95-40c8-bb8d-6447f2b6dfd1 req-ced67c56-156c-4437-ae1b-2808913f82aa service nova] Creating event network-changed:452a5598-4173-4a88-8db6-c8043089f346 for instance 44417337-ef8b-407b-aafd-7f00dfc5b4d8 on n-h2-843621-1 May 27 15:02:03.239272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c8b4254-6d48-4ec0-b855-e4b19017a5bf tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:03.240333 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c8b4254-6d48-4ec0-b855-e4b19017a5bf tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:03.241914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c8b4254-6d48-4ec0-b855-e4b19017a5bf tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:03.288176 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-94cafbd4-eb95-40c8-bb8d-6447f2b6dfd1 req-ced67c56-156c-4437-ae1b-2808913f82aa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111843 May 27 15:02:03.304153 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 627/1211] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:03.348048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6f1b2226-3588-47db-a623-e785a39c7aba tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:03.357744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6f1b2226-3588-47db-a623-e785a39c7aba tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:03.397308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f1b2226-3588-47db-a623-e785a39c7aba tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:03.416840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f1b2226-3588-47db-a623-e785a39c7aba tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:03.422001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f1b2226-3588-47db-a623-e785a39c7aba tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:03.422824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f1b2226-3588-47db-a623-e785a39c7aba tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:03.830334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2c8b4254-6d48-4ec0-b855-e4b19017a5bf tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:03.843148 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2c8b4254-6d48-4ec0-b855-e4b19017a5bf tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1308 microversion: 2.1 time: 0.654033 May 27 15:02:03.844419 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 585/1212] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:03 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1308 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:03.854943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-259093cc-ef82-4e19-b389-143428d7d446 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776aca820>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:03.936525 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-259093cc-ef82-4e19-b389-143428d7d446 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25" status: 200 len: 1452 microversion: 2.1 time: 0.090633 May 27 15:02:03.937323 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 586/1213] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:03 2022] GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25 => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:03.945613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6f1b2226-3588-47db-a623-e785a39c7aba tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:03.948930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-eef7c4da-fcef-487e-95a1-43f2f130864b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:03.949758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-eef7c4da-fcef-487e-95a1-43f2f130864b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:03.958406 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6f1b2226-3588-47db-a623-e785a39c7aba tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1476 microversion: 2.1 time: 0.643196 May 27 15:02:03.961955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eef7c4da-fcef-487e-95a1-43f2f130864b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:03.963335 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 628/1214] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:03 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1476 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:03.966528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eef7c4da-fcef-487e-95a1-43f2f130864b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:03.967586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eef7c4da-fcef-487e-95a1-43f2f130864b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:03.969858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eef7c4da-fcef-487e-95a1-43f2f130864b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:03.975509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f00cd63c-be23-485c-97f2-aace20b6bae4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:03.986447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f00cd63c-be23-485c-97f2-aace20b6bae4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:03.994873 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f00cd63c-be23-485c-97f2-aace20b6bae4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:03.996039 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f00cd63c-be23-485c-97f2-aace20b6bae4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:04.012601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f00cd63c-be23-485c-97f2-aace20b6bae4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:04.014502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f00cd63c-be23-485c-97f2-aace20b6bae4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:04.092385 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f00cd63c-be23-485c-97f2-aace20b6bae4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127668 May 27 15:02:04.093051 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 629/1215] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:02:03 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:02:04.254587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-eef7c4da-fcef-487e-95a1-43f2f130864b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:04.278364 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-eef7c4da-fcef-487e-95a1-43f2f130864b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1316 microversion: 2.1 time: 0.338597 May 27 15:02:04.283032 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 587/1216] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:03 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:04.873627 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2414e24a-4e0b-44c4-a58d-9eaddef4c864 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:04.876148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2414e24a-4e0b-44c4-a58d-9eaddef4c864 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:04.890265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2414e24a-4e0b-44c4-a58d-9eaddef4c864 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:04.890969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2414e24a-4e0b-44c4-a58d-9eaddef4c864 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:04.892028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2414e24a-4e0b-44c4-a58d-9eaddef4c864 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:04.892480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2414e24a-4e0b-44c4-a58d-9eaddef4c864 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:04.964943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a55a137b-eb3f-4cf6-a9c9-d7860e30ac9c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776c15550>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:05.065889 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a55a137b-eb3f-4cf6-a9c9-d7860e30ac9c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25" status: 200 len: 1452 microversion: 2.1 time: 0.111171 May 27 15:02:05.069081 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 588/1217] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:04 2022] GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25 => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:05.079211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-643386f0-4817-4acb-aa22-f1818781eb9f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:05.087866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-643386f0-4817-4acb-aa22-f1818781eb9f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:05.100219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-643386f0-4817-4acb-aa22-f1818781eb9f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:05.101463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-643386f0-4817-4acb-aa22-f1818781eb9f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:05.102390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-643386f0-4817-4acb-aa22-f1818781eb9f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:05.102939 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-643386f0-4817-4acb-aa22-f1818781eb9f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:05.122868 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2414e24a-4e0b-44c4-a58d-9eaddef4c864 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:05.141266 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2414e24a-4e0b-44c4-a58d-9eaddef4c864 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1308 microversion: 2.1 time: 0.276624 May 27 15:02:05.142735 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 630/1218] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:04 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1308 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:05.148902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3219a48b-def1-4481-9cf1-0cc41b840a88 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:05.154768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3219a48b-def1-4481-9cf1-0cc41b840a88 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:05.164433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3219a48b-def1-4481-9cf1-0cc41b840a88 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:05.165253 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3219a48b-def1-4481-9cf1-0cc41b840a88 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:05.166273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3219a48b-def1-4481-9cf1-0cc41b840a88 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:05.166963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3219a48b-def1-4481-9cf1-0cc41b840a88 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:05.219602 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3219a48b-def1-4481-9cf1-0cc41b840a88 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.074972 May 27 15:02:05.220598 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 631/1219] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:02:05 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:02:05.303985 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3405c829-cb41-434f-a4ff-76d4150f768d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:05.305169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3405c829-cb41-434f-a4ff-76d4150f768d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:05.306885 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-643386f0-4817-4acb-aa22-f1818781eb9f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:05.320269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3405c829-cb41-434f-a4ff-76d4150f768d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:05.321453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3405c829-cb41-434f-a4ff-76d4150f768d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:05.322731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3405c829-cb41-434f-a4ff-76d4150f768d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:05.323798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3405c829-cb41-434f-a4ff-76d4150f768d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:05.328016 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-643386f0-4817-4acb-aa22-f1818781eb9f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1476 microversion: 2.1 time: 0.252584 May 27 15:02:05.331797 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 589/1220] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:05 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1476 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:05.529419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3405c829-cb41-434f-a4ff-76d4150f768d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:05.540378 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3405c829-cb41-434f-a4ff-76d4150f768d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1316 microversion: 2.1 time: 0.242878 May 27 15:02:05.541165 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 632/1221] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:05 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1316 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:06.082607 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4cfb55c1-708b-4d9d-81c2-858d06569c27 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776b93160>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:06.099263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:06.100421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=14 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:06.153717 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4cfb55c1-708b-4d9d-81c2-858d06569c27 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25" status: 200 len: 1452 microversion: 2.1 time: 0.073674 May 27 15:02:06.154590 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 590/1222] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:06 2022] GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25 => generated 1452 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:02:06.166895 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e40d0aed-e27a-407a-9ea2-caa695fe8f10 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:06.167684 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e40d0aed-e27a-407a-9ea2-caa695fe8f10 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:06.175251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e40d0aed-e27a-407a-9ea2-caa695fe8f10 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:06.176165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e40d0aed-e27a-407a-9ea2-caa695fe8f10 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:06.177324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e40d0aed-e27a-407a-9ea2-caa695fe8f10 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:06.178035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e40d0aed-e27a-407a-9ea2-caa695fe8f10 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:06.235166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-67469bbf-44c4-46ad-b25b-260a261d9b49 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:06.237683 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-67469bbf-44c4-46ad-b25b-260a261d9b49 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:06.248303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67469bbf-44c4-46ad-b25b-260a261d9b49 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:06.249810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67469bbf-44c4-46ad-b25b-260a261d9b49 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:06.251070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67469bbf-44c4-46ad-b25b-260a261d9b49 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:06.251779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67469bbf-44c4-46ad-b25b-260a261d9b49 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:06.258112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:06.301591 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-67469bbf-44c4-46ad-b25b-260a261d9b49 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.071876 May 27 15:02:06.307573 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 591/1223] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:02:06 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 15:02:06.345018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:06.367913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4badd2e2-4867-4727-90b5-118f558208aa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:06.369134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4badd2e2-4867-4727-90b5-118f558208aa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:06.378242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4badd2e2-4867-4727-90b5-118f558208aa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:06.378711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4badd2e2-4867-4727-90b5-118f558208aa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:06.379578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4badd2e2-4867-4727-90b5-118f558208aa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:06.379976 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4badd2e2-4867-4727-90b5-118f558208aa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:06.426683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e40d0aed-e27a-407a-9ea2-caa695fe8f10 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:06.448184 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e40d0aed-e27a-407a-9ea2-caa695fe8f10 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1308 microversion: 2.1 time: 0.283553 May 27 15:02:06.453652 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 633/1224] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:06 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:06.560731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-188e210e-8a60-4e00-877b-1e4a5125b0f0 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:06.561659 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-188e210e-8a60-4e00-877b-1e4a5125b0f0 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:06.588126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-188e210e-8a60-4e00-877b-1e4a5125b0f0 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:06.588714 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-188e210e-8a60-4e00-877b-1e4a5125b0f0 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:06.589509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-188e210e-8a60-4e00-877b-1e4a5125b0f0 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:06.589958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-188e210e-8a60-4e00-877b-1e4a5125b0f0 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:06.593314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4badd2e2-4867-4727-90b5-118f558208aa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:06.622980 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4badd2e2-4867-4727-90b5-118f558208aa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1476 microversion: 2.1 time: 0.277363 May 27 15:02:06.625890 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 592/1225] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:06 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1476 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:02:06.850243 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-188e210e-8a60-4e00-877b-1e4a5125b0f0 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:06.858753 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-188e210e-8a60-4e00-877b-1e4a5125b0f0 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1316 microversion: 2.1 time: 0.303393 May 27 15:02:06.864665 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 634/1226] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:06 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:07.173283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-74b42fdf-9cfd-46cd-9587-44cb0022e2c4 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776b93e50>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:07.267675 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-74b42fdf-9cfd-46cd-9587-44cb0022e2c4 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25" status: 200 len: 1452 microversion: 2.1 time: 0.102037 May 27 15:02:07.269896 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 593/1227] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:07 2022] GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:02:07.315334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ab78ab4e-368a-4dab-b7c9-3d474ddad7aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:07.317170 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ab78ab4e-368a-4dab-b7c9-3d474ddad7aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:07.326968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab78ab4e-368a-4dab-b7c9-3d474ddad7aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:07.329222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab78ab4e-368a-4dab-b7c9-3d474ddad7aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:07.334620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab78ab4e-368a-4dab-b7c9-3d474ddad7aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:07.335800 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab78ab4e-368a-4dab-b7c9-3d474ddad7aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:07.369469 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:07.414109 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ab78ab4e-368a-4dab-b7c9-3d474ddad7aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.103629 May 27 15:02:07.417062 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 635/1228] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:02:07 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:02:07.457455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cfbe5b76-3a49-4f3e-9673-debb837e2738 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:07.459301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cfbe5b76-3a49-4f3e-9673-debb837e2738 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:07.477352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfbe5b76-3a49-4f3e-9673-debb837e2738 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:07.479124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfbe5b76-3a49-4f3e-9673-debb837e2738 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:07.480240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfbe5b76-3a49-4f3e-9673-debb837e2738 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:07.480937 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfbe5b76-3a49-4f3e-9673-debb837e2738 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:07.650734 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cfbe5b76-3a49-4f3e-9673-debb837e2738 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:07.662111 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cfbe5b76-3a49-4f3e-9673-debb837e2738 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1308 microversion: 2.1 time: 0.210663 May 27 15:02:07.663644 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 594/1229] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:07 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1308 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:07.665350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ec71fcc2-39f4-46ad-be40-5bb577996b03 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:07.666048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ec71fcc2-39f4-46ad-be40-5bb577996b03 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:07.672606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec71fcc2-39f4-46ad-be40-5bb577996b03 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:07.673106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec71fcc2-39f4-46ad-be40-5bb577996b03 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:07.674034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec71fcc2-39f4-46ad-be40-5bb577996b03 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:07.674513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec71fcc2-39f4-46ad-be40-5bb577996b03 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:07.807842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ec71fcc2-39f4-46ad-be40-5bb577996b03 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:07.815512 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ec71fcc2-39f4-46ad-be40-5bb577996b03 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1476 microversion: 2.1 time: 0.154223 May 27 15:02:07.816061 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 636/1230] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:07 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1476 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:02:07.880685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f5332f4f-7c0b-4aa0-a13e-166df6b26028 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:07.881304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f5332f4f-7c0b-4aa0-a13e-166df6b26028 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:07.887368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f5332f4f-7c0b-4aa0-a13e-166df6b26028 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:07.887817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f5332f4f-7c0b-4aa0-a13e-166df6b26028 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:07.888583 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f5332f4f-7c0b-4aa0-a13e-166df6b26028 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:07.889050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f5332f4f-7c0b-4aa0-a13e-166df6b26028 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:08.031819 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f5332f4f-7c0b-4aa0-a13e-166df6b26028 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:08.043322 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f5332f4f-7c0b-4aa0-a13e-166df6b26028 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1316 microversion: 2.1 time: 0.166385 May 27 15:02:08.053151 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 595/1231] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:07 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:08.289880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d1182294-632e-4aa5-836d-d9f34391d551 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776b05700>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:08.340218 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d1182294-632e-4aa5-836d-d9f34391d551 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25" status: 200 len: 1461 microversion: 2.1 time: 0.056948 May 27 15:02:08.340934 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 637/1232] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:08 2022] GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25 => generated 1461 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:08.358987 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2276ae53-2236-4009-93e6-e976fe93e800 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776b96af0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:08.405336 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2276ae53-2236-4009-93e6-e976fe93e800 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25" status: 200 len: 1461 microversion: 2.1 time: 0.056824 May 27 15:02:08.406153 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 596/1233] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:08 2022] GET /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25 => generated 1461 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:08.418270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a8964c32-6eac-496d-b67a-8dce4be22b9b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:08.418923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a8964c32-6eac-496d-b67a-8dce4be22b9b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 73173e14-0308-44e3-adc9-8bbd5509246c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:08.425909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a8964c32-6eac-496d-b67a-8dce4be22b9b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:08.426674 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a8964c32-6eac-496d-b67a-8dce4be22b9b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:08.427462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a8964c32-6eac-496d-b67a-8dce4be22b9b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:08.427854 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-462e4182-c3bc-4fc5-936b-4a08110bdc84 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:08.427972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a8964c32-6eac-496d-b67a-8dce4be22b9b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:08.428902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-462e4182-c3bc-4fc5-936b-4a08110bdc84 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:08.437095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-462e4182-c3bc-4fc5-936b-4a08110bdc84 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:08.437555 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-462e4182-c3bc-4fc5-936b-4a08110bdc84 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:08.438358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-462e4182-c3bc-4fc5-936b-4a08110bdc84 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:08.438804 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-462e4182-c3bc-4fc5-936b-4a08110bdc84 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:08.474900 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-462e4182-c3bc-4fc5-936b-4a08110bdc84 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.051105 May 27 15:02:08.476706 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 597/1234] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:02:08 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 15:02:08.573380 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a8964c32-6eac-496d-b67a-8dce4be22b9b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:08.582399 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a8964c32-6eac-496d-b67a-8dce4be22b9b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c" status: 200 len: 1468 microversion: 2.1 time: 0.168736 May 27 15:02:08.582988 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 638/1235] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:08 2022] GET /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c => generated 1468 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:08.601734 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-afa7dd1a-aabf-42ca-ac0d-54a08689afbd tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2027102646"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:08.602848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-afa7dd1a-aabf-42ca-ac0d-54a08689afbd tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:08.609295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afa7dd1a-aabf-42ca-ac0d-54a08689afbd tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:08.609753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afa7dd1a-aabf-42ca-ac0d-54a08689afbd tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:08.610567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afa7dd1a-aabf-42ca-ac0d-54a08689afbd tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:08.611268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afa7dd1a-aabf-42ca-ac0d-54a08689afbd tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:08.680715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3d015909-d3ff-4116-8034-76d8eaefc140 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:08.681722 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3d015909-d3ff-4116-8034-76d8eaefc140 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:08.689070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d015909-d3ff-4116-8034-76d8eaefc140 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:08.689781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d015909-d3ff-4116-8034-76d8eaefc140 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:08.691351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d015909-d3ff-4116-8034-76d8eaefc140 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:08.691978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d015909-d3ff-4116-8034-76d8eaefc140 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:08.840987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3d015909-d3ff-4116-8034-76d8eaefc140 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:08.849918 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3d015909-d3ff-4116-8034-76d8eaefc140 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1308 microversion: 2.1 time: 0.173602 May 27 15:02:08.850574 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 639/1236] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:08 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:08.855450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b367b049-2248-4430-8fff-9d3a7eae558e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:08.856215 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b367b049-2248-4430-8fff-9d3a7eae558e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:08.863311 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b367b049-2248-4430-8fff-9d3a7eae558e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:08.864029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b367b049-2248-4430-8fff-9d3a7eae558e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:08.864943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b367b049-2248-4430-8fff-9d3a7eae558e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:08.865597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b367b049-2248-4430-8fff-9d3a7eae558e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:08.926141 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-afa7dd1a-aabf-42ca-ac0d-54a08689afbd tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "POST /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe/action" status: 202 len: 0 microversion: 2.1 time: 0.328100 May 27 15:02:08.932935 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 598/1237] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:02:08 2022] POST /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 27 15:02:08.942938 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-138ea827-9f8e-40c8-8202-ac9d5849083e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776af2430>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:08.995981 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-138ea827-9f8e-40c8-8202-ac9d5849083e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/5badf179-57b9-4165-b9a3-05e8c4b435bb" status: 200 len: 1453 microversion: 2.1 time: 0.057966 May 27 15:02:08.996756 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 599/1238] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:08 2022] GET /compute/v2.1/images/5badf179-57b9-4165-b9a3-05e8c4b435bb => generated 1453 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:09.024385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b367b049-2248-4430-8fff-9d3a7eae558e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:09.032398 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b367b049-2248-4430-8fff-9d3a7eae558e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1476 microversion: 2.1 time: 0.180702 May 27 15:02:09.033092 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 640/1239] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:08 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1476 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:09.059484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-68b71dd0-82a1-4a91-a493-58d6151bc1aa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:09.060399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-68b71dd0-82a1-4a91-a493-58d6151bc1aa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:09.066958 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68b71dd0-82a1-4a91-a493-58d6151bc1aa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:09.067638 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68b71dd0-82a1-4a91-a493-58d6151bc1aa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:09.068516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68b71dd0-82a1-4a91-a493-58d6151bc1aa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:09.069197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68b71dd0-82a1-4a91-a493-58d6151bc1aa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:09.206119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-68b71dd0-82a1-4a91-a493-58d6151bc1aa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:09.213899 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-68b71dd0-82a1-4a91-a493-58d6151bc1aa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1316 microversion: 2.1 time: 0.158429 May 27 15:02:09.214486 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 600/1240] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:09 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:09.487865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5ce6e03d-9e12-4bc9-93b1-c853546e4f99 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:09.488799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5ce6e03d-9e12-4bc9-93b1-c853546e4f99 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:09.495014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ce6e03d-9e12-4bc9-93b1-c853546e4f99 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:09.495474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ce6e03d-9e12-4bc9-93b1-c853546e4f99 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:09.496249 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ce6e03d-9e12-4bc9-93b1-c853546e4f99 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:09.496714 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ce6e03d-9e12-4bc9-93b1-c853546e4f99 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:09.526963 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5ce6e03d-9e12-4bc9-93b1-c853546e4f99 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.043879 May 27 15:02:09.527543 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 641/1241] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:02:09 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:02:09.867283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-230b4f3d-f5ba-4b28-a2f5-91bdd1566a18 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:09.867929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-230b4f3d-f5ba-4b28-a2f5-91bdd1566a18 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:09.874879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-230b4f3d-f5ba-4b28-a2f5-91bdd1566a18 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:09.875330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-230b4f3d-f5ba-4b28-a2f5-91bdd1566a18 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:09.876090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-230b4f3d-f5ba-4b28-a2f5-91bdd1566a18 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:09.876528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-230b4f3d-f5ba-4b28-a2f5-91bdd1566a18 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:10.013293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-87462211-c6e3-4b19-b873-bfe6b358cd5a tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776b05790>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:10.014589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-230b4f3d-f5ba-4b28-a2f5-91bdd1566a18 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:10.023030 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-230b4f3d-f5ba-4b28-a2f5-91bdd1566a18 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1308 microversion: 2.1 time: 0.159682 May 27 15:02:10.023756 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 601/1242] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:09 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1308 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:10.052316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-48ca39d1-4d2f-4e79-9d31-ae811141a074 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:10.053836 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-48ca39d1-4d2f-4e79-9d31-ae811141a074 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:10.063862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-48ca39d1-4d2f-4e79-9d31-ae811141a074 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:10.064306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-48ca39d1-4d2f-4e79-9d31-ae811141a074 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:10.065650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-48ca39d1-4d2f-4e79-9d31-ae811141a074 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:10.066093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-48ca39d1-4d2f-4e79-9d31-ae811141a074 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:10.086297 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-87462211-c6e3-4b19-b873-bfe6b358cd5a tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/5badf179-57b9-4165-b9a3-05e8c4b435bb" status: 200 len: 1453 microversion: 2.1 time: 0.079596 May 27 15:02:10.086878 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 642/1243] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:10 2022] GET /compute/v2.1/images/5badf179-57b9-4165-b9a3-05e8c4b435bb => generated 1453 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:10.229805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-48ca39d1-4d2f-4e79-9d31-ae811141a074 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:10.232569 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-514710b0-742f-430d-bb01-98f8a286ccde tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:10.233622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-514710b0-742f-430d-bb01-98f8a286ccde tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:10.239834 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-48ca39d1-4d2f-4e79-9d31-ae811141a074 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1476 microversion: 2.1 time: 0.193582 May 27 15:02:10.240779 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 602/1244] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:10 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1476 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:02:10.242257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-514710b0-742f-430d-bb01-98f8a286ccde tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:10.242782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-514710b0-742f-430d-bb01-98f8a286ccde tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:10.243914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-514710b0-742f-430d-bb01-98f8a286ccde tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:10.244160 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-514710b0-742f-430d-bb01-98f8a286ccde tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:10.311469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-cc6ba2b6-1c45-43f3-be2e-d7c5f2e29d95 req-8cc398b3-d1c2-45f8-9b87-1e93636c0eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72bd3cf-9b54-4d56-ab10-9f2a602a15f5", "name": "network-vif-plugged", "status": "completed", "tag": "b633ef09-5eca-4f03-95aa-8ed44cb2e4c0"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:10.330597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-cc6ba2b6-1c45-43f3-be2e-d7c5f2e29d95 req-8cc398b3-d1c2-45f8-9b87-1e93636c0eb5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:10.332748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-cc6ba2b6-1c45-43f3-be2e-d7c5f2e29d95 req-8cc398b3-d1c2-45f8-9b87-1e93636c0eb5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:10.349433 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-cc6ba2b6-1c45-43f3-be2e-d7c5f2e29d95 req-8cc398b3-d1c2-45f8-9b87-1e93636c0eb5 service nova] Creating event network-vif-plugged:b633ef09-5eca-4f03-95aa-8ed44cb2e4c0 for instance a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 on n-h2-843621-1 May 27 15:02:10.356453 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-cc6ba2b6-1c45-43f3-be2e-d7c5f2e29d95 req-8cc398b3-d1c2-45f8-9b87-1e93636c0eb5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050493 May 27 15:02:10.357966 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 603/1245] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:10.439143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-514710b0-742f-430d-bb01-98f8a286ccde tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:10.448593 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-514710b0-742f-430d-bb01-98f8a286ccde tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1316 microversion: 2.1 time: 0.220263 May 27 15:02:10.449640 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 643/1246] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:10 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1316 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:10.541664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-56a88f36-c0d0-4acd-b063-c5d7883dd5ac tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:10.543249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-56a88f36-c0d0-4acd-b063-c5d7883dd5ac tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:10.557905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56a88f36-c0d0-4acd-b063-c5d7883dd5ac tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:10.560983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56a88f36-c0d0-4acd-b063-c5d7883dd5ac tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:10.564388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56a88f36-c0d0-4acd-b063-c5d7883dd5ac tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:10.565086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56a88f36-c0d0-4acd-b063-c5d7883dd5ac tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:10.646465 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-56a88f36-c0d0-4acd-b063-c5d7883dd5ac tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.111530 May 27 15:02:10.647586 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 604/1247] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:02:10 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:02:11.040621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d699e6e4-f746-47b0-af00-7e49cce2c188 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:11.041437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d699e6e4-f746-47b0-af00-7e49cce2c188 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:11.050666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d699e6e4-f746-47b0-af00-7e49cce2c188 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:11.052000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d699e6e4-f746-47b0-af00-7e49cce2c188 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:11.053403 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d699e6e4-f746-47b0-af00-7e49cce2c188 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:11.054182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d699e6e4-f746-47b0-af00-7e49cce2c188 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:11.106926 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0b0716f8-9afc-4622-aa00-9c4e2c80293d tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776acac10>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:11.182659 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0b0716f8-9afc-4622-aa00-9c4e2c80293d tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/5badf179-57b9-4165-b9a3-05e8c4b435bb" status: 200 len: 1453 microversion: 2.1 time: 0.083919 May 27 15:02:11.184246 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 605/1248] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:11 2022] GET /compute/v2.1/images/5badf179-57b9-4165-b9a3-05e8c4b435bb => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:11.268389 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d699e6e4-f746-47b0-af00-7e49cce2c188 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:11.280235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dcfe03dc-6156-4f59-88ac-ef8ed01a94c0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:11.281011 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d699e6e4-f746-47b0-af00-7e49cce2c188 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1308 microversion: 2.1 time: 0.244952 May 27 15:02:11.282112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dcfe03dc-6156-4f59-88ac-ef8ed01a94c0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:11.284879 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 644/1249] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:11 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1308 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:02:11.297705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dcfe03dc-6156-4f59-88ac-ef8ed01a94c0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:11.298400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dcfe03dc-6156-4f59-88ac-ef8ed01a94c0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:11.299447 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dcfe03dc-6156-4f59-88ac-ef8ed01a94c0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:11.300617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dcfe03dc-6156-4f59-88ac-ef8ed01a94c0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:11.466992 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a3492bb6-700d-4a7c-a617-b5e6e0052e1f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:11.467634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a3492bb6-700d-4a7c-a617-b5e6e0052e1f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:11.481596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a3492bb6-700d-4a7c-a617-b5e6e0052e1f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:11.482443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a3492bb6-700d-4a7c-a617-b5e6e0052e1f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:11.483172 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a3492bb6-700d-4a7c-a617-b5e6e0052e1f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:11.483726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a3492bb6-700d-4a7c-a617-b5e6e0052e1f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:11.504109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dcfe03dc-6156-4f59-88ac-ef8ed01a94c0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:11.514952 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dcfe03dc-6156-4f59-88ac-ef8ed01a94c0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1476 microversion: 2.1 time: 0.261111 May 27 15:02:11.515627 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 606/1250] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:11 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1476 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:02:11.655842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a3492bb6-700d-4a7c-a617-b5e6e0052e1f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:11.658062 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d85c5572-446e-48af-8241-ecf82f1f2d10 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:11.659202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d85c5572-446e-48af-8241-ecf82f1f2d10 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:11.664380 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a3492bb6-700d-4a7c-a617-b5e6e0052e1f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1316 microversion: 2.1 time: 0.201643 May 27 15:02:11.671724 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d85c5572-446e-48af-8241-ecf82f1f2d10 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:11.672374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d85c5572-446e-48af-8241-ecf82f1f2d10 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:11.673340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d85c5572-446e-48af-8241-ecf82f1f2d10 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:11.674466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d85c5572-446e-48af-8241-ecf82f1f2d10 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:11.674890 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 645/1251] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:11 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1316 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:02:11.731622 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d85c5572-446e-48af-8241-ecf82f1f2d10 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.077507 May 27 15:02:11.733249 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 607/1252] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:02:11 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:02:12.203792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-98c280b1-3ce4-4da6-83cd-eaa46a7a15c1 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776a13550>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:12.293448 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-98c280b1-3ce4-4da6-83cd-eaa46a7a15c1 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/5badf179-57b9-4165-b9a3-05e8c4b435bb" status: 200 len: 1453 microversion: 2.1 time: 0.098169 May 27 15:02:12.296079 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 646/1253] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:12 2022] GET /compute/v2.1/images/5badf179-57b9-4165-b9a3-05e8c4b435bb => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:12.302931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-903a00ec-3331-4eab-afdd-cf9c3759d6e4 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:12.303810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-903a00ec-3331-4eab-afdd-cf9c3759d6e4 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:12.314946 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-903a00ec-3331-4eab-afdd-cf9c3759d6e4 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:12.319769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-903a00ec-3331-4eab-afdd-cf9c3759d6e4 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:12.323370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-903a00ec-3331-4eab-afdd-cf9c3759d6e4 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:12.323898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-903a00ec-3331-4eab-afdd-cf9c3759d6e4 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:12.391552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-2d27da73-c84d-4b21-935a-30772078e83d req-7e266062-73c8-452e-8bcf-b117141d63b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73173e14-0308-44e3-adc9-8bbd5509246c", "name": "network-vif-unplugged", "status": "completed", "tag": "f1f01d43-89a5-406d-9090-8469b79684bd"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:12.436611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2d27da73-c84d-4b21-935a-30772078e83d req-7e266062-73c8-452e-8bcf-b117141d63b0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:12.437120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2d27da73-c84d-4b21-935a-30772078e83d req-7e266062-73c8-452e-8bcf-b117141d63b0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:12.491177 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-2d27da73-c84d-4b21-935a-30772078e83d req-7e266062-73c8-452e-8bcf-b117141d63b0 service nova] Creating event network-vif-unplugged:f1f01d43-89a5-406d-9090-8469b79684bd for instance 73173e14-0308-44e3-adc9-8bbd5509246c on n-h2-843621-1 May 27 15:02:12.510878 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-2d27da73-c84d-4b21-935a-30772078e83d req-7e266062-73c8-452e-8bcf-b117141d63b0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123485 May 27 15:02:12.518730 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 647/1254] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:12.534870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8f190916-4dd3-4819-b7bb-c0ca04968ccc tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:12.535820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8f190916-4dd3-4819-b7bb-c0ca04968ccc tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:12.552395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f190916-4dd3-4819-b7bb-c0ca04968ccc tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:12.553193 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f190916-4dd3-4819-b7bb-c0ca04968ccc tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:12.554831 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f190916-4dd3-4819-b7bb-c0ca04968ccc tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:12.555620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f190916-4dd3-4819-b7bb-c0ca04968ccc tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:13.747137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8f190916-4dd3-4819-b7bb-c0ca04968ccc tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:13.759402 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-903a00ec-3331-4eab-afdd-cf9c3759d6e4 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:13.760467 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8f190916-4dd3-4819-b7bb-c0ca04968ccc tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1476 microversion: 2.1 time: 1.230278 May 27 15:02:13.761296 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 648/1255] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:12 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1476 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:13.773383 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-903a00ec-3331-4eab-afdd-cf9c3759d6e4 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1308 microversion: 2.1 time: 1.474228 May 27 15:02:13.774062 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 608/1256] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:12 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1308 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:13.774951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e87cf90-2065-49f0-b023-321599f7df0f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:13.775810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e87cf90-2065-49f0-b023-321599f7df0f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:13.787566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e87cf90-2065-49f0-b023-321599f7df0f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:13.791628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e87cf90-2065-49f0-b023-321599f7df0f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:13.792849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e87cf90-2065-49f0-b023-321599f7df0f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:13.794506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e87cf90-2065-49f0-b023-321599f7df0f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:13.823019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-456eae43-b6cd-4fc1-a8c3-399d1cdd4f45 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776be3670>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:14.064512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e87cf90-2065-49f0-b023-321599f7df0f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:14.077663 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e87cf90-2065-49f0-b023-321599f7df0f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1316 microversion: 2.1 time: 0.313170 May 27 15:02:14.090325 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 649/1257] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:13 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:14.090325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a16bbe9f-d639-4dfd-b494-e7c637dc093e tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7d76724-20dc-4ec6-85e8-dfad7d3508cc"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:14.090325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a16bbe9f-d639-4dfd-b494-e7c637dc093e tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:14.107237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a16bbe9f-d639-4dfd-b494-e7c637dc093e tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:14.112695 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a16bbe9f-d639-4dfd-b494-e7c637dc093e tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:14.113649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a16bbe9f-d639-4dfd-b494-e7c637dc093e tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:14.114210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a16bbe9f-d639-4dfd-b494-e7c637dc093e tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:15.661202 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a16bbe9f-d639-4dfd-b494-e7c637dc093e tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "POST /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.573192 May 27 15:02:15.677461 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 650/1258] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 15:02:14 2022] POST /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3/os-volume_attachments => generated 194 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:15.698821 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-23b5f132-2f10-4ba7-8d71-ee19dbed300e req-d295e2e1-c716-4b2f-9aef-4c4a2d5c685c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5bcd82-1317-4a81-ab42-a18a58cca922", "name": "network-vif-unplugged", "status": "completed", "tag": "b0bc61de-2df1-4e1c-927e-67f3048f9a5d"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:15.715696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-23b5f132-2f10-4ba7-8d71-ee19dbed300e req-d295e2e1-c716-4b2f-9aef-4c4a2d5c685c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:15.717031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-23b5f132-2f10-4ba7-8d71-ee19dbed300e req-d295e2e1-c716-4b2f-9aef-4c4a2d5c685c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:15.745437 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-23b5f132-2f10-4ba7-8d71-ee19dbed300e req-d295e2e1-c716-4b2f-9aef-4c4a2d5c685c service nova] Creating event network-vif-unplugged:b0bc61de-2df1-4e1c-927e-67f3048f9a5d for instance 5b5bcd82-1317-4a81-ab42-a18a58cca922 on n-h2-843621-1 May 27 15:02:15.756907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [req-23b5f132-2f10-4ba7-8d71-ee19dbed300e req-d295e2e1-c716-4b2f-9aef-4c4a2d5c685c service nova] Instance 5b5bcd82-1317-4a81-ab42-a18a58cca922 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119248) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 15:02:15.796596 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-23b5f132-2f10-4ba7-8d71-ee19dbed300e req-d295e2e1-c716-4b2f-9aef-4c4a2d5c685c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115253 May 27 15:02:15.802862 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 651/1259] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:15.821062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-03981683-4b4e-45d6-ab58-b34deea7a458 req-facabbd5-6129-4be3-95de-d881e8131bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44417337-ef8b-407b-aafd-7f00dfc5b4d8", "name": "network-vif-plugged", "status": "completed", "tag": "452a5598-4173-4a88-8db6-c8043089f346"}, {"server_uuid": "30fca3d4-3998-4aa2-b00c-ba71724fdfbe", "name": "network-vif-plugged", "status": "completed", "tag": "f270cafa-0002-4b22-940b-89a2575c17f8"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:15.852260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-03981683-4b4e-45d6-ab58-b34deea7a458 req-facabbd5-6129-4be3-95de-d881e8131bcb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:15.852860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-03981683-4b4e-45d6-ab58-b34deea7a458 req-facabbd5-6129-4be3-95de-d881e8131bcb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:15.916120 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-03981683-4b4e-45d6-ab58-b34deea7a458 req-facabbd5-6129-4be3-95de-d881e8131bcb service nova] Creating event network-vif-plugged:452a5598-4173-4a88-8db6-c8043089f346 for instance 44417337-ef8b-407b-aafd-7f00dfc5b4d8 on n-h2-843621-1 May 27 15:02:15.916654 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-03981683-4b4e-45d6-ab58-b34deea7a458 req-facabbd5-6129-4be3-95de-d881e8131bcb service nova] Creating event network-vif-plugged:f270cafa-0002-4b22-940b-89a2575c17f8 for instance 30fca3d4-3998-4aa2-b00c-ba71724fdfbe on n-h2-843621-1 May 27 15:02:15.938966 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-03981683-4b4e-45d6-ab58-b34deea7a458 req-facabbd5-6129-4be3-95de-d881e8131bcb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.129376 May 27 15:02:15.941901 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 652/1260] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:15.967201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-da78011b-6164-4adc-9f7c-a94e2c1853dd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:15.969308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-da78011b-6164-4adc-9f7c-a94e2c1853dd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:15.979272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da78011b-6164-4adc-9f7c-a94e2c1853dd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:15.982013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da78011b-6164-4adc-9f7c-a94e2c1853dd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:15.983012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da78011b-6164-4adc-9f7c-a94e2c1853dd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:15.986220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da78011b-6164-4adc-9f7c-a94e2c1853dd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:16.343473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-da78011b-6164-4adc-9f7c-a94e2c1853dd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:16.352864 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-da78011b-6164-4adc-9f7c-a94e2c1853dd tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1475 microversion: 2.1 time: 0.409639 May 27 15:02:16.353457 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 653/1261] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:15 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1475 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:16.374893 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-837e844c-3b97-4ea6-bd1b-115962ec0e1e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:16.376589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-837e844c-3b97-4ea6-bd1b-115962ec0e1e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:16.393087 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-837e844c-3b97-4ea6-bd1b-115962ec0e1e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:16.393824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-837e844c-3b97-4ea6-bd1b-115962ec0e1e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:16.394776 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-837e844c-3b97-4ea6-bd1b-115962ec0e1e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:16.395374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-837e844c-3b97-4ea6-bd1b-115962ec0e1e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:16.653681 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-837e844c-3b97-4ea6-bd1b-115962ec0e1e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:16.663128 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-837e844c-3b97-4ea6-bd1b-115962ec0e1e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1488 microversion: 2.1 time: 0.308486 May 27 15:02:16.681858 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 654/1262] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:16 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1488 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:16.692802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a90b287a-2d05-4af1-aa18-81a811d5274e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:16.693440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a90b287a-2d05-4af1-aa18-81a811d5274e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:16.707102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a90b287a-2d05-4af1-aa18-81a811d5274e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:16.707557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a90b287a-2d05-4af1-aa18-81a811d5274e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:16.708350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a90b287a-2d05-4af1-aa18-81a811d5274e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:16.708813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a90b287a-2d05-4af1-aa18-81a811d5274e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:16.775286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:17.029886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a90b287a-2d05-4af1-aa18-81a811d5274e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:17.038831 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a90b287a-2d05-4af1-aa18-81a811d5274e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1316 microversion: 2.1 time: 0.355767 May 27 15:02:17.040487 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 655/1263] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:16 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:17.049638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0eaf1385-9e12-40b1-8f40-9a4800aed45b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:17.072755 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0eaf1385-9e12-40b1-8f40-9a4800aed45b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:17.074002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0eaf1385-9e12-40b1-8f40-9a4800aed45b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:17.203250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0eaf1385-9e12-40b1-8f40-9a4800aed45b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Going to try to stop instance {{(pid=119248) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 15:02:17.283988 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0eaf1385-9e12-40b1-8f40-9a4800aed45b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "POST /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5/action" status: 202 len: 0 microversion: 2.1 time: 0.240402 May 27 15:02:17.288369 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 656/1264] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:02:17 2022] POST /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:02:17.318775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2ccb6d4f-73c0-4c07-8dec-67c603b8b73c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:17.323445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2ccb6d4f-73c0-4c07-8dec-67c603b8b73c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:17.338037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ccb6d4f-73c0-4c07-8dec-67c603b8b73c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:17.338499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ccb6d4f-73c0-4c07-8dec-67c603b8b73c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:17.339287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ccb6d4f-73c0-4c07-8dec-67c603b8b73c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:17.339735 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ccb6d4f-73c0-4c07-8dec-67c603b8b73c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:17.553258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2ccb6d4f-73c0-4c07-8dec-67c603b8b73c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:17.566981 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2ccb6d4f-73c0-4c07-8dec-67c603b8b73c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1498 microversion: 2.1 time: 0.273471 May 27 15:02:17.579354 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 657/1265] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:17 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1498 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:17.591075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e4c30898-e69a-4612-9dba-690d05e3d18f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:17.592456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e4c30898-e69a-4612-9dba-690d05e3d18f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:17.608998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4c30898-e69a-4612-9dba-690d05e3d18f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:17.610225 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4c30898-e69a-4612-9dba-690d05e3d18f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:17.611832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4c30898-e69a-4612-9dba-690d05e3d18f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:17.613334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4c30898-e69a-4612-9dba-690d05e3d18f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:17.850757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e4c30898-e69a-4612-9dba-690d05e3d18f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:17.870701 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e4c30898-e69a-4612-9dba-690d05e3d18f tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1473 microversion: 2.1 time: 0.288994 May 27 15:02:17.871486 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 658/1266] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:17 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1473 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:17.895558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-a2d35bd3-c4d6-4eff-ac28-fed6d29fb6d2 req-09c050a8-207d-4eb0-9f5c-15f535c6e1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b5bcd82-1317-4a81-ab42-a18a58cca922", "tag": "b0bc61de-2df1-4e1c-927e-67f3048f9a5d"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:17.917947 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-a2d35bd3-c4d6-4eff-ac28-fed6d29fb6d2 req-09c050a8-207d-4eb0-9f5c-15f535c6e1a0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:17.918816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-a2d35bd3-c4d6-4eff-ac28-fed6d29fb6d2 req-09c050a8-207d-4eb0-9f5c-15f535c6e1a0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:17.938591 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-a2d35bd3-c4d6-4eff-ac28-fed6d29fb6d2 req-09c050a8-207d-4eb0-9f5c-15f535c6e1a0 service nova] Creating event network-changed:b0bc61de-2df1-4e1c-927e-67f3048f9a5d for instance 5b5bcd82-1317-4a81-ab42-a18a58cca922 on n-h2-843621-1 May 27 15:02:17.948878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [req-a2d35bd3-c4d6-4eff-ac28-fed6d29fb6d2 req-09c050a8-207d-4eb0-9f5c-15f535c6e1a0 service nova] Instance 5b5bcd82-1317-4a81-ab42-a18a58cca922 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119248) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 15:02:17.976918 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-a2d35bd3-c4d6-4eff-ac28-fed6d29fb6d2 req-09c050a8-207d-4eb0-9f5c-15f535c6e1a0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093157 May 27 15:02:17.977948 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 659/1267] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:18.059585 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bffeff23-ffc4-437b-b8cb-94c99ebcf6c7 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:18.060304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bffeff23-ffc4-437b-b8cb-94c99ebcf6c7 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:18.074405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bffeff23-ffc4-437b-b8cb-94c99ebcf6c7 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:18.079142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bffeff23-ffc4-437b-b8cb-94c99ebcf6c7 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:18.081767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bffeff23-ffc4-437b-b8cb-94c99ebcf6c7 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:18.083810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bffeff23-ffc4-437b-b8cb-94c99ebcf6c7 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:18.413386 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bffeff23-ffc4-437b-b8cb-94c99ebcf6c7 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:18.433520 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bffeff23-ffc4-437b-b8cb-94c99ebcf6c7 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1316 microversion: 2.1 time: 0.378664 May 27 15:02:18.435220 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 660/1268] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:18 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:18.589415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-513a84c2-193a-480f-b1db-33d9e533ae9e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:18.590152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-513a84c2-193a-480f-b1db-33d9e533ae9e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:18.605055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-513a84c2-193a-480f-b1db-33d9e533ae9e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:18.607574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-513a84c2-193a-480f-b1db-33d9e533ae9e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:18.612570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-513a84c2-193a-480f-b1db-33d9e533ae9e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:18.612821 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-513a84c2-193a-480f-b1db-33d9e533ae9e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:19.713122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-513a84c2-193a-480f-b1db-33d9e533ae9e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:19.728666 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-513a84c2-193a-480f-b1db-33d9e533ae9e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1498 microversion: 2.1 time: 1.144217 May 27 15:02:19.743456 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 661/1269] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:18 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1498 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:02:19.758423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f88706e8-d413-4de3-ad7a-b8587591f0bb tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:19.763034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f88706e8-d413-4de3-ad7a-b8587591f0bb tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:19.777694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f88706e8-d413-4de3-ad7a-b8587591f0bb tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:19.778738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f88706e8-d413-4de3-ad7a-b8587591f0bb tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:19.779770 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f88706e8-d413-4de3-ad7a-b8587591f0bb tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:19.780394 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f88706e8-d413-4de3-ad7a-b8587591f0bb tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:20.604047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f88706e8-d413-4de3-ad7a-b8587591f0bb tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:20.615096 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f88706e8-d413-4de3-ad7a-b8587591f0bb tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1470 microversion: 2.1 time: 0.866477 May 27 15:02:20.615694 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 662/1270] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:19 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1470 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:20.638402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-54ffdf23-0d09-4bb8-b0ac-f346c33f45e4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:20.639944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-54ffdf23-0d09-4bb8-b0ac-f346c33f45e4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:20.654251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-54ffdf23-0d09-4bb8-b0ac-f346c33f45e4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:20.656564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-54ffdf23-0d09-4bb8-b0ac-f346c33f45e4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:20.658351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-54ffdf23-0d09-4bb8-b0ac-f346c33f45e4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:20.660701 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-54ffdf23-0d09-4bb8-b0ac-f346c33f45e4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:21.186393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-54ffdf23-0d09-4bb8-b0ac-f346c33f45e4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:21.199425 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-54ffdf23-0d09-4bb8-b0ac-f346c33f45e4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1466 microversion: 2.1 time: 0.581629 May 27 15:02:21.200423 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 663/1271] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:20 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1466 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:21.205134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d0119e2d-5ee1-4440-94fa-5c4faf9e99b1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:21.206166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d0119e2d-5ee1-4440-94fa-5c4faf9e99b1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:21.217734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0119e2d-5ee1-4440-94fa-5c4faf9e99b1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:21.218187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0119e2d-5ee1-4440-94fa-5c4faf9e99b1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:21.218971 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0119e2d-5ee1-4440-94fa-5c4faf9e99b1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:21.219449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0119e2d-5ee1-4440-94fa-5c4faf9e99b1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:21.448303 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d0119e2d-5ee1-4440-94fa-5c4faf9e99b1 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "POST /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922/action" status: 202 len: 0 microversion: 2.1 time: 0.244793 May 27 15:02:21.448303 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 664/1272] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:02:21 2022] POST /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:02:21.468121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-30e6a197-4702-4ee5-96e6-e6bd5411b13e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:21.473338 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-30e6a197-4702-4ee5-96e6-e6bd5411b13e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:21.489183 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30e6a197-4702-4ee5-96e6-e6bd5411b13e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:21.490533 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30e6a197-4702-4ee5-96e6-e6bd5411b13e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:21.495091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30e6a197-4702-4ee5-96e6-e6bd5411b13e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:21.495715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30e6a197-4702-4ee5-96e6-e6bd5411b13e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:21.763860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-30e6a197-4702-4ee5-96e6-e6bd5411b13e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:21.781888 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-30e6a197-4702-4ee5-96e6-e6bd5411b13e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1498 microversion: 2.1 time: 0.333399 May 27 15:02:21.791965 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 665/1273] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:21 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1498 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:21.884650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7d0ec6ed-9e1f-428d-bc6f-a0cfa1083659 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:21.885579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7d0ec6ed-9e1f-428d-bc6f-a0cfa1083659 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:21.889981 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:21.896297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d0ec6ed-9e1f-428d-bc6f-a0cfa1083659 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:21.897094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d0ec6ed-9e1f-428d-bc6f-a0cfa1083659 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:21.898286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d0ec6ed-9e1f-428d-bc6f-a0cfa1083659 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:21.898979 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d0ec6ed-9e1f-428d-bc6f-a0cfa1083659 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:22.314083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:22.557068 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7d0ec6ed-9e1f-428d-bc6f-a0cfa1083659 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1617 microversion: 2.1 time: 0.767182 May 27 15:02:22.557660 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 666/1274] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:21 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1617 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:22.592390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-543f4af0-9bcc-4b21-8679-5ac21562ace9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:22.593052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-543f4af0-9bcc-4b21-8679-5ac21562ace9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:22.610736 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-543f4af0-9bcc-4b21-8679-5ac21562ace9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:22.611290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-543f4af0-9bcc-4b21-8679-5ac21562ace9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:22.625144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-543f4af0-9bcc-4b21-8679-5ac21562ace9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:22.625714 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-543f4af0-9bcc-4b21-8679-5ac21562ace9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:22.995302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-543f4af0-9bcc-4b21-8679-5ac21562ace9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:23.007397 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-543f4af0-9bcc-4b21-8679-5ac21562ace9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1469 microversion: 2.1 time: 0.427665 May 27 15:02:23.008806 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 667/1275] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:22 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1469 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:23.030041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-38077620-af57-49d3-b488-0f5a04e8474f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Action: 'create', calling method: .version_select at 0x7fc7768bf9d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1119197806", "policies": ["affinity"]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:23.134297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-38077620-af57-49d3-b488-0f5a04e8474f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for project a081b119396543ad8ac9421acc677175. Resources: {'server_groups'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:02:23.153384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-38077620-af57-49d3-b488-0f5a04e8474f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for user f426b883acdc49f8b0c4a9ba68e4572b and project a081b119396543ad8ac9421acc677175. Resources: {'server_groups'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:02:23.247949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-38077620-af57-49d3-b488-0f5a04e8474f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for project a081b119396543ad8ac9421acc677175. Resources: {'server_groups'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:02:23.260194 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-38077620-af57-49d3-b488-0f5a04e8474f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for user f426b883acdc49f8b0c4a9ba68e4572b and project a081b119396543ad8ac9421acc677175. Resources: {'server_groups'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:02:23.295130 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-38077620-af57-49d3-b488-0f5a04e8474f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.285056 May 27 15:02:23.295734 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 668/1276] 10.222.0.13 () {60 vars in 1173 bytes} [Fri May 27 15:02:23 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:23.305085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d5d813d5-22eb-4b4c-b2a9-460e26f3cf63 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:23.306054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d5d813d5-22eb-4b4c-b2a9-460e26f3cf63 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:23.317134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5d813d5-22eb-4b4c-b2a9-460e26f3cf63 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:23.317898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5d813d5-22eb-4b4c-b2a9-460e26f3cf63 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:23.319455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5d813d5-22eb-4b4c-b2a9-460e26f3cf63 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:23.320082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5d813d5-22eb-4b4c-b2a9-460e26f3cf63 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:23.645806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d5d813d5-22eb-4b4c-b2a9-460e26f3cf63 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:23.661279 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d5d813d5-22eb-4b4c-b2a9-460e26f3cf63 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1498 microversion: 2.1 time: 0.361428 May 27 15:02:23.677204 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 669/1277] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:23 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1498 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:23.690980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1830337991", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "1ed3038c-7c93-45cf-b931-4568dc0d8fe3"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:23.768956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:33.283023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=8 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:33.657259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:33.703969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:34.055954 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-456eae43-b6cd-4fc1-a8c3-399d1cdd4f45 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/5badf179-57b9-4165-b9a3-05e8c4b435bb" status: 200 len: 1453 microversion: 2.1 time: 20.267825 May 27 15:02:34.056911 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 609/1278] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:13 2022] GET /compute/v2.1/images/5badf179-57b9-4165-b9a3-05e8c4b435bb => generated 1453 bytes in 20269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:34.059806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] validate_networks() for None {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:02:34.310333 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8f620756-48dd-4c8c-adac-d82f4191b39b tempest-VolumesAdminNegativeTest-570021324 tempest-VolumesAdminNegativeTest-570021324-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "758791e1-0dd4-449b-997c-e5cd34871b95"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:34.311428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8f620756-48dd-4c8c-adac-d82f4191b39b tempest-VolumesAdminNegativeTest-570021324 tempest-VolumesAdminNegativeTest-570021324-project-admin] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:34.333133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8f620756-48dd-4c8c-adac-d82f4191b39b tempest-VolumesAdminNegativeTest-570021324 tempest-VolumesAdminNegativeTest-570021324-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:34.333893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8f620756-48dd-4c8c-adac-d82f4191b39b tempest-VolumesAdminNegativeTest-570021324 tempest-VolumesAdminNegativeTest-570021324-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:34.335111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8f620756-48dd-4c8c-adac-d82f4191b39b tempest-VolumesAdminNegativeTest-570021324 tempest-VolumesAdminNegativeTest-570021324-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:34.335754 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8f620756-48dd-4c8c-adac-d82f4191b39b tempest-VolumesAdminNegativeTest-570021324 tempest-VolumesAdminNegativeTest-570021324-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:34.369837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:02:34.371000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:02:34.371581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:02:34.373192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:02:34.373832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:02:34.407838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:34.411311 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:34.412429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:34.413209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:34.454029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for project a081b119396543ad8ac9421acc677175. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:02:34.479715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for user f426b883acdc49f8b0c4a9ba68e4572b and project a081b119396543ad8ac9421acc677175. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:02:34.545211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Going to run 2 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:02:34.550451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 31db04fa-a046-4535-8191-c7db2b34a029] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:02:34.618405 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-8f620756-48dd-4c8c-adac-d82f4191b39b tempest-VolumesAdminNegativeTest-570021324 tempest-VolumesAdminNegativeTest-570021324-project-admin] HTTP exception thrown: Volume 758791e1-0dd4-449b-997c-e5cd34871b95 could not be found. May 27 15:02:34.622199 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119248) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8f620756-48dd-4c8c-adac-d82f4191b39b tempest-VolumesAdminNegativeTest-570021324 tempest-VolumesAdminNegativeTest-570021324-project-admin] Request method failure captured: May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: request: PUT /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments/147c0061-da02-429d-a9b0-897c842b78a7 HTTP/1.1 May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 74 May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOe60G2IoPW8UXt7e3AUzQOi3-10fDxmDMPrwz3L1fIY0ZuTx2biU-RJqr4PM9l8b9_6VHr1v7o1ludiNXee1VFCGIIE52CxDTRqi30e-UuzPo6sKt7eX0mjJ_OiT0dkNjyjLziQnG3LCGNhZIZZ7X4IX6CkKBMDvLl5PeR_dXmPmjI May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 4f77d62e64774eaa83b8bcecc31affba May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-VolumesAdminNegativeTest-570021324 May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,admin,member May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,admin,member May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4f77d62e64774eaa83b8bcecc31affba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4f77d62e64774eaa83b8bcecc31affba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4f77d62e64774eaa83b8bcecc31affba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4f77d62e64774eaa83b8bcecc31affba", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-VolumesAdminNegativeTest-570021324 May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 4f77d62e64774eaa83b8bcecc31affba May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-570021324 May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-VolumesAdminNegativeTest-570021324-project-admin May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 7e57f4e1cc244003b4c46071a19e9fd6 May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-VolumesAdminNegativeTest-570021324-project-admin May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: {"volumeAttachment": {"volumeId": "758791e1-0dd4-449b-997c-e5cd34871b95"}} May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: exception: Volume 758791e1-0dd4-449b-997c-e5cd34871b95 could not be found. May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'server_id': 'c1699aaf-d186-4cde-ac8c-318a335635b3', 'id': '147c0061-da02-429d-a9b0-897c842b78a7', 'body': {'volumeAttachment': {'volumeId': '758791e1-0dd4-449b-997c-e5cd34871b95'}}} May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 758791e1-0dd4-449b-997c-e5cd34871b95 could not be found. (HTTP 404) (Request-ID: req-e93918f2-b2f7-48a2-b6f3-c43136f3db32) May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:02:34.646289 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 758791e1-0dd4-449b-997c-e5cd34871b95 could not be found. May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 758791e1-0dd4-449b-997c-e5cd34871b95 could not be found. May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 758791e1-0dd4-449b-997c-e5cd34871b95 could not be found. May 27 15:02:34.650939 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:02:34.655631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8f620756-48dd-4c8c-adac-d82f4191b39b tempest-VolumesAdminNegativeTest-570021324 tempest-VolumesAdminNegativeTest-570021324-project-admin] Returning 400 to user: Volume 758791e1-0dd4-449b-997c-e5cd34871b95 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:02:34.657181 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8f620756-48dd-4c8c-adac-d82f4191b39b tempest-VolumesAdminNegativeTest-570021324 tempest-VolumesAdminNegativeTest-570021324-project-admin] 10.222.0.13 "PUT /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments/147c0061-da02-429d-a9b0-897c842b78a7" status: 400 len: 107 microversion: 2.1 time: 0.593234 May 27 15:02:34.657995 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 610/1279] 10.222.0.13 () {60 vars in 1432 bytes} [Fri May 27 15:02:34 2022] PUT /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments/147c0061-da02-429d-a9b0-897c842b78a7 => generated 107 bytes in 601 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:02:34.695703 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for project a081b119396543ad8ac9421acc677175. Resources: {'server_group_members'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:02:34.702411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for user f426b883acdc49f8b0c4a9ba68e4572b and project a081b119396543ad8ac9421acc677175. Resources: {'server_group_members'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:02:34.812567 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for project a081b119396543ad8ac9421acc677175. Resources: {'server_group_members'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:02:34.820020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for user f426b883acdc49f8b0c4a9ba68e4572b and project a081b119396543ad8ac9421acc677175. Resources: {'server_group_members'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:02:34.853533 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=31db04fa-a046-4535-8191-c7db2b34a029,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:02:34.950616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5c4387e1-1b74-4974-a6fa-80d469b6b646 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:34.951994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5c4387e1-1b74-4974-a6fa-80d469b6b646 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:34.964783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c4387e1-1b74-4974-a6fa-80d469b6b646 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:34.965790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c4387e1-1b74-4974-a6fa-80d469b6b646 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:34.968081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c4387e1-1b74-4974-a6fa-80d469b6b646 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:34.969927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c4387e1-1b74-4974-a6fa-80d469b6b646 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:35.016633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for project a081b119396543ad8ac9421acc677175. Resources: {'server_group_members'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:02:35.035131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for user f426b883acdc49f8b0c4a9ba68e4572b and project a081b119396543ad8ac9421acc677175. Resources: {'server_group_members'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:02:35.155548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for project a081b119396543ad8ac9421acc677175. Resources: {'server_group_members'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:02:35.172591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for user f426b883acdc49f8b0c4a9ba68e4572b and project a081b119396543ad8ac9421acc677175. Resources: {'server_group_members'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:02:35.251379 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8f598000-2b83-434a-b0b8-40a78110127c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 11.571634 May 27 15:02:35.256392 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 670/1280] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:02:23 2022] POST /compute/v2.1/servers => generated 32 bytes in 11578 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 27 15:02:35.261877 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-bd5d7c77-b15c-4d14-ad62-7007524c9cf2 req-08a9bb1a-f38e-41f2-b88f-7dd27b74702f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5bcd82-1317-4a81-ab42-a18a58cca922", "name": "network-vif-plugged", "status": "completed", "tag": "b0bc61de-2df1-4e1c-927e-67f3048f9a5d"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:35.262830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5c4387e1-1b74-4974-a6fa-80d469b6b646 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:35.275098 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5c4387e1-1b74-4974-a6fa-80d469b6b646 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1462 microversion: 2.1 time: 0.614609 May 27 15:02:35.282358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-bd5d7c77-b15c-4d14-ad62-7007524c9cf2 req-08a9bb1a-f38e-41f2-b88f-7dd27b74702f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:35.284618 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 611/1281] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:34 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1462 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:35.285624 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-bd5d7c77-b15c-4d14-ad62-7007524c9cf2 req-08a9bb1a-f38e-41f2-b88f-7dd27b74702f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:35.290952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-89ab9d85-430f-4803-ac31-9338497d32a7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:35.291860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-89ab9d85-430f-4803-ac31-9338497d32a7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:35.307462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89ab9d85-430f-4803-ac31-9338497d32a7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:35.308219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89ab9d85-430f-4803-ac31-9338497d32a7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:35.309258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89ab9d85-430f-4803-ac31-9338497d32a7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:35.310531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89ab9d85-430f-4803-ac31-9338497d32a7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:35.330770 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-bd5d7c77-b15c-4d14-ad62-7007524c9cf2 req-08a9bb1a-f38e-41f2-b88f-7dd27b74702f service nova] Creating event network-vif-plugged:b0bc61de-2df1-4e1c-927e-67f3048f9a5d for instance 5b5bcd82-1317-4a81-ab42-a18a58cca922 on n-h1-843621-1 May 27 15:02:35.337223 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-bd5d7c77-b15c-4d14-ad62-7007524c9cf2 req-08a9bb1a-f38e-41f2-b88f-7dd27b74702f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078896 May 27 15:02:35.338549 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 671/1282] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:35.501856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-cd62d063-af0c-47a4-9ec9-557cf72ffb51 req-ccc470f0-832b-4e66-8f2a-a6c99bedc34c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5bcd82-1317-4a81-ab42-a18a58cca922", "name": "network-vif-unplugged", "status": "completed", "tag": "b0bc61de-2df1-4e1c-927e-67f3048f9a5d"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:35.520636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-cd62d063-af0c-47a4-9ec9-557cf72ffb51 req-ccc470f0-832b-4e66-8f2a-a6c99bedc34c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:35.527699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-cd62d063-af0c-47a4-9ec9-557cf72ffb51 req-ccc470f0-832b-4e66-8f2a-a6c99bedc34c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:35.546400 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-cd62d063-af0c-47a4-9ec9-557cf72ffb51 req-ccc470f0-832b-4e66-8f2a-a6c99bedc34c service nova] Creating event network-vif-unplugged:b0bc61de-2df1-4e1c-927e-67f3048f9a5d for instance 5b5bcd82-1317-4a81-ab42-a18a58cca922 on n-h1-843621-1 May 27 15:02:35.570917 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-cd62d063-af0c-47a4-9ec9-557cf72ffb51 req-ccc470f0-832b-4e66-8f2a-a6c99bedc34c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.228673 May 27 15:02:35.573560 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 672/1283] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:35.586062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-86a5e914-4e9d-458a-98a1-0225656735f9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Action: 'create', calling method: .version_select at 0x7fc7769fda60>, body: {"keypair": {"name": "tempest-keypair-469040580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHm98CIdpiIoSOoeue3Mi8lfgwdzveBQNh9WPhgnkAftzy/uiBNTFerUWeetvLYC1pxCVBbWcMIc1Bd97Y+jcMTEyUWpLmWI+3TK2fHoIXezybYLStrP+XBcMvas/eDCmQ=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:35.588561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-89ab9d85-430f-4803-ac31-9338497d32a7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:35.612081 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-89ab9d85-430f-4803-ac31-9338497d32a7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1498 microversion: 2.1 time: 0.326011 May 27 15:02:35.623484 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 612/1284] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:35 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1498 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:35.623694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-86a5e914-4e9d-458a-98a1-0225656735f9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Getting quotas for project d33fc05684054fbab26a8e2a7c848451. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:02:35.630048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-86a5e914-4e9d-458a-98a1-0225656735f9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Getting quotas for user a4e5682baae1477f9d710d65918a2cad and project d33fc05684054fbab26a8e2a7c848451. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:02:35.632603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f2b46ec0-83ac-467b-a874-724f941ff59a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:35.635130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f2b46ec0-83ac-467b-a874-724f941ff59a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:35.654408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2b46ec0-83ac-467b-a874-724f941ff59a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:35.657050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2b46ec0-83ac-467b-a874-724f941ff59a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:35.658775 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2b46ec0-83ac-467b-a874-724f941ff59a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:35.663080 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2b46ec0-83ac-467b-a874-724f941ff59a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:35.667836 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-86a5e914-4e9d-458a-98a1-0225656735f9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.091891 May 27 15:02:35.670447 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 673/1285] 10.222.0.13 () {62 vars in 1199 bytes} [Fri May 27 15:02:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 95 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 15:02:35.677758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-30b9d339-75cc-4de7-ac59-439423c615fb tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776893e50>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:35.756128 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-30b9d339-75cc-4de7-ac59-439423c615fb tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/5badf179-57b9-4165-b9a3-05e8c4b435bb" status: 200 len: 1462 microversion: 2.1 time: 0.083281 May 27 15:02:35.757415 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 674/1286] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:35 2022] GET /compute/v2.1/images/5badf179-57b9-4165-b9a3-05e8c4b435bb => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:35.768366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-aee57d99-9ff5-4512-9b4a-049e5c9e4e1e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:35.774789 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-aee57d99-9ff5-4512-9b4a-049e5c9e4e1e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:35.775649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-aee57d99-9ff5-4512-9b4a-049e5c9e4e1e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Searching by: {'deleted': False, 'project_id': 'a081b119396543ad8ac9421acc677175'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:02:35.803146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aee57d99-9ff5-4512-9b4a-049e5c9e4e1e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:35.803688 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aee57d99-9ff5-4512-9b4a-049e5c9e4e1e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:35.805287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aee57d99-9ff5-4512-9b4a-049e5c9e4e1e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:35.805811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aee57d99-9ff5-4512-9b4a-049e5c9e4e1e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:35.844493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-f2b46ec0-83ac-467b-a874-724f941ff59a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lazy-loading 'services' on Instance uuid c1699aaf-d186-4cde-ac8c-318a335635b3 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:02:35.926998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-aee57d99-9ff5-4512-9b4a-049e5c9e4e1e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:02:36.048012 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f2b46ec0-83ac-467b-a874-724f941ff59a tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments/147c0061-da02-429d-a9b0-897c842b78a7" status: 202 len: 0 microversion: 2.1 time: 0.424051 May 27 15:02:36.049087 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 613/1287] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 15:02:35 2022] DELETE /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments/147c0061-da02-429d-a9b0-897c842b78a7 => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:02:36.069352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a4e7d8b6-53db-4b9c-b4cb-f5c0b072ecb2 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:36.073997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a4e7d8b6-53db-4b9c-b4cb-f5c0b072ecb2 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:36.083923 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-aee57d99-9ff5-4512-9b4a-049e5c9e4e1e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.321767 May 27 15:02:36.085312 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 675/1288] 10.222.0.13 () {58 vars in 1124 bytes} [Fri May 27 15:02:35 2022] GET /compute/v2.1/servers => generated 1003 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:36.088649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4e7d8b6-53db-4b9c-b4cb-f5c0b072ecb2 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:36.089529 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4e7d8b6-53db-4b9c-b4cb-f5c0b072ecb2 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:36.090633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4e7d8b6-53db-4b9c-b4cb-f5c0b072ecb2 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:36.091719 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2e443de5-5adf-42d2-94cc-6a9a66b737a2 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776893790>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:36.092218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4e7d8b6-53db-4b9c-b4cb-f5c0b072ecb2 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:36.174773 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2e443de5-5adf-42d2-94cc-6a9a66b737a2 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/5badf179-57b9-4165-b9a3-05e8c4b435bb" status: 200 len: 1462 microversion: 2.1 time: 0.086548 May 27 15:02:36.177157 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 676/1289] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:36 2022] GET /compute/v2.1/images/5badf179-57b9-4165-b9a3-05e8c4b435bb => generated 1462 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:36.193683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2f654adf-4f93-4a5f-868c-b5626d896e9d tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:36.197137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2f654adf-4f93-4a5f-868c-b5626d896e9d tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:36.211360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2f654adf-4f93-4a5f-868c-b5626d896e9d tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:36.212393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2f654adf-4f93-4a5f-868c-b5626d896e9d tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:36.214114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2f654adf-4f93-4a5f-868c-b5626d896e9d tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:36.214600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2f654adf-4f93-4a5f-868c-b5626d896e9d tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:36.266992 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2f654adf-4f93-4a5f-868c-b5626d896e9d tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087474 May 27 15:02:36.269251 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 677/1290] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:02:36 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:36.274650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-47d57057-291d-496d-9750-496411e0bbab tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:36.275808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-47d57057-291d-496d-9750-496411e0bbab tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:36.304303 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a4e7d8b6-53db-4b9c-b4cb-f5c0b072ecb2 tempest-MigrationsAdminTest-385248573 tempest-MigrationsAdminTest-385248573-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1613 microversion: 2.1 time: 0.247994 May 27 15:02:36.305794 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 614/1291] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:36 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1613 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:36.331868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7143f7a1-1a29-4e4d-adab-1e5a45e689b4 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:36.332931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7143f7a1-1a29-4e4d-adab-1e5a45e689b4 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:36.341388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7143f7a1-1a29-4e4d-adab-1e5a45e689b4 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:36.342191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7143f7a1-1a29-4e4d-adab-1e5a45e689b4 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:36.343215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7143f7a1-1a29-4e4d-adab-1e5a45e689b4 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:36.343818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7143f7a1-1a29-4e4d-adab-1e5a45e689b4 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:36.360044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-47d57057-291d-496d-9750-496411e0bbab tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:36.371274 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-47d57057-291d-496d-9750-496411e0bbab tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0" status: 200 len: 1219 microversion: 2.1 time: 0.100264 May 27 15:02:36.372645 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 678/1292] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:36 2022] GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:36.378533 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-45d3ac6a-5cea-456c-b0be-fdb867ee57d4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:36.379142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-45d3ac6a-5cea-456c-b0be-fdb867ee57d4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:36.387754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45d3ac6a-5cea-456c-b0be-fdb867ee57d4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:36.388413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45d3ac6a-5cea-456c-b0be-fdb867ee57d4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:36.389373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45d3ac6a-5cea-456c-b0be-fdb867ee57d4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:36.397468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45d3ac6a-5cea-456c-b0be-fdb867ee57d4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:36.438434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-45d3ac6a-5cea-456c-b0be-fdb867ee57d4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:02:36.555878 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7143f7a1-1a29-4e4d-adab-1e5a45e689b4 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:36.568917 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7143f7a1-1a29-4e4d-adab-1e5a45e689b4 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 1467 microversion: 2.1 time: 0.251922 May 27 15:02:36.569808 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 615/1293] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:36 2022] GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 1467 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:36.587981 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:36.592332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-801b222f-a0c4-4411-acca-531f34d5a930 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-530342201"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:36.596448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-801b222f-a0c4-4411-acca-531f34d5a930 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 73173e14-0308-44e3-adc9-8bbd5509246c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:36.610238 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-45d3ac6a-5cea-456c-b0be-fdb867ee57d4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 204 len: 0 microversion: 2.1 time: 0.236183 May 27 15:02:36.612133 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 679/1294] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:02:36 2022] DELETE /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:02:36.620266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-801b222f-a0c4-4411-acca-531f34d5a930 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:36.621874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-801b222f-a0c4-4411-acca-531f34d5a930 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:36.624117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-801b222f-a0c4-4411-acca-531f34d5a930 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:36.625225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-801b222f-a0c4-4411-acca-531f34d5a930 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:36.629053 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4a1b0161-80b2-4a98-bc47-35fe4fc51a86 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:36.632400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4a1b0161-80b2-4a98-bc47-35fe4fc51a86 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:36.646636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a1b0161-80b2-4a98-bc47-35fe4fc51a86 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:36.647359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a1b0161-80b2-4a98-bc47-35fe4fc51a86 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:36.648966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a1b0161-80b2-4a98-bc47-35fe4fc51a86 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:36.649643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a1b0161-80b2-4a98-bc47-35fe4fc51a86 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:36.965522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4a1b0161-80b2-4a98-bc47-35fe4fc51a86 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:36.991180 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4a1b0161-80b2-4a98-bc47-35fe4fc51a86 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1468 microversion: 2.1 time: 0.371719 May 27 15:02:36.995901 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 680/1295] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:36 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1468 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:37.013502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b888e91c-1636-4edb-9fe8-fd5712f5b80c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:37.016254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b888e91c-1636-4edb-9fe8-fd5712f5b80c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:37.036221 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b888e91c-1636-4edb-9fe8-fd5712f5b80c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:37.038107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b888e91c-1636-4edb-9fe8-fd5712f5b80c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:37.039083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b888e91c-1636-4edb-9fe8-fd5712f5b80c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:37.040246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b888e91c-1636-4edb-9fe8-fd5712f5b80c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:37.168585 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-801b222f-a0c4-4411-acca-531f34d5a930 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "POST /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c/action" status: 202 len: 0 microversion: 2.1 time: 0.585495 May 27 15:02:37.182628 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 616/1296] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:02:36 2022] POST /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 27 15:02:37.206314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2fcc3c9c-1bcc-431c-9648-19e81732c067 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776af2280>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:37.234595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b888e91c-1636-4edb-9fe8-fd5712f5b80c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:37.245593 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b888e91c-1636-4edb-9fe8-fd5712f5b80c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1498 microversion: 2.1 time: 0.245406 May 27 15:02:37.253678 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 681/1297] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:36 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1498 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:37.270021 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2fcc3c9c-1bcc-431c-9648-19e81732c067 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff" status: 200 len: 1452 microversion: 2.1 time: 0.077689 May 27 15:02:37.271532 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 617/1298] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:37 2022] GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff => generated 1452 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:37.282128 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5498a196-9df8-4151-b0cb-0c4cb413c6ce tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:37.283977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5498a196-9df8-4151-b0cb-0c4cb413c6ce tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:37.290549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5498a196-9df8-4151-b0cb-0c4cb413c6ce tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:37.291014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5498a196-9df8-4151-b0cb-0c4cb413c6ce tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:37.291798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5498a196-9df8-4151-b0cb-0c4cb413c6ce tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:37.292241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5498a196-9df8-4151-b0cb-0c4cb413c6ce tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:37.327320 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5498a196-9df8-4151-b0cb-0c4cb413c6ce tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049579 May 27 15:02:37.328242 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 682/1299] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:02:37 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:37.370581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-9e931c7f-e5b0-41e1-80cd-81ea2d920647 req-2edf7253-2ea7-4ba0-8a18-dd67be299956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5bcd82-1317-4a81-ab42-a18a58cca922", "name": "network-vif-plugged", "status": "completed", "tag": "b0bc61de-2df1-4e1c-927e-67f3048f9a5d"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:37.382542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-9e931c7f-e5b0-41e1-80cd-81ea2d920647 req-2edf7253-2ea7-4ba0-8a18-dd67be299956 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:37.383755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-9e931c7f-e5b0-41e1-80cd-81ea2d920647 req-2edf7253-2ea7-4ba0-8a18-dd67be299956 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:37.390199 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-30712d9e-7104-4c77-9fcb-3c2b304fabcc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:37.391184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-30712d9e-7104-4c77-9fcb-3c2b304fabcc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:37.399935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30712d9e-7104-4c77-9fcb-3c2b304fabcc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:37.400961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30712d9e-7104-4c77-9fcb-3c2b304fabcc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:37.401771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30712d9e-7104-4c77-9fcb-3c2b304fabcc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:37.402464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30712d9e-7104-4c77-9fcb-3c2b304fabcc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:37.405337 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-9e931c7f-e5b0-41e1-80cd-81ea2d920647 req-2edf7253-2ea7-4ba0-8a18-dd67be299956 service nova] Creating event network-vif-plugged:b0bc61de-2df1-4e1c-927e-67f3048f9a5d for instance 5b5bcd82-1317-4a81-ab42-a18a58cca922 on n-h1-843621-1 May 27 15:02:37.411353 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-9e931c7f-e5b0-41e1-80cd-81ea2d920647 req-2edf7253-2ea7-4ba0-8a18-dd67be299956 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048833 May 27 15:02:37.412223 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 618/1300] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:37.486794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-30712d9e-7104-4c77-9fcb-3c2b304fabcc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:37.497627 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-30712d9e-7104-4c77-9fcb-3c2b304fabcc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0" status: 200 len: 1223 microversion: 2.1 time: 0.112132 May 27 15:02:37.498481 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 683/1301] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:37 2022] GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 => generated 1223 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:02:37.586837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-429c90b0-68af-42ba-b60d-09a51550fa66 req-f411bed3-5e6c-4436-92a4-d62e414ae3eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b5bcd82-1317-4a81-ab42-a18a58cca922", "tag": "b0bc61de-2df1-4e1c-927e-67f3048f9a5d"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:37.595397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-429c90b0-68af-42ba-b60d-09a51550fa66 req-f411bed3-5e6c-4436-92a4-d62e414ae3eb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:37.596088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-429c90b0-68af-42ba-b60d-09a51550fa66 req-f411bed3-5e6c-4436-92a4-d62e414ae3eb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:37.607999 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-429c90b0-68af-42ba-b60d-09a51550fa66 req-f411bed3-5e6c-4436-92a4-d62e414ae3eb service nova] Creating event network-changed:b0bc61de-2df1-4e1c-927e-67f3048f9a5d for instance 5b5bcd82-1317-4a81-ab42-a18a58cca922 on n-h1-843621-1 May 27 15:02:37.613271 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-429c90b0-68af-42ba-b60d-09a51550fa66 req-f411bed3-5e6c-4436-92a4-d62e414ae3eb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031210 May 27 15:02:37.613877 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 619/1302] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:37.872613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-15fe9423-6006-4ec7-9375-41f798e61952 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-918396511", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ea59746d-d29f-4b95-9223-b583ea043fbf"}, {"port": "71fcf64b-5a54-42bd-a04e-812ea701d6ba", "tag": "port-1"}, {"port": "45313e38-2a42-4c68-84d0-f6a729364e79", "tag": "port-2"}, {"uuid": "69934cb0-5c4b-4dd4-8617-8f85c4a32409", "tag": "net-1"}, {"uuid": "69934cb0-5c4b-4dd4-8617-8f85c4a32409"}, {"uuid": "18727193-8e72-4f66-9b6e-13c45732481b", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "18727193-8e72-4f66-9b6e-13c45732481b", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "f4fbebe1-d6fc-4b60-a6e5-2660d4ab7667", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "034f136d-626b-4938-8a13-733ad49ef11a", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "3dff3891-6419-44a4-b2de-e30e3dfa91ec", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--280690418"}], "key_name": "tempest-keypair-469040580", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:38.013918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-09dac8bd-3546-4ebe-93f6-113d4b134721 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:38.014938 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-09dac8bd-3546-4ebe-93f6-113d4b134721 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:38.030700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09dac8bd-3546-4ebe-93f6-113d4b134721 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:38.033352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09dac8bd-3546-4ebe-93f6-113d4b134721 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:38.034444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09dac8bd-3546-4ebe-93f6-113d4b134721 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:38.036156 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09dac8bd-3546-4ebe-93f6-113d4b134721 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:38.065904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-15fe9423-6006-4ec7-9375-41f798e61952 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] validate_networks() for [('ea59746d-d29f-4b95-9223-b583ea043fbf', None, None, None, None, None), (None, None, '71fcf64b-5a54-42bd-a04e-812ea701d6ba', None, None, None), (None, None, '45313e38-2a42-4c68-84d0-f6a729364e79', None, None, None), ('69934cb0-5c4b-4dd4-8617-8f85c4a32409', None, None, None, None, None), ('69934cb0-5c4b-4dd4-8617-8f85c4a32409', None, None, None, None, None), ('18727193-8e72-4f66-9b6e-13c45732481b', '10.2.2.100', None, None, None, None), ('18727193-8e72-4f66-9b6e-13c45732481b', '10.2.2.200', None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:02:38.425450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-09dac8bd-3546-4ebe-93f6-113d4b134721 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:38.433416 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-09dac8bd-3546-4ebe-93f6-113d4b134721 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1468 microversion: 2.1 time: 0.425470 May 27 15:02:38.443802 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 620/1303] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:38 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1468 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:38.449328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-36057166-44af-4b0b-9a89-e8550112ebee tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:38.450124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-36057166-44af-4b0b-9a89-e8550112ebee tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:38.457246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36057166-44af-4b0b-9a89-e8550112ebee tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:38.457911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36057166-44af-4b0b-9a89-e8550112ebee tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:38.458922 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36057166-44af-4b0b-9a89-e8550112ebee tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:38.459585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36057166-44af-4b0b-9a89-e8550112ebee tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:39.038670 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-36057166-44af-4b0b-9a89-e8550112ebee tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:39.052957 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-36057166-44af-4b0b-9a89-e8550112ebee tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1498 microversion: 2.1 time: 0.605705 May 27 15:02:39.056892 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 621/1304] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:38 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1498 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:39.070856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8e161bc5-6615-4f33-8bb3-bd2793871b7a tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776aca0d0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:39.156876 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8e161bc5-6615-4f33-8bb3-bd2793871b7a tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff" status: 200 len: 1452 microversion: 2.1 time: 0.097954 May 27 15:02:39.159091 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 622/1305] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:39 2022] GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:39.166948 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1d54bfbf-9e1f-46de-9601-a99646bc39da tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:39.169726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1d54bfbf-9e1f-46de-9601-a99646bc39da tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:39.187285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d54bfbf-9e1f-46de-9601-a99646bc39da tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:39.187746 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d54bfbf-9e1f-46de-9601-a99646bc39da tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:39.188604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d54bfbf-9e1f-46de-9601-a99646bc39da tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:39.192264 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d54bfbf-9e1f-46de-9601-a99646bc39da tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:39.256311 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1d54bfbf-9e1f-46de-9601-a99646bc39da tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095713 May 27 15:02:39.260524 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 623/1306] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:02:39 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:39.266798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9731a2c0-f16b-41ae-97dd-a2c8eb62b38c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:39.268537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9731a2c0-f16b-41ae-97dd-a2c8eb62b38c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:39.276262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9731a2c0-f16b-41ae-97dd-a2c8eb62b38c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:39.277553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9731a2c0-f16b-41ae-97dd-a2c8eb62b38c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:39.279772 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9731a2c0-f16b-41ae-97dd-a2c8eb62b38c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:39.281905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9731a2c0-f16b-41ae-97dd-a2c8eb62b38c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:39.512505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9731a2c0-f16b-41ae-97dd-a2c8eb62b38c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:39.525208 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9731a2c0-f16b-41ae-97dd-a2c8eb62b38c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0" status: 200 len: 1279 microversion: 2.1 time: 0.262266 May 27 15:02:39.539346 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 624/1307] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:39 2022] GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 => generated 1279 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:39.547209 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-e682cc95-bceb-4d30-ab08-71c6d3085363 req-b53445b9-7626-4988-a02c-b0eddf74e073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30fca3d4-3998-4aa2-b00c-ba71724fdfbe", "name": "network-vif-unplugged", "status": "completed", "tag": "f270cafa-0002-4b22-940b-89a2575c17f8"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:39.571469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-e682cc95-bceb-4d30-ab08-71c6d3085363 req-b53445b9-7626-4988-a02c-b0eddf74e073 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:39.571970 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-e682cc95-bceb-4d30-ab08-71c6d3085363 req-b53445b9-7626-4988-a02c-b0eddf74e073 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:39.602336 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-e682cc95-bceb-4d30-ab08-71c6d3085363 req-b53445b9-7626-4988-a02c-b0eddf74e073 service nova] Creating event network-vif-unplugged:f270cafa-0002-4b22-940b-89a2575c17f8 for instance 30fca3d4-3998-4aa2-b00c-ba71724fdfbe on n-h2-843621-1 May 27 15:02:39.614499 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-e682cc95-bceb-4d30-ab08-71c6d3085363 req-b53445b9-7626-4988-a02c-b0eddf74e073 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072840 May 27 15:02:39.615160 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 625/1308] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:39.633359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-62061b85-3235-4017-bd25-aaeaaf533f88 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:39.635685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-62061b85-3235-4017-bd25-aaeaaf533f88 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:39.650828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-62061b85-3235-4017-bd25-aaeaaf533f88 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:39.651294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-62061b85-3235-4017-bd25-aaeaaf533f88 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:39.652100 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-62061b85-3235-4017-bd25-aaeaaf533f88 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:39.652550 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-62061b85-3235-4017-bd25-aaeaaf533f88 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:39.863957 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-62061b85-3235-4017-bd25-aaeaaf533f88 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:39.882412 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-62061b85-3235-4017-bd25-aaeaaf533f88 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1426 microversion: 2.1 time: 0.259790 May 27 15:02:39.894223 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 626/1309] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:39 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1426 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:40.073673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6f042da7-d3d2-40bb-b144-696ab14e061e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:40.075408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6f042da7-d3d2-40bb-b144-696ab14e061e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:40.088075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f042da7-d3d2-40bb-b144-696ab14e061e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:40.096886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f042da7-d3d2-40bb-b144-696ab14e061e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:40.097953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f042da7-d3d2-40bb-b144-696ab14e061e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:40.098527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f042da7-d3d2-40bb-b144-696ab14e061e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:40.611776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6f042da7-d3d2-40bb-b144-696ab14e061e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:40.622865 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6f042da7-d3d2-40bb-b144-696ab14e061e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1498 microversion: 2.1 time: 0.553277 May 27 15:02:40.649129 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 627/1310] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:40 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1498 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:40.655241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-18840610-80be-4c13-877c-6e7bdd643a95 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776b96040>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:40.715898 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-18840610-80be-4c13-877c-6e7bdd643a95 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff" status: 200 len: 1452 microversion: 2.1 time: 0.065060 May 27 15:02:40.717611 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 628/1311] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:40 2022] GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff => generated 1452 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:40.734199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-05530fea-a57a-4d11-8d25-5a5b2e7d6c02 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:40.739936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-05530fea-a57a-4d11-8d25-5a5b2e7d6c02 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:40.753372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05530fea-a57a-4d11-8d25-5a5b2e7d6c02 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:40.754343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05530fea-a57a-4d11-8d25-5a5b2e7d6c02 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:40.760049 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05530fea-a57a-4d11-8d25-5a5b2e7d6c02 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:40.761240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05530fea-a57a-4d11-8d25-5a5b2e7d6c02 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:40.809311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:40.812323 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-05530fea-a57a-4d11-8d25-5a5b2e7d6c02 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093540 May 27 15:02:40.813722 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 629/1312] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:02:40 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:40.820352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bf10c70a-68f1-4144-9d48-76e7a5d3c659 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:40.821327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bf10c70a-68f1-4144-9d48-76e7a5d3c659 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:40.832644 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf10c70a-68f1-4144-9d48-76e7a5d3c659 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:40.834630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf10c70a-68f1-4144-9d48-76e7a5d3c659 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:40.836507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf10c70a-68f1-4144-9d48-76e7a5d3c659 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:40.837347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf10c70a-68f1-4144-9d48-76e7a5d3c659 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:41.061454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bf10c70a-68f1-4144-9d48-76e7a5d3c659 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:41.116318 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bf10c70a-68f1-4144-9d48-76e7a5d3c659 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0" status: 200 len: 1277 microversion: 2.1 time: 0.294094 May 27 15:02:41.131270 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 630/1313] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:40 2022] GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 => generated 1277 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:41.142740 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-f498c369-e739-459d-b0db-cd0c69363eba req-44da1ab5-8806-4e1c-ab6a-dca76cf6f923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5bcd82-1317-4a81-ab42-a18a58cca922", "name": "network-vif-deleted", "tag": "b0bc61de-2df1-4e1c-927e-67f3048f9a5d"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:41.153181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f498c369-e739-459d-b0db-cd0c69363eba req-44da1ab5-8806-4e1c-ab6a-dca76cf6f923 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:41.154765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f498c369-e739-459d-b0db-cd0c69363eba req-44da1ab5-8806-4e1c-ab6a-dca76cf6f923 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:41.174546 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-f498c369-e739-459d-b0db-cd0c69363eba req-44da1ab5-8806-4e1c-ab6a-dca76cf6f923 service nova] Creating event network-vif-deleted:b0bc61de-2df1-4e1c-927e-67f3048f9a5d for instance 5b5bcd82-1317-4a81-ab42-a18a58cca922 on n-h1-843621-1 May 27 15:02:41.182675 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-f498c369-e739-459d-b0db-cd0c69363eba req-44da1ab5-8806-4e1c-ab6a-dca76cf6f923 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048842 May 27 15:02:41.183870 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 631/1314] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:41.198171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a7ffa31d-88f2-4cf3-b06b-63ce7f79cfb2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:41.202033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a7ffa31d-88f2-4cf3-b06b-63ce7f79cfb2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:41.217761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a7ffa31d-88f2-4cf3-b06b-63ce7f79cfb2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:41.218517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a7ffa31d-88f2-4cf3-b06b-63ce7f79cfb2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:41.220796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a7ffa31d-88f2-4cf3-b06b-63ce7f79cfb2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:41.221977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a7ffa31d-88f2-4cf3-b06b-63ce7f79cfb2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:41.289139 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a7ffa31d-88f2-4cf3-b06b-63ce7f79cfb2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:41.290045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a7ffa31d-88f2-4cf3-b06b-63ce7f79cfb2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:41.290805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-a7ffa31d-88f2-4cf3-b06b-63ce7f79cfb2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lazy-loading 'fault' on Instance uuid 5b5bcd82-1317-4a81-ab42-a18a58cca922 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:02:41.402872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a7ffa31d-88f2-4cf3-b06b-63ce7f79cfb2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:41.411882 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a7ffa31d-88f2-4cf3-b06b-63ce7f79cfb2 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 200 len: 1303 microversion: 2.1 time: 0.226397 May 27 15:02:41.417405 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 632/1315] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:41 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 1303 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:41.649265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7c40cdc9-575e-48fe-b18c-db44968eb86d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:41.650002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7c40cdc9-575e-48fe-b18c-db44968eb86d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:41.664267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7c40cdc9-575e-48fe-b18c-db44968eb86d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:41.664752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7c40cdc9-575e-48fe-b18c-db44968eb86d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:41.665550 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7c40cdc9-575e-48fe-b18c-db44968eb86d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:41.666008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7c40cdc9-575e-48fe-b18c-db44968eb86d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:42.924046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7c40cdc9-575e-48fe-b18c-db44968eb86d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:42.944069 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7c40cdc9-575e-48fe-b18c-db44968eb86d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1498 microversion: 2.1 time: 1.298143 May 27 15:02:42.948171 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 633/1316] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:41 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1498 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:02:42.970597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a9963edc-087f-42d4-a964-6de926d8a2c9 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776af2670>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:43.078917 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a9963edc-087f-42d4-a964-6de926d8a2c9 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff" status: 200 len: 1452 microversion: 2.1 time: 0.125627 May 27 15:02:43.080545 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 634/1317] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:42 2022] GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff => generated 1452 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:43.091991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-312be463-a56a-4ecb-8917-f6f1f4c85326 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:43.094096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-312be463-a56a-4ecb-8917-f6f1f4c85326 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:43.114945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-312be463-a56a-4ecb-8917-f6f1f4c85326 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:43.115863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-312be463-a56a-4ecb-8917-f6f1f4c85326 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:43.116996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-312be463-a56a-4ecb-8917-f6f1f4c85326 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:43.119831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-312be463-a56a-4ecb-8917-f6f1f4c85326 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:43.200893 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-312be463-a56a-4ecb-8917-f6f1f4c85326 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114901 May 27 15:02:43.202426 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 635/1318] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:02:43 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:43.219140 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1cbc65b0-a762-498c-9d6f-dc7f2c9b26bc tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:43.223502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1cbc65b0-a762-498c-9d6f-dc7f2c9b26bc tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:43.246624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1cbc65b0-a762-498c-9d6f-dc7f2c9b26bc tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:43.252121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1cbc65b0-a762-498c-9d6f-dc7f2c9b26bc tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:43.255546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1cbc65b0-a762-498c-9d6f-dc7f2c9b26bc tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:43.263058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1cbc65b0-a762-498c-9d6f-dc7f2c9b26bc tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:43.386629 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1cbc65b0-a762-498c-9d6f-dc7f2c9b26bc tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182080 May 27 15:02:43.387230 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 636/1319] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:02:43 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:43.401243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-430361ea-6d6b-4c6a-838c-74ad09c59226 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:43.401983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-430361ea-6d6b-4c6a-838c-74ad09c59226 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:43.410383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-430361ea-6d6b-4c6a-838c-74ad09c59226 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:43.411229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-430361ea-6d6b-4c6a-838c-74ad09c59226 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:43.411655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-430361ea-6d6b-4c6a-838c-74ad09c59226 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:43.412102 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-430361ea-6d6b-4c6a-838c-74ad09c59226 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:44.187037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-15fe9423-6006-4ec7-9375-41f798e61952 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:02:44.188177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-15fe9423-6006-4ec7-9375-41f798e61952 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:02:44.189790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-15fe9423-6006-4ec7-9375-41f798e61952 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:02:44.190552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-15fe9423-6006-4ec7-9375-41f798e61952 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:02:44.191216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-15fe9423-6006-4ec7-9375-41f798e61952 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:02:44.211404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-15fe9423-6006-4ec7-9375-41f798e61952 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:44.213917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-15fe9423-6006-4ec7-9375-41f798e61952 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:44.216768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-15fe9423-6006-4ec7-9375-41f798e61952 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:44.219269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-15fe9423-6006-4ec7-9375-41f798e61952 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:44.250922 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-430361ea-6d6b-4c6a-838c-74ad09c59226 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:44.269246 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-430361ea-6d6b-4c6a-838c-74ad09c59226 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0" status: 200 len: 1319 microversion: 2.1 time: 0.874581 May 27 15:02:44.285108 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 637/1320] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:43 2022] GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 => generated 1319 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:44.288085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-15fe9423-6006-4ec7-9375-41f798e61952 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Getting quotas for project d33fc05684054fbab26a8e2a7c848451. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:02:44.292761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b697ead0-f31d-4dda-b4e2-a4eba45ad3d8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:44.293858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b697ead0-f31d-4dda-b4e2-a4eba45ad3d8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 5b5bcd82-1317-4a81-ab42-a18a58cca922] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:44.309766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-15fe9423-6006-4ec7-9375-41f798e61952 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Getting quotas for user a4e5682baae1477f9d710d65918a2cad and project d33fc05684054fbab26a8e2a7c848451. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:02:44.313182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b697ead0-f31d-4dda-b4e2-a4eba45ad3d8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:44.313584 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b697ead0-f31d-4dda-b4e2-a4eba45ad3d8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:44.314416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b697ead0-f31d-4dda-b4e2-a4eba45ad3d8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:44.314865 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b697ead0-f31d-4dda-b4e2-a4eba45ad3d8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:44.344573 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-b697ead0-f31d-4dda-b4e2-a4eba45ad3d8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] HTTP exception thrown: Instance 5b5bcd82-1317-4a81-ab42-a18a58cca922 could not be found. May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b697ead0-f31d-4dda-b4e2-a4eba45ad3d8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Request method failure captured: May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 HTTP/1.1 May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikObYSjb6MvGIY6lnXWeRgbRH8-3u-XeAD_M8gYclQB86P0-vJ0O-mlRXOOdgi9Ciokk3zvlbORmJSvIjMH0aKkVptvuW2jGpVP3aAHzMMuyeEkxvb2vuUmANHcgU-82521qHqIJuUMKjFEpA46unHpTCNcDkvT0KB5fohpXq-D8gFBk May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 7369228028774765965f3cf001f8806a May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-MigrationsAdminTest-2005600101 May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7369228028774765965f3cf001f8806a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7369228028774765965f3cf001f8806a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7369228028774765965f3cf001f8806a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7369228028774765965f3cf001f8806a", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-MigrationsAdminTest-2005600101 May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 7369228028774765965f3cf001f8806a May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-MigrationsAdminTest-2005600101 May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-MigrationsAdminTest-2005600101-project May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: a5a825c2385e490d81ddcbc2de76980d May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-MigrationsAdminTest-2005600101-project May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 5b5bcd82-1317-4a81-ab42-a18a58cca922 could not be found. May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '5b5bcd82-1317-4a81-ab42-a18a58cca922'} May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b5bcd82-1317-4a81-ab42-a18a58cca922 could not be found. May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b5bcd82-1317-4a81-ab42-a18a58cca922 could not be found. May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:02:44.347085 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:02:44.354557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:02:44.354557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:02:44.354557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:02:44.354557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:02:44.354557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:02:44.354557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b5bcd82-1317-4a81-ab42-a18a58cca922 could not be found. May 27 15:02:44.354557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:02:44.354557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b697ead0-f31d-4dda-b4e2-a4eba45ad3d8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Returning 404 to user: Instance 5b5bcd82-1317-4a81-ab42-a18a58cca922 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:02:44.354557 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b697ead0-f31d-4dda-b4e2-a4eba45ad3d8 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922" status: 404 len: 111 microversion: 2.1 time: 0.062293 May 27 15:02:44.361448 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 638/1321] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:44 2022] GET /compute/v2.1/servers/5b5bcd82-1317-4a81-ab42-a18a58cca922 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:02:44.369244 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7dab4c9c-f7c0-49b5-b275-200bfe3c124e tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:44.369670 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7dab4c9c-f7c0-49b5-b275-200bfe3c124e tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:44.391317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7dab4c9c-f7c0-49b5-b275-200bfe3c124e tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:44.392197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7dab4c9c-f7c0-49b5-b275-200bfe3c124e tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:44.393605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7dab4c9c-f7c0-49b5-b275-200bfe3c124e tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:44.394857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7dab4c9c-f7c0-49b5-b275-200bfe3c124e tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:44.644358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-7dab4c9c-f7c0-49b5-b275-200bfe3c124e tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lazy-loading 'services' on Instance uuid 1ae8a942-8725-474d-a782-1faf50e606b3 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:02:45.030801 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7dab4c9c-f7c0-49b5-b275-200bfe3c124e tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3/os-volume_attachments/e7d76724-20dc-4ec6-85e8-dfad7d3508cc" status: 202 len: 0 microversion: 2.1 time: 0.668424 May 27 15:02:45.035095 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 639/1322] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 15:02:44 2022] DELETE /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3/os-volume_attachments/e7d76724-20dc-4ec6-85e8-dfad7d3508cc => generated 0 bytes in 676 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:02:45.047543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-3a38c2c2-6bce-4098-b2f0-8c8b5b6a8e31 req-55d85818-bd48-403d-9359-d0802749d87b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73173e14-0308-44e3-adc9-8bbd5509246c", "name": "network-vif-plugged", "status": "completed", "tag": "f1f01d43-89a5-406d-9090-8469b79684bd"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:45.068487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3a38c2c2-6bce-4098-b2f0-8c8b5b6a8e31 req-55d85818-bd48-403d-9359-d0802749d87b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:45.078591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3a38c2c2-6bce-4098-b2f0-8c8b5b6a8e31 req-55d85818-bd48-403d-9359-d0802749d87b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:45.114157 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-3a38c2c2-6bce-4098-b2f0-8c8b5b6a8e31 req-55d85818-bd48-403d-9359-d0802749d87b service nova] Creating event network-vif-plugged:f1f01d43-89a5-406d-9090-8469b79684bd for instance 73173e14-0308-44e3-adc9-8bbd5509246c on n-h2-843621-1 May 27 15:02:45.126927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-15fe9423-6006-4ec7-9375-41f798e61952 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:02:45.129973 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-3a38c2c2-6bce-4098-b2f0-8c8b5b6a8e31 req-55d85818-bd48-403d-9359-d0802749d87b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093081 May 27 15:02:45.131503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-15fe9423-6006-4ec7-9375-41f798e61952 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='f4fbebe1-d6fc-4b60-a6e5-2660d4ab7667',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='034f136d-626b-4938-8a13-733ad49ef11a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3dff3891-6419-44a4-b2de-e30e3dfa91ec',volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:02:45.136050 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 640/1323] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:45.149372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ae1c183e-c5ed-4585-8f1a-7be5f27c0004 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:45.165681 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ae1c183e-c5ed-4585-8f1a-7be5f27c0004 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:45.186686 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae1c183e-c5ed-4585-8f1a-7be5f27c0004 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:45.190071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae1c183e-c5ed-4585-8f1a-7be5f27c0004 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:45.192213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae1c183e-c5ed-4585-8f1a-7be5f27c0004 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:45.194686 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae1c183e-c5ed-4585-8f1a-7be5f27c0004 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:45.622492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ae1c183e-c5ed-4585-8f1a-7be5f27c0004 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:45.631511 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ae1c183e-c5ed-4585-8f1a-7be5f27c0004 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1498 microversion: 2.1 time: 0.489302 May 27 15:02:45.640228 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 641/1324] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:45 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1498 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:45.674665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1f399e68-24c3-41d3-beda-75d6e6dd21e0 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776acac10>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:45.783914 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1f399e68-24c3-41d3-beda-75d6e6dd21e0 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff" status: 200 len: 1452 microversion: 2.1 time: 0.140997 May 27 15:02:45.791315 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 642/1325] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:45 2022] GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:45.799218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-81821944-c9d8-40ac-ba55-388fb6d69283 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:45.800484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-81821944-c9d8-40ac-ba55-388fb6d69283 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:45.809866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81821944-c9d8-40ac-ba55-388fb6d69283 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:45.810652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81821944-c9d8-40ac-ba55-388fb6d69283 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:45.811955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81821944-c9d8-40ac-ba55-388fb6d69283 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:45.812612 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81821944-c9d8-40ac-ba55-388fb6d69283 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:45.907245 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-81821944-c9d8-40ac-ba55-388fb6d69283 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114023 May 27 15:02:45.910481 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 643/1326] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:02:45 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:45.927625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-93e3a903-bc32-4389-b962-391bc50eaa31 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:45.928142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-93e3a903-bc32-4389-b962-391bc50eaa31 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:45.946707 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93e3a903-bc32-4389-b962-391bc50eaa31 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:45.947182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93e3a903-bc32-4389-b962-391bc50eaa31 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:45.947993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93e3a903-bc32-4389-b962-391bc50eaa31 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:45.949733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93e3a903-bc32-4389-b962-391bc50eaa31 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:46.037132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-93e3a903-bc32-4389-b962-391bc50eaa31 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:02:46.240427 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-93e3a903-bc32-4389-b962-391bc50eaa31 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "DELETE /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 204 len: 0 microversion: 2.1 time: 0.322151 May 27 15:02:46.241830 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 644/1327] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:02:45 2022] DELETE /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:02:46.254059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a16af982-42e2-4a01-953e-1885e97f02b9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:46.254975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a16af982-42e2-4a01-953e-1885e97f02b9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:46.265910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a16af982-42e2-4a01-953e-1885e97f02b9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:46.267040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a16af982-42e2-4a01-953e-1885e97f02b9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:46.268807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a16af982-42e2-4a01-953e-1885e97f02b9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:46.269424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a16af982-42e2-4a01-953e-1885e97f02b9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:46.520635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a16af982-42e2-4a01-953e-1885e97f02b9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:46.539230 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a16af982-42e2-4a01-953e-1885e97f02b9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0" status: 200 len: 1319 microversion: 2.1 time: 0.296136 May 27 15:02:46.540019 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 645/1328] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:46 2022] GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:46.556778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-01b3d948-b894-4bc9-a002-c06ee75d86e7 req-98d82486-fdc5-4d12-a94d-e48d1e87bfbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31db04fa-a046-4535-8191-c7db2b34a029", "tag": "c6b81cde-c01c-4516-850b-f6b6598924c3"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:46.586287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-01b3d948-b894-4bc9-a002-c06ee75d86e7 req-98d82486-fdc5-4d12-a94d-e48d1e87bfbe service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:46.586744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-01b3d948-b894-4bc9-a002-c06ee75d86e7 req-98d82486-fdc5-4d12-a94d-e48d1e87bfbe service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:46.615272 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-01b3d948-b894-4bc9-a002-c06ee75d86e7 req-98d82486-fdc5-4d12-a94d-e48d1e87bfbe service nova] Creating event network-changed:c6b81cde-c01c-4516-850b-f6b6598924c3 for instance 31db04fa-a046-4535-8191-c7db2b34a029 on n-h1-843621-1 May 27 15:02:46.625107 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-01b3d948-b894-4bc9-a002-c06ee75d86e7 req-98d82486-fdc5-4d12-a94d-e48d1e87bfbe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079273 May 27 15:02:46.627282 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 646/1329] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:46.640828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9b61e5f8-77eb-4e0b-82fb-4ccfd42bed3e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:46.641552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9b61e5f8-77eb-4e0b-82fb-4ccfd42bed3e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:46.654907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b61e5f8-77eb-4e0b-82fb-4ccfd42bed3e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:46.655510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b61e5f8-77eb-4e0b-82fb-4ccfd42bed3e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:46.656325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b61e5f8-77eb-4e0b-82fb-4ccfd42bed3e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:46.656799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b61e5f8-77eb-4e0b-82fb-4ccfd42bed3e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:46.936762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9b61e5f8-77eb-4e0b-82fb-4ccfd42bed3e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:46.947381 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9b61e5f8-77eb-4e0b-82fb-4ccfd42bed3e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1534 microversion: 2.1 time: 0.318620 May 27 15:02:46.948550 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 647/1330] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:46 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1534 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:46.954027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-42042f4c-f74a-44f6-b06e-8cc18d2538c2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:46.955371 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-42042f4c-f74a-44f6-b06e-8cc18d2538c2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:46.967453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42042f4c-f74a-44f6-b06e-8cc18d2538c2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:46.969359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42042f4c-f74a-44f6-b06e-8cc18d2538c2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:46.970921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42042f4c-f74a-44f6-b06e-8cc18d2538c2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:46.974066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42042f4c-f74a-44f6-b06e-8cc18d2538c2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:47.051358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:47.389836 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-42042f4c-f74a-44f6-b06e-8cc18d2538c2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:47.400003 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-42042f4c-f74a-44f6-b06e-8cc18d2538c2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1498 microversion: 2.1 time: 0.450137 May 27 15:02:47.400602 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 648/1331] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:46 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1498 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:47.419000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e4496abc-08d7-4ee5-b36e-8bb703efef55 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776af20d0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:47.497223 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e4496abc-08d7-4ee5-b36e-8bb703efef55 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff" status: 200 len: 1452 microversion: 2.1 time: 0.085396 May 27 15:02:47.498476 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 649/1332] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:47 2022] GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:47.510460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bc92cd35-0876-4785-a891-37c6b464b12e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:47.511560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bc92cd35-0876-4785-a891-37c6b464b12e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:47.524168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc92cd35-0876-4785-a891-37c6b464b12e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:47.524744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc92cd35-0876-4785-a891-37c6b464b12e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:47.525629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc92cd35-0876-4785-a891-37c6b464b12e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:47.526141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc92cd35-0876-4785-a891-37c6b464b12e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:47.624196 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bc92cd35-0876-4785-a891-37c6b464b12e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123733 May 27 15:02:47.628493 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 650/1333] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:02:47 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:47.640640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b39d4a13-b33d-46fd-b1e3-057ed1bcc40a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:47.641296 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b39d4a13-b33d-46fd-b1e3-057ed1bcc40a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:47.654490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b39d4a13-b33d-46fd-b1e3-057ed1bcc40a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:47.654942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b39d4a13-b33d-46fd-b1e3-057ed1bcc40a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:47.655726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b39d4a13-b33d-46fd-b1e3-057ed1bcc40a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:47.656164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b39d4a13-b33d-46fd-b1e3-057ed1bcc40a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:48.229737 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b39d4a13-b33d-46fd-b1e3-057ed1bcc40a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:48.238550 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b39d4a13-b33d-46fd-b1e3-057ed1bcc40a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0" status: 200 len: 1319 microversion: 2.1 time: 0.612233 May 27 15:02:48.239140 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 651/1334] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:47 2022] GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 => generated 1319 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:48.245061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-01a8eb0c-04c9-4f1a-a74e-bf5106875f1e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:48.245684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-01a8eb0c-04c9-4f1a-a74e-bf5106875f1e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:48.253611 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01a8eb0c-04c9-4f1a-a74e-bf5106875f1e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:48.254625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01a8eb0c-04c9-4f1a-a74e-bf5106875f1e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:48.255422 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01a8eb0c-04c9-4f1a-a74e-bf5106875f1e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:48.255988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01a8eb0c-04c9-4f1a-a74e-bf5106875f1e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:48.529494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-01a8eb0c-04c9-4f1a-a74e-bf5106875f1e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:48.541059 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-01a8eb0c-04c9-4f1a-a74e-bf5106875f1e tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1534 microversion: 2.1 time: 0.299839 May 27 15:02:48.541666 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 652/1335] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:48 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1534 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:48.549492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9ed1dfad-ade1-46fe-b614-a0bcd08764b7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:48.552245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9ed1dfad-ade1-46fe-b614-a0bcd08764b7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:48.566140 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ed1dfad-ade1-46fe-b614-a0bcd08764b7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:48.567034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ed1dfad-ade1-46fe-b614-a0bcd08764b7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:48.568662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ed1dfad-ade1-46fe-b614-a0bcd08764b7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:48.569403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ed1dfad-ade1-46fe-b614-a0bcd08764b7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:48.831855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9ed1dfad-ade1-46fe-b614-a0bcd08764b7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:48.861004 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9ed1dfad-ade1-46fe-b614-a0bcd08764b7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1498 microversion: 2.1 time: 0.308931 May 27 15:02:48.862049 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 653/1336] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:48 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1498 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:48.867271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7fe5cf9e-870f-467e-9b14-6ee1bb570e6a tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776b933a0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:48.977714 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7fe5cf9e-870f-467e-9b14-6ee1bb570e6a tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff" status: 200 len: 1452 microversion: 2.1 time: 0.114054 May 27 15:02:48.986531 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 654/1337] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:48 2022] GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:49.001989 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-980cb205-f8d6-4ae8-9c43-459a2c281c0e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:49.003010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-980cb205-f8d6-4ae8-9c43-459a2c281c0e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:49.029648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-980cb205-f8d6-4ae8-9c43-459a2c281c0e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:49.030116 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-980cb205-f8d6-4ae8-9c43-459a2c281c0e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:49.038729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-980cb205-f8d6-4ae8-9c43-459a2c281c0e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:49.039467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-980cb205-f8d6-4ae8-9c43-459a2c281c0e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:49.124261 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-980cb205-f8d6-4ae8-9c43-459a2c281c0e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136293 May 27 15:02:49.128699 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 655/1338] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:02:48 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:49.138699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-8536a18f-93c7-4598-b1a6-fd941947b366 req-7db697b0-789b-4094-b715-1d54f9f0f208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023b1bc9-f67a-4173-9730-9ecb7a3f6ed0", "tag": "e0e653e0-9fdc-48c4-84a5-af24da58ef81"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:49.158591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-8536a18f-93c7-4598-b1a6-fd941947b366 req-7db697b0-789b-4094-b715-1d54f9f0f208 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:49.158959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-8536a18f-93c7-4598-b1a6-fd941947b366 req-7db697b0-789b-4094-b715-1d54f9f0f208 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:49.196945 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-8536a18f-93c7-4598-b1a6-fd941947b366 req-7db697b0-789b-4094-b715-1d54f9f0f208 service nova] Creating event network-changed:e0e653e0-9fdc-48c4-84a5-af24da58ef81 for instance 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 on n-h1-843621-1 May 27 15:02:49.210608 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-8536a18f-93c7-4598-b1a6-fd941947b366 req-7db697b0-789b-4094-b715-1d54f9f0f208 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080633 May 27 15:02:49.213113 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 656/1339] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:49.259262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c52506d9-16e9-44da-a991-e8c048ac4a43 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:49.260084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c52506d9-16e9-44da-a991-e8c048ac4a43 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:49.273592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c52506d9-16e9-44da-a991-e8c048ac4a43 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:49.276096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c52506d9-16e9-44da-a991-e8c048ac4a43 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:49.277283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c52506d9-16e9-44da-a991-e8c048ac4a43 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:49.278246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c52506d9-16e9-44da-a991-e8c048ac4a43 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:49.679163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c52506d9-16e9-44da-a991-e8c048ac4a43 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:49.703811 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c52506d9-16e9-44da-a991-e8c048ac4a43 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0" status: 200 len: 1319 microversion: 2.1 time: 0.451479 May 27 15:02:49.704737 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 657/1340] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:49 2022] GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 => generated 1319 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:02:49.709786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1b120c38-3700-4f2c-9f3f-3f28cae433ed tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:49.710411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1b120c38-3700-4f2c-9f3f-3f28cae433ed tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:49.716959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b120c38-3700-4f2c-9f3f-3f28cae433ed tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:49.717658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b120c38-3700-4f2c-9f3f-3f28cae433ed tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:49.718763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b120c38-3700-4f2c-9f3f-3f28cae433ed tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:49.719497 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b120c38-3700-4f2c-9f3f-3f28cae433ed tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:49.768703 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b120c38-3700-4f2c-9f3f-3f28cae433ed tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:49.769350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b120c38-3700-4f2c-9f3f-3f28cae433ed tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:49.794613 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-1b120c38-3700-4f2c-9f3f-3f28cae433ed tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lazy-loading 'fault' on Instance uuid 39985ed3-7d07-48db-80b4-c570f7422e1f {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:02:49.908412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1b120c38-3700-4f2c-9f3f-3f28cae433ed tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:49.923233 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1b120c38-3700-4f2c-9f3f-3f28cae433ed tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 200 len: 1369 microversion: 2.1 time: 0.217056 May 27 15:02:49.925207 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 658/1341] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:49 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:49.930369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-210a5ac4-e2e7-4f54-87ce-07340298b61c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:49.931232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-210a5ac4-e2e7-4f54-87ce-07340298b61c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:49.941786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-210a5ac4-e2e7-4f54-87ce-07340298b61c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:49.942900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-210a5ac4-e2e7-4f54-87ce-07340298b61c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:49.944519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-210a5ac4-e2e7-4f54-87ce-07340298b61c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:49.946363 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-210a5ac4-e2e7-4f54-87ce-07340298b61c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:50.181426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-210a5ac4-e2e7-4f54-87ce-07340298b61c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:50.202740 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-210a5ac4-e2e7-4f54-87ce-07340298b61c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 200 len: 1475 microversion: 2.1 time: 0.275332 May 27 15:02:50.204964 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 659/1342] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:49 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 1475 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:50.210498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8b42e3d2-5642-4f48-bd1b-51efd3318efa tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776aca9d0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:50.290527 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8b42e3d2-5642-4f48-bd1b-51efd3318efa tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff" status: 200 len: 1452 microversion: 2.1 time: 0.084164 May 27 15:02:50.291137 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 660/1343] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:50 2022] GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff => generated 1452 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:50.305013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-94d04671-4810-4a0a-8561-101f0ef3472e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:50.309206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-94d04671-4810-4a0a-8561-101f0ef3472e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:50.339184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94d04671-4810-4a0a-8561-101f0ef3472e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:50.342827 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94d04671-4810-4a0a-8561-101f0ef3472e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:50.344473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94d04671-4810-4a0a-8561-101f0ef3472e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:50.345390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94d04671-4810-4a0a-8561-101f0ef3472e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:50.429675 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-94d04671-4810-4a0a-8561-101f0ef3472e tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136569 May 27 15:02:50.434166 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 661/1344] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:02:50 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:50.443402 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fe105af2-72a5-4cde-b112-18bd23bf6616 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2002380809"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:50.444855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fe105af2-72a5-4cde-b112-18bd23bf6616 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:50.448511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:50.453100 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe105af2-72a5-4cde-b112-18bd23bf6616 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:50.453495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe105af2-72a5-4cde-b112-18bd23bf6616 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:50.455180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe105af2-72a5-4cde-b112-18bd23bf6616 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:50.457700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe105af2-72a5-4cde-b112-18bd23bf6616 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:50.973628 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fe105af2-72a5-4cde-b112-18bd23bf6616 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "POST /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5/action" status: 202 len: 0 microversion: 2.1 time: 0.540349 May 27 15:02:50.975368 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 662/1345] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:02:50 2022] POST /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 27 15:02:50.982347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-01962cff-0752-4dd4-8c5e-e6ea13910d48 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:50.983397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-01962cff-0752-4dd4-8c5e-e6ea13910d48 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:50.993860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01962cff-0752-4dd4-8c5e-e6ea13910d48 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:50.994654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01962cff-0752-4dd4-8c5e-e6ea13910d48 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:50.995950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01962cff-0752-4dd4-8c5e-e6ea13910d48 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:50.997501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01962cff-0752-4dd4-8c5e-e6ea13910d48 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:51.356904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-01962cff-0752-4dd4-8c5e-e6ea13910d48 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:51.369127 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-01962cff-0752-4dd4-8c5e-e6ea13910d48 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0" status: 200 len: 1319 microversion: 2.1 time: 0.391660 May 27 15:02:51.380081 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 663/1346] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:50 2022] GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 => generated 1319 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:51.384967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-37d585e0-cfea-4b3d-8bfd-f328e87f5ce4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:51.385719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-37d585e0-cfea-4b3d-8bfd-f328e87f5ce4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 39985ed3-7d07-48db-80b4-c570f7422e1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:51.395570 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-37d585e0-cfea-4b3d-8bfd-f328e87f5ce4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:51.396042 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-37d585e0-cfea-4b3d-8bfd-f328e87f5ce4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:51.396924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-37d585e0-cfea-4b3d-8bfd-f328e87f5ce4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:51.397387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-37d585e0-cfea-4b3d-8bfd-f328e87f5ce4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:51.416758 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-37d585e0-cfea-4b3d-8bfd-f328e87f5ce4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] HTTP exception thrown: Instance 39985ed3-7d07-48db-80b4-c570f7422e1f could not be found. May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-37d585e0-cfea-4b3d-8bfd-f328e87f5ce4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Request method failure captured: May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f HTTP/1.1 May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikObYSjb6MvGIY6lnXWeRgbRH8-3u-XeAD_M8gYclQB86P0-vJ0O-mlRXOOdgi9Ciokk3zvlbORmJSvIjMH0aKkVptvuW2jGpVP3aAHzMMuyeEkxvb2vuUmANHcgU-82521qHqIJuUMKjFEpA46unHpTCNcDkvT0KB5fohpXq-D8gFBk May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 7369228028774765965f3cf001f8806a May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-MigrationsAdminTest-2005600101 May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7369228028774765965f3cf001f8806a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7369228028774765965f3cf001f8806a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7369228028774765965f3cf001f8806a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7369228028774765965f3cf001f8806a", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-MigrationsAdminTest-2005600101 May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 7369228028774765965f3cf001f8806a May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-MigrationsAdminTest-2005600101 May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-MigrationsAdminTest-2005600101-project May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: a5a825c2385e490d81ddcbc2de76980d May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-MigrationsAdminTest-2005600101-project May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 39985ed3-7d07-48db-80b4-c570f7422e1f could not be found. May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '39985ed3-7d07-48db-80b4-c570f7422e1f'} May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39985ed3-7d07-48db-80b4-c570f7422e1f could not be found. May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39985ed3-7d07-48db-80b4-c570f7422e1f could not be found. May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:02:51.419011 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:02:51.423872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:02:51.423872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:02:51.423872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:02:51.423872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:02:51.423872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:02:51.423872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39985ed3-7d07-48db-80b4-c570f7422e1f could not be found. May 27 15:02:51.423872 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:02:51.423872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-37d585e0-cfea-4b3d-8bfd-f328e87f5ce4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Returning 404 to user: Instance 39985ed3-7d07-48db-80b4-c570f7422e1f could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:02:51.423872 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-37d585e0-cfea-4b3d-8bfd-f328e87f5ce4 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f" status: 404 len: 111 microversion: 2.1 time: 0.039309 May 27 15:02:51.429067 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 664/1347] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:51 2022] GET /compute/v2.1/servers/39985ed3-7d07-48db-80b4-c570f7422e1f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:02:51.436694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c841ba74-f1c2-4146-9f1f-d196042f4261 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776a808b0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:51.488257 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c841ba74-f1c2-4146-9f1f-d196042f4261 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984" status: 200 len: 1412 microversion: 2.1 time: 0.057997 May 27 15:02:51.493998 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 665/1348] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:51 2022] GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984 => generated 1412 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:51.495771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-7fdf45e3-2c05-4f8d-b55d-54016d1727e1 req-90475e04-4ee7-416b-bea4-2b87d6407925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39985ed3-7d07-48db-80b4-c570f7422e1f", "name": "network-vif-deleted", "tag": "ac6d5c81-c7de-49e1-a62d-df0fdf576229"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:51.508444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-7fdf45e3-2c05-4f8d-b55d-54016d1727e1 req-90475e04-4ee7-416b-bea4-2b87d6407925 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:51.508904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-7fdf45e3-2c05-4f8d-b55d-54016d1727e1 req-90475e04-4ee7-416b-bea4-2b87d6407925 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:51.522695 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-7fdf45e3-2c05-4f8d-b55d-54016d1727e1 req-90475e04-4ee7-416b-bea4-2b87d6407925 service nova] Creating event network-vif-deleted:ac6d5c81-c7de-49e1-a62d-df0fdf576229 for instance 39985ed3-7d07-48db-80b4-c570f7422e1f on n-h2-843621-1 May 27 15:02:51.549845 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-7fdf45e3-2c05-4f8d-b55d-54016d1727e1 req-90475e04-4ee7-416b-bea4-2b87d6407925 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055496 May 27 15:02:51.550488 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 666/1349] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:51.564459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-159a684a-6e9e-4d34-b4df-14d439e35c65 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776bf6f70>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:51.666055 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-159a684a-6e9e-4d34-b4df-14d439e35c65 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff" status: 200 len: 1452 microversion: 2.1 time: 0.108184 May 27 15:02:51.668695 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 667/1350] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:51 2022] GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:51.675197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4e65ca72-ac98-4db9-a75f-ad7514749783 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:51.676884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4e65ca72-ac98-4db9-a75f-ad7514749783 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:51.686285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e65ca72-ac98-4db9-a75f-ad7514749783 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:51.687154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e65ca72-ac98-4db9-a75f-ad7514749783 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:51.689479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e65ca72-ac98-4db9-a75f-ad7514749783 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:51.690090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e65ca72-ac98-4db9-a75f-ad7514749783 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:51.720525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4e65ca72-ac98-4db9-a75f-ad7514749783 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:02:51.784429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:51.851062 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4e65ca72-ac98-4db9-a75f-ad7514749783 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "DELETE /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 204 len: 0 microversion: 2.1 time: 0.178664 May 27 15:02:51.852374 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 668/1351] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:02:51 2022] DELETE /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:02:51.860494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1eaf4e30-845b-467e-a5b4-b86be065cacc tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:51.862066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1eaf4e30-845b-467e-a5b4-b86be065cacc tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:51.869301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1eaf4e30-845b-467e-a5b4-b86be065cacc tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:51.869719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1eaf4e30-845b-467e-a5b4-b86be065cacc tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:51.870502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1eaf4e30-845b-467e-a5b4-b86be065cacc tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:51.870942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1eaf4e30-845b-467e-a5b4-b86be065cacc tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:51.904183 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1eaf4e30-845b-467e-a5b4-b86be065cacc tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050048 May 27 15:02:51.905217 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 669/1352] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:02:51 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:51.910409 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8512eda5-0115-4558-bdc7-4b21c82a91b0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:51.911176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8512eda5-0115-4558-bdc7-4b21c82a91b0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:51.918680 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8512eda5-0115-4558-bdc7-4b21c82a91b0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:51.918680 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8512eda5-0115-4558-bdc7-4b21c82a91b0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:51.919569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8512eda5-0115-4558-bdc7-4b21c82a91b0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:51.920018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8512eda5-0115-4558-bdc7-4b21c82a91b0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:52.115608 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8512eda5-0115-4558-bdc7-4b21c82a91b0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:52.127069 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8512eda5-0115-4558-bdc7-4b21c82a91b0 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1466 microversion: 2.1 time: 0.219414 May 27 15:02:52.136799 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 670/1353] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:51 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1466 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:52.397798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-551a5f99-166a-4e6e-af83-f6fef7de510f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:52.398443 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-551a5f99-166a-4e6e-af83-f6fef7de510f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:52.406603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-551a5f99-166a-4e6e-af83-f6fef7de510f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:52.407072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-551a5f99-166a-4e6e-af83-f6fef7de510f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:52.407873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-551a5f99-166a-4e6e-af83-f6fef7de510f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:52.408323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-551a5f99-166a-4e6e-af83-f6fef7de510f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:52.583780 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-551a5f99-166a-4e6e-af83-f6fef7de510f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:52.591944 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-551a5f99-166a-4e6e-af83-f6fef7de510f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0" status: 200 len: 1319 microversion: 2.1 time: 0.206623 May 27 15:02:52.601669 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 671/1354] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:52 2022] GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:02:52.624239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0932a890-2373-4cd9-af80-240ac3837d55 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776ae9310>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:52.699622 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0932a890-2373-4cd9-af80-240ac3837d55 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984" status: 200 len: 1412 microversion: 2.1 time: 0.105498 May 27 15:02:52.700647 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 672/1355] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:52 2022] GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984 => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:52.727357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-524b3989-fbb0-4b5f-a3c1-90e7d04a2ddc tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776af2280>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:52.805860 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-524b3989-fbb0-4b5f-a3c1-90e7d04a2ddc tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff" status: 200 len: 1452 microversion: 2.1 time: 0.097657 May 27 15:02:52.811739 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 673/1356] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:52 2022] GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:52.917109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c5106eac-5239-4888-ab8d-54f97e25dad4 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:52.918641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c5106eac-5239-4888-ab8d-54f97e25dad4 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:52.930204 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c5106eac-5239-4888-ab8d-54f97e25dad4 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:52.931255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c5106eac-5239-4888-ab8d-54f97e25dad4 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:52.932192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c5106eac-5239-4888-ab8d-54f97e25dad4 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:52.933449 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c5106eac-5239-4888-ab8d-54f97e25dad4 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:52.988281 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c5106eac-5239-4888-ab8d-54f97e25dad4 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074840 May 27 15:02:52.995456 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 674/1357] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:02:52 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:53.148525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-781bcaf1-5ee9-4657-92c2-116d504ef7e7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:53.149238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-781bcaf1-5ee9-4657-92c2-116d504ef7e7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:53.159639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-781bcaf1-5ee9-4657-92c2-116d504ef7e7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:53.160369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-781bcaf1-5ee9-4657-92c2-116d504ef7e7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:53.161340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-781bcaf1-5ee9-4657-92c2-116d504ef7e7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:53.161806 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-781bcaf1-5ee9-4657-92c2-116d504ef7e7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:53.351638 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-781bcaf1-5ee9-4657-92c2-116d504ef7e7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:53.367605 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-781bcaf1-5ee9-4657-92c2-116d504ef7e7 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1466 microversion: 2.1 time: 0.224110 May 27 15:02:53.382313 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 675/1358] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:53 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1466 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:53.609507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-26e2ea4f-79a1-48e4-aa0e-d40db7baa61b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:53.610144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-26e2ea4f-79a1-48e4-aa0e-d40db7baa61b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:53.623807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26e2ea4f-79a1-48e4-aa0e-d40db7baa61b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:53.624306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26e2ea4f-79a1-48e4-aa0e-d40db7baa61b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:53.624989 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26e2ea4f-79a1-48e4-aa0e-d40db7baa61b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:53.625330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26e2ea4f-79a1-48e4-aa0e-d40db7baa61b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:53.903182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-26e2ea4f-79a1-48e4-aa0e-d40db7baa61b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:53.923396 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-26e2ea4f-79a1-48e4-aa0e-d40db7baa61b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0" status: 200 len: 1319 microversion: 2.1 time: 0.317679 May 27 15:02:53.928360 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 676/1359] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:53 2022] GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:53.942200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-39c975d7-ec1a-4191-8079-7a21b80fd103 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776b93ca0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:54.138688 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-39c975d7-ec1a-4191-8079-7a21b80fd103 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984" status: 200 len: 1412 microversion: 2.1 time: 0.201365 May 27 15:02:54.142222 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 677/1360] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:53 2022] GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984 => generated 1412 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:54.159437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-802663ca-0678-4c04-b739-35556ab60485 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776a80ee0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:54.252194 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:54.253596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:54.332823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=34 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:54.340840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=23 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:02:55.312377 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-15fe9423-6006-4ec7-9375-41f798e61952 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 17.444198 May 27 15:02:55.319486 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 684/1361] 10.222.0.13 () {62 vars in 1188 bytes} [Fri May 27 15:02:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 17452 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 15:02:55.326039 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-47067046-6c20-49cb-b5aa-47f1ddc147f8 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:55.328310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-47067046-6c20-49cb-b5aa-47f1ddc147f8 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:55.338708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47067046-6c20-49cb-b5aa-47f1ddc147f8 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:55.340559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47067046-6c20-49cb-b5aa-47f1ddc147f8 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:55.341699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47067046-6c20-49cb-b5aa-47f1ddc147f8 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:55.342773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47067046-6c20-49cb-b5aa-47f1ddc147f8 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:55.392354 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-47067046-6c20-49cb-b5aa-47f1ddc147f8 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070412 May 27 15:02:55.393405 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 685/1362] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:02:55 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:02:55.399197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-90e03a3c-d24e-4210-b0e5-a9b9036b3ec9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:55.404405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-90e03a3c-d24e-4210-b0e5-a9b9036b3ec9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:55.415754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-90e03a3c-d24e-4210-b0e5-a9b9036b3ec9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:55.416554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-90e03a3c-d24e-4210-b0e5-a9b9036b3ec9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:55.417628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-90e03a3c-d24e-4210-b0e5-a9b9036b3ec9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:55.418328 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-90e03a3c-d24e-4210-b0e5-a9b9036b3ec9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:55.461806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-90e03a3c-d24e-4210-b0e5-a9b9036b3ec9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:55.462681 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-90e03a3c-d24e-4210-b0e5-a9b9036b3ec9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:55.463636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-90e03a3c-d24e-4210-b0e5-a9b9036b3ec9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lazy-loading 'fault' on Instance uuid 701f3802-4b28-473a-b3f1-5f2a43e1ebe7 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:02:55.533252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-90e03a3c-d24e-4210-b0e5-a9b9036b3ec9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:55.544193 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-90e03a3c-d24e-4210-b0e5-a9b9036b3ec9 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 200 len: 1301 microversion: 2.1 time: 0.149443 May 27 15:02:55.557182 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 686/1363] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:55 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 1301 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:55.570722 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-af27eb71-407f-4f01-86ee-538fd9c49a5a req-598ab6f5-e670-4f97-9377-0604811638f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701f3802-4b28-473a-b3f1-5f2a43e1ebe7", "name": "network-vif-deleted", "tag": "d311ed01-b43c-4481-918e-786b3710c187"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:55.583001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-af27eb71-407f-4f01-86ee-538fd9c49a5a req-598ab6f5-e670-4f97-9377-0604811638f0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:55.583944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-af27eb71-407f-4f01-86ee-538fd9c49a5a req-598ab6f5-e670-4f97-9377-0604811638f0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:55.606507 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-af27eb71-407f-4f01-86ee-538fd9c49a5a req-598ab6f5-e670-4f97-9377-0604811638f0 service nova] Creating event network-vif-deleted:d311ed01-b43c-4481-918e-786b3710c187 for instance 701f3802-4b28-473a-b3f1-5f2a43e1ebe7 on n-h2-843621-1 May 27 15:02:55.633692 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-af27eb71-407f-4f01-86ee-538fd9c49a5a req-598ab6f5-e670-4f97-9377-0604811638f0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053064 May 27 15:02:55.636574 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 687/1364] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:55.651021 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f8990fcc-7d27-4c37-87ac-e3fa6d9ab3c4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:02:55.652322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f8990fcc-7d27-4c37-87ac-e3fa6d9ab3c4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:02:55.663684 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8990fcc-7d27-4c37-87ac-e3fa6d9ab3c4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:55.664610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8990fcc-7d27-4c37-87ac-e3fa6d9ab3c4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:55.665725 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8990fcc-7d27-4c37-87ac-e3fa6d9ab3c4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:55.666469 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8990fcc-7d27-4c37-87ac-e3fa6d9ab3c4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:55.887315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f8990fcc-7d27-4c37-87ac-e3fa6d9ab3c4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:02:55.902422 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f8990fcc-7d27-4c37-87ac-e3fa6d9ab3c4 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0" status: 200 len: 1319 microversion: 2.1 time: 0.264086 May 27 15:02:55.903637 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 688/1365] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:02:55 2022] GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:02:55.914423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2954e0e1-cb1c-44d8-bab3-344b0ce46ec5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-910457432", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "0ccca6c3-83b2-4106-9cbd-795a4836060e"}], "block_device_mapping_v2": [{"uuid": "739f4489-457e-40f1-9e2d-2a3c057f96a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:56.353231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-2954e0e1-cb1c-44d8-bab3-344b0ce46ec5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] validate_networks() for [('0ccca6c3-83b2-4106-9cbd-795a4836060e', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:02:57.129309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-2954e0e1-cb1c-44d8-bab3-344b0ce46ec5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:02:57.129746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-2954e0e1-cb1c-44d8-bab3-344b0ce46ec5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:02:57.130227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-2954e0e1-cb1c-44d8-bab3-344b0ce46ec5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:02:57.130660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-2954e0e1-cb1c-44d8-bab3-344b0ce46ec5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:02:57.131246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-2954e0e1-cb1c-44d8-bab3-344b0ce46ec5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:02:57.149348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2954e0e1-cb1c-44d8-bab3-344b0ce46ec5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:57.150393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2954e0e1-cb1c-44d8-bab3-344b0ce46ec5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:57.151698 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2954e0e1-cb1c-44d8-bab3-344b0ce46ec5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:57.152388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2954e0e1-cb1c-44d8-bab3-344b0ce46ec5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:57.193798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-2954e0e1-cb1c-44d8-bab3-344b0ce46ec5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Getting quotas for project 0dbdeb12b89c475cba7fef0ab845dada. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:02:57.208757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-2954e0e1-cb1c-44d8-bab3-344b0ce46ec5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Getting quotas for user 4284d5f7a29045d18393bde2961a904b and project 0dbdeb12b89c475cba7fef0ab845dada. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:02:57.424392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2954e0e1-cb1c-44d8-bab3-344b0ce46ec5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:02:57.436661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2954e0e1-cb1c-44d8-bab3-344b0ce46ec5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='739f4489-457e-40f1-9e2d-2a3c057f96a5',volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:02:58.005429 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2954e0e1-cb1c-44d8-bab3-344b0ce46ec5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.083780 May 27 15:02:58.009534 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 689/1366] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 27 15:02:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2105 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 15:02:58.237049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-f60f807b-762e-42de-8c35-4edb16d4d8b8 req-04a20100-b340-4722-9780-fa8d89cc1ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31db04fa-a046-4535-8191-c7db2b34a029", "name": "network-vif-plugged", "status": "completed", "tag": "c6b81cde-c01c-4516-850b-f6b6598924c3"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:02:58.259175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-f60f807b-762e-42de-8c35-4edb16d4d8b8 req-04a20100-b340-4722-9780-fa8d89cc1ed6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:02:58.264583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-f60f807b-762e-42de-8c35-4edb16d4d8b8 req-04a20100-b340-4722-9780-fa8d89cc1ed6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:02:58.301670 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-f60f807b-762e-42de-8c35-4edb16d4d8b8 req-04a20100-b340-4722-9780-fa8d89cc1ed6 service nova] Creating event network-vif-plugged:c6b81cde-c01c-4516-850b-f6b6598924c3 for instance 31db04fa-a046-4535-8191-c7db2b34a029 on n-h1-843621-1 May 27 15:02:58.313752 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-f60f807b-762e-42de-8c35-4edb16d4d8b8 req-04a20100-b340-4722-9780-fa8d89cc1ed6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.302562 May 27 15:02:58.318079 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 690/1367] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:02:58.327612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-253261dc-3e1d-47be-9e91-67cf3f0815b2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc7767b4940>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:03.623137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:03.920560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=36 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:05.463391 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-802663ca-0678-4c04-b739-35556ab60485 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff" status: 200 len: 1461 microversion: 2.1 time: 11.316743 May 27 15:03:05.464418 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 678/1368] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:54 2022] GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff => generated 1461 bytes in 11322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:05.472888 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-253261dc-3e1d-47be-9e91-67cf3f0815b2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984" status: 200 len: 1412 microversion: 2.1 time: 7.149275 May 27 15:03:05.473471 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 691/1369] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:02:58 2022] GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984 => generated 1412 bytes in 7151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:05.481204 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1965e92f-ebba-40d5-8ef7-735eb476187b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:05.482392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e9877881-97a7-4344-91ef-3b265a0b38aa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:05.484708 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1965e92f-ebba-40d5-8ef7-735eb476187b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:05.489753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e9877881-97a7-4344-91ef-3b265a0b38aa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: 701f3802-4b28-473a-b3f1-5f2a43e1ebe7] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:05.498558 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1965e92f-ebba-40d5-8ef7-735eb476187b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:05.501673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1965e92f-ebba-40d5-8ef7-735eb476187b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:05.502901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1965e92f-ebba-40d5-8ef7-735eb476187b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:05.503604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1965e92f-ebba-40d5-8ef7-735eb476187b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:05.503879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e9877881-97a7-4344-91ef-3b265a0b38aa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:05.504524 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e9877881-97a7-4344-91ef-3b265a0b38aa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:05.506196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e9877881-97a7-4344-91ef-3b265a0b38aa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:05.506817 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e9877881-97a7-4344-91ef-3b265a0b38aa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:05.567365 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-e9877881-97a7-4344-91ef-3b265a0b38aa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] HTTP exception thrown: Instance 701f3802-4b28-473a-b3f1-5f2a43e1ebe7 could not be found. May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e9877881-97a7-4344-91ef-3b265a0b38aa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Request method failure captured: May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 HTTP/1.1 May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObYSjb6MvGIY6lnXWeRgbRH8-3u-XeAD_M8gYclQB86P0-vJ0O-mlRXOOdgi9Ciokk3zvlbORmJSvIjMH0aKkVptvuW2jGpVP3aAHzMMuyeEkxvb2vuUmANHcgU-82521qHqIJuUMKjFEpA46unHpTCNcDkvT0KB5fohpXq-D8gFBk May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 7369228028774765965f3cf001f8806a May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-MigrationsAdminTest-2005600101 May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7369228028774765965f3cf001f8806a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7369228028774765965f3cf001f8806a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7369228028774765965f3cf001f8806a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7369228028774765965f3cf001f8806a", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-MigrationsAdminTest-2005600101 May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 7369228028774765965f3cf001f8806a May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-MigrationsAdminTest-2005600101 May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-MigrationsAdminTest-2005600101-project May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: a5a825c2385e490d81ddcbc2de76980d May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-MigrationsAdminTest-2005600101-project May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 701f3802-4b28-473a-b3f1-5f2a43e1ebe7 could not be found. May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '701f3802-4b28-473a-b3f1-5f2a43e1ebe7'} May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 701f3802-4b28-473a-b3f1-5f2a43e1ebe7 could not be found. May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 701f3802-4b28-473a-b3f1-5f2a43e1ebe7 could not be found. May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:03:05.570150 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:05.575201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:05.575201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:03:05.575201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:03:05.575201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:03:05.575201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:03:05.575201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 701f3802-4b28-473a-b3f1-5f2a43e1ebe7 could not be found. May 27 15:03:05.575201 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:05.577674 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e9877881-97a7-4344-91ef-3b265a0b38aa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Returning 404 to user: Instance 701f3802-4b28-473a-b3f1-5f2a43e1ebe7 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:03:05.581507 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e9877881-97a7-4344-91ef-3b265a0b38aa tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7" status: 404 len: 111 microversion: 2.1 time: 0.104378 May 27 15:03:05.587222 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 692/1370] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:05 2022] GET /compute/v2.1/servers/701f3802-4b28-473a-b3f1-5f2a43e1ebe7 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:03:05.594296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e098b65a-f8c9-4d5f-ab52-9010a3cdff2e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:05.600475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e098b65a-f8c9-4d5f-ab52-9010a3cdff2e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:05.618182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e098b65a-f8c9-4d5f-ab52-9010a3cdff2e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:05.618915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e098b65a-f8c9-4d5f-ab52-9010a3cdff2e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:05.620022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e098b65a-f8c9-4d5f-ab52-9010a3cdff2e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:05.630229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e098b65a-f8c9-4d5f-ab52-9010a3cdff2e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:06.194468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1965e92f-ebba-40d5-8ef7-735eb476187b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:06.201930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1965e92f-ebba-40d5-8ef7-735eb476187b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:06.202297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e098b65a-f8c9-4d5f-ab52-9010a3cdff2e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:06.211249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1965e92f-ebba-40d5-8ef7-735eb476187b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:06.219236 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1965e92f-ebba-40d5-8ef7-735eb476187b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1751 microversion: 2.32 time: 0.750949 May 27 15:03:06.223428 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e098b65a-f8c9-4d5f-ab52-9010a3cdff2e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0" status: 200 len: 1319 microversion: 2.1 time: 0.634529 May 27 15:03:06.224242 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 693/1371] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:05 2022] GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 => generated 1319 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:06.231195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-abc3e940-9d1d-4715-a278-40839319adf1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:06.232064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-abc3e940-9d1d-4715-a278-40839319adf1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:06.233641 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 679/1372] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:05 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1751 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:06.241215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-6c3558c3-6742-490b-84b6-b8037f4c6a97 req-6e72c7da-5e73-4e9c-b706-e55616fcf6ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72bd3cf-9b54-4d56-ab10-9f2a602a15f5", "name": "network-vif-plugged", "status": "completed", "tag": "b633ef09-5eca-4f03-95aa-8ed44cb2e4c0"}, {"server_uuid": "023b1bc9-f67a-4173-9730-9ecb7a3f6ed0", "name": "network-vif-plugged", "status": "completed", "tag": "e0e653e0-9fdc-48c4-84a5-af24da58ef81"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:06.245424 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-abc3e940-9d1d-4715-a278-40839319adf1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:06.249611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-abc3e940-9d1d-4715-a278-40839319adf1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:06.251248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-abc3e940-9d1d-4715-a278-40839319adf1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:06.251723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-abc3e940-9d1d-4715-a278-40839319adf1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:06.254278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6c3558c3-6742-490b-84b6-b8037f4c6a97 req-6e72c7da-5e73-4e9c-b706-e55616fcf6ed service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:06.254929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6c3558c3-6742-490b-84b6-b8037f4c6a97 req-6e72c7da-5e73-4e9c-b706-e55616fcf6ed service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:06.274995 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-6c3558c3-6742-490b-84b6-b8037f4c6a97 req-6e72c7da-5e73-4e9c-b706-e55616fcf6ed service nova] Creating event network-vif-plugged:b633ef09-5eca-4f03-95aa-8ed44cb2e4c0 for instance a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 on n-h2-843621-1 May 27 15:03:06.275734 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-6c3558c3-6742-490b-84b6-b8037f4c6a97 req-6e72c7da-5e73-4e9c-b706-e55616fcf6ed service nova] Creating event network-vif-plugged:e0e653e0-9fdc-48c4-84a5-af24da58ef81 for instance 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 on n-h1-843621-1 May 27 15:03:06.286519 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-6c3558c3-6742-490b-84b6-b8037f4c6a97 req-6e72c7da-5e73-4e9c-b706-e55616fcf6ed service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049931 May 27 15:03:06.287744 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 680/1373] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:06.297099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5f4969d9-04e5-43f4-8271-0dd8fcebf311 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776be3790>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:06.369488 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5f4969d9-04e5-43f4-8271-0dd8fcebf311 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff" status: 200 len: 1461 microversion: 2.1 time: 0.080064 May 27 15:03:06.370651 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 681/1374] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:06 2022] GET /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff => generated 1461 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:06.376311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-02e648ca-564f-4a42-9b86-02f939299a81 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:06.377417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-02e648ca-564f-4a42-9b86-02f939299a81 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:06.384628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-02e648ca-564f-4a42-9b86-02f939299a81 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:06.385391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-02e648ca-564f-4a42-9b86-02f939299a81 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:06.386343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-02e648ca-564f-4a42-9b86-02f939299a81 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:06.386949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-02e648ca-564f-4a42-9b86-02f939299a81 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:06.418681 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-02e648ca-564f-4a42-9b86-02f939299a81 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:03:06.496057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-abc3e940-9d1d-4715-a278-40839319adf1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:06.507125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-abc3e940-9d1d-4715-a278-40839319adf1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:06.509443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-abc3e940-9d1d-4715-a278-40839319adf1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:06.511882 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-abc3e940-9d1d-4715-a278-40839319adf1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1292 microversion: 2.25 time: 0.284738 May 27 15:03:06.513753 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 694/1375] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:06 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1292 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:06.520035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7d7343e4-81ca-4851-bbe6-726d12477031 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:06.520971 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7d7343e4-81ca-4851-bbe6-726d12477031 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 73173e14-0308-44e3-adc9-8bbd5509246c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:06.528430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d7343e4-81ca-4851-bbe6-726d12477031 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:06.528972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d7343e4-81ca-4851-bbe6-726d12477031 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:06.529806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d7343e4-81ca-4851-bbe6-726d12477031 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:06.530314 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d7343e4-81ca-4851-bbe6-726d12477031 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:06.569923 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-02e648ca-564f-4a42-9b86-02f939299a81 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 204 len: 0 microversion: 2.1 time: 0.196795 May 27 15:03:06.570683 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 682/1376] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:03:06 2022] DELETE /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:03:06.604285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-758f30ab-691a-4d6d-ad74-a74f06fb1fee tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776c37040>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:06.702514 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-758f30ab-691a-4d6d-ad74-a74f06fb1fee tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984" status: 200 len: 1412 microversion: 2.1 time: 0.130735 May 27 15:03:06.705469 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 683/1377] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:06 2022] GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984 => generated 1412 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:06.714068 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-58549f09-0fe9-4fc8-a6e7-d476a77787f5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:06.715441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-58549f09-0fe9-4fc8-a6e7-d476a77787f5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:06.730824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58549f09-0fe9-4fc8-a6e7-d476a77787f5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:06.731582 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58549f09-0fe9-4fc8-a6e7-d476a77787f5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:06.733029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58549f09-0fe9-4fc8-a6e7-d476a77787f5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:06.733735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58549f09-0fe9-4fc8-a6e7-d476a77787f5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:06.814019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7d7343e4-81ca-4851-bbe6-726d12477031 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:06.822419 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7d7343e4-81ca-4851-bbe6-726d12477031 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c" status: 200 len: 1468 microversion: 2.1 time: 0.307315 May 27 15:03:06.834242 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 695/1378] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:06 2022] GET /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c => generated 1468 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:06.839623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-91dd19aa-2919-4324-bab3-03bd20e66884 req-497a33d6-b480-44ee-b5e6-7a1fa53b49e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05873cb2-4587-4714-a252-49a90edbabd2", "tag": "94292363-2ffc-491a-a278-eb63c9334b1f"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:06.850952 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-91dd19aa-2919-4324-bab3-03bd20e66884 req-497a33d6-b480-44ee-b5e6-7a1fa53b49e1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:06.851402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-91dd19aa-2919-4324-bab3-03bd20e66884 req-497a33d6-b480-44ee-b5e6-7a1fa53b49e1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:06.880998 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-91dd19aa-2919-4324-bab3-03bd20e66884 req-497a33d6-b480-44ee-b5e6-7a1fa53b49e1 service nova] Creating event network-changed:94292363-2ffc-491a-a278-eb63c9334b1f for instance 05873cb2-4587-4714-a252-49a90edbabd2 on n-h1-843621-1 May 27 15:03:06.889938 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-91dd19aa-2919-4324-bab3-03bd20e66884 req-497a33d6-b480-44ee-b5e6-7a1fa53b49e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053485 May 27 15:03:06.891078 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 696/1379] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:06.896756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-051adea1-0a6a-4031-8dce-8906d4efc76d tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc7769903a0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:07.033282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-58549f09-0fe9-4fc8-a6e7-d476a77787f5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:07.042636 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-58549f09-0fe9-4fc8-a6e7-d476a77787f5 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1466 microversion: 2.1 time: 0.335895 May 27 15:03:07.043247 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 684/1380] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:06 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1466 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:07.127945 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-051adea1-0a6a-4031-8dce-8906d4efc76d tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images?changes-since=2022-05-27T15%3A01%3A13Z" status: 200 len: 2375 microversion: 2.1 time: 0.234796 May 27 15:03:07.129622 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 697/1381] 10.222.0.13 () {58 vars in 1198 bytes} [Fri May 27 15:03:06 2022] GET /compute/v2.1/images?changes-since=2022-05-27T15%3A01%3A13Z => generated 2375 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:07.154347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0beb9bf4-e09d-4810-a9dc-a500bccc0fd3 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776be3280>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:07.236852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:07.238826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:07.244345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-118ddfa7-0d02-447f-a343-cadc3ad43ed1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:07.245319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-118ddfa7-0d02-447f-a343-cadc3ad43ed1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:07.284014 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0beb9bf4-e09d-4810-a9dc-a500bccc0fd3 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-88682750" status: 200 len: 483 microversion: 2.1 time: 0.144058 May 27 15:03:07.285345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-118ddfa7-0d02-447f-a343-cadc3ad43ed1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:07.286201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-118ddfa7-0d02-447f-a343-cadc3ad43ed1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:07.287326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-118ddfa7-0d02-447f-a343-cadc3ad43ed1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:07.288084 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 685/1382] 10.222.0.13 () {58 vars in 1226 bytes} [Fri May 27 15:03:07 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-88682750 => generated 483 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:07.293348 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-19779415-0a60-48fd-80ca-82254c6b92cc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:07.293571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-118ddfa7-0d02-447f-a343-cadc3ad43ed1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:07.300334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-19779415-0a60-48fd-80ca-82254c6b92cc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:07.318825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-19779415-0a60-48fd-80ca-82254c6b92cc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:07.319552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-19779415-0a60-48fd-80ca-82254c6b92cc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:07.320499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-19779415-0a60-48fd-80ca-82254c6b92cc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:07.321119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-19779415-0a60-48fd-80ca-82254c6b92cc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:07.931893 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-118ddfa7-0d02-447f-a343-cadc3ad43ed1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:07.946212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-118ddfa7-0d02-447f-a343-cadc3ad43ed1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:07.947949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-118ddfa7-0d02-447f-a343-cadc3ad43ed1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:07.949430 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-118ddfa7-0d02-447f-a343-cadc3ad43ed1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1797 microversion: 2.32 time: 0.714467 May 27 15:03:07.950739 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 698/1383] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:07 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1797 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:03:07.953554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-19779415-0a60-48fd-80ca-82254c6b92cc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:07.959304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5979d5b7-5d4e-42f7-9059-edb10f4292ec tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc7768904c0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:07.962119 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-19779415-0a60-48fd-80ca-82254c6b92cc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0" status: 200 len: 1319 microversion: 2.1 time: 0.672397 May 27 15:03:07.970603 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 686/1384] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:07 2022] GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 => generated 1319 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:07.988662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-25d887f3-17f1-4068-9e29-5b36ae095355 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:07.992609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-25d887f3-17f1-4068-9e29-5b36ae095355 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:08.014802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-25d887f3-17f1-4068-9e29-5b36ae095355 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:08.024660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-25d887f3-17f1-4068-9e29-5b36ae095355 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:08.025538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-25d887f3-17f1-4068-9e29-5b36ae095355 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:08.025994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-25d887f3-17f1-4068-9e29-5b36ae095355 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:08.187539 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5979d5b7-5d4e-42f7-9059-edb10f4292ec tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images?server=73173e14-0308-44e3-adc9-8bbd5509246c" status: 200 len: 956 microversion: 2.1 time: 0.235021 May 27 15:03:08.198277 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 699/1385] 10.222.0.13 () {58 vars in 1208 bytes} [Fri May 27 15:03:07 2022] GET /compute/v2.1/images?server=73173e14-0308-44e3-adc9-8bbd5509246c => generated 956 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:08.209186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4de7fe86-e5fb-4151-a2a6-bca07ad9f17c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc7767198b0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:08.302911 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4de7fe86-e5fb-4151-a2a6-bca07ad9f17c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984" status: 200 len: 1412 microversion: 2.1 time: 0.103206 May 27 15:03:08.305540 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 700/1386] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:08 2022] GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984 => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:08.315533 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9cce9154-7307-428b-b20e-57e69f2328e3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:08.316500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9cce9154-7307-428b-b20e-57e69f2328e3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:08.330393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cce9154-7307-428b-b20e-57e69f2328e3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:08.331860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cce9154-7307-428b-b20e-57e69f2328e3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:08.334025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cce9154-7307-428b-b20e-57e69f2328e3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:08.335584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cce9154-7307-428b-b20e-57e69f2328e3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:08.569626 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-25d887f3-17f1-4068-9e29-5b36ae095355 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:08.586266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-25d887f3-17f1-4068-9e29-5b36ae095355 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:08.593586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-25d887f3-17f1-4068-9e29-5b36ae095355 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:08.598862 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-25d887f3-17f1-4068-9e29-5b36ae095355 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1292 microversion: 2.25 time: 0.620017 May 27 15:03:08.602583 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 687/1387] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:07 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1292 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:08.620006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-198717e4-6d70-4bf3-ae42-60ba878540d5 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776bca700>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:08.722669 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-198717e4-6d70-4bf3-ae42-60ba878540d5 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fv2.1%2Fservers%2F30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 485 microversion: 2.1 time: 0.118473 May 27 15:03:08.724390 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 688/1388] 10.222.0.13 () {58 vars in 1316 bytes} [Fri May 27 15:03:08 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fv2.1%2Fservers%2F30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 485 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:08.737196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-da139e0e-5f9b-474b-ad0b-f23f85b17ba5 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776be3a60>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:08.814895 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-da139e0e-5f9b-474b-ad0b-f23f85b17ba5 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fservers%2F30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 485 microversion: 2.1 time: 0.082931 May 27 15:03:08.815978 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 689/1389] 10.222.0.13 () {58 vars in 1302 bytes} [Fri May 27 15:03:08 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fservers%2F30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 485 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:08.829286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-37b0d4df-75b8-4394-8f20-05f649fbdeb7 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776bca040>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:08.966297 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-37b0d4df-75b8-4394-8f20-05f649fbdeb7 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3705 microversion: 2.1 time: 0.141298 May 27 15:03:08.967353 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 690/1390] 10.222.0.13 () {58 vars in 1148 bytes} [Fri May 27 15:03:08 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3705 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:03:08.972559 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d70294bc-05ef-48fc-a017-8e702897edca tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:08.973355 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d70294bc-05ef-48fc-a017-8e702897edca tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:08.981414 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d70294bc-05ef-48fc-a017-8e702897edca tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:08.982009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d70294bc-05ef-48fc-a017-8e702897edca tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:08.983042 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d70294bc-05ef-48fc-a017-8e702897edca tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:08.983709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d70294bc-05ef-48fc-a017-8e702897edca tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:09.063962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9cce9154-7307-428b-b20e-57e69f2328e3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5a825c2385e490d81ddcbc2de76980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369228028774765965f3cf001f8806a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:09.073212 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9cce9154-7307-428b-b20e-57e69f2328e3 tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 200 len: 1466 microversion: 2.1 time: 0.764718 May 27 15:03:09.073797 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 701/1391] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:08 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 1466 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:09.089636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bc331183-77f7-4879-b37d-3e5dd68608fc tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc77754ddc0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:09.236447 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bc331183-77f7-4879-b37d-3e5dd68608fc tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.152697 May 27 15:03:09.249244 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 702/1392] 10.222.0.13 () {58 vars in 1148 bytes} [Fri May 27 15:03:09 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:09.263666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0c096d75-3278-4000-9605-04d98e27cb97 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:09.264354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0c096d75-3278-4000-9605-04d98e27cb97 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:09.285023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c096d75-3278-4000-9605-04d98e27cb97 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:09.285488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c096d75-3278-4000-9605-04d98e27cb97 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:09.286402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c096d75-3278-4000-9605-04d98e27cb97 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:09.286901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c096d75-3278-4000-9605-04d98e27cb97 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:09.429614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d70294bc-05ef-48fc-a017-8e702897edca tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:09.443345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d70294bc-05ef-48fc-a017-8e702897edca tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:09.444904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d70294bc-05ef-48fc-a017-8e702897edca tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:09.446087 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d70294bc-05ef-48fc-a017-8e702897edca tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1797 microversion: 2.32 time: 0.477704 May 27 15:03:09.446830 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 691/1393] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:08 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1797 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:09.465731 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6ed0bd48-ba3d-4a83-abc3-6661bd034967 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776bfad30>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:09.650488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0c096d75-3278-4000-9605-04d98e27cb97 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:09.667199 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0c096d75-3278-4000-9605-04d98e27cb97 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0" status: 200 len: 1469 microversion: 2.1 time: 0.405138 May 27 15:03:09.670561 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 703/1394] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:09 2022] GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 => generated 1469 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:09.674984 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6ed0bd48-ba3d-4a83-abc3-6661bd034967 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.216804 May 27 15:03:09.679479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-05e5a144-fbd7-439e-a1e2-60ae2d87866a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776890160>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:09.704507 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 692/1395] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 15:03:09 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:09.725862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fae38163-a45b-4f1f-abf2-710a43dc6cf7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:09.726491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fae38163-a45b-4f1f-abf2-710a43dc6cf7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:09.764404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fae38163-a45b-4f1f-abf2-710a43dc6cf7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:09.765351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fae38163-a45b-4f1f-abf2-710a43dc6cf7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:09.768101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fae38163-a45b-4f1f-abf2-710a43dc6cf7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:09.778498 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-05e5a144-fbd7-439e-a1e2-60ae2d87866a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984" status: 200 len: 1412 microversion: 2.1 time: 0.104800 May 27 15:03:09.779220 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 704/1396] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:09 2022] GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:09.781291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fae38163-a45b-4f1f-abf2-710a43dc6cf7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:09.791219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-536205c2-efe6-4520-a954-6a3f12bf7c12 req-b34450d2-3e52-415c-8859-e57b21eb3533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73173e14-0308-44e3-adc9-8bbd5509246c", "name": "network-vif-unplugged", "status": "completed", "tag": "f1f01d43-89a5-406d-9090-8469b79684bd"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:09.826502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-536205c2-efe6-4520-a954-6a3f12bf7c12 req-b34450d2-3e52-415c-8859-e57b21eb3533 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:09.827433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-536205c2-efe6-4520-a954-6a3f12bf7c12 req-b34450d2-3e52-415c-8859-e57b21eb3533 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:09.858803 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-536205c2-efe6-4520-a954-6a3f12bf7c12 req-b34450d2-3e52-415c-8859-e57b21eb3533 service nova] Creating event network-vif-unplugged:f1f01d43-89a5-406d-9090-8469b79684bd for instance 73173e14-0308-44e3-adc9-8bbd5509246c on n-h2-843621-1 May 27 15:03:09.895048 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-536205c2-efe6-4520-a954-6a3f12bf7c12 req-b34450d2-3e52-415c-8859-e57b21eb3533 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107350 May 27 15:03:09.896462 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 705/1397] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:10.103112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fae38163-a45b-4f1f-abf2-710a43dc6cf7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:10.119945 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-f7d3ba79-36e3-4200-a197-4408810a3713 req-a5459b2a-270e-4890-b0e2-b6b9a602db59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f37dbb2d-08d2-4f90-9c36-d373a0dec9d5", "name": "network-vif-deleted", "tag": "a88e358c-7366-488d-b011-77c43429e37d"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:10.127027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fae38163-a45b-4f1f-abf2-710a43dc6cf7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:10.131678 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fae38163-a45b-4f1f-abf2-710a43dc6cf7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:10.135371 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fae38163-a45b-4f1f-abf2-710a43dc6cf7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1292 microversion: 2.25 time: 0.428211 May 27 15:03:10.154899 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 693/1398] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:09 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1292 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:10.156912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-f7d3ba79-36e3-4200-a197-4408810a3713 req-a5459b2a-270e-4890-b0e2-b6b9a602db59 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:10.160494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-f7d3ba79-36e3-4200-a197-4408810a3713 req-a5459b2a-270e-4890-b0e2-b6b9a602db59 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:10.182103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fc08bae7-f3ed-4259-a4f8-32bc3359b46b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776bfa820>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:10.197976 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-f7d3ba79-36e3-4200-a197-4408810a3713 req-a5459b2a-270e-4890-b0e2-b6b9a602db59 service nova] Creating event network-vif-deleted:a88e358c-7366-488d-b011-77c43429e37d for instance f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 on n-h2-843621-1 May 27 15:03:10.213407 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-f7d3ba79-36e3-4200-a197-4408810a3713 req-a5459b2a-270e-4890-b0e2-b6b9a602db59 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.313847 May 27 15:03:10.216980 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 706/1399] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:10.234291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-88830fd5-a0b4-4034-b798-efcbede6c7cd tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:10.238993 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-88830fd5-a0b4-4034-b798-efcbede6c7cd tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 31db04fa-a046-4535-8191-c7db2b34a029] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:10.253901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88830fd5-a0b4-4034-b798-efcbede6c7cd tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:10.254362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88830fd5-a0b4-4034-b798-efcbede6c7cd tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:10.257019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88830fd5-a0b4-4034-b798-efcbede6c7cd tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:10.257781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88830fd5-a0b4-4034-b798-efcbede6c7cd tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:10.436086 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fc08bae7-f3ed-4259-a4f8-32bc3359b46b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/detail?changes-since=2022-05-27T15%3A01%3A08Z" status: 200 len: 6326 microversion: 2.1 time: 0.279753 May 27 15:03:10.437980 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 694/1400] 10.222.0.13 () {58 vars in 1219 bytes} [Fri May 27 15:03:10 2022] GET /compute/v2.1/images/detail?changes-since=2022-05-27T15%3A01%3A08Z => generated 6326 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:10.461037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-be8386c9-f511-4b41-a7dc-e626d0e8f89c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:10.461855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-be8386c9-f511-4b41-a7dc-e626d0e8f89c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] [instance: f37dbb2d-08d2-4f90-9c36-d373a0dec9d5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:10.480233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be8386c9-f511-4b41-a7dc-e626d0e8f89c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:10.480933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be8386c9-f511-4b41-a7dc-e626d0e8f89c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:10.481884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be8386c9-f511-4b41-a7dc-e626d0e8f89c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:10.482439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be8386c9-f511-4b41-a7dc-e626d0e8f89c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:10.537137 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-be8386c9-f511-4b41-a7dc-e626d0e8f89c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] HTTP exception thrown: Instance f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 could not be found. May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-be8386c9-f511-4b41-a7dc-e626d0e8f89c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Request method failure captured: May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 HTTP/1.1 May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikObYSjb6MvGIY6lnXWeRgbRH8-3u-XeAD_M8gYclQB86P0-vJ0O-mlRXOOdgi9Ciokk3zvlbORmJSvIjMH0aKkVptvuW2jGpVP3aAHzMMuyeEkxvb2vuUmANHcgU-82521qHqIJuUMKjFEpA46unHpTCNcDkvT0KB5fohpXq-D8gFBk May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 7369228028774765965f3cf001f8806a May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-MigrationsAdminTest-2005600101 May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7369228028774765965f3cf001f8806a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7369228028774765965f3cf001f8806a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7369228028774765965f3cf001f8806a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7369228028774765965f3cf001f8806a", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-MigrationsAdminTest-2005600101 May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 7369228028774765965f3cf001f8806a May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-MigrationsAdminTest-2005600101 May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-MigrationsAdminTest-2005600101-project May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: a5a825c2385e490d81ddcbc2de76980d May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-MigrationsAdminTest-2005600101-project May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 could not be found. May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'f37dbb2d-08d2-4f90-9c36-d373a0dec9d5'} May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 could not be found. May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 could not be found. May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:03:10.539042 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:03:10.543904 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:10.543904 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:03:10.543904 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:03:10.543904 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:03:10.543904 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:03:10.543904 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 could not be found. May 27 15:03:10.543904 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:03:10.544483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-88830fd5-a0b4-4034-b798-efcbede6c7cd tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:10.544595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-be8386c9-f511-4b41-a7dc-e626d0e8f89c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] Returning 404 to user: Instance f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:03:10.545664 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-be8386c9-f511-4b41-a7dc-e626d0e8f89c tempest-MigrationsAdminTest-2005600101 tempest-MigrationsAdminTest-2005600101-project] 10.222.0.13 "GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5" status: 404 len: 111 microversion: 2.1 time: 0.105978 May 27 15:03:10.546647 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 695/1401] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:10 2022] GET /compute/v2.1/servers/f37dbb2d-08d2-4f90-9c36-d373a0dec9d5 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:03:10.553240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-86be6fd9-c52f-4318-a4ce-ef49e65c5485 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776bf6940>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:10.570590 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-88830fd5-a0b4-4034-b798-efcbede6c7cd tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/31db04fa-a046-4535-8191-c7db2b34a029" status: 200 len: 1469 microversion: 2.1 time: 0.347540 May 27 15:03:10.584617 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 707/1402] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:10 2022] GET /compute/v2.1/servers/31db04fa-a046-4535-8191-c7db2b34a029 => generated 1469 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:10.591688 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-43195a0b-6ad9-446a-aa85-627efe9a0c1e tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:10.591688 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-43195a0b-6ad9-446a-aa85-627efe9a0c1e tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:10.598794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-43195a0b-6ad9-446a-aa85-627efe9a0c1e tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:10.599272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-43195a0b-6ad9-446a-aa85-627efe9a0c1e tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:10.600156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-43195a0b-6ad9-446a-aa85-627efe9a0c1e tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:10.600614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-43195a0b-6ad9-446a-aa85-627efe9a0c1e tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:10.646422 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-86be6fd9-c52f-4318-a4ce-ef49e65c5485 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-88682750" status: 200 len: 663 microversion: 2.1 time: 0.098483 May 27 15:03:10.658634 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 696/1403] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 15:03:10 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-88682750 => generated 663 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:10.667330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dada49ff-4c56-465b-8716-d06219723679 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:10.673445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dada49ff-4c56-465b-8716-d06219723679 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:10.677036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dada49ff-4c56-465b-8716-d06219723679 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Searching by: {'reservation_id': 'r-gzn5xl1f', 'deleted': False, 'project_id': 'a081b119396543ad8ac9421acc677175'} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:03:10.692094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dada49ff-4c56-465b-8716-d06219723679 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:10.697603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dada49ff-4c56-465b-8716-d06219723679 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:10.698934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dada49ff-4c56-465b-8716-d06219723679 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:10.699509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dada49ff-4c56-465b-8716-d06219723679 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:10.815268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-43195a0b-6ad9-446a-aa85-627efe9a0c1e tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:10.831038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-43195a0b-6ad9-446a-aa85-627efe9a0c1e tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:10.832777 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-43195a0b-6ad9-446a-aa85-627efe9a0c1e tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:10.834334 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-43195a0b-6ad9-446a-aa85-627efe9a0c1e tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1843 microversion: 2.32 time: 0.248507 May 27 15:03:10.835308 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 708/1404] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:10 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1843 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:10.841300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6a96e037-5766-4f22-b195-d6fc66803884 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc77754ddc0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:10.920865 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6a96e037-5766-4f22-b195-d6fc66803884 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fv2.1%2Fservers%2F30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 1465 microversion: 2.1 time: 0.084160 May 27 15:03:10.921941 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 709/1405] 10.222.0.13 () {58 vars in 1337 bytes} [Fri May 27 15:03:10 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fv2.1%2Fservers%2F30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 1465 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:10.928191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3ecffd38-65c6-447d-b2e3-03662c5bdf04 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776893c10>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:10.964067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.multi_cell_list [None req-dada49ff-4c56-465b-8716-d06219723679 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119249) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:03:10.996284 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3ecffd38-65c6-447d-b2e3-03662c5bdf04 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984" status: 200 len: 1412 microversion: 2.1 time: 0.073073 May 27 15:03:10.998464 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 710/1406] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:10 2022] GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984 => generated 1412 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:11.005080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3144075d-3d4f-45a2-b8c5-d419de7d7348 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776719670>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:11.084098 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3144075d-3d4f-45a2-b8c5-d419de7d7348 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fservers%2F30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 1465 microversion: 2.1 time: 0.084341 May 27 15:03:11.085433 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 711/1407] 10.222.0.13 () {58 vars in 1323 bytes} [Fri May 27 15:03:10 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.13%2Fcompute%2Fservers%2F30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 1465 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:11.121562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4dd7e6e0-35da-4743-9c05-e08e743624e0 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc7768dff70>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:11.292050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dada49ff-4c56-465b-8716-d06219723679 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:11.300963 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4dd7e6e0-35da-4743-9c05-e08e743624e0 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7789 microversion: 2.1 time: 0.196213 May 27 15:03:11.302690 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 712/1408] 10.222.0.13 () {58 vars in 1169 bytes} [Fri May 27 15:03:11 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7789 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:11.305116 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dada49ff-4c56-465b-8716-d06219723679 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:11.305865 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dada49ff-4c56-465b-8716-d06219723679 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:11.310079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ec9661a5-75fa-4169-a2c2-e7e95b408730 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:11.310967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ec9661a5-75fa-4169-a2c2-e7e95b408730 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:11.320829 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec9661a5-75fa-4169-a2c2-e7e95b408730 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:11.322271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec9661a5-75fa-4169-a2c2-e7e95b408730 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:11.323635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec9661a5-75fa-4169-a2c2-e7e95b408730 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:11.324332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec9661a5-75fa-4169-a2c2-e7e95b408730 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:11.721525 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dada49ff-4c56-465b-8716-d06219723679 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?reservation_id=r-gzn5xl1f" status: 200 len: 2931 microversion: 2.1 time: 1.070879 May 27 15:03:11.722651 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 697/1409] 10.222.0.13 () {58 vars in 1196 bytes} [Fri May 27 15:03:10 2022] GET /compute/v2.1/servers/detail?reservation_id=r-gzn5xl1f => generated 2931 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:11.729152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f3276e54-a8a6-4916-bc74-956e9b090dcc tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776be38b0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:11.866291 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f3276e54-a8a6-4916-bc74-956e9b090dcc tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.140159 May 27 15:03:11.867117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ec9661a5-75fa-4169-a2c2-e7e95b408730 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:11.870329 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 698/1410] 10.222.0.13 () {58 vars in 1169 bytes} [Fri May 27 15:03:11 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:11.889272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8c6a4ea5-ee5e-4117-9549-55b19beb3875 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:11.903179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ec9661a5-75fa-4169-a2c2-e7e95b408730 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:11.905892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ec9661a5-75fa-4169-a2c2-e7e95b408730 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:11.916269 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ec9661a5-75fa-4169-a2c2-e7e95b408730 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1292 microversion: 2.25 time: 0.608694 May 27 15:03:11.931793 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 713/1411] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:11 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1292 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:11.951223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fa5c199f-333b-4bea-81de-13a622eb8044 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:11.959677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fa5c199f-333b-4bea-81de-13a622eb8044 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:11.973006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa5c199f-333b-4bea-81de-13a622eb8044 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:11.973515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa5c199f-333b-4bea-81de-13a622eb8044 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:11.975238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa5c199f-333b-4bea-81de-13a622eb8044 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:11.975687 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa5c199f-333b-4bea-81de-13a622eb8044 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:11.977571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.compute.server_groups [None req-8c6a4ea5-ee5e-4117-9549-55b19beb3875 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Querying cell 57e0886a-3e0a-4a65-b585-e8d63742d44b(cell1) for 2 instances {{(pid=119249) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 27 15:03:11.978422 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c6a4ea5-ee5e-4117-9549-55b19beb3875 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:11.978996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c6a4ea5-ee5e-4117-9549-55b19beb3875 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:12.082173 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8c6a4ea5-ee5e-4117-9549-55b19beb3875 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/1ed3038c-7c93-45cf-b931-4568dc0d8fe3" status: 200 len: 266 microversion: 2.1 time: 0.210661 May 27 15:03:12.085371 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 699/1412] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 15:03:11 2022] GET /compute/v2.1/os-server-groups/1ed3038c-7c93-45cf-b931-4568dc0d8fe3 => generated 266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:12.099308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-12502057-8089-4241-bd93-65f5a0f72c13 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776b93b80>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:12.207563 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-12502057-8089-4241-bd93-65f5a0f72c13 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/346e776e-8931-417f-87da-575810efb12b" status: 200 len: 784 microversion: 2.1 time: 0.119437 May 27 15:03:12.209915 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 700/1413] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:12 2022] GET /compute/v2.1/images/346e776e-8931-417f-87da-575810efb12b => generated 784 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:12.223630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8b06eee6-cf85-4c65-b5d2-439475dac50d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776bfa3a0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:12.311175 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8b06eee6-cf85-4c65-b5d2-439475dac50d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984" status: 200 len: 1412 microversion: 2.1 time: 0.099825 May 27 15:03:12.312524 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 701/1414] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:12 2022] GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984 => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:12.326361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-740dc7e9-d7c5-496f-a998-ecc154f01ece req-c830e702-0284-4dfd-a400-bcd0493312b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "tag": "48a86e26-7a18-41f0-bb5d-f642d2334344"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:12.344790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-740dc7e9-d7c5-496f-a998-ecc154f01ece req-c830e702-0284-4dfd-a400-bcd0493312b3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:12.357615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-740dc7e9-d7c5-496f-a998-ecc154f01ece req-c830e702-0284-4dfd-a400-bcd0493312b3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:12.397571 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-740dc7e9-d7c5-496f-a998-ecc154f01ece req-c830e702-0284-4dfd-a400-bcd0493312b3 service nova] Creating event network-changed:48a86e26-7a18-41f0-bb5d-f642d2334344 for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:03:12.405993 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-740dc7e9-d7c5-496f-a998-ecc154f01ece req-c830e702-0284-4dfd-a400-bcd0493312b3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090430 May 27 15:03:12.408536 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 702/1415] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:12.415850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-795a2a64-6eb1-4830-ab10-a27342dda53b tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:12.421776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-795a2a64-6eb1-4830-ab10-a27342dda53b tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:12.433902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-795a2a64-6eb1-4830-ab10-a27342dda53b tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:12.437192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-795a2a64-6eb1-4830-ab10-a27342dda53b tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:12.438720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-795a2a64-6eb1-4830-ab10-a27342dda53b tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:12.451106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-795a2a64-6eb1-4830-ab10-a27342dda53b tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:12.607026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fa5c199f-333b-4bea-81de-13a622eb8044 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:12.626966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fa5c199f-333b-4bea-81de-13a622eb8044 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:12.638254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fa5c199f-333b-4bea-81de-13a622eb8044 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:12.640889 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fa5c199f-333b-4bea-81de-13a622eb8044 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1843 microversion: 2.32 time: 0.714611 May 27 15:03:12.649520 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 714/1416] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:11 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1843 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:12.669839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-faab3b41-3d64-4f68-8774-54b4d4564990 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc7768dfaf0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:12.755799 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-faab3b41-3d64-4f68-8774-54b4d4564990 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.094867 May 27 15:03:12.756439 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 715/1417] 10.222.0.13 () {58 vars in 1157 bytes} [Fri May 27 15:03:12 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:12.772995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e758df6-31d8-4add-89e4-23508ce2bc0f tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776893af0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:12.976300 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-795a2a64-6eb1-4830-ab10-a27342dda53b tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0" status: 200 len: 1620 microversion: 2.1 time: 0.565152 May 27 15:03:12.979062 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 703/1418] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:12 2022] GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 => generated 1620 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:13.002818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c9b2b7f7-e7ec-429e-90ac-0aa096cd94ac tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:13.004978 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c9b2b7f7-e7ec-429e-90ac-0aa096cd94ac tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:13.015921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9b2b7f7-e7ec-429e-90ac-0aa096cd94ac tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:13.022633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9b2b7f7-e7ec-429e-90ac-0aa096cd94ac tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:13.025144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9b2b7f7-e7ec-429e-90ac-0aa096cd94ac tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:13.031091 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9b2b7f7-e7ec-429e-90ac-0aa096cd94ac tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:13.582053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c9b2b7f7-e7ec-429e-90ac-0aa096cd94ac tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:13.601825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c9b2b7f7-e7ec-429e-90ac-0aa096cd94ac tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:13.607363 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c9b2b7f7-e7ec-429e-90ac-0aa096cd94ac tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:13.609999 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c9b2b7f7-e7ec-429e-90ac-0aa096cd94ac tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1292 microversion: 2.25 time: 0.613925 May 27 15:03:13.613109 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 704/1419] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:12 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1292 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:13.628001 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-879f85c9-f4c4-489a-9490-74c1c18d6850 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:13.631941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-879f85c9-f4c4-489a-9490-74c1c18d6850 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] [instance: 31db04fa-a046-4535-8191-c7db2b34a029] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:13.650606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-879f85c9-f4c4-489a-9490-74c1c18d6850 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:13.658146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-879f85c9-f4c4-489a-9490-74c1c18d6850 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:13.659259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-879f85c9-f4c4-489a-9490-74c1c18d6850 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:13.660730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-879f85c9-f4c4-489a-9490-74c1c18d6850 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:14.143643 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-879f85c9-f4c4-489a-9490-74c1c18d6850 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/31db04fa-a046-4535-8191-c7db2b34a029" status: 200 len: 1620 microversion: 2.1 time: 0.525616 May 27 15:03:14.162355 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 705/1420] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:13 2022] GET /compute/v2.1/servers/31db04fa-a046-4535-8191-c7db2b34a029 => generated 1620 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:14.181368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b8b97ccd-f990-4187-b691-4070ab6433cc tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:14.183959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b8b97ccd-f990-4187-b691-4070ab6433cc tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:14.193873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8b97ccd-f990-4187-b691-4070ab6433cc tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:14.194625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8b97ccd-f990-4187-b691-4070ab6433cc tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:14.195568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8b97ccd-f990-4187-b691-4070ab6433cc tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:14.196168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8b97ccd-f990-4187-b691-4070ab6433cc tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:14.262045 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b8b97ccd-f990-4187-b691-4070ab6433cc tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.098351 May 27 15:03:14.265212 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 706/1421] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:03:14 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:03:14.302859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-df1f05ad-d440-4350-ba62-881262c7f283 tempest-VolumesAdminNegativeTest-570021324 tempest-VolumesAdminNegativeTest-570021324-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "faa829c0-afdc-4131-b295-843966fe1b04"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:14.305149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-df1f05ad-d440-4350-ba62-881262c7f283 tempest-VolumesAdminNegativeTest-570021324 tempest-VolumesAdminNegativeTest-570021324-project-admin] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:14.330110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df1f05ad-d440-4350-ba62-881262c7f283 tempest-VolumesAdminNegativeTest-570021324 tempest-VolumesAdminNegativeTest-570021324-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:14.330110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df1f05ad-d440-4350-ba62-881262c7f283 tempest-VolumesAdminNegativeTest-570021324 tempest-VolumesAdminNegativeTest-570021324-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:14.330824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df1f05ad-d440-4350-ba62-881262c7f283 tempest-VolumesAdminNegativeTest-570021324 tempest-VolumesAdminNegativeTest-570021324-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:14.331266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df1f05ad-d440-4350-ba62-881262c7f283 tempest-VolumesAdminNegativeTest-570021324 tempest-VolumesAdminNegativeTest-570021324-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:14.385694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:14.964419 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e758df6-31d8-4add-89e4-23508ce2bc0f tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "DELETE /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff" status: 204 len: 0 microversion: 2.1 time: 2.191957 May 27 15:03:14.964419 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 716/1422] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:12 2022] DELETE /compute/v2.1/images/8325ffc9-7950-4b7d-b4e9-119fb8d660ff => generated 0 bytes in 2193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:03:14.971060 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-580fe006-5cc5-469e-a440-d7518cefdb18 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc7769c4940>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:15.080237 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-580fe006-5cc5-469e-a440-d7518cefdb18 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984" status: 200 len: 1412 microversion: 2.1 time: 0.115336 May 27 15:03:15.081158 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 717/1423] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:14 2022] GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984 => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:15.092076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3d9383a8-8587-41ba-9479-6fc7cce641d9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:15.093296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3d9383a8-8587-41ba-9479-6fc7cce641d9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:15.128161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d9383a8-8587-41ba-9479-6fc7cce641d9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:15.128623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d9383a8-8587-41ba-9479-6fc7cce641d9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:15.129527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d9383a8-8587-41ba-9479-6fc7cce641d9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:15.129886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d9383a8-8587-41ba-9479-6fc7cce641d9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:15.548901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3d9383a8-8587-41ba-9479-6fc7cce641d9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:15.552827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:15.564030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3d9383a8-8587-41ba-9479-6fc7cce641d9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:15.566642 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3d9383a8-8587-41ba-9479-6fc7cce641d9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:15.570014 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3d9383a8-8587-41ba-9479-6fc7cce641d9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.485045 May 27 15:03:15.571393 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 718/1424] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:15 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:15.577532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7e67ad26-0b1c-428d-ae9a-ba9ed738764e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Action: 'create', calling method: .version_select at 0x7fc7768dfc10>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1925270134", "policies": ["anti-affinity"]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:15.601003 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-7e67ad26-0b1c-428d-ae9a-ba9ed738764e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for project a081b119396543ad8ac9421acc677175. Resources: {'server_groups'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:15.608701 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-7e67ad26-0b1c-428d-ae9a-ba9ed738764e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for user f426b883acdc49f8b0c4a9ba68e4572b and project a081b119396543ad8ac9421acc677175. Resources: {'server_groups'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:15.676079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-7e67ad26-0b1c-428d-ae9a-ba9ed738764e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for project a081b119396543ad8ac9421acc677175. Resources: {'server_groups'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:15.684421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-7e67ad26-0b1c-428d-ae9a-ba9ed738764e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for user f426b883acdc49f8b0c4a9ba68e4572b and project a081b119396543ad8ac9421acc677175. Resources: {'server_groups'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:15.702765 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7e67ad26-0b1c-428d-ae9a-ba9ed738764e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.130052 May 27 15:03:15.716373 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 719/1425] 10.222.0.13 () {60 vars in 1173 bytes} [Fri May 27 15:03:15 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:15.727083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-73a46a38-5486-4b64-963f-9a687d19aa49 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:15.727907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-73a46a38-5486-4b64-963f-9a687d19aa49 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:15.736977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73a46a38-5486-4b64-963f-9a687d19aa49 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:15.737896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73a46a38-5486-4b64-963f-9a687d19aa49 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:15.738930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73a46a38-5486-4b64-963f-9a687d19aa49 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:15.739614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73a46a38-5486-4b64-963f-9a687d19aa49 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:15.969659 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-73a46a38-5486-4b64-963f-9a687d19aa49 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:15.979177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-73a46a38-5486-4b64-963f-9a687d19aa49 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:15.981142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-73a46a38-5486-4b64-963f-9a687d19aa49 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:15.983702 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-73a46a38-5486-4b64-963f-9a687d19aa49 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1292 microversion: 2.25 time: 0.265700 May 27 15:03:15.985233 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 720/1426] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:15 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1292 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:15.995366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-d866c903-c48c-4a19-bf55-35a54def9b6d req-d1af3b62-7c82-4563-a88e-c21e6779ed67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "tag": "71fcf64b-5a54-42bd-a04e-812ea701d6ba"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:16.006401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d866c903-c48c-4a19-bf55-35a54def9b6d req-d1af3b62-7c82-4563-a88e-c21e6779ed67 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:16.007025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d866c903-c48c-4a19-bf55-35a54def9b6d req-d1af3b62-7c82-4563-a88e-c21e6779ed67 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:16.019700 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-d866c903-c48c-4a19-bf55-35a54def9b6d req-d1af3b62-7c82-4563-a88e-c21e6779ed67 service nova] Creating event network-changed:71fcf64b-5a54-42bd-a04e-812ea701d6ba for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:03:16.024993 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-d866c903-c48c-4a19-bf55-35a54def9b6d req-d1af3b62-7c82-4563-a88e-c21e6779ed67 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037811 May 27 15:03:16.026129 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 721/1427] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:16.031485 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dd355eac-2241-40cf-a965-a61721a2e4fe tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc7768bfca0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:16.920326 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dd355eac-2241-40cf-a965-a61721a2e4fe tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "DELETE /compute/v2.1/images/5badf179-57b9-4165-b9a3-05e8c4b435bb" status: 204 len: 0 microversion: 2.1 time: 0.892802 May 27 15:03:16.921101 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 722/1428] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:16 2022] DELETE /compute/v2.1/images/5badf179-57b9-4165-b9a3-05e8c4b435bb => generated 0 bytes in 894 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:03:16.928400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1176992970", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "4756748d-e981-4a6d-bfcf-2b1c5cfe8b51"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:16.989503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] validate_networks() for None {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:03:17.235696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:03:17.236113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:03:17.236591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:03:17.237595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:03:17.238336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:03:17.261661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:17.262571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:17.263878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:17.264662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:17.278547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:17.293287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for project a081b119396543ad8ac9421acc677175. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:17.300209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for user f426b883acdc49f8b0c4a9ba68e4572b and project a081b119396543ad8ac9421acc677175. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:17.314705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Going to run 2 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:03:17.317180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: ea226b76-3184-469f-93c4-adbf4286a9e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:03:17.388204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for project a081b119396543ad8ac9421acc677175. Resources: {'server_group_members'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:17.395244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for user f426b883acdc49f8b0c4a9ba68e4572b and project a081b119396543ad8ac9421acc677175. Resources: {'server_group_members'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:17.447438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for project a081b119396543ad8ac9421acc677175. Resources: {'server_group_members'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:17.456626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for user f426b883acdc49f8b0c4a9ba68e4572b and project a081b119396543ad8ac9421acc677175. Resources: {'server_group_members'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:17.483906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 5c5472e6-8234-4e99-935f-7798245c1d2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=ea226b76-3184-469f-93c4-adbf4286a9e3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:03:17.549640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for project a081b119396543ad8ac9421acc677175. Resources: {'server_group_members'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:17.555139 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for user f426b883acdc49f8b0c4a9ba68e4572b and project a081b119396543ad8ac9421acc677175. Resources: {'server_group_members'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:17.601644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for project a081b119396543ad8ac9421acc677175. Resources: {'server_group_members'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:17.607944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for user f426b883acdc49f8b0c4a9ba68e4572b and project a081b119396543ad8ac9421acc677175. Resources: {'server_group_members'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:17.645697 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-901f4c4f-9c28-41c9-afa7-64c09e262571 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.723240 May 27 15:03:17.646642 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 723/1429] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:03:16 2022] POST /compute/v2.1/servers => generated 32 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 27 15:03:17.655242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b4eebb2c-8067-4a09-9c63-6945209ff2ca tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc7769fd940>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:17.713566 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b4eebb2c-8067-4a09-9c63-6945209ff2ca tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984" status: 200 len: 1421 microversion: 2.1 time: 0.065387 May 27 15:03:17.721163 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 724/1430] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:17 2022] GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984 => generated 1421 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:17.884529 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f90a4c82-1a2b-498f-94f7-48b4ddf062dd tempest-TenantUsagesNegativeTestJSON-1828055987 tempest-TenantUsagesNegativeTestJSON-1828055987-project-admin] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-05-26T15%3A03%3A16.288475&end=2022-05-28T15%3A03%3A16.288475" status: 404 len: 112 microversion: - time: 0.168475 May 27 15:03:17.885784 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 725/1431] 10.222.0.13 () {58 vars in 1315 bytes} [Fri May 27 15:03:17 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-05-26T15%3A03%3A16.288475&end=2022-05-28T15%3A03%3A16.288475 => generated 112 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 15:03:17.889619 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7d5b008f-beb7-404a-8235-cf2b452450ee tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:17.890243 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7d5b008f-beb7-404a-8235-cf2b452450ee tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:17.898175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d5b008f-beb7-404a-8235-cf2b452450ee tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:17.898636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d5b008f-beb7-404a-8235-cf2b452450ee tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:17.899685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d5b008f-beb7-404a-8235-cf2b452450ee tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:17.899898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d5b008f-beb7-404a-8235-cf2b452450ee tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:18.155998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7d5b008f-beb7-404a-8235-cf2b452450ee tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:18.168771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7d5b008f-beb7-404a-8235-cf2b452450ee tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:18.170312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7d5b008f-beb7-404a-8235-cf2b452450ee tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:18.172173 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7d5b008f-beb7-404a-8235-cf2b452450ee tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.285780 May 27 15:03:18.174465 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 726/1432] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:17 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:18.181535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-720349b9-8397-4180-815d-5956f0480b4e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc77699bd30>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:18.878120 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-720349b9-8397-4180-815d-5956f0480b4e tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "DELETE /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25" status: 204 len: 0 microversion: 2.1 time: 0.702292 May 27 15:03:18.878735 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 727/1433] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:18 2022] DELETE /compute/v2.1/images/45c5d8bf-5ed1-45f7-a815-744e0f4dee25 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:03:18.884497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bb4ce55b-7716-442a-bad0-22a14f43a21a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:18.885155 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bb4ce55b-7716-442a-bad0-22a14f43a21a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:18.897416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb4ce55b-7716-442a-bad0-22a14f43a21a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:18.897889 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb4ce55b-7716-442a-bad0-22a14f43a21a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:18.898680 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb4ce55b-7716-442a-bad0-22a14f43a21a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:18.903565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb4ce55b-7716-442a-bad0-22a14f43a21a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:19.072120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bb4ce55b-7716-442a-bad0-22a14f43a21a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:19.083863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bb4ce55b-7716-442a-bad0-22a14f43a21a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:19.086073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bb4ce55b-7716-442a-bad0-22a14f43a21a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:19.087599 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bb4ce55b-7716-442a-bad0-22a14f43a21a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1292 microversion: 2.25 time: 0.207566 May 27 15:03:19.088821 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 728/1434] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:18 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1292 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:19.102121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8da76e48-e5cf-41ee-b013-f3e67664b890 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:19.106462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8da76e48-e5cf-41ee-b013-f3e67664b890 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:19.108066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8da76e48-e5cf-41ee-b013-f3e67664b890 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Searching by: {'deleted': False, 'project_id': 'a081b119396543ad8ac9421acc677175'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:03:19.114811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8da76e48-e5cf-41ee-b013-f3e67664b890 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:19.116003 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8da76e48-e5cf-41ee-b013-f3e67664b890 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:19.117496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8da76e48-e5cf-41ee-b013-f3e67664b890 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:19.117951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8da76e48-e5cf-41ee-b013-f3e67664b890 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:19.153907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-8da76e48-e5cf-41ee-b013-f3e67664b890 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:03:19.199800 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8da76e48-e5cf-41ee-b013-f3e67664b890 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.109334 May 27 15:03:19.200719 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 729/1435] 10.222.0.13 () {58 vars in 1124 bytes} [Fri May 27 15:03:19 2022] GET /compute/v2.1/servers => generated 1665 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:19.217972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7c6d7340-a33f-4d93-ac56-dd57720d86a0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc77699b160>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:19.280992 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7c6d7340-a33f-4d93-ac56-dd57720d86a0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984" status: 200 len: 1421 microversion: 2.1 time: 0.078926 May 27 15:03:19.283541 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 730/1436] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:19 2022] GET /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984 => generated 1421 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:19.288295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e60cbe2d-90d9-405e-8f55-44c402b06739 tempest-TenantUsagesNegativeTestJSON-1828055987 tempest-TenantUsagesNegativeTestJSON-1828055987-project-admin] Calling method '.version_select at 0x7fc7768df550>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:19.291269 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-e60cbe2d-90d9-405e-8f55-44c402b06739 tempest-TenantUsagesNegativeTestJSON-1828055987 tempest-TenantUsagesNegativeTestJSON-1828055987-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e60cbe2d-90d9-405e-8f55-44c402b06739 tempest-TenantUsagesNegativeTestJSON-1828055987 tempest-TenantUsagesNegativeTestJSON-1828055987-project-admin] Request method failure captured: May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-simple-tenant-usage/99794384d4504738bdafd3519ae0bf1d?start=2022-05-28T15%3A03%3A16.288475&end=2022-05-26T15%3A03%3A16.288475 HTTP/1.1 May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOg0LSeWXM3pUN7f-LXUf0CcUoQIqf-ptdBs_iI64inKNhQU2HHi9PRMMzMsSFWJ9PfBqyAyAmTfr1GXJO6KcR0It4hb9wgNdceEMUe9QylH4gsN02upXGB2ENKCAJFmVzSXRW0EXOHke013KN0xmfq3gmrtbhKjCWJ9uHMkiCnCjik May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: f19c5612a6544f9eb1da8ade115f7183 May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1828055987 May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f19c5612a6544f9eb1da8ade115f7183"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f19c5612a6544f9eb1da8ade115f7183"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f19c5612a6544f9eb1da8ade115f7183"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f19c5612a6544f9eb1da8ade115f7183", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1828055987 May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: f19c5612a6544f9eb1da8ade115f7183 May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1828055987 May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-TenantUsagesNegativeTestJSON-1828055987-project-admin May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: f2072fbb747847e18ab2ce85ffd49afa May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1828055987-project-admin May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid start time. The start time cannot occur after the end time. May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '99794384d4504738bdafd3519ae0bf1d'} May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. May 27 15:03:19.293368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:19.299825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e60cbe2d-90d9-405e-8f55-44c402b06739 tempest-TenantUsagesNegativeTestJSON-1828055987 tempest-TenantUsagesNegativeTestJSON-1828055987-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:03:19.301000 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e60cbe2d-90d9-405e-8f55-44c402b06739 tempest-TenantUsagesNegativeTestJSON-1828055987 tempest-TenantUsagesNegativeTestJSON-1828055987-project-admin] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage/99794384d4504738bdafd3519ae0bf1d?start=2022-05-28T15%3A03%3A16.288475&end=2022-05-26T15%3A03%3A16.288475" status: 400 len: 111 microversion: 2.1 time: 0.016255 May 27 15:03:19.301796 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 731/1437] 10.222.0.13 () {58 vars in 1411 bytes} [Fri May 27 15:03:19 2022] GET /compute/v2.1/os-simple-tenant-usage/99794384d4504738bdafd3519ae0bf1d?start=2022-05-28T15%3A03%3A16.288475&end=2022-05-26T15%3A03%3A16.288475 => generated 111 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:03:19.306551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-5ea4af45-3283-4062-a863-8370b0168ee8 req-03cc2022-28b8-43a4-8808-92c5e5ee2dfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "tag": "45313e38-2a42-4c68-84d0-f6a729364e79"}, {"name": "network-changed", "server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "tag": "f82a5a42-f473-44b2-b255-6b333e4f281b"}, {"name": "network-changed", "server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "tag": "56ba96ed-73b1-4ad8-ad61-f82b64af6976"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:19.321848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-5ea4af45-3283-4062-a863-8370b0168ee8 req-03cc2022-28b8-43a4-8808-92c5e5ee2dfc service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:19.322405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-5ea4af45-3283-4062-a863-8370b0168ee8 req-03cc2022-28b8-43a4-8808-92c5e5ee2dfc service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:19.340653 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-5ea4af45-3283-4062-a863-8370b0168ee8 req-03cc2022-28b8-43a4-8808-92c5e5ee2dfc service nova] Creating event network-changed:45313e38-2a42-4c68-84d0-f6a729364e79 for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:03:19.341494 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-5ea4af45-3283-4062-a863-8370b0168ee8 req-03cc2022-28b8-43a4-8808-92c5e5ee2dfc service nova] Creating event network-changed:f82a5a42-f473-44b2-b255-6b333e4f281b for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:03:19.342402 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-5ea4af45-3283-4062-a863-8370b0168ee8 req-03cc2022-28b8-43a4-8808-92c5e5ee2dfc service nova] Creating event network-changed:56ba96ed-73b1-4ad8-ad61-f82b64af6976 for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:03:19.353179 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-5ea4af45-3283-4062-a863-8370b0168ee8 req-03cc2022-28b8-43a4-8808-92c5e5ee2dfc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.049842 May 27 15:03:19.354467 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 732/1438] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:19.360874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0f80c781-0800-42a1-8731-9f7eccbde987 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:19.361692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0f80c781-0800-42a1-8731-9f7eccbde987 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:19.373375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f80c781-0800-42a1-8731-9f7eccbde987 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:19.374424 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f80c781-0800-42a1-8731-9f7eccbde987 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:19.375837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f80c781-0800-42a1-8731-9f7eccbde987 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:19.376643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f80c781-0800-42a1-8731-9f7eccbde987 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:19.421152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0f80c781-0800-42a1-8731-9f7eccbde987 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:03:19.632948 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0f80c781-0800-42a1-8731-9f7eccbde987 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "DELETE /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 204 len: 0 microversion: 2.1 time: 0.276603 May 27 15:03:19.634060 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 733/1439] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:03:19 2022] DELETE /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:03:19.654265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cfae6b4f-790e-4b14-af2d-779f65ecf10c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:19.655054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cfae6b4f-790e-4b14-af2d-779f65ecf10c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:19.682818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cfae6b4f-790e-4b14-af2d-779f65ecf10c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:19.685642 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cfae6b4f-790e-4b14-af2d-779f65ecf10c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:19.692228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cfae6b4f-790e-4b14-af2d-779f65ecf10c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:19.699311 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cfae6b4f-790e-4b14-af2d-779f65ecf10c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:19.966171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cfae6b4f-790e-4b14-af2d-779f65ecf10c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:19.977355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cfae6b4f-790e-4b14-af2d-779f65ecf10c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:19.979145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cfae6b4f-790e-4b14-af2d-779f65ecf10c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:19.980320 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cfae6b4f-790e-4b14-af2d-779f65ecf10c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.345489 May 27 15:03:19.980912 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 734/1440] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:19 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:19.986096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-22c79b80-9d5e-4731-99a0-033bbf8d8233 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:19.987008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-22c79b80-9d5e-4731-99a0-033bbf8d8233 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 5c5472e6-8234-4e99-935f-7798245c1d2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:19.994241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22c79b80-9d5e-4731-99a0-033bbf8d8233 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:19.994696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22c79b80-9d5e-4731-99a0-033bbf8d8233 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:19.995634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22c79b80-9d5e-4731-99a0-033bbf8d8233 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:19.996107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22c79b80-9d5e-4731-99a0-033bbf8d8233 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:20.065862 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-22c79b80-9d5e-4731-99a0-033bbf8d8233 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:20.074518 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-22c79b80-9d5e-4731-99a0-033bbf8d8233 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f" status: 200 len: 1277 microversion: 2.1 time: 0.092410 May 27 15:03:20.075925 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 735/1441] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:19 2022] GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:20.081305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-96478e93-6c6d-4b37-9a75-c0e8e055c640 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc7769959d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:20.620271 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-96478e93-6c6d-4b37-9a75-c0e8e055c640 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "DELETE /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984" status: 204 len: 0 microversion: 2.1 time: 0.543053 May 27 15:03:20.624064 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 736/1442] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:20 2022] DELETE /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:03:20.735943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f7e0cf00-032b-4962-b4ac-1010ddd74259 tempest-TenantUsagesNegativeTestJSON-963594396 tempest-TenantUsagesNegativeTestJSON-963594396-project] Calling method '.version_select at 0x7fc7769ade50>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:20.739186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f7e0cf00-032b-4962-b4ac-1010ddd74259 tempest-TenantUsagesNegativeTestJSON-963594396 tempest-TenantUsagesNegativeTestJSON-963594396-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '89ed4a690c4b4f9990e081bc08156ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99794384d4504738bdafd3519ae0bf1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f7e0cf00-032b-4962-b4ac-1010ddd74259 tempest-TenantUsagesNegativeTestJSON-963594396 tempest-TenantUsagesNegativeTestJSON-963594396-project] Request method failure captured: May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-26T15%3A03%3A16.288475&end=2022-05-28T15%3A03%3A16.288475&detailed=1 HTTP/1.1 May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOgzqYhQ3luhVAYM0mHGYtpggxAg-dK3IgI3jdUg8zuhl6GWlsU9oqMcEza6_vqyJAR1W7RGlok9EBEraDM3SKn8luKjYaz2pmW0Tb7Wf1ccZDv8pG-d13Yche6Pm_92T1z6l8vLxyGT4tVZ-sxvHlFIWkTFPc7QgyOUw50WUPc4xUc May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 99794384d4504738bdafd3519ae0bf1d May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-963594396 May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99794384d4504738bdafd3519ae0bf1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/99794384d4504738bdafd3519ae0bf1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/99794384d4504738bdafd3519ae0bf1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_99794384d4504738bdafd3519ae0bf1d", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-963594396 May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 99794384d4504738bdafd3519ae0bf1d May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-963594396 May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-TenantUsagesNegativeTestJSON-963594396-project May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 89ed4a690c4b4f9990e081bc08156ed6 May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-963594396-project May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: action_args: {} May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._index(req) May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 15:03:20.741403 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 15:03:20.746719 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 27 15:03:20.746719 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:20.746719 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:03:20.746719 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:20.746719 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:20.746719 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:03:20.746719 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:03:20.746719 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 15:03:20.746719 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 15:03:20.746719 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 27 15:03:20.746719 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:20.746719 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f7e0cf00-032b-4962-b4ac-1010ddd74259 tempest-TenantUsagesNegativeTestJSON-963594396 tempest-TenantUsagesNegativeTestJSON-963594396-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:03:20.748145 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f7e0cf00-032b-4962-b4ac-1010ddd74259 tempest-TenantUsagesNegativeTestJSON-963594396 tempest-TenantUsagesNegativeTestJSON-963594396-project] 10.222.0.13 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-26T15%3A03%3A16.288475&end=2022-05-28T15%3A03%3A16.288475&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.122200 May 27 15:03:20.748973 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 737/1443] 10.222.0.13 () {58 vars in 1334 bytes} [Fri May 27 15:03:20 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-26T15%3A03%3A16.288475&end=2022-05-28T15%3A03%3A16.288475&detailed=1 => generated 123 bytes in 124 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 15:03:20.758404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f03dc7ce-750c-4419-9f6c-22b496ef9013 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:20.759126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f03dc7ce-750c-4419-9f6c-22b496ef9013 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:20.766584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f03dc7ce-750c-4419-9f6c-22b496ef9013 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:20.767168 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f03dc7ce-750c-4419-9f6c-22b496ef9013 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:20.768361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f03dc7ce-750c-4419-9f6c-22b496ef9013 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:20.768956 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f03dc7ce-750c-4419-9f6c-22b496ef9013 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:20.775689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:21.196860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f03dc7ce-750c-4419-9f6c-22b496ef9013 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:21.216938 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f03dc7ce-750c-4419-9f6c-22b496ef9013 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 200 len: 1473 microversion: 2.1 time: 0.458355 May 27 15:03:21.217589 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 738/1444] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:20 2022] GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 1473 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:21.233728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-bccf9ce5-44a3-41d0-9ce0-a92411465fb2 req-0002db68-5318-41a6-92c1-510cdc7683ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72bd3cf-9b54-4d56-ab10-9f2a602a15f5", "name": "network-vif-unplugged", "status": "completed", "tag": "b633ef09-5eca-4f03-95aa-8ed44cb2e4c0"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:21.253145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-bccf9ce5-44a3-41d0-9ce0-a92411465fb2 req-0002db68-5318-41a6-92c1-510cdc7683ff service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:21.253885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-bccf9ce5-44a3-41d0-9ce0-a92411465fb2 req-0002db68-5318-41a6-92c1-510cdc7683ff service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:21.274669 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-bccf9ce5-44a3-41d0-9ce0-a92411465fb2 req-0002db68-5318-41a6-92c1-510cdc7683ff service nova] Creating event network-vif-unplugged:b633ef09-5eca-4f03-95aa-8ed44cb2e4c0 for instance a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 on n-h2-843621-1 May 27 15:03:21.287352 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-bccf9ce5-44a3-41d0-9ce0-a92411465fb2 req-0002db68-5318-41a6-92c1-510cdc7683ff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056967 May 27 15:03:21.289106 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 739/1445] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:21.289818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:21.317773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ef321795-7181-49c6-8221-4d619c454144 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:21.318805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ef321795-7181-49c6-8221-4d619c454144 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:21.341360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef321795-7181-49c6-8221-4d619c454144 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:21.343214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef321795-7181-49c6-8221-4d619c454144 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:21.346188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef321795-7181-49c6-8221-4d619c454144 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:21.347488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef321795-7181-49c6-8221-4d619c454144 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:21.750649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ef321795-7181-49c6-8221-4d619c454144 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:21.768007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ef321795-7181-49c6-8221-4d619c454144 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:21.770382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ef321795-7181-49c6-8221-4d619c454144 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:21.772025 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ef321795-7181-49c6-8221-4d619c454144 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1292 microversion: 2.25 time: 0.466927 May 27 15:03:21.773678 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 740/1446] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:21 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1292 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:21.783558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4234a4e7-e981-4566-acd0-f9dd22cb877d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:21.784630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4234a4e7-e981-4566-acd0-f9dd22cb877d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:21.797805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4234a4e7-e981-4566-acd0-f9dd22cb877d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:21.798042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4234a4e7-e981-4566-acd0-f9dd22cb877d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:21.800490 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4234a4e7-e981-4566-acd0-f9dd22cb877d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:21.801166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4234a4e7-e981-4566-acd0-f9dd22cb877d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:21.840829 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4234a4e7-e981-4566-acd0-f9dd22cb877d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:03:21.989973 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4234a4e7-e981-4566-acd0-f9dd22cb877d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 204 len: 0 microversion: 2.1 time: 0.214571 May 27 15:03:21.990872 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 741/1447] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:03:21 2022] DELETE /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:03:22.002126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a02f454b-2ca6-4ebe-9432-ce78863c166f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:22.002913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a02f454b-2ca6-4ebe-9432-ce78863c166f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:22.016380 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a02f454b-2ca6-4ebe-9432-ce78863c166f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:22.016898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a02f454b-2ca6-4ebe-9432-ce78863c166f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:22.024117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a02f454b-2ca6-4ebe-9432-ce78863c166f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:22.024117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a02f454b-2ca6-4ebe-9432-ce78863c166f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:22.861955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a02f454b-2ca6-4ebe-9432-ce78863c166f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:22.872704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a02f454b-2ca6-4ebe-9432-ce78863c166f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:22.874594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a02f454b-2ca6-4ebe-9432-ce78863c166f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:22.876368 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a02f454b-2ca6-4ebe-9432-ce78863c166f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.884648 May 27 15:03:22.876975 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 742/1448] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:21 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:22.892631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ce298d4f-0b0d-48a6-818c-898647af2382 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:22.893288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ce298d4f-0b0d-48a6-818c-898647af2382 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 5c5472e6-8234-4e99-935f-7798245c1d2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:22.899033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:UPDATE=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:22.900940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ce298d4f-0b0d-48a6-818c-898647af2382 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:22.901505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ce298d4f-0b0d-48a6-818c-898647af2382 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:22.902469 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ce298d4f-0b0d-48a6-818c-898647af2382 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:22.902926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ce298d4f-0b0d-48a6-818c-898647af2382 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:22.928531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:23.182283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ce298d4f-0b0d-48a6-818c-898647af2382 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:23.190934 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ce298d4f-0b0d-48a6-818c-898647af2382 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f" status: 200 len: 1319 microversion: 2.1 time: 0.302135 May 27 15:03:23.194273 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 743/1449] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:22 2022] GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:23.202433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-5d15e7e1-c077-4ddf-b4af-c2fdacc9016c req-65eb35ad-33b8-4e77-9923-3048cfcd8106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "tag": "ffdb865a-7004-4d4e-afa6-d0613ac33132"}, {"name": "network-changed", "server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "tag": "f318c091-0a24-4179-812b-dc1ec5baf655"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:23.216922 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-5d15e7e1-c077-4ddf-b4af-c2fdacc9016c req-65eb35ad-33b8-4e77-9923-3048cfcd8106 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:23.217386 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-5d15e7e1-c077-4ddf-b4af-c2fdacc9016c req-65eb35ad-33b8-4e77-9923-3048cfcd8106 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:23.273679 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-5d15e7e1-c077-4ddf-b4af-c2fdacc9016c req-65eb35ad-33b8-4e77-9923-3048cfcd8106 service nova] Creating event network-changed:ffdb865a-7004-4d4e-afa6-d0613ac33132 for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:03:23.274310 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-5d15e7e1-c077-4ddf-b4af-c2fdacc9016c req-65eb35ad-33b8-4e77-9923-3048cfcd8106 service nova] Creating event network-changed:f318c091-0a24-4179-812b-dc1ec5baf655 for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:03:23.280575 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-5d15e7e1-c077-4ddf-b4af-c2fdacc9016c req-65eb35ad-33b8-4e77-9923-3048cfcd8106 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.081374 May 27 15:03:23.282529 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 744/1450] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:23.294501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-20b025b2-68fa-495f-8015-a51aed36fd5a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1896549840", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "5b029644-79a0-4d20-9c9d-09c8d08d8d68"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:23.398606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-20b025b2-68fa-495f-8015-a51aed36fd5a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] validate_networks() for [('5b029644-79a0-4d20-9c9d-09c8d08d8d68', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:03:24.273323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-20b025b2-68fa-495f-8015-a51aed36fd5a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:03:24.273885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-20b025b2-68fa-495f-8015-a51aed36fd5a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:03:24.274366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-20b025b2-68fa-495f-8015-a51aed36fd5a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:03:24.274795 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-20b025b2-68fa-495f-8015-a51aed36fd5a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:03:24.275224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-20b025b2-68fa-495f-8015-a51aed36fd5a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:03:24.292336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-20b025b2-68fa-495f-8015-a51aed36fd5a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:24.292835 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-20b025b2-68fa-495f-8015-a51aed36fd5a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:24.296529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-20b025b2-68fa-495f-8015-a51aed36fd5a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:24.297067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-20b025b2-68fa-495f-8015-a51aed36fd5a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:24.321286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:24.340523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-20b025b2-68fa-495f-8015-a51aed36fd5a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Getting quotas for project 1ee754951c48459888c45e9e8ec10dce. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:24.350618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-20b025b2-68fa-495f-8015-a51aed36fd5a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Getting quotas for user c118a948fbea4575813842ca30613064 and project 1ee754951c48459888c45e9e8ec10dce. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:24.383248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-20b025b2-68fa-495f-8015-a51aed36fd5a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:03:24.389861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-20b025b2-68fa-495f-8015-a51aed36fd5a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: fa3160e1-6021-4618-8d44-fb03c94ffe08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:03:24.484490 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-20b025b2-68fa-495f-8015-a51aed36fd5a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.200041 May 27 15:03:24.492287 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 745/1451] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:03:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:03:24.498267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9ce7547a-8cc9-4924-9365-8b1cfce80e06 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:24.502262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9ce7547a-8cc9-4924-9365-8b1cfce80e06 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 30fca3d4-3998-4aa2-b00c-ba71724fdfbe] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:24.521112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ce7547a-8cc9-4924-9365-8b1cfce80e06 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:24.521507 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ce7547a-8cc9-4924-9365-8b1cfce80e06 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:24.522306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ce7547a-8cc9-4924-9365-8b1cfce80e06 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:24.522749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ce7547a-8cc9-4924-9365-8b1cfce80e06 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:24.554999 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-9ce7547a-8cc9-4924-9365-8b1cfce80e06 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] HTTP exception thrown: Instance 30fca3d4-3998-4aa2-b00c-ba71724fdfbe could not be found. May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9ce7547a-8cc9-4924-9365-8b1cfce80e06 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Request method failure captured: May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe HTTP/1.1 May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOezglAWHqYnD_cPnE947Rnk1GRUjjDBAki483LWrknDY0VLyV0s73POuQJIS86HBw6cOyKc3W5zmzO-rqTwUKwWdfzs371IILsTOPzEqcTYTb9PgzbKu2DbbmOI_z7J5BV1mB6p2sq7uJmkeeFeQPKPyJp8q-_f3yJ7gpumr8EKUd4 May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 322433b59fd84c6eadc41b4d21f0601b May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ListImageFiltersTestJSON-305504672 May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/322433b59fd84c6eadc41b4d21f0601b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/322433b59fd84c6eadc41b4d21f0601b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/322433b59fd84c6eadc41b4d21f0601b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_322433b59fd84c6eadc41b4d21f0601b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ListImageFiltersTestJSON-305504672 May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 322433b59fd84c6eadc41b4d21f0601b May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-305504672 May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ListImageFiltersTestJSON-305504672-project May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 6b0b310046184dd49ba35d33ac2e958d May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ListImageFiltersTestJSON-305504672-project May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 30fca3d4-3998-4aa2-b00c-ba71724fdfbe could not be found. May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '30fca3d4-3998-4aa2-b00c-ba71724fdfbe'} May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30fca3d4-3998-4aa2-b00c-ba71724fdfbe could not be found. May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30fca3d4-3998-4aa2-b00c-ba71724fdfbe could not be found. May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:03:24.556705 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:24.562515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:24.562515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:03:24.562515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:03:24.562515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:03:24.562515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:03:24.562515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30fca3d4-3998-4aa2-b00c-ba71724fdfbe could not be found. May 27 15:03:24.562515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:24.562515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9ce7547a-8cc9-4924-9365-8b1cfce80e06 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Returning 404 to user: Instance 30fca3d4-3998-4aa2-b00c-ba71724fdfbe could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:03:24.562515 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9ce7547a-8cc9-4924-9365-8b1cfce80e06 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe" status: 404 len: 111 microversion: 2.1 time: 0.064161 May 27 15:03:24.562515 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 746/1452] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:24 2022] GET /compute/v2.1/servers/30fca3d4-3998-4aa2-b00c-ba71724fdfbe => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:03:24.575073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-09090b5b-8d07-403f-96b1-e66fc99c740a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:24.575698 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-09090b5b-8d07-403f-96b1-e66fc99c740a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:24.588805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-09090b5b-8d07-403f-96b1-e66fc99c740a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:24.589265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-09090b5b-8d07-403f-96b1-e66fc99c740a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:24.590048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-09090b5b-8d07-403f-96b1-e66fc99c740a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:24.590486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-09090b5b-8d07-403f-96b1-e66fc99c740a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:24.983666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-09090b5b-8d07-403f-96b1-e66fc99c740a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:25.000355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-09090b5b-8d07-403f-96b1-e66fc99c740a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:25.007261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-09090b5b-8d07-403f-96b1-e66fc99c740a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:25.009664 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-09090b5b-8d07-403f-96b1-e66fc99c740a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1292 microversion: 2.25 time: 0.450110 May 27 15:03:25.012810 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 747/1453] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:24 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1292 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:25.026711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d2222eed-17fd-48ad-b5cd-5cf5df81f983 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:25.026823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d2222eed-17fd-48ad-b5cd-5cf5df81f983 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:25.040099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2222eed-17fd-48ad-b5cd-5cf5df81f983 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:25.042489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2222eed-17fd-48ad-b5cd-5cf5df81f983 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:25.043359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2222eed-17fd-48ad-b5cd-5cf5df81f983 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:25.044865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2222eed-17fd-48ad-b5cd-5cf5df81f983 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:25.637565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d2222eed-17fd-48ad-b5cd-5cf5df81f983 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:25.650935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d2222eed-17fd-48ad-b5cd-5cf5df81f983 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:25.653570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d2222eed-17fd-48ad-b5cd-5cf5df81f983 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:25.655181 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d2222eed-17fd-48ad-b5cd-5cf5df81f983 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.641372 May 27 15:03:25.656511 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 748/1454] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:25 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:25.663337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0eb599dd-39dd-401a-b32d-c4cbd85ca50f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:25.664400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0eb599dd-39dd-401a-b32d-c4cbd85ca50f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 5c5472e6-8234-4e99-935f-7798245c1d2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:25.672513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0eb599dd-39dd-401a-b32d-c4cbd85ca50f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:25.673260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0eb599dd-39dd-401a-b32d-c4cbd85ca50f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:25.674223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0eb599dd-39dd-401a-b32d-c4cbd85ca50f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:25.675008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0eb599dd-39dd-401a-b32d-c4cbd85ca50f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:25.993073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0eb599dd-39dd-401a-b32d-c4cbd85ca50f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:26.010527 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0eb599dd-39dd-401a-b32d-c4cbd85ca50f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f" status: 200 len: 1319 microversion: 2.1 time: 0.352525 May 27 15:03:26.026091 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 749/1455] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:25 2022] GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:26.038880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3d8277f9-9464-4369-a431-1bfd4109c6f7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:26.039478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3d8277f9-9464-4369-a431-1bfd4109c6f7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: fa3160e1-6021-4618-8d44-fb03c94ffe08] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:26.046819 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d8277f9-9464-4369-a431-1bfd4109c6f7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:26.047823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d8277f9-9464-4369-a431-1bfd4109c6f7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:26.048644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d8277f9-9464-4369-a431-1bfd4109c6f7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:26.049291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d8277f9-9464-4369-a431-1bfd4109c6f7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:26.132054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3d8277f9-9464-4369-a431-1bfd4109c6f7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:26.140151 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3d8277f9-9464-4369-a431-1bfd4109c6f7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08" status: 200 len: 1260 microversion: 2.1 time: 0.112677 May 27 15:03:26.141469 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 750/1456] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:26 2022] GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08 => generated 1260 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:26.154009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1f5bd851-a638-43a9-9a79-3e949eafac56 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:26.154531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1f5bd851-a638-43a9-9a79-3e949eafac56 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 73173e14-0308-44e3-adc9-8bbd5509246c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:26.162056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f5bd851-a638-43a9-9a79-3e949eafac56 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:26.162519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f5bd851-a638-43a9-9a79-3e949eafac56 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:26.167092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f5bd851-a638-43a9-9a79-3e949eafac56 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:26.167740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f5bd851-a638-43a9-9a79-3e949eafac56 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:26.197954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1f5bd851-a638-43a9-9a79-3e949eafac56 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 73173e14-0308-44e3-adc9-8bbd5509246c] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:03:26.319456 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1f5bd851-a638-43a9-9a79-3e949eafac56 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "DELETE /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c" status: 204 len: 0 microversion: 2.1 time: 0.175899 May 27 15:03:26.321621 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 751/1457] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:03:26 2022] DELETE /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:03:26.328513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-025dbbcd-f55c-43b5-a74e-2fb1089f821a req-cc59c8f0-1a07-4e24-8e67-69f4e29ec6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30fca3d4-3998-4aa2-b00c-ba71724fdfbe", "name": "network-vif-deleted", "tag": "f270cafa-0002-4b22-940b-89a2575c17f8"}, {"name": "network-changed", "server_uuid": "5c5472e6-8234-4e99-935f-7798245c1d2f", "tag": "59d955ba-194a-4de9-a56d-fcc1fe5995b9"}, {"server_uuid": "a72bd3cf-9b54-4d56-ab10-9f2a602a15f5", "name": "network-vif-deleted", "tag": "b633ef09-5eca-4f03-95aa-8ed44cb2e4c0"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:26.340143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-025dbbcd-f55c-43b5-a74e-2fb1089f821a req-cc59c8f0-1a07-4e24-8e67-69f4e29ec6d8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:26.341284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-025dbbcd-f55c-43b5-a74e-2fb1089f821a req-cc59c8f0-1a07-4e24-8e67-69f4e29ec6d8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:26.361342 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-025dbbcd-f55c-43b5-a74e-2fb1089f821a req-cc59c8f0-1a07-4e24-8e67-69f4e29ec6d8 service nova] Creating event network-vif-deleted:f270cafa-0002-4b22-940b-89a2575c17f8 for instance 30fca3d4-3998-4aa2-b00c-ba71724fdfbe on n-h2-843621-1 May 27 15:03:26.363219 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-025dbbcd-f55c-43b5-a74e-2fb1089f821a req-cc59c8f0-1a07-4e24-8e67-69f4e29ec6d8 service nova] Creating event network-changed:59d955ba-194a-4de9-a56d-fcc1fe5995b9 for instance 5c5472e6-8234-4e99-935f-7798245c1d2f on n-h1-843621-1 May 27 15:03:26.364537 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-025dbbcd-f55c-43b5-a74e-2fb1089f821a req-cc59c8f0-1a07-4e24-8e67-69f4e29ec6d8 service nova] Creating event network-vif-deleted:b633ef09-5eca-4f03-95aa-8ed44cb2e4c0 for instance a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 on n-h2-843621-1 May 27 15:03:26.376635 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-025dbbcd-f55c-43b5-a74e-2fb1089f821a req-cc59c8f0-1a07-4e24-8e67-69f4e29ec6d8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.052999 May 27 15:03:26.377278 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 752/1458] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:26.385214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-d6ecd97f-55e1-4f2d-bde9-5d9019c053b0 req-903a0429-91f9-4802-9f34-9a0b6155fd14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea226b76-3184-469f-93c4-adbf4286a9e3", "tag": "dfab4598-069d-4d01-bdf9-cd9448feb574"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:26.395620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d6ecd97f-55e1-4f2d-bde9-5d9019c053b0 req-903a0429-91f9-4802-9f34-9a0b6155fd14 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:26.396300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d6ecd97f-55e1-4f2d-bde9-5d9019c053b0 req-903a0429-91f9-4802-9f34-9a0b6155fd14 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:26.409571 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-d6ecd97f-55e1-4f2d-bde9-5d9019c053b0 req-903a0429-91f9-4802-9f34-9a0b6155fd14 service nova] Creating event network-changed:dfab4598-069d-4d01-bdf9-cd9448feb574 for instance ea226b76-3184-469f-93c4-adbf4286a9e3 on n-h2-843621-1 May 27 15:03:26.415636 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-d6ecd97f-55e1-4f2d-bde9-5d9019c053b0 req-903a0429-91f9-4802-9f34-9a0b6155fd14 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036827 May 27 15:03:26.417130 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 753/1459] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:26.421870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-379e2d04-93f8-42f1-9bcc-ae97be1dd0a4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:26.423159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-379e2d04-93f8-42f1-9bcc-ae97be1dd0a4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:26.430085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-379e2d04-93f8-42f1-9bcc-ae97be1dd0a4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:26.430552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-379e2d04-93f8-42f1-9bcc-ae97be1dd0a4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:26.431356 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-379e2d04-93f8-42f1-9bcc-ae97be1dd0a4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:26.431808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-379e2d04-93f8-42f1-9bcc-ae97be1dd0a4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:26.566996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-379e2d04-93f8-42f1-9bcc-ae97be1dd0a4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:26.576121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-379e2d04-93f8-42f1-9bcc-ae97be1dd0a4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:26.577622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-379e2d04-93f8-42f1-9bcc-ae97be1dd0a4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:26.579334 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-379e2d04-93f8-42f1-9bcc-ae97be1dd0a4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1292 microversion: 2.25 time: 0.161974 May 27 15:03:26.579917 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 754/1460] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:26 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1292 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:26.585141 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b5e95821-c640-4509-8341-1578acd9c20a tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Calling method '.version_select at 0x7fc776c3e820>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:26.629066 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b5e95821-c640-4509-8341-1578acd9c20a tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] 10.222.0.13 "GET /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e" status: 200 len: 637 microversion: 2.1 time: 0.048033 May 27 15:03:26.629863 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 755/1461] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:26 2022] GET /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e => generated 637 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:26.634782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d0dce167-6284-43e3-98aa-c3fff242e2ae tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:26.635612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d0dce167-6284-43e3-98aa-c3fff242e2ae tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 73173e14-0308-44e3-adc9-8bbd5509246c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:26.642506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0dce167-6284-43e3-98aa-c3fff242e2ae tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:26.643126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0dce167-6284-43e3-98aa-c3fff242e2ae tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:26.643740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0dce167-6284-43e3-98aa-c3fff242e2ae tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:26.644181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0dce167-6284-43e3-98aa-c3fff242e2ae tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:26.797958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d0dce167-6284-43e3-98aa-c3fff242e2ae tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:26.806131 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d0dce167-6284-43e3-98aa-c3fff242e2ae tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c" status: 200 len: 1474 microversion: 2.1 time: 0.175249 May 27 15:03:26.807074 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 756/1462] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:26 2022] GET /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c => generated 1474 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:26.812109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ab060c9a-4fa8-49d0-830f-c9128ae12914 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Action: 'update_all', calling method: .version_select at 0x7fc776995ca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:26.861066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-ab060c9a-4fa8-49d0-830f-c9128ae12914 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Getting quotas for project 9d2643f68389491692ba45f0ef90f92a. Resources: dict_keys(['metadata_items']) {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:26.874944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-ab060c9a-4fa8-49d0-830f-c9128ae12914 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Getting quotas for user f9a81201228e40cf867ce2b4b40dd183 and project 9d2643f68389491692ba45f0ef90f92a. Resources: dict_keys(['metadata_items']) {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:27.261809 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ab060c9a-4fa8-49d0-830f-c9128ae12914 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] 10.222.0.13 "PUT /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.453484 May 27 15:03:27.265309 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 757/1463] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:03:26 2022] PUT /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata => generated 61 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:03:27.277557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3df4d162-5596-4321-894d-b4409f9be4f9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:27.278287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3df4d162-5596-4321-894d-b4409f9be4f9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:27.287525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3df4d162-5596-4321-894d-b4409f9be4f9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:27.287998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3df4d162-5596-4321-894d-b4409f9be4f9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:27.288885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3df4d162-5596-4321-894d-b4409f9be4f9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:27.289282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3df4d162-5596-4321-894d-b4409f9be4f9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:27.508136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3df4d162-5596-4321-894d-b4409f9be4f9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:27.517310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3df4d162-5596-4321-894d-b4409f9be4f9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:27.518818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3df4d162-5596-4321-894d-b4409f9be4f9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:27.519980 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3df4d162-5596-4321-894d-b4409f9be4f9 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.248197 May 27 15:03:27.520576 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 758/1464] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:27 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:27.525177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a31ebdcf-88f7-45d0-9c40-51ab30e825a6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:27.526423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a31ebdcf-88f7-45d0-9c40-51ab30e825a6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 5c5472e6-8234-4e99-935f-7798245c1d2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:27.532428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a31ebdcf-88f7-45d0-9c40-51ab30e825a6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:27.532917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a31ebdcf-88f7-45d0-9c40-51ab30e825a6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:27.533689 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a31ebdcf-88f7-45d0-9c40-51ab30e825a6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:27.534132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a31ebdcf-88f7-45d0-9c40-51ab30e825a6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:27.669292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a31ebdcf-88f7-45d0-9c40-51ab30e825a6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:27.677379 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a31ebdcf-88f7-45d0-9c40-51ab30e825a6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f" status: 200 len: 1319 microversion: 2.1 time: 0.155843 May 27 15:03:27.677952 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 759/1465] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:27 2022] GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:27.682465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fabf5e9b-be9a-4ee3-9e86-e992eb99e03a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:27.683083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fabf5e9b-be9a-4ee3-9e86-e992eb99e03a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: fa3160e1-6021-4618-8d44-fb03c94ffe08] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:27.689521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fabf5e9b-be9a-4ee3-9e86-e992eb99e03a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:27.689996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fabf5e9b-be9a-4ee3-9e86-e992eb99e03a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:27.690757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fabf5e9b-be9a-4ee3-9e86-e992eb99e03a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:27.691201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fabf5e9b-be9a-4ee3-9e86-e992eb99e03a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:27.753839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fabf5e9b-be9a-4ee3-9e86-e992eb99e03a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:27.761475 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fabf5e9b-be9a-4ee3-9e86-e992eb99e03a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08" status: 200 len: 1268 microversion: 2.1 time: 0.082554 May 27 15:03:27.762045 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 760/1466] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:27 2022] GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08 => generated 1268 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:27.766721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b00f4bb8-5b49-4ca9-bf92-b476ce86a1a5 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Calling method '.version_select at 0x7fc7769c4310>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:28.264107 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b00f4bb8-5b49-4ca9-bf92-b476ce86a1a5 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] 10.222.0.13 "DELETE /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.500994 May 27 15:03:28.265533 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 761/1467] 10.222.0.13 () {58 vars in 1295 bytes} [Fri May 27 15:03:27 2022] DELETE /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata/os_version => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:03:28.276662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-71ee0f26-5a8c-4560-991b-6130ddd552ff tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:28.277755 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-71ee0f26-5a8c-4560-991b-6130ddd552ff tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:28.300387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-71ee0f26-5a8c-4560-991b-6130ddd552ff tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:28.301195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-71ee0f26-5a8c-4560-991b-6130ddd552ff tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:28.302362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-71ee0f26-5a8c-4560-991b-6130ddd552ff tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:28.304508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-71ee0f26-5a8c-4560-991b-6130ddd552ff tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:28.471271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-71ee0f26-5a8c-4560-991b-6130ddd552ff tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:28.480721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-71ee0f26-5a8c-4560-991b-6130ddd552ff tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:28.482362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-71ee0f26-5a8c-4560-991b-6130ddd552ff tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:28.483596 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-71ee0f26-5a8c-4560-991b-6130ddd552ff tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1292 microversion: 2.25 time: 0.216070 May 27 15:03:28.484238 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 762/1468] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:28 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1292 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:28.491160 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1d93e340-0326-4e2a-93e8-e8745e9f0e10 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:28.492121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1d93e340-0326-4e2a-93e8-e8745e9f0e10 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 73173e14-0308-44e3-adc9-8bbd5509246c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:28.499014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d93e340-0326-4e2a-93e8-e8745e9f0e10 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:28.499641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d93e340-0326-4e2a-93e8-e8745e9f0e10 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:28.501099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d93e340-0326-4e2a-93e8-e8745e9f0e10 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:28.501645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d93e340-0326-4e2a-93e8-e8745e9f0e10 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:28.657527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1d93e340-0326-4e2a-93e8-e8745e9f0e10 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:28.668806 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1d93e340-0326-4e2a-93e8-e8745e9f0e10 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c" status: 200 len: 1474 microversion: 2.1 time: 0.182606 May 27 15:03:28.669805 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 763/1469] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:28 2022] GET /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c => generated 1474 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:28.674562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c105c8bb-853b-4e62-9360-3db9c8023a8a tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Calling method '.version_select at 0x7fc7768905e0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:28.730676 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c105c8bb-853b-4e62-9360-3db9c8023a8a tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] 10.222.0.13 "GET /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata" status: 200 len: 37 microversion: 2.1 time: 0.059608 May 27 15:03:28.731190 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 764/1470] 10.222.0.13 () {58 vars in 1259 bytes} [Fri May 27 15:03:28 2022] GET /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata => generated 37 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:03:28.741447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-16fe70e9-5cca-4f9d-9b99-2691634f8944 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:28.742149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-16fe70e9-5cca-4f9d-9b99-2691634f8944 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:28.748747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16fe70e9-5cca-4f9d-9b99-2691634f8944 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:28.749316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16fe70e9-5cca-4f9d-9b99-2691634f8944 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:28.750761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16fe70e9-5cca-4f9d-9b99-2691634f8944 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:28.751334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16fe70e9-5cca-4f9d-9b99-2691634f8944 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:28.956286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-16fe70e9-5cca-4f9d-9b99-2691634f8944 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:28.959999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:28.966462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-16fe70e9-5cca-4f9d-9b99-2691634f8944 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:28.968059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-16fe70e9-5cca-4f9d-9b99-2691634f8944 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:28.969308 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-16fe70e9-5cca-4f9d-9b99-2691634f8944 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.232311 May 27 15:03:28.969872 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 765/1471] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:28 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:28.974738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-afc69be5-1592-4f63-b359-e23e40dcb085 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:28.975351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-afc69be5-1592-4f63-b359-e23e40dcb085 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 5c5472e6-8234-4e99-935f-7798245c1d2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:28.981637 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-afc69be5-1592-4f63-b359-e23e40dcb085 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:28.982096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-afc69be5-1592-4f63-b359-e23e40dcb085 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:28.982874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-afc69be5-1592-4f63-b359-e23e40dcb085 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:28.983323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-afc69be5-1592-4f63-b359-e23e40dcb085 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:29.118454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-afc69be5-1592-4f63-b359-e23e40dcb085 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:29.126967 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-afc69be5-1592-4f63-b359-e23e40dcb085 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f" status: 200 len: 1319 microversion: 2.1 time: 0.156111 May 27 15:03:29.127546 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 766/1472] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:28 2022] GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:29.132069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f3dc98b6-951c-4537-89b3-ddce1625f6cf tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Action: 'update_all', calling method: .version_select at 0x7fc7768bfca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:29.193453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-f3dc98b6-951c-4537-89b3-ddce1625f6cf tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Getting quotas for project 9d2643f68389491692ba45f0ef90f92a. Resources: dict_keys(['metadata_items']) {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:29.201120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-f3dc98b6-951c-4537-89b3-ddce1625f6cf tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Getting quotas for user f9a81201228e40cf867ce2b4b40dd183 and project 9d2643f68389491692ba45f0ef90f92a. Resources: dict_keys(['metadata_items']) {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:29.595474 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f3dc98b6-951c-4537-89b3-ddce1625f6cf tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] 10.222.0.13 "PUT /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.466688 May 27 15:03:29.601179 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 767/1473] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:03:29 2022] PUT /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata => generated 61 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:03:29.607883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f885b0e9-c4ce-4c1a-983c-6029fc932f9b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:29.609549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f885b0e9-c4ce-4c1a-983c-6029fc932f9b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: fa3160e1-6021-4618-8d44-fb03c94ffe08] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:29.618860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f885b0e9-c4ce-4c1a-983c-6029fc932f9b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:29.619605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f885b0e9-c4ce-4c1a-983c-6029fc932f9b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:29.621346 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f885b0e9-c4ce-4c1a-983c-6029fc932f9b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:29.622207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f885b0e9-c4ce-4c1a-983c-6029fc932f9b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:29.961284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f885b0e9-c4ce-4c1a-983c-6029fc932f9b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:29.981149 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f885b0e9-c4ce-4c1a-983c-6029fc932f9b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08" status: 200 len: 1308 microversion: 2.1 time: 0.377954 May 27 15:03:29.988655 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 768/1474] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:29 2022] GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08 => generated 1308 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:29.995591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-60feb0e6-8d6f-4fda-b3b4-101d7dde355e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:29.998699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-60feb0e6-8d6f-4fda-b3b4-101d7dde355e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:30.016321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-60feb0e6-8d6f-4fda-b3b4-101d7dde355e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:30.019051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-60feb0e6-8d6f-4fda-b3b4-101d7dde355e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:30.020084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-60feb0e6-8d6f-4fda-b3b4-101d7dde355e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:30.021487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-60feb0e6-8d6f-4fda-b3b4-101d7dde355e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:30.372527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-60feb0e6-8d6f-4fda-b3b4-101d7dde355e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:30.381961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-60feb0e6-8d6f-4fda-b3b4-101d7dde355e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:30.383792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-60feb0e6-8d6f-4fda-b3b4-101d7dde355e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:30.385138 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-60feb0e6-8d6f-4fda-b3b4-101d7dde355e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1292 microversion: 2.25 time: 0.394351 May 27 15:03:30.386029 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 769/1475] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:29 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1292 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:30.390660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0924d8a9-1708-4eaa-a893-2624207df19d tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Calling method '.version_select at 0x7fc7769adca0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:30.452594 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0924d8a9-1708-4eaa-a893-2624207df19d tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] 10.222.0.13 "GET /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.065561 May 27 15:03:30.453840 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 770/1476] 10.222.0.13 () {58 vars in 1289 bytes} [Fri May 27 15:03:30 2022] GET /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata/os_distro => generated 33 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:03:30.474450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-40e60ebb-3eb6-4f58-bbdd-47460f0eae5c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:30.474911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-40e60ebb-3eb6-4f58-bbdd-47460f0eae5c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 73173e14-0308-44e3-adc9-8bbd5509246c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:30.489099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-40e60ebb-3eb6-4f58-bbdd-47460f0eae5c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:30.490692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-40e60ebb-3eb6-4f58-bbdd-47460f0eae5c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:30.491632 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-40e60ebb-3eb6-4f58-bbdd-47460f0eae5c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:30.492209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-40e60ebb-3eb6-4f58-bbdd-47460f0eae5c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:30.572322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-40e60ebb-3eb6-4f58-bbdd-47460f0eae5c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0b310046184dd49ba35d33ac2e958d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322433b59fd84c6eadc41b4d21f0601b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:30.582732 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-40e60ebb-3eb6-4f58-bbdd-47460f0eae5c tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c" status: 200 len: 1303 microversion: 2.1 time: 0.127888 May 27 15:03:30.584460 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 771/1477] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:30 2022] GET /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c => generated 1303 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:30.590061 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-23b7a7c0-844f-413a-b600-6718a85b9469 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:30.591097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-23b7a7c0-844f-413a-b600-6718a85b9469 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:30.599076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23b7a7c0-844f-413a-b600-6718a85b9469 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:30.600417 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23b7a7c0-844f-413a-b600-6718a85b9469 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:30.601667 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23b7a7c0-844f-413a-b600-6718a85b9469 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:30.602395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23b7a7c0-844f-413a-b600-6718a85b9469 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:30.823308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-23b7a7c0-844f-413a-b600-6718a85b9469 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:30.835473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-23b7a7c0-844f-413a-b600-6718a85b9469 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:30.837039 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-23b7a7c0-844f-413a-b600-6718a85b9469 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:30.838266 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-23b7a7c0-844f-413a-b600-6718a85b9469 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.252420 May 27 15:03:30.850495 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 772/1478] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:30 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:30.855371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6b77d833-a2dc-4288-84f9-1f7832ccaa41 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:30.856002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6b77d833-a2dc-4288-84f9-1f7832ccaa41 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 5c5472e6-8234-4e99-935f-7798245c1d2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:30.862920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b77d833-a2dc-4288-84f9-1f7832ccaa41 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:30.863779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b77d833-a2dc-4288-84f9-1f7832ccaa41 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:30.864582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b77d833-a2dc-4288-84f9-1f7832ccaa41 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:30.865073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b77d833-a2dc-4288-84f9-1f7832ccaa41 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:31.050199 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6b77d833-a2dc-4288-84f9-1f7832ccaa41 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:31.058891 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6b77d833-a2dc-4288-84f9-1f7832ccaa41 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f" status: 200 len: 1319 microversion: 2.1 time: 0.207220 May 27 15:03:31.059698 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 773/1479] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:30 2022] GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:31.065095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-ada20f73-cac2-4e89-af5d-f5eda34cd7df req-ede95f15-e12b-4ee7-bc44-9d33e79c115f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73173e14-0308-44e3-adc9-8bbd5509246c", "name": "network-vif-deleted", "tag": "f1f01d43-89a5-406d-9090-8469b79684bd"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:31.074867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-ada20f73-cac2-4e89-af5d-f5eda34cd7df req-ede95f15-e12b-4ee7-bc44-9d33e79c115f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:31.075333 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-ada20f73-cac2-4e89-af5d-f5eda34cd7df req-ede95f15-e12b-4ee7-bc44-9d33e79c115f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:31.088645 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-ada20f73-cac2-4e89-af5d-f5eda34cd7df req-ede95f15-e12b-4ee7-bc44-9d33e79c115f service nova] Creating event network-vif-deleted:f1f01d43-89a5-406d-9090-8469b79684bd for instance 73173e14-0308-44e3-adc9-8bbd5509246c on n-h2-843621-1 May 27 15:03:31.094880 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-ada20f73-cac2-4e89-af5d-f5eda34cd7df req-ede95f15-e12b-4ee7-bc44-9d33e79c115f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033307 May 27 15:03:31.095718 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 774/1480] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:31.103080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-33138e70-7249-4555-9719-1d00e9daa2fe tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Action: 'update_all', calling method: .version_select at 0x7fc776990820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:31.159717 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-33138e70-7249-4555-9719-1d00e9daa2fe tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Getting quotas for project 9d2643f68389491692ba45f0ef90f92a. Resources: dict_keys(['metadata_items']) {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:31.166710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-33138e70-7249-4555-9719-1d00e9daa2fe tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Getting quotas for user f9a81201228e40cf867ce2b4b40dd183 and project 9d2643f68389491692ba45f0ef90f92a. Resources: dict_keys(['metadata_items']) {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:31.471400 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-33138e70-7249-4555-9719-1d00e9daa2fe tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] 10.222.0.13 "PUT /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.374260 May 27 15:03:31.472006 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 775/1481] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:03:31 2022] PUT /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata => generated 61 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:03:31.477645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-79ede4fb-5134-4b5d-bcd4-198b8b2beccd req-24a2d578-fc0f-4840-97c0-f7a3d310ef86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa3160e1-6021-4618-8d44-fb03c94ffe08", "tag": "19d47f23-5967-48f2-8242-77be2fe51d5b"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:31.488734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-79ede4fb-5134-4b5d-bcd4-198b8b2beccd req-24a2d578-fc0f-4840-97c0-f7a3d310ef86 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:31.489375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-79ede4fb-5134-4b5d-bcd4-198b8b2beccd req-24a2d578-fc0f-4840-97c0-f7a3d310ef86 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:31.503972 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-79ede4fb-5134-4b5d-bcd4-198b8b2beccd req-24a2d578-fc0f-4840-97c0-f7a3d310ef86 service nova] Creating event network-changed:19d47f23-5967-48f2-8242-77be2fe51d5b for instance fa3160e1-6021-4618-8d44-fb03c94ffe08 on n-h2-843621-1 May 27 15:03:31.510058 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-79ede4fb-5134-4b5d-bcd4-198b8b2beccd req-24a2d578-fc0f-4840-97c0-f7a3d310ef86 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035303 May 27 15:03:31.510993 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 776/1482] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:31.518229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4ca3ca2a-fbcc-4016-8842-fb011ecb00a8 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:31.518952 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4ca3ca2a-fbcc-4016-8842-fb011ecb00a8 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: fa3160e1-6021-4618-8d44-fb03c94ffe08] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:31.526672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ca3ca2a-fbcc-4016-8842-fb011ecb00a8 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:31.527309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ca3ca2a-fbcc-4016-8842-fb011ecb00a8 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:31.527983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ca3ca2a-fbcc-4016-8842-fb011ecb00a8 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:31.528443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ca3ca2a-fbcc-4016-8842-fb011ecb00a8 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:31.695572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4ca3ca2a-fbcc-4016-8842-fb011ecb00a8 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:31.705491 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4ca3ca2a-fbcc-4016-8842-fb011ecb00a8 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08" status: 200 len: 1308 microversion: 2.1 time: 0.192595 May 27 15:03:31.706089 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 777/1483] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:31 2022] GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08 => generated 1308 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:31.716416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-75231cfb-fdd0-4de8-8466-0911c0103e06 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:31.717078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-75231cfb-fdd0-4de8-8466-0911c0103e06 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:31.723317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:31.724941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75231cfb-fdd0-4de8-8466-0911c0103e06 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:31.725415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75231cfb-fdd0-4de8-8466-0911c0103e06 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:31.726332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75231cfb-fdd0-4de8-8466-0911c0103e06 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:31.726792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75231cfb-fdd0-4de8-8466-0911c0103e06 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:31.931167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-75231cfb-fdd0-4de8-8466-0911c0103e06 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:31.953339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-75231cfb-fdd0-4de8-8466-0911c0103e06 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:31.955374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-75231cfb-fdd0-4de8-8466-0911c0103e06 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:31.957018 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-75231cfb-fdd0-4de8-8466-0911c0103e06 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1292 microversion: 2.25 time: 0.249934 May 27 15:03:31.958325 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 778/1484] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:31 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1292 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:31.968175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1d2fc20a-7e56-49d0-ac7b-a66a5fe08f9f tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Calling method '.version_select at 0x7fc776995e50>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:32.028026 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1d2fc20a-7e56-49d0-ac7b-a66a5fe08f9f tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] 10.222.0.13 "GET /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.068182 May 27 15:03:32.029137 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 779/1485] 10.222.0.13 () {58 vars in 1259 bytes} [Fri May 27 15:03:31 2022] GET /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata => generated 61 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:03:32.035513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6b7946aa-1217-46b5-a896-219adfd93e46 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:32.036503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6b7946aa-1217-46b5-a896-219adfd93e46 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] [instance: 73173e14-0308-44e3-adc9-8bbd5509246c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:32.044133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b7946aa-1217-46b5-a896-219adfd93e46 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:32.044988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b7946aa-1217-46b5-a896-219adfd93e46 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:32.046134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b7946aa-1217-46b5-a896-219adfd93e46 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:32.046579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b7946aa-1217-46b5-a896-219adfd93e46 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:32.065623 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-6b7946aa-1217-46b5-a896-219adfd93e46 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] HTTP exception thrown: Instance 73173e14-0308-44e3-adc9-8bbd5509246c could not be found. May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6b7946aa-1217-46b5-a896-219adfd93e46 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Request method failure captured: May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c HTTP/1.1 May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOezglAWHqYnD_cPnE947Rnk1GRUjjDBAki483LWrknDY0VLyV0s73POuQJIS86HBw6cOyKc3W5zmzO-rqTwUKwWdfzs371IILsTOPzEqcTYTb9PgzbKu2DbbmOI_z7J5BV1mB6p2sq7uJmkeeFeQPKPyJp8q-_f3yJ7gpumr8EKUd4 May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 322433b59fd84c6eadc41b4d21f0601b May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ListImageFiltersTestJSON-305504672 May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/322433b59fd84c6eadc41b4d21f0601b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/322433b59fd84c6eadc41b4d21f0601b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/322433b59fd84c6eadc41b4d21f0601b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_322433b59fd84c6eadc41b4d21f0601b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ListImageFiltersTestJSON-305504672 May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 322433b59fd84c6eadc41b4d21f0601b May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-305504672 May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ListImageFiltersTestJSON-305504672-project May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 6b0b310046184dd49ba35d33ac2e958d May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ListImageFiltersTestJSON-305504672-project May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 73173e14-0308-44e3-adc9-8bbd5509246c could not be found. May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '73173e14-0308-44e3-adc9-8bbd5509246c'} May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73173e14-0308-44e3-adc9-8bbd5509246c could not be found. May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73173e14-0308-44e3-adc9-8bbd5509246c could not be found. May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:03:32.067594 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:32.073590 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:32.073590 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:03:32.073590 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:03:32.073590 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:03:32.073590 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:03:32.073590 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73173e14-0308-44e3-adc9-8bbd5509246c could not be found. May 27 15:03:32.073590 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:32.073590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6b7946aa-1217-46b5-a896-219adfd93e46 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Returning 404 to user: Instance 73173e14-0308-44e3-adc9-8bbd5509246c could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:03:32.073590 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6b7946aa-1217-46b5-a896-219adfd93e46 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "GET /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c" status: 404 len: 111 microversion: 2.1 time: 0.038845 May 27 15:03:32.073590 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 780/1486] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:32 2022] GET /compute/v2.1/servers/73173e14-0308-44e3-adc9-8bbd5509246c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:03:32.075924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-ca924b26-84c8-4e65-9458-ea3e887d6b97 req-99cb3745-5fa0-478b-acfa-b6a47d47e133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5472e6-8234-4e99-935f-7798245c1d2f", "name": "network-vif-plugged", "status": "completed", "tag": "59d955ba-194a-4de9-a56d-fcc1fe5995b9"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:32.085956 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-ca924b26-84c8-4e65-9458-ea3e887d6b97 req-99cb3745-5fa0-478b-acfa-b6a47d47e133 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:32.086120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-ca924b26-84c8-4e65-9458-ea3e887d6b97 req-99cb3745-5fa0-478b-acfa-b6a47d47e133 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:32.100696 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-ca924b26-84c8-4e65-9458-ea3e887d6b97 req-99cb3745-5fa0-478b-acfa-b6a47d47e133 service nova] Creating event network-vif-plugged:59d955ba-194a-4de9-a56d-fcc1fe5995b9 for instance 5c5472e6-8234-4e99-935f-7798245c1d2f on n-h1-843621-1 May 27 15:03:32.106026 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-ca924b26-84c8-4e65-9458-ea3e887d6b97 req-99cb3745-5fa0-478b-acfa-b6a47d47e133 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034325 May 27 15:03:32.106925 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 781/1487] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:32.115965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-da597c21-be83-4aba-8996-398102d23cf3 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:32.115965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-da597c21-be83-4aba-8996-398102d23cf3 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:32.121780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da597c21-be83-4aba-8996-398102d23cf3 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:32.122341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da597c21-be83-4aba-8996-398102d23cf3 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:32.123178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da597c21-be83-4aba-8996-398102d23cf3 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:32.123687 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da597c21-be83-4aba-8996-398102d23cf3 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:32.322454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-da597c21-be83-4aba-8996-398102d23cf3 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:32.331982 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-da597c21-be83-4aba-8996-398102d23cf3 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:32.333913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-da597c21-be83-4aba-8996-398102d23cf3 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:32.335345 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-da597c21-be83-4aba-8996-398102d23cf3 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.226696 May 27 15:03:32.341144 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 782/1488] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:32 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:32.349296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-db0266cc-5015-4a18-bced-3cb1aa754f55 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Action: 'update_all', calling method: .version_select at 0x7fc7769ad940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:32.404282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-db0266cc-5015-4a18-bced-3cb1aa754f55 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Getting quotas for project 9d2643f68389491692ba45f0ef90f92a. Resources: dict_keys(['metadata_items']) {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:32.411220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-db0266cc-5015-4a18-bced-3cb1aa754f55 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Getting quotas for user f9a81201228e40cf867ce2b4b40dd183 and project 9d2643f68389491692ba45f0ef90f92a. Resources: dict_keys(['metadata_items']) {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:32.662976 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-db0266cc-5015-4a18-bced-3cb1aa754f55 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] 10.222.0.13 "PUT /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.320143 May 27 15:03:32.664820 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 783/1489] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:03:32 2022] PUT /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata => generated 61 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:03:32.671468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-88f1bf04-0093-477a-bc47-fdc90ce86082 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:32.672381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-88f1bf04-0093-477a-bc47-fdc90ce86082 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 5c5472e6-8234-4e99-935f-7798245c1d2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:32.680277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88f1bf04-0093-477a-bc47-fdc90ce86082 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:32.680757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88f1bf04-0093-477a-bc47-fdc90ce86082 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:32.681542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88f1bf04-0093-477a-bc47-fdc90ce86082 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:32.681982 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88f1bf04-0093-477a-bc47-fdc90ce86082 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:32.761947 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-df1f05ad-d440-4350-ba62-881262c7f283 tempest-VolumesAdminNegativeTest-570021324 tempest-VolumesAdminNegativeTest-570021324-project-admin] HTTP exception thrown: Volume 2d99b915-edbd-4a17-86b2-5b0d1159d1bc could not be found. May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-df1f05ad-d440-4350-ba62-881262c7f283 tempest-VolumesAdminNegativeTest-570021324 tempest-VolumesAdminNegativeTest-570021324-project-admin] Request method failure captured: May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: request: PUT /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments/2d99b915-edbd-4a17-86b2-5b0d1159d1bc HTTP/1.1 May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 74 May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOe60G2IoPW8UXt7e3AUzQOi3-10fDxmDMPrwz3L1fIY0ZuTx2biU-RJqr4PM9l8b9_6VHr1v7o1ludiNXee1VFCGIIE52CxDTRqi30e-UuzPo6sKt7eX0mjJ_OiT0dkNjyjLziQnG3LCGNhZIZZ7X4IX6CkKBMDvLl5PeR_dXmPmjI May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 4f77d62e64774eaa83b8bcecc31affba May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-VolumesAdminNegativeTest-570021324 May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,admin,member May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,admin,member May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4f77d62e64774eaa83b8bcecc31affba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4f77d62e64774eaa83b8bcecc31affba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4f77d62e64774eaa83b8bcecc31affba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4f77d62e64774eaa83b8bcecc31affba", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-VolumesAdminNegativeTest-570021324 May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 4f77d62e64774eaa83b8bcecc31affba May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-570021324 May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-VolumesAdminNegativeTest-570021324-project-admin May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 7e57f4e1cc244003b4c46071a19e9fd6 May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-VolumesAdminNegativeTest-570021324-project-admin May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: {"volumeAttachment": {"volumeId": "faa829c0-afdc-4131-b295-843966fe1b04"}} May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: exception: Volume 2d99b915-edbd-4a17-86b2-5b0d1159d1bc could not be found. May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'server_id': 'c1699aaf-d186-4cde-ac8c-318a335635b3', 'id': '2d99b915-edbd-4a17-86b2-5b0d1159d1bc', 'body': {'volumeAttachment': {'volumeId': 'faa829c0-afdc-4131-b295-843966fe1b04'}}} May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2d99b915-edbd-4a17-86b2-5b0d1159d1bc could not be found. (HTTP 404) (Request-ID: req-aae539fc-a2bb-402e-8a9d-57cf7f46335b) May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:03:32.764205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2d99b915-edbd-4a17-86b2-5b0d1159d1bc could not be found. May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2d99b915-edbd-4a17-86b2-5b0d1159d1bc could not be found. May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2d99b915-edbd-4a17-86b2-5b0d1159d1bc could not be found. May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-df1f05ad-d440-4350-ba62-881262c7f283 tempest-VolumesAdminNegativeTest-570021324 tempest-VolumesAdminNegativeTest-570021324-project-admin] Returning 404 to user: Volume 2d99b915-edbd-4a17-86b2-5b0d1159d1bc could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-df1f05ad-d440-4350-ba62-881262c7f283 tempest-VolumesAdminNegativeTest-570021324 tempest-VolumesAdminNegativeTest-570021324-project-admin] 10.222.0.13 "PUT /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments/2d99b915-edbd-4a17-86b2-5b0d1159d1bc" status: 404 len: 109 microversion: 2.1 time: 18.479013 May 27 15:03:32.774773 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 707/1490] 10.222.0.13 () {60 vars in 1432 bytes} [Fri May 27 15:03:14 2022] PUT /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3/os-volume_attachments/2d99b915-edbd-4a17-86b2-5b0d1159d1bc => generated 109 bytes in 18501 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:03:32.778668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cda6e1d3-53eb-4c82-82d8-aba1325f6e19 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776ca59d0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:32.919506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-88f1bf04-0093-477a-bc47-fdc90ce86082 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:32.936740 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-88f1bf04-0093-477a-bc47-fdc90ce86082 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f" status: 200 len: 1319 microversion: 2.1 time: 0.268295 May 27 15:03:32.938285 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 784/1491] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:32 2022] GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:32.948034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d4b24875-bcc0-4925-9ec6-cabe740ff187 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Action: 'update_all', calling method: .version_select at 0x7fc776d4aa60>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:33.038081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-d4b24875-bcc0-4925-9ec6-cabe740ff187 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Getting quotas for project 9d2643f68389491692ba45f0ef90f92a. Resources: dict_keys(['metadata_items']) {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:33.047682 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-d4b24875-bcc0-4925-9ec6-cabe740ff187 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Getting quotas for user f9a81201228e40cf867ce2b4b40dd183 and project 9d2643f68389491692ba45f0ef90f92a. Resources: dict_keys(['metadata_items']) {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:33.214160 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cda6e1d3-53eb-4c82-82d8-aba1325f6e19 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "DELETE /compute/v2.1/images/6042ce3e-12b5-4af7-82f6-90882e320280" status: 204 len: 0 microversion: 2.1 time: 0.445945 May 27 15:03:33.215396 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 708/1492] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:32 2022] DELETE /compute/v2.1/images/6042ce3e-12b5-4af7-82f6-90882e320280 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:03:33.220965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b9c30c88-9e85-4b48-a03a-d7f9694e350c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:33.221921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b9c30c88-9e85-4b48-a03a-d7f9694e350c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: fa3160e1-6021-4618-8d44-fb03c94ffe08] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:33.238357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9c30c88-9e85-4b48-a03a-d7f9694e350c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:33.241383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9c30c88-9e85-4b48-a03a-d7f9694e350c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:33.243688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9c30c88-9e85-4b48-a03a-d7f9694e350c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:33.245254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9c30c88-9e85-4b48-a03a-d7f9694e350c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:33.490172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b9c30c88-9e85-4b48-a03a-d7f9694e350c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:33.504948 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b9c30c88-9e85-4b48-a03a-d7f9694e350c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08" status: 200 len: 1308 microversion: 2.1 time: 0.285794 May 27 15:03:33.509135 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 709/1493] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:33 2022] GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08 => generated 1308 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:33.520891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-56f95e8e-c23f-4d8d-b991-f14c39b55816 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:33.522246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-56f95e8e-c23f-4d8d-b991-f14c39b55816 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:33.535601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56f95e8e-c23f-4d8d-b991-f14c39b55816 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:33.540205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56f95e8e-c23f-4d8d-b991-f14c39b55816 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:33.541528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56f95e8e-c23f-4d8d-b991-f14c39b55816 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:33.542199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56f95e8e-c23f-4d8d-b991-f14c39b55816 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:33.640056 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-56f95e8e-c23f-4d8d-b991-f14c39b55816 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127905 May 27 15:03:33.641816 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 710/1494] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:03:33 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:03:33.650770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-65b1a0d1-a175-43f6-b609-bc42dec7277d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:33.656071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-65b1a0d1-a175-43f6-b609-bc42dec7277d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:33.673138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65b1a0d1-a175-43f6-b609-bc42dec7277d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:33.674983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65b1a0d1-a175-43f6-b609-bc42dec7277d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:33.676514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65b1a0d1-a175-43f6-b609-bc42dec7277d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:33.677266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65b1a0d1-a175-43f6-b609-bc42dec7277d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:33.709020 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d4b24875-bcc0-4925-9ec6-cabe740ff187 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] 10.222.0.13 "PUT /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata" status: 200 len: 64 microversion: 2.1 time: 0.769522 May 27 15:03:33.710645 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 785/1495] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:03:32 2022] PUT /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata => generated 64 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:03:33.717969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-572f6e59-a107-427c-b81e-b56f4fddeea0 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776740160>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:34.085099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-65b1a0d1-a175-43f6-b609-bc42dec7277d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:34.102583 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-65b1a0d1-a175-43f6-b609-bc42dec7277d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:34.108148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-65b1a0d1-a175-43f6-b609-bc42dec7277d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:34.111924 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-65b1a0d1-a175-43f6-b609-bc42dec7277d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1292 microversion: 2.25 time: 0.467187 May 27 15:03:34.124906 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 711/1496] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:33 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1292 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:34.138650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-807db6ed-1d22-4bb8-af66-5831665979b7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:34.139593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-807db6ed-1d22-4bb8-af66-5831665979b7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:34.155146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-807db6ed-1d22-4bb8-af66-5831665979b7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:34.157471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-807db6ed-1d22-4bb8-af66-5831665979b7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:34.158476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-807db6ed-1d22-4bb8-af66-5831665979b7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:34.162158 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-807db6ed-1d22-4bb8-af66-5831665979b7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:34.173456 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-572f6e59-a107-427c-b81e-b56f4fddeea0 tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "DELETE /compute/v2.1/images/4c3339da-8c0b-454c-ad21-4759cd025c38" status: 204 len: 0 microversion: 2.1 time: 0.461438 May 27 15:03:34.177525 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 786/1497] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:33 2022] DELETE /compute/v2.1/images/4c3339da-8c0b-454c-ad21-4759cd025c38 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:03:34.184610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3de8a8f2-4236-48b9-85f8-1ec393806c89 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Calling method '.version_select at 0x7fc776e8c3a0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:34.254779 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3de8a8f2-4236-48b9-85f8-1ec393806c89 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] 10.222.0.13 "GET /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata" status: 200 len: 64 microversion: 2.1 time: 0.075779 May 27 15:03:34.256914 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 787/1498] 10.222.0.13 () {58 vars in 1259 bytes} [Fri May 27 15:03:34 2022] GET /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata => generated 64 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:03:34.265364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-804f04a3-94d0-46b9-b7d1-905b84613746 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:34.277647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-804f04a3-94d0-46b9-b7d1-905b84613746 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 5c5472e6-8234-4e99-935f-7798245c1d2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:34.284765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-804f04a3-94d0-46b9-b7d1-905b84613746 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:34.285300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-804f04a3-94d0-46b9-b7d1-905b84613746 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:34.286152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-804f04a3-94d0-46b9-b7d1-905b84613746 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:34.297449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-804f04a3-94d0-46b9-b7d1-905b84613746 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:34.327947 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:34.571963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-807db6ed-1d22-4bb8-af66-5831665979b7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:34.590441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-807db6ed-1d22-4bb8-af66-5831665979b7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:34.592300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-807db6ed-1d22-4bb8-af66-5831665979b7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:34.594000 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-807db6ed-1d22-4bb8-af66-5831665979b7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.466670 May 27 15:03:34.595770 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 712/1499] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:34 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:34.602621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e788100f-d8e5-4739-82ed-e2f2a951e62b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] Calling method '.version_select at 0x7fc776d295e0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:34.668173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-804f04a3-94d0-46b9-b7d1-905b84613746 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:34.692310 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-804f04a3-94d0-46b9-b7d1-905b84613746 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f" status: 200 len: 1468 microversion: 2.1 time: 0.433969 May 27 15:03:34.708300 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 788/1500] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:34 2022] GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f => generated 1468 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:34.715294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-d8d58c74-b2dd-491a-bf3c-b975a32591e7 req-7bbd59ec-159f-4317-889f-fffcedf176bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea226b76-3184-469f-93c4-adbf4286a9e3", "name": "network-vif-plugged", "status": "completed", "tag": "dfab4598-069d-4d01-bdf9-cd9448feb574"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:34.740208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d8d58c74-b2dd-491a-bf3c-b975a32591e7 req-7bbd59ec-159f-4317-889f-fffcedf176bb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:34.742706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d8d58c74-b2dd-491a-bf3c-b975a32591e7 req-7bbd59ec-159f-4317-889f-fffcedf176bb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:34.761878 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-d8d58c74-b2dd-491a-bf3c-b975a32591e7 req-7bbd59ec-159f-4317-889f-fffcedf176bb service nova] Creating event network-vif-plugged:dfab4598-069d-4d01-bdf9-cd9448feb574 for instance ea226b76-3184-469f-93c4-adbf4286a9e3 on n-h2-843621-1 May 27 15:03:34.769124 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-d8d58c74-b2dd-491a-bf3c-b975a32591e7 req-7bbd59ec-159f-4317-889f-fffcedf176bb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059053 May 27 15:03:34.770200 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 789/1501] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:34.776699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-332d2b3e-bfb3-492c-b9c0-e504152cd472 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Action: 'update_all', calling method: .version_select at 0x7fc7768dfee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:34.869880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-332d2b3e-bfb3-492c-b9c0-e504152cd472 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Getting quotas for project 9d2643f68389491692ba45f0ef90f92a. Resources: dict_keys(['metadata_items']) {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:34.889003 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-332d2b3e-bfb3-492c-b9c0-e504152cd472 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Getting quotas for user f9a81201228e40cf867ce2b4b40dd183 and project 9d2643f68389491692ba45f0ef90f92a. Resources: dict_keys(['metadata_items']) {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:35.036973 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e788100f-d8e5-4739-82ed-e2f2a951e62b tempest-ListImageFiltersTestJSON-305504672 tempest-ListImageFiltersTestJSON-305504672-project] 10.222.0.13 "DELETE /compute/v2.1/images/d375f728-f963-4882-aa81-3efbc860b2f3" status: 204 len: 0 microversion: 2.1 time: 0.439891 May 27 15:03:35.037566 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 713/1502] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:34 2022] DELETE /compute/v2.1/images/d375f728-f963-4882-aa81-3efbc860b2f3 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:03:35.047362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2cec9edc-b082-4cbf-b057-98d72aebccd5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:35.051751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2cec9edc-b082-4cbf-b057-98d72aebccd5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: fa3160e1-6021-4618-8d44-fb03c94ffe08] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:35.085295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2cec9edc-b082-4cbf-b057-98d72aebccd5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:35.085966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2cec9edc-b082-4cbf-b057-98d72aebccd5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:35.101158 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2cec9edc-b082-4cbf-b057-98d72aebccd5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:35.101693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2cec9edc-b082-4cbf-b057-98d72aebccd5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:35.351697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2cec9edc-b082-4cbf-b057-98d72aebccd5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:35.367160 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2cec9edc-b082-4cbf-b057-98d72aebccd5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08" status: 200 len: 1308 microversion: 2.1 time: 0.326162 May 27 15:03:35.368777 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 714/1503] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:35 2022] GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08 => generated 1308 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:35.374853 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-42fe1aa5-d9ea-47cc-b6ff-8996c87a5e83 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:35.376110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-42fe1aa5-d9ea-47cc-b6ff-8996c87a5e83 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: ea226b76-3184-469f-93c4-adbf4286a9e3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:35.383949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42fe1aa5-d9ea-47cc-b6ff-8996c87a5e83 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:35.384805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42fe1aa5-d9ea-47cc-b6ff-8996c87a5e83 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:35.385932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42fe1aa5-d9ea-47cc-b6ff-8996c87a5e83 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:35.386592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42fe1aa5-d9ea-47cc-b6ff-8996c87a5e83 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:35.552276 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-332d2b3e-bfb3-492c-b9c0-e504152cd472 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] 10.222.0.13 "PUT /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.780666 May 27 15:03:35.556690 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 790/1504] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:03:34 2022] PUT /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata => generated 61 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:03:35.559033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-67f17e75-4929-426c-9939-5b07289ddb42 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:35.559999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-67f17e75-4929-426c-9939-5b07289ddb42 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:35.577751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67f17e75-4929-426c-9939-5b07289ddb42 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:35.578906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67f17e75-4929-426c-9939-5b07289ddb42 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:35.579731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67f17e75-4929-426c-9939-5b07289ddb42 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:35.580183 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67f17e75-4929-426c-9939-5b07289ddb42 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:35.616027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-42fe1aa5-d9ea-47cc-b6ff-8996c87a5e83 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:35.635667 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-42fe1aa5-d9ea-47cc-b6ff-8996c87a5e83 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/ea226b76-3184-469f-93c4-adbf4286a9e3" status: 200 len: 1319 microversion: 2.1 time: 0.265460 May 27 15:03:35.637772 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 715/1505] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:35 2022] GET /compute/v2.1/servers/ea226b76-3184-469f-93c4-adbf4286a9e3 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:35.652626 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-351c4bba-7eba-49e2-9818-a35567ebe231 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Action: 'update', calling method: .version_select at 0x7fc776c371f0>, body: {"meta": {"os_version": "alt"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:35.764521 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-351c4bba-7eba-49e2-9818-a35567ebe231 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Getting quotas for project 9d2643f68389491692ba45f0ef90f92a. Resources: dict_keys(['metadata_items']) {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:35.778523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-351c4bba-7eba-49e2-9818-a35567ebe231 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Getting quotas for user f9a81201228e40cf867ce2b4b40dd183 and project 9d2643f68389491692ba45f0ef90f92a. Resources: dict_keys(['metadata_items']) {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:35.831309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-67f17e75-4929-426c-9939-5b07289ddb42 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:35.857095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-67f17e75-4929-426c-9939-5b07289ddb42 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:35.874722 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-67f17e75-4929-426c-9939-5b07289ddb42 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:35.878287 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-67f17e75-4929-426c-9939-5b07289ddb42 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1292 microversion: 2.25 time: 0.324041 May 27 15:03:35.881140 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 791/1506] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:35 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1292 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:35.916866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-88c5e01c-347e-4540-bae9-80bba4c259d8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:35.917524 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-88c5e01c-347e-4540-bae9-80bba4c259d8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:35.950711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88c5e01c-347e-4540-bae9-80bba4c259d8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:35.951167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88c5e01c-347e-4540-bae9-80bba4c259d8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:35.952145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88c5e01c-347e-4540-bae9-80bba4c259d8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:35.952787 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88c5e01c-347e-4540-bae9-80bba4c259d8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:36.337673 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-351c4bba-7eba-49e2-9818-a35567ebe231 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] 10.222.0.13 "PUT /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.698484 May 27 15:03:36.338844 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 716/1507] 10.222.0.13 () {60 vars in 1312 bytes} [Fri May 27 15:03:35 2022] PUT /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata/os_version => generated 31 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:03:36.349830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-456997bf-55e0-4936-8191-8bc1282d0d81 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Calling method '.version_select at 0x7fc776be33a0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:36.406273 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-456997bf-55e0-4936-8191-8bc1282d0d81 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] 10.222.0.13 "GET /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata" status: 200 len: 58 microversion: 2.1 time: 0.061730 May 27 15:03:36.413961 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 717/1508] 10.222.0.13 () {58 vars in 1259 bytes} [Fri May 27 15:03:36 2022] GET /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata => generated 58 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 15:03:36.419721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-19e415b8-0c79-4e3c-9799-f6641120d1af tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:36.420354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-19e415b8-0c79-4e3c-9799-f6641120d1af tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: fa3160e1-6021-4618-8d44-fb03c94ffe08] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:36.428114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-19e415b8-0c79-4e3c-9799-f6641120d1af tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:36.428921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-19e415b8-0c79-4e3c-9799-f6641120d1af tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:36.429705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-19e415b8-0c79-4e3c-9799-f6641120d1af tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:36.430149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-19e415b8-0c79-4e3c-9799-f6641120d1af tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:36.451048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-88c5e01c-347e-4540-bae9-80bba4c259d8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:36.460908 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-88c5e01c-347e-4540-bae9-80bba4c259d8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:36.462435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-88c5e01c-347e-4540-bae9-80bba4c259d8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:36.463630 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-88c5e01c-347e-4540-bae9-80bba4c259d8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.571856 May 27 15:03:36.464193 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 792/1509] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:35 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:36.495207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6269841b-a855-4179-9210-401ab2d67c0f tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Action: 'update_all', calling method: .version_select at 0x7fc7767b4b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:36.563845 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-6269841b-a855-4179-9210-401ab2d67c0f tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Getting quotas for project 9d2643f68389491692ba45f0ef90f92a. Resources: dict_keys(['metadata_items']) {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:36.573529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-6269841b-a855-4179-9210-401ab2d67c0f tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Getting quotas for user f9a81201228e40cf867ce2b4b40dd183 and project 9d2643f68389491692ba45f0ef90f92a. Resources: dict_keys(['metadata_items']) {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:36.670843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-19e415b8-0c79-4e3c-9799-f6641120d1af tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:36.681088 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-19e415b8-0c79-4e3c-9799-f6641120d1af tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08" status: 200 len: 1308 microversion: 2.1 time: 0.265775 May 27 15:03:36.682275 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 718/1510] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:36 2022] GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08 => generated 1308 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:36.687309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1ef40aeb-4e80-42c7-ad4c-e226f46239db tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:36.688706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1ef40aeb-4e80-42c7-ad4c-e226f46239db tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: ea226b76-3184-469f-93c4-adbf4286a9e3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:36.697603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ef40aeb-4e80-42c7-ad4c-e226f46239db tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:36.698667 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ef40aeb-4e80-42c7-ad4c-e226f46239db tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:36.699676 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ef40aeb-4e80-42c7-ad4c-e226f46239db tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:36.700371 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ef40aeb-4e80-42c7-ad4c-e226f46239db tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:36.929787 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1ef40aeb-4e80-42c7-ad4c-e226f46239db tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:36.939938 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1ef40aeb-4e80-42c7-ad4c-e226f46239db tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/ea226b76-3184-469f-93c4-adbf4286a9e3" status: 200 len: 1469 microversion: 2.1 time: 0.256392 May 27 15:03:36.952103 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 719/1511] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:36 2022] GET /compute/v2.1/servers/ea226b76-3184-469f-93c4-adbf4286a9e3 => generated 1469 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:36.952103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-0d22271f-636b-4cc1-abdd-f3e4a6b9686c req-4608db44-bf83-47f5-959e-1f935476c60b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3160e1-6021-4618-8d44-fb03c94ffe08", "name": "network-vif-plugged", "status": "completed", "tag": "19d47f23-5967-48f2-8242-77be2fe51d5b"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:36.957645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0d22271f-636b-4cc1-abdd-f3e4a6b9686c req-4608db44-bf83-47f5-959e-1f935476c60b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:36.958220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0d22271f-636b-4cc1-abdd-f3e4a6b9686c req-4608db44-bf83-47f5-959e-1f935476c60b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:36.972852 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-0d22271f-636b-4cc1-abdd-f3e4a6b9686c req-4608db44-bf83-47f5-959e-1f935476c60b service nova] Creating event network-vif-plugged:19d47f23-5967-48f2-8242-77be2fe51d5b for instance fa3160e1-6021-4618-8d44-fb03c94ffe08 on n-h2-843621-1 May 27 15:03:36.982113 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-0d22271f-636b-4cc1-abdd-f3e4a6b9686c req-4608db44-bf83-47f5-959e-1f935476c60b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037898 May 27 15:03:36.983384 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 720/1512] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:37.029904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5ef513c4-6950-4896-8d0f-897d456cc32b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:37.035506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5ef513c4-6950-4896-8d0f-897d456cc32b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:37.066163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5ef513c4-6950-4896-8d0f-897d456cc32b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:37.068769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5ef513c4-6950-4896-8d0f-897d456cc32b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:37.069676 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5ef513c4-6950-4896-8d0f-897d456cc32b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:37.070617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5ef513c4-6950-4896-8d0f-897d456cc32b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:37.116523 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6269841b-a855-4179-9210-401ab2d67c0f tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] 10.222.0.13 "PUT /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.640429 May 27 15:03:37.117571 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 793/1513] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:03:36 2022] PUT /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata => generated 61 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:03:37.122434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-911fb901-2816-4f9d-a233-da1d36913163 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:37.129802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-911fb901-2816-4f9d-a233-da1d36913163 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:37.130697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-911fb901-2816-4f9d-a233-da1d36913163 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Searching by: {'reservation_id': 'r-mghr57ry', 'deleted': False, 'project_id': 'a081b119396543ad8ac9421acc677175'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:03:37.146929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-911fb901-2816-4f9d-a233-da1d36913163 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:37.153073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-911fb901-2816-4f9d-a233-da1d36913163 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:37.153979 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-911fb901-2816-4f9d-a233-da1d36913163 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:37.154638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-911fb901-2816-4f9d-a233-da1d36913163 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:37.299230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-911fb901-2816-4f9d-a233-da1d36913163 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:03:37.311166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5ef513c4-6950-4896-8d0f-897d456cc32b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:37.322238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5ef513c4-6950-4896-8d0f-897d456cc32b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:37.326037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5ef513c4-6950-4896-8d0f-897d456cc32b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:37.328514 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5ef513c4-6950-4896-8d0f-897d456cc32b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1292 microversion: 2.25 time: 0.342755 May 27 15:03:37.329720 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 721/1514] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:36 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1292 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:37.336650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2d6d2a18-f5d3-4421-880d-6a1b8bcafc00 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Action: 'create', calling method: .version_select at 0x7fc776b93b80>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:37.426791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=65 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:37.427695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-2d6d2a18-f5d3-4421-880d-6a1b8bcafc00 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Getting quotas for project 9d2643f68389491692ba45f0ef90f92a. Resources: dict_keys(['metadata_items']) {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:37.431070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-911fb901-2816-4f9d-a233-da1d36913163 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:37.440040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-911fb901-2816-4f9d-a233-da1d36913163 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:37.440737 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-911fb901-2816-4f9d-a233-da1d36913163 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:37.443416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-2d6d2a18-f5d3-4421-880d-6a1b8bcafc00 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Getting quotas for user f9a81201228e40cf867ce2b4b40dd183 and project 9d2643f68389491692ba45f0ef90f92a. Resources: dict_keys(['metadata_items']) {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:37.614122 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-911fb901-2816-4f9d-a233-da1d36913163 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?reservation_id=r-mghr57ry" status: 200 len: 2930 microversion: 2.1 time: 0.495589 May 27 15:03:37.620983 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 794/1515] 10.222.0.13 () {58 vars in 1196 bytes} [Fri May 27 15:03:37 2022] GET /compute/v2.1/servers/detail?reservation_id=r-mghr57ry => generated 2930 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:37.636659 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d9830301-7a2d-45e7-97f6-2decaaeedeb5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:37.640468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d9830301-7a2d-45e7-97f6-2decaaeedeb5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:37.651300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d9830301-7a2d-45e7-97f6-2decaaeedeb5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:37.651775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d9830301-7a2d-45e7-97f6-2decaaeedeb5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:37.652566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d9830301-7a2d-45e7-97f6-2decaaeedeb5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:37.653118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d9830301-7a2d-45e7-97f6-2decaaeedeb5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:37.659103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:37.862150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d9830301-7a2d-45e7-97f6-2decaaeedeb5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:37.875464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d9830301-7a2d-45e7-97f6-2decaaeedeb5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:37.877557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d9830301-7a2d-45e7-97f6-2decaaeedeb5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:37.879115 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d9830301-7a2d-45e7-97f6-2decaaeedeb5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.262854 May 27 15:03:37.880192 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 795/1516] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:37 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:37.884919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-93b2cb91-15af-4272-a953-d19694231074 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:37.903692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.compute.server_groups [None req-93b2cb91-15af-4272-a953-d19694231074 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Querying cell 57e0886a-3e0a-4a65-b585-e8d63742d44b(cell1) for 2 instances {{(pid=119248) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 27 15:03:37.904872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-93b2cb91-15af-4272-a953-d19694231074 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:37.905518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-93b2cb91-15af-4272-a953-d19694231074 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:37.944638 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-93b2cb91-15af-4272-a953-d19694231074 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/4756748d-e981-4a6d-bfcf-2b1c5cfe8b51" status: 200 len: 271 microversion: 2.1 time: 0.063111 May 27 15:03:37.945567 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 796/1517] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 15:03:37 2022] GET /compute/v2.1/os-server-groups/4756748d-e981-4a6d-bfcf-2b1c5cfe8b51 => generated 271 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:37.951137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-84363105-dbea-4eee-a462-7c07685994ab tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:37.951983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-84363105-dbea-4eee-a462-7c07685994ab tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: fa3160e1-6021-4618-8d44-fb03c94ffe08] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:37.959858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84363105-dbea-4eee-a462-7c07685994ab tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:37.960837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84363105-dbea-4eee-a462-7c07685994ab tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:37.961847 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84363105-dbea-4eee-a462-7c07685994ab tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:37.962465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84363105-dbea-4eee-a462-7c07685994ab tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:38.036537 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2d6d2a18-f5d3-4421-880d-6a1b8bcafc00 tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] 10.222.0.13 "POST /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata" status: 200 len: 85 microversion: 2.1 time: 0.705467 May 27 15:03:38.037605 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 722/1518] 10.222.0.13 () {60 vars in 1280 bytes} [Fri May 27 15:03:37 2022] POST /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata => generated 85 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:03:38.148410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-84363105-dbea-4eee-a462-7c07685994ab tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:38.159623 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-84363105-dbea-4eee-a462-7c07685994ab tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08" status: 200 len: 1308 microversion: 2.1 time: 0.212317 May 27 15:03:38.163122 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 797/1519] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:37 2022] GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08 => generated 1308 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:38.175130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bd2757ef-d9ee-41c0-8799-2c945cce700b tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:38.177318 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bd2757ef-d9ee-41c0-8799-2c945cce700b tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] [instance: 5c5472e6-8234-4e99-935f-7798245c1d2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:38.190518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd2757ef-d9ee-41c0-8799-2c945cce700b tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:38.191404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd2757ef-d9ee-41c0-8799-2c945cce700b tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:38.192462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd2757ef-d9ee-41c0-8799-2c945cce700b tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:38.195413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd2757ef-d9ee-41c0-8799-2c945cce700b tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:38.240299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-57646d01-a4c8-4861-a4f4-31940fd8c7ce tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Action: 'create', calling method: .version_select at 0x7fc776c9dc10>, body: {"keypair": {"name": "tempest-keypair-607084644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDr+TWBwgZuDGLdLyunKFZ+SCiXDL77LhTP3i17VzSHo6iRwvX54Rk3M6/9s55p//P8hHFqV0SdfnhN/USeHN6MPFCMmzLogO76ZHNsytyTF59VagLKcPW9omtdobqhfZA=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:38.292271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-57646d01-a4c8-4861-a4f4-31940fd8c7ce tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Getting quotas for project b91fab3d50964ca78eb25126cc5a0efb. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:38.306343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-57646d01-a4c8-4861-a4f4-31940fd8c7ce tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Getting quotas for user 4ac36743a37549d9bd72b5a60c9e8af2 and project b91fab3d50964ca78eb25126cc5a0efb. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:38.368193 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bd2757ef-d9ee-41c0-8799-2c945cce700b tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f" status: 200 len: 1619 microversion: 2.1 time: 0.199270 May 27 15:03:38.380465 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-57646d01-a4c8-4861-a4f4-31940fd8c7ce tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.339767 May 27 15:03:38.380465 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 723/1520] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:03:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:38.381223 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 798/1521] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:38 2022] GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f => generated 1619 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:38.387001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f466a8d9-e108-49a4-8652-014753d21a23 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:38.387601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f466a8d9-e108-49a4-8652-014753d21a23 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:38.395429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-95965b12-5174-48b6-a53b-b6c7cf95bc7c tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] Calling method '.version_select at 0x7fc776ed2ca0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:38.395961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f466a8d9-e108-49a4-8652-014753d21a23 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:38.396628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f466a8d9-e108-49a4-8652-014753d21a23 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:38.397576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f466a8d9-e108-49a4-8652-014753d21a23 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:38.398210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f466a8d9-e108-49a4-8652-014753d21a23 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:38.472621 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-95965b12-5174-48b6-a53b-b6c7cf95bc7c tempest-ImagesMetadataTestJSON-173936005 tempest-ImagesMetadataTestJSON-173936005-project] 10.222.0.13 "GET /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata" status: 200 len: 85 microversion: 2.1 time: 0.092519 May 27 15:03:38.478611 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 724/1522] 10.222.0.13 () {58 vars in 1259 bytes} [Fri May 27 15:03:38 2022] GET /compute/v2.1/images/cc70d92a-06dd-4d12-bccf-251fcd02505e/metadata => generated 85 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:03:38.483588 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c64d188d-777c-4f54-b9c0-f82c4c7252b7 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:38.485471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c64d188d-777c-4f54-b9c0-f82c4c7252b7 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] [instance: ea226b76-3184-469f-93c4-adbf4286a9e3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:38.502436 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c64d188d-777c-4f54-b9c0-f82c4c7252b7 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:38.502903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c64d188d-777c-4f54-b9c0-f82c4c7252b7 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:38.503689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c64d188d-777c-4f54-b9c0-f82c4c7252b7 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:38.504134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c64d188d-777c-4f54-b9c0-f82c4c7252b7 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:38.629933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f466a8d9-e108-49a4-8652-014753d21a23 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:38.638879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f466a8d9-e108-49a4-8652-014753d21a23 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:38.644483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f466a8d9-e108-49a4-8652-014753d21a23 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:38.648791 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f466a8d9-e108-49a4-8652-014753d21a23 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1292 microversion: 2.25 time: 0.265215 May 27 15:03:38.652597 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 799/1523] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:38 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1292 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:38.660102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1c1048ee-3c99-4ad0-b8e9-36d969a1fa60 tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Calling method '.version_select at 0x7fc7767b4280>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:38.679885 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1c1048ee-3c99-4ad0-b8e9-36d969a1fa60 tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-607084644" status: 200 len: 496 microversion: 2.1 time: 0.025953 May 27 15:03:38.692848 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 800/1524] 10.222.0.13 () {58 vars in 1214 bytes} [Fri May 27 15:03:38 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-607084644 => generated 496 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:38.706161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4484efdf-8f5b-4d9e-a008-e1c6570bae62 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:38.708350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4484efdf-8f5b-4d9e-a008-e1c6570bae62 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:38.718316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4484efdf-8f5b-4d9e-a008-e1c6570bae62 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:38.726498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4484efdf-8f5b-4d9e-a008-e1c6570bae62 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:38.730119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4484efdf-8f5b-4d9e-a008-e1c6570bae62 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:38.730858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4484efdf-8f5b-4d9e-a008-e1c6570bae62 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:38.788234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4484efdf-8f5b-4d9e-a008-e1c6570bae62 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:03:38.834353 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c64d188d-777c-4f54-b9c0-f82c4c7252b7 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/ea226b76-3184-469f-93c4-adbf4286a9e3" status: 200 len: 1620 microversion: 2.1 time: 0.352670 May 27 15:03:38.844718 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 725/1525] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:38 2022] GET /compute/v2.1/servers/ea226b76-3184-469f-93c4-adbf4286a9e3 => generated 1620 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:38.855571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e455221d-bf48-4941-b7cf-fe72afb04c35 tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Calling method '.version_select at 0x7fc776d29f70>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:38.912020 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e455221d-bf48-4941-b7cf-fe72afb04c35 tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-607084644" status: 202 len: 0 microversion: 2.1 time: 0.073816 May 27 15:03:38.912630 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 726/1526] 10.222.0.13 () {58 vars in 1217 bytes} [Fri May 27 15:03:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-607084644 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:03:38.917695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7c4a5de1-d14a-47c6-ac55-325eb44c09ab tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:38.918868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7c4a5de1-d14a-47c6-ac55-325eb44c09ab tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:38.952315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7c4a5de1-d14a-47c6-ac55-325eb44c09ab tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:38.965142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7c4a5de1-d14a-47c6-ac55-325eb44c09ab tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:38.966233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7c4a5de1-d14a-47c6-ac55-325eb44c09ab tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:38.966558 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7c4a5de1-d14a-47c6-ac55-325eb44c09ab tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:38.998972 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4484efdf-8f5b-4d9e-a008-e1c6570bae62 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 204 len: 0 microversion: 2.1 time: 0.300399 May 27 15:03:38.999949 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 801/1527] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:03:38 2022] DELETE /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:03:39.008444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ec2a7c84-3924-4234-9bd2-3d90df8afbda tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Action: 'create', calling method: .version_select at 0x7fc776e8c8b0>, body: {"keypair": {"name": "tempest-keypair-1552895879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQDU7Z6rDcrDsNTG8TDeE5wL+P33ytD1kMrIReUcqcbG2j7IF6qDjB9xOr+rZQPkpGrO8jPHDvBn/It5FsS2BZAyFq5KmEpvLVmIGy8FzoxiIyM/LjnVsY/jnjy4pJXqQ=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:39.027087 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-ec2a7c84-3924-4234-9bd2-3d90df8afbda tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Getting quotas for project b91fab3d50964ca78eb25126cc5a0efb. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:39.040332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-ec2a7c84-3924-4234-9bd2-3d90df8afbda tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Getting quotas for user 4ac36743a37549d9bd72b5a60c9e8af2 and project b91fab3d50964ca78eb25126cc5a0efb. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:39.090330 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ec2a7c84-3924-4234-9bd2-3d90df8afbda tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.088914 May 27 15:03:39.091626 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 802/1528] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:03:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:39.098257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5e3c6913-085c-404d-81d5-f7643e76dfeb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:39.099425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5e3c6913-085c-404d-81d5-f7643e76dfeb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:39.106565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5e3c6913-085c-404d-81d5-f7643e76dfeb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:39.107359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5e3c6913-085c-404d-81d5-f7643e76dfeb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:39.108525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5e3c6913-085c-404d-81d5-f7643e76dfeb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:39.110295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5e3c6913-085c-404d-81d5-f7643e76dfeb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:39.337276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5e3c6913-085c-404d-81d5-f7643e76dfeb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590be802bea346fc9240befaae60ec9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3ff9fdd7364a82ad3ed271a33da615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:39.352917 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5e3c6913-085c-404d-81d5-f7643e76dfeb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 200 len: 1684 microversion: 2.1 time: 0.259857 May 27 15:03:39.353646 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7c4a5de1-d14a-47c6-ac55-325eb44c09ab tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:39.354828 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 803/1529] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:39 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 1684 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:39.360490 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-06c1e3e7-f51f-4221-8f07-6e7ff79a9bb5 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-667991739", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "44417337-ef8b-407b-aafd-7f00dfc5b4d8"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:39.368229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7c4a5de1-d14a-47c6-ac55-325eb44c09ab tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:39.369781 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7c4a5de1-d14a-47c6-ac55-325eb44c09ab tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:39.373230 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7c4a5de1-d14a-47c6-ac55-325eb44c09ab tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.459550 May 27 15:03:39.373822 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 727/1530] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:38 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:39.380524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d5002a25-aa9f-40ce-8398-eba4c86ea69b tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Calling method '.version_select at 0x7fc776d29c10>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:39.422725 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d5002a25-aa9f-40ce-8398-eba4c86ea69b tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552895879" status: 202 len: 0 microversion: 2.1 time: 0.044538 May 27 15:03:39.424280 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 728/1531] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 27 15:03:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552895879 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:03:39.429632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e96f0907-4da7-4807-b44f-ab4c5a1a8471 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:39.430252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e96f0907-4da7-4807-b44f-ab4c5a1a8471 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: fa3160e1-6021-4618-8d44-fb03c94ffe08] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:39.431189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-06c1e3e7-f51f-4221-8f07-6e7ff79a9bb5 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] validate_networks() for None {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:03:39.437130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e96f0907-4da7-4807-b44f-ab4c5a1a8471 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:39.437616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e96f0907-4da7-4807-b44f-ab4c5a1a8471 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:39.438397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e96f0907-4da7-4807-b44f-ab4c5a1a8471 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:39.439403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e96f0907-4da7-4807-b44f-ab4c5a1a8471 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:39.767653 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-06c1e3e7-f51f-4221-8f07-6e7ff79a9bb5 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:03:39.768076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-06c1e3e7-f51f-4221-8f07-6e7ff79a9bb5 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:03:39.768555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-06c1e3e7-f51f-4221-8f07-6e7ff79a9bb5 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:03:39.768994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-06c1e3e7-f51f-4221-8f07-6e7ff79a9bb5 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:03:39.769415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-06c1e3e7-f51f-4221-8f07-6e7ff79a9bb5 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:03:39.787202 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06c1e3e7-f51f-4221-8f07-6e7ff79a9bb5 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:39.787654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06c1e3e7-f51f-4221-8f07-6e7ff79a9bb5 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:39.788459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06c1e3e7-f51f-4221-8f07-6e7ff79a9bb5 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:39.788958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06c1e3e7-f51f-4221-8f07-6e7ff79a9bb5 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:39.829568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-06c1e3e7-f51f-4221-8f07-6e7ff79a9bb5 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for project a081b119396543ad8ac9421acc677175. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:39.839501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-06c1e3e7-f51f-4221-8f07-6e7ff79a9bb5 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for user f426b883acdc49f8b0c4a9ba68e4572b and project a081b119396543ad8ac9421acc677175. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:39.841083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e96f0907-4da7-4807-b44f-ab4c5a1a8471 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:39.849856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:39.854107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-06c1e3e7-f51f-4221-8f07-6e7ff79a9bb5 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:03:39.854569 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e96f0907-4da7-4807-b44f-ab4c5a1a8471 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08" status: 200 len: 1489 microversion: 2.1 time: 0.428945 May 27 15:03:39.855728 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 729/1532] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:39 2022] GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08 => generated 1489 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:39.862219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-06c1e3e7-f51f-4221-8f07-6e7ff79a9bb5 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:03:39.873438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8c69395d-1e65-4e2f-854d-194b04172b8b tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Action: 'create', calling method: .version_select at 0x7fc776cbe550>, body: {"keypair": {"name": "tempest-keypair-1307001120", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:39.901823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-8c69395d-1e65-4e2f-854d-194b04172b8b tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Getting quotas for project b91fab3d50964ca78eb25126cc5a0efb. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:39.912309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-8c69395d-1e65-4e2f-854d-194b04172b8b tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Getting quotas for user 4ac36743a37549d9bd72b5a60c9e8af2 and project b91fab3d50964ca78eb25126cc5a0efb. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:39.956951 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8c69395d-1e65-4e2f-854d-194b04172b8b tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.098701 May 27 15:03:39.957226 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-06c1e3e7-f51f-4221-8f07-6e7ff79a9bb5 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601134 May 27 15:03:39.958600 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 730/1533] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:03:39 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:39.969729 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 804/1534] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:03:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:03:39.969948 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-03185a1f-2e01-48f6-a058-ef7f0fcef418 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:39.969948 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-03185a1f-2e01-48f6-a058-ef7f0fcef418 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:39.976793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03185a1f-2e01-48f6-a058-ef7f0fcef418 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:39.977500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03185a1f-2e01-48f6-a058-ef7f0fcef418 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:39.978641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03185a1f-2e01-48f6-a058-ef7f0fcef418 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:39.980869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03185a1f-2e01-48f6-a058-ef7f0fcef418 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:39.982494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-12ae733e-f929-4262-a30b-d8061816fd6f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:39.983277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-12ae733e-f929-4262-a30b-d8061816fd6f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: fa3160e1-6021-4618-8d44-fb03c94ffe08] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:40.013800 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12ae733e-f929-4262-a30b-d8061816fd6f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:40.014261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12ae733e-f929-4262-a30b-d8061816fd6f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:40.015048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12ae733e-f929-4262-a30b-d8061816fd6f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:40.015489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12ae733e-f929-4262-a30b-d8061816fd6f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:40.052130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-12ae733e-f929-4262-a30b-d8061816fd6f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lazy-loading 'flavor' on Instance uuid fa3160e1-6021-4618-8d44-fb03c94ffe08 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:03:40.212294 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-12ae733e-f929-4262-a30b-d8061816fd6f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "POST /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08/action" status: 202 len: 0 microversion: 2.1 time: 0.239124 May 27 15:03:40.229588 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 805/1535] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:03:39 2022] POST /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:03:40.235988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-03185a1f-2e01-48f6-a058-ef7f0fcef418 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:40.243997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-40185a3a-1575-4ba3-885e-4cd7e018b0cf tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Calling method '.version_select at 0x7fc7767400d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:40.248880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-03185a1f-2e01-48f6-a058-ef7f0fcef418 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:40.251872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-03185a1f-2e01-48f6-a058-ef7f0fcef418 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:40.255956 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-03185a1f-2e01-48f6-a058-ef7f0fcef418 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1280 microversion: 2.25 time: 0.292869 May 27 15:03:40.258016 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 731/1536] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:39 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1280 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:40.264587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4a39aa68-1281-4754-b77a-e831dfa9c49d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:40.265359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4a39aa68-1281-4754-b77a-e831dfa9c49d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:40.291465 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-40185a3a-1575-4ba3-885e-4cd7e018b0cf tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1307001120" status: 202 len: 0 microversion: 2.1 time: 0.055454 May 27 15:03:40.293223 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 806/1537] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 27 15:03:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1307001120 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:03:40.298868 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ac1d4aff-b9a6-458b-ae92-7b64c94213c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:40.299880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ac1d4aff-b9a6-458b-ae92-7b64c94213c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: fa3160e1-6021-4618-8d44-fb03c94ffe08] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:40.313615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac1d4aff-b9a6-458b-ae92-7b64c94213c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:40.314093 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac1d4aff-b9a6-458b-ae92-7b64c94213c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:40.315085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac1d4aff-b9a6-458b-ae92-7b64c94213c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:40.315661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac1d4aff-b9a6-458b-ae92-7b64c94213c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:40.367988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4a39aa68-1281-4754-b77a-e831dfa9c49d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:40.375847 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4a39aa68-1281-4754-b77a-e831dfa9c49d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e" status: 200 len: 1216 microversion: 2.1 time: 0.116758 May 27 15:03:40.376425 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 732/1538] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:40 2022] GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e => generated 1216 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:40.398471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-37a9e0c5-a593-4c48-8cea-fcb48ff41993 tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Action: 'create', calling method: .version_select at 0x7fc776cd4160>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-474311117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJccRNOklhrC8Ks3Cqcrsq2E/E7j1/SnoYv/C9d3B//9oq1pS1CRJb5Ko3uYaDzxoB+MTqpWKhQQ+3wOvn/YgFoApQP1Ol7Vbxp03oP077ziIGy+nQw8W/MsVFFLuxs1eg=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:40.436017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-37a9e0c5-a593-4c48-8cea-fcb48ff41993 tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Getting quotas for project b91fab3d50964ca78eb25126cc5a0efb. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:40.442538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-37a9e0c5-a593-4c48-8cea-fcb48ff41993 tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Getting quotas for user 4ac36743a37549d9bd72b5a60c9e8af2 and project b91fab3d50964ca78eb25126cc5a0efb. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:40.504116 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-37a9e0c5-a593-4c48-8cea-fcb48ff41993 tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.114868 May 27 15:03:40.504811 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 733/1539] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:03:40 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:40.513040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8de4df2e-f36c-425d-87e8-df1e8b2e22ef tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:40.513668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8de4df2e-f36c-425d-87e8-df1e8b2e22ef tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:40.530123 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8de4df2e-f36c-425d-87e8-df1e8b2e22ef tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:40.531579 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8de4df2e-f36c-425d-87e8-df1e8b2e22ef tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:40.533741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8de4df2e-f36c-425d-87e8-df1e8b2e22ef tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:40.534213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8de4df2e-f36c-425d-87e8-df1e8b2e22ef tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:40.572288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ac1d4aff-b9a6-458b-ae92-7b64c94213c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:40.581751 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ac1d4aff-b9a6-458b-ae92-7b64c94213c0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08" status: 200 len: 1497 microversion: 2.1 time: 0.288039 May 27 15:03:40.582700 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 807/1540] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:40 2022] GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08 => generated 1497 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:40.595436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6eef7013-003e-4575-982a-b116cc23ce9d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:40.596365 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6eef7013-003e-4575-982a-b116cc23ce9d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:40.607941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6eef7013-003e-4575-982a-b116cc23ce9d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:40.608465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6eef7013-003e-4575-982a-b116cc23ce9d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:40.609314 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6eef7013-003e-4575-982a-b116cc23ce9d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:40.609904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6eef7013-003e-4575-982a-b116cc23ce9d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:41.239554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8de4df2e-f36c-425d-87e8-df1e8b2e22ef tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590be802bea346fc9240befaae60ec9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3ff9fdd7364a82ad3ed271a33da615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:41.247315 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8de4df2e-f36c-425d-87e8-df1e8b2e22ef tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 200 len: 1684 microversion: 2.1 time: 0.741180 May 27 15:03:41.251045 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 734/1541] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:40 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 1684 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:41.263986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1e596cf3-a59b-415c-98e1-60272f34d049 tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Action: 'create', calling method: .version_select at 0x7fc776d544c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1385487521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmq/SEkneZr47AB+Ba2XBKBl/JS2feyzgRiOVg0CmseA87seTyk2kekx9GF5FCW73ZQqGWbgBsN6c8itryAmRLQlT825JLYxNY3Oa1Y3Zwp1GN998UBVD80rxB5UkqeyA=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:41.289060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-1e596cf3-a59b-415c-98e1-60272f34d049 tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Getting quotas for project b91fab3d50964ca78eb25126cc5a0efb. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:41.294496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:41.298962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-1e596cf3-a59b-415c-98e1-60272f34d049 tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Getting quotas for user 4ac36743a37549d9bd72b5a60c9e8af2 and project b91fab3d50964ca78eb25126cc5a0efb. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:41.329739 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1e596cf3-a59b-415c-98e1-60272f34d049 tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.077327 May 27 15:03:41.330565 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 735/1542] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:03:41 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:41.336435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5fbb5bf5-0d37-40de-b7cf-3484433c070d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:41.337485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5fbb5bf5-0d37-40de-b7cf-3484433c070d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:41.346681 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fbb5bf5-0d37-40de-b7cf-3484433c070d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:41.347416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fbb5bf5-0d37-40de-b7cf-3484433c070d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:41.348704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fbb5bf5-0d37-40de-b7cf-3484433c070d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:41.349351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fbb5bf5-0d37-40de-b7cf-3484433c070d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:41.365527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6eef7013-003e-4575-982a-b116cc23ce9d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:41.375451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6eef7013-003e-4575-982a-b116cc23ce9d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:41.377005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6eef7013-003e-4575-982a-b116cc23ce9d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:41.378187 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6eef7013-003e-4575-982a-b116cc23ce9d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.793997 May 27 15:03:41.378761 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 808/1543] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:40 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:41.392026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9b67e314-1706-4248-b2eb-df2c5fa2158a tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Action: 'create', calling method: .version_select at 0x7fc776d4ab80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1356109906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGy7B1mvTmwiLCOFwOhjhq5NfTnjLeh7Phn36HsOx308taznc9vVd3uTOhNDdO9zNGsOrh1N/jxyiKMAoTqO3Dt7GW/kYR/wKoJ5wWDARLAOqZdEi7c1wEIpTtmSWY39/w=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:41.420144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-9b67e314-1706-4248-b2eb-df2c5fa2158a tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Getting quotas for project b91fab3d50964ca78eb25126cc5a0efb. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:41.427173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-9b67e314-1706-4248-b2eb-df2c5fa2158a tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Getting quotas for user 4ac36743a37549d9bd72b5a60c9e8af2 and project b91fab3d50964ca78eb25126cc5a0efb. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:41.455259 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9b67e314-1706-4248-b2eb-df2c5fa2158a tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.069102 May 27 15:03:41.461301 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 809/1544] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:03:41 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:41.472981 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-41074d83-de28-42d8-a3b6-59fae2def12c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:41.473359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-41074d83-de28-42d8-a3b6-59fae2def12c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:41.489793 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41074d83-de28-42d8-a3b6-59fae2def12c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:41.491727 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41074d83-de28-42d8-a3b6-59fae2def12c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:41.494812 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41074d83-de28-42d8-a3b6-59fae2def12c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:41.495316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41074d83-de28-42d8-a3b6-59fae2def12c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:41.679410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-41074d83-de28-42d8-a3b6-59fae2def12c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:41.688642 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-41074d83-de28-42d8-a3b6-59fae2def12c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e" status: 200 len: 1220 microversion: 2.1 time: 0.225924 May 27 15:03:41.693851 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 810/1545] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:41 2022] GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e => generated 1220 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:41.703760 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1da02a79-3cbc-4b47-8aff-1ab415dd189e tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Calling method '.version_select at 0x7fc776721700>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:41.709002 n-d-843621-1 devstack@n-api.service[119248]: WARNING oslo_db.sqlalchemy.utils [None req-1da02a79-3cbc-4b47-8aff-1ab415dd189e tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Unique keys not in sort_keys. The sorting order may be unstable. May 27 15:03:41.715647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5fbb5bf5-0d37-40de-b7cf-3484433c070d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:41.730206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5fbb5bf5-0d37-40de-b7cf-3484433c070d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:41.732736 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1da02a79-3cbc-4b47-8aff-1ab415dd189e tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.037546 May 27 15:03:41.734755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5fbb5bf5-0d37-40de-b7cf-3484433c070d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:41.742729 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 811/1546] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 15:03:41 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:41.746579 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5fbb5bf5-0d37-40de-b7cf-3484433c070d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1280 microversion: 2.25 time: 0.404060 May 27 15:03:41.747472 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 736/1547] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:41 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1280 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:41.754612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e530184f-f859-4dee-9306-e8220db28473 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:41.755656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e530184f-f859-4dee-9306-e8220db28473 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: fa3160e1-6021-4618-8d44-fb03c94ffe08] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:41.759326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d36fa2bb-c539-4318-baf1-99bf2747e03b tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Calling method '.version_select at 0x7fc776be3670>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:41.771918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e530184f-f859-4dee-9306-e8220db28473 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:41.773124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e530184f-f859-4dee-9306-e8220db28473 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:41.777332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e530184f-f859-4dee-9306-e8220db28473 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:41.778113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e530184f-f859-4dee-9306-e8220db28473 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:41.821622 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d36fa2bb-c539-4318-baf1-99bf2747e03b tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1356109906" status: 202 len: 0 microversion: 2.1 time: 0.072766 May 27 15:03:41.825198 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 737/1548] 10.222.0.13 () {58 vars in 1277 bytes} [Fri May 27 15:03:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1356109906 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:03:41.834513 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9b33f58e-078d-4c3f-9620-2984afc41898 tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Calling method '.version_select at 0x7fc776a80f70>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:41.881350 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9b33f58e-078d-4c3f-9620-2984afc41898 tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1385487521" status: 202 len: 0 microversion: 2.1 time: 0.054714 May 27 15:03:41.885476 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 738/1549] 10.222.0.13 () {58 vars in 1277 bytes} [Fri May 27 15:03:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1385487521 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:03:41.896078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8f3eea55-8429-46a1-acc4-ab12946feac0 tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] Calling method '.version_select at 0x7fc776c9d9d0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:41.963760 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8f3eea55-8429-46a1-acc4-ab12946feac0 tempest-KeyPairsV2TestJSON-1856048604 tempest-KeyPairsV2TestJSON-1856048604-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-474311117" status: 202 len: 0 microversion: 2.1 time: 0.076663 May 27 15:03:41.970874 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 739/1550] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 15:03:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-474311117 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:03:42.271499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-154653f8-f71d-4a9b-b4b4-33e8f6c20ade tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:42.272435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-154653f8-f71d-4a9b-b4b4-33e8f6c20ade tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:42.281798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-154653f8-f71d-4a9b-b4b4-33e8f6c20ade tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:42.282316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-154653f8-f71d-4a9b-b4b4-33e8f6c20ade tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:42.283109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-154653f8-f71d-4a9b-b4b4-33e8f6c20ade tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:42.283708 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-154653f8-f71d-4a9b-b4b4-33e8f6c20ade tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:42.318256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e530184f-f859-4dee-9306-e8220db28473 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:42.329404 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e530184f-f859-4dee-9306-e8220db28473 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08" status: 200 len: 1480 microversion: 2.1 time: 0.585370 May 27 15:03:42.337242 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 812/1551] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:41 2022] GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08 => generated 1480 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:42.345977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-80bd039a-f6b9-43c4-8a61-c566d541cef7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-746287178"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:42.347416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-80bd039a-f6b9-43c4-8a61-c566d541cef7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: fa3160e1-6021-4618-8d44-fb03c94ffe08] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:42.363080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-80bd039a-f6b9-43c4-8a61-c566d541cef7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:42.363702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-80bd039a-f6b9-43c4-8a61-c566d541cef7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:42.364614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-80bd039a-f6b9-43c4-8a61-c566d541cef7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:42.366708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-80bd039a-f6b9-43c4-8a61-c566d541cef7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:42.669863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-154653f8-f71d-4a9b-b4b4-33e8f6c20ade tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590be802bea346fc9240befaae60ec9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3ff9fdd7364a82ad3ed271a33da615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:42.684687 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-154653f8-f71d-4a9b-b4b4-33e8f6c20ade tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 200 len: 1684 microversion: 2.1 time: 0.419110 May 27 15:03:42.696352 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 740/1552] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:42 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 1684 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:42.732190 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6e371e6e-e55f-45da-8e40-1a709d4558e8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:42.735793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6e371e6e-e55f-45da-8e40-1a709d4558e8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:42.748907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6e371e6e-e55f-45da-8e40-1a709d4558e8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:42.752082 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6e371e6e-e55f-45da-8e40-1a709d4558e8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:42.753345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6e371e6e-e55f-45da-8e40-1a709d4558e8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:42.753993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6e371e6e-e55f-45da-8e40-1a709d4558e8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:42.800233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:42.987026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:43.057876 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-80bd039a-f6b9-43c4-8a61-c566d541cef7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "POST /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08/action" status: 202 len: 0 microversion: 2.1 time: 0.715307 May 27 15:03:43.057996 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 813/1553] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:03:42 2022] POST /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08/action => generated 0 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 27 15:03:43.072084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-573d3107-6833-44f9-9dd8-d7402b95585d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:43.075013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-573d3107-6833-44f9-9dd8-d7402b95585d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:43.088348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-573d3107-6833-44f9-9dd8-d7402b95585d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:43.088851 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-573d3107-6833-44f9-9dd8-d7402b95585d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:43.096036 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-573d3107-6833-44f9-9dd8-d7402b95585d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:43.096693 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-573d3107-6833-44f9-9dd8-d7402b95585d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:43.251030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-573d3107-6833-44f9-9dd8-d7402b95585d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:43.264556 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-573d3107-6833-44f9-9dd8-d7402b95585d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e" status: 200 len: 1274 microversion: 2.1 time: 0.205345 May 27 15:03:43.265524 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 814/1554] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:43 2022] GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e => generated 1274 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:43.282259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-56250b6a-8fe7-46d6-bcc8-ba3254c2a419 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:43.282890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-56250b6a-8fe7-46d6-bcc8-ba3254c2a419 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:43.297289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-56250b6a-8fe7-46d6-bcc8-ba3254c2a419 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:43.297755 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-56250b6a-8fe7-46d6-bcc8-ba3254c2a419 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:43.298549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-56250b6a-8fe7-46d6-bcc8-ba3254c2a419 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:43.299005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-56250b6a-8fe7-46d6-bcc8-ba3254c2a419 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:43.317092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6e371e6e-e55f-45da-8e40-1a709d4558e8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:43.336013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6e371e6e-e55f-45da-8e40-1a709d4558e8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:43.343049 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6e371e6e-e55f-45da-8e40-1a709d4558e8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:43.345188 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6e371e6e-e55f-45da-8e40-1a709d4558e8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.629235 May 27 15:03:43.349624 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 741/1555] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:42 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:43.370784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e669f744-6512-4095-a6d0-a26343065ed6 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776d64d30>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:43.452086 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e669f744-6512-4095-a6d0-a26343065ed6 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1437 microversion: 2.1 time: 0.101160 May 27 15:03:43.453650 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 742/1556] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:43 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1437 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:43.529204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-56250b6a-8fe7-46d6-bcc8-ba3254c2a419 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:43.541694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-56250b6a-8fe7-46d6-bcc8-ba3254c2a419 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:43.544555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-56250b6a-8fe7-46d6-bcc8-ba3254c2a419 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:43.546018 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-56250b6a-8fe7-46d6-bcc8-ba3254c2a419 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1280 microversion: 2.25 time: 0.279549 May 27 15:03:43.547358 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 815/1557] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:43 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1280 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:43.633631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-afe933e6-df4f-4836-a312-3a0d46ef489e tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-454456090", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "684efa1b-7bb1-423b-b91c-b58edd8a8dc9"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:43.695883 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-afe933e6-df4f-4836-a312-3a0d46ef489e tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] validate_networks() for [('684efa1b-7bb1-423b-b91c-b58edd8a8dc9', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:03:43.704093 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b719fa68-85f9-4fa9-acdd-64111d3f5358 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:43.705324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b719fa68-85f9-4fa9-acdd-64111d3f5358 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:43.716425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b719fa68-85f9-4fa9-acdd-64111d3f5358 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:43.718275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b719fa68-85f9-4fa9-acdd-64111d3f5358 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:43.719798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b719fa68-85f9-4fa9-acdd-64111d3f5358 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:43.723430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b719fa68-85f9-4fa9-acdd-64111d3f5358 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:44.051624 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b719fa68-85f9-4fa9-acdd-64111d3f5358 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590be802bea346fc9240befaae60ec9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3ff9fdd7364a82ad3ed271a33da615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:44.068479 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b719fa68-85f9-4fa9-acdd-64111d3f5358 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 200 len: 1684 microversion: 2.1 time: 0.368759 May 27 15:03:44.079217 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 816/1558] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:43 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 1684 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:44.285376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-56998b94-314b-426c-97bb-ca82053e9c3f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:44.286092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-56998b94-314b-426c-97bb-ca82053e9c3f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:44.306758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-56998b94-314b-426c-97bb-ca82053e9c3f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:44.308379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-56998b94-314b-426c-97bb-ca82053e9c3f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:44.310868 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-56998b94-314b-426c-97bb-ca82053e9c3f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:44.311499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-56998b94-314b-426c-97bb-ca82053e9c3f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:44.542994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-afe933e6-df4f-4836-a312-3a0d46ef489e tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:03:44.543599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-afe933e6-df4f-4836-a312-3a0d46ef489e tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:03:44.544299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-afe933e6-df4f-4836-a312-3a0d46ef489e tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:03:44.544984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-afe933e6-df4f-4836-a312-3a0d46ef489e tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:03:44.545623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-afe933e6-df4f-4836-a312-3a0d46ef489e tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:03:44.563923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afe933e6-df4f-4836-a312-3a0d46ef489e tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:44.567990 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afe933e6-df4f-4836-a312-3a0d46ef489e tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:44.571681 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afe933e6-df4f-4836-a312-3a0d46ef489e tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:44.572353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afe933e6-df4f-4836-a312-3a0d46ef489e tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:44.615044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-56998b94-314b-426c-97bb-ca82053e9c3f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:44.637519 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-56998b94-314b-426c-97bb-ca82053e9c3f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e" status: 200 len: 1274 microversion: 2.1 time: 0.359068 May 27 15:03:44.641799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-afe933e6-df4f-4836-a312-3a0d46ef489e tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Getting quotas for project d986899c1cbd4b0bb94d6615a0b5e26e. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:44.648859 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 817/1559] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:44 2022] GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e => generated 1274 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:44.654008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5c5ffc95-4fc8-41e1-b57f-ef89d8b0bf0b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:44.654832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5c5ffc95-4fc8-41e1-b57f-ef89d8b0bf0b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:44.673848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c5ffc95-4fc8-41e1-b57f-ef89d8b0bf0b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:44.674336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-afe933e6-df4f-4836-a312-3a0d46ef489e tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Getting quotas for user 50b34e3da4684475bfd453cf52ed53ad and project d986899c1cbd4b0bb94d6615a0b5e26e. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:44.674840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c5ffc95-4fc8-41e1-b57f-ef89d8b0bf0b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:44.675788 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c5ffc95-4fc8-41e1-b57f-ef89d8b0bf0b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:44.676245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c5ffc95-4fc8-41e1-b57f-ef89d8b0bf0b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:44.691920 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-afe933e6-df4f-4836-a312-3a0d46ef489e tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:03:44.695021 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-afe933e6-df4f-4836-a312-3a0d46ef489e tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:03:44.821910 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-afe933e6-df4f-4836-a312-3a0d46ef489e tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.367006 May 27 15:03:44.832323 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 743/1560] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 27 15:03:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1378 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 15:03:44.842067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-346c6a33-5188-4766-b934-82a9ef2e3463 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776cbe790>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:44.963043 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-346c6a33-5188-4766-b934-82a9ef2e3463 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1437 microversion: 2.1 time: 0.127637 May 27 15:03:44.963633 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 744/1561] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:44 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1437 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:44.981300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-786e268d-8aef-4e9b-8755-d3680b131555 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:44.981945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-786e268d-8aef-4e9b-8755-d3680b131555 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:45.006503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-786e268d-8aef-4e9b-8755-d3680b131555 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:45.007172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-786e268d-8aef-4e9b-8755-d3680b131555 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:45.008591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-786e268d-8aef-4e9b-8755-d3680b131555 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:45.009283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-786e268d-8aef-4e9b-8755-d3680b131555 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:45.412330 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5c5ffc95-4fc8-41e1-b57f-ef89d8b0bf0b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:45.433501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5c5ffc95-4fc8-41e1-b57f-ef89d8b0bf0b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:45.441092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5c5ffc95-4fc8-41e1-b57f-ef89d8b0bf0b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:45.445701 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5c5ffc95-4fc8-41e1-b57f-ef89d8b0bf0b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.795435 May 27 15:03:45.447778 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 818/1562] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:44 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:45.469373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c78243f1-6142-43e8-8784-6f47b6b8851c tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:45.473036 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c78243f1-6142-43e8-8784-6f47b6b8851c tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:45.761925 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c78243f1-6142-43e8-8784-6f47b6b8851c tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:45.774285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c78243f1-6142-43e8-8784-6f47b6b8851c tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:45.782114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c78243f1-6142-43e8-8784-6f47b6b8851c tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:45.787825 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c78243f1-6142-43e8-8784-6f47b6b8851c tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1" status: 200 len: 1258 microversion: 2.21 time: 0.334501 May 27 15:03:45.790000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-786e268d-8aef-4e9b-8755-d3680b131555 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:45.803748 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 819/1563] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:45 2022] GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 => generated 1258 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:45.804448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-786e268d-8aef-4e9b-8755-d3680b131555 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:45.806435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-786e268d-8aef-4e9b-8755-d3680b131555 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:45.807858 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-786e268d-8aef-4e9b-8755-d3680b131555 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1280 microversion: 2.25 time: 0.836862 May 27 15:03:45.811925 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 745/1564] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:44 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1280 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:45.821390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-334876c3-e68e-4ceb-a7b2-9b5a702454ab tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:45.824046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-334876c3-e68e-4ceb-a7b2-9b5a702454ab tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:45.824203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-5df9112a-4ea6-4587-8b49-2c4e170595f2 req-af816d63-2af3-4c14-ad9d-83ccf7898d00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ae8a942-8725-474d-a782-1faf50e606b3", "name": "network-vif-deleted", "tag": "34f5db1a-cf77-4163-b1d7-8eace101a7e7"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:45.849547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-5df9112a-4ea6-4587-8b49-2c4e170595f2 req-af816d63-2af3-4c14-ad9d-83ccf7898d00 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:45.852537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-5df9112a-4ea6-4587-8b49-2c4e170595f2 req-af816d63-2af3-4c14-ad9d-83ccf7898d00 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:45.854234 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-334876c3-e68e-4ceb-a7b2-9b5a702454ab tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:45.854959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-334876c3-e68e-4ceb-a7b2-9b5a702454ab tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:45.856144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-334876c3-e68e-4ceb-a7b2-9b5a702454ab tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:45.857086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-334876c3-e68e-4ceb-a7b2-9b5a702454ab tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:45.874497 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-5df9112a-4ea6-4587-8b49-2c4e170595f2 req-af816d63-2af3-4c14-ad9d-83ccf7898d00 service nova] Creating event network-vif-deleted:34f5db1a-cf77-4163-b1d7-8eace101a7e7 for instance 1ae8a942-8725-474d-a782-1faf50e606b3 on n-h1-843621-1 May 27 15:03:45.911659 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-5df9112a-4ea6-4587-8b49-2c4e170595f2 req-af816d63-2af3-4c14-ad9d-83ccf7898d00 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104184 May 27 15:03:45.915480 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 820/1565] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:45.935145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-334876c3-e68e-4ceb-a7b2-9b5a702454ab tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:45.936807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-334876c3-e68e-4ceb-a7b2-9b5a702454ab tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:45.938049 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-334876c3-e68e-4ceb-a7b2-9b5a702454ab tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lazy-loading 'fault' on Instance uuid 1ae8a942-8725-474d-a782-1faf50e606b3 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:03:45.942602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0afc1e0a-edc2-4853-aa48-c242cd0dbe57 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:45.946974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0afc1e0a-edc2-4853-aa48-c242cd0dbe57 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:45.961035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0afc1e0a-edc2-4853-aa48-c242cd0dbe57 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:45.978698 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0afc1e0a-edc2-4853-aa48-c242cd0dbe57 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:45.983753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0afc1e0a-edc2-4853-aa48-c242cd0dbe57 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:45.988406 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0afc1e0a-edc2-4853-aa48-c242cd0dbe57 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:46.066600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-334876c3-e68e-4ceb-a7b2-9b5a702454ab tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590be802bea346fc9240befaae60ec9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3ff9fdd7364a82ad3ed271a33da615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:46.083194 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-334876c3-e68e-4ceb-a7b2-9b5a702454ab tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 200 len: 1332 microversion: 2.1 time: 0.266873 May 27 15:03:46.087259 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 746/1566] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:45 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 1332 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:46.105365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-30b5adb5-2086-412b-b255-2a3088a508a9 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776d3faf0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:46.323430 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-30b5adb5-2086-412b-b255-2a3088a508a9 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1437 microversion: 2.1 time: 0.234476 May 27 15:03:46.324195 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 747/1567] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:46 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1437 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:46.466664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-54d09f16-e128-4134-a81c-a05e00327346 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:46.467833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-54d09f16-e128-4134-a81c-a05e00327346 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:46.479335 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54d09f16-e128-4134-a81c-a05e00327346 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:46.481500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54d09f16-e128-4134-a81c-a05e00327346 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:46.482599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54d09f16-e128-4134-a81c-a05e00327346 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:46.485317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54d09f16-e128-4134-a81c-a05e00327346 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:47.151837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-54d09f16-e128-4134-a81c-a05e00327346 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:47.172621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-54d09f16-e128-4134-a81c-a05e00327346 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:47.175861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-54d09f16-e128-4134-a81c-a05e00327346 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:47.184103 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-54d09f16-e128-4134-a81c-a05e00327346 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.718670 May 27 15:03:47.185397 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 748/1568] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:46 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:03:47.199354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e111d4ed-16c0-4c95-88f3-6f2d1c407fd3 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:47.200505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e111d4ed-16c0-4c95-88f3-6f2d1c407fd3 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:47.219758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e111d4ed-16c0-4c95-88f3-6f2d1c407fd3 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:47.224661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e111d4ed-16c0-4c95-88f3-6f2d1c407fd3 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:47.227411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e111d4ed-16c0-4c95-88f3-6f2d1c407fd3 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:47.229103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e111d4ed-16c0-4c95-88f3-6f2d1c407fd3 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:47.416303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e111d4ed-16c0-4c95-88f3-6f2d1c407fd3 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:47.431766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e111d4ed-16c0-4c95-88f3-6f2d1c407fd3 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:47.436692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e111d4ed-16c0-4c95-88f3-6f2d1c407fd3 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:47.440911 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e111d4ed-16c0-4c95-88f3-6f2d1c407fd3 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1" status: 200 len: 1310 microversion: 2.21 time: 0.253211 May 27 15:03:47.441720 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 749/1569] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:47 2022] GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 => generated 1310 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:47.456913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-800c3a86-106c-47a2-88bb-dc98d0a5eacc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:47.457830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-800c3a86-106c-47a2-88bb-dc98d0a5eacc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:47.472505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-800c3a86-106c-47a2-88bb-dc98d0a5eacc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:47.478386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-800c3a86-106c-47a2-88bb-dc98d0a5eacc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:47.480701 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-800c3a86-106c-47a2-88bb-dc98d0a5eacc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:47.481353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-800c3a86-106c-47a2-88bb-dc98d0a5eacc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:47.513736 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0afc1e0a-edc2-4853-aa48-c242cd0dbe57 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:47.524070 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0afc1e0a-edc2-4853-aa48-c242cd0dbe57 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e" status: 200 len: 1316 microversion: 2.1 time: 1.604930 May 27 15:03:47.524663 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 821/1570] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:45 2022] GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e => generated 1316 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:47.544839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e24e864a-fa71-4192-a408-e299b3dcd4dd tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:47.545466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e24e864a-fa71-4192-a408-e299b3dcd4dd tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:47.595297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e24e864a-fa71-4192-a408-e299b3dcd4dd tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:47.605504 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e24e864a-fa71-4192-a408-e299b3dcd4dd tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:47.608492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e24e864a-fa71-4192-a408-e299b3dcd4dd tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:47.611244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e24e864a-fa71-4192-a408-e299b3dcd4dd tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:47.676623 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-e24e864a-fa71-4192-a408-e299b3dcd4dd tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] HTTP exception thrown: Instance 1ae8a942-8725-474d-a782-1faf50e606b3 could not be found. May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e24e864a-fa71-4192-a408-e299b3dcd4dd tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Request method failure captured: May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 HTTP/1.1 May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOdKOsO5B5ZBMI9yJO1IsnK9bGtL9teNQY6id6m3A9eEUy4hLHSvtaP7YmFCx0ur0stQrC9uv5z4glRp4zQ8idyRukYNaStNxDDWZ_n0mjS8t53TyHC40KvL4cEwxRarEVznJp2nYuyZ9-lLsE5jcsvU3tfcf7TXffixSpYSEzBT6ZM May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: ea3ff9fdd7364a82ad3ed271a33da615 May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1346408267 May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea3ff9fdd7364a82ad3ed271a33da615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea3ff9fdd7364a82ad3ed271a33da615"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea3ff9fdd7364a82ad3ed271a33da615"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea3ff9fdd7364a82ad3ed271a33da615", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1346408267 May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: ea3ff9fdd7364a82ad3ed271a33da615 May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1346408267 May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AttachSCSIVolumeTestJSON-1346408267-project May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 590be802bea346fc9240befaae60ec9e May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1346408267-project May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 1ae8a942-8725-474d-a782-1faf50e606b3 could not be found. May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '1ae8a942-8725-474d-a782-1faf50e606b3'} May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ae8a942-8725-474d-a782-1faf50e606b3 could not be found. May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ae8a942-8725-474d-a782-1faf50e606b3 could not be found. May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:03:47.686562 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:47.691747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:03:47.691747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:03:47.691747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:03:47.691747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:03:47.691747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:03:47.691747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ae8a942-8725-474d-a782-1faf50e606b3 could not be found. May 27 15:03:47.691747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:03:47.698966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e24e864a-fa71-4192-a408-e299b3dcd4dd tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Returning 404 to user: Instance 1ae8a942-8725-474d-a782-1faf50e606b3 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:03:47.702871 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e24e864a-fa71-4192-a408-e299b3dcd4dd tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 404 len: 111 microversion: 2.1 time: 0.161856 May 27 15:03:47.709069 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 822/1571] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:47 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:03:47.731000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-372f6d18-7076-45e3-bf65-90eeac28041d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc7765d94c0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:47.756121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-800c3a86-106c-47a2-88bb-dc98d0a5eacc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:47.777835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-800c3a86-106c-47a2-88bb-dc98d0a5eacc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:47.779718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-800c3a86-106c-47a2-88bb-dc98d0a5eacc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:47.793572 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-800c3a86-106c-47a2-88bb-dc98d0a5eacc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1280 microversion: 2.25 time: 0.336873 May 27 15:03:47.794249 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 750/1572] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:47 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1280 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:47.817460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-603e2db8-9b80-430d-95c2-934d766f6193 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '.version_select at 0x7fc776d78b80>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:47.891153 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-603e2db8-9b80-430d-95c2-934d766f6193 tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1420042190" status: 202 len: 0 microversion: 2.1 time: 0.082881 May 27 15:03:47.896041 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 751/1573] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 27 15:03:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1420042190 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:03:47.901001 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-372f6d18-7076-45e3-bf65-90eeac28041d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1437 microversion: 2.1 time: 0.187445 May 27 15:03:47.910875 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 823/1574] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:47 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1437 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:48.208299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5e152d2c-fff8-460d-b878-95215754940c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:48.209992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5e152d2c-fff8-460d-b878-95215754940c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:48.227872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e152d2c-fff8-460d-b878-95215754940c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:48.228786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e152d2c-fff8-460d-b878-95215754940c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:48.231120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e152d2c-fff8-460d-b878-95215754940c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:48.244443 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e152d2c-fff8-460d-b878-95215754940c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:48.462473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c6e36e28-5501-468f-b29c-d5988f7ac0cb tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:48.463111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c6e36e28-5501-468f-b29c-d5988f7ac0cb tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:48.485159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c6e36e28-5501-468f-b29c-d5988f7ac0cb tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:48.485632 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c6e36e28-5501-468f-b29c-d5988f7ac0cb tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:48.486445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c6e36e28-5501-468f-b29c-d5988f7ac0cb tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:48.486898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c6e36e28-5501-468f-b29c-d5988f7ac0cb tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:49.024079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c6e36e28-5501-468f-b29c-d5988f7ac0cb tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:49.036231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c6e36e28-5501-468f-b29c-d5988f7ac0cb tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:49.043103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c6e36e28-5501-468f-b29c-d5988f7ac0cb tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:49.044370 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c6e36e28-5501-468f-b29c-d5988f7ac0cb tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1" status: 200 len: 1316 microversion: 2.21 time: 0.588786 May 27 15:03:49.050127 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 824/1575] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:48 2022] GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 => generated 1316 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:49.056820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1f871a8e-9b59-4ceb-8af7-a2bf115ead19 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:49.057451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1f871a8e-9b59-4ceb-8af7-a2bf115ead19 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:49.080316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f871a8e-9b59-4ceb-8af7-a2bf115ead19 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:49.080796 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f871a8e-9b59-4ceb-8af7-a2bf115ead19 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:49.085486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f871a8e-9b59-4ceb-8af7-a2bf115ead19 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:49.086285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f871a8e-9b59-4ceb-8af7-a2bf115ead19 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:49.145068 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5e152d2c-fff8-460d-b878-95215754940c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:49.183536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5e152d2c-fff8-460d-b878-95215754940c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:49.187641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5e152d2c-fff8-460d-b878-95215754940c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:49.192106 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5e152d2c-fff8-460d-b878-95215754940c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.988171 May 27 15:03:49.193531 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 752/1576] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:48 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:49.208616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ba0ff76f-3a1e-46a1-81a8-8d631d668e79 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:49.210294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ba0ff76f-3a1e-46a1-81a8-8d631d668e79 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:49.242623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ba0ff76f-3a1e-46a1-81a8-8d631d668e79 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:49.243248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ba0ff76f-3a1e-46a1-81a8-8d631d668e79 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:49.244854 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ba0ff76f-3a1e-46a1-81a8-8d631d668e79 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:49.250477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ba0ff76f-3a1e-46a1-81a8-8d631d668e79 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:49.670670 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ba0ff76f-3a1e-46a1-81a8-8d631d668e79 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:49.683895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ba0ff76f-3a1e-46a1-81a8-8d631d668e79 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:49.685760 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ba0ff76f-3a1e-46a1-81a8-8d631d668e79 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:49.687242 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ba0ff76f-3a1e-46a1-81a8-8d631d668e79 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1280 microversion: 2.25 time: 0.491574 May 27 15:03:49.689422 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 753/1577] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:49 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1280 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:49.695648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-fcb66800-2059-41d0-8f9a-caa8cb7593c6 req-8b141533-5dd7-480a-8f3a-c686d1fccc4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12d7cca3-a419-4171-b2f7-d3ea5eee2a0e", "tag": "33ee41da-e298-4ee9-9a25-20564f1f7632"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:49.706007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-fcb66800-2059-41d0-8f9a-caa8cb7593c6 req-8b141533-5dd7-480a-8f3a-c686d1fccc4d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:49.706830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-fcb66800-2059-41d0-8f9a-caa8cb7593c6 req-8b141533-5dd7-480a-8f3a-c686d1fccc4d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:49.708709 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1f871a8e-9b59-4ceb-8af7-a2bf115ead19 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:49.720895 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-fcb66800-2059-41d0-8f9a-caa8cb7593c6 req-8b141533-5dd7-480a-8f3a-c686d1fccc4d service nova] Creating event network-changed:33ee41da-e298-4ee9-9a25-20564f1f7632 for instance 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e on n-h1-843621-1 May 27 15:03:49.721613 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1f871a8e-9b59-4ceb-8af7-a2bf115ead19 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e" status: 200 len: 1316 microversion: 2.1 time: 0.665596 May 27 15:03:49.726215 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 825/1578] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:49 2022] GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e => generated 1316 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:49.739962 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-fcb66800-2059-41d0-8f9a-caa8cb7593c6 req-8b141533-5dd7-480a-8f3a-c686d1fccc4d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048405 May 27 15:03:49.742862 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 754/1579] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:49.750734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3af9a2c1-d297-40c0-9cb6-b4ba61001aee tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc77677c670>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:49.805712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:49.852517 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3af9a2c1-d297-40c0-9cb6-b4ba61001aee tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1437 microversion: 2.1 time: 0.124053 May 27 15:03:49.858067 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 826/1580] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:49 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1437 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:50.071126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d445fc1a-0019-4827-b20d-f8e678b86c14 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:50.083202 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d445fc1a-0019-4827-b20d-f8e678b86c14 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:50.113483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d445fc1a-0019-4827-b20d-f8e678b86c14 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:50.114684 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d445fc1a-0019-4827-b20d-f8e678b86c14 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:50.117732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d445fc1a-0019-4827-b20d-f8e678b86c14 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:50.119128 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d445fc1a-0019-4827-b20d-f8e678b86c14 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:50.270928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d445fc1a-0019-4827-b20d-f8e678b86c14 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:50.279775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d445fc1a-0019-4827-b20d-f8e678b86c14 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:50.281381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d445fc1a-0019-4827-b20d-f8e678b86c14 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:50.282525 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d445fc1a-0019-4827-b20d-f8e678b86c14 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1" status: 200 len: 1316 microversion: 2.21 time: 0.216502 May 27 15:03:50.283087 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 827/1581] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:50 2022] GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 => generated 1316 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:50.298572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dfc24f5f-847e-4fee-a700-295fb608ab3f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:50.302105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dfc24f5f-847e-4fee-a700-295fb608ab3f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:50.315779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dfc24f5f-847e-4fee-a700-295fb608ab3f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:50.322227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dfc24f5f-847e-4fee-a700-295fb608ab3f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:50.323423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dfc24f5f-847e-4fee-a700-295fb608ab3f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:50.324232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dfc24f5f-847e-4fee-a700-295fb608ab3f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:50.342941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0d59ee7c-286e-4a48-81c0-2a4626af2f02 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-981163411", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "a400f266-0bb2-420b-8500-ad7b63a44ef7"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:50.445092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-0d59ee7c-286e-4a48-81c0-2a4626af2f02 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] validate_networks() for [('a400f266-0bb2-420b-8500-ad7b63a44ef7', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:03:51.192842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dfc24f5f-847e-4fee-a700-295fb608ab3f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:51.227590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dfc24f5f-847e-4fee-a700-295fb608ab3f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:51.229277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dfc24f5f-847e-4fee-a700-295fb608ab3f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:51.230536 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dfc24f5f-847e-4fee-a700-295fb608ab3f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.938650 May 27 15:03:51.239961 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 828/1582] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:50 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:51.268526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5f4d2e34-2a17-44c7-b7d8-0422ebe1e1aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:51.273733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5f4d2e34-2a17-44c7-b7d8-0422ebe1e1aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:51.309073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f4d2e34-2a17-44c7-b7d8-0422ebe1e1aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:51.313443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f4d2e34-2a17-44c7-b7d8-0422ebe1e1aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:51.314625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f4d2e34-2a17-44c7-b7d8-0422ebe1e1aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:51.315590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f4d2e34-2a17-44c7-b7d8-0422ebe1e1aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:51.792454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5f4d2e34-2a17-44c7-b7d8-0422ebe1e1aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:51.803979 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5f4d2e34-2a17-44c7-b7d8-0422ebe1e1aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:51.806349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5f4d2e34-2a17-44c7-b7d8-0422ebe1e1aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:51.810982 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5f4d2e34-2a17-44c7-b7d8-0422ebe1e1aa tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1280 microversion: 2.25 time: 0.569881 May 27 15:03:51.812740 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 829/1583] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:51 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1280 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:51.820652 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0c5d7f0b-6417-44ef-be6d-8fef3768bc6e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:51.823203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0c5d7f0b-6417-44ef-be6d-8fef3768bc6e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:51.837763 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c5d7f0b-6417-44ef-be6d-8fef3768bc6e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:51.841264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c5d7f0b-6417-44ef-be6d-8fef3768bc6e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:51.842289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c5d7f0b-6417-44ef-be6d-8fef3768bc6e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:51.842910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c5d7f0b-6417-44ef-be6d-8fef3768bc6e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:51.874171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-0d59ee7c-286e-4a48-81c0-2a4626af2f02 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:03:51.875286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-0d59ee7c-286e-4a48-81c0-2a4626af2f02 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:03:51.875961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-0d59ee7c-286e-4a48-81c0-2a4626af2f02 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:03:51.876540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-0d59ee7c-286e-4a48-81c0-2a4626af2f02 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:03:51.877156 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-0d59ee7c-286e-4a48-81c0-2a4626af2f02 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:03:51.891134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0d59ee7c-286e-4a48-81c0-2a4626af2f02 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:51.891865 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0d59ee7c-286e-4a48-81c0-2a4626af2f02 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:51.892886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0d59ee7c-286e-4a48-81c0-2a4626af2f02 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:51.897342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0d59ee7c-286e-4a48-81c0-2a4626af2f02 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:51.935198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-0d59ee7c-286e-4a48-81c0-2a4626af2f02 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Getting quotas for project 37b5a0b0723a46c1b0755e824e32b776. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:03:51.945531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-0d59ee7c-286e-4a48-81c0-2a4626af2f02 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Getting quotas for user 0536f4a5547545acaa06b6aad5d1fbe4 and project 37b5a0b0723a46c1b0755e824e32b776. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:03:51.967838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0d59ee7c-286e-4a48-81c0-2a4626af2f02 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:03:51.971484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0d59ee7c-286e-4a48-81c0-2a4626af2f02 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 2834b60d-ed8c-48d6-bbf5-2daeec41f497] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:03:52.049672 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0d59ee7c-286e-4a48-81c0-2a4626af2f02 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.998294 May 27 15:03:52.055753 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 755/1584] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:03:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:03:52.068947 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e03b7c69-4d65-455c-a207-eba8700e25d0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776dfc550>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:52.255996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0c5d7f0b-6417-44ef-be6d-8fef3768bc6e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:52.270196 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0c5d7f0b-6417-44ef-be6d-8fef3768bc6e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e" status: 200 len: 1316 microversion: 2.1 time: 0.456157 May 27 15:03:52.282957 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 830/1585] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:51 2022] GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e => generated 1316 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:52.295208 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e03b7c69-4d65-455c-a207-eba8700e25d0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1437 microversion: 2.1 time: 0.238070 May 27 15:03:52.303685 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 756/1586] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:52 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1437 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:52.303942 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-6a10cfdc-4620-491a-bd9a-0c14f837c1ed req-6d0af4f5-18ab-41d7-ad3e-55f5c16c363d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3160e1-6021-4618-8d44-fb03c94ffe08", "name": "network-vif-plugged", "status": "completed", "tag": "19d47f23-5967-48f2-8242-77be2fe51d5b"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:52.310160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-933b608a-a021-4bbb-bf34-c6016e106c67 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:52.313603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-933b608a-a021-4bbb-bf34-c6016e106c67 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:52.321516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-6a10cfdc-4620-491a-bd9a-0c14f837c1ed req-6d0af4f5-18ab-41d7-ad3e-55f5c16c363d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:52.322303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-6a10cfdc-4620-491a-bd9a-0c14f837c1ed req-6d0af4f5-18ab-41d7-ad3e-55f5c16c363d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:52.326746 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-933b608a-a021-4bbb-bf34-c6016e106c67 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:52.329006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-933b608a-a021-4bbb-bf34-c6016e106c67 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:52.330208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-933b608a-a021-4bbb-bf34-c6016e106c67 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:52.332460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-933b608a-a021-4bbb-bf34-c6016e106c67 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:52.358403 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-6a10cfdc-4620-491a-bd9a-0c14f837c1ed req-6d0af4f5-18ab-41d7-ad3e-55f5c16c363d service nova] Creating event network-vif-plugged:19d47f23-5967-48f2-8242-77be2fe51d5b for instance fa3160e1-6021-4618-8d44-fb03c94ffe08 on n-h2-843621-1 May 27 15:03:52.367927 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-6a10cfdc-4620-491a-bd9a-0c14f837c1ed req-6d0af4f5-18ab-41d7-ad3e-55f5c16c363d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090448 May 27 15:03:52.379365 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 831/1587] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:52.394031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-15c6d6c2-89d5-46ff-b004-63f7fb65d721 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:52.395577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-15c6d6c2-89d5-46ff-b004-63f7fb65d721 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 2834b60d-ed8c-48d6-bbf5-2daeec41f497] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:52.622364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-15c6d6c2-89d5-46ff-b004-63f7fb65d721 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:52.635901 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-15c6d6c2-89d5-46ff-b004-63f7fb65d721 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497" status: 200 len: 1214 microversion: 2.1 time: 0.252691 May 27 15:03:52.648109 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 832/1588] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:52 2022] GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 => generated 1214 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:52.675375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d2dcca46-9540-4bdb-8f11-fe7d433da273 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:52.676009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d2dcca46-9540-4bdb-8f11-fe7d433da273 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:52.712733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2dcca46-9540-4bdb-8f11-fe7d433da273 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:52.713410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2dcca46-9540-4bdb-8f11-fe7d433da273 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:52.716348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2dcca46-9540-4bdb-8f11-fe7d433da273 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:52.718649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2dcca46-9540-4bdb-8f11-fe7d433da273 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:52.789860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-933b608a-a021-4bbb-bf34-c6016e106c67 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:52.803239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-933b608a-a021-4bbb-bf34-c6016e106c67 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:52.808491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-933b608a-a021-4bbb-bf34-c6016e106c67 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:52.810693 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-933b608a-a021-4bbb-bf34-c6016e106c67 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1" status: 200 len: 1358 microversion: 2.21 time: 0.510967 May 27 15:03:52.814556 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 757/1589] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:52 2022] GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 => generated 1358 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:52.832613 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-7e30c455-984d-41af-9216-9b8943e7c8e9 req-9de705b9-45eb-4e79-908d-42bd238c8d2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1", "tag": "b87baaf2-e707-4273-84b7-2bea3b773b73"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:52.856978 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-7e30c455-984d-41af-9216-9b8943e7c8e9 req-9de705b9-45eb-4e79-908d-42bd238c8d2e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:52.859757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-7e30c455-984d-41af-9216-9b8943e7c8e9 req-9de705b9-45eb-4e79-908d-42bd238c8d2e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:52.913219 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-7e30c455-984d-41af-9216-9b8943e7c8e9 req-9de705b9-45eb-4e79-908d-42bd238c8d2e service nova] Creating event network-changed:b87baaf2-e707-4273-84b7-2bea3b773b73 for instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 on n-h2-843621-1 May 27 15:03:52.925479 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-7e30c455-984d-41af-9216-9b8943e7c8e9 req-9de705b9-45eb-4e79-908d-42bd238c8d2e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107568 May 27 15:03:52.926566 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 758/1590] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:52.940383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8d86a055-e52e-48ea-8c46-b922d44a9b17 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:52.942494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8d86a055-e52e-48ea-8c46-b922d44a9b17 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:52.950725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d86a055-e52e-48ea-8c46-b922d44a9b17 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:52.951780 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d86a055-e52e-48ea-8c46-b922d44a9b17 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:52.952891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d86a055-e52e-48ea-8c46-b922d44a9b17 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:52.953759 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d86a055-e52e-48ea-8c46-b922d44a9b17 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:53.322774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8d86a055-e52e-48ea-8c46-b922d44a9b17 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:53.337884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8d86a055-e52e-48ea-8c46-b922d44a9b17 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:53.340115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8d86a055-e52e-48ea-8c46-b922d44a9b17 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:53.343266 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8d86a055-e52e-48ea-8c46-b922d44a9b17 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1280 microversion: 2.25 time: 0.413538 May 27 15:03:53.345147 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 759/1591] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:52 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1280 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:53.352107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9006983f-fdcb-4511-8d82-1ad8525a339d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:53.358206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9006983f-fdcb-4511-8d82-1ad8525a339d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:53.368188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d2dcca46-9540-4bdb-8f11-fe7d433da273 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:53.383559 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9006983f-fdcb-4511-8d82-1ad8525a339d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:53.386956 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d2dcca46-9540-4bdb-8f11-fe7d433da273 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:53.387876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9006983f-fdcb-4511-8d82-1ad8525a339d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:53.390723 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9006983f-fdcb-4511-8d82-1ad8525a339d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:53.391466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9006983f-fdcb-4511-8d82-1ad8525a339d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:53.391878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d2dcca46-9540-4bdb-8f11-fe7d433da273 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:53.396759 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d2dcca46-9540-4bdb-8f11-fe7d433da273 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.747065 May 27 15:03:53.398660 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 833/1592] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:52 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:53.413170 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-36270a7e-fc29-47f6-9c24-07090ef3a6d5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc77666cc10>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:53.537582 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-36270a7e-fc29-47f6-9c24-07090ef3a6d5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1437 microversion: 2.1 time: 0.137562 May 27 15:03:53.543697 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 834/1593] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:53 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1437 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:53.654165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7ad31140-0e64-4a62-b11f-21185fd173f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:53.655339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7ad31140-0e64-4a62-b11f-21185fd173f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 2834b60d-ed8c-48d6-bbf5-2daeec41f497] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:53.670591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7ad31140-0e64-4a62-b11f-21185fd173f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:53.684907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7ad31140-0e64-4a62-b11f-21185fd173f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:53.686024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7ad31140-0e64-4a62-b11f-21185fd173f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:53.686742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7ad31140-0e64-4a62-b11f-21185fd173f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:53.909758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7ad31140-0e64-4a62-b11f-21185fd173f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:53.920469 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7ad31140-0e64-4a62-b11f-21185fd173f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497" status: 200 len: 1210 microversion: 2.1 time: 0.269814 May 27 15:03:53.922879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9006983f-fdcb-4511-8d82-1ad8525a339d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:53.924084 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 835/1594] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:53 2022] GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 => generated 1210 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:03:53.932438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1c6b4bd2-3b85-4803-ad89-7377512864d6 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:53.933913 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9006983f-fdcb-4511-8d82-1ad8525a339d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e" status: 200 len: 1316 microversion: 2.1 time: 0.584479 May 27 15:03:53.934778 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 760/1595] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:53 2022] GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e => generated 1316 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:53.935662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1c6b4bd2-3b85-4803-ad89-7377512864d6 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:53.948390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1c6b4bd2-3b85-4803-ad89-7377512864d6 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:53.961484 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1c6b4bd2-3b85-4803-ad89-7377512864d6 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:53.962721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1c6b4bd2-3b85-4803-ad89-7377512864d6 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:53.963395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1c6b4bd2-3b85-4803-ad89-7377512864d6 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:54.245515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1c6b4bd2-3b85-4803-ad89-7377512864d6 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:54.253541 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:54.260053 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1c6b4bd2-3b85-4803-ad89-7377512864d6 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:54.263476 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1c6b4bd2-3b85-4803-ad89-7377512864d6 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:54.265637 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1c6b4bd2-3b85-4803-ad89-7377512864d6 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1" status: 200 len: 1358 microversion: 2.21 time: 0.339331 May 27 15:03:54.267262 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 836/1596] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:53 2022] GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 => generated 1358 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:54.363453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0105f1fa-205c-4713-a9eb-b66bf91c7b65 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:54.364401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0105f1fa-205c-4713-a9eb-b66bf91c7b65 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:54.389808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-5b70e415-c685-412e-8cd7-a3fdbfb7c76c req-41309f63-1d75-4bdb-b1d6-4864fb793b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05873cb2-4587-4714-a252-49a90edbabd2", "name": "network-vif-plugged", "status": "completed", "tag": "94292363-2ffc-491a-a278-eb63c9334b1f"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:54.400963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0105f1fa-205c-4713-a9eb-b66bf91c7b65 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:54.403517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0105f1fa-205c-4713-a9eb-b66bf91c7b65 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:54.405210 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0105f1fa-205c-4713-a9eb-b66bf91c7b65 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:54.409419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0105f1fa-205c-4713-a9eb-b66bf91c7b65 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:54.416622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-5b70e415-c685-412e-8cd7-a3fdbfb7c76c req-41309f63-1d75-4bdb-b1d6-4864fb793b17 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:54.417452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-5b70e415-c685-412e-8cd7-a3fdbfb7c76c req-41309f63-1d75-4bdb-b1d6-4864fb793b17 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:54.473386 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-5b70e415-c685-412e-8cd7-a3fdbfb7c76c req-41309f63-1d75-4bdb-b1d6-4864fb793b17 service nova] Creating event network-vif-plugged:94292363-2ffc-491a-a278-eb63c9334b1f for instance 05873cb2-4587-4714-a252-49a90edbabd2 on n-h1-843621-1 May 27 15:03:54.485961 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-5b70e415-c685-412e-8cd7-a3fdbfb7c76c req-41309f63-1d75-4bdb-b1d6-4864fb793b17 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099647 May 27 15:03:54.495008 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 837/1597] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:54.506347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9a711ac2-c112-4359-9841-63750dc39c56 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:54.507435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9a711ac2-c112-4359-9841-63750dc39c56 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:54.515808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a711ac2-c112-4359-9841-63750dc39c56 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:54.517097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a711ac2-c112-4359-9841-63750dc39c56 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:54.519217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a711ac2-c112-4359-9841-63750dc39c56 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:54.519840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a711ac2-c112-4359-9841-63750dc39c56 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:54.994723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9a711ac2-c112-4359-9841-63750dc39c56 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:54.997656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0105f1fa-205c-4713-a9eb-b66bf91c7b65 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:55.007076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0105f1fa-205c-4713-a9eb-b66bf91c7b65 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:55.008045 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9a711ac2-c112-4359-9841-63750dc39c56 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:55.009155 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0105f1fa-205c-4713-a9eb-b66bf91c7b65 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:55.009590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9a711ac2-c112-4359-9841-63750dc39c56 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:55.010708 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0105f1fa-205c-4713-a9eb-b66bf91c7b65 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1280 microversion: 2.25 time: 0.652081 May 27 15:03:55.010874 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9a711ac2-c112-4359-9841-63750dc39c56 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.509804 May 27 15:03:55.011342 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 838/1598] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:54 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:55.023939 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 761/1599] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:54 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1280 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:55.032364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6ed796e9-8b81-4c7b-a353-b16cbd756d5b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc7767b40d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:55.033494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c7d32222-aeaf-4f7e-a78a-13b473237780 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:55.034333 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c7d32222-aeaf-4f7e-a78a-13b473237780 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 2834b60d-ed8c-48d6-bbf5-2daeec41f497] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:55.044138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c7d32222-aeaf-4f7e-a78a-13b473237780 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:55.044820 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c7d32222-aeaf-4f7e-a78a-13b473237780 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:55.046083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c7d32222-aeaf-4f7e-a78a-13b473237780 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:55.046474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c7d32222-aeaf-4f7e-a78a-13b473237780 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:55.092470 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6ed796e9-8b81-4c7b-a353-b16cbd756d5b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1437 microversion: 2.1 time: 0.074848 May 27 15:03:55.093256 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 839/1600] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:55 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1437 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:55.107262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2a2b3ec0-470e-4009-bb54-fb76916e48a8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:55.108020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2a2b3ec0-470e-4009-bb54-fb76916e48a8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:55.114745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a2b3ec0-470e-4009-bb54-fb76916e48a8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:55.115206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a2b3ec0-470e-4009-bb54-fb76916e48a8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:55.115999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a2b3ec0-470e-4009-bb54-fb76916e48a8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:55.116439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a2b3ec0-470e-4009-bb54-fb76916e48a8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:55.177090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c7d32222-aeaf-4f7e-a78a-13b473237780 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:55.184780 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c7d32222-aeaf-4f7e-a78a-13b473237780 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497" status: 200 len: 1272 microversion: 2.1 time: 0.158448 May 27 15:03:55.201178 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 762/1601] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:55 2022] GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:55.286698 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-68df3d3f-eba1-4b25-9868-fe91eed5eaf2 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:55.287462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-68df3d3f-eba1-4b25-9868-fe91eed5eaf2 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:55.300537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68df3d3f-eba1-4b25-9868-fe91eed5eaf2 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:55.301041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68df3d3f-eba1-4b25-9868-fe91eed5eaf2 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:55.301901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68df3d3f-eba1-4b25-9868-fe91eed5eaf2 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:55.302356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68df3d3f-eba1-4b25-9868-fe91eed5eaf2 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:55.493731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2a2b3ec0-470e-4009-bb54-fb76916e48a8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:55.514785 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2a2b3ec0-470e-4009-bb54-fb76916e48a8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e" status: 200 len: 1316 microversion: 2.1 time: 0.415803 May 27 15:03:55.530729 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 840/1602] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:55 2022] GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e => generated 1316 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:55.670499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-68df3d3f-eba1-4b25-9868-fe91eed5eaf2 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:55.682479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-68df3d3f-eba1-4b25-9868-fe91eed5eaf2 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:55.690597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-68df3d3f-eba1-4b25-9868-fe91eed5eaf2 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:55.691831 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-68df3d3f-eba1-4b25-9868-fe91eed5eaf2 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1" status: 200 len: 1358 microversion: 2.21 time: 0.410621 May 27 15:03:55.692421 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 763/1603] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:55 2022] GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 => generated 1358 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:56.030384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ec48ca27-c0c9-4f26-96ab-2de29e8703b5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:56.031177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ec48ca27-c0c9-4f26-96ab-2de29e8703b5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:56.044199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3e8f3e6a-3b56-43d5-adeb-42e99b2bf0f3 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:56.045039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3e8f3e6a-3b56-43d5-adeb-42e99b2bf0f3 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:56.052083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec48ca27-c0c9-4f26-96ab-2de29e8703b5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:56.055813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e8f3e6a-3b56-43d5-adeb-42e99b2bf0f3 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:56.056387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec48ca27-c0c9-4f26-96ab-2de29e8703b5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:56.056979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e8f3e6a-3b56-43d5-adeb-42e99b2bf0f3 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:56.057924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec48ca27-c0c9-4f26-96ab-2de29e8703b5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:56.058834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e8f3e6a-3b56-43d5-adeb-42e99b2bf0f3 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:56.060063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec48ca27-c0c9-4f26-96ab-2de29e8703b5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:56.069477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e8f3e6a-3b56-43d5-adeb-42e99b2bf0f3 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:56.567430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ec48ca27-c0c9-4f26-96ab-2de29e8703b5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:56.577371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ec48ca27-c0c9-4f26-96ab-2de29e8703b5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:56.595824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ec48ca27-c0c9-4f26-96ab-2de29e8703b5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:56.597847 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ec48ca27-c0c9-4f26-96ab-2de29e8703b5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.571538 May 27 15:03:56.612480 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 841/1604] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:56 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:56.621239 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-38524a22-4493-4ddd-b35e-1e3606a93040 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc7767b4b80>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:56.667831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3e8f3e6a-3b56-43d5-adeb-42e99b2bf0f3 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:56.678631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3e8f3e6a-3b56-43d5-adeb-42e99b2bf0f3 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:56.689000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3e8f3e6a-3b56-43d5-adeb-42e99b2bf0f3 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:56.694932 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3e8f3e6a-3b56-43d5-adeb-42e99b2bf0f3 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1280 microversion: 2.25 time: 0.652448 May 27 15:03:56.700126 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 764/1605] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:56 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1280 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:03:56.720987 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-891ada90-025a-4698-a3c9-33486ac614aa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:56.721663 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-891ada90-025a-4698-a3c9-33486ac614aa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 2834b60d-ed8c-48d6-bbf5-2daeec41f497] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:56.733275 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-38524a22-4493-4ddd-b35e-1e3606a93040 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1437 microversion: 2.1 time: 0.111711 May 27 15:03:56.737349 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 842/1606] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:56 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1437 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:56.744611 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-891ada90-025a-4698-a3c9-33486ac614aa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:56.751761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-891ada90-025a-4698-a3c9-33486ac614aa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:56.752587 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a63b18f0-6366-4d1d-9ab8-bb6b27d5ed50 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:56.754595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-891ada90-025a-4698-a3c9-33486ac614aa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:56.756416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-891ada90-025a-4698-a3c9-33486ac614aa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:56.758597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a63b18f0-6366-4d1d-9ab8-bb6b27d5ed50 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:56.776078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:56.783961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a63b18f0-6366-4d1d-9ab8-bb6b27d5ed50 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:56.786587 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a63b18f0-6366-4d1d-9ab8-bb6b27d5ed50 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:56.790314 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a63b18f0-6366-4d1d-9ab8-bb6b27d5ed50 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:56.791055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a63b18f0-6366-4d1d-9ab8-bb6b27d5ed50 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:57.073472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-891ada90-025a-4698-a3c9-33486ac614aa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:57.082916 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-891ada90-025a-4698-a3c9-33486ac614aa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497" status: 200 len: 1272 microversion: 2.1 time: 0.380100 May 27 15:03:57.083501 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 765/1607] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:56 2022] GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 => generated 1272 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:57.092334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b87c8ba9-b714-44f3-9668-2377b5f94a2f tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:57.099892 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b87c8ba9-b714-44f3-9668-2377b5f94a2f tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:57.116027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b87c8ba9-b714-44f3-9668-2377b5f94a2f tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:57.117051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b87c8ba9-b714-44f3-9668-2377b5f94a2f tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:57.119611 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b87c8ba9-b714-44f3-9668-2377b5f94a2f tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:57.121344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b87c8ba9-b714-44f3-9668-2377b5f94a2f tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:57.133910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a63b18f0-6366-4d1d-9ab8-bb6b27d5ed50 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:57.143493 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a63b18f0-6366-4d1d-9ab8-bb6b27d5ed50 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e" status: 200 len: 1316 microversion: 2.1 time: 0.405049 May 27 15:03:57.148137 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 843/1608] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:56 2022] GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e => generated 1316 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:57.442568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b87c8ba9-b714-44f3-9668-2377b5f94a2f tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:57.451061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b87c8ba9-b714-44f3-9668-2377b5f94a2f tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:57.452586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b87c8ba9-b714-44f3-9668-2377b5f94a2f tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:57.453775 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b87c8ba9-b714-44f3-9668-2377b5f94a2f tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1" status: 200 len: 1358 microversion: 2.21 time: 0.366092 May 27 15:03:57.464620 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 766/1609] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:57 2022] GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 => generated 1358 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:57.618342 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e45faef1-2a96-499d-a783-1b8d0396c93a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:57.618966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e45faef1-2a96-499d-a783-1b8d0396c93a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:57.630798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e45faef1-2a96-499d-a783-1b8d0396c93a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:57.636531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e45faef1-2a96-499d-a783-1b8d0396c93a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:57.643385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e45faef1-2a96-499d-a783-1b8d0396c93a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:57.644760 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e45faef1-2a96-499d-a783-1b8d0396c93a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:57.713253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3d251ba7-48db-4266-a254-7c4963755cda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:57.714151 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3d251ba7-48db-4266-a254-7c4963755cda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:57.721045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:03:57.733448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d251ba7-48db-4266-a254-7c4963755cda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:57.734863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d251ba7-48db-4266-a254-7c4963755cda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:57.735848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d251ba7-48db-4266-a254-7c4963755cda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:57.736461 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d251ba7-48db-4266-a254-7c4963755cda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:58.243217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e45faef1-2a96-499d-a783-1b8d0396c93a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:58.260190 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e45faef1-2a96-499d-a783-1b8d0396c93a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:58.267031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e45faef1-2a96-499d-a783-1b8d0396c93a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:58.271598 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e45faef1-2a96-499d-a783-1b8d0396c93a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.654530 May 27 15:03:58.275529 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 844/1610] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:57 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:58.287802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1d5b1a04-a901-40e1-b4d6-ab5bb796ef2f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776635af0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:58.347010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3d251ba7-48db-4266-a254-7c4963755cda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:58.370064 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1d5b1a04-a901-40e1-b4d6-ab5bb796ef2f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1437 microversion: 2.1 time: 0.092932 May 27 15:03:58.370534 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 845/1611] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:58 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1437 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:58.388058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-75fb45eb-aa92-40be-a72d-67036f43f28d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:58.388391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3d251ba7-48db-4266-a254-7c4963755cda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:58.390974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3d251ba7-48db-4266-a254-7c4963755cda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:58.393847 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-75fb45eb-aa92-40be-a72d-67036f43f28d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 2834b60d-ed8c-48d6-bbf5-2daeec41f497] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:58.396591 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3d251ba7-48db-4266-a254-7c4963755cda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1476 microversion: 2.25 time: 0.687620 May 27 15:03:58.409831 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75fb45eb-aa92-40be-a72d-67036f43f28d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:58.410576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75fb45eb-aa92-40be-a72d-67036f43f28d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:58.411675 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75fb45eb-aa92-40be-a72d-67036f43f28d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:58.412305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75fb45eb-aa92-40be-a72d-67036f43f28d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:58.417080 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 767/1612] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:57 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1476 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:03:58.427358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ecedf690-9243-4dac-bf55-97961f3dd040 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:58.428884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ecedf690-9243-4dac-bf55-97961f3dd040 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:58.446709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecedf690-9243-4dac-bf55-97961f3dd040 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:58.447232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecedf690-9243-4dac-bf55-97961f3dd040 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:58.448110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecedf690-9243-4dac-bf55-97961f3dd040 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:58.451491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecedf690-9243-4dac-bf55-97961f3dd040 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:58.754037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-75fb45eb-aa92-40be-a72d-67036f43f28d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:58.764611 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-75fb45eb-aa92-40be-a72d-67036f43f28d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497" status: 200 len: 1314 microversion: 2.1 time: 0.387847 May 27 15:03:58.770799 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 846/1613] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:58 2022] GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:58.813488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ecedf690-9243-4dac-bf55-97961f3dd040 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:58.822058 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ecedf690-9243-4dac-bf55-97961f3dd040 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e" status: 200 len: 1316 microversion: 2.1 time: 0.403532 May 27 15:03:58.822645 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 768/1614] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:03:58 2022] GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e => generated 1316 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:58.842132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-53cb0f54-29b0-4e08-8269-da49a0ec6e38 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:58.842771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-53cb0f54-29b0-4e08-8269-da49a0ec6e38 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:58.866699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-53cb0f54-29b0-4e08-8269-da49a0ec6e38 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:58.867267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-53cb0f54-29b0-4e08-8269-da49a0ec6e38 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:58.876191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-53cb0f54-29b0-4e08-8269-da49a0ec6e38 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:58.876697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-53cb0f54-29b0-4e08-8269-da49a0ec6e38 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:59.259006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3466314f-76f9-48cf-8774-aa45cf17f553 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:59.259835 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3466314f-76f9-48cf-8774-aa45cf17f553 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:59.273029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3466314f-76f9-48cf-8774-aa45cf17f553 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:59.275163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3466314f-76f9-48cf-8774-aa45cf17f553 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:59.277589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3466314f-76f9-48cf-8774-aa45cf17f553 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:59.280164 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3466314f-76f9-48cf-8774-aa45cf17f553 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:59.329578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-53cb0f54-29b0-4e08-8269-da49a0ec6e38 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:59.342017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-53cb0f54-29b0-4e08-8269-da49a0ec6e38 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:59.361402 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-53cb0f54-29b0-4e08-8269-da49a0ec6e38 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:03:59.363716 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-53cb0f54-29b0-4e08-8269-da49a0ec6e38 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1" status: 200 len: 1358 microversion: 2.21 time: 0.539867 May 27 15:03:59.369583 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 769/1615] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:58 2022] GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 => generated 1358 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:59.397603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-9b41aefc-18a3-4d61-b148-09d39d83d7be req-13286359-088e-4fd6-98e0-684e836b0417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2834b60d-ed8c-48d6-bbf5-2daeec41f497", "tag": "804ba85b-e4f9-432b-936f-ae2e8b6e0bd2"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:59.421022 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-9b41aefc-18a3-4d61-b148-09d39d83d7be req-13286359-088e-4fd6-98e0-684e836b0417 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:59.423962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-9b41aefc-18a3-4d61-b148-09d39d83d7be req-13286359-088e-4fd6-98e0-684e836b0417 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:59.438313 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-9b41aefc-18a3-4d61-b148-09d39d83d7be req-13286359-088e-4fd6-98e0-684e836b0417 service nova] Creating event network-changed:804ba85b-e4f9-432b-936f-ae2e8b6e0bd2 for instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 on n-h2-843621-1 May 27 15:03:59.444625 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-9b41aefc-18a3-4d61-b148-09d39d83d7be req-13286359-088e-4fd6-98e0-684e836b0417 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073378 May 27 15:03:59.445886 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 770/1616] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:59.454413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aa6d00c6-98a5-46fe-86a6-f8568a9c7a25 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:59.455324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-aa6d00c6-98a5-46fe-86a6-f8568a9c7a25 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:59.462484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa6d00c6-98a5-46fe-86a6-f8568a9c7a25 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:59.463241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa6d00c6-98a5-46fe-86a6-f8568a9c7a25 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:59.464227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa6d00c6-98a5-46fe-86a6-f8568a9c7a25 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:59.464945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa6d00c6-98a5-46fe-86a6-f8568a9c7a25 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:59.507057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-aa6d00c6-98a5-46fe-86a6-f8568a9c7a25 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:03:59.518202 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-3466314f-76f9-48cf-8774-aa45cf17f553 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lazy-loading 'services' on Instance uuid 05873cb2-4587-4714-a252-49a90edbabd2 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:03:59.535654 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3466314f-76f9-48cf-8774-aa45cf17f553 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1968 microversion: 2.25 time: 0.763075 May 27 15:03:59.536925 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 847/1617] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:58 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1968 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:03:59.541966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-cae7de53-9764-4f43-909f-f4315c1b6555 req-f4355b70-adac-405f-9c8c-69820c274a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12d7cca3-a419-4171-b2f7-d3ea5eee2a0e", "name": "network-vif-plugged", "status": "completed", "tag": "33ee41da-e298-4ee9-9a25-20564f1f7632"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:03:59.551663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-cae7de53-9764-4f43-909f-f4315c1b6555 req-f4355b70-adac-405f-9c8c-69820c274a85 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:59.552450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-cae7de53-9764-4f43-909f-f4315c1b6555 req-f4355b70-adac-405f-9c8c-69820c274a85 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:59.596706 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-cae7de53-9764-4f43-909f-f4315c1b6555 req-f4355b70-adac-405f-9c8c-69820c274a85 service nova] Creating event network-vif-plugged:33ee41da-e298-4ee9-9a25-20564f1f7632 for instance 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e on n-h1-843621-1 May 27 15:03:59.605731 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-cae7de53-9764-4f43-909f-f4315c1b6555 req-f4355b70-adac-405f-9c8c-69820c274a85 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066736 May 27 15:03:59.606780 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 848/1618] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:03:59.621280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0173858b-4120-4bab-baf0-34ffc23bdce0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:59.622428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0173858b-4120-4bab-baf0-34ffc23bdce0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:59.632311 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0173858b-4120-4bab-baf0-34ffc23bdce0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:59.633096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0173858b-4120-4bab-baf0-34ffc23bdce0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:59.634251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0173858b-4120-4bab-baf0-34ffc23bdce0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:59.635053 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0173858b-4120-4bab-baf0-34ffc23bdce0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:59.752275 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-aa6d00c6-98a5-46fe-86a6-f8568a9c7a25 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3" status: 204 len: 0 microversion: 2.1 time: 0.303431 May 27 15:03:59.757609 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 771/1619] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:03:59 2022] DELETE /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:03:59.770942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2b6408d2-3a01-4dea-b66c-208c22beef4c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776d3f820>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:59.840427 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2b6408d2-3a01-4dea-b66c-208c22beef4c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1437 microversion: 2.1 time: 0.081080 May 27 15:03:59.844996 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 772/1620] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:03:59 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1437 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:03:59.854185 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-351155cb-8cf2-4aa2-974e-4a3c25199802 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:03:59.855281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-351155cb-8cf2-4aa2-974e-4a3c25199802 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:03:59.868481 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-351155cb-8cf2-4aa2-974e-4a3c25199802 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:59.870344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-351155cb-8cf2-4aa2-974e-4a3c25199802 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:03:59.873651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-351155cb-8cf2-4aa2-974e-4a3c25199802 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:03:59.874361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-351155cb-8cf2-4aa2-974e-4a3c25199802 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:00.254766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0173858b-4120-4bab-baf0-34ffc23bdce0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:00.272072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0173858b-4120-4bab-baf0-34ffc23bdce0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:00.276657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0173858b-4120-4bab-baf0-34ffc23bdce0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:00.284192 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0173858b-4120-4bab-baf0-34ffc23bdce0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.666306 May 27 15:04:00.284858 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 849/1621] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:59 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:00.308103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8937f993-aa5b-4af0-a246-532f7a1aec42 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:00.308781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8937f993-aa5b-4af0-a246-532f7a1aec42 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:00.324448 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:00.329045 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8937f993-aa5b-4af0-a246-532f7a1aec42 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:00.329518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8937f993-aa5b-4af0-a246-532f7a1aec42 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:00.332338 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8937f993-aa5b-4af0-a246-532f7a1aec42 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:00.332839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8937f993-aa5b-4af0-a246-532f7a1aec42 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:00.392704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-351155cb-8cf2-4aa2-974e-4a3c25199802 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lazy-loading 'services' on Instance uuid 05873cb2-4587-4714-a252-49a90edbabd2 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:04:00.439098 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-351155cb-8cf2-4aa2-974e-4a3c25199802 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1968 microversion: 2.25 time: 0.592677 May 27 15:04:00.462741 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 773/1622] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:03:59 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1968 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:00.477033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f117bcaa-8173-4ed2-9a4f-fbad6ab48f7f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:00.477900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f117bcaa-8173-4ed2-9a4f-fbad6ab48f7f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 2834b60d-ed8c-48d6-bbf5-2daeec41f497] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:00.496417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f117bcaa-8173-4ed2-9a4f-fbad6ab48f7f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:00.501354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f117bcaa-8173-4ed2-9a4f-fbad6ab48f7f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:00.502512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f117bcaa-8173-4ed2-9a4f-fbad6ab48f7f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:00.503227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f117bcaa-8173-4ed2-9a4f-fbad6ab48f7f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:00.628207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8937f993-aa5b-4af0-a246-532f7a1aec42 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37aeba85d8b4c1282ac1b470836bae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be47565a2f034bbd8f81292196597473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:00.646434 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8937f993-aa5b-4af0-a246-532f7a1aec42 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3" status: 200 len: 1514 microversion: 2.1 time: 0.345016 May 27 15:04:00.647059 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 850/1623] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:00 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3 => generated 1514 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:00.657710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d076f99f-34c0-48a6-be0b-ed6e342ab855 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:00.658855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d076f99f-34c0-48a6-be0b-ed6e342ab855 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:00.670318 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d076f99f-34c0-48a6-be0b-ed6e342ab855 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:00.673270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d076f99f-34c0-48a6-be0b-ed6e342ab855 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:00.674075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d076f99f-34c0-48a6-be0b-ed6e342ab855 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:00.679009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d076f99f-34c0-48a6-be0b-ed6e342ab855 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:00.841712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f117bcaa-8173-4ed2-9a4f-fbad6ab48f7f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:00.856246 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f117bcaa-8173-4ed2-9a4f-fbad6ab48f7f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497" status: 200 len: 1314 microversion: 2.1 time: 0.387326 May 27 15:04:00.866642 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 774/1624] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:00 2022] GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:00.871968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-13ca63ed-5486-4134-a133-f6dc259be5a2 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:00.877880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-13ca63ed-5486-4134-a133-f6dc259be5a2 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:00.905988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13ca63ed-5486-4134-a133-f6dc259be5a2 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:00.906906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13ca63ed-5486-4134-a133-f6dc259be5a2 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:00.908241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13ca63ed-5486-4134-a133-f6dc259be5a2 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:00.908892 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13ca63ed-5486-4134-a133-f6dc259be5a2 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:00.993975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d076f99f-34c0-48a6-be0b-ed6e342ab855 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:01.006145 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d076f99f-34c0-48a6-be0b-ed6e342ab855 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e" status: 200 len: 1316 microversion: 2.1 time: 0.356810 May 27 15:04:01.023957 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 851/1625] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:00 2022] GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e => generated 1316 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:01.023957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-165bbe50-b287-4083-a3ed-1c7feafd1fcf tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:01.023957 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:04:01.023957 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:04:01.023957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-165bbe50-b287-4083-a3ed-1c7feafd1fcf tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:01.023957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-165bbe50-b287-4083-a3ed-1c7feafd1fcf tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:01.025234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-165bbe50-b287-4083-a3ed-1c7feafd1fcf tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:01.025772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-165bbe50-b287-4083-a3ed-1c7feafd1fcf tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:01.068382 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-165bbe50-b287-4083-a3ed-1c7feafd1fcf tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.051419 May 27 15:04:01.073714 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 852/1626] 10.222.0.13 () {60 vars in 1216 bytes} [Fri May 27 15:04:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:04:01.110185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6b2524a3-2b40-45b7-9879-6ba9f841f45c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc7765d3160>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:01.181399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-13ca63ed-5486-4134-a133-f6dc259be5a2 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:01.198707 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-13ca63ed-5486-4134-a133-f6dc259be5a2 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:01.200271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-13ca63ed-5486-4134-a133-f6dc259be5a2 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:01.201506 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-13ca63ed-5486-4134-a133-f6dc259be5a2 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1" status: 200 len: 1358 microversion: 2.21 time: 0.333390 May 27 15:04:01.202089 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 775/1627] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:00 2022] GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 => generated 1358 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:01.215222 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6b2524a3-2b40-45b7-9879-6ba9f841f45c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1437 microversion: 2.1 time: 0.125622 May 27 15:04:01.216410 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 853/1628] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:04:01 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1437 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:01.230144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bdcf29ee-ae1f-46a6-be8e-72d194cad5d4 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-843621-1", "block_migration": "auto"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:01.231379 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bdcf29ee-ae1f-46a6-be8e-72d194cad5d4 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:01.264041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bdcf29ee-ae1f-46a6-be8e-72d194cad5d4 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:01.264504 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bdcf29ee-ae1f-46a6-be8e-72d194cad5d4 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:01.265367 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bdcf29ee-ae1f-46a6-be8e-72d194cad5d4 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:01.265824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bdcf29ee-ae1f-46a6-be8e-72d194cad5d4 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:01.303746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-06cf17df-c56f-48e1-b8ad-c90c6be705b1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:01.305433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-06cf17df-c56f-48e1-b8ad-c90c6be705b1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:01.314883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06cf17df-c56f-48e1-b8ad-c90c6be705b1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:01.318625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06cf17df-c56f-48e1-b8ad-c90c6be705b1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:01.322289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06cf17df-c56f-48e1-b8ad-c90c6be705b1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:01.328169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06cf17df-c56f-48e1-b8ad-c90c6be705b1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:01.334998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-bdcf29ee-ae1f-46a6-be8e-72d194cad5d4 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lazy-loading 'flavor' on Instance uuid 05873cb2-4587-4714-a252-49a90edbabd2 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:04:01.365792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bdcf29ee-ae1f-46a6-be8e-72d194cad5d4 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Going to try to live migrate instance to n-h2-843621-1 {{(pid=119249) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 27 15:04:01.835691 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-06cf17df-c56f-48e1-b8ad-c90c6be705b1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:01.847653 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-06cf17df-c56f-48e1-b8ad-c90c6be705b1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:01.852465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-06cf17df-c56f-48e1-b8ad-c90c6be705b1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:01.860041 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-06cf17df-c56f-48e1-b8ad-c90c6be705b1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.560068 May 27 15:04:01.862445 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 854/1629] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:01 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:01.875372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-aa036ccf-465c-4ae8-b574-b33cc00ebeb7 req-0910a201-3604-42ed-9850-e4114c6a4665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1", "name": "network-vif-plugged", "status": "completed", "tag": "b87baaf2-e707-4273-84b7-2bea3b773b73"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:01.903233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-aa036ccf-465c-4ae8-b574-b33cc00ebeb7 req-0910a201-3604-42ed-9850-e4114c6a4665 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:01.903723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-aa036ccf-465c-4ae8-b574-b33cc00ebeb7 req-0910a201-3604-42ed-9850-e4114c6a4665 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:01.917393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:01.929545 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-aa036ccf-465c-4ae8-b574-b33cc00ebeb7 req-0910a201-3604-42ed-9850-e4114c6a4665 service nova] Creating event network-vif-plugged:b87baaf2-e707-4273-84b7-2bea3b773b73 for instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 on n-h2-843621-1 May 27 15:04:01.936176 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-aa036ccf-465c-4ae8-b574-b33cc00ebeb7 req-0910a201-3604-42ed-9850-e4114c6a4665 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070385 May 27 15:04:01.937144 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 855/1630] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:01.948185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-06cedebd-2ece-4fcb-969d-a82322b4e51f tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:01.949701 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-06cedebd-2ece-4fcb-969d-a82322b4e51f tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:01.959201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=38 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:01.960434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06cedebd-2ece-4fcb-969d-a82322b4e51f tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:01.961086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06cedebd-2ece-4fcb-969d-a82322b4e51f tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:01.962074 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06cedebd-2ece-4fcb-969d-a82322b4e51f tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:01.962537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06cedebd-2ece-4fcb-969d-a82322b4e51f tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:02.398926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-06cedebd-2ece-4fcb-969d-a82322b4e51f tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37aeba85d8b4c1282ac1b470836bae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be47565a2f034bbd8f81292196597473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:02.415397 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-06cedebd-2ece-4fcb-969d-a82322b4e51f tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3" status: 200 len: 1514 microversion: 2.1 time: 0.472146 May 27 15:04:02.416971 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 856/1631] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:01 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3 => generated 1514 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:02.425353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-20ec0350-b3a6-4b1d-9f51-b41d1ecf9e03 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:02.426358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-20ec0350-b3a6-4b1d-9f51-b41d1ecf9e03 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 2834b60d-ed8c-48d6-bbf5-2daeec41f497] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:02.447127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-20ec0350-b3a6-4b1d-9f51-b41d1ecf9e03 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:02.447595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-20ec0350-b3a6-4b1d-9f51-b41d1ecf9e03 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:02.448395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-20ec0350-b3a6-4b1d-9f51-b41d1ecf9e03 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:02.448874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-20ec0350-b3a6-4b1d-9f51-b41d1ecf9e03 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:02.629019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=19 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:02.785779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-20ec0350-b3a6-4b1d-9f51-b41d1ecf9e03 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:02.798052 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-20ec0350-b3a6-4b1d-9f51-b41d1ecf9e03 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497" status: 200 len: 1314 microversion: 2.1 time: 0.379648 May 27 15:04:02.807143 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 857/1632] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:02 2022] GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:02.819598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dd804b2b-3fb4-40d7-8bac-a4913103a63e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:02.820568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dd804b2b-3fb4-40d7-8bac-a4913103a63e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:02.833527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd804b2b-3fb4-40d7-8bac-a4913103a63e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:02.834258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd804b2b-3fb4-40d7-8bac-a4913103a63e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:02.835394 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd804b2b-3fb4-40d7-8bac-a4913103a63e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:02.836039 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd804b2b-3fb4-40d7-8bac-a4913103a63e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:03.156232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dd804b2b-3fb4-40d7-8bac-a4913103a63e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:03.166012 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dd804b2b-3fb4-40d7-8bac-a4913103a63e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e" status: 200 len: 1316 microversion: 2.1 time: 0.357421 May 27 15:04:03.166493 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 858/1633] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:02 2022] GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:03.182321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d72e9120-a2b8-4738-a807-efbbfeb578cd tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:03.182884 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d72e9120-a2b8-4738-a807-efbbfeb578cd tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:03.195148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d72e9120-a2b8-4738-a807-efbbfeb578cd tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:03.195621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d72e9120-a2b8-4738-a807-efbbfeb578cd tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:03.196475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d72e9120-a2b8-4738-a807-efbbfeb578cd tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:03.196989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d72e9120-a2b8-4738-a807-efbbfeb578cd tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:03.454647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d72e9120-a2b8-4738-a807-efbbfeb578cd tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:03.459041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:03.465811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d72e9120-a2b8-4738-a807-efbbfeb578cd tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:03.477988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d72e9120-a2b8-4738-a807-efbbfeb578cd tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:03.482772 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d72e9120-a2b8-4738-a807-efbbfeb578cd tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1" status: 200 len: 1358 microversion: 2.21 time: 0.309837 May 27 15:04:03.484526 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 859/1634] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:03 2022] GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 => generated 1358 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:03.489642 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a443178f-32d7-4d06-a2ad-7ffa786ada2d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc7767b40d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:03.559048 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a443178f-32d7-4d06-a2ad-7ffa786ada2d tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1437 microversion: 2.1 time: 0.073209 May 27 15:04:03.560823 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 860/1635] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:04:03 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1437 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:03.576948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8b235e03-f584-435e-9657-9e36060d759c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:03.577910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8b235e03-f584-435e-9657-9e36060d759c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:03.589315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b235e03-f584-435e-9657-9e36060d759c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:03.590054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b235e03-f584-435e-9657-9e36060d759c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:03.591033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b235e03-f584-435e-9657-9e36060d759c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:03.591670 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b235e03-f584-435e-9657-9e36060d759c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:04.067257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8b235e03-f584-435e-9657-9e36060d759c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:04.088400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8b235e03-f584-435e-9657-9e36060d759c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:04.094594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8b235e03-f584-435e-9657-9e36060d759c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:04.097039 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8b235e03-f584-435e-9657-9e36060d759c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.535037 May 27 15:04:04.104349 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 861/1636] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:03 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:04.109483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6fd609cc-38d9-4203-b32a-279198803240 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:04.113906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6fd609cc-38d9-4203-b32a-279198803240 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:04.128027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6fd609cc-38d9-4203-b32a-279198803240 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:04.134337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6fd609cc-38d9-4203-b32a-279198803240 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:04.142076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6fd609cc-38d9-4203-b32a-279198803240 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:04.145118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6fd609cc-38d9-4203-b32a-279198803240 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:05.323193 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6fd609cc-38d9-4203-b32a-279198803240 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37aeba85d8b4c1282ac1b470836bae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be47565a2f034bbd8f81292196597473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:05.336559 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6fd609cc-38d9-4203-b32a-279198803240 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3" status: 200 len: 1514 microversion: 2.1 time: 1.230796 May 27 15:04:05.337206 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 862/1637] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:04 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3 => generated 1514 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:05.364961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4058b3e1-67ea-4603-a0c9-e2313b1e24f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:05.365534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4058b3e1-67ea-4603-a0c9-e2313b1e24f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 2834b60d-ed8c-48d6-bbf5-2daeec41f497] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:05.393969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4058b3e1-67ea-4603-a0c9-e2313b1e24f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:05.394451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4058b3e1-67ea-4603-a0c9-e2313b1e24f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:05.395274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4058b3e1-67ea-4603-a0c9-e2313b1e24f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:05.395732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4058b3e1-67ea-4603-a0c9-e2313b1e24f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:05.531895 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bdcf29ee-ae1f-46a6-be8e-72d194cad5d4 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2/action" status: 202 len: 0 microversion: 2.25 time: 4.328680 May 27 15:04:05.535952 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 776/1638] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 27 15:04:01 2022] POST /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2/action => generated 0 bytes in 4333 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 15:04:05.541441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9fb5e22d-8876-4320-bf64-7b1bf5560e52 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:05.542430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9fb5e22d-8876-4320-bf64-7b1bf5560e52 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:05.563699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9fb5e22d-8876-4320-bf64-7b1bf5560e52 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:05.577125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9fb5e22d-8876-4320-bf64-7b1bf5560e52 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:05.578991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9fb5e22d-8876-4320-bf64-7b1bf5560e52 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:05.580847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9fb5e22d-8876-4320-bf64-7b1bf5560e52 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:05.742148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4058b3e1-67ea-4603-a0c9-e2313b1e24f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:05.757154 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4058b3e1-67ea-4603-a0c9-e2313b1e24f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497" status: 200 len: 1314 microversion: 2.1 time: 0.405401 May 27 15:04:05.758019 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 863/1639] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:05 2022] GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:05.763489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-48a9e55f-c1d3-489a-ae9a-1478bde815b9 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:05.775505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-48a9e55f-c1d3-489a-ae9a-1478bde815b9 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:05.805169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48a9e55f-c1d3-489a-ae9a-1478bde815b9 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:05.809538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48a9e55f-c1d3-489a-ae9a-1478bde815b9 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:05.814114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48a9e55f-c1d3-489a-ae9a-1478bde815b9 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:05.814812 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48a9e55f-c1d3-489a-ae9a-1478bde815b9 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:06.181921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9fb5e22d-8876-4320-bf64-7b1bf5560e52 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:06.191321 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9fb5e22d-8876-4320-bf64-7b1bf5560e52 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e" status: 200 len: 1465 microversion: 2.1 time: 0.654145 May 27 15:04:06.200350 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 777/1640] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:05 2022] GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e => generated 1465 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:06.213791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8bf9571a-aeb2-4150-809f-1083148c20ac tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776ede700>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:06.283124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-48a9e55f-c1d3-489a-ae9a-1478bde815b9 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:06.311146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-48a9e55f-c1d3-489a-ae9a-1478bde815b9 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:06.312770 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-48a9e55f-c1d3-489a-ae9a-1478bde815b9 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:06.314012 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8bf9571a-aeb2-4150-809f-1083148c20ac tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1437 microversion: 2.1 time: 0.107622 May 27 15:04:06.314809 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 778/1641] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:04:06 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1437 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:06.329425 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-48a9e55f-c1d3-489a-ae9a-1478bde815b9 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1" status: 200 len: 1551 microversion: 2.21 time: 0.554884 May 27 15:04:06.340853 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 864/1642] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:05 2022] GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 => generated 1551 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:06.347379 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-08e502a8-cead-45de-8cef-daedd3d1ce07 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:06.348440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-08e502a8-cead-45de-8cef-daedd3d1ce07 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:06.354229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8dd34646-838d-4335-9601-fa4cce709ce4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:06.354450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8dd34646-838d-4335-9601-fa4cce709ce4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:06.371333 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08e502a8-cead-45de-8cef-daedd3d1ce07 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:06.371796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08e502a8-cead-45de-8cef-daedd3d1ce07 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:06.372660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08e502a8-cead-45de-8cef-daedd3d1ce07 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:06.373142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08e502a8-cead-45de-8cef-daedd3d1ce07 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:06.382256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8dd34646-838d-4335-9601-fa4cce709ce4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:06.382709 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8dd34646-838d-4335-9601-fa4cce709ce4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:06.383510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8dd34646-838d-4335-9601-fa4cce709ce4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:06.383955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8dd34646-838d-4335-9601-fa4cce709ce4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:06.787133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8dd34646-838d-4335-9601-fa4cce709ce4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:06.810234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8dd34646-838d-4335-9601-fa4cce709ce4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:06.812600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8dd34646-838d-4335-9601-fa4cce709ce4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:06.829556 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8dd34646-838d-4335-9601-fa4cce709ce4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.487442 May 27 15:04:06.831167 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 865/1643] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:06 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:06.836286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-08e502a8-cead-45de-8cef-daedd3d1ce07 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:06.862099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-08e502a8-cead-45de-8cef-daedd3d1ce07 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:06.864152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9db31ae5-f77b-4065-9799-50faf1543c84 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:06.864938 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9db31ae5-f77b-4065-9799-50faf1543c84 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:06.868707 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-08e502a8-cead-45de-8cef-daedd3d1ce07 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:06.870353 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-08e502a8-cead-45de-8cef-daedd3d1ce07 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.554450 May 27 15:04:06.870928 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 779/1644] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:06 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:06.886613 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-a7b16ece-521a-4ea1-90d1-61e033e2f888 req-fc0dcbf3-b918-4f8a-9145-d7c969e21ffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1699aaf-d186-4cde-ac8c-318a335635b3", "name": "network-vif-deleted", "tag": "c4f42381-866f-40f4-907d-639a893e5639"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:06.891684 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9db31ae5-f77b-4065-9799-50faf1543c84 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:06.892161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9db31ae5-f77b-4065-9799-50faf1543c84 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:06.893105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9db31ae5-f77b-4065-9799-50faf1543c84 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:06.893555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9db31ae5-f77b-4065-9799-50faf1543c84 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:06.914850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-a7b16ece-521a-4ea1-90d1-61e033e2f888 req-fc0dcbf3-b918-4f8a-9145-d7c969e21ffd service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:06.915309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-a7b16ece-521a-4ea1-90d1-61e033e2f888 req-fc0dcbf3-b918-4f8a-9145-d7c969e21ffd service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:06.955537 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-a7b16ece-521a-4ea1-90d1-61e033e2f888 req-fc0dcbf3-b918-4f8a-9145-d7c969e21ffd service nova] Creating event network-vif-deleted:c4f42381-866f-40f4-907d-639a893e5639 for instance c1699aaf-d186-4cde-ac8c-318a335635b3 on n-h1-843621-1 May 27 15:04:06.969987 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-a7b16ece-521a-4ea1-90d1-61e033e2f888 req-fc0dcbf3-b918-4f8a-9145-d7c969e21ffd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097650 May 27 15:04:06.972012 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 780/1645] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:06.996251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-d9af6894-053e-4b20-a5f3-aa2c81e9286d req-057c6bb8-9a05-4734-97af-3bf6dc328f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2834b60d-ed8c-48d6-bbf5-2daeec41f497", "name": "network-vif-plugged", "status": "completed", "tag": "804ba85b-e4f9-432b-936f-ae2e8b6e0bd2"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:07.015964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d9af6894-053e-4b20-a5f3-aa2c81e9286d req-057c6bb8-9a05-4734-97af-3bf6dc328f40 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:07.024084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d9af6894-053e-4b20-a5f3-aa2c81e9286d req-057c6bb8-9a05-4734-97af-3bf6dc328f40 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:07.028861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:07.047782 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-d9af6894-053e-4b20-a5f3-aa2c81e9286d req-057c6bb8-9a05-4734-97af-3bf6dc328f40 service nova] Creating event network-vif-plugged:804ba85b-e4f9-432b-936f-ae2e8b6e0bd2 for instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 on n-h2-843621-1 May 27 15:04:07.067573 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-d9af6894-053e-4b20-a5f3-aa2c81e9286d req-057c6bb8-9a05-4734-97af-3bf6dc328f40 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090865 May 27 15:04:07.069430 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 781/1646] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:07.096738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e273afba-9631-4742-99d1-29a8c5063d37 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:07.098593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e273afba-9631-4742-99d1-29a8c5063d37 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:07.108477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e273afba-9631-4742-99d1-29a8c5063d37 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:07.109373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e273afba-9631-4742-99d1-29a8c5063d37 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:07.110628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e273afba-9631-4742-99d1-29a8c5063d37 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:07.111342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e273afba-9631-4742-99d1-29a8c5063d37 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:07.177616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e273afba-9631-4742-99d1-29a8c5063d37 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:04:07.196056 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9db31ae5-f77b-4065-9799-50faf1543c84 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e" status: 200 len: 1616 microversion: 2.1 time: 0.363771 May 27 15:04:07.196660 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 866/1647] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:06 2022] GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e => generated 1616 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:07.206893 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-57b6567d-b09c-40f4-a06f-42f0697931fd tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:07.207848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-57b6567d-b09c-40f4-a06f-42f0697931fd tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:07.215050 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57b6567d-b09c-40f4-a06f-42f0697931fd tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:07.215872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57b6567d-b09c-40f4-a06f-42f0697931fd tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:07.216995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57b6567d-b09c-40f4-a06f-42f0697931fd tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:07.217692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57b6567d-b09c-40f4-a06f-42f0697931fd tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:07.299612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57b6567d-b09c-40f4-a06f-42f0697931fd tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:07.301107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57b6567d-b09c-40f4-a06f-42f0697931fd tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:07.301594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-57b6567d-b09c-40f4-a06f-42f0697931fd tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lazy-loading 'fault' on Instance uuid c1699aaf-d186-4cde-ac8c-318a335635b3 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:04:07.370721 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e273afba-9631-4742-99d1-29a8c5063d37 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "DELETE /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1" status: 204 len: 0 microversion: 2.21 time: 0.295066 May 27 15:04:07.376296 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 782/1648] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:04:07 2022] DELETE /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:04:07.388713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-32864dda-2a05-4a09-a248-f135eb4fc808 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:07.389481 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-32864dda-2a05-4a09-a248-f135eb4fc808 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 2834b60d-ed8c-48d6-bbf5-2daeec41f497] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:07.399003 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-57b6567d-b09c-40f4-a06f-42f0697931fd tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37aeba85d8b4c1282ac1b470836bae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be47565a2f034bbd8f81292196597473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:07.402717 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32864dda-2a05-4a09-a248-f135eb4fc808 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:07.404572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32864dda-2a05-4a09-a248-f135eb4fc808 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:07.405481 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32864dda-2a05-4a09-a248-f135eb4fc808 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:07.406520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32864dda-2a05-4a09-a248-f135eb4fc808 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:07.417904 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-57b6567d-b09c-40f4-a06f-42f0697931fd tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3" status: 200 len: 1307 microversion: 2.1 time: 0.213778 May 27 15:04:07.421333 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 867/1649] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:07 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3 => generated 1307 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:07.432589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2f11ae08-cf2c-49b2-b122-c62935ecd55b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776cdc790>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:07.517785 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2f11ae08-cf2c-49b2-b122-c62935ecd55b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1437 microversion: 2.1 time: 0.095002 May 27 15:04:07.518377 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 868/1650] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:04:07 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1437 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:07.527649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-780d9560-110b-4275-b35f-c0cf0b445acb tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:07.528290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-780d9560-110b-4275-b35f-c0cf0b445acb tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:07.536246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-780d9560-110b-4275-b35f-c0cf0b445acb tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:07.537162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-780d9560-110b-4275-b35f-c0cf0b445acb tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:07.538267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-780d9560-110b-4275-b35f-c0cf0b445acb tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:07.538697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-780d9560-110b-4275-b35f-c0cf0b445acb tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:07.725241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-32864dda-2a05-4a09-a248-f135eb4fc808 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:07.733953 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-32864dda-2a05-4a09-a248-f135eb4fc808 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497" status: 200 len: 1314 microversion: 2.1 time: 0.356053 May 27 15:04:07.745763 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 783/1651] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:07 2022] GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:07.751992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-85f092b9-85de-43a3-81fb-d7ecd481b8ab tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-295885232", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["44417337-ef8b-407b-aafd-7f00dfc5b4d8"]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:07.889331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-780d9560-110b-4275-b35f-c0cf0b445acb tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:07.907728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-85f092b9-85de-43a3-81fb-d7ecd481b8ab tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] validate_networks() for None {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:04:07.911964 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-780d9560-110b-4275-b35f-c0cf0b445acb tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:07.914539 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-780d9560-110b-4275-b35f-c0cf0b445acb tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:07.916137 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-780d9560-110b-4275-b35f-c0cf0b445acb tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1" status: 200 len: 1557 microversion: 2.21 time: 0.396589 May 27 15:04:07.917028 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 869/1652] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:07 2022] GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 => generated 1557 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:07.924587 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-39801d4f-9cb5-467b-a8d7-5d8f1aae133a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:07.925535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-39801d4f-9cb5-467b-a8d7-5d8f1aae133a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:07.933488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39801d4f-9cb5-467b-a8d7-5d8f1aae133a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:07.934487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39801d4f-9cb5-467b-a8d7-5d8f1aae133a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:07.935455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39801d4f-9cb5-467b-a8d7-5d8f1aae133a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:07.936091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39801d4f-9cb5-467b-a8d7-5d8f1aae133a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:08.356648 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-39801d4f-9cb5-467b-a8d7-5d8f1aae133a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:08.374247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-39801d4f-9cb5-467b-a8d7-5d8f1aae133a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:08.376104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-39801d4f-9cb5-467b-a8d7-5d8f1aae133a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:08.382346 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-39801d4f-9cb5-467b-a8d7-5d8f1aae133a tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.463960 May 27 15:04:08.388704 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 870/1653] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:07 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:08.402922 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0148729a-63a2-41b0-92ea-5a4bb1437362 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:08.409586 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0148729a-63a2-41b0-92ea-5a4bb1437362 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:08.419685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0148729a-63a2-41b0-92ea-5a4bb1437362 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:08.420150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0148729a-63a2-41b0-92ea-5a4bb1437362 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:08.421561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0148729a-63a2-41b0-92ea-5a4bb1437362 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:08.423049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0148729a-63a2-41b0-92ea-5a4bb1437362 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:08.428790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-85f092b9-85de-43a3-81fb-d7ecd481b8ab tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:04:08.431658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-85f092b9-85de-43a3-81fb-d7ecd481b8ab tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:04:08.432523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-85f092b9-85de-43a3-81fb-d7ecd481b8ab tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:04:08.433139 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-85f092b9-85de-43a3-81fb-d7ecd481b8ab tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:04:08.433738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-85f092b9-85de-43a3-81fb-d7ecd481b8ab tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:04:08.460531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85f092b9-85de-43a3-81fb-d7ecd481b8ab tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:08.461359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85f092b9-85de-43a3-81fb-d7ecd481b8ab tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:08.462451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85f092b9-85de-43a3-81fb-d7ecd481b8ab tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:08.463080 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85f092b9-85de-43a3-81fb-d7ecd481b8ab tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:08.554846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-85f092b9-85de-43a3-81fb-d7ecd481b8ab tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for project a081b119396543ad8ac9421acc677175. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:04:08.570591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-85f092b9-85de-43a3-81fb-d7ecd481b8ab tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for user f426b883acdc49f8b0c4a9ba68e4572b and project a081b119396543ad8ac9421acc677175. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:04:08.616233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-85f092b9-85de-43a3-81fb-d7ecd481b8ab tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:04:08.633092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-85f092b9-85de-43a3-81fb-d7ecd481b8ab tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 8f095e10-b6bc-4908-bc4f-6534231f3068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:04:08.789075 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-85f092b9-85de-43a3-81fb-d7ecd481b8ab tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.039879 May 27 15:04:08.798631 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 784/1654] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:04:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:04:08.812932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e226b566-6eb3-4a44-bffc-14fa1d912f89 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:08.815085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e226b566-6eb3-4a44-bffc-14fa1d912f89 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] [instance: c1699aaf-d186-4cde-ac8c-318a335635b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:08.826406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e226b566-6eb3-4a44-bffc-14fa1d912f89 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:08.827190 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e226b566-6eb3-4a44-bffc-14fa1d912f89 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:08.828922 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e226b566-6eb3-4a44-bffc-14fa1d912f89 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:08.829603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e226b566-6eb3-4a44-bffc-14fa1d912f89 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:08.855391 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-e226b566-6eb3-4a44-bffc-14fa1d912f89 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] HTTP exception thrown: Instance c1699aaf-d186-4cde-ac8c-318a335635b3 could not be found. May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e226b566-6eb3-4a44-bffc-14fa1d912f89 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Request method failure captured: May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3 HTTP/1.1 May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOe3EVE8qq5LrR2QiOLuWBzBGmk2mgH3CLKs2Z3rwSt1hGlUivB1cAtS79PNaAuSD7lmGIIaYnRICuEjrMycZuGl9Se8VM4e8-piiESzGzIYMqLp_2rWiBC9iYwrkeUOoTg4ycksBalvKfZDSuEQuMR_ypMNwE08AKM5iF3Cq66wP_I May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: be47565a2f034bbd8f81292196597473 May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-VolumesAdminNegativeTest-1074657748 May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/be47565a2f034bbd8f81292196597473"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/be47565a2f034bbd8f81292196597473"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/be47565a2f034bbd8f81292196597473"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_be47565a2f034bbd8f81292196597473", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-VolumesAdminNegativeTest-1074657748 May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: be47565a2f034bbd8f81292196597473 May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1074657748 May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-VolumesAdminNegativeTest-1074657748-project May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: f37aeba85d8b4c1282ac1b470836bae6 May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-VolumesAdminNegativeTest-1074657748-project May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance c1699aaf-d186-4cde-ac8c-318a335635b3 could not be found. May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'c1699aaf-d186-4cde-ac8c-318a335635b3'} May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1699aaf-d186-4cde-ac8c-318a335635b3 could not be found. May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1699aaf-d186-4cde-ac8c-318a335635b3 could not be found. May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:08.862106 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:08.867205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:08.867205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:08.867205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:08.867205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:08.867205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:08.867205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1699aaf-d186-4cde-ac8c-318a335635b3 could not be found. May 27 15:04:08.867205 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:08.869220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e226b566-6eb3-4a44-bffc-14fa1d912f89 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] Returning 404 to user: Instance c1699aaf-d186-4cde-ac8c-318a335635b3 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:08.871361 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e226b566-6eb3-4a44-bffc-14fa1d912f89 tempest-VolumesAdminNegativeTest-1074657748 tempest-VolumesAdminNegativeTest-1074657748-project] 10.222.0.13 "GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3" status: 404 len: 111 microversion: 2.1 time: 0.070452 May 27 15:04:08.872857 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 785/1655] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:08 2022] GET /compute/v2.1/servers/c1699aaf-d186-4cde-ac8c-318a335635b3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:04:08.880087 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ea69ad66-f113-400a-b1a1-41b09fc14010 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776d3fc10>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:08.959960 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ea69ad66-f113-400a-b1a1-41b09fc14010 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1437 microversion: 2.1 time: 0.085009 May 27 15:04:08.964939 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 786/1656] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:04:08 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1437 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:08.975049 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-46eac981-e3be-4bd1-95f4-067dd3f99350 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:08.981656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-46eac981-e3be-4bd1-95f4-067dd3f99350 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 2834b60d-ed8c-48d6-bbf5-2daeec41f497] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:08.997846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-46eac981-e3be-4bd1-95f4-067dd3f99350 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:09.002357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-46eac981-e3be-4bd1-95f4-067dd3f99350 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:09.004324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-46eac981-e3be-4bd1-95f4-067dd3f99350 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:09.005241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-46eac981-e3be-4bd1-95f4-067dd3f99350 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:09.039997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0148729a-63a2-41b0-92ea-5a4bb1437362 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:09.051128 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0148729a-63a2-41b0-92ea-5a4bb1437362 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:09.052655 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0148729a-63a2-41b0-92ea-5a4bb1437362 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:09.058121 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0148729a-63a2-41b0-92ea-5a4bb1437362 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.662923 May 27 15:04:09.058719 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 871/1657] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:08 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:09.079418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3e947b45-4c48-4114-bd83-8c72be54fc9d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:09.089181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3e947b45-4c48-4114-bd83-8c72be54fc9d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 8f095e10-b6bc-4908-bc4f-6534231f3068] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:09.393081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3e947b45-4c48-4114-bd83-8c72be54fc9d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:09.407774 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3e947b45-4c48-4114-bd83-8c72be54fc9d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068" status: 200 len: 1216 microversion: 2.1 time: 0.330324 May 27 15:04:09.409931 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 872/1658] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:09 2022] GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068 => generated 1216 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:09.426345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bee36276-4bb7-48f0-8e4b-11e5a10b978f tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:09.430769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bee36276-4bb7-48f0-8e4b-11e5a10b978f tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:09.456708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bee36276-4bb7-48f0-8e4b-11e5a10b978f tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:09.459887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bee36276-4bb7-48f0-8e4b-11e5a10b978f tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:09.464304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bee36276-4bb7-48f0-8e4b-11e5a10b978f tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:09.466058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bee36276-4bb7-48f0-8e4b-11e5a10b978f tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:09.506748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-46eac981-e3be-4bd1-95f4-067dd3f99350 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:09.522555 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-46eac981-e3be-4bd1-95f4-067dd3f99350 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497" status: 200 len: 1314 microversion: 2.1 time: 0.554118 May 27 15:04:09.523429 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 787/1659] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:08 2022] GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:09.542484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e4695406-4aa9-433c-a2f2-7f12cd733b9f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:09.548115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e4695406-4aa9-433c-a2f2-7f12cd733b9f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:09.558571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e4695406-4aa9-433c-a2f2-7f12cd733b9f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:09.559036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e4695406-4aa9-433c-a2f2-7f12cd733b9f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:09.559832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e4695406-4aa9-433c-a2f2-7f12cd733b9f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:09.560293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e4695406-4aa9-433c-a2f2-7f12cd733b9f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:10.091584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bee36276-4bb7-48f0-8e4b-11e5a10b978f tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:10.110260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bee36276-4bb7-48f0-8e4b-11e5a10b978f tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:10.117048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bee36276-4bb7-48f0-8e4b-11e5a10b978f tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:10.124907 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bee36276-4bb7-48f0-8e4b-11e5a10b978f tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1" status: 200 len: 1557 microversion: 2.21 time: 0.712939 May 27 15:04:10.143758 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 873/1660] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:09 2022] GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 => generated 1557 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:10.169653 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e4695406-4aa9-433c-a2f2-7f12cd733b9f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:10.177407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b939e98c-de4d-4aac-a34a-c69ff9b8082b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc7765d9310>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:10.183828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e4695406-4aa9-433c-a2f2-7f12cd733b9f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:10.188702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e4695406-4aa9-433c-a2f2-7f12cd733b9f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:10.190545 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e4695406-4aa9-433c-a2f2-7f12cd733b9f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.655495 May 27 15:04:10.205038 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 788/1661] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:09 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:10.232925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b9b52161-bb56-4d66-848d-528ee3402ad6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:10.235707 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b9b52161-bb56-4d66-848d-528ee3402ad6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:10.262353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9b52161-bb56-4d66-848d-528ee3402ad6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:10.266726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9b52161-bb56-4d66-848d-528ee3402ad6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:10.271126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9b52161-bb56-4d66-848d-528ee3402ad6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:10.271823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9b52161-bb56-4d66-848d-528ee3402ad6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:10.275531 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b939e98c-de4d-4aac-a34a-c69ff9b8082b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1437 microversion: 2.1 time: 0.130145 May 27 15:04:10.276122 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 874/1662] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:04:10 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1437 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:10.426853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-03dfad6c-04e0-424b-8224-3c0c6be11fdf tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:10.427502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-03dfad6c-04e0-424b-8224-3c0c6be11fdf tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 8f095e10-b6bc-4908-bc4f-6534231f3068] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:10.450045 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03dfad6c-04e0-424b-8224-3c0c6be11fdf tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:10.450526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03dfad6c-04e0-424b-8224-3c0c6be11fdf tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:10.451365 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03dfad6c-04e0-424b-8224-3c0c6be11fdf tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:10.451821 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03dfad6c-04e0-424b-8224-3c0c6be11fdf tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:10.661290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-03dfad6c-04e0-424b-8224-3c0c6be11fdf tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:10.691796 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-03dfad6c-04e0-424b-8224-3c0c6be11fdf tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068" status: 200 len: 1268 microversion: 2.1 time: 0.265687 May 27 15:04:10.697687 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 875/1663] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:10 2022] GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068 => generated 1268 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:10.721974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-21495de7-203f-41b2-9fb0-6f98071472ea tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:10.722672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-21495de7-203f-41b2-9fb0-6f98071472ea tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 2834b60d-ed8c-48d6-bbf5-2daeec41f497] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:10.751390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21495de7-203f-41b2-9fb0-6f98071472ea tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:10.751895 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21495de7-203f-41b2-9fb0-6f98071472ea tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:10.752961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21495de7-203f-41b2-9fb0-6f98071472ea tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:10.755859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21495de7-203f-41b2-9fb0-6f98071472ea tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:10.875953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b9b52161-bb56-4d66-848d-528ee3402ad6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:10.892824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b9b52161-bb56-4d66-848d-528ee3402ad6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:10.896328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b9b52161-bb56-4d66-848d-528ee3402ad6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:10.902192 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b9b52161-bb56-4d66-848d-528ee3402ad6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.695518 May 27 15:04:10.903153 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 789/1664] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:10 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:10.913697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-b6f84054-19aa-4090-8ec6-270e2fcade72 req-3bfc14f5-2248-4f94-9ce4-04f6920bafd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1", "name": "network-vif-deleted", "tag": "b87baaf2-e707-4273-84b7-2bea3b773b73"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:10.934223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b6f84054-19aa-4090-8ec6-270e2fcade72 req-3bfc14f5-2248-4f94-9ce4-04f6920bafd1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:10.938807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b6f84054-19aa-4090-8ec6-270e2fcade72 req-3bfc14f5-2248-4f94-9ce4-04f6920bafd1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:10.981091 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-b6f84054-19aa-4090-8ec6-270e2fcade72 req-3bfc14f5-2248-4f94-9ce4-04f6920bafd1 service nova] Creating event network-vif-deleted:b87baaf2-e707-4273-84b7-2bea3b773b73 for instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 on n-h2-843621-1 May 27 15:04:11.012874 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-b6f84054-19aa-4090-8ec6-270e2fcade72 req-3bfc14f5-2248-4f94-9ce4-04f6920bafd1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107267 May 27 15:04:11.021123 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 790/1665] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:11.038405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:11.149381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-87b5ada9-9e34-4d06-80f7-ba057eefa407 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:11.150729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-87b5ada9-9e34-4d06-80f7-ba057eefa407 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:11.170632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87b5ada9-9e34-4d06-80f7-ba057eefa407 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:11.171265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87b5ada9-9e34-4d06-80f7-ba057eefa407 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:11.172053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87b5ada9-9e34-4d06-80f7-ba057eefa407 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:11.172508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87b5ada9-9e34-4d06-80f7-ba057eefa407 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:11.260208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-21495de7-203f-41b2-9fb0-6f98071472ea tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:11.269650 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-21495de7-203f-41b2-9fb0-6f98071472ea tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497" status: 200 len: 1502 microversion: 2.1 time: 0.571078 May 27 15:04:11.288135 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 876/1666] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:10 2022] GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 => generated 1502 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:11.292830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87b5ada9-9e34-4d06-80f7-ba057eefa407 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:11.293679 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87b5ada9-9e34-4d06-80f7-ba057eefa407 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:11.294178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-87b5ada9-9e34-4d06-80f7-ba057eefa407 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lazy-loading 'fault' on Instance uuid 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:04:11.300540 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-27175ced-6825-44c7-9fb5-25cdf72762e6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:11.315323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-27175ced-6825-44c7-9fb5-25cdf72762e6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:11.341405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27175ced-6825-44c7-9fb5-25cdf72762e6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:11.341871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27175ced-6825-44c7-9fb5-25cdf72762e6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:11.342751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27175ced-6825-44c7-9fb5-25cdf72762e6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:11.343185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27175ced-6825-44c7-9fb5-25cdf72762e6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:11.559481 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-87b5ada9-9e34-4d06-80f7-ba057eefa407 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:11.581156 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-87b5ada9-9e34-4d06-80f7-ba057eefa407 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:11.583218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-87b5ada9-9e34-4d06-80f7-ba057eefa407 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50b34e3da4684475bfd453cf52ed53ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd986899c1cbd4b0bb94d6615a0b5e26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:11.584689 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-87b5ada9-9e34-4d06-80f7-ba057eefa407 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1" status: 200 len: 1348 microversion: 2.21 time: 0.440615 May 27 15:04:11.585753 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 791/1667] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:11 2022] GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 => generated 1348 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:04:11.598288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-75ff94ff-b054-4dd1-9bd3-bdf862c97ae7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776d3faf0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:11.712081 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-75ff94ff-b054-4dd1-9bd3-bdf862c97ae7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1437 microversion: 2.1 time: 0.125066 May 27 15:04:11.713072 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 792/1668] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:04:11 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1437 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:11.720693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0fe26506-887f-4b90-bb14-3c55d52bf6b4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:11.732093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0fe26506-887f-4b90-bb14-3c55d52bf6b4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 2834b60d-ed8c-48d6-bbf5-2daeec41f497] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:11.734475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-27175ced-6825-44c7-9fb5-25cdf72762e6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:11.741711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0fe26506-887f-4b90-bb14-3c55d52bf6b4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:11.742476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0fe26506-887f-4b90-bb14-3c55d52bf6b4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:11.743685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-27175ced-6825-44c7-9fb5-25cdf72762e6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:11.743979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0fe26506-887f-4b90-bb14-3c55d52bf6b4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:11.744509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0fe26506-887f-4b90-bb14-3c55d52bf6b4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:11.757770 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-27175ced-6825-44c7-9fb5-25cdf72762e6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:11.767645 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-27175ced-6825-44c7-9fb5-25cdf72762e6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.478068 May 27 15:04:11.770517 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 877/1669] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:11 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:11.782462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9687ee38-0fcb-400c-8911-4820895f841b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:11.783101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9687ee38-0fcb-400c-8911-4820895f841b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 8f095e10-b6bc-4908-bc4f-6534231f3068] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:11.790334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0fe26506-887f-4b90-bb14-3c55d52bf6b4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 2834b60d-ed8c-48d6-bbf5-2daeec41f497] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:04:11.817288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9687ee38-0fcb-400c-8911-4820895f841b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:11.818074 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9687ee38-0fcb-400c-8911-4820895f841b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:11.818963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9687ee38-0fcb-400c-8911-4820895f841b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:11.819626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9687ee38-0fcb-400c-8911-4820895f841b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:11.942945 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0fe26506-887f-4b90-bb14-3c55d52bf6b4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497" status: 204 len: 0 microversion: 2.1 time: 0.228102 May 27 15:04:11.944006 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 793/1670] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:04:11 2022] DELETE /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:04:11.954450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-868ad0cf-22be-48cc-b0ba-eb4ffb02b66c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:11.959991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-868ad0cf-22be-48cc-b0ba-eb4ffb02b66c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:11.968039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-868ad0cf-22be-48cc-b0ba-eb4ffb02b66c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:11.969231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-868ad0cf-22be-48cc-b0ba-eb4ffb02b66c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:11.970407 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-868ad0cf-22be-48cc-b0ba-eb4ffb02b66c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:11.971078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-868ad0cf-22be-48cc-b0ba-eb4ffb02b66c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:11.991961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9687ee38-0fcb-400c-8911-4820895f841b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:12.003817 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9687ee38-0fcb-400c-8911-4820895f841b tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068" status: 200 len: 1274 microversion: 2.1 time: 0.232015 May 27 15:04:12.004907 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 878/1671] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:11 2022] GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068 => generated 1274 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:12.013362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1f52ffd7-f534-4456-b451-d37303d05fea tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:12.014379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1f52ffd7-f534-4456-b451-d37303d05fea tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 2834b60d-ed8c-48d6-bbf5-2daeec41f497] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:12.034478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f52ffd7-f534-4456-b451-d37303d05fea tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:12.035304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f52ffd7-f534-4456-b451-d37303d05fea tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:12.036320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f52ffd7-f534-4456-b451-d37303d05fea tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:12.037138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f52ffd7-f534-4456-b451-d37303d05fea tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:12.454599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-868ad0cf-22be-48cc-b0ba-eb4ffb02b66c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:12.473382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-868ad0cf-22be-48cc-b0ba-eb4ffb02b66c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:12.474993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-868ad0cf-22be-48cc-b0ba-eb4ffb02b66c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:12.483576 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-868ad0cf-22be-48cc-b0ba-eb4ffb02b66c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.534709 May 27 15:04:12.484953 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 794/1672] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:11 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:12.547367 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1f52ffd7-f534-4456-b451-d37303d05fea tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:12.564824 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1f52ffd7-f534-4456-b451-d37303d05fea tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497" status: 200 len: 1508 microversion: 2.1 time: 0.555028 May 27 15:04:12.574275 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 879/1673] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:12 2022] GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 => generated 1508 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:12.608429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-70a7167a-db44-4b58-acbc-6001e05ffaf0 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:12.610330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-70a7167a-db44-4b58-acbc-6001e05ffaf0 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:12.628437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70a7167a-db44-4b58-acbc-6001e05ffaf0 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:12.631765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70a7167a-db44-4b58-acbc-6001e05ffaf0 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:12.633791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70a7167a-db44-4b58-acbc-6001e05ffaf0 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:12.635774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70a7167a-db44-4b58-acbc-6001e05ffaf0 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:12.670047 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-70a7167a-db44-4b58-acbc-6001e05ffaf0 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] HTTP exception thrown: Instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 could not be found. May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-70a7167a-db44-4b58-acbc-6001e05ffaf0 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Request method failure captured: May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 HTTP/1.1 May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOhOL7Ja_pfrBnedbsbUWSDqz_venqBO00JBjcH2ceDXZaW4XUkZjCZXwd8zkZFQNAPgtHESyQT4cOigbOxc9-lNwX7iLmkdBQVlNidfMC5TKKenkwexiwFd8kmopg7DInItq34CO_-ujTjSxBVnUWa66FFbCaAwh_CFMB_qCbeu4zs May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-Openstack-Nova-Api-Version: 2.21 May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: d986899c1cbd4b0bb94d6615a0b5e26e May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-InstanceActionsV221TestJSON-489212393 May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d986899c1cbd4b0bb94d6615a0b5e26e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d986899c1cbd4b0bb94d6615a0b5e26e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d986899c1cbd4b0bb94d6615a0b5e26e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d986899c1cbd4b0bb94d6615a0b5e26e", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-InstanceActionsV221TestJSON-489212393 May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: d986899c1cbd4b0bb94d6615a0b5e26e May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-489212393 May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-InstanceActionsV221TestJSON-489212393-project May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 50b34e3da4684475bfd453cf52ed53ad May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-InstanceActionsV221TestJSON-489212393-project May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 could not be found. May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1'} May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 could not be found. May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 could not be found. May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:12.673743 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:12.678827 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:12.678827 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:12.678827 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:12.678827 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:12.678827 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:12.678827 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:12.678827 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 could not be found. May 27 15:04:12.678827 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:12.680657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-70a7167a-db44-4b58-acbc-6001e05ffaf0 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Returning 404 to user: Instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:12.681761 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-70a7167a-db44-4b58-acbc-6001e05ffaf0 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1" status: 404 len: 111 microversion: 2.21 time: 0.078155 May 27 15:04:12.683747 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 795/1674] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:12 2022] GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:04:12.694089 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4050886c-550c-4530-8441-1bd771d95cd0 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Calling method '.version_select at 0x7fc7765d3b80>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:12.694676 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4050886c-550c-4530-8441-1bd771d95cd0 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:12.702065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4050886c-550c-4530-8441-1bd771d95cd0 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:12.702522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4050886c-550c-4530-8441-1bd771d95cd0 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:12.703565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4050886c-550c-4530-8441-1bd771d95cd0 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:12.704200 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4050886c-550c-4530-8441-1bd771d95cd0 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:12.727198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b7094291-97ba-4fc7-9030-11cd0bf4ecce tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776d9c310>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:12.785890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:12.826350 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b7094291-97ba-4fc7-9030-11cd0bf4ecce tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1437 microversion: 2.1 time: 0.104151 May 27 15:04:12.826954 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 796/1675] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:04:12 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1437 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:12.842424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3fdfb330-5105-4d02-8fd3-7b5f6c91f7b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:12.845021 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3fdfb330-5105-4d02-8fd3-7b5f6c91f7b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:12.870398 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fdfb330-5105-4d02-8fd3-7b5f6c91f7b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:12.870983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fdfb330-5105-4d02-8fd3-7b5f6c91f7b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:12.871900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fdfb330-5105-4d02-8fd3-7b5f6c91f7b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:12.872476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fdfb330-5105-4d02-8fd3-7b5f6c91f7b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:12.926154 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4050886c-550c-4530-8441-1bd771d95cd0 tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.237046 May 27 15:04:12.927245 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 880/1676] 10.222.0.13 () {60 vars in 1336 bytes} [Fri May 27 15:04:12 2022] GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1/os-instance-actions => generated 611 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:04:12.949518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-511c36a4-f81e-41c6-b61b-9a960cc6e1ae tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:12.950291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-511c36a4-f81e-41c6-b61b-9a960cc6e1ae tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:12.971131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-511c36a4-f81e-41c6-b61b-9a960cc6e1ae tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:12.971458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-511c36a4-f81e-41c6-b61b-9a960cc6e1ae tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:12.976502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-511c36a4-f81e-41c6-b61b-9a960cc6e1ae tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:12.977242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-511c36a4-f81e-41c6-b61b-9a960cc6e1ae tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:13.034350 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-511c36a4-f81e-41c6-b61b-9a960cc6e1ae tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] HTTP exception thrown: Instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 could not be found. May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-511c36a4-f81e-41c6-b61b-9a960cc6e1ae tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Request method failure captured: May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 HTTP/1.1 May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOhOL7Ja_pfrBnedbsbUWSDqz_venqBO00JBjcH2ceDXZaW4XUkZjCZXwd8zkZFQNAPgtHESyQT4cOigbOxc9-lNwX7iLmkdBQVlNidfMC5TKKenkwexiwFd8kmopg7DInItq34CO_-ujTjSxBVnUWa66FFbCaAwh_CFMB_qCbeu4zs May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-Openstack-Nova-Api-Version: 2.21 May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: d986899c1cbd4b0bb94d6615a0b5e26e May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-InstanceActionsV221TestJSON-489212393 May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d986899c1cbd4b0bb94d6615a0b5e26e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d986899c1cbd4b0bb94d6615a0b5e26e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d986899c1cbd4b0bb94d6615a0b5e26e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d986899c1cbd4b0bb94d6615a0b5e26e", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-InstanceActionsV221TestJSON-489212393 May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: d986899c1cbd4b0bb94d6615a0b5e26e May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-489212393 May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-InstanceActionsV221TestJSON-489212393-project May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 50b34e3da4684475bfd453cf52ed53ad May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-InstanceActionsV221TestJSON-489212393-project May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 could not be found. May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1'} May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 could not be found. May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:04:13.036118 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:04:13.043090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 could not be found. May 27 15:04:13.043090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:13.043090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:13.043090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:13.043090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:13.043090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:13.043090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:13.043090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:13.043090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:13.043090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 could not be found. May 27 15:04:13.043090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:13.043090 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-511c36a4-f81e-41c6-b61b-9a960cc6e1ae tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Returning 404 to user: Instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:13.050649 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-511c36a4-f81e-41c6-b61b-9a960cc6e1ae tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "DELETE /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1" status: 404 len: 111 microversion: 2.21 time: 0.099744 May 27 15:04:13.050649 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 881/1677] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:04:12 2022] DELETE /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 27 15:04:13.059186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6678a24d-7e94-49e7-8272-0aaf3d3e0091 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:13.061385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6678a24d-7e94-49e7-8272-0aaf3d3e0091 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 8f095e10-b6bc-4908-bc4f-6534231f3068] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:13.075997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6678a24d-7e94-49e7-8272-0aaf3d3e0091 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:13.076472 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6678a24d-7e94-49e7-8272-0aaf3d3e0091 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:13.077291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6678a24d-7e94-49e7-8272-0aaf3d3e0091 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:13.086183 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6678a24d-7e94-49e7-8272-0aaf3d3e0091 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:13.112202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3fdfb330-5105-4d02-8fd3-7b5f6c91f7b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:13.134786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3fdfb330-5105-4d02-8fd3-7b5f6c91f7b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:13.144812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3fdfb330-5105-4d02-8fd3-7b5f6c91f7b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:13.150182 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3fdfb330-5105-4d02-8fd3-7b5f6c91f7b6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.318456 May 27 15:04:13.157454 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 797/1678] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:12 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:13.170969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-115c8702-50ca-4f4f-aa2c-bf27d868c33c tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:13.172496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-115c8702-50ca-4f4f-aa2c-bf27d868c33c tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] [instance: 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:13.190484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-115c8702-50ca-4f4f-aa2c-bf27d868c33c tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:13.191142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-115c8702-50ca-4f4f-aa2c-bf27d868c33c tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:13.196197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-115c8702-50ca-4f4f-aa2c-bf27d868c33c tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:13.196197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-115c8702-50ca-4f4f-aa2c-bf27d868c33c tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:13.242613 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-115c8702-50ca-4f4f-aa2c-bf27d868c33c tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] HTTP exception thrown: Instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 could not be found. May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-115c8702-50ca-4f4f-aa2c-bf27d868c33c tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Request method failure captured: May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 HTTP/1.1 May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOhOL7Ja_pfrBnedbsbUWSDqz_venqBO00JBjcH2ceDXZaW4XUkZjCZXwd8zkZFQNAPgtHESyQT4cOigbOxc9-lNwX7iLmkdBQVlNidfMC5TKKenkwexiwFd8kmopg7DInItq34CO_-ujTjSxBVnUWa66FFbCaAwh_CFMB_qCbeu4zs May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-Openstack-Nova-Api-Version: 2.21 May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: d986899c1cbd4b0bb94d6615a0b5e26e May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-InstanceActionsV221TestJSON-489212393 May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d986899c1cbd4b0bb94d6615a0b5e26e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d986899c1cbd4b0bb94d6615a0b5e26e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d986899c1cbd4b0bb94d6615a0b5e26e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d986899c1cbd4b0bb94d6615a0b5e26e", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-InstanceActionsV221TestJSON-489212393 May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: d986899c1cbd4b0bb94d6615a0b5e26e May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-489212393 May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-InstanceActionsV221TestJSON-489212393-project May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 50b34e3da4684475bfd453cf52ed53ad May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-InstanceActionsV221TestJSON-489212393-project May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 could not be found. May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1'} May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 could not be found. May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 could not be found. May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:13.244347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:13.250041 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:13.250041 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:13.250041 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:13.250041 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:13.250041 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:13.250041 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:13.250041 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 could not be found. May 27 15:04:13.250041 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:13.264686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6678a24d-7e94-49e7-8272-0aaf3d3e0091 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:13.272283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-115c8702-50ca-4f4f-aa2c-bf27d868c33c tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] Returning 404 to user: Instance 70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:13.275358 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-115c8702-50ca-4f4f-aa2c-bf27d868c33c tempest-InstanceActionsV221TestJSON-489212393 tempest-InstanceActionsV221TestJSON-489212393-project] 10.222.0.13 "GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1" status: 404 len: 111 microversion: 2.21 time: 0.116567 May 27 15:04:13.281866 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6678a24d-7e94-49e7-8272-0aaf3d3e0091 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068" status: 200 len: 1274 microversion: 2.1 time: 0.231896 May 27 15:04:13.282102 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 798/1679] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:13 2022] GET /compute/v2.1/servers/70d7f607-a1c2-4379-ae0a-ce0c3edbcdc1 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:04:13.289451 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 882/1680] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:13 2022] GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068 => generated 1274 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:13.541968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c25b308f-200d-4263-86ec-ef71b299aa28 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:13.542952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c25b308f-200d-4263-86ec-ef71b299aa28 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:13.582691 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-56c2bece-d986-4820-a9c3-0140621f0ac8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:13.583323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-56c2bece-d986-4820-a9c3-0140621f0ac8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 2834b60d-ed8c-48d6-bbf5-2daeec41f497] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:13.584214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c25b308f-200d-4263-86ec-ef71b299aa28 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:13.587137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c25b308f-200d-4263-86ec-ef71b299aa28 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:13.588956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c25b308f-200d-4263-86ec-ef71b299aa28 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:13.592707 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c25b308f-200d-4263-86ec-ef71b299aa28 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:13.599563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-56c2bece-d986-4820-a9c3-0140621f0ac8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:13.600027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-56c2bece-d986-4820-a9c3-0140621f0ac8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:13.600871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-56c2bece-d986-4820-a9c3-0140621f0ac8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:13.601341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-56c2bece-d986-4820-a9c3-0140621f0ac8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:14.505314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c25b308f-200d-4263-86ec-ef71b299aa28 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:14.524851 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c25b308f-200d-4263-86ec-ef71b299aa28 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:14.526331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c25b308f-200d-4263-86ec-ef71b299aa28 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:14.527565 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c25b308f-200d-4263-86ec-ef71b299aa28 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.995079 May 27 15:04:14.528139 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 799/1681] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:13 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:14.534358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-56c2bece-d986-4820-a9c3-0140621f0ac8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:14.544832 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-56c2bece-d986-4820-a9c3-0140621f0ac8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497" status: 200 len: 1508 microversion: 2.1 time: 0.966601 May 27 15:04:14.550610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2a766470-c26b-4136-bc83-6d3c45c1b88b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776b93dc0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:14.551154 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 883/1682] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:13 2022] GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 => generated 1508 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:04:14.559417 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6195ccd2-61d9-45d0-bf43-2833f7ad955f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:14.560292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6195ccd2-61d9-45d0-bf43-2833f7ad955f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:14.586390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6195ccd2-61d9-45d0-bf43-2833f7ad955f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:14.587849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6195ccd2-61d9-45d0-bf43-2833f7ad955f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:14.591666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6195ccd2-61d9-45d0-bf43-2833f7ad955f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:14.592362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6195ccd2-61d9-45d0-bf43-2833f7ad955f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:14.636071 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2a766470-c26b-4136-bc83-6d3c45c1b88b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1446 microversion: 2.1 time: 0.095758 May 27 15:04:14.636659 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 800/1683] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:04:14 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1446 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:14.648483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-15ff4135-469d-4b28-85f4-d822169fa371 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:14.649144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-15ff4135-469d-4b28-85f4-d822169fa371 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 8f095e10-b6bc-4908-bc4f-6534231f3068] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:14.678895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15ff4135-469d-4b28-85f4-d822169fa371 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:14.685668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15ff4135-469d-4b28-85f4-d822169fa371 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:14.690507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15ff4135-469d-4b28-85f4-d822169fa371 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:14.691254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15ff4135-469d-4b28-85f4-d822169fa371 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:15.341694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6195ccd2-61d9-45d0-bf43-2833f7ad955f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:15.348160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-15ff4135-469d-4b28-85f4-d822169fa371 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:15.352938 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6195ccd2-61d9-45d0-bf43-2833f7ad955f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:15.354836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6195ccd2-61d9-45d0-bf43-2833f7ad955f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:15.356387 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6195ccd2-61d9-45d0-bf43-2833f7ad955f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.804103 May 27 15:04:15.357213 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 884/1684] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:14 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:15.365614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1d8ae104-730e-4c48-91d0-7f32ee608c6e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc7765c39d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:15.378218 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-15ff4135-469d-4b28-85f4-d822169fa371 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068" status: 200 len: 1316 microversion: 2.1 time: 0.733489 May 27 15:04:15.379097 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 801/1685] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:14 2022] GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068 => generated 1316 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:15.432765 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1d8ae104-730e-4c48-91d0-7f32ee608c6e tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 200 len: 1446 microversion: 2.1 time: 0.071380 May 27 15:04:15.433652 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 885/1686] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:04:15 2022] GET /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 1446 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:15.447406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e59d6395-ded6-442e-8b9c-9040bb1d11ec tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776d9ce50>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:15.548244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-16f3a211-66da-49b4-a8cf-fc8191dcd643 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:15.549020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-16f3a211-66da-49b4-a8cf-fc8191dcd643 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:15.559588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16f3a211-66da-49b4-a8cf-fc8191dcd643 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:15.561102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16f3a211-66da-49b4-a8cf-fc8191dcd643 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:15.564184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16f3a211-66da-49b4-a8cf-fc8191dcd643 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:15.567363 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16f3a211-66da-49b4-a8cf-fc8191dcd643 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:16.115594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-16f3a211-66da-49b4-a8cf-fc8191dcd643 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:16.133667 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-16f3a211-66da-49b4-a8cf-fc8191dcd643 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:16.136236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-16f3a211-66da-49b4-a8cf-fc8191dcd643 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:16.139449 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-16f3a211-66da-49b4-a8cf-fc8191dcd643 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.596484 May 27 15:04:16.143885 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 886/1687] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:15 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:16.170985 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-365efac7-742d-4871-b6ae-f70c974165d9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:16.180114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-365efac7-742d-4871-b6ae-f70c974165d9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 2834b60d-ed8c-48d6-bbf5-2daeec41f497] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:16.222813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-365efac7-742d-4871-b6ae-f70c974165d9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:16.226718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-365efac7-742d-4871-b6ae-f70c974165d9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:16.230137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-365efac7-742d-4871-b6ae-f70c974165d9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:16.235679 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-365efac7-742d-4871-b6ae-f70c974165d9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:16.345071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-365efac7-742d-4871-b6ae-f70c974165d9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:16.346071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-365efac7-742d-4871-b6ae-f70c974165d9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:16.346737 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-365efac7-742d-4871-b6ae-f70c974165d9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lazy-loading 'fault' on Instance uuid 2834b60d-ed8c-48d6-bbf5-2daeec41f497 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:04:16.437683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-365efac7-742d-4871-b6ae-f70c974165d9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:16.445106 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-365efac7-742d-4871-b6ae-f70c974165d9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497" status: 200 len: 1304 microversion: 2.1 time: 0.299240 May 27 15:04:16.445693 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 887/1688] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:16 2022] GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 => generated 1304 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:16.466625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-d9166ffd-f467-40ec-b5f0-055044f807d9 req-676f5d74-cd24-4bbb-9806-8f213df009e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2834b60d-ed8c-48d6-bbf5-2daeec41f497", "name": "network-vif-deleted", "tag": "804ba85b-e4f9-432b-936f-ae2e8b6e0bd2"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:16.491337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d9166ffd-f467-40ec-b5f0-055044f807d9 req-676f5d74-cd24-4bbb-9806-8f213df009e9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:16.491800 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d9166ffd-f467-40ec-b5f0-055044f807d9 req-676f5d74-cd24-4bbb-9806-8f213df009e9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:16.564447 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-d9166ffd-f467-40ec-b5f0-055044f807d9 req-676f5d74-cd24-4bbb-9806-8f213df009e9 service nova] Creating event network-vif-deleted:804ba85b-e4f9-432b-936f-ae2e8b6e0bd2 for instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 on n-h2-843621-1 May 27 15:04:16.591026 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-d9166ffd-f467-40ec-b5f0-055044f807d9 req-676f5d74-cd24-4bbb-9806-8f213df009e9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136164 May 27 15:04:16.596074 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 888/1689] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:16.603869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1e9b82ba-8e58-468e-96c2-9a544bc21287 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:16.606615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1e9b82ba-8e58-468e-96c2-9a544bc21287 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:16.625773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e9b82ba-8e58-468e-96c2-9a544bc21287 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:16.626523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e9b82ba-8e58-468e-96c2-9a544bc21287 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:16.627509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e9b82ba-8e58-468e-96c2-9a544bc21287 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:16.628134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e9b82ba-8e58-468e-96c2-9a544bc21287 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:16.746073 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e59d6395-ded6-442e-8b9c-9040bb1d11ec tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "DELETE /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 204 len: 0 microversion: 2.1 time: 1.303831 May 27 15:04:16.748282 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 802/1690] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:15 2022] DELETE /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 0 bytes in 1307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:04:16.756502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2bc4c7fb-d4d5-497b-bb50-72491f83ec59 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:16.757773 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2bc4c7fb-d4d5-497b-bb50-72491f83ec59 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 8f095e10-b6bc-4908-bc4f-6534231f3068] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:16.788849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2bc4c7fb-d4d5-497b-bb50-72491f83ec59 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:16.792532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2bc4c7fb-d4d5-497b-bb50-72491f83ec59 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:16.797503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2bc4c7fb-d4d5-497b-bb50-72491f83ec59 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:16.800142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2bc4c7fb-d4d5-497b-bb50-72491f83ec59 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:16.817849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:16.996098 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1e9b82ba-8e58-468e-96c2-9a544bc21287 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:17.019279 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1e9b82ba-8e58-468e-96c2-9a544bc21287 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:17.024267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1e9b82ba-8e58-468e-96c2-9a544bc21287 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:17.029911 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1e9b82ba-8e58-468e-96c2-9a544bc21287 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.431902 May 27 15:04:17.031612 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 889/1691] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:16 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:17.036687 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-314280fa-1e47-4452-894e-f25d54834bbe tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:17.037631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-314280fa-1e47-4452-894e-f25d54834bbe tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: fa3160e1-6021-4618-8d44-fb03c94ffe08] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:17.064363 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-314280fa-1e47-4452-894e-f25d54834bbe tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:17.064990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-314280fa-1e47-4452-894e-f25d54834bbe tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:17.066614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-314280fa-1e47-4452-894e-f25d54834bbe tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:17.067104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-314280fa-1e47-4452-894e-f25d54834bbe tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:17.128156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-314280fa-1e47-4452-894e-f25d54834bbe tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: fa3160e1-6021-4618-8d44-fb03c94ffe08] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:04:17.159962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2bc4c7fb-d4d5-497b-bb50-72491f83ec59 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:17.170471 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2bc4c7fb-d4d5-497b-bb50-72491f83ec59 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068" status: 200 len: 1316 microversion: 2.1 time: 0.418941 May 27 15:04:17.173663 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 803/1692] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:16 2022] GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068 => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:17.192372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a14fa112-2a7d-47b1-bad3-fa6a4082b1d8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:17.193378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a14fa112-2a7d-47b1-bad3-fa6a4082b1d8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:17.200349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a14fa112-2a7d-47b1-bad3-fa6a4082b1d8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:17.201185 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a14fa112-2a7d-47b1-bad3-fa6a4082b1d8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:17.202018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a14fa112-2a7d-47b1-bad3-fa6a4082b1d8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:17.203187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a14fa112-2a7d-47b1-bad3-fa6a4082b1d8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:17.331647 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-314280fa-1e47-4452-894e-f25d54834bbe tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08" status: 204 len: 0 microversion: 2.1 time: 0.298409 May 27 15:04:17.332956 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 890/1693] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:04:17 2022] DELETE /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:04:17.464165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3d958cc9-b386-43d9-b406-7f69e60efed1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:17.465122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3d958cc9-b386-43d9-b406-7f69e60efed1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 2834b60d-ed8c-48d6-bbf5-2daeec41f497] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:17.476886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d958cc9-b386-43d9-b406-7f69e60efed1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:17.477795 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d958cc9-b386-43d9-b406-7f69e60efed1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:17.478599 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d958cc9-b386-43d9-b406-7f69e60efed1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:17.479047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d958cc9-b386-43d9-b406-7f69e60efed1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:17.514062 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-3d958cc9-b386-43d9-b406-7f69e60efed1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 could not be found. May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3d958cc9-b386-43d9-b406-7f69e60efed1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 HTTP/1.1 May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 could not be found. May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '2834b60d-ed8c-48d6-bbf5-2daeec41f497'} May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 could not be found. May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 could not be found. May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:17.516654 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:17.521507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:17.521507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:17.521507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:17.521507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:17.521507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:17.521507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 could not be found. May 27 15:04:17.521507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:17.523594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3d958cc9-b386-43d9-b406-7f69e60efed1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:17.525455 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3d958cc9-b386-43d9-b406-7f69e60efed1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497" status: 404 len: 111 microversion: 2.1 time: 0.065629 May 27 15:04:17.535667 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 891/1694] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:17 2022] GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:04:17.550226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a14fa112-2a7d-47b1-bad3-fa6a4082b1d8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:17.561152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a14fa112-2a7d-47b1-bad3-fa6a4082b1d8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:17.564566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a14fa112-2a7d-47b1-bad3-fa6a4082b1d8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:17.566541 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a14fa112-2a7d-47b1-bad3-fa6a4082b1d8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.380309 May 27 15:04:17.567798 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 804/1695] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:17 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:17.572808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a38fb6b8-b815-4738-805a-edd965af0d53 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1301366427", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "5b029644-79a0-4d20-9c9d-09c8d08d8d68"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:17.641425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-a38fb6b8-b815-4738-805a-edd965af0d53 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] validate_networks() for [('5b029644-79a0-4d20-9c9d-09c8d08d8d68', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:04:17.711773 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f2fd4ae0-7e4d-466c-bd73-b4b9d0ea783a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-616932562", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "a400f266-0bb2-420b-8500-ad7b63a44ef7"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:17.866210 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-f2fd4ae0-7e4d-466c-bd73-b4b9d0ea783a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] validate_networks() for [('a400f266-0bb2-420b-8500-ad7b63a44ef7', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:04:18.479164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:18.596250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:18.707740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a38fb6b8-b815-4738-805a-edd965af0d53 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:04:18.709973 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a38fb6b8-b815-4738-805a-edd965af0d53 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:04:18.711379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a38fb6b8-b815-4738-805a-edd965af0d53 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:04:18.712359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a38fb6b8-b815-4738-805a-edd965af0d53 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:04:18.713365 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a38fb6b8-b815-4738-805a-edd965af0d53 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:04:18.741693 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a38fb6b8-b815-4738-805a-edd965af0d53 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:18.742276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a38fb6b8-b815-4738-805a-edd965af0d53 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:18.743474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a38fb6b8-b815-4738-805a-edd965af0d53 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:18.744058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a38fb6b8-b815-4738-805a-edd965af0d53 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:18.778746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-a38fb6b8-b815-4738-805a-edd965af0d53 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Getting quotas for project 1ee754951c48459888c45e9e8ec10dce. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:04:18.796063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-a38fb6b8-b815-4738-805a-edd965af0d53 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Getting quotas for user c118a948fbea4575813842ca30613064 and project 1ee754951c48459888c45e9e8ec10dce. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:04:18.820184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a38fb6b8-b815-4738-805a-edd965af0d53 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:04:18.823714 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a38fb6b8-b815-4738-805a-edd965af0d53 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:04:18.837788 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:18.894496 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a38fb6b8-b815-4738-805a-edd965af0d53 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.323999 May 27 15:04:18.901768 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 892/1696] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:04:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 15:04:18.908841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-69c23f1d-7e8f-4332-923e-7b3a86dd4d14 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:18.909788 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-69c23f1d-7e8f-4332-923e-7b3a86dd4d14 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:18.922844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-69c23f1d-7e8f-4332-923e-7b3a86dd4d14 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:18.923615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-69c23f1d-7e8f-4332-923e-7b3a86dd4d14 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:18.925419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-69c23f1d-7e8f-4332-923e-7b3a86dd4d14 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:18.926140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-69c23f1d-7e8f-4332-923e-7b3a86dd4d14 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:19.264188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-69c23f1d-7e8f-4332-923e-7b3a86dd4d14 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:19.274449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-69c23f1d-7e8f-4332-923e-7b3a86dd4d14 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:19.276400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-69c23f1d-7e8f-4332-923e-7b3a86dd4d14 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:19.278488 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-69c23f1d-7e8f-4332-923e-7b3a86dd4d14 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.375263 May 27 15:04:19.279339 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 893/1697] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:18 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:19.284205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f2fd4ae0-7e4d-466c-bd73-b4b9d0ea783a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:04:19.284845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f2fd4ae0-7e4d-466c-bd73-b4b9d0ea783a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:04:19.285144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f2fd4ae0-7e4d-466c-bd73-b4b9d0ea783a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:04:19.285564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f2fd4ae0-7e4d-466c-bd73-b4b9d0ea783a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:04:19.286024 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f2fd4ae0-7e4d-466c-bd73-b4b9d0ea783a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:04:19.286612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-02957a65-2eed-4a59-b182-9c9519ef1de2 req-d372cf3b-64ce-4c3f-b40f-6ae9ceb60f4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3160e1-6021-4618-8d44-fb03c94ffe08", "name": "network-vif-unplugged", "status": "completed", "tag": "19d47f23-5967-48f2-8242-77be2fe51d5b"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:19.289275 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:19.305540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2fd4ae0-7e4d-466c-bd73-b4b9d0ea783a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:19.305914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2fd4ae0-7e4d-466c-bd73-b4b9d0ea783a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:19.306742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2fd4ae0-7e4d-466c-bd73-b4b9d0ea783a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:19.307273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2fd4ae0-7e4d-466c-bd73-b4b9d0ea783a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:19.310843 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-02957a65-2eed-4a59-b182-9c9519ef1de2 req-d372cf3b-64ce-4c3f-b40f-6ae9ceb60f4c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:19.325303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-02957a65-2eed-4a59-b182-9c9519ef1de2 req-d372cf3b-64ce-4c3f-b40f-6ae9ceb60f4c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:19.340005 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-02957a65-2eed-4a59-b182-9c9519ef1de2 req-d372cf3b-64ce-4c3f-b40f-6ae9ceb60f4c service nova] Creating event network-vif-unplugged:19d47f23-5967-48f2-8242-77be2fe51d5b for instance fa3160e1-6021-4618-8d44-fb03c94ffe08 on n-h2-843621-1 May 27 15:04:19.352402 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-02957a65-2eed-4a59-b182-9c9519ef1de2 req-d372cf3b-64ce-4c3f-b40f-6ae9ceb60f4c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071532 May 27 15:04:19.357731 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 894/1698] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:19.362962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-f2fd4ae0-7e4d-466c-bd73-b4b9d0ea783a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Getting quotas for project 37b5a0b0723a46c1b0755e824e32b776. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:04:19.371507 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-979019bb-8fec-4817-99f3-6bbfe9568c52 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:19.372346 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-979019bb-8fec-4817-99f3-6bbfe9568c52 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 8f095e10-b6bc-4908-bc4f-6534231f3068] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:19.374235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-f2fd4ae0-7e4d-466c-bd73-b4b9d0ea783a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Getting quotas for user 0536f4a5547545acaa06b6aad5d1fbe4 and project 37b5a0b0723a46c1b0755e824e32b776. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:04:19.389656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-979019bb-8fec-4817-99f3-6bbfe9568c52 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:19.391036 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-979019bb-8fec-4817-99f3-6bbfe9568c52 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:19.392192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-979019bb-8fec-4817-99f3-6bbfe9568c52 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:19.395619 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-979019bb-8fec-4817-99f3-6bbfe9568c52 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:19.413490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f2fd4ae0-7e4d-466c-bd73-b4b9d0ea783a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:04:19.416396 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f2fd4ae0-7e4d-466c-bd73-b4b9d0ea783a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:04:19.513467 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f2fd4ae0-7e4d-466c-bd73-b4b9d0ea783a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.805583 May 27 15:04:19.519976 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 805/1699] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:04:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 15:04:19.525001 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c312de48-d760-476d-a7f8-5a2f7ee44348 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:19.526493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c312de48-d760-476d-a7f8-5a2f7ee44348 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:19.544532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c312de48-d760-476d-a7f8-5a2f7ee44348 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:19.545282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c312de48-d760-476d-a7f8-5a2f7ee44348 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:19.546249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c312de48-d760-476d-a7f8-5a2f7ee44348 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:19.546925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c312de48-d760-476d-a7f8-5a2f7ee44348 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:19.954386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c312de48-d760-476d-a7f8-5a2f7ee44348 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:19.971424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c312de48-d760-476d-a7f8-5a2f7ee44348 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:19.973391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c312de48-d760-476d-a7f8-5a2f7ee44348 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:19.974901 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c312de48-d760-476d-a7f8-5a2f7ee44348 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.453829 May 27 15:04:19.989138 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 806/1700] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:19 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:19.994054 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-c0718e9a-e0bf-4c91-9451-ac90450a54f6 req-a1fc6c5e-9d91-49fb-b1e8-11eadab75179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f095e10-b6bc-4908-bc4f-6534231f3068", "tag": "b0c9c218-f779-4474-993f-a4d8fac6fdd3"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:20.007398 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-c0718e9a-e0bf-4c91-9451-ac90450a54f6 req-a1fc6c5e-9d91-49fb-b1e8-11eadab75179 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:20.007846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-c0718e9a-e0bf-4c91-9451-ac90450a54f6 req-a1fc6c5e-9d91-49fb-b1e8-11eadab75179 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:20.037802 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-c0718e9a-e0bf-4c91-9451-ac90450a54f6 req-a1fc6c5e-9d91-49fb-b1e8-11eadab75179 service nova] Creating event network-changed:b0c9c218-f779-4474-993f-a4d8fac6fdd3 for instance 8f095e10-b6bc-4908-bc4f-6534231f3068 on n-h1-843621-1 May 27 15:04:20.044389 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-c0718e9a-e0bf-4c91-9451-ac90450a54f6 req-a1fc6c5e-9d91-49fb-b1e8-11eadab75179 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053570 May 27 15:04:20.045170 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 807/1701] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:20.056757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-34e5ecf2-dee8-44e5-bccf-364d0c364028 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:20.058956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-34e5ecf2-dee8-44e5-bccf-364d0c364028 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:20.075809 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-34e5ecf2-dee8-44e5-bccf-364d0c364028 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:20.076299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-34e5ecf2-dee8-44e5-bccf-364d0c364028 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:20.079925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-34e5ecf2-dee8-44e5-bccf-364d0c364028 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:20.080404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-34e5ecf2-dee8-44e5-bccf-364d0c364028 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:20.111805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-979019bb-8fec-4817-99f3-6bbfe9568c52 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:20.121707 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-979019bb-8fec-4817-99f3-6bbfe9568c52 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068" status: 200 len: 1316 microversion: 2.1 time: 0.759461 May 27 15:04:20.129508 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 895/1702] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:19 2022] GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068 => generated 1316 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:20.140420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-871d8bdc-513c-4fb1-a7c1-ef291170f64e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:20.155855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-871d8bdc-513c-4fb1-a7c1-ef291170f64e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:20.372015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-34e5ecf2-dee8-44e5-bccf-364d0c364028 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:20.385173 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-34e5ecf2-dee8-44e5-bccf-364d0c364028 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039" status: 200 len: 1204 microversion: 2.1 time: 0.338661 May 27 15:04:20.388144 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 808/1703] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:20 2022] GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039 => generated 1204 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:20.405123 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5388b57c-14d3-4918-b9c9-769b142ce4a4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:20.406913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5388b57c-14d3-4918-b9c9-769b142ce4a4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:20.416350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5388b57c-14d3-4918-b9c9-769b142ce4a4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:20.417218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5388b57c-14d3-4918-b9c9-769b142ce4a4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:20.418459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5388b57c-14d3-4918-b9c9-769b142ce4a4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:20.419021 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5388b57c-14d3-4918-b9c9-769b142ce4a4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:20.425977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-871d8bdc-513c-4fb1-a7c1-ef291170f64e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:20.438889 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-871d8bdc-513c-4fb1-a7c1-ef291170f64e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1214 microversion: 2.1 time: 0.307882 May 27 15:04:20.439506 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 896/1704] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:20 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1214 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:20.882645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5388b57c-14d3-4918-b9c9-769b142ce4a4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:20.900142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5388b57c-14d3-4918-b9c9-769b142ce4a4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:20.905463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5388b57c-14d3-4918-b9c9-769b142ce4a4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:20.909954 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5388b57c-14d3-4918-b9c9-769b142ce4a4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.523021 May 27 15:04:20.913409 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 809/1705] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:20 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:20.997127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d7dde25e-e096-47fa-bce3-0da240a15eac tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:20.998035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d7dde25e-e096-47fa-bce3-0da240a15eac tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:21.019699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7dde25e-e096-47fa-bce3-0da240a15eac tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:21.020585 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7dde25e-e096-47fa-bce3-0da240a15eac tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:21.022132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7dde25e-e096-47fa-bce3-0da240a15eac tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:21.022642 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7dde25e-e096-47fa-bce3-0da240a15eac tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:21.147782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-672bafbf-7006-4a5f-bd17-056b7605775e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:21.148617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-672bafbf-7006-4a5f-bd17-056b7605775e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 8f095e10-b6bc-4908-bc4f-6534231f3068] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:21.161593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-672bafbf-7006-4a5f-bd17-056b7605775e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:21.166997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-672bafbf-7006-4a5f-bd17-056b7605775e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:21.168214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-672bafbf-7006-4a5f-bd17-056b7605775e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:21.168970 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-672bafbf-7006-4a5f-bd17-056b7605775e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:22.088259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d7dde25e-e096-47fa-bce3-0da240a15eac tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:22.104150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d7dde25e-e096-47fa-bce3-0da240a15eac tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:22.111786 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d7dde25e-e096-47fa-bce3-0da240a15eac tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:22.113773 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d7dde25e-e096-47fa-bce3-0da240a15eac tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 1.120957 May 27 15:04:22.117400 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 897/1706] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:20 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:22.127742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-15ddcb1c-88e2-4189-92f5-0f4bcfa08d42 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:22.131431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-15ddcb1c-88e2-4189-92f5-0f4bcfa08d42 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:22.145132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-15ddcb1c-88e2-4189-92f5-0f4bcfa08d42 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:22.149034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-15ddcb1c-88e2-4189-92f5-0f4bcfa08d42 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:22.152929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-15ddcb1c-88e2-4189-92f5-0f4bcfa08d42 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:22.153772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-15ddcb1c-88e2-4189-92f5-0f4bcfa08d42 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:22.319453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-15ddcb1c-88e2-4189-92f5-0f4bcfa08d42 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:22.332826 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-15ddcb1c-88e2-4189-92f5-0f4bcfa08d42 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039" status: 200 len: 1266 microversion: 2.1 time: 0.210059 May 27 15:04:22.333879 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 898/1707] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:22 2022] GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:22.346067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-82e0497d-8eba-4b82-aea4-1779a919e8d5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:22.349517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-82e0497d-8eba-4b82-aea4-1779a919e8d5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:22.362306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82e0497d-8eba-4b82-aea4-1779a919e8d5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:22.363129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82e0497d-8eba-4b82-aea4-1779a919e8d5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:22.367671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82e0497d-8eba-4b82-aea4-1779a919e8d5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:22.369767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82e0497d-8eba-4b82-aea4-1779a919e8d5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:22.403023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-672bafbf-7006-4a5f-bd17-056b7605775e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:22.420561 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-672bafbf-7006-4a5f-bd17-056b7605775e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068" status: 200 len: 1316 microversion: 2.1 time: 1.276428 May 27 15:04:22.422852 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 810/1708] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:21 2022] GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068 => generated 1316 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:04:22.445387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e32fe8a9-276b-4df4-bb50-28828e3da738 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:22.447542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e32fe8a9-276b-4df4-bb50-28828e3da738 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:22.469547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e32fe8a9-276b-4df4-bb50-28828e3da738 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:22.474303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e32fe8a9-276b-4df4-bb50-28828e3da738 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:22.475486 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e32fe8a9-276b-4df4-bb50-28828e3da738 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:22.477757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e32fe8a9-276b-4df4-bb50-28828e3da738 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:22.544082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-82e0497d-8eba-4b82-aea4-1779a919e8d5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:22.561644 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-82e0497d-8eba-4b82-aea4-1779a919e8d5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1272 microversion: 2.1 time: 0.225996 May 27 15:04:22.564840 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 899/1709] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:22 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1272 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:22.582309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-7ebf921a-29cb-449e-abcc-8cf6e626dfcf req-a369df32-8ea1-4779-ae73-eab6163491a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3160e1-6021-4618-8d44-fb03c94ffe08", "name": "network-vif-deleted", "tag": "19d47f23-5967-48f2-8242-77be2fe51d5b"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:22.605565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-7ebf921a-29cb-449e-abcc-8cf6e626dfcf req-a369df32-8ea1-4779-ae73-eab6163491a0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:22.607745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-7ebf921a-29cb-449e-abcc-8cf6e626dfcf req-a369df32-8ea1-4779-ae73-eab6163491a0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:22.620261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:22.649131 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-7ebf921a-29cb-449e-abcc-8cf6e626dfcf req-a369df32-8ea1-4779-ae73-eab6163491a0 service nova] Creating event network-vif-deleted:19d47f23-5967-48f2-8242-77be2fe51d5b for instance fa3160e1-6021-4618-8d44-fb03c94ffe08 on n-h2-843621-1 May 27 15:04:22.663825 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-7ebf921a-29cb-449e-abcc-8cf6e626dfcf req-a369df32-8ea1-4779-ae73-eab6163491a0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093874 May 27 15:04:22.664888 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 900/1710] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:23.146640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2e2f00a3-132f-4711-bae1-71510b79e26f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:23.147709 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2e2f00a3-132f-4711-bae1-71510b79e26f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:23.174563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e2f00a3-132f-4711-bae1-71510b79e26f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:23.197430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e2f00a3-132f-4711-bae1-71510b79e26f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:23.207130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e2f00a3-132f-4711-bae1-71510b79e26f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:23.209830 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e2f00a3-132f-4711-bae1-71510b79e26f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:23.219122 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e32fe8a9-276b-4df4-bb50-28828e3da738 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:23.264658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e32fe8a9-276b-4df4-bb50-28828e3da738 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:23.268941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e32fe8a9-276b-4df4-bb50-28828e3da738 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:23.273130 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e32fe8a9-276b-4df4-bb50-28828e3da738 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.848677 May 27 15:04:23.285603 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 811/1711] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:22 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:23.355059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c50f75ee-b06a-47ee-9ca3-c7ec86ee09f5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:23.356174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c50f75ee-b06a-47ee-9ca3-c7ec86ee09f5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:23.397487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c50f75ee-b06a-47ee-9ca3-c7ec86ee09f5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:23.399762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c50f75ee-b06a-47ee-9ca3-c7ec86ee09f5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:23.401800 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c50f75ee-b06a-47ee-9ca3-c7ec86ee09f5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:23.402356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c50f75ee-b06a-47ee-9ca3-c7ec86ee09f5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:23.880856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2e2f00a3-132f-4711-bae1-71510b79e26f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:23.901231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2e2f00a3-132f-4711-bae1-71510b79e26f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:23.903050 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2e2f00a3-132f-4711-bae1-71510b79e26f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:23.904452 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2e2f00a3-132f-4711-bae1-71510b79e26f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.762168 May 27 15:04:23.905067 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 901/1712] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:23 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:04:23.915759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f80a8752-d6a6-46ec-98eb-1cf1bb61e78c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:23.916427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f80a8752-d6a6-46ec-98eb-1cf1bb61e78c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 8f095e10-b6bc-4908-bc4f-6534231f3068] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:23.927204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f80a8752-d6a6-46ec-98eb-1cf1bb61e78c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:23.927677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f80a8752-d6a6-46ec-98eb-1cf1bb61e78c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:23.928487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f80a8752-d6a6-46ec-98eb-1cf1bb61e78c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:23.934163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f80a8752-d6a6-46ec-98eb-1cf1bb61e78c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:24.116835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c50f75ee-b06a-47ee-9ca3-c7ec86ee09f5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:24.135271 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c50f75ee-b06a-47ee-9ca3-c7ec86ee09f5 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039" status: 200 len: 1308 microversion: 2.1 time: 0.787291 May 27 15:04:24.137626 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 812/1713] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:23 2022] GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039 => generated 1308 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:24.145552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b32d39b9-2da8-46d7-a25a-f1272cad62d0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:24.148620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b32d39b9-2da8-46d7-a25a-f1272cad62d0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:24.162070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b32d39b9-2da8-46d7-a25a-f1272cad62d0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:24.163617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b32d39b9-2da8-46d7-a25a-f1272cad62d0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:24.164741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b32d39b9-2da8-46d7-a25a-f1272cad62d0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:24.165586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b32d39b9-2da8-46d7-a25a-f1272cad62d0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:24.274271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b32d39b9-2da8-46d7-a25a-f1272cad62d0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:24.297691 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b32d39b9-2da8-46d7-a25a-f1272cad62d0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1272 microversion: 2.1 time: 0.153751 May 27 15:04:24.298666 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 813/1714] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:24 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:24.312366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e0951a84-9781-4f7d-ac57-32e14642c72d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:24.314260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e0951a84-9781-4f7d-ac57-32e14642c72d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:24.333618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0951a84-9781-4f7d-ac57-32e14642c72d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:24.336513 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0951a84-9781-4f7d-ac57-32e14642c72d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:24.338532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0951a84-9781-4f7d-ac57-32e14642c72d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:24.339538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0951a84-9781-4f7d-ac57-32e14642c72d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:24.353117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f80a8752-d6a6-46ec-98eb-1cf1bb61e78c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:24.377035 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f80a8752-d6a6-46ec-98eb-1cf1bb61e78c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068" status: 200 len: 1316 microversion: 2.1 time: 0.470828 May 27 15:04:24.383141 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 902/1715] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:23 2022] GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068 => generated 1316 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:24.741445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e0951a84-9781-4f7d-ac57-32e14642c72d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:24.755210 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e0951a84-9781-4f7d-ac57-32e14642c72d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:24.758477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e0951a84-9781-4f7d-ac57-32e14642c72d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:24.762378 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e0951a84-9781-4f7d-ac57-32e14642c72d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.460409 May 27 15:04:24.779913 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 814/1716] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:24 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:24.925257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7b746fb0-c71b-4bd6-9f54-a6d7ed112933 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:24.926008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7b746fb0-c71b-4bd6-9f54-a6d7ed112933 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:24.950364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7b746fb0-c71b-4bd6-9f54-a6d7ed112933 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:24.952907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7b746fb0-c71b-4bd6-9f54-a6d7ed112933 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:24.958892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7b746fb0-c71b-4bd6-9f54-a6d7ed112933 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:24.959680 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7b746fb0-c71b-4bd6-9f54-a6d7ed112933 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:25.153123 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-12fcce6c-76b6-4174-a857-8ce2906bbf3f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:25.153846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-12fcce6c-76b6-4174-a857-8ce2906bbf3f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:25.172108 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12fcce6c-76b6-4174-a857-8ce2906bbf3f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:25.172565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12fcce6c-76b6-4174-a857-8ce2906bbf3f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:25.173889 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12fcce6c-76b6-4174-a857-8ce2906bbf3f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:25.174712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12fcce6c-76b6-4174-a857-8ce2906bbf3f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:25.612517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7b746fb0-c71b-4bd6-9f54-a6d7ed112933 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:25.631126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7b746fb0-c71b-4bd6-9f54-a6d7ed112933 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:25.634516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7b746fb0-c71b-4bd6-9f54-a6d7ed112933 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:25.637043 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7b746fb0-c71b-4bd6-9f54-a6d7ed112933 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.717219 May 27 15:04:25.638886 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 903/1717] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:24 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:25.645547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-e0154f80-628d-481b-adf8-2b1263ea4dca req-10c21471-c2cf-4c4c-94df-0384e389b747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f095e10-b6bc-4908-bc4f-6534231f3068", "name": "network-vif-plugged", "status": "completed", "tag": "b0c9c218-f779-4474-993f-a4d8fac6fdd3"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:25.665289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e0154f80-628d-481b-adf8-2b1263ea4dca req-10c21471-c2cf-4c4c-94df-0384e389b747 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:25.666114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e0154f80-628d-481b-adf8-2b1263ea4dca req-10c21471-c2cf-4c4c-94df-0384e389b747 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:25.684040 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-e0154f80-628d-481b-adf8-2b1263ea4dca req-10c21471-c2cf-4c4c-94df-0384e389b747 service nova] Creating event network-vif-plugged:b0c9c218-f779-4474-993f-a4d8fac6fdd3 for instance 8f095e10-b6bc-4908-bc4f-6534231f3068 on n-h1-843621-1 May 27 15:04:25.692968 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-e0154f80-628d-481b-adf8-2b1263ea4dca req-10c21471-c2cf-4c4c-94df-0384e389b747 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052443 May 27 15:04:25.698770 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 904/1718] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:25.706502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-af24c85f-ddab-4257-9362-dc21f60136b2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:25.707933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-af24c85f-ddab-4257-9362-dc21f60136b2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:25.727300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af24c85f-ddab-4257-9362-dc21f60136b2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:25.730686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af24c85f-ddab-4257-9362-dc21f60136b2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:25.731878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af24c85f-ddab-4257-9362-dc21f60136b2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:25.732351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af24c85f-ddab-4257-9362-dc21f60136b2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:25.877167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-12fcce6c-76b6-4174-a857-8ce2906bbf3f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:25.893080 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-12fcce6c-76b6-4174-a857-8ce2906bbf3f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039" status: 200 len: 1308 microversion: 2.1 time: 0.743708 May 27 15:04:25.894544 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 815/1719] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:25 2022] GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039 => generated 1308 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:25.903117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c1d959c4-031c-4fdf-8104-c03c417e68ae tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:25.906884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c1d959c4-031c-4fdf-8104-c03c417e68ae tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 8f095e10-b6bc-4908-bc4f-6534231f3068] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:25.917804 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1d959c4-031c-4fdf-8104-c03c417e68ae tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:25.918623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1d959c4-031c-4fdf-8104-c03c417e68ae tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:25.919679 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1d959c4-031c-4fdf-8104-c03c417e68ae tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:25.920389 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1d959c4-031c-4fdf-8104-c03c417e68ae tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:26.567652 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-af24c85f-ddab-4257-9362-dc21f60136b2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:26.586048 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-af24c85f-ddab-4257-9362-dc21f60136b2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1314 microversion: 2.1 time: 0.885546 May 27 15:04:26.600775 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 905/1720] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:25 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1314 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:26.607361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-df584fdc-5168-4590-8422-77a110617366 req-0dbb80dd-fd3a-4302-bb46-0839fb3d1c7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d30bdb24-7f40-43fe-8f5d-e7e601f4e039", "tag": "bb9884c3-24dd-483c-9017-7ec4b50ceca7"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:26.626649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-df584fdc-5168-4590-8422-77a110617366 req-0dbb80dd-fd3a-4302-bb46-0839fb3d1c7e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:26.628754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-df584fdc-5168-4590-8422-77a110617366 req-0dbb80dd-fd3a-4302-bb46-0839fb3d1c7e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:26.643006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c1d959c4-031c-4fdf-8104-c03c417e68ae tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:26.653129 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c1d959c4-031c-4fdf-8104-c03c417e68ae tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068" status: 200 len: 1316 microversion: 2.1 time: 0.756054 May 27 15:04:26.655971 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 816/1721] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:25 2022] GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068 => generated 1316 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:26.664168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ff3f7e04-36fb-4019-9523-7083aa351bce tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:26.675382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ff3f7e04-36fb-4019-9523-7083aa351bce tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:26.680723 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-df584fdc-5168-4590-8422-77a110617366 req-0dbb80dd-fd3a-4302-bb46-0839fb3d1c7e service nova] Creating event network-changed:bb9884c3-24dd-483c-9017-7ec4b50ceca7 for instance d30bdb24-7f40-43fe-8f5d-e7e601f4e039 on n-h2-843621-1 May 27 15:04:26.683695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff3f7e04-36fb-4019-9523-7083aa351bce tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:26.684161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff3f7e04-36fb-4019-9523-7083aa351bce tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:26.691674 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-df584fdc-5168-4590-8422-77a110617366 req-0dbb80dd-fd3a-4302-bb46-0839fb3d1c7e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089039 May 27 15:04:26.693402 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 906/1722] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:26.693566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff3f7e04-36fb-4019-9523-7083aa351bce tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:26.694079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff3f7e04-36fb-4019-9523-7083aa351bce tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:26.702694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5cfc6aad-e5c1-4334-b4c0-fb4208cacd72 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:26.704592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5cfc6aad-e5c1-4334-b4c0-fb4208cacd72 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:26.716040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5cfc6aad-e5c1-4334-b4c0-fb4208cacd72 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:26.717424 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5cfc6aad-e5c1-4334-b4c0-fb4208cacd72 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:26.718307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5cfc6aad-e5c1-4334-b4c0-fb4208cacd72 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:26.718992 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5cfc6aad-e5c1-4334-b4c0-fb4208cacd72 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:27.183525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ff3f7e04-36fb-4019-9523-7083aa351bce tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:27.190805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5cfc6aad-e5c1-4334-b4c0-fb4208cacd72 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:27.208304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ff3f7e04-36fb-4019-9523-7083aa351bce tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:27.210252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5cfc6aad-e5c1-4334-b4c0-fb4208cacd72 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:27.211632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ff3f7e04-36fb-4019-9523-7083aa351bce tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:27.214045 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ff3f7e04-36fb-4019-9523-7083aa351bce tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.556768 May 27 15:04:27.215069 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 817/1723] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:26 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:27.216708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5cfc6aad-e5c1-4334-b4c0-fb4208cacd72 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:27.219948 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5cfc6aad-e5c1-4334-b4c0-fb4208cacd72 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.524425 May 27 15:04:27.232789 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 907/1724] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:26 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:27.233050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a3657b64-c86e-4a61-8d91-2e7d88c184e0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:27.234686 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a3657b64-c86e-4a61-8d91-2e7d88c184e0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:27.248503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3657b64-c86e-4a61-8d91-2e7d88c184e0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:27.249269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3657b64-c86e-4a61-8d91-2e7d88c184e0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:27.250365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3657b64-c86e-4a61-8d91-2e7d88c184e0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:27.250994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3657b64-c86e-4a61-8d91-2e7d88c184e0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:27.514737 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a3657b64-c86e-4a61-8d91-2e7d88c184e0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:27.533129 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a3657b64-c86e-4a61-8d91-2e7d88c184e0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039" status: 200 len: 1308 microversion: 2.1 time: 0.313435 May 27 15:04:27.534543 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 818/1725] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:27 2022] GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039 => generated 1308 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:27.609309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-70fe9caa-2322-461e-9112-9ddea551c7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:27.610140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-70fe9caa-2322-461e-9112-9ddea551c7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:27.625845 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-70fe9caa-2322-461e-9112-9ddea551c7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:27.630284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-70fe9caa-2322-461e-9112-9ddea551c7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:27.632769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-70fe9caa-2322-461e-9112-9ddea551c7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:27.635118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-70fe9caa-2322-461e-9112-9ddea551c7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:27.673706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6f7eb5ec-9d16-460a-a099-2a6b58d201fa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:27.674337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6f7eb5ec-9d16-460a-a099-2a6b58d201fa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 8f095e10-b6bc-4908-bc4f-6534231f3068] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:27.688295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f7eb5ec-9d16-460a-a099-2a6b58d201fa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:27.691358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f7eb5ec-9d16-460a-a099-2a6b58d201fa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:27.694657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f7eb5ec-9d16-460a-a099-2a6b58d201fa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:27.695398 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f7eb5ec-9d16-460a-a099-2a6b58d201fa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:28.035367 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6f7eb5ec-9d16-460a-a099-2a6b58d201fa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:28.051879 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6f7eb5ec-9d16-460a-a099-2a6b58d201fa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068" status: 200 len: 1316 microversion: 2.1 time: 0.384560 May 27 15:04:28.052488 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 819/1726] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:27 2022] GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068 => generated 1316 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:28.125166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-70fe9caa-2322-461e-9112-9ddea551c7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:28.134308 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-70fe9caa-2322-461e-9112-9ddea551c7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1314 microversion: 2.1 time: 0.532944 May 27 15:04:28.141258 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 908/1727] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:27 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:28.238184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a5a79ce3-62a3-45c5-a5dc-8a5d0d3369fd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:28.240133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a5a79ce3-62a3-45c5-a5dc-8a5d0d3369fd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:28.253475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6f837665-3736-41c1-9959-3e9bc46ebbff tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:28.254996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6f837665-3736-41c1-9959-3e9bc46ebbff tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:28.265026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a5a79ce3-62a3-45c5-a5dc-8a5d0d3369fd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:28.267985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a5a79ce3-62a3-45c5-a5dc-8a5d0d3369fd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:28.268995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a5a79ce3-62a3-45c5-a5dc-8a5d0d3369fd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:28.269533 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f837665-3736-41c1-9959-3e9bc46ebbff tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:28.271183 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f837665-3736-41c1-9959-3e9bc46ebbff tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:28.272741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a5a79ce3-62a3-45c5-a5dc-8a5d0d3369fd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:28.274262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f837665-3736-41c1-9959-3e9bc46ebbff tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:28.274876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f837665-3736-41c1-9959-3e9bc46ebbff tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:28.754833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:28.880785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6f837665-3736-41c1-9959-3e9bc46ebbff tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:28.882781 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a5a79ce3-62a3-45c5-a5dc-8a5d0d3369fd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:28.895903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6f837665-3736-41c1-9959-3e9bc46ebbff tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:28.905316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a5a79ce3-62a3-45c5-a5dc-8a5d0d3369fd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:28.917248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6f837665-3736-41c1-9959-3e9bc46ebbff tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:28.918790 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6f837665-3736-41c1-9959-3e9bc46ebbff tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1885 microversion: 2.32 time: 0.672186 May 27 15:04:28.920869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a5a79ce3-62a3-45c5-a5dc-8a5d0d3369fd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:28.929062 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 909/1728] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:28 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1885 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:28.940121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f286c932-9ae2-45f4-9fbc-b211f6164551 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:28.940548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f286c932-9ae2-45f4-9fbc-b211f6164551 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:28.943791 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a5a79ce3-62a3-45c5-a5dc-8a5d0d3369fd tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.696871 May 27 15:04:28.947905 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 820/1729] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:28 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:28.974905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f286c932-9ae2-45f4-9fbc-b211f6164551 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:28.975366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f286c932-9ae2-45f4-9fbc-b211f6164551 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:28.976165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f286c932-9ae2-45f4-9fbc-b211f6164551 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:28.976613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f286c932-9ae2-45f4-9fbc-b211f6164551 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:28.984044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-eadbd851-ce7a-4af7-8b73-a9daebdcf355 req-2677e4b3-6bea-4bdc-afd7-435aadabbfa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74741255-3451-4856-af14-5320fa7e2d76", "tag": "faeab52a-27e8-41e2-9430-1f0c5cc36535"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:29.008753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-eadbd851-ce7a-4af7-8b73-a9daebdcf355 req-2677e4b3-6bea-4bdc-afd7-435aadabbfa9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:29.010390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-eadbd851-ce7a-4af7-8b73-a9daebdcf355 req-2677e4b3-6bea-4bdc-afd7-435aadabbfa9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:29.025901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:29.064917 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-eadbd851-ce7a-4af7-8b73-a9daebdcf355 req-2677e4b3-6bea-4bdc-afd7-435aadabbfa9 service nova] Creating event network-changed:faeab52a-27e8-41e2-9430-1f0c5cc36535 for instance 74741255-3451-4856-af14-5320fa7e2d76 on n-h2-843621-1 May 27 15:04:29.084277 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-eadbd851-ce7a-4af7-8b73-a9daebdcf355 req-2677e4b3-6bea-4bdc-afd7-435aadabbfa9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135049 May 27 15:04:29.103142 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 821/1730] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:29.128141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d1655ff5-18f4-428f-b9f7-42562c7b50fb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:29.134376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d1655ff5-18f4-428f-b9f7-42562c7b50fb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:29.153944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1655ff5-18f4-428f-b9f7-42562c7b50fb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:29.161498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1655ff5-18f4-428f-b9f7-42562c7b50fb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:29.163568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1655ff5-18f4-428f-b9f7-42562c7b50fb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:29.164037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1655ff5-18f4-428f-b9f7-42562c7b50fb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:29.248078 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-d1655ff5-18f4-428f-b9f7-42562c7b50fb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] HTTP exception thrown: Instance 1ae8a942-8725-474d-a782-1faf50e606b3 could not be found. May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d1655ff5-18f4-428f-b9f7-42562c7b50fb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Request method failure captured: May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 HTTP/1.1 May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOdKOsO5B5ZBMI9yJO1IsnK9bGtL9teNQY6id6m3A9eEUy4hLHSvtaP7YmFCx0ur0stQrC9uv5z4glRp4zQ8idyRukYNaStNxDDWZ_n0mjS8t53TyHC40KvL4cEwxRarEVznJp2nYuyZ9-lLsE5jcsvU3tfcf7TXffixSpYSEzBT6ZM May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: ea3ff9fdd7364a82ad3ed271a33da615 May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1346408267 May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea3ff9fdd7364a82ad3ed271a33da615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea3ff9fdd7364a82ad3ed271a33da615"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea3ff9fdd7364a82ad3ed271a33da615"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea3ff9fdd7364a82ad3ed271a33da615", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1346408267 May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: ea3ff9fdd7364a82ad3ed271a33da615 May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1346408267 May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-AttachSCSIVolumeTestJSON-1346408267-project May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 590be802bea346fc9240befaae60ec9e May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1346408267-project May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 1ae8a942-8725-474d-a782-1faf50e606b3 could not be found. May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '1ae8a942-8725-474d-a782-1faf50e606b3'} May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ae8a942-8725-474d-a782-1faf50e606b3 could not be found. May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:04:29.252288 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:04:29.257828 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ae8a942-8725-474d-a782-1faf50e606b3 could not be found. May 27 15:04:29.257828 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:29.257828 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:29.257828 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:29.257828 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:29.257828 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:29.257828 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:29.257828 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:29.257828 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:29.257828 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ae8a942-8725-474d-a782-1faf50e606b3 could not be found. May 27 15:04:29.257828 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:29.260714 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d1655ff5-18f4-428f-b9f7-42562c7b50fb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Returning 404 to user: Instance 1ae8a942-8725-474d-a782-1faf50e606b3 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:29.262882 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d1655ff5-18f4-428f-b9f7-42562c7b50fb tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 404 len: 111 microversion: 2.1 time: 0.140356 May 27 15:04:29.265787 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 822/1731] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:04:29 2022] DELETE /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:04:29.278037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-583bbaf5-8c20-4fbc-bcaa-7988398db15e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:29.280241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-583bbaf5-8c20-4fbc-bcaa-7988398db15e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 8f095e10-b6bc-4908-bc4f-6534231f3068] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:29.294532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-583bbaf5-8c20-4fbc-bcaa-7988398db15e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:29.296520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-583bbaf5-8c20-4fbc-bcaa-7988398db15e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:29.298651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-583bbaf5-8c20-4fbc-bcaa-7988398db15e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:29.300137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-583bbaf5-8c20-4fbc-bcaa-7988398db15e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:29.334338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:29.336087 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f286c932-9ae2-45f4-9fbc-b211f6164551 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:29.344867 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f286c932-9ae2-45f4-9fbc-b211f6164551 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039" status: 200 len: 1308 microversion: 2.1 time: 0.414570 May 27 15:04:29.348660 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 910/1732] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:28 2022] GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039 => generated 1308 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:29.367781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ec6506f6-f2c8-45b6-aaef-5aa5e73249d9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:29.373685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ec6506f6-f2c8-45b6-aaef-5aa5e73249d9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:29.385285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec6506f6-f2c8-45b6-aaef-5aa5e73249d9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:29.385746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec6506f6-f2c8-45b6-aaef-5aa5e73249d9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:29.386582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec6506f6-f2c8-45b6-aaef-5aa5e73249d9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:29.386978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec6506f6-f2c8-45b6-aaef-5aa5e73249d9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:29.408550 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:29.693686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ec6506f6-f2c8-45b6-aaef-5aa5e73249d9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:29.705756 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ec6506f6-f2c8-45b6-aaef-5aa5e73249d9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1314 microversion: 2.1 time: 0.353925 May 27 15:04:29.709972 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 911/1733] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:29 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:29.717156 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-583bbaf5-8c20-4fbc-bcaa-7988398db15e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:29.728467 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-583bbaf5-8c20-4fbc-bcaa-7988398db15e tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068" status: 200 len: 1465 microversion: 2.1 time: 0.461175 May 27 15:04:29.733414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dd8de4e2-325f-4986-bfa9-7ba785b2a92c tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:29.737838 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 823/1734] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:29 2022] GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068 => generated 1465 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:29.739488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dd8de4e2-325f-4986-bfa9-7ba785b2a92c tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] [instance: 1ae8a942-8725-474d-a782-1faf50e606b3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:29.757617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4e69935c-7ad5-44dc-95e6-fd75d042a849 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:29.758659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4e69935c-7ad5-44dc-95e6-fd75d042a849 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] [instance: 8f095e10-b6bc-4908-bc4f-6534231f3068] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:29.761936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd8de4e2-325f-4986-bfa9-7ba785b2a92c tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:29.768272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd8de4e2-325f-4986-bfa9-7ba785b2a92c tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:29.771930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd8de4e2-325f-4986-bfa9-7ba785b2a92c tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:29.773816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd8de4e2-325f-4986-bfa9-7ba785b2a92c tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:29.782250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e69935c-7ad5-44dc-95e6-fd75d042a849 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:29.784947 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e69935c-7ad5-44dc-95e6-fd75d042a849 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:29.787412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e69935c-7ad5-44dc-95e6-fd75d042a849 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:29.795073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e69935c-7ad5-44dc-95e6-fd75d042a849 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:29.825908 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-dd8de4e2-325f-4986-bfa9-7ba785b2a92c tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] HTTP exception thrown: Instance 1ae8a942-8725-474d-a782-1faf50e606b3 could not be found. May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dd8de4e2-325f-4986-bfa9-7ba785b2a92c tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Request method failure captured: May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 HTTP/1.1 May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOdKOsO5B5ZBMI9yJO1IsnK9bGtL9teNQY6id6m3A9eEUy4hLHSvtaP7YmFCx0ur0stQrC9uv5z4glRp4zQ8idyRukYNaStNxDDWZ_n0mjS8t53TyHC40KvL4cEwxRarEVznJp2nYuyZ9-lLsE5jcsvU3tfcf7TXffixSpYSEzBT6ZM May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: ea3ff9fdd7364a82ad3ed271a33da615 May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1346408267 May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea3ff9fdd7364a82ad3ed271a33da615"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea3ff9fdd7364a82ad3ed271a33da615"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea3ff9fdd7364a82ad3ed271a33da615"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea3ff9fdd7364a82ad3ed271a33da615", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1346408267 May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: ea3ff9fdd7364a82ad3ed271a33da615 May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1346408267 May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AttachSCSIVolumeTestJSON-1346408267-project May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 590be802bea346fc9240befaae60ec9e May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1346408267-project May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 1ae8a942-8725-474d-a782-1faf50e606b3 could not be found. May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '1ae8a942-8725-474d-a782-1faf50e606b3'} May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ae8a942-8725-474d-a782-1faf50e606b3 could not be found. May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ae8a942-8725-474d-a782-1faf50e606b3 could not be found. May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:29.829026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:29.835140 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:29.835140 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:29.835140 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:29.835140 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:29.835140 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:29.835140 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ae8a942-8725-474d-a782-1faf50e606b3 could not be found. May 27 15:04:29.835140 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:29.837461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dd8de4e2-325f-4986-bfa9-7ba785b2a92c tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] Returning 404 to user: Instance 1ae8a942-8725-474d-a782-1faf50e606b3 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:29.839150 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dd8de4e2-325f-4986-bfa9-7ba785b2a92c tempest-AttachSCSIVolumeTestJSON-1346408267 tempest-AttachSCSIVolumeTestJSON-1346408267-project] 10.222.0.13 "GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3" status: 404 len: 111 microversion: 2.1 time: 0.127642 May 27 15:04:29.843801 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 912/1735] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:29 2022] GET /compute/v2.1/servers/1ae8a942-8725-474d-a782-1faf50e606b3 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:04:29.938590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-075e6b5b-2190-4ead-8a97-cc55a5274709 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:29.939312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-075e6b5b-2190-4ead-8a97-cc55a5274709 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:29.951492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-075e6b5b-2190-4ead-8a97-cc55a5274709 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:29.952072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-075e6b5b-2190-4ead-8a97-cc55a5274709 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:29.955372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-075e6b5b-2190-4ead-8a97-cc55a5274709 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:29.955961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-075e6b5b-2190-4ead-8a97-cc55a5274709 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:30.430123 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=10 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:31.100264 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4e69935c-7ad5-44dc-95e6-fd75d042a849 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068" status: 200 len: 1616 microversion: 2.1 time: 1.345498 May 27 15:04:31.103348 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 824/1736] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:29 2022] GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068 => generated 1616 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:04:31.126176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-17792b89-b40f-46d4-a565-379c35fa27de tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:31.130338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-17792b89-b40f-46d4-a565-379c35fa27de tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:31.160752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17792b89-b40f-46d4-a565-379c35fa27de tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:31.161229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17792b89-b40f-46d4-a565-379c35fa27de tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:31.162051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17792b89-b40f-46d4-a565-379c35fa27de tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:31.162500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17792b89-b40f-46d4-a565-379c35fa27de tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:31.388275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-075e6b5b-2190-4ead-8a97-cc55a5274709 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:31.424657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-075e6b5b-2190-4ead-8a97-cc55a5274709 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:31.437577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-075e6b5b-2190-4ead-8a97-cc55a5274709 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:31.438944 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-075e6b5b-2190-4ead-8a97-cc55a5274709 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1873 microversion: 2.32 time: 1.505470 May 27 15:04:31.439551 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 913/1737] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:29 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1873 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:31.477669 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-da6345a0-e508-49e2-83af-cba1c287bc97 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:31.478432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-da6345a0-e508-49e2-83af-cba1c287bc97 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:31.492278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da6345a0-e508-49e2-83af-cba1c287bc97 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:31.498712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da6345a0-e508-49e2-83af-cba1c287bc97 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:31.500266 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da6345a0-e508-49e2-83af-cba1c287bc97 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:31.500756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da6345a0-e508-49e2-83af-cba1c287bc97 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:32.376924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-da6345a0-e508-49e2-83af-cba1c287bc97 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:32.378804 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-17792b89-b40f-46d4-a565-379c35fa27de tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:32.392954 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-17792b89-b40f-46d4-a565-379c35fa27de tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:32.398789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-17792b89-b40f-46d4-a565-379c35fa27de tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:32.400719 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-17792b89-b40f-46d4-a565-379c35fa27de tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 1.295881 May 27 15:04:32.402357 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 825/1738] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:31 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:32.408359 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-da6345a0-e508-49e2-83af-cba1c287bc97 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039" status: 200 len: 1308 microversion: 2.1 time: 0.966375 May 27 15:04:32.409596 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 914/1739] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:31 2022] GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039 => generated 1308 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:32.425534 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a2f9bc29-7fd2-487a-880f-08f00dc0d675 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:32.429823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a2f9bc29-7fd2-487a-880f-08f00dc0d675 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:32.432965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f9739d91-22b2-42b6-a8be-ac63445b2ab8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1126840825", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "44417337-ef8b-407b-aafd-7f00dfc5b4d8"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:32.443613 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a2f9bc29-7fd2-487a-880f-08f00dc0d675 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:32.444420 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a2f9bc29-7fd2-487a-880f-08f00dc0d675 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:32.445850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a2f9bc29-7fd2-487a-880f-08f00dc0d675 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:32.448299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a2f9bc29-7fd2-487a-880f-08f00dc0d675 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:32.613886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-f9739d91-22b2-42b6-a8be-ac63445b2ab8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] validate_networks() for None {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:04:33.155135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a2f9bc29-7fd2-487a-880f-08f00dc0d675 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:33.195029 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a2f9bc29-7fd2-487a-880f-08f00dc0d675 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1314 microversion: 2.1 time: 0.787706 May 27 15:04:33.199355 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 826/1740] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:32 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1314 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:33.220815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-85f116dc-03e0-40f8-87ad-95cf787ef4a7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:33.224855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-85f116dc-03e0-40f8-87ad-95cf787ef4a7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:33.257288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85f116dc-03e0-40f8-87ad-95cf787ef4a7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:33.258222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85f116dc-03e0-40f8-87ad-95cf787ef4a7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:33.259255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85f116dc-03e0-40f8-87ad-95cf787ef4a7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:33.259886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85f116dc-03e0-40f8-87ad-95cf787ef4a7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:33.663560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f9739d91-22b2-42b6-a8be-ac63445b2ab8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:04:33.666785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f9739d91-22b2-42b6-a8be-ac63445b2ab8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:04:33.667772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f9739d91-22b2-42b6-a8be-ac63445b2ab8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:04:33.668488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f9739d91-22b2-42b6-a8be-ac63445b2ab8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:04:33.668946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f9739d91-22b2-42b6-a8be-ac63445b2ab8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:04:33.702047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9739d91-22b2-42b6-a8be-ac63445b2ab8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:33.705948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9739d91-22b2-42b6-a8be-ac63445b2ab8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:33.708184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9739d91-22b2-42b6-a8be-ac63445b2ab8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:33.708663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9739d91-22b2-42b6-a8be-ac63445b2ab8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:33.778277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-f9739d91-22b2-42b6-a8be-ac63445b2ab8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for project a081b119396543ad8ac9421acc677175. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:04:33.795545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-f9739d91-22b2-42b6-a8be-ac63445b2ab8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Getting quotas for user f426b883acdc49f8b0c4a9ba68e4572b and project a081b119396543ad8ac9421acc677175. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:04:33.844423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f9739d91-22b2-42b6-a8be-ac63445b2ab8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:04:33.853438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f9739d91-22b2-42b6-a8be-ac63445b2ab8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:04:33.903343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-85f116dc-03e0-40f8-87ad-95cf787ef4a7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:33.925482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-85f116dc-03e0-40f8-87ad-95cf787ef4a7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:33.931617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-85f116dc-03e0-40f8-87ad-95cf787ef4a7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:33.935609 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-85f116dc-03e0-40f8-87ad-95cf787ef4a7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1873 microversion: 2.32 time: 0.733682 May 27 15:04:33.953425 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 827/1741] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:33 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1873 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:33.974913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-16ff9bf3-8123-4a80-a422-20b368f1334f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:33.981903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-16ff9bf3-8123-4a80-a422-20b368f1334f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:33.999141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16ff9bf3-8123-4a80-a422-20b368f1334f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:34.001102 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16ff9bf3-8123-4a80-a422-20b368f1334f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:34.003734 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16ff9bf3-8123-4a80-a422-20b368f1334f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:34.005865 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16ff9bf3-8123-4a80-a422-20b368f1334f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:34.006117 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f9739d91-22b2-42b6-a8be-ac63445b2ab8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.590350 May 27 15:04:34.013553 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 915/1742] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:04:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:04:34.028509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8a37b700-bad1-4e45-b262-d82134b06493 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:34.029419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8a37b700-bad1-4e45-b262-d82134b06493 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:34.067830 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a37b700-bad1-4e45-b262-d82134b06493 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:34.068462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a37b700-bad1-4e45-b262-d82134b06493 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:34.069447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a37b700-bad1-4e45-b262-d82134b06493 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:34.076990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a37b700-bad1-4e45-b262-d82134b06493 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:34.483828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-16ff9bf3-8123-4a80-a422-20b368f1334f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:34.511034 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-16ff9bf3-8123-4a80-a422-20b368f1334f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039" status: 200 len: 1308 microversion: 2.1 time: 0.556183 May 27 15:04:34.517423 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 828/1743] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:33 2022] GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039 => generated 1308 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:34.531940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8a37b700-bad1-4e45-b262-d82134b06493 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:34.541920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8a37b700-bad1-4e45-b262-d82134b06493 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:34.554711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8a37b700-bad1-4e45-b262-d82134b06493 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:34.556307 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8a37b700-bad1-4e45-b262-d82134b06493 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.542939 May 27 15:04:34.567816 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 916/1744] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:34 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:34.580572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-89cd1dce-915d-47ed-8902-24afecef90a2 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:34.581684 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-89cd1dce-915d-47ed-8902-24afecef90a2 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:34.697049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-89cd1dce-915d-47ed-8902-24afecef90a2 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:34.708955 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-89cd1dce-915d-47ed-8902-24afecef90a2 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97" status: 200 len: 1217 microversion: 2.1 time: 0.137346 May 27 15:04:34.709843 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 917/1745] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:34 2022] GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 => generated 1217 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:34.718305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-05663bd5-739d-4474-bb2c-5018747c789b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:34.726558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-05663bd5-739d-4474-bb2c-5018747c789b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:34.742542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05663bd5-739d-4474-bb2c-5018747c789b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:34.744489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05663bd5-739d-4474-bb2c-5018747c789b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:34.751553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05663bd5-739d-4474-bb2c-5018747c789b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:34.752411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05663bd5-739d-4474-bb2c-5018747c789b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:34.866183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-642143f5-9063-4d1c-819b-b37da6b73b4f tempest-FloatingIPDetailsNegativeTestJSON-823956975 tempest-FloatingIPDetailsNegativeTestJSON-823956975-project] Calling method '.version_select at 0x7fc776be3040>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:34.952641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG neutronclient.v2_0.client [None req-642143f5-9063-4d1c-819b-b37da6b73b4f tempest-FloatingIPDetailsNegativeTestJSON-823956975 tempest-FloatingIPDetailsNegativeTestJSON-823956975-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 12b89e75-e75c-4487-a659-b710b112da0f could not be found", "detail": ""}} {{(pid=119249) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:04:34.954428 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-642143f5-9063-4d1c-819b-b37da6b73b4f tempest-FloatingIPDetailsNegativeTestJSON-823956975 tempest-FloatingIPDetailsNegativeTestJSON-823956975-project] HTTP exception thrown: Floating IP not found for ID 12b89e75-e75c-4487-a659-b710b112da0f May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-642143f5-9063-4d1c-819b-b37da6b73b4f tempest-FloatingIPDetailsNegativeTestJSON-823956975 tempest-FloatingIPDetailsNegativeTestJSON-823956975-project] Request method failure captured: May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-floating-ips/12b89e75-e75c-4487-a659-b710b112da0f HTTP/1.1 May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOiBreFWHCKANNSCUuIVVFQObHNPuUCi_AWroV-LmzDc2nRJwo0XZY5wKvIc8lRYXnXokVgmje3Yp3xFVE3aGhehqS6jV6MrPIg6A-rEvOmXkl1AOglv4IvenEu7zKQ5PI5svEdZCkQKygt9nbmvn9OOUngP_tg1ujvV1e2qfuH0DLA May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: b12e1fdc32e6457b9af1e59e6b1a9e68 May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-823956975 May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b12e1fdc32e6457b9af1e59e6b1a9e68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b12e1fdc32e6457b9af1e59e6b1a9e68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b12e1fdc32e6457b9af1e59e6b1a9e68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b12e1fdc32e6457b9af1e59e6b1a9e68", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-823956975 May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: b12e1fdc32e6457b9af1e59e6b1a9e68 May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-823956975 May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-823956975-project May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 1900f987243743abb036eecc91652d6d May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-823956975-project May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: exception: Floating IP not found for ID 12b89e75-e75c-4487-a659-b710b112da0f May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '12b89e75-e75c-4487-a659-b710b112da0f'} May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 12b89e75-e75c-4487-a659-b710b112da0f could not be found May 27 15:04:34.956576 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59a4a776-cccc-463c-b526-a1a61a348583'] May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 12b89e75-e75c-4487-a659-b710b112da0f. May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 12b89e75-e75c-4487-a659-b710b112da0f May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 12b89e75-e75c-4487-a659-b710b112da0f May 27 15:04:34.961631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:34.966222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-642143f5-9063-4d1c-819b-b37da6b73b4f tempest-FloatingIPDetailsNegativeTestJSON-823956975 tempest-FloatingIPDetailsNegativeTestJSON-823956975-project] Returning 404 to user: Floating IP not found for ID 12b89e75-e75c-4487-a659-b710b112da0f {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:34.967286 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-642143f5-9063-4d1c-819b-b37da6b73b4f tempest-FloatingIPDetailsNegativeTestJSON-823956975 tempest-FloatingIPDetailsNegativeTestJSON-823956975-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips/12b89e75-e75c-4487-a659-b710b112da0f" status: 404 len: 111 microversion: 2.1 time: 0.448018 May 27 15:04:34.968438 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 829/1746] 10.222.0.13 () {58 vars in 1259 bytes} [Fri May 27 15:04:34 2022] GET /compute/v2.1/os-floating-ips/12b89e75-e75c-4487-a659-b710b112da0f => generated 111 bytes in 449 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:04:34.977523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-f97a576d-071c-4c7f-bdd6-e6041ec6bdad req-a10b6599-a6dd-44ff-8280-fdfc3564029a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30bdb24-7f40-43fe-8f5d-e7e601f4e039", "name": "network-vif-plugged", "status": "completed", "tag": "bb9884c3-24dd-483c-9017-7ec4b50ceca7"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:35.007248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f97a576d-071c-4c7f-bdd6-e6041ec6bdad req-a10b6599-a6dd-44ff-8280-fdfc3564029a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:35.031787 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f97a576d-071c-4c7f-bdd6-e6041ec6bdad req-a10b6599-a6dd-44ff-8280-fdfc3564029a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:35.063023 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-f97a576d-071c-4c7f-bdd6-e6041ec6bdad req-a10b6599-a6dd-44ff-8280-fdfc3564029a service nova] Creating event network-vif-plugged:bb9884c3-24dd-483c-9017-7ec4b50ceca7 for instance d30bdb24-7f40-43fe-8f5d-e7e601f4e039 on n-h2-843621-1 May 27 15:04:35.081552 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-f97a576d-071c-4c7f-bdd6-e6041ec6bdad req-a10b6599-a6dd-44ff-8280-fdfc3564029a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110340 May 27 15:04:35.085264 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 830/1747] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:35.104243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7b59aba8-8221-4198-8596-b49d14ff4bbd tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:35.105305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7b59aba8-8221-4198-8596-b49d14ff4bbd tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:35.123630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b59aba8-8221-4198-8596-b49d14ff4bbd tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:35.127437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b59aba8-8221-4198-8596-b49d14ff4bbd tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:35.129934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b59aba8-8221-4198-8596-b49d14ff4bbd tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:35.133712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b59aba8-8221-4198-8596-b49d14ff4bbd tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:35.275517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-05663bd5-739d-4474-bb2c-5018747c789b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:35.285426 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-05663bd5-739d-4474-bb2c-5018747c789b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1314 microversion: 2.1 time: 0.572822 May 27 15:04:35.286736 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 918/1748] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:34 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:35.537020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5f56ccc4-b9c8-470b-9795-e93f416b305b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:35.538510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5f56ccc4-b9c8-470b-9795-e93f416b305b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:35.556113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f56ccc4-b9c8-470b-9795-e93f416b305b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:35.556582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f56ccc4-b9c8-470b-9795-e93f416b305b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:35.587343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f56ccc4-b9c8-470b-9795-e93f416b305b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:35.587978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f56ccc4-b9c8-470b-9795-e93f416b305b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:36.810593 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5f56ccc4-b9c8-470b-9795-e93f416b305b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:36.819198 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5f56ccc4-b9c8-470b-9795-e93f416b305b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039" status: 200 len: 1308 microversion: 2.1 time: 1.288888 May 27 15:04:36.837989 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 919/1749] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:35 2022] GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039 => generated 1308 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:36.854563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2163d4a5-c5ee-4ac0-bb6b-9d51cb4fbe10 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:36.855197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2163d4a5-c5ee-4ac0-bb6b-9d51cb4fbe10 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:36.867751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2163d4a5-c5ee-4ac0-bb6b-9d51cb4fbe10 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:36.868193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7b59aba8-8221-4198-8596-b49d14ff4bbd tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:36.868713 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2163d4a5-c5ee-4ac0-bb6b-9d51cb4fbe10 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:36.869349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2163d4a5-c5ee-4ac0-bb6b-9d51cb4fbe10 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:36.869803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2163d4a5-c5ee-4ac0-bb6b-9d51cb4fbe10 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:36.887694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7b59aba8-8221-4198-8596-b49d14ff4bbd tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:36.890801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7b59aba8-8221-4198-8596-b49d14ff4bbd tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:36.892732 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7b59aba8-8221-4198-8596-b49d14ff4bbd tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1873 microversion: 2.32 time: 1.805688 May 27 15:04:36.894597 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 831/1750] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:35 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1873 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:36.910210 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e167e08b-47c6-4cac-a7bf-7f30df88c1ea tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:36.915552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e167e08b-47c6-4cac-a7bf-7f30df88c1ea tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:36.935360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e167e08b-47c6-4cac-a7bf-7f30df88c1ea tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:36.937889 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e167e08b-47c6-4cac-a7bf-7f30df88c1ea tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:36.938925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e167e08b-47c6-4cac-a7bf-7f30df88c1ea tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:36.941317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e167e08b-47c6-4cac-a7bf-7f30df88c1ea tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:37.071181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e167e08b-47c6-4cac-a7bf-7f30df88c1ea tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:37.089170 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e167e08b-47c6-4cac-a7bf-7f30df88c1ea tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97" status: 200 len: 1275 microversion: 2.1 time: 0.192932 May 27 15:04:37.090791 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 832/1751] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:36 2022] GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 => generated 1275 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:37.121064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a78782b5-7c59-4461-88ca-be824dcec8a9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:37.123696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a78782b5-7c59-4461-88ca-be824dcec8a9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:37.142393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a78782b5-7c59-4461-88ca-be824dcec8a9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:37.142853 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a78782b5-7c59-4461-88ca-be824dcec8a9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:37.146829 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a78782b5-7c59-4461-88ca-be824dcec8a9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:37.150267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a78782b5-7c59-4461-88ca-be824dcec8a9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:37.325637 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2163d4a5-c5ee-4ac0-bb6b-9d51cb4fbe10 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:37.343059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2163d4a5-c5ee-4ac0-bb6b-9d51cb4fbe10 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:37.351427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2163d4a5-c5ee-4ac0-bb6b-9d51cb4fbe10 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:37.360312 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2163d4a5-c5ee-4ac0-bb6b-9d51cb4fbe10 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.520205 May 27 15:04:37.361465 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 920/1752] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:36 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:37.480026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-25472993-cb10-4583-a930-d41b8479fa86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1981947367", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:37.560739 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-25472993-cb10-4583-a930-d41b8479fa86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] validate_networks() for [('80eb5c58-0683-4e37-88ce-18553afe38a6', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:04:37.872312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a78782b5-7c59-4461-88ca-be824dcec8a9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:37.885966 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a78782b5-7c59-4461-88ca-be824dcec8a9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1314 microversion: 2.1 time: 0.791918 May 27 15:04:37.887366 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 833/1753] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:37 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1314 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:37.893478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-ef6dbd4e-4f48-46a7-a6fc-65cc2097e31c req-93c9532e-6949-4937-9f9c-d7ef0e88ed2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74741255-3451-4856-af14-5320fa7e2d76", "name": "network-vif-plugged", "status": "completed", "tag": "faeab52a-27e8-41e2-9430-1f0c5cc36535"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:37.906545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ef6dbd4e-4f48-46a7-a6fc-65cc2097e31c req-93c9532e-6949-4937-9f9c-d7ef0e88ed2f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:37.907254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ef6dbd4e-4f48-46a7-a6fc-65cc2097e31c req-93c9532e-6949-4937-9f9c-d7ef0e88ed2f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:37.926807 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-ef6dbd4e-4f48-46a7-a6fc-65cc2097e31c req-93c9532e-6949-4937-9f9c-d7ef0e88ed2f service nova] Creating event network-vif-plugged:faeab52a-27e8-41e2-9430-1f0c5cc36535 for instance 74741255-3451-4856-af14-5320fa7e2d76 on n-h2-843621-1 May 27 15:04:37.933058 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-ef6dbd4e-4f48-46a7-a6fc-65cc2097e31c req-93c9532e-6949-4937-9f9c-d7ef0e88ed2f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044133 May 27 15:04:37.934192 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 834/1754] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:37.940302 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-df7680d2-b5a3-4d15-9899-e502aca31c6b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:37.945049 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-df7680d2-b5a3-4d15-9899-e502aca31c6b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:37.955201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df7680d2-b5a3-4d15-9899-e502aca31c6b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:37.956268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df7680d2-b5a3-4d15-9899-e502aca31c6b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:37.957528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df7680d2-b5a3-4d15-9899-e502aca31c6b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:37.958159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df7680d2-b5a3-4d15-9899-e502aca31c6b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:38.414709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-df7680d2-b5a3-4d15-9899-e502aca31c6b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:38.425236 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-df7680d2-b5a3-4d15-9899-e502aca31c6b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039" status: 200 len: 1488 microversion: 2.1 time: 0.487207 May 27 15:04:38.425853 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 835/1755] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:37 2022] GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039 => generated 1488 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:38.449876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-79b8b697-15ff-411b-b6d6-1bb6d3104fc0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:38.450492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-79b8b697-15ff-411b-b6d6-1bb6d3104fc0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:38.466205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79b8b697-15ff-411b-b6d6-1bb6d3104fc0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:38.472121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79b8b697-15ff-411b-b6d6-1bb6d3104fc0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:38.477155 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79b8b697-15ff-411b-b6d6-1bb6d3104fc0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:38.477981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79b8b697-15ff-411b-b6d6-1bb6d3104fc0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:39.047538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-25472993-cb10-4583-a930-d41b8479fa86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:04:39.048875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-25472993-cb10-4583-a930-d41b8479fa86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:04:39.050178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-25472993-cb10-4583-a930-d41b8479fa86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:04:39.051072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-25472993-cb10-4583-a930-d41b8479fa86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:04:39.051692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-25472993-cb10-4583-a930-d41b8479fa86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:04:39.077052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-25472993-cb10-4583-a930-d41b8479fa86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:39.077554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-25472993-cb10-4583-a930-d41b8479fa86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:39.085321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-25472993-cb10-4583-a930-d41b8479fa86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:39.086371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-25472993-cb10-4583-a930-d41b8479fa86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:39.101967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:39.106514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-79b8b697-15ff-411b-b6d6-1bb6d3104fc0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:39.121830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-79b8b697-15ff-411b-b6d6-1bb6d3104fc0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:39.125320 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-79b8b697-15ff-411b-b6d6-1bb6d3104fc0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:39.129075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-25472993-cb10-4583-a930-d41b8479fa86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Getting quotas for project b31e7608039c4158936369f57b31cf55. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:04:39.131014 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-79b8b697-15ff-411b-b6d6-1bb6d3104fc0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1873 microversion: 2.32 time: 0.693588 May 27 15:04:39.132360 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 836/1756] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:38 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1873 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:39.153353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-25472993-cb10-4583-a930-d41b8479fa86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Getting quotas for user a8a53f4308e94cc1af6516680c0f2a47 and project b31e7608039c4158936369f57b31cf55. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:04:39.155932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3dff5388-3c7f-400c-a89c-4432882c6d63 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:39.156976 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3dff5388-3c7f-400c-a89c-4432882c6d63 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:39.193509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3dff5388-3c7f-400c-a89c-4432882c6d63 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:39.202829 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3dff5388-3c7f-400c-a89c-4432882c6d63 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:39.211827 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3dff5388-3c7f-400c-a89c-4432882c6d63 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:39.217556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3dff5388-3c7f-400c-a89c-4432882c6d63 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:39.248396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-25472993-cb10-4583-a930-d41b8479fa86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:04:39.257688 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-25472993-cb10-4583-a930-d41b8479fa86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:04:39.366964 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-25472993-cb10-4583-a930-d41b8479fa86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.993567 May 27 15:04:39.380498 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 921/1757] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:04:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 2008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:04:39.392903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-001fac5b-3366-4b46-a011-ca264ce42b1e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:39.416234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-001fac5b-3366-4b46-a011-ca264ce42b1e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:39.444067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-001fac5b-3366-4b46-a011-ca264ce42b1e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:39.447443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-001fac5b-3366-4b46-a011-ca264ce42b1e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:39.449573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-001fac5b-3366-4b46-a011-ca264ce42b1e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:39.454021 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-001fac5b-3366-4b46-a011-ca264ce42b1e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:40.010304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-001fac5b-3366-4b46-a011-ca264ce42b1e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:40.052512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-001fac5b-3366-4b46-a011-ca264ce42b1e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:40.069416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-001fac5b-3366-4b46-a011-ca264ce42b1e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:40.081191 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-001fac5b-3366-4b46-a011-ca264ce42b1e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.695219 May 27 15:04:40.083897 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 922/1758] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:39 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:40.114706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e746982a-d5f6-42e6-9eac-ccc7b25b298a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-568300691"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:40.121180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e746982a-d5f6-42e6-9eac-ccc7b25b298a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:40.125207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3dff5388-3c7f-400c-a89c-4432882c6d63 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:40.138215 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3dff5388-3c7f-400c-a89c-4432882c6d63 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97" status: 200 len: 1317 microversion: 2.1 time: 1.000945 May 27 15:04:40.138984 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 837/1759] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:39 2022] GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 => generated 1317 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:40.139365 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e746982a-d5f6-42e6-9eac-ccc7b25b298a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:40.141736 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e746982a-d5f6-42e6-9eac-ccc7b25b298a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:40.150016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e746982a-d5f6-42e6-9eac-ccc7b25b298a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:40.153007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e746982a-d5f6-42e6-9eac-ccc7b25b298a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:40.153911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0a7ab759-1e26-44a3-ba36-d165ce10dc9f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:40.154561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0a7ab759-1e26-44a3-ba36-d165ce10dc9f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:40.175548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a7ab759-1e26-44a3-ba36-d165ce10dc9f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:40.176025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a7ab759-1e26-44a3-ba36-d165ce10dc9f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:40.176870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a7ab759-1e26-44a3-ba36-d165ce10dc9f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:40.177330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a7ab759-1e26-44a3-ba36-d165ce10dc9f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:40.790008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0a7ab759-1e26-44a3-ba36-d165ce10dc9f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:40.799373 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0a7ab759-1e26-44a3-ba36-d165ce10dc9f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1501 microversion: 2.1 time: 0.658450 May 27 15:04:40.800117 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 838/1760] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:40 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1501 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:40.827349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-eae295e3-0082-407a-84ad-0932289c480c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:40.840832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-eae295e3-0082-407a-84ad-0932289c480c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:40.871949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eae295e3-0082-407a-84ad-0932289c480c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:40.883816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eae295e3-0082-407a-84ad-0932289c480c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:40.923928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eae295e3-0082-407a-84ad-0932289c480c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:40.930152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eae295e3-0082-407a-84ad-0932289c480c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:40.934922 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e746982a-d5f6-42e6-9eac-ccc7b25b298a tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "POST /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039/action" status: 202 len: 0 microversion: 2.1 time: 0.848681 May 27 15:04:40.945079 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 923/1761] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:04:40 2022] POST /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039/action => generated 0 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 27 15:04:40.950804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1e543484-dce5-4e42-b93a-430e724ca627 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:40.951529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1e543484-dce5-4e42-b93a-430e724ca627 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:40.979495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e543484-dce5-4e42-b93a-430e724ca627 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:40.980067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e543484-dce5-4e42-b93a-430e724ca627 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:40.981050 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e543484-dce5-4e42-b93a-430e724ca627 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:40.981478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e543484-dce5-4e42-b93a-430e724ca627 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:41.895682 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-eae295e3-0082-407a-84ad-0932289c480c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:41.921699 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-eae295e3-0082-407a-84ad-0932289c480c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1266 microversion: 2.1 time: 1.115886 May 27 15:04:41.923211 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 839/1762] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:40 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1266 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:41.940508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9fcca538-56a0-4dc1-8f6b-330a18170355 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc77c0313a0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:42.113196 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9fcca538-56a0-4dc1-8f6b-330a18170355 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/af29bc9a-69da-465c-94fc-79e74632772c" status: 200 len: 1411 microversion: 2.1 time: 0.187666 May 27 15:04:42.114383 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 840/1763] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:04:41 2022] GET /compute/v2.1/images/af29bc9a-69da-465c-94fc-79e74632772c => generated 1411 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:42.123255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-996609e0-04f6-488e-8ecc-f14c85c3415e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:42.124148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-996609e0-04f6-488e-8ecc-f14c85c3415e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:42.137273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-996609e0-04f6-488e-8ecc-f14c85c3415e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:42.138518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-996609e0-04f6-488e-8ecc-f14c85c3415e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:42.141389 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-996609e0-04f6-488e-8ecc-f14c85c3415e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:42.157936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-996609e0-04f6-488e-8ecc-f14c85c3415e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:42.860918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-996609e0-04f6-488e-8ecc-f14c85c3415e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:42.898962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-996609e0-04f6-488e-8ecc-f14c85c3415e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:42.906242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-996609e0-04f6-488e-8ecc-f14c85c3415e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:42.915301 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-996609e0-04f6-488e-8ecc-f14c85c3415e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.799040 May 27 15:04:42.916942 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 841/1764] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:42 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:42.929052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-83845c5f-16f9-43ae-9611-d8dd3b891b13 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:42.936569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-83845c5f-16f9-43ae-9611-d8dd3b891b13 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:42.965565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-83845c5f-16f9-43ae-9611-d8dd3b891b13 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:42.966735 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1e543484-dce5-4e42-b93a-430e724ca627 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:42.967758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-83845c5f-16f9-43ae-9611-d8dd3b891b13 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:42.973214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-83845c5f-16f9-43ae-9611-d8dd3b891b13 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:42.975141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-83845c5f-16f9-43ae-9611-d8dd3b891b13 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:42.983428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1e543484-dce5-4e42-b93a-430e724ca627 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:42.987593 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1e543484-dce5-4e42-b93a-430e724ca627 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:42.992446 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1e543484-dce5-4e42-b93a-430e724ca627 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1873 microversion: 2.32 time: 2.044517 May 27 15:04:42.994077 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 924/1765] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:40 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1873 bytes in 2048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:43.009148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9d6ca437-8454-4d20-b445-c93585801f71 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc7808569d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:43.072075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:43.086828 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9d6ca437-8454-4d20-b445-c93585801f71 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/af29bc9a-69da-465c-94fc-79e74632772c" status: 200 len: 1411 microversion: 2.1 time: 0.090710 May 27 15:04:43.087420 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 925/1766] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:04:42 2022] GET /compute/v2.1/images/af29bc9a-69da-465c-94fc-79e74632772c => generated 1411 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:43.111102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-535b863f-afee-4833-a329-aa028c4ec813 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:43.111738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-535b863f-afee-4833-a329-aa028c4ec813 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:43.129393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=91 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:43.144081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-535b863f-afee-4833-a329-aa028c4ec813 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:43.144559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-535b863f-afee-4833-a329-aa028c4ec813 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:43.148329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-535b863f-afee-4833-a329-aa028c4ec813 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:43.149904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-535b863f-afee-4833-a329-aa028c4ec813 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:43.620252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-535b863f-afee-4833-a329-aa028c4ec813 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:43.660003 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-535b863f-afee-4833-a329-aa028c4ec813 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1272 microversion: 2.1 time: 0.561533 May 27 15:04:43.664742 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 926/1767] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:43 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1272 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:43.688353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9ab67538-345c-4570-8b28-2acd1ee1c141 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc7807b64c0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:44.198947 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-83845c5f-16f9-43ae-9611-d8dd3b891b13 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:44.223149 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9ab67538-345c-4570-8b28-2acd1ee1c141 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "DELETE /compute/v2.1/images/af29bc9a-69da-465c-94fc-79e74632772c" status: 204 len: 0 microversion: 2.1 time: 0.556199 May 27 15:04:44.225804 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 927/1768] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:43 2022] DELETE /compute/v2.1/images/af29bc9a-69da-465c-94fc-79e74632772c => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:04:44.233547 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-83845c5f-16f9-43ae-9611-d8dd3b891b13 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97" status: 200 len: 1317 microversion: 2.1 time: 1.314270 May 27 15:04:44.246124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-0b4ac1e5-5bc3-49f6-b997-d88f9372770e req-1ae09c82-bd8f-4718-9861-5f3b32dc3f21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc92f950-a316-4536-b69c-fd6900c98f97", "tag": "8c191ad1-df28-4fa7-8018-135517279560"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:44.252092 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 842/1769] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:42 2022] GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 => generated 1317 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:44.267717 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-35c4fb53-dec3-4667-bb0e-d1b0c1427d21 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:44.268986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-35c4fb53-dec3-4667-bb0e-d1b0c1427d21 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:44.291463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0b4ac1e5-5bc3-49f6-b997-d88f9372770e req-1ae09c82-bd8f-4718-9861-5f3b32dc3f21 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:44.292218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0b4ac1e5-5bc3-49f6-b997-d88f9372770e req-1ae09c82-bd8f-4718-9861-5f3b32dc3f21 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:44.296564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35c4fb53-dec3-4667-bb0e-d1b0c1427d21 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:44.297453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35c4fb53-dec3-4667-bb0e-d1b0c1427d21 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:44.316009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35c4fb53-dec3-4667-bb0e-d1b0c1427d21 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:44.316949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35c4fb53-dec3-4667-bb0e-d1b0c1427d21 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:44.350867 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-0b4ac1e5-5bc3-49f6-b997-d88f9372770e req-1ae09c82-bd8f-4718-9861-5f3b32dc3f21 service nova] Creating event network-changed:8c191ad1-df28-4fa7-8018-135517279560 for instance fc92f950-a316-4536-b69c-fd6900c98f97 on n-h2-843621-1 May 27 15:04:44.369762 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-0b4ac1e5-5bc3-49f6-b997-d88f9372770e req-1ae09c82-bd8f-4718-9861-5f3b32dc3f21 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141497 May 27 15:04:44.370457 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 928/1770] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:44.397458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fd20389d-a517-4c0b-95e8-d65461943c03 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:44.398315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fd20389d-a517-4c0b-95e8-d65461943c03 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:44.421717 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd20389d-a517-4c0b-95e8-d65461943c03 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:44.422193 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd20389d-a517-4c0b-95e8-d65461943c03 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:44.434807 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd20389d-a517-4c0b-95e8-d65461943c03 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:44.435982 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd20389d-a517-4c0b-95e8-d65461943c03 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:45.391346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-35c4fb53-dec3-4667-bb0e-d1b0c1427d21 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:45.403944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-35c4fb53-dec3-4667-bb0e-d1b0c1427d21 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:45.416072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-35c4fb53-dec3-4667-bb0e-d1b0c1427d21 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:45.437542 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-35c4fb53-dec3-4667-bb0e-d1b0c1427d21 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 1.168521 May 27 15:04:45.445526 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 843/1771] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:44 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:45.457915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ef7e3ddd-133e-452e-a604-6113d65cdaa4 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776daa1f0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:45.549123 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-ef7e3ddd-133e-452e-a604-6113d65cdaa4 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] HTTP exception thrown: Image not found. May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ef7e3ddd-133e-452e-a604-6113d65cdaa4 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Request method failure captured: May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/images/af29bc9a-69da-465c-94fc-79e74632772c HTTP/1.1 May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOekeThdeVCogF6dj7wYTadlmdkqsIR70GO0d08ee7m39zNH8hgxhXUBy4qSQ5tNThjyRRTsRzMRH9a1sdIBgwsOJVsDAG32UdEFxmmF41Be8zs5IhW1tEYXXmifuRJjqD7bllUZ5OZYxIkgYwovqgmGlGDuNU-wBhsFeuMC7AzdqB8 May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee754951c48459888c45e9e8ec10dce", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesTestJSON-601948072 May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesTestJSON-601948072-project May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: c118a948fbea4575813842ca30613064 May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesTestJSON-601948072-project May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: exception: Image not found. May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'af29bc9a-69da-465c-94fc-79e74632772c'} May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID af29bc9a-69da-465c-94fc-79e74632772c May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 27 15:04:45.573067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image af29bc9a-69da-465c-94fc-79e74632772c could not be found. May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ef7e3ddd-133e-452e-a604-6113d65cdaa4 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Returning 404 to user: Image not found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ef7e3ddd-133e-452e-a604-6113d65cdaa4 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/images/af29bc9a-69da-465c-94fc-79e74632772c" status: 404 len: 62 microversion: 2.1 time: 0.123967 May 27 15:04:45.580258 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 844/1772] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:04:45 2022] GET /compute/v2.1/images/af29bc9a-69da-465c-94fc-79e74632772c => generated 62 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:04:45.588869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ef075a0e-57c7-43ea-98e4-82ae045ee54b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:45.588869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ef075a0e-57c7-43ea-98e4-82ae045ee54b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:45.601036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef075a0e-57c7-43ea-98e4-82ae045ee54b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:45.601846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef075a0e-57c7-43ea-98e4-82ae045ee54b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:45.604559 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef075a0e-57c7-43ea-98e4-82ae045ee54b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:45.605265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef075a0e-57c7-43ea-98e4-82ae045ee54b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:45.866496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fd20389d-a517-4c0b-95e8-d65461943c03 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:45.892112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fd20389d-a517-4c0b-95e8-d65461943c03 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:45.897660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fd20389d-a517-4c0b-95e8-d65461943c03 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:45.898895 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fd20389d-a517-4c0b-95e8-d65461943c03 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1873 microversion: 2.32 time: 1.522906 May 27 15:04:45.902393 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 929/1773] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:44 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1873 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:45.916339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-16e7de63-7f12-4cde-8b4b-41670ff50824 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:45.917012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-16e7de63-7f12-4cde-8b4b-41670ff50824 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:45.917238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ef075a0e-57c7-43ea-98e4-82ae045ee54b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:45.927830 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16e7de63-7f12-4cde-8b4b-41670ff50824 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:45.928291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16e7de63-7f12-4cde-8b4b-41670ff50824 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:45.929123 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16e7de63-7f12-4cde-8b4b-41670ff50824 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:45.929553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16e7de63-7f12-4cde-8b4b-41670ff50824 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:45.931708 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ef075a0e-57c7-43ea-98e4-82ae045ee54b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1272 microversion: 2.1 time: 0.351770 May 27 15:04:45.933079 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 845/1774] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:45 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1272 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:45.963818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-90518399-30cb-4fbe-a61f-6da7c164fa99 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:45.969238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-90518399-30cb-4fbe-a61f-6da7c164fa99 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:45.985968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90518399-30cb-4fbe-a61f-6da7c164fa99 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:45.986759 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90518399-30cb-4fbe-a61f-6da7c164fa99 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:45.989995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90518399-30cb-4fbe-a61f-6da7c164fa99 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:45.993990 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90518399-30cb-4fbe-a61f-6da7c164fa99 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:46.420872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-16e7de63-7f12-4cde-8b4b-41670ff50824 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:46.424431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-90518399-30cb-4fbe-a61f-6da7c164fa99 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:46.431753 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-16e7de63-7f12-4cde-8b4b-41670ff50824 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97" status: 200 len: 1317 microversion: 2.1 time: 0.526421 May 27 15:04:46.436544 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 930/1775] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:45 2022] GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 => generated 1317 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:46.443779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0d916433-fad9-45ed-adcc-dc670767e15d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ee298d9-3fae-4a6b-8ee9-e4749ae0c866"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:46.447738 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-90518399-30cb-4fbe-a61f-6da7c164fa99 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039" status: 200 len: 1488 microversion: 2.1 time: 0.513475 May 27 15:04:46.448531 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 846/1776] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:45 2022] GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039 => generated 1488 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:46.453236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0d916433-fad9-45ed-adcc-dc670767e15d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:46.464304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-04ced3f0-641d-4ba7-a45a-3d45744040da tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:46.465141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-04ced3f0-641d-4ba7-a45a-3d45744040da tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:46.468070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0d916433-fad9-45ed-adcc-dc670767e15d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:46.470491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0d916433-fad9-45ed-adcc-dc670767e15d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:46.473013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04ced3f0-641d-4ba7-a45a-3d45744040da tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:46.473625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0d916433-fad9-45ed-adcc-dc670767e15d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:46.473916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04ced3f0-641d-4ba7-a45a-3d45744040da tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:46.475180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04ced3f0-641d-4ba7-a45a-3d45744040da tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:46.476225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04ced3f0-641d-4ba7-a45a-3d45744040da tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:46.476946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0d916433-fad9-45ed-adcc-dc670767e15d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:46.513841 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-04ced3f0-641d-4ba7-a45a-3d45744040da tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:04:46.679057 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-04ced3f0-641d-4ba7-a45a-3d45744040da tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039" status: 204 len: 0 microversion: 2.1 time: 0.217486 May 27 15:04:46.693311 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 847/1777] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:04:46 2022] DELETE /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:04:46.704250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4ca97dd7-2077-42d4-9395-31d36fcce585 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:46.705455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4ca97dd7-2077-42d4-9395-31d36fcce585 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:46.721748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4ca97dd7-2077-42d4-9395-31d36fcce585 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:46.724396 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4ca97dd7-2077-42d4-9395-31d36fcce585 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:46.725863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4ca97dd7-2077-42d4-9395-31d36fcce585 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:46.726702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4ca97dd7-2077-42d4-9395-31d36fcce585 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:47.105660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4ca97dd7-2077-42d4-9395-31d36fcce585 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:47.135422 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4ca97dd7-2077-42d4-9395-31d36fcce585 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:47.140986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4ca97dd7-2077-42d4-9395-31d36fcce585 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:47.142925 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4ca97dd7-2077-42d4-9395-31d36fcce585 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.446639 May 27 15:04:47.145037 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 848/1778] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:46 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:47.151131 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-d7cc5fd2-dce8-4dc7-b543-86de86c678ba req-4a63fb55-939e-464c-8e12-6de35db1c337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05873cb2-4587-4714-a252-49a90edbabd2", "name": "network-vif-unplugged", "status": "completed", "tag": "94292363-2ffc-491a-a278-eb63c9334b1f"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:47.173388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:47.178343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d7cc5fd2-dce8-4dc7-b543-86de86c678ba req-4a63fb55-939e-464c-8e12-6de35db1c337 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:47.179263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d7cc5fd2-dce8-4dc7-b543-86de86c678ba req-4a63fb55-939e-464c-8e12-6de35db1c337 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:47.200092 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-d7cc5fd2-dce8-4dc7-b543-86de86c678ba req-4a63fb55-939e-464c-8e12-6de35db1c337 service nova] Creating event network-vif-unplugged:94292363-2ffc-491a-a278-eb63c9334b1f for instance 05873cb2-4587-4714-a252-49a90edbabd2 on n-h1-843621-1 May 27 15:04:47.212598 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-d7cc5fd2-dce8-4dc7-b543-86de86c678ba req-4a63fb55-939e-464c-8e12-6de35db1c337 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064495 May 27 15:04:47.216340 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 849/1779] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:47.228966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2a51bfb0-e5c1-4f50-bdf4-2831f7fd51e2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc776f3c550>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:47.324197 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-2a51bfb0-e5c1-4f50-bdf4-2831f7fd51e2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] HTTP exception thrown: Image not found. May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2a51bfb0-e5c1-4f50-bdf4-2831f7fd51e2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Request method failure captured: May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/images/af29bc9a-69da-465c-94fc-79e74632772c HTTP/1.1 May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOekeThdeVCogF6dj7wYTadlmdkqsIR70GO0d08ee7m39zNH8hgxhXUBy4qSQ5tNThjyRRTsRzMRH9a1sdIBgwsOJVsDAG32UdEFxmmF41Be8zs5IhW1tEYXXmifuRJjqD7bllUZ5OZYxIkgYwovqgmGlGDuNU-wBhsFeuMC7AzdqB8 May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee754951c48459888c45e9e8ec10dce", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesTestJSON-601948072 May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesTestJSON-601948072-project May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: c118a948fbea4575813842ca30613064 May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesTestJSON-601948072-project May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: exception: Image not found. May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'af29bc9a-69da-465c-94fc-79e74632772c'} May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image af29bc9a-69da-465c-94fc-79e74632772c to delete May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image af29bc9a-69da-465c-94fc-79e74632772c could not be found. May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:47.329135 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:47.335169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2a51bfb0-e5c1-4f50-bdf4-2831f7fd51e2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Returning 404 to user: Image not found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:47.338714 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2a51bfb0-e5c1-4f50-bdf4-2831f7fd51e2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "DELETE /compute/v2.1/images/af29bc9a-69da-465c-94fc-79e74632772c" status: 404 len: 62 microversion: 2.1 time: 0.115379 May 27 15:04:47.339896 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 850/1780] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:47 2022] DELETE /compute/v2.1/images/af29bc9a-69da-465c-94fc-79e74632772c => generated 62 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:04:47.356595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-02575953-e7fa-4285-9bde-0692d2a4c3e1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:47.358614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-02575953-e7fa-4285-9bde-0692d2a4c3e1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:47.375074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-02575953-e7fa-4285-9bde-0692d2a4c3e1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:47.375542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-02575953-e7fa-4285-9bde-0692d2a4c3e1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:47.376349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-02575953-e7fa-4285-9bde-0692d2a4c3e1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:47.376934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-02575953-e7fa-4285-9bde-0692d2a4c3e1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:47.691226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-02575953-e7fa-4285-9bde-0692d2a4c3e1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:47.706992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-02575953-e7fa-4285-9bde-0692d2a4c3e1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:47.709749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-02575953-e7fa-4285-9bde-0692d2a4c3e1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:47.711403 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-02575953-e7fa-4285-9bde-0692d2a4c3e1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1873 microversion: 2.32 time: 0.364933 May 27 15:04:47.715100 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 851/1781] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:47 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1873 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:47.720604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dd71ba5f-40e7-4be2-8ed1-c66bae18f038 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:47.721468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dd71ba5f-40e7-4be2-8ed1-c66bae18f038 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:47.731326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd71ba5f-40e7-4be2-8ed1-c66bae18f038 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:47.731801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd71ba5f-40e7-4be2-8ed1-c66bae18f038 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:47.732609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd71ba5f-40e7-4be2-8ed1-c66bae18f038 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:47.733114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd71ba5f-40e7-4be2-8ed1-c66bae18f038 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:48.224576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dd71ba5f-40e7-4be2-8ed1-c66bae18f038 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:48.241751 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dd71ba5f-40e7-4be2-8ed1-c66bae18f038 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1314 microversion: 2.1 time: 0.524728 May 27 15:04:48.243174 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 852/1782] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:47 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:48.250160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9ab5474c-d391-48c1-be35-11922b77c279 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:48.253633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9ab5474c-d391-48c1-be35-11922b77c279 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:48.268621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ab5474c-d391-48c1-be35-11922b77c279 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:48.269593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ab5474c-d391-48c1-be35-11922b77c279 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:48.271324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ab5474c-d391-48c1-be35-11922b77c279 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:48.272143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ab5474c-d391-48c1-be35-11922b77c279 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:48.323179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9ab5474c-d391-48c1-be35-11922b77c279 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:04:48.409071 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.compute.api [None req-9ab5474c-d391-48c1-be35-11922b77c279 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Instance is already in deleting state, ignoring this request May 27 15:04:48.410538 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9ab5474c-d391-48c1-be35-11922b77c279 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039" status: 204 len: 0 microversion: 2.1 time: 0.165986 May 27 15:04:48.412336 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 853/1783] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:04:48 2022] DELETE /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:04:48.417885 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8a1a1b0b-3525-4c27-a6bc-607259857cae tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:48.419009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8a1a1b0b-3525-4c27-a6bc-607259857cae tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:48.428558 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a1a1b0b-3525-4c27-a6bc-607259857cae tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:48.429521 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a1a1b0b-3525-4c27-a6bc-607259857cae tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:48.430897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a1a1b0b-3525-4c27-a6bc-607259857cae tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:48.431700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a1a1b0b-3525-4c27-a6bc-607259857cae tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:48.917867 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0d916433-fad9-45ed-adcc-dc670767e15d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "POST /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.477314 May 27 15:04:48.918530 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 931/1784] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 15:04:46 2022] POST /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76/os-volume_attachments => generated 194 bytes in 2481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:48.938689 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ed1806d3-2353-4a69-b902-6a77565d4d73 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:48.943133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ed1806d3-2353-4a69-b902-6a77565d4d73 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:48.956456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed1806d3-2353-4a69-b902-6a77565d4d73 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:48.962968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed1806d3-2353-4a69-b902-6a77565d4d73 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:48.964892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed1806d3-2353-4a69-b902-6a77565d4d73 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:48.970939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed1806d3-2353-4a69-b902-6a77565d4d73 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:49.104870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:49.161675 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8a1a1b0b-3525-4c27-a6bc-607259857cae tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:49.177597 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8a1a1b0b-3525-4c27-a6bc-607259857cae tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97" status: 200 len: 1317 microversion: 2.1 time: 0.763268 May 27 15:04:49.178578 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 854/1785] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:48 2022] GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 => generated 1317 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:49.190747 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2477bc7d-1135-4b63-890d-676e9b925b4b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:49.191847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2477bc7d-1135-4b63-890d-676e9b925b4b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:49.202103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2477bc7d-1135-4b63-890d-676e9b925b4b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:49.204901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2477bc7d-1135-4b63-890d-676e9b925b4b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:49.206109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2477bc7d-1135-4b63-890d-676e9b925b4b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:49.206570 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2477bc7d-1135-4b63-890d-676e9b925b4b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:49.210461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=14 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:49.421150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ed1806d3-2353-4a69-b902-6a77565d4d73 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:49.448557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ed1806d3-2353-4a69-b902-6a77565d4d73 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:49.461424 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ed1806d3-2353-4a69-b902-6a77565d4d73 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:49.463708 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ed1806d3-2353-4a69-b902-6a77565d4d73 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.543545 May 27 15:04:49.468530 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 932/1786] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:48 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:49.478026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9d1dffd1-d1e9-456a-8db0-bfdd04f5c721 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:49.484054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9d1dffd1-d1e9-456a-8db0-bfdd04f5c721 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:49.508023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9d1dffd1-d1e9-456a-8db0-bfdd04f5c721 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:49.511281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9d1dffd1-d1e9-456a-8db0-bfdd04f5c721 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:49.512791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9d1dffd1-d1e9-456a-8db0-bfdd04f5c721 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:49.516620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9d1dffd1-d1e9-456a-8db0-bfdd04f5c721 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:49.762453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2477bc7d-1135-4b63-890d-676e9b925b4b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:49.777522 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2477bc7d-1135-4b63-890d-676e9b925b4b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039" status: 200 len: 1494 microversion: 2.1 time: 0.597523 May 27 15:04:49.778994 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 855/1787] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:49 2022] GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039 => generated 1494 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:49.783789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-2ef6f67c-fe11-4b81-bb05-a9253a1ffc3c req-72006871-7ee4-44d5-b6bb-ff2fe013e6ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30bdb24-7f40-43fe-8f5d-e7e601f4e039", "name": "network-vif-plugged", "status": "completed", "tag": "bb9884c3-24dd-483c-9017-7ec4b50ceca7"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:49.805203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2ef6f67c-fe11-4b81-bb05-a9253a1ffc3c req-72006871-7ee4-44d5-b6bb-ff2fe013e6ab service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:49.817820 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2ef6f67c-fe11-4b81-bb05-a9253a1ffc3c req-72006871-7ee4-44d5-b6bb-ff2fe013e6ab service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:49.851147 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-2ef6f67c-fe11-4b81-bb05-a9253a1ffc3c req-72006871-7ee4-44d5-b6bb-ff2fe013e6ab service nova] Creating event network-vif-plugged:bb9884c3-24dd-483c-9017-7ec4b50ceca7 for instance d30bdb24-7f40-43fe-8f5d-e7e601f4e039 on n-h2-843621-1 May 27 15:04:49.866476 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-2ef6f67c-fe11-4b81-bb05-a9253a1ffc3c req-72006871-7ee4-44d5-b6bb-ff2fe013e6ab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085741 May 27 15:04:49.868202 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 856/1788] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:49.887988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3191198f-8695-4876-b88c-171b1536795f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:49.891825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3191198f-8695-4876-b88c-171b1536795f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:49.912293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3191198f-8695-4876-b88c-171b1536795f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:49.913111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3191198f-8695-4876-b88c-171b1536795f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:49.914322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3191198f-8695-4876-b88c-171b1536795f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:49.915258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3191198f-8695-4876-b88c-171b1536795f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:49.975204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9d1dffd1-d1e9-456a-8db0-bfdd04f5c721 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:50.000153 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9d1dffd1-d1e9-456a-8db0-bfdd04f5c721 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:50.005023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9d1dffd1-d1e9-456a-8db0-bfdd04f5c721 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:50.008522 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9d1dffd1-d1e9-456a-8db0-bfdd04f5c721 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1873 microversion: 2.32 time: 0.536735 May 27 15:04:50.010096 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 933/1789] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:49 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1873 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:50.020757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-f870acce-3bb9-4c99-aab0-47065676086d req-6f13604b-5077-49c0-8e91-bb8d72765254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05873cb2-4587-4714-a252-49a90edbabd2", "tag": "94292363-2ffc-491a-a278-eb63c9334b1f"}, {"name": "network-changed", "server_uuid": "ccb6575b-6908-43ae-989f-1bdfcc5f5c63", "tag": "4e0cf72f-d286-4fec-b5c7-e5289e6ed198"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:50.047169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-f870acce-3bb9-4c99-aab0-47065676086d req-6f13604b-5077-49c0-8e91-bb8d72765254 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:50.048512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-f870acce-3bb9-4c99-aab0-47065676086d req-6f13604b-5077-49c0-8e91-bb8d72765254 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:50.118641 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-f870acce-3bb9-4c99-aab0-47065676086d req-6f13604b-5077-49c0-8e91-bb8d72765254 service nova] Creating event network-changed:94292363-2ffc-491a-a278-eb63c9334b1f for instance 05873cb2-4587-4714-a252-49a90edbabd2 on n-h1-843621-1 May 27 15:04:50.120847 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-f870acce-3bb9-4c99-aab0-47065676086d req-6f13604b-5077-49c0-8e91-bb8d72765254 service nova] Creating event network-changed:4e0cf72f-d286-4fec-b5c7-e5289e6ed198 for instance ccb6575b-6908-43ae-989f-1bdfcc5f5c63 on n-h1-843621-1 May 27 15:04:50.136071 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-f870acce-3bb9-4c99-aab0-47065676086d req-6f13604b-5077-49c0-8e91-bb8d72765254 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.123350 May 27 15:04:50.138057 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 934/1790] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:50.160561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3191198f-8695-4876-b88c-171b1536795f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:50.174467 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3191198f-8695-4876-b88c-171b1536795f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1314 microversion: 2.1 time: 0.304204 May 27 15:04:50.176684 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 857/1791] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:49 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:50.210881 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bc69c7a9-7127-4d7c-8fa5-5f43f84d4d4f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:50.211884 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bc69c7a9-7127-4d7c-8fa5-5f43f84d4d4f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:50.232581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc69c7a9-7127-4d7c-8fa5-5f43f84d4d4f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:50.239631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc69c7a9-7127-4d7c-8fa5-5f43f84d4d4f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:50.243061 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc69c7a9-7127-4d7c-8fa5-5f43f84d4d4f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:50.244228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc69c7a9-7127-4d7c-8fa5-5f43f84d4d4f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:50.493966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-317cdbaf-34c2-43cc-a457-c803b04d8e0d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:50.495024 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-317cdbaf-34c2-43cc-a457-c803b04d8e0d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:50.506921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-317cdbaf-34c2-43cc-a457-c803b04d8e0d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:50.509237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-317cdbaf-34c2-43cc-a457-c803b04d8e0d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:50.513366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-317cdbaf-34c2-43cc-a457-c803b04d8e0d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:50.514047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-317cdbaf-34c2-43cc-a457-c803b04d8e0d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:50.569703 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bc69c7a9-7127-4d7c-8fa5-5f43f84d4d4f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:50.580318 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bc69c7a9-7127-4d7c-8fa5-5f43f84d4d4f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97" status: 200 len: 1317 microversion: 2.1 time: 0.380712 May 27 15:04:50.590821 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 935/1792] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:50 2022] GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:50.804038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ed4975a1-736b-4b33-ab70-23ea103b7db0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:50.805110 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ed4975a1-736b-4b33-ab70-23ea103b7db0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:50.805344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-317cdbaf-34c2-43cc-a457-c803b04d8e0d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:50.816396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed4975a1-736b-4b33-ab70-23ea103b7db0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:50.818401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed4975a1-736b-4b33-ab70-23ea103b7db0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:50.822512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed4975a1-736b-4b33-ab70-23ea103b7db0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:50.823861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed4975a1-736b-4b33-ab70-23ea103b7db0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:50.839973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-317cdbaf-34c2-43cc-a457-c803b04d8e0d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:50.849491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-317cdbaf-34c2-43cc-a457-c803b04d8e0d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:50.852143 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-317cdbaf-34c2-43cc-a457-c803b04d8e0d tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.362191 May 27 15:04:50.856727 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 858/1793] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:50 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:04:51.035492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c1ad9586-d497-4a9f-97c3-d37c0b955d8d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:51.036572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c1ad9586-d497-4a9f-97c3-d37c0b955d8d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:51.067389 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1ad9586-d497-4a9f-97c3-d37c0b955d8d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:51.068194 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1ad9586-d497-4a9f-97c3-d37c0b955d8d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:51.069635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1ad9586-d497-4a9f-97c3-d37c0b955d8d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:51.078356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1ad9586-d497-4a9f-97c3-d37c0b955d8d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:51.161008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:51.541644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ed4975a1-736b-4b33-ab70-23ea103b7db0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:51.575148 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ed4975a1-736b-4b33-ab70-23ea103b7db0 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039" status: 200 len: 1494 microversion: 2.1 time: 0.774715 May 27 15:04:51.598697 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 936/1794] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:50 2022] GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039 => generated 1494 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:51.629153 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-da70cb57-a540-4b77-bdfb-db02c38b3dac tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:51.630173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-da70cb57-a540-4b77-bdfb-db02c38b3dac tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:51.653018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da70cb57-a540-4b77-bdfb-db02c38b3dac tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:51.654197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da70cb57-a540-4b77-bdfb-db02c38b3dac tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:51.656425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da70cb57-a540-4b77-bdfb-db02c38b3dac tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:51.658919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da70cb57-a540-4b77-bdfb-db02c38b3dac tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:51.749732 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c1ad9586-d497-4a9f-97c3-d37c0b955d8d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:51.818856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c1ad9586-d497-4a9f-97c3-d37c0b955d8d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:51.821755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c1ad9586-d497-4a9f-97c3-d37c0b955d8d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:51.825703 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c1ad9586-d497-4a9f-97c3-d37c0b955d8d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1873 microversion: 2.32 time: 0.800701 May 27 15:04:51.841437 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 859/1795] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:51 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1873 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:51.848609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-56d3110a-7961-4479-a9b2-d530d45d8ce6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:51.849621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-56d3110a-7961-4479-a9b2-d530d45d8ce6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:51.857176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56d3110a-7961-4479-a9b2-d530d45d8ce6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:51.857975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56d3110a-7961-4479-a9b2-d530d45d8ce6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:51.859832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56d3110a-7961-4479-a9b2-d530d45d8ce6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:51.860511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56d3110a-7961-4479-a9b2-d530d45d8ce6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:52.057686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-da70cb57-a540-4b77-bdfb-db02c38b3dac tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:52.076517 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-da70cb57-a540-4b77-bdfb-db02c38b3dac tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1314 microversion: 2.1 time: 0.474155 May 27 15:04:52.079642 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 937/1796] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:51 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:52.099932 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7f142a2d-f992-4c88-82ae-936fd5c8d692 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:52.101302 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-56d3110a-7961-4479-a9b2-d530d45d8ce6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:52.101614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7f142a2d-f992-4c88-82ae-936fd5c8d692 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:52.108198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f142a2d-f992-4c88-82ae-936fd5c8d692 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:52.109649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f142a2d-f992-4c88-82ae-936fd5c8d692 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:52.110621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f142a2d-f992-4c88-82ae-936fd5c8d692 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:52.111309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f142a2d-f992-4c88-82ae-936fd5c8d692 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:52.112933 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-56d3110a-7961-4479-a9b2-d530d45d8ce6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97" status: 200 len: 1317 microversion: 2.1 time: 0.268829 May 27 15:04:52.113652 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 860/1797] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:51 2022] GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:52.479316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7f142a2d-f992-4c88-82ae-936fd5c8d692 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:52.497888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7f142a2d-f992-4c88-82ae-936fd5c8d692 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:52.500516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7f142a2d-f992-4c88-82ae-936fd5c8d692 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:52.502033 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7f142a2d-f992-4c88-82ae-936fd5c8d692 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.418906 May 27 15:04:52.509849 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 938/1798] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:52 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:52.609440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e92c89f8-92b0-40bc-af3a-a41a55fb0ece tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:52.610228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e92c89f8-92b0-40bc-af3a-a41a55fb0ece tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:52.621877 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e92c89f8-92b0-40bc-af3a-a41a55fb0ece tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:52.624960 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e92c89f8-92b0-40bc-af3a-a41a55fb0ece tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:52.626014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e92c89f8-92b0-40bc-af3a-a41a55fb0ece tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:52.627688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e92c89f8-92b0-40bc-af3a-a41a55fb0ece tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:52.847266 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5fa0ea5a-acf2-4d89-ae76-14a444ed6e85 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:52.848603 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5fa0ea5a-acf2-4d89-ae76-14a444ed6e85 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:52.862181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5fa0ea5a-acf2-4d89-ae76-14a444ed6e85 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:52.870211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5fa0ea5a-acf2-4d89-ae76-14a444ed6e85 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:52.875557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5fa0ea5a-acf2-4d89-ae76-14a444ed6e85 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:52.876254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5fa0ea5a-acf2-4d89-ae76-14a444ed6e85 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:52.899787 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:04:52.930106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e92c89f8-92b0-40bc-af3a-a41a55fb0ece tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:52.941619 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e92c89f8-92b0-40bc-af3a-a41a55fb0ece tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039" status: 200 len: 1494 microversion: 2.1 time: 0.336226 May 27 15:04:52.951623 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 861/1799] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:52 2022] GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039 => generated 1494 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:53.095470 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9f27a091-213e-43b6-9ae3-0738aeeecd59 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:53.096597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9f27a091-213e-43b6-9ae3-0738aeeecd59 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:53.108181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f27a091-213e-43b6-9ae3-0738aeeecd59 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:53.109582 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f27a091-213e-43b6-9ae3-0738aeeecd59 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:53.110670 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f27a091-213e-43b6-9ae3-0738aeeecd59 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:53.112247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f27a091-213e-43b6-9ae3-0738aeeecd59 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:53.523075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5fa0ea5a-acf2-4d89-ae76-14a444ed6e85 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:53.556871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5fa0ea5a-acf2-4d89-ae76-14a444ed6e85 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:53.561912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5fa0ea5a-acf2-4d89-ae76-14a444ed6e85 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:53.565563 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5fa0ea5a-acf2-4d89-ae76-14a444ed6e85 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1873 microversion: 2.32 time: 0.724266 May 27 15:04:53.568197 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 939/1800] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:52 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1873 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:53.570130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9f27a091-213e-43b6-9ae3-0738aeeecd59 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:53.575472 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e9f139c9-3595-47b6-b202-4615bbbb7b6c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:53.576313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e9f139c9-3595-47b6-b202-4615bbbb7b6c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:53.580467 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9f27a091-213e-43b6-9ae3-0738aeeecd59 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1314 microversion: 2.1 time: 0.488887 May 27 15:04:53.581624 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 862/1801] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:53 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:53.585229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e9f139c9-3595-47b6-b202-4615bbbb7b6c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:53.585949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e9f139c9-3595-47b6-b202-4615bbbb7b6c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:53.587551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e9f139c9-3595-47b6-b202-4615bbbb7b6c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:53.588008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e9f139c9-3595-47b6-b202-4615bbbb7b6c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:53.869995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e9f139c9-3595-47b6-b202-4615bbbb7b6c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:53.892100 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e9f139c9-3595-47b6-b202-4615bbbb7b6c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97" status: 200 len: 1317 microversion: 2.1 time: 0.322551 May 27 15:04:53.895359 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 940/1802] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:53 2022] GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:53.903680 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-29f77593-2365-44b7-a7df-ab4a56b890bc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:53.904299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-29f77593-2365-44b7-a7df-ab4a56b890bc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:53.912599 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29f77593-2365-44b7-a7df-ab4a56b890bc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:53.913083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29f77593-2365-44b7-a7df-ab4a56b890bc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:53.913860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29f77593-2365-44b7-a7df-ab4a56b890bc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:53.914303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29f77593-2365-44b7-a7df-ab4a56b890bc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:53.940377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a7e599c5-6512-459a-92dc-c625ffacc57b tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] Calling method '.version_select at 0x7fc776ca5af0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:53.982499 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-a7e599c5-6512-459a-92dc-c625ffacc57b tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] HTTP exception thrown: Image not found. May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a7e599c5-6512-459a-92dc-c625ffacc57b tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] Request method failure captured: May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/images/f94dae15-78c2-48cc-97f6-5e6063d14769/metadata/os_distro HTTP/1.1 May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOiU8UJyszGzw7mtmlxp8hexeXI3dk6rldUv8mBUy7L9_an8J73CVafbB8LP5fCstTEzqZpZXLbZtitYiE6W9pYBoJGB14bctATLdqnLeSCXMvfHIFCqa9KDscpXmme_nHhs7VQZe06v2clhyqEm-IR3knKEylHGmxngYnhM8faW_f8 May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 136ea6d93dc344939bdcf18b56505ef4 May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-880377843 May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/136ea6d93dc344939bdcf18b56505ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/136ea6d93dc344939bdcf18b56505ef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/136ea6d93dc344939bdcf18b56505ef4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_136ea6d93dc344939bdcf18b56505ef4", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-880377843 May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 136ea6d93dc344939bdcf18b56505ef4 May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-880377843 May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesMetadataNegativeTestJSON-880377843-project May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 60399485cb324fc8ac7d41a3a01febfd May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-880377843-project May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: exception: Image not found. May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'image_id': 'f94dae15-78c2-48cc-97f6-5e6063d14769', 'id': 'os_distro'} May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f94dae15-78c2-48cc-97f6-5e6063d14769 May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 27 15:04:53.986558 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f94dae15-78c2-48cc-97f6-5e6063d14769 could not be found. May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:53.991811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a7e599c5-6512-459a-92dc-c625ffacc57b tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] Returning 404 to user: Image not found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:54.004941 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a7e599c5-6512-459a-92dc-c625ffacc57b tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] 10.222.0.13 "DELETE /compute/v2.1/images/f94dae15-78c2-48cc-97f6-5e6063d14769/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.405747 May 27 15:04:54.009876 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 863/1803] 10.222.0.13 () {58 vars in 1292 bytes} [Fri May 27 15:04:53 2022] DELETE /compute/v2.1/images/f94dae15-78c2-48cc-97f6-5e6063d14769/metadata/os_distro => generated 62 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:04:54.016160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-916c953a-8aef-4944-97e7-23e7ca663819 req-64b23761-11f4-4147-9169-825ce7009fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30bdb24-7f40-43fe-8f5d-e7e601f4e039", "name": "network-vif-deleted", "tag": "bb9884c3-24dd-483c-9017-7ec4b50ceca7"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:54.025716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-916c953a-8aef-4944-97e7-23e7ca663819 req-64b23761-11f4-4147-9169-825ce7009fe3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:54.026134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-916c953a-8aef-4944-97e7-23e7ca663819 req-64b23761-11f4-4147-9169-825ce7009fe3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:54.037367 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-916c953a-8aef-4944-97e7-23e7ca663819 req-64b23761-11f4-4147-9169-825ce7009fe3 service nova] Creating event network-vif-deleted:bb9884c3-24dd-483c-9017-7ec4b50ceca7 for instance d30bdb24-7f40-43fe-8f5d-e7e601f4e039 on n-h2-843621-1 May 27 15:04:54.042681 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-916c953a-8aef-4944-97e7-23e7ca663819 req-64b23761-11f4-4147-9169-825ce7009fe3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034285 May 27 15:04:54.043864 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 864/1804] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:54.049295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-65714d6c-ab6b-46a8-8c94-4d043bef864f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:54.050015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-65714d6c-ab6b-46a8-8c94-4d043bef864f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:54.056873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65714d6c-ab6b-46a8-8c94-4d043bef864f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:54.057556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65714d6c-ab6b-46a8-8c94-4d043bef864f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:54.058532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65714d6c-ab6b-46a8-8c94-4d043bef864f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:54.059367 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65714d6c-ab6b-46a8-8c94-4d043bef864f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:54.109898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65714d6c-ab6b-46a8-8c94-4d043bef864f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:54.110566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65714d6c-ab6b-46a8-8c94-4d043bef864f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:54.111544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-65714d6c-ab6b-46a8-8c94-4d043bef864f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lazy-loading 'fault' on Instance uuid d30bdb24-7f40-43fe-8f5d-e7e601f4e039 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:04:54.120825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-29f77593-2365-44b7-a7df-ab4a56b890bc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:54.131888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-29f77593-2365-44b7-a7df-ab4a56b890bc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:54.135919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-29f77593-2365-44b7-a7df-ab4a56b890bc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:54.138569 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-29f77593-2365-44b7-a7df-ab4a56b890bc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.241815 May 27 15:04:54.141510 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 941/1805] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:53 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:54.150798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b8b56e1a-d773-486b-9b93-dad1a1dcba7a tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] Calling method '.version_select at 0x7fc7807c59d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:54.187017 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-b8b56e1a-d773-486b-9b93-dad1a1dcba7a tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] HTTP exception thrown: Image not found. May 27 15:04:54.187339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-65714d6c-ab6b-46a8-8c94-4d043bef864f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c118a948fbea4575813842ca30613064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee754951c48459888c45e9e8ec10dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b8b56e1a-d773-486b-9b93-dad1a1dcba7a tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] Request method failure captured: May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/images/b1bd7743-7429-409f-a268-e7f627ef9c2b/metadata/os_version HTTP/1.1 May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOiU8UJyszGzw7mtmlxp8hexeXI3dk6rldUv8mBUy7L9_an8J73CVafbB8LP5fCstTEzqZpZXLbZtitYiE6W9pYBoJGB14bctATLdqnLeSCXMvfHIFCqa9KDscpXmme_nHhs7VQZe06v2clhyqEm-IR3knKEylHGmxngYnhM8faW_f8 May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 136ea6d93dc344939bdcf18b56505ef4 May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-880377843 May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/136ea6d93dc344939bdcf18b56505ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/136ea6d93dc344939bdcf18b56505ef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/136ea6d93dc344939bdcf18b56505ef4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_136ea6d93dc344939bdcf18b56505ef4", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-880377843 May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 136ea6d93dc344939bdcf18b56505ef4 May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-880377843 May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ImagesMetadataNegativeTestJSON-880377843-project May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 60399485cb324fc8ac7d41a3a01febfd May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-880377843-project May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: exception: Image not found. May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'image_id': 'b1bd7743-7429-409f-a268-e7f627ef9c2b', 'id': 'os_version'} May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b1bd7743-7429-409f-a268-e7f627ef9c2b May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 27 15:04:54.194842 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b1bd7743-7429-409f-a268-e7f627ef9c2b could not be found. May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b8b56e1a-d773-486b-9b93-dad1a1dcba7a tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] Returning 404 to user: Image not found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b8b56e1a-d773-486b-9b93-dad1a1dcba7a tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] 10.222.0.13 "GET /compute/v2.1/images/b1bd7743-7429-409f-a268-e7f627ef9c2b/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.054344 May 27 15:04:54.204452 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 942/1806] 10.222.0.13 () {58 vars in 1292 bytes} [Fri May 27 15:04:54 2022] GET /compute/v2.1/images/b1bd7743-7429-409f-a268-e7f627ef9c2b/metadata/os_version => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:04:54.215705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d3745c34-4ce6-404e-9ec7-205c9584b567 tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] Calling method '.version_select at 0x7fc78081ca60>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:54.223767 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-65714d6c-ab6b-46a8-8c94-4d043bef864f tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039" status: 200 len: 1298 microversion: 2.1 time: 0.178241 May 27 15:04:54.225723 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 865/1807] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:54 2022] GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039 => generated 1298 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-d3745c34-4ce6-404e-9ec7-205c9584b567 tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] HTTP exception thrown: Image not found. May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d3745c34-4ce6-404e-9ec7-205c9584b567 tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] Request method failure captured: May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/images/50e9cc85-63da-40f9-99f2-b3a379057c14/metadata HTTP/1.1 May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOiU8UJyszGzw7mtmlxp8hexeXI3dk6rldUv8mBUy7L9_an8J73CVafbB8LP5fCstTEzqZpZXLbZtitYiE6W9pYBoJGB14bctATLdqnLeSCXMvfHIFCqa9KDscpXmme_nHhs7VQZe06v2clhyqEm-IR3knKEylHGmxngYnhM8faW_f8 May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 136ea6d93dc344939bdcf18b56505ef4 May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-880377843 May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/136ea6d93dc344939bdcf18b56505ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/136ea6d93dc344939bdcf18b56505ef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/136ea6d93dc344939bdcf18b56505ef4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_136ea6d93dc344939bdcf18b56505ef4", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-880377843 May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 136ea6d93dc344939bdcf18b56505ef4 May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-880377843 May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ImagesMetadataNegativeTestJSON-880377843-project May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 60399485cb324fc8ac7d41a3a01febfd May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-880377843-project May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: exception: Image not found. May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'image_id': '50e9cc85-63da-40f9-99f2-b3a379057c14'} May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 50e9cc85-63da-40f9-99f2-b3a379057c14 May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 27 15:04:54.273576 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 50e9cc85-63da-40f9-99f2-b3a379057c14 could not be found. May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d3745c34-4ce6-404e-9ec7-205c9584b567 tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] Returning 404 to user: Image not found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d3745c34-4ce6-404e-9ec7-205c9584b567 tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] 10.222.0.13 "GET /compute/v2.1/images/50e9cc85-63da-40f9-99f2-b3a379057c14/metadata" status: 404 len: 62 microversion: 2.1 time: 0.065294 May 27 15:04:54.281395 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 943/1808] 10.222.0.13 () {58 vars in 1259 bytes} [Fri May 27 15:04:54 2022] GET /compute/v2.1/images/50e9cc85-63da-40f9-99f2-b3a379057c14/metadata => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:04:54.294709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5b9130fd-a771-419f-af67-613ec9c2b573 tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] Action: 'update_all', calling method: .version_select at 0x7fc77737c4c0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:54.326179 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-5b9130fd-a771-419f-af67-613ec9c2b573 tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] HTTP exception thrown: Image not found. May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5b9130fd-a771-419f-af67-613ec9c2b573 tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] Request method failure captured: May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: request: PUT /compute/v2.1/images/69dcd9c0-e195-4a27-8177-70df03840dc6/metadata HTTP/1.1 May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 57 May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOiU8UJyszGzw7mtmlxp8hexeXI3dk6rldUv8mBUy7L9_an8J73CVafbB8LP5fCstTEzqZpZXLbZtitYiE6W9pYBoJGB14bctATLdqnLeSCXMvfHIFCqa9KDscpXmme_nHhs7VQZe06v2clhyqEm-IR3knKEylHGmxngYnhM8faW_f8 May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 136ea6d93dc344939bdcf18b56505ef4 May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-880377843 May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/136ea6d93dc344939bdcf18b56505ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/136ea6d93dc344939bdcf18b56505ef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/136ea6d93dc344939bdcf18b56505ef4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_136ea6d93dc344939bdcf18b56505ef4", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-880377843 May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 136ea6d93dc344939bdcf18b56505ef4 May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-880377843 May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesMetadataNegativeTestJSON-880377843-project May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 60399485cb324fc8ac7d41a3a01febfd May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-880377843-project May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: exception: Image not found. May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'image_id': '69dcd9c0-e195-4a27-8177-70df03840dc6', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 69dcd9c0-e195-4a27-8177-70df03840dc6 May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 27 15:04:54.342348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 69dcd9c0-e195-4a27-8177-70df03840dc6 could not be found. May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5b9130fd-a771-419f-af67-613ec9c2b573 tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] Returning 404 to user: Image not found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:54.350547 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5b9130fd-a771-419f-af67-613ec9c2b573 tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] 10.222.0.13 "PUT /compute/v2.1/images/69dcd9c0-e195-4a27-8177-70df03840dc6/metadata" status: 404 len: 62 microversion: 2.1 time: 0.056550 May 27 15:04:54.367535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5c1a2c27-1d37-41d5-a2b9-504963566f52 tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] Action: 'update', calling method: .version_select at 0x7fc7807c5ee0>, body: {"meta": {"os_distro": "alt"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:54.367654 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 866/1809] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:04:54 2022] PUT /compute/v2.1/images/69dcd9c0-e195-4a27-8177-70df03840dc6/metadata => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:04:54.396827 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-5c1a2c27-1d37-41d5-a2b9-504963566f52 tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] HTTP exception thrown: Image not found. May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5c1a2c27-1d37-41d5-a2b9-504963566f52 tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] Request method failure captured: May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: request: PUT /compute/v2.1/images/1aae420a-0981-42c7-9d5b-c64ad79388f5/metadata/os_distro HTTP/1.1 May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 30 May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOiU8UJyszGzw7mtmlxp8hexeXI3dk6rldUv8mBUy7L9_an8J73CVafbB8LP5fCstTEzqZpZXLbZtitYiE6W9pYBoJGB14bctATLdqnLeSCXMvfHIFCqa9KDscpXmme_nHhs7VQZe06v2clhyqEm-IR3knKEylHGmxngYnhM8faW_f8 May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 136ea6d93dc344939bdcf18b56505ef4 May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-880377843 May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/136ea6d93dc344939bdcf18b56505ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/136ea6d93dc344939bdcf18b56505ef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/136ea6d93dc344939bdcf18b56505ef4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_136ea6d93dc344939bdcf18b56505ef4", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-880377843 May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 136ea6d93dc344939bdcf18b56505ef4 May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-880377843 May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ImagesMetadataNegativeTestJSON-880377843-project May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 60399485cb324fc8ac7d41a3a01febfd May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-880377843-project May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: {"meta": {"os_distro": "alt"}} May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: exception: Image not found. May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'image_id': '1aae420a-0981-42c7-9d5b-c64ad79388f5', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1aae420a-0981-42c7-9d5b-c64ad79388f5 May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 27 15:04:54.399095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1aae420a-0981-42c7-9d5b-c64ad79388f5 could not be found. May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5c1a2c27-1d37-41d5-a2b9-504963566f52 tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] Returning 404 to user: Image not found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5c1a2c27-1d37-41d5-a2b9-504963566f52 tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] 10.222.0.13 "PUT /compute/v2.1/images/1aae420a-0981-42c7-9d5b-c64ad79388f5/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.047860 May 27 15:04:54.408058 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 944/1810] 10.222.0.13 () {60 vars in 1309 bytes} [Fri May 27 15:04:54 2022] PUT /compute/v2.1/images/1aae420a-0981-42c7-9d5b-c64ad79388f5/metadata/os_distro => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:04:54.428706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5945805b-2aea-40f1-a409-7d7070e2c71f tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] Action: 'create', calling method: .version_select at 0x7fc777289700>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:54.474127 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-5945805b-2aea-40f1-a409-7d7070e2c71f tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] HTTP exception thrown: Image not found. May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5945805b-2aea-40f1-a409-7d7070e2c71f tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] Request method failure captured: May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/images/2db277a1-aa63-4dfa-9ac3-ac58b9b874f1/metadata HTTP/1.1 May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 57 May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOiU8UJyszGzw7mtmlxp8hexeXI3dk6rldUv8mBUy7L9_an8J73CVafbB8LP5fCstTEzqZpZXLbZtitYiE6W9pYBoJGB14bctATLdqnLeSCXMvfHIFCqa9KDscpXmme_nHhs7VQZe06v2clhyqEm-IR3knKEylHGmxngYnhM8faW_f8 May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 136ea6d93dc344939bdcf18b56505ef4 May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-880377843 May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/136ea6d93dc344939bdcf18b56505ef4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/136ea6d93dc344939bdcf18b56505ef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/136ea6d93dc344939bdcf18b56505ef4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_136ea6d93dc344939bdcf18b56505ef4", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-880377843 May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 136ea6d93dc344939bdcf18b56505ef4 May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-880377843 May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesMetadataNegativeTestJSON-880377843-project May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 60399485cb324fc8ac7d41a3a01febfd May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-880377843-project May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: exception: Image not found. May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'image_id': '2db277a1-aa63-4dfa-9ac3-ac58b9b874f1', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2db277a1-aa63-4dfa-9ac3-ac58b9b874f1 May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 27 15:04:54.478728 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2db277a1-aa63-4dfa-9ac3-ac58b9b874f1 could not be found. May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:04:54.489664 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:54.504143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5945805b-2aea-40f1-a409-7d7070e2c71f tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] Returning 404 to user: Image not found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:54.504143 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5945805b-2aea-40f1-a409-7d7070e2c71f tempest-ImagesMetadataNegativeTestJSON-880377843 tempest-ImagesMetadataNegativeTestJSON-880377843-project] 10.222.0.13 "POST /compute/v2.1/images/2db277a1-aa63-4dfa-9ac3-ac58b9b874f1/metadata" status: 404 len: 62 microversion: 2.1 time: 0.084741 May 27 15:04:54.510430 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 867/1811] 10.222.0.13 () {60 vars in 1280 bytes} [Fri May 27 15:04:54 2022] POST /compute/v2.1/images/2db277a1-aa63-4dfa-9ac3-ac58b9b874f1/metadata => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:04:54.607307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-216b9dd6-8518-4892-b1ca-935be3261331 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:54.608178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-216b9dd6-8518-4892-b1ca-935be3261331 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:54.620562 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3492b0be-2f31-4f20-86da-6d95505dce7f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:54.621663 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3492b0be-2f31-4f20-86da-6d95505dce7f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:54.622892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-216b9dd6-8518-4892-b1ca-935be3261331 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:54.624819 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-216b9dd6-8518-4892-b1ca-935be3261331 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:54.626004 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-216b9dd6-8518-4892-b1ca-935be3261331 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:54.626800 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-216b9dd6-8518-4892-b1ca-935be3261331 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:54.646281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3492b0be-2f31-4f20-86da-6d95505dce7f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:54.647255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3492b0be-2f31-4f20-86da-6d95505dce7f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:54.648905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3492b0be-2f31-4f20-86da-6d95505dce7f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:54.650110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3492b0be-2f31-4f20-86da-6d95505dce7f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:55.493615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3492b0be-2f31-4f20-86da-6d95505dce7f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:55.502428 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3492b0be-2f31-4f20-86da-6d95505dce7f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1314 microversion: 2.1 time: 0.906330 May 27 15:04:55.516599 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 868/1812] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:54 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1314 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:55.522003 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0a888ae0-4156-470d-9c39-aa4e05900ace tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:55.527497 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0a888ae0-4156-470d-9c39-aa4e05900ace tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:55.547589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a888ae0-4156-470d-9c39-aa4e05900ace tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:55.548286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a888ae0-4156-470d-9c39-aa4e05900ace tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:55.549365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a888ae0-4156-470d-9c39-aa4e05900ace tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:55.550020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a888ae0-4156-470d-9c39-aa4e05900ace tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:55.747602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-216b9dd6-8518-4892-b1ca-935be3261331 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:55.775421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-216b9dd6-8518-4892-b1ca-935be3261331 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:55.782170 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-216b9dd6-8518-4892-b1ca-935be3261331 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:55.785848 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-216b9dd6-8518-4892-b1ca-935be3261331 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1873 microversion: 2.32 time: 1.189723 May 27 15:04:55.814120 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 945/1813] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:54 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1873 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:04:55.834641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-961c8a31-7b39-4adf-b8c9-2ca930b23bf8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:55.837863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-961c8a31-7b39-4adf-b8c9-2ca930b23bf8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:55.857070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-961c8a31-7b39-4adf-b8c9-2ca930b23bf8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:55.858021 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-961c8a31-7b39-4adf-b8c9-2ca930b23bf8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:55.861216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-961c8a31-7b39-4adf-b8c9-2ca930b23bf8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:55.861853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-961c8a31-7b39-4adf-b8c9-2ca930b23bf8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:56.444240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0a888ae0-4156-470d-9c39-aa4e05900ace tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:56.457956 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0a888ae0-4156-470d-9c39-aa4e05900ace tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97" status: 200 len: 1317 microversion: 2.1 time: 0.939795 May 27 15:04:56.462623 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 869/1814] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:55 2022] GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 => generated 1317 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:56.476000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-71b466c2-ae77-4f54-b2bb-e5312b17fe8c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:56.480340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-71b466c2-ae77-4f54-b2bb-e5312b17fe8c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: d30bdb24-7f40-43fe-8f5d-e7e601f4e039] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:56.501140 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71b466c2-ae77-4f54-b2bb-e5312b17fe8c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:56.502607 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71b466c2-ae77-4f54-b2bb-e5312b17fe8c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:56.503451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71b466c2-ae77-4f54-b2bb-e5312b17fe8c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:56.504073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71b466c2-ae77-4f54-b2bb-e5312b17fe8c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:56.544652 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-71b466c2-ae77-4f54-b2bb-e5312b17fe8c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] HTTP exception thrown: Instance d30bdb24-7f40-43fe-8f5d-e7e601f4e039 could not be found. May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-71b466c2-ae77-4f54-b2bb-e5312b17fe8c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Request method failure captured: May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039 HTTP/1.1 May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOekeThdeVCogF6dj7wYTadlmdkqsIR70GO0d08ee7m39zNH8hgxhXUBy4qSQ5tNThjyRRTsRzMRH9a1sdIBgwsOJVsDAG32UdEFxmmF41Be8zs5IhW1tEYXXmifuRJjqD7bllUZ5OZYxIkgYwovqgmGlGDuNU-wBhsFeuMC7AzdqB8 May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee754951c48459888c45e9e8ec10dce", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesTestJSON-601948072 May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesTestJSON-601948072-project May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: c118a948fbea4575813842ca30613064 May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesTestJSON-601948072-project May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance d30bdb24-7f40-43fe-8f5d-e7e601f4e039 could not be found. May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'd30bdb24-7f40-43fe-8f5d-e7e601f4e039'} May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d30bdb24-7f40-43fe-8f5d-e7e601f4e039 could not be found. May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d30bdb24-7f40-43fe-8f5d-e7e601f4e039 could not be found. May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:56.547672 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:56.553083 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:56.553083 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:56.553083 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:56.553083 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:56.553083 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d30bdb24-7f40-43fe-8f5d-e7e601f4e039 could not be found. May 27 15:04:56.553083 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:56.554384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-71b466c2-ae77-4f54-b2bb-e5312b17fe8c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Returning 404 to user: Instance d30bdb24-7f40-43fe-8f5d-e7e601f4e039 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:56.555460 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-71b466c2-ae77-4f54-b2bb-e5312b17fe8c tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039" status: 404 len: 111 microversion: 2.1 time: 0.089602 May 27 15:04:56.559992 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 870/1815] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:56 2022] GET /compute/v2.1/servers/d30bdb24-7f40-43fe-8f5d-e7e601f4e039 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:04:56.566097 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c020fbc7-39a3-447e-a86d-37d704bb35dc tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:56.573662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c020fbc7-39a3-447e-a86d-37d704bb35dc tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:56.589801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c020fbc7-39a3-447e-a86d-37d704bb35dc tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:56.590694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c020fbc7-39a3-447e-a86d-37d704bb35dc tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:56.591690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c020fbc7-39a3-447e-a86d-37d704bb35dc tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:56.595402 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c020fbc7-39a3-447e-a86d-37d704bb35dc tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:56.602740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-961c8a31-7b39-4adf-b8c9-2ca930b23bf8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:56.633234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-961c8a31-7b39-4adf-b8c9-2ca930b23bf8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:56.637336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-961c8a31-7b39-4adf-b8c9-2ca930b23bf8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:56.639095 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-961c8a31-7b39-4adf-b8c9-2ca930b23bf8 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.823081 May 27 15:04:56.640977 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 946/1816] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:55 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:56.651796 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-488747bf-b6b2-44fc-888d-109b4643b2e7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc78081c1f0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:56.706869 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-488747bf-b6b2-44fc-888d-109b4643b2e7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] HTTP exception thrown: Image not found. May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-488747bf-b6b2-44fc-888d-109b4643b2e7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Request method failure captured: May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb HTTP/1.1 May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOekeThdeVCogF6dj7wYTadlmdkqsIR70GO0d08ee7m39zNH8hgxhXUBy4qSQ5tNThjyRRTsRzMRH9a1sdIBgwsOJVsDAG32UdEFxmmF41Be8zs5IhW1tEYXXmifuRJjqD7bllUZ5OZYxIkgYwovqgmGlGDuNU-wBhsFeuMC7AzdqB8 May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee754951c48459888c45e9e8ec10dce", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ImagesTestJSON-601948072 May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ImagesTestJSON-601948072-project May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: c118a948fbea4575813842ca30613064 May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ImagesTestJSON-601948072-project May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: exception: Image not found. May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '98cc2538-bf87-435d-b2f7-6e3ce0e80eeb'} May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 98cc2538-bf87-435d-b2f7-6e3ce0e80eeb to delete May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 98cc2538-bf87-435d-b2f7-6e3ce0e80eeb could not be found. May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:56.711418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:04:56.716302 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:56.721714 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-488747bf-b6b2-44fc-888d-109b4643b2e7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Returning 404 to user: Image not found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:56.724800 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-488747bf-b6b2-44fc-888d-109b4643b2e7 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "DELETE /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb" status: 404 len: 62 microversion: 2.1 time: 0.081970 May 27 15:04:56.732496 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 947/1817] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:56 2022] DELETE /compute/v2.1/images/98cc2538-bf87-435d-b2f7-6e3ce0e80eeb => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:04:56.760383 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8ecfcd16-01e8-4a90-b4c8-501606ab0fce tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:56.763914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8ecfcd16-01e8-4a90-b4c8-501606ab0fce tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: fa3160e1-6021-4618-8d44-fb03c94ffe08] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:56.786958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ecfcd16-01e8-4a90-b4c8-501606ab0fce tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:56.787794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ecfcd16-01e8-4a90-b4c8-501606ab0fce tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:56.791092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ecfcd16-01e8-4a90-b4c8-501606ab0fce tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:56.794951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ecfcd16-01e8-4a90-b4c8-501606ab0fce tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:56.855985 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-8ecfcd16-01e8-4a90-b4c8-501606ab0fce tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] HTTP exception thrown: Instance fa3160e1-6021-4618-8d44-fb03c94ffe08 could not be found. May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8ecfcd16-01e8-4a90-b4c8-501606ab0fce tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Request method failure captured: May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08 HTTP/1.1 May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOekeThdeVCogF6dj7wYTadlmdkqsIR70GO0d08ee7m39zNH8hgxhXUBy4qSQ5tNThjyRRTsRzMRH9a1sdIBgwsOJVsDAG32UdEFxmmF41Be8zs5IhW1tEYXXmifuRJjqD7bllUZ5OZYxIkgYwovqgmGlGDuNU-wBhsFeuMC7AzdqB8 May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee754951c48459888c45e9e8ec10dce", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ImagesTestJSON-601948072 May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ImagesTestJSON-601948072-project May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: c118a948fbea4575813842ca30613064 May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ImagesTestJSON-601948072-project May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance fa3160e1-6021-4618-8d44-fb03c94ffe08 could not be found. May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'fa3160e1-6021-4618-8d44-fb03c94ffe08'} May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa3160e1-6021-4618-8d44-fb03c94ffe08 could not be found. May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:04:56.863359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa3160e1-6021-4618-8d44-fb03c94ffe08 could not be found. May 27 15:04:56.868421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:56.868421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:56.868421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:56.868421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:56.868421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:56.868421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:56.868421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:56.868421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:56.868421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa3160e1-6021-4618-8d44-fb03c94ffe08 could not be found. May 27 15:04:56.868421 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:56.870867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8ecfcd16-01e8-4a90-b4c8-501606ab0fce tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Returning 404 to user: Instance fa3160e1-6021-4618-8d44-fb03c94ffe08 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:56.870867 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8ecfcd16-01e8-4a90-b4c8-501606ab0fce tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08" status: 404 len: 111 microversion: 2.1 time: 0.131245 May 27 15:04:56.874082 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 948/1818] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:04:56 2022] DELETE /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:04:56.882806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6ff7cda8-6181-4f05-97e4-f522c42a1a6c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:56.885882 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6ff7cda8-6181-4f05-97e4-f522c42a1a6c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:56.905936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ff7cda8-6181-4f05-97e4-f522c42a1a6c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:56.907680 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ff7cda8-6181-4f05-97e4-f522c42a1a6c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:56.909339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ff7cda8-6181-4f05-97e4-f522c42a1a6c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:56.911209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ff7cda8-6181-4f05-97e4-f522c42a1a6c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:56.982143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c020fbc7-39a3-447e-a86d-37d704bb35dc tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:57.013139 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c020fbc7-39a3-447e-a86d-37d704bb35dc tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1314 microversion: 2.1 time: 0.445481 May 27 15:04:57.031557 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 871/1819] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:56 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:57.039466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2199c3ef-1486-4f7e-bf47-aa8a18018c19 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:57.048168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2199c3ef-1486-4f7e-bf47-aa8a18018c19 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: fa3160e1-6021-4618-8d44-fb03c94ffe08] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:57.082192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2199c3ef-1486-4f7e-bf47-aa8a18018c19 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:57.083636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2199c3ef-1486-4f7e-bf47-aa8a18018c19 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:57.090589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2199c3ef-1486-4f7e-bf47-aa8a18018c19 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:57.093121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2199c3ef-1486-4f7e-bf47-aa8a18018c19 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:57.162021 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-2199c3ef-1486-4f7e-bf47-aa8a18018c19 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] HTTP exception thrown: Instance fa3160e1-6021-4618-8d44-fb03c94ffe08 could not be found. May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2199c3ef-1486-4f7e-bf47-aa8a18018c19 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Request method failure captured: May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08 HTTP/1.1 May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOekeThdeVCogF6dj7wYTadlmdkqsIR70GO0d08ee7m39zNH8hgxhXUBy4qSQ5tNThjyRRTsRzMRH9a1sdIBgwsOJVsDAG32UdEFxmmF41Be8zs5IhW1tEYXXmifuRJjqD7bllUZ5OZYxIkgYwovqgmGlGDuNU-wBhsFeuMC7AzdqB8 May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee754951c48459888c45e9e8ec10dce", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesTestJSON-601948072 May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesTestJSON-601948072-project May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: c118a948fbea4575813842ca30613064 May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesTestJSON-601948072-project May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance fa3160e1-6021-4618-8d44-fb03c94ffe08 could not be found. May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'fa3160e1-6021-4618-8d44-fb03c94ffe08'} May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa3160e1-6021-4618-8d44-fb03c94ffe08 could not be found. May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa3160e1-6021-4618-8d44-fb03c94ffe08 could not be found. May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:57.165258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:57.178157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:57.178157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:57.178157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:57.178157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:57.178157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa3160e1-6021-4618-8d44-fb03c94ffe08 could not be found. May 27 15:04:57.178157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:57.178157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2199c3ef-1486-4f7e-bf47-aa8a18018c19 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Returning 404 to user: Instance fa3160e1-6021-4618-8d44-fb03c94ffe08 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:57.178157 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2199c3ef-1486-4f7e-bf47-aa8a18018c19 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08" status: 404 len: 111 microversion: 2.1 time: 0.141641 May 27 15:04:57.178157 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 872/1820] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:57 2022] GET /compute/v2.1/servers/fa3160e1-6021-4618-8d44-fb03c94ffe08 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:04:57.182994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-eb37067d-efa8-422f-9007-ebc45f6d13be req-3d13a054-2150-49de-895a-0a47b7f0d7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "name": "network-vif-plugged", "status": "completed", "tag": "71fcf64b-5a54-42bd-a04e-812ea701d6ba"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:57.194376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-eb37067d-efa8-422f-9007-ebc45f6d13be req-3d13a054-2150-49de-895a-0a47b7f0d7e6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:57.195168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-eb37067d-efa8-422f-9007-ebc45f6d13be req-3d13a054-2150-49de-895a-0a47b7f0d7e6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:57.224613 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-eb37067d-efa8-422f-9007-ebc45f6d13be req-3d13a054-2150-49de-895a-0a47b7f0d7e6 service nova] Creating event network-vif-plugged:71fcf64b-5a54-42bd-a04e-812ea701d6ba for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:04:57.237926 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-eb37067d-efa8-422f-9007-ebc45f6d13be req-3d13a054-2150-49de-895a-0a47b7f0d7e6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064904 May 27 15:04:57.240930 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 873/1821] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:04:57.253663 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a45a450f-7535-4f21-a2cc-4c39a6b26ba2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc77716aca0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:57.302675 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-a45a450f-7535-4f21-a2cc-4c39a6b26ba2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] HTTP exception thrown: Image not found. May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a45a450f-7535-4f21-a2cc-4c39a6b26ba2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Request method failure captured: May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984 HTTP/1.1 May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOekeThdeVCogF6dj7wYTadlmdkqsIR70GO0d08ee7m39zNH8hgxhXUBy4qSQ5tNThjyRRTsRzMRH9a1sdIBgwsOJVsDAG32UdEFxmmF41Be8zs5IhW1tEYXXmifuRJjqD7bllUZ5OZYxIkgYwovqgmGlGDuNU-wBhsFeuMC7AzdqB8 May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee754951c48459888c45e9e8ec10dce", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesTestJSON-601948072 May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesTestJSON-601948072-project May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: c118a948fbea4575813842ca30613064 May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesTestJSON-601948072-project May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: exception: Image not found. May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '2f11eec7-a88f-4a96-b454-abbe8a14a984'} May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2f11eec7-a88f-4a96-b454-abbe8a14a984 to delete May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2f11eec7-a88f-4a96-b454-abbe8a14a984 could not be found. May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:57.305929 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a45a450f-7535-4f21-a2cc-4c39a6b26ba2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Returning 404 to user: Image not found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a45a450f-7535-4f21-a2cc-4c39a6b26ba2 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "DELETE /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984" status: 404 len: 62 microversion: 2.1 time: 0.064690 May 27 15:04:57.321833 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 874/1822] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:57 2022] DELETE /compute/v2.1/images/2f11eec7-a88f-4a96-b454-abbe8a14a984 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:04:57.573733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6ff7cda8-6181-4f05-97e4-f522c42a1a6c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:57.603268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6ff7cda8-6181-4f05-97e4-f522c42a1a6c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:57.608713 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6ff7cda8-6181-4f05-97e4-f522c42a1a6c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:57.617445 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6ff7cda8-6181-4f05-97e4-f522c42a1a6c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1873 microversion: 2.32 time: 0.741693 May 27 15:04:57.620816 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 949/1823] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:56 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1873 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:57.633014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-605b16c6-ed23-47df-86b1-59f77e63f9dd tempest-ListImageFiltersNegativeTestJSON-1517982116 tempest-ListImageFiltersNegativeTestJSON-1517982116-project] Calling method '.version_select at 0x7fc776ca5700>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:57.642243 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-73f3e5d7-aa82-4696-bbbc-129e22d65be9 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:57.643135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-73f3e5d7-aa82-4696-bbbc-129e22d65be9 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:57.650566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73f3e5d7-aa82-4696-bbbc-129e22d65be9 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:57.650955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73f3e5d7-aa82-4696-bbbc-129e22d65be9 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:57.652561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73f3e5d7-aa82-4696-bbbc-129e22d65be9 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:57.653471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73f3e5d7-aa82-4696-bbbc-129e22d65be9 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:57.674918 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-605b16c6-ed23-47df-86b1-59f77e63f9dd tempest-ListImageFiltersNegativeTestJSON-1517982116 tempest-ListImageFiltersNegativeTestJSON-1517982116-project] HTTP exception thrown: Image not found. May 27 15:04:57.678598 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-73f3e5d7-aa82-4696-bbbc-129e22d65be9 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] HTTP exception thrown: Instance a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 could not be found. May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-73f3e5d7-aa82-4696-bbbc-129e22d65be9 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Request method failure captured: May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 HTTP/1.1 May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOekeThdeVCogF6dj7wYTadlmdkqsIR70GO0d08ee7m39zNH8hgxhXUBy4qSQ5tNThjyRRTsRzMRH9a1sdIBgwsOJVsDAG32UdEFxmmF41Be8zs5IhW1tEYXXmifuRJjqD7bllUZ5OZYxIkgYwovqgmGlGDuNU-wBhsFeuMC7AzdqB8 May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee754951c48459888c45e9e8ec10dce", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ImagesTestJSON-601948072 May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ImagesTestJSON-601948072-project May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: c118a948fbea4575813842ca30613064 May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ImagesTestJSON-601948072-project May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 could not be found. May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'a72bd3cf-9b54-4d56-ab10-9f2a602a15f5'} May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 could not be found. May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:04:57.680952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 could not be found. May 27 15:04:57.689875 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:57.689875 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:57.689875 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:57.689875 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:57.689875 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:57.689875 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:57.689875 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:57.689875 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:57.689875 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 could not be found. May 27 15:04:57.689875 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-605b16c6-ed23-47df-86b1-59f77e63f9dd tempest-ListImageFiltersNegativeTestJSON-1517982116 tempest-ListImageFiltersNegativeTestJSON-1517982116-project] Request method failure captured: May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/images/d349421a-3556-4113-9e51-8029594590fd HTTP/1.1 May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOiZpsGeybNhp8DhmCDPR8Arl08_5-NCu5sCcWcbIekPoLnNWuSfsTBjmyjVCsQmZY6_5aL7TZwBOMjozg213IcqWSAOGYa4yQPCw5u1sJg6uz3KGTmC4CSPgqanClfIc49JimJrOgabC2MZF-cIrXBfHhlTVEjIwxakURKaMfcfgx0 May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: a55780e5d0064b66aa3976aa40f4f2ae May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1517982116 May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a55780e5d0064b66aa3976aa40f4f2ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a55780e5d0064b66aa3976aa40f4f2ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a55780e5d0064b66aa3976aa40f4f2ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a55780e5d0064b66aa3976aa40f4f2ae", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1517982116 May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: a55780e5d0064b66aa3976aa40f4f2ae May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1517982116 May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ListImageFiltersNegativeTestJSON-1517982116-project May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 64b52bead50e48c99510e2a1b39e44c5 May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1517982116-project May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: exception: Image not found. May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'd349421a-3556-4113-9e51-8029594590fd'} May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d349421a-3556-4113-9e51-8029594590fd May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 27 15:04:57.691630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d349421a-3556-4113-9e51-8029594590fd could not be found. May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-605b16c6-ed23-47df-86b1-59f77e63f9dd tempest-ListImageFiltersNegativeTestJSON-1517982116 tempest-ListImageFiltersNegativeTestJSON-1517982116-project] Returning 404 to user: Image not found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-605b16c6-ed23-47df-86b1-59f77e63f9dd tempest-ListImageFiltersNegativeTestJSON-1517982116 tempest-ListImageFiltersNegativeTestJSON-1517982116-project] 10.222.0.13 "GET /compute/v2.1/images/d349421a-3556-4113-9e51-8029594590fd" status: 404 len: 62 microversion: 2.1 time: 0.375081 May 27 15:04:57.704347 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 875/1824] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:04:57 2022] GET /compute/v2.1/images/d349421a-3556-4113-9e51-8029594590fd => generated 62 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:04:57.714275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-73f3e5d7-aa82-4696-bbbc-129e22d65be9 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Returning 404 to user: Instance a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:57.716166 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-73f3e5d7-aa82-4696-bbbc-129e22d65be9 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 404 len: 111 microversion: 2.1 time: 0.081223 May 27 15:04:57.721145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-238be629-095f-4fd2-87bb-4fe04d0ad2e9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:57.722839 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 950/1825] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:04:57 2022] DELETE /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:04:57.725254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-238be629-095f-4fd2-87bb-4fe04d0ad2e9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:57.734121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-47dbd55b-abca-41e7-888d-53b92841b310 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:57.735924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-47dbd55b-abca-41e7-888d-53b92841b310 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:57.741402 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-238be629-095f-4fd2-87bb-4fe04d0ad2e9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:57.742462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-238be629-095f-4fd2-87bb-4fe04d0ad2e9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:57.745884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-238be629-095f-4fd2-87bb-4fe04d0ad2e9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:57.747035 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-238be629-095f-4fd2-87bb-4fe04d0ad2e9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:57.750163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47dbd55b-abca-41e7-888d-53b92841b310 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:57.752250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47dbd55b-abca-41e7-888d-53b92841b310 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:57.755249 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47dbd55b-abca-41e7-888d-53b92841b310 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:57.756316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47dbd55b-abca-41e7-888d-53b92841b310 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:58.192246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-238be629-095f-4fd2-87bb-4fe04d0ad2e9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:58.203540 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-238be629-095f-4fd2-87bb-4fe04d0ad2e9 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97" status: 200 len: 1317 microversion: 2.1 time: 0.497254 May 27 15:04:58.205811 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 876/1826] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:57 2022] GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:58.226621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-67c40574-3d38-4fcd-8f09-cbdd9e75c1d1 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:58.228247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-67c40574-3d38-4fcd-8f09-cbdd9e75c1d1 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: a72bd3cf-9b54-4d56-ab10-9f2a602a15f5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:58.245883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-47dbd55b-abca-41e7-888d-53b92841b310 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:58.253535 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67c40574-3d38-4fcd-8f09-cbdd9e75c1d1 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:58.256972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67c40574-3d38-4fcd-8f09-cbdd9e75c1d1 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:58.260815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67c40574-3d38-4fcd-8f09-cbdd9e75c1d1 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:58.263246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67c40574-3d38-4fcd-8f09-cbdd9e75c1d1 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:58.292439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-47dbd55b-abca-41e7-888d-53b92841b310 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:58.297062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-47dbd55b-abca-41e7-888d-53b92841b310 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:58.304602 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-47dbd55b-abca-41e7-888d-53b92841b310 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.578314 May 27 15:04:58.307598 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 951/1827] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:57 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:58.332851 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bd92a4f4-2f4e-4cab-841c-3bb95242490f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:58.335227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bd92a4f4-2f4e-4cab-841c-3bb95242490f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:58.352968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd92a4f4-2f4e-4cab-841c-3bb95242490f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:58.355818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd92a4f4-2f4e-4cab-841c-3bb95242490f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:58.359146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd92a4f4-2f4e-4cab-841c-3bb95242490f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:58.364501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd92a4f4-2f4e-4cab-841c-3bb95242490f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:58.377401 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-67c40574-3d38-4fcd-8f09-cbdd9e75c1d1 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] HTTP exception thrown: Instance a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 could not be found. May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-67c40574-3d38-4fcd-8f09-cbdd9e75c1d1 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Request method failure captured: May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 HTTP/1.1 May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOekeThdeVCogF6dj7wYTadlmdkqsIR70GO0d08ee7m39zNH8hgxhXUBy4qSQ5tNThjyRRTsRzMRH9a1sdIBgwsOJVsDAG32UdEFxmmF41Be8zs5IhW1tEYXXmifuRJjqD7bllUZ5OZYxIkgYwovqgmGlGDuNU-wBhsFeuMC7AzdqB8 May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee754951c48459888c45e9e8ec10dce", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesTestJSON-601948072 May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesTestJSON-601948072-project May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: c118a948fbea4575813842ca30613064 May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesTestJSON-601948072-project May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 could not be found. May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'a72bd3cf-9b54-4d56-ab10-9f2a602a15f5'} May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 could not be found. May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 could not be found. May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:58.385108 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:58.392318 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:58.392318 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:58.392318 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:58.392318 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:58.392318 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 could not be found. May 27 15:04:58.392318 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:58.396095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-67c40574-3d38-4fcd-8f09-cbdd9e75c1d1 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Returning 404 to user: Instance a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:58.398375 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-67c40574-3d38-4fcd-8f09-cbdd9e75c1d1 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5" status: 404 len: 111 microversion: 2.1 time: 0.190784 May 27 15:04:58.398941 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 877/1828] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:58 2022] GET /compute/v2.1/servers/a72bd3cf-9b54-4d56-ab10-9f2a602a15f5 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:04:58.422704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-edc322e7-00a2-4611-b6ad-d520d335818b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '.version_select at 0x7fc7772ae940>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:58.513832 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-edc322e7-00a2-4611-b6ad-d520d335818b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] HTTP exception thrown: Image not found. May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-edc322e7-00a2-4611-b6ad-d520d335818b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Request method failure captured: May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f HTTP/1.1 May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOekeThdeVCogF6dj7wYTadlmdkqsIR70GO0d08ee7m39zNH8hgxhXUBy4qSQ5tNThjyRRTsRzMRH9a1sdIBgwsOJVsDAG32UdEFxmmF41Be8zs5IhW1tEYXXmifuRJjqD7bllUZ5OZYxIkgYwovqgmGlGDuNU-wBhsFeuMC7AzdqB8 May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee754951c48459888c45e9e8ec10dce", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesTestJSON-601948072 May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesTestJSON-601948072-project May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: c118a948fbea4575813842ca30613064 May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesTestJSON-601948072-project May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: exception: Image not found. May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '5be9bdda-05d7-4d27-963e-635400664d5f'} May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5be9bdda-05d7-4d27-963e-635400664d5f to delete May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5be9bdda-05d7-4d27-963e-635400664d5f could not be found. May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:58.516142 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-edc322e7-00a2-4611-b6ad-d520d335818b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Returning 404 to user: Image not found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:58.521392 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-edc322e7-00a2-4611-b6ad-d520d335818b tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "DELETE /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f" status: 404 len: 62 microversion: 2.1 time: 0.114218 May 27 15:04:58.524067 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 878/1829] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:58 2022] DELETE /compute/v2.1/images/5be9bdda-05d7-4d27-963e-635400664d5f => generated 62 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:04:58.551665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-98332528-e9f8-445b-99bd-35a835a63b45 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:58.553322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-98332528-e9f8-445b-99bd-35a835a63b45 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:58.584726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98332528-e9f8-445b-99bd-35a835a63b45 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:58.588464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98332528-e9f8-445b-99bd-35a835a63b45 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:58.590445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98332528-e9f8-445b-99bd-35a835a63b45 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:58.594623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98332528-e9f8-445b-99bd-35a835a63b45 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:58.636852 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-98332528-e9f8-445b-99bd-35a835a63b45 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] HTTP exception thrown: Instance bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 could not be found. May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-98332528-e9f8-445b-99bd-35a835a63b45 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Request method failure captured: May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 HTTP/1.1 May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOekeThdeVCogF6dj7wYTadlmdkqsIR70GO0d08ee7m39zNH8hgxhXUBy4qSQ5tNThjyRRTsRzMRH9a1sdIBgwsOJVsDAG32UdEFxmmF41Be8zs5IhW1tEYXXmifuRJjqD7bllUZ5OZYxIkgYwovqgmGlGDuNU-wBhsFeuMC7AzdqB8 May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee754951c48459888c45e9e8ec10dce", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesTestJSON-601948072 May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesTestJSON-601948072-project May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: c118a948fbea4575813842ca30613064 May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesTestJSON-601948072-project May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 could not be found. May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25'} May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 could not be found. May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:04:58.646549 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 could not be found. May 27 15:04:58.652173 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:58.652173 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:58.652173 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:58.652173 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:58.652173 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:58.652173 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:58.652173 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:58.652173 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:58.652173 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 could not be found. May 27 15:04:58.652173 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:04:58.657214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-98332528-e9f8-445b-99bd-35a835a63b45 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Returning 404 to user: Instance bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:58.659095 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-98332528-e9f8-445b-99bd-35a835a63b45 tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25" status: 404 len: 111 microversion: 2.1 time: 0.132624 May 27 15:04:58.661430 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 879/1830] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:04:58 2022] DELETE /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:04:58.673066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-27f35fae-0fbe-4bbd-8aa6-f383e5fbf053 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:58.674013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-27f35fae-0fbe-4bbd-8aa6-f383e5fbf053 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:58.698599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-27f35fae-0fbe-4bbd-8aa6-f383e5fbf053 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:58.699482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-27f35fae-0fbe-4bbd-8aa6-f383e5fbf053 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:58.705786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-27f35fae-0fbe-4bbd-8aa6-f383e5fbf053 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:58.707849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-27f35fae-0fbe-4bbd-8aa6-f383e5fbf053 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:58.724102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bd92a4f4-2f4e-4cab-841c-3bb95242490f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:58.744607 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bd92a4f4-2f4e-4cab-841c-3bb95242490f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1314 microversion: 2.1 time: 0.430938 May 27 15:04:58.747290 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 952/1831] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:58 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:58.761867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e56b779-e589-410a-9163-7eced38dd3be tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:58.770272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e56b779-e589-410a-9163-7eced38dd3be tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] [instance: bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:58.791053 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e56b779-e589-410a-9163-7eced38dd3be tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:58.792173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e56b779-e589-410a-9163-7eced38dd3be tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:58.798387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e56b779-e589-410a-9163-7eced38dd3be tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:58.800418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e56b779-e589-410a-9163-7eced38dd3be tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:58.835624 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-0e56b779-e589-410a-9163-7eced38dd3be tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] HTTP exception thrown: Instance bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 could not be found. May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e56b779-e589-410a-9163-7eced38dd3be tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Request method failure captured: May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 HTTP/1.1 May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOekeThdeVCogF6dj7wYTadlmdkqsIR70GO0d08ee7m39zNH8hgxhXUBy4qSQ5tNThjyRRTsRzMRH9a1sdIBgwsOJVsDAG32UdEFxmmF41Be8zs5IhW1tEYXXmifuRJjqD7bllUZ5OZYxIkgYwovqgmGlGDuNU-wBhsFeuMC7AzdqB8 May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ee754951c48459888c45e9e8ec10dce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ee754951c48459888c45e9e8ec10dce", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ImagesTestJSON-601948072 May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 1ee754951c48459888c45e9e8ec10dce May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ImagesTestJSON-601948072 May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ImagesTestJSON-601948072-project May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: c118a948fbea4575813842ca30613064 May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ImagesTestJSON-601948072-project May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 could not be found. May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25'} May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 could not be found. May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 could not be found. May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:58.838798 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:04:58.844026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:04:58.844026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:04:58.844026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:04:58.844026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:04:58.844026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 could not be found. May 27 15:04:58.844026 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:04:58.844026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e56b779-e589-410a-9163-7eced38dd3be tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] Returning 404 to user: Instance bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:04:58.844026 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e56b779-e589-410a-9163-7eced38dd3be tempest-ImagesTestJSON-601948072 tempest-ImagesTestJSON-601948072-project] 10.222.0.13 "GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25" status: 404 len: 111 microversion: 2.1 time: 0.090725 May 27 15:04:58.844026 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 953/1832] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:58 2022] GET /compute/v2.1/servers/bf3193ca-7dcb-42f0-ba1c-a4e7b40c3a25 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:04:59.151881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-27f35fae-0fbe-4bbd-8aa6-f383e5fbf053 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:59.174642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-27f35fae-0fbe-4bbd-8aa6-f383e5fbf053 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:59.177863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-27f35fae-0fbe-4bbd-8aa6-f383e5fbf053 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:59.180369 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-27f35fae-0fbe-4bbd-8aa6-f383e5fbf053 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1873 microversion: 2.32 time: 0.517534 May 27 15:04:59.181295 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 880/1833] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:58 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1873 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:59.238209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e3277eb6-7d79-4c65-9e71-8607a7fc4b8c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:59.238940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e3277eb6-7d79-4c65-9e71-8607a7fc4b8c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:59.252905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3277eb6-7d79-4c65-9e71-8607a7fc4b8c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:59.253641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3277eb6-7d79-4c65-9e71-8607a7fc4b8c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:59.254407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3277eb6-7d79-4c65-9e71-8607a7fc4b8c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:59.278221 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3277eb6-7d79-4c65-9e71-8607a7fc4b8c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:59.281445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-0e19f6f8-f82d-4b89-bc51-5b9df74bb435 req-a7dfcaf1-2709-4b98-997c-f70fe9590ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc92f950-a316-4536-b69c-fd6900c98f97", "name": "network-vif-plugged", "status": "completed", "tag": "8c191ad1-df28-4fa7-8018-135517279560"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:04:59.300556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0e19f6f8-f82d-4b89-bc51-5b9df74bb435 req-a7dfcaf1-2709-4b98-997c-f70fe9590ba1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:59.301895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0e19f6f8-f82d-4b89-bc51-5b9df74bb435 req-a7dfcaf1-2709-4b98-997c-f70fe9590ba1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:59.344096 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-0e19f6f8-f82d-4b89-bc51-5b9df74bb435 req-a7dfcaf1-2709-4b98-997c-f70fe9590ba1 service nova] Creating event network-vif-plugged:8c191ad1-df28-4fa7-8018-135517279560 for instance fc92f950-a316-4536-b69c-fd6900c98f97 on n-h2-843621-1 May 27 15:04:59.370790 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-0e19f6f8-f82d-4b89-bc51-5b9df74bb435 req-a7dfcaf1-2709-4b98-997c-f70fe9590ba1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098453 May 27 15:04:59.375363 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 881/1834] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:04:59.398803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7ad58b3d-a4db-421b-b2f0-19f6a62b835f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:59.402990 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7ad58b3d-a4db-421b-b2f0-19f6a62b835f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:59.412523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ad58b3d-a4db-421b-b2f0-19f6a62b835f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:59.413355 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ad58b3d-a4db-421b-b2f0-19f6a62b835f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:59.414348 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ad58b3d-a4db-421b-b2f0-19f6a62b835f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:59.415135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ad58b3d-a4db-421b-b2f0-19f6a62b835f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:59.917909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e3277eb6-7d79-4c65-9e71-8607a7fc4b8c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:59.925496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7ad58b3d-a4db-421b-b2f0-19f6a62b835f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:59.940836 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e3277eb6-7d79-4c65-9e71-8607a7fc4b8c tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97" status: 200 len: 1317 microversion: 2.1 time: 0.705318 May 27 15:04:59.943320 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7ad58b3d-a4db-421b-b2f0-19f6a62b835f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:59.945697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7ad58b3d-a4db-421b-b2f0-19f6a62b835f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:04:59.950239 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7ad58b3d-a4db-421b-b2f0-19f6a62b835f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.571841 May 27 15:04:59.951812 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 954/1835] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:59 2022] GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 => generated 1317 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:04:59.955710 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 882/1836] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:04:59 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:04:59.961878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8b5093e3-6ebb-4cd6-88fa-90d53526e57d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:04:59.962861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8b5093e3-6ebb-4cd6-88fa-90d53526e57d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:04:59.975094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b5093e3-6ebb-4cd6-88fa-90d53526e57d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:59.975841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b5093e3-6ebb-4cd6-88fa-90d53526e57d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:04:59.976963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b5093e3-6ebb-4cd6-88fa-90d53526e57d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:04:59.977633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b5093e3-6ebb-4cd6-88fa-90d53526e57d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:00.214238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-61358907-c614-45e9-be6c-3b96d5ed560a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:00.215111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-61358907-c614-45e9-be6c-3b96d5ed560a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:00.230845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-61358907-c614-45e9-be6c-3b96d5ed560a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:00.232186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-61358907-c614-45e9-be6c-3b96d5ed560a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:00.233899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8b5093e3-6ebb-4cd6-88fa-90d53526e57d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:00.234849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-61358907-c614-45e9-be6c-3b96d5ed560a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:00.235660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-61358907-c614-45e9-be6c-3b96d5ed560a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:00.245671 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8b5093e3-6ebb-4cd6-88fa-90d53526e57d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1314 microversion: 2.1 time: 0.291898 May 27 15:05:00.249976 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 955/1837] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:04:59 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:00.676419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-61358907-c614-45e9-be6c-3b96d5ed560a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:00.696377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-61358907-c614-45e9-be6c-3b96d5ed560a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:00.701325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-61358907-c614-45e9-be6c-3b96d5ed560a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:00.703867 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-61358907-c614-45e9-be6c-3b96d5ed560a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1873 microversion: 2.32 time: 0.494514 May 27 15:05:00.708133 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 883/1838] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:00 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1873 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:05:00.977092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-effc4c74-9819-4b3c-be02-fa8ce3e28956 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:00.978217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-effc4c74-9819-4b3c-be02-fa8ce3e28956 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:00.981778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-63c4e832-409c-4cc6-a3f4-7ec9cfb90084 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:00.982938 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-63c4e832-409c-4cc6-a3f4-7ec9cfb90084 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:00.994693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-effc4c74-9819-4b3c-be02-fa8ce3e28956 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:00.996105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-effc4c74-9819-4b3c-be02-fa8ce3e28956 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:00.998399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-effc4c74-9819-4b3c-be02-fa8ce3e28956 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:00.999364 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-effc4c74-9819-4b3c-be02-fa8ce3e28956 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:01.023840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63c4e832-409c-4cc6-a3f4-7ec9cfb90084 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:01.024701 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63c4e832-409c-4cc6-a3f4-7ec9cfb90084 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:01.026269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63c4e832-409c-4cc6-a3f4-7ec9cfb90084 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:01.029878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63c4e832-409c-4cc6-a3f4-7ec9cfb90084 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:01.384472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-effc4c74-9819-4b3c-be02-fa8ce3e28956 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:01.413681 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-effc4c74-9819-4b3c-be02-fa8ce3e28956 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:01.425236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-effc4c74-9819-4b3c-be02-fa8ce3e28956 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:01.427106 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-effc4c74-9819-4b3c-be02-fa8ce3e28956 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.457069 May 27 15:05:01.440579 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 884/1839] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:00 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:01.484105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4d7bf18d-f08f-418d-81ef-959d35658dff tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:01.486863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4d7bf18d-f08f-418d-81ef-959d35658dff tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:01.509149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4d7bf18d-f08f-418d-81ef-959d35658dff tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:01.511908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4d7bf18d-f08f-418d-81ef-959d35658dff tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:01.515774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4d7bf18d-f08f-418d-81ef-959d35658dff tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:01.516909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4d7bf18d-f08f-418d-81ef-959d35658dff tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:01.575537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-63c4e832-409c-4cc6-a3f4-7ec9cfb90084 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:01.603090 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-63c4e832-409c-4cc6-a3f4-7ec9cfb90084 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97" status: 200 len: 1317 microversion: 2.1 time: 0.646174 May 27 15:05:01.604592 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 956/1840] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:00 2022] GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 => generated 1317 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:01.907580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4d7bf18d-f08f-418d-81ef-959d35658dff tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:01.920409 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4d7bf18d-f08f-418d-81ef-959d35658dff tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1314 microversion: 2.1 time: 0.488229 May 27 15:05:01.923745 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 885/1841] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:01 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:01.930138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-53c8d5a5-3d40-47d2-bb2c-ec1c3dc6de47 req-01461b6c-0162-4cd1-b341-ec7a679f8331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccb6575b-6908-43ae-989f-1bdfcc5f5c63", "name": "network-vif-plugged", "status": "completed", "tag": "4e0cf72f-d286-4fec-b5c7-e5289e6ed198"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:01.958564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-53c8d5a5-3d40-47d2-bb2c-ec1c3dc6de47 req-01461b6c-0162-4cd1-b341-ec7a679f8331 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:01.962494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-53c8d5a5-3d40-47d2-bb2c-ec1c3dc6de47 req-01461b6c-0162-4cd1-b341-ec7a679f8331 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:02.006735 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-53c8d5a5-3d40-47d2-bb2c-ec1c3dc6de47 req-01461b6c-0162-4cd1-b341-ec7a679f8331 service nova] Creating event network-vif-plugged:4e0cf72f-d286-4fec-b5c7-e5289e6ed198 for instance ccb6575b-6908-43ae-989f-1bdfcc5f5c63 on n-h1-843621-1 May 27 15:05:02.022267 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-53c8d5a5-3d40-47d2-bb2c-ec1c3dc6de47 req-01461b6c-0162-4cd1-b341-ec7a679f8331 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096700 May 27 15:05:02.023435 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 886/1842] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:02.038435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cd5e460c-69e6-4b19-8e52-0bef6b9f8685 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:02.039497 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cd5e460c-69e6-4b19-8e52-0bef6b9f8685 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:02.048430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cd5e460c-69e6-4b19-8e52-0bef6b9f8685 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:02.053301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cd5e460c-69e6-4b19-8e52-0bef6b9f8685 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:02.054447 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cd5e460c-69e6-4b19-8e52-0bef6b9f8685 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:02.055134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cd5e460c-69e6-4b19-8e52-0bef6b9f8685 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:02.071208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:02.198827 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a67b3299-8508-4509-9239-2f19d54692fb tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] 10.222.0.13 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.574944 May 27 15:05:02.199616 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 957/1843] 10.222.0.13 () {58 vars in 1127 bytes} [Fri May 27 15:05:01 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 576 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 15:05:02.209852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c917cd42-d78c-417d-bfe6-bc0d63f35e71 tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] Calling method '.version_select at 0x7fc78081cf70>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:02.257906 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-c917cd42-d78c-417d-bfe6-bc0d63f35e71 tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] HTTP exception thrown: Image not found. May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c917cd42-d78c-417d-bfe6-bc0d63f35e71 tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] Request method failure captured: May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOidaANuaMIbUESy1NzojlEqrs8o0zTpyCfL-xvHnujfI-mn7IJYBM-yWG2jx9K5xHt_F3QC0uu1Cd9bg8eBMuPsmssrlE6_3xVDe54kkOp38RvCa34wYjxSqqBxg22XZdIcEnS-B7pG7_Y3lNAP-6xhGvFvuW3Dh1HQKjf6BedayhE May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: f7d265a016e34135b5f046eb5525f110 May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1237650491 May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f7d265a016e34135b5f046eb5525f110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f7d265a016e34135b5f046eb5525f110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f7d265a016e34135b5f046eb5525f110"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f7d265a016e34135b5f046eb5525f110", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1237650491 May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: f7d265a016e34135b5f046eb5525f110 May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1237650491 May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ImagesDeleteNegativeTestJSON-1237650491-project May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 6bc7233dead546feb521ba0c97cc7bbd May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1237650491-project May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: exception: Image not found. May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '-1'} May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.263501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:05:02.268886 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.275496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c917cd42-d78c-417d-bfe6-bc0d63f35e71 tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] Returning 404 to user: Image not found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:02.281777 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c917cd42-d78c-417d-bfe6-bc0d63f35e71 tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] 10.222.0.13 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.074290 May 27 15:05:02.291002 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 958/1844] 10.222.0.13 () {58 vars in 1133 bytes} [Fri May 27 15:05:02 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 27 15:05:02.312200 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3a0eb4b7-861b-47b4-b817-af17a5d07e58 tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] Calling method '.version_select at 0x7fc78084daf0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:02.360907 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-3a0eb4b7-861b-47b4-b817-af17a5d07e58 tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] HTTP exception thrown: Image not found. May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3a0eb4b7-861b-47b4-b817-af17a5d07e58 tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] Request method failure captured: May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/images/36b49813-96cc-475f-b893-e0e49198077j HTTP/1.1 May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOidaANuaMIbUESy1NzojlEqrs8o0zTpyCfL-xvHnujfI-mn7IJYBM-yWG2jx9K5xHt_F3QC0uu1Cd9bg8eBMuPsmssrlE6_3xVDe54kkOp38RvCa34wYjxSqqBxg22XZdIcEnS-B7pG7_Y3lNAP-6xhGvFvuW3Dh1HQKjf6BedayhE May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: f7d265a016e34135b5f046eb5525f110 May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1237650491 May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f7d265a016e34135b5f046eb5525f110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f7d265a016e34135b5f046eb5525f110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f7d265a016e34135b5f046eb5525f110"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f7d265a016e34135b5f046eb5525f110", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1237650491 May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: f7d265a016e34135b5f046eb5525f110 May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1237650491 May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ImagesDeleteNegativeTestJSON-1237650491-project May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 6bc7233dead546feb521ba0c97cc7bbd May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1237650491-project May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: exception: Image not found. May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '36b49813-96cc-475f-b893-e0e49198077j'} May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 36b49813-96cc-475f-b893-e0e49198077j to delete May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 36b49813-96cc-475f-b893-e0e49198077j could not be found. May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:02.363620 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:05:02.369952 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.374783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3a0eb4b7-861b-47b4-b817-af17a5d07e58 tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] Returning 404 to user: Image not found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:02.375929 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3a0eb4b7-861b-47b4-b817-af17a5d07e58 tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] 10.222.0.13 "DELETE /compute/v2.1/images/36b49813-96cc-475f-b893-e0e49198077j" status: 404 len: 62 microversion: 2.1 time: 0.079619 May 27 15:05:02.381897 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 959/1845] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:02 2022] DELETE /compute/v2.1/images/36b49813-96cc-475f-b893-e0e49198077j => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:05:02.400137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-af764cfd-226e-4d44-924f-cffb6e6c6a4d tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] Calling method '.version_select at 0x7fc78081c310>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:02.421079 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-af764cfd-226e-4d44-924f-cffb6e6c6a4d tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] HTTP exception thrown: Image not found. May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-af764cfd-226e-4d44-924f-cffb6e6c6a4d tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] Request method failure captured: May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/images/ba9715e8-eb92-481e-87b7-0b1aa40a285c1 HTTP/1.1 May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOidaANuaMIbUESy1NzojlEqrs8o0zTpyCfL-xvHnujfI-mn7IJYBM-yWG2jx9K5xHt_F3QC0uu1Cd9bg8eBMuPsmssrlE6_3xVDe54kkOp38RvCa34wYjxSqqBxg22XZdIcEnS-B7pG7_Y3lNAP-6xhGvFvuW3Dh1HQKjf6BedayhE May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: f7d265a016e34135b5f046eb5525f110 May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1237650491 May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f7d265a016e34135b5f046eb5525f110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f7d265a016e34135b5f046eb5525f110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f7d265a016e34135b5f046eb5525f110"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f7d265a016e34135b5f046eb5525f110", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1237650491 May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: f7d265a016e34135b5f046eb5525f110 May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1237650491 May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ImagesDeleteNegativeTestJSON-1237650491-project May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 6bc7233dead546feb521ba0c97cc7bbd May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1237650491-project May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: exception: Image not found. May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'ba9715e8-eb92-481e-87b7-0b1aa40a285c1'} May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ba9715e8-eb92-481e-87b7-0b1aa40a285c1 to delete May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ba9715e8-eb92-481e-87b7-0b1aa40a285c1 could not be found. May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:02.439629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:05:02.446056 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.451032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-af764cfd-226e-4d44-924f-cffb6e6c6a4d tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] Returning 404 to user: Image not found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:02.454371 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-af764cfd-226e-4d44-924f-cffb6e6c6a4d tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] 10.222.0.13 "DELETE /compute/v2.1/images/ba9715e8-eb92-481e-87b7-0b1aa40a285c1" status: 404 len: 62 microversion: 2.1 time: 0.070408 May 27 15:05:02.455984 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 960/1846] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:05:02 2022] DELETE /compute/v2.1/images/ba9715e8-eb92-481e-87b7-0b1aa40a285c1 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:05:02.489984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c8b9cc2f-05a7-4bb4-8f88-0e71a5d22845 tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] Calling method '.version_select at 0x7fc77712cdc0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:02.537178 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-c8b9cc2f-05a7-4bb4-8f88-0e71a5d22845 tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] HTTP exception thrown: Image not found. May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c8b9cc2f-05a7-4bb4-8f88-0e71a5d22845 tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] Request method failure captured: May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/images/tempest-invalid-489730870 HTTP/1.1 May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOidaANuaMIbUESy1NzojlEqrs8o0zTpyCfL-xvHnujfI-mn7IJYBM-yWG2jx9K5xHt_F3QC0uu1Cd9bg8eBMuPsmssrlE6_3xVDe54kkOp38RvCa34wYjxSqqBxg22XZdIcEnS-B7pG7_Y3lNAP-6xhGvFvuW3Dh1HQKjf6BedayhE May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: f7d265a016e34135b5f046eb5525f110 May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1237650491 May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f7d265a016e34135b5f046eb5525f110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f7d265a016e34135b5f046eb5525f110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f7d265a016e34135b5f046eb5525f110"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f7d265a016e34135b5f046eb5525f110", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1237650491 May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: f7d265a016e34135b5f046eb5525f110 May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1237650491 May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ImagesDeleteNegativeTestJSON-1237650491-project May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 6bc7233dead546feb521ba0c97cc7bbd May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1237650491-project May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: exception: Image not found. May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'tempest-invalid-489730870'} May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-489730870 to delete May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-489730870 could not be found. May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.542343 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:05:02.547216 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:02.552809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c8b9cc2f-05a7-4bb4-8f88-0e71a5d22845 tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] Returning 404 to user: Image not found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:02.554921 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c8b9cc2f-05a7-4bb4-8f88-0e71a5d22845 tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] 10.222.0.13 "DELETE /compute/v2.1/images/tempest-invalid-489730870" status: 404 len: 62 microversion: 2.1 time: 0.089805 May 27 15:05:02.557380 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 961/1847] 10.222.0.13 () {58 vars in 1202 bytes} [Fri May 27 15:05:02 2022] DELETE /compute/v2.1/images/tempest-invalid-489730870 => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:05:02.567229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cd5e460c-69e6-4b19-8e52-0bef6b9f8685 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:02.574028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e3917fa1-1e2e-4a9a-9511-7a37681f8df5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:02.582018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cd5e460c-69e6-4b19-8e52-0bef6b9f8685 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:02.583142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e3917fa1-1e2e-4a9a-9511-7a37681f8df5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:02.583558 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cd5e460c-69e6-4b19-8e52-0bef6b9f8685 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:02.584788 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cd5e460c-69e6-4b19-8e52-0bef6b9f8685 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1873 microversion: 2.32 time: 0.559970 May 27 15:05:02.593611 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 887/1848] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:02 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1873 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:02.598859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3917fa1-1e2e-4a9a-9511-7a37681f8df5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:02.612390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c48f2e9b-8d81-430b-bc40-672eec419e70 tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] Calling method '.version_select at 0x7fc777232b80>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:02.613189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3917fa1-1e2e-4a9a-9511-7a37681f8df5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:02.615173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3917fa1-1e2e-4a9a-9511-7a37681f8df5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:02.616343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3917fa1-1e2e-4a9a-9511-7a37681f8df5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:02.673150 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-c48f2e9b-8d81-430b-bc40-672eec419e70 tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] HTTP exception thrown: Image not found. May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c48f2e9b-8d81-430b-bc40-672eec419e70 tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] Request method failure captured: May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/images/6fa8172d-9291-4bff-9459-cb3d7743b44d HTTP/1.1 May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOidaANuaMIbUESy1NzojlEqrs8o0zTpyCfL-xvHnujfI-mn7IJYBM-yWG2jx9K5xHt_F3QC0uu1Cd9bg8eBMuPsmssrlE6_3xVDe54kkOp38RvCa34wYjxSqqBxg22XZdIcEnS-B7pG7_Y3lNAP-6xhGvFvuW3Dh1HQKjf6BedayhE May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: f7d265a016e34135b5f046eb5525f110 May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1237650491 May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f7d265a016e34135b5f046eb5525f110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f7d265a016e34135b5f046eb5525f110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f7d265a016e34135b5f046eb5525f110"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f7d265a016e34135b5f046eb5525f110", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1237650491 May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: f7d265a016e34135b5f046eb5525f110 May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1237650491 May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesDeleteNegativeTestJSON-1237650491-project May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 6bc7233dead546feb521ba0c97cc7bbd May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1237650491-project May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: exception: Image not found. May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '6fa8172d-9291-4bff-9459-cb3d7743b44d'} May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6fa8172d-9291-4bff-9459-cb3d7743b44d to delete May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6fa8172d-9291-4bff-9459-cb3d7743b44d could not be found. May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:02.675052 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c48f2e9b-8d81-430b-bc40-672eec419e70 tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] Returning 404 to user: Image not found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c48f2e9b-8d81-430b-bc40-672eec419e70 tempest-ImagesDeleteNegativeTestJSON-1237650491 tempest-ImagesDeleteNegativeTestJSON-1237650491-project] 10.222.0.13 "DELETE /compute/v2.1/images/6fa8172d-9291-4bff-9459-cb3d7743b44d" status: 404 len: 62 microversion: 2.1 time: 0.079780 May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 888/1849] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:02 2022] DELETE /compute/v2.1/images/6fa8172d-9291-4bff-9459-cb3d7743b44d => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:05:02.683648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0b9142d5-87f8-4c28-9744-5cb58701c510 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:02.685644 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0b9142d5-87f8-4c28-9744-5cb58701c510 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:02.709919 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b9142d5-87f8-4c28-9744-5cb58701c510 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:02.713949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b9142d5-87f8-4c28-9744-5cb58701c510 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:02.715112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b9142d5-87f8-4c28-9744-5cb58701c510 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:02.715729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b9142d5-87f8-4c28-9744-5cb58701c510 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:03.332208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e3917fa1-1e2e-4a9a-9511-7a37681f8df5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:03.367977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0b9142d5-87f8-4c28-9744-5cb58701c510 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:03.377323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e3917fa1-1e2e-4a9a-9511-7a37681f8df5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:03.380968 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0b9142d5-87f8-4c28-9744-5cb58701c510 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97" status: 200 len: 1466 microversion: 2.1 time: 0.702509 May 27 15:05:03.381998 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 889/1850] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:02 2022] GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 => generated 1466 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:03.387293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e3917fa1-1e2e-4a9a-9511-7a37681f8df5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:03.391232 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e3917fa1-1e2e-4a9a-9511-7a37681f8df5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.831983 May 27 15:05:03.391838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-198b93e2-abc9-4407-8f6c-40b664b392ae tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:03.392692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-198b93e2-abc9-4407-8f6c-40b664b392ae tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:03.403707 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 962/1851] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:02 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:03.421868 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-687a6f6c-fcec-4961-a3e7-c545e85a61a2 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:03.422776 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-687a6f6c-fcec-4961-a3e7-c545e85a61a2 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:03.425362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-198b93e2-abc9-4407-8f6c-40b664b392ae tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:03.425831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-198b93e2-abc9-4407-8f6c-40b664b392ae tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:03.426623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-198b93e2-abc9-4407-8f6c-40b664b392ae tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:03.427071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-198b93e2-abc9-4407-8f6c-40b664b392ae tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:03.439567 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-687a6f6c-fcec-4961-a3e7-c545e85a61a2 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:03.442019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-687a6f6c-fcec-4961-a3e7-c545e85a61a2 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:03.444373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-687a6f6c-fcec-4961-a3e7-c545e85a61a2 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:03.446308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-687a6f6c-fcec-4961-a3e7-c545e85a61a2 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:03.966852 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-687a6f6c-fcec-4961-a3e7-c545e85a61a2 tempest-ServersOnMultiNodesTest-2069129188 tempest-ServersOnMultiNodesTest-2069129188-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97" status: 200 len: 1617 microversion: 2.1 time: 0.552954 May 27 15:05:03.969201 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 963/1852] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:03 2022] GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 => generated 1617 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:03.986725 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eb493dc5-4699-450d-92ef-0f1f1b878c8f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:03.987620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-eb493dc5-4699-450d-92ef-0f1f1b878c8f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:04.012110 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb493dc5-4699-450d-92ef-0f1f1b878c8f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:04.012977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb493dc5-4699-450d-92ef-0f1f1b878c8f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:04.015516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb493dc5-4699-450d-92ef-0f1f1b878c8f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:04.016558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb493dc5-4699-450d-92ef-0f1f1b878c8f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:04.053571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-198b93e2-abc9-4407-8f6c-40b664b392ae tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:04.071272 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-198b93e2-abc9-4407-8f6c-40b664b392ae tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1314 microversion: 2.1 time: 0.687398 May 27 15:05:04.085638 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 890/1853] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:03 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1314 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:04.445805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b87f9518-fe42-4ff5-8195-07f4e192fd2e tempest-ListImagesTestJSON-1826635602 tempest-ListImagesTestJSON-1826635602-project] Calling method '.version_select at 0x7fc776af21f0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:04.453194 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eb493dc5-4699-450d-92ef-0f1f1b878c8f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:04.473196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eb493dc5-4699-450d-92ef-0f1f1b878c8f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:04.480655 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eb493dc5-4699-450d-92ef-0f1f1b878c8f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:04.491323 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-eb493dc5-4699-450d-92ef-0f1f1b878c8f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1873 microversion: 2.32 time: 0.519936 May 27 15:05:04.493448 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 964/1854] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:03 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1873 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:04.513493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c92800c3-c62b-4da8-aa43-8d207d794808 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:04.515294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c92800c3-c62b-4da8-aa43-8d207d794808 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:04.534832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c92800c3-c62b-4da8-aa43-8d207d794808 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:04.546858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c92800c3-c62b-4da8-aa43-8d207d794808 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:04.550371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c92800c3-c62b-4da8-aa43-8d207d794808 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:04.552931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c92800c3-c62b-4da8-aa43-8d207d794808 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:04.553749 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b87f9518-fe42-4ff5-8195-07f4e192fd2e tempest-ListImagesTestJSON-1826635602 tempest-ListImagesTestJSON-1826635602-project] 10.222.0.13 "GET /compute/v2.1/images/346e776e-8931-417f-87da-575810efb12b" status: 200 len: 784 microversion: 2.1 time: 0.465123 May 27 15:05:04.554456 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 891/1855] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:05:04 2022] GET /compute/v2.1/images/346e776e-8931-417f-87da-575810efb12b => generated 784 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:04.578710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-fc80adaa-6269-434b-9138-649d34ee7a8f req-3e8da2bb-e276-4c24-9a0c-80cec8175f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "name": "network-vif-plugged", "status": "completed", "tag": "ffdb865a-7004-4d4e-afa6-d0613ac33132"}, {"server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "name": "network-vif-plugged", "status": "completed", "tag": "48a86e26-7a18-41f0-bb5d-f642d2334344"}, {"server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "name": "network-vif-plugged", "status": "completed", "tag": "56ba96ed-73b1-4ad8-ad61-f82b64af6976"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:04.612022 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-fc80adaa-6269-434b-9138-649d34ee7a8f req-3e8da2bb-e276-4c24-9a0c-80cec8175f49 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:04.617893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-fc80adaa-6269-434b-9138-649d34ee7a8f req-3e8da2bb-e276-4c24-9a0c-80cec8175f49 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:04.645232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c92800c3-c62b-4da8-aa43-8d207d794808 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:05:04.679392 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-fc80adaa-6269-434b-9138-649d34ee7a8f req-3e8da2bb-e276-4c24-9a0c-80cec8175f49 service nova] Creating event network-vif-plugged:ffdb865a-7004-4d4e-afa6-d0613ac33132 for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:05:04.679392 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-fc80adaa-6269-434b-9138-649d34ee7a8f req-3e8da2bb-e276-4c24-9a0c-80cec8175f49 service nova] Creating event network-vif-plugged:48a86e26-7a18-41f0-bb5d-f642d2334344 for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:05:04.679392 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-fc80adaa-6269-434b-9138-649d34ee7a8f req-3e8da2bb-e276-4c24-9a0c-80cec8175f49 service nova] Creating event network-vif-plugged:56ba96ed-73b1-4ad8-ad61-f82b64af6976 for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:05:04.682406 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-fc80adaa-6269-434b-9138-649d34ee7a8f req-3e8da2bb-e276-4c24-9a0c-80cec8175f49 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.117029 May 27 15:05:04.683302 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 892/1856] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:04.688549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-20ed9b72-e2a8-439a-b40a-c4ae903c964e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:04.689621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-20ed9b72-e2a8-439a-b40a-c4ae903c964e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:04.697291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20ed9b72-e2a8-439a-b40a-c4ae903c964e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:04.698059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20ed9b72-e2a8-439a-b40a-c4ae903c964e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:04.699026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20ed9b72-e2a8-439a-b40a-c4ae903c964e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:04.699677 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20ed9b72-e2a8-439a-b40a-c4ae903c964e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:04.783020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:04.889555 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c92800c3-c62b-4da8-aa43-8d207d794808 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97" status: 204 len: 0 microversion: 2.1 time: 0.390444 May 27 15:05:04.890164 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 965/1857] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:05:04 2022] DELETE /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:05:04.900615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0b0fc41a-e90b-4b7a-9e8f-1301e1509ee4 tempest-ListImagesTestJSON-1826635602 tempest-ListImagesTestJSON-1826635602-project] Calling method '.version_select at 0x7fc78079c8b0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:05.077201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-20ed9b72-e2a8-439a-b40a-c4ae903c964e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:05.088434 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0b0fc41a-e90b-4b7a-9e8f-1301e1509ee4 tempest-ListImagesTestJSON-1826635602 tempest-ListImagesTestJSON-1826635602-project] 10.222.0.13 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.195081 May 27 15:05:05.093917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-20ed9b72-e2a8-439a-b40a-c4ae903c964e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:05.095221 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 966/1858] 10.222.0.13 () {58 vars in 1121 bytes} [Fri May 27 15:05:04 2022] GET /compute/v2.1/images => generated 445 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:05.110217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-20ed9b72-e2a8-439a-b40a-c4ae903c964e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:05.111581 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-20ed9b72-e2a8-439a-b40a-c4ae903c964e tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.427042 May 27 15:05:05.112278 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 893/1859] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:04 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:05.142225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-57c44685-a9ad-4b9d-9778-5971432ce183 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:05.146471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-57c44685-a9ad-4b9d-9778-5971432ce183 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:05.158517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57c44685-a9ad-4b9d-9778-5971432ce183 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:05.159250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57c44685-a9ad-4b9d-9778-5971432ce183 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:05.160524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57c44685-a9ad-4b9d-9778-5971432ce183 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:05.161272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57c44685-a9ad-4b9d-9778-5971432ce183 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:05.440459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-57c44685-a9ad-4b9d-9778-5971432ce183 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:05.455791 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-57c44685-a9ad-4b9d-9778-5971432ce183 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97" status: 200 len: 1472 microversion: 2.1 time: 0.328228 May 27 15:05:05.457951 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 894/1860] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:05 2022] GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 => generated 1472 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:05.463036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-80b8fe6b-bf16-48e1-96ae-e4e4a98f9b2d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:05.466639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-80b8fe6b-bf16-48e1-96ae-e4e4a98f9b2d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:05.488528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-80b8fe6b-bf16-48e1-96ae-e4e4a98f9b2d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:05.490715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-80b8fe6b-bf16-48e1-96ae-e4e4a98f9b2d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:05.493765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-80b8fe6b-bf16-48e1-96ae-e4e4a98f9b2d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:05.496029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-80b8fe6b-bf16-48e1-96ae-e4e4a98f9b2d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:05.654262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d844f24d-f2b7-4f1d-8c24-6cc37224b7cf tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Action: 'create', calling method: .version_select at 0x7fc7807ffdc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-542628177", "description": "tempest-description-2043913982"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:05.807510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-80b8fe6b-bf16-48e1-96ae-e4e4a98f9b2d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:05.836050 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-80b8fe6b-bf16-48e1-96ae-e4e4a98f9b2d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1499 microversion: 2.1 time: 0.371158 May 27 15:05:05.837697 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 895/1861] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:05 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1499 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:05.855740 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-92e67b1c-1b01-44d5-b7da-6e3ea48f43f1 tempest-ListImagesTestJSON-1826635602 tempest-ListImagesTestJSON-1826635602-project] Calling method '.version_select at 0x7fc7772413a0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:05.948025 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-92e67b1c-1b01-44d5-b7da-6e3ea48f43f1 tempest-ListImagesTestJSON-1826635602 tempest-ListImagesTestJSON-1826635602-project] 10.222.0.13 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.104115 May 27 15:05:05.948274 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 896/1862] 10.222.0.13 () {58 vars in 1142 bytes} [Fri May 27 15:05:05 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:05.969904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fd7a676f-0dbe-4744-a4d7-9975226fdee4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:05.973202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fd7a676f-0dbe-4744-a4d7-9975226fdee4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:05.976086 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d844f24d-f2b7-4f1d-8c24-6cc37224b7cf tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.879553 May 27 15:05:05.977473 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 967/1863] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:05:05 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:05.991023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-258f77f1-3049-440b-bef2-e7761b73388d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:05.992721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-258f77f1-3049-440b-bef2-e7761b73388d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:06.003632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd7a676f-0dbe-4744-a4d7-9975226fdee4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:06.004437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd7a676f-0dbe-4744-a4d7-9975226fdee4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:06.005543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-258f77f1-3049-440b-bef2-e7761b73388d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:06.005820 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd7a676f-0dbe-4744-a4d7-9975226fdee4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:06.006514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-258f77f1-3049-440b-bef2-e7761b73388d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:06.007307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd7a676f-0dbe-4744-a4d7-9975226fdee4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:06.008184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-258f77f1-3049-440b-bef2-e7761b73388d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:06.008944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-258f77f1-3049-440b-bef2-e7761b73388d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:06.062816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-258f77f1-3049-440b-bef2-e7761b73388d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lazy-loading 'flavor' on Instance uuid ccb6575b-6908-43ae-989f-1bdfcc5f5c63 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:05:06.253254 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-258f77f1-3049-440b-bef2-e7761b73388d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "POST /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63/action" status: 200 len: 32 microversion: 2.1 time: 0.272115 May 27 15:05:06.261261 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 968/1864] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:05:05 2022] POST /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63/action => generated 32 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:05:06.273769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-24e78c62-31e4-4ed7-8dc8-cdc6ed469e2f tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Action: 'create', calling method: .version_select at 0x7fc7807ff8b0>, body: {"security_group_rule": {"parent_group_id": "5685083f-4804-424b-b6a6-fe3495bfd96f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:06.411445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fd7a676f-0dbe-4744-a4d7-9975226fdee4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:06.423110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fd7a676f-0dbe-4744-a4d7-9975226fdee4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:06.430761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fd7a676f-0dbe-4744-a4d7-9975226fdee4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:06.432418 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fd7a676f-0dbe-4744-a4d7-9975226fdee4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1873 microversion: 2.32 time: 0.482501 May 27 15:05:06.433534 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 897/1865] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:05 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1873 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:06.439640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7dbf39de-ccd2-4ac2-b641-d5b026f44691 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:06.440552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7dbf39de-ccd2-4ac2-b641-d5b026f44691 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:06.449249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7dbf39de-ccd2-4ac2-b641-d5b026f44691 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:06.450871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7dbf39de-ccd2-4ac2-b641-d5b026f44691 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:06.452079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7dbf39de-ccd2-4ac2-b641-d5b026f44691 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:06.452887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7dbf39de-ccd2-4ac2-b641-d5b026f44691 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:06.956887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7dbf39de-ccd2-4ac2-b641-d5b026f44691 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:06.978616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7dbf39de-ccd2-4ac2-b641-d5b026f44691 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:06.984967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7dbf39de-ccd2-4ac2-b641-d5b026f44691 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:06.991604 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7dbf39de-ccd2-4ac2-b641-d5b026f44691 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.554623 May 27 15:05:06.994122 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 898/1866] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:06 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:07.010420 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7a655614-bf64-4f54-b017-7d12bba91060 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:07.012468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7a655614-bf64-4f54-b017-7d12bba91060 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:07.028725 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-24e78c62-31e4-4ed7-8dc8-cdc6ed469e2f tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.765125 May 27 15:05:07.031457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a655614-bf64-4f54-b017-7d12bba91060 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:07.035945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a655614-bf64-4f54-b017-7d12bba91060 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:07.037687 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 969/1867] 10.222.0.13 () {60 vars in 1194 bytes} [Fri May 27 15:05:06 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:07.038843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a655614-bf64-4f54-b017-7d12bba91060 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:07.040922 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a655614-bf64-4f54-b017-7d12bba91060 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:07.059699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-17dd3705-e1e9-4fba-a193-e33d1ef99052 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:07.060618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-17dd3705-e1e9-4fba-a193-e33d1ef99052 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:07.099462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-17dd3705-e1e9-4fba-a193-e33d1ef99052 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:07.100010 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-17dd3705-e1e9-4fba-a193-e33d1ef99052 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:07.101335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-17dd3705-e1e9-4fba-a193-e33d1ef99052 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:07.102114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-17dd3705-e1e9-4fba-a193-e33d1ef99052 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:07.250972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7a655614-bf64-4f54-b017-7d12bba91060 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:07.259620 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7a655614-bf64-4f54-b017-7d12bba91060 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.261744 May 27 15:05:07.285467 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 899/1868] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:06 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:07.292188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-7be8e64d-bfda-4456-acf0-511a59c5a9ab req-b7e5a2e1-7c24-4253-9027-a9349fe02d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "name": "network-vif-plugged", "status": "completed", "tag": "f318c091-0a24-4179-812b-dc1ec5baf655"}, {"server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "name": "network-vif-plugged", "status": "completed", "tag": "45313e38-2a42-4c68-84d0-f6a729364e79"}, {"server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "name": "network-vif-plugged", "status": "completed", "tag": "f82a5a42-f473-44b2-b255-6b333e4f281b"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:07.322275 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-7be8e64d-bfda-4456-acf0-511a59c5a9ab req-b7e5a2e1-7c24-4253-9027-a9349fe02d92 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:07.323478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-7be8e64d-bfda-4456-acf0-511a59c5a9ab req-b7e5a2e1-7c24-4253-9027-a9349fe02d92 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:07.355275 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-7be8e64d-bfda-4456-acf0-511a59c5a9ab req-b7e5a2e1-7c24-4253-9027-a9349fe02d92 service nova] Creating event network-vif-plugged:f318c091-0a24-4179-812b-dc1ec5baf655 for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:05:07.357667 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-7be8e64d-bfda-4456-acf0-511a59c5a9ab req-b7e5a2e1-7c24-4253-9027-a9349fe02d92 service nova] Creating event network-vif-plugged:45313e38-2a42-4c68-84d0-f6a729364e79 for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:05:07.359789 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-7be8e64d-bfda-4456-acf0-511a59c5a9ab req-b7e5a2e1-7c24-4253-9027-a9349fe02d92 service nova] Creating event network-vif-plugged:f82a5a42-f473-44b2-b255-6b333e4f281b for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:05:07.372406 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-7be8e64d-bfda-4456-acf0-511a59c5a9ab req-b7e5a2e1-7c24-4253-9027-a9349fe02d92 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.084879 May 27 15:05:07.374300 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 900/1869] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:07.392617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-598112c9-5003-4a70-9643-c176052e36b5 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Action: 'create', calling method: .version_select at 0x7fc7772adf70>, body: {"security_group_rule": {"parent_group_id": "5685083f-4804-424b-b6a6-fe3495bfd96f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:07.594305 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-598112c9-5003-4a70-9643-c176052e36b5 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] HTTP exception thrown: This rule already exists in group 5685083f-4804-424b-b6a6-fe3495bfd96f May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-598112c9-5003-4a70-9643-c176052e36b5 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Request method failure captured: May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 138 May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOigOC6k-TKgotDmEq4dCPsrirQu-gmSyIFfjjYgnl9qsZlRP4ZF70epoN40g53azK80B--6bZTGaBtEZWIlaimOgxmL6Epgur2JGTteusVGhGl1z-FAH9MLs0wc-vScN8SrI0hgtn7ODdVXSWrS6IT9oI5aFbFZmvb8Lr2qcZSlp8g May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: f9960d9840cb4c4ab7e67c2e6ee577c5 May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f9960d9840cb4c4ab7e67c2e6ee577c5", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: f9960d9840cb4c4ab7e67c2e6ee577c5 May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 38faf2d22aaf4794b0e7e6a67ad4f940 May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: {"security_group_rule": {"parent_group_id": "5685083f-4804-424b-b6a6-fe3495bfd96f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: exception: This rule already exists in group 5685083f-4804-424b-b6a6-fe3495bfd96f May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5685083f-4804-424b-b6a6-fe3495bfd96f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 5685083f-4804-424b-b6a6-fe3495bfd96f May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 5685083f-4804-424b-b6a6-fe3495bfd96f May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:07.600925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:07.607965 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:07.607965 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:07.607965 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 5685083f-4804-424b-b6a6-fe3495bfd96f May 27 15:05:07.607965 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:07.607965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-598112c9-5003-4a70-9643-c176052e36b5 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Returning 400 to user: This rule already exists in group 5685083f-4804-424b-b6a6-fe3495bfd96f {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:07.607965 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-598112c9-5003-4a70-9643-c176052e36b5 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.224136 May 27 15:05:07.607965 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 901/1870] 10.222.0.13 () {60 vars in 1194 bytes} [Fri May 27 15:05:07 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 228 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:05:07.616704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-17dd3705-e1e9-4fba-a193-e33d1ef99052 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:07.622365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-94e470e4-cbaf-4739-8d51-55053a7e366b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:07.623310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-94e470e4-cbaf-4739-8d51-55053a7e366b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:07.627502 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-17dd3705-e1e9-4fba-a193-e33d1ef99052 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97" status: 200 len: 1472 microversion: 2.1 time: 0.587981 May 27 15:05:07.630363 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 970/1871] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:07 2022] GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 => generated 1472 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:07.638872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94e470e4-cbaf-4739-8d51-55053a7e366b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:07.643355 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94e470e4-cbaf-4739-8d51-55053a7e366b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:07.650109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94e470e4-cbaf-4739-8d51-55053a7e366b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:07.650892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6f11398a-a438-4f56-911d-2c500390fc04 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Calling method '.version_select at 0x7fc7765c3ee0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:07.653230 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94e470e4-cbaf-4739-8d51-55053a7e366b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:08.220709 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6f11398a-a438-4f56-911d-2c500390fc04 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-group-rules/2a80c6c0-5a37-4880-b90b-a88bd12ebb35" status: 202 len: 0 microversion: 2.1 time: 0.576577 May 27 15:05:08.223273 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 971/1872] 10.222.0.13 () {58 vars in 1286 bytes} [Fri May 27 15:05:07 2022] DELETE /compute/v2.1/os-security-group-rules/2a80c6c0-5a37-4880-b90b-a88bd12ebb35 => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:05:08.226442 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-94e470e4-cbaf-4739-8d51-55053a7e366b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:08.231552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-af25e964-358a-4df4-93b4-244063e89af1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:08.242017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-af25e964-358a-4df4-93b4-244063e89af1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:08.242379 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-94e470e4-cbaf-4739-8d51-55053a7e366b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:08.249425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-94e470e4-cbaf-4739-8d51-55053a7e366b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:08.250660 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-94e470e4-cbaf-4739-8d51-55053a7e366b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1873 microversion: 2.32 time: 0.642843 May 27 15:05:08.251560 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 902/1873] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:07 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1873 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:08.256199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-eac7bbe5-6796-4eca-a162-ce2b48312ec8 req-600d286b-3d7b-4302-92ea-f4b667422a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc92f950-a316-4536-b69c-fd6900c98f97", "name": "network-vif-deleted", "tag": "8c191ad1-df28-4fa7-8018-135517279560"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:08.272578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af25e964-358a-4df4-93b4-244063e89af1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:08.276808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af25e964-358a-4df4-93b4-244063e89af1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:08.277085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-eac7bbe5-6796-4eca-a162-ce2b48312ec8 req-600d286b-3d7b-4302-92ea-f4b667422a54 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:08.277543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-eac7bbe5-6796-4eca-a162-ce2b48312ec8 req-600d286b-3d7b-4302-92ea-f4b667422a54 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:08.281386 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af25e964-358a-4df4-93b4-244063e89af1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:08.282132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af25e964-358a-4df4-93b4-244063e89af1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:08.307810 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-eac7bbe5-6796-4eca-a162-ce2b48312ec8 req-600d286b-3d7b-4302-92ea-f4b667422a54 service nova] Creating event network-vif-deleted:8c191ad1-df28-4fa7-8018-135517279560 for instance fc92f950-a316-4536-b69c-fd6900c98f97 on n-h2-843621-1 May 27 15:05:08.333863 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-eac7bbe5-6796-4eca-a162-ce2b48312ec8 req-600d286b-3d7b-4302-92ea-f4b667422a54 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072563 May 27 15:05:08.347209 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 903/1874] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:08.373492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ce61023d-ddb9-4a0f-ad85-03c9911ed361 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Action: 'create', calling method: .version_select at 0x7fc7770920d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1437504408", "description": "tempest-description-1432801914"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:08.749339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-af25e964-358a-4df4-93b4-244063e89af1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:08.762601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-af25e964-358a-4df4-93b4-244063e89af1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:08.768247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-af25e964-358a-4df4-93b4-244063e89af1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:08.771617 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-af25e964-358a-4df4-93b4-244063e89af1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.546551 May 27 15:05:08.772504 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 972/1875] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:08 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:08.787868 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee622f5b-bf63-43aa-9e95-668be614ca9e tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:08.789326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ee622f5b-bf63-43aa-9e95-668be614ca9e tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:08.802728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee622f5b-bf63-43aa-9e95-668be614ca9e tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:08.803926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee622f5b-bf63-43aa-9e95-668be614ca9e tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:08.805658 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee622f5b-bf63-43aa-9e95-668be614ca9e tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:08.807679 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee622f5b-bf63-43aa-9e95-668be614ca9e tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:09.055933 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ce61023d-ddb9-4a0f-ad85-03c9911ed361 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.705491 May 27 15:05:09.057010 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 904/1876] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:05:08 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:09.072985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8d6bcd29-8e84-4752-83b2-779e0fce227a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:09.074830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8d6bcd29-8e84-4752-83b2-779e0fce227a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:09.086649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d6bcd29-8e84-4752-83b2-779e0fce227a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:09.087580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d6bcd29-8e84-4752-83b2-779e0fce227a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:09.088691 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d6bcd29-8e84-4752-83b2-779e0fce227a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:09.093484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d6bcd29-8e84-4752-83b2-779e0fce227a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:09.167930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ee622f5b-bf63-43aa-9e95-668be614ca9e tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:09.184526 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ee622f5b-bf63-43aa-9e95-668be614ca9e tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.409623 May 27 15:05:09.185266 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 973/1877] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:08 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:09.198286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d6bcd29-8e84-4752-83b2-779e0fce227a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:09.199166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d6bcd29-8e84-4752-83b2-779e0fce227a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:09.199626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f0c07d9e-9759-401f-9867-51680ba55ff6 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Action: 'create', calling method: .version_select at 0x7fc780721ee0>, body: {"security_group_rule": {"parent_group_id": "57d83206-3250-4b14-96b5-d0ba60d0d9a2", "ip_protocol": "tcp", "from_port": 1904863411, "to_port": 22}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:09.201007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-8d6bcd29-8e84-4752-83b2-779e0fce227a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lazy-loading 'fault' on Instance uuid fc92f950-a316-4536-b69c-fd6900c98f97 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:05:09.398464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8d6bcd29-8e84-4752-83b2-779e0fce227a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:09.440769 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8d6bcd29-8e84-4752-83b2-779e0fce227a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97" status: 200 len: 1307 microversion: 2.1 time: 0.381745 May 27 15:05:09.452146 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 905/1878] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:09 2022] GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 => generated 1307 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:09.490180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-af561f2b-65dc-4736-adb3-21ab6b349cc5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:09.501043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-af561f2b-65dc-4736-adb3-21ab6b349cc5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:09.512201 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-f0c07d9e-9759-401f-9867-51680ba55ff6 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] HTTP exception thrown: Invalid port range 1904863411:22. Former value cannot be greater than the later May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f0c07d9e-9759-401f-9867-51680ba55ff6 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Request method failure captured: May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 146 May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOigOC6k-TKgotDmEq4dCPsrirQu-gmSyIFfjjYgnl9qsZlRP4ZF70epoN40g53azK80B--6bZTGaBtEZWIlaimOgxmL6Epgur2JGTteusVGhGl1z-FAH9MLs0wc-vScN8SrI0hgtn7ODdVXSWrS6IT9oI5aFbFZmvb8Lr2qcZSlp8g May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: f9960d9840cb4c4ab7e67c2e6ee577c5 May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f9960d9840cb4c4ab7e67c2e6ee577c5", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: f9960d9840cb4c4ab7e67c2e6ee577c5 May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 38faf2d22aaf4794b0e7e6a67ad4f940 May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: {"security_group_rule": {"parent_group_id": "57d83206-3250-4b14-96b5-d0ba60d0d9a2", "ip_protocol": "tcp", "from_port": 1904863411, "to_port": 22}} May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid port range 1904863411:22. Former value cannot be greater than the later May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'security_group_rule': {'parent_group_id': '57d83206-3250-4b14-96b5-d0ba60d0d9a2', 'ip_protocol': 'tcp', 'from_port': 1904863411, 'to_port': 22}}} May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1904863411:22. Former value cannot be greater than the later May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1904863411:22. Former value cannot be greater than the later May 27 15:05:09.516330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:09.521418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:09.521418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:09.521418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:09.521418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:09.521418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:09.521418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:09.521418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:09.521418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1904863411:22. Former value cannot be greater than the later May 27 15:05:09.521418 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:09.523434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f0c07d9e-9759-401f-9867-51680ba55ff6 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Returning 400 to user: Invalid port range 1904863411:22. Former value cannot be greater than the later {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:09.525315 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f0c07d9e-9759-401f-9867-51680ba55ff6 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.335344 May 27 15:05:09.526662 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 974/1879] 10.222.0.13 () {60 vars in 1194 bytes} [Fri May 27 15:05:09 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 338 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:05:09.533978 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af561f2b-65dc-4736-adb3-21ab6b349cc5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:09.534793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af561f2b-65dc-4736-adb3-21ab6b349cc5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:09.536109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af561f2b-65dc-4736-adb3-21ab6b349cc5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:09.537444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af561f2b-65dc-4736-adb3-21ab6b349cc5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:09.539541 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-39ee0911-2ddc-46e0-9265-27de61a24167 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Action: 'create', calling method: .version_select at 0x7fc7765d39d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2117825074", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:09.542241 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-39ee0911-2ddc-46e0-9265-27de61a24167 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] HTTP exception thrown: Security group id should be uuid May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-39ee0911-2ddc-46e0-9265-27de61a24167 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Request method failure captured: May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 131 May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOigOC6k-TKgotDmEq4dCPsrirQu-gmSyIFfjjYgnl9qsZlRP4ZF70epoN40g53azK80B--6bZTGaBtEZWIlaimOgxmL6Epgur2JGTteusVGhGl1z-FAH9MLs0wc-vScN8SrI0hgtn7ODdVXSWrS6IT9oI5aFbFZmvb8Lr2qcZSlp8g May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: f9960d9840cb4c4ab7e67c2e6ee577c5 May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f9960d9840cb4c4ab7e67c2e6ee577c5", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: f9960d9840cb4c4ab7e67c2e6ee577c5 May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 38faf2d22aaf4794b0e7e6a67ad4f940 May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2117825074", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: exception: Security group id should be uuid May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-2117825074', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:09.546743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:09.554316 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid May 27 15:05:09.554316 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:09.556890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-39ee0911-2ddc-46e0-9265-27de61a24167 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Returning 400 to user: Security group id should be uuid {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:09.559872 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-39ee0911-2ddc-46e0-9265-27de61a24167 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.026485 May 27 15:05:09.562475 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 975/1880] 10.222.0.13 () {60 vars in 1194 bytes} [Fri May 27 15:05:09 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 27 15:05:09.579570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7e32c6b2-70af-413e-8c85-2a8891faf02d tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Action: 'create', calling method: .version_select at 0x7fc77666c310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1007647567", "description": "tempest-description-1154691746"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:09.871667 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-af561f2b-65dc-4736-adb3-21ab6b349cc5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:09.899150 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-af561f2b-65dc-4736-adb3-21ab6b349cc5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:09.902286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-af561f2b-65dc-4736-adb3-21ab6b349cc5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:09.904550 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-af561f2b-65dc-4736-adb3-21ab6b349cc5 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1873 microversion: 2.32 time: 0.450157 May 27 15:05:09.917027 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 906/1881] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:09 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1873 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:09.931319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fb4c00a6-7388-4d09-9605-45b296587777 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:09.938174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fb4c00a6-7388-4d09-9605-45b296587777 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:09.961257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb4c00a6-7388-4d09-9605-45b296587777 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:09.962045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb4c00a6-7388-4d09-9605-45b296587777 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:09.963402 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb4c00a6-7388-4d09-9605-45b296587777 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:09.964133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb4c00a6-7388-4d09-9605-45b296587777 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:10.093577 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7e32c6b2-70af-413e-8c85-2a8891faf02d tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.524450 May 27 15:05:10.102947 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 976/1882] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:05:09 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:10.111530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-57794297-dfde-46a8-8b5e-7c01b7a7ff0b tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Action: 'create', calling method: .version_select at 0x7fc776c3e820>, body: {"security_group_rule": {"parent_group_id": "c5149dbd-45b0-45c3-8bd9-6d5116abc47b", "ip_protocol": "tempest-999-1840479496", "from_port": 22, "to_port": 22}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:10.365939 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-57794297-dfde-46a8-8b5e-7c01b7a7ff0b tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] HTTP exception thrown: Invalid IP protocol tempest-999-1840479496. May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-57794297-dfde-46a8-8b5e-7c01b7a7ff0b tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Request method failure captured: May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 157 May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOigOC6k-TKgotDmEq4dCPsrirQu-gmSyIFfjjYgnl9qsZlRP4ZF70epoN40g53azK80B--6bZTGaBtEZWIlaimOgxmL6Epgur2JGTteusVGhGl1z-FAH9MLs0wc-vScN8SrI0hgtn7ODdVXSWrS6IT9oI5aFbFZmvb8Lr2qcZSlp8g May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: f9960d9840cb4c4ab7e67c2e6ee577c5 May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f9960d9840cb4c4ab7e67c2e6ee577c5", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: f9960d9840cb4c4ab7e67c2e6ee577c5 May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 38faf2d22aaf4794b0e7e6a67ad4f940 May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: {"security_group_rule": {"parent_group_id": "c5149dbd-45b0-45c3-8bd9-6d5116abc47b", "ip_protocol": "tempest-999-1840479496", "from_port": 22, "to_port": 22}} May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid IP protocol tempest-999-1840479496. May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c5149dbd-45b0-45c3-8bd9-6d5116abc47b', 'ip_protocol': 'tempest-999-1840479496', 'from_port': 22, 'to_port': 22}}} May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1840479496. May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1840479496. May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:10.369156 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:10.376367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:10.376367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:10.376367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:10.376367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:10.376367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:10.376367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:10.376367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1840479496. May 27 15:05:10.376367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:10.378308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-57794297-dfde-46a8-8b5e-7c01b7a7ff0b tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Returning 400 to user: Invalid IP protocol tempest-999-1840479496. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:10.379700 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-57794297-dfde-46a8-8b5e-7c01b7a7ff0b tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.275027 May 27 15:05:10.381189 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 977/1883] 10.222.0.13 () {60 vars in 1194 bytes} [Fri May 27 15:05:10 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 277 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 27 15:05:10.402237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fb4c00a6-7388-4d09-9605-45b296587777 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:10.409532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8b1e6955-482d-475f-86c8-be592afa9cfa tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:10.414796 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8b1e6955-482d-475f-86c8-be592afa9cfa tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:10.427564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fb4c00a6-7388-4d09-9605-45b296587777 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:10.433233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b1e6955-482d-475f-86c8-be592afa9cfa tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:10.435910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b1e6955-482d-475f-86c8-be592afa9cfa tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:10.437479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b1e6955-482d-475f-86c8-be592afa9cfa tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:10.437709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fb4c00a6-7388-4d09-9605-45b296587777 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:10.439664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b1e6955-482d-475f-86c8-be592afa9cfa tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:10.440115 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fb4c00a6-7388-4d09-9605-45b296587777 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.520684 May 27 15:05:10.445805 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 907/1884] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:09 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:10.450800 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4ad4e910-b24e-40a0-bce1-71ea6d028f58 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Action: 'create', calling method: .version_select at 0x7fc77729dca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1717798929", "description": "tempest-description-1201587045"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:10.804130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8b1e6955-482d-475f-86c8-be592afa9cfa tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:10.818312 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8b1e6955-482d-475f-86c8-be592afa9cfa tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.435658 May 27 15:05:10.821433 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 978/1885] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:10 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:10.830200 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d45cf454-f182-4aec-9eb4-5818e433c3d6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:10.837499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d45cf454-f182-4aec-9eb4-5818e433c3d6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: fc92f950-a316-4536-b69c-fd6900c98f97] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:10.850711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d45cf454-f182-4aec-9eb4-5818e433c3d6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:10.851946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d45cf454-f182-4aec-9eb4-5818e433c3d6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:10.852978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d45cf454-f182-4aec-9eb4-5818e433c3d6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:10.863881 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d45cf454-f182-4aec-9eb4-5818e433c3d6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:10.902426 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-d45cf454-f182-4aec-9eb4-5818e433c3d6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] HTTP exception thrown: Instance fc92f950-a316-4536-b69c-fd6900c98f97 could not be found. May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d45cf454-f182-4aec-9eb4-5818e433c3d6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Request method failure captured: May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 HTTP/1.1 May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOfd5hdxLeIINzf1SGh8rcVIlOjIbaEfXQGyzTLmyQvSh4Xl0M97PMVOQYpMpAcyHD0h4iPPWz2VoG4iudcTpWdaEThkb3zz2WwK1_NStu3ayjQgrPJgz8YPOZlcPx0wS3ui17AvHHUaERlLugYwIFWbEzuGHXRywldg7ob0y3b_kdc May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: a081b119396543ad8ac9421acc677175 May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a081b119396543ad8ac9421acc677175"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a081b119396543ad8ac9421acc677175"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a081b119396543ad8ac9421acc677175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a081b119396543ad8ac9421acc677175", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: a081b119396543ad8ac9421acc677175 May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersOnMultiNodesTest-943751365-project May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: f426b883acdc49f8b0c4a9ba68e4572b May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersOnMultiNodesTest-943751365-project May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance fc92f950-a316-4536-b69c-fd6900c98f97 could not be found. May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'fc92f950-a316-4536-b69c-fd6900c98f97'} May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc92f950-a316-4536-b69c-fd6900c98f97 could not be found. May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc92f950-a316-4536-b69c-fd6900c98f97 could not be found. May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:10.904115 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:10.914914 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:10.914914 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:10.914914 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:10.914914 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:10.914914 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:10.914914 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc92f950-a316-4536-b69c-fd6900c98f97 could not be found. May 27 15:05:10.914914 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:10.914914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d45cf454-f182-4aec-9eb4-5818e433c3d6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Returning 404 to user: Instance fc92f950-a316-4536-b69c-fd6900c98f97 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:10.914914 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d45cf454-f182-4aec-9eb4-5818e433c3d6 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97" status: 404 len: 111 microversion: 2.1 time: 0.083805 May 27 15:05:10.914914 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 979/1886] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:10 2022] GET /compute/v2.1/servers/fc92f950-a316-4536-b69c-fd6900c98f97 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:05:10.919334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dde72c91-c5c1-410e-a71b-427830700746 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:10.922360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dde72c91-c5c1-410e-a71b-427830700746 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 8f095e10-b6bc-4908-bc4f-6534231f3068] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:10.938308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dde72c91-c5c1-410e-a71b-427830700746 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:10.939244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dde72c91-c5c1-410e-a71b-427830700746 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:10.940310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dde72c91-c5c1-410e-a71b-427830700746 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:10.940975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dde72c91-c5c1-410e-a71b-427830700746 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:10.951399 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4ad4e910-b24e-40a0-bce1-71ea6d028f58 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.504119 May 27 15:05:10.953853 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 908/1887] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:05:10 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:10.964528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c35f07ff-0d77-49c7-9d97-c916d60121d6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:10.973615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c35f07ff-0d77-49c7-9d97-c916d60121d6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:10.999419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c35f07ff-0d77-49c7-9d97-c916d60121d6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:10.999920 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c35f07ff-0d77-49c7-9d97-c916d60121d6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:11.000791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c35f07ff-0d77-49c7-9d97-c916d60121d6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:11.003801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c35f07ff-0d77-49c7-9d97-c916d60121d6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:11.013385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dde72c91-c5c1-410e-a71b-427830700746 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 8f095e10-b6bc-4908-bc4f-6534231f3068] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:05:11.244093 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dde72c91-c5c1-410e-a71b-427830700746 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068" status: 204 len: 0 microversion: 2.1 time: 0.327742 May 27 15:05:11.249815 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 980/1888] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:05:10 2022] DELETE /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:05:11.258928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9650e486-11e6-4f9e-8f1a-e7dc116325a8 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Action: 'create', calling method: .version_select at 0x7fc7807210d0>, body: {"security_group_rule": {"parent_group_id": "67ac1d8d-c589-4b02-a6c4-df61807bb456", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:11.463734 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-9650e486-11e6-4f9e-8f1a-e7dc116325a8 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9650e486-11e6-4f9e-8f1a-e7dc116325a8 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Request method failure captured: May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 138 May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOigOC6k-TKgotDmEq4dCPsrirQu-gmSyIFfjjYgnl9qsZlRP4ZF70epoN40g53azK80B--6bZTGaBtEZWIlaimOgxmL6Epgur2JGTteusVGhGl1z-FAH9MLs0wc-vScN8SrI0hgtn7ODdVXSWrS6IT9oI5aFbFZmvb8Lr2qcZSlp8g May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: f9960d9840cb4c4ab7e67c2e6ee577c5 May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f9960d9840cb4c4ab7e67c2e6ee577c5", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: f9960d9840cb4c4ab7e67c2e6ee577c5 May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 38faf2d22aaf4794b0e7e6a67ad4f940 May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: {"security_group_rule": {"parent_group_id": "67ac1d8d-c589-4b02-a6c4-df61807bb456", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid port range 22:21. Former value cannot be greater than the later May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'security_group_rule': {'parent_group_id': '67ac1d8d-c589-4b02-a6c4-df61807bb456', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later May 27 15:05:11.467219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:11.479181 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:11.479181 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:11.479181 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:11.479181 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:11.479181 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:11.479181 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:11.479181 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:11.479181 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later May 27 15:05:11.479181 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:11.479181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9650e486-11e6-4f9e-8f1a-e7dc116325a8 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:11.479181 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9650e486-11e6-4f9e-8f1a-e7dc116325a8 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.222799 May 27 15:05:11.485598 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 981/1889] 10.222.0.13 () {60 vars in 1194 bytes} [Fri May 27 15:05:11 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 238 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:05:11.539807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c35f07ff-0d77-49c7-9d97-c916d60121d6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:11.551499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c35f07ff-0d77-49c7-9d97-c916d60121d6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:11.553081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c35f07ff-0d77-49c7-9d97-c916d60121d6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:11.554584 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c35f07ff-0d77-49c7-9d97-c916d60121d6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 2826 microversion: 2.32 time: 0.600751 May 27 15:05:11.555770 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 909/1890] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:10 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 2826 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:11.560748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-82b6a97d-30b3-482e-a1e3-e238f375777d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:11.561630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-82b6a97d-30b3-482e-a1e3-e238f375777d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 8f095e10-b6bc-4908-bc4f-6534231f3068] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:11.567538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:11.570103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82b6a97d-30b3-482e-a1e3-e238f375777d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:11.570908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82b6a97d-30b3-482e-a1e3-e238f375777d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:11.571911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82b6a97d-30b3-482e-a1e3-e238f375777d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:11.572523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82b6a97d-30b3-482e-a1e3-e238f375777d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:11.779530 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-82b6a97d-30b3-482e-a1e3-e238f375777d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:11.790584 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-82b6a97d-30b3-482e-a1e3-e238f375777d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068" status: 200 len: 1471 microversion: 2.1 time: 0.233315 May 27 15:05:11.792214 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 910/1891] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:11 2022] GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068 => generated 1471 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:11.798346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0a5889ea-83b2-42a8-82cd-e1dae0b11883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:11.799286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0a5889ea-83b2-42a8-82cd-e1dae0b11883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:11.812133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-23e34d37-9f03-495b-94f8-ff53c08ab611 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1470721619", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "c12cba1c-fb03-4426-9903-a7c919b09dde"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:11.821941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a5889ea-83b2-42a8-82cd-e1dae0b11883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:11.822512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a5889ea-83b2-42a8-82cd-e1dae0b11883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:11.825322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a5889ea-83b2-42a8-82cd-e1dae0b11883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:11.825939 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a5889ea-83b2-42a8-82cd-e1dae0b11883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:11.862864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:11.890133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-23e34d37-9f03-495b-94f8-ff53c08ab611 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] validate_networks() for [('c12cba1c-fb03-4426-9903-a7c919b09dde', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:05:12.206268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0a5889ea-83b2-42a8-82cd-e1dae0b11883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:12.228743 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0a5889ea-83b2-42a8-82cd-e1dae0b11883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:12.232623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0a5889ea-83b2-42a8-82cd-e1dae0b11883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:12.242609 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0a5889ea-83b2-42a8-82cd-e1dae0b11883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1486 microversion: 2.25 time: 0.448626 May 27 15:05:12.243150 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 911/1892] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:11 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1486 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:12.252012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-327024d8-8fbe-4bc9-b430-64a138dfe535 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Action: 'create', calling method: .version_select at 0x7fc7771c9820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1277557019", "description": "tempest-description-1415128198"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:12.684503 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-327024d8-8fbe-4bc9-b430-64a138dfe535 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.438140 May 27 15:05:12.697452 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 912/1893] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:05:12 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:12.705441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-23e34d37-9f03-495b-94f8-ff53c08ab611 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:05:12.705880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-23e34d37-9f03-495b-94f8-ff53c08ab611 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:05:12.706365 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-23e34d37-9f03-495b-94f8-ff53c08ab611 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:05:12.706816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-23e34d37-9f03-495b-94f8-ff53c08ab611 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:05:12.707269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-23e34d37-9f03-495b-94f8-ff53c08ab611 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:05:12.714629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-983ed413-ff8f-459a-8ac5-c3d9d26798ab tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:12.719928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-983ed413-ff8f-459a-8ac5-c3d9d26798ab tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:12.720572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23e34d37-9f03-495b-94f8-ff53c08ab611 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:12.721077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23e34d37-9f03-495b-94f8-ff53c08ab611 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:12.721899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23e34d37-9f03-495b-94f8-ff53c08ab611 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:12.722438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23e34d37-9f03-495b-94f8-ff53c08ab611 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:12.728872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-983ed413-ff8f-459a-8ac5-c3d9d26798ab tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:12.730480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-983ed413-ff8f-459a-8ac5-c3d9d26798ab tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:12.731547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-983ed413-ff8f-459a-8ac5-c3d9d26798ab tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:12.732230 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-983ed413-ff8f-459a-8ac5-c3d9d26798ab tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:12.748530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-23e34d37-9f03-495b-94f8-ff53c08ab611 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Getting quotas for project b939a1a277f248fdaad387a445a9e780. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:05:12.755291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-23e34d37-9f03-495b-94f8-ff53c08ab611 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Getting quotas for user d3cb6de543d34fed9b582f5af0712790 and project b939a1a277f248fdaad387a445a9e780. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:05:12.771522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-23e34d37-9f03-495b-94f8-ff53c08ab611 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:05:12.774318 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-23e34d37-9f03-495b-94f8-ff53c08ab611 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:05:12.804098 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:12.848383 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-23e34d37-9f03-495b-94f8-ff53c08ab611 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.357736 May 27 15:05:12.850076 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 982/1894] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:05:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:05:12.856510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-09fa2a35-de2f-49e8-bbcf-a56fa61f28e2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:12.859853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-09fa2a35-de2f-49e8-bbcf-a56fa61f28e2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:12.871508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-09fa2a35-de2f-49e8-bbcf-a56fa61f28e2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:12.872337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-09fa2a35-de2f-49e8-bbcf-a56fa61f28e2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:12.873359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-09fa2a35-de2f-49e8-bbcf-a56fa61f28e2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:12.875501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-09fa2a35-de2f-49e8-bbcf-a56fa61f28e2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:12.939804 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-983ed413-ff8f-459a-8ac5-c3d9d26798ab tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.253198 May 27 15:05:12.940942 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 913/1895] 10.222.0.13 () {60 vars in 1315 bytes} [Fri May 27 15:05:12 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae/os-interface => generated 1831 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:13.055056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-82666dce-c936-4793-a22e-231bb1467164 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Action: 'create', calling method: .version_select at 0x7fc77729dd30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-999217455", "description": "tempest-description-92689243"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:13.573420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-09fa2a35-de2f-49e8-bbcf-a56fa61f28e2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:13.611586 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-09fa2a35-de2f-49e8-bbcf-a56fa61f28e2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.760048 May 27 15:05:13.626939 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 983/1896] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:12 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:13.647462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0d655304-eb41-422a-9572-2f0cd6ff5ef7 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Action: 'create', calling method: .version_select at 0x7fc780732790>, body: {"security_group_rule": {"parent_group_id": "d41386b9-cb4f-4def-a1f2-f463693c4ca2", "ip_protocol": "tcp", "from_port": 22, "to_port": 167891515}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:14.504251 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-82666dce-c936-4793-a22e-231bb1467164 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 1.561769 May 27 15:05:14.505678 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 914/1897] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:05:12 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:14.511532 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-0d655304-eb41-422a-9572-2f0cd6ff5ef7 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] HTTP exception thrown: Invalid port range 22:167891515. Valid TCP ports should be between 1-65535 May 27 15:05:14.513268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-efd330a9-922f-47d9-b034-561c79a7c18f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0d655304-eb41-422a-9572-2f0cd6ff5ef7 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Request method failure captured: May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 145 May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOigOC6k-TKgotDmEq4dCPsrirQu-gmSyIFfjjYgnl9qsZlRP4ZF70epoN40g53azK80B--6bZTGaBtEZWIlaimOgxmL6Epgur2JGTteusVGhGl1z-FAH9MLs0wc-vScN8SrI0hgtn7ODdVXSWrS6IT9oI5aFbFZmvb8Lr2qcZSlp8g May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: f9960d9840cb4c4ab7e67c2e6ee577c5 May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f9960d9840cb4c4ab7e67c2e6ee577c5", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: f9960d9840cb4c4ab7e67c2e6ee577c5 May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 38faf2d22aaf4794b0e7e6a67ad4f940 May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: {"security_group_rule": {"parent_group_id": "d41386b9-cb4f-4def-a1f2-f463693c4ca2", "ip_protocol": "tcp", "from_port": 22, "to_port": 167891515}} May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid port range 22:167891515. Valid TCP ports should be between 1-65535 May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd41386b9-cb4f-4def-a1f2-f463693c4ca2', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 167891515}}} May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:167891515. Valid TCP ports should be between 1-65535 May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:167891515. Valid TCP ports should be between 1-65535 May 27 15:05:14.513968 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:14.519742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:14.519742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:14.519742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:14.519742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:14.519742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:14.519742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:14.519742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:14.519742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:167891515. Valid TCP ports should be between 1-65535 May 27 15:05:14.519742 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:14.520488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-efd330a9-922f-47d9-b034-561c79a7c18f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 8f095e10-b6bc-4908-bc4f-6534231f3068] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:14.521444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0d655304-eb41-422a-9572-2f0cd6ff5ef7 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Returning 400 to user: Invalid port range 22:167891515. Valid TCP ports should be between 1-65535 {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:14.522525 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0d655304-eb41-422a-9572-2f0cd6ff5ef7 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.893849 May 27 15:05:14.530139 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 984/1898] 10.222.0.13 () {60 vars in 1194 bytes} [Fri May 27 15:05:13 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 902 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:05:14.535354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-18bf2dea-2588-4c34-bf27-53ecc03a279d tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:14.541914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-18bf2dea-2588-4c34-bf27-53ecc03a279d tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:14.552600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efd330a9-922f-47d9-b034-561c79a7c18f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:14.553895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efd330a9-922f-47d9-b034-561c79a7c18f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:14.555853 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efd330a9-922f-47d9-b034-561c79a7c18f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:14.557147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efd330a9-922f-47d9-b034-561c79a7c18f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:14.569777 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18bf2dea-2588-4c34-bf27-53ecc03a279d tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:14.570292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18bf2dea-2588-4c34-bf27-53ecc03a279d tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:14.571111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18bf2dea-2588-4c34-bf27-53ecc03a279d tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:14.571576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18bf2dea-2588-4c34-bf27-53ecc03a279d tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:14.750647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-18bf2dea-2588-4c34-bf27-53ecc03a279d tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:14.770736 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-18bf2dea-2588-4c34-bf27-53ecc03a279d tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1285 microversion: 2.1 time: 0.238467 May 27 15:05:14.772531 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 985/1899] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:14 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1285 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:14.789638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-78a55e30-3c97-44f2-86f8-1b47c48d9148 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:14.790616 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-78a55e30-3c97-44f2-86f8-1b47c48d9148 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:14.808277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78a55e30-3c97-44f2-86f8-1b47c48d9148 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:14.809109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78a55e30-3c97-44f2-86f8-1b47c48d9148 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:14.810166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78a55e30-3c97-44f2-86f8-1b47c48d9148 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:14.810849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78a55e30-3c97-44f2-86f8-1b47c48d9148 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:15.053357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-efd330a9-922f-47d9-b034-561c79a7c18f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:15.073181 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-efd330a9-922f-47d9-b034-561c79a7c18f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068" status: 200 len: 1471 microversion: 2.1 time: 0.558069 May 27 15:05:15.073961 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 915/1900] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:14 2022] GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068 => generated 1471 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:15.087782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aca4722c-1023-4f2a-b7a7-e88fa38b027e tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Action: 'create', calling method: .version_select at 0x7fc776b93dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-898500189", "description": "tempest-description-2144005806"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:15.192922 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-78a55e30-3c97-44f2-86f8-1b47c48d9148 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:15.211104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-78a55e30-3c97-44f2-86f8-1b47c48d9148 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:15.220169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-78a55e30-3c97-44f2-86f8-1b47c48d9148 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:15.221797 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-78a55e30-3c97-44f2-86f8-1b47c48d9148 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1476 microversion: 2.25 time: 0.436173 May 27 15:05:15.223103 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 986/1901] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:14 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1476 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:15.234728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1c5c95ff-5c84-4bc6-b574-108473d1f75b tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Action: 'create', calling method: .version_select at 0x7fc78081cee0>, body: {"security_group_rule": {"parent_group_id": "9eeeb3ff-5570-48e4-b16d-bbe54821e3cd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:15.295320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG neutronclient.v2_0.client [None req-1c5c95ff-5c84-4bc6-b574-108473d1f75b tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9eeeb3ff-5570-48e4-b16d-bbe54821e3cd does not exist", "detail": ""}} {{(pid=119248) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:05:15.296165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.security_group_api [None req-1c5c95ff-5c84-4bc6-b574-108473d1f75b tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Neutron security group 9eeeb3ff-5570-48e4-b16d-bbe54821e3cd not found {{(pid=119248) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 27 15:05:15.298495 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-1c5c95ff-5c84-4bc6-b574-108473d1f75b tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] HTTP exception thrown: Security group 9eeeb3ff-5570-48e4-b16d-bbe54821e3cd does not exist May 27 15:05:15.298495 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-db6a896e-1ffb-4665-8daf-4fd4cea07d5b'] May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1c5c95ff-5c84-4bc6-b574-108473d1f75b tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Request method failure captured: May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 138 May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOigOC6k-TKgotDmEq4dCPsrirQu-gmSyIFfjjYgnl9qsZlRP4ZF70epoN40g53azK80B--6bZTGaBtEZWIlaimOgxmL6Epgur2JGTteusVGhGl1z-FAH9MLs0wc-vScN8SrI0hgtn7ODdVXSWrS6IT9oI5aFbFZmvb8Lr2qcZSlp8g May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: f9960d9840cb4c4ab7e67c2e6ee577c5 May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f9960d9840cb4c4ab7e67c2e6ee577c5", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: f9960d9840cb4c4ab7e67c2e6ee577c5 May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 38faf2d22aaf4794b0e7e6a67ad4f940 May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: {"security_group_rule": {"parent_group_id": "9eeeb3ff-5570-48e4-b16d-bbe54821e3cd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: exception: Security group 9eeeb3ff-5570-48e4-b16d-bbe54821e3cd does not exist May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-db6a896e-1ffb-4665-8daf-4fd4cea07d5b'] May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9eeeb3ff-5570-48e4-b16d-bbe54821e3cd', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:05:15.301412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9eeeb3ff-5570-48e4-b16d-bbe54821e3cd does not exist May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db6a896e-1ffb-4665-8daf-4fd4cea07d5b'] May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9eeeb3ff-5570-48e4-b16d-bbe54821e3cd does not exist May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db6a896e-1ffb-4665-8daf-4fd4cea07d5b'] May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9eeeb3ff-5570-48e4-b16d-bbe54821e3cd does not exist May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db6a896e-1ffb-4665-8daf-4fd4cea07d5b'] May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9eeeb3ff-5570-48e4-b16d-bbe54821e3cd does not exist May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db6a896e-1ffb-4665-8daf-4fd4cea07d5b'] May 27 15:05:15.307138 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:15.317178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1c5c95ff-5c84-4bc6-b574-108473d1f75b tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Returning 404 to user: Security group 9eeeb3ff-5570-48e4-b16d-bbe54821e3cd does not exist May 27 15:05:15.317178 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-db6a896e-1ffb-4665-8daf-4fd4cea07d5b'] {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:15.317178 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1c5c95ff-5c84-4bc6-b574-108473d1f75b tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.090331 May 27 15:05:15.317178 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 987/1902] 10.222.0.13 () {60 vars in 1194 bytes} [Fri May 27 15:05:15 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:05:15.325512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6af6e218-a504-4a29-870c-37bcec325a9a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:15.326639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6af6e218-a504-4a29-870c-37bcec325a9a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:15.337503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6af6e218-a504-4a29-870c-37bcec325a9a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:15.344843 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6af6e218-a504-4a29-870c-37bcec325a9a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:15.366654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6af6e218-a504-4a29-870c-37bcec325a9a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:15.369644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6af6e218-a504-4a29-870c-37bcec325a9a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:15.694836 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-aca4722c-1023-4f2a-b7a7-e88fa38b027e tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.619080 May 27 15:05:15.695872 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 916/1903] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:05:15 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:15.713811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8a04024f-6f41-43be-8fce-daabcfa82c52 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '.version_select at 0x7fc776ede8b0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:15.717154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a04024f-6f41-43be-8fce-daabcfa82c52 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:15.722647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a04024f-6f41-43be-8fce-daabcfa82c52 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:15.792944 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8a04024f-6f41-43be-8fce-daabcfa82c52 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 1940 microversion: 2.25 time: 0.091546 May 27 15:05:15.793626 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 917/1904] 10.222.0.13 () {60 vars in 1183 bytes} [Fri May 27 15:05:15 2022] GET /compute/v2.1/os-migrations => generated 1940 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:15.814678 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d31c8b8b-fd66-4b3e-aa5d-861e7fea1a21 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Calling method '.version_select at 0x7fc77708a280>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:15.953464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG neutronclient.v2_0.client [None req-d31c8b8b-fd66-4b3e-aa5d-861e7fea1a21 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 2c6507fa-7336-4d45-bb48-3670617f351e does not exist", "detail": ""}} {{(pid=119249) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:05:15.954937 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.security_group_api [None req-d31c8b8b-fd66-4b3e-aa5d-861e7fea1a21 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Neutron security group rule 2c6507fa-7336-4d45-bb48-3670617f351e not found {{(pid=119249) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} May 27 15:05:15.956595 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-d31c8b8b-fd66-4b3e-aa5d-861e7fea1a21 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] HTTP exception thrown: Security group rule 2c6507fa-7336-4d45-bb48-3670617f351e does not exist May 27 15:05:15.956595 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-66732624-66b1-488f-a5ff-b435f2950902'] May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d31c8b8b-fd66-4b3e-aa5d-861e7fea1a21 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Request method failure captured: May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/os-security-group-rules/2c6507fa-7336-4d45-bb48-3670617f351e HTTP/1.1 May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOigOC6k-TKgotDmEq4dCPsrirQu-gmSyIFfjjYgnl9qsZlRP4ZF70epoN40g53azK80B--6bZTGaBtEZWIlaimOgxmL6Epgur2JGTteusVGhGl1z-FAH9MLs0wc-vScN8SrI0hgtn7ODdVXSWrS6IT9oI5aFbFZmvb8Lr2qcZSlp8g May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: f9960d9840cb4c4ab7e67c2e6ee577c5 May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f9960d9840cb4c4ab7e67c2e6ee577c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f9960d9840cb4c4ab7e67c2e6ee577c5", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: f9960d9840cb4c4ab7e67c2e6ee577c5 May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745 May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 38faf2d22aaf4794b0e7e6a67ad4f940 May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: exception: Security group rule 2c6507fa-7336-4d45-bb48-3670617f351e does not exist May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-66732624-66b1-488f-a5ff-b435f2950902'] May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '2c6507fa-7336-4d45-bb48-3670617f351e'} May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:05:15.961432 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 2c6507fa-7336-4d45-bb48-3670617f351e does not exist May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66732624-66b1-488f-a5ff-b435f2950902'] May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 2c6507fa-7336-4d45-bb48-3670617f351e does not exist May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66732624-66b1-488f-a5ff-b435f2950902'] May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 2c6507fa-7336-4d45-bb48-3670617f351e does not exist May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66732624-66b1-488f-a5ff-b435f2950902'] May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 2c6507fa-7336-4d45-bb48-3670617f351e does not exist May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66732624-66b1-488f-a5ff-b435f2950902'] May 27 15:05:15.971008 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:15.985095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d31c8b8b-fd66-4b3e-aa5d-861e7fea1a21 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Returning 404 to user: Security group rule 2c6507fa-7336-4d45-bb48-3670617f351e does not exist May 27 15:05:15.985095 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-66732624-66b1-488f-a5ff-b435f2950902'] {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:15.985095 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d31c8b8b-fd66-4b3e-aa5d-861e7fea1a21 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-group-rules/2c6507fa-7336-4d45-bb48-3670617f351e" status: 404 len: 199 microversion: 2.1 time: 0.172223 May 27 15:05:15.985095 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 918/1905] 10.222.0.13 () {58 vars in 1286 bytes} [Fri May 27 15:05:15 2022] DELETE /compute/v2.1/os-security-group-rules/2c6507fa-7336-4d45-bb48-3670617f351e => generated 199 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:05:15.995275 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-9de9953d-3890-49d4-a5b8-568d73f47455 req-290682e5-2a03-47cf-89cf-488ef6dfffa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f095e10-b6bc-4908-bc4f-6534231f3068", "name": "network-vif-deleted", "tag": "b0c9c218-f779-4474-993f-a4d8fac6fdd3"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:16.028456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-9de9953d-3890-49d4-a5b8-568d73f47455 req-290682e5-2a03-47cf-89cf-488ef6dfffa5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:16.032118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-9de9953d-3890-49d4-a5b8-568d73f47455 req-290682e5-2a03-47cf-89cf-488ef6dfffa5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:16.083325 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-9de9953d-3890-49d4-a5b8-568d73f47455 req-290682e5-2a03-47cf-89cf-488ef6dfffa5 service nova] Creating event network-vif-deleted:b0c9c218-f779-4474-993f-a4d8fac6fdd3 for instance 8f095e10-b6bc-4908-bc4f-6534231f3068 on n-h1-843621-1 May 27 15:05:16.106536 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-9de9953d-3890-49d4-a5b8-568d73f47455 req-290682e5-2a03-47cf-89cf-488ef6dfffa5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125068 May 27 15:05:16.109682 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 919/1906] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:16.131081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fa76cc13-ecd1-4c66-9bd3-ecfd657bd26e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:16.132267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fa76cc13-ecd1-4c66-9bd3-ecfd657bd26e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:16.158323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa76cc13-ecd1-4c66-9bd3-ecfd657bd26e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:16.160695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa76cc13-ecd1-4c66-9bd3-ecfd657bd26e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:16.162368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa76cc13-ecd1-4c66-9bd3-ecfd657bd26e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:16.165067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa76cc13-ecd1-4c66-9bd3-ecfd657bd26e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:16.253107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6af6e218-a504-4a29-870c-37bcec325a9a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:16.273396 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6af6e218-a504-4a29-870c-37bcec325a9a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.954197 May 27 15:05:16.274031 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 988/1907] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:15 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:16.279758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a8970fba-4899-4299-8245-a7048d0c5a98 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:16.281416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a8970fba-4899-4299-8245-a7048d0c5a98 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:16.292094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a8970fba-4899-4299-8245-a7048d0c5a98 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:16.294797 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a8970fba-4899-4299-8245-a7048d0c5a98 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:16.297213 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a8970fba-4899-4299-8245-a7048d0c5a98 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:16.298054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a8970fba-4899-4299-8245-a7048d0c5a98 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:16.360733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fa76cc13-ecd1-4c66-9bd3-ecfd657bd26e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:16.374513 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fa76cc13-ecd1-4c66-9bd3-ecfd657bd26e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1283 microversion: 2.1 time: 0.262692 May 27 15:05:16.375997 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 920/1908] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:16 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1283 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:16.384533 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1e28e0a6-9cb0-4826-9318-16871e9a1292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-785697931", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "2cdeb662-0950-451c-a0af-fa0b549f5c60"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:16.456915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-1e28e0a6-9cb0-4826-9318-16871e9a1292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] validate_networks() for [('2cdeb662-0950-451c-a0af-fa0b549f5c60', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:05:16.643451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-a8970fba-4899-4299-8245-a7048d0c5a98 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] Lazy-loading 'services' on Instance uuid 05873cb2-4587-4714-a252-49a90edbabd2 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:05:16.663038 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a8970fba-4899-4299-8245-a7048d0c5a98 tempest-LiveAutoBlockMigrationV225Test-1901853024 tempest-LiveAutoBlockMigrationV225Test-1901853024-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1968 microversion: 2.25 time: 0.386651 May 27 15:05:16.663650 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 989/1909] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:16 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1968 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:16.668857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-38da5e83-3bbe-468e-8c64-4d277b5e59be tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Calling method '.version_select at 0x7fc780747dc0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:17.227100 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-1e28e0a6-9cb0-4826-9318-16871e9a1292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:05:17.227785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-1e28e0a6-9cb0-4826-9318-16871e9a1292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:05:17.228416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-1e28e0a6-9cb0-4826-9318-16871e9a1292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:05:17.229264 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-1e28e0a6-9cb0-4826-9318-16871e9a1292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:05:17.230167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-1e28e0a6-9cb0-4826-9318-16871e9a1292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:05:17.232812 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-38da5e83-3bbe-468e-8c64-4d277b5e59be tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/d41386b9-cb4f-4def-a1f2-f463693c4ca2" status: 202 len: 0 microversion: 2.1 time: 0.567660 May 27 15:05:17.234445 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 990/1910] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:05:16 2022] DELETE /compute/v2.1/os-security-groups/d41386b9-cb4f-4def-a1f2-f463693c4ca2 => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:05:17.240481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-49c9ddee-f20b-4764-8916-9939d8dc7f30 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:17.241641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-49c9ddee-f20b-4764-8916-9939d8dc7f30 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 8f095e10-b6bc-4908-bc4f-6534231f3068] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:17.260147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-49c9ddee-f20b-4764-8916-9939d8dc7f30 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:17.261387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-49c9ddee-f20b-4764-8916-9939d8dc7f30 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:17.262412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-49c9ddee-f20b-4764-8916-9939d8dc7f30 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:17.263056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-49c9ddee-f20b-4764-8916-9939d8dc7f30 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:17.266034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1e28e0a6-9cb0-4826-9318-16871e9a1292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:17.266549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1e28e0a6-9cb0-4826-9318-16871e9a1292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:17.268064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1e28e0a6-9cb0-4826-9318-16871e9a1292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:17.268774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1e28e0a6-9cb0-4826-9318-16871e9a1292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:17.282680 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:17.284368 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-49c9ddee-f20b-4764-8916-9939d8dc7f30 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] HTTP exception thrown: Instance 8f095e10-b6bc-4908-bc4f-6534231f3068 could not be found. May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-49c9ddee-f20b-4764-8916-9939d8dc7f30 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Request method failure captured: May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068 HTTP/1.1 May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOfd5hdxLeIINzf1SGh8rcVIlOjIbaEfXQGyzTLmyQvSh4Xl0M97PMVOQYpMpAcyHD0h4iPPWz2VoG4iudcTpWdaEThkb3zz2WwK1_NStu3ayjQgrPJgz8YPOZlcPx0wS3ui17AvHHUaERlLugYwIFWbEzuGHXRywldg7ob0y3b_kdc May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: a081b119396543ad8ac9421acc677175 May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a081b119396543ad8ac9421acc677175"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a081b119396543ad8ac9421acc677175"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a081b119396543ad8ac9421acc677175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a081b119396543ad8ac9421acc677175", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: a081b119396543ad8ac9421acc677175 May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersOnMultiNodesTest-943751365-project May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: f426b883acdc49f8b0c4a9ba68e4572b May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersOnMultiNodesTest-943751365-project May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 8f095e10-b6bc-4908-bc4f-6534231f3068 could not be found. May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '8f095e10-b6bc-4908-bc4f-6534231f3068'} May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f095e10-b6bc-4908-bc4f-6534231f3068 could not be found. May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f095e10-b6bc-4908-bc4f-6534231f3068 could not be found. May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:17.286025 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:17.291419 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:17.291419 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:17.291419 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:17.291419 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:17.291419 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:17.291419 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f095e10-b6bc-4908-bc4f-6534231f3068 could not be found. May 27 15:05:17.291419 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:17.293307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-49c9ddee-f20b-4764-8916-9939d8dc7f30 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Returning 404 to user: Instance 8f095e10-b6bc-4908-bc4f-6534231f3068 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:17.294445 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-49c9ddee-f20b-4764-8916-9939d8dc7f30 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068" status: 404 len: 111 microversion: 2.1 time: 0.058683 May 27 15:05:17.295603 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 991/1911] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:17 2022] GET /compute/v2.1/servers/8f095e10-b6bc-4908-bc4f-6534231f3068 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:05:17.301624 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-2f29f9ef-c19f-402f-9a1a-a48b06e1a045 req-b1d55fdb-2698-4257-9433-83d7f1a02bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "tag": "48a86e26-7a18-41f0-bb5d-f642d2334344"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:17.310490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-1e28e0a6-9cb0-4826-9318-16871e9a1292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Getting quotas for project fa4b76a0ca994471bc3d779e67ad7bd8. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:05:17.314675 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2f29f9ef-c19f-402f-9a1a-a48b06e1a045 req-b1d55fdb-2698-4257-9433-83d7f1a02bb7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:17.315395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2f29f9ef-c19f-402f-9a1a-a48b06e1a045 req-b1d55fdb-2698-4257-9433-83d7f1a02bb7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:17.323783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-1e28e0a6-9cb0-4826-9318-16871e9a1292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Getting quotas for user 7a3bafe047b746dfb54a6d795292c0c0 and project fa4b76a0ca994471bc3d779e67ad7bd8. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:05:17.329784 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-2f29f9ef-c19f-402f-9a1a-a48b06e1a045 req-b1d55fdb-2698-4257-9433-83d7f1a02bb7 service nova] Creating event network-changed:48a86e26-7a18-41f0-bb5d-f642d2334344 for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:05:17.337392 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-2f29f9ef-c19f-402f-9a1a-a48b06e1a045 req-b1d55fdb-2698-4257-9433-83d7f1a02bb7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039407 May 27 15:05:17.343799 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 992/1912] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:17.350406 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ef3f615c-3781-48cf-85f7-87ee3c7aedfc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:17.351302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ef3f615c-3781-48cf-85f7-87ee3c7aedfc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:17.359241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef3f615c-3781-48cf-85f7-87ee3c7aedfc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:17.360157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef3f615c-3781-48cf-85f7-87ee3c7aedfc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:17.361322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef3f615c-3781-48cf-85f7-87ee3c7aedfc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:17.361991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef3f615c-3781-48cf-85f7-87ee3c7aedfc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:17.381511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1e28e0a6-9cb0-4826-9318-16871e9a1292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:05:17.387058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1e28e0a6-9cb0-4826-9318-16871e9a1292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:05:17.395706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ef3f615c-3781-48cf-85f7-87ee3c7aedfc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:05:17.473984 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1e28e0a6-9cb0-4826-9318-16871e9a1292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.093456 May 27 15:05:17.482417 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 921/1913] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:05:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:05:17.488573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bdaf5187-2f53-4895-a44b-01cdf90f5281 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Calling method '.version_select at 0x7fc7775b3940>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:17.556795 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ef3f615c-3781-48cf-85f7-87ee3c7aedfc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "DELETE /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 204 len: 0 microversion: 2.25 time: 0.207536 May 27 15:05:17.558129 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 993/1914] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:05:17 2022] DELETE /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:05:17.571001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-923d8f0e-729a-41cc-b575-7a1fd8705cfe tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:17.571869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-923d8f0e-729a-41cc-b575-7a1fd8705cfe tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:17.586918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-923d8f0e-729a-41cc-b575-7a1fd8705cfe tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:17.593583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-923d8f0e-729a-41cc-b575-7a1fd8705cfe tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:17.594861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-923d8f0e-729a-41cc-b575-7a1fd8705cfe tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:17.595660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-923d8f0e-729a-41cc-b575-7a1fd8705cfe tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:17.884164 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-923d8f0e-729a-41cc-b575-7a1fd8705cfe tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:17.943564 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-923d8f0e-729a-41cc-b575-7a1fd8705cfe tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.378792 May 27 15:05:17.945899 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 994/1915] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:17 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:17.966453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-531dea7c-38a5-4386-af47-ba9960966883 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:17.969254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-531dea7c-38a5-4386-af47-ba9960966883 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:17.983676 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bdaf5187-2f53-4895-a44b-01cdf90f5281 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/67ac1d8d-c589-4b02-a6c4-df61807bb456" status: 202 len: 0 microversion: 2.1 time: 0.499192 May 27 15:05:17.985320 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 922/1916] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:05:17 2022] DELETE /compute/v2.1/os-security-groups/67ac1d8d-c589-4b02-a6c4-df61807bb456 => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:05:17.994399 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-531dea7c-38a5-4386-af47-ba9960966883 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:17.995502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-531dea7c-38a5-4386-af47-ba9960966883 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:17.996589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-531dea7c-38a5-4386-af47-ba9960966883 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:17.997491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-531dea7c-38a5-4386-af47-ba9960966883 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:17.999863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-44ead559-0de3-4f35-a754-e774dd8f0612 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:18.000510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-44ead559-0de3-4f35-a754-e774dd8f0612 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:18.022731 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44ead559-0de3-4f35-a754-e774dd8f0612 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:18.041521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-531dea7c-38a5-4386-af47-ba9960966883 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:05:18.042768 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44ead559-0de3-4f35-a754-e774dd8f0612 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:18.047487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44ead559-0de3-4f35-a754-e774dd8f0612 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:18.047984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44ead559-0de3-4f35-a754-e774dd8f0612 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:18.231534 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-531dea7c-38a5-4386-af47-ba9960966883 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "DELETE /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e" status: 204 len: 0 microversion: 2.1 time: 0.281792 May 27 15:05:18.242963 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 995/1917] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:05:17 2022] DELETE /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:05:18.256943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a89fa3c8-1bde-4414-85f2-518013bbf6d0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:18.257982 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a89fa3c8-1bde-4414-85f2-518013bbf6d0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:18.266912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a89fa3c8-1bde-4414-85f2-518013bbf6d0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:18.267661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a89fa3c8-1bde-4414-85f2-518013bbf6d0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:18.268244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a89fa3c8-1bde-4414-85f2-518013bbf6d0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:18.268762 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a89fa3c8-1bde-4414-85f2-518013bbf6d0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:18.395008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a89fa3c8-1bde-4414-85f2-518013bbf6d0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:18.405484 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a89fa3c8-1bde-4414-85f2-518013bbf6d0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1219 microversion: 2.1 time: 0.162078 May 27 15:05:18.412404 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 996/1918] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:18 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1219 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:18.412404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cb1feae1-1af4-4c65-9594-d2aa8f9db0e4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:18.412779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cb1feae1-1af4-4c65-9594-d2aa8f9db0e4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:18.421436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb1feae1-1af4-4c65-9594-d2aa8f9db0e4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:18.422350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb1feae1-1af4-4c65-9594-d2aa8f9db0e4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:18.424052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb1feae1-1af4-4c65-9594-d2aa8f9db0e4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:18.424052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb1feae1-1af4-4c65-9594-d2aa8f9db0e4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:18.432614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-44ead559-0de3-4f35-a754-e774dd8f0612 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:18.446307 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-44ead559-0de3-4f35-a754-e774dd8f0612 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1325 microversion: 2.1 time: 0.458294 May 27 15:05:18.462035 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 923/1919] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:17 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1325 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:18.472572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-af588ee2-f35a-4be5-9452-9447e6a810be tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Calling method '.version_select at 0x7fc7770924c0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:19.039251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cb1feae1-1af4-4c65-9594-d2aa8f9db0e4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:19.048532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cb1feae1-1af4-4c65-9594-d2aa8f9db0e4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:19.050502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cb1feae1-1af4-4c65-9594-d2aa8f9db0e4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:19.051701 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cb1feae1-1af4-4c65-9594-d2aa8f9db0e4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1482 microversion: 2.25 time: 0.644255 May 27 15:05:19.052283 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 997/1920] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:18 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1482 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:19.062065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-88218628-77c1-4117-9a72-9b68de823883 req-7f3ddc58-c9fd-42dc-b6dd-82fdbadd637b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c473f1c8-4e5d-4141-94e1-0bc0af40797e", "tag": "8e11235b-24c3-4020-a8f1-f86e3040645f"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:19.073949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-88218628-77c1-4117-9a72-9b68de823883 req-7f3ddc58-c9fd-42dc-b6dd-82fdbadd637b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:19.074374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-88218628-77c1-4117-9a72-9b68de823883 req-7f3ddc58-c9fd-42dc-b6dd-82fdbadd637b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:19.088372 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-88218628-77c1-4117-9a72-9b68de823883 req-7f3ddc58-c9fd-42dc-b6dd-82fdbadd637b service nova] Creating event network-changed:8e11235b-24c3-4020-a8f1-f86e3040645f for instance c473f1c8-4e5d-4141-94e1-0bc0af40797e on n-h2-843621-1 May 27 15:05:19.094587 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-88218628-77c1-4117-9a72-9b68de823883 req-7f3ddc58-c9fd-42dc-b6dd-82fdbadd637b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040731 May 27 15:05:19.095208 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 998/1921] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:19.103618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e8913453-b35b-4265-80c5-4c8e34942a3d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:19.104326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e8913453-b35b-4265-80c5-4c8e34942a3d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:19.111415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e8913453-b35b-4265-80c5-4c8e34942a3d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:19.112200 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e8913453-b35b-4265-80c5-4c8e34942a3d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:19.113139 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e8913453-b35b-4265-80c5-4c8e34942a3d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:19.113579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e8913453-b35b-4265-80c5-4c8e34942a3d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:19.284035 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-af588ee2-f35a-4be5-9452-9447e6a810be tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/c5149dbd-45b0-45c3-8bd9-6d5116abc47b" status: 202 len: 0 microversion: 2.1 time: 0.819809 May 27 15:05:19.284901 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 924/1922] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:05:18 2022] DELETE /compute/v2.1/os-security-groups/c5149dbd-45b0-45c3-8bd9-6d5116abc47b => generated 0 bytes in 822 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:05:19.292859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-99fe937d-54d8-4482-b971-159c94627b86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:19.293589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-99fe937d-54d8-4482-b971-159c94627b86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:19.301464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99fe937d-54d8-4482-b971-159c94627b86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:19.302214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99fe937d-54d8-4482-b971-159c94627b86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:19.303480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99fe937d-54d8-4482-b971-159c94627b86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:19.304343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99fe937d-54d8-4482-b971-159c94627b86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:19.382432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e8913453-b35b-4265-80c5-4c8e34942a3d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:19.392048 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e8913453-b35b-4265-80c5-4c8e34942a3d tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e" status: 200 len: 1471 microversion: 2.1 time: 0.292513 May 27 15:05:19.392656 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 999/1923] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:19 2022] GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e => generated 1471 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:19.398204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7dec2a32-2933-4661-9fde-6e02a1440e77 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Calling method '.version_select at 0x7fc7807ff9d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:19.646860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-99fe937d-54d8-4482-b971-159c94627b86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:19.655143 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-99fe937d-54d8-4482-b971-159c94627b86 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.368547 May 27 15:05:19.655775 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 925/1924] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:19 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:19.669590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7e09f606-43c9-4e1b-b8d6-9dd5616c140a tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:19.670240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7e09f606-43c9-4e1b-b8d6-9dd5616c140a tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:19.678118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e09f606-43c9-4e1b-b8d6-9dd5616c140a tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:19.678118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e09f606-43c9-4e1b-b8d6-9dd5616c140a tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:19.678381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e09f606-43c9-4e1b-b8d6-9dd5616c140a tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:19.678737 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e09f606-43c9-4e1b-b8d6-9dd5616c140a tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:19.757609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7e09f606-43c9-4e1b-b8d6-9dd5616c140a tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:19.768921 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7e09f606-43c9-4e1b-b8d6-9dd5616c140a tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1219 microversion: 2.1 time: 0.111598 May 27 15:05:19.769656 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 926/1925] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:19 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:19.782882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7d44829b-a710-4793-9735-53487f128f8e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:19.782882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7d44829b-a710-4793-9735-53487f128f8e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:19.782882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d44829b-a710-4793-9735-53487f128f8e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:19.783308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d44829b-a710-4793-9735-53487f128f8e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:19.784917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d44829b-a710-4793-9735-53487f128f8e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:19.785551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d44829b-a710-4793-9735-53487f128f8e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:19.806157 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7dec2a32-2933-4661-9fde-6e02a1440e77 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/57d83206-3250-4b14-96b5-d0ba60d0d9a2" status: 202 len: 0 microversion: 2.1 time: 0.411994 May 27 15:05:19.806781 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1000/1926] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:05:19 2022] DELETE /compute/v2.1/os-security-groups/57d83206-3250-4b14-96b5-d0ba60d0d9a2 => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:05:19.816222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-321c3b33-963c-436e-84a1-0edcc0f35e9c req-74a5cc8f-e336-41df-bec9-716de1496bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05873cb2-4587-4714-a252-49a90edbabd2", "name": "network-vif-deleted", "tag": "94292363-2ffc-491a-a278-eb63c9334b1f"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:19.859317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-321c3b33-963c-436e-84a1-0edcc0f35e9c req-74a5cc8f-e336-41df-bec9-716de1496bde service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:19.860112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-321c3b33-963c-436e-84a1-0edcc0f35e9c req-74a5cc8f-e336-41df-bec9-716de1496bde service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:19.876731 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-321c3b33-963c-436e-84a1-0edcc0f35e9c req-74a5cc8f-e336-41df-bec9-716de1496bde service nova] Creating event network-vif-deleted:94292363-2ffc-491a-a278-eb63c9334b1f for instance 05873cb2-4587-4714-a252-49a90edbabd2 on n-h2-843621-1 May 27 15:05:19.882508 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-321c3b33-963c-436e-84a1-0edcc0f35e9c req-74a5cc8f-e336-41df-bec9-716de1496bde service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073979 May 27 15:05:19.883247 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1001/1927] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:19.889487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ccb4eef3-596b-4a08-83ee-65a9267552d0 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] Calling method '.version_select at 0x7fc78079cb80>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:20.001485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7d44829b-a710-4793-9735-53487f128f8e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:20.009431 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7d44829b-a710-4793-9735-53487f128f8e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1325 microversion: 2.1 time: 0.237929 May 27 15:05:20.010035 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 927/1928] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:19 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1325 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:20.074521 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f3b6e044-7bbb-4927-b42e-fdea6a9e7518 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:20.076025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f3b6e044-7bbb-4927-b42e-fdea6a9e7518 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:20.084603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3b6e044-7bbb-4927-b42e-fdea6a9e7518 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:20.085427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3b6e044-7bbb-4927-b42e-fdea6a9e7518 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:20.086647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3b6e044-7bbb-4927-b42e-fdea6a9e7518 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:20.087283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3b6e044-7bbb-4927-b42e-fdea6a9e7518 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:20.182646 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f3b6e044-7bbb-4927-b42e-fdea6a9e7518 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:20.194661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f3b6e044-7bbb-4927-b42e-fdea6a9e7518 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:20.196204 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f3b6e044-7bbb-4927-b42e-fdea6a9e7518 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:20.197488 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f3b6e044-7bbb-4927-b42e-fdea6a9e7518 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1265 microversion: 2.25 time: 0.129019 May 27 15:05:20.207957 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 928/1929] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:20 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:20.298197 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ccb4eef3-596b-4a08-83ee-65a9267552d0 tempest-SecurityGroupRulesNegativeTestJSON-1530319745 tempest-SecurityGroupRulesNegativeTestJSON-1530319745-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/5685083f-4804-424b-b6a6-fe3495bfd96f" status: 202 len: 0 microversion: 2.1 time: 0.413283 May 27 15:05:20.299439 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1002/1930] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:05:19 2022] DELETE /compute/v2.1/os-security-groups/5685083f-4804-424b-b6a6-fe3495bfd96f => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:05:20.414743 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e9fed16d-acb1-480d-bca8-ffe715525fed tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:20.416370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e9fed16d-acb1-480d-bca8-ffe715525fed tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:20.430887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9fed16d-acb1-480d-bca8-ffe715525fed tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:20.432503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9fed16d-acb1-480d-bca8-ffe715525fed tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:20.433907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9fed16d-acb1-480d-bca8-ffe715525fed tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:20.434661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9fed16d-acb1-480d-bca8-ffe715525fed tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:20.673941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9122ca54-23e6-4665-be11-9ccc783b1879 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:20.675639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9122ca54-23e6-4665-be11-9ccc783b1879 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:20.695881 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9122ca54-23e6-4665-be11-9ccc783b1879 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:20.697644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9122ca54-23e6-4665-be11-9ccc783b1879 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:20.699207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9122ca54-23e6-4665-be11-9ccc783b1879 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:20.708224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9122ca54-23e6-4665-be11-9ccc783b1879 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:20.726617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e9fed16d-acb1-480d-bca8-ffe715525fed tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:20.752931 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e9fed16d-acb1-480d-bca8-ffe715525fed tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e" status: 200 len: 1471 microversion: 2.1 time: 0.343239 May 27 15:05:20.762853 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 929/1931] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:20 2022] GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e => generated 1471 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:20.791531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ae1fc2e0-808d-4158-af3e-e92b7ee77e0a tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:20.792236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ae1fc2e0-808d-4158-af3e-e92b7ee77e0a tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:20.802173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae1fc2e0-808d-4158-af3e-e92b7ee77e0a tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:20.806426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae1fc2e0-808d-4158-af3e-e92b7ee77e0a tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:20.807500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae1fc2e0-808d-4158-af3e-e92b7ee77e0a tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:20.807970 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae1fc2e0-808d-4158-af3e-e92b7ee77e0a tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:20.948081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ae1fc2e0-808d-4158-af3e-e92b7ee77e0a tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:20.961589 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ae1fc2e0-808d-4158-af3e-e92b7ee77e0a tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1285 microversion: 2.1 time: 0.174117 May 27 15:05:20.973413 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 930/1932] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:20 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:05:21.008344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9122ca54-23e6-4665-be11-9ccc783b1879 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:21.020050 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9122ca54-23e6-4665-be11-9ccc783b1879 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.350497 May 27 15:05:21.027097 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1003/1933] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:20 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:21.035436 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-981cc715-ed4b-4606-86e1-094636b160b5 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:21.036184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-981cc715-ed4b-4606-86e1-094636b160b5 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:21.043263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-981cc715-ed4b-4606-86e1-094636b160b5 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:21.043736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-981cc715-ed4b-4606-86e1-094636b160b5 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:21.044567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-981cc715-ed4b-4606-86e1-094636b160b5 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:21.045055 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-981cc715-ed4b-4606-86e1-094636b160b5 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:21.216420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9325c702-e456-466e-8b59-4bf9c0e460f0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:21.218200 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9325c702-e456-466e-8b59-4bf9c0e460f0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:21.233689 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9325c702-e456-466e-8b59-4bf9c0e460f0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:21.234582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9325c702-e456-466e-8b59-4bf9c0e460f0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:21.237693 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9325c702-e456-466e-8b59-4bf9c0e460f0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:21.240211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9325c702-e456-466e-8b59-4bf9c0e460f0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:21.302685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-981cc715-ed4b-4606-86e1-094636b160b5 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:21.312801 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-981cc715-ed4b-4606-86e1-094636b160b5 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1325 microversion: 2.1 time: 0.288386 May 27 15:05:21.317810 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 931/1934] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:21 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1325 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:21.371696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9325c702-e456-466e-8b59-4bf9c0e460f0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:21.381185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9325c702-e456-466e-8b59-4bf9c0e460f0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:21.392622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9325c702-e456-466e-8b59-4bf9c0e460f0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:21.394063 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9325c702-e456-466e-8b59-4bf9c0e460f0 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1265 microversion: 2.25 time: 0.181606 May 27 15:05:21.394878 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1004/1935] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:21 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:21.771485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-21ea0e53-29a5-4c10-92da-35cac3545e78 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:21.772872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-21ea0e53-29a5-4c10-92da-35cac3545e78 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:21.781915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21ea0e53-29a5-4c10-92da-35cac3545e78 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:21.782827 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21ea0e53-29a5-4c10-92da-35cac3545e78 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:21.783950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21ea0e53-29a5-4c10-92da-35cac3545e78 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:21.784711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21ea0e53-29a5-4c10-92da-35cac3545e78 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:21.929917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-21ea0e53-29a5-4c10-92da-35cac3545e78 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:21.941612 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-21ea0e53-29a5-4c10-92da-35cac3545e78 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e" status: 200 len: 1429 microversion: 2.1 time: 0.173770 May 27 15:05:21.951011 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 932/1936] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:21 2022] GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e => generated 1429 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:21.979420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-51cfab3a-6ba2-4ca1-a043-68ed6284d8fb tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:21.979951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-51cfab3a-6ba2-4ca1-a043-68ed6284d8fb tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:21.986507 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51cfab3a-6ba2-4ca1-a043-68ed6284d8fb tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:21.986996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51cfab3a-6ba2-4ca1-a043-68ed6284d8fb tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:21.987860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51cfab3a-6ba2-4ca1-a043-68ed6284d8fb tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:21.988609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51cfab3a-6ba2-4ca1-a043-68ed6284d8fb tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:22.039975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d0e38110-f852-45ed-9d8b-fa44652265c3 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:22.040861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d0e38110-f852-45ed-9d8b-fa44652265c3 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:22.052507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d0e38110-f852-45ed-9d8b-fa44652265c3 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:22.053290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d0e38110-f852-45ed-9d8b-fa44652265c3 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:22.054450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d0e38110-f852-45ed-9d8b-fa44652265c3 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:22.055161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d0e38110-f852-45ed-9d8b-fa44652265c3 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:22.086984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-51cfab3a-6ba2-4ca1-a043-68ed6284d8fb tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:22.101281 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-51cfab3a-6ba2-4ca1-a043-68ed6284d8fb tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1273 microversion: 2.1 time: 0.125608 May 27 15:05:22.101883 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1005/1937] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:21 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1273 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:22.114093 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-52c01492-874b-4074-8c53-781acf747e2e req-114162b4-c8fc-423a-becf-b11bf04b7f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12d7cca3-a419-4171-b2f7-d3ea5eee2a0e", "name": "network-vif-deleted", "tag": "33ee41da-e298-4ee9-9a25-20564f1f7632"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:22.147515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-52c01492-874b-4074-8c53-781acf747e2e req-114162b4-c8fc-423a-becf-b11bf04b7f9c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:22.147954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-52c01492-874b-4074-8c53-781acf747e2e req-114162b4-c8fc-423a-becf-b11bf04b7f9c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:22.202690 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-52c01492-874b-4074-8c53-781acf747e2e req-114162b4-c8fc-423a-becf-b11bf04b7f9c service nova] Creating event network-vif-deleted:33ee41da-e298-4ee9-9a25-20564f1f7632 for instance 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e on n-h1-843621-1 May 27 15:05:22.222538 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-52c01492-874b-4074-8c53-781acf747e2e req-114162b4-c8fc-423a-becf-b11bf04b7f9c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112331 May 27 15:05:22.227750 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1006/1938] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:22.337909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-32144216-a25e-431e-b532-b3d6045f26e3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:22.339444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-32144216-a25e-431e-b532-b3d6045f26e3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:22.351218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d0e38110-f852-45ed-9d8b-fa44652265c3 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:22.374431 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d0e38110-f852-45ed-9d8b-fa44652265c3 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.337690 May 27 15:05:22.376505 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 933/1939] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:22 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:22.401528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32144216-a25e-431e-b532-b3d6045f26e3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:22.401528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32144216-a25e-431e-b532-b3d6045f26e3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:22.406243 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32144216-a25e-431e-b532-b3d6045f26e3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:22.412090 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32144216-a25e-431e-b532-b3d6045f26e3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:22.419566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-03403c4b-8192-4bdf-ac32-337129ff3e7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:22.421723 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-03403c4b-8192-4bdf-ac32-337129ff3e7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:22.440655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03403c4b-8192-4bdf-ac32-337129ff3e7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:22.442998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03403c4b-8192-4bdf-ac32-337129ff3e7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:22.444324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03403c4b-8192-4bdf-ac32-337129ff3e7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:22.446766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03403c4b-8192-4bdf-ac32-337129ff3e7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:22.733544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:22.755429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-03403c4b-8192-4bdf-ac32-337129ff3e7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:22.764071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:22.774875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-03403c4b-8192-4bdf-ac32-337129ff3e7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:22.780046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-03403c4b-8192-4bdf-ac32-337129ff3e7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:22.789617 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-03403c4b-8192-4bdf-ac32-337129ff3e7b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1265 microversion: 2.25 time: 0.378976 May 27 15:05:22.790918 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 934/1940] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:22 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1265 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:05:22.811965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bffed089-93b0-45b4-82bd-ad1971e512fc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:22.815558 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bffed089-93b0-45b4-82bd-ad1971e512fc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:22.841306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bffed089-93b0-45b4-82bd-ad1971e512fc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:22.849535 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bffed089-93b0-45b4-82bd-ad1971e512fc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:22.852059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bffed089-93b0-45b4-82bd-ad1971e512fc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:22.853810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bffed089-93b0-45b4-82bd-ad1971e512fc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:22.945636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bffed089-93b0-45b4-82bd-ad1971e512fc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:05:22.985476 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-32144216-a25e-431e-b532-b3d6045f26e3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:23.009163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:23.018361 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-32144216-a25e-431e-b532-b3d6045f26e3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1325 microversion: 2.1 time: 0.686325 May 27 15:05:23.024525 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1007/1941] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:22 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1325 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:23.049667 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8a367ccd-597b-4d42-b55a-3ad518e70031 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:23.052529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8a367ccd-597b-4d42-b55a-3ad518e70031 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:23.118254 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bffed089-93b0-45b4-82bd-ad1971e512fc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "DELETE /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 204 len: 0 microversion: 2.1 time: 0.324177 May 27 15:05:23.121137 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 935/1942] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:05:22 2022] DELETE /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:05:23.134268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5d9c299c-8a63-40ec-836f-08582477ae05 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:23.135681 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5d9c299c-8a63-40ec-836f-08582477ae05 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:23.141597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a367ccd-597b-4d42-b55a-3ad518e70031 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:23.146915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a367ccd-597b-4d42-b55a-3ad518e70031 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:23.154237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a367ccd-597b-4d42-b55a-3ad518e70031 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:23.155685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a367ccd-597b-4d42-b55a-3ad518e70031 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:23.155956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d9c299c-8a63-40ec-836f-08582477ae05 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:23.157356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d9c299c-8a63-40ec-836f-08582477ae05 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:23.159281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d9c299c-8a63-40ec-836f-08582477ae05 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:23.160435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d9c299c-8a63-40ec-836f-08582477ae05 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:23.239289 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-8a367ccd-597b-4d42-b55a-3ad518e70031 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] HTTP exception thrown: Instance 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e could not be found. May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8a367ccd-597b-4d42-b55a-3ad518e70031 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Request method failure captured: May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e HTTP/1.1 May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOfd5hdxLeIINzf1SGh8rcVIlOjIbaEfXQGyzTLmyQvSh4Xl0M97PMVOQYpMpAcyHD0h4iPPWz2VoG4iudcTpWdaEThkb3zz2WwK1_NStu3ayjQgrPJgz8YPOZlcPx0wS3ui17AvHHUaERlLugYwIFWbEzuGHXRywldg7ob0y3b_kdc May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: a081b119396543ad8ac9421acc677175 May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a081b119396543ad8ac9421acc677175"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a081b119396543ad8ac9421acc677175"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a081b119396543ad8ac9421acc677175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a081b119396543ad8ac9421acc677175", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: a081b119396543ad8ac9421acc677175 May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersOnMultiNodesTest-943751365-project May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: f426b883acdc49f8b0c4a9ba68e4572b May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersOnMultiNodesTest-943751365-project May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e could not be found. May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '12d7cca3-a419-4171-b2f7-d3ea5eee2a0e'} May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e could not be found. May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e could not be found. May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:23.246618 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:23.257220 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:23.257220 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:23.257220 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:23.257220 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:23.257220 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:23.257220 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e could not be found. May 27 15:05:23.257220 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:23.276933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8a367ccd-597b-4d42-b55a-3ad518e70031 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Returning 404 to user: Instance 12d7cca3-a419-4171-b2f7-d3ea5eee2a0e could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:23.283414 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8a367ccd-597b-4d42-b55a-3ad518e70031 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e" status: 404 len: 111 microversion: 2.1 time: 0.253590 May 27 15:05:23.287882 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1008/1943] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:23 2022] GET /compute/v2.1/servers/12d7cca3-a419-4171-b2f7-d3ea5eee2a0e => generated 111 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:05:23.310561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c3a3af1b-4134-45e2-a577-c786d6c9b4f8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:23.313770 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c3a3af1b-4134-45e2-a577-c786d6c9b4f8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:23.346434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3a3af1b-4134-45e2-a577-c786d6c9b4f8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:23.346965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3a3af1b-4134-45e2-a577-c786d6c9b4f8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:23.351761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3a3af1b-4134-45e2-a577-c786d6c9b4f8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:23.352233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3a3af1b-4134-45e2-a577-c786d6c9b4f8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:23.549180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5d9c299c-8a63-40ec-836f-08582477ae05 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:23.561633 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5d9c299c-8a63-40ec-836f-08582477ae05 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1315 microversion: 2.1 time: 0.438855 May 27 15:05:23.566984 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 936/1944] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:23 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:23.579845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a4e32154-5b5b-4b41-8ec0-003be85a07bc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:23.580928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a4e32154-5b5b-4b41-8ec0-003be85a07bc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: ea226b76-3184-469f-93c4-adbf4286a9e3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:23.588442 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4e32154-5b5b-4b41-8ec0-003be85a07bc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:23.589349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4e32154-5b5b-4b41-8ec0-003be85a07bc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:23.591801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4e32154-5b5b-4b41-8ec0-003be85a07bc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:23.593346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4e32154-5b5b-4b41-8ec0-003be85a07bc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:23.642299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a4e32154-5b5b-4b41-8ec0-003be85a07bc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: ea226b76-3184-469f-93c4-adbf4286a9e3] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:05:23.704026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c3a3af1b-4134-45e2-a577-c786d6c9b4f8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:23.721139 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c3a3af1b-4134-45e2-a577-c786d6c9b4f8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1553 microversion: 2.1 time: 0.428804 May 27 15:05:23.735344 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1009/1945] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:23 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1553 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:23.742108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1344bb90-16c2-4cbc-a2e7-4de6af622861 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:23.743245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1344bb90-16c2-4cbc-a2e7-4de6af622861 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:23.753015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1344bb90-16c2-4cbc-a2e7-4de6af622861 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:23.753920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1344bb90-16c2-4cbc-a2e7-4de6af622861 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:23.755212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1344bb90-16c2-4cbc-a2e7-4de6af622861 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:23.756953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1344bb90-16c2-4cbc-a2e7-4de6af622861 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:23.791877 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:23.837637 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a4e32154-5b5b-4b41-8ec0-003be85a07bc tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ea226b76-3184-469f-93c4-adbf4286a9e3" status: 204 len: 0 microversion: 2.1 time: 0.265656 May 27 15:05:23.838311 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 937/1946] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:05:23 2022] DELETE /compute/v2.1/servers/ea226b76-3184-469f-93c4-adbf4286a9e3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:05:23.857216 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e17e59b8-477b-42db-9381-007b702e404f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:23.857986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e17e59b8-477b-42db-9381-007b702e404f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:23.876655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e17e59b8-477b-42db-9381-007b702e404f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:23.877164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e17e59b8-477b-42db-9381-007b702e404f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:23.877944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e17e59b8-477b-42db-9381-007b702e404f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:23.878624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e17e59b8-477b-42db-9381-007b702e404f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:24.002120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1344bb90-16c2-4cbc-a2e7-4de6af622861 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:24.018716 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1344bb90-16c2-4cbc-a2e7-4de6af622861 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.281358 May 27 15:05:24.019954 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1010/1947] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:23 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:24.028143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e17e59b8-477b-42db-9381-007b702e404f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:24.039710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-32eb70b5-75c8-4392-92e1-1cc7e4800481 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:24.040577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-32eb70b5-75c8-4392-92e1-1cc7e4800481 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 5c5472e6-8234-4e99-935f-7798245c1d2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:24.055299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32eb70b5-75c8-4392-92e1-1cc7e4800481 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:24.060971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e17e59b8-477b-42db-9381-007b702e404f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:24.063575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e17e59b8-477b-42db-9381-007b702e404f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:24.065643 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e17e59b8-477b-42db-9381-007b702e404f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1265 microversion: 2.25 time: 0.217743 May 27 15:05:24.067971 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 938/1948] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:23 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:24.068324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32eb70b5-75c8-4392-92e1-1cc7e4800481 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:24.071987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32eb70b5-75c8-4392-92e1-1cc7e4800481 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:24.072605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32eb70b5-75c8-4392-92e1-1cc7e4800481 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:24.082066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3afc253c-8ae2-4197-8f68-5673f4cdfe6d tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:24.083387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3afc253c-8ae2-4197-8f68-5673f4cdfe6d tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:24.102073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3afc253c-8ae2-4197-8f68-5673f4cdfe6d tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:24.102540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3afc253c-8ae2-4197-8f68-5673f4cdfe6d tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:24.104997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3afc253c-8ae2-4197-8f68-5673f4cdfe6d tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:24.105491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3afc253c-8ae2-4197-8f68-5673f4cdfe6d tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:24.118933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-32eb70b5-75c8-4392-92e1-1cc7e4800481 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 5c5472e6-8234-4e99-935f-7798245c1d2f] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:05:24.337864 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-32eb70b5-75c8-4392-92e1-1cc7e4800481 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f" status: 204 len: 0 microversion: 2.1 time: 0.315794 May 27 15:05:24.343781 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1011/1949] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:05:24 2022] DELETE /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:05:24.366143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-883b0112-8670-48a1-8203-f4da4d3a7c73 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:24.367210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-883b0112-8670-48a1-8203-f4da4d3a7c73 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: ea226b76-3184-469f-93c4-adbf4286a9e3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:24.387341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-883b0112-8670-48a1-8203-f4da4d3a7c73 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:24.388876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-883b0112-8670-48a1-8203-f4da4d3a7c73 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:24.395522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3afc253c-8ae2-4197-8f68-5673f4cdfe6d tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:24.402249 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-883b0112-8670-48a1-8203-f4da4d3a7c73 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:24.405101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-883b0112-8670-48a1-8203-f4da4d3a7c73 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:24.408023 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3afc253c-8ae2-4197-8f68-5673f4cdfe6d tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1325 microversion: 2.1 time: 0.334537 May 27 15:05:24.410733 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 939/1950] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:24 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1325 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:24.517358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-e53ceeb2-5bbb-4941-8461-e69d43343dbf req-aa797e61-2fc4-4bba-8a20-65779d61bb5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a4ac567-1148-41b4-80eb-6fb25fae7b7c", "tag": "103f073e-4e7b-4dab-9558-27baab47f022"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:24.535030 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-e53ceeb2-5bbb-4941-8461-e69d43343dbf req-aa797e61-2fc4-4bba-8a20-65779d61bb5d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:24.535862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-e53ceeb2-5bbb-4941-8461-e69d43343dbf req-aa797e61-2fc4-4bba-8a20-65779d61bb5d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:24.550119 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-e53ceeb2-5bbb-4941-8461-e69d43343dbf req-aa797e61-2fc4-4bba-8a20-65779d61bb5d service nova] Creating event network-changed:103f073e-4e7b-4dab-9558-27baab47f022 for instance 3a4ac567-1148-41b4-80eb-6fb25fae7b7c on n-h1-843621-1 May 27 15:05:24.563267 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-e53ceeb2-5bbb-4941-8461-e69d43343dbf req-aa797e61-2fc4-4bba-8a20-65779d61bb5d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054286 May 27 15:05:24.564712 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 940/1951] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:05:24.591226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6661a1b3-c8cb-4aaf-9fc9-b63490bc4509 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:24.592485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6661a1b3-c8cb-4aaf-9fc9-b63490bc4509 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:24.603557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6661a1b3-c8cb-4aaf-9fc9-b63490bc4509 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:24.604334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6661a1b3-c8cb-4aaf-9fc9-b63490bc4509 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:24.605731 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6661a1b3-c8cb-4aaf-9fc9-b63490bc4509 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:24.606505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6661a1b3-c8cb-4aaf-9fc9-b63490bc4509 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:24.673165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-883b0112-8670-48a1-8203-f4da4d3a7c73 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:24.692311 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-883b0112-8670-48a1-8203-f4da4d3a7c73 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/ea226b76-3184-469f-93c4-adbf4286a9e3" status: 200 len: 1475 microversion: 2.1 time: 0.346005 May 27 15:05:24.706146 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1012/1952] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:24 2022] GET /compute/v2.1/servers/ea226b76-3184-469f-93c4-adbf4286a9e3 => generated 1475 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:24.752724 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-147fc619-d636-43f8-af42-558f88ab939b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:24.753808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-147fc619-d636-43f8-af42-558f88ab939b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:24.763670 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-147fc619-d636-43f8-af42-558f88ab939b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:24.764472 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-147fc619-d636-43f8-af42-558f88ab939b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:24.765789 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-147fc619-d636-43f8-af42-558f88ab939b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:24.768063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-147fc619-d636-43f8-af42-558f88ab939b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:24.812653 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6661a1b3-c8cb-4aaf-9fc9-b63490bc4509 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:24.825253 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6661a1b3-c8cb-4aaf-9fc9-b63490bc4509 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1315 microversion: 2.1 time: 0.239619 May 27 15:05:24.826635 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 941/1953] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:24 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:05:24.970542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-147fc619-d636-43f8-af42-558f88ab939b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:24.980317 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-147fc619-d636-43f8-af42-558f88ab939b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1553 microversion: 2.1 time: 0.242525 May 27 15:05:24.981166 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1013/1954] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:24 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1553 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:05:25.014460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-68dacb05-a466-40ea-a1ef-34f831c19e44 tempest-AZV2TestJSON-1831597322 tempest-AZV2TestJSON-1831597322-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:25.016092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68dacb05-a466-40ea-a1ef-34f831c19e44 tempest-AZV2TestJSON-1831597322 tempest-AZV2TestJSON-1831597322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:25.016566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68dacb05-a466-40ea-a1ef-34f831c19e44 tempest-AZV2TestJSON-1831597322 tempest-AZV2TestJSON-1831597322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:25.017410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68dacb05-a466-40ea-a1ef-34f831c19e44 tempest-AZV2TestJSON-1831597322 tempest-AZV2TestJSON-1831597322-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:25.017841 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68dacb05-a466-40ea-a1ef-34f831c19e44 tempest-AZV2TestJSON-1831597322 tempest-AZV2TestJSON-1831597322-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:25.041231 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-68dacb05-a466-40ea-a1ef-34f831c19e44 tempest-AZV2TestJSON-1831597322 tempest-AZV2TestJSON-1831597322-project] 10.222.0.13 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.203057 May 27 15:05:25.042077 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 942/1955] 10.222.0.13 () {58 vars in 1163 bytes} [Fri May 27 15:05:24 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:05:25.048104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-df1d51e5-7eac-48a1-bf90-08a183248d44 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:25.048850 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-df1d51e5-7eac-48a1-bf90-08a183248d44 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:25.058013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df1d51e5-7eac-48a1-bf90-08a183248d44 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:25.058478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df1d51e5-7eac-48a1-bf90-08a183248d44 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:25.059276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df1d51e5-7eac-48a1-bf90-08a183248d44 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:25.059723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df1d51e5-7eac-48a1-bf90-08a183248d44 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:25.106933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-52a0e85b-f140-4de6-963b-3f738c02fbda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:25.108702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-52a0e85b-f140-4de6-963b-3f738c02fbda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:25.117760 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52a0e85b-f140-4de6-963b-3f738c02fbda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:25.118642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52a0e85b-f140-4de6-963b-3f738c02fbda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:25.119896 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52a0e85b-f140-4de6-963b-3f738c02fbda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:25.120502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52a0e85b-f140-4de6-963b-3f738c02fbda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:25.215612 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-52a0e85b-f140-4de6-963b-3f738c02fbda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:25.227599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-52a0e85b-f140-4de6-963b-3f738c02fbda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:25.230154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-52a0e85b-f140-4de6-963b-3f738c02fbda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:25.233696 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-52a0e85b-f140-4de6-963b-3f738c02fbda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1265 microversion: 2.25 time: 0.134309 May 27 15:05:25.247258 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 943/1956] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:25 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:25.281966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-df1d51e5-7eac-48a1-bf90-08a183248d44 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:25.302652 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-df1d51e5-7eac-48a1-bf90-08a183248d44 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.256238 May 27 15:05:25.303369 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1014/1957] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:25 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:05:25.435673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3f7cd136-52f2-4394-a152-4746cc9a32fa tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:25.437164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3f7cd136-52f2-4394-a152-4746cc9a32fa tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:25.447824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f7cd136-52f2-4394-a152-4746cc9a32fa tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:25.448384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f7cd136-52f2-4394-a152-4746cc9a32fa tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:25.448876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f7cd136-52f2-4394-a152-4746cc9a32fa tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:25.450050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f7cd136-52f2-4394-a152-4746cc9a32fa tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:25.627846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3f7cd136-52f2-4394-a152-4746cc9a32fa tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:25.648620 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3f7cd136-52f2-4394-a152-4746cc9a32fa tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1325 microversion: 2.1 time: 0.216596 May 27 15:05:25.649567 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 944/1958] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:25 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1325 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:25.730081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-11736620-1c77-446f-b774-721fca9eba07 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:25.731693 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-11736620-1c77-446f-b774-721fca9eba07 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: ea226b76-3184-469f-93c4-adbf4286a9e3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:25.746586 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-11736620-1c77-446f-b774-721fca9eba07 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:25.747321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-11736620-1c77-446f-b774-721fca9eba07 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:25.749298 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-11736620-1c77-446f-b774-721fca9eba07 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:25.750099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-11736620-1c77-446f-b774-721fca9eba07 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:25.856510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4ce0aacc-fc14-4a00-a7d4-81e4f3c448c3 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:25.857803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4ce0aacc-fc14-4a00-a7d4-81e4f3c448c3 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:25.900468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4ce0aacc-fc14-4a00-a7d4-81e4f3c448c3 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:25.901997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4ce0aacc-fc14-4a00-a7d4-81e4f3c448c3 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:25.904556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4ce0aacc-fc14-4a00-a7d4-81e4f3c448c3 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:25.905939 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4ce0aacc-fc14-4a00-a7d4-81e4f3c448c3 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:26.111993 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-11736620-1c77-446f-b774-721fca9eba07 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:26.134621 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-11736620-1c77-446f-b774-721fca9eba07 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/ea226b76-3184-469f-93c4-adbf4286a9e3" status: 200 len: 1475 microversion: 2.1 time: 0.417915 May 27 15:05:26.146628 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1015/1959] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:25 2022] GET /compute/v2.1/servers/ea226b76-3184-469f-93c4-adbf4286a9e3 => generated 1475 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:26.153258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-82d1ad93-93c3-4857-af5c-22d5c616ae5e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:26.154118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-82d1ad93-93c3-4857-af5c-22d5c616ae5e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:26.164290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82d1ad93-93c3-4857-af5c-22d5c616ae5e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:26.165060 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82d1ad93-93c3-4857-af5c-22d5c616ae5e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:26.167104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82d1ad93-93c3-4857-af5c-22d5c616ae5e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:26.168841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82d1ad93-93c3-4857-af5c-22d5c616ae5e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:26.421690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4ce0aacc-fc14-4a00-a7d4-81e4f3c448c3 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:26.435540 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4ce0aacc-fc14-4a00-a7d4-81e4f3c448c3 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1315 microversion: 2.1 time: 0.593015 May 27 15:05:26.437570 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 945/1960] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:25 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:26.457582 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-73703fd1-ff75-4fc9-9105-3cacab1d6883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:26.462290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-73703fd1-ff75-4fc9-9105-3cacab1d6883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:26.480933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73703fd1-ff75-4fc9-9105-3cacab1d6883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:26.483689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73703fd1-ff75-4fc9-9105-3cacab1d6883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:26.484755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73703fd1-ff75-4fc9-9105-3cacab1d6883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:26.489799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73703fd1-ff75-4fc9-9105-3cacab1d6883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:26.704336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-73703fd1-ff75-4fc9-9105-3cacab1d6883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:26.714549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-73703fd1-ff75-4fc9-9105-3cacab1d6883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:26.721893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-73703fd1-ff75-4fc9-9105-3cacab1d6883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:26.725911 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-73703fd1-ff75-4fc9-9105-3cacab1d6883 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1265 microversion: 2.25 time: 0.283990 May 27 15:05:26.729061 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 946/1961] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:26 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:26.744005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d88773f5-13c7-4927-8b55-710e10314174 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:26.749661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d88773f5-13c7-4927-8b55-710e10314174 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:26.767110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d88773f5-13c7-4927-8b55-710e10314174 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:26.769277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d88773f5-13c7-4927-8b55-710e10314174 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:26.769277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d88773f5-13c7-4927-8b55-710e10314174 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:26.774722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d88773f5-13c7-4927-8b55-710e10314174 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:26.778070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-82d1ad93-93c3-4857-af5c-22d5c616ae5e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:26.797011 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-82d1ad93-93c3-4857-af5c-22d5c616ae5e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1553 microversion: 2.1 time: 0.647587 May 27 15:05:26.798975 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1016/1962] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:26 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1553 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:26.821741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-71671328-d40d-4e7d-b9b6-ceda72de0b65 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:26.825374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-71671328-d40d-4e7d-b9b6-ceda72de0b65 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:26.843458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-71671328-d40d-4e7d-b9b6-ceda72de0b65 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:26.844364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-71671328-d40d-4e7d-b9b6-ceda72de0b65 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:26.845510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-71671328-d40d-4e7d-b9b6-ceda72de0b65 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:26.851768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-71671328-d40d-4e7d-b9b6-ceda72de0b65 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:27.348022 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d88773f5-13c7-4927-8b55-710e10314174 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:27.362771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-71671328-d40d-4e7d-b9b6-ceda72de0b65 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:27.364422 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:27.373027 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-71671328-d40d-4e7d-b9b6-ceda72de0b65 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1325 microversion: 2.1 time: 0.559829 May 27 15:05:27.379196 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1017/1963] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:26 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1325 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:27.384001 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d88773f5-13c7-4927-8b55-710e10314174 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.653212 May 27 15:05:27.389125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-06eeaab9-25b3-48a8-95e7-d9401d0e37b8 req-ccd11f78-48bd-4319-8330-f662932c552e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c473f1c8-4e5d-4141-94e1-0bc0af40797e", "name": "network-vif-plugged", "status": "completed", "tag": "8e11235b-24c3-4020-a8f1-f86e3040645f"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:27.399357 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 947/1964] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:26 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:27.412547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d60f0a13-716b-424f-9bcc-dfdd5fd6e43a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:27.413149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d60f0a13-716b-424f-9bcc-dfdd5fd6e43a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: ea226b76-3184-469f-93c4-adbf4286a9e3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:27.418556 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-06eeaab9-25b3-48a8-95e7-d9401d0e37b8 req-ccd11f78-48bd-4319-8330-f662932c552e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:27.425423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-06eeaab9-25b3-48a8-95e7-d9401d0e37b8 req-ccd11f78-48bd-4319-8330-f662932c552e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:27.450661 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-06eeaab9-25b3-48a8-95e7-d9401d0e37b8 req-ccd11f78-48bd-4319-8330-f662932c552e service nova] Creating event network-vif-plugged:8e11235b-24c3-4020-a8f1-f86e3040645f for instance c473f1c8-4e5d-4141-94e1-0bc0af40797e on n-h2-843621-1 May 27 15:05:27.452916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d60f0a13-716b-424f-9bcc-dfdd5fd6e43a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:27.460256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d60f0a13-716b-424f-9bcc-dfdd5fd6e43a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:27.463008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d60f0a13-716b-424f-9bcc-dfdd5fd6e43a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:27.465392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d60f0a13-716b-424f-9bcc-dfdd5fd6e43a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:27.475690 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-06eeaab9-25b3-48a8-95e7-d9401d0e37b8 req-ccd11f78-48bd-4319-8330-f662932c552e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094938 May 27 15:05:27.478088 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1018/1965] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:27.491188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c3b482cb-9569-4c9f-97f4-bc017dfd94d5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:27.498019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c3b482cb-9569-4c9f-97f4-bc017dfd94d5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:27.524773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3b482cb-9569-4c9f-97f4-bc017dfd94d5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:27.525407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3b482cb-9569-4c9f-97f4-bc017dfd94d5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:27.526413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3b482cb-9569-4c9f-97f4-bc017dfd94d5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:27.529350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3b482cb-9569-4c9f-97f4-bc017dfd94d5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:28.229315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c3b482cb-9569-4c9f-97f4-bc017dfd94d5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:28.250267 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c3b482cb-9569-4c9f-97f4-bc017dfd94d5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1315 microversion: 2.1 time: 0.769766 May 27 15:05:28.254624 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1019/1966] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:27 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1315 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:28.291194 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d60f0a13-716b-424f-9bcc-dfdd5fd6e43a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:28.302746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-cfdb59f5-6927-4e60-b1c5-2938e94ab2b9 req-1bcceee8-55c4-4927-8532-35e58376d231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74741255-3451-4856-af14-5320fa7e2d76", "name": "network-vif-deleted", "tag": "faeab52a-27e8-41e2-9430-1f0c5cc36535"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:28.330719 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d60f0a13-716b-424f-9bcc-dfdd5fd6e43a tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/ea226b76-3184-469f-93c4-adbf4286a9e3" status: 200 len: 1475 microversion: 2.1 time: 0.930036 May 27 15:05:28.335985 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 948/1967] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:27 2022] GET /compute/v2.1/servers/ea226b76-3184-469f-93c4-adbf4286a9e3 => generated 1475 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:28.356366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-005e2e89-aced-477c-9126-0486be717e08 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:28.362072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-005e2e89-aced-477c-9126-0486be717e08 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:28.372610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-cfdb59f5-6927-4e60-b1c5-2938e94ab2b9 req-1bcceee8-55c4-4927-8532-35e58376d231 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:28.373163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-cfdb59f5-6927-4e60-b1c5-2938e94ab2b9 req-1bcceee8-55c4-4927-8532-35e58376d231 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:28.393528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-005e2e89-aced-477c-9126-0486be717e08 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:28.399372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-005e2e89-aced-477c-9126-0486be717e08 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:28.401641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-005e2e89-aced-477c-9126-0486be717e08 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:28.406305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-005e2e89-aced-477c-9126-0486be717e08 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:28.495731 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-cfdb59f5-6927-4e60-b1c5-2938e94ab2b9 req-1bcceee8-55c4-4927-8532-35e58376d231 service nova] Creating event network-vif-deleted:faeab52a-27e8-41e2-9430-1f0c5cc36535 for instance 74741255-3451-4856-af14-5320fa7e2d76 on n-h2-843621-1 May 27 15:05:28.504123 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-cfdb59f5-6927-4e60-b1c5-2938e94ab2b9 req-1bcceee8-55c4-4927-8532-35e58376d231 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240600 May 27 15:05:28.505875 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1020/1968] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:28.519013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ec687c0f-3ed1-4147-8256-595c61947978 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:28.520079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ec687c0f-3ed1-4147-8256-595c61947978 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:28.542528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec687c0f-3ed1-4147-8256-595c61947978 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:28.544238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec687c0f-3ed1-4147-8256-595c61947978 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:28.545304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec687c0f-3ed1-4147-8256-595c61947978 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:28.548615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec687c0f-3ed1-4147-8256-595c61947978 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:28.552212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-005e2e89-aced-477c-9126-0486be717e08 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:28.563747 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-005e2e89-aced-477c-9126-0486be717e08 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:28.567687 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-005e2e89-aced-477c-9126-0486be717e08 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:28.570860 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-005e2e89-aced-477c-9126-0486be717e08 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1265 microversion: 2.25 time: 0.232860 May 27 15:05:28.572538 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 949/1969] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:28 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:28.583304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-0b7b3c23-0b0d-47f2-95f4-33ba92528674 req-e61cbb0c-9583-4756-9673-b46b90086c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea226b76-3184-469f-93c4-adbf4286a9e3", "name": "network-vif-deleted", "tag": "dfab4598-069d-4d01-bdf9-cd9448feb574"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:28.611401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0b7b3c23-0b0d-47f2-95f4-33ba92528674 req-e61cbb0c-9583-4756-9673-b46b90086c79 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:28.612854 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0b7b3c23-0b0d-47f2-95f4-33ba92528674 req-e61cbb0c-9583-4756-9673-b46b90086c79 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:28.658033 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-0b7b3c23-0b0d-47f2-95f4-33ba92528674 req-e61cbb0c-9583-4756-9673-b46b90086c79 service nova] Creating event network-vif-deleted:dfab4598-069d-4d01-bdf9-cd9448feb574 for instance ea226b76-3184-469f-93c4-adbf4286a9e3 on n-h2-843621-1 May 27 15:05:28.670173 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-0b7b3c23-0b0d-47f2-95f4-33ba92528674 req-e61cbb0c-9583-4756-9673-b46b90086c79 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094809 May 27 15:05:28.681964 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 950/1970] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:28.694799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ae241f1a-7971-4348-b28f-829937a1da5f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:28.696118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ae241f1a-7971-4348-b28f-829937a1da5f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:28.703080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ec687c0f-3ed1-4147-8256-595c61947978 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:28.706101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae241f1a-7971-4348-b28f-829937a1da5f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:28.707126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae241f1a-7971-4348-b28f-829937a1da5f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:28.708745 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae241f1a-7971-4348-b28f-829937a1da5f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:28.709525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae241f1a-7971-4348-b28f-829937a1da5f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:28.718809 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ec687c0f-3ed1-4147-8256-595c61947978 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1345 microversion: 2.1 time: 0.210186 May 27 15:05:28.729166 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1021/1971] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:28 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1345 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:28.738912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7cc5b2a1-a650-4904-81ed-ae473d849c30 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:28.741290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7cc5b2a1-a650-4904-81ed-ae473d849c30 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:28.750949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7cc5b2a1-a650-4904-81ed-ae473d849c30 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:28.751884 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7cc5b2a1-a650-4904-81ed-ae473d849c30 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:28.753595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7cc5b2a1-a650-4904-81ed-ae473d849c30 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:28.754873 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7cc5b2a1-a650-4904-81ed-ae473d849c30 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:29.052512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ae241f1a-7971-4348-b28f-829937a1da5f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:29.058043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:29.085045 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ae241f1a-7971-4348-b28f-829937a1da5f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1325 microversion: 2.1 time: 0.398626 May 27 15:05:29.096728 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 951/1972] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:28 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1325 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:29.209846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7cc5b2a1-a650-4904-81ed-ae473d849c30 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:29.229205 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7cc5b2a1-a650-4904-81ed-ae473d849c30 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.507202 May 27 15:05:29.231851 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1022/1973] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:28 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:29.285396 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dae0ffcc-92dd-4369-bcc7-502497fd994d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:29.289785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dae0ffcc-92dd-4369-bcc7-502497fd994d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:29.334501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dae0ffcc-92dd-4369-bcc7-502497fd994d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:29.335740 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dae0ffcc-92dd-4369-bcc7-502497fd994d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:29.337471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dae0ffcc-92dd-4369-bcc7-502497fd994d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:29.338571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dae0ffcc-92dd-4369-bcc7-502497fd994d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:29.372324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2ca6e44d-1bb4-40dc-9eb5-218065311477 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:29.375149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2ca6e44d-1bb4-40dc-9eb5-218065311477 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: ea226b76-3184-469f-93c4-adbf4286a9e3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:29.392348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ca6e44d-1bb4-40dc-9eb5-218065311477 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:29.395494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ca6e44d-1bb4-40dc-9eb5-218065311477 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:29.398475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ca6e44d-1bb4-40dc-9eb5-218065311477 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:29.399181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ca6e44d-1bb4-40dc-9eb5-218065311477 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:29.540066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ca6e44d-1bb4-40dc-9eb5-218065311477 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:29.540442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ca6e44d-1bb4-40dc-9eb5-218065311477 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:29.541197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-2ca6e44d-1bb4-40dc-9eb5-218065311477 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lazy-loading 'fault' on Instance uuid ea226b76-3184-469f-93c4-adbf4286a9e3 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:05:29.685326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2ca6e44d-1bb4-40dc-9eb5-218065311477 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:29.702382 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2ca6e44d-1bb4-40dc-9eb5-218065311477 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/ea226b76-3184-469f-93c4-adbf4286a9e3" status: 200 len: 1309 microversion: 2.1 time: 0.355498 May 27 15:05:29.704324 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1023/1974] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:29 2022] GET /compute/v2.1/servers/ea226b76-3184-469f-93c4-adbf4286a9e3 => generated 1309 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:29.720186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-27f3cd91-c2a5-4b68-87ce-22c5b0d1759d req-6a707ddb-4d48-4298-9f14-9ff74604035f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea226b76-3184-469f-93c4-adbf4286a9e3", "name": "network-vif-unplugged", "status": "completed", "tag": "dfab4598-069d-4d01-bdf9-cd9448feb574"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:29.744874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-27f3cd91-c2a5-4b68-87ce-22c5b0d1759d req-6a707ddb-4d48-4298-9f14-9ff74604035f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:29.745976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-27f3cd91-c2a5-4b68-87ce-22c5b0d1759d req-6a707ddb-4d48-4298-9f14-9ff74604035f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:29.785961 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-27f3cd91-c2a5-4b68-87ce-22c5b0d1759d req-6a707ddb-4d48-4298-9f14-9ff74604035f service nova] Creating event network-vif-unplugged:dfab4598-069d-4d01-bdf9-cd9448feb574 for instance ea226b76-3184-469f-93c4-adbf4286a9e3 on n-h2-843621-1 May 27 15:05:29.786750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dae0ffcc-92dd-4369-bcc7-502497fd994d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:29.797643 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dae0ffcc-92dd-4369-bcc7-502497fd994d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1315 microversion: 2.1 time: 0.526116 May 27 15:05:29.802106 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 952/1975] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:29 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:05:29.812299 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-27f3cd91-c2a5-4b68-87ce-22c5b0d1759d req-6a707ddb-4d48-4298-9f14-9ff74604035f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106169 May 27 15:05:29.813636 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1024/1976] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:29.814522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5632564e-e0c3-49ac-aa81-15947ad82345 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:29.815223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5632564e-e0c3-49ac-aa81-15947ad82345 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:29.821088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1eb9932e-b34c-42e6-a46a-b300c7986e81 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:29.822005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1eb9932e-b34c-42e6-a46a-b300c7986e81 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:29.830553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1eb9932e-b34c-42e6-a46a-b300c7986e81 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:29.831195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1eb9932e-b34c-42e6-a46a-b300c7986e81 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:29.831502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:29.833258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1eb9932e-b34c-42e6-a46a-b300c7986e81 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:29.833897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1eb9932e-b34c-42e6-a46a-b300c7986e81 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:29.834208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5632564e-e0c3-49ac-aa81-15947ad82345 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:29.834959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5632564e-e0c3-49ac-aa81-15947ad82345 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:29.836419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5632564e-e0c3-49ac-aa81-15947ad82345 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:29.837403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5632564e-e0c3-49ac-aa81-15947ad82345 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:29.958737 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1eb9932e-b34c-42e6-a46a-b300c7986e81 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:29.976120 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1eb9932e-b34c-42e6-a46a-b300c7986e81 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1345 microversion: 2.1 time: 0.160753 May 27 15:05:29.977058 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1025/1977] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:29 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1345 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:30.114127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e2ea112-67d1-4ac5-a5c2-550ca62fd1ce tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:30.116542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e2ea112-67d1-4ac5-a5c2-550ca62fd1ce tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:30.128900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e2ea112-67d1-4ac5-a5c2-550ca62fd1ce tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:30.130198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e2ea112-67d1-4ac5-a5c2-550ca62fd1ce tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:30.132803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e2ea112-67d1-4ac5-a5c2-550ca62fd1ce tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:30.134013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e2ea112-67d1-4ac5-a5c2-550ca62fd1ce tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:30.211046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5632564e-e0c3-49ac-aa81-15947ad82345 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:30.222048 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5632564e-e0c3-49ac-aa81-15947ad82345 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:30.224063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5632564e-e0c3-49ac-aa81-15947ad82345 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:30.225584 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5632564e-e0c3-49ac-aa81-15947ad82345 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1265 microversion: 2.25 time: 0.422097 May 27 15:05:30.237098 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 953/1978] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:29 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1265 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:30.258004 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-db852ed6-d861-40fc-b26a-ce133c534582 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:30.259240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-db852ed6-d861-40fc-b26a-ce133c534582 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:30.271191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db852ed6-d861-40fc-b26a-ce133c534582 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:30.272467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db852ed6-d861-40fc-b26a-ce133c534582 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:30.273693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db852ed6-d861-40fc-b26a-ce133c534582 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:30.274568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db852ed6-d861-40fc-b26a-ce133c534582 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:30.470611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e2ea112-67d1-4ac5-a5c2-550ca62fd1ce tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:30.485086 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e2ea112-67d1-4ac5-a5c2-550ca62fd1ce tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1523 microversion: 2.1 time: 0.378227 May 27 15:05:30.502074 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1026/1979] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:30 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1523 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:05:30.533132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-15edbc71-7bd2-41c7-a7e4-149cf91057e8 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:30.535031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-15edbc71-7bd2-41c7-a7e4-149cf91057e8 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:30.545127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=96,nova_api:UPDATE=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:30.548351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-15edbc71-7bd2-41c7-a7e4-149cf91057e8 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:30.549199 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-15edbc71-7bd2-41c7-a7e4-149cf91057e8 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:30.550527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-15edbc71-7bd2-41c7-a7e4-149cf91057e8 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:30.551281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-15edbc71-7bd2-41c7-a7e4-149cf91057e8 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:30.560753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:30.578653 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-db852ed6-d861-40fc-b26a-ce133c534582 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:30.590871 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-db852ed6-d861-40fc-b26a-ce133c534582 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.339517 May 27 15:05:30.592331 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 954/1980] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:30 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:05:30.603354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-0a0e8fd4-d515-452b-b23f-b07522fd2f43 req-b2211df2-5a44-4dc2-b6df-70c63e1c0ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5472e6-8234-4e99-935f-7798245c1d2f", "name": "network-vif-deleted", "tag": "59d955ba-194a-4de9-a56d-fcc1fe5995b9"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:30.622239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0a0e8fd4-d515-452b-b23f-b07522fd2f43 req-b2211df2-5a44-4dc2-b6df-70c63e1c0ca4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:30.623077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0a0e8fd4-d515-452b-b23f-b07522fd2f43 req-b2211df2-5a44-4dc2-b6df-70c63e1c0ca4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:30.642148 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-0a0e8fd4-d515-452b-b23f-b07522fd2f43 req-b2211df2-5a44-4dc2-b6df-70c63e1c0ca4 service nova] Creating event network-vif-deleted:59d955ba-194a-4de9-a56d-fcc1fe5995b9 for instance 5c5472e6-8234-4e99-935f-7798245c1d2f on n-h1-843621-1 May 27 15:05:30.648643 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-0a0e8fd4-d515-452b-b23f-b07522fd2f43 req-b2211df2-5a44-4dc2-b6df-70c63e1c0ca4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050112 May 27 15:05:30.649603 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 955/1981] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:30.733925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8079313b-7bca-479c-acee-e6a906683cfb tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:30.734965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8079313b-7bca-479c-acee-e6a906683cfb tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: ea226b76-3184-469f-93c4-adbf4286a9e3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:30.761104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8079313b-7bca-479c-acee-e6a906683cfb tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:30.762893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8079313b-7bca-479c-acee-e6a906683cfb tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:30.766251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8079313b-7bca-479c-acee-e6a906683cfb tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:30.767844 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8079313b-7bca-479c-acee-e6a906683cfb tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:30.804248 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-8079313b-7bca-479c-acee-e6a906683cfb tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] HTTP exception thrown: Instance ea226b76-3184-469f-93c4-adbf4286a9e3 could not be found. May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8079313b-7bca-479c-acee-e6a906683cfb tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Request method failure captured: May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/ea226b76-3184-469f-93c4-adbf4286a9e3 HTTP/1.1 May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOfd5hdxLeIINzf1SGh8rcVIlOjIbaEfXQGyzTLmyQvSh4Xl0M97PMVOQYpMpAcyHD0h4iPPWz2VoG4iudcTpWdaEThkb3zz2WwK1_NStu3ayjQgrPJgz8YPOZlcPx0wS3ui17AvHHUaERlLugYwIFWbEzuGHXRywldg7ob0y3b_kdc May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: a081b119396543ad8ac9421acc677175 May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a081b119396543ad8ac9421acc677175"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a081b119396543ad8ac9421acc677175"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a081b119396543ad8ac9421acc677175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a081b119396543ad8ac9421acc677175", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: a081b119396543ad8ac9421acc677175 May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersOnMultiNodesTest-943751365-project May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: f426b883acdc49f8b0c4a9ba68e4572b May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersOnMultiNodesTest-943751365-project May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance ea226b76-3184-469f-93c4-adbf4286a9e3 could not be found. May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'ea226b76-3184-469f-93c4-adbf4286a9e3'} May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea226b76-3184-469f-93c4-adbf4286a9e3 could not be found. May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea226b76-3184-469f-93c4-adbf4286a9e3 could not be found. May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:30.809812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:30.815855 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:30.815855 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:30.815855 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:30.815855 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:30.815855 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:30.815855 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea226b76-3184-469f-93c4-adbf4286a9e3 could not be found. May 27 15:05:30.815855 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:30.817659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8079313b-7bca-479c-acee-e6a906683cfb tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Returning 404 to user: Instance ea226b76-3184-469f-93c4-adbf4286a9e3 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:30.821153 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8079313b-7bca-479c-acee-e6a906683cfb tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/ea226b76-3184-469f-93c4-adbf4286a9e3" status: 404 len: 111 microversion: 2.1 time: 0.091243 May 27 15:05:30.823240 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 956/1982] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:30 2022] GET /compute/v2.1/servers/ea226b76-3184-469f-93c4-adbf4286a9e3 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:05:30.834367 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-73e59127-d3cf-4976-af3e-60741d5ff495 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:30.835415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-73e59127-d3cf-4976-af3e-60741d5ff495 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:30.852875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73e59127-d3cf-4976-af3e-60741d5ff495 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:30.854569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73e59127-d3cf-4976-af3e-60741d5ff495 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:30.856721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73e59127-d3cf-4976-af3e-60741d5ff495 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:30.857906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73e59127-d3cf-4976-af3e-60741d5ff495 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:30.877664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-15edbc71-7bd2-41c7-a7e4-149cf91057e8 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:30.894700 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-15edbc71-7bd2-41c7-a7e4-149cf91057e8 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1523 microversion: 2.1 time: 0.383343 May 27 15:05:30.899094 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1027/1983] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:30 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1523 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:05:30.920072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e43dd94-55c2-4c51-96c2-0ad722d5e875 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:30.921009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e43dd94-55c2-4c51-96c2-0ad722d5e875 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 5c5472e6-8234-4e99-935f-7798245c1d2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:30.949118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e43dd94-55c2-4c51-96c2-0ad722d5e875 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:30.949740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e43dd94-55c2-4c51-96c2-0ad722d5e875 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:30.951359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e43dd94-55c2-4c51-96c2-0ad722d5e875 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:30.952954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e43dd94-55c2-4c51-96c2-0ad722d5e875 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:31.031833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e43dd94-55c2-4c51-96c2-0ad722d5e875 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:31.032661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e43dd94-55c2-4c51-96c2-0ad722d5e875 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:31.033648 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-0e43dd94-55c2-4c51-96c2-0ad722d5e875 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lazy-loading 'fault' on Instance uuid 5c5472e6-8234-4e99-935f-7798245c1d2f {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:05:31.171771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e43dd94-55c2-4c51-96c2-0ad722d5e875 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:31.187978 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e43dd94-55c2-4c51-96c2-0ad722d5e875 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f" status: 200 len: 1309 microversion: 2.1 time: 0.284813 May 27 15:05:31.189596 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1028/1984] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:30 2022] GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f => generated 1309 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:31.196388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f6fec2ec-8aae-48fb-886e-aa0915793c0e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1848689967", "metadata": {"": ""}}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f6fec2ec-8aae-48fb-886e-aa0915793c0e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Request method failure captured: May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e/action HTTP/1.1 May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 107 May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOimLUy6xqp-gD8lGFWAUihJRQaSsy_euXND3kG660I8aII4Fj7ST5KLuaskP9b7InGbbwTAnVT5MT1H-Njofjk92SIoSVXWmihhyVdCbe--Q04_qmor9yl_DFjMNoGrjAWoGuMhIp_HpJ221pj4licupaHrWSVP-C-ksMH4M8HOkGM May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b939a1a277f248fdaad387a445a9e780", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: d3cb6de543d34fed9b582f5af0712790 May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1848689967", "metadata": {"": ""}}} May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'c473f1c8-4e5d-4141-94e1-0bc0af40797e', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1848689967', 'metadata': {'': ''}}}} May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'': ''} May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:05:31.200308 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:05:31.208207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:05:31.208207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:05:31.208207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:05:31.208207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:05:31.208207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:05:31.208207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:05:31.208207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:31.208207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:31.208207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:31.208207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:31.208207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:31.208207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:31.208207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:05:31.208207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:05:31.208207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:05:31.208207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:31.212266 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f6fec2ec-8aae-48fb-886e-aa0915793c0e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:31.213810 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f6fec2ec-8aae-48fb-886e-aa0915793c0e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "POST /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e/action" status: 400 len: 170 microversion: 2.1 time: 0.022815 May 27 15:05:31.215008 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1029/1985] 10.222.0.13 () {60 vars in 1278 bytes} [Fri May 27 15:05:31 2022] POST /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e/action => generated 170 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:05:31.223329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-39a96d37-50dc-497f-8dc9-445e360e66db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:31.224187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-39a96d37-50dc-497f-8dc9-445e360e66db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:31.235448 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39a96d37-50dc-497f-8dc9-445e360e66db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:31.236318 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39a96d37-50dc-497f-8dc9-445e360e66db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:31.237870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39a96d37-50dc-497f-8dc9-445e360e66db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:31.238984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39a96d37-50dc-497f-8dc9-445e360e66db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:31.309056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-73e59127-d3cf-4976-af3e-60741d5ff495 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:31.321248 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-73e59127-d3cf-4976-af3e-60741d5ff495 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1315 microversion: 2.1 time: 0.495929 May 27 15:05:31.335633 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 957/1986] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:30 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:31.341656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-69d87897-dd27-4e13-9720-412e358fb24c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:31.344903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-69d87897-dd27-4e13-9720-412e358fb24c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:31.359294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69d87897-dd27-4e13-9720-412e358fb24c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:31.360951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69d87897-dd27-4e13-9720-412e358fb24c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:31.362917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69d87897-dd27-4e13-9720-412e358fb24c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:31.363754 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69d87897-dd27-4e13-9720-412e358fb24c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:31.426385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-39a96d37-50dc-497f-8dc9-445e360e66db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:31.438530 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-39a96d37-50dc-497f-8dc9-445e360e66db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1345 microversion: 2.1 time: 0.222012 May 27 15:05:31.449677 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1030/1987] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:31 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1345 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:31.460127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-56eb5a9d-d5d9-4bce-b9a0-1c094e8fc7f4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:31.461109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-56eb5a9d-d5d9-4bce-b9a0-1c094e8fc7f4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:31.469281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-56eb5a9d-d5d9-4bce-b9a0-1c094e8fc7f4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:31.470470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-56eb5a9d-d5d9-4bce-b9a0-1c094e8fc7f4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:31.471454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-56eb5a9d-d5d9-4bce-b9a0-1c094e8fc7f4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:31.472886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-56eb5a9d-d5d9-4bce-b9a0-1c094e8fc7f4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:31.582422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-56eb5a9d-d5d9-4bce-b9a0-1c094e8fc7f4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:31.596504 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-56eb5a9d-d5d9-4bce-b9a0-1c094e8fc7f4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:31.598222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-56eb5a9d-d5d9-4bce-b9a0-1c094e8fc7f4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:31.606850 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-56eb5a9d-d5d9-4bce-b9a0-1c094e8fc7f4 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1265 microversion: 2.25 time: 0.148125 May 27 15:05:31.608871 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1031/1988] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:31 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:31.620774 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c2a7c446-15c8-4fae-a3c3-d8888b44ca61 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:31.621563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c2a7c446-15c8-4fae-a3c3-d8888b44ca61 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:31.629238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2a7c446-15c8-4fae-a3c3-d8888b44ca61 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:31.630002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2a7c446-15c8-4fae-a3c3-d8888b44ca61 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:31.630896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2a7c446-15c8-4fae-a3c3-d8888b44ca61 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:31.631577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2a7c446-15c8-4fae-a3c3-d8888b44ca61 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:31.844599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-69d87897-dd27-4e13-9720-412e358fb24c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:31.861391 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-69d87897-dd27-4e13-9720-412e358fb24c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1523 microversion: 2.1 time: 0.534404 May 27 15:05:31.861999 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 958/1989] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:31 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1523 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:31.880013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-703e2fd2-17cc-49ce-b196-7f61bace1312 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:31.880656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-703e2fd2-17cc-49ce-b196-7f61bace1312 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:31.908258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-703e2fd2-17cc-49ce-b196-7f61bace1312 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:31.908872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-703e2fd2-17cc-49ce-b196-7f61bace1312 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:31.910632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-703e2fd2-17cc-49ce-b196-7f61bace1312 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:31.911381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-703e2fd2-17cc-49ce-b196-7f61bace1312 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:32.082072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c2a7c446-15c8-4fae-a3c3-d8888b44ca61 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:32.101650 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c2a7c446-15c8-4fae-a3c3-d8888b44ca61 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.491452 May 27 15:05:32.105411 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1032/1990] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:31 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:32.215955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1a478832-0f78-438e-b8ec-626215d00292 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:32.217434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1a478832-0f78-438e-b8ec-626215d00292 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 5c5472e6-8234-4e99-935f-7798245c1d2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:32.225249 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a478832-0f78-438e-b8ec-626215d00292 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:32.225865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a478832-0f78-438e-b8ec-626215d00292 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:32.226710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a478832-0f78-438e-b8ec-626215d00292 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:32.227223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a478832-0f78-438e-b8ec-626215d00292 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:32.275341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a478832-0f78-438e-b8ec-626215d00292 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:32.275892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a478832-0f78-438e-b8ec-626215d00292 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:32.276422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-1a478832-0f78-438e-b8ec-626215d00292 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lazy-loading 'fault' on Instance uuid 5c5472e6-8234-4e99-935f-7798245c1d2f {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:05:32.353680 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1a478832-0f78-438e-b8ec-626215d00292 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:32.353990 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-703e2fd2-17cc-49ce-b196-7f61bace1312 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:32.371335 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-703e2fd2-17cc-49ce-b196-7f61bace1312 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1523 microversion: 2.1 time: 0.495107 May 27 15:05:32.372965 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 959/1991] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:31 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1523 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:05:32.376467 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1a478832-0f78-438e-b8ec-626215d00292 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f" status: 200 len: 1309 microversion: 2.1 time: 0.170899 May 27 15:05:32.387010 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1033/1992] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:32 2022] GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f => generated 1309 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:32.391790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-10575d9b-bc0c-4c03-acc4-d79b5eb3a274 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:32.392710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-10575d9b-bc0c-4c03-acc4-d79b5eb3a274 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:32.393088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-339cb26c-0baf-4917-a81f-14b959ea8a4e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-794440726", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-339cb26c-0baf-4917-a81f-14b959ea8a4e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Request method failure captured: May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e/action HTTP/1.1 May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 618 May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOimLUy6xqp-gD8lGFWAUihJRQaSsy_euXND3kG660I8aII4Fj7ST5KLuaskP9b7InGbbwTAnVT5MT1H-Njofjk92SIoSVXWmihhyVdCbe--Q04_qmor9yl_DFjMNoGrjAWoGuMhIp_HpJ221pj4licupaHrWSVP-C-ksMH4M8HOkGM May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b939a1a277f248fdaad387a445a9e780", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: d3cb6de543d34fed9b582f5af0712790 May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-794440726", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'c473f1c8-4e5d-4141-94e1-0bc0af40797e', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-794440726', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:05:32.395839 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:05:32.399570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:32.403015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-339cb26c-0baf-4917-a81f-14b959ea8a4e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:32.403015 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-339cb26c-0baf-4917-a81f-14b959ea8a4e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "POST /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e/action" status: 400 len: 938 microversion: 2.1 time: 0.013968 May 27 15:05:32.403203 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1034/1993] 10.222.0.13 () {60 vars in 1278 bytes} [Fri May 27 15:05:32 2022] POST /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e/action => generated 938 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:05:32.411815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a35b371e-3c63-44f9-8331-8169a12ad975 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:32.414433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10575d9b-bc0c-4c03-acc4-d79b5eb3a274 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:32.415149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10575d9b-bc0c-4c03-acc4-d79b5eb3a274 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:32.416255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10575d9b-bc0c-4c03-acc4-d79b5eb3a274 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:32.416587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10575d9b-bc0c-4c03-acc4-d79b5eb3a274 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:32.422521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a35b371e-3c63-44f9-8331-8169a12ad975 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:32.439817 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a35b371e-3c63-44f9-8331-8169a12ad975 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:32.443260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a35b371e-3c63-44f9-8331-8169a12ad975 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:32.445145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a35b371e-3c63-44f9-8331-8169a12ad975 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:32.447501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a35b371e-3c63-44f9-8331-8169a12ad975 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:33.000392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a35b371e-3c63-44f9-8331-8169a12ad975 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:33.014106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-10575d9b-bc0c-4c03-acc4-d79b5eb3a274 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:33.014626 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a35b371e-3c63-44f9-8331-8169a12ad975 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1523 microversion: 2.1 time: 0.606094 May 27 15:05:33.015649 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1035/1994] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:32 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1523 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:33.033147 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-10575d9b-bc0c-4c03-acc4-d79b5eb3a274 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1315 microversion: 2.1 time: 0.656828 May 27 15:05:33.034566 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 960/1995] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:32 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:33.040221 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-19b024f9-a1e3-46ad-b612-26b18362af08 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:33.043631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-19b024f9-a1e3-46ad-b612-26b18362af08 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:33.046798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-14fc682f-6a8e-4745-85d9-b7cdc6b17a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:33.048335 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-14fc682f-6a8e-4745-85d9-b7cdc6b17a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:33.056064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14fc682f-6a8e-4745-85d9-b7cdc6b17a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:33.056970 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14fc682f-6a8e-4745-85d9-b7cdc6b17a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:33.058065 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14fc682f-6a8e-4745-85d9-b7cdc6b17a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:33.058748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14fc682f-6a8e-4745-85d9-b7cdc6b17a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:33.071775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19b024f9-a1e3-46ad-b612-26b18362af08 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:33.072849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19b024f9-a1e3-46ad-b612-26b18362af08 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:33.074362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19b024f9-a1e3-46ad-b612-26b18362af08 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:33.077567 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19b024f9-a1e3-46ad-b612-26b18362af08 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:33.171832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-14fc682f-6a8e-4745-85d9-b7cdc6b17a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:33.192439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-14fc682f-6a8e-4745-85d9-b7cdc6b17a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:33.196428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-14fc682f-6a8e-4745-85d9-b7cdc6b17a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:33.199307 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-14fc682f-6a8e-4745-85d9-b7cdc6b17a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1265 microversion: 2.25 time: 0.162966 May 27 15:05:33.200664 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 961/1996] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:33 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:33.210506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b99e576f-7348-4ee4-8850-48b2206b94ae tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:33.211660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b99e576f-7348-4ee4-8850-48b2206b94ae tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:33.222123 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-19b024f9-a1e3-46ad-b612-26b18362af08 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:33.230407 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b99e576f-7348-4ee4-8850-48b2206b94ae tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:33.234555 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b99e576f-7348-4ee4-8850-48b2206b94ae tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:33.236295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b99e576f-7348-4ee4-8850-48b2206b94ae tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:33.236755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b99e576f-7348-4ee4-8850-48b2206b94ae tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:33.249150 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-19b024f9-a1e3-46ad-b612-26b18362af08 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1345 microversion: 2.1 time: 0.218099 May 27 15:05:33.260942 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1036/1997] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:33 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1345 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:33.265973 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4ee1df5f-9e50-48ef-bb39-32a592d6dd0a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:33.267224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4ee1df5f-9e50-48ef-bb39-32a592d6dd0a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:33.279358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ee1df5f-9e50-48ef-bb39-32a592d6dd0a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:33.280969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ee1df5f-9e50-48ef-bb39-32a592d6dd0a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:33.282438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ee1df5f-9e50-48ef-bb39-32a592d6dd0a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:33.283247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ee1df5f-9e50-48ef-bb39-32a592d6dd0a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:33.552195 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b99e576f-7348-4ee4-8850-48b2206b94ae tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:33.567619 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b99e576f-7348-4ee4-8850-48b2206b94ae tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1523 microversion: 2.1 time: 0.364715 May 27 15:05:33.582440 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 962/1998] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:33 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1523 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:33.603486 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3f98fc64-2583-4ec3-bbd4-967c4dd6abff tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:33.606128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3f98fc64-2583-4ec3-bbd4-967c4dd6abff tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 5c5472e6-8234-4e99-935f-7798245c1d2f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:33.619286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f98fc64-2583-4ec3-bbd4-967c4dd6abff tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:33.620478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f98fc64-2583-4ec3-bbd4-967c4dd6abff tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:33.622260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f98fc64-2583-4ec3-bbd4-967c4dd6abff tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:33.623794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f98fc64-2583-4ec3-bbd4-967c4dd6abff tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:33.653523 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-3f98fc64-2583-4ec3-bbd4-967c4dd6abff tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] HTTP exception thrown: Instance 5c5472e6-8234-4e99-935f-7798245c1d2f could not be found. May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3f98fc64-2583-4ec3-bbd4-967c4dd6abff tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Request method failure captured: May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f HTTP/1.1 May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOfd5hdxLeIINzf1SGh8rcVIlOjIbaEfXQGyzTLmyQvSh4Xl0M97PMVOQYpMpAcyHD0h4iPPWz2VoG4iudcTpWdaEThkb3zz2WwK1_NStu3ayjQgrPJgz8YPOZlcPx0wS3ui17AvHHUaERlLugYwIFWbEzuGHXRywldg7ob0y3b_kdc May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: a081b119396543ad8ac9421acc677175 May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a081b119396543ad8ac9421acc677175"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a081b119396543ad8ac9421acc677175"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a081b119396543ad8ac9421acc677175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a081b119396543ad8ac9421acc677175", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: a081b119396543ad8ac9421acc677175 May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersOnMultiNodesTest-943751365-project May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: f426b883acdc49f8b0c4a9ba68e4572b May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersOnMultiNodesTest-943751365-project May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 5c5472e6-8234-4e99-935f-7798245c1d2f could not be found. May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '5c5472e6-8234-4e99-935f-7798245c1d2f'} May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c5472e6-8234-4e99-935f-7798245c1d2f could not be found. May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c5472e6-8234-4e99-935f-7798245c1d2f could not be found. May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:33.656488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:33.665624 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:33.665624 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:33.665624 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:33.665624 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:33.665624 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:33.665624 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c5472e6-8234-4e99-935f-7798245c1d2f could not be found. May 27 15:05:33.665624 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:33.665624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3f98fc64-2583-4ec3-bbd4-967c4dd6abff tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Returning 404 to user: Instance 5c5472e6-8234-4e99-935f-7798245c1d2f could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:33.672665 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3f98fc64-2583-4ec3-bbd4-967c4dd6abff tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f" status: 404 len: 111 microversion: 2.1 time: 0.082243 May 27 15:05:33.674081 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 963/1999] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:33 2022] GET /compute/v2.1/servers/5c5472e6-8234-4e99-935f-7798245c1d2f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:05:33.682844 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-af09122d-a502-4165-86ab-1937a6d542f8 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-af09122d-a502-4165-86ab-1937a6d542f8 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Request method failure captured: May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e/action HTTP/1.1 May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 285 May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOimLUy6xqp-gD8lGFWAUihJRQaSsy_euXND3kG660I8aII4Fj7ST5KLuaskP9b7InGbbwTAnVT5MT1H-Njofjk92SIoSVXWmihhyVdCbe--Q04_qmor9yl_DFjMNoGrjAWoGuMhIp_HpJ221pj4licupaHrWSVP-C-ksMH4M8HOkGM May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b939a1a277f248fdaad387a445a9e780", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: d3cb6de543d34fed9b582f5af0712790 May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'c473f1c8-4e5d-4141-94e1-0bc0af40797e', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise error May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:33.687725 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 27 15:05:33.692971 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:33.696801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-af09122d-a502-4165-86ab-1937a6d542f8 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:33.697988 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-af09122d-a502-4165-86ab-1937a6d542f8 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "POST /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e/action" status: 400 len: 619 microversion: 2.1 time: 0.022558 May 27 15:05:33.699130 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 964/2000] 10.222.0.13 () {60 vars in 1278 bytes} [Fri May 27 15:05:33 2022] POST /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e/action => generated 619 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:05:33.709360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f803cb95-0fcc-4ebb-8410-8cc84d6cca94 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:33.773597 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f803cb95-0fcc-4ebb-8410-8cc84d6cca94 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/4756748d-e981-4a6d-bfcf-2b1c5cfe8b51" status: 204 len: 0 microversion: 2.1 time: 0.068580 May 27 15:05:33.774406 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 965/2001] 10.222.0.13 () {58 vars in 1265 bytes} [Fri May 27 15:05:33 2022] DELETE /compute/v2.1/os-server-groups/4756748d-e981-4a6d-bfcf-2b1c5cfe8b51 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:05:33.793962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5e1bb996-ff1b-49cf-b0bd-51781c5969a3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:33.794714 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5e1bb996-ff1b-49cf-b0bd-51781c5969a3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:33.816247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e1bb996-ff1b-49cf-b0bd-51781c5969a3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:33.816631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e1bb996-ff1b-49cf-b0bd-51781c5969a3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:33.817508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e1bb996-ff1b-49cf-b0bd-51781c5969a3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:33.818001 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e1bb996-ff1b-49cf-b0bd-51781c5969a3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:34.033877 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4ee1df5f-9e50-48ef-bb39-32a592d6dd0a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:34.044822 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4ee1df5f-9e50-48ef-bb39-32a592d6dd0a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.793216 May 27 15:05:34.046841 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1037/2002] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:33 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:34.052745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3a729438-56d4-48e2-8412-bb1fa569f37f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:34.054270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3a729438-56d4-48e2-8412-bb1fa569f37f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 31db04fa-a046-4535-8191-c7db2b34a029] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:34.070878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a729438-56d4-48e2-8412-bb1fa569f37f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:34.071841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a729438-56d4-48e2-8412-bb1fa569f37f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:34.073212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a729438-56d4-48e2-8412-bb1fa569f37f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:34.074015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a729438-56d4-48e2-8412-bb1fa569f37f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:34.126779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3a729438-56d4-48e2-8412-bb1fa569f37f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 31db04fa-a046-4535-8191-c7db2b34a029] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:05:34.180770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5e1bb996-ff1b-49cf-b0bd-51781c5969a3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:34.190434 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5e1bb996-ff1b-49cf-b0bd-51781c5969a3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1523 microversion: 2.1 time: 0.414824 May 27 15:05:34.191011 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 966/2003] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:33 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1523 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:34.199600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9e42636d-3bb2-4807-9ad8-d8d34c0e5cb0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:34.205778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9e42636d-3bb2-4807-9ad8-d8d34c0e5cb0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:34.220484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e42636d-3bb2-4807-9ad8-d8d34c0e5cb0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:34.221850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e42636d-3bb2-4807-9ad8-d8d34c0e5cb0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:34.223348 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e42636d-3bb2-4807-9ad8-d8d34c0e5cb0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:34.224030 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e42636d-3bb2-4807-9ad8-d8d34c0e5cb0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:34.327882 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3a729438-56d4-48e2-8412-bb1fa569f37f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "DELETE /compute/v2.1/servers/31db04fa-a046-4535-8191-c7db2b34a029" status: 204 len: 0 microversion: 2.1 time: 0.278793 May 27 15:05:34.329580 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1038/2004] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:05:34 2022] DELETE /compute/v2.1/servers/31db04fa-a046-4535-8191-c7db2b34a029 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:05:34.341413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e7ef1a45-6258-4ce9-a312-a4e306ddd84b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:34.344564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e7ef1a45-6258-4ce9-a312-a4e306ddd84b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:34.381646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7ef1a45-6258-4ce9-a312-a4e306ddd84b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:34.382108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7ef1a45-6258-4ce9-a312-a4e306ddd84b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:34.383360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7ef1a45-6258-4ce9-a312-a4e306ddd84b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:34.383819 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7ef1a45-6258-4ce9-a312-a4e306ddd84b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:34.665304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9e42636d-3bb2-4807-9ad8-d8d34c0e5cb0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:34.697830 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9e42636d-3bb2-4807-9ad8-d8d34c0e5cb0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1315 microversion: 2.1 time: 0.502004 May 27 15:05:34.700949 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 967/2005] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:34 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1315 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:34.712333 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d40f44b3-d9df-43ee-bcca-14e865273a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:34.716513 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d40f44b3-d9df-43ee-bcca-14e865273a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:34.730742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d40f44b3-d9df-43ee-bcca-14e865273a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:34.731753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d40f44b3-d9df-43ee-bcca-14e865273a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:34.734778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d40f44b3-d9df-43ee-bcca-14e865273a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:34.737940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d40f44b3-d9df-43ee-bcca-14e865273a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:34.757906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e7ef1a45-6258-4ce9-a312-a4e306ddd84b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:34.778729 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e7ef1a45-6258-4ce9-a312-a4e306ddd84b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1523 microversion: 2.1 time: 0.444845 May 27 15:05:34.780343 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1039/2006] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:34 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1523 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:34.793972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a223706e-d912-412b-9bb1-0e6f852ef4de tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:34.795061 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a223706e-d912-412b-9bb1-0e6f852ef4de tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:34.814328 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a223706e-d912-412b-9bb1-0e6f852ef4de tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:34.815680 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a223706e-d912-412b-9bb1-0e6f852ef4de tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:34.819903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d40f44b3-d9df-43ee-bcca-14e865273a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:34.820738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d40f44b3-d9df-43ee-bcca-14e865273a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:34.820896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a223706e-d912-412b-9bb1-0e6f852ef4de tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:34.821321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a223706e-d912-412b-9bb1-0e6f852ef4de tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:34.822019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-d40f44b3-d9df-43ee-bcca-14e865273a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lazy-loading 'fault' on Instance uuid 05873cb2-4587-4714-a252-49a90edbabd2 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:05:35.023892 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:35.197831 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a223706e-d912-412b-9bb1-0e6f852ef4de tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:35.201474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d40f44b3-d9df-43ee-bcca-14e865273a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:35.211308 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a223706e-d912-412b-9bb1-0e6f852ef4de tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1345 microversion: 2.1 time: 0.429425 May 27 15:05:35.211920 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1040/2007] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:34 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1345 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:35.229040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4a5f33ff-96ed-41e2-8fd1-466ba4d89530 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:35.229040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4a5f33ff-96ed-41e2-8fd1-466ba4d89530 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:35.229040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a5f33ff-96ed-41e2-8fd1-466ba4d89530 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:35.231097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a5f33ff-96ed-41e2-8fd1-466ba4d89530 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:35.231097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a5f33ff-96ed-41e2-8fd1-466ba4d89530 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:35.231772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a5f33ff-96ed-41e2-8fd1-466ba4d89530 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:35.238236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d40f44b3-d9df-43ee-bcca-14e865273a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:35.240067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d40f44b3-d9df-43ee-bcca-14e865273a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:35.241750 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d40f44b3-d9df-43ee-bcca-14e865273a34 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 200 len: 1193 microversion: 2.25 time: 0.536228 May 27 15:05:35.244419 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 968/2008] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:34 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 1193 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:35.251560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-57f937bf-4f84-4b50-b619-6860860f1718 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-818836190"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:35.255046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-57f937bf-4f84-4b50-b619-6860860f1718 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:35.273820 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57f937bf-4f84-4b50-b619-6860860f1718 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:35.278618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57f937bf-4f84-4b50-b619-6860860f1718 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:35.279584 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57f937bf-4f84-4b50-b619-6860860f1718 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:35.280184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57f937bf-4f84-4b50-b619-6860860f1718 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:35.300125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4a5f33ff-96ed-41e2-8fd1-466ba4d89530 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:05:35.436538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:35.484501 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4a5f33ff-96ed-41e2-8fd1-466ba4d89530 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "DELETE /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0" status: 204 len: 0 microversion: 2.1 time: 0.271163 May 27 15:05:35.488190 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1041/2009] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:05:35 2022] DELETE /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:05:35.494974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-be286ecc-7d09-48a1-99bf-fb1918610b05 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:35.495701 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-be286ecc-7d09-48a1-99bf-fb1918610b05 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:35.517303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be286ecc-7d09-48a1-99bf-fb1918610b05 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:35.517929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be286ecc-7d09-48a1-99bf-fb1918610b05 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:35.519538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be286ecc-7d09-48a1-99bf-fb1918610b05 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:35.520026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be286ecc-7d09-48a1-99bf-fb1918610b05 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:35.773455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-be286ecc-7d09-48a1-99bf-fb1918610b05 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:35.785161 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-be286ecc-7d09-48a1-99bf-fb1918610b05 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.298162 May 27 15:05:35.797059 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1042/2010] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:35 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:35.797059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b351bc5c-5067-4b3b-8007-8f36c68209aa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:35.797059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b351bc5c-5067-4b3b-8007-8f36c68209aa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 31db04fa-a046-4535-8191-c7db2b34a029] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:35.803959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b351bc5c-5067-4b3b-8007-8f36c68209aa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:35.804540 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b351bc5c-5067-4b3b-8007-8f36c68209aa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:35.805392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b351bc5c-5067-4b3b-8007-8f36c68209aa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:35.805846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b351bc5c-5067-4b3b-8007-8f36c68209aa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:35.928960 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-57f937bf-4f84-4b50-b619-6860860f1718 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "POST /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e/action" status: 202 len: 0 microversion: 2.1 time: 0.682449 May 27 15:05:35.935571 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 969/2011] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:05:35 2022] POST /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e/action => generated 0 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 27 15:05:35.960152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d4e755ae-dfd4-4d90-a428-b75df28b58be tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:35.961676 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d4e755ae-dfd4-4d90-a428-b75df28b58be tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:35.978806 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d4e755ae-dfd4-4d90-a428-b75df28b58be tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:35.980130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d4e755ae-dfd4-4d90-a428-b75df28b58be tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:35.984218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d4e755ae-dfd4-4d90-a428-b75df28b58be tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:35.986685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d4e755ae-dfd4-4d90-a428-b75df28b58be tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:36.055319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b351bc5c-5067-4b3b-8007-8f36c68209aa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:36.071979 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b351bc5c-5067-4b3b-8007-8f36c68209aa tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/31db04fa-a046-4535-8191-c7db2b34a029" status: 200 len: 1475 microversion: 2.1 time: 0.284075 May 27 15:05:36.073608 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1043/2012] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:35 2022] GET /compute/v2.1/servers/31db04fa-a046-4535-8191-c7db2b34a029 => generated 1475 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:36.093983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8a04202b-48d0-4983-9d67-da9ee6d9588c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-710610673"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:36.096875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8a04202b-48d0-4983-9d67-da9ee6d9588c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:36.113740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a04202b-48d0-4983-9d67-da9ee6d9588c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:36.115449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a04202b-48d0-4983-9d67-da9ee6d9588c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:36.117562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a04202b-48d0-4983-9d67-da9ee6d9588c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:36.118937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a04202b-48d0-4983-9d67-da9ee6d9588c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:36.200620 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-8a04202b-48d0-4983-9d67-da9ee6d9588c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] HTTP exception thrown: Cannot 'createImage' instance c473f1c8-4e5d-4141-94e1-0bc0af40797e while it is in task_state image_snapshot May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8a04202b-48d0-4983-9d67-da9ee6d9588c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Request method failure captured: May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e/action HTTP/1.1 May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 84 May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOimLUy6xqp-gD8lGFWAUihJRQaSsy_euXND3kG660I8aII4Fj7ST5KLuaskP9b7InGbbwTAnVT5MT1H-Njofjk92SIoSVXWmihhyVdCbe--Q04_qmor9yl_DFjMNoGrjAWoGuMhIp_HpJ221pj4licupaHrWSVP-C-ksMH4M8HOkGM May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b939a1a277f248fdaad387a445a9e780", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: d3cb6de543d34fed9b582f5af0712790 May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-710610673"}} May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: exception: Cannot 'createImage' instance c473f1c8-4e5d-4141-94e1-0bc0af40797e while it is in task_state image_snapshot May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'c473f1c8-4e5d-4141-94e1-0bc0af40797e', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-710610673'}}} May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c473f1c8-4e5d-4141-94e1-0bc0af40797e in task_state image_snapshot. Cannot snapshot while the instance is in this state. May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 15:05:36.206162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance c473f1c8-4e5d-4141-94e1-0bc0af40797e while it is in task_state image_snapshot May 27 15:05:36.215031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:36.215031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:36.215031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:36.215031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:36.215031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:36.215031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:36.215031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:36.215031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:36.215031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance c473f1c8-4e5d-4141-94e1-0bc0af40797e while it is in task_state image_snapshot May 27 15:05:36.215031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:36.220131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8a04202b-48d0-4983-9d67-da9ee6d9588c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Returning 409 to user: Cannot 'createImage' instance c473f1c8-4e5d-4141-94e1-0bc0af40797e while it is in task_state image_snapshot {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:36.222418 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8a04202b-48d0-4983-9d67-da9ee6d9588c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "POST /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e/action" status: 409 len: 159 microversion: 2.1 time: 0.146467 May 27 15:05:36.224314 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1044/2013] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:05:36 2022] POST /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e/action => generated 159 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:05:36.237436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e99b1253-87c4-4c1a-8520-275b8ceedbc3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '.version_select at 0x7fc7807323a0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:36.368585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d4e755ae-dfd4-4d90-a428-b75df28b58be tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:36.376741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:36.380034 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d4e755ae-dfd4-4d90-a428-b75df28b58be tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1315 microversion: 2.1 time: 0.441257 May 27 15:05:36.380967 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 970/2014] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:35 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:36.386800 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-45cca8d3-cf54-4a38-ae85-cc085f45043d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:36.388334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-45cca8d3-cf54-4a38-ae85-cc085f45043d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:36.398857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45cca8d3-cf54-4a38-ae85-cc085f45043d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:36.399674 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45cca8d3-cf54-4a38-ae85-cc085f45043d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:36.400749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45cca8d3-cf54-4a38-ae85-cc085f45043d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:36.401454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45cca8d3-cf54-4a38-ae85-cc085f45043d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:36.518336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-45cca8d3-cf54-4a38-ae85-cc085f45043d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:36.540469 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-45cca8d3-cf54-4a38-ae85-cc085f45043d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1345 microversion: 2.1 time: 0.158051 May 27 15:05:36.541660 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 971/2015] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:36 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1345 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:36.547208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-54273869-773c-4d1c-a122-c620d647933f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:36.554114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-54273869-773c-4d1c-a122-c620d647933f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 05873cb2-4587-4714-a252-49a90edbabd2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:36.573256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54273869-773c-4d1c-a122-c620d647933f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:36.576370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54273869-773c-4d1c-a122-c620d647933f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:36.581960 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54273869-773c-4d1c-a122-c620d647933f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:36.582907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54273869-773c-4d1c-a122-c620d647933f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:36.640176 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e99b1253-87c4-4c1a-8520-275b8ceedbc3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "DELETE /compute/v2.1/images/2796f171-e60a-4cc2-acc8-57001c0c699d" status: 204 len: 0 microversion: 2.1 time: 0.406693 May 27 15:05:36.641770 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1045/2016] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:36 2022] DELETE /compute/v2.1/images/2796f171-e60a-4cc2-acc8-57001c0c699d => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:05:36.650257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-84590ce7-0abc-439a-981a-494ed487cd07 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:36.651677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-84590ce7-0abc-439a-981a-494ed487cd07 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:36.660240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84590ce7-0abc-439a-981a-494ed487cd07 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:36.664079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84590ce7-0abc-439a-981a-494ed487cd07 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:36.664615 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-54273869-773c-4d1c-a122-c620d647933f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] HTTP exception thrown: Instance 05873cb2-4587-4714-a252-49a90edbabd2 could not be found. May 27 15:05:36.665245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84590ce7-0abc-439a-981a-494ed487cd07 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:36.665829 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84590ce7-0abc-439a-981a-494ed487cd07 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-54273869-773c-4d1c-a122-c620d647933f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Request method failure captured: May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 HTTP/1.1 May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikObeii5akAfuoQuqcBM5xu8qHmUXemdb7Xuwg6ZB45tBGHwoUarz3MzgSJWXoi-_nmwfzdzOYzRIfMfUXK9E8irjU9cq-KTuwmcJdVERJt53gIG4UQ10__sZia8bqXHintDMpqNycR2c9_yK0D4Z8IRS7Siv6uc9dNkL_reeUgmiXv0 May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-Openstack-Nova-Api-Version: 2.25 May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 0dbdeb12b89c475cba7fef0ab845dada May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2105219972 May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0dbdeb12b89c475cba7fef0ab845dada"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0dbdeb12b89c475cba7fef0ab845dada"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0dbdeb12b89c475cba7fef0ab845dada"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0dbdeb12b89c475cba7fef0ab845dada", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2105219972 May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 0dbdeb12b89c475cba7fef0ab845dada May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2105219972 May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-LiveAutoBlockMigrationV225Test-2105219972-project May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 4284d5f7a29045d18393bde2961a904b May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2105219972-project May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 05873cb2-4587-4714-a252-49a90edbabd2 could not be found. May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '05873cb2-4587-4714-a252-49a90edbabd2'} May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05873cb2-4587-4714-a252-49a90edbabd2 could not be found. May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05873cb2-4587-4714-a252-49a90edbabd2 could not be found. May 27 15:05:36.667580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:36.673551 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:36.673551 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:36.673551 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:36.673551 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:36.673551 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:36.673551 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:36.673551 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:36.673551 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05873cb2-4587-4714-a252-49a90edbabd2 could not be found. May 27 15:05:36.673551 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:36.682794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-54273869-773c-4d1c-a122-c620d647933f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Returning 404 to user: Instance 05873cb2-4587-4714-a252-49a90edbabd2 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:36.684073 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-54273869-773c-4d1c-a122-c620d647933f tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2" status: 404 len: 111 microversion: 2.25 time: 0.141213 May 27 15:05:36.684914 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 972/2017] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:36 2022] GET /compute/v2.1/servers/05873cb2-4587-4714-a252-49a90edbabd2 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:05:36.807164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c959f6c5-9055-40a9-af16-1b84a9684c1f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:36.807944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c959f6c5-9055-40a9-af16-1b84a9684c1f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:36.829413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c959f6c5-9055-40a9-af16-1b84a9684c1f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:36.839555 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c959f6c5-9055-40a9-af16-1b84a9684c1f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:36.843979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c959f6c5-9055-40a9-af16-1b84a9684c1f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:36.846236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c959f6c5-9055-40a9-af16-1b84a9684c1f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:36.948502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-84590ce7-0abc-439a-981a-494ed487cd07 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:36.961958 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-84590ce7-0abc-439a-981a-494ed487cd07 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1535 microversion: 2.1 time: 0.316068 May 27 15:05:36.962565 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1046/2018] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:36 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1535 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:05:37.108116 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e7b3f895-d895-4fd0-9432-ef6567fb7633 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:37.108869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e7b3f895-d895-4fd0-9432-ef6567fb7633 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 31db04fa-a046-4535-8191-c7db2b34a029] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:37.120037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7b3f895-d895-4fd0-9432-ef6567fb7633 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:37.121684 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7b3f895-d895-4fd0-9432-ef6567fb7633 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:37.123556 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7b3f895-d895-4fd0-9432-ef6567fb7633 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:37.124026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7b3f895-d895-4fd0-9432-ef6567fb7633 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:37.318708 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c959f6c5-9055-40a9-af16-1b84a9684c1f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:37.333007 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c959f6c5-9055-40a9-af16-1b84a9684c1f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.531524 May 27 15:05:37.339398 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 973/2019] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:36 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:37.398207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-183197a0-3c99-4929-baa8-084e579aba8b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:37.399214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-183197a0-3c99-4929-baa8-084e579aba8b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:37.416195 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-183197a0-3c99-4929-baa8-084e579aba8b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:37.416660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-183197a0-3c99-4929-baa8-084e579aba8b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:37.417486 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-183197a0-3c99-4929-baa8-084e579aba8b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:37.417932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-183197a0-3c99-4929-baa8-084e579aba8b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:37.418477 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e7b3f895-d895-4fd0-9432-ef6567fb7633 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:37.439323 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e7b3f895-d895-4fd0-9432-ef6567fb7633 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/31db04fa-a046-4535-8191-c7db2b34a029" status: 200 len: 1475 microversion: 2.1 time: 0.335121 May 27 15:05:37.451446 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1047/2020] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:37 2022] GET /compute/v2.1/servers/31db04fa-a046-4535-8191-c7db2b34a029 => generated 1475 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:05:37.575075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d51c969d-5898-4403-9ea9-41c9a446711f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:37.577098 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d51c969d-5898-4403-9ea9-41c9a446711f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:37.590562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d51c969d-5898-4403-9ea9-41c9a446711f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:37.591394 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d51c969d-5898-4403-9ea9-41c9a446711f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:37.592953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d51c969d-5898-4403-9ea9-41c9a446711f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:37.593560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d51c969d-5898-4403-9ea9-41c9a446711f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:37.665168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-183197a0-3c99-4929-baa8-084e579aba8b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:37.676710 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-183197a0-3c99-4929-baa8-084e579aba8b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1315 microversion: 2.1 time: 0.282482 May 27 15:05:37.678203 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 974/2021] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:37 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:05:37.735451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d51c969d-5898-4403-9ea9-41c9a446711f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:37.754045 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d51c969d-5898-4403-9ea9-41c9a446711f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1345 microversion: 2.1 time: 0.186518 May 27 15:05:37.764830 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1048/2022] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:37 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1345 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:37.981639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e664f5b0-72ba-46e2-90ca-eca17b2300da tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:37.982286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e664f5b0-72ba-46e2-90ca-eca17b2300da tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:37.994507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e664f5b0-72ba-46e2-90ca-eca17b2300da tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:37.994976 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e664f5b0-72ba-46e2-90ca-eca17b2300da tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:37.997993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e664f5b0-72ba-46e2-90ca-eca17b2300da tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:38.000462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e664f5b0-72ba-46e2-90ca-eca17b2300da tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:38.255822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e664f5b0-72ba-46e2-90ca-eca17b2300da tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:38.270063 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e664f5b0-72ba-46e2-90ca-eca17b2300da tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1541 microversion: 2.1 time: 0.292360 May 27 15:05:38.270786 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 975/2023] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:37 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1541 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:05:38.359623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7f5a5124-7b68-4670-8961-d15329f5dfdc tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:38.360579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7f5a5124-7b68-4670-8961-d15329f5dfdc tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:38.371554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f5a5124-7b68-4670-8961-d15329f5dfdc tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:38.382277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f5a5124-7b68-4670-8961-d15329f5dfdc tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:38.383459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f5a5124-7b68-4670-8961-d15329f5dfdc tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:38.384127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f5a5124-7b68-4670-8961-d15329f5dfdc tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:38.463743 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7758f19c-c4f4-4f20-b364-4e263d56a964 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:38.477092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7758f19c-c4f4-4f20-b364-4e263d56a964 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 31db04fa-a046-4535-8191-c7db2b34a029] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:38.484909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7758f19c-c4f4-4f20-b364-4e263d56a964 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:38.485397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7758f19c-c4f4-4f20-b364-4e263d56a964 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:38.486321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7758f19c-c4f4-4f20-b364-4e263d56a964 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:38.486796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7758f19c-c4f4-4f20-b364-4e263d56a964 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:38.741217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7f5a5124-7b68-4670-8961-d15329f5dfdc tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:38.757209 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7f5a5124-7b68-4670-8961-d15329f5dfdc tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.401489 May 27 15:05:38.769986 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1049/2024] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:38 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:38.784662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1b193f9f-6e50-44f1-9910-346f4091be61 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:38.785553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1b193f9f-6e50-44f1-9910-346f4091be61 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:38.801976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b193f9f-6e50-44f1-9910-346f4091be61 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:38.802438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b193f9f-6e50-44f1-9910-346f4091be61 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:38.809644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b193f9f-6e50-44f1-9910-346f4091be61 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:38.810126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b193f9f-6e50-44f1-9910-346f4091be61 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:38.824650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7758f19c-c4f4-4f20-b364-4e263d56a964 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:38.841452 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7758f19c-c4f4-4f20-b364-4e263d56a964 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/31db04fa-a046-4535-8191-c7db2b34a029" status: 200 len: 1475 microversion: 2.1 time: 0.386778 May 27 15:05:38.843275 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 976/2025] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:38 2022] GET /compute/v2.1/servers/31db04fa-a046-4535-8191-c7db2b34a029 => generated 1475 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:38.854825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d1a69d7a-92b8-4046-9f60-64319516ff0a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:38.855748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d1a69d7a-92b8-4046-9f60-64319516ff0a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:38.878527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1a69d7a-92b8-4046-9f60-64319516ff0a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:38.880148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1a69d7a-92b8-4046-9f60-64319516ff0a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:38.882486 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1a69d7a-92b8-4046-9f60-64319516ff0a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:38.882967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1a69d7a-92b8-4046-9f60-64319516ff0a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:39.131248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d1a69d7a-92b8-4046-9f60-64319516ff0a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:39.147151 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d1a69d7a-92b8-4046-9f60-64319516ff0a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1345 microversion: 2.1 time: 0.298515 May 27 15:05:39.153679 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 977/2026] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:38 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1345 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:39.196097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1b193f9f-6e50-44f1-9910-346f4091be61 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:39.205872 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1b193f9f-6e50-44f1-9910-346f4091be61 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1315 microversion: 2.1 time: 0.433036 May 27 15:05:39.218296 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1050/2027] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:38 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:39.288191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dd2681c5-0072-44c8-bac1-ab9ac8243911 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:39.288889 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dd2681c5-0072-44c8-bac1-ab9ac8243911 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:39.308551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd2681c5-0072-44c8-bac1-ab9ac8243911 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:39.309294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd2681c5-0072-44c8-bac1-ab9ac8243911 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:39.310282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd2681c5-0072-44c8-bac1-ab9ac8243911 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:39.310948 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd2681c5-0072-44c8-bac1-ab9ac8243911 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:39.658779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-b4d0ae7a-1df9-4e80-b7ca-68c6a5ddfb4b req-3a3c60f2-ec2d-438c-ace4-fe0de0ddb5e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31db04fa-a046-4535-8191-c7db2b34a029", "name": "network-vif-deleted", "tag": "c6b81cde-c01c-4516-850b-f6b6598924c3"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:39.670920 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dd2681c5-0072-44c8-bac1-ab9ac8243911 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:39.688138 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dd2681c5-0072-44c8-bac1-ab9ac8243911 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1536 microversion: 2.1 time: 0.402385 May 27 15:05:39.692768 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 978/2028] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:39 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1536 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:39.696026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-b4d0ae7a-1df9-4e80-b7ca-68c6a5ddfb4b req-3a3c60f2-ec2d-438c-ace4-fe0de0ddb5e0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:39.696483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-b4d0ae7a-1df9-4e80-b7ca-68c6a5ddfb4b req-3a3c60f2-ec2d-438c-ace4-fe0de0ddb5e0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:39.759259 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-b4d0ae7a-1df9-4e80-b7ca-68c6a5ddfb4b req-3a3c60f2-ec2d-438c-ace4-fe0de0ddb5e0 service nova] Creating event network-vif-deleted:c6b81cde-c01c-4516-850b-f6b6598924c3 for instance 31db04fa-a046-4535-8191-c7db2b34a029 on n-h1-843621-1 May 27 15:05:39.775442 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-12d35ce2-66f0-4cec-9e31-712ee911871f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:39.777129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-12d35ce2-66f0-4cec-9e31-712ee911871f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:39.782781 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-b4d0ae7a-1df9-4e80-b7ca-68c6a5ddfb4b req-3a3c60f2-ec2d-438c-ace4-fe0de0ddb5e0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128979 May 27 15:05:39.788257 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1051/2029] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:39.799370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12d35ce2-66f0-4cec-9e31-712ee911871f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:39.806091 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12d35ce2-66f0-4cec-9e31-712ee911871f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:39.810491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12d35ce2-66f0-4cec-9e31-712ee911871f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:39.812962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12d35ce2-66f0-4cec-9e31-712ee911871f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:39.864663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ab5193a4-868d-464c-b59e-5de0f1906179 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:39.866467 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ab5193a4-868d-464c-b59e-5de0f1906179 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 31db04fa-a046-4535-8191-c7db2b34a029] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:39.893412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab5193a4-868d-464c-b59e-5de0f1906179 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:39.896492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab5193a4-868d-464c-b59e-5de0f1906179 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:39.900643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab5193a4-868d-464c-b59e-5de0f1906179 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:39.907430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab5193a4-868d-464c-b59e-5de0f1906179 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:40.178342 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ab5193a4-868d-464c-b59e-5de0f1906179 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:40.192742 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ab5193a4-868d-464c-b59e-5de0f1906179 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/31db04fa-a046-4535-8191-c7db2b34a029" status: 200 len: 1304 microversion: 2.1 time: 0.337896 May 27 15:05:40.204485 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1052/2030] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:39 2022] GET /compute/v2.1/servers/31db04fa-a046-4535-8191-c7db2b34a029 => generated 1304 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:40.211516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-891d6810-5e31-4991-923b-d6b9f7ce883a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:40.212718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-891d6810-5e31-4991-923b-d6b9f7ce883a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:40.222490 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-891d6810-5e31-4991-923b-d6b9f7ce883a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:40.223242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-891d6810-5e31-4991-923b-d6b9f7ce883a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:40.224593 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-891d6810-5e31-4991-923b-d6b9f7ce883a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:40.225824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-891d6810-5e31-4991-923b-d6b9f7ce883a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:40.279681 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-12d35ce2-66f0-4cec-9e31-712ee911871f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:40.291972 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-12d35ce2-66f0-4cec-9e31-712ee911871f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.521046 May 27 15:05:40.297657 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 979/2031] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:39 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:05:40.312852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b54e8b37-f70e-4d42-90dc-b073cc710da8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:40.313487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b54e8b37-f70e-4d42-90dc-b073cc710da8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:40.331479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b54e8b37-f70e-4d42-90dc-b073cc710da8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:40.340429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b54e8b37-f70e-4d42-90dc-b073cc710da8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:40.344388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b54e8b37-f70e-4d42-90dc-b073cc710da8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:40.345091 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b54e8b37-f70e-4d42-90dc-b073cc710da8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:40.428569 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-891d6810-5e31-4991-923b-d6b9f7ce883a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:40.455680 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-891d6810-5e31-4991-923b-d6b9f7ce883a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1345 microversion: 2.1 time: 0.249455 May 27 15:05:40.474707 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1053/2032] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:40 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1345 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:40.707727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b54e8b37-f70e-4d42-90dc-b073cc710da8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:40.722395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-173adbba-082c-4b45-aad9-33c7dacaa278 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:40.723328 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-173adbba-082c-4b45-aad9-33c7dacaa278 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:40.738912 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b54e8b37-f70e-4d42-90dc-b073cc710da8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1315 microversion: 2.1 time: 0.439692 May 27 15:05:40.743618 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 980/2033] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:40 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:40.749254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-173adbba-082c-4b45-aad9-33c7dacaa278 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:40.753196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-173adbba-082c-4b45-aad9-33c7dacaa278 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:40.754548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-173adbba-082c-4b45-aad9-33c7dacaa278 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:40.756148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-173adbba-082c-4b45-aad9-33c7dacaa278 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:41.009856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-173adbba-082c-4b45-aad9-33c7dacaa278 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:41.020981 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-173adbba-082c-4b45-aad9-33c7dacaa278 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1523 microversion: 2.1 time: 0.308217 May 27 15:05:41.032544 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1054/2034] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:40 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:41.038769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e2d7a37f-b9bc-41f5-9a54-040fe55fbe31 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:41.039570 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e2d7a37f-b9bc-41f5-9a54-040fe55fbe31 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:41.051370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e2d7a37f-b9bc-41f5-9a54-040fe55fbe31 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:41.057487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e2d7a37f-b9bc-41f5-9a54-040fe55fbe31 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:41.058623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e2d7a37f-b9bc-41f5-9a54-040fe55fbe31 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:41.059080 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e2d7a37f-b9bc-41f5-9a54-040fe55fbe31 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:41.132004 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e2d7a37f-b9bc-41f5-9a54-040fe55fbe31 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:05:41.210179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6141a66c-b141-4b8b-a9c4-36f624f658e7 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:41.211068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6141a66c-b141-4b8b-a9c4-36f624f658e7 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 31db04fa-a046-4535-8191-c7db2b34a029] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:41.230913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6141a66c-b141-4b8b-a9c4-36f624f658e7 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:41.231886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6141a66c-b141-4b8b-a9c4-36f624f658e7 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:41.233638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6141a66c-b141-4b8b-a9c4-36f624f658e7 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:41.240812 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6141a66c-b141-4b8b-a9c4-36f624f658e7 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:41.272550 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-6141a66c-b141-4b8b-a9c4-36f624f658e7 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] HTTP exception thrown: Instance 31db04fa-a046-4535-8191-c7db2b34a029 could not be found. May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6141a66c-b141-4b8b-a9c4-36f624f658e7 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Request method failure captured: May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/31db04fa-a046-4535-8191-c7db2b34a029 HTTP/1.1 May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOfd5hdxLeIINzf1SGh8rcVIlOjIbaEfXQGyzTLmyQvSh4Xl0M97PMVOQYpMpAcyHD0h4iPPWz2VoG4iudcTpWdaEThkb3zz2WwK1_NStu3ayjQgrPJgz8YPOZlcPx0wS3ui17AvHHUaERlLugYwIFWbEzuGHXRywldg7ob0y3b_kdc May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: a081b119396543ad8ac9421acc677175 May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a081b119396543ad8ac9421acc677175"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a081b119396543ad8ac9421acc677175"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a081b119396543ad8ac9421acc677175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a081b119396543ad8ac9421acc677175", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: a081b119396543ad8ac9421acc677175 May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersOnMultiNodesTest-943751365-project May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: f426b883acdc49f8b0c4a9ba68e4572b May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersOnMultiNodesTest-943751365-project May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 31db04fa-a046-4535-8191-c7db2b34a029 could not be found. May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '31db04fa-a046-4535-8191-c7db2b34a029'} May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31db04fa-a046-4535-8191-c7db2b34a029 could not be found. May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31db04fa-a046-4535-8191-c7db2b34a029 could not be found. May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:41.274609 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:41.282447 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:41.282447 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:41.282447 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:41.282447 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:41.282447 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:41.282447 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31db04fa-a046-4535-8191-c7db2b34a029 could not be found. May 27 15:05:41.282447 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:41.284427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6141a66c-b141-4b8b-a9c4-36f624f658e7 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Returning 404 to user: Instance 31db04fa-a046-4535-8191-c7db2b34a029 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:41.285598 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6141a66c-b141-4b8b-a9c4-36f624f658e7 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/31db04fa-a046-4535-8191-c7db2b34a029" status: 404 len: 111 microversion: 2.1 time: 0.079792 May 27 15:05:41.289875 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1055/2035] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:41 2022] GET /compute/v2.1/servers/31db04fa-a046-4535-8191-c7db2b34a029 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:05:41.327838 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e2d7a37f-b9bc-41f5-9a54-040fe55fbe31 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 204 len: 0 microversion: 2.1 time: 0.292748 May 27 15:05:41.330196 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 981/2036] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:05:41 2022] DELETE /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:05:41.347345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-89783ed1-964c-4631-bbd1-4dee1b328054 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:41.366578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-89783ed1-964c-4631-bbd1-4dee1b328054 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:41.389070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89783ed1-964c-4631-bbd1-4dee1b328054 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:41.397348 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89783ed1-964c-4631-bbd1-4dee1b328054 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:41.398215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89783ed1-964c-4631-bbd1-4dee1b328054 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:41.398672 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89783ed1-964c-4631-bbd1-4dee1b328054 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:41.473321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89783ed1-964c-4631-bbd1-4dee1b328054 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:41.473321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89783ed1-964c-4631-bbd1-4dee1b328054 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:41.473321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-89783ed1-964c-4631-bbd1-4dee1b328054 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lazy-loading 'fault' on Instance uuid 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:05:41.647122 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-89783ed1-964c-4631-bbd1-4dee1b328054 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:41.661923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bb13991c-98e0-484a-959e-7264944772fa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Action: 'create', calling method: .version_select at 0x7fc7765d39d0>, body: {"keypair": {"name": "tempest-keypair-1612558958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlBIqIzARgShAv86ges0RuLDerNz9ttQvlycGKfGzp1u3dN7CFsKiCwGThbR5ahLwbiLUoeCVHE7VT9rWRf+GdEgssoMVaqA4VLOUebYfEMPPpcTiy0k3ROGVYfIHDOgA=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:41.685345 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-89783ed1-964c-4631-bbd1-4dee1b328054 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0" status: 200 len: 1309 microversion: 2.1 time: 0.350153 May 27 15:05:41.687105 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 982/2037] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:41 2022] GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 => generated 1309 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:41.693340 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-bb13991c-98e0-484a-959e-7264944772fa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Getting quotas for project 3565af3212e74e83b5adc7465922a274. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:05:41.703057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-bb13991c-98e0-484a-959e-7264944772fa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Getting quotas for user 13124d91fc454405af084784c6f447ab and project 3565af3212e74e83b5adc7465922a274. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:05:41.708909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e9b8f3d1-a6d9-4c48-903f-bf616741ff99 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:41.711861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e9b8f3d1-a6d9-4c48-903f-bf616741ff99 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:41.731633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9b8f3d1-a6d9-4c48-903f-bf616741ff99 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:41.732987 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9b8f3d1-a6d9-4c48-903f-bf616741ff99 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:41.733838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9b8f3d1-a6d9-4c48-903f-bf616741ff99 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:41.734278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9b8f3d1-a6d9-4c48-903f-bf616741ff99 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:41.744594 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bb13991c-98e0-484a-959e-7264944772fa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.449048 May 27 15:05:41.746452 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1056/2038] 10.222.0.13 () {62 vars in 1199 bytes} [Fri May 27 15:05:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 452 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 15:05:41.758010 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8d1fa5a7-dd33-458d-b61e-c20614b30db3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:41.759932 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8d1fa5a7-dd33-458d-b61e-c20614b30db3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:41.770117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d1fa5a7-dd33-458d-b61e-c20614b30db3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:41.771047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d1fa5a7-dd33-458d-b61e-c20614b30db3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:41.773300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d1fa5a7-dd33-458d-b61e-c20614b30db3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:41.774307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d1fa5a7-dd33-458d-b61e-c20614b30db3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:42.156360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8d1fa5a7-dd33-458d-b61e-c20614b30db3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:42.165885 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8d1fa5a7-dd33-458d-b61e-c20614b30db3 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1529 microversion: 2.1 time: 0.417840 May 27 15:05:42.170946 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1057/2039] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:41 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1529 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:42.187742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-13a1401d-1cef-4ec3-a4f7-babe39e6103f req-1aed7f97-cd70-4f8d-9734-938a594cb59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a4ac567-1148-41b4-80eb-6fb25fae7b7c", "name": "network-vif-plugged", "status": "completed", "tag": "103f073e-4e7b-4dab-9558-27baab47f022"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:42.202581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e9b8f3d1-a6d9-4c48-903f-bf616741ff99 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:42.212600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-13a1401d-1cef-4ec3-a4f7-babe39e6103f req-1aed7f97-cd70-4f8d-9734-938a594cb59a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:42.216328 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-13a1401d-1cef-4ec3-a4f7-babe39e6103f req-1aed7f97-cd70-4f8d-9734-938a594cb59a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:42.216841 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e9b8f3d1-a6d9-4c48-903f-bf616741ff99 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.525524 May 27 15:05:42.219772 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 983/2040] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:41 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:42.229759 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d4442a37-d823-4602-be93-53a86078416f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:42.232637 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d4442a37-d823-4602-be93-53a86078416f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:42.253007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d4442a37-d823-4602-be93-53a86078416f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:42.253843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d4442a37-d823-4602-be93-53a86078416f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:42.256841 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d4442a37-d823-4602-be93-53a86078416f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:42.257628 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-13a1401d-1cef-4ec3-a4f7-babe39e6103f req-1aed7f97-cd70-4f8d-9734-938a594cb59a service nova] Creating event network-vif-plugged:103f073e-4e7b-4dab-9558-27baab47f022 for instance 3a4ac567-1148-41b4-80eb-6fb25fae7b7c on n-h1-843621-1 May 27 15:05:42.258467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d4442a37-d823-4602-be93-53a86078416f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:42.289620 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-13a1401d-1cef-4ec3-a4f7-babe39e6103f req-1aed7f97-cd70-4f8d-9734-938a594cb59a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095749 May 27 15:05:42.291211 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1058/2041] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:42.328643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-87818c01-67fa-41ff-ba58-33aab97b3f22 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:42.329465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-87818c01-67fa-41ff-ba58-33aab97b3f22 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:42.343814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87818c01-67fa-41ff-ba58-33aab97b3f22 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:42.344278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87818c01-67fa-41ff-ba58-33aab97b3f22 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:42.345118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87818c01-67fa-41ff-ba58-33aab97b3f22 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:42.345703 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87818c01-67fa-41ff-ba58-33aab97b3f22 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:42.389359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d4442a37-d823-4602-be93-53a86078416f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:42.399442 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d4442a37-d823-4602-be93-53a86078416f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1345 microversion: 2.1 time: 0.178315 May 27 15:05:42.411890 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 984/2042] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:42 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1345 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:42.418066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-417a3d49-8517-4a45-b666-0cfb0101878a req-9109d59b-6bc3-41de-8b22-260015fb83f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023b1bc9-f67a-4173-9730-9ecb7a3f6ed0", "name": "network-vif-deleted", "tag": "e0e653e0-9fdc-48c4-84a5-af24da58ef81"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:42.436788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-417a3d49-8517-4a45-b666-0cfb0101878a req-9109d59b-6bc3-41de-8b22-260015fb83f9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:42.437832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-417a3d49-8517-4a45-b666-0cfb0101878a req-9109d59b-6bc3-41de-8b22-260015fb83f9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:42.462644 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-417a3d49-8517-4a45-b666-0cfb0101878a req-9109d59b-6bc3-41de-8b22-260015fb83f9 service nova] Creating event network-vif-deleted:e0e653e0-9fdc-48c4-84a5-af24da58ef81 for instance 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 on n-h1-843621-1 May 27 15:05:42.471227 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-417a3d49-8517-4a45-b666-0cfb0101878a req-9109d59b-6bc3-41de-8b22-260015fb83f9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057153 May 27 15:05:42.472783 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 985/2043] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:42.705343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-667514a8-fa0f-493b-ac3f-2f8029a74687 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:42.706533 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-667514a8-fa0f-493b-ac3f-2f8029a74687 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:42.721446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-667514a8-fa0f-493b-ac3f-2f8029a74687 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:42.728204 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-667514a8-fa0f-493b-ac3f-2f8029a74687 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:42.729627 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-667514a8-fa0f-493b-ac3f-2f8029a74687 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:42.730317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-667514a8-fa0f-493b-ac3f-2f8029a74687 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:42.743337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-87818c01-67fa-41ff-ba58-33aab97b3f22 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:42.759941 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-87818c01-67fa-41ff-ba58-33aab97b3f22 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1315 microversion: 2.1 time: 0.466358 May 27 15:05:42.766207 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-667514a8-fa0f-493b-ac3f-2f8029a74687 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] HTTP exception thrown: Instance 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 could not be found. May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-667514a8-fa0f-493b-ac3f-2f8029a74687 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Request method failure captured: May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 HTTP/1.1 May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOfd5hdxLeIINzf1SGh8rcVIlOjIbaEfXQGyzTLmyQvSh4Xl0M97PMVOQYpMpAcyHD0h4iPPWz2VoG4iudcTpWdaEThkb3zz2WwK1_NStu3ayjQgrPJgz8YPOZlcPx0wS3ui17AvHHUaERlLugYwIFWbEzuGHXRywldg7ob0y3b_kdc May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: a081b119396543ad8ac9421acc677175 May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a081b119396543ad8ac9421acc677175"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a081b119396543ad8ac9421acc677175"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a081b119396543ad8ac9421acc677175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a081b119396543ad8ac9421acc677175", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: a081b119396543ad8ac9421acc677175 May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersOnMultiNodesTest-943751365-project May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: f426b883acdc49f8b0c4a9ba68e4572b May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersOnMultiNodesTest-943751365-project May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 could not be found. May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '023b1bc9-f67a-4173-9730-9ecb7a3f6ed0'} May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 could not be found. May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 could not be found. May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:42.768007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:42.773637 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:42.773637 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:42.773637 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:42.773637 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:42.773637 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:42.773637 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 could not be found. May 27 15:05:42.773637 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:42.774237 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1059/2044] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:42 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:42.774341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-667514a8-fa0f-493b-ac3f-2f8029a74687 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Returning 404 to user: Instance 023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:42.774341 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-667514a8-fa0f-493b-ac3f-2f8029a74687 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0" status: 404 len: 111 microversion: 2.1 time: 0.071295 May 27 15:05:42.774341 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 986/2045] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:42 2022] GET /compute/v2.1/servers/023b1bc9-f67a-4173-9730-9ecb7a3f6ed0 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:05:42.783066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a67d4c9c-0e6b-4835-8213-06aaf7a0074f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:42.876439 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a67d4c9c-0e6b-4835-8213-06aaf7a0074f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/1ed3038c-7c93-45cf-b931-4568dc0d8fe3" status: 204 len: 0 microversion: 2.1 time: 0.098456 May 27 15:05:42.877093 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1060/2046] 10.222.0.13 () {58 vars in 1265 bytes} [Fri May 27 15:05:42 2022] DELETE /compute/v2.1/os-server-groups/1ed3038c-7c93-45cf-b931-4568dc0d8fe3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:05:42.885576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-53f69bc0-a666-4eb3-b53a-3830ed2e8e6f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:42.886080 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-53f69bc0-a666-4eb3-b53a-3830ed2e8e6f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:42.902858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-53f69bc0-a666-4eb3-b53a-3830ed2e8e6f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:42.903320 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-53f69bc0-a666-4eb3-b53a-3830ed2e8e6f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:42.904116 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-53f69bc0-a666-4eb3-b53a-3830ed2e8e6f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:42.905349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-53f69bc0-a666-4eb3-b53a-3830ed2e8e6f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:42.953291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:42.967707 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-53f69bc0-a666-4eb3-b53a-3830ed2e8e6f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:05:43.082443 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-53f69bc0-a666-4eb3-b53a-3830ed2e8e6f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "DELETE /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 204 len: 0 microversion: 2.1 time: 0.200424 May 27 15:05:43.092971 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-45e91eda-b0ad-4e6a-b368-ef9feb0fc55f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:43.093876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-45e91eda-b0ad-4e6a-b368-ef9feb0fc55f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:43.098005 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 987/2047] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:05:42 2022] DELETE /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:05:43.103702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45e91eda-b0ad-4e6a-b368-ef9feb0fc55f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:43.104554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45e91eda-b0ad-4e6a-b368-ef9feb0fc55f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:43.105591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45e91eda-b0ad-4e6a-b368-ef9feb0fc55f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:43.106210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45e91eda-b0ad-4e6a-b368-ef9feb0fc55f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:43.189692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-adf85bc9-ec56-48e5-8f35-33850a95262e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:43.190742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-adf85bc9-ec56-48e5-8f35-33850a95262e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:43.199670 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-adf85bc9-ec56-48e5-8f35-33850a95262e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:43.207206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-adf85bc9-ec56-48e5-8f35-33850a95262e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:43.208456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-adf85bc9-ec56-48e5-8f35-33850a95262e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:43.209239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-adf85bc9-ec56-48e5-8f35-33850a95262e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:43.559301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-45e91eda-b0ad-4e6a-b368-ef9feb0fc55f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:43.582417 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-45e91eda-b0ad-4e6a-b368-ef9feb0fc55f tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1472 microversion: 2.1 time: 0.493919 May 27 15:05:43.585841 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1061/2048] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:43 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1472 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:43.600595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-46c8fa8a-b0f0-4387-b0ed-3cc1302dc415 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:43.602234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-46c8fa8a-b0f0-4387-b0ed-3cc1302dc415 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:43.602375 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-adf85bc9-ec56-48e5-8f35-33850a95262e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:43.613196 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-adf85bc9-ec56-48e5-8f35-33850a95262e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1529 microversion: 2.1 time: 0.428824 May 27 15:05:43.625373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-46c8fa8a-b0f0-4387-b0ed-3cc1302dc415 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:43.626024 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 988/2049] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:43 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1529 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:05:43.631085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-39497777-6588-46b6-a684-095fc6ba8c11 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:43.632115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-46c8fa8a-b0f0-4387-b0ed-3cc1302dc415 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:43.632978 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-39497777-6588-46b6-a684-095fc6ba8c11 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:43.638383 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-46c8fa8a-b0f0-4387-b0ed-3cc1302dc415 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:43.638984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-46c8fa8a-b0f0-4387-b0ed-3cc1302dc415 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:43.678448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-39497777-6588-46b6-a684-095fc6ba8c11 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:43.678915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-39497777-6588-46b6-a684-095fc6ba8c11 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:43.682253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-39497777-6588-46b6-a684-095fc6ba8c11 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:43.682715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-39497777-6588-46b6-a684-095fc6ba8c11 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:43.871019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-39497777-6588-46b6-a684-095fc6ba8c11 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:43.894227 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-39497777-6588-46b6-a684-095fc6ba8c11 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1345 microversion: 2.1 time: 0.266902 May 27 15:05:43.898125 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 989/2050] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:43 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1345 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:43.920012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ee7ca3d0-cd2e-4a1c-bd84-ca1cf1a7e2bc tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:43.921236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ee7ca3d0-cd2e-4a1c-bd84-ca1cf1a7e2bc tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:43.947341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ee7ca3d0-cd2e-4a1c-bd84-ca1cf1a7e2bc tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:43.959360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ee7ca3d0-cd2e-4a1c-bd84-ca1cf1a7e2bc tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:43.960438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ee7ca3d0-cd2e-4a1c-bd84-ca1cf1a7e2bc tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:43.961103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ee7ca3d0-cd2e-4a1c-bd84-ca1cf1a7e2bc tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:44.153171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-46c8fa8a-b0f0-4387-b0ed-3cc1302dc415 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:44.163953 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-46c8fa8a-b0f0-4387-b0ed-3cc1302dc415 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.567159 May 27 15:05:44.176333 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1062/2051] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:43 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:44.362874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-3c986e9a-a064-4050-a72e-ff22c2883b07 req-5fa115fa-2930-495f-ad60-8a6706ca36f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c473f1c8-4e5d-4141-94e1-0bc0af40797e", "name": "network-vif-plugged", "status": "completed", "tag": "8e11235b-24c3-4020-a8f1-f86e3040645f"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:44.394891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3c986e9a-a064-4050-a72e-ff22c2883b07 req-5fa115fa-2930-495f-ad60-8a6706ca36f3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:44.399127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3c986e9a-a064-4050-a72e-ff22c2883b07 req-5fa115fa-2930-495f-ad60-8a6706ca36f3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:44.435566 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-3c986e9a-a064-4050-a72e-ff22c2883b07 req-5fa115fa-2930-495f-ad60-8a6706ca36f3 service nova] Creating event network-vif-plugged:8e11235b-24c3-4020-a8f1-f86e3040645f for instance c473f1c8-4e5d-4141-94e1-0bc0af40797e on n-h2-843621-1 May 27 15:05:44.447628 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-3c986e9a-a064-4050-a72e-ff22c2883b07 req-5fa115fa-2930-495f-ad60-8a6706ca36f3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089860 May 27 15:05:44.450411 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1063/2052] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:44.561810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ee7ca3d0-cd2e-4a1c-bd84-ca1cf1a7e2bc tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:44.584788 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ee7ca3d0-cd2e-4a1c-bd84-ca1cf1a7e2bc tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1315 microversion: 2.1 time: 0.682845 May 27 15:05:44.592865 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 990/2053] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:43 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1315 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:44.616402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ccb016e6-3c1c-45aa-a3b8-f7edb4933d48 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:44.618606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ccb016e6-3c1c-45aa-a3b8-f7edb4933d48 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:44.627926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:44.643683 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aca3bd10-d878-4a96-b994-faafd378e7f6 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:44.644325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-aca3bd10-d878-4a96-b994-faafd378e7f6 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:44.645747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccb016e6-3c1c-45aa-a3b8-f7edb4933d48 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:44.651139 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccb016e6-3c1c-45aa-a3b8-f7edb4933d48 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:44.653204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccb016e6-3c1c-45aa-a3b8-f7edb4933d48 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:44.661811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccb016e6-3c1c-45aa-a3b8-f7edb4933d48 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:44.663085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aca3bd10-d878-4a96-b994-faafd378e7f6 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:44.664784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aca3bd10-d878-4a96-b994-faafd378e7f6 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:44.669800 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aca3bd10-d878-4a96-b994-faafd378e7f6 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:44.684655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aca3bd10-d878-4a96-b994-faafd378e7f6 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:44.690260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:45.821556 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ccb016e6-3c1c-45aa-a3b8-f7edb4933d48 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f426b883acdc49f8b0c4a9ba68e4572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a081b119396543ad8ac9421acc677175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:45.845600 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ccb016e6-3c1c-45aa-a3b8-f7edb4933d48 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 200 len: 1472 microversion: 2.1 time: 1.225528 May 27 15:05:45.845600 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1064/2054] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:44 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 1472 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:45.849295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9d4fc6d8-bbb4-4910-9cb3-da7397aae30b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:45.849919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9d4fc6d8-bbb4-4910-9cb3-da7397aae30b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:45.865678 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9d4fc6d8-bbb4-4910-9cb3-da7397aae30b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:45.866310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9d4fc6d8-bbb4-4910-9cb3-da7397aae30b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:45.867141 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9d4fc6d8-bbb4-4910-9cb3-da7397aae30b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:45.867761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9d4fc6d8-bbb4-4910-9cb3-da7397aae30b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:45.922204 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-aca3bd10-d878-4a96-b994-faafd378e7f6 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:45.930857 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-aca3bd10-d878-4a96-b994-faafd378e7f6 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 200 len: 1529 microversion: 2.1 time: 1.303412 May 27 15:05:45.945968 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 991/2055] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:44 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 1529 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:45.952652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-45bbbc46-2e90-4dda-8823-f05d23e33859 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:45.967074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-45bbbc46-2e90-4dda-8823-f05d23e33859 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:45.979852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45bbbc46-2e90-4dda-8823-f05d23e33859 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:45.980650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45bbbc46-2e90-4dda-8823-f05d23e33859 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:45.981736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45bbbc46-2e90-4dda-8823-f05d23e33859 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:45.985992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45bbbc46-2e90-4dda-8823-f05d23e33859 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:46.035652 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9d4fc6d8-bbb4-4910-9cb3-da7397aae30b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:46.047719 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9d4fc6d8-bbb4-4910-9cb3-da7397aae30b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1345 microversion: 2.1 time: 0.206318 May 27 15:05:46.051142 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1065/2056] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:45 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1345 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:46.066234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-2158be2f-d4ec-49d7-9c7c-e204e943ac48 req-0095c9fc-7bcd-42f7-8b64-0dc1113d830a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44417337-ef8b-407b-aafd-7f00dfc5b4d8", "name": "network-vif-deleted", "tag": "452a5598-4173-4a88-8db6-c8043089f346"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:46.075333 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2158be2f-d4ec-49d7-9c7c-e204e943ac48 req-0095c9fc-7bcd-42f7-8b64-0dc1113d830a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:46.076215 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2158be2f-d4ec-49d7-9c7c-e204e943ac48 req-0095c9fc-7bcd-42f7-8b64-0dc1113d830a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:46.093658 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-2158be2f-d4ec-49d7-9c7c-e204e943ac48 req-0095c9fc-7bcd-42f7-8b64-0dc1113d830a service nova] Creating event network-vif-deleted:452a5598-4173-4a88-8db6-c8043089f346 for instance 44417337-ef8b-407b-aafd-7f00dfc5b4d8 on n-h2-843621-1 May 27 15:05:46.104771 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-2158be2f-d4ec-49d7-9c7c-e204e943ac48 req-0095c9fc-7bcd-42f7-8b64-0dc1113d830a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041272 May 27 15:05:46.106491 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1066/2057] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:46.118573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-22377568-75fe-4d4f-b628-b2eb37a30413 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:46.120054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-22377568-75fe-4d4f-b628-b2eb37a30413 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:46.135142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22377568-75fe-4d4f-b628-b2eb37a30413 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:46.136223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22377568-75fe-4d4f-b628-b2eb37a30413 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:46.137808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22377568-75fe-4d4f-b628-b2eb37a30413 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:46.138759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22377568-75fe-4d4f-b628-b2eb37a30413 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:46.597052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-45bbbc46-2e90-4dda-8823-f05d23e33859 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:46.610242 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-45bbbc46-2e90-4dda-8823-f05d23e33859 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1505 microversion: 2.1 time: 0.663110 May 27 15:05:46.614325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-22377568-75fe-4d4f-b628-b2eb37a30413 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:46.615832 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 992/2058] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:45 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1505 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:46.623144 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-22377568-75fe-4d4f-b628-b2eb37a30413 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1504 microversion: 2.1 time: 0.513800 May 27 15:05:46.623849 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1067/2059] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:46 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1504 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:46.643416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4ee0d32a-29e3-414b-9348-b3c39a7fa8d8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-999217455"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:46.643970 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4ee0d32a-29e3-414b-9348-b3c39a7fa8d8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:46.647818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:46.658703 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4ee0d32a-29e3-414b-9348-b3c39a7fa8d8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:46.659587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4ee0d32a-29e3-414b-9348-b3c39a7fa8d8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:46.660633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4ee0d32a-29e3-414b-9348-b3c39a7fa8d8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:46.661309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4ee0d32a-29e3-414b-9348-b3c39a7fa8d8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:46.679161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-99bebd12-1bef-4a4c-8288-09aff9ddfa3e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-443945650", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7fbb2c43-5d8d-43c9-999b-43c445e0b1f6"}], "security_groups": [{"name": "tempest-securitygroup--1969082177"}], "key_name": "tempest-keypair-1612558958", "user_data": "}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:47.000071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-99bebd12-1bef-4a4c-8288-09aff9ddfa3e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] validate_networks() for [('7fbb2c43-5d8d-43c9-999b-43c445e0b1f6', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:05:47.142711 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.network.security_group_api [None req-4ee0d32a-29e3-414b-9348-b3c39a7fa8d8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Adding security group bb911aef-1979-41ae-9149-3a617ed11d98 to port 103f073e-4e7b-4dab-9558-27baab47f022 May 27 15:05:47.768763 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-99bebd12-1bef-4a4c-8288-09aff9ddfa3e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:05:47.770207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-99bebd12-1bef-4a4c-8288-09aff9ddfa3e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:05:47.770207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-99bebd12-1bef-4a4c-8288-09aff9ddfa3e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:05:47.770677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-99bebd12-1bef-4a4c-8288-09aff9ddfa3e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:05:47.771263 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-99bebd12-1bef-4a4c-8288-09aff9ddfa3e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:05:47.781539 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99bebd12-1bef-4a4c-8288-09aff9ddfa3e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:47.782088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99bebd12-1bef-4a4c-8288-09aff9ddfa3e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:47.783028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99bebd12-1bef-4a4c-8288-09aff9ddfa3e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:47.783658 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99bebd12-1bef-4a4c-8288-09aff9ddfa3e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:47.803779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-99bebd12-1bef-4a4c-8288-09aff9ddfa3e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Getting quotas for project 3565af3212e74e83b5adc7465922a274. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:05:47.810731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-99bebd12-1bef-4a4c-8288-09aff9ddfa3e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Getting quotas for user 13124d91fc454405af084784c6f447ab and project 3565af3212e74e83b5adc7465922a274. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:05:47.830418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-99bebd12-1bef-4a4c-8288-09aff9ddfa3e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:05:47.833005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-99bebd12-1bef-4a4c-8288-09aff9ddfa3e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:05:47.844435 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4ee0d32a-29e3-414b-9348-b3c39a7fa8d8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "POST /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c/action" status: 202 len: 0 microversion: 2.1 time: 1.205493 May 27 15:05:47.853438 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 993/2060] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:05:46 2022] POST /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c/action => generated 0 bytes in 1208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:05:47.853438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-36028ff5-d156-43ce-b2ea-b01f57262ba8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:47.854984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-36028ff5-d156-43ce-b2ea-b01f57262ba8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] [instance: 44417337-ef8b-407b-aafd-7f00dfc5b4d8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:47.870053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36028ff5-d156-43ce-b2ea-b01f57262ba8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:47.876297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36028ff5-d156-43ce-b2ea-b01f57262ba8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:47.877412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36028ff5-d156-43ce-b2ea-b01f57262ba8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:47.877871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36028ff5-d156-43ce-b2ea-b01f57262ba8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:47.902119 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-36028ff5-d156-43ce-b2ea-b01f57262ba8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] HTTP exception thrown: Instance 44417337-ef8b-407b-aafd-7f00dfc5b4d8 could not be found. May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-36028ff5-d156-43ce-b2ea-b01f57262ba8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Request method failure captured: May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 HTTP/1.1 May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOfd5hdxLeIINzf1SGh8rcVIlOjIbaEfXQGyzTLmyQvSh4Xl0M97PMVOQYpMpAcyHD0h4iPPWz2VoG4iudcTpWdaEThkb3zz2WwK1_NStu3ayjQgrPJgz8YPOZlcPx0wS3ui17AvHHUaERlLugYwIFWbEzuGHXRywldg7ob0y3b_kdc May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: a081b119396543ad8ac9421acc677175 May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a081b119396543ad8ac9421acc677175"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a081b119396543ad8ac9421acc677175"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a081b119396543ad8ac9421acc677175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a081b119396543ad8ac9421acc677175", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: a081b119396543ad8ac9421acc677175 May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-943751365 May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersOnMultiNodesTest-943751365-project May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: f426b883acdc49f8b0c4a9ba68e4572b May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersOnMultiNodesTest-943751365-project May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 44417337-ef8b-407b-aafd-7f00dfc5b4d8 could not be found. May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '44417337-ef8b-407b-aafd-7f00dfc5b4d8'} May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44417337-ef8b-407b-aafd-7f00dfc5b4d8 could not be found. May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44417337-ef8b-407b-aafd-7f00dfc5b4d8 could not be found. May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:47.904010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:47.912144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:47.912144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:47.912144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:47.912144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:47.912144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:47.912144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44417337-ef8b-407b-aafd-7f00dfc5b4d8 could not be found. May 27 15:05:47.912144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:47.912144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-36028ff5-d156-43ce-b2ea-b01f57262ba8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] Returning 404 to user: Instance 44417337-ef8b-407b-aafd-7f00dfc5b4d8 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:47.912144 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-36028ff5-d156-43ce-b2ea-b01f57262ba8 tempest-ServersOnMultiNodesTest-943751365 tempest-ServersOnMultiNodesTest-943751365-project] 10.222.0.13 "GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8" status: 404 len: 111 microversion: 2.1 time: 0.059259 May 27 15:05:47.915239 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 994/2061] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:47 2022] GET /compute/v2.1/servers/44417337-ef8b-407b-aafd-7f00dfc5b4d8 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:05:47.922714 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-f0dbc0e7-c9f8-4580-9f87-52daea3af8cc req-c5553a64-b758-4c96-b4b8-de37124ea68f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c473f1c8-4e5d-4141-94e1-0bc0af40797e", "name": "network-vif-deleted", "tag": "8e11235b-24c3-4020-a8f1-f86e3040645f"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:47.934041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f0dbc0e7-c9f8-4580-9f87-52daea3af8cc req-c5553a64-b758-4c96-b4b8-de37124ea68f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:47.934496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f0dbc0e7-c9f8-4580-9f87-52daea3af8cc req-c5553a64-b758-4c96-b4b8-de37124ea68f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:47.949385 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-f0dbc0e7-c9f8-4580-9f87-52daea3af8cc req-c5553a64-b758-4c96-b4b8-de37124ea68f service nova] Creating event network-vif-deleted:8e11235b-24c3-4020-a8f1-f86e3040645f for instance c473f1c8-4e5d-4141-94e1-0bc0af40797e on n-h2-843621-1 May 27 15:05:47.955916 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-f0dbc0e7-c9f8-4580-9f87-52daea3af8cc req-c5553a64-b758-4c96-b4b8-de37124ea68f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039213 May 27 15:05:47.956861 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 995/2062] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:47.959242 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-99bebd12-1bef-4a4c-8288-09aff9ddfa3e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.284358 May 27 15:05:47.963860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c32f89e3-56ad-42dc-8003-291d02191a65 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:47.965028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c32f89e3-56ad-42dc-8003-291d02191a65 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:47.965399 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1068/2063] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 27 15:05:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1291 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 27 15:05:47.970355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-526401d8-fd35-461f-8550-13aa3ad90815 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:47.971886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-526401d8-fd35-461f-8550-13aa3ad90815 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:47.975114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c32f89e3-56ad-42dc-8003-291d02191a65 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:47.975801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c32f89e3-56ad-42dc-8003-291d02191a65 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:47.976844 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c32f89e3-56ad-42dc-8003-291d02191a65 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:47.977920 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c32f89e3-56ad-42dc-8003-291d02191a65 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:47.996414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-526401d8-fd35-461f-8550-13aa3ad90815 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:47.997062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-526401d8-fd35-461f-8550-13aa3ad90815 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:47.997953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-526401d8-fd35-461f-8550-13aa3ad90815 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:47.999037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-526401d8-fd35-461f-8550-13aa3ad90815 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:48.002310 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-c32f89e3-56ad-42dc-8003-291d02191a65 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] HTTP exception thrown: Instance c473f1c8-4e5d-4141-94e1-0bc0af40797e could not be found. May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c32f89e3-56ad-42dc-8003-291d02191a65 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Request method failure captured: May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e HTTP/1.1 May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOimLUy6xqp-gD8lGFWAUihJRQaSsy_euXND3kG660I8aII4Fj7ST5KLuaskP9b7InGbbwTAnVT5MT1H-Njofjk92SIoSVXWmihhyVdCbe--Q04_qmor9yl_DFjMNoGrjAWoGuMhIp_HpJ221pj4licupaHrWSVP-C-ksMH4M8HOkGM May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b939a1a277f248fdaad387a445a9e780", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: d3cb6de543d34fed9b582f5af0712790 May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance c473f1c8-4e5d-4141-94e1-0bc0af40797e could not be found. May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'c473f1c8-4e5d-4141-94e1-0bc0af40797e'} May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c473f1c8-4e5d-4141-94e1-0bc0af40797e could not be found. May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c473f1c8-4e5d-4141-94e1-0bc0af40797e could not be found. May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:48.024557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:48.030700 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:48.030700 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:48.030700 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:48.030700 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:48.030700 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:48.030700 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:48.030700 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c473f1c8-4e5d-4141-94e1-0bc0af40797e could not be found. May 27 15:05:48.030700 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:48.030700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c32f89e3-56ad-42dc-8003-291d02191a65 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Returning 404 to user: Instance c473f1c8-4e5d-4141-94e1-0bc0af40797e could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:48.030700 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c32f89e3-56ad-42dc-8003-291d02191a65 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 404 len: 111 microversion: 2.1 time: 0.067932 May 27 15:05:48.035737 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 996/2064] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:47 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:05:48.050684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4b9fd244-db3c-4fe5-aac4-83cf2e432b54 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:48.051523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4b9fd244-db3c-4fe5-aac4-83cf2e432b54 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:48.068771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b9fd244-db3c-4fe5-aac4-83cf2e432b54 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:48.069419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b9fd244-db3c-4fe5-aac4-83cf2e432b54 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:48.070312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b9fd244-db3c-4fe5-aac4-83cf2e432b54 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:48.070767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b9fd244-db3c-4fe5-aac4-83cf2e432b54 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:48.132214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-526401d8-fd35-461f-8550-13aa3ad90815 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:48.142254 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-526401d8-fd35-461f-8550-13aa3ad90815 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1345 microversion: 2.1 time: 0.175610 May 27 15:05:48.150671 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1069/2065] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:47 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1345 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:48.174479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-80ecedcc-96fd-4629-9e76-8d86aa5b4f46 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-898500189"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:48.176109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-80ecedcc-96fd-4629-9e76-8d86aa5b4f46 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:48.195525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-80ecedcc-96fd-4629-9e76-8d86aa5b4f46 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:48.196471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-80ecedcc-96fd-4629-9e76-8d86aa5b4f46 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:48.198074 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-80ecedcc-96fd-4629-9e76-8d86aa5b4f46 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:48.198074 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-80ecedcc-96fd-4629-9e76-8d86aa5b4f46 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:48.393763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4b9fd244-db3c-4fe5-aac4-83cf2e432b54 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:48.408047 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4b9fd244-db3c-4fe5-aac4-83cf2e432b54 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1485 microversion: 2.1 time: 0.370969 May 27 15:05:48.420701 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 997/2066] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:48 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1485 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:48.420701 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7f465a30-1e06-4201-a3e4-50a43c80a309 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:48.420701 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7f465a30-1e06-4201-a3e4-50a43c80a309 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:48.523291 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.network.security_group_api [None req-80ecedcc-96fd-4629-9e76-8d86aa5b4f46 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Adding security group a123edee-d5ec-40a9-b42e-42500e205ab2 to port 103f073e-4e7b-4dab-9558-27baab47f022 May 27 15:05:48.594128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7f465a30-1e06-4201-a3e4-50a43c80a309 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:48.604390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7f465a30-1e06-4201-a3e4-50a43c80a309 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:48.606901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7f465a30-1e06-4201-a3e4-50a43c80a309 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:48.610027 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7f465a30-1e06-4201-a3e4-50a43c80a309 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1281 microversion: 2.20 time: 0.199323 May 27 15:05:48.611250 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 998/2067] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:48 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1281 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:48.618160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a21e1146-6bb4-4967-afec-de80a1a6af3a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Action: 'create', calling method: .version_select at 0x7fc7806abe50>, body: {"keypair": {"name": "tempest-keypair-1741623972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIvxRlYSv7NyujCvicnOqrPg+ECnuICv76Zx7Wv3esMWdWmsd/DPrmz0JXXlHCEWguA8t0xDFSKmgHy9j2OCR5WyrCWmlk5mLFGR22k1Z6M1XPeqT78bPC8TaKbqXV97g=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:48.648128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-a21e1146-6bb4-4967-afec-de80a1a6af3a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Getting quotas for project b939a1a277f248fdaad387a445a9e780. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:05:48.654873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-a21e1146-6bb4-4967-afec-de80a1a6af3a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Getting quotas for user d3cb6de543d34fed9b582f5af0712790 and project b939a1a277f248fdaad387a445a9e780. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:05:48.690199 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a21e1146-6bb4-4967-afec-de80a1a6af3a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.077304 May 27 15:05:48.697637 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 999/2068] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:05:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:48.705232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-130b8acb-da7b-4bed-bbf3-3d7d43c189df tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-32154728", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:48.783059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-130b8acb-da7b-4bed-bbf3-3d7d43c189df tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] validate_networks() for [('80eb5c58-0683-4e37-88ce-18553afe38a6', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:05:49.859079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-130b8acb-da7b-4bed-bbf3-3d7d43c189df tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:05:49.859721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-130b8acb-da7b-4bed-bbf3-3d7d43c189df tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:05:49.860735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-130b8acb-da7b-4bed-bbf3-3d7d43c189df tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:05:49.862140 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-130b8acb-da7b-4bed-bbf3-3d7d43c189df tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:05:49.864199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-130b8acb-da7b-4bed-bbf3-3d7d43c189df tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:05:49.888620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-130b8acb-da7b-4bed-bbf3-3d7d43c189df tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:49.889890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-130b8acb-da7b-4bed-bbf3-3d7d43c189df tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:49.890875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-130b8acb-da7b-4bed-bbf3-3d7d43c189df tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:49.891399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-130b8acb-da7b-4bed-bbf3-3d7d43c189df tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:49.922853 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-130b8acb-da7b-4bed-bbf3-3d7d43c189df tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Getting quotas for project b31e7608039c4158936369f57b31cf55. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:05:49.931005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-130b8acb-da7b-4bed-bbf3-3d7d43c189df tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Getting quotas for user a8a53f4308e94cc1af6516680c0f2a47 and project b31e7608039c4158936369f57b31cf55. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:05:49.994394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-130b8acb-da7b-4bed-bbf3-3d7d43c189df tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:05:50.003890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-130b8acb-da7b-4bed-bbf3-3d7d43c189df tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:05:50.015327 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-80ecedcc-96fd-4629-9e76-8d86aa5b4f46 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "POST /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c/action" status: 202 len: 0 microversion: 2.1 time: 1.862473 May 27 15:05:50.016788 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1070/2069] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:05:48 2022] POST /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c/action => generated 0 bytes in 1865 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:05:50.022112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-08f9085b-d35c-4778-8be6-3fa90a613e4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:50.022787 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-08f9085b-d35c-4778-8be6-3fa90a613e4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:50.040975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08f9085b-d35c-4778-8be6-3fa90a613e4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:50.041477 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08f9085b-d35c-4778-8be6-3fa90a613e4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:50.042320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08f9085b-d35c-4778-8be6-3fa90a613e4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:50.042775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08f9085b-d35c-4778-8be6-3fa90a613e4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:50.159399 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-130b8acb-da7b-4bed-bbf3-3d7d43c189df tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.457687 May 27 15:05:50.166216 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1000/2070] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:05:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 1462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:05:50.166493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08f9085b-d35c-4778-8be6-3fa90a613e4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:50.166493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08f9085b-d35c-4778-8be6-3fa90a613e4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:50.166872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-08f9085b-d35c-4778-8be6-3fa90a613e4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lazy-loading 'fault' on Instance uuid 74741255-3451-4856-af14-5320fa7e2d76 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:05:50.182459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8da94743-f504-4db1-9a90-5fdf268d55d0 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:50.185493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8da94743-f504-4db1-9a90-5fdf268d55d0 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:50.209263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8da94743-f504-4db1-9a90-5fdf268d55d0 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:50.209735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8da94743-f504-4db1-9a90-5fdf268d55d0 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:50.210544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8da94743-f504-4db1-9a90-5fdf268d55d0 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:50.210984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8da94743-f504-4db1-9a90-5fdf268d55d0 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:50.388537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-08f9085b-d35c-4778-8be6-3fa90a613e4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:50.406199 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-08f9085b-d35c-4778-8be6-3fa90a613e4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 200 len: 1350 microversion: 2.1 time: 0.387867 May 27 15:05:50.408876 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1071/2071] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:50 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 1350 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:50.427897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-4054b5e4-b419-45a3-bd53-f2d3c0f3e122 req-9870685b-09c5-4720-809d-eedc58ba29fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a4ac567-1148-41b4-80eb-6fb25fae7b7c", "tag": "103f073e-4e7b-4dab-9558-27baab47f022"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:50.507615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8da94743-f504-4db1-9a90-5fdf268d55d0 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:50.517850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8da94743-f504-4db1-9a90-5fdf268d55d0 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:50.530495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8da94743-f504-4db1-9a90-5fdf268d55d0 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:50.531659 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8da94743-f504-4db1-9a90-5fdf268d55d0 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1341 microversion: 2.20 time: 0.362563 May 27 15:05:50.532254 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1001/2072] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:50 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1341 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:50.535827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-4054b5e4-b419-45a3-bd53-f2d3c0f3e122 req-9870685b-09c5-4720-809d-eedc58ba29fe service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:50.536856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-4054b5e4-b419-45a3-bd53-f2d3c0f3e122 req-9870685b-09c5-4720-809d-eedc58ba29fe service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:50.567289 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d17e5be2-9b20-40d8-8df6-80bf29428408 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:50.571000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d17e5be2-9b20-40d8-8df6-80bf29428408 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:50.586379 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d17e5be2-9b20-40d8-8df6-80bf29428408 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:50.586573 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-4054b5e4-b419-45a3-bd53-f2d3c0f3e122 req-9870685b-09c5-4720-809d-eedc58ba29fe service nova] Creating event network-changed:103f073e-4e7b-4dab-9558-27baab47f022 for instance 3a4ac567-1148-41b4-80eb-6fb25fae7b7c on n-h1-843621-1 May 27 15:05:50.586848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d17e5be2-9b20-40d8-8df6-80bf29428408 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:50.601437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d17e5be2-9b20-40d8-8df6-80bf29428408 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:50.601905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d17e5be2-9b20-40d8-8df6-80bf29428408 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:50.603123 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-4054b5e4-b419-45a3-bd53-f2d3c0f3e122 req-9870685b-09c5-4720-809d-eedc58ba29fe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190428 May 27 15:05:50.605354 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1072/2073] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:50.656523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5562ef84-77aa-438b-8163-cc437f8beb3e tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:50.660460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5562ef84-77aa-438b-8163-cc437f8beb3e tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:50.874632 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5562ef84-77aa-438b-8163-cc437f8beb3e tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:50.940446 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5562ef84-77aa-438b-8163-cc437f8beb3e tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1212 microversion: 2.1 time: 0.326886 May 27 15:05:50.953224 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1073/2074] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:50 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1212 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:51.259460 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d17e5be2-9b20-40d8-8df6-80bf29428408 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.704453 May 27 15:05:51.261198 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1002/2075] 10.222.0.13 () {58 vars in 1292 bytes} [Fri May 27 15:05:50 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c/os-security-groups => generated 1155 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:51.278428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-95901aa3-1e9e-4e17-bd53-4e3d87764cf7 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Action: 'create', calling method: .version_select at 0x7fc7806a90d0>, body: {"security_group": {"name": " tempest-securitygroup -1992487885 ", "description": "tempest-description-303874549"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:51.427812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e30502c8-39e6-4278-ac92-662c29759513 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:51.428522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e30502c8-39e6-4278-ac92-662c29759513 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:51.443156 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e30502c8-39e6-4278-ac92-662c29759513 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:51.444466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e30502c8-39e6-4278-ac92-662c29759513 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:51.447370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e30502c8-39e6-4278-ac92-662c29759513 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:51.447848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e30502c8-39e6-4278-ac92-662c29759513 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:51.479496 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-e30502c8-39e6-4278-ac92-662c29759513 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e30502c8-39e6-4278-ac92-662c29759513 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 HTTP/1.1 May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '74741255-3451-4856-af14-5320fa7e2d76'} May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:51.482055 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:51.489450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:51.489450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:51.489450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:51.489450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:51.489450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:51.489450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. May 27 15:05:51.489450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:51.491645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e30502c8-39e6-4278-ac92-662c29759513 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:51.492785 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e30502c8-39e6-4278-ac92-662c29759513 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 404 len: 111 microversion: 2.1 time: 0.069275 May 27 15:05:51.497191 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1003/2076] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:51 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:05:51.553001 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b4c7cb3e-3427-4984-bb4a-26e22e48d422 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:51.554802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b4c7cb3e-3427-4984-bb4a-26e22e48d422 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:51.570286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4c7cb3e-3427-4984-bb4a-26e22e48d422 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:51.571609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4c7cb3e-3427-4984-bb4a-26e22e48d422 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:51.574887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4c7cb3e-3427-4984-bb4a-26e22e48d422 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:51.576709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4c7cb3e-3427-4984-bb4a-26e22e48d422 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:51.842808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b4c7cb3e-3427-4984-bb4a-26e22e48d422 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:51.883005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b4c7cb3e-3427-4984-bb4a-26e22e48d422 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:51.892527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b4c7cb3e-3427-4984-bb4a-26e22e48d422 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:51.895919 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b4c7cb3e-3427-4984-bb4a-26e22e48d422 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1339 microversion: 2.20 time: 0.346610 May 27 15:05:51.897654 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1004/2077] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:51 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1339 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:05:51.912955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9f573e0f-8878-4019-ba46-8f26a143e4ba tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:51.916209 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9f573e0f-8878-4019-ba46-8f26a143e4ba tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:51.935416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f573e0f-8878-4019-ba46-8f26a143e4ba tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:51.938386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f573e0f-8878-4019-ba46-8f26a143e4ba tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:51.939876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f573e0f-8878-4019-ba46-8f26a143e4ba tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:51.942578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f573e0f-8878-4019-ba46-8f26a143e4ba tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:51.978931 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-9f573e0f-8878-4019-ba46-8f26a143e4ba tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9f573e0f-8878-4019-ba46-8f26a143e4ba tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76/os-volume_attachments HTTP/1.1 May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'server_id': '74741255-3451-4856-af14-5320fa7e2d76'} May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:51.983603 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. May 27 15:05:51.990861 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:51.990861 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:51.990861 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:51.990861 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:51.990861 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:51.990861 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:51.990861 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:51.990861 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:51.990861 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. May 27 15:05:51.990861 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:51.994654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9f573e0f-8878-4019-ba46-8f26a143e4ba tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:51.996542 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9f573e0f-8878-4019-ba46-8f26a143e4ba tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.096837 May 27 15:05:51.996813 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-95901aa3-1e9e-4e17-bd53-4e3d87764cf7 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.725181 May 27 15:05:52.005671 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1074/2078] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:05:51 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:52.005671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6f1b05bd-83a7-48e2-b781-c11b47da6102 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:52.005671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6f1b05bd-83a7-48e2-b781-c11b47da6102 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:52.009658 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1005/2079] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:05:51 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76/os-volume_attachments => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:05:52.021734 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9bba743c-75f7-4cd2-9cf7-824bbcea14c9 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc7806bc820>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:52.027690 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f1b05bd-83a7-48e2-b781-c11b47da6102 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:52.027690 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f1b05bd-83a7-48e2-b781-c11b47da6102 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:52.034303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f1b05bd-83a7-48e2-b781-c11b47da6102 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:52.034835 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f1b05bd-83a7-48e2-b781-c11b47da6102 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:52.398964 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9bba743c-75f7-4cd2-9cf7-824bbcea14c9 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/d47cf553-53d3-40e6-857d-b2e20b86dcd8" status: 200 len: 223 microversion: 2.1 time: 0.388123 May 27 15:05:52.399995 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1006/2080] 10.222.0.13 () {58 vars in 1268 bytes} [Fri May 27 15:05:52 2022] GET /compute/v2.1/os-security-groups/d47cf553-53d3-40e6-857d-b2e20b86dcd8 => generated 223 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:52.406666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-11ccd7f7-0886-40c5-9f96-96c107d2d481 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-601268931", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "a400f266-0bb2-420b-8500-ad7b63a44ef7"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:52.431990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6f1b05bd-83a7-48e2-b781-c11b47da6102 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:52.460520 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6f1b05bd-83a7-48e2-b781-c11b47da6102 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1264 microversion: 2.1 time: 0.460647 May 27 15:05:52.461168 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1075/2081] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:51 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1264 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:52.491248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-998da196-f870-4ec2-bf21-9e19dfa26490 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc78071cd30>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:52.527034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-11ccd7f7-0886-40c5-9f96-96c107d2d481 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] validate_networks() for [('a400f266-0bb2-420b-8500-ad7b63a44ef7', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:05:54.093945 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-998da196-f870-4ec2-bf21-9e19dfa26490 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/d47cf553-53d3-40e6-857d-b2e20b86dcd8" status: 202 len: 0 microversion: 2.1 time: 1.631675 May 27 15:05:54.094860 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1076/2082] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:05:52 2022] DELETE /compute/v2.1/os-security-groups/d47cf553-53d3-40e6-857d-b2e20b86dcd8 => generated 0 bytes in 1633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:05:54.103051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-1001b02c-e5c7-4ebe-8f9e-5a7589a04e26 req-c513a7f8-e95f-42a5-8d27-dd70a64eb1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a4ac567-1148-41b4-80eb-6fb25fae7b7c", "tag": "103f073e-4e7b-4dab-9558-27baab47f022"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:54.107817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-11ccd7f7-0886-40c5-9f96-96c107d2d481 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:05:54.108969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-11ccd7f7-0886-40c5-9f96-96c107d2d481 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:05:54.109972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-11ccd7f7-0886-40c5-9f96-96c107d2d481 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:05:54.110909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-11ccd7f7-0886-40c5-9f96-96c107d2d481 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:05:54.111895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-11ccd7f7-0886-40c5-9f96-96c107d2d481 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:05:54.147598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-1001b02c-e5c7-4ebe-8f9e-5a7589a04e26 req-c513a7f8-e95f-42a5-8d27-dd70a64eb1f1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:54.148067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-1001b02c-e5c7-4ebe-8f9e-5a7589a04e26 req-c513a7f8-e95f-42a5-8d27-dd70a64eb1f1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:54.151664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11ccd7f7-0886-40c5-9f96-96c107d2d481 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:54.160425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11ccd7f7-0886-40c5-9f96-96c107d2d481 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:54.166342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11ccd7f7-0886-40c5-9f96-96c107d2d481 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:54.167223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11ccd7f7-0886-40c5-9f96-96c107d2d481 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:54.203458 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-1001b02c-e5c7-4ebe-8f9e-5a7589a04e26 req-c513a7f8-e95f-42a5-8d27-dd70a64eb1f1 service nova] Creating event network-changed:103f073e-4e7b-4dab-9558-27baab47f022 for instance 3a4ac567-1148-41b4-80eb-6fb25fae7b7c on n-h1-843621-1 May 27 15:05:54.220416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-11ccd7f7-0886-40c5-9f96-96c107d2d481 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Getting quotas for project 37b5a0b0723a46c1b0755e824e32b776. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:05:54.226604 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-1001b02c-e5c7-4ebe-8f9e-5a7589a04e26 req-c513a7f8-e95f-42a5-8d27-dd70a64eb1f1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130485 May 27 15:05:54.244272 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1077/2083] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:54.254655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-11ccd7f7-0886-40c5-9f96-96c107d2d481 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Getting quotas for user 0536f4a5547545acaa06b6aad5d1fbe4 and project 37b5a0b0723a46c1b0755e824e32b776. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:05:54.267740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b18749e9-10e0-4e46-a19b-24fd0256251a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:54.268467 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b18749e9-10e0-4e46-a19b-24fd0256251a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:54.272580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-11ccd7f7-0886-40c5-9f96-96c107d2d481 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:05:54.275024 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-11ccd7f7-0886-40c5-9f96-96c107d2d481 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:05:54.303331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b18749e9-10e0-4e46-a19b-24fd0256251a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:54.303811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b18749e9-10e0-4e46-a19b-24fd0256251a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:54.304623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b18749e9-10e0-4e46-a19b-24fd0256251a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:54.305101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b18749e9-10e0-4e46-a19b-24fd0256251a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:54.356445 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-11ccd7f7-0886-40c5-9f96-96c107d2d481 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.955196 May 27 15:05:54.360609 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1007/2084] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:05:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:05:54.371530 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6a389a58-fb56-4f40-ac8a-3a4f28777cc5 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:54.376315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6a389a58-fb56-4f40-ac8a-3a4f28777cc5 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:54.407324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6a389a58-fb56-4f40-ac8a-3a4f28777cc5 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:54.413008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6a389a58-fb56-4f40-ac8a-3a4f28777cc5 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:54.414487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6a389a58-fb56-4f40-ac8a-3a4f28777cc5 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:54.419600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6a389a58-fb56-4f40-ac8a-3a4f28777cc5 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:54.950724 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b18749e9-10e0-4e46-a19b-24fd0256251a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:54.959668 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b18749e9-10e0-4e46-a19b-24fd0256251a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:54.968111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b18749e9-10e0-4e46-a19b-24fd0256251a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:54.969170 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b18749e9-10e0-4e46-a19b-24fd0256251a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1407 microversion: 2.20 time: 0.724255 May 27 15:05:54.969758 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1078/2085] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:54 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1407 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:55.370923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6a389a58-fb56-4f40-ac8a-3a4f28777cc5 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:55.394116 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6a389a58-fb56-4f40-ac8a-3a4f28777cc5 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1312 microversion: 2.1 time: 1.026966 May 27 15:05:55.395487 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1008/2086] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:54 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1312 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:55.410530 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e8913e80-1f68-4cf5-ba6f-bfbf6a209bf8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc78070ef70>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:55.410867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2320ff6a-d896-49b4-8c65-da01203fd058 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Action: 'update', calling method: .version_select at 0x7fc7806e4040>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:55.412148 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:05:55.412148 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:05:55.413422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2320ff6a-d896-49b4-8c65-da01203fd058 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:55.413889 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2320ff6a-d896-49b4-8c65-da01203fd058 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:55.440082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2320ff6a-d896-49b4-8c65-da01203fd058 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:55.440906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2320ff6a-d896-49b4-8c65-da01203fd058 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:55.466291 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-2320ff6a-d896-49b4-8c65-da01203fd058 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] HTTP exception thrown: Service 7b3b0375-492b-41e2-babd-20153a913c79 could not be found. May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2320ff6a-d896-49b4-8c65-da01203fd058 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Request method failure captured: May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: request: PUT /compute/v2.1/os-services/7b3b0375-492b-41e2-babd-20153a913c79 HTTP/1.1 May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 56 May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOjR1584-gHWRtXs9RpYuiX19zQg_mHUQkyMvWJPHTNwM4K1qZqJ-zqMy3AxIPoZo2-z00M8En6F2ydhz5iNnzkwZWhqtKU7CyehVHhOD9gi3ryR_aC9-qYNwMFqgdnJ1w2j_tj3Uvwc55f_ReZqvDSwlrhvBjSYDejQKVtKx3G_8_E May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-Openstack-Nova-Api-Version: 2.53 May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: b6c975139013407298569a3f9b27b231 May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1050848648 May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6c975139013407298569a3f9b27b231"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6c975139013407298569a3f9b27b231"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b6c975139013407298569a3f9b27b231"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b6c975139013407298569a3f9b27b231", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1050848648 May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: b6c975139013407298569a3f9b27b231 May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1050848648 May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 52146b3fa75a4863a23a331f26128e63 May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: {"status": "disabled", "disabled_reason": "maintenance"} May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: exception: Service 7b3b0375-492b-41e2-babd-20153a913c79 could not be found. May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '7b3b0375-492b-41e2-babd-20153a913c79', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 7b3b0375-492b-41e2-babd-20153a913c79 could not be found. May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:05:55.468383 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:05:55.477533 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 27 15:05:55.477533 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:55.477533 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 7b3b0375-492b-41e2-babd-20153a913c79 could not be found. May 27 15:05:55.477533 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:55.477533 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:55.477533 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:55.477533 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:55.477533 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:55.477533 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:55.477533 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:55.477533 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:55.477533 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 7b3b0375-492b-41e2-babd-20153a913c79 could not be found. May 27 15:05:55.477533 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:05:55.477533 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2320ff6a-d896-49b4-8c65-da01203fd058 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Returning 404 to user: Service 7b3b0375-492b-41e2-babd-20153a913c79 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:55.477533 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2320ff6a-d896-49b4-8c65-da01203fd058 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-services/7b3b0375-492b-41e2-babd-20153a913c79" status: 404 len: 110 microversion: 2.53 time: 0.487167 May 27 15:05:55.485072 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1079/2087] 10.222.0.13 () {62 vars in 1308 bytes} [Fri May 27 15:05:54 2022] PUT /compute/v2.1/os-services/7b3b0375-492b-41e2-babd-20153a913c79 => generated 110 bytes in 501 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:05:55.492098 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9f330a91-cc30-4194-8eb9-f3cae4508175 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-116474113", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:55.521320 n-d-843621-1 devstack@n-api.service[119249]: DEBUG neutronclient.v2_0.client [None req-e8913e80-1f68-4cf5-ba6f-bfbf6a209bf8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d47cf553-53d3-40e6-857d-b2e20b86dcd8 does not exist", "detail": ""}} {{(pid=119249) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:05:55.522537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.security_group_api [None req-e8913e80-1f68-4cf5-ba6f-bfbf6a209bf8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Neutron security group d47cf553-53d3-40e6-857d-b2e20b86dcd8 not found {{(pid=119249) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 27 15:05:55.523302 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-e8913e80-1f68-4cf5-ba6f-bfbf6a209bf8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] HTTP exception thrown: Security group d47cf553-53d3-40e6-857d-b2e20b86dcd8 does not exist May 27 15:05:55.523302 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-ca7972ae-9975-43fd-9304-111d2d47f8d0'] May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e8913e80-1f68-4cf5-ba6f-bfbf6a209bf8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Request method failure captured: May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-security-groups/d47cf553-53d3-40e6-857d-b2e20b86dcd8 HTTP/1.1 May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOioXW1g9zfFJmrjFPUtqf1JkPOhTiGh0dQbrGTQeVBiQ2YItsGoLEVL7FPVNVHWC47EYq5bcE4MxdYNeFr1n8wrvdpg-P9YwTSrmg95hClAZskxttqGgB6RuHmw6OrmsxIPwgD27GZbwc2vNj9QfnR_dJ1A7Lc434AgecYE4my0CB4 May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4b76a0ca994471bc3d779e67ad7bd8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 7a3bafe047b746dfb54a6d795292c0c0 May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: exception: Security group d47cf553-53d3-40e6-857d-b2e20b86dcd8 does not exist May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-ca7972ae-9975-43fd-9304-111d2d47f8d0'] May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'd47cf553-53d3-40e6-857d-b2e20b86dcd8'} May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:05:55.527366 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d47cf553-53d3-40e6-857d-b2e20b86dcd8 does not exist May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca7972ae-9975-43fd-9304-111d2d47f8d0'] May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d47cf553-53d3-40e6-857d-b2e20b86dcd8 does not exist May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca7972ae-9975-43fd-9304-111d2d47f8d0'] May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d47cf553-53d3-40e6-857d-b2e20b86dcd8 does not exist May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca7972ae-9975-43fd-9304-111d2d47f8d0'] May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d47cf553-53d3-40e6-857d-b2e20b86dcd8 does not exist May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca7972ae-9975-43fd-9304-111d2d47f8d0'] May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e8913e80-1f68-4cf5-ba6f-bfbf6a209bf8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Returning 404 to user: Security group d47cf553-53d3-40e6-857d-b2e20b86dcd8 does not exist May 27 15:05:55.532835 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-ca7972ae-9975-43fd-9304-111d2d47f8d0'] {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:55.538687 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e8913e80-1f68-4cf5-ba6f-bfbf6a209bf8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/d47cf553-53d3-40e6-857d-b2e20b86dcd8" status: 404 len: 194 microversion: 2.1 time: 0.140398 May 27 15:05:55.543980 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1009/2088] 10.222.0.13 () {58 vars in 1268 bytes} [Fri May 27 15:05:55 2022] GET /compute/v2.1/os-security-groups/d47cf553-53d3-40e6-857d-b2e20b86dcd8 => generated 194 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:05:55.551031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dcf7d3bf-38e5-4ab0-9f0f-c3ffecaab4dd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:55.551864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dcf7d3bf-38e5-4ab0-9f0f-c3ffecaab4dd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:55.561196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dcf7d3bf-38e5-4ab0-9f0f-c3ffecaab4dd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:55.561754 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dcf7d3bf-38e5-4ab0-9f0f-c3ffecaab4dd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:55.562655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dcf7d3bf-38e5-4ab0-9f0f-c3ffecaab4dd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:55.563434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dcf7d3bf-38e5-4ab0-9f0f-c3ffecaab4dd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:55.595786 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-9f330a91-cc30-4194-8eb9-f3cae4508175 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] validate_networks() for [('c12cba1c-fb03-4426-9903-a7c919b09dde', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:05:55.707804 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dcf7d3bf-38e5-4ab0-9f0f-c3ffecaab4dd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:55.724354 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dcf7d3bf-38e5-4ab0-9f0f-c3ffecaab4dd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 200 len: 1210 microversion: 2.1 time: 0.175032 May 27 15:05:55.725212 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1010/2089] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:55 2022] GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 1210 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:55.757373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9077eef5-e93e-435d-a2bc-5d0fbddffaca tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Action: 'update', calling method: .version_select at 0x7fc7806bc9d0>, body: {"status": "disabled"} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:55.761247 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:05:55.761247 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 15:05:55.767149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9077eef5-e93e-435d-a2bc-5d0fbddffaca tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:55.768163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9077eef5-e93e-435d-a2bc-5d0fbddffaca tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:55.794163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9077eef5-e93e-435d-a2bc-5d0fbddffaca tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:55.794980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9077eef5-e93e-435d-a2bc-5d0fbddffaca tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:55.817429 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-9077eef5-e93e-435d-a2bc-5d0fbddffaca tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] HTTP exception thrown: Service 7b3b0375-492b-41e2-babd-20153a913c79 could not be found. May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9077eef5-e93e-435d-a2bc-5d0fbddffaca tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Request method failure captured: May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: request: PUT /compute/v2.1/os-services/7b3b0375-492b-41e2-babd-20153a913c79 HTTP/1.1 May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 22 May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOjR1584-gHWRtXs9RpYuiX19zQg_mHUQkyMvWJPHTNwM4K1qZqJ-zqMy3AxIPoZo2-z00M8En6F2ydhz5iNnzkwZWhqtKU7CyehVHhOD9gi3ryR_aC9-qYNwMFqgdnJ1w2j_tj3Uvwc55f_ReZqvDSwlrhvBjSYDejQKVtKx3G_8_E May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-Openstack-Nova-Api-Version: 2.53 May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: b6c975139013407298569a3f9b27b231 May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1050848648 May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,admin,member May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,admin,member May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6c975139013407298569a3f9b27b231"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6c975139013407298569a3f9b27b231"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b6c975139013407298569a3f9b27b231"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b6c975139013407298569a3f9b27b231", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1050848648 May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: b6c975139013407298569a3f9b27b231 May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1050848648 May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 52146b3fa75a4863a23a331f26128e63 May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: {"status": "disabled"} May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: exception: Service 7b3b0375-492b-41e2-babd-20153a913c79 could not be found. May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '7b3b0375-492b-41e2-babd-20153a913c79', 'body': {'status': 'disabled'}} May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 7b3b0375-492b-41e2-babd-20153a913c79 could not be found. May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:05:55.823786 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:05:55.830112 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 27 15:05:55.830112 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:55.830112 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 7b3b0375-492b-41e2-babd-20153a913c79 could not be found. May 27 15:05:55.830112 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:55.830112 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:55.830112 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:55.830112 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:55.830112 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:55.830112 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:55.830112 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:55.830112 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:55.830112 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 7b3b0375-492b-41e2-babd-20153a913c79 could not be found. May 27 15:05:55.830112 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:55.836352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9077eef5-e93e-435d-a2bc-5d0fbddffaca tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Returning 404 to user: Service 7b3b0375-492b-41e2-babd-20153a913c79 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:55.837674 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9077eef5-e93e-435d-a2bc-5d0fbddffaca tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-services/7b3b0375-492b-41e2-babd-20153a913c79" status: 404 len: 110 microversion: 2.53 time: 0.108448 May 27 15:05:55.841710 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1011/2090] 10.222.0.13 () {62 vars in 1308 bytes} [Fri May 27 15:05:55 2022] PUT /compute/v2.1/os-services/7b3b0375-492b-41e2-babd-20153a913c79 => generated 110 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:05:55.850992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-69988229-e3db-432c-b503-30f91efaa746 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Action: 'create', calling method: .version_select at 0x7fc7806bc0d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-513090224", "description": "tempest-description-1801328773"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:56.582871 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-69988229-e3db-432c-b503-30f91efaa746 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.739181 May 27 15:05:56.591061 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1012/2091] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:05:55 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:56.596558 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-403a3330-0095-4216-8ce6-64e7a0ddf8a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:56.597069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-403a3330-0095-4216-8ce6-64e7a0ddf8a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:56.616619 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-403a3330-0095-4216-8ce6-64e7a0ddf8a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:56.617459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-403a3330-0095-4216-8ce6-64e7a0ddf8a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:56.618460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-403a3330-0095-4216-8ce6-64e7a0ddf8a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:56.621776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-403a3330-0095-4216-8ce6-64e7a0ddf8a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:56.677047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:56.683328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-403a3330-0095-4216-8ce6-64e7a0ddf8a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:05:56.861557 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-403a3330-0095-4216-8ce6-64e7a0ddf8a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 204 len: 0 microversion: 2.1 time: 0.269043 May 27 15:05:56.862766 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1013/2092] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:05:56 2022] DELETE /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:05:56.870954 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5597a9db-70f5-410c-bb90-d4fe0ba9b772 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Action: 'update', calling method: .version_select at 0x7fc7806ecee0>, body: {"status": "enabled"} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:56.877403 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:05:56.877403 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 15:05:56.878749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5597a9db-70f5-410c-bb90-d4fe0ba9b772 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:56.879210 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5597a9db-70f5-410c-bb90-d4fe0ba9b772 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:56.897347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5597a9db-70f5-410c-bb90-d4fe0ba9b772 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:56.899401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5597a9db-70f5-410c-bb90-d4fe0ba9b772 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:56.904186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-9f330a91-cc30-4194-8eb9-f3cae4508175 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:05:56.905329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-9f330a91-cc30-4194-8eb9-f3cae4508175 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:05:56.906029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-9f330a91-cc30-4194-8eb9-f3cae4508175 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:05:56.906677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-9f330a91-cc30-4194-8eb9-f3cae4508175 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:05:56.907621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-9f330a91-cc30-4194-8eb9-f3cae4508175 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:05:56.912568 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-5597a9db-70f5-410c-bb90-d4fe0ba9b772 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] HTTP exception thrown: Service 7b3b0375-492b-41e2-babd-20153a913c79 could not be found. May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5597a9db-70f5-410c-bb90-d4fe0ba9b772 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Request method failure captured: May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: request: PUT /compute/v2.1/os-services/7b3b0375-492b-41e2-babd-20153a913c79 HTTP/1.1 May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 21 May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOjR1584-gHWRtXs9RpYuiX19zQg_mHUQkyMvWJPHTNwM4K1qZqJ-zqMy3AxIPoZo2-z00M8En6F2ydhz5iNnzkwZWhqtKU7CyehVHhOD9gi3ryR_aC9-qYNwMFqgdnJ1w2j_tj3Uvwc55f_ReZqvDSwlrhvBjSYDejQKVtKx3G_8_E May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-Openstack-Nova-Api-Version: 2.53 May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: b6c975139013407298569a3f9b27b231 May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1050848648 May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,admin,member May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,admin,member May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6c975139013407298569a3f9b27b231"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6c975139013407298569a3f9b27b231"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b6c975139013407298569a3f9b27b231"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b6c975139013407298569a3f9b27b231", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1050848648 May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: b6c975139013407298569a3f9b27b231 May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1050848648 May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 52146b3fa75a4863a23a331f26128e63 May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: {"status": "enabled"} May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: exception: Service 7b3b0375-492b-41e2-babd-20153a913c79 could not be found. May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '7b3b0375-492b-41e2-babd-20153a913c79', 'body': {'status': 'enabled'}} May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 7b3b0375-492b-41e2-babd-20153a913c79 could not be found. May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:05:56.922272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:05:56.927997 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 27 15:05:56.927997 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:05:56.927997 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 7b3b0375-492b-41e2-babd-20153a913c79 could not be found. May 27 15:05:56.927997 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:56.927997 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:05:56.927997 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:56.927997 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:05:56.927997 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:05:56.927997 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:05:56.927997 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:05:56.927997 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:05:56.927997 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 7b3b0375-492b-41e2-babd-20153a913c79 could not be found. May 27 15:05:56.927997 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:05:56.927997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5597a9db-70f5-410c-bb90-d4fe0ba9b772 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Returning 404 to user: Service 7b3b0375-492b-41e2-babd-20153a913c79 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:05:56.927997 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5597a9db-70f5-410c-bb90-d4fe0ba9b772 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-services/7b3b0375-492b-41e2-babd-20153a913c79" status: 404 len: 110 microversion: 2.53 time: 0.059900 May 27 15:05:56.936521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f330a91-cc30-4194-8eb9-f3cae4508175 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:56.936723 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1014/2093] 10.222.0.13 () {62 vars in 1308 bytes} [Fri May 27 15:05:56 2022] PUT /compute/v2.1/os-services/7b3b0375-492b-41e2-babd-20153a913c79 => generated 110 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:05:56.936887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f330a91-cc30-4194-8eb9-f3cae4508175 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:56.936887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f330a91-cc30-4194-8eb9-f3cae4508175 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:56.936887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f330a91-cc30-4194-8eb9-f3cae4508175 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:56.937352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e1f5c705-cef2-436d-9649-b83af644033c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:56.940603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e1f5c705-cef2-436d-9649-b83af644033c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:56.961484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1f5c705-cef2-436d-9649-b83af644033c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:56.961939 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1f5c705-cef2-436d-9649-b83af644033c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:56.965622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1f5c705-cef2-436d-9649-b83af644033c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:56.966084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1f5c705-cef2-436d-9649-b83af644033c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:56.989907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-9f330a91-cc30-4194-8eb9-f3cae4508175 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Getting quotas for project b939a1a277f248fdaad387a445a9e780. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:05:56.997433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-9f330a91-cc30-4194-8eb9-f3cae4508175 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Getting quotas for user d3cb6de543d34fed9b582f5af0712790 and project b939a1a277f248fdaad387a445a9e780. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:05:57.013045 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9f330a91-cc30-4194-8eb9-f3cae4508175 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:05:57.015498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9f330a91-cc30-4194-8eb9-f3cae4508175 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:05:57.116262 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9f330a91-cc30-4194-8eb9-f3cae4508175 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.629564 May 27 15:05:57.117367 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1080/2094] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:05:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 1632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:05:57.136547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-c7ee958f-c01b-431f-b3b5-b4dc96c940ad req-e0a0d7a3-66b4-45cd-8a0f-ecaf5ba8027e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d17a653-7f3e-44d7-9b89-68b4b35c9175", "tag": "f12487eb-11c2-4e49-877b-4fd161db40aa"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:57.152531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c7ee958f-c01b-431f-b3b5-b4dc96c940ad req-e0a0d7a3-66b4-45cd-8a0f-ecaf5ba8027e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:57.153214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c7ee958f-c01b-431f-b3b5-b4dc96c940ad req-e0a0d7a3-66b4-45cd-8a0f-ecaf5ba8027e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:57.181145 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-c7ee958f-c01b-431f-b3b5-b4dc96c940ad req-e0a0d7a3-66b4-45cd-8a0f-ecaf5ba8027e service nova] Creating event network-changed:f12487eb-11c2-4e49-877b-4fd161db40aa for instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 on n-h2-843621-1 May 27 15:05:57.197763 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-c7ee958f-c01b-431f-b3b5-b4dc96c940ad req-e0a0d7a3-66b4-45cd-8a0f-ecaf5ba8027e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074979 May 27 15:05:57.201120 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1081/2095] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:57.214121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ac065176-87a2-4cac-883c-4e59d9ab354c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:57.218272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ac065176-87a2-4cac-883c-4e59d9ab354c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:57.235146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac065176-87a2-4cac-883c-4e59d9ab354c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:57.237825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac065176-87a2-4cac-883c-4e59d9ab354c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:57.239803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac065176-87a2-4cac-883c-4e59d9ab354c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:57.240998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac065176-87a2-4cac-883c-4e59d9ab354c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:57.379719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e1f5c705-cef2-436d-9649-b83af644033c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:57.389370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e1f5c705-cef2-436d-9649-b83af644033c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:57.396450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e1f5c705-cef2-436d-9649-b83af644033c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:57.400886 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e1f5c705-cef2-436d-9649-b83af644033c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1407 microversion: 2.20 time: 0.473821 May 27 15:05:57.401578 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1015/2096] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:56 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1407 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:57.412515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3940bcdb-62a3-45ce-8e9e-960febfe86d6 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Action: 'create', calling method: .version_select at 0x7fc78073df70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-303759725", "description": "tempest-description-666185703"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:57.760442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ac065176-87a2-4cac-883c-4e59d9ab354c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:57.772311 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ac065176-87a2-4cac-883c-4e59d9ab354c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1312 microversion: 2.1 time: 0.568671 May 27 15:05:57.773511 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1082/2097] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:57 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1312 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:57.783402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6b599aed-b20c-4f3f-aabd-5b43d145ab8c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:57.784383 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6b599aed-b20c-4f3f-aabd-5b43d145ab8c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:57.798560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b599aed-b20c-4f3f-aabd-5b43d145ab8c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:57.809382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b599aed-b20c-4f3f-aabd-5b43d145ab8c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:57.811692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b599aed-b20c-4f3f-aabd-5b43d145ab8c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:57.812414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b599aed-b20c-4f3f-aabd-5b43d145ab8c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:57.985962 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3940bcdb-62a3-45ce-8e9e-960febfe86d6 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.579065 May 27 15:05:57.989505 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1016/2098] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:05:57 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:58.021522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4e3a8666-1541-4d02-baaf-ce71f8023adb tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:58.025163 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:05:58.025163 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 15:05:58.030681 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e3a8666-1541-4d02-baaf-ce71f8023adb tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:58.031697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e3a8666-1541-4d02-baaf-ce71f8023adb tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:58.036782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e3a8666-1541-4d02-baaf-ce71f8023adb tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:58.037634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e3a8666-1541-4d02-baaf-ce71f8023adb tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:58.078445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6b599aed-b20c-4f3f-aabd-5b43d145ab8c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:58.087759 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6b599aed-b20c-4f3f-aabd-5b43d145ab8c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 200 len: 1314 microversion: 2.1 time: 0.313070 May 27 15:05:58.088365 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1083/2099] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:57 2022] GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:58.091139 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4e3a8666-1541-4d02-baaf-ce71f8023adb tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.097647 May 27 15:05:58.093575 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1017/2100] 10.222.0.13 () {60 vars in 1177 bytes} [Fri May 27 15:05:57 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:58.094552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-97c753de-8cb9-4561-a444-fb66bb7da17b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:58.095176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-97c753de-8cb9-4561-a444-fb66bb7da17b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:58.109536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-6055ee78-3ac2-4cda-bb52-3634dcf9c671 req-adc0b910-0a00-44fd-a8f1-c69b14352e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "054d9c3e-3968-4177-9ea6-5bb30613592c", "tag": "7163613f-892d-4157-b0e8-eda1dbd40060"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:58.112512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-97c753de-8cb9-4561-a444-fb66bb7da17b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:58.113095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-97c753de-8cb9-4561-a444-fb66bb7da17b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:58.113907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-97c753de-8cb9-4561-a444-fb66bb7da17b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:58.114351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-97c753de-8cb9-4561-a444-fb66bb7da17b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:58.122373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6055ee78-3ac2-4cda-bb52-3634dcf9c671 req-adc0b910-0a00-44fd-a8f1-c69b14352e02 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:58.123388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6055ee78-3ac2-4cda-bb52-3634dcf9c671 req-adc0b910-0a00-44fd-a8f1-c69b14352e02 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:58.143026 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-6055ee78-3ac2-4cda-bb52-3634dcf9c671 req-adc0b910-0a00-44fd-a8f1-c69b14352e02 service nova] Creating event network-changed:7163613f-892d-4157-b0e8-eda1dbd40060 for instance 054d9c3e-3968-4177-9ea6-5bb30613592c on n-h2-843621-1 May 27 15:05:58.153414 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-6055ee78-3ac2-4cda-bb52-3634dcf9c671 req-adc0b910-0a00-44fd-a8f1-c69b14352e02 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057274 May 27 15:05:58.156937 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1018/2101] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:58.164634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-76b1bbeb-905b-4d66-961a-c3da8e306a51 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Action: 'create', calling method: .version_select at 0x7fc780704af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1653248035", "description": "tempest-description-1311296782"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:05:58.277496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-97c753de-8cb9-4561-a444-fb66bb7da17b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:58.293464 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-97c753de-8cb9-4561-a444-fb66bb7da17b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 200 len: 1228 microversion: 2.1 time: 0.203017 May 27 15:05:58.304192 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1084/2102] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:58 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 1228 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:58.309432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-05b997db-7fc1-4178-beb0-4ecf556229c7 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:58.311501 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:05:58.311501 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:05:58.313172 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05b997db-7fc1-4178-beb0-4ecf556229c7 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:58.313659 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05b997db-7fc1-4178-beb0-4ecf556229c7 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:58.314524 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05b997db-7fc1-4178-beb0-4ecf556229c7 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:58.315016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05b997db-7fc1-4178-beb0-4ecf556229c7 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:58.343624 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-05b997db-7fc1-4178-beb0-4ecf556229c7 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.037928 May 27 15:05:58.344927 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1085/2103] 10.222.0.13 () {60 vars in 1210 bytes} [Fri May 27 15:05:58 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:58.360476 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9bba28a6-a7df-4473-8203-a9cfd1ef788d tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:58.361645 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:05:58.361645 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:05:58.363049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9bba28a6-a7df-4473-8203-a9cfd1ef788d tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:58.363554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9bba28a6-a7df-4473-8203-a9cfd1ef788d tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:58.364616 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9bba28a6-a7df-4473-8203-a9cfd1ef788d tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:58.374020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9bba28a6-a7df-4473-8203-a9cfd1ef788d tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:58.421098 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9bba28a6-a7df-4473-8203-a9cfd1ef788d tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.064857 May 27 15:05:58.425653 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1086/2104] 10.222.0.13 () {60 vars in 1177 bytes} [Fri May 27 15:05:58 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:05:58.436918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8ec924ec-dd83-46d8-9f8f-b2111bbe684b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:58.444040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8ec924ec-dd83-46d8-9f8f-b2111bbe684b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:58.455540 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-76b1bbeb-905b-4d66-961a-c3da8e306a51 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.297422 May 27 15:05:58.462433 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1019/2105] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:05:58 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:58.465648 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ec924ec-dd83-46d8-9f8f-b2111bbe684b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:58.466364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ec924ec-dd83-46d8-9f8f-b2111bbe684b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:58.468171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ec924ec-dd83-46d8-9f8f-b2111bbe684b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:58.468957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ec924ec-dd83-46d8-9f8f-b2111bbe684b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:58.469498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-476b6e09-c18f-43b9-bcb5-a3625599deee tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:58.471986 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:05:58.471986 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 15:05:58.476257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-476b6e09-c18f-43b9-bcb5-a3625599deee tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:58.477042 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-476b6e09-c18f-43b9-bcb5-a3625599deee tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:58.479818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-476b6e09-c18f-43b9-bcb5-a3625599deee tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:58.480440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-476b6e09-c18f-43b9-bcb5-a3625599deee tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:58.537237 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-476b6e09-c18f-43b9-bcb5-a3625599deee tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=n-d-843621-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.077563 May 27 15:05:58.538541 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1020/2106] 10.222.0.13 () {60 vars in 1234 bytes} [Fri May 27 15:05:58 2022] GET /compute/v2.1/os-services?host=n-d-843621-1&binary=xxx => generated 16 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:58.543459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ce361f66-bf67-46b7-9c5a-aced89f8395f tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc7806ab700>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:58.764235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8ec924ec-dd83-46d8-9f8f-b2111bbe684b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:58.789030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8ec924ec-dd83-46d8-9f8f-b2111bbe684b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:58.793206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8ec924ec-dd83-46d8-9f8f-b2111bbe684b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:58.796969 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8ec924ec-dd83-46d8-9f8f-b2111bbe684b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1407 microversion: 2.20 time: 0.365720 May 27 15:05:58.803147 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1087/2107] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:05:58 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1407 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:58.814553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ce36da79-b406-407b-ad71-9b01c31d6d10 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:58.822806 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:05:58.822806 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:05:58.829317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ce36da79-b406-407b-ad71-9b01c31d6d10 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:58.830841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ce36da79-b406-407b-ad71-9b01c31d6d10 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:58.831876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ce36da79-b406-407b-ad71-9b01c31d6d10 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:58.837906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ce36da79-b406-407b-ad71-9b01c31d6d10 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:58.905239 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ce36da79-b406-407b-ad71-9b01c31d6d10 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.099063 May 27 15:05:58.906245 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1088/2108] 10.222.0.13 () {60 vars in 1177 bytes} [Fri May 27 15:05:58 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:05:58.916047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-54a44894-8530-4d21-a65a-99f8326fc10b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:58.916966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-54a44894-8530-4d21-a65a-99f8326fc10b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:58.932559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-54a44894-8530-4d21-a65a-99f8326fc10b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:58.933456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-54a44894-8530-4d21-a65a-99f8326fc10b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:58.934499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-54a44894-8530-4d21-a65a-99f8326fc10b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:58.935156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-54a44894-8530-4d21-a65a-99f8326fc10b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:59.265439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-54a44894-8530-4d21-a65a-99f8326fc10b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:05:59.267083 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ce361f66-bf67-46b7-9c5a-aced89f8395f tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 0.727172 May 27 15:05:59.267713 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1021/2109] 10.222.0.13 () {58 vars in 1157 bytes} [Fri May 27 15:05:58 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:59.278409 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-54a44894-8530-4d21-a65a-99f8326fc10b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1312 microversion: 2.1 time: 0.371004 May 27 15:05:59.279685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-58331c09-dde5-4c86-b810-6fd39a156033 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:59.282629 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:05:59.282629 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 15:05:59.283665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58331c09-dde5-4c86-b810-6fd39a156033 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:59.284167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58331c09-dde5-4c86-b810-6fd39a156033 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:59.285862 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1089/2110] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:58 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1312 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:59.286083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58331c09-dde5-4c86-b810-6fd39a156033 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:59.286544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58331c09-dde5-4c86-b810-6fd39a156033 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:59.303917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-16346f29-4a67-47be-b03f-2d3c820e6b68 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:59.305038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-16346f29-4a67-47be-b03f-2d3c820e6b68 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:05:59.315811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16346f29-4a67-47be-b03f-2d3c820e6b68 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:59.316637 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16346f29-4a67-47be-b03f-2d3c820e6b68 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:59.318314 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16346f29-4a67-47be-b03f-2d3c820e6b68 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:59.319491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16346f29-4a67-47be-b03f-2d3c820e6b68 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:59.372290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:05:59.400504 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-58331c09-dde5-4c86-b810-6fd39a156033 tempest-ServicesAdminNegativeV253TestJSON-1050848648 tempest-ServicesAdminNegativeV253TestJSON-1050848648-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.124793 May 27 15:05:59.409264 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1022/2111] 10.222.0.13 () {60 vars in 1238 bytes} [Fri May 27 15:05:59 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:05:59.415208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-157e2bcb-3645-4a60-98f8-2d5bd251eb16 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc777232af0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:00.113987 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-157e2bcb-3645-4a60-98f8-2d5bd251eb16 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/f8c3d409-20ef-4422-9d25-280d9f1b89df" status: 202 len: 0 microversion: 2.1 time: 0.703054 May 27 15:06:00.114910 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1023/2112] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:05:59 2022] DELETE /compute/v2.1/os-security-groups/f8c3d409-20ef-4422-9d25-280d9f1b89df => generated 0 bytes in 705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:06:00.120665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f328dbcd-9124-48a8-84f3-4bba95fa794a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:00.121771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f328dbcd-9124-48a8-84f3-4bba95fa794a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:00.138875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f328dbcd-9124-48a8-84f3-4bba95fa794a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:00.139695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f328dbcd-9124-48a8-84f3-4bba95fa794a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:00.140513 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f328dbcd-9124-48a8-84f3-4bba95fa794a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:00.140996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f328dbcd-9124-48a8-84f3-4bba95fa794a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:00.196926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-16346f29-4a67-47be-b03f-2d3c820e6b68 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:00.205915 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-16346f29-4a67-47be-b03f-2d3c820e6b68 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 200 len: 1314 microversion: 2.1 time: 0.917785 May 27 15:06:00.207065 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1090/2113] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:05:59 2022] GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 1314 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:00.275609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f328dbcd-9124-48a8-84f3-4bba95fa794a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:00.291012 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f328dbcd-9124-48a8-84f3-4bba95fa794a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 200 len: 1282 microversion: 2.1 time: 0.173611 May 27 15:06:00.291765 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1024/2114] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:00 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 1282 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:00.317169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-851a3b34-b55a-4028-9483-aa8fbff33dfb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:00.317880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-851a3b34-b55a-4028-9483-aa8fbff33dfb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:00.337473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-851a3b34-b55a-4028-9483-aa8fbff33dfb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:00.339714 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-851a3b34-b55a-4028-9483-aa8fbff33dfb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:00.362425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-851a3b34-b55a-4028-9483-aa8fbff33dfb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:00.366522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-851a3b34-b55a-4028-9483-aa8fbff33dfb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:00.469509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e8420552-1cf3-4251-889d-330c9307e784 tempest-ServicesAdminNegativeV253TestJSON-179078900 tempest-ServicesAdminNegativeV253TestJSON-179078900-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:00.471491 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:06:00.471491 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:06:00.473893 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e8420552-1cf3-4251-889d-330c9307e784 tempest-ServicesAdminNegativeV253TestJSON-179078900 tempest-ServicesAdminNegativeV253TestJSON-179078900-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b172debe193346f2bdf651e51fe097d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd66f75b00d140409696936bd5a71079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e8420552-1cf3-4251-889d-330c9307e784 tempest-ServicesAdminNegativeV253TestJSON-179078900 tempest-ServicesAdminNegativeV253TestJSON-179078900-project] Request method failure captured: May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-services HTTP/1.1 May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOjQkhMjeP1ja7TsrxeYevni38laARAyzMCoBQxXzYq1KGNsbhI7RElzLMhiczRteKgPiYrESdvj2DzhXnyD4gquAf7c093s2gal7XlUjPMtamG673VlmnQuwwEnNQ3LtBVC2Rv6cndvT7Ipgnip51NF4FKcx61RQNzPTmovMZYDsIk May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-Openstack-Nova-Api-Version: 2.53 May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: dd66f75b00d140409696936bd5a71079 May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-179078900 May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd66f75b00d140409696936bd5a71079"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/dd66f75b00d140409696936bd5a71079"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/dd66f75b00d140409696936bd5a71079"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_dd66f75b00d140409696936bd5a71079", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-179078900 May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: dd66f75b00d140409696936bd5a71079 May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-179078900 May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServicesAdminNegativeV253TestJSON-179078900-project May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b172debe193346f2bdf651e51fe097d2 May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-179078900-project May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: action_args: {} May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.force_reraise() May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise self.value May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.enforce( May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. May 27 15:06:00.475770 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:00.482374 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:00.482374 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:00.482374 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:00.482374 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:00.482374 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:00.482374 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 27 15:06:00.482374 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 27 15:06:00.482374 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. May 27 15:06:00.482374 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:00.501501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e8420552-1cf3-4251-889d-330c9307e784 tempest-ServicesAdminNegativeV253TestJSON-179078900 tempest-ServicesAdminNegativeV253TestJSON-179078900-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:00.505393 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e8420552-1cf3-4251-889d-330c9307e784 tempest-ServicesAdminNegativeV253TestJSON-179078900 tempest-ServicesAdminNegativeV253TestJSON-179078900-project] 10.222.0.13 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.295420 May 27 15:06:00.508640 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1091/2115] 10.222.0.13 () {60 vars in 1177 bytes} [Fri May 27 15:06:00 2022] GET /compute/v2.1/os-services => generated 112 bytes in 301 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) May 27 15:06:00.518610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ef772b35-a907-44ac-8e6a-7e1f0445e21c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc7806a6a60>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:00.633912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG neutronclient.v2_0.client [None req-ef772b35-a907-44ac-8e6a-7e1f0445e21c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f8c3d409-20ef-4422-9d25-280d9f1b89df does not exist", "detail": ""}} {{(pid=119248) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:06:00.635038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.security_group_api [None req-ef772b35-a907-44ac-8e6a-7e1f0445e21c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Neutron security group f8c3d409-20ef-4422-9d25-280d9f1b89df not found {{(pid=119248) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 27 15:06:00.635756 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-ef772b35-a907-44ac-8e6a-7e1f0445e21c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] HTTP exception thrown: Security group f8c3d409-20ef-4422-9d25-280d9f1b89df does not exist May 27 15:06:00.635756 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-123f4fb7-5c12-4892-90ae-5dac2afb90f9'] May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ef772b35-a907-44ac-8e6a-7e1f0445e21c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Request method failure captured: May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-security-groups/f8c3d409-20ef-4422-9d25-280d9f1b89df HTTP/1.1 May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOioXW1g9zfFJmrjFPUtqf1JkPOhTiGh0dQbrGTQeVBiQ2YItsGoLEVL7FPVNVHWC47EYq5bcE4MxdYNeFr1n8wrvdpg-P9YwTSrmg95hClAZskxttqGgB6RuHmw6OrmsxIPwgD27GZbwc2vNj9QfnR_dJ1A7Lc434AgecYE4my0CB4 May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4b76a0ca994471bc3d779e67ad7bd8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 7a3bafe047b746dfb54a6d795292c0c0 May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: exception: Security group f8c3d409-20ef-4422-9d25-280d9f1b89df does not exist May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-123f4fb7-5c12-4892-90ae-5dac2afb90f9'] May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'f8c3d409-20ef-4422-9d25-280d9f1b89df'} May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:06:00.639627 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f8c3d409-20ef-4422-9d25-280d9f1b89df does not exist May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-123f4fb7-5c12-4892-90ae-5dac2afb90f9'] May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f8c3d409-20ef-4422-9d25-280d9f1b89df does not exist May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-123f4fb7-5c12-4892-90ae-5dac2afb90f9'] May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f8c3d409-20ef-4422-9d25-280d9f1b89df does not exist May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-123f4fb7-5c12-4892-90ae-5dac2afb90f9'] May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f8c3d409-20ef-4422-9d25-280d9f1b89df does not exist May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-123f4fb7-5c12-4892-90ae-5dac2afb90f9'] May 27 15:06:00.645235 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:00.652619 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ef772b35-a907-44ac-8e6a-7e1f0445e21c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Returning 404 to user: Security group f8c3d409-20ef-4422-9d25-280d9f1b89df does not exist May 27 15:06:00.652619 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-123f4fb7-5c12-4892-90ae-5dac2afb90f9'] {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:00.652619 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ef772b35-a907-44ac-8e6a-7e1f0445e21c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/f8c3d409-20ef-4422-9d25-280d9f1b89df" status: 404 len: 194 microversion: 2.1 time: 0.139043 May 27 15:06:00.652619 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1092/2116] 10.222.0.13 () {58 vars in 1268 bytes} [Fri May 27 15:06:00 2022] GET /compute/v2.1/os-security-groups/f8c3d409-20ef-4422-9d25-280d9f1b89df => generated 194 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:00.670644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-75bbaeb0-3bb4-472d-a471-d7df8c8e2176 req-3a851eb7-2b0b-405f-856c-1c9e5778bf52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c814849f-c8b5-44a6-9727-654fcc92437c", "tag": "dbf9387d-a39c-43c1-a9a0-f9184ed123cc"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:00.697893 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-75bbaeb0-3bb4-472d-a471-d7df8c8e2176 req-3a851eb7-2b0b-405f-856c-1c9e5778bf52 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:00.702655 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-75bbaeb0-3bb4-472d-a471-d7df8c8e2176 req-3a851eb7-2b0b-405f-856c-1c9e5778bf52 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:00.731095 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-75bbaeb0-3bb4-472d-a471-d7df8c8e2176 req-3a851eb7-2b0b-405f-856c-1c9e5778bf52 service nova] Creating event network-changed:dbf9387d-a39c-43c1-a9a0-f9184ed123cc for instance c814849f-c8b5-44a6-9727-654fcc92437c on n-h1-843621-1 May 27 15:06:00.749484 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-75bbaeb0-3bb4-472d-a471-d7df8c8e2176 req-3a851eb7-2b0b-405f-856c-1c9e5778bf52 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097538 May 27 15:06:00.759072 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1093/2117] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:00.774047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-269bbcee-a400-4598-84c5-6ef85176b66a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:00.774759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-269bbcee-a400-4598-84c5-6ef85176b66a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:00.812012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-269bbcee-a400-4598-84c5-6ef85176b66a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:00.815496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-269bbcee-a400-4598-84c5-6ef85176b66a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:00.818828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-269bbcee-a400-4598-84c5-6ef85176b66a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:00.831272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-269bbcee-a400-4598-84c5-6ef85176b66a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:00.956155 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-851a3b34-b55a-4028-9483-aa8fbff33dfb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:00.968642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-851a3b34-b55a-4028-9483-aa8fbff33dfb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:00.974498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-851a3b34-b55a-4028-9483-aa8fbff33dfb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:00.988889 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-851a3b34-b55a-4028-9483-aa8fbff33dfb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1407 microversion: 2.20 time: 0.682730 May 27 15:06:00.992426 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1025/2118] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:00 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1407 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:06:01.011092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e6daa477-f662-4d7c-b1ab-ec74151f4d4d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc78071eee0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:01.407763 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-269bbcee-a400-4598-84c5-6ef85176b66a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:01.424412 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-269bbcee-a400-4598-84c5-6ef85176b66a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1312 microversion: 2.1 time: 0.658776 May 27 15:06:01.426808 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1094/2119] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:00 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1312 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:01.442563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1db88bd6-d8d5-477c-b8a7-1d22ae992f63 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:01.446471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1db88bd6-d8d5-477c-b8a7-1d22ae992f63 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:01.463761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1db88bd6-d8d5-477c-b8a7-1d22ae992f63 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:01.466077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1db88bd6-d8d5-477c-b8a7-1d22ae992f63 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:01.468944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1db88bd6-d8d5-477c-b8a7-1d22ae992f63 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:01.471205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1db88bd6-d8d5-477c-b8a7-1d22ae992f63 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:01.873036 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1db88bd6-d8d5-477c-b8a7-1d22ae992f63 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:01.878019 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e6daa477-f662-4d7c-b1ab-ec74151f4d4d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/492beffc-b784-45f9-8878-873b078355ad" status: 202 len: 0 microversion: 2.1 time: 0.882886 May 27 15:06:01.880938 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1026/2120] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:06:00 2022] DELETE /compute/v2.1/os-security-groups/492beffc-b784-45f9-8878-873b078355ad => generated 0 bytes in 886 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:06:01.910188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b5af4075-3ac4-4d6e-aa0c-7f1c43072a49 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:01.910838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b5af4075-3ac4-4d6e-aa0c-7f1c43072a49 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:01.919448 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1db88bd6-d8d5-477c-b8a7-1d22ae992f63 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:01.921380 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:01.934012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1db88bd6-d8d5-477c-b8a7-1d22ae992f63 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:01.937779 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1db88bd6-d8d5-477c-b8a7-1d22ae992f63 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 2945 microversion: 2.32 time: 0.505225 May 27 15:06:01.949978 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1095/2121] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:01 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 2945 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:06:01.956902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b5af4075-3ac4-4d6e-aa0c-7f1c43072a49 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:01.960869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b5af4075-3ac4-4d6e-aa0c-7f1c43072a49 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:01.964783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b5af4075-3ac4-4d6e-aa0c-7f1c43072a49 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:01.971821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b5af4075-3ac4-4d6e-aa0c-7f1c43072a49 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:01.980070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1675baaa-4f40-4731-b7ac-fa5cbfde8109 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:01.981242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1675baaa-4f40-4731-b7ac-fa5cbfde8109 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:02.002748 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1675baaa-4f40-4731-b7ac-fa5cbfde8109 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:02.003415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1675baaa-4f40-4731-b7ac-fa5cbfde8109 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:02.004519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1675baaa-4f40-4731-b7ac-fa5cbfde8109 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:02.005332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1675baaa-4f40-4731-b7ac-fa5cbfde8109 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:02.282084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b5af4075-3ac4-4d6e-aa0c-7f1c43072a49 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:02.293951 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b5af4075-3ac4-4d6e-aa0c-7f1c43072a49 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 200 len: 1314 microversion: 2.1 time: 0.409476 May 27 15:06:02.296301 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1027/2122] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:01 2022] GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:02.304654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5742427c-2209-4035-9a99-0386e3ea32f2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc78070e940>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:02.317550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1675baaa-4f40-4731-b7ac-fa5cbfde8109 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:02.331267 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1675baaa-4f40-4731-b7ac-fa5cbfde8109 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 200 len: 1324 microversion: 2.1 time: 0.371325 May 27 15:06:02.332833 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1096/2123] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:01 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 1324 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:02.347188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-72904a45-f447-4275-931b-cacfb9dbeff6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:02.347395 n-d-843621-1 devstack@n-api.service[119249]: DEBUG neutronclient.v2_0.client [None req-5742427c-2209-4035-9a99-0386e3ea32f2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 492beffc-b784-45f9-8878-873b078355ad does not exist", "detail": ""}} {{(pid=119249) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:06:02.347705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-72904a45-f447-4275-931b-cacfb9dbeff6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:02.348281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.security_group_api [None req-5742427c-2209-4035-9a99-0386e3ea32f2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Neutron security group 492beffc-b784-45f9-8878-873b078355ad not found {{(pid=119249) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 27 15:06:02.349406 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-5742427c-2209-4035-9a99-0386e3ea32f2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] HTTP exception thrown: Security group 492beffc-b784-45f9-8878-873b078355ad does not exist May 27 15:06:02.349406 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-634169e0-35ee-412b-a388-b89113f636ed'] May 27 15:06:02.361292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72904a45-f447-4275-931b-cacfb9dbeff6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:02.361758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72904a45-f447-4275-931b-cacfb9dbeff6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:02.362816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72904a45-f447-4275-931b-cacfb9dbeff6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:02.363460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72904a45-f447-4275-931b-cacfb9dbeff6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5742427c-2209-4035-9a99-0386e3ea32f2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Request method failure captured: May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-security-groups/492beffc-b784-45f9-8878-873b078355ad HTTP/1.1 May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOioXW1g9zfFJmrjFPUtqf1JkPOhTiGh0dQbrGTQeVBiQ2YItsGoLEVL7FPVNVHWC47EYq5bcE4MxdYNeFr1n8wrvdpg-P9YwTSrmg95hClAZskxttqGgB6RuHmw6OrmsxIPwgD27GZbwc2vNj9QfnR_dJ1A7Lc434AgecYE4my0CB4 May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4b76a0ca994471bc3d779e67ad7bd8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 7a3bafe047b746dfb54a6d795292c0c0 May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: exception: Security group 492beffc-b784-45f9-8878-873b078355ad does not exist May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-634169e0-35ee-412b-a388-b89113f636ed'] May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '492beffc-b784-45f9-8878-873b078355ad'} May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:06:02.377254 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 492beffc-b784-45f9-8878-873b078355ad does not exist May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-634169e0-35ee-412b-a388-b89113f636ed'] May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 492beffc-b784-45f9-8878-873b078355ad does not exist May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-634169e0-35ee-412b-a388-b89113f636ed'] May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 492beffc-b784-45f9-8878-873b078355ad does not exist May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-634169e0-35ee-412b-a388-b89113f636ed'] May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 492beffc-b784-45f9-8878-873b078355ad does not exist May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-634169e0-35ee-412b-a388-b89113f636ed'] May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5742427c-2209-4035-9a99-0386e3ea32f2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Returning 404 to user: Security group 492beffc-b784-45f9-8878-873b078355ad does not exist May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-634169e0-35ee-412b-a388-b89113f636ed'] {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5742427c-2209-4035-9a99-0386e3ea32f2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/492beffc-b784-45f9-8878-873b078355ad" status: 404 len: 194 microversion: 2.1 time: 0.079194 May 27 15:06:02.383265 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1028/2124] 10.222.0.13 () {58 vars in 1268 bytes} [Fri May 27 15:06:02 2022] GET /compute/v2.1/os-security-groups/492beffc-b784-45f9-8878-873b078355ad => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:02.401466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-baa9acf7-726d-4dc1-8abc-6f8a1cb6c42e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:02.402098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-baa9acf7-726d-4dc1-8abc-6f8a1cb6c42e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:02.431513 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-baa9acf7-726d-4dc1-8abc-6f8a1cb6c42e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:02.432293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-baa9acf7-726d-4dc1-8abc-6f8a1cb6c42e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:02.434322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-baa9acf7-726d-4dc1-8abc-6f8a1cb6c42e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:02.437282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-baa9acf7-726d-4dc1-8abc-6f8a1cb6c42e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:02.525867 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-72904a45-f447-4275-931b-cacfb9dbeff6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.191842 May 27 15:06:02.527069 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1097/2125] 10.222.0.13 () {60 vars in 1315 bytes} [Fri May 27 15:06:02 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae/os-interface => generated 1831 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:06:02.540422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1de88af0-2691-48fd-829c-3be4a6faddf3 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc780732c10>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:02.825778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-baa9acf7-726d-4dc1-8abc-6f8a1cb6c42e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:02.848050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-baa9acf7-726d-4dc1-8abc-6f8a1cb6c42e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:02.854540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-baa9acf7-726d-4dc1-8abc-6f8a1cb6c42e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:02.857323 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-baa9acf7-726d-4dc1-8abc-6f8a1cb6c42e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1407 microversion: 2.20 time: 0.476041 May 27 15:06:02.872178 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1029/2126] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:02 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:06:02.886952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-03a678f2-276f-4e5a-aed5-df3f868a1e01 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:02.888576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-03a678f2-276f-4e5a-aed5-df3f868a1e01 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:02.907306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03a678f2-276f-4e5a-aed5-df3f868a1e01 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:02.908036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03a678f2-276f-4e5a-aed5-df3f868a1e01 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:02.910155 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03a678f2-276f-4e5a-aed5-df3f868a1e01 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:02.911378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03a678f2-276f-4e5a-aed5-df3f868a1e01 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:02.985754 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1de88af0-2691-48fd-829c-3be4a6faddf3 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/b5477b34-b1fc-41f0-9319-15cae7ac0159" status: 202 len: 0 microversion: 2.1 time: 0.457275 May 27 15:06:02.986771 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1098/2127] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:06:02 2022] DELETE /compute/v2.1/os-security-groups/b5477b34-b1fc-41f0-9319-15cae7ac0159 => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:06:02.994016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e3b131b-6b0b-4722-adfb-ab23988a6ada tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:02.995549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e3b131b-6b0b-4722-adfb-ab23988a6ada tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:03.014419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e3b131b-6b0b-4722-adfb-ab23988a6ada tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:03.014867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e3b131b-6b0b-4722-adfb-ab23988a6ada tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:03.016976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e3b131b-6b0b-4722-adfb-ab23988a6ada tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:03.021700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e3b131b-6b0b-4722-adfb-ab23988a6ada tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:03.058556 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e3b131b-6b0b-4722-adfb-ab23988a6ada tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:06:03.156046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:03.181159 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e3b131b-6b0b-4722-adfb-ab23988a6ada tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "DELETE /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 204 len: 0 microversion: 2.25 time: 0.192658 May 27 15:06:03.181782 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1099/2128] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:06:02 2022] DELETE /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:06:03.193138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-fec7567c-e1c0-4c66-9e72-78aa3270b0a4 req-380cf75f-3be9-4b11-92f0-74172b3f2f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d17a653-7f3e-44d7-9b89-68b4b35c9175", "name": "network-vif-plugged", "status": "completed", "tag": "f12487eb-11c2-4e49-877b-4fd161db40aa"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:03.197818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-03a678f2-276f-4e5a-aed5-df3f868a1e01 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:03.209153 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-03a678f2-276f-4e5a-aed5-df3f868a1e01 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1312 microversion: 2.1 time: 0.333663 May 27 15:06:03.212146 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1030/2129] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:02 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1312 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:03.213940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-fec7567c-e1c0-4c66-9e72-78aa3270b0a4 req-380cf75f-3be9-4b11-92f0-74172b3f2f0f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:03.214397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-fec7567c-e1c0-4c66-9e72-78aa3270b0a4 req-380cf75f-3be9-4b11-92f0-74172b3f2f0f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:03.219214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-35e4512e-01e4-4e84-b362-5ce7fe63cf86 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc78071e4c0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:03.245086 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-fec7567c-e1c0-4c66-9e72-78aa3270b0a4 req-380cf75f-3be9-4b11-92f0-74172b3f2f0f service nova] Creating event network-vif-plugged:f12487eb-11c2-4e49-877b-4fd161db40aa for instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 on n-h2-843621-1 May 27 15:06:03.255105 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-fec7567c-e1c0-4c66-9e72-78aa3270b0a4 req-380cf75f-3be9-4b11-92f0-74172b3f2f0f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071911 May 27 15:06:03.256319 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1100/2130] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:03.263185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-72a86b4e-7148-47df-b2b3-5acaa3d635a9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:03.263949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-72a86b4e-7148-47df-b2b3-5acaa3d635a9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:03.267073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG neutronclient.v2_0.client [None req-35e4512e-01e4-4e84-b362-5ce7fe63cf86 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b5477b34-b1fc-41f0-9319-15cae7ac0159 does not exist", "detail": ""}} {{(pid=119249) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:06:03.273760 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.security_group_api [None req-35e4512e-01e4-4e84-b362-5ce7fe63cf86 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Neutron security group b5477b34-b1fc-41f0-9319-15cae7ac0159 not found {{(pid=119249) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 27 15:06:03.275117 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-35e4512e-01e4-4e84-b362-5ce7fe63cf86 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] HTTP exception thrown: Security group b5477b34-b1fc-41f0-9319-15cae7ac0159 does not exist May 27 15:06:03.275117 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-35ad2407-3a01-4805-a44c-58e3b26d1b90'] May 27 15:06:03.278285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72a86b4e-7148-47df-b2b3-5acaa3d635a9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:03.279031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72a86b4e-7148-47df-b2b3-5acaa3d635a9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-35e4512e-01e4-4e84-b362-5ce7fe63cf86 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Request method failure captured: May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-security-groups/b5477b34-b1fc-41f0-9319-15cae7ac0159 HTTP/1.1 May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOioXW1g9zfFJmrjFPUtqf1JkPOhTiGh0dQbrGTQeVBiQ2YItsGoLEVL7FPVNVHWC47EYq5bcE4MxdYNeFr1n8wrvdpg-P9YwTSrmg95hClAZskxttqGgB6RuHmw6OrmsxIPwgD27GZbwc2vNj9QfnR_dJ1A7Lc434AgecYE4my0CB4 May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4b76a0ca994471bc3d779e67ad7bd8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 7a3bafe047b746dfb54a6d795292c0c0 May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: exception: Security group b5477b34-b1fc-41f0-9319-15cae7ac0159 does not exist May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-35ad2407-3a01-4805-a44c-58e3b26d1b90'] May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'b5477b34-b1fc-41f0-9319-15cae7ac0159'} May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:06:03.280541 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b5477b34-b1fc-41f0-9319-15cae7ac0159 does not exist May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35ad2407-3a01-4805-a44c-58e3b26d1b90'] May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b5477b34-b1fc-41f0-9319-15cae7ac0159 does not exist May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35ad2407-3a01-4805-a44c-58e3b26d1b90'] May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b5477b34-b1fc-41f0-9319-15cae7ac0159 does not exist May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35ad2407-3a01-4805-a44c-58e3b26d1b90'] May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b5477b34-b1fc-41f0-9319-15cae7ac0159 does not exist May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35ad2407-3a01-4805-a44c-58e3b26d1b90'] May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-35e4512e-01e4-4e84-b362-5ce7fe63cf86 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Returning 404 to user: Security group b5477b34-b1fc-41f0-9319-15cae7ac0159 does not exist May 27 15:06:03.285225 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-35ad2407-3a01-4805-a44c-58e3b26d1b90'] {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:03.288078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72a86b4e-7148-47df-b2b3-5acaa3d635a9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:03.288078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72a86b4e-7148-47df-b2b3-5acaa3d635a9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:03.294215 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-35e4512e-01e4-4e84-b362-5ce7fe63cf86 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/b5477b34-b1fc-41f0-9319-15cae7ac0159" status: 404 len: 194 microversion: 2.1 time: 0.080381 May 27 15:06:03.296446 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1031/2131] 10.222.0.13 () {58 vars in 1268 bytes} [Fri May 27 15:06:03 2022] GET /compute/v2.1/os-security-groups/b5477b34-b1fc-41f0-9319-15cae7ac0159 => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:03.308638 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-667aed85-3c2d-42fa-a887-28dd782fedf7 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc7806cd0d0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:03.792149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-72a86b4e-7148-47df-b2b3-5acaa3d635a9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:03.804807 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-72a86b4e-7148-47df-b2b3-5acaa3d635a9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:03.808920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-72a86b4e-7148-47df-b2b3-5acaa3d635a9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:03.812459 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-72a86b4e-7148-47df-b2b3-5acaa3d635a9 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1563 microversion: 2.25 time: 0.554002 May 27 15:06:03.813802 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1101/2132] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:03 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1563 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:06:03.857650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e0c6b737-bf19-4b48-9484-05d0912e77e8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:03.860248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e0c6b737-bf19-4b48-9484-05d0912e77e8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:03.871022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e0c6b737-bf19-4b48-9484-05d0912e77e8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:03.871600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e0c6b737-bf19-4b48-9484-05d0912e77e8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:03.875513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e0c6b737-bf19-4b48-9484-05d0912e77e8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:03.875980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e0c6b737-bf19-4b48-9484-05d0912e77e8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:03.896546 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-667aed85-3c2d-42fa-a887-28dd782fedf7 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.595703 May 27 15:06:03.898903 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1032/2133] 10.222.0.13 () {58 vars in 1157 bytes} [Fri May 27 15:06:03 2022] GET /compute/v2.1/os-security-groups => generated 1155 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:03.902260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-74c7b61f-121a-4228-9939-a60df4e4342f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:03.902873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-74c7b61f-121a-4228-9939-a60df4e4342f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:03.917592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-74c7b61f-121a-4228-9939-a60df4e4342f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:03.918046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-74c7b61f-121a-4228-9939-a60df4e4342f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:03.918835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-74c7b61f-121a-4228-9939-a60df4e4342f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:03.919311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-74c7b61f-121a-4228-9939-a60df4e4342f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:04.229642 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e0c6b737-bf19-4b48-9484-05d0912e77e8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:04.249723 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e0c6b737-bf19-4b48-9484-05d0912e77e8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 200 len: 1314 microversion: 2.1 time: 0.404912 May 27 15:06:04.260027 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1102/2134] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:03 2022] GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:04.264955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=18 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:04.270255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-6fdc3f96-a0de-436f-a36a-be1fd769889a req-5bfe53cc-dc07-4791-a79e-e4f60ff22b97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2719794f-cbe2-4bfa-a24f-18a461655423", "tag": "23cd166c-ce87-4dd9-a78d-1b8bf7552a1e"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:04.288075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-6fdc3f96-a0de-436f-a36a-be1fd769889a req-5bfe53cc-dc07-4791-a79e-e4f60ff22b97 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:04.298402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-6fdc3f96-a0de-436f-a36a-be1fd769889a req-5bfe53cc-dc07-4791-a79e-e4f60ff22b97 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:04.327707 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-74c7b61f-121a-4228-9939-a60df4e4342f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:04.336595 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-6fdc3f96-a0de-436f-a36a-be1fd769889a req-5bfe53cc-dc07-4791-a79e-e4f60ff22b97 service nova] Creating event network-changed:23cd166c-ce87-4dd9-a78d-1b8bf7552a1e for instance 2719794f-cbe2-4bfa-a24f-18a461655423 on n-h2-843621-1 May 27 15:06:04.344921 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-74c7b61f-121a-4228-9939-a60df4e4342f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 200 len: 1324 microversion: 2.1 time: 0.445628 May 27 15:06:04.352804 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1033/2135] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:03 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 1324 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:04.361443 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-6fdc3f96-a0de-436f-a36a-be1fd769889a req-5bfe53cc-dc07-4791-a79e-e4f60ff22b97 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087456 May 27 15:06:04.367504 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3fa464ea-d285-4a3d-bb4f-cdef4fc9ee75 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:04.368871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3fa464ea-d285-4a3d-bb4f-cdef4fc9ee75 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:04.375364 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1103/2136] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:04.383438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-feb41c07-b0e8-4c31-820b-85811090abfb tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Action: 'create', calling method: .version_select at 0x7fc7806aa790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-380914542", "description": "tempest-description-1467499075"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:04.401945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fa464ea-d285-4a3d-bb4f-cdef4fc9ee75 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:04.405945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fa464ea-d285-4a3d-bb4f-cdef4fc9ee75 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:04.409751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fa464ea-d285-4a3d-bb4f-cdef4fc9ee75 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:04.411084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fa464ea-d285-4a3d-bb4f-cdef4fc9ee75 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:04.765790 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-feb41c07-b0e8-4c31-820b-85811090abfb tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.388785 May 27 15:06:04.766505 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1104/2137] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:06:04 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:04.776330 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c40f579e-2341-47f2-8ede-31893576d3e5 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:04.778090 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c40f579e-2341-47f2-8ede-31893576d3e5 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:04.788968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c40f579e-2341-47f2-8ede-31893576d3e5 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:04.789437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c40f579e-2341-47f2-8ede-31893576d3e5 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:04.790238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c40f579e-2341-47f2-8ede-31893576d3e5 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:04.790687 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c40f579e-2341-47f2-8ede-31893576d3e5 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:04.810821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3fa464ea-d285-4a3d-bb4f-cdef4fc9ee75 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:04.820081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3fa464ea-d285-4a3d-bb4f-cdef4fc9ee75 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:04.821866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3fa464ea-d285-4a3d-bb4f-cdef4fc9ee75 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:04.833088 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3fa464ea-d285-4a3d-bb4f-cdef4fc9ee75 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1407 microversion: 2.20 time: 0.478347 May 27 15:06:04.852923 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1034/2138] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:04 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1407 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:06:04.858248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b380dab7-8fab-41c3-bc63-3a02ff5a24bd tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Action: 'create', calling method: .version_select at 0x7fc7806cdca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1406743529", "description": "tempest-description-1197609754"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:05.262441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c40f579e-2341-47f2-8ede-31893576d3e5 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:05.272188 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c40f579e-2341-47f2-8ede-31893576d3e5 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1312 microversion: 2.1 time: 0.504254 May 27 15:06:05.282404 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1105/2139] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:04 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1312 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:05.288448 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7f9f3607-561f-460c-8c41-b2750559aff7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:05.289301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7f9f3607-561f-460c-8c41-b2750559aff7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:05.296179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f9f3607-561f-460c-8c41-b2750559aff7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:05.296944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f9f3607-561f-460c-8c41-b2750559aff7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:05.297933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f9f3607-561f-460c-8c41-b2750559aff7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:05.298557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f9f3607-561f-460c-8c41-b2750559aff7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:05.440203 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b380dab7-8fab-41c3-bc63-3a02ff5a24bd tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.585160 May 27 15:06:05.440606 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1035/2140] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:06:04 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:05.445791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-481f16a2-014a-4b15-98d6-33ac04d8ebf1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:05.446604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-481f16a2-014a-4b15-98d6-33ac04d8ebf1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:05.458044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-481f16a2-014a-4b15-98d6-33ac04d8ebf1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:05.458507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-481f16a2-014a-4b15-98d6-33ac04d8ebf1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:05.463988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-481f16a2-014a-4b15-98d6-33ac04d8ebf1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:05.464986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-481f16a2-014a-4b15-98d6-33ac04d8ebf1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:05.618073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7f9f3607-561f-460c-8c41-b2750559aff7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:05.628799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7f9f3607-561f-460c-8c41-b2750559aff7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:05.637072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7f9f3607-561f-460c-8c41-b2750559aff7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:05.639907 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7f9f3607-561f-460c-8c41-b2750559aff7 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1563 microversion: 2.25 time: 0.354575 May 27 15:06:05.643250 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1106/2141] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:05 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1563 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:06:05.662782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4c598674-9093-4337-b5ad-478c94eb8d5a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:05.665581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4c598674-9093-4337-b5ad-478c94eb8d5a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:05.685302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c598674-9093-4337-b5ad-478c94eb8d5a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:05.686854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c598674-9093-4337-b5ad-478c94eb8d5a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:05.693686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c598674-9093-4337-b5ad-478c94eb8d5a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:05.694634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c598674-9093-4337-b5ad-478c94eb8d5a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:05.803400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-481f16a2-014a-4b15-98d6-33ac04d8ebf1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:05.818146 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-481f16a2-014a-4b15-98d6-33ac04d8ebf1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 200 len: 1314 microversion: 2.1 time: 0.376392 May 27 15:06:05.819717 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1036/2142] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:05 2022] GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:05.832196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d0c36342-46bd-4109-b004-18cc79c30be2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1033502554", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "2cdeb662-0950-451c-a0af-fa0b549f5c60"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:05.940168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-d0c36342-46bd-4109-b004-18cc79c30be2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] validate_networks() for [('2cdeb662-0950-451c-a0af-fa0b549f5c60', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:06:05.955273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4c598674-9093-4337-b5ad-478c94eb8d5a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:05.965161 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4c598674-9093-4337-b5ad-478c94eb8d5a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 200 len: 1324 microversion: 2.1 time: 0.320517 May 27 15:06:05.966429 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1107/2143] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:05 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 1324 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:05.972941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1b89d0ac-e54b-4a7e-995c-a6eb8f79787b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:05.973964 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1b89d0ac-e54b-4a7e-995c-a6eb8f79787b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:05.983023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b89d0ac-e54b-4a7e-995c-a6eb8f79787b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:05.983761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b89d0ac-e54b-4a7e-995c-a6eb8f79787b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:05.984899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b89d0ac-e54b-4a7e-995c-a6eb8f79787b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:05.985655 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b89d0ac-e54b-4a7e-995c-a6eb8f79787b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:06.340134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1b89d0ac-e54b-4a7e-995c-a6eb8f79787b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:06.371314 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1b89d0ac-e54b-4a7e-995c-a6eb8f79787b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:06.373090 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1b89d0ac-e54b-4a7e-995c-a6eb8f79787b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:06.374472 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1b89d0ac-e54b-4a7e-995c-a6eb8f79787b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1599 microversion: 2.20 time: 0.406351 May 27 15:06:06.375035 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1108/2144] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:05 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1599 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:06:06.380190 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f8470edc-89b4-42c6-8cb8-56fef6cbcb28 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:06.380832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f8470edc-89b4-42c6-8cb8-56fef6cbcb28 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:06.389215 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8470edc-89b4-42c6-8cb8-56fef6cbcb28 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:06.389674 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8470edc-89b4-42c6-8cb8-56fef6cbcb28 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:06.390457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8470edc-89b4-42c6-8cb8-56fef6cbcb28 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:06.390895 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8470edc-89b4-42c6-8cb8-56fef6cbcb28 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:06.814242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f8470edc-89b4-42c6-8cb8-56fef6cbcb28 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:06.824337 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f8470edc-89b4-42c6-8cb8-56fef6cbcb28 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1312 microversion: 2.1 time: 0.447896 May 27 15:06:06.825329 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1109/2145] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:06 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1312 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:06.831106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7d95738b-6c63-48a8-ad26-ba559f046a37 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:06.831465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7d95738b-6c63-48a8-ad26-ba559f046a37 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:06.839378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d95738b-6c63-48a8-ad26-ba559f046a37 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:06.840082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d95738b-6c63-48a8-ad26-ba559f046a37 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:06.841126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d95738b-6c63-48a8-ad26-ba559f046a37 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:06.842295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d95738b-6c63-48a8-ad26-ba559f046a37 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:06.861095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-d0c36342-46bd-4109-b004-18cc79c30be2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:06:06.863215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-d0c36342-46bd-4109-b004-18cc79c30be2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:06:06.864346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-d0c36342-46bd-4109-b004-18cc79c30be2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:06:06.865094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-d0c36342-46bd-4109-b004-18cc79c30be2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:06:06.866277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-d0c36342-46bd-4109-b004-18cc79c30be2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:06:06.877328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d0c36342-46bd-4109-b004-18cc79c30be2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:06.878216 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d0c36342-46bd-4109-b004-18cc79c30be2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:06.879462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d0c36342-46bd-4109-b004-18cc79c30be2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:06.880087 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d0c36342-46bd-4109-b004-18cc79c30be2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:06.900927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-d0c36342-46bd-4109-b004-18cc79c30be2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Getting quotas for project fa4b76a0ca994471bc3d779e67ad7bd8. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:06:06.908444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-d0c36342-46bd-4109-b004-18cc79c30be2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Getting quotas for user 7a3bafe047b746dfb54a6d795292c0c0 and project fa4b76a0ca994471bc3d779e67ad7bd8. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:06:06.933517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d0c36342-46bd-4109-b004-18cc79c30be2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:06:06.939462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d0c36342-46bd-4109-b004-18cc79c30be2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:06:07.005880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=18 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:07.011263 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d0c36342-46bd-4109-b004-18cc79c30be2 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.188837 May 27 15:06:07.017962 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1037/2146] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:06:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:06:07.021104 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7d95738b-6c63-48a8-ad26-ba559f046a37 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.193906 May 27 15:06:07.022028 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1110/2147] 10.222.0.13 () {60 vars in 1315 bytes} [Fri May 27 15:06:06 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-interface => generated 284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:06:07.023753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-7d74f4ee-8a51-4924-8f98-fd054101293c req-29d77f08-d126-4923-a33f-b393f1bf69eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e4f7f7-6bda-4d0b-9685-74266d42efc0", "name": "network-vif-deleted", "tag": "2c3a966d-ef56-4dbf-afab-504228aa5443"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:07.026655 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eccf9f37-d906-4f2f-9490-985f4238fad1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:07.027265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-eccf9f37-d906-4f2f-9490-985f4238fad1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:07.035068 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-7d74f4ee-8a51-4924-8f98-fd054101293c req-29d77f08-d126-4923-a33f-b393f1bf69eb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:07.035553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-7d74f4ee-8a51-4924-8f98-fd054101293c req-29d77f08-d126-4923-a33f-b393f1bf69eb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:07.061006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eccf9f37-d906-4f2f-9490-985f4238fad1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:07.062243 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-7d74f4ee-8a51-4924-8f98-fd054101293c req-29d77f08-d126-4923-a33f-b393f1bf69eb service nova] Creating event network-vif-deleted:2c3a966d-ef56-4dbf-afab-504228aa5443 for instance 18e4f7f7-6bda-4d0b-9685-74266d42efc0 on n-h1-843621-1 May 27 15:06:07.064918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eccf9f37-d906-4f2f-9490-985f4238fad1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:07.069640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eccf9f37-d906-4f2f-9490-985f4238fad1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:07.070062 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-7d74f4ee-8a51-4924-8f98-fd054101293c req-29d77f08-d126-4923-a33f-b393f1bf69eb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050329 May 27 15:06:07.070674 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eccf9f37-d906-4f2f-9490-985f4238fad1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:07.080260 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1038/2148] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:07.104848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6f3cea0a-b607-493e-acff-da07333e9a57 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:07.105668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6f3cea0a-b607-493e-acff-da07333e9a57 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:07.120237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eccf9f37-d906-4f2f-9490-985f4238fad1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:07.121258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eccf9f37-d906-4f2f-9490-985f4238fad1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:07.121896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-eccf9f37-d906-4f2f-9490-985f4238fad1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lazy-loading 'fault' on Instance uuid 18e4f7f7-6bda-4d0b-9685-74266d42efc0 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:06:07.122669 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f3cea0a-b607-493e-acff-da07333e9a57 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:07.125699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f3cea0a-b607-493e-acff-da07333e9a57 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:07.129600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f3cea0a-b607-493e-acff-da07333e9a57 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:07.130913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f3cea0a-b607-493e-acff-da07333e9a57 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:07.746122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eccf9f37-d906-4f2f-9490-985f4238fad1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:07.776262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:07.782337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eccf9f37-d906-4f2f-9490-985f4238fad1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:07.793791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eccf9f37-d906-4f2f-9490-985f4238fad1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:07.796910 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-eccf9f37-d906-4f2f-9490-985f4238fad1 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 200 len: 1352 microversion: 2.25 time: 0.773546 May 27 15:06:07.798415 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1111/2149] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:07 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 1352 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:06:07.818180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-f6a07465-1586-4d79-a36f-6f5cb3130acd req-b232f3da-5f20-49ba-8a30-fe2b6192e386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "054d9c3e-3968-4177-9ea6-5bb30613592c", "name": "network-vif-plugged", "status": "completed", "tag": "7163613f-892d-4157-b0e8-eda1dbd40060"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:07.850699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-f6a07465-1586-4d79-a36f-6f5cb3130acd req-b232f3da-5f20-49ba-8a30-fe2b6192e386 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:07.851361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-f6a07465-1586-4d79-a36f-6f5cb3130acd req-b232f3da-5f20-49ba-8a30-fe2b6192e386 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:07.897007 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-f6a07465-1586-4d79-a36f-6f5cb3130acd req-b232f3da-5f20-49ba-8a30-fe2b6192e386 service nova] Creating event network-vif-plugged:7163613f-892d-4157-b0e8-eda1dbd40060 for instance 054d9c3e-3968-4177-9ea6-5bb30613592c on n-h2-843621-1 May 27 15:06:07.919314 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-f6a07465-1586-4d79-a36f-6f5cb3130acd req-b232f3da-5f20-49ba-8a30-fe2b6192e386 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117028 May 27 15:06:07.920423 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1112/2150] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:07.942168 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d4290a8e-c7ab-4d44-82b4-c9ef8b80f8d7 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:07.943492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d4290a8e-c7ab-4d44-82b4-c9ef8b80f8d7 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:07.966262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4290a8e-c7ab-4d44-82b4-c9ef8b80f8d7 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:07.974923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4290a8e-c7ab-4d44-82b4-c9ef8b80f8d7 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:07.976695 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4290a8e-c7ab-4d44-82b4-c9ef8b80f8d7 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:07.977707 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4290a8e-c7ab-4d44-82b4-c9ef8b80f8d7 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:08.411826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d4290a8e-c7ab-4d44-82b4-c9ef8b80f8d7 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:08.426812 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d4290a8e-c7ab-4d44-82b4-c9ef8b80f8d7 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 200 len: 1324 microversion: 2.1 time: 0.501367 May 27 15:06:08.429643 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1113/2151] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:07 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 1324 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:08.446755 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-84eef63b-84cd-4a5b-b115-8bc8f9f4c9ad tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:08.452247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-84eef63b-84cd-4a5b-b115-8bc8f9f4c9ad tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:08.469445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84eef63b-84cd-4a5b-b115-8bc8f9f4c9ad tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:08.472806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84eef63b-84cd-4a5b-b115-8bc8f9f4c9ad tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:08.474040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84eef63b-84cd-4a5b-b115-8bc8f9f4c9ad tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:08.475227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84eef63b-84cd-4a5b-b115-8bc8f9f4c9ad tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:08.490952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6f3cea0a-b607-493e-acff-da07333e9a57 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:08.499305 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6f3cea0a-b607-493e-acff-da07333e9a57 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 200 len: 1314 microversion: 2.1 time: 1.416452 May 27 15:06:08.499947 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1039/2152] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:07 2022] GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 1314 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:08.510925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5894b7b3-2c26-450f-8e55-49e50a3b8a02 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:08.514911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5894b7b3-2c26-450f-8e55-49e50a3b8a02 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:08.532312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5894b7b3-2c26-450f-8e55-49e50a3b8a02 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:08.532945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5894b7b3-2c26-450f-8e55-49e50a3b8a02 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:08.537706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5894b7b3-2c26-450f-8e55-49e50a3b8a02 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:08.538521 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5894b7b3-2c26-450f-8e55-49e50a3b8a02 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:08.669591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-84eef63b-84cd-4a5b-b115-8bc8f9f4c9ad tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:08.693484 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-84eef63b-84cd-4a5b-b115-8bc8f9f4c9ad tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 200 len: 1268 microversion: 2.1 time: 0.261476 May 27 15:06:08.705186 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1114/2153] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:08 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 1268 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:08.839665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e0f7c854-6533-407d-9388-2a586285c649 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:08.844869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e0f7c854-6533-407d-9388-2a586285c649 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: 18e4f7f7-6bda-4d0b-9685-74266d42efc0] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:08.855248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e0f7c854-6533-407d-9388-2a586285c649 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:08.861129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e0f7c854-6533-407d-9388-2a586285c649 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:08.862870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e0f7c854-6533-407d-9388-2a586285c649 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:08.864334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e0f7c854-6533-407d-9388-2a586285c649 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:08.865799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=12 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:08.893501 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-e0f7c854-6533-407d-9388-2a586285c649 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] HTTP exception thrown: Instance 18e4f7f7-6bda-4d0b-9685-74266d42efc0 could not be found. May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e0f7c854-6533-407d-9388-2a586285c649 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Request method failure captured: May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 HTTP/1.1 May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObeii5akAfuoQuqcBM5xu8qHmUXemdb7Xuwg6ZB45tBGHwoUarz3MzgSJWXoi-_nmwfzdzOYzRIfMfUXK9E8irjU9cq-KTuwmcJdVERJt53gIG4UQ10__sZia8bqXHintDMpqNycR2c9_yK0D4Z8IRS7Siv6uc9dNkL_reeUgmiXv0 May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-Openstack-Nova-Api-Version: 2.25 May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 0dbdeb12b89c475cba7fef0ab845dada May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2105219972 May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0dbdeb12b89c475cba7fef0ab845dada"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0dbdeb12b89c475cba7fef0ab845dada"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0dbdeb12b89c475cba7fef0ab845dada"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0dbdeb12b89c475cba7fef0ab845dada", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2105219972 May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 0dbdeb12b89c475cba7fef0ab845dada May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2105219972 May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-LiveAutoBlockMigrationV225Test-2105219972-project May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 4284d5f7a29045d18393bde2961a904b May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2105219972-project May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 18e4f7f7-6bda-4d0b-9685-74266d42efc0 could not be found. May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '18e4f7f7-6bda-4d0b-9685-74266d42efc0'} May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18e4f7f7-6bda-4d0b-9685-74266d42efc0 could not be found. May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18e4f7f7-6bda-4d0b-9685-74266d42efc0 could not be found. May 27 15:06:08.895212 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:08.903902 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:08.903902 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:08.903902 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:08.903902 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:08.903902 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:08.903902 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:08.903902 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:08.903902 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18e4f7f7-6bda-4d0b-9685-74266d42efc0 could not be found. May 27 15:06:08.903902 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:08.903902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e0f7c854-6533-407d-9388-2a586285c649 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Returning 404 to user: Instance 18e4f7f7-6bda-4d0b-9685-74266d42efc0 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:08.903902 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e0f7c854-6533-407d-9388-2a586285c649 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0" status: 404 len: 111 microversion: 2.25 time: 0.071851 May 27 15:06:08.903902 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1115/2154] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:08 2022] GET /compute/v2.1/servers/18e4f7f7-6bda-4d0b-9685-74266d42efc0 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:06:08.914931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5894b7b3-2c26-450f-8e55-49e50a3b8a02 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:08.918442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-99a3111a-6324-4d00-b269-07e05b952ae6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:08.920922 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-99a3111a-6324-4d00-b269-07e05b952ae6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:08.929207 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5894b7b3-2c26-450f-8e55-49e50a3b8a02 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1312 microversion: 2.1 time: 0.422038 May 27 15:06:08.930085 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1040/2155] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:08 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1312 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:08.949986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99a3111a-6324-4d00-b269-07e05b952ae6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:08.953957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99a3111a-6324-4d00-b269-07e05b952ae6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:08.955235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99a3111a-6324-4d00-b269-07e05b952ae6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:08.956256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99a3111a-6324-4d00-b269-07e05b952ae6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:09.069271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-99a3111a-6324-4d00-b269-07e05b952ae6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:06:09.230198 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-99a3111a-6324-4d00-b269-07e05b952ae6 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 204 len: 0 microversion: 2.25 time: 0.322722 May 27 15:06:09.237089 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1116/2156] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:06:08 2022] DELETE /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:06:09.260535 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2e4507e7-a4db-4518-a634-3b19f5359b4c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:09.273739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2e4507e7-a4db-4518-a634-3b19f5359b4c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:09.293520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e4507e7-a4db-4518-a634-3b19f5359b4c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:09.294395 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e4507e7-a4db-4518-a634-3b19f5359b4c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:09.296038 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e4507e7-a4db-4518-a634-3b19f5359b4c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:09.296694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e4507e7-a4db-4518-a634-3b19f5359b4c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:09.448463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b064b086-9ef7-4fe1-8626-aaf3f6bc72b0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:09.449193 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b064b086-9ef7-4fe1-8626-aaf3f6bc72b0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:09.461041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b064b086-9ef7-4fe1-8626-aaf3f6bc72b0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:09.462767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b064b086-9ef7-4fe1-8626-aaf3f6bc72b0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:09.463632 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b064b086-9ef7-4fe1-8626-aaf3f6bc72b0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:09.464079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b064b086-9ef7-4fe1-8626-aaf3f6bc72b0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:09.614954 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2e4507e7-a4db-4518-a634-3b19f5359b4c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:09.627650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2e4507e7-a4db-4518-a634-3b19f5359b4c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:09.631021 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2e4507e7-a4db-4518-a634-3b19f5359b4c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:09.632849 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2e4507e7-a4db-4518-a634-3b19f5359b4c tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1548 microversion: 2.25 time: 0.393593 May 27 15:06:09.633664 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1041/2157] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:09 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1548 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:06:09.639478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0fa7ff40-83eb-46d2-88f4-56149ec920a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:09.640427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0fa7ff40-83eb-46d2-88f4-56149ec920a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:09.668533 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0fa7ff40-83eb-46d2-88f4-56149ec920a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:09.669501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0fa7ff40-83eb-46d2-88f4-56149ec920a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:09.674222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0fa7ff40-83eb-46d2-88f4-56149ec920a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:09.676541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0fa7ff40-83eb-46d2-88f4-56149ec920a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:09.683448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:09.917243 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b064b086-9ef7-4fe1-8626-aaf3f6bc72b0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:09.932358 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b064b086-9ef7-4fe1-8626-aaf3f6bc72b0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 200 len: 1324 microversion: 2.1 time: 0.488834 May 27 15:06:09.938463 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1117/2158] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:09 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 1324 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:09.945216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8f4a10b6-3a6d-4c40-b6cc-91be95b3499c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:09.949195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8f4a10b6-3a6d-4c40-b6cc-91be95b3499c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:09.970248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f4a10b6-3a6d-4c40-b6cc-91be95b3499c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:09.971207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f4a10b6-3a6d-4c40-b6cc-91be95b3499c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:09.973017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f4a10b6-3a6d-4c40-b6cc-91be95b3499c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:09.975814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f4a10b6-3a6d-4c40-b6cc-91be95b3499c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:10.123812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0fa7ff40-83eb-46d2-88f4-56149ec920a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:10.132818 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0fa7ff40-83eb-46d2-88f4-56149ec920a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 200 len: 1314 microversion: 2.1 time: 0.497157 May 27 15:06:10.137652 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1042/2159] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:09 2022] GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:10.142959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8f4a10b6-3a6d-4c40-b6cc-91be95b3499c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:10.147003 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-efbe2709-b93f-4711-9b94-c7128f0f744e tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:10.148095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-efbe2709-b93f-4711-9b94-c7128f0f744e tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:10.153973 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8f4a10b6-3a6d-4c40-b6cc-91be95b3499c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 200 len: 1274 microversion: 2.1 time: 0.213732 May 27 15:06:10.154751 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1118/2160] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:09 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 1274 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:10.155786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efbe2709-b93f-4711-9b94-c7128f0f744e tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:10.156546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efbe2709-b93f-4711-9b94-c7128f0f744e tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:10.157577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efbe2709-b93f-4711-9b94-c7128f0f744e tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:10.158193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efbe2709-b93f-4711-9b94-c7128f0f744e tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:10.177768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-0b170ff7-53ab-4130-beb3-b93b9d1f3c28 req-8b5b2019-369c-48d1-87bc-2a680ef0a73b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d17a653-7f3e-44d7-9b89-68b4b35c9175", "tag": "f12487eb-11c2-4e49-877b-4fd161db40aa"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:10.195055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0b170ff7-53ab-4130-beb3-b93b9d1f3c28 req-8b5b2019-369c-48d1-87bc-2a680ef0a73b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:10.195867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0b170ff7-53ab-4130-beb3-b93b9d1f3c28 req-8b5b2019-369c-48d1-87bc-2a680ef0a73b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:10.210358 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-0b170ff7-53ab-4130-beb3-b93b9d1f3c28 req-8b5b2019-369c-48d1-87bc-2a680ef0a73b service nova] Creating event network-changed:f12487eb-11c2-4e49-877b-4fd161db40aa for instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 on n-h2-843621-1 May 27 15:06:10.217440 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-0b170ff7-53ab-4130-beb3-b93b9d1f3c28 req-8b5b2019-369c-48d1-87bc-2a680ef0a73b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049104 May 27 15:06:10.218760 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1119/2161] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:10.226861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-01858182-9723-4500-b3db-fc5efd0e8944 req-d23a6f57-5dca-4aeb-ab64-95954ca127e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c814849f-c8b5-44a6-9727-654fcc92437c", "name": "network-vif-plugged", "status": "completed", "tag": "dbf9387d-a39c-43c1-a9a0-f9184ed123cc"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:10.239505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-01858182-9723-4500-b3db-fc5efd0e8944 req-d23a6f57-5dca-4aeb-ab64-95954ca127e5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:10.240817 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-01858182-9723-4500-b3db-fc5efd0e8944 req-d23a6f57-5dca-4aeb-ab64-95954ca127e5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:10.261714 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-01858182-9723-4500-b3db-fc5efd0e8944 req-d23a6f57-5dca-4aeb-ab64-95954ca127e5 service nova] Creating event network-vif-plugged:dbf9387d-a39c-43c1-a9a0-f9184ed123cc for instance c814849f-c8b5-44a6-9727-654fcc92437c on n-h1-843621-1 May 27 15:06:10.269923 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-01858182-9723-4500-b3db-fc5efd0e8944 req-d23a6f57-5dca-4aeb-ab64-95954ca127e5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049437 May 27 15:06:10.271150 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1120/2162] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:10.377427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-efbe2709-b93f-4711-9b94-c7128f0f744e tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:10.387402 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-efbe2709-b93f-4711-9b94-c7128f0f744e tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1497 microversion: 2.1 time: 0.246058 May 27 15:06:10.393564 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1043/2163] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:10 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1497 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:10.407975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-66c303d4-d487-45cd-8200-b8d6a2c31bd9 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:10.409236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-66c303d4-d487-45cd-8200-b8d6a2c31bd9 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:10.415701 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66c303d4-d487-45cd-8200-b8d6a2c31bd9 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:10.416201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66c303d4-d487-45cd-8200-b8d6a2c31bd9 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:10.417312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66c303d4-d487-45cd-8200-b8d6a2c31bd9 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:10.418191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66c303d4-d487-45cd-8200-b8d6a2c31bd9 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:10.444516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-66c303d4-d487-45cd-8200-b8d6a2c31bd9 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lazy-loading 'flavor' on Instance uuid 054d9c3e-3968-4177-9ea6-5bb30613592c {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:06:10.542114 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-66c303d4-d487-45cd-8200-b8d6a2c31bd9 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "POST /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c/action" status: 200 len: 32 microversion: 2.1 time: 0.134692 May 27 15:06:10.548232 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1121/2164] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:06:10 2022] POST /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c/action => generated 32 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:06:10.559821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e239b20d-fc66-4e6a-ab87-39cf2ba9cbca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:10.564276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e239b20d-fc66-4e6a-ab87-39cf2ba9cbca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:10.579152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e239b20d-fc66-4e6a-ab87-39cf2ba9cbca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:10.580046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e239b20d-fc66-4e6a-ab87-39cf2ba9cbca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:10.582038 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e239b20d-fc66-4e6a-ab87-39cf2ba9cbca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:10.582992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e239b20d-fc66-4e6a-ab87-39cf2ba9cbca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:10.651845 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-21c0dcb5-65e2-4db1-825e-745ae7c7c134 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:10.652558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-21c0dcb5-65e2-4db1-825e-745ae7c7c134 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:10.659687 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21c0dcb5-65e2-4db1-825e-745ae7c7c134 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:10.660220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21c0dcb5-65e2-4db1-825e-745ae7c7c134 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:10.660956 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21c0dcb5-65e2-4db1-825e-745ae7c7c134 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:10.661398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21c0dcb5-65e2-4db1-825e-745ae7c7c134 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:10.958519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e239b20d-fc66-4e6a-ab87-39cf2ba9cbca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:10.961872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-21c0dcb5-65e2-4db1-825e-745ae7c7c134 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:10.969441 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e239b20d-fc66-4e6a-ab87-39cf2ba9cbca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.415723 May 27 15:06:10.970594 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1044/2165] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:10 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:10.978996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-decb448f-572a-4e25-8ef4-8d7360564297 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:10.979850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-decb448f-572a-4e25-8ef4-8d7360564297 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:10.982897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-21c0dcb5-65e2-4db1-825e-745ae7c7c134 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:10.988932 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-21c0dcb5-65e2-4db1-825e-745ae7c7c134 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:10.990869 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-21c0dcb5-65e2-4db1-825e-745ae7c7c134 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1548 microversion: 2.25 time: 0.343026 May 27 15:06:10.991658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-decb448f-572a-4e25-8ef4-8d7360564297 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:10.992987 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-decb448f-572a-4e25-8ef4-8d7360564297 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:10.995231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-decb448f-572a-4e25-8ef4-8d7360564297 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:10.996217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-decb448f-572a-4e25-8ef4-8d7360564297 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:11.006182 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1122/2166] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:10 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1548 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:06:11.154991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b3fda5ce-26b2-4072-aea2-9f1f007d582d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:11.155922 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b3fda5ce-26b2-4072-aea2-9f1f007d582d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:11.161994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b3fda5ce-26b2-4072-aea2-9f1f007d582d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:11.162654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b3fda5ce-26b2-4072-aea2-9f1f007d582d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:11.163626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b3fda5ce-26b2-4072-aea2-9f1f007d582d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:11.164234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b3fda5ce-26b2-4072-aea2-9f1f007d582d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:11.354446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-decb448f-572a-4e25-8ef4-8d7360564297 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:11.362521 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-decb448f-572a-4e25-8ef4-8d7360564297 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 200 len: 1324 microversion: 2.1 time: 0.390359 May 27 15:06:11.367874 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1045/2167] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:10 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 1324 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:11.380984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1500717e-1570-4649-a87c-b7b52862cd63 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:11.382087 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1500717e-1570-4649-a87c-b7b52862cd63 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:11.392729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1500717e-1570-4649-a87c-b7b52862cd63 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:11.393196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1500717e-1570-4649-a87c-b7b52862cd63 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:11.393996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1500717e-1570-4649-a87c-b7b52862cd63 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:11.394447 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1500717e-1570-4649-a87c-b7b52862cd63 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:11.522775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b3fda5ce-26b2-4072-aea2-9f1f007d582d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:11.530858 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b3fda5ce-26b2-4072-aea2-9f1f007d582d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 200 len: 1314 microversion: 2.1 time: 0.380372 May 27 15:06:11.534828 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1123/2168] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:11 2022] GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:11.700268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-32a366e2-af79-4521-b7ca-43e6d54d8810 req-997dbf7d-95a4-4421-8450-2afd7cc7634f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3d494d-8dd1-49b1-a94a-d17aa943e4e4", "name": "network-vif-deleted", "tag": "20c204bd-a0e4-4b3a-88e0-34bca47af413"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:11.711659 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-32a366e2-af79-4521-b7ca-43e6d54d8810 req-997dbf7d-95a4-4421-8450-2afd7cc7634f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:11.713059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-32a366e2-af79-4521-b7ca-43e6d54d8810 req-997dbf7d-95a4-4421-8450-2afd7cc7634f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:11.726221 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-32a366e2-af79-4521-b7ca-43e6d54d8810 req-997dbf7d-95a4-4421-8450-2afd7cc7634f service nova] Creating event network-vif-deleted:20c204bd-a0e4-4b3a-88e0-34bca47af413 for instance ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 on n-h1-843621-1 May 27 15:06:11.734233 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-32a366e2-af79-4521-b7ca-43e6d54d8810 req-997dbf7d-95a4-4421-8450-2afd7cc7634f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038091 May 27 15:06:11.738027 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1124/2169] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:06:11.986795 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1500717e-1570-4649-a87c-b7b52862cd63 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:11.994959 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1500717e-1570-4649-a87c-b7b52862cd63 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 200 len: 1316 microversion: 2.1 time: 0.625739 May 27 15:06:11.995556 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1046/2170] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:11 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 1316 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:11.996319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-13e86514-ae97-4fac-bee6-01ba8cc12328 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:11.997219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-13e86514-ae97-4fac-bee6-01ba8cc12328 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:12.007626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-13e86514-ae97-4fac-bee6-01ba8cc12328 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:12.010603 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-13e86514-ae97-4fac-bee6-01ba8cc12328 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:12.011727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-71d78c1b-c098-43b1-ad03-e742952aa9d5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:12.012351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-71d78c1b-c098-43b1-ad03-e742952aa9d5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:12.012793 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-13e86514-ae97-4fac-bee6-01ba8cc12328 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:12.013378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-13e86514-ae97-4fac-bee6-01ba8cc12328 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:12.024606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71d78c1b-c098-43b1-ad03-e742952aa9d5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:12.025093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71d78c1b-c098-43b1-ad03-e742952aa9d5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:12.025878 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71d78c1b-c098-43b1-ad03-e742952aa9d5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:12.026318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71d78c1b-c098-43b1-ad03-e742952aa9d5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:12.196649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-71d78c1b-c098-43b1-ad03-e742952aa9d5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:12.205125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-71d78c1b-c098-43b1-ad03-e742952aa9d5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:12.210645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-71d78c1b-c098-43b1-ad03-e742952aa9d5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:12.225828 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-71d78c1b-c098-43b1-ad03-e742952aa9d5 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1506 microversion: 2.25 time: 0.205774 May 27 15:06:12.231063 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1047/2171] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:12 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:06:12.257448 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-13e86514-ae97-4fac-bee6-01ba8cc12328 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:12.263761 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-13e86514-ae97-4fac-bee6-01ba8cc12328 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.279236 May 27 15:06:12.274724 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1125/2172] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:11 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:12.325036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-0a51933d-9161-4319-8bf9-0020605c89aa req-5b767b70-5e25-4b08-86fc-143b67a88b72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2719794f-cbe2-4bfa-a24f-18a461655423", "name": "network-vif-plugged", "status": "completed", "tag": "23cd166c-ce87-4dd9-a78d-1b8bf7552a1e"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:12.335927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0a51933d-9161-4319-8bf9-0020605c89aa req-5b767b70-5e25-4b08-86fc-143b67a88b72 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:12.336375 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0a51933d-9161-4319-8bf9-0020605c89aa req-5b767b70-5e25-4b08-86fc-143b67a88b72 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:12.353137 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-0a51933d-9161-4319-8bf9-0020605c89aa req-5b767b70-5e25-4b08-86fc-143b67a88b72 service nova] Creating event network-vif-plugged:23cd166c-ce87-4dd9-a78d-1b8bf7552a1e for instance 2719794f-cbe2-4bfa-a24f-18a461655423 on n-h2-843621-1 May 27 15:06:12.358538 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-0a51933d-9161-4319-8bf9-0020605c89aa req-5b767b70-5e25-4b08-86fc-143b67a88b72 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037042 May 27 15:06:12.359438 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1048/2173] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:12.384708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-10313ded-ccea-4c83-a70c-ea0765637b90 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:12.385331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-10313ded-ccea-4c83-a70c-ea0765637b90 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:12.395403 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10313ded-ccea-4c83-a70c-ea0765637b90 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:12.396323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10313ded-ccea-4c83-a70c-ea0765637b90 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:12.397481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10313ded-ccea-4c83-a70c-ea0765637b90 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:12.398217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10313ded-ccea-4c83-a70c-ea0765637b90 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:12.551380 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9f2a54c8-ce97-482d-99b2-448a6e812aba tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:12.552383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9f2a54c8-ce97-482d-99b2-448a6e812aba tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:12.559378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f2a54c8-ce97-482d-99b2-448a6e812aba tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:12.560094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f2a54c8-ce97-482d-99b2-448a6e812aba tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:12.561101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f2a54c8-ce97-482d-99b2-448a6e812aba tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:12.561712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f2a54c8-ce97-482d-99b2-448a6e812aba tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:12.726709 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-10313ded-ccea-4c83-a70c-ea0765637b90 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:12.741134 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-10313ded-ccea-4c83-a70c-ea0765637b90 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 200 len: 1324 microversion: 2.1 time: 0.359863 May 27 15:06:12.742204 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1126/2174] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:12 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 1324 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:12.894332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9f2a54c8-ce97-482d-99b2-448a6e812aba tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:12.906628 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9f2a54c8-ce97-482d-99b2-448a6e812aba tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 200 len: 1314 microversion: 2.1 time: 0.359323 May 27 15:06:12.908352 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1049/2175] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:12 2022] GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:13.015818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-26c371cf-97fc-4a62-a30c-cf56a99ba0fd tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:13.017171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-26c371cf-97fc-4a62-a30c-cf56a99ba0fd tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:13.025270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26c371cf-97fc-4a62-a30c-cf56a99ba0fd tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:13.025920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26c371cf-97fc-4a62-a30c-cf56a99ba0fd tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:13.026919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26c371cf-97fc-4a62-a30c-cf56a99ba0fd tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:13.027525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26c371cf-97fc-4a62-a30c-cf56a99ba0fd tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:13.254664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-30a6f025-3c4a-486e-909e-7d39e5b5b824 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:13.256575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-30a6f025-3c4a-486e-909e-7d39e5b5b824 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:13.269896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-26c371cf-97fc-4a62-a30c-cf56a99ba0fd tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:13.278039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30a6f025-3c4a-486e-909e-7d39e5b5b824 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:13.278629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30a6f025-3c4a-486e-909e-7d39e5b5b824 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:13.279496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30a6f025-3c4a-486e-909e-7d39e5b5b824 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:13.280182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30a6f025-3c4a-486e-909e-7d39e5b5b824 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:13.280642 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-26c371cf-97fc-4a62-a30c-cf56a99ba0fd tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 200 len: 1316 microversion: 2.1 time: 0.268507 May 27 15:06:13.282846 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1127/2176] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:13 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:13.294672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-32785411-7457-4766-a210-3f6c5d688572 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:13.297371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-32785411-7457-4766-a210-3f6c5d688572 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:13.306556 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32785411-7457-4766-a210-3f6c5d688572 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:13.307189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32785411-7457-4766-a210-3f6c5d688572 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:13.307986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32785411-7457-4766-a210-3f6c5d688572 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:13.308735 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32785411-7457-4766-a210-3f6c5d688572 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:13.347816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:13.362564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30a6f025-3c4a-486e-909e-7d39e5b5b824 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:13.363130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30a6f025-3c4a-486e-909e-7d39e5b5b824 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:13.363824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-30a6f025-3c4a-486e-909e-7d39e5b5b824 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lazy-loading 'fault' on Instance uuid ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:06:13.465784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-30a6f025-3c4a-486e-909e-7d39e5b5b824 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:13.489676 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-30a6f025-3c4a-486e-909e-7d39e5b5b824 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:13.492297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-30a6f025-3c4a-486e-909e-7d39e5b5b824 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:13.495182 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-30a6f025-3c4a-486e-909e-7d39e5b5b824 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 200 len: 1352 microversion: 2.25 time: 0.250608 May 27 15:06:13.506058 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1050/2177] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:13 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 1352 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:06:13.652757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-32785411-7457-4766-a210-3f6c5d688572 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:13.672041 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-32785411-7457-4766-a210-3f6c5d688572 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.387299 May 27 15:06:13.672863 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1128/2178] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:13 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:13.765941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7ba7a8a8-3f01-45ca-b3f7-4d2c53b9fa6a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:13.767929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7ba7a8a8-3f01-45ca-b3f7-4d2c53b9fa6a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:13.789282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-05f8877d-8372-481c-88e1-c3e42fa8931f req-26dcf79f-e933-446f-91cd-bb5afde80e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "332c261b-d7bd-44c6-9f15-31e825c440b6", "tag": "b97655f0-29fe-4e43-8737-f3775f6f744d"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:13.790621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ba7a8a8-3f01-45ca-b3f7-4d2c53b9fa6a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:13.791483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ba7a8a8-3f01-45ca-b3f7-4d2c53b9fa6a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:13.793676 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ba7a8a8-3f01-45ca-b3f7-4d2c53b9fa6a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:13.794317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ba7a8a8-3f01-45ca-b3f7-4d2c53b9fa6a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:13.814658 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-05f8877d-8372-481c-88e1-c3e42fa8931f req-26dcf79f-e933-446f-91cd-bb5afde80e80 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:13.825335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-05f8877d-8372-481c-88e1-c3e42fa8931f req-26dcf79f-e933-446f-91cd-bb5afde80e80 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:13.848221 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-05f8877d-8372-481c-88e1-c3e42fa8931f req-26dcf79f-e933-446f-91cd-bb5afde80e80 service nova] Creating event network-changed:b97655f0-29fe-4e43-8737-f3775f6f744d for instance 332c261b-d7bd-44c6-9f15-31e825c440b6 on n-h1-843621-1 May 27 15:06:13.853561 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-05f8877d-8372-481c-88e1-c3e42fa8931f req-26dcf79f-e933-446f-91cd-bb5afde80e80 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067877 May 27 15:06:13.854431 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1129/2179] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:13.931353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-78e9d5bd-14a2-4d63-9fbd-85cc5290555a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:13.933087 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-78e9d5bd-14a2-4d63-9fbd-85cc5290555a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:13.941609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78e9d5bd-14a2-4d63-9fbd-85cc5290555a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:13.942380 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78e9d5bd-14a2-4d63-9fbd-85cc5290555a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:13.943344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78e9d5bd-14a2-4d63-9fbd-85cc5290555a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:13.943960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78e9d5bd-14a2-4d63-9fbd-85cc5290555a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:14.089557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7ba7a8a8-3f01-45ca-b3f7-4d2c53b9fa6a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:14.098918 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7ba7a8a8-3f01-45ca-b3f7-4d2c53b9fa6a tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 200 len: 1324 microversion: 2.1 time: 0.343504 May 27 15:06:14.100117 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1051/2180] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:13 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 1324 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:14.204519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-78e9d5bd-14a2-4d63-9fbd-85cc5290555a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:14.236797 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-78e9d5bd-14a2-4d63-9fbd-85cc5290555a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 200 len: 1314 microversion: 2.1 time: 0.310526 May 27 15:06:14.249296 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1130/2181] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:13 2022] GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:14.299308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8c6b7133-1305-4d77-95b7-48753c3271a8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:14.300956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8c6b7133-1305-4d77-95b7-48753c3271a8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:14.309138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c6b7133-1305-4d77-95b7-48753c3271a8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:14.309973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c6b7133-1305-4d77-95b7-48753c3271a8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:14.311666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c6b7133-1305-4d77-95b7-48753c3271a8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:14.312348 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c6b7133-1305-4d77-95b7-48753c3271a8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:14.523281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0ebdb2eb-4403-4283-85ba-ced140222a31 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:14.524427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0ebdb2eb-4403-4283-85ba-ced140222a31 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ab3d494d-8dd1-49b1-a94a-d17aa943e4e4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:14.538391 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ebdb2eb-4403-4283-85ba-ced140222a31 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:14.539192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ebdb2eb-4403-4283-85ba-ced140222a31 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:14.540582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ebdb2eb-4403-4283-85ba-ced140222a31 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:14.541413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ebdb2eb-4403-4283-85ba-ced140222a31 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:14.571905 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-0ebdb2eb-4403-4283-85ba-ced140222a31 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] HTTP exception thrown: Instance ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 could not be found. May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0ebdb2eb-4403-4283-85ba-ced140222a31 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Request method failure captured: May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 HTTP/1.1 May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikObeii5akAfuoQuqcBM5xu8qHmUXemdb7Xuwg6ZB45tBGHwoUarz3MzgSJWXoi-_nmwfzdzOYzRIfMfUXK9E8irjU9cq-KTuwmcJdVERJt53gIG4UQ10__sZia8bqXHintDMpqNycR2c9_yK0D4Z8IRS7Siv6uc9dNkL_reeUgmiXv0 May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-Openstack-Nova-Api-Version: 2.25 May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 0dbdeb12b89c475cba7fef0ab845dada May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2105219972 May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0dbdeb12b89c475cba7fef0ab845dada"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0dbdeb12b89c475cba7fef0ab845dada"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0dbdeb12b89c475cba7fef0ab845dada"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0dbdeb12b89c475cba7fef0ab845dada", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2105219972 May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 0dbdeb12b89c475cba7fef0ab845dada May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2105219972 May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-LiveAutoBlockMigrationV225Test-2105219972-project May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 4284d5f7a29045d18393bde2961a904b May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2105219972-project May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 could not be found. May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'ab3d494d-8dd1-49b1-a94a-d17aa943e4e4'} May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 could not be found. May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 could not be found. May 27 15:06:14.575466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:14.582483 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:14.582483 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:14.582483 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:14.582483 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:14.582483 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:14.582483 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:14.582483 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:14.582483 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 could not be found. May 27 15:06:14.582483 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:14.582483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0ebdb2eb-4403-4283-85ba-ced140222a31 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Returning 404 to user: Instance ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:14.582483 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0ebdb2eb-4403-4283-85ba-ced140222a31 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4" status: 404 len: 111 microversion: 2.25 time: 0.068034 May 27 15:06:14.582483 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1131/2182] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:14 2022] GET /compute/v2.1/servers/ab3d494d-8dd1-49b1-a94a-d17aa943e4e4 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:06:14.595194 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0f92f894-8592-4e30-bb43-eb9032b7cfcc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:14.596090 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0f92f894-8592-4e30-bb43-eb9032b7cfcc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:14.608541 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f92f894-8592-4e30-bb43-eb9032b7cfcc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:14.609274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f92f894-8592-4e30-bb43-eb9032b7cfcc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:14.612001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f92f894-8592-4e30-bb43-eb9032b7cfcc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:14.613139 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f92f894-8592-4e30-bb43-eb9032b7cfcc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:14.667922 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8c6b7133-1305-4d77-95b7-48753c3271a8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:14.681554 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8c6b7133-1305-4d77-95b7-48753c3271a8 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 200 len: 1316 microversion: 2.1 time: 0.385891 May 27 15:06:14.692149 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1052/2183] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:14 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 1316 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:14.698051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ef4c846f-a3af-4406-9dea-c344f47bb07a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:14.698880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ef4c846f-a3af-4406-9dea-c344f47bb07a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:14.701281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0f92f894-8592-4e30-bb43-eb9032b7cfcc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:06:14.706147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef4c846f-a3af-4406-9dea-c344f47bb07a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:14.709251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef4c846f-a3af-4406-9dea-c344f47bb07a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:14.710372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef4c846f-a3af-4406-9dea-c344f47bb07a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:14.711027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef4c846f-a3af-4406-9dea-c344f47bb07a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:14.822360 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0f92f894-8592-4e30-bb43-eb9032b7cfcc tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 204 len: 0 microversion: 2.25 time: 0.236486 May 27 15:06:14.823412 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1132/2184] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:06:14 2022] DELETE /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 27 15:06:14.833159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9b2c72a9-e062-499c-bf02-4bcedacbe074 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:14.834135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9b2c72a9-e062-499c-bf02-4bcedacbe074 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:14.841222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b2c72a9-e062-499c-bf02-4bcedacbe074 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:14.841822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b2c72a9-e062-499c-bf02-4bcedacbe074 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:14.842704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b2c72a9-e062-499c-bf02-4bcedacbe074 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:14.843232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b2c72a9-e062-499c-bf02-4bcedacbe074 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:15.204941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ef4c846f-a3af-4406-9dea-c344f47bb07a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:15.214149 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ef4c846f-a3af-4406-9dea-c344f47bb07a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.520438 May 27 15:06:15.214988 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1053/2185] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:14 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:15.221254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-af6ed1a1-01c2-4683-989a-c6a520a47551 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:15.222223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-af6ed1a1-01c2-4683-989a-c6a520a47551 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:15.228999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af6ed1a1-01c2-4683-989a-c6a520a47551 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:15.229640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af6ed1a1-01c2-4683-989a-c6a520a47551 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:15.230426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af6ed1a1-01c2-4683-989a-c6a520a47551 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:15.230865 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af6ed1a1-01c2-4683-989a-c6a520a47551 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:15.299132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9b2c72a9-e062-499c-bf02-4bcedacbe074 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:15.307627 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9b2c72a9-e062-499c-bf02-4bcedacbe074 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:15.309142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9b2c72a9-e062-499c-bf02-4bcedacbe074 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:15.310387 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9b2c72a9-e062-499c-bf02-4bcedacbe074 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1563 microversion: 2.25 time: 0.482683 May 27 15:06:15.311155 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1133/2186] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:14 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1563 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:06:15.315700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b15f7dc9-6535-4740-98ad-c65d0526dab7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:15.316306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b15f7dc9-6535-4740-98ad-c65d0526dab7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:15.328505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b15f7dc9-6535-4740-98ad-c65d0526dab7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:15.329760 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b15f7dc9-6535-4740-98ad-c65d0526dab7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:15.330635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b15f7dc9-6535-4740-98ad-c65d0526dab7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:15.331080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b15f7dc9-6535-4740-98ad-c65d0526dab7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:15.460571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b15f7dc9-6535-4740-98ad-c65d0526dab7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:15.470230 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b15f7dc9-6535-4740-98ad-c65d0526dab7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 200 len: 1272 microversion: 2.1 time: 0.157979 May 27 15:06:15.470814 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1134/2187] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:15 2022] GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:15.543070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-af6ed1a1-01c2-4683-989a-c6a520a47551 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:15.550775 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-af6ed1a1-01c2-4683-989a-c6a520a47551 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 200 len: 1521 microversion: 2.1 time: 0.334114 May 27 15:06:15.551353 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1054/2188] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:15 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:15.570962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-44075917-143c-42e9-b9dc-dc8cbc33f050 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:15.571667 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-44075917-143c-42e9-b9dc-dc8cbc33f050 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:15.578561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44075917-143c-42e9-b9dc-dc8cbc33f050 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:15.579101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44075917-143c-42e9-b9dc-dc8cbc33f050 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:15.579959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44075917-143c-42e9-b9dc-dc8cbc33f050 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:15.580472 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44075917-143c-42e9-b9dc-dc8cbc33f050 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:15.699359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-93ebe12a-15d1-469f-a516-e0f6d5c97d4d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:15.700212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-93ebe12a-15d1-469f-a516-e0f6d5c97d4d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:15.707477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93ebe12a-15d1-469f-a516-e0f6d5c97d4d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:15.707672 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93ebe12a-15d1-469f-a516-e0f6d5c97d4d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:15.709167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93ebe12a-15d1-469f-a516-e0f6d5c97d4d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:15.709779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93ebe12a-15d1-469f-a516-e0f6d5c97d4d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:15.853757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-44075917-143c-42e9-b9dc-dc8cbc33f050 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:15.862023 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-44075917-143c-42e9-b9dc-dc8cbc33f050 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 200 len: 1521 microversion: 2.1 time: 0.296317 May 27 15:06:15.862875 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1135/2189] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:15 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:15.880606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1ee13d04-13e3-47b8-b3f2-2657561db3fb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-753692031"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:15.881856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1ee13d04-13e3-47b8-b3f2-2657561db3fb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:15.887876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1ee13d04-13e3-47b8-b3f2-2657561db3fb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:15.888427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1ee13d04-13e3-47b8-b3f2-2657561db3fb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:15.889981 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1ee13d04-13e3-47b8-b3f2-2657561db3fb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:15.890534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1ee13d04-13e3-47b8-b3f2-2657561db3fb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:15.967058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-93ebe12a-15d1-469f-a516-e0f6d5c97d4d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:15.978527 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-93ebe12a-15d1-469f-a516-e0f6d5c97d4d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 200 len: 1316 microversion: 2.1 time: 0.282881 May 27 15:06:15.995868 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1055/2190] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:15 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:16.002723 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-8f55dc82-9624-4cda-a423-cdbbcbc80b96 req-a18d97c5-e004-4487-a1de-953c1ad799fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c814849f-c8b5-44a6-9727-654fcc92437c", "name": "network-vif-deleted", "tag": "dbf9387d-a39c-43c1-a9a0-f9184ed123cc"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:16.032201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-8f55dc82-9624-4cda-a423-cdbbcbc80b96 req-a18d97c5-e004-4487-a1de-953c1ad799fe service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:16.032201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-8f55dc82-9624-4cda-a423-cdbbcbc80b96 req-a18d97c5-e004-4487-a1de-953c1ad799fe service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:16.043481 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-8f55dc82-9624-4cda-a423-cdbbcbc80b96 req-a18d97c5-e004-4487-a1de-953c1ad799fe service nova] Creating event network-vif-deleted:dbf9387d-a39c-43c1-a9a0-f9184ed123cc for instance c814849f-c8b5-44a6-9727-654fcc92437c on n-h1-843621-1 May 27 15:06:16.049749 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-8f55dc82-9624-4cda-a423-cdbbcbc80b96 req-a18d97c5-e004-4487-a1de-953c1ad799fe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052548 May 27 15:06:16.050918 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1056/2191] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:16.239991 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1ee13d04-13e3-47b8-b3f2-2657561db3fb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "POST /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423/action" status: 202 len: 0 microversion: 2.1 time: 0.363646 May 27 15:06:16.241949 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1136/2192] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:06:15 2022] POST /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) May 27 15:06:16.250553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a1795245-8fe3-4798-bdf3-75e6bdb8cbb7 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:16.251514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a1795245-8fe3-4798-bdf3-75e6bdb8cbb7 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:16.264782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a1795245-8fe3-4798-bdf3-75e6bdb8cbb7 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:16.265486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a1795245-8fe3-4798-bdf3-75e6bdb8cbb7 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:16.266510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a1795245-8fe3-4798-bdf3-75e6bdb8cbb7 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:16.267807 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a1795245-8fe3-4798-bdf3-75e6bdb8cbb7 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:16.339383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c7239c85-3743-4e0c-9786-7e264c670022 tempest-FloatingIPsNegativeTestJSON-102943580 tempest-FloatingIPsNegativeTestJSON-102943580-project] Calling method '.version_select at 0x7fc7806cd3a0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:16.674889 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c7239c85-3743-4e0c-9786-7e264c670022 tempest-FloatingIPsNegativeTestJSON-102943580 tempest-FloatingIPsNegativeTestJSON-102943580-project] 10.222.0.13 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.517393 May 27 15:06:16.675869 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1057/2193] 10.222.0.13 () {58 vars in 1148 bytes} [Fri May 27 15:06:16 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 15:06:16.681062 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-52f613ee-8aec-4019-86ea-dcb2be56e13c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '.version_select at 0x7fc780668700>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:16.718642 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a1795245-8fe3-4798-bdf3-75e6bdb8cbb7 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:16.726877 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a1795245-8fe3-4798-bdf3-75e6bdb8cbb7 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.482875 May 27 15:06:16.737069 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1137/2194] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:16 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:16.742094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c21eeee4-0838-40cc-b8d8-2d5049a8ddca tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:16.742841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c21eeee4-0838-40cc-b8d8-2d5049a8ddca tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:16.748986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c21eeee4-0838-40cc-b8d8-2d5049a8ddca tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:16.750069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c21eeee4-0838-40cc-b8d8-2d5049a8ddca tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:16.750851 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c21eeee4-0838-40cc-b8d8-2d5049a8ddca tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:16.751559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c21eeee4-0838-40cc-b8d8-2d5049a8ddca tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:16.809818 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-52f613ee-8aec-4019-86ea-dcb2be56e13c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "DELETE /compute/v2.1/images/65ad0a28-c2bc-4b82-939f-ec66a2155e2b" status: 204 len: 0 microversion: 2.1 time: 0.132456 May 27 15:06:16.810501 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1058/2195] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:16 2022] DELETE /compute/v2.1/images/65ad0a28-c2bc-4b82-939f-ec66a2155e2b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:06:16.818893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dbe63fcf-798a-4725-a29f-65cacae6a613 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:16.819649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dbe63fcf-798a-4725-a29f-65cacae6a613 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:16.827523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dbe63fcf-798a-4725-a29f-65cacae6a613 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:16.828143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dbe63fcf-798a-4725-a29f-65cacae6a613 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:16.828964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dbe63fcf-798a-4725-a29f-65cacae6a613 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:16.829413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dbe63fcf-798a-4725-a29f-65cacae6a613 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:16.890120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=16 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:16.902147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dbe63fcf-798a-4725-a29f-65cacae6a613 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:16.913160 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dbe63fcf-798a-4725-a29f-65cacae6a613 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 200 len: 1272 microversion: 2.1 time: 0.101360 May 27 15:06:16.913565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c21eeee4-0838-40cc-b8d8-2d5049a8ddca tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:16.916858 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1059/2196] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:16 2022] GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 1272 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:16.919221 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c7208cdf-ef3e-4eab-9f53-d59795c68ef6 tempest-FloatingIPsNegativeTestJSON-102943580 tempest-FloatingIPsNegativeTestJSON-102943580-project] Action: 'create', calling method: .version_select at 0x7fc78073d820>, body: {"pool": "non_exist_pool"} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:16.924458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c21eeee4-0838-40cc-b8d8-2d5049a8ddca tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:16.925436 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:16.926182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c21eeee4-0838-40cc-b8d8-2d5049a8ddca tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:16.927896 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c21eeee4-0838-40cc-b8d8-2d5049a8ddca tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1563 microversion: 2.25 time: 0.189730 May 27 15:06:16.929329 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1138/2197] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:16 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1563 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:06:16.934163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cea25a2b-1620-419a-8f3b-b734b048f36b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '.version_select at 0x7fc780732d30>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:16.964886 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-cea25a2b-1620-419a-8f3b-b734b048f36b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] HTTP exception thrown: Image not found. May 27 15:06:16.965095 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-c7208cdf-ef3e-4eab-9f53-d59795c68ef6 tempest-FloatingIPsNegativeTestJSON-102943580 tempest-FloatingIPsNegativeTestJSON-102943580-project] HTTP exception thrown: Floating IP pool not found. May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c7208cdf-ef3e-4eab-9f53-d59795c68ef6 tempest-FloatingIPsNegativeTestJSON-102943580 tempest-FloatingIPsNegativeTestJSON-102943580-project] Request method failure captured: May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 26 May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOjojDhnL3TE-SBHkHdoZRAQg4l6dMjGxX-cHpQqq164ayz0YasgxlCm7hhewnbS3EN-9-fFF-zKHTB135Gp4t1HuvH_XOQHKXOksLqxwpc65eaXDiNjA02T_FG49JQ4yy0wPH0XVtbKPwkTLva9-uKN9AdZxyI0k-NOVkITtQ00-pk May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: c26569841b7641b6a6a8ea35da5c4a76 May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-102943580 May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c26569841b7641b6a6a8ea35da5c4a76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c26569841b7641b6a6a8ea35da5c4a76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c26569841b7641b6a6a8ea35da5c4a76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c26569841b7641b6a6a8ea35da5c4a76", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-102943580 May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: c26569841b7641b6a6a8ea35da5c4a76 May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-102943580 May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-FloatingIPsNegativeTestJSON-102943580-project May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: d9a4eef0e13349168ec5e7c164f9809a May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-102943580-project May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: {"pool": "non_exist_pool"} May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: exception: Floating IP pool not found. May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'pool': 'non_exist_pool'}} May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2958, in allocate_floating_ip May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2948, in _get_floating_ip_pool_id_by_name_or_id May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:16.967543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:16.973491 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. May 27 15:06:16.973491 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cea25a2b-1620-419a-8f3b-b734b048f36b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Request method failure captured: May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/images/65ad0a28-c2bc-4b82-939f-ec66a2155e2b HTTP/1.1 May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOimLUy6xqp-gD8lGFWAUihJRQaSsy_euXND3kG660I8aII4Fj7ST5KLuaskP9b7InGbbwTAnVT5MT1H-Njofjk92SIoSVXWmihhyVdCbe--Q04_qmor9yl_DFjMNoGrjAWoGuMhIp_HpJ221pj4licupaHrWSVP-C-ksMH4M8HOkGM May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b939a1a277f248fdaad387a445a9e780", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: d3cb6de543d34fed9b582f5af0712790 May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: exception: Image not found. May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '65ad0a28-c2bc-4b82-939f-ec66a2155e2b'} May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 65ad0a28-c2bc-4b82-939f-ec66a2155e2b May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 27 15:06:16.973689 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 65ad0a28-c2bc-4b82-939f-ec66a2155e2b could not be found. May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cea25a2b-1620-419a-8f3b-b734b048f36b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Returning 404 to user: Image not found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:16.983881 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cea25a2b-1620-419a-8f3b-b734b048f36b tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/images/65ad0a28-c2bc-4b82-939f-ec66a2155e2b" status: 404 len: 62 microversion: 2.1 time: 0.039656 May 27 15:06:16.987909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c7208cdf-ef3e-4eab-9f53-d59795c68ef6 tempest-FloatingIPsNegativeTestJSON-102943580 tempest-FloatingIPsNegativeTestJSON-102943580-project] Returning 404 to user: Floating IP pool not found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:16.988031 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1139/2198] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:06:16 2022] GET /compute/v2.1/images/65ad0a28-c2bc-4b82-939f-ec66a2155e2b => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:06:16.988144 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c7208cdf-ef3e-4eab-9f53-d59795c68ef6 tempest-FloatingIPsNegativeTestJSON-102943580 tempest-FloatingIPsNegativeTestJSON-102943580-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.058897 May 27 15:06:16.988144 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1060/2199] 10.222.0.13 () {60 vars in 1169 bytes} [Fri May 27 15:06:16 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:06:16.988341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a98f06bb-8050-48e3-aff0-82840f1f8539 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:16.988341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a98f06bb-8050-48e3-aff0-82840f1f8539 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:16.989411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a98f06bb-8050-48e3-aff0-82840f1f8539 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:16.989914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a98f06bb-8050-48e3-aff0-82840f1f8539 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:16.991010 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a98f06bb-8050-48e3-aff0-82840f1f8539 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:16.991458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a98f06bb-8050-48e3-aff0-82840f1f8539 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:16.993543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5eba484c-ddde-4a5e-86cf-d0be94d13681 tempest-FloatingIPsNegativeTestJSON-102943580 tempest-FloatingIPsNegativeTestJSON-102943580-project] Calling method '.version_select at 0x7fc7806ab280>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:17.036883 n-d-843621-1 devstack@n-api.service[119249]: DEBUG neutronclient.v2_0.client [None req-5eba484c-ddde-4a5e-86cf-d0be94d13681 tempest-FloatingIPsNegativeTestJSON-102943580 tempest-FloatingIPsNegativeTestJSON-102943580-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6b252cd7-fe02-4723-a400-82b46c33ef30 could not be found", "detail": ""}} {{(pid=119249) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:06:17.037657 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-5eba484c-ddde-4a5e-86cf-d0be94d13681 tempest-FloatingIPsNegativeTestJSON-102943580 tempest-FloatingIPsNegativeTestJSON-102943580-project] HTTP exception thrown: Floating IP not found for ID 6b252cd7-fe02-4723-a400-82b46c33ef30 May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5eba484c-ddde-4a5e-86cf-d0be94d13681 tempest-FloatingIPsNegativeTestJSON-102943580 tempest-FloatingIPsNegativeTestJSON-102943580-project] Request method failure captured: May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/os-floating-ips/6b252cd7-fe02-4723-a400-82b46c33ef30 HTTP/1.1 May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOjojDhnL3TE-SBHkHdoZRAQg4l6dMjGxX-cHpQqq164ayz0YasgxlCm7hhewnbS3EN-9-fFF-zKHTB135Gp4t1HuvH_XOQHKXOksLqxwpc65eaXDiNjA02T_FG49JQ4yy0wPH0XVtbKPwkTLva9-uKN9AdZxyI0k-NOVkITtQ00-pk May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: c26569841b7641b6a6a8ea35da5c4a76 May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-102943580 May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c26569841b7641b6a6a8ea35da5c4a76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c26569841b7641b6a6a8ea35da5c4a76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c26569841b7641b6a6a8ea35da5c4a76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c26569841b7641b6a6a8ea35da5c4a76", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-102943580 May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: c26569841b7641b6a6a8ea35da5c4a76 May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-102943580 May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-FloatingIPsNegativeTestJSON-102943580-project May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: d9a4eef0e13349168ec5e7c164f9809a May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-102943580-project May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: exception: Floating IP not found for ID 6b252cd7-fe02-4723-a400-82b46c33ef30 May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '6b252cd7-fe02-4723-a400-82b46c33ef30'} May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 6b252cd7-fe02-4723-a400-82b46c33ef30 could not be found May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f08b6dbd-2fd5-4338-95d8-fa06d96954d4'] May 27 15:06:17.039538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 6b252cd7-fe02-4723-a400-82b46c33ef30. May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 6b252cd7-fe02-4723-a400-82b46c33ef30 May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 6b252cd7-fe02-4723-a400-82b46c33ef30 May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:17.044849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5eba484c-ddde-4a5e-86cf-d0be94d13681 tempest-FloatingIPsNegativeTestJSON-102943580 tempest-FloatingIPsNegativeTestJSON-102943580-project] Returning 404 to user: Floating IP not found for ID 6b252cd7-fe02-4723-a400-82b46c33ef30 {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:17.047712 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5eba484c-ddde-4a5e-86cf-d0be94d13681 tempest-FloatingIPsNegativeTestJSON-102943580 tempest-FloatingIPsNegativeTestJSON-102943580-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/6b252cd7-fe02-4723-a400-82b46c33ef30" status: 404 len: 111 microversion: 2.1 time: 0.056931 May 27 15:06:17.052703 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1061/2200] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 15:06:16 2022] DELETE /compute/v2.1/os-floating-ips/6b252cd7-fe02-4723-a400-82b46c33ef30 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:17.054652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-08e1431f-2ab0-4adb-82e1-1444200a8d4c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:17.055467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-08e1431f-2ab0-4adb-82e1-1444200a8d4c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:17.064271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08e1431f-2ab0-4adb-82e1-1444200a8d4c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:17.065950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08e1431f-2ab0-4adb-82e1-1444200a8d4c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:17.067288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08e1431f-2ab0-4adb-82e1-1444200a8d4c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:17.068894 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08e1431f-2ab0-4adb-82e1-1444200a8d4c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:17.257367 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a98f06bb-8050-48e3-aff0-82840f1f8539 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:17.274280 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a98f06bb-8050-48e3-aff0-82840f1f8539 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 200 len: 1533 microversion: 2.1 time: 0.298777 May 27 15:06:17.287927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-08e1431f-2ab0-4adb-82e1-1444200a8d4c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:17.289959 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1140/2201] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:16 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 1533 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:17.296802 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-08e1431f-2ab0-4adb-82e1-1444200a8d4c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 200 len: 1316 microversion: 2.1 time: 0.247266 May 27 15:06:17.297389 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1062/2202] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:17 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:17.747266 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d4f56747-d610-4f6f-a363-abef292b97ca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:17.749222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d4f56747-d610-4f6f-a363-abef292b97ca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:17.758307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4f56747-d610-4f6f-a363-abef292b97ca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:17.758920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4f56747-d610-4f6f-a363-abef292b97ca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:17.759815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4f56747-d610-4f6f-a363-abef292b97ca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:17.760364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4f56747-d610-4f6f-a363-abef292b97ca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:17.932121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e32212cd-5bd7-4d5f-883a-25f653771509 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:17.933378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e32212cd-5bd7-4d5f-883a-25f653771509 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:17.958319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e32212cd-5bd7-4d5f-883a-25f653771509 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:17.958817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e32212cd-5bd7-4d5f-883a-25f653771509 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:17.959658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e32212cd-5bd7-4d5f-883a-25f653771509 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:17.960112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e32212cd-5bd7-4d5f-883a-25f653771509 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:18.002280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d4f56747-d610-4f6f-a363-abef292b97ca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:18.011271 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d4f56747-d610-4f6f-a363-abef292b97ca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.270155 May 27 15:06:18.012419 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1141/2203] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:17 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:18.018208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a4650bfe-fdbb-4954-999f-d0fc1784ee5b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:18.019082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a4650bfe-fdbb-4954-999f-d0fc1784ee5b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:18.025273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:18.027698 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4650bfe-fdbb-4954-999f-d0fc1784ee5b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:18.028652 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4650bfe-fdbb-4954-999f-d0fc1784ee5b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:18.030303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4650bfe-fdbb-4954-999f-d0fc1784ee5b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:18.030935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4650bfe-fdbb-4954-999f-d0fc1784ee5b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:18.167747 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e32212cd-5bd7-4d5f-883a-25f653771509 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:18.171526 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:18.177156 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e32212cd-5bd7-4d5f-883a-25f653771509 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 200 len: 1293 microversion: 2.1 time: 0.251683 May 27 15:06:18.178352 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1063/2204] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:17 2022] GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 1293 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:18.304334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a4650bfe-fdbb-4954-999f-d0fc1784ee5b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:18.304965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-730772fa-a400-41e4-9609-b03834131c46 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:18.305973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-730772fa-a400-41e4-9609-b03834131c46 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:18.313306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-730772fa-a400-41e4-9609-b03834131c46 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:18.313771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-730772fa-a400-41e4-9609-b03834131c46 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:18.314520 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a4650bfe-fdbb-4954-999f-d0fc1784ee5b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:18.314696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-730772fa-a400-41e4-9609-b03834131c46 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:18.314984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-730772fa-a400-41e4-9609-b03834131c46 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:18.317928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a4650bfe-fdbb-4954-999f-d0fc1784ee5b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:18.319424 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a4650bfe-fdbb-4954-999f-d0fc1784ee5b tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1563 microversion: 2.25 time: 0.305777 May 27 15:06:18.319967 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1142/2205] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:18 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1563 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:06:18.328140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-086f8367-53c5-4857-a7c6-e3c70c2c1a14 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:18.329056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-086f8367-53c5-4857-a7c6-e3c70c2c1a14 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:18.335750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-086f8367-53c5-4857-a7c6-e3c70c2c1a14 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:18.336471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-086f8367-53c5-4857-a7c6-e3c70c2c1a14 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:18.338017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-086f8367-53c5-4857-a7c6-e3c70c2c1a14 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:18.338643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-086f8367-53c5-4857-a7c6-e3c70c2c1a14 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:18.581171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-730772fa-a400-41e4-9609-b03834131c46 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:18.592584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-086f8367-53c5-4857-a7c6-e3c70c2c1a14 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:18.593341 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-730772fa-a400-41e4-9609-b03834131c46 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 200 len: 1539 microversion: 2.1 time: 0.301040 May 27 15:06:18.601366 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1064/2206] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:18 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 1539 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:18.608208 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-086f8367-53c5-4857-a7c6-e3c70c2c1a14 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 200 len: 1316 microversion: 2.1 time: 0.286336 May 27 15:06:18.608828 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1143/2207] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:18 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:19.029976 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f51d52b2-cc83-4fb4-942b-80f8a8080b46 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:19.031399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f51d52b2-cc83-4fb4-942b-80f8a8080b46 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:19.043361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f51d52b2-cc83-4fb4-942b-80f8a8080b46 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:19.043831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f51d52b2-cc83-4fb4-942b-80f8a8080b46 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:19.046044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f51d52b2-cc83-4fb4-942b-80f8a8080b46 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:19.046509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f51d52b2-cc83-4fb4-942b-80f8a8080b46 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:19.195990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2929b1db-5f0a-4238-9cf3-81fadc0ccc83 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:19.196548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2929b1db-5f0a-4238-9cf3-81fadc0ccc83 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:19.210928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2929b1db-5f0a-4238-9cf3-81fadc0ccc83 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:19.211674 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2929b1db-5f0a-4238-9cf3-81fadc0ccc83 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:19.212840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2929b1db-5f0a-4238-9cf3-81fadc0ccc83 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:19.213980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2929b1db-5f0a-4238-9cf3-81fadc0ccc83 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:19.226620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:19.266817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f51d52b2-cc83-4fb4-942b-80f8a8080b46 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:19.275083 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f51d52b2-cc83-4fb4-942b-80f8a8080b46 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.250535 May 27 15:06:19.284221 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1065/2208] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:19 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:19.341312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1a9c39c2-2910-4680-9523-2486b64d0cda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:19.342570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2929b1db-5f0a-4238-9cf3-81fadc0ccc83 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:19.342736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1a9c39c2-2910-4680-9523-2486b64d0cda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:19.350474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a9c39c2-2910-4680-9523-2486b64d0cda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:19.356532 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2929b1db-5f0a-4238-9cf3-81fadc0ccc83 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 200 len: 1293 microversion: 2.1 time: 0.165262 May 27 15:06:19.365926 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a9c39c2-2910-4680-9523-2486b64d0cda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:19.366967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a9c39c2-2910-4680-9523-2486b64d0cda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:19.367452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a9c39c2-2910-4680-9523-2486b64d0cda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:19.372439 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1144/2209] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:19 2022] GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 1293 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:19.562568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1a9c39c2-2910-4680-9523-2486b64d0cda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:19.573560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1a9c39c2-2910-4680-9523-2486b64d0cda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:19.575806 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1a9c39c2-2910-4680-9523-2486b64d0cda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:19.578578 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1a9c39c2-2910-4680-9523-2486b64d0cda tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1563 microversion: 2.25 time: 0.244582 May 27 15:06:19.578994 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1066/2210] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:19 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:06:19.612785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-08c8a7e9-83c5-409d-ae54-48c4db25f0d9 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:19.614061 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-08c8a7e9-83c5-409d-ae54-48c4db25f0d9 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:19.625174 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08c8a7e9-83c5-409d-ae54-48c4db25f0d9 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:19.625874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08c8a7e9-83c5-409d-ae54-48c4db25f0d9 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:19.627026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fc53e1ca-2aab-4fc4-aeb5-96d23ce415f7 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:19.627666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08c8a7e9-83c5-409d-ae54-48c4db25f0d9 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:19.627918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fc53e1ca-2aab-4fc4-aeb5-96d23ce415f7 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:19.628549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08c8a7e9-83c5-409d-ae54-48c4db25f0d9 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:19.639265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc53e1ca-2aab-4fc4-aeb5-96d23ce415f7 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:19.639729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc53e1ca-2aab-4fc4-aeb5-96d23ce415f7 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:19.640526 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc53e1ca-2aab-4fc4-aeb5-96d23ce415f7 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:19.645370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc53e1ca-2aab-4fc4-aeb5-96d23ce415f7 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:19.812866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-08c8a7e9-83c5-409d-ae54-48c4db25f0d9 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:19.822846 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-08c8a7e9-83c5-409d-ae54-48c4db25f0d9 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 200 len: 1534 microversion: 2.1 time: 0.214708 May 27 15:06:19.835330 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1145/2211] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:19 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 1534 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:20.039268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-dc82f53b-df4a-4de1-b6e8-dedaa1dad395 req-2864c6e1-87fd-458d-8e2c-2536f4e3b314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad32218c-901a-44e3-92e3-5aeb695c4cc8", "name": "network-vif-deleted", "tag": "1d06f984-6b2c-4b79-8cfb-73890966fc2a"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:20.050126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-dc82f53b-df4a-4de1-b6e8-dedaa1dad395 req-2864c6e1-87fd-458d-8e2c-2536f4e3b314 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:20.051053 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-dc82f53b-df4a-4de1-b6e8-dedaa1dad395 req-2864c6e1-87fd-458d-8e2c-2536f4e3b314 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:20.062760 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fc53e1ca-2aab-4fc4-aeb5-96d23ce415f7 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:20.064145 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-dc82f53b-df4a-4de1-b6e8-dedaa1dad395 req-2864c6e1-87fd-458d-8e2c-2536f4e3b314 service nova] Creating event network-vif-deleted:1d06f984-6b2c-4b79-8cfb-73890966fc2a for instance ad32218c-901a-44e3-92e3-5aeb695c4cc8 on n-h1-843621-1 May 27 15:06:20.069551 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-dc82f53b-df4a-4de1-b6e8-dedaa1dad395 req-2864c6e1-87fd-458d-8e2c-2536f4e3b314 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034106 May 27 15:06:20.070790 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1146/2212] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:06:20.072906 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fc53e1ca-2aab-4fc4-aeb5-96d23ce415f7 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 200 len: 1316 microversion: 2.1 time: 0.451047 May 27 15:06:20.073596 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1067/2213] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:19 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 1316 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:20.294080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-71c1dafe-df45-4c0c-9b47-24614b9e13a8 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:20.296476 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-71c1dafe-df45-4c0c-9b47-24614b9e13a8 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:20.304014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-71c1dafe-df45-4c0c-9b47-24614b9e13a8 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:20.304474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-71c1dafe-df45-4c0c-9b47-24614b9e13a8 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:20.305876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-71c1dafe-df45-4c0c-9b47-24614b9e13a8 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:20.306562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-71c1dafe-df45-4c0c-9b47-24614b9e13a8 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:20.376982 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d820e1f1-a6a2-44cd-94c8-3ab6896c961b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:20.376982 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d820e1f1-a6a2-44cd-94c8-3ab6896c961b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:20.382298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d820e1f1-a6a2-44cd-94c8-3ab6896c961b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:20.382756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d820e1f1-a6a2-44cd-94c8-3ab6896c961b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:20.383542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d820e1f1-a6a2-44cd-94c8-3ab6896c961b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:20.384205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d820e1f1-a6a2-44cd-94c8-3ab6896c961b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:20.502953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d820e1f1-a6a2-44cd-94c8-3ab6896c961b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:20.513460 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d820e1f1-a6a2-44cd-94c8-3ab6896c961b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 200 len: 1293 microversion: 2.1 time: 0.142036 May 27 15:06:20.522854 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1068/2214] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:20 2022] GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 1293 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:20.584573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-71c1dafe-df45-4c0c-9b47-24614b9e13a8 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:20.593996 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-71c1dafe-df45-4c0c-9b47-24614b9e13a8 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.304677 May 27 15:06:20.595292 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1147/2215] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:20 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:20.600264 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ad87f289-ff1d-4984-b9d6-f4d86f27dc98 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:20.600927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ad87f289-ff1d-4984-b9d6-f4d86f27dc98 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:20.608900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad87f289-ff1d-4984-b9d6-f4d86f27dc98 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:20.609356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad87f289-ff1d-4984-b9d6-f4d86f27dc98 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:20.610495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad87f289-ff1d-4984-b9d6-f4d86f27dc98 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:20.610948 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad87f289-ff1d-4984-b9d6-f4d86f27dc98 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:20.702660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ad87f289-ff1d-4984-b9d6-f4d86f27dc98 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:20.712595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ad87f289-ff1d-4984-b9d6-f4d86f27dc98 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:20.714142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ad87f289-ff1d-4984-b9d6-f4d86f27dc98 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:20.715349 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ad87f289-ff1d-4984-b9d6-f4d86f27dc98 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1521 microversion: 2.25 time: 0.122131 May 27 15:06:20.721887 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1069/2216] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:20 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1521 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:06:20.842387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-188a327e-c3b8-4b95-a1a6-40a15582a5e7 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:20.843005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-188a327e-c3b8-4b95-a1a6-40a15582a5e7 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:20.850362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-188a327e-c3b8-4b95-a1a6-40a15582a5e7 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:20.850819 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-188a327e-c3b8-4b95-a1a6-40a15582a5e7 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:20.851598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-188a327e-c3b8-4b95-a1a6-40a15582a5e7 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:20.852038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-188a327e-c3b8-4b95-a1a6-40a15582a5e7 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:21.091086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-adbe7d3d-42da-44fd-861a-35a3623fac3c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:21.091884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-adbe7d3d-42da-44fd-861a-35a3623fac3c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:21.108180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-adbe7d3d-42da-44fd-861a-35a3623fac3c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:21.108588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-188a327e-c3b8-4b95-a1a6-40a15582a5e7 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:21.108782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-adbe7d3d-42da-44fd-861a-35a3623fac3c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:21.109568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-adbe7d3d-42da-44fd-861a-35a3623fac3c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:21.110028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-adbe7d3d-42da-44fd-861a-35a3623fac3c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:21.137756 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-188a327e-c3b8-4b95-a1a6-40a15582a5e7 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 200 len: 1521 microversion: 2.1 time: 0.299584 May 27 15:06:21.142538 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1148/2217] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:20 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:21.160479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4f192883-3af6-4da1-881e-7191e09cb2ef tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:21.161816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4f192883-3af6-4da1-881e-7191e09cb2ef tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:21.169991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4f192883-3af6-4da1-881e-7191e09cb2ef tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:21.170815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4f192883-3af6-4da1-881e-7191e09cb2ef tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:21.171716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4f192883-3af6-4da1-881e-7191e09cb2ef tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:21.172273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4f192883-3af6-4da1-881e-7191e09cb2ef tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:21.209302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4f192883-3af6-4da1-881e-7191e09cb2ef tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:06:21.291750 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4f192883-3af6-4da1-881e-7191e09cb2ef tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 204 len: 0 microversion: 2.1 time: 0.136047 May 27 15:06:21.295707 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1149/2218] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:06:21 2022] DELETE /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:06:21.305733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-49432867-96e8-4d48-bef9-5b1533b800eb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:21.306465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-49432867-96e8-4d48-bef9-5b1533b800eb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:21.313855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-49432867-96e8-4d48-bef9-5b1533b800eb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:21.314335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-49432867-96e8-4d48-bef9-5b1533b800eb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:21.315110 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-49432867-96e8-4d48-bef9-5b1533b800eb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:21.315564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-49432867-96e8-4d48-bef9-5b1533b800eb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:21.425046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-adbe7d3d-42da-44fd-861a-35a3623fac3c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:21.433272 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-adbe7d3d-42da-44fd-861a-35a3623fac3c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 200 len: 1316 microversion: 2.1 time: 0.347703 May 27 15:06:21.439215 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1070/2219] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:21 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 1316 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:21.494034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-49432867-96e8-4d48-bef9-5b1533b800eb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:21.503698 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-49432867-96e8-4d48-bef9-5b1533b800eb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 200 len: 1527 microversion: 2.1 time: 0.204861 May 27 15:06:21.504297 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1150/2220] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:21 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 1527 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:21.533005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7d3112f5-3616-4cab-b735-02d259bb67d5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:21.534193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7d3112f5-3616-4cab-b735-02d259bb67d5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:21.541287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d3112f5-3616-4cab-b735-02d259bb67d5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:21.541745 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d3112f5-3616-4cab-b735-02d259bb67d5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:21.542749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d3112f5-3616-4cab-b735-02d259bb67d5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:21.543194 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d3112f5-3616-4cab-b735-02d259bb67d5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:21.606723 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7d3112f5-3616-4cab-b735-02d259bb67d5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:21.611681 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-380f3139-4fdb-4f56-a5bf-57a3f7fd23bd tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:21.612795 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-380f3139-4fdb-4f56-a5bf-57a3f7fd23bd tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:21.615766 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7d3112f5-3616-4cab-b735-02d259bb67d5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 200 len: 1293 microversion: 2.1 time: 0.089016 May 27 15:06:21.616915 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1071/2221] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:21 2022] GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:21.629538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-380f3139-4fdb-4f56-a5bf-57a3f7fd23bd tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:21.630082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-380f3139-4fdb-4f56-a5bf-57a3f7fd23bd tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:21.630949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-380f3139-4fdb-4f56-a5bf-57a3f7fd23bd tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:21.631513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-380f3139-4fdb-4f56-a5bf-57a3f7fd23bd tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:21.734426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7fe9ee34-d461-4817-8e57-e3b508907446 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:21.735309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7fe9ee34-d461-4817-8e57-e3b508907446 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:21.742307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fe9ee34-d461-4817-8e57-e3b508907446 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:21.743037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fe9ee34-d461-4817-8e57-e3b508907446 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:21.744114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fe9ee34-d461-4817-8e57-e3b508907446 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:21.744750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fe9ee34-d461-4817-8e57-e3b508907446 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:21.783344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-380f3139-4fdb-4f56-a5bf-57a3f7fd23bd tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:21.786786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fe9ee34-d461-4817-8e57-e3b508907446 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:21.787563 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fe9ee34-d461-4817-8e57-e3b508907446 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:21.788207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-7fe9ee34-d461-4817-8e57-e3b508907446 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lazy-loading 'fault' on Instance uuid ad32218c-901a-44e3-92e3-5aeb695c4cc8 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:06:21.791317 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-380f3139-4fdb-4f56-a5bf-57a3f7fd23bd tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.183913 May 27 15:06:21.802372 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1151/2222] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:21 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:21.836040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7fe9ee34-d461-4817-8e57-e3b508907446 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:21.844833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7fe9ee34-d461-4817-8e57-e3b508907446 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:21.846651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7fe9ee34-d461-4817-8e57-e3b508907446 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4284d5f7a29045d18393bde2961a904b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbdeb12b89c475cba7fef0ab845dada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:21.848574 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7fe9ee34-d461-4817-8e57-e3b508907446 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 200 len: 1351 microversion: 2.25 time: 0.118540 May 27 15:06:21.849483 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1072/2223] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:21 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 1351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:06:22.342921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-726b19c8-aef6-4bc2-ab0c-77ebf12c5553 req-cafb6015-ab1d-409d-b181-79f1651c60e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332c261b-d7bd-44c6-9f15-31e825c440b6", "name": "network-vif-plugged", "status": "completed", "tag": "b97655f0-29fe-4e43-8737-f3775f6f744d"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:22.383324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-726b19c8-aef6-4bc2-ab0c-77ebf12c5553 req-cafb6015-ab1d-409d-b181-79f1651c60e5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:22.383789 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-726b19c8-aef6-4bc2-ab0c-77ebf12c5553 req-cafb6015-ab1d-409d-b181-79f1651c60e5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:22.399533 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-726b19c8-aef6-4bc2-ab0c-77ebf12c5553 req-cafb6015-ab1d-409d-b181-79f1651c60e5 service nova] Creating event network-vif-plugged:b97655f0-29fe-4e43-8737-f3775f6f744d for instance 332c261b-d7bd-44c6-9f15-31e825c440b6 on n-h1-843621-1 May 27 15:06:22.412008 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-726b19c8-aef6-4bc2-ab0c-77ebf12c5553 req-cafb6015-ab1d-409d-b181-79f1651c60e5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077645 May 27 15:06:22.413629 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1152/2224] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:22.466686 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cfe44b09-16ff-48ac-88c1-94addaaec2b4 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:22.468057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cfe44b09-16ff-48ac-88c1-94addaaec2b4 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:22.492912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfe44b09-16ff-48ac-88c1-94addaaec2b4 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:22.494840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfe44b09-16ff-48ac-88c1-94addaaec2b4 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:22.497098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfe44b09-16ff-48ac-88c1-94addaaec2b4 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:22.502140 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfe44b09-16ff-48ac-88c1-94addaaec2b4 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:22.522710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-68b0b0e6-eca6-4f94-a50d-9ef87c9a4af0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:22.523512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-68b0b0e6-eca6-4f94-a50d-9ef87c9a4af0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:22.551344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68b0b0e6-eca6-4f94-a50d-9ef87c9a4af0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:22.552576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68b0b0e6-eca6-4f94-a50d-9ef87c9a4af0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:22.553423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68b0b0e6-eca6-4f94-a50d-9ef87c9a4af0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:22.553864 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68b0b0e6-eca6-4f94-a50d-9ef87c9a4af0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:22.750627 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-68b0b0e6-eca6-4f94-a50d-9ef87c9a4af0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:22.751096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cfe44b09-16ff-48ac-88c1-94addaaec2b4 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:22.758561 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-68b0b0e6-eca6-4f94-a50d-9ef87c9a4af0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 200 len: 1527 microversion: 2.1 time: 0.241467 May 27 15:06:22.760847 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cfe44b09-16ff-48ac-88c1-94addaaec2b4 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 200 len: 1316 microversion: 2.1 time: 0.299836 May 27 15:06:22.761422 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1073/2225] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:22 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:22.768394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ef4863ed-6e40-4ea1-b308-26a13efdcd88 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:22.769330 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1153/2226] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:22 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 1527 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:22.770377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ef4863ed-6e40-4ea1-b308-26a13efdcd88 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:22.776434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef4863ed-6e40-4ea1-b308-26a13efdcd88 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:22.776927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef4863ed-6e40-4ea1-b308-26a13efdcd88 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:22.777697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef4863ed-6e40-4ea1-b308-26a13efdcd88 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:22.778137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef4863ed-6e40-4ea1-b308-26a13efdcd88 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:22.791321 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-ef4863ed-6e40-4ea1-b308-26a13efdcd88 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance c814849f-c8b5-44a6-9727-654fcc92437c could not be found. May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ef4863ed-6e40-4ea1-b308-26a13efdcd88 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c HTTP/1.1 May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance c814849f-c8b5-44a6-9727-654fcc92437c could not be found. May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'c814849f-c8b5-44a6-9727-654fcc92437c'} May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c814849f-c8b5-44a6-9727-654fcc92437c could not be found. May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c814849f-c8b5-44a6-9727-654fcc92437c could not be found. May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:22.792866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:22.797685 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:22.797685 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:22.797685 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:22.797685 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:22.797685 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:22.797685 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c814849f-c8b5-44a6-9727-654fcc92437c could not be found. May 27 15:06:22.797685 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:22.797685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ef4863ed-6e40-4ea1-b308-26a13efdcd88 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance c814849f-c8b5-44a6-9727-654fcc92437c could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:22.797685 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ef4863ed-6e40-4ea1-b308-26a13efdcd88 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 404 len: 111 microversion: 2.1 time: 0.031583 May 27 15:06:22.797685 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1074/2227] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:22 2022] GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:22.809568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b0b67675-04bc-4bff-8627-a7f9e95228af tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:22.811745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b0b67675-04bc-4bff-8627-a7f9e95228af tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:22.817428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b0b67675-04bc-4bff-8627-a7f9e95228af tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:22.817939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b0b67675-04bc-4bff-8627-a7f9e95228af tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:22.818782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b0b67675-04bc-4bff-8627-a7f9e95228af tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:22.819296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b0b67675-04bc-4bff-8627-a7f9e95228af tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:22.867243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3224a1ad-a91e-4f03-b2ff-d7d7ed865a58 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:22.867989 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3224a1ad-a91e-4f03-b2ff-d7d7ed865a58 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] [instance: ad32218c-901a-44e3-92e3-5aeb695c4cc8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:22.881747 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3224a1ad-a91e-4f03-b2ff-d7d7ed865a58 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:22.882346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3224a1ad-a91e-4f03-b2ff-d7d7ed865a58 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:22.883192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3224a1ad-a91e-4f03-b2ff-d7d7ed865a58 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:22.883719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3224a1ad-a91e-4f03-b2ff-d7d7ed865a58 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:22.909000 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-3224a1ad-a91e-4f03-b2ff-d7d7ed865a58 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] HTTP exception thrown: Instance ad32218c-901a-44e3-92e3-5aeb695c4cc8 could not be found. May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3224a1ad-a91e-4f03-b2ff-d7d7ed865a58 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Request method failure captured: May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 HTTP/1.1 May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikObeii5akAfuoQuqcBM5xu8qHmUXemdb7Xuwg6ZB45tBGHwoUarz3MzgSJWXoi-_nmwfzdzOYzRIfMfUXK9E8irjU9cq-KTuwmcJdVERJt53gIG4UQ10__sZia8bqXHintDMpqNycR2c9_yK0D4Z8IRS7Siv6uc9dNkL_reeUgmiXv0 May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-Openstack-Nova-Api-Version: 2.25 May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 0dbdeb12b89c475cba7fef0ab845dada May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2105219972 May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0dbdeb12b89c475cba7fef0ab845dada"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0dbdeb12b89c475cba7fef0ab845dada"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0dbdeb12b89c475cba7fef0ab845dada"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0dbdeb12b89c475cba7fef0ab845dada", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2105219972 May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 0dbdeb12b89c475cba7fef0ab845dada May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2105219972 May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-LiveAutoBlockMigrationV225Test-2105219972-project May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 4284d5f7a29045d18393bde2961a904b May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2105219972-project May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance ad32218c-901a-44e3-92e3-5aeb695c4cc8 could not be found. May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'ad32218c-901a-44e3-92e3-5aeb695c4cc8'} May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad32218c-901a-44e3-92e3-5aeb695c4cc8 could not be found. May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad32218c-901a-44e3-92e3-5aeb695c4cc8 could not be found. May 27 15:06:22.910680 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:22.920053 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:22.920053 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:22.920053 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:22.920053 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:22.920053 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:22.920053 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:22.920053 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:22.920053 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad32218c-901a-44e3-92e3-5aeb695c4cc8 could not be found. May 27 15:06:22.920053 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:22.920053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3224a1ad-a91e-4f03-b2ff-d7d7ed865a58 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] Returning 404 to user: Instance ad32218c-901a-44e3-92e3-5aeb695c4cc8 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:22.920053 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3224a1ad-a91e-4f03-b2ff-d7d7ed865a58 tempest-LiveAutoBlockMigrationV225Test-2105219972 tempest-LiveAutoBlockMigrationV225Test-2105219972-project] 10.222.0.13 "GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8" status: 404 len: 111 microversion: 2.25 time: 0.049427 May 27 15:06:22.920053 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1075/2228] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:22 2022] GET /compute/v2.1/servers/ad32218c-901a-44e3-92e3-5aeb695c4cc8 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 27 15:06:22.920053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1d6e0049-66d7-447d-8baa-6b05fdacd8f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-251111837", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "a400f266-0bb2-420b-8500-ad7b63a44ef7"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:22.933903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:22.985034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-1d6e0049-66d7-447d-8baa-6b05fdacd8f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] validate_networks() for [('a400f266-0bb2-420b-8500-ad7b63a44ef7', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:06:23.057059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b0b67675-04bc-4bff-8627-a7f9e95228af tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:23.065952 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b0b67675-04bc-4bff-8627-a7f9e95228af tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.260005 May 27 15:06:23.076282 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1154/2229] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:22 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:23.551553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-1d6e0049-66d7-447d-8baa-6b05fdacd8f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:06:23.552593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-1d6e0049-66d7-447d-8baa-6b05fdacd8f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:06:23.553122 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-1d6e0049-66d7-447d-8baa-6b05fdacd8f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:06:23.553576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-1d6e0049-66d7-447d-8baa-6b05fdacd8f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:06:23.554006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-1d6e0049-66d7-447d-8baa-6b05fdacd8f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:06:23.573046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d6e0049-66d7-447d-8baa-6b05fdacd8f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:23.573590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d6e0049-66d7-447d-8baa-6b05fdacd8f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:23.574459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d6e0049-66d7-447d-8baa-6b05fdacd8f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:23.574907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d6e0049-66d7-447d-8baa-6b05fdacd8f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:23.597501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-1d6e0049-66d7-447d-8baa-6b05fdacd8f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Getting quotas for project 37b5a0b0723a46c1b0755e824e32b776. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:06:23.603629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-1d6e0049-66d7-447d-8baa-6b05fdacd8f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Getting quotas for user 0536f4a5547545acaa06b6aad5d1fbe4 and project 37b5a0b0723a46c1b0755e824e32b776. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:06:23.618964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1d6e0049-66d7-447d-8baa-6b05fdacd8f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:06:23.621891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1d6e0049-66d7-447d-8baa-6b05fdacd8f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:06:23.680617 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1d6e0049-66d7-447d-8baa-6b05fdacd8f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765424 May 27 15:06:23.681959 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1076/2230] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:06:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:06:23.692731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-20843b23-bee4-44c9-acb0-e97752170dd8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:23.694277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-20843b23-bee4-44c9-acb0-e97752170dd8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:23.777804 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f5482ad2-9c4a-4d5e-8312-b540f0b801d1 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:23.778441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f5482ad2-9c4a-4d5e-8312-b540f0b801d1 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:23.789846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-20843b23-bee4-44c9-acb0-e97752170dd8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:23.795026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f5482ad2-9c4a-4d5e-8312-b540f0b801d1 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:23.795482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f5482ad2-9c4a-4d5e-8312-b540f0b801d1 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:23.796258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f5482ad2-9c4a-4d5e-8312-b540f0b801d1 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:23.796769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f5482ad2-9c4a-4d5e-8312-b540f0b801d1 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:23.803772 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-20843b23-bee4-44c9-acb0-e97752170dd8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 200 len: 1214 microversion: 2.1 time: 0.114776 May 27 15:06:23.810022 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1155/2231] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:23 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:23.815827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fd42dca1-77fe-4de1-a258-bfcf158aad02 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:23.816727 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fd42dca1-77fe-4de1-a258-bfcf158aad02 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:23.825119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd42dca1-77fe-4de1-a258-bfcf158aad02 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:23.826550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd42dca1-77fe-4de1-a258-bfcf158aad02 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:23.827808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd42dca1-77fe-4de1-a258-bfcf158aad02 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:23.829058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd42dca1-77fe-4de1-a258-bfcf158aad02 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:24.103700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fd42dca1-77fe-4de1-a258-bfcf158aad02 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:24.114015 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fd42dca1-77fe-4de1-a258-bfcf158aad02 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 200 len: 1527 microversion: 2.1 time: 0.302437 May 27 15:06:24.117104 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1156/2232] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:23 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 1527 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:24.299314 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-869178e6-8d7c-4d56-aab3-8e67ef58cac2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1218652227", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:24.376057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-869178e6-8d7c-4d56-aab3-8e67ef58cac2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] validate_networks() for None {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:06:24.508969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f5482ad2-9c4a-4d5e-8312-b540f0b801d1 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:24.535177 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f5482ad2-9c4a-4d5e-8312-b540f0b801d1 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 200 len: 1316 microversion: 2.1 time: 0.759470 May 27 15:06:24.545517 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1077/2233] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:23 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 1316 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:24.545517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d01e89ea-2a96-412b-91e2-05da05b2717a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:24.546827 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d01e89ea-2a96-412b-91e2-05da05b2717a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:24.553599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d01e89ea-2a96-412b-91e2-05da05b2717a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:24.555269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d01e89ea-2a96-412b-91e2-05da05b2717a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:24.556473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d01e89ea-2a96-412b-91e2-05da05b2717a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:24.557133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d01e89ea-2a96-412b-91e2-05da05b2717a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:24.884473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d01e89ea-2a96-412b-91e2-05da05b2717a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:24.893404 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d01e89ea-2a96-412b-91e2-05da05b2717a tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.355232 May 27 15:06:24.894173 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1078/2234] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:24 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:24.898857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-4814a9d4-1e65-4924-a495-01f4533f9ce8 req-eb570e27-f1e3-45e2-a025-83a2c8bcbe96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2719794f-cbe2-4bfa-a24f-18a461655423", "name": "network-vif-deleted", "tag": "23cd166c-ce87-4dd9-a78d-1b8bf7552a1e"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:24.907042 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4814a9d4-1e65-4924-a495-01f4533f9ce8 req-eb570e27-f1e3-45e2-a025-83a2c8bcbe96 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:24.907502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4814a9d4-1e65-4924-a495-01f4533f9ce8 req-eb570e27-f1e3-45e2-a025-83a2c8bcbe96 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:24.918502 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-4814a9d4-1e65-4924-a495-01f4533f9ce8 req-eb570e27-f1e3-45e2-a025-83a2c8bcbe96 service nova] Creating event network-vif-deleted:23cd166c-ce87-4dd9-a78d-1b8bf7552a1e for instance 2719794f-cbe2-4bfa-a24f-18a461655423 on n-h2-843621-1 May 27 15:06:24.923708 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-4814a9d4-1e65-4924-a495-01f4533f9ce8 req-eb570e27-f1e3-45e2-a025-83a2c8bcbe96 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028185 May 27 15:06:24.924294 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1079/2235] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:24.928501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-869178e6-8d7c-4d56-aab3-8e67ef58cac2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:06:24.929033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-869178e6-8d7c-4d56-aab3-8e67ef58cac2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:06:24.929444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-869178e6-8d7c-4d56-aab3-8e67ef58cac2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:06:24.929631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a78f06ea-dc1c-4ee7-ac14-341b17c2d158 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:24.930057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-869178e6-8d7c-4d56-aab3-8e67ef58cac2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:06:24.930329 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a78f06ea-dc1c-4ee7-ac14-341b17c2d158 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:24.930472 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-869178e6-8d7c-4d56-aab3-8e67ef58cac2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:06:24.937195 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a78f06ea-dc1c-4ee7-ac14-341b17c2d158 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:24.937527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a78f06ea-dc1c-4ee7-ac14-341b17c2d158 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:24.938298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a78f06ea-dc1c-4ee7-ac14-341b17c2d158 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:24.938743 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a78f06ea-dc1c-4ee7-ac14-341b17c2d158 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:24.941214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-869178e6-8d7c-4d56-aab3-8e67ef58cac2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:24.941387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-869178e6-8d7c-4d56-aab3-8e67ef58cac2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:24.942149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-869178e6-8d7c-4d56-aab3-8e67ef58cac2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:24.942588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-869178e6-8d7c-4d56-aab3-8e67ef58cac2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:24.962507 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-869178e6-8d7c-4d56-aab3-8e67ef58cac2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Getting quotas for project 1c24fcdf60ab4259b3a15b50336e6e22. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:06:24.968107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-869178e6-8d7c-4d56-aab3-8e67ef58cac2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Getting quotas for user d8920dea47a54142b7d376c36ea5ac52 and project 1c24fcdf60ab4259b3a15b50336e6e22. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:06:24.982605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-869178e6-8d7c-4d56-aab3-8e67ef58cac2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:06:24.984908 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-869178e6-8d7c-4d56-aab3-8e67ef58cac2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:06:25.035690 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-869178e6-8d7c-4d56-aab3-8e67ef58cac2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.916921 May 27 15:06:25.036507 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1157/2236] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:06:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:06:25.047989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-50e4c29d-dab1-43b0-a1f6-4368cbf44fa2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:25.048617 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-50e4c29d-dab1-43b0-a1f6-4368cbf44fa2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:25.057242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a78f06ea-dc1c-4ee7-ac14-341b17c2d158 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:25.069180 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a78f06ea-dc1c-4ee7-ac14-341b17c2d158 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 200 len: 1266 microversion: 2.1 time: 0.141466 May 27 15:06:25.072469 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1080/2237] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:24 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:25.108352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-50e4c29d-dab1-43b0-a1f6-4368cbf44fa2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8920dea47a54142b7d376c36ea5ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c24fcdf60ab4259b3a15b50336e6e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:25.121391 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-50e4c29d-dab1-43b0-a1f6-4368cbf44fa2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 200 len: 1216 microversion: 2.1 time: 0.078765 May 27 15:06:25.128466 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1158/2238] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:25 2022] GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 1216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:25.133649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-16e1a35f-b2c8-44f8-92cf-62657de5b2be tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:25.134389 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-16e1a35f-b2c8-44f8-92cf-62657de5b2be tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:25.143161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16e1a35f-b2c8-44f8-92cf-62657de5b2be tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:25.147181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16e1a35f-b2c8-44f8-92cf-62657de5b2be tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:25.148035 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16e1a35f-b2c8-44f8-92cf-62657de5b2be tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:25.148637 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16e1a35f-b2c8-44f8-92cf-62657de5b2be tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:25.191221 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16e1a35f-b2c8-44f8-92cf-62657de5b2be tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:25.191994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16e1a35f-b2c8-44f8-92cf-62657de5b2be tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:25.192724 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-16e1a35f-b2c8-44f8-92cf-62657de5b2be tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lazy-loading 'fault' on Instance uuid 2719794f-cbe2-4bfa-a24f-18a461655423 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:06:25.264483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-16e1a35f-b2c8-44f8-92cf-62657de5b2be tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:25.275882 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-16e1a35f-b2c8-44f8-92cf-62657de5b2be tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 200 len: 1314 microversion: 2.1 time: 0.145698 May 27 15:06:25.287878 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1081/2239] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:25 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:25.558173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-14ad2ede-d927-4d16-aed7-278577be5018 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:25.561711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-14ad2ede-d927-4d16-aed7-278577be5018 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:25.580379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-14ad2ede-d927-4d16-aed7-278577be5018 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:25.581352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-14ad2ede-d927-4d16-aed7-278577be5018 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:25.582994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-14ad2ede-d927-4d16-aed7-278577be5018 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:25.583937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-14ad2ede-d927-4d16-aed7-278577be5018 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:25.866024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-14ad2ede-d927-4d16-aed7-278577be5018 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:25.893393 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-14ad2ede-d927-4d16-aed7-278577be5018 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 200 len: 1504 microversion: 2.1 time: 0.342157 May 27 15:06:25.928291 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1159/2240] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:25 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 1504 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:25.933123 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1f527be2-a432-46fd-a783-0b626507325d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:25.934552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1f527be2-a432-46fd-a783-0b626507325d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:25.946916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f527be2-a432-46fd-a783-0b626507325d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:25.947681 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f527be2-a432-46fd-a783-0b626507325d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:25.948515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8e9957cb-f5d4-48df-8dc8-afc9516fb0e0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-380914542"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:25.949448 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8e9957cb-f5d4-48df-8dc8-afc9516fb0e0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:25.949924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f527be2-a432-46fd-a783-0b626507325d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:25.950668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f527be2-a432-46fd-a783-0b626507325d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:25.971103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e9957cb-f5d4-48df-8dc8-afc9516fb0e0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:25.971568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e9957cb-f5d4-48df-8dc8-afc9516fb0e0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:25.972381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e9957cb-f5d4-48df-8dc8-afc9516fb0e0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:25.972861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e9957cb-f5d4-48df-8dc8-afc9516fb0e0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:25.980793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:26.321210 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1f527be2-a432-46fd-a783-0b626507325d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:26.335512 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1f527be2-a432-46fd-a783-0b626507325d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.415375 May 27 15:06:26.337008 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1082/2241] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:25 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:26.343736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f849924f-dce0-4f02-8c33-a09cef7ca966 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:26.344615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f849924f-dce0-4f02-8c33-a09cef7ca966 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:26.352240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f849924f-dce0-4f02-8c33-a09cef7ca966 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:26.352846 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.network.security_group_api [None req-8e9957cb-f5d4-48df-8dc8-afc9516fb0e0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Adding security group 974b4234-ca2d-4063-aeb7-8456733bbc9b to port b97655f0-29fe-4e43-8737-f3775f6f744d May 27 15:06:26.353122 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f849924f-dce0-4f02-8c33-a09cef7ca966 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:26.354051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f849924f-dce0-4f02-8c33-a09cef7ca966 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:26.354642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f849924f-dce0-4f02-8c33-a09cef7ca966 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:26.471093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f849924f-dce0-4f02-8c33-a09cef7ca966 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:26.487758 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f849924f-dce0-4f02-8c33-a09cef7ca966 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 200 len: 1272 microversion: 2.1 time: 0.149404 May 27 15:06:26.488733 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1083/2242] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:26 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 1272 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:26.493840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a873ef89-7100-431f-a5d4-60b3429c2119 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:26.494768 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a873ef89-7100-431f-a5d4-60b3429c2119 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:26.502036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a873ef89-7100-431f-a5d4-60b3429c2119 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:26.502497 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a873ef89-7100-431f-a5d4-60b3429c2119 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:26.503298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a873ef89-7100-431f-a5d4-60b3429c2119 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:26.503986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a873ef89-7100-431f-a5d4-60b3429c2119 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:26.598560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a873ef89-7100-431f-a5d4-60b3429c2119 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8920dea47a54142b7d376c36ea5ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c24fcdf60ab4259b3a15b50336e6e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:26.615418 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a873ef89-7100-431f-a5d4-60b3429c2119 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 200 len: 1274 microversion: 2.1 time: 0.124955 May 27 15:06:26.626904 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1084/2243] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:26 2022] GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 1274 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:26.632721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-32eae876-cc11-4700-a6c7-f367f896f79c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:26.644870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-32eae876-cc11-4700-a6c7-f367f896f79c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:26.655088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32eae876-cc11-4700-a6c7-f367f896f79c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:26.660772 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32eae876-cc11-4700-a6c7-f367f896f79c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:26.662130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32eae876-cc11-4700-a6c7-f367f896f79c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:26.662792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32eae876-cc11-4700-a6c7-f367f896f79c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:26.696635 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-32eae876-cc11-4700-a6c7-f367f896f79c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] HTTP exception thrown: Instance 2719794f-cbe2-4bfa-a24f-18a461655423 could not be found. May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-32eae876-cc11-4700-a6c7-f367f896f79c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Request method failure captured: May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 HTTP/1.1 May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOimLUy6xqp-gD8lGFWAUihJRQaSsy_euXND3kG660I8aII4Fj7ST5KLuaskP9b7InGbbwTAnVT5MT1H-Njofjk92SIoSVXWmihhyVdCbe--Q04_qmor9yl_DFjMNoGrjAWoGuMhIp_HpJ221pj4licupaHrWSVP-C-ksMH4M8HOkGM May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b939a1a277f248fdaad387a445a9e780", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: d3cb6de543d34fed9b582f5af0712790 May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 2719794f-cbe2-4bfa-a24f-18a461655423 could not be found. May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '2719794f-cbe2-4bfa-a24f-18a461655423'} May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2719794f-cbe2-4bfa-a24f-18a461655423 could not be found. May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2719794f-cbe2-4bfa-a24f-18a461655423 could not be found. May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:26.700616 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:26.710865 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:26.710865 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:26.710865 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:26.710865 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:26.710865 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:26.710865 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:26.710865 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2719794f-cbe2-4bfa-a24f-18a461655423 could not be found. May 27 15:06:26.710865 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:26.713365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-32eae876-cc11-4700-a6c7-f367f896f79c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Returning 404 to user: Instance 2719794f-cbe2-4bfa-a24f-18a461655423 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:26.715129 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-32eae876-cc11-4700-a6c7-f367f896f79c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 404 len: 111 microversion: 2.1 time: 0.086564 May 27 15:06:26.716226 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1085/2244] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:26 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:26.853438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5e5e3497-2a65-47fc-804d-2c32886b2098 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1726831975", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:26.933105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-5e5e3497-2a65-47fc-804d-2c32886b2098 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] validate_networks() for [('c12cba1c-fb03-4426-9903-a7c919b09dde', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:06:27.406651 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8e9957cb-f5d4-48df-8dc8-afc9516fb0e0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "POST /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6/action" status: 202 len: 0 microversion: 2.1 time: 1.474383 May 27 15:06:27.412106 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1160/2245] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:06:25 2022] POST /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6/action => generated 0 bytes in 1479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:06:27.413630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-963b18f6-f52f-4a01-94e6-a3669fabe846 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:27.414546 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-963b18f6-f52f-4a01-94e6-a3669fabe846 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:27.445575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-963b18f6-f52f-4a01-94e6-a3669fabe846 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:27.446966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-963b18f6-f52f-4a01-94e6-a3669fabe846 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:27.452647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-963b18f6-f52f-4a01-94e6-a3669fabe846 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:27.456255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-963b18f6-f52f-4a01-94e6-a3669fabe846 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:27.988490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-5e5e3497-2a65-47fc-804d-2c32886b2098 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:06:27.989092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-5e5e3497-2a65-47fc-804d-2c32886b2098 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:06:27.989317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-5e5e3497-2a65-47fc-804d-2c32886b2098 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:06:27.990052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-5e5e3497-2a65-47fc-804d-2c32886b2098 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:06:27.990894 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-5e5e3497-2a65-47fc-804d-2c32886b2098 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:06:28.005916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e5e3497-2a65-47fc-804d-2c32886b2098 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:28.006679 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e5e3497-2a65-47fc-804d-2c32886b2098 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:28.007685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e5e3497-2a65-47fc-804d-2c32886b2098 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:28.008312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e5e3497-2a65-47fc-804d-2c32886b2098 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:28.029406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-5e5e3497-2a65-47fc-804d-2c32886b2098 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Getting quotas for project b939a1a277f248fdaad387a445a9e780. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:06:28.035800 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-5e5e3497-2a65-47fc-804d-2c32886b2098 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Getting quotas for user d3cb6de543d34fed9b582f5af0712790 and project b939a1a277f248fdaad387a445a9e780. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:06:28.052155 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5e5e3497-2a65-47fc-804d-2c32886b2098 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:06:28.055012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5e5e3497-2a65-47fc-804d-2c32886b2098 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: b9907dbd-e85c-4b26-b80c-35d28319b5f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:06:28.122884 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5e5e3497-2a65-47fc-804d-2c32886b2098 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.275902 May 27 15:06:28.124536 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1086/2246] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:06:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:06:28.130088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-665e3500-6e00-4062-80b7-93abafcd9976 req-f614f010-c913-47f0-ba8f-23fd08de7527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "332c261b-d7bd-44c6-9f15-31e825c440b6", "tag": "b97655f0-29fe-4e43-8737-f3775f6f744d"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:28.143114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-665e3500-6e00-4062-80b7-93abafcd9976 req-f614f010-c913-47f0-ba8f-23fd08de7527 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:28.143927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-665e3500-6e00-4062-80b7-93abafcd9976 req-f614f010-c913-47f0-ba8f-23fd08de7527 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:28.158310 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-665e3500-6e00-4062-80b7-93abafcd9976 req-f614f010-c913-47f0-ba8f-23fd08de7527 service nova] Creating event network-changed:b97655f0-29fe-4e43-8737-f3775f6f744d for instance 332c261b-d7bd-44c6-9f15-31e825c440b6 on n-h1-843621-1 May 27 15:06:28.166159 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-665e3500-6e00-4062-80b7-93abafcd9976 req-f614f010-c913-47f0-ba8f-23fd08de7527 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039894 May 27 15:06:28.167985 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1087/2247] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:28.175857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-90eab828-cebe-49b1-97a4-fc7010aca5d5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc78066d550>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:28.192173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-963b18f6-f52f-4a01-94e6-a3669fabe846 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:28.208160 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-963b18f6-f52f-4a01-94e6-a3669fabe846 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.798933 May 27 15:06:28.216632 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1161/2248] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:27 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:28.231573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1e02a7cc-08cf-4413-afcb-45cffe63624e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:28.233255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1e02a7cc-08cf-4413-afcb-45cffe63624e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:28.250325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e02a7cc-08cf-4413-afcb-45cffe63624e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:28.252104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e02a7cc-08cf-4413-afcb-45cffe63624e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:28.257978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e02a7cc-08cf-4413-afcb-45cffe63624e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:28.258454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e02a7cc-08cf-4413-afcb-45cffe63624e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:28.457451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG neutronclient.v2_0.client [None req-90eab828-cebe-49b1-97a4-fc7010aca5d5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 974b4234-ca2d-4063-aeb7-8456733bbc9b in use.", "detail": ""}} {{(pid=119249) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:06:28.458153 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-90eab828-cebe-49b1-97a4-fc7010aca5d5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] HTTP exception thrown: Security Group 974b4234-ca2d-4063-aeb7-8456733bbc9b in use. May 27 15:06:28.458153 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-1c8b2b78-1d46-4ec2-ad0b-80c321df75fb'] May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-90eab828-cebe-49b1-97a4-fc7010aca5d5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Request method failure captured: May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/os-security-groups/974b4234-ca2d-4063-aeb7-8456733bbc9b HTTP/1.1 May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOioXW1g9zfFJmrjFPUtqf1JkPOhTiGh0dQbrGTQeVBiQ2YItsGoLEVL7FPVNVHWC47EYq5bcE4MxdYNeFr1n8wrvdpg-P9YwTSrmg95hClAZskxttqGgB6RuHmw6OrmsxIPwgD27GZbwc2vNj9QfnR_dJ1A7Lc434AgecYE4my0CB4 May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4b76a0ca994471bc3d779e67ad7bd8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 7a3bafe047b746dfb54a6d795292c0c0 May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: exception: Security Group 974b4234-ca2d-4063-aeb7-8456733bbc9b in use. May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-1c8b2b78-1d46-4ec2-ad0b-80c321df75fb'] May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '974b4234-ca2d-4063-aeb7-8456733bbc9b'} May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:06:28.460246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 974b4234-ca2d-4063-aeb7-8456733bbc9b in use. May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c8b2b78-1d46-4ec2-ad0b-80c321df75fb'] May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 974b4234-ca2d-4063-aeb7-8456733bbc9b in use. May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c8b2b78-1d46-4ec2-ad0b-80c321df75fb'] May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 974b4234-ca2d-4063-aeb7-8456733bbc9b in use. May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c8b2b78-1d46-4ec2-ad0b-80c321df75fb'] May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 974b4234-ca2d-4063-aeb7-8456733bbc9b in use. May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c8b2b78-1d46-4ec2-ad0b-80c321df75fb'] May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-90eab828-cebe-49b1-97a4-fc7010aca5d5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Returning 400 to user: Security Group 974b4234-ca2d-4063-aeb7-8456733bbc9b in use. May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-1c8b2b78-1d46-4ec2-ad0b-80c321df75fb'] {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-90eab828-cebe-49b1-97a4-fc7010aca5d5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/974b4234-ca2d-4063-aeb7-8456733bbc9b" status: 400 len: 185 microversion: 2.1 time: 0.292374 May 27 15:06:28.467480 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1088/2249] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:06:28 2022] DELETE /compute/v2.1/os-security-groups/974b4234-ca2d-4063-aeb7-8456733bbc9b => generated 185 bytes in 294 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:06:28.476119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-945c5885-343d-4284-85e3-72b63347c5b2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:28.476119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-945c5885-343d-4284-85e3-72b63347c5b2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:28.488621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-945c5885-343d-4284-85e3-72b63347c5b2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:28.489777 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-945c5885-343d-4284-85e3-72b63347c5b2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:28.490872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-945c5885-343d-4284-85e3-72b63347c5b2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:28.491324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-945c5885-343d-4284-85e3-72b63347c5b2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:28.760502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1e02a7cc-08cf-4413-afcb-45cffe63624e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:28.770850 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1e02a7cc-08cf-4413-afcb-45cffe63624e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 200 len: 1314 microversion: 2.1 time: 0.552670 May 27 15:06:28.772087 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1162/2250] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:28 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:28.777581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5c75462a-3c5b-44fd-a903-a52e5ef02d08 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:28.778407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5c75462a-3c5b-44fd-a903-a52e5ef02d08 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: b9907dbd-e85c-4b26-b80c-35d28319b5f3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:28.786721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c75462a-3c5b-44fd-a903-a52e5ef02d08 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:28.789161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c75462a-3c5b-44fd-a903-a52e5ef02d08 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:28.790382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c75462a-3c5b-44fd-a903-a52e5ef02d08 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:28.791445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c75462a-3c5b-44fd-a903-a52e5ef02d08 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:28.841155 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:28.975998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-945c5885-343d-4284-85e3-72b63347c5b2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8920dea47a54142b7d376c36ea5ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c24fcdf60ab4259b3a15b50336e6e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:29.002616 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-945c5885-343d-4284-85e3-72b63347c5b2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 200 len: 1316 microversion: 2.1 time: 0.536335 May 27 15:06:29.004095 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1089/2251] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:28 2022] GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 1316 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:29.015455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d5447534-5c07-41ea-a5df-d8ed69e3ceb5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:29.016430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d5447534-5c07-41ea-a5df-d8ed69e3ceb5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:29.023473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d5447534-5c07-41ea-a5df-d8ed69e3ceb5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:29.023932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d5447534-5c07-41ea-a5df-d8ed69e3ceb5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:29.024767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d5447534-5c07-41ea-a5df-d8ed69e3ceb5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:29.025416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d5447534-5c07-41ea-a5df-d8ed69e3ceb5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:29.036207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5c75462a-3c5b-44fd-a903-a52e5ef02d08 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:29.054071 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5c75462a-3c5b-44fd-a903-a52e5ef02d08 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3" status: 200 len: 1229 microversion: 2.1 time: 0.280365 May 27 15:06:29.057242 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1163/2252] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:28 2022] GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3 => generated 1229 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:29.179145 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d5447534-5c07-41ea-a5df-d8ed69e3ceb5 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "POST /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6/action" status: 202 len: 0 microversion: 2.1 time: 0.167233 May 27 15:06:29.180377 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1090/2253] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:06:29 2022] POST /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:06:29.195159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-05aa5d32-289c-40d3-87af-65a38b98042c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:29.199437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-05aa5d32-289c-40d3-87af-65a38b98042c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:29.214117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05aa5d32-289c-40d3-87af-65a38b98042c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:29.215466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05aa5d32-289c-40d3-87af-65a38b98042c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:29.217604 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05aa5d32-289c-40d3-87af-65a38b98042c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:29.218895 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05aa5d32-289c-40d3-87af-65a38b98042c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:29.235964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ae34146c-e130-46b9-a4b4-4aa7aa4d4608 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:29.238006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ae34146c-e130-46b9-a4b4-4aa7aa4d4608 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:29.261345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae34146c-e130-46b9-a4b4-4aa7aa4d4608 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:29.267984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae34146c-e130-46b9-a4b4-4aa7aa4d4608 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:29.270062 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae34146c-e130-46b9-a4b4-4aa7aa4d4608 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:29.270809 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae34146c-e130-46b9-a4b4-4aa7aa4d4608 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:29.971503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ae34146c-e130-46b9-a4b4-4aa7aa4d4608 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:29.981572 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ae34146c-e130-46b9-a4b4-4aa7aa4d4608 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.753083 May 27 15:06:29.982873 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1091/2254] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:29 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:29.991681 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-05aa5d32-289c-40d3-87af-65a38b98042c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:30.001783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-44597533-6258-4c7c-9208-d33b06392dc0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:30.002427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-44597533-6258-4c7c-9208-d33b06392dc0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:30.010064 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-05aa5d32-289c-40d3-87af-65a38b98042c tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 200 len: 1574 microversion: 2.1 time: 0.822318 May 27 15:06:30.013334 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1164/2255] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:29 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 1574 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:30.014349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44597533-6258-4c7c-9208-d33b06392dc0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:30.015208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44597533-6258-4c7c-9208-d33b06392dc0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:30.016665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44597533-6258-4c7c-9208-d33b06392dc0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:30.017634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44597533-6258-4c7c-9208-d33b06392dc0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:30.028779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-430e06cd-1742-405c-981d-ce0f8665117f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:30.030891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-430e06cd-1742-405c-981d-ce0f8665117f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:30.043512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-430e06cd-1742-405c-981d-ce0f8665117f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:30.045653 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-430e06cd-1742-405c-981d-ce0f8665117f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:30.047960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-430e06cd-1742-405c-981d-ce0f8665117f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:30.049117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-430e06cd-1742-405c-981d-ce0f8665117f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:30.401549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-44597533-6258-4c7c-9208-d33b06392dc0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:30.412158 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-44597533-6258-4c7c-9208-d33b06392dc0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 200 len: 1314 microversion: 2.1 time: 0.427807 May 27 15:06:30.414616 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1092/2256] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:29 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:30.423560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5b7cc2a6-ec35-4134-a209-a4d4a9898b04 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:30.424851 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5b7cc2a6-ec35-4134-a209-a4d4a9898b04 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: b9907dbd-e85c-4b26-b80c-35d28319b5f3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:30.431914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5b7cc2a6-ec35-4134-a209-a4d4a9898b04 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:30.431914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5b7cc2a6-ec35-4134-a209-a4d4a9898b04 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:30.432638 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5b7cc2a6-ec35-4134-a209-a4d4a9898b04 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:30.433110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5b7cc2a6-ec35-4134-a209-a4d4a9898b04 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:30.457650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-430e06cd-1742-405c-981d-ce0f8665117f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8920dea47a54142b7d376c36ea5ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c24fcdf60ab4259b3a15b50336e6e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:30.467278 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-430e06cd-1742-405c-981d-ce0f8665117f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 200 len: 1316 microversion: 2.1 time: 0.446953 May 27 15:06:30.468485 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1165/2257] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:30 2022] GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 1316 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:30.474294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-9586b622-90ee-498a-8d88-401c717136af req-68bb244a-f331-481a-b2d0-bc7a1843f83d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb464b82-c037-489f-a0ee-4008ea19886b", "tag": "0c5e77ff-3945-4734-9d97-8d6e127cdd38"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:30.491720 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9586b622-90ee-498a-8d88-401c717136af req-68bb244a-f331-481a-b2d0-bc7a1843f83d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:30.492453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9586b622-90ee-498a-8d88-401c717136af req-68bb244a-f331-481a-b2d0-bc7a1843f83d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:30.537241 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-9586b622-90ee-498a-8d88-401c717136af req-68bb244a-f331-481a-b2d0-bc7a1843f83d service nova] Creating event network-changed:0c5e77ff-3945-4734-9d97-8d6e127cdd38 for instance fb464b82-c037-489f-a0ee-4008ea19886b on n-h2-843621-1 May 27 15:06:30.544654 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-9586b622-90ee-498a-8d88-401c717136af req-68bb244a-f331-481a-b2d0-bc7a1843f83d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074663 May 27 15:06:30.545294 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1166/2258] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:30.550927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5b7cc2a6-ec35-4134-a209-a4d4a9898b04 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:30.551305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-2ee58152-4d5c-4a96-a028-0cb64f8d755a req-71e7a162-4785-4765-92c2-5748a58ed969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "841712c3-20ca-42ed-9c1f-22b88de952b6", "tag": "13825ca0-6a05-4ba6-a741-69e4ddf343f1"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:30.560468 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5b7cc2a6-ec35-4134-a209-a4d4a9898b04 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3" status: 200 len: 1283 microversion: 2.1 time: 0.141490 May 27 15:06:30.561108 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1093/2259] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:30 2022] GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3 => generated 1283 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:30.566236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2ee58152-4d5c-4a96-a028-0cb64f8d755a req-71e7a162-4785-4765-92c2-5748a58ed969 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:30.568142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2ee58152-4d5c-4a96-a028-0cb64f8d755a req-71e7a162-4785-4765-92c2-5748a58ed969 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:30.584485 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-2ee58152-4d5c-4a96-a028-0cb64f8d755a req-71e7a162-4785-4765-92c2-5748a58ed969 service nova] Creating event network-changed:13825ca0-6a05-4ba6-a741-69e4ddf343f1 for instance 841712c3-20ca-42ed-9c1f-22b88de952b6 on n-h2-843621-1 May 27 15:06:30.589525 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-2ee58152-4d5c-4a96-a028-0cb64f8d755a req-71e7a162-4785-4765-92c2-5748a58ed969 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042682 May 27 15:06:30.590465 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1167/2260] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:31.001067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-785f9292-ef35-4d3a-8ef9-8c31a282d86f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:31.002275 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-785f9292-ef35-4d3a-8ef9-8c31a282d86f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:31.009623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-785f9292-ef35-4d3a-8ef9-8c31a282d86f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:31.010397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-785f9292-ef35-4d3a-8ef9-8c31a282d86f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:31.011298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-785f9292-ef35-4d3a-8ef9-8c31a282d86f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:31.011771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-785f9292-ef35-4d3a-8ef9-8c31a282d86f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:31.035702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2ab05a30-9071-4f8a-97fe-6889637e8040 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:31.037742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2ab05a30-9071-4f8a-97fe-6889637e8040 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:31.045728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ab05a30-9071-4f8a-97fe-6889637e8040 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:31.046589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ab05a30-9071-4f8a-97fe-6889637e8040 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:31.047637 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ab05a30-9071-4f8a-97fe-6889637e8040 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:31.048247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ab05a30-9071-4f8a-97fe-6889637e8040 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:31.229287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-785f9292-ef35-4d3a-8ef9-8c31a282d86f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:31.238670 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-785f9292-ef35-4d3a-8ef9-8c31a282d86f tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.242556 May 27 15:06:31.251659 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1094/2261] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:30 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:31.285656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2ab05a30-9071-4f8a-97fe-6889637e8040 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:31.299870 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2ab05a30-9071-4f8a-97fe-6889637e8040 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 200 len: 1574 microversion: 2.1 time: 0.270428 May 27 15:06:31.301681 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1168/2262] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:31 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 1574 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:31.432354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cc031065-7315-418b-9928-9a8000ea0af3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:31.433030 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cc031065-7315-418b-9928-9a8000ea0af3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:31.441596 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc031065-7315-418b-9928-9a8000ea0af3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:31.442124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc031065-7315-418b-9928-9a8000ea0af3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:31.445782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc031065-7315-418b-9928-9a8000ea0af3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:31.445782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc031065-7315-418b-9928-9a8000ea0af3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:31.486610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4094d686-f82e-419f-94dd-2c5bc2d61592 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:31.487297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4094d686-f82e-419f-94dd-2c5bc2d61592 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:31.498611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4094d686-f82e-419f-94dd-2c5bc2d61592 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:31.499399 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4094d686-f82e-419f-94dd-2c5bc2d61592 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:31.500386 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4094d686-f82e-419f-94dd-2c5bc2d61592 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:31.500855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4094d686-f82e-419f-94dd-2c5bc2d61592 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:31.672476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cc031065-7315-418b-9928-9a8000ea0af3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:31.680887 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cc031065-7315-418b-9928-9a8000ea0af3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 200 len: 1314 microversion: 2.1 time: 0.252440 May 27 15:06:31.690216 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1095/2263] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:31 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:31.692435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4094d686-f82e-419f-94dd-2c5bc2d61592 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8920dea47a54142b7d376c36ea5ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c24fcdf60ab4259b3a15b50336e6e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:31.695433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b6cba44a-ae18-4a2b-abd2-3f7b46d58a35 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:31.696057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b6cba44a-ae18-4a2b-abd2-3f7b46d58a35 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: b9907dbd-e85c-4b26-b80c-35d28319b5f3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:31.702529 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4094d686-f82e-419f-94dd-2c5bc2d61592 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 200 len: 1316 microversion: 2.1 time: 0.221682 May 27 15:06:31.703359 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1169/2264] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:31 2022] GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:31.704763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b6cba44a-ae18-4a2b-abd2-3f7b46d58a35 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:31.705469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b6cba44a-ae18-4a2b-abd2-3f7b46d58a35 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:31.706500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b6cba44a-ae18-4a2b-abd2-3f7b46d58a35 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:31.707069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b6cba44a-ae18-4a2b-abd2-3f7b46d58a35 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:32.010802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b6cba44a-ae18-4a2b-abd2-3f7b46d58a35 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:32.026235 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b6cba44a-ae18-4a2b-abd2-3f7b46d58a35 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3" status: 200 len: 1325 microversion: 2.1 time: 0.334434 May 27 15:06:32.027545 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1096/2265] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:31 2022] GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3 => generated 1325 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:32.261913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8921a5fd-725f-4927-9e55-7bb150ffd32c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:32.262857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8921a5fd-725f-4927-9e55-7bb150ffd32c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:32.271261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8921a5fd-725f-4927-9e55-7bb150ffd32c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:32.271719 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8921a5fd-725f-4927-9e55-7bb150ffd32c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:32.272790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8921a5fd-725f-4927-9e55-7bb150ffd32c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:32.273410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8921a5fd-725f-4927-9e55-7bb150ffd32c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:32.317690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f270c924-7b8d-456b-9d50-df538526bc47 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:32.318466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f270c924-7b8d-456b-9d50-df538526bc47 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:32.325064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f270c924-7b8d-456b-9d50-df538526bc47 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:32.326525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f270c924-7b8d-456b-9d50-df538526bc47 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:32.327507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f270c924-7b8d-456b-9d50-df538526bc47 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:32.328057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f270c924-7b8d-456b-9d50-df538526bc47 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:32.553999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8921a5fd-725f-4927-9e55-7bb150ffd32c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:32.584697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f270c924-7b8d-456b-9d50-df538526bc47 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:32.585123 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8921a5fd-725f-4927-9e55-7bb150ffd32c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.324987 May 27 15:06:32.585123 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1170/2266] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:32 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:32.600713 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f270c924-7b8d-456b-9d50-df538526bc47 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 200 len: 1572 microversion: 2.1 time: 0.286892 May 27 15:06:32.605806 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1097/2267] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:32 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 1572 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:32.620987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ab4e1c11-9a6a-4004-86db-b6b3e5f308ae tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1406743529"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:32.621579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ab4e1c11-9a6a-4004-86db-b6b3e5f308ae tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:32.631754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab4e1c11-9a6a-4004-86db-b6b3e5f308ae tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:32.631754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab4e1c11-9a6a-4004-86db-b6b3e5f308ae tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:32.632485 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab4e1c11-9a6a-4004-86db-b6b3e5f308ae tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:32.633005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab4e1c11-9a6a-4004-86db-b6b3e5f308ae tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:32.682277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-27450c23-360b-4db9-aed5-46ef020435ba req-0133c676-a245-43ed-94ec-f19444ad8c17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9907dbd-e85c-4b26-b80c-35d28319b5f3", "tag": "53ba122e-6340-4681-a6f0-3313425f9c72"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:32.696843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-27450c23-360b-4db9-aed5-46ef020435ba req-0133c676-a245-43ed-94ec-f19444ad8c17 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:32.699513 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-27450c23-360b-4db9-aed5-46ef020435ba req-0133c676-a245-43ed-94ec-f19444ad8c17 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:32.730282 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-27450c23-360b-4db9-aed5-46ef020435ba req-0133c676-a245-43ed-94ec-f19444ad8c17 service nova] Creating event network-changed:53ba122e-6340-4681-a6f0-3313425f9c72 for instance b9907dbd-e85c-4b26-b80c-35d28319b5f3 on n-h2-843621-1 May 27 15:06:32.740986 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-27450c23-360b-4db9-aed5-46ef020435ba req-0133c676-a245-43ed-94ec-f19444ad8c17 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062105 May 27 15:06:32.741997 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1098/2268] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:32.748863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-713b666b-1b63-416a-87a9-78d8636c40b8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:32.749796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-713b666b-1b63-416a-87a9-78d8636c40b8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:32.756371 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-713b666b-1b63-416a-87a9-78d8636c40b8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:32.756878 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-713b666b-1b63-416a-87a9-78d8636c40b8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:32.757674 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-713b666b-1b63-416a-87a9-78d8636c40b8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:32.758118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-713b666b-1b63-416a-87a9-78d8636c40b8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:32.863103 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.network.security_group_api [None req-ab4e1c11-9a6a-4004-86db-b6b3e5f308ae tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Adding security group 646e93e5-b6e0-429a-8743-17f3594008be to port b97655f0-29fe-4e43-8737-f3775f6f744d May 27 15:06:33.008297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-713b666b-1b63-416a-87a9-78d8636c40b8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:33.016207 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-713b666b-1b63-416a-87a9-78d8636c40b8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 200 len: 1314 microversion: 2.1 time: 0.272751 May 27 15:06:33.016988 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1099/2269] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:32 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:33.021834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1eec2ef6-2cbc-441d-8549-b14c609ff9b7 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:33.022753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1eec2ef6-2cbc-441d-8549-b14c609ff9b7 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:33.031139 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1eec2ef6-2cbc-441d-8549-b14c609ff9b7 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:33.031679 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1eec2ef6-2cbc-441d-8549-b14c609ff9b7 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:33.032569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1eec2ef6-2cbc-441d-8549-b14c609ff9b7 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:33.033160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1eec2ef6-2cbc-441d-8549-b14c609ff9b7 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:33.257082 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1eec2ef6-2cbc-441d-8549-b14c609ff9b7 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8920dea47a54142b7d376c36ea5ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c24fcdf60ab4259b3a15b50336e6e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:33.265698 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1eec2ef6-2cbc-441d-8549-b14c609ff9b7 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 200 len: 1316 microversion: 2.1 time: 0.247406 May 27 15:06:33.266275 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1100/2270] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:33 2022] GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:33.416305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6928defd-35b0-418e-a7f4-4d1576913474 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1836018348", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "2344c7a7-c142-4221-acc7-8131f1072282"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:33.483860 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ab4e1c11-9a6a-4004-86db-b6b3e5f308ae tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "POST /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6/action" status: 202 len: 0 microversion: 2.1 time: 0.869093 May 27 15:06:33.484798 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1171/2271] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:06:32 2022] POST /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6/action => generated 0 bytes in 871 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:06:33.492197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a61cc813-ea76-4df0-bc9f-b3f98582daf0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:33.493150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a61cc813-ea76-4df0-bc9f-b3f98582daf0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: b9907dbd-e85c-4b26-b80c-35d28319b5f3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:33.510764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a61cc813-ea76-4df0-bc9f-b3f98582daf0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:33.511341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a61cc813-ea76-4df0-bc9f-b3f98582daf0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:33.512406 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a61cc813-ea76-4df0-bc9f-b3f98582daf0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:33.514225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-6928defd-35b0-418e-a7f4-4d1576913474 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] validate_networks() for [('2344c7a7-c142-4221-acc7-8131f1072282', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:06:33.515121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a61cc813-ea76-4df0-bc9f-b3f98582daf0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:33.903224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a61cc813-ea76-4df0-bc9f-b3f98582daf0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:33.911756 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a61cc813-ea76-4df0-bc9f-b3f98582daf0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3" status: 200 len: 1325 microversion: 2.1 time: 0.425826 May 27 15:06:33.912539 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1172/2272] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:33 2022] GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3 => generated 1325 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:33.927192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-15504644-31d5-41d9-a1b6-9ffef211bea0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc780704670>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:34.158999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG neutronclient.v2_0.client [None req-15504644-31d5-41d9-a1b6-9ffef211bea0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 646e93e5-b6e0-429a-8743-17f3594008be in use.", "detail": ""}} {{(pid=119248) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:06:34.159722 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-15504644-31d5-41d9-a1b6-9ffef211bea0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] HTTP exception thrown: Security Group 646e93e5-b6e0-429a-8743-17f3594008be in use. May 27 15:06:34.159722 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-f696939f-bfc9-440c-af9f-7327bf846a09'] May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-15504644-31d5-41d9-a1b6-9ffef211bea0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Request method failure captured: May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/os-security-groups/646e93e5-b6e0-429a-8743-17f3594008be HTTP/1.1 May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOioXW1g9zfFJmrjFPUtqf1JkPOhTiGh0dQbrGTQeVBiQ2YItsGoLEVL7FPVNVHWC47EYq5bcE4MxdYNeFr1n8wrvdpg-P9YwTSrmg95hClAZskxttqGgB6RuHmw6OrmsxIPwgD27GZbwc2vNj9QfnR_dJ1A7Lc434AgecYE4my0CB4 May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4b76a0ca994471bc3d779e67ad7bd8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 7a3bafe047b746dfb54a6d795292c0c0 May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: exception: Security Group 646e93e5-b6e0-429a-8743-17f3594008be in use. May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-f696939f-bfc9-440c-af9f-7327bf846a09'] May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '646e93e5-b6e0-429a-8743-17f3594008be'} May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:06:34.161748 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 646e93e5-b6e0-429a-8743-17f3594008be in use. May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f696939f-bfc9-440c-af9f-7327bf846a09'] May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 646e93e5-b6e0-429a-8743-17f3594008be in use. May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f696939f-bfc9-440c-af9f-7327bf846a09'] May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 646e93e5-b6e0-429a-8743-17f3594008be in use. May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f696939f-bfc9-440c-af9f-7327bf846a09'] May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 646e93e5-b6e0-429a-8743-17f3594008be in use. May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f696939f-bfc9-440c-af9f-7327bf846a09'] May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-15504644-31d5-41d9-a1b6-9ffef211bea0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Returning 400 to user: Security Group 646e93e5-b6e0-429a-8743-17f3594008be in use. May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-f696939f-bfc9-440c-af9f-7327bf846a09'] {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-15504644-31d5-41d9-a1b6-9ffef211bea0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/646e93e5-b6e0-429a-8743-17f3594008be" status: 400 len: 185 microversion: 2.1 time: 0.240705 May 27 15:06:34.167280 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1173/2273] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:06:33 2022] DELETE /compute/v2.1/os-security-groups/646e93e5-b6e0-429a-8743-17f3594008be => generated 185 bytes in 242 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:06:34.173420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-52289ea7-1d53-40ee-9492-d66bc099e278 req-4dbb4025-4b37-4b2b-845b-b949486f9f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "332c261b-d7bd-44c6-9f15-31e825c440b6", "tag": "b97655f0-29fe-4e43-8737-f3775f6f744d"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:34.186980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-52289ea7-1d53-40ee-9492-d66bc099e278 req-4dbb4025-4b37-4b2b-845b-b949486f9f66 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:34.188461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-52289ea7-1d53-40ee-9492-d66bc099e278 req-4dbb4025-4b37-4b2b-845b-b949486f9f66 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:34.205662 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-52289ea7-1d53-40ee-9492-d66bc099e278 req-4dbb4025-4b37-4b2b-845b-b949486f9f66 service nova] Creating event network-changed:b97655f0-29fe-4e43-8737-f3775f6f744d for instance 332c261b-d7bd-44c6-9f15-31e825c440b6 on n-h1-843621-1 May 27 15:06:34.212576 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-52289ea7-1d53-40ee-9492-d66bc099e278 req-4dbb4025-4b37-4b2b-845b-b949486f9f66 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046928 May 27 15:06:34.213228 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1174/2274] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:34.222537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-74b69144-799a-48bb-836f-92952c1959fa tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:34.242289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-74b69144-799a-48bb-836f-92952c1959fa tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:34.277714 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74b69144-799a-48bb-836f-92952c1959fa tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:34.278182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74b69144-799a-48bb-836f-92952c1959fa tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:34.279574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74b69144-799a-48bb-836f-92952c1959fa tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:34.280017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74b69144-799a-48bb-836f-92952c1959fa tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:34.286649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-6928defd-35b0-418e-a7f4-4d1576913474 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:06:34.287077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-6928defd-35b0-418e-a7f4-4d1576913474 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:06:34.287561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-6928defd-35b0-418e-a7f4-4d1576913474 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:06:34.287984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-6928defd-35b0-418e-a7f4-4d1576913474 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:06:34.288403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-6928defd-35b0-418e-a7f4-4d1576913474 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:06:34.299020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6928defd-35b0-418e-a7f4-4d1576913474 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:34.299493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6928defd-35b0-418e-a7f4-4d1576913474 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:34.300318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6928defd-35b0-418e-a7f4-4d1576913474 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:34.300795 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6928defd-35b0-418e-a7f4-4d1576913474 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:34.320017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-6928defd-35b0-418e-a7f4-4d1576913474 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Getting quotas for project e41b606a0de24f7fa9ea68af7064723b. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:06:34.326239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-6928defd-35b0-418e-a7f4-4d1576913474 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Getting quotas for user 741a4f106a8f416891b90994e6ce9d40 and project e41b606a0de24f7fa9ea68af7064723b. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:06:34.342163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6928defd-35b0-418e-a7f4-4d1576913474 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:06:34.345064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6928defd-35b0-418e-a7f4-4d1576913474 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:06:34.405108 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6928defd-35b0-418e-a7f4-4d1576913474 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.137727 May 27 15:06:34.408844 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1101/2275] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:06:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:06:34.418352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-33afa414-ba27-4a31-b978-8ffa530131e3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:34.418986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-33afa414-ba27-4a31-b978-8ffa530131e3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:34.429356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-33afa414-ba27-4a31-b978-8ffa530131e3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:34.429808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-33afa414-ba27-4a31-b978-8ffa530131e3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:34.431297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-33afa414-ba27-4a31-b978-8ffa530131e3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:34.431749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-33afa414-ba27-4a31-b978-8ffa530131e3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:34.458137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:34.470167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-74b69144-799a-48bb-836f-92952c1959fa tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:34.478926 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-74b69144-799a-48bb-836f-92952c1959fa tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.263840 May 27 15:06:34.488654 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1175/2276] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:34 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:34.491738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-705e8d52-20e4-4cef-8dad-ba05eb4a2de0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:34.493119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-705e8d52-20e4-4cef-8dad-ba05eb4a2de0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:34.501166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-705e8d52-20e4-4cef-8dad-ba05eb4a2de0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:34.501624 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-705e8d52-20e4-4cef-8dad-ba05eb4a2de0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:34.502727 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-705e8d52-20e4-4cef-8dad-ba05eb4a2de0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:34.503359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-705e8d52-20e4-4cef-8dad-ba05eb4a2de0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:34.542682 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-705e8d52-20e4-4cef-8dad-ba05eb4a2de0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:06:34.702805 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-705e8d52-20e4-4cef-8dad-ba05eb4a2de0 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "DELETE /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 204 len: 0 microversion: 2.1 time: 0.213767 May 27 15:06:34.706817 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1176/2277] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:06:34 2022] DELETE /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:06:34.711010 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f93c93ff-ff5c-478f-b2b9-b660e4a1060b tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:34.712082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f93c93ff-ff5c-478f-b2b9-b660e4a1060b tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:34.720577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f93c93ff-ff5c-478f-b2b9-b660e4a1060b tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:34.721015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f93c93ff-ff5c-478f-b2b9-b660e4a1060b tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:34.724398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f93c93ff-ff5c-478f-b2b9-b660e4a1060b tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:34.724398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f93c93ff-ff5c-478f-b2b9-b660e4a1060b tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:34.943086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-33afa414-ba27-4a31-b978-8ffa530131e3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:34.952909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:34.959260 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-33afa414-ba27-4a31-b978-8ffa530131e3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 200 len: 1314 microversion: 2.1 time: 0.547533 May 27 15:06:34.960166 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1102/2278] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:34 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:34.973032 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b3005857-6668-459d-8f0e-40e672556fbb tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:34.975757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b3005857-6668-459d-8f0e-40e672556fbb tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:34.991130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3005857-6668-459d-8f0e-40e672556fbb tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:34.991620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3005857-6668-459d-8f0e-40e672556fbb tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:34.992407 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3005857-6668-459d-8f0e-40e672556fbb tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:34.995237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3005857-6668-459d-8f0e-40e672556fbb tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:35.012005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f93c93ff-ff5c-478f-b2b9-b660e4a1060b tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8920dea47a54142b7d376c36ea5ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c24fcdf60ab4259b3a15b50336e6e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:35.021448 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f93c93ff-ff5c-478f-b2b9-b660e4a1060b tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 200 len: 1316 microversion: 2.1 time: 0.315823 May 27 15:06:35.032152 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1177/2279] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:34 2022] GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:35.038176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ccc0a43f-42a2-429d-8f59-9128dfbf7050 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:35.039245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ccc0a43f-42a2-429d-8f59-9128dfbf7050 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:35.041531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:35.050554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccc0a43f-42a2-429d-8f59-9128dfbf7050 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:35.051018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccc0a43f-42a2-429d-8f59-9128dfbf7050 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:35.051816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccc0a43f-42a2-429d-8f59-9128dfbf7050 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:35.052265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccc0a43f-42a2-429d-8f59-9128dfbf7050 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:35.088776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b3005857-6668-459d-8f0e-40e672556fbb tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:35.100516 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b3005857-6668-459d-8f0e-40e672556fbb tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1215 microversion: 2.1 time: 0.138455 May 27 15:06:35.101495 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1103/2280] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:34 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1215 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:35.109281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2d5ff631-1305-40b3-a7f8-28114169c265 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:35.110439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2d5ff631-1305-40b3-a7f8-28114169c265 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: b9907dbd-e85c-4b26-b80c-35d28319b5f3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:35.117449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=10 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:35.125035 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2d5ff631-1305-40b3-a7f8-28114169c265 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:35.125846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2d5ff631-1305-40b3-a7f8-28114169c265 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:35.126867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2d5ff631-1305-40b3-a7f8-28114169c265 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:35.127426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2d5ff631-1305-40b3-a7f8-28114169c265 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:35.313521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ccc0a43f-42a2-429d-8f59-9128dfbf7050 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:35.317553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2d5ff631-1305-40b3-a7f8-28114169c265 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:35.322044 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ccc0a43f-42a2-429d-8f59-9128dfbf7050 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 200 len: 1647 microversion: 2.1 time: 0.288694 May 27 15:06:35.322629 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1178/2281] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:35 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 1647 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:35.327227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-d0f92e96-8b31-452b-a4b6-c16c944ee00a req-aed9b74f-ba41-4b8a-b7ed-5c44aebe50a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "841712c3-20ca-42ed-9c1f-22b88de952b6", "name": "network-vif-plugged", "status": "completed", "tag": "13825ca0-6a05-4ba6-a741-69e4ddf343f1"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:35.334723 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2d5ff631-1305-40b3-a7f8-28114169c265 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3" status: 200 len: 1325 microversion: 2.1 time: 0.232056 May 27 15:06:35.335674 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1104/2282] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:35 2022] GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3 => generated 1325 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:35.336592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d0f92e96-8b31-452b-a4b6-c16c944ee00a req-aed9b74f-ba41-4b8a-b7ed-5c44aebe50a3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:35.337106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d0f92e96-8b31-452b-a4b6-c16c944ee00a req-aed9b74f-ba41-4b8a-b7ed-5c44aebe50a3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:35.349973 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-d0f92e96-8b31-452b-a4b6-c16c944ee00a req-aed9b74f-ba41-4b8a-b7ed-5c44aebe50a3 service nova] Creating event network-vif-plugged:13825ca0-6a05-4ba6-a741-69e4ddf343f1 for instance 841712c3-20ca-42ed-9c1f-22b88de952b6 on n-h2-843621-1 May 27 15:06:35.355181 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-d0f92e96-8b31-452b-a4b6-c16c944ee00a req-aed9b74f-ba41-4b8a-b7ed-5c44aebe50a3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031125 May 27 15:06:35.355791 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1179/2283] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:35.496359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-73741ffc-64d1-427c-8215-38c40f6b120c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:35.497250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-73741ffc-64d1-427c-8215-38c40f6b120c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:35.500358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:35.504516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73741ffc-64d1-427c-8215-38c40f6b120c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:35.504998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73741ffc-64d1-427c-8215-38c40f6b120c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:35.505772 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73741ffc-64d1-427c-8215-38c40f6b120c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:35.506213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73741ffc-64d1-427c-8215-38c40f6b120c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:35.642781 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-73741ffc-64d1-427c-8215-38c40f6b120c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:35.650897 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-73741ffc-64d1-427c-8215-38c40f6b120c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.158817 May 27 15:06:35.651485 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1105/2284] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:35 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:35.977096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-61c9029d-5d07-40aa-a4ab-875b97486537 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:35.977802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-61c9029d-5d07-40aa-a4ab-875b97486537 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:35.984092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-61c9029d-5d07-40aa-a4ab-875b97486537 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:35.984568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-61c9029d-5d07-40aa-a4ab-875b97486537 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:35.985358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-61c9029d-5d07-40aa-a4ab-875b97486537 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:35.985804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-61c9029d-5d07-40aa-a4ab-875b97486537 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:36.038875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a24a9e56-31c1-443a-afd3-bbcca26d3941 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:36.039507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a24a9e56-31c1-443a-afd3-bbcca26d3941 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:36.046662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a24a9e56-31c1-443a-afd3-bbcca26d3941 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:36.047129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a24a9e56-31c1-443a-afd3-bbcca26d3941 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:36.047922 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a24a9e56-31c1-443a-afd3-bbcca26d3941 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:36.048371 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a24a9e56-31c1-443a-afd3-bbcca26d3941 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:36.169716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-61c9029d-5d07-40aa-a4ab-875b97486537 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:36.186793 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-61c9029d-5d07-40aa-a4ab-875b97486537 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 200 len: 1314 microversion: 2.1 time: 0.213826 May 27 15:06:36.187682 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1180/2285] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:35 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:36.205169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9f7ca94a-4367-4bf8-9820-e84b78be45aa tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:36.206098 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9f7ca94a-4367-4bf8-9820-e84b78be45aa tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:36.231792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f7ca94a-4367-4bf8-9820-e84b78be45aa tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:36.232733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f7ca94a-4367-4bf8-9820-e84b78be45aa tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:36.234815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f7ca94a-4367-4bf8-9820-e84b78be45aa tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:36.235538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f7ca94a-4367-4bf8-9820-e84b78be45aa tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:36.237004 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a24a9e56-31c1-443a-afd3-bbcca26d3941 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8920dea47a54142b7d376c36ea5ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c24fcdf60ab4259b3a15b50336e6e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:36.248911 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a24a9e56-31c1-443a-afd3-bbcca26d3941 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 200 len: 1316 microversion: 2.1 time: 0.213742 May 27 15:06:36.249512 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1106/2286] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:36 2022] GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:36.307400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9f7ca94a-4367-4bf8-9820-e84b78be45aa tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:36.315963 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9f7ca94a-4367-4bf8-9820-e84b78be45aa tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1263 microversion: 2.1 time: 0.127057 May 27 15:06:36.316547 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1181/2287] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:36 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1263 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:36.339610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-19460da0-94ee-4323-9d2e-b982c9360292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:36.340254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-19460da0-94ee-4323-9d2e-b982c9360292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:36.346403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-19460da0-94ee-4323-9d2e-b982c9360292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:36.346870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-19460da0-94ee-4323-9d2e-b982c9360292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:36.347951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-19460da0-94ee-4323-9d2e-b982c9360292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:36.348399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-19460da0-94ee-4323-9d2e-b982c9360292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:36.352512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fe926558-72e4-4f71-aa9d-3eb9d16b92ba tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:36.353408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fe926558-72e4-4f71-aa9d-3eb9d16b92ba tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: b9907dbd-e85c-4b26-b80c-35d28319b5f3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:36.366556 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fe926558-72e4-4f71-aa9d-3eb9d16b92ba tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:36.367061 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fe926558-72e4-4f71-aa9d-3eb9d16b92ba tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:36.368157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fe926558-72e4-4f71-aa9d-3eb9d16b92ba tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:36.368611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fe926558-72e4-4f71-aa9d-3eb9d16b92ba tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:36.391301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:36.588035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fe926558-72e4-4f71-aa9d-3eb9d16b92ba tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:36.591473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-19460da0-94ee-4323-9d2e-b982c9360292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:36.596159 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fe926558-72e4-4f71-aa9d-3eb9d16b92ba tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3" status: 200 len: 1325 microversion: 2.1 time: 0.247777 May 27 15:06:36.596785 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1182/2288] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:36 2022] GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3 => generated 1325 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:36.601984 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-19460da0-94ee-4323-9d2e-b982c9360292 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 200 len: 1647 microversion: 2.1 time: 0.266105 May 27 15:06:36.602924 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1107/2289] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:36 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 1647 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:36.668662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4d5f8ee6-cf5b-4ad0-bffc-6a1836f0b0ff tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:36.669296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4d5f8ee6-cf5b-4ad0-bffc-6a1836f0b0ff tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:36.676351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d5f8ee6-cf5b-4ad0-bffc-6a1836f0b0ff tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:36.676831 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d5f8ee6-cf5b-4ad0-bffc-6a1836f0b0ff tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:36.677613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d5f8ee6-cf5b-4ad0-bffc-6a1836f0b0ff tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:36.678055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d5f8ee6-cf5b-4ad0-bffc-6a1836f0b0ff tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:36.821158 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4d5f8ee6-cf5b-4ad0-bffc-6a1836f0b0ff tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:36.828921 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4d5f8ee6-cf5b-4ad0-bffc-6a1836f0b0ff tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.164042 May 27 15:06:36.829508 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1183/2290] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:36 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:37.204173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-490b3659-7c36-4fb3-8a6f-d3eea341336f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:37.204829 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-490b3659-7c36-4fb3-8a6f-d3eea341336f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:37.212349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-490b3659-7c36-4fb3-8a6f-d3eea341336f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:37.212831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-490b3659-7c36-4fb3-8a6f-d3eea341336f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:37.213801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-490b3659-7c36-4fb3-8a6f-d3eea341336f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:37.214422 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-490b3659-7c36-4fb3-8a6f-d3eea341336f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:37.270189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fd6c875d-e3e9-4a8e-999a-83bc5c3e4c1d tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:37.271764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fd6c875d-e3e9-4a8e-999a-83bc5c3e4c1d tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:37.282334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd6c875d-e3e9-4a8e-999a-83bc5c3e4c1d tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:37.283185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd6c875d-e3e9-4a8e-999a-83bc5c3e4c1d tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:37.285282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd6c875d-e3e9-4a8e-999a-83bc5c3e4c1d tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:37.287018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd6c875d-e3e9-4a8e-999a-83bc5c3e4c1d tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:37.409652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-490b3659-7c36-4fb3-8a6f-d3eea341336f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:37.419835 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-490b3659-7c36-4fb3-8a6f-d3eea341336f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 200 len: 1314 microversion: 2.1 time: 0.219908 May 27 15:06:37.431261 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1108/2291] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:37 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:37.437656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2c40ec75-55cb-4456-9092-e592b96af4f5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:37.438570 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2c40ec75-55cb-4456-9092-e592b96af4f5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:37.455992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c40ec75-55cb-4456-9092-e592b96af4f5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:37.459016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c40ec75-55cb-4456-9092-e592b96af4f5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:37.460096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c40ec75-55cb-4456-9092-e592b96af4f5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:37.460844 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c40ec75-55cb-4456-9092-e592b96af4f5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:37.508778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fd6c875d-e3e9-4a8e-999a-83bc5c3e4c1d tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8920dea47a54142b7d376c36ea5ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c24fcdf60ab4259b3a15b50336e6e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:37.517585 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fd6c875d-e3e9-4a8e-999a-83bc5c3e4c1d tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 200 len: 1316 microversion: 2.1 time: 0.254650 May 27 15:06:37.519046 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1184/2292] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:37 2022] GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 1316 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:37.532046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-76164284-b549-4af9-a182-77e9344de454 req-58f90910-4081-44df-b109-e281ccba945d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb464b82-c037-489f-a0ee-4008ea19886b", "name": "network-vif-plugged", "status": "completed", "tag": "0c5e77ff-3945-4734-9d97-8d6e127cdd38"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:37.542953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-76164284-b549-4af9-a182-77e9344de454 req-58f90910-4081-44df-b109-e281ccba945d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:37.543656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-76164284-b549-4af9-a182-77e9344de454 req-58f90910-4081-44df-b109-e281ccba945d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:37.558600 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-76164284-b549-4af9-a182-77e9344de454 req-58f90910-4081-44df-b109-e281ccba945d service nova] Creating event network-vif-plugged:0c5e77ff-3945-4734-9d97-8d6e127cdd38 for instance fb464b82-c037-489f-a0ee-4008ea19886b on n-h2-843621-1 May 27 15:06:37.566082 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-76164284-b549-4af9-a182-77e9344de454 req-58f90910-4081-44df-b109-e281ccba945d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045049 May 27 15:06:37.567771 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1185/2293] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:37.574854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-00f155e0-7f0c-4944-8044-d1c1f675cc12 req-6648eb8e-1c3d-4582-b214-5bfbffbb8faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332c261b-d7bd-44c6-9f15-31e825c440b6", "name": "network-vif-deleted", "tag": "b97655f0-29fe-4e43-8737-f3775f6f744d"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:37.592884 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-00f155e0-7f0c-4944-8044-d1c1f675cc12 req-6648eb8e-1c3d-4582-b214-5bfbffbb8faa service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:37.593927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-00f155e0-7f0c-4944-8044-d1c1f675cc12 req-6648eb8e-1c3d-4582-b214-5bfbffbb8faa service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:37.608072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2c40ec75-55cb-4456-9092-e592b96af4f5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:37.618746 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-00f155e0-7f0c-4944-8044-d1c1f675cc12 req-6648eb8e-1c3d-4582-b214-5bfbffbb8faa service nova] Creating event network-vif-deleted:b97655f0-29fe-4e43-8737-f3775f6f744d for instance 332c261b-d7bd-44c6-9f15-31e825c440b6 on n-h1-843621-1 May 27 15:06:37.624561 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2c40ec75-55cb-4456-9092-e592b96af4f5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1269 microversion: 2.1 time: 0.191655 May 27 15:06:37.634740 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-00f155e0-7f0c-4944-8044-d1c1f675cc12 req-6648eb8e-1c3d-4582-b214-5bfbffbb8faa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060587 May 27 15:06:37.634740 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1186/2294] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:37.635663 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1109/2295] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:37 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1269 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:37.641687 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-696e53d8-a778-4daf-acc6-ff0774d9a915 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:37.642601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-696e53d8-a778-4daf-acc6-ff0774d9a915 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:37.645753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3f574de8-19ee-4af4-84fc-6a4a16007e33 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:37.646478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3f574de8-19ee-4af4-84fc-6a4a16007e33 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: b9907dbd-e85c-4b26-b80c-35d28319b5f3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:37.652912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-696e53d8-a778-4daf-acc6-ff0774d9a915 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:37.653662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-696e53d8-a778-4daf-acc6-ff0774d9a915 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:37.654736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-696e53d8-a778-4daf-acc6-ff0774d9a915 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:37.656015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-696e53d8-a778-4daf-acc6-ff0774d9a915 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:37.667272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f574de8-19ee-4af4-84fc-6a4a16007e33 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:37.670064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f574de8-19ee-4af4-84fc-6a4a16007e33 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:37.672461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f574de8-19ee-4af4-84fc-6a4a16007e33 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:37.672958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f574de8-19ee-4af4-84fc-6a4a16007e33 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:37.709489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-696e53d8-a778-4daf-acc6-ff0774d9a915 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:37.711461 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-696e53d8-a778-4daf-acc6-ff0774d9a915 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:37.712245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-696e53d8-a778-4daf-acc6-ff0774d9a915 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lazy-loading 'fault' on Instance uuid 332c261b-d7bd-44c6-9f15-31e825c440b6 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:06:37.775422 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-696e53d8-a778-4daf-acc6-ff0774d9a915 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:37.784975 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-696e53d8-a778-4daf-acc6-ff0774d9a915 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 200 len: 1306 microversion: 2.1 time: 0.147749 May 27 15:06:37.796311 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1110/2296] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:37 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 1306 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:37.847604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4fe85de0-a183-434b-b360-6ff808140cca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:37.848352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4fe85de0-a183-434b-b360-6ff808140cca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:37.859020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4fe85de0-a183-434b-b360-6ff808140cca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:37.859248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4fe85de0-a183-434b-b360-6ff808140cca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:37.860720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4fe85de0-a183-434b-b360-6ff808140cca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:37.861319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4fe85de0-a183-434b-b360-6ff808140cca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:37.903107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3f574de8-19ee-4af4-84fc-6a4a16007e33 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:37.913061 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3f574de8-19ee-4af4-84fc-6a4a16007e33 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3" status: 200 len: 1325 microversion: 2.1 time: 0.278222 May 27 15:06:37.914039 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1187/2297] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:37 2022] GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3 => generated 1325 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:38.066463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4fe85de0-a183-434b-b360-6ff808140cca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:38.076817 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4fe85de0-a183-434b-b360-6ff808140cca tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.233241 May 27 15:06:38.078231 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1111/2298] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:37 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:38.437575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f1c81cf1-6291-466b-91a2-310ececf4592 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:38.438400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f1c81cf1-6291-466b-91a2-310ececf4592 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:38.445304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1c81cf1-6291-466b-91a2-310ececf4592 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:38.445844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1c81cf1-6291-466b-91a2-310ececf4592 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:38.446695 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1c81cf1-6291-466b-91a2-310ececf4592 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:38.447226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1c81cf1-6291-466b-91a2-310ececf4592 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:38.536779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5005a61e-a07f-4d0a-9793-0f25c7ff187d tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:38.537368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5005a61e-a07f-4d0a-9793-0f25c7ff187d tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:38.544387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5005a61e-a07f-4d0a-9793-0f25c7ff187d tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:38.545606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5005a61e-a07f-4d0a-9793-0f25c7ff187d tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:38.546446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5005a61e-a07f-4d0a-9793-0f25c7ff187d tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:38.546904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5005a61e-a07f-4d0a-9793-0f25c7ff187d tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:38.604496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f1c81cf1-6291-466b-91a2-310ececf4592 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:38.612762 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f1c81cf1-6291-466b-91a2-310ececf4592 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 200 len: 1502 microversion: 2.1 time: 0.178961 May 27 15:06:38.613356 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1188/2299] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:38 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 1502 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:38.629357 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1d69aae5-261f-4283-b6c5-00f748dd8a3b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:38.629891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1d69aae5-261f-4283-b6c5-00f748dd8a3b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:38.636264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d69aae5-261f-4283-b6c5-00f748dd8a3b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:38.636904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d69aae5-261f-4283-b6c5-00f748dd8a3b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:38.637770 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d69aae5-261f-4283-b6c5-00f748dd8a3b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:38.638962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d69aae5-261f-4283-b6c5-00f748dd8a3b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:38.706426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5005a61e-a07f-4d0a-9793-0f25c7ff187d tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8920dea47a54142b7d376c36ea5ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c24fcdf60ab4259b3a15b50336e6e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:38.713411 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1d69aae5-261f-4283-b6c5-00f748dd8a3b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "POST /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6/action" status: 202 len: 0 microversion: 2.1 time: 0.087642 May 27 15:06:38.718087 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1189/2300] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:06:38 2022] POST /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:06:38.718298 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5005a61e-a07f-4d0a-9793-0f25c7ff187d tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 200 len: 1316 microversion: 2.1 time: 0.184041 May 27 15:06:38.718298 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1112/2301] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:38 2022] GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:38.720694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-05b47fd2-4817-4d5e-9817-a5bac2625f76 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:38.721442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-05b47fd2-4817-4d5e-9817-a5bac2625f76 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:38.724105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7d02db40-0f68-43a9-8393-d20acaf4246b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:38.724895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7d02db40-0f68-43a9-8393-d20acaf4246b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:38.728779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05b47fd2-4817-4d5e-9817-a5bac2625f76 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:38.729241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05b47fd2-4817-4d5e-9817-a5bac2625f76 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:38.730272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05b47fd2-4817-4d5e-9817-a5bac2625f76 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:38.730471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05b47fd2-4817-4d5e-9817-a5bac2625f76 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:38.732287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d02db40-0f68-43a9-8393-d20acaf4246b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:38.732527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d02db40-0f68-43a9-8393-d20acaf4246b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:38.733391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d02db40-0f68-43a9-8393-d20acaf4246b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:38.734238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d02db40-0f68-43a9-8393-d20acaf4246b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:38.941129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-05b47fd2-4817-4d5e-9817-a5bac2625f76 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:38.949783 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-05b47fd2-4817-4d5e-9817-a5bac2625f76 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1311 microversion: 2.1 time: 0.233990 May 27 15:06:38.950363 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1190/2302] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:38 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1311 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:38.958245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7d02db40-0f68-43a9-8393-d20acaf4246b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:38.958410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e57b2c8d-60c1-4b2b-aa81-bb5dbcc1cc85 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:38.958410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e57b2c8d-60c1-4b2b-aa81-bb5dbcc1cc85 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:38.965767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e57b2c8d-60c1-4b2b-aa81-bb5dbcc1cc85 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:38.966035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e57b2c8d-60c1-4b2b-aa81-bb5dbcc1cc85 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:38.967031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e57b2c8d-60c1-4b2b-aa81-bb5dbcc1cc85 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:38.967687 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7d02db40-0f68-43a9-8393-d20acaf4246b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 200 len: 1507 microversion: 2.1 time: 0.247674 May 27 15:06:38.967967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e57b2c8d-60c1-4b2b-aa81-bb5dbcc1cc85 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:38.979663 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1113/2303] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:38 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 1507 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:38.983572 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-e57b2c8d-60c1-4b2b-aa81-bb5dbcc1cc85 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] HTTP exception thrown: Instance 332c261b-d7bd-44c6-9f15-31e825c440b6 could not be found. May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e57b2c8d-60c1-4b2b-aa81-bb5dbcc1cc85 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Request method failure captured: May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 HTTP/1.1 May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOioXW1g9zfFJmrjFPUtqf1JkPOhTiGh0dQbrGTQeVBiQ2YItsGoLEVL7FPVNVHWC47EYq5bcE4MxdYNeFr1n8wrvdpg-P9YwTSrmg95hClAZskxttqGgB6RuHmw6OrmsxIPwgD27GZbwc2vNj9QfnR_dJ1A7Lc434AgecYE4my0CB4 May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4b76a0ca994471bc3d779e67ad7bd8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 7a3bafe047b746dfb54a6d795292c0c0 May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 332c261b-d7bd-44c6-9f15-31e825c440b6 could not be found. May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '332c261b-d7bd-44c6-9f15-31e825c440b6'} May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 332c261b-d7bd-44c6-9f15-31e825c440b6 could not be found. May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 332c261b-d7bd-44c6-9f15-31e825c440b6 could not be found. May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:38.985381 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:38.991290 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:38.991290 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:38.991290 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:38.991290 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:38.991290 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:38.991290 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 332c261b-d7bd-44c6-9f15-31e825c440b6 could not be found. May 27 15:06:38.991290 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:38.991897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1ca60b70-c008-42b0-a173-a4dcea89173e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:38.992004 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e57b2c8d-60c1-4b2b-aa81-bb5dbcc1cc85 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Returning 404 to user: Instance 332c261b-d7bd-44c6-9f15-31e825c440b6 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:38.992103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1ca60b70-c008-42b0-a173-a4dcea89173e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: b9907dbd-e85c-4b26-b80c-35d28319b5f3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:38.992220 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e57b2c8d-60c1-4b2b-aa81-bb5dbcc1cc85 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 404 len: 111 microversion: 2.1 time: 0.036121 May 27 15:06:38.993023 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1191/2304] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:38 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:38.998463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ca23276d-1df9-4748-bc5e-02a81da5b9a6 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc78062d670>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:39.000104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ca60b70-c008-42b0-a173-a4dcea89173e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:39.000808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ca60b70-c008-42b0-a173-a4dcea89173e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:39.002231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ca60b70-c008-42b0-a173-a4dcea89173e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:39.002780 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ca60b70-c008-42b0-a173-a4dcea89173e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:39.239264 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1ca60b70-c008-42b0-a173-a4dcea89173e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:39.248824 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1ca60b70-c008-42b0-a173-a4dcea89173e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3" status: 200 len: 1325 microversion: 2.1 time: 0.266956 May 27 15:06:39.258884 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1114/2305] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:38 2022] GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3 => generated 1325 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:39.265328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f07e0d8c-0bd3-4519-9c14-4a924605c751 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:39.266193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f07e0d8c-0bd3-4519-9c14-4a924605c751 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:39.273222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f07e0d8c-0bd3-4519-9c14-4a924605c751 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:39.273905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f07e0d8c-0bd3-4519-9c14-4a924605c751 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:39.274806 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f07e0d8c-0bd3-4519-9c14-4a924605c751 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:39.275385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f07e0d8c-0bd3-4519-9c14-4a924605c751 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:39.350118 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ca23276d-1df9-4748-bc5e-02a81da5b9a6 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/974b4234-ca2d-4063-aeb7-8456733bbc9b" status: 202 len: 0 microversion: 2.1 time: 0.354971 May 27 15:06:39.351561 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1192/2306] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:06:38 2022] DELETE /compute/v2.1/os-security-groups/974b4234-ca2d-4063-aeb7-8456733bbc9b => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:06:39.378324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dfef43a5-ac43-4778-a0e5-7ab5af9e1ba1 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc780681f70>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:39.478640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f07e0d8c-0bd3-4519-9c14-4a924605c751 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:39.488624 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f07e0d8c-0bd3-4519-9c14-4a924605c751 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.227861 May 27 15:06:39.492715 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1115/2307] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:39 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:39.594369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-1e204c69-6e8e-4f16-979f-f02de042a98b req-4da2edd3-3916-4323-9f0f-d14dd1986c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9907dbd-e85c-4b26-b80c-35d28319b5f3", "name": "network-vif-plugged", "status": "completed", "tag": "53ba122e-6340-4681-a6f0-3313425f9c72"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:39.605877 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-1e204c69-6e8e-4f16-979f-f02de042a98b req-4da2edd3-3916-4323-9f0f-d14dd1986c7c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:39.608039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-1e204c69-6e8e-4f16-979f-f02de042a98b req-4da2edd3-3916-4323-9f0f-d14dd1986c7c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:39.626745 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-1e204c69-6e8e-4f16-979f-f02de042a98b req-4da2edd3-3916-4323-9f0f-d14dd1986c7c service nova] Creating event network-vif-plugged:53ba122e-6340-4681-a6f0-3313425f9c72 for instance b9907dbd-e85c-4b26-b80c-35d28319b5f3 on n-h2-843621-1 May 27 15:06:39.629510 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dfef43a5-ac43-4778-a0e5-7ab5af9e1ba1 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/646e93e5-b6e0-429a-8743-17f3594008be" status: 202 len: 0 microversion: 2.1 time: 0.261773 May 27 15:06:39.635755 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-1e204c69-6e8e-4f16-979f-f02de042a98b req-4da2edd3-3916-4323-9f0f-d14dd1986c7c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049865 May 27 15:06:39.637309 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1116/2308] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:06:39.653028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a9947fa3-1a50-4e84-8e2e-0a89d8fd7946 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Action: 'create', calling method: .version_select at 0x7fc7771c91f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-814884246", "description": "tempest-description-2023870217"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:39.653256 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1193/2309] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:06:39 2022] DELETE /compute/v2.1/os-security-groups/646e93e5-b6e0-429a-8743-17f3594008be => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:06:39.694063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-d1a0e919-3584-4db8-8df6-83f888a5544b req-89762962-b402-4ebe-879a-08c8102873e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43977f10-b575-4abc-877b-2877ded82fee", "tag": "32123a21-d6ba-4e17-af90-97a4d6efb2fa"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:39.712161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d1a0e919-3584-4db8-8df6-83f888a5544b req-89762962-b402-4ebe-879a-08c8102873e4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:39.712938 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d1a0e919-3584-4db8-8df6-83f888a5544b req-89762962-b402-4ebe-879a-08c8102873e4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:39.729078 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-d1a0e919-3584-4db8-8df6-83f888a5544b req-89762962-b402-4ebe-879a-08c8102873e4 service nova] Creating event network-changed:32123a21-d6ba-4e17-af90-97a4d6efb2fa for instance 43977f10-b575-4abc-877b-2877ded82fee on n-h2-843621-1 May 27 15:06:39.736813 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-d1a0e919-3584-4db8-8df6-83f888a5544b req-89762962-b402-4ebe-879a-08c8102873e4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048375 May 27 15:06:39.737995 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1194/2310] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:06:39.744259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7c1dea73-694d-469c-b22e-bca10533b2c6 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:39.745096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7c1dea73-694d-469c-b22e-bca10533b2c6 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:39.753576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c1dea73-694d-469c-b22e-bca10533b2c6 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:39.754165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c1dea73-694d-469c-b22e-bca10533b2c6 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:39.755513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c1dea73-694d-469c-b22e-bca10533b2c6 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:39.756442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c1dea73-694d-469c-b22e-bca10533b2c6 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:39.868198 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a9947fa3-1a50-4e84-8e2e-0a89d8fd7946 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.222399 May 27 15:06:39.870244 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1117/2311] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:06:39 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:39.884563 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f8b98bfe-8b0d-4d32-a1fa-ef8bd792ca8a tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Action: 'update', calling method: .version_select at 0x7fc7807049d0>, body: {"security_group": {"name": "tempest-sg-hth-669105960", "description": "tempest-description-hth-2093714264"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:39.976219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7c1dea73-694d-469c-b22e-bca10533b2c6 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8920dea47a54142b7d376c36ea5ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c24fcdf60ab4259b3a15b50336e6e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:39.985321 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7c1dea73-694d-469c-b22e-bca10533b2c6 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 200 len: 1466 microversion: 2.1 time: 0.245860 May 27 15:06:39.985899 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1195/2312] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:39 2022] GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 1466 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:39.992252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7d350c67-c1a9-40c4-9d88-c16bba71e69e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:39.992898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7d350c67-c1a9-40c4-9d88-c16bba71e69e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:40.000047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d350c67-c1a9-40c4-9d88-c16bba71e69e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:40.000502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d350c67-c1a9-40c4-9d88-c16bba71e69e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:40.001516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d350c67-c1a9-40c4-9d88-c16bba71e69e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:40.002147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d350c67-c1a9-40c4-9d88-c16bba71e69e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:40.142428 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f8b98bfe-8b0d-4d32-a1fa-ef8bd792ca8a tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "PUT /compute/v2.1/os-security-groups/a7891f41-653b-4ae3-af73-1c834848036d" status: 200 len: 217 microversion: 2.1 time: 0.264414 May 27 15:06:40.143041 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1118/2313] 10.222.0.13 () {60 vars in 1289 bytes} [Fri May 27 15:06:39 2022] PUT /compute/v2.1/os-security-groups/a7891f41-653b-4ae3-af73-1c834848036d => generated 217 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:06:40.147802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3a11ebb6-e402-4124-9c6a-6ee791865e4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:40.148632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3a11ebb6-e402-4124-9c6a-6ee791865e4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:40.156622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a11ebb6-e402-4124-9c6a-6ee791865e4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:40.157040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a11ebb6-e402-4124-9c6a-6ee791865e4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:40.157838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a11ebb6-e402-4124-9c6a-6ee791865e4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:40.158282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a11ebb6-e402-4124-9c6a-6ee791865e4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:40.193411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7d350c67-c1a9-40c4-9d88-c16bba71e69e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:40.202201 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7d350c67-c1a9-40c4-9d88-c16bba71e69e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1311 microversion: 2.1 time: 0.215286 May 27 15:06:40.202784 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1196/2314] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:39 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1311 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:40.207549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-13aa0fae-da3e-4342-ae6b-e210be2161f0 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:40.208048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-13aa0fae-da3e-4342-ae6b-e210be2161f0 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:40.217633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-13aa0fae-da3e-4342-ae6b-e210be2161f0 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:40.218086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-13aa0fae-da3e-4342-ae6b-e210be2161f0 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:40.218867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-13aa0fae-da3e-4342-ae6b-e210be2161f0 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:40.219310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-13aa0fae-da3e-4342-ae6b-e210be2161f0 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:40.245558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-13aa0fae-da3e-4342-ae6b-e210be2161f0 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:06:40.299715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3a11ebb6-e402-4124-9c6a-6ee791865e4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:40.308016 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3a11ebb6-e402-4124-9c6a-6ee791865e4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 200 len: 1487 microversion: 2.1 time: 0.163851 May 27 15:06:40.308593 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1119/2315] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:40 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 1487 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:40.319431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-06766b42-2587-444b-9754-7c26f9031b02 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc780704670>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:40.331368 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-13aa0fae-da3e-4342-ae6b-e210be2161f0 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 204 len: 0 microversion: 2.1 time: 0.127143 May 27 15:06:40.331951 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1197/2316] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:06:40 2022] DELETE /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:06:40.337308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-60c0b9a2-93e0-410a-b780-5ca20dfe281c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:40.338036 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-60c0b9a2-93e0-410a-b780-5ca20dfe281c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: b9907dbd-e85c-4b26-b80c-35d28319b5f3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:40.344767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-60c0b9a2-93e0-410a-b780-5ca20dfe281c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:40.345217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-60c0b9a2-93e0-410a-b780-5ca20dfe281c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:40.346022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-60c0b9a2-93e0-410a-b780-5ca20dfe281c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:40.346459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-60c0b9a2-93e0-410a-b780-5ca20dfe281c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:40.370041 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-06766b42-2587-444b-9754-7c26f9031b02 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/a7891f41-653b-4ae3-af73-1c834848036d" status: 200 len: 217 microversion: 2.1 time: 0.060269 May 27 15:06:40.370662 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1120/2317] 10.222.0.13 () {58 vars in 1268 bytes} [Fri May 27 15:06:40 2022] GET /compute/v2.1/os-security-groups/a7891f41-653b-4ae3-af73-1c834848036d => generated 217 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:40.375718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1a276e2d-ca90-43c6-8860-897dcdc1bca8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:40.376227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1a276e2d-ca90-43c6-8860-897dcdc1bca8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:40.383264 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a276e2d-ca90-43c6-8860-897dcdc1bca8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:40.383788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a276e2d-ca90-43c6-8860-897dcdc1bca8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:40.384572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a276e2d-ca90-43c6-8860-897dcdc1bca8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:40.385065 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a276e2d-ca90-43c6-8860-897dcdc1bca8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:40.412086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1a276e2d-ca90-43c6-8860-897dcdc1bca8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:06:40.439718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:40.494185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-60c0b9a2-93e0-410a-b780-5ca20dfe281c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:40.496203 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1a276e2d-ca90-43c6-8860-897dcdc1bca8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "DELETE /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 204 len: 0 microversion: 2.1 time: 0.124019 May 27 15:06:40.496910 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1121/2318] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:06:40 2022] DELETE /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:06:40.503672 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-13b42a78-1265-4096-8dc5-00f258703d3c tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:40.504387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-13b42a78-1265-4096-8dc5-00f258703d3c tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:40.505565 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-60c0b9a2-93e0-410a-b780-5ca20dfe281c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3" status: 200 len: 1325 microversion: 2.1 time: 0.172423 May 27 15:06:40.506157 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1198/2319] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:40 2022] GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3 => generated 1325 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:40.510769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d91931ab-5630-445c-8ce0-5b1669352b6a tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc78064c820>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:40.510933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13b42a78-1265-4096-8dc5-00f258703d3c tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:40.511241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13b42a78-1265-4096-8dc5-00f258703d3c tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:40.512010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13b42a78-1265-4096-8dc5-00f258703d3c tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:40.512636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13b42a78-1265-4096-8dc5-00f258703d3c tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:40.703292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-13b42a78-1265-4096-8dc5-00f258703d3c tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8920dea47a54142b7d376c36ea5ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c24fcdf60ab4259b3a15b50336e6e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:40.710946 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-13b42a78-1265-4096-8dc5-00f258703d3c tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 200 len: 1472 microversion: 2.1 time: 0.212020 May 27 15:06:40.711529 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1122/2320] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:40 2022] GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 1472 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:40.716116 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b53e12bf-2e01-47a7-9715-56eaec251717 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:40.716881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b53e12bf-2e01-47a7-9715-56eaec251717 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:40.725117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b53e12bf-2e01-47a7-9715-56eaec251717 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:40.725575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b53e12bf-2e01-47a7-9715-56eaec251717 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:40.726416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b53e12bf-2e01-47a7-9715-56eaec251717 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:40.727034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b53e12bf-2e01-47a7-9715-56eaec251717 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:40.781053 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d91931ab-5630-445c-8ce0-5b1669352b6a tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/a7891f41-653b-4ae3-af73-1c834848036d" status: 202 len: 0 microversion: 2.1 time: 0.273576 May 27 15:06:40.781680 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1199/2321] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:06:40 2022] DELETE /compute/v2.1/os-security-groups/a7891f41-653b-4ae3-af73-1c834848036d => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:06:40.786225 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-814437d7-261a-49ae-a549-f1063f80404d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:40.786849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-814437d7-261a-49ae-a549-f1063f80404d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:40.793026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-814437d7-261a-49ae-a549-f1063f80404d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:40.793494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-814437d7-261a-49ae-a549-f1063f80404d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:40.794286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-814437d7-261a-49ae-a549-f1063f80404d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:40.794715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-814437d7-261a-49ae-a549-f1063f80404d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:40.933544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b53e12bf-2e01-47a7-9715-56eaec251717 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:40.941912 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b53e12bf-2e01-47a7-9715-56eaec251717 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 200 len: 1493 microversion: 2.1 time: 0.229351 May 27 15:06:40.942494 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1123/2322] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:40 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 1493 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:40.947168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0e86c13e-5413-4f21-8c4a-a6fc1191193b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:40.947611 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0e86c13e-5413-4f21-8c4a-a6fc1191193b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:40.954256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0e86c13e-5413-4f21-8c4a-a6fc1191193b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:40.954720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0e86c13e-5413-4f21-8c4a-a6fc1191193b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:40.955560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0e86c13e-5413-4f21-8c4a-a6fc1191193b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:40.955951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0e86c13e-5413-4f21-8c4a-a6fc1191193b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:40.961296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-814437d7-261a-49ae-a549-f1063f80404d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:40.969311 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-814437d7-261a-49ae-a549-f1063f80404d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.186594 May 27 15:06:40.969903 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-0e86c13e-5413-4f21-8c4a-a6fc1191193b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] HTTP exception thrown: Instance 332c261b-d7bd-44c6-9f15-31e825c440b6 could not be found. May 27 15:06:40.970060 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1200/2323] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:40 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0e86c13e-5413-4f21-8c4a-a6fc1191193b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Request method failure captured: May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 HTTP/1.1 May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOioXW1g9zfFJmrjFPUtqf1JkPOhTiGh0dQbrGTQeVBiQ2YItsGoLEVL7FPVNVHWC47EYq5bcE4MxdYNeFr1n8wrvdpg-P9YwTSrmg95hClAZskxttqGgB6RuHmw6OrmsxIPwgD27GZbwc2vNj9QfnR_dJ1A7Lc434AgecYE4my0CB4 May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4b76a0ca994471bc3d779e67ad7bd8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 7a3bafe047b746dfb54a6d795292c0c0 May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 332c261b-d7bd-44c6-9f15-31e825c440b6 could not be found. May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '332c261b-d7bd-44c6-9f15-31e825c440b6'} May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 332c261b-d7bd-44c6-9f15-31e825c440b6 could not be found. May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:40.971636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:40.976274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 332c261b-d7bd-44c6-9f15-31e825c440b6 could not be found. May 27 15:06:40.976274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:40.976274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:40.976274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:40.976274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:40.976274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:40.976274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:40.976274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:40.976274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:40.976274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 332c261b-d7bd-44c6-9f15-31e825c440b6 could not be found. May 27 15:06:40.976274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:40.976274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0e86c13e-5413-4f21-8c4a-a6fc1191193b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Returning 404 to user: Instance 332c261b-d7bd-44c6-9f15-31e825c440b6 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:40.976274 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0e86c13e-5413-4f21-8c4a-a6fc1191193b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "DELETE /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 404 len: 111 microversion: 2.1 time: 0.029622 May 27 15:06:40.976274 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1124/2324] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:06:40 2022] DELETE /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:40.981289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fd849fa0-d586-43aa-89bd-52e328b22517 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:40.982418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fd849fa0-d586-43aa-89bd-52e328b22517 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 332c261b-d7bd-44c6-9f15-31e825c440b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:40.988443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd849fa0-d586-43aa-89bd-52e328b22517 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:40.988939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd849fa0-d586-43aa-89bd-52e328b22517 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:40.989707 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd849fa0-d586-43aa-89bd-52e328b22517 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:40.990147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd849fa0-d586-43aa-89bd-52e328b22517 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:41.005772 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-fd849fa0-d586-43aa-89bd-52e328b22517 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] HTTP exception thrown: Instance 332c261b-d7bd-44c6-9f15-31e825c440b6 could not be found. May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fd849fa0-d586-43aa-89bd-52e328b22517 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Request method failure captured: May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 HTTP/1.1 May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOioXW1g9zfFJmrjFPUtqf1JkPOhTiGh0dQbrGTQeVBiQ2YItsGoLEVL7FPVNVHWC47EYq5bcE4MxdYNeFr1n8wrvdpg-P9YwTSrmg95hClAZskxttqGgB6RuHmw6OrmsxIPwgD27GZbwc2vNj9QfnR_dJ1A7Lc434AgecYE4my0CB4 May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4b76a0ca994471bc3d779e67ad7bd8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 7a3bafe047b746dfb54a6d795292c0c0 May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 332c261b-d7bd-44c6-9f15-31e825c440b6 could not be found. May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '332c261b-d7bd-44c6-9f15-31e825c440b6'} May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 332c261b-d7bd-44c6-9f15-31e825c440b6 could not be found. May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 332c261b-d7bd-44c6-9f15-31e825c440b6 could not be found. May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:41.007412 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.013103 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.013103 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:41.013103 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:41.013103 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:41.013103 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:41.013103 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 332c261b-d7bd-44c6-9f15-31e825c440b6 could not be found. May 27 15:06:41.013103 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.013103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fd849fa0-d586-43aa-89bd-52e328b22517 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Returning 404 to user: Instance 332c261b-d7bd-44c6-9f15-31e825c440b6 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:41.013103 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fd849fa0-d586-43aa-89bd-52e328b22517 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6" status: 404 len: 111 microversion: 2.1 time: 0.031374 May 27 15:06:41.013103 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1201/2325] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:40 2022] GET /compute/v2.1/servers/332c261b-d7bd-44c6-9f15-31e825c440b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:41.017847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6c398361-bdcf-4df2-84ae-e668fc3b45bd tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc777691dc0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:41.039353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG neutronclient.v2_0.client [None req-6c398361-bdcf-4df2-84ae-e668fc3b45bd tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 646e93e5-b6e0-429a-8743-17f3594008be does not exist", "detail": ""}} {{(pid=119249) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:06:41.039961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.security_group_api [None req-6c398361-bdcf-4df2-84ae-e668fc3b45bd tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Neutron security group 646e93e5-b6e0-429a-8743-17f3594008be not found {{(pid=119249) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 27 15:06:41.040487 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-6c398361-bdcf-4df2-84ae-e668fc3b45bd tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] HTTP exception thrown: Security group 646e93e5-b6e0-429a-8743-17f3594008be does not exist May 27 15:06:41.040487 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-9865c279-76e6-4272-bbe9-c07107ea9f02'] May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6c398361-bdcf-4df2-84ae-e668fc3b45bd tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Request method failure captured: May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/os-security-groups/646e93e5-b6e0-429a-8743-17f3594008be HTTP/1.1 May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOioXW1g9zfFJmrjFPUtqf1JkPOhTiGh0dQbrGTQeVBiQ2YItsGoLEVL7FPVNVHWC47EYq5bcE4MxdYNeFr1n8wrvdpg-P9YwTSrmg95hClAZskxttqGgB6RuHmw6OrmsxIPwgD27GZbwc2vNj9QfnR_dJ1A7Lc434AgecYE4my0CB4 May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4b76a0ca994471bc3d779e67ad7bd8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 7a3bafe047b746dfb54a6d795292c0c0 May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: exception: Security group 646e93e5-b6e0-429a-8743-17f3594008be does not exist May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-9865c279-76e6-4272-bbe9-c07107ea9f02'] May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '646e93e5-b6e0-429a-8743-17f3594008be'} May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:06:41.042390 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 646e93e5-b6e0-429a-8743-17f3594008be does not exist May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9865c279-76e6-4272-bbe9-c07107ea9f02'] May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 646e93e5-b6e0-429a-8743-17f3594008be does not exist May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9865c279-76e6-4272-bbe9-c07107ea9f02'] May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 646e93e5-b6e0-429a-8743-17f3594008be does not exist May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9865c279-76e6-4272-bbe9-c07107ea9f02'] May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 646e93e5-b6e0-429a-8743-17f3594008be does not exist May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9865c279-76e6-4272-bbe9-c07107ea9f02'] May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6c398361-bdcf-4df2-84ae-e668fc3b45bd tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Returning 404 to user: Security group 646e93e5-b6e0-429a-8743-17f3594008be does not exist May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-9865c279-76e6-4272-bbe9-c07107ea9f02'] {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6c398361-bdcf-4df2-84ae-e668fc3b45bd tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/646e93e5-b6e0-429a-8743-17f3594008be" status: 404 len: 194 microversion: 2.1 time: 0.029787 May 27 15:06:41.048457 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1125/2326] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:06:41 2022] DELETE /compute/v2.1/os-security-groups/646e93e5-b6e0-429a-8743-17f3594008be => generated 194 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:41.054074 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-44792416-2227-4e91-a4dd-34e1c18c6717 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc78079cc10>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:41.077505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG neutronclient.v2_0.client [None req-44792416-2227-4e91-a4dd-34e1c18c6717 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 974b4234-ca2d-4063-aeb7-8456733bbc9b does not exist", "detail": ""}} {{(pid=119248) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:06:41.078108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.security_group_api [None req-44792416-2227-4e91-a4dd-34e1c18c6717 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Neutron security group 974b4234-ca2d-4063-aeb7-8456733bbc9b not found {{(pid=119248) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 27 15:06:41.078635 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-44792416-2227-4e91-a4dd-34e1c18c6717 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] HTTP exception thrown: Security group 974b4234-ca2d-4063-aeb7-8456733bbc9b does not exist May 27 15:06:41.078635 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-5a7d45fb-e6d6-4cbd-8fc1-f75f3fb0d45f'] May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-44792416-2227-4e91-a4dd-34e1c18c6717 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Request method failure captured: May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/os-security-groups/974b4234-ca2d-4063-aeb7-8456733bbc9b HTTP/1.1 May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOioXW1g9zfFJmrjFPUtqf1JkPOhTiGh0dQbrGTQeVBiQ2YItsGoLEVL7FPVNVHWC47EYq5bcE4MxdYNeFr1n8wrvdpg-P9YwTSrmg95hClAZskxttqGgB6RuHmw6OrmsxIPwgD27GZbwc2vNj9QfnR_dJ1A7Lc434AgecYE4my0CB4 May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4b76a0ca994471bc3d779e67ad7bd8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 7a3bafe047b746dfb54a6d795292c0c0 May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: exception: Security group 974b4234-ca2d-4063-aeb7-8456733bbc9b does not exist May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-5a7d45fb-e6d6-4cbd-8fc1-f75f3fb0d45f'] May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '974b4234-ca2d-4063-aeb7-8456733bbc9b'} May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:06:41.080580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 974b4234-ca2d-4063-aeb7-8456733bbc9b does not exist May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a7d45fb-e6d6-4cbd-8fc1-f75f3fb0d45f'] May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 974b4234-ca2d-4063-aeb7-8456733bbc9b does not exist May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a7d45fb-e6d6-4cbd-8fc1-f75f3fb0d45f'] May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 974b4234-ca2d-4063-aeb7-8456733bbc9b does not exist May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a7d45fb-e6d6-4cbd-8fc1-f75f3fb0d45f'] May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 974b4234-ca2d-4063-aeb7-8456733bbc9b does not exist May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a7d45fb-e6d6-4cbd-8fc1-f75f3fb0d45f'] May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-44792416-2227-4e91-a4dd-34e1c18c6717 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Returning 404 to user: Security group 974b4234-ca2d-4063-aeb7-8456733bbc9b does not exist May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-5a7d45fb-e6d6-4cbd-8fc1-f75f3fb0d45f'] {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-44792416-2227-4e91-a4dd-34e1c18c6717 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/974b4234-ca2d-4063-aeb7-8456733bbc9b" status: 404 len: 194 microversion: 2.1 time: 0.032683 May 27 15:06:41.085738 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1202/2327] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:06:41 2022] DELETE /compute/v2.1/os-security-groups/974b4234-ca2d-4063-aeb7-8456733bbc9b => generated 194 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:41.090870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-abdbb11c-a524-4884-a4da-e8995cc1273b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc7806650d0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:41.113982 n-d-843621-1 devstack@n-api.service[119249]: DEBUG neutronclient.v2_0.client [None req-abdbb11c-a524-4884-a4da-e8995cc1273b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b5477b34-b1fc-41f0-9319-15cae7ac0159 does not exist", "detail": ""}} {{(pid=119249) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:06:41.114606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.security_group_api [None req-abdbb11c-a524-4884-a4da-e8995cc1273b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Neutron security group b5477b34-b1fc-41f0-9319-15cae7ac0159 not found {{(pid=119249) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 27 15:06:41.115130 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-abdbb11c-a524-4884-a4da-e8995cc1273b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] HTTP exception thrown: Security group b5477b34-b1fc-41f0-9319-15cae7ac0159 does not exist May 27 15:06:41.115130 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-baf7a4d0-ab34-41c7-a353-1eb9a33873d9'] May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-abdbb11c-a524-4884-a4da-e8995cc1273b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Request method failure captured: May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/os-security-groups/b5477b34-b1fc-41f0-9319-15cae7ac0159 HTTP/1.1 May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOioXW1g9zfFJmrjFPUtqf1JkPOhTiGh0dQbrGTQeVBiQ2YItsGoLEVL7FPVNVHWC47EYq5bcE4MxdYNeFr1n8wrvdpg-P9YwTSrmg95hClAZskxttqGgB6RuHmw6OrmsxIPwgD27GZbwc2vNj9QfnR_dJ1A7Lc434AgecYE4my0CB4 May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4b76a0ca994471bc3d779e67ad7bd8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 7a3bafe047b746dfb54a6d795292c0c0 May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: exception: Security group b5477b34-b1fc-41f0-9319-15cae7ac0159 does not exist May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-baf7a4d0-ab34-41c7-a353-1eb9a33873d9'] May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'b5477b34-b1fc-41f0-9319-15cae7ac0159'} May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:06:41.117281 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b5477b34-b1fc-41f0-9319-15cae7ac0159 does not exist May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-baf7a4d0-ab34-41c7-a353-1eb9a33873d9'] May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b5477b34-b1fc-41f0-9319-15cae7ac0159 does not exist May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-baf7a4d0-ab34-41c7-a353-1eb9a33873d9'] May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b5477b34-b1fc-41f0-9319-15cae7ac0159 does not exist May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-baf7a4d0-ab34-41c7-a353-1eb9a33873d9'] May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b5477b34-b1fc-41f0-9319-15cae7ac0159 does not exist May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-baf7a4d0-ab34-41c7-a353-1eb9a33873d9'] May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-abdbb11c-a524-4884-a4da-e8995cc1273b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Returning 404 to user: Security group b5477b34-b1fc-41f0-9319-15cae7ac0159 does not exist May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-baf7a4d0-ab34-41c7-a353-1eb9a33873d9'] {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-abdbb11c-a524-4884-a4da-e8995cc1273b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/b5477b34-b1fc-41f0-9319-15cae7ac0159" status: 404 len: 194 microversion: 2.1 time: 0.031744 May 27 15:06:41.122084 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1126/2328] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:06:41 2022] DELETE /compute/v2.1/os-security-groups/b5477b34-b1fc-41f0-9319-15cae7ac0159 => generated 194 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:41.127883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c8910849-ab44-4949-ae92-9545ea94c1ac tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc78064c550>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:41.150275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG neutronclient.v2_0.client [None req-c8910849-ab44-4949-ae92-9545ea94c1ac tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 492beffc-b784-45f9-8878-873b078355ad does not exist", "detail": ""}} {{(pid=119248) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:06:41.150868 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.security_group_api [None req-c8910849-ab44-4949-ae92-9545ea94c1ac tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Neutron security group 492beffc-b784-45f9-8878-873b078355ad not found {{(pid=119248) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 27 15:06:41.151386 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-c8910849-ab44-4949-ae92-9545ea94c1ac tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] HTTP exception thrown: Security group 492beffc-b784-45f9-8878-873b078355ad does not exist May 27 15:06:41.151386 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-a0a096fe-927b-45f3-9dc8-d98ffb15d9ff'] May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c8910849-ab44-4949-ae92-9545ea94c1ac tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Request method failure captured: May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/os-security-groups/492beffc-b784-45f9-8878-873b078355ad HTTP/1.1 May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOioXW1g9zfFJmrjFPUtqf1JkPOhTiGh0dQbrGTQeVBiQ2YItsGoLEVL7FPVNVHWC47EYq5bcE4MxdYNeFr1n8wrvdpg-P9YwTSrmg95hClAZskxttqGgB6RuHmw6OrmsxIPwgD27GZbwc2vNj9QfnR_dJ1A7Lc434AgecYE4my0CB4 May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4b76a0ca994471bc3d779e67ad7bd8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 7a3bafe047b746dfb54a6d795292c0c0 May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: exception: Security group 492beffc-b784-45f9-8878-873b078355ad does not exist May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-a0a096fe-927b-45f3-9dc8-d98ffb15d9ff'] May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '492beffc-b784-45f9-8878-873b078355ad'} May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:06:41.153256 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 492beffc-b784-45f9-8878-873b078355ad does not exist May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0a096fe-927b-45f3-9dc8-d98ffb15d9ff'] May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 492beffc-b784-45f9-8878-873b078355ad does not exist May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0a096fe-927b-45f3-9dc8-d98ffb15d9ff'] May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 492beffc-b784-45f9-8878-873b078355ad does not exist May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0a096fe-927b-45f3-9dc8-d98ffb15d9ff'] May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 492beffc-b784-45f9-8878-873b078355ad does not exist May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0a096fe-927b-45f3-9dc8-d98ffb15d9ff'] May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c8910849-ab44-4949-ae92-9545ea94c1ac tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Returning 404 to user: Security group 492beffc-b784-45f9-8878-873b078355ad does not exist May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-a0a096fe-927b-45f3-9dc8-d98ffb15d9ff'] {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c8910849-ab44-4949-ae92-9545ea94c1ac tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/492beffc-b784-45f9-8878-873b078355ad" status: 404 len: 194 microversion: 2.1 time: 0.030746 May 27 15:06:41.158507 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1203/2329] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:06:41 2022] DELETE /compute/v2.1/os-security-groups/492beffc-b784-45f9-8878-873b078355ad => generated 194 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:41.163115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c3972ea4-bde9-43ff-ad42-906d276dae7d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc7776a59d0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:41.185684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG neutronclient.v2_0.client [None req-c3972ea4-bde9-43ff-ad42-906d276dae7d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f8c3d409-20ef-4422-9d25-280d9f1b89df does not exist", "detail": ""}} {{(pid=119249) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:06:41.186306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.security_group_api [None req-c3972ea4-bde9-43ff-ad42-906d276dae7d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Neutron security group f8c3d409-20ef-4422-9d25-280d9f1b89df not found {{(pid=119249) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 27 15:06:41.186836 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-c3972ea4-bde9-43ff-ad42-906d276dae7d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] HTTP exception thrown: Security group f8c3d409-20ef-4422-9d25-280d9f1b89df does not exist May 27 15:06:41.186836 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-b22af512-f41f-4077-8ab0-cd6048610450'] May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c3972ea4-bde9-43ff-ad42-906d276dae7d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Request method failure captured: May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/os-security-groups/f8c3d409-20ef-4422-9d25-280d9f1b89df HTTP/1.1 May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOioXW1g9zfFJmrjFPUtqf1JkPOhTiGh0dQbrGTQeVBiQ2YItsGoLEVL7FPVNVHWC47EYq5bcE4MxdYNeFr1n8wrvdpg-P9YwTSrmg95hClAZskxttqGgB6RuHmw6OrmsxIPwgD27GZbwc2vNj9QfnR_dJ1A7Lc434AgecYE4my0CB4 May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4b76a0ca994471bc3d779e67ad7bd8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 7a3bafe047b746dfb54a6d795292c0c0 May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: exception: Security group f8c3d409-20ef-4422-9d25-280d9f1b89df does not exist May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-b22af512-f41f-4077-8ab0-cd6048610450'] May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'f8c3d409-20ef-4422-9d25-280d9f1b89df'} May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:06:41.188771 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f8c3d409-20ef-4422-9d25-280d9f1b89df does not exist May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b22af512-f41f-4077-8ab0-cd6048610450'] May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f8c3d409-20ef-4422-9d25-280d9f1b89df does not exist May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b22af512-f41f-4077-8ab0-cd6048610450'] May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f8c3d409-20ef-4422-9d25-280d9f1b89df does not exist May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b22af512-f41f-4077-8ab0-cd6048610450'] May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f8c3d409-20ef-4422-9d25-280d9f1b89df does not exist May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b22af512-f41f-4077-8ab0-cd6048610450'] May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c3972ea4-bde9-43ff-ad42-906d276dae7d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Returning 404 to user: Security group f8c3d409-20ef-4422-9d25-280d9f1b89df does not exist May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-b22af512-f41f-4077-8ab0-cd6048610450'] {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c3972ea4-bde9-43ff-ad42-906d276dae7d tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/f8c3d409-20ef-4422-9d25-280d9f1b89df" status: 404 len: 194 microversion: 2.1 time: 0.030941 May 27 15:06:41.194208 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1127/2330] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:06:41 2022] DELETE /compute/v2.1/os-security-groups/f8c3d409-20ef-4422-9d25-280d9f1b89df => generated 194 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:41.201707 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-310981bf-a083-4837-9e88-a516146d254f tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc78079c820>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:41.222141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aada9a89-abaa-490d-bc28-e7ec91f67254 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:41.223907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-aada9a89-abaa-490d-bc28-e7ec91f67254 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:41.224293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG neutronclient.v2_0.client [None req-310981bf-a083-4837-9e88-a516146d254f tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d47cf553-53d3-40e6-857d-b2e20b86dcd8 does not exist", "detail": ""}} {{(pid=119248) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:06:41.225373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.security_group_api [None req-310981bf-a083-4837-9e88-a516146d254f tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Neutron security group d47cf553-53d3-40e6-857d-b2e20b86dcd8 not found {{(pid=119248) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 27 15:06:41.226090 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-310981bf-a083-4837-9e88-a516146d254f tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] HTTP exception thrown: Security group d47cf553-53d3-40e6-857d-b2e20b86dcd8 does not exist May 27 15:06:41.226090 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-501ef196-9491-4b2c-9907-9637b014ea7b'] May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-310981bf-a083-4837-9e88-a516146d254f tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Request method failure captured: May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/os-security-groups/d47cf553-53d3-40e6-857d-b2e20b86dcd8 HTTP/1.1 May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOioXW1g9zfFJmrjFPUtqf1JkPOhTiGh0dQbrGTQeVBiQ2YItsGoLEVL7FPVNVHWC47EYq5bcE4MxdYNeFr1n8wrvdpg-P9YwTSrmg95hClAZskxttqGgB6RuHmw6OrmsxIPwgD27GZbwc2vNj9QfnR_dJ1A7Lc434AgecYE4my0CB4 May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4b76a0ca994471bc3d779e67ad7bd8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 7a3bafe047b746dfb54a6d795292c0c0 May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: exception: Security group d47cf553-53d3-40e6-857d-b2e20b86dcd8 does not exist May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-501ef196-9491-4b2c-9907-9637b014ea7b'] May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'd47cf553-53d3-40e6-857d-b2e20b86dcd8'} May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:06:41.229035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d47cf553-53d3-40e6-857d-b2e20b86dcd8 does not exist May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-501ef196-9491-4b2c-9907-9637b014ea7b'] May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d47cf553-53d3-40e6-857d-b2e20b86dcd8 does not exist May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-501ef196-9491-4b2c-9907-9637b014ea7b'] May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d47cf553-53d3-40e6-857d-b2e20b86dcd8 does not exist May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-501ef196-9491-4b2c-9907-9637b014ea7b'] May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d47cf553-53d3-40e6-857d-b2e20b86dcd8 does not exist May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-501ef196-9491-4b2c-9907-9637b014ea7b'] May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-310981bf-a083-4837-9e88-a516146d254f tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Returning 404 to user: Security group d47cf553-53d3-40e6-857d-b2e20b86dcd8 does not exist May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-501ef196-9491-4b2c-9907-9637b014ea7b'] {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:41.234607 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-310981bf-a083-4837-9e88-a516146d254f tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/d47cf553-53d3-40e6-857d-b2e20b86dcd8" status: 404 len: 194 microversion: 2.1 time: 0.034934 May 27 15:06:41.239297 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1204/2331] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:06:41 2022] DELETE /compute/v2.1/os-security-groups/d47cf553-53d3-40e6-857d-b2e20b86dcd8 => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:41.239400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aada9a89-abaa-490d-bc28-e7ec91f67254 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:41.239400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aada9a89-abaa-490d-bc28-e7ec91f67254 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:41.239400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aada9a89-abaa-490d-bc28-e7ec91f67254 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:41.239686 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aada9a89-abaa-490d-bc28-e7ec91f67254 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:41.241664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-01c0ae75-2f13-4047-a5c7-4f94b3fc17f6 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:41.242167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-01c0ae75-2f13-4047-a5c7-4f94b3fc17f6 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:41.249443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-01c0ae75-2f13-4047-a5c7-4f94b3fc17f6 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:41.249899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-01c0ae75-2f13-4047-a5c7-4f94b3fc17f6 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:41.250711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-01c0ae75-2f13-4047-a5c7-4f94b3fc17f6 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:41.251191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-01c0ae75-2f13-4047-a5c7-4f94b3fc17f6 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:41.276569 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-01c0ae75-2f13-4047-a5c7-4f94b3fc17f6 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:06:41.283374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:41.379752 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-01c0ae75-2f13-4047-a5c7-4f94b3fc17f6 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 204 len: 0 microversion: 2.1 time: 0.141627 May 27 15:06:41.380702 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1205/2332] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:06:41 2022] DELETE /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:06:41.390008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2bfb8624-bdd7-4764-bbf2-e5313dfaa402 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:41.391006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2bfb8624-bdd7-4764-bbf2-e5313dfaa402 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:41.397780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bfb8624-bdd7-4764-bbf2-e5313dfaa402 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:41.398241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bfb8624-bdd7-4764-bbf2-e5313dfaa402 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:41.399060 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bfb8624-bdd7-4764-bbf2-e5313dfaa402 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:41.399512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bfb8624-bdd7-4764-bbf2-e5313dfaa402 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:41.405366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-aada9a89-abaa-490d-bc28-e7ec91f67254 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:41.413425 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-aada9a89-abaa-490d-bc28-e7ec91f67254 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1311 microversion: 2.1 time: 0.198102 May 27 15:06:41.414003 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1128/2333] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:41 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1311 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:41.523942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d85fcc3d-e8cd-43e8-b485-565b5151e6b0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:41.524598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d85fcc3d-e8cd-43e8-b485-565b5151e6b0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: b9907dbd-e85c-4b26-b80c-35d28319b5f3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:41.531678 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d85fcc3d-e8cd-43e8-b485-565b5151e6b0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:41.532699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d85fcc3d-e8cd-43e8-b485-565b5151e6b0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:41.533748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d85fcc3d-e8cd-43e8-b485-565b5151e6b0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:41.534283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d85fcc3d-e8cd-43e8-b485-565b5151e6b0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:41.561227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2bfb8624-bdd7-4764-bbf2-e5313dfaa402 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:41.570184 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2bfb8624-bdd7-4764-bbf2-e5313dfaa402 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1646 microversion: 2.1 time: 0.184524 May 27 15:06:41.570773 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1206/2334] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:41 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1646 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:41.677735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d85fcc3d-e8cd-43e8-b485-565b5151e6b0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:41.685355 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d85fcc3d-e8cd-43e8-b485-565b5151e6b0 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3" status: 200 len: 1325 microversion: 2.1 time: 0.165680 May 27 15:06:41.685924 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1129/2335] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:41 2022] GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3 => generated 1325 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:41.728268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e90d6de6-737d-4bfa-be02-79946edb2e6a tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:41.728844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e90d6de6-737d-4bfa-be02-79946edb2e6a tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:41.736923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e90d6de6-737d-4bfa-be02-79946edb2e6a tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:41.737321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e90d6de6-737d-4bfa-be02-79946edb2e6a tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:41.738421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e90d6de6-737d-4bfa-be02-79946edb2e6a tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:41.739170 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e90d6de6-737d-4bfa-be02-79946edb2e6a tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:41.872926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e90d6de6-737d-4bfa-be02-79946edb2e6a tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8920dea47a54142b7d376c36ea5ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c24fcdf60ab4259b3a15b50336e6e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:41.883657 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e90d6de6-737d-4bfa-be02-79946edb2e6a tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 200 len: 1472 microversion: 2.1 time: 0.159690 May 27 15:06:41.884477 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1207/2336] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:41 2022] GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 1472 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:41.959209 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-198c7fb3-1230-4d9e-8419-2152f5109c0b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:41.959963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-198c7fb3-1230-4d9e-8419-2152f5109c0b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:41.966506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-198c7fb3-1230-4d9e-8419-2152f5109c0b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:41.966978 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-198c7fb3-1230-4d9e-8419-2152f5109c0b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:41.968142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-198c7fb3-1230-4d9e-8419-2152f5109c0b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:41.968605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-198c7fb3-1230-4d9e-8419-2152f5109c0b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:41.987079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dc32acdd-eec2-4c33-82df-d692b78e9a50 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:41.987728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dc32acdd-eec2-4c33-82df-d692b78e9a50 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:41.994921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dc32acdd-eec2-4c33-82df-d692b78e9a50 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:41.995414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dc32acdd-eec2-4c33-82df-d692b78e9a50 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:41.996300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dc32acdd-eec2-4c33-82df-d692b78e9a50 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:41.996775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dc32acdd-eec2-4c33-82df-d692b78e9a50 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:42.190591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-198c7fb3-1230-4d9e-8419-2152f5109c0b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:42.196483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dc32acdd-eec2-4c33-82df-d692b78e9a50 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:42.206647 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dc32acdd-eec2-4c33-82df-d692b78e9a50 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.223634 May 27 15:06:42.207810 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1208/2337] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:41 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:42.210539 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-198c7fb3-1230-4d9e-8419-2152f5109c0b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 200 len: 1493 microversion: 2.1 time: 0.255479 May 27 15:06:42.211296 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1130/2338] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:41 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 1493 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:42.431024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-307aaea6-f777-4ce1-a1f7-04df0d5659d3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:42.431643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-307aaea6-f777-4ce1-a1f7-04df0d5659d3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:42.438525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-307aaea6-f777-4ce1-a1f7-04df0d5659d3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:42.438975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-307aaea6-f777-4ce1-a1f7-04df0d5659d3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:42.439778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-307aaea6-f777-4ce1-a1f7-04df0d5659d3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:42.440226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-307aaea6-f777-4ce1-a1f7-04df0d5659d3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:42.586227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-307aaea6-f777-4ce1-a1f7-04df0d5659d3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:42.587656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ad53f4f4-06c2-4c9a-8eb2-c1e9ae4e588b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:42.588350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ad53f4f4-06c2-4c9a-8eb2-c1e9ae4e588b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:42.594971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad53f4f4-06c2-4c9a-8eb2-c1e9ae4e588b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:42.595265 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-307aaea6-f777-4ce1-a1f7-04df0d5659d3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1311 microversion: 2.1 time: 0.168229 May 27 15:06:42.595530 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad53f4f4-06c2-4c9a-8eb2-c1e9ae4e588b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:42.596081 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1209/2339] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:42 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1311 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:42.596314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad53f4f4-06c2-4c9a-8eb2-c1e9ae4e588b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:42.596791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad53f4f4-06c2-4c9a-8eb2-c1e9ae4e588b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:42.702873 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f4b95a24-db99-47b1-9774-9ed646de38b5 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:42.703560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f4b95a24-db99-47b1-9774-9ed646de38b5 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: b9907dbd-e85c-4b26-b80c-35d28319b5f3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:42.710526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4b95a24-db99-47b1-9774-9ed646de38b5 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:42.710983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4b95a24-db99-47b1-9774-9ed646de38b5 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:42.711762 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4b95a24-db99-47b1-9774-9ed646de38b5 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:42.712202 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4b95a24-db99-47b1-9774-9ed646de38b5 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:42.773314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ad53f4f4-06c2-4c9a-8eb2-c1e9ae4e588b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:42.781574 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ad53f4f4-06c2-4c9a-8eb2-c1e9ae4e588b tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1646 microversion: 2.1 time: 0.197958 May 27 15:06:42.782336 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1131/2340] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:42 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1646 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:42.877507 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f4b95a24-db99-47b1-9774-9ed646de38b5 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:42.886376 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f4b95a24-db99-47b1-9774-9ed646de38b5 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3" status: 200 len: 1325 microversion: 2.1 time: 0.187947 May 27 15:06:42.887039 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1210/2341] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:42 2022] GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3 => generated 1325 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:42.901659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8ec90b1a-86de-4676-85ea-98fed2ae26d0 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:42.902306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8ec90b1a-86de-4676-85ea-98fed2ae26d0 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:42.908879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ec90b1a-86de-4676-85ea-98fed2ae26d0 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:42.909343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ec90b1a-86de-4676-85ea-98fed2ae26d0 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:42.910253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ec90b1a-86de-4676-85ea-98fed2ae26d0 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:42.910696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ec90b1a-86de-4676-85ea-98fed2ae26d0 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:43.066467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8ec90b1a-86de-4676-85ea-98fed2ae26d0 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8920dea47a54142b7d376c36ea5ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c24fcdf60ab4259b3a15b50336e6e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:43.074530 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8ec90b1a-86de-4676-85ea-98fed2ae26d0 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 200 len: 1472 microversion: 2.1 time: 0.176915 May 27 15:06:43.075156 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1132/2342] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:42 2022] GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 1472 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:43.231543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-26080a4e-457d-4927-b02c-4d5f7406dbf6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:43.234838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-26080a4e-457d-4927-b02c-4d5f7406dbf6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:43.235052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c11bc55d-a43c-46bf-8932-396705c375b0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:43.236001 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c11bc55d-a43c-46bf-8932-396705c375b0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:43.245588 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c11bc55d-a43c-46bf-8932-396705c375b0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:43.246046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c11bc55d-a43c-46bf-8932-396705c375b0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:43.247093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c11bc55d-a43c-46bf-8932-396705c375b0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:43.248339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c11bc55d-a43c-46bf-8932-396705c375b0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:43.251326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26080a4e-457d-4927-b02c-4d5f7406dbf6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:43.252022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26080a4e-457d-4927-b02c-4d5f7406dbf6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:43.253135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26080a4e-457d-4927-b02c-4d5f7406dbf6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:43.253776 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26080a4e-457d-4927-b02c-4d5f7406dbf6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:43.479100 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c11bc55d-a43c-46bf-8932-396705c375b0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:43.481793 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-26080a4e-457d-4927-b02c-4d5f7406dbf6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:43.490058 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c11bc55d-a43c-46bf-8932-396705c375b0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 200 len: 1493 microversion: 2.1 time: 0.265164 May 27 15:06:43.490243 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-26080a4e-457d-4927-b02c-4d5f7406dbf6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.265256 May 27 15:06:43.491397 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1211/2343] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:43 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:43.503355 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1133/2344] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:43 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 1493 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:43.613075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1d77f8f9-49db-4900-898e-e0183647e4a6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:43.614171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1d77f8f9-49db-4900-898e-e0183647e4a6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:43.620958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d77f8f9-49db-4900-898e-e0183647e4a6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:43.621890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d77f8f9-49db-4900-898e-e0183647e4a6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:43.622842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d77f8f9-49db-4900-898e-e0183647e4a6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:43.623687 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d77f8f9-49db-4900-898e-e0183647e4a6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:43.789005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1d77f8f9-49db-4900-898e-e0183647e4a6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:43.796742 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1d77f8f9-49db-4900-898e-e0183647e4a6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1311 microversion: 2.1 time: 0.187454 May 27 15:06:43.797318 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1212/2345] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:43 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1311 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:43.798388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8b9b38db-ffa0-40a2-b5f7-1b57f954d806 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:43.799824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8b9b38db-ffa0-40a2-b5f7-1b57f954d806 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:43.807807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b9b38db-ffa0-40a2-b5f7-1b57f954d806 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:43.808262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b9b38db-ffa0-40a2-b5f7-1b57f954d806 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:43.809088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b9b38db-ffa0-40a2-b5f7-1b57f954d806 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:43.809527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b9b38db-ffa0-40a2-b5f7-1b57f954d806 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:43.906849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fafe2314-6fcc-4452-99be-8b311bbd1e67 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:43.908056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fafe2314-6fcc-4452-99be-8b311bbd1e67 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: b9907dbd-e85c-4b26-b80c-35d28319b5f3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:43.914901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fafe2314-6fcc-4452-99be-8b311bbd1e67 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:43.915876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fafe2314-6fcc-4452-99be-8b311bbd1e67 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:43.916691 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fafe2314-6fcc-4452-99be-8b311bbd1e67 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:43.917143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fafe2314-6fcc-4452-99be-8b311bbd1e67 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:44.053209 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8b9b38db-ffa0-40a2-b5f7-1b57f954d806 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bafe047b746dfb54a6d795292c0c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4b76a0ca994471bc3d779e67ad7bd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:44.063324 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8b9b38db-ffa0-40a2-b5f7-1b57f954d806 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 200 len: 1646 microversion: 2.1 time: 0.268940 May 27 15:06:44.063911 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1134/2346] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:43 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 1646 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:44.070952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-cb73533c-ff3b-4e68-b980-974eeeab2830 req-36079ff1-2966-46c8-8f42-e63955273f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a4ac567-1148-41b4-80eb-6fb25fae7b7c", "name": "network-vif-deleted", "tag": "103f073e-4e7b-4dab-9558-27baab47f022"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:44.081404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-cb73533c-ff3b-4e68-b980-974eeeab2830 req-36079ff1-2966-46c8-8f42-e63955273f0f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:44.081942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-cb73533c-ff3b-4e68-b980-974eeeab2830 req-36079ff1-2966-46c8-8f42-e63955273f0f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:44.099997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fafe2314-6fcc-4452-99be-8b311bbd1e67 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:44.108511 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fafe2314-6fcc-4452-99be-8b311bbd1e67 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3" status: 200 len: 1325 microversion: 2.1 time: 0.206552 May 27 15:06:44.109124 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1213/2347] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:43 2022] GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3 => generated 1325 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:44.114612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0ddf4b6e-9916-43d6-8d2f-fbe56e658b5f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:44.115232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0ddf4b6e-9916-43d6-8d2f-fbe56e658b5f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:44.121746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ddf4b6e-9916-43d6-8d2f-fbe56e658b5f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:44.122205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ddf4b6e-9916-43d6-8d2f-fbe56e658b5f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:44.123712 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-cb73533c-ff3b-4e68-b980-974eeeab2830 req-36079ff1-2966-46c8-8f42-e63955273f0f service nova] Creating event network-vif-deleted:103f073e-4e7b-4dab-9558-27baab47f022 for instance 3a4ac567-1148-41b4-80eb-6fb25fae7b7c on n-h1-843621-1 May 27 15:06:44.124962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ddf4b6e-9916-43d6-8d2f-fbe56e658b5f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:44.125421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ddf4b6e-9916-43d6-8d2f-fbe56e658b5f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:44.129423 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-cb73533c-ff3b-4e68-b980-974eeeab2830 req-36079ff1-2966-46c8-8f42-e63955273f0f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063721 May 27 15:06:44.130035 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1135/2348] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:44.258698 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0ddf4b6e-9916-43d6-8d2f-fbe56e658b5f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8920dea47a54142b7d376c36ea5ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c24fcdf60ab4259b3a15b50336e6e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:44.266301 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0ddf4b6e-9916-43d6-8d2f-fbe56e658b5f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 200 len: 1472 microversion: 2.1 time: 0.156237 May 27 15:06:44.266867 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1214/2349] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:44 2022] GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 1472 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:44.510129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-df85e00f-4032-486d-a185-b9dabffeb091 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:44.511004 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-df85e00f-4032-486d-a185-b9dabffeb091 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:44.511619 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-15d74c46-c5a5-483d-9d6f-48594caf56a2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:44.512246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-15d74c46-c5a5-483d-9d6f-48594caf56a2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:44.513788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:44.514665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=18 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:44.522693 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-15d74c46-c5a5-483d-9d6f-48594caf56a2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:44.523614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-15d74c46-c5a5-483d-9d6f-48594caf56a2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:44.524123 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df85e00f-4032-486d-a185-b9dabffeb091 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:44.524890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df85e00f-4032-486d-a185-b9dabffeb091 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:44.525016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-15d74c46-c5a5-483d-9d6f-48594caf56a2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:44.525787 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-15d74c46-c5a5-483d-9d6f-48594caf56a2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:44.526177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df85e00f-4032-486d-a185-b9dabffeb091 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:44.526885 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df85e00f-4032-486d-a185-b9dabffeb091 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:44.820015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-df85e00f-4032-486d-a185-b9dabffeb091 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:44.829395 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-df85e00f-4032-486d-a185-b9dabffeb091 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.324632 May 27 15:06:44.830645 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1136/2350] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:44 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:44.835904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-040d4155-275d-45e6-98b6-fef9d53b4c55 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:44.836403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-040d4155-275d-45e6-98b6-fef9d53b4c55 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:44.839638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-15d74c46-c5a5-483d-9d6f-48594caf56a2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:44.846454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-040d4155-275d-45e6-98b6-fef9d53b4c55 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:44.847251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-040d4155-275d-45e6-98b6-fef9d53b4c55 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:44.848170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-040d4155-275d-45e6-98b6-fef9d53b4c55 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:44.848719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-040d4155-275d-45e6-98b6-fef9d53b4c55 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:44.849433 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-15d74c46-c5a5-483d-9d6f-48594caf56a2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 200 len: 1493 microversion: 2.1 time: 0.341707 May 27 15:06:44.859992 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1215/2351] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:44 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 1493 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:45.084840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d8ffeb3a-01ab-42b6-83b6-27cd662e1ac4 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:45.087264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d8ffeb3a-01ab-42b6-83b6-27cd662e1ac4 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] [instance: 3a4ac567-1148-41b4-80eb-6fb25fae7b7c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:45.094702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-040d4155-275d-45e6-98b6-fef9d53b4c55 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:45.098350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8ffeb3a-01ab-42b6-83b6-27cd662e1ac4 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:45.101708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8ffeb3a-01ab-42b6-83b6-27cd662e1ac4 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:45.102739 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8ffeb3a-01ab-42b6-83b6-27cd662e1ac4 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:45.103349 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-040d4155-275d-45e6-98b6-fef9d53b4c55 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1311 microversion: 2.1 time: 0.271368 May 27 15:06:45.103535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8ffeb3a-01ab-42b6-83b6-27cd662e1ac4 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:45.113860 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1137/2352] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:44 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1311 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:45.126425 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-d8ffeb3a-01ab-42b6-83b6-27cd662e1ac4 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] HTTP exception thrown: Instance 3a4ac567-1148-41b4-80eb-6fb25fae7b7c could not be found. May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d8ffeb3a-01ab-42b6-83b6-27cd662e1ac4 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Request method failure captured: May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c HTTP/1.1 May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOioXW1g9zfFJmrjFPUtqf1JkPOhTiGh0dQbrGTQeVBiQ2YItsGoLEVL7FPVNVHWC47EYq5bcE4MxdYNeFr1n8wrvdpg-P9YwTSrmg95hClAZskxttqGgB6RuHmw6OrmsxIPwgD27GZbwc2vNj9QfnR_dJ1A7Lc434AgecYE4my0CB4 May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fa4b76a0ca994471bc3d779e67ad7bd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fa4b76a0ca994471bc3d779e67ad7bd8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: fa4b76a0ca994471bc3d779e67ad7bd8 May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1949508343 May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 7a3bafe047b746dfb54a6d795292c0c0 May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-SecurityGroupsTestJSON-1949508343-project May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 3a4ac567-1148-41b4-80eb-6fb25fae7b7c could not be found. May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '3a4ac567-1148-41b4-80eb-6fb25fae7b7c'} May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a4ac567-1148-41b4-80eb-6fb25fae7b7c could not be found. May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a4ac567-1148-41b4-80eb-6fb25fae7b7c could not be found. May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:45.128286 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:45.136708 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:45.136708 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:45.136708 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:45.136708 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:45.136708 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:45.136708 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a4ac567-1148-41b4-80eb-6fb25fae7b7c could not be found. May 27 15:06:45.136708 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:45.136708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d8ffeb3a-01ab-42b6-83b6-27cd662e1ac4 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Returning 404 to user: Instance 3a4ac567-1148-41b4-80eb-6fb25fae7b7c could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:45.136708 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d8ffeb3a-01ab-42b6-83b6-27cd662e1ac4 tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c" status: 404 len: 111 microversion: 2.1 time: 0.052016 May 27 15:06:45.138677 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c515e65d-db4e-4b0c-8a2c-dc86f5e070ad tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:45.138677 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c515e65d-db4e-4b0c-8a2c-dc86f5e070ad tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: b9907dbd-e85c-4b26-b80c-35d28319b5f3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:45.139033 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1216/2353] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:45 2022] GET /compute/v2.1/servers/3a4ac567-1148-41b4-80eb-6fb25fae7b7c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:45.139033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4e19f8bb-a497-4fc6-aa1d-461c5c65594f tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc78062d310>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:45.149109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c515e65d-db4e-4b0c-8a2c-dc86f5e070ad tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:45.149624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c515e65d-db4e-4b0c-8a2c-dc86f5e070ad tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:45.150657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c515e65d-db4e-4b0c-8a2c-dc86f5e070ad tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:45.151281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c515e65d-db4e-4b0c-8a2c-dc86f5e070ad tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:45.462738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c515e65d-db4e-4b0c-8a2c-dc86f5e070ad tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:45.472382 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c515e65d-db4e-4b0c-8a2c-dc86f5e070ad tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3" status: 200 len: 1523 microversion: 2.1 time: 0.350405 May 27 15:06:45.473237 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1138/2354] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:45 2022] GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3 => generated 1523 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:45.479478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4b8dfc93-1d33-4aec-8562-9b662ce20bb1 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:45.480495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4b8dfc93-1d33-4aec-8562-9b662ce20bb1 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:45.490603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b8dfc93-1d33-4aec-8562-9b662ce20bb1 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:45.490603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b8dfc93-1d33-4aec-8562-9b662ce20bb1 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:45.491887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b8dfc93-1d33-4aec-8562-9b662ce20bb1 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:45.492462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b8dfc93-1d33-4aec-8562-9b662ce20bb1 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:45.632283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4b8dfc93-1d33-4aec-8562-9b662ce20bb1 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8920dea47a54142b7d376c36ea5ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c24fcdf60ab4259b3a15b50336e6e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:45.640082 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4b8dfc93-1d33-4aec-8562-9b662ce20bb1 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 200 len: 1430 microversion: 2.1 time: 0.165578 May 27 15:06:45.640693 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1139/2355] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:45 2022] GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 1430 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:45.646694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-d9307478-dc76-4858-8f1c-770700d2f2c4 req-e3c779dd-cb34-4573-b7b0-17d44b393b81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43977f10-b575-4abc-877b-2877ded82fee", "name": "network-vif-plugged", "status": "completed", "tag": "32123a21-d6ba-4e17-af90-97a4d6efb2fa"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:45.656655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d9307478-dc76-4858-8f1c-770700d2f2c4 req-e3c779dd-cb34-4573-b7b0-17d44b393b81 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:45.658214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d9307478-dc76-4858-8f1c-770700d2f2c4 req-e3c779dd-cb34-4573-b7b0-17d44b393b81 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:45.680159 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-d9307478-dc76-4858-8f1c-770700d2f2c4 req-e3c779dd-cb34-4573-b7b0-17d44b393b81 service nova] Creating event network-vif-plugged:32123a21-d6ba-4e17-af90-97a4d6efb2fa for instance 43977f10-b575-4abc-877b-2877ded82fee on n-h2-843621-1 May 27 15:06:45.688447 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-d9307478-dc76-4858-8f1c-770700d2f2c4 req-e3c779dd-cb34-4573-b7b0-17d44b393b81 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046227 May 27 15:06:45.689251 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1140/2356] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:45.695277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-796f4dcb-28e6-4b7e-9839-269a0997820e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:45.695875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-796f4dcb-28e6-4b7e-9839-269a0997820e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: b9907dbd-e85c-4b26-b80c-35d28319b5f3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:45.698538 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4e19f8bb-a497-4fc6-aa1d-461c5c65594f tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/a123edee-d5ec-40a9-b42e-42500e205ab2" status: 202 len: 0 microversion: 2.1 time: 0.564034 May 27 15:06:45.699338 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1217/2357] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:06:45 2022] DELETE /compute/v2.1/os-security-groups/a123edee-d5ec-40a9-b42e-42500e205ab2 => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:06:45.703401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-796f4dcb-28e6-4b7e-9839-269a0997820e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:45.703864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-796f4dcb-28e6-4b7e-9839-269a0997820e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:45.704648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-796f4dcb-28e6-4b7e-9839-269a0997820e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:45.705125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-796f4dcb-28e6-4b7e-9839-269a0997820e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:45.706812 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-3bf9f2fa-394a-4f26-8d6d-f1399655aecb req-4dafb577-8160-4197-a798-4b7901087014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "841712c3-20ca-42ed-9c1f-22b88de952b6", "name": "network-vif-deleted", "tag": "13825ca0-6a05-4ba6-a741-69e4ddf343f1"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:45.718135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3bf9f2fa-394a-4f26-8d6d-f1399655aecb req-4dafb577-8160-4197-a798-4b7901087014 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:45.718816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3bf9f2fa-394a-4f26-8d6d-f1399655aecb req-4dafb577-8160-4197-a798-4b7901087014 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:45.733609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-796f4dcb-28e6-4b7e-9839-269a0997820e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: b9907dbd-e85c-4b26-b80c-35d28319b5f3] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:06:45.751681 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-3bf9f2fa-394a-4f26-8d6d-f1399655aecb req-4dafb577-8160-4197-a798-4b7901087014 service nova] Creating event network-vif-deleted:13825ca0-6a05-4ba6-a741-69e4ddf343f1 for instance 841712c3-20ca-42ed-9c1f-22b88de952b6 on n-h2-843621-1 May 27 15:06:45.757703 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-3bf9f2fa-394a-4f26-8d6d-f1399655aecb req-4dafb577-8160-4197-a798-4b7901087014 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054260 May 27 15:06:45.759811 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1218/2358] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:45.768152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:45.795236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-85b2b54b-e448-471d-bdbd-948d53dc243e tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] Calling method '.version_select at 0x7fc78062de50>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:45.846267 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-796f4dcb-28e6-4b7e-9839-269a0997820e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3" status: 204 len: 0 microversion: 2.1 time: 0.155221 May 27 15:06:45.850095 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1141/2359] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:06:45 2022] DELETE /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:06:45.856242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-793bfd44-37fa-47f1-a45c-58830f70743c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:45.858493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-793bfd44-37fa-47f1-a45c-58830f70743c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:45.866740 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-793bfd44-37fa-47f1-a45c-58830f70743c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:45.867836 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-793bfd44-37fa-47f1-a45c-58830f70743c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:45.868747 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-793bfd44-37fa-47f1-a45c-58830f70743c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:45.869322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-793bfd44-37fa-47f1-a45c-58830f70743c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:46.102022 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-793bfd44-37fa-47f1-a45c-58830f70743c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:46.110847 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-793bfd44-37fa-47f1-a45c-58830f70743c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.259055 May 27 15:06:46.111440 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1142/2360] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:45 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:46.116417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d336f0cc-1a05-459d-900c-3ee24927c0fb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:46.117067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d336f0cc-1a05-459d-900c-3ee24927c0fb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: b9907dbd-e85c-4b26-b80c-35d28319b5f3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:46.124208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d336f0cc-1a05-459d-900c-3ee24927c0fb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:46.124663 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d336f0cc-1a05-459d-900c-3ee24927c0fb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:46.125480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d336f0cc-1a05-459d-900c-3ee24927c0fb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:46.125923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d336f0cc-1a05-459d-900c-3ee24927c0fb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:46.144229 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-85b2b54b-e448-471d-bdbd-948d53dc243e tempest-SecurityGroupsTestJSON-1949508343 tempest-SecurityGroupsTestJSON-1949508343-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/bb911aef-1979-41ae-9149-3a617ed11d98" status: 202 len: 0 microversion: 2.1 time: 0.367303 May 27 15:06:46.148778 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1219/2361] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:06:45 2022] DELETE /compute/v2.1/os-security-groups/bb911aef-1979-41ae-9149-3a617ed11d98 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:06:46.154895 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-16e6af1a-9e93-4c05-b4f4-4c6c9d2081cc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:46.155742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-16e6af1a-9e93-4c05-b4f4-4c6c9d2081cc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:46.174153 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16e6af1a-9e93-4c05-b4f4-4c6c9d2081cc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:46.175307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16e6af1a-9e93-4c05-b4f4-4c6c9d2081cc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:46.177251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16e6af1a-9e93-4c05-b4f4-4c6c9d2081cc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:46.177998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16e6af1a-9e93-4c05-b4f4-4c6c9d2081cc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:46.214817 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16e6af1a-9e93-4c05-b4f4-4c6c9d2081cc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:46.215347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16e6af1a-9e93-4c05-b4f4-4c6c9d2081cc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:46.216045 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-16e6af1a-9e93-4c05-b4f4-4c6c9d2081cc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lazy-loading 'fault' on Instance uuid 841712c3-20ca-42ed-9c1f-22b88de952b6 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:06:46.274157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-16e6af1a-9e93-4c05-b4f4-4c6c9d2081cc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:46.285328 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-16e6af1a-9e93-4c05-b4f4-4c6c9d2081cc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 200 len: 1304 microversion: 2.1 time: 0.135304 May 27 15:06:46.286864 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1220/2362] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:46 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 1304 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:46.292134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-da34bdbe-7531-4f6a-9b99-e0fe0421946b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:46.294060 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-da34bdbe-7531-4f6a-9b99-e0fe0421946b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:46.302383 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da34bdbe-7531-4f6a-9b99-e0fe0421946b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:46.303034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da34bdbe-7531-4f6a-9b99-e0fe0421946b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:46.304636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da34bdbe-7531-4f6a-9b99-e0fe0421946b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:46.305228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da34bdbe-7531-4f6a-9b99-e0fe0421946b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:46.314583 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d336f0cc-1a05-459d-900c-3ee24927c0fb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:46.322700 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d336f0cc-1a05-459d-900c-3ee24927c0fb tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3" status: 200 len: 1529 microversion: 2.1 time: 0.210152 May 27 15:06:46.323458 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1143/2363] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:46 2022] GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3 => generated 1529 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:46.329044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-18183fcf-12ca-4e63-8eca-2a57a588d713 req-39e6eadf-22d5-4600-9c5a-f57bcc9290e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb464b82-c037-489f-a0ee-4008ea19886b", "name": "network-vif-deleted", "tag": "0c5e77ff-3945-4734-9d97-8d6e127cdd38"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:46.338152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-18183fcf-12ca-4e63-8eca-2a57a588d713 req-39e6eadf-22d5-4600-9c5a-f57bcc9290e4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:46.338780 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-18183fcf-12ca-4e63-8eca-2a57a588d713 req-39e6eadf-22d5-4600-9c5a-f57bcc9290e4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:46.352243 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-18183fcf-12ca-4e63-8eca-2a57a588d713 req-39e6eadf-22d5-4600-9c5a-f57bcc9290e4 service nova] Creating event network-vif-deleted:0c5e77ff-3945-4734-9d97-8d6e127cdd38 for instance fb464b82-c037-489f-a0ee-4008ea19886b on n-h2-843621-1 May 27 15:06:46.361008 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-18183fcf-12ca-4e63-8eca-2a57a588d713 req-39e6eadf-22d5-4600-9c5a-f57bcc9290e4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035908 May 27 15:06:46.362264 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1144/2364] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:46.459911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-da34bdbe-7531-4f6a-9b99-e0fe0421946b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:46.467991 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-da34bdbe-7531-4f6a-9b99-e0fe0421946b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1311 microversion: 2.1 time: 0.179497 May 27 15:06:46.468485 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1221/2365] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:46 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1311 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:46.657585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-14bae253-c095-4c5d-a4a1-7d897a75cddd tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:46.658478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-14bae253-c095-4c5d-a4a1-7d897a75cddd tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:46.665144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14bae253-c095-4c5d-a4a1-7d897a75cddd tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:46.665688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14bae253-c095-4c5d-a4a1-7d897a75cddd tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:46.666552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14bae253-c095-4c5d-a4a1-7d897a75cddd tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:46.667075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14bae253-c095-4c5d-a4a1-7d897a75cddd tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:46.701734 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14bae253-c095-4c5d-a4a1-7d897a75cddd tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:46.702289 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14bae253-c095-4c5d-a4a1-7d897a75cddd tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:46.702829 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-14bae253-c095-4c5d-a4a1-7d897a75cddd tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lazy-loading 'fault' on Instance uuid fb464b82-c037-489f-a0ee-4008ea19886b {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:06:46.747103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-14bae253-c095-4c5d-a4a1-7d897a75cddd tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8920dea47a54142b7d376c36ea5ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c24fcdf60ab4259b3a15b50336e6e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:46.755237 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-14bae253-c095-4c5d-a4a1-7d897a75cddd tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 200 len: 1306 microversion: 2.1 time: 0.101945 May 27 15:06:46.755824 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1145/2366] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:46 2022] GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 1306 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:47.131236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c0f17612-0ed5-4703-b061-2288a16c68b8 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:47.131934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c0f17612-0ed5-4703-b061-2288a16c68b8 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:47.144192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0f17612-0ed5-4703-b061-2288a16c68b8 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:47.144661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0f17612-0ed5-4703-b061-2288a16c68b8 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:47.145496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0f17612-0ed5-4703-b061-2288a16c68b8 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:47.145950 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0f17612-0ed5-4703-b061-2288a16c68b8 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:47.303653 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a31718b7-8810-45f9-bd0b-6d6ae00c5365 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:47.304288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a31718b7-8810-45f9-bd0b-6d6ae00c5365 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:47.312017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a31718b7-8810-45f9-bd0b-6d6ae00c5365 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:47.312469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a31718b7-8810-45f9-bd0b-6d6ae00c5365 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:47.313287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a31718b7-8810-45f9-bd0b-6d6ae00c5365 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:47.313725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a31718b7-8810-45f9-bd0b-6d6ae00c5365 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:47.318162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c0f17612-0ed5-4703-b061-2288a16c68b8 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:47.326196 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c0f17612-0ed5-4703-b061-2288a16c68b8 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.200796 May 27 15:06:47.336467 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1222/2367] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:47 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:47.342286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ff7af80f-f704-4090-96f1-6f725f2fa31f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:47.342907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ff7af80f-f704-4090-96f1-6f725f2fa31f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: b9907dbd-e85c-4b26-b80c-35d28319b5f3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:47.349738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff7af80f-f704-4090-96f1-6f725f2fa31f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:47.350227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff7af80f-f704-4090-96f1-6f725f2fa31f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:47.351245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff7af80f-f704-4090-96f1-6f725f2fa31f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:47.351690 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff7af80f-f704-4090-96f1-6f725f2fa31f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:47.359290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a31718b7-8810-45f9-bd0b-6d6ae00c5365 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:47.359993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a31718b7-8810-45f9-bd0b-6d6ae00c5365 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:47.360628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-a31718b7-8810-45f9-bd0b-6d6ae00c5365 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lazy-loading 'fault' on Instance uuid 841712c3-20ca-42ed-9c1f-22b88de952b6 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:06:47.407479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a31718b7-8810-45f9-bd0b-6d6ae00c5365 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:47.415531 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a31718b7-8810-45f9-bd0b-6d6ae00c5365 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 200 len: 1304 microversion: 2.1 time: 0.115900 May 27 15:06:47.416439 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1146/2368] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:47 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:47.485356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-70f40957-bcb7-4eab-a131-d997ce737b08 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:47.485978 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-70f40957-bcb7-4eab-a131-d997ce737b08 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:47.492591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70f40957-bcb7-4eab-a131-d997ce737b08 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:47.493111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70f40957-bcb7-4eab-a131-d997ce737b08 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:47.493875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70f40957-bcb7-4eab-a131-d997ce737b08 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:47.494358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70f40957-bcb7-4eab-a131-d997ce737b08 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:47.521963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ff7af80f-f704-4090-96f1-6f725f2fa31f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:47.527493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:47.534139 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ff7af80f-f704-4090-96f1-6f725f2fa31f tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3" status: 200 len: 1529 microversion: 2.1 time: 0.196116 May 27 15:06:47.534736 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1223/2369] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:47 2022] GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3 => generated 1529 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:47.773281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f9e19894-e4b0-436c-b33d-f88b4458b1c2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:47.773901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f9e19894-e4b0-436c-b33d-f88b4458b1c2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:47.783100 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9e19894-e4b0-436c-b33d-f88b4458b1c2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:47.783904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9e19894-e4b0-436c-b33d-f88b4458b1c2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:47.785208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9e19894-e4b0-436c-b33d-f88b4458b1c2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:47.785507 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9e19894-e4b0-436c-b33d-f88b4458b1c2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:47.822607 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9e19894-e4b0-436c-b33d-f88b4458b1c2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:47.823063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9e19894-e4b0-436c-b33d-f88b4458b1c2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:47.823569 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-f9e19894-e4b0-436c-b33d-f88b4458b1c2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lazy-loading 'fault' on Instance uuid fb464b82-c037-489f-a0ee-4008ea19886b {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:06:47.906911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f9e19894-e4b0-436c-b33d-f88b4458b1c2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8920dea47a54142b7d376c36ea5ac52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c24fcdf60ab4259b3a15b50336e6e22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:47.918716 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f9e19894-e4b0-436c-b33d-f88b4458b1c2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 200 len: 1306 microversion: 2.1 time: 0.149164 May 27 15:06:47.919967 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1224/2370] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:47 2022] GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 1306 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:47.967971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-70f40957-bcb7-4eab-a131-d997ce737b08 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:47.978838 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-70f40957-bcb7-4eab-a131-d997ce737b08 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1311 microversion: 2.1 time: 0.497579 May 27 15:06:47.980491 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1147/2371] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:47 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1311 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:48.343992 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1fd646cd-950e-4d14-9e48-d091760e7759 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:48.344637 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1fd646cd-950e-4d14-9e48-d091760e7759 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:48.353002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1fd646cd-950e-4d14-9e48-d091760e7759 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:48.353631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1fd646cd-950e-4d14-9e48-d091760e7759 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:48.354609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1fd646cd-950e-4d14-9e48-d091760e7759 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:48.356157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1fd646cd-950e-4d14-9e48-d091760e7759 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:48.433155 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5c360fef-80ef-4459-b094-3f102d9a090d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:48.433895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5c360fef-80ef-4459-b094-3f102d9a090d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:48.441396 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c360fef-80ef-4459-b094-3f102d9a090d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:48.441937 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c360fef-80ef-4459-b094-3f102d9a090d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:48.443085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c360fef-80ef-4459-b094-3f102d9a090d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:48.444273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c360fef-80ef-4459-b094-3f102d9a090d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:48.482652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c360fef-80ef-4459-b094-3f102d9a090d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:48.483400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c360fef-80ef-4459-b094-3f102d9a090d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:48.484082 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-5c360fef-80ef-4459-b094-3f102d9a090d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lazy-loading 'fault' on Instance uuid 841712c3-20ca-42ed-9c1f-22b88de952b6 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:06:48.555242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5c360fef-80ef-4459-b094-3f102d9a090d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:48.571450 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5c360fef-80ef-4459-b094-3f102d9a090d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 200 len: 1304 microversion: 2.1 time: 0.141309 May 27 15:06:48.572546 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1148/2372] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:48 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 1304 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:48.587050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b7507af7-8683-4399-951d-743f63f7c7ab tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:48.588014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1fd646cd-950e-4d14-9e48-d091760e7759 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:48.588387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b7507af7-8683-4399-951d-743f63f7c7ab tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: b9907dbd-e85c-4b26-b80c-35d28319b5f3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:48.595719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7507af7-8683-4399-951d-743f63f7c7ab tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:48.596440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7507af7-8683-4399-951d-743f63f7c7ab tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:48.597623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7507af7-8683-4399-951d-743f63f7c7ab tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:48.598077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7507af7-8683-4399-951d-743f63f7c7ab tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:48.601131 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1fd646cd-950e-4d14-9e48-d091760e7759 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.257699 May 27 15:06:48.602009 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1225/2373] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:48 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:48.766172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b7507af7-8683-4399-951d-743f63f7c7ab tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cb6de543d34fed9b582f5af0712790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b939a1a277f248fdaad387a445a9e780', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:48.777777 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b7507af7-8683-4399-951d-743f63f7c7ab tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3" status: 200 len: 1529 microversion: 2.1 time: 0.200179 May 27 15:06:48.778884 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1149/2374] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:48 2022] GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3 => generated 1529 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:48.940628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-238c6bfd-5eae-4e7b-8464-a6149322d2de tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:48.942045 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-238c6bfd-5eae-4e7b-8464-a6149322d2de tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:48.948504 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-238c6bfd-5eae-4e7b-8464-a6149322d2de tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:48.949015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-238c6bfd-5eae-4e7b-8464-a6149322d2de tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:48.949808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-238c6bfd-5eae-4e7b-8464-a6149322d2de tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:48.950264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-238c6bfd-5eae-4e7b-8464-a6149322d2de tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:48.968616 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-238c6bfd-5eae-4e7b-8464-a6149322d2de tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] HTTP exception thrown: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-238c6bfd-5eae-4e7b-8464-a6149322d2de tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Request method failure captured: May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b HTTP/1.1 May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOjv09MVe8XeEy7Bjf4XUNpz9TPpSt6PubYRg4q3XxMCb53pVWEJUNMmXQImS5cwFi77PMmijdya9GhlSD9guBRGNQvZe64N3sgW08THfJs6FIhJGgY0Q-gKn4PaAnGrJkLvxeyhO_11j8Es1tODZ3VsZt2uqBuIQVFSf5RNmR0Yd0k May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 1c24fcdf60ab4259b3a15b50336e6e22 May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1c24fcdf60ab4259b3a15b50336e6e22", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 1c24fcdf60ab4259b3a15b50336e6e22 May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ImagesNegativeTestJSON-800523739-project May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: d8920dea47a54142b7d376c36ea5ac52 May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ImagesNegativeTestJSON-800523739-project May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'fb464b82-c037-489f-a0ee-4008ea19886b'} May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:48.974404 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:48.979526 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:48.979526 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:48.979526 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:48.979526 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:48.979526 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:48.979526 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. May 27 15:06:48.979526 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:48.979526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-238c6bfd-5eae-4e7b-8464-a6149322d2de tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Returning 404 to user: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:48.979526 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-238c6bfd-5eae-4e7b-8464-a6149322d2de tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 404 len: 111 microversion: 2.1 time: 0.042345 May 27 15:06:48.981348 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1226/2375] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:48 2022] GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:48.987794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-55c80379-79d4-49ad-b21f-297e530136e5 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1064321467", "metadata": {"image_type": "test"}}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:48.989583 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-55c80379-79d4-49ad-b21f-297e530136e5 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:49.000151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-92a736bf-745f-4554-9b68-6cb6caa32db0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:49.002326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-92a736bf-745f-4554-9b68-6cb6caa32db0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:49.004699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-55c80379-79d4-49ad-b21f-297e530136e5 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:49.005679 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-55c80379-79d4-49ad-b21f-297e530136e5 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:49.006645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-55c80379-79d4-49ad-b21f-297e530136e5 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:49.007108 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-55c80379-79d4-49ad-b21f-297e530136e5 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:49.014250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-92a736bf-745f-4554-9b68-6cb6caa32db0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:49.015618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-92a736bf-745f-4554-9b68-6cb6caa32db0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:49.016737 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-92a736bf-745f-4554-9b68-6cb6caa32db0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:49.017398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-92a736bf-745f-4554-9b68-6cb6caa32db0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:49.037817 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-55c80379-79d4-49ad-b21f-297e530136e5 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] HTTP exception thrown: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-55c80379-79d4-49ad-b21f-297e530136e5 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Request method failure captured: May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b/action HTTP/1.1 May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 112 May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOjv09MVe8XeEy7Bjf4XUNpz9TPpSt6PubYRg4q3XxMCb53pVWEJUNMmXQImS5cwFi77PMmijdya9GhlSD9guBRGNQvZe64N3sgW08THfJs6FIhJGgY0Q-gKn4PaAnGrJkLvxeyhO_11j8Es1tODZ3VsZt2uqBuIQVFSf5RNmR0Yd0k May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1c24fcdf60ab4259b3a15b50336e6e22 May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1c24fcdf60ab4259b3a15b50336e6e22", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1c24fcdf60ab4259b3a15b50336e6e22 May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesNegativeTestJSON-800523739-project May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: d8920dea47a54142b7d376c36ea5ac52 May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesNegativeTestJSON-800523739-project May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1064321467", "metadata": {"image_type": "test"}}} May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'fb464b82-c037-489f-a0ee-4008ea19886b', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1064321467', 'metadata': {'image_type': 'test'}}}} May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 27 15:06:49.039430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:49.050586 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:49.050586 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:49.050586 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:49.050586 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. May 27 15:06:49.050586 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.050586 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:49.050586 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.050586 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.050586 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:49.050586 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:49.050586 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:49.050586 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:49.050586 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. May 27 15:06:49.050586 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.050586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-55c80379-79d4-49ad-b21f-297e530136e5 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Returning 404 to user: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:49.050586 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-55c80379-79d4-49ad-b21f-297e530136e5 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "POST /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b/action" status: 404 len: 111 microversion: 2.1 time: 0.058253 May 27 15:06:49.050586 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1150/2376] 10.222.0.13 () {60 vars in 1278 bytes} [Fri May 27 15:06:48 2022] POST /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:49.055412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a8629db6-a09e-407b-8235-17a00d81d19f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-159165263", "metadata": {"image_type": "test"}}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:49.056512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a8629db6-a09e-407b-8235-17a00d81d19f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Failed to fetch instance by id tempest-invalid-426492418 {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2926}} May 27 15:06:49.057044 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-a8629db6-a09e-407b-8235-17a00d81d19f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] HTTP exception thrown: Instance tempest-invalid-426492418 could not be found. May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a8629db6-a09e-407b-8235-17a00d81d19f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Request method failure captured: May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/tempest-invalid-426492418/action HTTP/1.1 May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 111 May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOjv09MVe8XeEy7Bjf4XUNpz9TPpSt6PubYRg4q3XxMCb53pVWEJUNMmXQImS5cwFi77PMmijdya9GhlSD9guBRGNQvZe64N3sgW08THfJs6FIhJGgY0Q-gKn4PaAnGrJkLvxeyhO_11j8Es1tODZ3VsZt2uqBuIQVFSf5RNmR0Yd0k May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1c24fcdf60ab4259b3a15b50336e6e22 May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1c24fcdf60ab4259b3a15b50336e6e22", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1c24fcdf60ab4259b3a15b50336e6e22 May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesNegativeTestJSON-800523739-project May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: d8920dea47a54142b7d376c36ea5ac52 May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesNegativeTestJSON-800523739-project May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-159165263", "metadata": {"image_type": "test"}}} May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance tempest-invalid-426492418 could not be found. May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'tempest-invalid-426492418', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-159165263', 'metadata': {'image_type': 'test'}}}} May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-426492418 could not be found. May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-426492418 could not be found. May 27 15:06:49.060357 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.065415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:49.065415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.065415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.065415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:49.065415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:49.065415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:49.065415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:49.065415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-426492418 could not be found. May 27 15:06:49.065415 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.074012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a8629db6-a09e-407b-8235-17a00d81d19f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Returning 404 to user: Instance tempest-invalid-426492418 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:49.075079 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a8629db6-a09e-407b-8235-17a00d81d19f tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "POST /compute/v2.1/servers/tempest-invalid-426492418/action" status: 404 len: 100 microversion: 2.1 time: 0.023841 May 27 15:06:49.081262 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1151/2377] 10.222.0.13 () {60 vars in 1245 bytes} [Fri May 27 15:06:49 2022] POST /compute/v2.1/servers/tempest-invalid-426492418/action => generated 100 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:49.086385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7772b39d-9843-476a-b3db-94aae99284f6 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1517790757"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:49.087625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7772b39d-9843-476a-b3db-94aae99284f6 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2926}} May 27 15:06:49.088157 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-7772b39d-9843-476a-b3db-94aae99284f6 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7772b39d-9843-476a-b3db-94aae99284f6 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Request method failure captured: May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 57 May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOjv09MVe8XeEy7Bjf4XUNpz9TPpSt6PubYRg4q3XxMCb53pVWEJUNMmXQImS5cwFi77PMmijdya9GhlSD9guBRGNQvZe64N3sgW08THfJs6FIhJGgY0Q-gKn4PaAnGrJkLvxeyhO_11j8Es1tODZ3VsZt2uqBuIQVFSf5RNmR0Yd0k May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1c24fcdf60ab4259b3a15b50336e6e22 May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1c24fcdf60ab4259b3a15b50336e6e22", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1c24fcdf60ab4259b3a15b50336e6e22 May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesNegativeTestJSON-800523739-project May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: d8920dea47a54142b7d376c36ea5ac52 May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesNegativeTestJSON-800523739-project May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: {"createImage": {"name": "tempest-test-snap-1517790757"}} May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1517790757'}}} May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 27 15:06:49.091656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.096590 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:49.096590 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.096590 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.096590 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:49.096590 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:49.096590 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:49.096590 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:49.096590 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 27 15:06:49.096590 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.098714 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7772b39d-9843-476a-b3db-94aae99284f6 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:49.099816 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7772b39d-9843-476a-b3db-94aae99284f6 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.017491 May 27 15:06:49.104996 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1152/2378] 10.222.0.13 () {60 vars in 1274 bytes} [Fri May 27 15:06:49 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:49.112492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1022a96d-064b-46fe-9cb2-c7d5dfb20fc2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-960036936"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:49.113887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1022a96d-064b-46fe-9cb2-c7d5dfb20fc2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2926}} May 27 15:06:49.114623 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-1022a96d-064b-46fe-9cb2-c7d5dfb20fc2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1022a96d-064b-46fe-9cb2-c7d5dfb20fc2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Request method failure captured: May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 56 May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOjv09MVe8XeEy7Bjf4XUNpz9TPpSt6PubYRg4q3XxMCb53pVWEJUNMmXQImS5cwFi77PMmijdya9GhlSD9guBRGNQvZe64N3sgW08THfJs6FIhJGgY0Q-gKn4PaAnGrJkLvxeyhO_11j8Es1tODZ3VsZt2uqBuIQVFSf5RNmR0Yd0k May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1c24fcdf60ab4259b3a15b50336e6e22 May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1c24fcdf60ab4259b3a15b50336e6e22", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1c24fcdf60ab4259b3a15b50336e6e22 May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesNegativeTestJSON-800523739-project May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: d8920dea47a54142b7d376c36ea5ac52 May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesNegativeTestJSON-800523739-project May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: {"createImage": {"name": "tempest-test-snap-960036936"}} May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-960036936'}}} May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 27 15:06:49.116656 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.121501 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:49.121501 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.121501 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.121501 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:49.121501 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:49.121501 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:49.121501 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:49.121501 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 27 15:06:49.121501 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.123654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1022a96d-064b-46fe-9cb2-c7d5dfb20fc2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:49.124703 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1022a96d-064b-46fe-9cb2-c7d5dfb20fc2 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.018363 May 27 15:06:49.129239 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1153/2379] 10.222.0.13 () {60 vars in 1280 bytes} [Fri May 27 15:06:49 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:49.135418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2cdda8b7-de14-4144-9520-eb84e05cb29a tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:49.136224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2cdda8b7-de14-4144-9520-eb84e05cb29a tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:49.139693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:49.145009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2cdda8b7-de14-4144-9520-eb84e05cb29a tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:49.145719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2cdda8b7-de14-4144-9520-eb84e05cb29a tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:49.146510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2cdda8b7-de14-4144-9520-eb84e05cb29a tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:49.146958 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2cdda8b7-de14-4144-9520-eb84e05cb29a tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:49.168608 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-2cdda8b7-de14-4144-9520-eb84e05cb29a tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] HTTP exception thrown: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2cdda8b7-de14-4144-9520-eb84e05cb29a tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Request method failure captured: May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b HTTP/1.1 May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOjv09MVe8XeEy7Bjf4XUNpz9TPpSt6PubYRg4q3XxMCb53pVWEJUNMmXQImS5cwFi77PMmijdya9GhlSD9guBRGNQvZe64N3sgW08THfJs6FIhJGgY0Q-gKn4PaAnGrJkLvxeyhO_11j8Es1tODZ3VsZt2uqBuIQVFSf5RNmR0Yd0k May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1c24fcdf60ab4259b3a15b50336e6e22 May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1c24fcdf60ab4259b3a15b50336e6e22", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1c24fcdf60ab4259b3a15b50336e6e22 May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesNegativeTestJSON-800523739-project May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: d8920dea47a54142b7d376c36ea5ac52 May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesNegativeTestJSON-800523739-project May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'fb464b82-c037-489f-a0ee-4008ea19886b'} May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:49.170766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:49.178272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. May 27 15:06:49.178272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.178272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:49.178272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.178272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.178272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:49.178272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:49.178272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:49.178272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:49.178272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. May 27 15:06:49.178272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.178272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2cdda8b7-de14-4144-9520-eb84e05cb29a tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Returning 404 to user: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:49.178272 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2cdda8b7-de14-4144-9520-eb84e05cb29a tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 404 len: 111 microversion: 2.1 time: 0.041683 May 27 15:06:49.178272 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1154/2380] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:06:49 2022] DELETE /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:49.181015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-47ad390d-a5d2-47fb-abca-3f08605ebb72 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:49.181605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-47ad390d-a5d2-47fb-abca-3f08605ebb72 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] [instance: fb464b82-c037-489f-a0ee-4008ea19886b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:49.188914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-47ad390d-a5d2-47fb-abca-3f08605ebb72 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:49.189370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-47ad390d-a5d2-47fb-abca-3f08605ebb72 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:49.190158 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-47ad390d-a5d2-47fb-abca-3f08605ebb72 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:49.190596 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-47ad390d-a5d2-47fb-abca-3f08605ebb72 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:49.205814 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-47ad390d-a5d2-47fb-abca-3f08605ebb72 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] HTTP exception thrown: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-47ad390d-a5d2-47fb-abca-3f08605ebb72 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Request method failure captured: May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b HTTP/1.1 May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOjv09MVe8XeEy7Bjf4XUNpz9TPpSt6PubYRg4q3XxMCb53pVWEJUNMmXQImS5cwFi77PMmijdya9GhlSD9guBRGNQvZe64N3sgW08THfJs6FIhJGgY0Q-gKn4PaAnGrJkLvxeyhO_11j8Es1tODZ3VsZt2uqBuIQVFSf5RNmR0Yd0k May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1c24fcdf60ab4259b3a15b50336e6e22 May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1c24fcdf60ab4259b3a15b50336e6e22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1c24fcdf60ab4259b3a15b50336e6e22", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1c24fcdf60ab4259b3a15b50336e6e22 May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-800523739 May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesNegativeTestJSON-800523739-project May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: d8920dea47a54142b7d376c36ea5ac52 May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesNegativeTestJSON-800523739-project May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'fb464b82-c037-489f-a0ee-4008ea19886b'} May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:49.207639 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.216634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.216634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:49.216634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:49.216634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:49.216634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:49.216634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. May 27 15:06:49.216634 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:49.216634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-47ad390d-a5d2-47fb-abca-3f08605ebb72 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] Returning 404 to user: Instance fb464b82-c037-489f-a0ee-4008ea19886b could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:49.216634 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-47ad390d-a5d2-47fb-abca-3f08605ebb72 tempest-ImagesNegativeTestJSON-800523739 tempest-ImagesNegativeTestJSON-800523739-project] 10.222.0.13 "GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b" status: 404 len: 111 microversion: 2.1 time: 0.032384 May 27 15:06:49.216634 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1155/2381] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:49 2022] GET /compute/v2.1/servers/fb464b82-c037-489f-a0ee-4008ea19886b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:49.293084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-92a736bf-745f-4554-9b68-6cb6caa32db0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:49.303875 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-92a736bf-745f-4554-9b68-6cb6caa32db0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1494 microversion: 2.1 time: 0.310180 May 27 15:06:49.304829 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1227/2382] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:48 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1494 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:49.401060 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-9d08a490-725c-4ab1-a77b-6ea915774b0e req-8c29ff3b-7503-400a-a0a5-418e92a5fc77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9907dbd-e85c-4b26-b80c-35d28319b5f3", "name": "network-vif-deleted", "tag": "53ba122e-6340-4681-a6f0-3313425f9c72"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:49.413334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:49.416355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9d08a490-725c-4ab1-a77b-6ea915774b0e req-8c29ff3b-7503-400a-a0a5-418e92a5fc77 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:49.417166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9d08a490-725c-4ab1-a77b-6ea915774b0e req-8c29ff3b-7503-400a-a0a5-418e92a5fc77 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:49.434981 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-9d08a490-725c-4ab1-a77b-6ea915774b0e req-8c29ff3b-7503-400a-a0a5-418e92a5fc77 service nova] Creating event network-vif-deleted:53ba122e-6340-4681-a6f0-3313425f9c72 for instance b9907dbd-e85c-4b26-b80c-35d28319b5f3 on n-h2-843621-1 May 27 15:06:49.440933 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-9d08a490-725c-4ab1-a77b-6ea915774b0e req-8c29ff3b-7503-400a-a0a5-418e92a5fc77 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050170 May 27 15:06:49.441882 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1228/2383] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:06:49.590002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-de950437-9b3d-4feb-acb6-1e78ca8d5d59 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:49.591500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-de950437-9b3d-4feb-acb6-1e78ca8d5d59 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:49.602177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de950437-9b3d-4feb-acb6-1e78ca8d5d59 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:49.602921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de950437-9b3d-4feb-acb6-1e78ca8d5d59 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:49.605638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de950437-9b3d-4feb-acb6-1e78ca8d5d59 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:49.606310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de950437-9b3d-4feb-acb6-1e78ca8d5d59 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:49.647831 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-de950437-9b3d-4feb-acb6-1e78ca8d5d59 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance 841712c3-20ca-42ed-9c1f-22b88de952b6 could not be found. May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-de950437-9b3d-4feb-acb6-1e78ca8d5d59 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 HTTP/1.1 May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 841712c3-20ca-42ed-9c1f-22b88de952b6 could not be found. May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '841712c3-20ca-42ed-9c1f-22b88de952b6'} May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 841712c3-20ca-42ed-9c1f-22b88de952b6 could not be found. May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 841712c3-20ca-42ed-9c1f-22b88de952b6 could not be found. May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:49.653466 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:49.659636 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:49.659636 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:49.659636 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:49.659636 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:49.659636 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:49.659636 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 841712c3-20ca-42ed-9c1f-22b88de952b6 could not be found. May 27 15:06:49.659636 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:49.663802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-de950437-9b3d-4feb-acb6-1e78ca8d5d59 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance 841712c3-20ca-42ed-9c1f-22b88de952b6 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:49.666025 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-de950437-9b3d-4feb-acb6-1e78ca8d5d59 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 404 len: 111 microversion: 2.1 time: 0.079999 May 27 15:06:49.667384 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1229/2384] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:49 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:49.675503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4618075b-6c55-4c92-8f0c-75afc1c1b84d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:49.676388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4618075b-6c55-4c92-8f0c-75afc1c1b84d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:49.683706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4618075b-6c55-4c92-8f0c-75afc1c1b84d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:49.684418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4618075b-6c55-4c92-8f0c-75afc1c1b84d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:49.685704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4618075b-6c55-4c92-8f0c-75afc1c1b84d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:49.686360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4618075b-6c55-4c92-8f0c-75afc1c1b84d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:50.045165 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a7a0ee15-1bf9-4b67-90cd-08c520fd01a0 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:50.045787 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a7a0ee15-1bf9-4b67-90cd-08c520fd01a0 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:50.056507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a7a0ee15-1bf9-4b67-90cd-08c520fd01a0 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:50.057292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a7a0ee15-1bf9-4b67-90cd-08c520fd01a0 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:50.061747 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a7a0ee15-1bf9-4b67-90cd-08c520fd01a0 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:50.062455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a7a0ee15-1bf9-4b67-90cd-08c520fd01a0 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:50.182299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4618075b-6c55-4c92-8f0c-75afc1c1b84d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:50.198352 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4618075b-6c55-4c92-8f0c-75afc1c1b84d tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1483 microversion: 2.1 time: 0.527684 May 27 15:06:50.201528 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1230/2385] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:49 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1483 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:50.216210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-99c2b8c1-14de-4fe3-8a78-70c26516254c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:50.217355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-99c2b8c1-14de-4fe3-8a78-70c26516254c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: b9907dbd-e85c-4b26-b80c-35d28319b5f3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:50.233323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99c2b8c1-14de-4fe3-8a78-70c26516254c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:50.233885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99c2b8c1-14de-4fe3-8a78-70c26516254c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:50.234683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99c2b8c1-14de-4fe3-8a78-70c26516254c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:50.235398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99c2b8c1-14de-4fe3-8a78-70c26516254c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:50.261925 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-99c2b8c1-14de-4fe3-8a78-70c26516254c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] HTTP exception thrown: Instance b9907dbd-e85c-4b26-b80c-35d28319b5f3 could not be found. May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-99c2b8c1-14de-4fe3-8a78-70c26516254c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Request method failure captured: May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3 HTTP/1.1 May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOimLUy6xqp-gD8lGFWAUihJRQaSsy_euXND3kG660I8aII4Fj7ST5KLuaskP9b7InGbbwTAnVT5MT1H-Njofjk92SIoSVXWmihhyVdCbe--Q04_qmor9yl_DFjMNoGrjAWoGuMhIp_HpJ221pj4licupaHrWSVP-C-ksMH4M8HOkGM May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b939a1a277f248fdaad387a445a9e780", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: d3cb6de543d34fed9b582f5af0712790 May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance b9907dbd-e85c-4b26-b80c-35d28319b5f3 could not be found. May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'b9907dbd-e85c-4b26-b80c-35d28319b5f3'} May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9907dbd-e85c-4b26-b80c-35d28319b5f3 could not be found. May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9907dbd-e85c-4b26-b80c-35d28319b5f3 could not be found. May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:50.264334 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:50.269743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:50.269743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:50.269743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:50.269743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:50.269743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:50.269743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:50.269743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9907dbd-e85c-4b26-b80c-35d28319b5f3 could not be found. May 27 15:06:50.269743 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:50.269743 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-99c2b8c1-14de-4fe3-8a78-70c26516254c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Returning 404 to user: Instance b9907dbd-e85c-4b26-b80c-35d28319b5f3 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:50.269743 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-99c2b8c1-14de-4fe3-8a78-70c26516254c tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3" status: 404 len: 111 microversion: 2.1 time: 0.063290 May 27 15:06:50.269743 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1231/2386] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:50 2022] GET /compute/v2.1/servers/b9907dbd-e85c-4b26-b80c-35d28319b5f3 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:50.273572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-abaf8168-7dee-4d86-af92-02ecdab08c52 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-427416838", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "a400f266-0bb2-420b-8500-ad7b63a44ef7"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:50.342587 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-abaf8168-7dee-4d86-af92-02ecdab08c52 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] validate_networks() for [('a400f266-0bb2-420b-8500-ad7b63a44ef7', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:06:50.538555 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a7a0ee15-1bf9-4b67-90cd-08c520fd01a0 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1645 microversion: 2.1 time: 1.221180 May 27 15:06:50.548985 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1156/2387] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:49 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1645 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:50.548985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bffad586-2159-46af-899d-266fb9e87617 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:50.548985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bffad586-2159-46af-899d-266fb9e87617 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:50.551850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bffad586-2159-46af-899d-266fb9e87617 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:50.552386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bffad586-2159-46af-899d-266fb9e87617 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:50.553215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bffad586-2159-46af-899d-266fb9e87617 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:50.554226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bffad586-2159-46af-899d-266fb9e87617 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:50.640736 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bffad586-2159-46af-899d-266fb9e87617 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "POST /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c/action" status: 202 len: 0 microversion: 2.1 time: 0.099428 May 27 15:06:50.644619 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1157/2388] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:06:50 2022] POST /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:06:50.665183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c970298b-7cad-4b54-9073-75fb7d34b003 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '.version_select at 0x7fc77c097040>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:50.717449 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-c970298b-7cad-4b54-9073-75fb7d34b003 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] HTTP exception thrown: Image not found. May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c970298b-7cad-4b54-9073-75fb7d34b003 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Request method failure captured: May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/images/65ad0a28-c2bc-4b82-939f-ec66a2155e2b HTTP/1.1 May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOimLUy6xqp-gD8lGFWAUihJRQaSsy_euXND3kG660I8aII4Fj7ST5KLuaskP9b7InGbbwTAnVT5MT1H-Njofjk92SIoSVXWmihhyVdCbe--Q04_qmor9yl_DFjMNoGrjAWoGuMhIp_HpJ221pj4licupaHrWSVP-C-ksMH4M8HOkGM May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b939a1a277f248fdaad387a445a9e780", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: d3cb6de543d34fed9b582f5af0712790 May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: exception: Image not found. May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '65ad0a28-c2bc-4b82-939f-ec66a2155e2b'} May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 65ad0a28-c2bc-4b82-939f-ec66a2155e2b to delete May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 65ad0a28-c2bc-4b82-939f-ec66a2155e2b could not be found. May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:50.722604 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:06:50.728358 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:50.733435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c970298b-7cad-4b54-9073-75fb7d34b003 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Returning 404 to user: Image not found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:50.735312 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c970298b-7cad-4b54-9073-75fb7d34b003 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "DELETE /compute/v2.1/images/65ad0a28-c2bc-4b82-939f-ec66a2155e2b" status: 404 len: 62 microversion: 2.1 time: 0.086533 May 27 15:06:50.736836 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1158/2389] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:50 2022] DELETE /compute/v2.1/images/65ad0a28-c2bc-4b82-939f-ec66a2155e2b => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:06:50.744205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-39dc870b-2aa6-40fe-bea5-048945275846 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:50.745421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-39dc870b-2aa6-40fe-bea5-048945275846 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:50.762004 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-39dc870b-2aa6-40fe-bea5-048945275846 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:50.763089 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-39dc870b-2aa6-40fe-bea5-048945275846 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:50.764662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-39dc870b-2aa6-40fe-bea5-048945275846 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:50.765325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-39dc870b-2aa6-40fe-bea5-048945275846 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:51.305731 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-39dc870b-2aa6-40fe-bea5-048945275846 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1645 microversion: 2.1 time: 0.567410 May 27 15:06:51.317209 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1159/2390] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:50 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1645 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:51.317209 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4b71ac13-9caf-46f1-bf00-c54276dfdd82 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:51.317209 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4b71ac13-9caf-46f1-bf00-c54276dfdd82 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:51.325240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b71ac13-9caf-46f1-bf00-c54276dfdd82 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:51.326341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b71ac13-9caf-46f1-bf00-c54276dfdd82 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:51.327712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b71ac13-9caf-46f1-bf00-c54276dfdd82 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:51.328408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b71ac13-9caf-46f1-bf00-c54276dfdd82 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:51.403349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-abaf8168-7dee-4d86-af92-02ecdab08c52 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:06:51.403933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-abaf8168-7dee-4d86-af92-02ecdab08c52 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:06:51.404455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-abaf8168-7dee-4d86-af92-02ecdab08c52 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:06:51.404971 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-abaf8168-7dee-4d86-af92-02ecdab08c52 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:06:51.405487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-abaf8168-7dee-4d86-af92-02ecdab08c52 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:06:51.416703 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-abaf8168-7dee-4d86-af92-02ecdab08c52 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:51.417596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-abaf8168-7dee-4d86-af92-02ecdab08c52 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:51.418866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-abaf8168-7dee-4d86-af92-02ecdab08c52 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:51.419885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-abaf8168-7dee-4d86-af92-02ecdab08c52 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:51.558802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4b71ac13-9caf-46f1-bf00-c54276dfdd82 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:51.570099 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4b71ac13-9caf-46f1-bf00-c54276dfdd82 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1491 microversion: 2.1 time: 0.260866 May 27 15:06:51.571024 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1160/2391] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:51 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1491 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:51.592404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4d151d58-b9de-4f04-867c-537d6d8fba00 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:51.593417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4d151d58-b9de-4f04-867c-537d6d8fba00 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:51.605443 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4d151d58-b9de-4f04-867c-537d6d8fba00 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:51.606342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4d151d58-b9de-4f04-867c-537d6d8fba00 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:51.608314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4d151d58-b9de-4f04-867c-537d6d8fba00 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:51.609099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4d151d58-b9de-4f04-867c-537d6d8fba00 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:51.639539 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-4d151d58-b9de-4f04-867c-537d6d8fba00 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] HTTP exception thrown: Instance 2719794f-cbe2-4bfa-a24f-18a461655423 could not be found. May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4d151d58-b9de-4f04-867c-537d6d8fba00 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Request method failure captured: May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 HTTP/1.1 May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOimLUy6xqp-gD8lGFWAUihJRQaSsy_euXND3kG660I8aII4Fj7ST5KLuaskP9b7InGbbwTAnVT5MT1H-Njofjk92SIoSVXWmihhyVdCbe--Q04_qmor9yl_DFjMNoGrjAWoGuMhIp_HpJ221pj4licupaHrWSVP-C-ksMH4M8HOkGM May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b939a1a277f248fdaad387a445a9e780", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: d3cb6de543d34fed9b582f5af0712790 May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 2719794f-cbe2-4bfa-a24f-18a461655423 could not be found. May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '2719794f-cbe2-4bfa-a24f-18a461655423'} May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2719794f-cbe2-4bfa-a24f-18a461655423 could not be found. May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:51.644391 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:51.650210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2719794f-cbe2-4bfa-a24f-18a461655423 could not be found. May 27 15:06:51.650210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:51.650210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:51.650210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:51.650210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:51.650210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:51.650210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:51.650210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:51.650210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:51.650210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2719794f-cbe2-4bfa-a24f-18a461655423 could not be found. May 27 15:06:51.650210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:51.650210 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4d151d58-b9de-4f04-867c-537d6d8fba00 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Returning 404 to user: Instance 2719794f-cbe2-4bfa-a24f-18a461655423 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:51.650210 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4d151d58-b9de-4f04-867c-537d6d8fba00 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 404 len: 111 microversion: 2.1 time: 0.059566 May 27 15:06:51.650210 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1161/2392] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:06:51 2022] DELETE /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:51.709672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-abaf8168-7dee-4d86-af92-02ecdab08c52 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Getting quotas for project 37b5a0b0723a46c1b0755e824e32b776. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:06:51.715198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-abaf8168-7dee-4d86-af92-02ecdab08c52 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Getting quotas for user 0536f4a5547545acaa06b6aad5d1fbe4 and project 37b5a0b0723a46c1b0755e824e32b776. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:06:51.731432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-abaf8168-7dee-4d86-af92-02ecdab08c52 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:06:51.737550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-abaf8168-7dee-4d86-af92-02ecdab08c52 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:06:51.817885 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-abaf8168-7dee-4d86-af92-02ecdab08c52 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.545080 May 27 15:06:51.823578 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1232/2393] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:06:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:06:51.828466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-07ee31e5-08b8-4e6c-b155-33088d2dcc8d tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:51.830807 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:06:51.830807 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:06:51.832121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-07ee31e5-08b8-4e6c-b155-33088d2dcc8d tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:51.832589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-07ee31e5-08b8-4e6c-b155-33088d2dcc8d tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:51.833433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-07ee31e5-08b8-4e6c-b155-33088d2dcc8d tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:51.833996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-07ee31e5-08b8-4e6c-b155-33088d2dcc8d tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:51.842924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8257f460-1656-47d4-8360-14a9d06b7b74 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-2131950579", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:51.881743 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-07ee31e5-08b8-4e6c-b155-33088d2dcc8d tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.061834 May 27 15:06:51.890192 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1233/2394] 10.222.0.13 () {58 vars in 1175 bytes} [Fri May 27 15:06:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:51.896185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee73d0b8-1eea-4f26-9a18-fc09e83adf44 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:51.897272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ee73d0b8-1eea-4f26-9a18-fc09e83adf44 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: 2719794f-cbe2-4bfa-a24f-18a461655423] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:51.905593 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee73d0b8-1eea-4f26-9a18-fc09e83adf44 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:51.906589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee73d0b8-1eea-4f26-9a18-fc09e83adf44 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:51.907648 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee73d0b8-1eea-4f26-9a18-fc09e83adf44 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:51.908428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee73d0b8-1eea-4f26-9a18-fc09e83adf44 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:51.924626 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-8257f460-1656-47d4-8360-14a9d06b7b74 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] validate_networks() for None {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:06:51.936320 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-ee73d0b8-1eea-4f26-9a18-fc09e83adf44 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] HTTP exception thrown: Instance 2719794f-cbe2-4bfa-a24f-18a461655423 could not be found. May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee73d0b8-1eea-4f26-9a18-fc09e83adf44 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Request method failure captured: May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 HTTP/1.1 May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOimLUy6xqp-gD8lGFWAUihJRQaSsy_euXND3kG660I8aII4Fj7ST5KLuaskP9b7InGbbwTAnVT5MT1H-Njofjk92SIoSVXWmihhyVdCbe--Q04_qmor9yl_DFjMNoGrjAWoGuMhIp_HpJ221pj4licupaHrWSVP-C-ksMH4M8HOkGM May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b939a1a277f248fdaad387a445a9e780", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: d3cb6de543d34fed9b582f5af0712790 May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 2719794f-cbe2-4bfa-a24f-18a461655423 could not be found. May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '2719794f-cbe2-4bfa-a24f-18a461655423'} May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2719794f-cbe2-4bfa-a24f-18a461655423 could not be found. May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2719794f-cbe2-4bfa-a24f-18a461655423 could not be found. May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:51.937994 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:51.943470 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:51.943470 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:51.943470 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:51.943470 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:51.943470 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:51.943470 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:51.943470 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2719794f-cbe2-4bfa-a24f-18a461655423 could not be found. May 27 15:06:51.943470 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:06:51.943470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee73d0b8-1eea-4f26-9a18-fc09e83adf44 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Returning 404 to user: Instance 2719794f-cbe2-4bfa-a24f-18a461655423 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:51.943470 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ee73d0b8-1eea-4f26-9a18-fc09e83adf44 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423" status: 404 len: 111 microversion: 2.1 time: 0.050636 May 27 15:06:51.943470 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1234/2395] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:51 2022] GET /compute/v2.1/servers/2719794f-cbe2-4bfa-a24f-18a461655423 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:51.948179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a6c2d91b-99ab-4992-a2c8-d7519232c0c1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:51.950936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a6c2d91b-99ab-4992-a2c8-d7519232c0c1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:52.057288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a6c2d91b-99ab-4992-a2c8-d7519232c0c1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:52.068055 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a6c2d91b-99ab-4992-a2c8-d7519232c0c1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1214 microversion: 2.1 time: 0.120873 May 27 15:06:52.068645 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1235/2396] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:51 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:52.083006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f8428f0c-4d90-4cc1-a8bd-d3571daf1efc tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843621-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:52.084296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f8428f0c-4d90-4cc1-a8bd-d3571daf1efc tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:52.101000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8428f0c-4d90-4cc1-a8bd-d3571daf1efc tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:52.101528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8428f0c-4d90-4cc1-a8bd-d3571daf1efc tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:52.102327 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8428f0c-4d90-4cc1-a8bd-d3571daf1efc tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:52.102771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8428f0c-4d90-4cc1-a8bd-d3571daf1efc tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:52.139251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-f8428f0c-4d90-4cc1-a8bd-d3571daf1efc tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lazy-loading 'flavor' on Instance uuid 43977f10-b575-4abc-877b-2877ded82fee {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:06:52.158541 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f8428f0c-4d90-4cc1-a8bd-d3571daf1efc tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Going to try to live migrate instance to n-h1-843621-1 {{(pid=119248) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 27 15:06:52.813446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-8257f460-1656-47d4-8360-14a9d06b7b74 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:06:52.813971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-8257f460-1656-47d4-8360-14a9d06b7b74 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:06:52.814414 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-8257f460-1656-47d4-8360-14a9d06b7b74 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:06:52.814844 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-8257f460-1656-47d4-8360-14a9d06b7b74 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:06:52.815266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-8257f460-1656-47d4-8360-14a9d06b7b74 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:06:52.833708 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8257f460-1656-47d4-8360-14a9d06b7b74 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:52.834737 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8257f460-1656-47d4-8360-14a9d06b7b74 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:52.836143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8257f460-1656-47d4-8360-14a9d06b7b74 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:52.850632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8257f460-1656-47d4-8360-14a9d06b7b74 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:52.897946 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-8257f460-1656-47d4-8360-14a9d06b7b74 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Getting quotas for project 6f9f274a9b24495fa40d9c8be7dcc3d5. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:06:52.905174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-8257f460-1656-47d4-8360-14a9d06b7b74 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Getting quotas for user e745803913eb40a9bb7fb90f59d574c9 and project 6f9f274a9b24495fa40d9c8be7dcc3d5. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:06:52.921018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8257f460-1656-47d4-8360-14a9d06b7b74 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:06:52.924452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8257f460-1656-47d4-8360-14a9d06b7b74 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:06:52.976475 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8257f460-1656-47d4-8360-14a9d06b7b74 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.327640 May 27 15:06:52.977160 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1162/2397] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:06:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:06:52.987285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-22fe74a7-27b7-46a7-b94d-c9361ff2d5d6 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '.version_select at 0x7fc77c0eb700>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:53.011821 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-22fe74a7-27b7-46a7-b94d-c9361ff2d5d6 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741623972" status: 202 len: 0 microversion: 2.1 time: 0.029932 May 27 15:06:53.013089 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1163/2398] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 27 15:06:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741623972 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:06:53.036099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-eb4b4f3b-7f56-4142-80a5-17762b6706ea tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:53.036637 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-eb4b4f3b-7f56-4142-80a5-17762b6706ea tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:53.053748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb4b4f3b-7f56-4142-80a5-17762b6706ea tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:53.054245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb4b4f3b-7f56-4142-80a5-17762b6706ea tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:53.055044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb4b4f3b-7f56-4142-80a5-17762b6706ea tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:53.055496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb4b4f3b-7f56-4142-80a5-17762b6706ea tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:53.087341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:53.095310 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-eb4b4f3b-7f56-4142-80a5-17762b6706ea tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/ips" status: 200 len: 152 microversion: 2.20 time: 0.081100 May 27 15:06:53.096223 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1164/2399] 10.222.0.13 () {60 vars in 1288 bytes} [Fri May 27 15:06:53 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/ips => generated 152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:06:53.116980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-def1c2bc-afbf-4eb6-964a-8370f49d4de2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:53.120604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-def1c2bc-afbf-4eb6-964a-8370f49d4de2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:53.141462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-def1c2bc-afbf-4eb6-964a-8370f49d4de2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:53.143901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-def1c2bc-afbf-4eb6-964a-8370f49d4de2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:53.146123 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-def1c2bc-afbf-4eb6-964a-8370f49d4de2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:53.148056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-def1c2bc-afbf-4eb6-964a-8370f49d4de2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:53.643970 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-def1c2bc-afbf-4eb6-964a-8370f49d4de2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:53.657615 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-def1c2bc-afbf-4eb6-964a-8370f49d4de2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1491 microversion: 2.1 time: 0.559942 May 27 15:06:53.663510 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1165/2400] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:53 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1491 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:53.682082 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-23cc435d-ba38-43d6-bb50-2c51c4408d72 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:53.692763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-23cc435d-ba38-43d6-bb50-2c51c4408d72 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:53.844762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-23cc435d-ba38-43d6-bb50-2c51c4408d72 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:53.857931 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-23cc435d-ba38-43d6-bb50-2c51c4408d72 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1217 microversion: 2.1 time: 0.190982 May 27 15:06:53.858534 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1166/2401] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:53 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1217 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:53.874075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1cb84ad4-1257-48ab-a82a-ff03891e94e7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:53.875963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1cb84ad4-1257-48ab-a82a-ff03891e94e7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:53.902575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1cb84ad4-1257-48ab-a82a-ff03891e94e7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:53.903010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1cb84ad4-1257-48ab-a82a-ff03891e94e7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:53.904355 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1cb84ad4-1257-48ab-a82a-ff03891e94e7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:53.904829 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1cb84ad4-1257-48ab-a82a-ff03891e94e7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:54.285994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1cb84ad4-1257-48ab-a82a-ff03891e94e7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:54.296292 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1cb84ad4-1257-48ab-a82a-ff03891e94e7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1272 microversion: 2.1 time: 0.432460 May 27 15:06:54.300844 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1167/2402] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:53 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1272 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:54.518604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-59abc84e-667b-44a8-8e17-ef83117f5889 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '.version_select at 0x7fc7776e2f70>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:54.545636 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-59abc84e-667b-44a8-8e17-ef83117f5889 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] HTTP exception thrown: Image not found. May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-59abc84e-667b-44a8-8e17-ef83117f5889 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Request method failure captured: May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/images/2796f171-e60a-4cc2-acc8-57001c0c699d HTTP/1.1 May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOimLUy6xqp-gD8lGFWAUihJRQaSsy_euXND3kG660I8aII4Fj7ST5KLuaskP9b7InGbbwTAnVT5MT1H-Njofjk92SIoSVXWmihhyVdCbe--Q04_qmor9yl_DFjMNoGrjAWoGuMhIp_HpJ221pj4licupaHrWSVP-C-ksMH4M8HOkGM May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b939a1a277f248fdaad387a445a9e780", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: d3cb6de543d34fed9b582f5af0712790 May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: exception: Image not found. May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '2796f171-e60a-4cc2-acc8-57001c0c699d'} May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2796f171-e60a-4cc2-acc8-57001c0c699d to delete May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2796f171-e60a-4cc2-acc8-57001c0c699d could not be found. May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:54.553614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:54.560543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-59abc84e-667b-44a8-8e17-ef83117f5889 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Returning 404 to user: Image not found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:54.562667 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-59abc84e-667b-44a8-8e17-ef83117f5889 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "DELETE /compute/v2.1/images/2796f171-e60a-4cc2-acc8-57001c0c699d" status: 404 len: 62 microversion: 2.1 time: 0.046336 May 27 15:06:54.566938 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1168/2403] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:54 2022] DELETE /compute/v2.1/images/2796f171-e60a-4cc2-acc8-57001c0c699d => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 27 15:06:54.572126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-df995c05-55fd-44e4-8ab8-8d8770873a58 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:54.585483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-df995c05-55fd-44e4-8ab8-8d8770873a58 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:54.593862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df995c05-55fd-44e4-8ab8-8d8770873a58 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:54.594680 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df995c05-55fd-44e4-8ab8-8d8770873a58 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:54.596419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df995c05-55fd-44e4-8ab8-8d8770873a58 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:54.597273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df995c05-55fd-44e4-8ab8-8d8770873a58 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:54.614567 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f8428f0c-4d90-4cc1-a8bd-d3571daf1efc tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee/action" status: 202 len: 0 microversion: 2.1 time: 2.544315 May 27 15:06:54.623779 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1236/2404] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:06:52 2022] POST /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee/action => generated 0 bytes in 2554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:06:54.635388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b70a015c-03e4-4abd-b13f-355de757677a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:54.636990 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-df995c05-55fd-44e4-8ab8-8d8770873a58 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] HTTP exception thrown: Instance c473f1c8-4e5d-4141-94e1-0bc0af40797e could not be found. May 27 15:06:54.640107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b70a015c-03e4-4abd-b13f-355de757677a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-df995c05-55fd-44e4-8ab8-8d8770873a58 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Request method failure captured: May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e HTTP/1.1 May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOimLUy6xqp-gD8lGFWAUihJRQaSsy_euXND3kG660I8aII4Fj7ST5KLuaskP9b7InGbbwTAnVT5MT1H-Njofjk92SIoSVXWmihhyVdCbe--Q04_qmor9yl_DFjMNoGrjAWoGuMhIp_HpJ221pj4licupaHrWSVP-C-ksMH4M8HOkGM May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b939a1a277f248fdaad387a445a9e780", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: d3cb6de543d34fed9b582f5af0712790 May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance c473f1c8-4e5d-4141-94e1-0bc0af40797e could not be found. May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'c473f1c8-4e5d-4141-94e1-0bc0af40797e'} May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c473f1c8-4e5d-4141-94e1-0bc0af40797e could not be found. May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:54.641272 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:54.645848 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c473f1c8-4e5d-4141-94e1-0bc0af40797e could not be found. May 27 15:06:54.645848 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:54.645848 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:54.645848 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:54.645848 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:54.645848 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:54.645848 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:54.645848 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:54.645848 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:54.645848 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c473f1c8-4e5d-4141-94e1-0bc0af40797e could not be found. May 27 15:06:54.645848 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:54.650134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-df995c05-55fd-44e4-8ab8-8d8770873a58 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Returning 404 to user: Instance c473f1c8-4e5d-4141-94e1-0bc0af40797e could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:54.651328 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-df995c05-55fd-44e4-8ab8-8d8770873a58 tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 404 len: 111 microversion: 2.1 time: 0.083111 May 27 15:06:54.655208 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1169/2405] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:06:54 2022] DELETE /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:54.662854 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-507f59e3-d88d-4940-b19b-58f2da8eb32e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:54.666528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-507f59e3-d88d-4940-b19b-58f2da8eb32e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] [instance: c473f1c8-4e5d-4141-94e1-0bc0af40797e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:54.673346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-507f59e3-d88d-4940-b19b-58f2da8eb32e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:54.674219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-507f59e3-d88d-4940-b19b-58f2da8eb32e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:54.675273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-507f59e3-d88d-4940-b19b-58f2da8eb32e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:54.675996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-507f59e3-d88d-4940-b19b-58f2da8eb32e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:54.683210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b70a015c-03e4-4abd-b13f-355de757677a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:54.683545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b70a015c-03e4-4abd-b13f-355de757677a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:54.684284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b70a015c-03e4-4abd-b13f-355de757677a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:54.685295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b70a015c-03e4-4abd-b13f-355de757677a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:54.694402 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-507f59e3-d88d-4940-b19b-58f2da8eb32e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] HTTP exception thrown: Instance c473f1c8-4e5d-4141-94e1-0bc0af40797e could not be found. May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-507f59e3-d88d-4940-b19b-58f2da8eb32e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Request method failure captured: May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e HTTP/1.1 May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOimLUy6xqp-gD8lGFWAUihJRQaSsy_euXND3kG660I8aII4Fj7ST5KLuaskP9b7InGbbwTAnVT5MT1H-Njofjk92SIoSVXWmihhyVdCbe--Q04_qmor9yl_DFjMNoGrjAWoGuMhIp_HpJ221pj4licupaHrWSVP-C-ksMH4M8HOkGM May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b939a1a277f248fdaad387a445a9e780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b939a1a277f248fdaad387a445a9e780", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: b939a1a277f248fdaad387a445a9e780 May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837 May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: d3cb6de543d34fed9b582f5af0712790 May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1992258837-project May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance c473f1c8-4e5d-4141-94e1-0bc0af40797e could not be found. May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'c473f1c8-4e5d-4141-94e1-0bc0af40797e'} May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c473f1c8-4e5d-4141-94e1-0bc0af40797e could not be found. May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c473f1c8-4e5d-4141-94e1-0bc0af40797e could not be found. May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:54.696628 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:06:54.701840 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:54.701840 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:06:54.701840 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:06:54.701840 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:06:54.701840 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:06:54.701840 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:06:54.701840 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c473f1c8-4e5d-4141-94e1-0bc0af40797e could not be found. May 27 15:06:54.701840 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:06:54.704485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-507f59e3-d88d-4940-b19b-58f2da8eb32e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] Returning 404 to user: Instance c473f1c8-4e5d-4141-94e1-0bc0af40797e could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:06:54.705690 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-507f59e3-d88d-4940-b19b-58f2da8eb32e tempest-ImagesOneServerNegativeTestJSON-1992258837 tempest-ImagesOneServerNegativeTestJSON-1992258837-project] 10.222.0.13 "GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e" status: 404 len: 111 microversion: 2.1 time: 0.046704 May 27 15:06:54.706815 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1170/2406] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:54 2022] GET /compute/v2.1/servers/c473f1c8-4e5d-4141-94e1-0bc0af40797e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:06:54.712417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0637003c-22eb-49c3-bf65-e4b54db51a92 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:54.713722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0637003c-22eb-49c3-bf65-e4b54db51a92 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:54.720534 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0637003c-22eb-49c3-bf65-e4b54db51a92 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:54.721487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0637003c-22eb-49c3-bf65-e4b54db51a92 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:54.722696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0637003c-22eb-49c3-bf65-e4b54db51a92 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:54.723910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0637003c-22eb-49c3-bf65-e4b54db51a92 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:55.475825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b70a015c-03e4-4abd-b13f-355de757677a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:55.488987 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b70a015c-03e4-4abd-b13f-355de757677a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1504 microversion: 2.1 time: 0.860527 May 27 15:06:55.496165 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1237/2407] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:54 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1504 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:55.508163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-df7176ef-b016-418e-88fc-9608cb9cf3d1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:55.509273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-df7176ef-b016-418e-88fc-9608cb9cf3d1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:55.526537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df7176ef-b016-418e-88fc-9608cb9cf3d1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:55.530376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df7176ef-b016-418e-88fc-9608cb9cf3d1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:55.533438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df7176ef-b016-418e-88fc-9608cb9cf3d1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:55.548629 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df7176ef-b016-418e-88fc-9608cb9cf3d1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:55.764835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0637003c-22eb-49c3-bf65-e4b54db51a92 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:55.766637 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-df7176ef-b016-418e-88fc-9608cb9cf3d1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:55.789066 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-df7176ef-b016-418e-88fc-9608cb9cf3d1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1275 microversion: 2.1 time: 0.290741 May 27 15:06:55.790059 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1238/2408] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:55 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1275 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:55.800230 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0637003c-22eb-49c3-bf65-e4b54db51a92 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1497 microversion: 2.1 time: 1.085830 May 27 15:06:55.800230 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1171/2409] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:54 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1497 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:55.800482 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8e8ba08e-d77f-457b-888e-87656e54d453 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:55.800482 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8e8ba08e-d77f-457b-888e-87656e54d453 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:55.816632 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e8ba08e-d77f-457b-888e-87656e54d453 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:55.817150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e8ba08e-d77f-457b-888e-87656e54d453 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:55.818028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e8ba08e-d77f-457b-888e-87656e54d453 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:55.818641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e8ba08e-d77f-457b-888e-87656e54d453 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:55.821636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-85a13bea-d5f6-4562-aab4-cb3eda91c8e6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:55.822573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-85a13bea-d5f6-4562-aab4-cb3eda91c8e6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:55.836436 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85a13bea-d5f6-4562-aab4-cb3eda91c8e6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:55.845930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85a13bea-d5f6-4562-aab4-cb3eda91c8e6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:55.847093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85a13bea-d5f6-4562-aab4-cb3eda91c8e6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:55.847661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85a13bea-d5f6-4562-aab4-cb3eda91c8e6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:55.930397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-85a13bea-d5f6-4562-aab4-cb3eda91c8e6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:06:56.085970 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-85a13bea-d5f6-4562-aab4-cb3eda91c8e6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "DELETE /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 204 len: 0 microversion: 2.1 time: 0.270763 May 27 15:06:56.090190 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1172/2410] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:06:55 2022] DELETE /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:06:56.099536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e291da87-5ad8-4d97-a017-92b2f624e4b6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:56.102593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e291da87-5ad8-4d97-a017-92b2f624e4b6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:56.110327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e291da87-5ad8-4d97-a017-92b2f624e4b6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:56.111571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e291da87-5ad8-4d97-a017-92b2f624e4b6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:56.113125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e291da87-5ad8-4d97-a017-92b2f624e4b6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:56.114108 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e291da87-5ad8-4d97-a017-92b2f624e4b6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:56.254806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8e8ba08e-d77f-457b-888e-87656e54d453 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:56.291643 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8e8ba08e-d77f-457b-888e-87656e54d453 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1314 microversion: 2.1 time: 0.500281 May 27 15:06:56.295805 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1239/2411] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:55 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:56.379751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e291da87-5ad8-4d97-a017-92b2f624e4b6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:56.389448 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e291da87-5ad8-4d97-a017-92b2f624e4b6 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.295992 May 27 15:06:56.390574 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1173/2412] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:56 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:56.506601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-26831241-cd54-4dde-921b-7326f521b447 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:56.507353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-26831241-cd54-4dde-921b-7326f521b447 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:56.521463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26831241-cd54-4dde-921b-7326f521b447 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:56.521929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26831241-cd54-4dde-921b-7326f521b447 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:56.522847 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26831241-cd54-4dde-921b-7326f521b447 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:56.523397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26831241-cd54-4dde-921b-7326f521b447 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:56.562056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3fe0c80b-e854-4315-a23f-93d9fe2e4a41 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:56.563874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3fe0c80b-e854-4315-a23f-93d9fe2e4a41 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:56.578278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fe0c80b-e854-4315-a23f-93d9fe2e4a41 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:56.579260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fe0c80b-e854-4315-a23f-93d9fe2e4a41 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:56.580427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fe0c80b-e854-4315-a23f-93d9fe2e4a41 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:56.581088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fe0c80b-e854-4315-a23f-93d9fe2e4a41 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:56.617221 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-3fe0c80b-e854-4315-a23f-93d9fe2e4a41 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lazy-loading 'flavor' on Instance uuid 3d17a653-7f3e-44d7-9b89-68b4b35c9175 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:06:56.746803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-26831241-cd54-4dde-921b-7326f521b447 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:56.766410 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-26831241-cd54-4dde-921b-7326f521b447 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1504 microversion: 2.1 time: 0.264209 May 27 15:06:56.767890 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1240/2413] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:56 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:56.848145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-700714f0-495e-4de4-8844-561cf1339779 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:56.848145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-700714f0-495e-4de4-8844-561cf1339779 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:56.848145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-700714f0-495e-4de4-8844-561cf1339779 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:56.848145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-700714f0-495e-4de4-8844-561cf1339779 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:56.848145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-700714f0-495e-4de4-8844-561cf1339779 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:56.848145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-700714f0-495e-4de4-8844-561cf1339779 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:56.975864 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-700714f0-495e-4de4-8844-561cf1339779 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:56.986477 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-700714f0-495e-4de4-8844-561cf1339779 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1275 microversion: 2.1 time: 0.181251 May 27 15:06:56.987992 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1241/2414] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:56 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1275 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:57.138066 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3fe0c80b-e854-4315-a23f-93d9fe2e4a41 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "POST /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/action" status: 202 len: 0 microversion: 2.20 time: 0.581182 May 27 15:06:57.140056 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1174/2415] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 27 15:06:56 2022] POST /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 27 15:06:57.148046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e82215b0-6a07-4dfe-81f2-f9b585091a59 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:57.148835 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e82215b0-6a07-4dfe-81f2-f9b585091a59 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:57.157189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e82215b0-6a07-4dfe-81f2-f9b585091a59 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:57.157714 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e82215b0-6a07-4dfe-81f2-f9b585091a59 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:57.158520 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e82215b0-6a07-4dfe-81f2-f9b585091a59 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:57.158968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e82215b0-6a07-4dfe-81f2-f9b585091a59 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:57.312210 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6ed7d2cd-212d-4bfe-b8c9-a06102e6ba14 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:57.312947 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6ed7d2cd-212d-4bfe-b8c9-a06102e6ba14 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:57.321801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ed7d2cd-212d-4bfe-b8c9-a06102e6ba14 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:57.322453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ed7d2cd-212d-4bfe-b8c9-a06102e6ba14 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:57.323356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ed7d2cd-212d-4bfe-b8c9-a06102e6ba14 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:57.324072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ed7d2cd-212d-4bfe-b8c9-a06102e6ba14 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:57.565084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e82215b0-6a07-4dfe-81f2-f9b585091a59 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:57.570938 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6ed7d2cd-212d-4bfe-b8c9-a06102e6ba14 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:57.579689 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e82215b0-6a07-4dfe-81f2-f9b585091a59 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:57.579901 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6ed7d2cd-212d-4bfe-b8c9-a06102e6ba14 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1314 microversion: 2.1 time: 0.271931 May 27 15:06:57.581675 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e82215b0-6a07-4dfe-81f2-f9b585091a59 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:57.585560 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e82215b0-6a07-4dfe-81f2-f9b585091a59 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1724 microversion: 2.20 time: 0.442263 May 27 15:06:57.587089 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1242/2416] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:57 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1724 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:06:57.589614 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1175/2417] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:57 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:57.594870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ea92c6c2-9011-4ae1-899e-32470e98e656 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:57.598277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ea92c6c2-9011-4ae1-899e-32470e98e656 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:57.606355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea92c6c2-9011-4ae1-899e-32470e98e656 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:57.606890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea92c6c2-9011-4ae1-899e-32470e98e656 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:57.607696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea92c6c2-9011-4ae1-899e-32470e98e656 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:57.608165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea92c6c2-9011-4ae1-899e-32470e98e656 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:57.725325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-44c94ffe-49c0-4949-80c1-3ec577ba07a0 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Action: 'create', calling method: .version_select at 0x7fc7772adf70>, body: {"keypair": {"name": "tempest-keypair-982888786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj9CuJjJNC9DGJXo19GUpIoVaGNgJlFj2b62+W3DokiaGdD6EO/JAIZIwaLR/LKoQbO14NeMjXbu3CqQV0nTDY4FQ6ovNYiXo0LNB3IbtrXCjhAi6vjBI0c3fASwCxhcQ=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:57.771949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ea92c6c2-9011-4ae1-899e-32470e98e656 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:57.775951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-44c94ffe-49c0-4949-80c1-3ec577ba07a0 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Getting quotas for project 6d729d0442554ca5a662cfabb7ea425b. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:06:57.776074 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:57.783805 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ea92c6c2-9011-4ae1-899e-32470e98e656 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.195520 May 27 15:06:57.784905 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1243/2418] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:57 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:57.790605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-02ce77a0-5faf-46da-b2a8-f96c6ea4cc8b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:57.791399 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-02ce77a0-5faf-46da-b2a8-f96c6ea4cc8b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:57.795086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-44c94ffe-49c0-4949-80c1-3ec577ba07a0 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Getting quotas for user c0b6df1a680e498b8f9014995a93f261 and project 6d729d0442554ca5a662cfabb7ea425b. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:06:57.803919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02ce77a0-5faf-46da-b2a8-f96c6ea4cc8b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:57.804388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02ce77a0-5faf-46da-b2a8-f96c6ea4cc8b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:57.805670 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02ce77a0-5faf-46da-b2a8-f96c6ea4cc8b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:57.806352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02ce77a0-5faf-46da-b2a8-f96c6ea4cc8b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:57.844139 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-44c94ffe-49c0-4949-80c1-3ec577ba07a0 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.194280 May 27 15:06:57.847467 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1176/2419] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:06:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:06:57.984859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-02ce77a0-5faf-46da-b2a8-f96c6ea4cc8b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:58.006397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bf01e30e-a372-45c1-9b3c-f5f4ff2fb4f7 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:58.007343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bf01e30e-a372-45c1-9b3c-f5f4ff2fb4f7 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:58.011847 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-02ce77a0-5faf-46da-b2a8-f96c6ea4cc8b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1504 microversion: 2.1 time: 0.225200 May 27 15:06:58.012406 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1244/2420] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:57 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1504 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:58.031159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf01e30e-a372-45c1-9b3c-f5f4ff2fb4f7 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:58.032393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf01e30e-a372-45c1-9b3c-f5f4ff2fb4f7 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:58.033497 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf01e30e-a372-45c1-9b3c-f5f4ff2fb4f7 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:58.033981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf01e30e-a372-45c1-9b3c-f5f4ff2fb4f7 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:58.158342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bf01e30e-a372-45c1-9b3c-f5f4ff2fb4f7 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:58.173126 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bf01e30e-a372-45c1-9b3c-f5f4ff2fb4f7 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1275 microversion: 2.1 time: 0.170039 May 27 15:06:58.174329 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1177/2421] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:57 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1275 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:58.596815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8eb417e3-ad44-4939-8df8-54c5b4be3049 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:58.597441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8eb417e3-ad44-4939-8df8-54c5b4be3049 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:58.606259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3559dca3-7b7a-46a4-9105-4cda71f7bba5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:58.607053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3559dca3-7b7a-46a4-9105-4cda71f7bba5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:58.621391 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8eb417e3-ad44-4939-8df8-54c5b4be3049 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:58.626161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8eb417e3-ad44-4939-8df8-54c5b4be3049 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:58.629462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3559dca3-7b7a-46a4-9105-4cda71f7bba5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:58.630323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3559dca3-7b7a-46a4-9105-4cda71f7bba5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:58.630978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8eb417e3-ad44-4939-8df8-54c5b4be3049 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:58.631757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3559dca3-7b7a-46a4-9105-4cda71f7bba5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:58.632431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3559dca3-7b7a-46a4-9105-4cda71f7bba5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:58.634105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8eb417e3-ad44-4939-8df8-54c5b4be3049 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:59.081301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8eb417e3-ad44-4939-8df8-54c5b4be3049 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:59.089733 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8eb417e3-ad44-4939-8df8-54c5b4be3049 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1314 microversion: 2.1 time: 0.496845 May 27 15:06:59.092300 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1245/2422] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:58 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:59.103559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-945a2f50-583a-4176-bf59-be5803b2ee28 req-12d68e89-5e5d-4632-9850-f572cc506f63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43977f10-b575-4abc-877b-2877ded82fee", "name": "network-vif-unplugged", "status": "completed", "tag": "32123a21-d6ba-4e17-af90-97a4d6efb2fa"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:59.126650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-945a2f50-583a-4176-bf59-be5803b2ee28 req-12d68e89-5e5d-4632-9850-f572cc506f63 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:59.127256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-945a2f50-583a-4176-bf59-be5803b2ee28 req-12d68e89-5e5d-4632-9850-f572cc506f63 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:59.154398 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-945a2f50-583a-4176-bf59-be5803b2ee28 req-12d68e89-5e5d-4632-9850-f572cc506f63 service nova] Creating event network-vif-unplugged:32123a21-d6ba-4e17-af90-97a4d6efb2fa for instance 43977f10-b575-4abc-877b-2877ded82fee on n-h2-843621-1 May 27 15:06:59.164105 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-945a2f50-583a-4176-bf59-be5803b2ee28 req-12d68e89-5e5d-4632-9850-f572cc506f63 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068875 May 27 15:06:59.165717 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1246/2423] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:59.168550 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3559dca3-7b7a-46a4-9105-4cda71f7bba5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:59.174186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8e1fdd24-8721-470b-bc1d-7be26f691799 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:59.175746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8e1fdd24-8721-470b-bc1d-7be26f691799 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:59.181874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3559dca3-7b7a-46a4-9105-4cda71f7bba5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:59.183444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3559dca3-7b7a-46a4-9105-4cda71f7bba5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:59.187303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e1fdd24-8721-470b-bc1d-7be26f691799 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:59.187771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e1fdd24-8721-470b-bc1d-7be26f691799 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:59.188592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e1fdd24-8721-470b-bc1d-7be26f691799 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:59.189105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e1fdd24-8721-470b-bc1d-7be26f691799 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:59.189268 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3559dca3-7b7a-46a4-9105-4cda71f7bba5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1724 microversion: 2.20 time: 0.587316 May 27 15:06:59.200931 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1178/2424] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:06:58 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1724 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:06:59.206585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-17ed7930-1566-42cc-b568-a3057a0b703c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:59.207223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-17ed7930-1566-42cc-b568-a3057a0b703c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:59.226690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17ed7930-1566-42cc-b568-a3057a0b703c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:59.227473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17ed7930-1566-42cc-b568-a3057a0b703c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:59.228485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17ed7930-1566-42cc-b568-a3057a0b703c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:59.229136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17ed7930-1566-42cc-b568-a3057a0b703c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:59.539595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-17ed7930-1566-42cc-b568-a3057a0b703c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:59.557941 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-17ed7930-1566-42cc-b568-a3057a0b703c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1504 microversion: 2.1 time: 0.358948 May 27 15:06:59.559018 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1179/2425] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:59 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1504 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:59.567402 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b9cd129e-d516-4703-909f-fe6e2da4dae5 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:59.573159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b9cd129e-d516-4703-909f-fe6e2da4dae5 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:06:59.586404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8e1fdd24-8721-470b-bc1d-7be26f691799 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:06:59.606520 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8e1fdd24-8721-470b-bc1d-7be26f691799 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.435040 May 27 15:06:59.607340 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1247/2426] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:59 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:06:59.608542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9cd129e-d516-4703-909f-fe6e2da4dae5 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:59.609897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9cd129e-d516-4703-909f-fe6e2da4dae5 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:59.610965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9cd129e-d516-4703-909f-fe6e2da4dae5 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:06:59.611821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9cd129e-d516-4703-909f-fe6e2da4dae5 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:06:59.994792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b9cd129e-d516-4703-909f-fe6e2da4dae5 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:00.011254 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b9cd129e-d516-4703-909f-fe6e2da4dae5 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1317 microversion: 2.1 time: 0.450951 May 27 15:07:00.012472 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1180/2427] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:06:59 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:00.108819 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b9ef41dc-8d51-45f0-bf31-84d922a92db2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:00.109341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b9ef41dc-8d51-45f0-bf31-84d922a92db2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:00.116592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9ef41dc-8d51-45f0-bf31-84d922a92db2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:00.118408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9ef41dc-8d51-45f0-bf31-84d922a92db2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:00.119430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9ef41dc-8d51-45f0-bf31-84d922a92db2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:00.120307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9ef41dc-8d51-45f0-bf31-84d922a92db2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:00.219046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-56d77086-8d45-4de4-b32f-e74eba100d93 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:00.222133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-56d77086-8d45-4de4-b32f-e74eba100d93 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:00.263888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56d77086-8d45-4de4-b32f-e74eba100d93 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:00.264957 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56d77086-8d45-4de4-b32f-e74eba100d93 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:00.267942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56d77086-8d45-4de4-b32f-e74eba100d93 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:00.273868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56d77086-8d45-4de4-b32f-e74eba100d93 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:00.565766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b9ef41dc-8d51-45f0-bf31-84d922a92db2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:00.579362 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b9ef41dc-8d51-45f0-bf31-84d922a92db2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1314 microversion: 2.1 time: 0.474545 May 27 15:07:00.591223 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1248/2428] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:00 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:00.597181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b1345d5d-101d-4ed0-b6eb-43cdbe9e83ec tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:00.598059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b1345d5d-101d-4ed0-b6eb-43cdbe9e83ec tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:00.604931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b1345d5d-101d-4ed0-b6eb-43cdbe9e83ec tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:00.605842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b1345d5d-101d-4ed0-b6eb-43cdbe9e83ec tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:00.607486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b1345d5d-101d-4ed0-b6eb-43cdbe9e83ec tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:00.608133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b1345d5d-101d-4ed0-b6eb-43cdbe9e83ec tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:00.735659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-56d77086-8d45-4de4-b32f-e74eba100d93 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:00.753377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-56d77086-8d45-4de4-b32f-e74eba100d93 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:00.755860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-56d77086-8d45-4de4-b32f-e74eba100d93 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:00.757808 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-56d77086-8d45-4de4-b32f-e74eba100d93 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1724 microversion: 2.20 time: 0.548207 May 27 15:07:00.762148 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1181/2429] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:00 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1724 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:00.774543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-192bf91f-2f64-48f5-ba8e-7a66bb5ac48c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:00.776101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-192bf91f-2f64-48f5-ba8e-7a66bb5ac48c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:00.795544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-192bf91f-2f64-48f5-ba8e-7a66bb5ac48c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:00.796595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-192bf91f-2f64-48f5-ba8e-7a66bb5ac48c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:00.797628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-192bf91f-2f64-48f5-ba8e-7a66bb5ac48c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:00.798260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-192bf91f-2f64-48f5-ba8e-7a66bb5ac48c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:00.804121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:00.953195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b1345d5d-101d-4ed0-b6eb-43cdbe9e83ec tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:00.973380 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b1345d5d-101d-4ed0-b6eb-43cdbe9e83ec tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1504 microversion: 2.1 time: 0.380192 May 27 15:07:00.974680 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1249/2430] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:00 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1504 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:01.039813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7dc44ea8-a012-49cb-93d3-535b0cf40120 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:01.040283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7dc44ea8-a012-49cb-93d3-535b0cf40120 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:01.055027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7dc44ea8-a012-49cb-93d3-535b0cf40120 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:01.056568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7dc44ea8-a012-49cb-93d3-535b0cf40120 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:01.058951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7dc44ea8-a012-49cb-93d3-535b0cf40120 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:01.059914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7dc44ea8-a012-49cb-93d3-535b0cf40120 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:01.162321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-192bf91f-2f64-48f5-ba8e-7a66bb5ac48c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:01.173951 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-192bf91f-2f64-48f5-ba8e-7a66bb5ac48c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 200 len: 1503 microversion: 2.1 time: 0.409606 May 27 15:07:01.183889 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1182/2431] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:00 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 1503 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:01.311210 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-bea425e5-076d-48a3-8f25-d9673865bd9a req-6724a0ab-4ca6-4c4e-a837-b193d5c12a6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1852d307-f34e-4a53-942f-145d41dc5c24", "tag": "0d3395a1-3889-43d9-8af7-cd140f2fee10"}, {"name": "network-changed", "server_uuid": "43977f10-b575-4abc-877b-2877ded82fee", "tag": "32123a21-d6ba-4e17-af90-97a4d6efb2fa"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:01.359237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-bea425e5-076d-48a3-8f25-d9673865bd9a req-6724a0ab-4ca6-4c4e-a837-b193d5c12a6c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:01.360369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-bea425e5-076d-48a3-8f25-d9673865bd9a req-6724a0ab-4ca6-4c4e-a837-b193d5c12a6c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:01.387409 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-bea425e5-076d-48a3-8f25-d9673865bd9a req-6724a0ab-4ca6-4c4e-a837-b193d5c12a6c service nova] Creating event network-changed:0d3395a1-3889-43d9-8af7-cd140f2fee10 for instance 1852d307-f34e-4a53-942f-145d41dc5c24 on n-h1-843621-1 May 27 15:07:01.389020 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-bea425e5-076d-48a3-8f25-d9673865bd9a req-6724a0ab-4ca6-4c4e-a837-b193d5c12a6c service nova] Creating event network-changed:32123a21-d6ba-4e17-af90-97a4d6efb2fa for instance 43977f10-b575-4abc-877b-2877ded82fee on n-h2-843621-1 May 27 15:07:01.397217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7dc44ea8-a012-49cb-93d3-535b0cf40120 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:01.406349 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-bea425e5-076d-48a3-8f25-d9673865bd9a req-6724a0ab-4ca6-4c4e-a837-b193d5c12a6c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.101555 May 27 15:07:01.407407 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1183/2432] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:01.409360 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7dc44ea8-a012-49cb-93d3-535b0cf40120 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1317 microversion: 2.1 time: 0.382012 May 27 15:07:01.410217 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1250/2433] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:01 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1317 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:01.597152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-833d13ba-3856-42db-946a-394da763b299 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:01.597781 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-833d13ba-3856-42db-946a-394da763b299 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:01.604150 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-833d13ba-3856-42db-946a-394da763b299 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:01.604606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-833d13ba-3856-42db-946a-394da763b299 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:01.605407 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-833d13ba-3856-42db-946a-394da763b299 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:01.605849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-833d13ba-3856-42db-946a-394da763b299 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:01.778082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ed1c5133-c601-48f4-b3f4-9ceb1909c6ba tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:01.778742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ed1c5133-c601-48f4-b3f4-9ceb1909c6ba tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:01.791315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed1c5133-c601-48f4-b3f4-9ceb1909c6ba tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:01.791930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed1c5133-c601-48f4-b3f4-9ceb1909c6ba tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:01.793262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed1c5133-c601-48f4-b3f4-9ceb1909c6ba tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:01.793846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed1c5133-c601-48f4-b3f4-9ceb1909c6ba tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:01.850316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:01.904942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-833d13ba-3856-42db-946a-394da763b299 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:01.915152 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-833d13ba-3856-42db-946a-394da763b299 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1314 microversion: 2.1 time: 0.322294 May 27 15:07:01.917101 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1184/2434] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:01 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:01.995543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-45138492-43d8-445a-9516-18ee51bc4a75 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:02.007689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-45138492-43d8-445a-9516-18ee51bc4a75 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:02.026339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45138492-43d8-445a-9516-18ee51bc4a75 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:02.027166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45138492-43d8-445a-9516-18ee51bc4a75 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:02.029851 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45138492-43d8-445a-9516-18ee51bc4a75 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:02.030567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45138492-43d8-445a-9516-18ee51bc4a75 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:02.062319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=8 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:02.338724 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ed1c5133-c601-48f4-b3f4-9ceb1909c6ba tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:02.377316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ed1c5133-c601-48f4-b3f4-9ceb1909c6ba tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:02.382549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ed1c5133-c601-48f4-b3f4-9ceb1909c6ba tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:02.385579 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ed1c5133-c601-48f4-b3f4-9ceb1909c6ba tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1724 microversion: 2.20 time: 0.610515 May 27 15:07:02.387081 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1251/2435] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:01 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1724 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:02.415319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-18198800-056c-4567-88e5-2e1cf69937d1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:02.431641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-18198800-056c-4567-88e5-2e1cf69937d1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: 054d9c3e-3968-4177-9ea6-5bb30613592c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:02.443309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18198800-056c-4567-88e5-2e1cf69937d1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:02.444002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18198800-056c-4567-88e5-2e1cf69937d1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:02.445078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18198800-056c-4567-88e5-2e1cf69937d1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:02.445736 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18198800-056c-4567-88e5-2e1cf69937d1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:02.471609 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-18198800-056c-4567-88e5-2e1cf69937d1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] HTTP exception thrown: Instance 054d9c3e-3968-4177-9ea6-5bb30613592c could not be found. May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-18198800-056c-4567-88e5-2e1cf69937d1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Request method failure captured: May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c HTTP/1.1 May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOiEZT_yUznL02JYnyfFpY5-AqbXTycrqZemwYdK6I1pwkUoe4d_DShOP-5yrVGZ1_NnulsAuqgehzk6xpTfuh6BBeddIJGDMEcn2G1d52QwVzD0bofDJR1kxquy9KQSHmIVIeCyrMuJT8-TSQhgmDkIpYR58yoeXGnbFeKL-JmPAtc May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: b31e7608039c4158936369f57b31cf55 May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerRescueTestJSON-576962126 May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b31e7608039c4158936369f57b31cf55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b31e7608039c4158936369f57b31cf55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b31e7608039c4158936369f57b31cf55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b31e7608039c4158936369f57b31cf55", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerRescueTestJSON-576962126 May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: b31e7608039c4158936369f57b31cf55 May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerRescueTestJSON-576962126 May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerRescueTestJSON-576962126-project May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: a8a53f4308e94cc1af6516680c0f2a47 May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerRescueTestJSON-576962126-project May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 054d9c3e-3968-4177-9ea6-5bb30613592c could not be found. May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '054d9c3e-3968-4177-9ea6-5bb30613592c'} May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 054d9c3e-3968-4177-9ea6-5bb30613592c could not be found. May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 054d9c3e-3968-4177-9ea6-5bb30613592c could not be found. May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:02.475085 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:02.478976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:02.478976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:02.478976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:02.478976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:07:02.478976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:07:02.478976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 054d9c3e-3968-4177-9ea6-5bb30613592c could not be found. May 27 15:07:02.478976 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:02.481009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-18198800-056c-4567-88e5-2e1cf69937d1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Returning 404 to user: Instance 054d9c3e-3968-4177-9ea6-5bb30613592c could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:07:02.483446 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-18198800-056c-4567-88e5-2e1cf69937d1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c" status: 404 len: 111 microversion: 2.1 time: 0.091858 May 27 15:07:02.484638 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1252/2436] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:02 2022] GET /compute/v2.1/servers/054d9c3e-3968-4177-9ea6-5bb30613592c => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:07:02.493224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6479a9eb-4c5b-4709-84ce-bd1b6fb72b79 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:02.494274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6479a9eb-4c5b-4709-84ce-bd1b6fb72b79 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:02.521946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6479a9eb-4c5b-4709-84ce-bd1b6fb72b79 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:02.522505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6479a9eb-4c5b-4709-84ce-bd1b6fb72b79 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:02.523362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6479a9eb-4c5b-4709-84ce-bd1b6fb72b79 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:02.523829 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6479a9eb-4c5b-4709-84ce-bd1b6fb72b79 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:02.726624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-45138492-43d8-445a-9516-18ee51bc4a75 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:02.736396 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-45138492-43d8-445a-9516-18ee51bc4a75 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1504 microversion: 2.1 time: 0.749700 May 27 15:07:02.739786 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1185/2437] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:01 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1504 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:02.748907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e8cfb048-bd83-48b1-99e3-b0585e034130 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:02.749684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e8cfb048-bd83-48b1-99e3-b0585e034130 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:02.756442 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8cfb048-bd83-48b1-99e3-b0585e034130 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:02.757291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8cfb048-bd83-48b1-99e3-b0585e034130 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:02.758503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8cfb048-bd83-48b1-99e3-b0585e034130 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:02.759421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8cfb048-bd83-48b1-99e3-b0585e034130 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:02.807413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e8cfb048-bd83-48b1-99e3-b0585e034130 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:07:02.870125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:02.904370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:02.920430 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e8cfb048-bd83-48b1-99e3-b0585e034130 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 204 len: 0 microversion: 2.1 time: 0.178679 May 27 15:07:02.921311 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1186/2438] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:07:02 2022] DELETE /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:07:02.936925 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6479a9eb-4c5b-4709-84ce-bd1b6fb72b79 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:02.948282 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6479a9eb-4c5b-4709-84ce-bd1b6fb72b79 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1317 microversion: 2.1 time: 0.462008 May 27 15:07:02.949343 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1253/2439] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:02 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:02.971453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d65a77c2-3a78-41a3-9763-aa3c4d269d5d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "e07de2f5-c0f3-42c0-9a3e-43ec95204347"}], "security_groups": [{"name": "tempest-securitygroup--233981010"}], "key_name": "tempest-keypair-982888786", "user_data": "}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:03.106169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-26bd9479-62ee-4b7a-997a-4362a87b66ea tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Action: 'create', calling method: .version_select at 0x7fc7776e28b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1374203573", "description": "tempest-description-745214818"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:03.345855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-d65a77c2-3a78-41a3-9763-aa3c4d269d5d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] validate_networks() for [('e07de2f5-c0f3-42c0-9a3e-43ec95204347', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:07:03.620920 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-26bd9479-62ee-4b7a-997a-4362a87b66ea tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.698336 May 27 15:07:03.621535 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1187/2440] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:07:02 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:03.628136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d42d0b58-0de7-4132-8bf9-414273cf72f3 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:03.629023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d42d0b58-0de7-4132-8bf9-414273cf72f3 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:03.639710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d42d0b58-0de7-4132-8bf9-414273cf72f3 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:03.640172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d42d0b58-0de7-4132-8bf9-414273cf72f3 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:03.641018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d42d0b58-0de7-4132-8bf9-414273cf72f3 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:03.641485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d42d0b58-0de7-4132-8bf9-414273cf72f3 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:03.938195 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d42d0b58-0de7-4132-8bf9-414273cf72f3 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:03.945971 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d42d0b58-0de7-4132-8bf9-414273cf72f3 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1491 microversion: 2.1 time: 0.323376 May 27 15:07:03.946544 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1188/2441] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:03 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1491 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:03.951033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-784a9915-2ce4-4db2-b7ba-526baaae7b8f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:03.951648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-784a9915-2ce4-4db2-b7ba-526baaae7b8f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:03.958952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-784a9915-2ce4-4db2-b7ba-526baaae7b8f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:03.959411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-784a9915-2ce4-4db2-b7ba-526baaae7b8f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:03.960182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-784a9915-2ce4-4db2-b7ba-526baaae7b8f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:03.960621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-784a9915-2ce4-4db2-b7ba-526baaae7b8f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:04.265881 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-d65a77c2-3a78-41a3-9763-aa3c4d269d5d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:07:04.266351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-d65a77c2-3a78-41a3-9763-aa3c4d269d5d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:07:04.266915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-d65a77c2-3a78-41a3-9763-aa3c4d269d5d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:07:04.267511 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-d65a77c2-3a78-41a3-9763-aa3c4d269d5d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:07:04.268016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-d65a77c2-3a78-41a3-9763-aa3c4d269d5d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:07:04.274993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-784a9915-2ce4-4db2-b7ba-526baaae7b8f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:04.277364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d65a77c2-3a78-41a3-9763-aa3c4d269d5d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:04.278021 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d65a77c2-3a78-41a3-9763-aa3c4d269d5d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:04.279071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d65a77c2-3a78-41a3-9763-aa3c4d269d5d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:04.279664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d65a77c2-3a78-41a3-9763-aa3c4d269d5d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:04.282987 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-784a9915-2ce4-4db2-b7ba-526baaae7b8f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1314 microversion: 2.1 time: 0.335304 May 27 15:07:04.292649 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1189/2442] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:03 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:04.292649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a6be472f-c7f2-4770-87ea-97da1c09fc47 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:04.292649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a6be472f-c7f2-4770-87ea-97da1c09fc47 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:04.296560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a6be472f-c7f2-4770-87ea-97da1c09fc47 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:04.297045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a6be472f-c7f2-4770-87ea-97da1c09fc47 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:04.297814 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a6be472f-c7f2-4770-87ea-97da1c09fc47 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:04.298120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-d65a77c2-3a78-41a3-9763-aa3c4d269d5d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Getting quotas for project 6d729d0442554ca5a662cfabb7ea425b. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:07:04.298663 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a6be472f-c7f2-4770-87ea-97da1c09fc47 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:04.303674 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-d65a77c2-3a78-41a3-9763-aa3c4d269d5d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Getting quotas for user c0b6df1a680e498b8f9014995a93f261 and project 6d729d0442554ca5a662cfabb7ea425b. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:07:04.317918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d65a77c2-3a78-41a3-9763-aa3c4d269d5d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:07:04.320255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d65a77c2-3a78-41a3-9763-aa3c4d269d5d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:07:04.379746 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d65a77c2-3a78-41a3-9763-aa3c4d269d5d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.416936 May 27 15:07:04.380406 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1254/2443] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:07:02 2022] POST /compute/v2.1/servers => generated 408 bytes in 1418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:07:04.389862 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-0cd5f787-208f-4ec9-8917-503e8e906092 req-4ef70f44-7793-47e7-8776-3104fab3088e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "054d9c3e-3968-4177-9ea6-5bb30613592c", "name": "network-vif-deleted", "tag": "7163613f-892d-4157-b0e8-eda1dbd40060"}, {"name": "network-changed", "server_uuid": "d9604d14-4598-4d42-8bbf-8763103061a4", "tag": "648e11b1-5568-4d40-a6cd-7e3f346ef13b"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:04.400548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0cd5f787-208f-4ec9-8917-503e8e906092 req-4ef70f44-7793-47e7-8776-3104fab3088e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:04.401036 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0cd5f787-208f-4ec9-8917-503e8e906092 req-4ef70f44-7793-47e7-8776-3104fab3088e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:04.415624 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-0cd5f787-208f-4ec9-8917-503e8e906092 req-4ef70f44-7793-47e7-8776-3104fab3088e service nova] Creating event network-vif-deleted:7163613f-892d-4157-b0e8-eda1dbd40060 for instance 054d9c3e-3968-4177-9ea6-5bb30613592c on n-h2-843621-1 May 27 15:07:04.416538 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-0cd5f787-208f-4ec9-8917-503e8e906092 req-4ef70f44-7793-47e7-8776-3104fab3088e service nova] Creating event network-changed:648e11b1-5568-4d40-a6cd-7e3f346ef13b for instance d9604d14-4598-4d42-8bbf-8763103061a4 on n-h1-843621-1 May 27 15:07:04.428215 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-0cd5f787-208f-4ec9-8917-503e8e906092 req-4ef70f44-7793-47e7-8776-3104fab3088e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.046043 May 27 15:07:04.429211 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1255/2444] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:04.436119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-62fe3fcd-7f85-4f5f-9e02-2ce3bca45caa tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Action: 'create', calling method: .version_select at 0x7fc7807b6940>, body: {"security_group_rule": {"parent_group_id": "b3d7a197-f9cb-42a7-acc3-7aa0b1363dab", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:04.546159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a6be472f-c7f2-4770-87ea-97da1c09fc47 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:04.554508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a6be472f-c7f2-4770-87ea-97da1c09fc47 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:04.556210 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a6be472f-c7f2-4770-87ea-97da1c09fc47 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:04.557579 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a6be472f-c7f2-4770-87ea-97da1c09fc47 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1724 microversion: 2.20 time: 0.272635 May 27 15:07:04.558311 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1190/2445] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:04 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:04.563259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e8ad8eb8-fca2-41c1-a63d-41a42b22508f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:04.564238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e8ad8eb8-fca2-41c1-a63d-41a42b22508f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:04.570799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8ad8eb8-fca2-41c1-a63d-41a42b22508f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:04.571441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8ad8eb8-fca2-41c1-a63d-41a42b22508f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:04.572372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8ad8eb8-fca2-41c1-a63d-41a42b22508f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:04.573021 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8ad8eb8-fca2-41c1-a63d-41a42b22508f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:04.849872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e8ad8eb8-fca2-41c1-a63d-41a42b22508f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:04.860577 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e8ad8eb8-fca2-41c1-a63d-41a42b22508f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1504 microversion: 2.1 time: 0.300651 May 27 15:07:04.861266 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1191/2446] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:04 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1504 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:04.875793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fcd24047-1ca1-4cf8-a902-4acaeac5f490 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:04.877566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fcd24047-1ca1-4cf8-a902-4acaeac5f490 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:04.885232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fcd24047-1ca1-4cf8-a902-4acaeac5f490 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:04.885729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fcd24047-1ca1-4cf8-a902-4acaeac5f490 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:04.887414 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fcd24047-1ca1-4cf8-a902-4acaeac5f490 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:04.888994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fcd24047-1ca1-4cf8-a902-4acaeac5f490 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:04.978520 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-62fe3fcd-7f85-4f5f-9e02-2ce3bca45caa tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.547661 May 27 15:07:04.979334 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1256/2447] 10.222.0.13 () {60 vars in 1194 bytes} [Fri May 27 15:07:04 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:04.984074 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c962f800-749b-4b4b-9746-b0ebffbd29c5 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:04.984915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c962f800-749b-4b4b-9746-b0ebffbd29c5 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:04.992413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c962f800-749b-4b4b-9746-b0ebffbd29c5 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:04.993156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c962f800-749b-4b4b-9746-b0ebffbd29c5 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:04.994709 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c962f800-749b-4b4b-9746-b0ebffbd29c5 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:04.995444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c962f800-749b-4b4b-9746-b0ebffbd29c5 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:05.088859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c962f800-749b-4b4b-9746-b0ebffbd29c5 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b6df1a680e498b8f9014995a93f261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d729d0442554ca5a662cfabb7ea425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:05.101208 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c962f800-749b-4b4b-9746-b0ebffbd29c5 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87" status: 200 len: 1221 microversion: 2.1 time: 0.120680 May 27 15:07:05.104613 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1257/2448] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:04 2022] GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 => generated 1221 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:05.112110 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1210f5a7-b28b-4562-90f2-932c20741629 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:05.112779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1210f5a7-b28b-4562-90f2-932c20741629 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:05.123109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1210f5a7-b28b-4562-90f2-932c20741629 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:05.123804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1210f5a7-b28b-4562-90f2-932c20741629 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:05.124834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1210f5a7-b28b-4562-90f2-932c20741629 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:05.125524 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1210f5a7-b28b-4562-90f2-932c20741629 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:05.189126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fcd24047-1ca1-4cf8-a902-4acaeac5f490 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:05.197479 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fcd24047-1ca1-4cf8-a902-4acaeac5f490 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1317 microversion: 2.1 time: 0.326057 May 27 15:07:05.198055 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1192/2449] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:04 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:05.203251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ad056a01-1192-4c99-a34c-2a786a11eea4 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Action: 'create', calling method: .version_select at 0x7fc780704f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-986537345", "description": "tempest-description-761731280"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:05.362686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1210f5a7-b28b-4562-90f2-932c20741629 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:05.371163 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1210f5a7-b28b-4562-90f2-932c20741629 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1491 microversion: 2.1 time: 0.265468 May 27 15:07:05.371746 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1258/2450] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:05 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1491 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:05.376871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b903d8b5-422f-4772-8b20-bb7b4c745656 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:05.377636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b903d8b5-422f-4772-8b20-bb7b4c745656 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:05.383599 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b903d8b5-422f-4772-8b20-bb7b4c745656 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:05.384095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b903d8b5-422f-4772-8b20-bb7b4c745656 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:05.384894 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b903d8b5-422f-4772-8b20-bb7b4c745656 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:05.385355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b903d8b5-422f-4772-8b20-bb7b4c745656 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:05.474102 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ad056a01-1192-4c99-a34c-2a786a11eea4 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.274924 May 27 15:07:05.474744 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1193/2451] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:07:05 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:05.486068 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-10ab0041-bdb3-4f02-99d5-fdf1372af7b4 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Action: 'create', calling method: .version_select at 0x7fc77c0ebc10>, body: {"security_group_rule": {"parent_group_id": "fed77f2f-58dc-4ad8-90f4-4ca20870a3fa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:05.623383 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b903d8b5-422f-4772-8b20-bb7b4c745656 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:05.634380 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b903d8b5-422f-4772-8b20-bb7b4c745656 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1314 microversion: 2.1 time: 0.260980 May 27 15:07:05.634978 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1259/2452] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:05 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:05.650355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a4a585ea-5c93-4711-9c0b-3da2c05772e7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:05.653706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a4a585ea-5c93-4711-9c0b-3da2c05772e7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:05.663173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4a585ea-5c93-4711-9c0b-3da2c05772e7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:05.664046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4a585ea-5c93-4711-9c0b-3da2c05772e7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:05.665076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4a585ea-5c93-4711-9c0b-3da2c05772e7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:05.665690 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4a585ea-5c93-4711-9c0b-3da2c05772e7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:05.992957 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-10ab0041-bdb3-4f02-99d5-fdf1372af7b4 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.511105 May 27 15:07:05.994083 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1194/2453] 10.222.0.13 () {60 vars in 1194 bytes} [Fri May 27 15:07:05 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:07:06.007459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a4a585ea-5c93-4711-9c0b-3da2c05772e7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:06.013184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d094c990-3949-4ec1-9399-b46c1c8821f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:06.015398 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d094c990-3949-4ec1-9399-b46c1c8821f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:06.019270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a4a585ea-5c93-4711-9c0b-3da2c05772e7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:06.021199 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a4a585ea-5c93-4711-9c0b-3da2c05772e7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:06.023117 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a4a585ea-5c93-4711-9c0b-3da2c05772e7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1724 microversion: 2.20 time: 0.386987 May 27 15:07:06.024222 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1260/2454] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:05 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1724 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:06.030843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d094c990-3949-4ec1-9399-b46c1c8821f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:06.032144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d094c990-3949-4ec1-9399-b46c1c8821f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:06.033238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d094c990-3949-4ec1-9399-b46c1c8821f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:06.034294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d094c990-3949-4ec1-9399-b46c1c8821f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:06.038519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c9e7e958-8d37-404a-adfb-6ef931b12e8b tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Action: 'create', calling method: .version_select at 0x7fc7806aad30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-161531319", "description": "tempest-description-1333323540"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:06.397469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d094c990-3949-4ec1-9399-b46c1c8821f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:06.407300 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d094c990-3949-4ec1-9399-b46c1c8821f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1504 microversion: 2.1 time: 0.411888 May 27 15:07:06.408184 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1195/2455] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:05 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1504 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:06.422190 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c65afc32-2d6a-4acf-880d-87124d3be2da tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:06.423213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c65afc32-2d6a-4acf-880d-87124d3be2da tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:06.430543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c65afc32-2d6a-4acf-880d-87124d3be2da tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:06.431281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c65afc32-2d6a-4acf-880d-87124d3be2da tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:06.432202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c65afc32-2d6a-4acf-880d-87124d3be2da tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:06.432767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c65afc32-2d6a-4acf-880d-87124d3be2da tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:06.600151 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c9e7e958-8d37-404a-adfb-6ef931b12e8b tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.574077 May 27 15:07:06.600807 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1261/2456] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:07:06 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:06.605857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-04fdb093-892d-4ec1-85d1-8f4296901a4c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:06.606829 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-04fdb093-892d-4ec1-85d1-8f4296901a4c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:06.609867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:06.618065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04fdb093-892d-4ec1-85d1-8f4296901a4c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:06.619070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04fdb093-892d-4ec1-85d1-8f4296901a4c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:06.620295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04fdb093-892d-4ec1-85d1-8f4296901a4c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:06.621000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04fdb093-892d-4ec1-85d1-8f4296901a4c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:07.186690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c65afc32-2d6a-4acf-880d-87124d3be2da tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b6df1a680e498b8f9014995a93f261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d729d0442554ca5a662cfabb7ea425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:07.198361 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c65afc32-2d6a-4acf-880d-87124d3be2da tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87" status: 200 len: 1350 microversion: 2.1 time: 0.788801 May 27 15:07:07.208322 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1196/2457] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:06 2022] GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 => generated 1350 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:07.208322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-327be900-7cdc-4ad5-928e-7bf3c229f3a9 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:07.208322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-327be900-7cdc-4ad5-928e-7bf3c229f3a9 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:07.214146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-04fdb093-892d-4ec1-85d1-8f4296901a4c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:07.216103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-327be900-7cdc-4ad5-928e-7bf3c229f3a9 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:07.216607 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-327be900-7cdc-4ad5-928e-7bf3c229f3a9 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:07.218160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-327be900-7cdc-4ad5-928e-7bf3c229f3a9 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:07.218690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-327be900-7cdc-4ad5-928e-7bf3c229f3a9 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:07.231147 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-04fdb093-892d-4ec1-85d1-8f4296901a4c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1317 microversion: 2.1 time: 0.628740 May 27 15:07:07.236075 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1262/2458] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:06 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1317 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:07.251489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-115c912e-c57a-4a64-b137-72000e75674f tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Action: 'create', calling method: .version_select at 0x7fc7806aaa60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1062812140", "description": "tempest-description-1997751879"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:07.556038 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-327be900-7cdc-4ad5-928e-7bf3c229f3a9 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:07.570650 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-327be900-7cdc-4ad5-928e-7bf3c229f3a9 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1491 microversion: 2.1 time: 0.367847 May 27 15:07:07.572892 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1197/2459] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:07 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1491 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:07.598083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8b881e98-3e0b-4df6-a9a8-8134a5d254f2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:07.599164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8b881e98-3e0b-4df6-a9a8-8134a5d254f2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:07.609613 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b881e98-3e0b-4df6-a9a8-8134a5d254f2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:07.610070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b881e98-3e0b-4df6-a9a8-8134a5d254f2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:07.611123 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b881e98-3e0b-4df6-a9a8-8134a5d254f2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:07.611825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b881e98-3e0b-4df6-a9a8-8134a5d254f2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:07.739725 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-115c912e-c57a-4a64-b137-72000e75674f tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.502227 May 27 15:07:07.740327 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1263/2460] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:07:07 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:07.747843 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3574aad3-1edb-4af3-b3bd-c7a169fb8b9d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:07.748705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3574aad3-1edb-4af3-b3bd-c7a169fb8b9d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:07.759737 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3574aad3-1edb-4af3-b3bd-c7a169fb8b9d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:07.763235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3574aad3-1edb-4af3-b3bd-c7a169fb8b9d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:07.764467 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3574aad3-1edb-4af3-b3bd-c7a169fb8b9d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:07.765094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3574aad3-1edb-4af3-b3bd-c7a169fb8b9d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:07.804064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=12 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:08.036520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8b881e98-3e0b-4df6-a9a8-8134a5d254f2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:08.046291 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8b881e98-3e0b-4df6-a9a8-8134a5d254f2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1314 microversion: 2.1 time: 0.471749 May 27 15:07:08.047134 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1198/2461] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:07 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:08.052310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-85791e59-5261-49a1-8984-f0c4003e05f0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:08.053416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-85791e59-5261-49a1-8984-f0c4003e05f0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:08.063251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85791e59-5261-49a1-8984-f0c4003e05f0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:08.063806 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85791e59-5261-49a1-8984-f0c4003e05f0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:08.064705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85791e59-5261-49a1-8984-f0c4003e05f0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:08.065245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85791e59-5261-49a1-8984-f0c4003e05f0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:08.128963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3574aad3-1edb-4af3-b3bd-c7a169fb8b9d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:08.145435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3574aad3-1edb-4af3-b3bd-c7a169fb8b9d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:08.147913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3574aad3-1edb-4af3-b3bd-c7a169fb8b9d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:08.149429 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3574aad3-1edb-4af3-b3bd-c7a169fb8b9d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1724 microversion: 2.20 time: 0.405985 May 27 15:07:08.161279 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1264/2462] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:07 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1724 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:08.166507 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-8b04138d-9841-4e15-861b-67a5d765a56f req-f6f30c55-335f-44dd-a03b-d3b5b51a0727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd42e7d1-e7c7-4c19-a13e-2e81332b4d87", "tag": "d51d103b-92f4-4d90-87fa-825486231bb3"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:08.178428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-8b04138d-9841-4e15-861b-67a5d765a56f req-f6f30c55-335f-44dd-a03b-d3b5b51a0727 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:08.179552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-8b04138d-9841-4e15-861b-67a5d765a56f req-f6f30c55-335f-44dd-a03b-d3b5b51a0727 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:08.198378 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-8b04138d-9841-4e15-861b-67a5d765a56f req-f6f30c55-335f-44dd-a03b-d3b5b51a0727 service nova] Creating event network-changed:d51d103b-92f4-4d90-87fa-825486231bb3 for instance cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 on n-h2-843621-1 May 27 15:07:08.205467 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-8b04138d-9841-4e15-861b-67a5d765a56f req-f6f30c55-335f-44dd-a03b-d3b5b51a0727 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042260 May 27 15:07:08.206733 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1265/2463] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:08.214503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-51e92887-4387-4f7a-8a30-605786a4d289 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Action: 'create', calling method: .version_select at 0x7fc7807ffd30>, body: {"security_group_rule": {"parent_group_id": "f7557e3f-4ada-4e10-aec4-8126cf5452a9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "b04eb248-f29d-4f55-9051-19dc14b3d762"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:08.439617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-85791e59-5261-49a1-8984-f0c4003e05f0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:08.448767 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-85791e59-5261-49a1-8984-f0c4003e05f0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1504 microversion: 2.1 time: 0.400393 May 27 15:07:08.449965 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1199/2464] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:08 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1504 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:08.455260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-690ce53e-688b-43bd-bd70-2a0b985d9766 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:08.456058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-690ce53e-688b-43bd-bd70-2a0b985d9766 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:08.462552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-690ce53e-688b-43bd-bd70-2a0b985d9766 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:08.463230 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-690ce53e-688b-43bd-bd70-2a0b985d9766 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:08.464175 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-690ce53e-688b-43bd-bd70-2a0b985d9766 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:08.464796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-690ce53e-688b-43bd-bd70-2a0b985d9766 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:08.737358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-690ce53e-688b-43bd-bd70-2a0b985d9766 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b6df1a680e498b8f9014995a93f261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d729d0442554ca5a662cfabb7ea425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:08.742437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:08.749212 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-690ce53e-688b-43bd-bd70-2a0b985d9766 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87" status: 200 len: 1350 microversion: 2.1 time: 0.297744 May 27 15:07:08.760259 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1200/2465] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:08 2022] GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 => generated 1350 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:08.767152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0c558b61-90b4-44c6-86fa-1550e478c8b6 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:08.767835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0c558b61-90b4-44c6-86fa-1550e478c8b6 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:08.775957 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c558b61-90b4-44c6-86fa-1550e478c8b6 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:08.776666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c558b61-90b4-44c6-86fa-1550e478c8b6 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:08.777493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c558b61-90b4-44c6-86fa-1550e478c8b6 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:08.777946 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c558b61-90b4-44c6-86fa-1550e478c8b6 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:08.975263 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-51e92887-4387-4f7a-8a30-605786a4d289 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.767044 May 27 15:07:08.976524 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1266/2466] 10.222.0.13 () {60 vars in 1194 bytes} [Fri May 27 15:07:08 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:08.988407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-28106b54-2e80-4f8f-b6de-090455aa2c4a req-c84c0903-a2f8-4ae7-813a-dc86597a289b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1852d307-f34e-4a53-942f-145d41dc5c24", "name": "network-vif-plugged", "status": "completed", "tag": "0d3395a1-3889-43d9-8af7-cd140f2fee10"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:08.996017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0c558b61-90b4-44c6-86fa-1550e478c8b6 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:09.007209 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0c558b61-90b4-44c6-86fa-1550e478c8b6 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1317 microversion: 2.1 time: 0.245324 May 27 15:07:09.008052 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1201/2467] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:08 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:09.013945 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-28106b54-2e80-4f8f-b6de-090455aa2c4a req-c84c0903-a2f8-4ae7-813a-dc86597a289b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:09.014412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-28106b54-2e80-4f8f-b6de-090455aa2c4a req-c84c0903-a2f8-4ae7-813a-dc86597a289b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:09.022193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-efe25611-5db9-42fc-a18b-01f56d93867b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:09.023032 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-efe25611-5db9-42fc-a18b-01f56d93867b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:09.027185 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-28106b54-2e80-4f8f-b6de-090455aa2c4a req-c84c0903-a2f8-4ae7-813a-dc86597a289b service nova] Creating event network-vif-plugged:0d3395a1-3889-43d9-8af7-cd140f2fee10 for instance 1852d307-f34e-4a53-942f-145d41dc5c24 on n-h1-843621-1 May 27 15:07:09.029690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efe25611-5db9-42fc-a18b-01f56d93867b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:09.030315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efe25611-5db9-42fc-a18b-01f56d93867b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:09.031271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efe25611-5db9-42fc-a18b-01f56d93867b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:09.031725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efe25611-5db9-42fc-a18b-01f56d93867b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:09.033570 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-28106b54-2e80-4f8f-b6de-090455aa2c4a req-c84c0903-a2f8-4ae7-813a-dc86597a289b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048365 May 27 15:07:09.034199 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1267/2468] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:09.042395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1de1db9c-fd01-4ffc-a19d-16c3980a701b tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Action: 'create', calling method: .version_select at 0x7fc78071ca60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-176932576", "description": "tempest-description-77433377"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:09.212288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-efe25611-5db9-42fc-a18b-01f56d93867b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:09.230679 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-efe25611-5db9-42fc-a18b-01f56d93867b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1491 microversion: 2.1 time: 0.221556 May 27 15:07:09.235849 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1202/2469] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:09 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1491 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:09.240591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e0348e8b-834a-4e16-a895-f4707369fed9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:09.243131 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e0348e8b-834a-4e16-a895-f4707369fed9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:09.262250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0348e8b-834a-4e16-a895-f4707369fed9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:09.262596 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0348e8b-834a-4e16-a895-f4707369fed9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:09.263992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0348e8b-834a-4e16-a895-f4707369fed9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:09.264450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0348e8b-834a-4e16-a895-f4707369fed9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:09.330376 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1de1db9c-fd01-4ffc-a19d-16c3980a701b tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.291950 May 27 15:07:09.331249 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1268/2470] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:07:09 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:09.338810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-04a75f47-7cbf-4038-9b18-fd2c7d82a11f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:09.339558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-04a75f47-7cbf-4038-9b18-fd2c7d82a11f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:09.370570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04a75f47-7cbf-4038-9b18-fd2c7d82a11f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:09.371268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04a75f47-7cbf-4038-9b18-fd2c7d82a11f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:09.372849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04a75f47-7cbf-4038-9b18-fd2c7d82a11f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:09.373462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04a75f47-7cbf-4038-9b18-fd2c7d82a11f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:09.400121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:09.500472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e0348e8b-834a-4e16-a895-f4707369fed9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:09.509316 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e0348e8b-834a-4e16-a895-f4707369fed9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1314 microversion: 2.1 time: 0.272269 May 27 15:07:09.512502 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1203/2471] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:09 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:09.517870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-70fbe8d8-0f55-4e20-bf30-ddaf4f296069 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Action: 'create', calling method: .version_select at 0x7fc77729d3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1588763651", "description": "tempest-description-1797414336"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:09.590045 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-04a75f47-7cbf-4038-9b18-fd2c7d82a11f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:09.599042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-04a75f47-7cbf-4038-9b18-fd2c7d82a11f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:09.601168 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-04a75f47-7cbf-4038-9b18-fd2c7d82a11f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:09.602577 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-04a75f47-7cbf-4038-9b18-fd2c7d82a11f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1724 microversion: 2.20 time: 0.269141 May 27 15:07:09.615122 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1269/2472] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:09 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:09.621180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-42ca268d-0ab5-4826-a6fb-40c0735c63cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:09.623246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-42ca268d-0ab5-4826-a6fb-40c0735c63cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:09.630069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-42ca268d-0ab5-4826-a6fb-40c0735c63cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:09.630549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-42ca268d-0ab5-4826-a6fb-40c0735c63cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:09.631335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-42ca268d-0ab5-4826-a6fb-40c0735c63cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:09.631987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-42ca268d-0ab5-4826-a6fb-40c0735c63cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:09.752356 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-70fbe8d8-0f55-4e20-bf30-ddaf4f296069 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.240966 May 27 15:07:09.753853 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1204/2473] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:07:09 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:09.767317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-35a1bb94-5dd1-4af7-bd1b-0b8da68a76f1 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Action: 'create', calling method: .version_select at 0x7fc777674670>, body: {"security_group_rule": {"parent_group_id": "24e35247-596b-4193-bf7f-55cb32dab84e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "3abe35f8-bb58-49cd-8abd-5bb6631fe3a1"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:09.857502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-42ca268d-0ab5-4826-a6fb-40c0735c63cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:09.866009 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-42ca268d-0ab5-4826-a6fb-40c0735c63cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1504 microversion: 2.1 time: 0.249390 May 27 15:07:09.876423 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1270/2474] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:09 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1504 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:09.882529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3c48d413-a208-434f-b17b-0675fdcff5b2 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:09.883420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3c48d413-a208-434f-b17b-0675fdcff5b2 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:09.890796 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c48d413-a208-434f-b17b-0675fdcff5b2 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:09.892134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c48d413-a208-434f-b17b-0675fdcff5b2 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:09.893159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c48d413-a208-434f-b17b-0675fdcff5b2 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:09.893803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c48d413-a208-434f-b17b-0675fdcff5b2 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:10.097873 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3c48d413-a208-434f-b17b-0675fdcff5b2 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b6df1a680e498b8f9014995a93f261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d729d0442554ca5a662cfabb7ea425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:10.106172 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3c48d413-a208-434f-b17b-0675fdcff5b2 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87" status: 200 len: 1350 microversion: 2.1 time: 0.228187 May 27 15:07:10.106747 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1271/2475] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:09 2022] GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 => generated 1350 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:10.111340 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fa204b15-afac-45a8-b235-27b3395d37f1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:10.111953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fa204b15-afac-45a8-b235-27b3395d37f1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:10.118717 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa204b15-afac-45a8-b235-27b3395d37f1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:10.119176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa204b15-afac-45a8-b235-27b3395d37f1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:10.120027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa204b15-afac-45a8-b235-27b3395d37f1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:10.120472 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa204b15-afac-45a8-b235-27b3395d37f1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:10.145829 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-35a1bb94-5dd1-4af7-bd1b-0b8da68a76f1 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.383160 May 27 15:07:10.146437 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1205/2476] 10.222.0.13 () {60 vars in 1194 bytes} [Fri May 27 15:07:09 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:10.157765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8ab313e4-1ebf-4bc4-9c29-9c610b20a3c2 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Calling method '.version_select at 0x7fc776ede790>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:10.321826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fa204b15-afac-45a8-b235-27b3395d37f1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:10.338569 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fa204b15-afac-45a8-b235-27b3395d37f1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1317 microversion: 2.1 time: 0.230605 May 27 15:07:10.349028 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1272/2477] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:10 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:10.356153 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-d17b6893-6d31-47f3-ac41-a9c3ca1970d0 req-d10d19fc-5437-439e-b0b3-1e787bcf7440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccb6575b-6908-43ae-989f-1bdfcc5f5c63", "name": "network-vif-deleted", "tag": "4e0cf72f-d286-4fec-b5c7-e5289e6ed198"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:10.369337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d17b6893-6d31-47f3-ac41-a9c3ca1970d0 req-d10d19fc-5437-439e-b0b3-1e787bcf7440 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:10.369963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d17b6893-6d31-47f3-ac41-a9c3ca1970d0 req-d10d19fc-5437-439e-b0b3-1e787bcf7440 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:10.382546 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-d17b6893-6d31-47f3-ac41-a9c3ca1970d0 req-d10d19fc-5437-439e-b0b3-1e787bcf7440 service nova] Creating event network-vif-deleted:4e0cf72f-d286-4fec-b5c7-e5289e6ed198 for instance ccb6575b-6908-43ae-989f-1bdfcc5f5c63 on n-h1-843621-1 May 27 15:07:10.388502 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-d17b6893-6d31-47f3-ac41-a9c3ca1970d0 req-d10d19fc-5437-439e-b0b3-1e787bcf7440 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039865 May 27 15:07:10.389151 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1273/2478] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:10.394658 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ddb881d7-4a14-4b92-ac7f-40b2b75b0df2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:10.395563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ddb881d7-4a14-4b92-ac7f-40b2b75b0df2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:10.402137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ddb881d7-4a14-4b92-ac7f-40b2b75b0df2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:10.402671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ddb881d7-4a14-4b92-ac7f-40b2b75b0df2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:10.404042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ddb881d7-4a14-4b92-ac7f-40b2b75b0df2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:10.404491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ddb881d7-4a14-4b92-ac7f-40b2b75b0df2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:10.470468 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8ab313e4-1ebf-4bc4-9c29-9c610b20a3c2 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/3abe35f8-bb58-49cd-8abd-5bb6631fe3a1" status: 202 len: 0 microversion: 2.1 time: 0.314197 May 27 15:07:10.470468 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1206/2479] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:07:10 2022] DELETE /compute/v2.1/os-security-groups/3abe35f8-bb58-49cd-8abd-5bb6631fe3a1 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:07:10.477278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d9fcb82c-f37e-4ab3-a2db-0dcc6ee92622 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Calling method '.version_select at 0x7fc776f3a9d0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:10.487134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ddb881d7-4a14-4b92-ac7f-40b2b75b0df2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:10.495134 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ddb881d7-4a14-4b92-ac7f-40b2b75b0df2 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1449 microversion: 2.1 time: 0.104700 May 27 15:07:10.495805 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1274/2480] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:10 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1449 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:10.532666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7fa8ff05-5f7d-45a0-a889-87d469ec6999 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:10.533711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7fa8ff05-5f7d-45a0-a889-87d469ec6999 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:10.537979 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d9fcb82c-f37e-4ab3-a2db-0dcc6ee92622 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/24e35247-596b-4193-bf7f-55cb32dab84e" status: 200 len: 245 microversion: 2.1 time: 0.064358 May 27 15:07:10.538991 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1207/2481] 10.222.0.13 () {58 vars in 1268 bytes} [Fri May 27 15:07:10 2022] GET /compute/v2.1/os-security-groups/24e35247-596b-4193-bf7f-55cb32dab84e => generated 245 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:10.551313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7fa8ff05-5f7d-45a0-a889-87d469ec6999 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:10.551733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a00df2d2-f0e9-4259-88ff-a3968d92049c tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Action: 'create', calling method: .version_select at 0x7fc7772a6160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1777185929", "description": "tempest-description-1841226612"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:10.552151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7fa8ff05-5f7d-45a0-a889-87d469ec6999 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:10.553190 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7fa8ff05-5f7d-45a0-a889-87d469ec6999 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:10.553775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7fa8ff05-5f7d-45a0-a889-87d469ec6999 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:10.776632 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7fa8ff05-5f7d-45a0-a889-87d469ec6999 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:10.785556 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7fa8ff05-5f7d-45a0-a889-87d469ec6999 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1314 microversion: 2.1 time: 0.259459 May 27 15:07:10.786082 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1275/2482] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:10 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:10.790758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-97c81650-2dee-4773-a80a-8d29c452cf6c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:10.791679 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-97c81650-2dee-4773-a80a-8d29c452cf6c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:10.798367 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-97c81650-2dee-4773-a80a-8d29c452cf6c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:10.798835 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-97c81650-2dee-4773-a80a-8d29c452cf6c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:10.799639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-97c81650-2dee-4773-a80a-8d29c452cf6c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:10.800089 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-97c81650-2dee-4773-a80a-8d29c452cf6c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:10.824394 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a00df2d2-f0e9-4259-88ff-a3968d92049c tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.275527 May 27 15:07:10.837075 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1208/2483] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:07:10 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:07:10.848438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c0449529-f395-4484-b01c-dcec03875570 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Action: 'create', calling method: .version_select at 0x7fc77c097040>, body: {"security_group_rule": {"parent_group_id": "467c72cc-ca1b-47a7-bc92-f488358f66e8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:10.987521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-97c81650-2dee-4773-a80a-8d29c452cf6c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:11.002422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-97c81650-2dee-4773-a80a-8d29c452cf6c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:11.004759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-97c81650-2dee-4773-a80a-8d29c452cf6c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:11.006016 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-97c81650-2dee-4773-a80a-8d29c452cf6c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1745 microversion: 2.20 time: 0.218842 May 27 15:07:11.006615 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1276/2484] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:10 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1745 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:11.012364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a9520bcd-5134-4457-a63c-56ebbb8a6ba4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:11.013352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a9520bcd-5134-4457-a63c-56ebbb8a6ba4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:11.019708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a9520bcd-5134-4457-a63c-56ebbb8a6ba4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:11.020367 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a9520bcd-5134-4457-a63c-56ebbb8a6ba4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:11.020993 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a9520bcd-5134-4457-a63c-56ebbb8a6ba4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:11.021445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a9520bcd-5134-4457-a63c-56ebbb8a6ba4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:11.126897 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c0449529-f395-4484-b01c-dcec03875570 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.288261 May 27 15:07:11.128718 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1209/2485] 10.222.0.13 () {60 vars in 1194 bytes} [Fri May 27 15:07:10 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:11.135734 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1f1d110f-ab17-4fe6-a3ef-93ade29548ff tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:11.140140 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1f1d110f-ab17-4fe6-a3ef-93ade29548ff tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:11.149214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f1d110f-ab17-4fe6-a3ef-93ade29548ff tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:11.149888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f1d110f-ab17-4fe6-a3ef-93ade29548ff tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:11.150823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f1d110f-ab17-4fe6-a3ef-93ade29548ff tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:11.151297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f1d110f-ab17-4fe6-a3ef-93ade29548ff tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:11.217347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a9520bcd-5134-4457-a63c-56ebbb8a6ba4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:11.235589 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a9520bcd-5134-4457-a63c-56ebbb8a6ba4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1504 microversion: 2.1 time: 0.227367 May 27 15:07:11.236975 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1277/2486] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:11 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:11.247456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1f988826-9b5d-4495-904a-755fd16a0dbc tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Action: 'create', calling method: .version_select at 0x7fc78064c5e0>, body: {"security_group_rule": {"parent_group_id": "467c72cc-ca1b-47a7-bc92-f488358f66e8", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:11.438339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1f1d110f-ab17-4fe6-a3ef-93ade29548ff tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b6df1a680e498b8f9014995a93f261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d729d0442554ca5a662cfabb7ea425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:11.448400 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1f1d110f-ab17-4fe6-a3ef-93ade29548ff tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87" status: 200 len: 1350 microversion: 2.1 time: 0.318138 May 27 15:07:11.449573 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1210/2487] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:11 2022] GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 => generated 1350 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:11.456284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-27790297-ef0e-493a-9931-120a661648cf tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:11.457114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-27790297-ef0e-493a-9931-120a661648cf tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:11.464572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-27790297-ef0e-493a-9931-120a661648cf tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:11.465263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-27790297-ef0e-493a-9931-120a661648cf tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:11.466978 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-27790297-ef0e-493a-9931-120a661648cf tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:11.467566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-27790297-ef0e-493a-9931-120a661648cf tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:11.632459 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1f988826-9b5d-4495-904a-755fd16a0dbc tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.393203 May 27 15:07:11.634061 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1278/2488] 10.222.0.13 () {60 vars in 1194 bytes} [Fri May 27 15:07:11 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:11.640664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-932c10af-276a-47ab-82a7-380fd6e2c8a1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:11.641346 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-932c10af-276a-47ab-82a7-380fd6e2c8a1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:11.648005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-932c10af-276a-47ab-82a7-380fd6e2c8a1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:11.649023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-932c10af-276a-47ab-82a7-380fd6e2c8a1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:11.650119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-932c10af-276a-47ab-82a7-380fd6e2c8a1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:11.650734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-932c10af-276a-47ab-82a7-380fd6e2c8a1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:11.668325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-27790297-ef0e-493a-9931-120a661648cf tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:11.686639 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-27790297-ef0e-493a-9931-120a661648cf tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1317 microversion: 2.1 time: 0.234976 May 27 15:07:11.687886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-932c10af-276a-47ab-82a7-380fd6e2c8a1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:11.688362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-932c10af-276a-47ab-82a7-380fd6e2c8a1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:11.688887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-932c10af-276a-47ab-82a7-380fd6e2c8a1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lazy-loading 'fault' on Instance uuid ccb6575b-6908-43ae-989f-1bdfcc5f5c63 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:07:11.699206 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1211/2489] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:11 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:11.706135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-13d82942-fa8a-4dc8-86c2-88d684a85333 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Calling method '.version_select at 0x7fc7775b9040>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:11.754209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-932c10af-276a-47ab-82a7-380fd6e2c8a1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:11.762379 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-932c10af-276a-47ab-82a7-380fd6e2c8a1 tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1304 microversion: 2.1 time: 0.126388 May 27 15:07:11.763108 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1279/2490] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:11 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:11.788161 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-13d82942-fa8a-4dc8-86c2-88d684a85333 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/467c72cc-ca1b-47a7-bc92-f488358f66e8" status: 200 len: 665 microversion: 2.1 time: 0.087471 May 27 15:07:11.788781 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1212/2491] 10.222.0.13 () {58 vars in 1268 bytes} [Fri May 27 15:07:11 2022] GET /compute/v2.1/os-security-groups/467c72cc-ca1b-47a7-bc92-f488358f66e8 => generated 665 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:11.800464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5074cea7-d722-4016-8b0b-0619a4345719 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Calling method '.version_select at 0x7fc7807b6af0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:11.801997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-39dba69f-66d2-4eb3-af29-bb3b3ef9587d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:11.802699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-39dba69f-66d2-4eb3-af29-bb3b3ef9587d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:11.809162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-39dba69f-66d2-4eb3-af29-bb3b3ef9587d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:11.810279 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-39dba69f-66d2-4eb3-af29-bb3b3ef9587d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:11.811202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-39dba69f-66d2-4eb3-af29-bb3b3ef9587d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:11.811659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-39dba69f-66d2-4eb3-af29-bb3b3ef9587d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:11.989496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-39dba69f-66d2-4eb3-af29-bb3b3ef9587d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:11.997891 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-39dba69f-66d2-4eb3-af29-bb3b3ef9587d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1314 microversion: 2.1 time: 0.199571 May 27 15:07:11.998493 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1213/2492] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:11 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:12.024808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e50a13ae-041c-4d5e-b3c3-8d68b243fa5b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:12.025492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e50a13ae-041c-4d5e-b3c3-8d68b243fa5b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:12.030606 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5074cea7-d722-4016-8b0b-0619a4345719 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-group-rules/85daf9e3-cf74-4b3e-b979-5624984e0313" status: 202 len: 0 microversion: 2.1 time: 0.233885 May 27 15:07:12.031419 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1280/2493] 10.222.0.13 () {58 vars in 1286 bytes} [Fri May 27 15:07:11 2022] DELETE /compute/v2.1/os-security-group-rules/85daf9e3-cf74-4b3e-b979-5624984e0313 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:07:12.032149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e50a13ae-041c-4d5e-b3c3-8d68b243fa5b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:12.032614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e50a13ae-041c-4d5e-b3c3-8d68b243fa5b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:12.033449 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e50a13ae-041c-4d5e-b3c3-8d68b243fa5b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:12.034056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e50a13ae-041c-4d5e-b3c3-8d68b243fa5b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:12.042067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1ade9700-ac0e-4d0d-9e82-39ae7f6a488e tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Calling method '.version_select at 0x7fc7807b6160>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:12.234603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e50a13ae-041c-4d5e-b3c3-8d68b243fa5b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:12.244733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e50a13ae-041c-4d5e-b3c3-8d68b243fa5b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:12.247007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e50a13ae-041c-4d5e-b3c3-8d68b243fa5b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:12.247751 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e50a13ae-041c-4d5e-b3c3-8d68b243fa5b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1745 microversion: 2.20 time: 0.227036 May 27 15:07:12.248713 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1214/2494] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:12 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1745 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:12.266915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b19d0528-09b6-4a75-aeb3-e3f1c9e36a3a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:12.267866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b19d0528-09b6-4a75-aeb3-e3f1c9e36a3a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:12.288950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b19d0528-09b6-4a75-aeb3-e3f1c9e36a3a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:12.289442 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b19d0528-09b6-4a75-aeb3-e3f1c9e36a3a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:12.290664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b19d0528-09b6-4a75-aeb3-e3f1c9e36a3a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:12.290664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b19d0528-09b6-4a75-aeb3-e3f1c9e36a3a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:12.325964 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1ade9700-ac0e-4d0d-9e82-39ae7f6a488e tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/467c72cc-ca1b-47a7-bc92-f488358f66e8" status: 202 len: 0 microversion: 2.1 time: 0.287073 May 27 15:07:12.326573 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1281/2495] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:07:12 2022] DELETE /compute/v2.1/os-security-groups/467c72cc-ca1b-47a7-bc92-f488358f66e8 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:07:12.335070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-109a9e47-c4e1-44b8-b343-f7cbe6018285 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Calling method '.version_select at 0x7fc7807219d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:12.395078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG neutronclient.v2_0.client [None req-109a9e47-c4e1-44b8-b343-f7cbe6018285 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3abe35f8-bb58-49cd-8abd-5bb6631fe3a1 does not exist", "detail": ""}} {{(pid=119248) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:07:12.396058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.security_group_api [None req-109a9e47-c4e1-44b8-b343-f7cbe6018285 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Neutron security group 3abe35f8-bb58-49cd-8abd-5bb6631fe3a1 not found {{(pid=119248) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 27 15:07:12.396769 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-109a9e47-c4e1-44b8-b343-f7cbe6018285 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] HTTP exception thrown: Security group 3abe35f8-bb58-49cd-8abd-5bb6631fe3a1 does not exist May 27 15:07:12.396769 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-ec68305c-9378-4a95-8b13-f6a45bafac92'] May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-109a9e47-c4e1-44b8-b343-f7cbe6018285 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Request method failure captured: May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/os-security-groups/3abe35f8-bb58-49cd-8abd-5bb6631fe3a1 HTTP/1.1 May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOkW2xy9LgqvSeI1OGFZrGSOb6ZRmbtGD7VnZBeAJnfarBBZdjPOWoBd-cMbhquo3-YFgkJUxrLoZ72he1Uu6-AISgZ6kCTTlimAajnrRcWP0AtusoAKHBKMaHbeaVJVbj2fxyCqil51PO2qPd20_hGp5VFOmHCLZm4o9SiuOH_Dvxo May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: bc94fca792734de98eb42652d98fcf4d May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1748103526 May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bc94fca792734de98eb42652d98fcf4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/bc94fca792734de98eb42652d98fcf4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/bc94fca792734de98eb42652d98fcf4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_bc94fca792734de98eb42652d98fcf4d", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1748103526 May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: bc94fca792734de98eb42652d98fcf4d May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1748103526 May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-SecurityGroupRulesTestJSON-1748103526-project May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: e143dc7330884d92aeebb1d2de0ab6f0 May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1748103526-project May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: exception: Security group 3abe35f8-bb58-49cd-8abd-5bb6631fe3a1 does not exist May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-ec68305c-9378-4a95-8b13-f6a45bafac92'] May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '3abe35f8-bb58-49cd-8abd-5bb6631fe3a1'} May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:07:12.399175 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3abe35f8-bb58-49cd-8abd-5bb6631fe3a1 does not exist May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec68305c-9378-4a95-8b13-f6a45bafac92'] May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3abe35f8-bb58-49cd-8abd-5bb6631fe3a1 does not exist May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec68305c-9378-4a95-8b13-f6a45bafac92'] May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3abe35f8-bb58-49cd-8abd-5bb6631fe3a1 does not exist May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec68305c-9378-4a95-8b13-f6a45bafac92'] May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3abe35f8-bb58-49cd-8abd-5bb6631fe3a1 does not exist May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec68305c-9378-4a95-8b13-f6a45bafac92'] May 27 15:07:12.402292 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:12.406164 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-109a9e47-c4e1-44b8-b343-f7cbe6018285 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Returning 404 to user: Security group 3abe35f8-bb58-49cd-8abd-5bb6631fe3a1 does not exist May 27 15:07:12.406164 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-ec68305c-9378-4a95-8b13-f6a45bafac92'] {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:07:12.407403 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-109a9e47-c4e1-44b8-b343-f7cbe6018285 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/3abe35f8-bb58-49cd-8abd-5bb6631fe3a1" status: 404 len: 194 microversion: 2.1 time: 0.076234 May 27 15:07:12.408567 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1282/2496] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:07:12 2022] DELETE /compute/v2.1/os-security-groups/3abe35f8-bb58-49cd-8abd-5bb6631fe3a1 => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:07:12.416989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e5e54793-98a4-4569-b06f-24c2e0a8dc38 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Calling method '.version_select at 0x7fc78064c550>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:12.507322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b19d0528-09b6-4a75-aeb3-e3f1c9e36a3a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:12.516211 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b19d0528-09b6-4a75-aeb3-e3f1c9e36a3a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1504 microversion: 2.1 time: 0.256265 May 27 15:07:12.516912 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1215/2497] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:12 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1504 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:12.522450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5256e343-dff3-494a-a433-3f3be9bfa944 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:12.523289 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5256e343-dff3-494a-a433-3f3be9bfa944 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:12.532246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5256e343-dff3-494a-a433-3f3be9bfa944 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:12.533015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5256e343-dff3-494a-a433-3f3be9bfa944 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:12.533981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5256e343-dff3-494a-a433-3f3be9bfa944 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:12.534575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5256e343-dff3-494a-a433-3f3be9bfa944 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:12.720847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5256e343-dff3-494a-a433-3f3be9bfa944 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b6df1a680e498b8f9014995a93f261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d729d0442554ca5a662cfabb7ea425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:12.730977 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5256e343-dff3-494a-a433-3f3be9bfa944 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87" status: 200 len: 1350 microversion: 2.1 time: 0.211533 May 27 15:07:12.730977 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1216/2498] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:12 2022] GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 => generated 1350 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:12.735393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-754380e5-c2b6-43bd-8719-fe88154d37db tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:12.736140 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-754380e5-c2b6-43bd-8719-fe88154d37db tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:12.742173 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e5e54793-98a4-4569-b06f-24c2e0a8dc38 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/24e35247-596b-4193-bf7f-55cb32dab84e" status: 202 len: 0 microversion: 2.1 time: 0.328889 May 27 15:07:12.744350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-754380e5-c2b6-43bd-8719-fe88154d37db tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:12.744943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-754380e5-c2b6-43bd-8719-fe88154d37db tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:12.745132 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1283/2499] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:07:12 2022] DELETE /compute/v2.1/os-security-groups/24e35247-596b-4193-bf7f-55cb32dab84e => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:07:12.746114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-754380e5-c2b6-43bd-8719-fe88154d37db tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:12.746811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-754380e5-c2b6-43bd-8719-fe88154d37db tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:12.753471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1b53863e-8063-4db9-9ad6-4dd6727f8cd3 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Calling method '.version_select at 0x7fc7807efdc0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:12.966896 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-754380e5-c2b6-43bd-8719-fe88154d37db tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:12.976463 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-754380e5-c2b6-43bd-8719-fe88154d37db tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1317 microversion: 2.1 time: 0.244464 May 27 15:07:12.977309 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1217/2500] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:12 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:12.983820 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5d44834f-d138-4022-ae25-71df4081743b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:12.984664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5d44834f-d138-4022-ae25-71df4081743b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:12.994078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d44834f-d138-4022-ae25-71df4081743b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:12.995275 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d44834f-d138-4022-ae25-71df4081743b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:12.996801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d44834f-d138-4022-ae25-71df4081743b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:12.998033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d44834f-d138-4022-ae25-71df4081743b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:13.040425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d44834f-d138-4022-ae25-71df4081743b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:13.041152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d44834f-d138-4022-ae25-71df4081743b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:13.041765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-5d44834f-d138-4022-ae25-71df4081743b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lazy-loading 'fault' on Instance uuid ccb6575b-6908-43ae-989f-1bdfcc5f5c63 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:07:13.097031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5d44834f-d138-4022-ae25-71df4081743b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a53f4308e94cc1af6516680c0f2a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b31e7608039c4158936369f57b31cf55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:13.111373 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5d44834f-d138-4022-ae25-71df4081743b tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 200 len: 1304 microversion: 2.1 time: 0.132744 May 27 15:07:13.120974 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1218/2501] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:12 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:13.121478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-143fcb4d-0411-4c5e-90db-6d704b3de0a5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:13.123109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-143fcb4d-0411-4c5e-90db-6d704b3de0a5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:13.132137 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1b53863e-8063-4db9-9ad6-4dd6727f8cd3 tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/b04eb248-f29d-4f55-9051-19dc14b3d762" status: 202 len: 0 microversion: 2.1 time: 0.383594 May 27 15:07:13.133317 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1284/2502] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:07:12 2022] DELETE /compute/v2.1/os-security-groups/b04eb248-f29d-4f55-9051-19dc14b3d762 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:07:13.141644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a05a1c99-e755-453b-ae22-4b9373ef9f3c tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Calling method '.version_select at 0x7fc7807ef550>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:13.149162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-143fcb4d-0411-4c5e-90db-6d704b3de0a5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:13.150465 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-143fcb4d-0411-4c5e-90db-6d704b3de0a5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:13.151807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-143fcb4d-0411-4c5e-90db-6d704b3de0a5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:13.152267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-143fcb4d-0411-4c5e-90db-6d704b3de0a5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:13.444650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-143fcb4d-0411-4c5e-90db-6d704b3de0a5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:13.457758 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-143fcb4d-0411-4c5e-90db-6d704b3de0a5 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1314 microversion: 2.1 time: 0.343473 May 27 15:07:13.458547 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1219/2503] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:13 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:13.469428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-00e8f8b5-a296-41f9-8854-1cc258ed1696 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:13.470174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-00e8f8b5-a296-41f9-8854-1cc258ed1696 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:13.482451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-00e8f8b5-a296-41f9-8854-1cc258ed1696 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:13.482911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-00e8f8b5-a296-41f9-8854-1cc258ed1696 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:13.486546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-00e8f8b5-a296-41f9-8854-1cc258ed1696 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:13.486999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-00e8f8b5-a296-41f9-8854-1cc258ed1696 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:13.711730 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a05a1c99-e755-453b-ae22-4b9373ef9f3c tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/f7557e3f-4ada-4e10-aec4-8126cf5452a9" status: 202 len: 0 microversion: 2.1 time: 0.574596 May 27 15:07:13.714873 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1285/2504] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:07:13 2022] DELETE /compute/v2.1/os-security-groups/f7557e3f-4ada-4e10-aec4-8126cf5452a9 => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:07:13.724487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-51c952f0-af74-40eb-b814-fb30a8f406b5 req-565f2517-128d-4295-b128-a60f0de14804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd42e7d1-e7c7-4c19-a13e-2e81332b4d87", "name": "network-vif-plugged", "status": "completed", "tag": "d51d103b-92f4-4d90-87fa-825486231bb3"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:13.746640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-51c952f0-af74-40eb-b814-fb30a8f406b5 req-565f2517-128d-4295-b128-a60f0de14804 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:13.748413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-51c952f0-af74-40eb-b814-fb30a8f406b5 req-565f2517-128d-4295-b128-a60f0de14804 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:13.796047 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-51c952f0-af74-40eb-b814-fb30a8f406b5 req-565f2517-128d-4295-b128-a60f0de14804 service nova] Creating event network-vif-plugged:d51d103b-92f4-4d90-87fa-825486231bb3 for instance cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 on n-h2-843621-1 May 27 15:07:13.801440 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-51c952f0-af74-40eb-b814-fb30a8f406b5 req-565f2517-128d-4295-b128-a60f0de14804 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080691 May 27 15:07:13.803584 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1286/2505] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:13.809595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b96184ac-2294-4a4d-8d6d-15b1fb7ec021 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:13.811021 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b96184ac-2294-4a4d-8d6d-15b1fb7ec021 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:13.823363 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b96184ac-2294-4a4d-8d6d-15b1fb7ec021 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:13.824192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b96184ac-2294-4a4d-8d6d-15b1fb7ec021 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:13.826220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b96184ac-2294-4a4d-8d6d-15b1fb7ec021 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:13.827552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b96184ac-2294-4a4d-8d6d-15b1fb7ec021 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:13.832483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-00e8f8b5-a296-41f9-8854-1cc258ed1696 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:13.864628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-00e8f8b5-a296-41f9-8854-1cc258ed1696 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:13.867429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-00e8f8b5-a296-41f9-8854-1cc258ed1696 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:13.869898 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-00e8f8b5-a296-41f9-8854-1cc258ed1696 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1740 microversion: 2.20 time: 0.410599 May 27 15:07:13.873770 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1220/2506] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:13 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1740 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:13.890859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4d1648e3-2ec5-4b3d-9ec0-5f00da13fd4c tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Calling method '.version_select at 0x7fc776daa790>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:14.222238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b96184ac-2294-4a4d-8d6d-15b1fb7ec021 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:14.232592 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b96184ac-2294-4a4d-8d6d-15b1fb7ec021 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1504 microversion: 2.1 time: 0.427550 May 27 15:07:14.243082 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1287/2507] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:13 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1504 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:14.248466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8514616b-b8a5-4e42-a289-8776b075e374 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:14.249116 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8514616b-b8a5-4e42-a289-8776b075e374 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:14.255815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8514616b-b8a5-4e42-a289-8776b075e374 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:14.256301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8514616b-b8a5-4e42-a289-8776b075e374 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:14.257071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8514616b-b8a5-4e42-a289-8776b075e374 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:14.257525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8514616b-b8a5-4e42-a289-8776b075e374 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:14.287513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:14.312877 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:14.749695 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4d1648e3-2ec5-4b3d-9ec0-5f00da13fd4c tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/fed77f2f-58dc-4ad8-90f4-4ca20870a3fa" status: 202 len: 0 microversion: 2.1 time: 0.874124 May 27 15:07:14.751839 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1221/2508] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:07:13 2022] DELETE /compute/v2.1/os-security-groups/fed77f2f-58dc-4ad8-90f4-4ca20870a3fa => generated 0 bytes in 877 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:07:14.762939 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b50c2309-da9c-429a-9447-b33f7cb7b2e8 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:14.764216 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b50c2309-da9c-429a-9447-b33f7cb7b2e8 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:14.777691 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b50c2309-da9c-429a-9447-b33f7cb7b2e8 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:14.778351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b50c2309-da9c-429a-9447-b33f7cb7b2e8 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:14.784332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b50c2309-da9c-429a-9447-b33f7cb7b2e8 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:14.785421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b50c2309-da9c-429a-9447-b33f7cb7b2e8 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:14.833737 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8514616b-b8a5-4e42-a289-8776b075e374 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b6df1a680e498b8f9014995a93f261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d729d0442554ca5a662cfabb7ea425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:14.850431 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8514616b-b8a5-4e42-a289-8776b075e374 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87" status: 200 len: 1350 microversion: 2.1 time: 0.606115 May 27 15:07:14.852178 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1288/2509] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:14 2022] GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 => generated 1350 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:14.859529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ab9d8515-52f7-482e-b52a-0e2ef440e89c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:14.861137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ab9d8515-52f7-482e-b52a-0e2ef440e89c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] [instance: ccb6575b-6908-43ae-989f-1bdfcc5f5c63] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:14.868852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab9d8515-52f7-482e-b52a-0e2ef440e89c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:14.869522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab9d8515-52f7-482e-b52a-0e2ef440e89c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:14.870487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab9d8515-52f7-482e-b52a-0e2ef440e89c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:14.871075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab9d8515-52f7-482e-b52a-0e2ef440e89c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:14.910896 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-ab9d8515-52f7-482e-b52a-0e2ef440e89c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] HTTP exception thrown: Instance ccb6575b-6908-43ae-989f-1bdfcc5f5c63 could not be found. May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ab9d8515-52f7-482e-b52a-0e2ef440e89c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Request method failure captured: May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 HTTP/1.1 May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOiEZT_yUznL02JYnyfFpY5-AqbXTycrqZemwYdK6I1pwkUoe4d_DShOP-5yrVGZ1_NnulsAuqgehzk6xpTfuh6BBeddIJGDMEcn2G1d52QwVzD0bofDJR1kxquy9KQSHmIVIeCyrMuJT8-TSQhgmDkIpYR58yoeXGnbFeKL-JmPAtc May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: b31e7608039c4158936369f57b31cf55 May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerRescueTestJSON-576962126 May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b31e7608039c4158936369f57b31cf55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b31e7608039c4158936369f57b31cf55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b31e7608039c4158936369f57b31cf55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b31e7608039c4158936369f57b31cf55", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerRescueTestJSON-576962126 May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: b31e7608039c4158936369f57b31cf55 May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerRescueTestJSON-576962126 May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerRescueTestJSON-576962126-project May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: a8a53f4308e94cc1af6516680c0f2a47 May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerRescueTestJSON-576962126-project May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance ccb6575b-6908-43ae-989f-1bdfcc5f5c63 could not be found. May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'ccb6575b-6908-43ae-989f-1bdfcc5f5c63'} May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccb6575b-6908-43ae-989f-1bdfcc5f5c63 could not be found. May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccb6575b-6908-43ae-989f-1bdfcc5f5c63 could not be found. May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:14.920893 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:14.924340 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:14.924340 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:14.924340 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:14.924340 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:07:14.924340 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:07:14.924340 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccb6575b-6908-43ae-989f-1bdfcc5f5c63 could not be found. May 27 15:07:14.924340 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:14.924340 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ab9d8515-52f7-482e-b52a-0e2ef440e89c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] Returning 404 to user: Instance ccb6575b-6908-43ae-989f-1bdfcc5f5c63 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:07:14.924340 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ab9d8515-52f7-482e-b52a-0e2ef440e89c tempest-ServerRescueTestJSON-576962126 tempest-ServerRescueTestJSON-576962126-project] 10.222.0.13 "GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63" status: 404 len: 111 microversion: 2.1 time: 0.068078 May 27 15:07:14.924340 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1289/2510] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:14 2022] GET /compute/v2.1/servers/ccb6575b-6908-43ae-989f-1bdfcc5f5c63 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:07:14.931418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-34357865-c19a-4f6f-bc51-0b9f205c2784 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:14.936890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-34357865-c19a-4f6f-bc51-0b9f205c2784 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:14.951557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34357865-c19a-4f6f-bc51-0b9f205c2784 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:14.958741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34357865-c19a-4f6f-bc51-0b9f205c2784 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:14.959606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34357865-c19a-4f6f-bc51-0b9f205c2784 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:14.960062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34357865-c19a-4f6f-bc51-0b9f205c2784 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:15.248749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b50c2309-da9c-429a-9447-b33f7cb7b2e8 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:15.265156 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b50c2309-da9c-429a-9447-b33f7cb7b2e8 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1317 microversion: 2.1 time: 0.511621 May 27 15:07:15.265890 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1222/2511] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:14 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1317 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:15.270966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-afe8f426-9895-4bcc-87f7-ac9050e4e91b tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] Calling method '.version_select at 0x7fc776f3ca60>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:15.323239 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-34357865-c19a-4f6f-bc51-0b9f205c2784 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:15.344896 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-34357865-c19a-4f6f-bc51-0b9f205c2784 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1502 microversion: 2.1 time: 0.415919 May 27 15:07:15.350865 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1290/2512] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:14 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1502 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:15.359581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2424c64d-fa80-4ab8-b576-5573537eb8e4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:15.367431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2424c64d-fa80-4ab8-b576-5573537eb8e4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:15.375375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2424c64d-fa80-4ab8-b576-5573537eb8e4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:15.375841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2424c64d-fa80-4ab8-b576-5573537eb8e4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:15.376903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2424c64d-fa80-4ab8-b576-5573537eb8e4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:15.377444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2424c64d-fa80-4ab8-b576-5573537eb8e4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:15.817875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2424c64d-fa80-4ab8-b576-5573537eb8e4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:15.834183 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2424c64d-fa80-4ab8-b576-5573537eb8e4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:15.835774 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2424c64d-fa80-4ab8-b576-5573537eb8e4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:15.837011 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2424c64d-fa80-4ab8-b576-5573537eb8e4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1740 microversion: 2.20 time: 0.484833 May 27 15:07:15.837871 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1291/2513] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:15 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1740 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:15.846503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d0cc080b-eefd-4fae-8a19-bec21ac7a3fd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:15.849971 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d0cc080b-eefd-4fae-8a19-bec21ac7a3fd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:15.863933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0cc080b-eefd-4fae-8a19-bec21ac7a3fd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:15.868106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0cc080b-eefd-4fae-8a19-bec21ac7a3fd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:15.869296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0cc080b-eefd-4fae-8a19-bec21ac7a3fd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:15.869991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0cc080b-eefd-4fae-8a19-bec21ac7a3fd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:15.924956 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-afe8f426-9895-4bcc-87f7-ac9050e4e91b tempest-SecurityGroupRulesTestJSON-1748103526 tempest-SecurityGroupRulesTestJSON-1748103526-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/b3d7a197-f9cb-42a7-acc3-7aa0b1363dab" status: 202 len: 0 microversion: 2.1 time: 0.656673 May 27 15:07:15.929477 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1223/2514] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:07:15 2022] DELETE /compute/v2.1/os-security-groups/b3d7a197-f9cb-42a7-acc3-7aa0b1363dab => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:07:15.932508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-da0a70ac-f0a0-4c36-8a52-de0c1eccd41f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:15.933096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-da0a70ac-f0a0-4c36-8a52-de0c1eccd41f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:15.948833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da0a70ac-f0a0-4c36-8a52-de0c1eccd41f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:15.949353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da0a70ac-f0a0-4c36-8a52-de0c1eccd41f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:15.950727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da0a70ac-f0a0-4c36-8a52-de0c1eccd41f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:15.951256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da0a70ac-f0a0-4c36-8a52-de0c1eccd41f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:16.008956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-da0a70ac-f0a0-4c36-8a52-de0c1eccd41f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lazy-loading 'flavor' on Instance uuid 1852d307-f34e-4a53-942f-145d41dc5c24 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:07:16.087991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:16.352114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d0cc080b-eefd-4fae-8a19-bec21ac7a3fd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:16.373364 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d0cc080b-eefd-4fae-8a19-bec21ac7a3fd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1494 microversion: 2.1 time: 0.529933 May 27 15:07:16.385019 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1292/2515] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:15 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1494 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:16.385019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-27cb6e1b-711a-4579-bd6e-c78410d5c7a1 req-7e6c41d9-25c8-44fe-ab51-ea7c65df2bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d17a653-7f3e-44d7-9b89-68b4b35c9175", "name": "network-vif-plugged", "status": "completed", "tag": "f12487eb-11c2-4e49-877b-4fd161db40aa"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:16.463652 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-27cb6e1b-711a-4579-bd6e-c78410d5c7a1 req-7e6c41d9-25c8-44fe-ab51-ea7c65df2bd0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:16.465007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-27cb6e1b-711a-4579-bd6e-c78410d5c7a1 req-7e6c41d9-25c8-44fe-ab51-ea7c65df2bd0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:16.536433 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-da0a70ac-f0a0-4c36-8a52-de0c1eccd41f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "POST /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24/action" status: 202 len: 0 microversion: 2.1 time: 0.607649 May 27 15:07:16.538995 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1224/2516] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:07:15 2022] POST /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:07:16.555559 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-13fba9ee-b168-49cd-8f9b-2d76427e0439 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:16.557181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-13fba9ee-b168-49cd-8f9b-2d76427e0439 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:16.575229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13fba9ee-b168-49cd-8f9b-2d76427e0439 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:16.576516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13fba9ee-b168-49cd-8f9b-2d76427e0439 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:16.577604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13fba9ee-b168-49cd-8f9b-2d76427e0439 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:16.579084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13fba9ee-b168-49cd-8f9b-2d76427e0439 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:16.580291 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-27cb6e1b-711a-4579-bd6e-c78410d5c7a1 req-7e6c41d9-25c8-44fe-ab51-ea7c65df2bd0 service nova] Creating event network-vif-plugged:f12487eb-11c2-4e49-877b-4fd161db40aa for instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 on n-h2-843621-1 May 27 15:07:16.615023 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-27cb6e1b-711a-4579-bd6e-c78410d5c7a1 req-7e6c41d9-25c8-44fe-ab51-ea7c65df2bd0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234498 May 27 15:07:16.633817 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1293/2517] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:16.647955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ccb47ff3-e0bb-40ad-a5df-2fc9bb6abcb7 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:16.649538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ccb47ff3-e0bb-40ad-a5df-2fc9bb6abcb7 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:16.659381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccb47ff3-e0bb-40ad-a5df-2fc9bb6abcb7 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:16.660015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccb47ff3-e0bb-40ad-a5df-2fc9bb6abcb7 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:16.661061 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccb47ff3-e0bb-40ad-a5df-2fc9bb6abcb7 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:16.661602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccb47ff3-e0bb-40ad-a5df-2fc9bb6abcb7 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:17.115778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ccb47ff3-e0bb-40ad-a5df-2fc9bb6abcb7 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:17.133460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-13fba9ee-b168-49cd-8f9b-2d76427e0439 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b6df1a680e498b8f9014995a93f261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d729d0442554ca5a662cfabb7ea425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:17.140031 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ccb47ff3-e0bb-40ad-a5df-2fc9bb6abcb7 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1317 microversion: 2.1 time: 0.504051 May 27 15:07:17.140765 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1294/2518] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:16 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:17.150760 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-13fba9ee-b168-49cd-8f9b-2d76427e0439 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87" status: 200 len: 1540 microversion: 2.1 time: 0.606982 May 27 15:07:17.150760 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1225/2519] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:16 2022] GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 => generated 1540 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:17.165405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7a2a64c1-e6d6-49f5-b409-ea03c7d82583 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:17.166041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7a2a64c1-e6d6-49f5-b409-ea03c7d82583 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:17.173845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a2a64c1-e6d6-49f5-b409-ea03c7d82583 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:17.174135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a2a64c1-e6d6-49f5-b409-ea03c7d82583 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:17.174982 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a2a64c1-e6d6-49f5-b409-ea03c7d82583 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:17.175463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a2a64c1-e6d6-49f5-b409-ea03c7d82583 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:17.183594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6ebd7e91-b1bf-4622-af10-f27d7eaafa71 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '.version_select at 0x7fc776d4a820>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:17.186662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ebd7e91-b1bf-4622-af10-f27d7eaafa71 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:17.187112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ebd7e91-b1bf-4622-af10-f27d7eaafa71 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:17.204371 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6ebd7e91-b1bf-4622-af10-f27d7eaafa71 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 400 microversion: 2.1 time: 0.032628 May 27 15:07:17.208853 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1295/2520] 10.222.0.13 () {58 vars in 1142 bytes} [Fri May 27 15:07:17 2022] GET /compute/v2.1/os-migrations => generated 400 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:17.224118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dddf4e5b-427c-484e-be35-f768bdb2ed78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:17.225117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dddf4e5b-427c-484e-be35-f768bdb2ed78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:17.242134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dddf4e5b-427c-484e-be35-f768bdb2ed78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:17.244858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dddf4e5b-427c-484e-be35-f768bdb2ed78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:17.247989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dddf4e5b-427c-484e-be35-f768bdb2ed78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:17.248455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dddf4e5b-427c-484e-be35-f768bdb2ed78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:17.261491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:17.525908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7a2a64c1-e6d6-49f5-b409-ea03c7d82583 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:17.544653 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7a2a64c1-e6d6-49f5-b409-ea03c7d82583 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.388884 May 27 15:07:17.548261 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1226/2521] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:17 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:17.556556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-56865c57-50d9-4f7f-97b0-64eea9065c19 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:17.558491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-56865c57-50d9-4f7f-97b0-64eea9065c19 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:17.564755 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dddf4e5b-427c-484e-be35-f768bdb2ed78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:17.572587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56865c57-50d9-4f7f-97b0-64eea9065c19 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:17.573317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56865c57-50d9-4f7f-97b0-64eea9065c19 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:17.574171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dddf4e5b-427c-484e-be35-f768bdb2ed78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:17.574300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56865c57-50d9-4f7f-97b0-64eea9065c19 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:17.576337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dddf4e5b-427c-484e-be35-f768bdb2ed78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:17.581159 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dddf4e5b-427c-484e-be35-f768bdb2ed78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1740 microversion: 2.20 time: 0.369236 May 27 15:07:17.581543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56865c57-50d9-4f7f-97b0-64eea9065c19 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:17.581959 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1296/2522] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:17 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1740 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:17.596280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-736e7993-56d9-4b1a-a2b4-e642bb785846 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:17.596933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-736e7993-56d9-4b1a-a2b4-e642bb785846 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:17.617622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-736e7993-56d9-4b1a-a2b4-e642bb785846 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:17.618341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-736e7993-56d9-4b1a-a2b4-e642bb785846 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:17.619294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-736e7993-56d9-4b1a-a2b4-e642bb785846 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:17.619887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-736e7993-56d9-4b1a-a2b4-e642bb785846 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:17.754374 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-56865c57-50d9-4f7f-97b0-64eea9065c19 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.204911 May 27 15:07:17.761140 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1227/2523] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 15:07:17 2022] GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87/os-interface => generated 285 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:17.959864 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-736e7993-56d9-4b1a-a2b4-e642bb785846 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1645 microversion: 2.1 time: 0.373280 May 27 15:07:17.960865 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1297/2524] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:17 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1645 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:18.125928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-deeeada7-a9eb-49d3-b0b9-ad2e27b97464 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-776037632", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "2344c7a7-c142-4221-acc7-8131f1072282"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:18.164172 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5c1ce90b-09d7-4d1b-af0c-bc8d13b4c05b tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:18.165411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5c1ce90b-09d7-4d1b-af0c-bc8d13b4c05b tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:18.194778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c1ce90b-09d7-4d1b-af0c-bc8d13b4c05b tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:18.197911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c1ce90b-09d7-4d1b-af0c-bc8d13b4c05b tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:18.202819 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c1ce90b-09d7-4d1b-af0c-bc8d13b4c05b tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:18.203740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c1ce90b-09d7-4d1b-af0c-bc8d13b4c05b tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:18.226703 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-deeeada7-a9eb-49d3-b0b9-ad2e27b97464 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] validate_networks() for [('2344c7a7-c142-4221-acc7-8131f1072282', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:07:18.607824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5c1ce90b-09d7-4d1b-af0c-bc8d13b4c05b tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:18.622666 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5c1ce90b-09d7-4d1b-af0c-bc8d13b4c05b tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1317 microversion: 2.1 time: 0.466670 May 27 15:07:18.636879 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1298/2525] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:18 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1317 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:18.645969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-004b5b6d-5502-4b88-9af3-cca6bf541ac6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:18.645969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-004b5b6d-5502-4b88-9af3-cca6bf541ac6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:18.654210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-004b5b6d-5502-4b88-9af3-cca6bf541ac6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:18.654812 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-004b5b6d-5502-4b88-9af3-cca6bf541ac6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:18.656927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-004b5b6d-5502-4b88-9af3-cca6bf541ac6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:18.657738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-004b5b6d-5502-4b88-9af3-cca6bf541ac6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:19.594015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-deeeada7-a9eb-49d3-b0b9-ad2e27b97464 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:07:19.594711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-deeeada7-a9eb-49d3-b0b9-ad2e27b97464 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:07:19.595839 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-deeeada7-a9eb-49d3-b0b9-ad2e27b97464 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:07:19.596546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-deeeada7-a9eb-49d3-b0b9-ad2e27b97464 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:07:19.597092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-deeeada7-a9eb-49d3-b0b9-ad2e27b97464 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:07:19.625318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-deeeada7-a9eb-49d3-b0b9-ad2e27b97464 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:19.630252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-deeeada7-a9eb-49d3-b0b9-ad2e27b97464 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:19.648023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-deeeada7-a9eb-49d3-b0b9-ad2e27b97464 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:19.650043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-deeeada7-a9eb-49d3-b0b9-ad2e27b97464 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:19.652633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-004b5b6d-5502-4b88-9af3-cca6bf541ac6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:19.666499 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-004b5b6d-5502-4b88-9af3-cca6bf541ac6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 1.041284 May 27 15:07:19.670852 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1299/2526] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:18 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:19.680315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cf4d46ba-99ed-4391-8304-31f45e2b05bf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:19.682861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cf4d46ba-99ed-4391-8304-31f45e2b05bf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:19.695502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cf4d46ba-99ed-4391-8304-31f45e2b05bf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:19.699446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cf4d46ba-99ed-4391-8304-31f45e2b05bf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:19.702663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cf4d46ba-99ed-4391-8304-31f45e2b05bf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:19.703301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cf4d46ba-99ed-4391-8304-31f45e2b05bf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:19.704374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-deeeada7-a9eb-49d3-b0b9-ad2e27b97464 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Getting quotas for project e41b606a0de24f7fa9ea68af7064723b. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:07:19.726587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-deeeada7-a9eb-49d3-b0b9-ad2e27b97464 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Getting quotas for user 741a4f106a8f416891b90994e6ce9d40 and project e41b606a0de24f7fa9ea68af7064723b. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:07:19.771769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-deeeada7-a9eb-49d3-b0b9-ad2e27b97464 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:07:19.774475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-deeeada7-a9eb-49d3-b0b9-ad2e27b97464 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:07:19.881833 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-deeeada7-a9eb-49d3-b0b9-ad2e27b97464 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.761076 May 27 15:07:19.893726 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1228/2527] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:07:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:07:19.898757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-ce8a0ed3-dfad-4e1c-9fd8-45ac79844252 req-a9b237e7-b7d5-40da-ba4f-6671aa2ac35c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9604d14-4598-4d42-8bbf-8763103061a4", "name": "network-vif-plugged", "status": "completed", "tag": "648e11b1-5568-4d40-a6cd-7e3f346ef13b"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:19.938718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ce8a0ed3-dfad-4e1c-9fd8-45ac79844252 req-a9b237e7-b7d5-40da-ba4f-6671aa2ac35c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:19.939863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ce8a0ed3-dfad-4e1c-9fd8-45ac79844252 req-a9b237e7-b7d5-40da-ba4f-6671aa2ac35c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:19.960543 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-ce8a0ed3-dfad-4e1c-9fd8-45ac79844252 req-a9b237e7-b7d5-40da-ba4f-6671aa2ac35c service nova] Creating event network-vif-plugged:648e11b1-5568-4d40-a6cd-7e3f346ef13b for instance d9604d14-4598-4d42-8bbf-8763103061a4 on n-h1-843621-1 May 27 15:07:19.972620 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-ce8a0ed3-dfad-4e1c-9fd8-45ac79844252 req-a9b237e7-b7d5-40da-ba4f-6671aa2ac35c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077281 May 27 15:07:19.973660 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1229/2528] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:19.993327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7473d6f8-4564-46c2-9897-8f1ba885642c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:19.994614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7473d6f8-4564-46c2-9897-8f1ba885642c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:20.009378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7473d6f8-4564-46c2-9897-8f1ba885642c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:20.012053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7473d6f8-4564-46c2-9897-8f1ba885642c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:20.013661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7473d6f8-4564-46c2-9897-8f1ba885642c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:20.016099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7473d6f8-4564-46c2-9897-8f1ba885642c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:20.288527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cf4d46ba-99ed-4391-8304-31f45e2b05bf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:20.297020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cf4d46ba-99ed-4391-8304-31f45e2b05bf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:20.299054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cf4d46ba-99ed-4391-8304-31f45e2b05bf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:20.299976 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cf4d46ba-99ed-4391-8304-31f45e2b05bf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1740 microversion: 2.20 time: 0.627855 May 27 15:07:20.323709 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1300/2529] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:19 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1740 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:20.347000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0191607d-2737-4ea6-a2cd-02923b1d1fe8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:20.347870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0191607d-2737-4ea6-a2cd-02923b1d1fe8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:20.540348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0191607d-2737-4ea6-a2cd-02923b1d1fe8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:20.560590 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0191607d-2737-4ea6-a2cd-02923b1d1fe8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1210 microversion: 2.1 time: 0.232061 May 27 15:07:20.564491 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1301/2530] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:20 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1210 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:20.569652 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-069d3fb5-215a-416c-94a5-69fa4c0bb24c req-88ab9c02-22fc-4935-9081-b72c0aee4075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd42e7d1-e7c7-4c19-a13e-2e81332b4d87", "tag": "d51d103b-92f4-4d90-87fa-825486231bb3"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:20.608324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-069d3fb5-215a-416c-94a5-69fa4c0bb24c req-88ab9c02-22fc-4935-9081-b72c0aee4075 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:20.624853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-069d3fb5-215a-416c-94a5-69fa4c0bb24c req-88ab9c02-22fc-4935-9081-b72c0aee4075 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:20.665566 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-069d3fb5-215a-416c-94a5-69fa4c0bb24c req-88ab9c02-22fc-4935-9081-b72c0aee4075 service nova] Creating event network-changed:d51d103b-92f4-4d90-87fa-825486231bb3 for instance cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 on n-h2-843621-1 May 27 15:07:20.694106 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-069d3fb5-215a-416c-94a5-69fa4c0bb24c req-88ab9c02-22fc-4935-9081-b72c0aee4075 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122929 May 27 15:07:20.698608 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1302/2531] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:20.709604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7473d6f8-4564-46c2-9897-8f1ba885642c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:20.717478 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7473d6f8-4564-46c2-9897-8f1ba885642c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1317 microversion: 2.1 time: 0.742358 May 27 15:07:20.721014 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1230/2532] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:19 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1317 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:20.760163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bead9323-7188-469e-b7e8-e41e54736563 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:20.761257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bead9323-7188-469e-b7e8-e41e54736563 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:20.783064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bead9323-7188-469e-b7e8-e41e54736563 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:20.788443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bead9323-7188-469e-b7e8-e41e54736563 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:20.794241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bead9323-7188-469e-b7e8-e41e54736563 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:20.794719 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bead9323-7188-469e-b7e8-e41e54736563 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:21.286749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bead9323-7188-469e-b7e8-e41e54736563 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:21.301571 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bead9323-7188-469e-b7e8-e41e54736563 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.583285 May 27 15:07:21.312118 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1303/2533] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:20 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:21.319983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5d548a10-15e2-4a38-b3e5-2a75a8c6286a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:21.320624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5d548a10-15e2-4a38-b3e5-2a75a8c6286a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:21.329647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d548a10-15e2-4a38-b3e5-2a75a8c6286a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:21.330098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d548a10-15e2-4a38-b3e5-2a75a8c6286a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:21.331071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d548a10-15e2-4a38-b3e5-2a75a8c6286a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:21.331827 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d548a10-15e2-4a38-b3e5-2a75a8c6286a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:21.579851 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-25ab71aa-3803-4c2a-8d72-9fe3db02571b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:21.580871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-25ab71aa-3803-4c2a-8d72-9fe3db02571b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:21.595508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-25ab71aa-3803-4c2a-8d72-9fe3db02571b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:21.597916 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-25ab71aa-3803-4c2a-8d72-9fe3db02571b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:21.601852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-25ab71aa-3803-4c2a-8d72-9fe3db02571b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:21.607164 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-25ab71aa-3803-4c2a-8d72-9fe3db02571b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:21.619318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5d548a10-15e2-4a38-b3e5-2a75a8c6286a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:21.655050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5d548a10-15e2-4a38-b3e5-2a75a8c6286a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:21.662666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5d548a10-15e2-4a38-b3e5-2a75a8c6286a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:21.666869 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5d548a10-15e2-4a38-b3e5-2a75a8c6286a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1740 microversion: 2.20 time: 0.351128 May 27 15:07:21.674674 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1231/2534] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:21 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1740 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:21.740278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-81b90b88-918c-4af1-9413-4f311556fe19 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:21.742696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-81b90b88-918c-4af1-9413-4f311556fe19 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:21.759013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81b90b88-918c-4af1-9413-4f311556fe19 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:21.759868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81b90b88-918c-4af1-9413-4f311556fe19 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:21.760951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81b90b88-918c-4af1-9413-4f311556fe19 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:21.761763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81b90b88-918c-4af1-9413-4f311556fe19 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:21.956195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-25ab71aa-3803-4c2a-8d72-9fe3db02571b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:21.971274 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-25ab71aa-3803-4c2a-8d72-9fe3db02571b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1262 microversion: 2.1 time: 0.395247 May 27 15:07:21.977844 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1304/2535] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:21 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1262 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:22.136343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-81b90b88-918c-4af1-9413-4f311556fe19 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:22.141781 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-81b90b88-918c-4af1-9413-4f311556fe19 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1317 microversion: 2.1 time: 0.411011 May 27 15:07:22.154915 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1232/2536] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:21 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:07:22.320591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5b9d74d2-4f1a-414e-8abb-974a025b1294 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:22.322001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5b9d74d2-4f1a-414e-8abb-974a025b1294 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:22.352549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5b9d74d2-4f1a-414e-8abb-974a025b1294 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:22.362831 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5b9d74d2-4f1a-414e-8abb-974a025b1294 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:22.368390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5b9d74d2-4f1a-414e-8abb-974a025b1294 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:22.368891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5b9d74d2-4f1a-414e-8abb-974a025b1294 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:22.609748 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5b9d74d2-4f1a-414e-8abb-974a025b1294 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:22.618514 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5b9d74d2-4f1a-414e-8abb-974a025b1294 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.302693 May 27 15:07:22.620414 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1305/2537] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:22 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:22.694599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8e3553e9-79e1-49e9-9503-e1dc75e6916a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:22.695392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8e3553e9-79e1-49e9-9503-e1dc75e6916a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:22.703238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e3553e9-79e1-49e9-9503-e1dc75e6916a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:22.704507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e3553e9-79e1-49e9-9503-e1dc75e6916a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:22.705569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e3553e9-79e1-49e9-9503-e1dc75e6916a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:22.711369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e3553e9-79e1-49e9-9503-e1dc75e6916a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:22.988986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8e3553e9-79e1-49e9-9503-e1dc75e6916a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:22.991754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e6f69a2c-b628-45d3-8d99-e0a5ea23d863 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:22.992732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e6f69a2c-b628-45d3-8d99-e0a5ea23d863 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:23.008864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8e3553e9-79e1-49e9-9503-e1dc75e6916a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:23.011113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e6f69a2c-b628-45d3-8d99-e0a5ea23d863 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:23.011688 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e6f69a2c-b628-45d3-8d99-e0a5ea23d863 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:23.013330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8e3553e9-79e1-49e9-9503-e1dc75e6916a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:23.013468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e6f69a2c-b628-45d3-8d99-e0a5ea23d863 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:23.017324 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8e3553e9-79e1-49e9-9503-e1dc75e6916a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1740 microversion: 2.20 time: 0.328807 May 27 15:07:23.017726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e6f69a2c-b628-45d3-8d99-e0a5ea23d863 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:23.028932 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1233/2538] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:22 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1740 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:23.138570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e6f69a2c-b628-45d3-8d99-e0a5ea23d863 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:23.149070 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e6f69a2c-b628-45d3-8d99-e0a5ea23d863 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1268 microversion: 2.1 time: 0.162056 May 27 15:07:23.150466 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1306/2539] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:22 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:23.169986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-73f380bc-071d-4254-be42-ca003e6843d9 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:23.172325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-73f380bc-071d-4254-be42-ca003e6843d9 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:23.181432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73f380bc-071d-4254-be42-ca003e6843d9 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:23.182299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73f380bc-071d-4254-be42-ca003e6843d9 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:23.183452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73f380bc-071d-4254-be42-ca003e6843d9 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:23.183850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73f380bc-071d-4254-be42-ca003e6843d9 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:23.404963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-73f380bc-071d-4254-be42-ca003e6843d9 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:23.416687 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-73f380bc-071d-4254-be42-ca003e6843d9 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1467 microversion: 2.1 time: 0.254063 May 27 15:07:23.419587 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1234/2540] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:23 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1467 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:23.436226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9fa3eb1a-1ee2-40dc-afe9-684d3a4cdcc3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-411142682", "metadata": {"image_type": "test"}}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:23.437597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9fa3eb1a-1ee2-40dc-afe9-684d3a4cdcc3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:23.451254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9fa3eb1a-1ee2-40dc-afe9-684d3a4cdcc3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:23.452255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9fa3eb1a-1ee2-40dc-afe9-684d3a4cdcc3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:23.453426 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9fa3eb1a-1ee2-40dc-afe9-684d3a4cdcc3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:23.453965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9fa3eb1a-1ee2-40dc-afe9-684d3a4cdcc3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:23.520918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-9fa3eb1a-1ee2-40dc-afe9-684d3a4cdcc3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Getting quotas for project 6f9f274a9b24495fa40d9c8be7dcc3d5. Resources: dict_keys(['metadata_items']) {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:07:23.533489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-9fa3eb1a-1ee2-40dc-afe9-684d3a4cdcc3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Getting quotas for user e745803913eb40a9bb7fb90f59d574c9 and project 6f9f274a9b24495fa40d9c8be7dcc3d5. Resources: dict_keys(['metadata_items']) {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:07:23.694525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1973b293-409c-4ebf-b615-e94c43077ce0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:23.694699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1973b293-409c-4ebf-b615-e94c43077ce0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:23.739071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1973b293-409c-4ebf-b615-e94c43077ce0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:23.744518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1973b293-409c-4ebf-b615-e94c43077ce0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:23.751283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1973b293-409c-4ebf-b615-e94c43077ce0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:23.755295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1973b293-409c-4ebf-b615-e94c43077ce0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:24.027307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1973b293-409c-4ebf-b615-e94c43077ce0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:24.048781 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1973b293-409c-4ebf-b615-e94c43077ce0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.368773 May 27 15:07:24.059877 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1235/2541] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:23 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:24.102226 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9fa3eb1a-1ee2-40dc-afe9-684d3a4cdcc3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "POST /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4/action" status: 202 len: 0 microversion: 2.1 time: 0.669045 May 27 15:07:24.103367 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1307/2542] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:07:23 2022] POST /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4/action => generated 0 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 27 15:07:24.127082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7a871f27-7817-4f23-9708-7fa0640e2097 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:24.130809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7a871f27-7817-4f23-9708-7fa0640e2097 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:24.138945 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a871f27-7817-4f23-9708-7fa0640e2097 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:24.139913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a871f27-7817-4f23-9708-7fa0640e2097 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:24.141289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a871f27-7817-4f23-9708-7fa0640e2097 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:24.142188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a871f27-7817-4f23-9708-7fa0640e2097 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:24.321709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ef504922-c325-4d81-b571-36dbc4b22116 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] Calling method '.version_select at 0x7fc7770aa670>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:24.423908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG neutronclient.v2_0.client [None req-ef504922-c325-4d81-b571-36dbc4b22116 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e413d086-884f-4b84-ac87-300bd58c1f2e does not exist", "detail": ""}} {{(pid=119249) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:07:24.424837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.security_group_api [None req-ef504922-c325-4d81-b571-36dbc4b22116 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] Neutron security group e413d086-884f-4b84-ac87-300bd58c1f2e not found {{(pid=119249) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 27 15:07:24.425522 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-ef504922-c325-4d81-b571-36dbc4b22116 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] HTTP exception thrown: Security group e413d086-884f-4b84-ac87-300bd58c1f2e does not exist May 27 15:07:24.425522 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-e829d681-5a22-4962-a052-b4c4e7dad2d0'] May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ef504922-c325-4d81-b571-36dbc4b22116 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] Request method failure captured: May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/os-security-groups/e413d086-884f-4b84-ac87-300bd58c1f2e HTTP/1.1 May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOkrJVOR5dhTYdKxCw5nc9U1pnTaytw3YhRFxp9i05Yyzic3xyEQT0OV_Fz2rTFvvFN8houGi9PXAf9BnNEFu_e6jmfmCsZM7w5aCWzb8lXHZZzBmzunj1XZGXEFEhL8x1INznkYxklrFvIDIrt2Mp2UwpJcVjr5oohPYU_6DfY-fZQ May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 251c58145cb74a48ae4600d8e7a0a5cd May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1143996845 May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/251c58145cb74a48ae4600d8e7a0a5cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/251c58145cb74a48ae4600d8e7a0a5cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/251c58145cb74a48ae4600d8e7a0a5cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_251c58145cb74a48ae4600d8e7a0a5cd", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1143996845 May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 251c58145cb74a48ae4600d8e7a0a5cd May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1143996845 May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-SecurityGroupsNegativeTestJSON-1143996845-project May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 7843c5756ec54b83931e2e5de732e9cc May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1143996845-project May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: exception: Security group e413d086-884f-4b84-ac87-300bd58c1f2e does not exist May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-e829d681-5a22-4962-a052-b4c4e7dad2d0'] May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'e413d086-884f-4b84-ac87-300bd58c1f2e'} May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:07:24.431905 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e413d086-884f-4b84-ac87-300bd58c1f2e does not exist May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e829d681-5a22-4962-a052-b4c4e7dad2d0'] May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e413d086-884f-4b84-ac87-300bd58c1f2e does not exist May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e829d681-5a22-4962-a052-b4c4e7dad2d0'] May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e413d086-884f-4b84-ac87-300bd58c1f2e does not exist May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e829d681-5a22-4962-a052-b4c4e7dad2d0'] May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e413d086-884f-4b84-ac87-300bd58c1f2e does not exist May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e829d681-5a22-4962-a052-b4c4e7dad2d0'] May 27 15:07:24.436843 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:07:24.441840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ef504922-c325-4d81-b571-36dbc4b22116 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] Returning 404 to user: Security group e413d086-884f-4b84-ac87-300bd58c1f2e does not exist May 27 15:07:24.441840 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-e829d681-5a22-4962-a052-b4c4e7dad2d0'] {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:07:24.443850 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ef504922-c325-4d81-b571-36dbc4b22116 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/e413d086-884f-4b84-ac87-300bd58c1f2e" status: 404 len: 194 microversion: 2.1 time: 0.382039 May 27 15:07:24.445532 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1236/2543] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:07:24 2022] DELETE /compute/v2.1/os-security-groups/e413d086-884f-4b84-ac87-300bd58c1f2e => generated 194 bytes in 385 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:07:24.451068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7a871f27-7817-4f23-9708-7fa0640e2097 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:24.451542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-07891129-8c8e-4464-8737-96d0b9f14387 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776c9d820>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:24.460737 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7a871f27-7817-4f23-9708-7fa0640e2097 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:24.462266 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7a871f27-7817-4f23-9708-7fa0640e2097 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:24.463911 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7a871f27-7817-4f23-9708-7fa0640e2097 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1740 microversion: 2.20 time: 0.358924 May 27 15:07:24.464923 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1308/2544] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:24 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1740 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:24.471364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9b090e26-18b8-45cc-b8fa-fee15f6a9432 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:24.471991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9b090e26-18b8-45cc-b8fa-fee15f6a9432 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:24.478415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b090e26-18b8-45cc-b8fa-fee15f6a9432 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:24.478879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b090e26-18b8-45cc-b8fa-fee15f6a9432 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:24.479852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b090e26-18b8-45cc-b8fa-fee15f6a9432 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:24.480320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b090e26-18b8-45cc-b8fa-fee15f6a9432 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:24.522695 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-07891129-8c8e-4464-8737-96d0b9f14387 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.075834 May 27 15:07:24.531398 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1237/2545] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:24 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:24.538722 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f8a2eab8-f190-40df-834f-57c086cac8e5 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005499 May 27 15:07:24.540033 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1238/2546] 10.222.0.13 () {58 vars in 1163 bytes} [Fri May 27 15:07:24 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 15:07:24.550916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-51d2c147-8560-4126-b516-754c7099b533 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] Calling method '.version_select at 0x7fc777232040>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:24.589554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9b090e26-18b8-45cc-b8fa-fee15f6a9432 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:24.602846 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9b090e26-18b8-45cc-b8fa-fee15f6a9432 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1268 microversion: 2.1 time: 0.136369 May 27 15:07:24.603130 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1309/2547] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:24 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1268 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:24.778477 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-51d2c147-8560-4126-b516-754c7099b533 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.230907 May 27 15:07:24.779083 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1239/2548] 10.222.0.13 () {58 vars in 1157 bytes} [Fri May 27 15:07:24 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:24.801874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-51052fbe-aca2-493c-aa60-e7c86db72d80 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] Calling method '.version_select at 0x7fc7767b4f70>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:24.962309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG neutronclient.v2_0.client [None req-51052fbe-aca2-493c-aa60-e7c86db72d80 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119248) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:07:24.963070 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-51052fbe-aca2-493c-aa60-e7c86db72d80 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] HTTP exception thrown: Insufficient rights for removing default security group. May 27 15:07:24.963070 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-d1dd12a8-9e4f-418d-acc7-25e77c8e5bb1'] May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-51052fbe-aca2-493c-aa60-e7c86db72d80 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] Request method failure captured: May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/os-security-groups/9dccad0e-0168-44ad-94d2-9c129ffdf66b HTTP/1.1 May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOkrJVOR5dhTYdKxCw5nc9U1pnTaytw3YhRFxp9i05Yyzic3xyEQT0OV_Fz2rTFvvFN8houGi9PXAf9BnNEFu_e6jmfmCsZM7w5aCWzb8lXHZZzBmzunj1XZGXEFEhL8x1INznkYxklrFvIDIrt2Mp2UwpJcVjr5oohPYU_6DfY-fZQ May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 251c58145cb74a48ae4600d8e7a0a5cd May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1143996845 May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/251c58145cb74a48ae4600d8e7a0a5cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/251c58145cb74a48ae4600d8e7a0a5cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/251c58145cb74a48ae4600d8e7a0a5cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_251c58145cb74a48ae4600d8e7a0a5cd", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1143996845 May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 251c58145cb74a48ae4600d8e7a0a5cd May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1143996845 May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-SecurityGroupsNegativeTestJSON-1143996845-project May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 7843c5756ec54b83931e2e5de732e9cc May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1143996845-project May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: exception: Insufficient rights for removing default security group. May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-d1dd12a8-9e4f-418d-acc7-25e77c8e5bb1'] May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '9dccad0e-0168-44ad-94d2-9c129ffdf66b'} May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:07:24.966091 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1dd12a8-9e4f-418d-acc7-25e77c8e5bb1'] May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1dd12a8-9e4f-418d-acc7-25e77c8e5bb1'] May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1dd12a8-9e4f-418d-acc7-25e77c8e5bb1'] May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d1dd12a8-9e4f-418d-acc7-25e77c8e5bb1'] May 27 15:07:24.969822 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:24.973361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-51052fbe-aca2-493c-aa60-e7c86db72d80 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] Returning 400 to user: Insufficient rights for removing default security group. May 27 15:07:24.973361 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-d1dd12a8-9e4f-418d-acc7-25e77c8e5bb1'] {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:07:24.974881 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-51052fbe-aca2-493c-aa60-e7c86db72d80 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/9dccad0e-0168-44ad-94d2-9c129ffdf66b" status: 400 len: 182 microversion: 2.1 time: 0.185181 May 27 15:07:24.975638 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1310/2549] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:07:24 2022] DELETE /compute/v2.1/os-security-groups/9dccad0e-0168-44ad-94d2-9c129ffdf66b => generated 182 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:07:24.998621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b5743ce0-ee35-489f-ade8-f38f1e7fbfdc tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] Calling method '.version_select at 0x7fc776d7f5e0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:25.033118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG neutronclient.v2_0.client [None req-b5743ce0-ee35-489f-ade8-f38f1e7fbfdc tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 77fec31d-6902-43dc-a475-78059ff80d18 does not exist", "detail": ""}} {{(pid=119249) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:07:25.033723 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.security_group_api [None req-b5743ce0-ee35-489f-ade8-f38f1e7fbfdc tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] Neutron security group 77fec31d-6902-43dc-a475-78059ff80d18 not found {{(pid=119249) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 27 15:07:25.034302 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-b5743ce0-ee35-489f-ade8-f38f1e7fbfdc tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] HTTP exception thrown: Security group 77fec31d-6902-43dc-a475-78059ff80d18 does not exist May 27 15:07:25.034302 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-316ac752-9867-4423-8ce3-069b1c4a2107'] May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b5743ce0-ee35-489f-ade8-f38f1e7fbfdc tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] Request method failure captured: May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-security-groups/77fec31d-6902-43dc-a475-78059ff80d18 HTTP/1.1 May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOkrJVOR5dhTYdKxCw5nc9U1pnTaytw3YhRFxp9i05Yyzic3xyEQT0OV_Fz2rTFvvFN8houGi9PXAf9BnNEFu_e6jmfmCsZM7w5aCWzb8lXHZZzBmzunj1XZGXEFEhL8x1INznkYxklrFvIDIrt2Mp2UwpJcVjr5oohPYU_6DfY-fZQ May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 251c58145cb74a48ae4600d8e7a0a5cd May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1143996845 May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/251c58145cb74a48ae4600d8e7a0a5cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/251c58145cb74a48ae4600d8e7a0a5cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/251c58145cb74a48ae4600d8e7a0a5cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_251c58145cb74a48ae4600d8e7a0a5cd", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1143996845 May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 251c58145cb74a48ae4600d8e7a0a5cd May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1143996845 May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-SecurityGroupsNegativeTestJSON-1143996845-project May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 7843c5756ec54b83931e2e5de732e9cc May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1143996845-project May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: exception: Security group 77fec31d-6902-43dc-a475-78059ff80d18 does not exist May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-316ac752-9867-4423-8ce3-069b1c4a2107'] May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '77fec31d-6902-43dc-a475-78059ff80d18'} May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:07:25.036206 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 77fec31d-6902-43dc-a475-78059ff80d18 does not exist May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-316ac752-9867-4423-8ce3-069b1c4a2107'] May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 77fec31d-6902-43dc-a475-78059ff80d18 does not exist May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-316ac752-9867-4423-8ce3-069b1c4a2107'] May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 77fec31d-6902-43dc-a475-78059ff80d18 does not exist May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-316ac752-9867-4423-8ce3-069b1c4a2107'] May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 77fec31d-6902-43dc-a475-78059ff80d18 does not exist May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-316ac752-9867-4423-8ce3-069b1c4a2107'] May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b5743ce0-ee35-489f-ade8-f38f1e7fbfdc tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] Returning 404 to user: Security group 77fec31d-6902-43dc-a475-78059ff80d18 does not exist May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: Neutron server returns request_ids: ['req-316ac752-9867-4423-8ce3-069b1c4a2107'] {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b5743ce0-ee35-489f-ade8-f38f1e7fbfdc tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] 10.222.0.13 "GET /compute/v2.1/os-security-groups/77fec31d-6902-43dc-a475-78059ff80d18" status: 404 len: 194 microversion: 2.1 time: 0.044892 May 27 15:07:25.042334 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1240/2550] 10.222.0.13 () {58 vars in 1268 bytes} [Fri May 27 15:07:24 2022] GET /compute/v2.1/os-security-groups/77fec31d-6902-43dc-a475-78059ff80d18 => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:07:25.051455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0205f34b-8a43-4b39-8d2f-c1ab5c8e1d27 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] Action: 'update', calling method: .version_select at 0x7fc7765c35e0>, body: {"security_group": {"name": "tempest-sg-726427675", "description": "tempest-description-316014123"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:25.070291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b3d969a7-2a84-4a64-967b-43e90cf1011a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:25.070851 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b3d969a7-2a84-4a64-967b-43e90cf1011a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:25.079678 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3d969a7-2a84-4a64-967b-43e90cf1011a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:25.080413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3d969a7-2a84-4a64-967b-43e90cf1011a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:25.081565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3d969a7-2a84-4a64-967b-43e90cf1011a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:25.082230 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3d969a7-2a84-4a64-967b-43e90cf1011a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:25.094275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG neutronclient.v2_0.client [None req-0205f34b-8a43-4b39-8d2f-c1ab5c8e1d27 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 413fe1f1-50ee-4fb4-bbc4-7968d88dc75d does not exist", "detail": ""}} {{(pid=119248) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:07:25.095143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.security_group_api [None req-0205f34b-8a43-4b39-8d2f-c1ab5c8e1d27 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] Neutron security group 413fe1f1-50ee-4fb4-bbc4-7968d88dc75d not found {{(pid=119248) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 27 15:07:25.095811 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-0205f34b-8a43-4b39-8d2f-c1ab5c8e1d27 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] HTTP exception thrown: Security group 413fe1f1-50ee-4fb4-bbc4-7968d88dc75d does not exist May 27 15:07:25.095811 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-cfd9218e-fe95-4aad-a0a6-01627f7dfe39'] May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0205f34b-8a43-4b39-8d2f-c1ab5c8e1d27 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] Request method failure captured: May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: request: PUT /compute/v2.1/os-security-groups/413fe1f1-50ee-4fb4-bbc4-7968d88dc75d HTTP/1.1 May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 100 May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOkrJVOR5dhTYdKxCw5nc9U1pnTaytw3YhRFxp9i05Yyzic3xyEQT0OV_Fz2rTFvvFN8houGi9PXAf9BnNEFu_e6jmfmCsZM7w5aCWzb8lXHZZzBmzunj1XZGXEFEhL8x1INznkYxklrFvIDIrt2Mp2UwpJcVjr5oohPYU_6DfY-fZQ May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 251c58145cb74a48ae4600d8e7a0a5cd May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1143996845 May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/251c58145cb74a48ae4600d8e7a0a5cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/251c58145cb74a48ae4600d8e7a0a5cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/251c58145cb74a48ae4600d8e7a0a5cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_251c58145cb74a48ae4600d8e7a0a5cd", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1143996845 May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 251c58145cb74a48ae4600d8e7a0a5cd May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1143996845 May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-SecurityGroupsNegativeTestJSON-1143996845-project May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 7843c5756ec54b83931e2e5de732e9cc May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1143996845-project May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: {"security_group": {"name": "tempest-sg-726427675", "description": "tempest-description-316014123"}} May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: exception: Security group 413fe1f1-50ee-4fb4-bbc4-7968d88dc75d does not exist May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-cfd9218e-fe95-4aad-a0a6-01627f7dfe39'] May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '413fe1f1-50ee-4fb4-bbc4-7968d88dc75d', 'body': {'security_group': {'name': 'tempest-sg-726427675', 'description': 'tempest-description-316014123'}}} May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:07:25.099358 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 413fe1f1-50ee-4fb4-bbc4-7968d88dc75d does not exist May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfd9218e-fe95-4aad-a0a6-01627f7dfe39'] May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 413fe1f1-50ee-4fb4-bbc4-7968d88dc75d does not exist May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfd9218e-fe95-4aad-a0a6-01627f7dfe39'] May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 413fe1f1-50ee-4fb4-bbc4-7968d88dc75d does not exist May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfd9218e-fe95-4aad-a0a6-01627f7dfe39'] May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 413fe1f1-50ee-4fb4-bbc4-7968d88dc75d does not exist May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfd9218e-fe95-4aad-a0a6-01627f7dfe39'] May 27 15:07:25.103531 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:07:25.107576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0205f34b-8a43-4b39-8d2f-c1ab5c8e1d27 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] Returning 404 to user: Security group 413fe1f1-50ee-4fb4-bbc4-7968d88dc75d does not exist May 27 15:07:25.107576 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-cfd9218e-fe95-4aad-a0a6-01627f7dfe39'] {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:07:25.108868 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0205f34b-8a43-4b39-8d2f-c1ab5c8e1d27 tempest-SecurityGroupsNegativeTestJSON-1143996845 tempest-SecurityGroupsNegativeTestJSON-1143996845-project] 10.222.0.13 "PUT /compute/v2.1/os-security-groups/413fe1f1-50ee-4fb4-bbc4-7968d88dc75d" status: 404 len: 194 microversion: 2.1 time: 0.062054 May 27 15:07:25.110048 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1311/2551] 10.222.0.13 () {60 vars in 1289 bytes} [Fri May 27 15:07:25 2022] PUT /compute/v2.1/os-security-groups/413fe1f1-50ee-4fb4-bbc4-7968d88dc75d => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:07:25.351690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b3d969a7-2a84-4a64-967b-43e90cf1011a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:25.360651 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b3d969a7-2a84-4a64-967b-43e90cf1011a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.297909 May 27 15:07:25.366153 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1241/2552] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:25 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:07:25.484254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5ff7ce06-62a5-45fc-91af-5781d2bfebf6 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:25.485050 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5ff7ce06-62a5-45fc-91af-5781d2bfebf6 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:25.503486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ff7ce06-62a5-45fc-91af-5781d2bfebf6 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:25.503907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ff7ce06-62a5-45fc-91af-5781d2bfebf6 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:25.505321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ff7ce06-62a5-45fc-91af-5781d2bfebf6 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:25.505867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ff7ce06-62a5-45fc-91af-5781d2bfebf6 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:25.538528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a9507ea2-46f1-4fdd-9dc5-eaebd2ba0a57 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc7770aa670>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:25.615771 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a9507ea2-46f1-4fdd-9dc5-eaebd2ba0a57 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.081546 May 27 15:07:25.617249 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1242/2553] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:25 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:07:25.641910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7d3387e6-46e2-4650-8edd-aad98f1f9f14 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:25.647060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7d3387e6-46e2-4650-8edd-aad98f1f9f14 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:25.655958 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d3387e6-46e2-4650-8edd-aad98f1f9f14 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:25.656718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d3387e6-46e2-4650-8edd-aad98f1f9f14 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:25.657727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d3387e6-46e2-4650-8edd-aad98f1f9f14 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:25.658533 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d3387e6-46e2-4650-8edd-aad98f1f9f14 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:25.763370 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5ff7ce06-62a5-45fc-91af-5781d2bfebf6 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:25.800976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5ff7ce06-62a5-45fc-91af-5781d2bfebf6 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:25.806014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5ff7ce06-62a5-45fc-91af-5781d2bfebf6 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:25.811562 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5ff7ce06-62a5-45fc-91af-5781d2bfebf6 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1740 microversion: 2.20 time: 0.330846 May 27 15:07:25.813477 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1312/2554] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:25 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1740 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:26.156228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-2015efea-c810-4946-b0ad-67d4f2e9a781 req-b337c03b-d957-441d-9291-9044a20aeacc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d3e9f6b-d322-4c17-9b7a-dae9c0867822", "tag": "e8dc33c2-75df-4472-a438-c3f1dc3de0b4"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:26.175626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2015efea-c810-4946-b0ad-67d4f2e9a781 req-b337c03b-d957-441d-9291-9044a20aeacc service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:26.176007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2015efea-c810-4946-b0ad-67d4f2e9a781 req-b337c03b-d957-441d-9291-9044a20aeacc service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:26.217662 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-2015efea-c810-4946-b0ad-67d4f2e9a781 req-b337c03b-d957-441d-9291-9044a20aeacc service nova] Creating event network-changed:e8dc33c2-75df-4472-a438-c3f1dc3de0b4 for instance 9d3e9f6b-d322-4c17-9b7a-dae9c0867822 on n-h2-843621-1 May 27 15:07:26.230333 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-2015efea-c810-4946-b0ad-67d4f2e9a781 req-b337c03b-d957-441d-9291-9044a20aeacc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079039 May 27 15:07:26.235478 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1313/2555] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:26.374049 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7d3387e6-46e2-4650-8edd-aad98f1f9f14 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:26.387191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-314043c8-1e11-4908-be4a-baff12831436 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:26.388140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-314043c8-1e11-4908-be4a-baff12831436 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:26.402775 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7d3387e6-46e2-4650-8edd-aad98f1f9f14 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1310 microversion: 2.1 time: 0.777451 May 27 15:07:26.405869 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1243/2556] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:25 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1310 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:26.408069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-314043c8-1e11-4908-be4a-baff12831436 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:26.410132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-314043c8-1e11-4908-be4a-baff12831436 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:26.411887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-314043c8-1e11-4908-be4a-baff12831436 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:26.413300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-314043c8-1e11-4908-be4a-baff12831436 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:26.631494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-94a2b541-a424-4a74-98ee-ebeb88bfddd9 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776d64d30>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:26.719422 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-94a2b541-a424-4a74-98ee-ebeb88bfddd9 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.088747 May 27 15:07:26.720076 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1244/2557] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:26 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:07:26.726591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-314043c8-1e11-4908-be4a-baff12831436 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:26.749100 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-314043c8-1e11-4908-be4a-baff12831436 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.368689 May 27 15:07:26.751317 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1314/2558] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:26 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:07:26.832788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-32d1eeac-699f-484f-a27e-d66e65d185f1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:26.833429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-32d1eeac-699f-484f-a27e-d66e65d185f1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:26.843091 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32d1eeac-699f-484f-a27e-d66e65d185f1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:26.843693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32d1eeac-699f-484f-a27e-d66e65d185f1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:26.845370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32d1eeac-699f-484f-a27e-d66e65d185f1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:26.847039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32d1eeac-699f-484f-a27e-d66e65d185f1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:27.085858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-32d1eeac-699f-484f-a27e-d66e65d185f1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:27.095885 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-32d1eeac-699f-484f-a27e-d66e65d185f1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:27.098064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-32d1eeac-699f-484f-a27e-d66e65d185f1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:27.099567 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-32d1eeac-699f-484f-a27e-d66e65d185f1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1740 microversion: 2.20 time: 0.271603 May 27 15:07:27.101395 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1245/2559] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:26 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1740 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:27.435667 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-159f63ed-fe02-44ce-9fa2-33f02402e259 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:27.439178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-159f63ed-fe02-44ce-9fa2-33f02402e259 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:27.469297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-159f63ed-fe02-44ce-9fa2-33f02402e259 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:27.470331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-159f63ed-fe02-44ce-9fa2-33f02402e259 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:27.471152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-159f63ed-fe02-44ce-9fa2-33f02402e259 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:27.475087 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-159f63ed-fe02-44ce-9fa2-33f02402e259 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:27.485623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:27.733106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f74bd693-84dc-467a-ad2e-653353724630 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc7806ab5e0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:27.802939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-159f63ed-fe02-44ce-9fa2-33f02402e259 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:27.819186 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f74bd693-84dc-467a-ad2e-653353724630 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.090331 May 27 15:07:27.820410 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-159f63ed-fe02-44ce-9fa2-33f02402e259 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1310 microversion: 2.1 time: 0.401104 May 27 15:07:27.820547 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1246/2560] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:27 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:07:27.823856 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1315/2561] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:27 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1310 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:27.826508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fe99065c-ea8b-4a9b-975e-1b51fc390151 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:27.827382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fe99065c-ea8b-4a9b-975e-1b51fc390151 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:27.840918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe99065c-ea8b-4a9b-975e-1b51fc390151 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:27.841776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe99065c-ea8b-4a9b-975e-1b51fc390151 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:27.842857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe99065c-ea8b-4a9b-975e-1b51fc390151 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:27.843480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe99065c-ea8b-4a9b-975e-1b51fc390151 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:28.076484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fe99065c-ea8b-4a9b-975e-1b51fc390151 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:28.085198 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fe99065c-ea8b-4a9b-975e-1b51fc390151 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.263328 May 27 15:07:28.085799 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1247/2562] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:27 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:28.121691 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-93ca49ce-fff4-4ca3-b273-34901981266a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:28.122850 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-93ca49ce-fff4-4ca3-b273-34901981266a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:28.136426 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-93ca49ce-fff4-4ca3-b273-34901981266a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:28.141164 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-93ca49ce-fff4-4ca3-b273-34901981266a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:28.142734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-93ca49ce-fff4-4ca3-b273-34901981266a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:28.143312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-93ca49ce-fff4-4ca3-b273-34901981266a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:28.455522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-93ca49ce-fff4-4ca3-b273-34901981266a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:28.468254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-93ca49ce-fff4-4ca3-b273-34901981266a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:28.470573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-93ca49ce-fff4-4ca3-b273-34901981266a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:28.474528 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-93ca49ce-fff4-4ca3-b273-34901981266a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1740 microversion: 2.20 time: 0.356770 May 27 15:07:28.490260 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1316/2563] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:28 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1740 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:28.839155 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3503cdc6-da5f-4687-89eb-6295573114f8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:28.839954 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3503cdc6-da5f-4687-89eb-6295573114f8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:28.845930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f7a1110a-ac40-4e2c-8fa9-1d9362de5bac tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc7765d3c10>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:28.853700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:28.857089 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3503cdc6-da5f-4687-89eb-6295573114f8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:28.858299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3503cdc6-da5f-4687-89eb-6295573114f8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:28.864858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3503cdc6-da5f-4687-89eb-6295573114f8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:28.865835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3503cdc6-da5f-4687-89eb-6295573114f8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:28.921337 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f7a1110a-ac40-4e2c-8fa9-1d9362de5bac tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.082229 May 27 15:07:28.931655 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1317/2564] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:28 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:07:29.114744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d7c0f085-645b-4630-b2c3-e64e446e83aa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:29.116805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d7c0f085-645b-4630-b2c3-e64e446e83aa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:29.129413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7c0f085-645b-4630-b2c3-e64e446e83aa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:29.130134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7c0f085-645b-4630-b2c3-e64e446e83aa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:29.131251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7c0f085-645b-4630-b2c3-e64e446e83aa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:29.132208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7c0f085-645b-4630-b2c3-e64e446e83aa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:29.420847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3503cdc6-da5f-4687-89eb-6295573114f8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:29.433206 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3503cdc6-da5f-4687-89eb-6295573114f8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1310 microversion: 2.1 time: 0.598184 May 27 15:07:29.438313 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1248/2565] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:28 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1310 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:29.494667 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-eed3eb72-5293-469c-87ed-270b7a9ca7b5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:29.495304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-eed3eb72-5293-469c-87ed-270b7a9ca7b5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:29.514623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eed3eb72-5293-469c-87ed-270b7a9ca7b5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:29.515092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eed3eb72-5293-469c-87ed-270b7a9ca7b5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:29.515921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eed3eb72-5293-469c-87ed-270b7a9ca7b5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:29.516378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eed3eb72-5293-469c-87ed-270b7a9ca7b5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:29.535514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d7c0f085-645b-4630-b2c3-e64e446e83aa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:29.547111 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d7c0f085-645b-4630-b2c3-e64e446e83aa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.448395 May 27 15:07:29.560064 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1318/2566] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:29 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:29.690639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:29.751300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:29.857397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-eed3eb72-5293-469c-87ed-270b7a9ca7b5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:29.870126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-eed3eb72-5293-469c-87ed-270b7a9ca7b5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:29.872438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-eed3eb72-5293-469c-87ed-270b7a9ca7b5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:29.873728 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-eed3eb72-5293-469c-87ed-270b7a9ca7b5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1740 microversion: 2.20 time: 0.383341 May 27 15:07:29.877160 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1249/2567] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:29 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1740 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:07:29.936262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-90879531-06df-46b1-9e7a-5a7073226752 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc7765c3160>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:30.023155 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-90879531-06df-46b1-9e7a-5a7073226752 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.091304 May 27 15:07:30.026090 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1319/2568] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:29 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:07:30.459384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f1f64b23-8af4-47ce-bfc5-653f467c6a50 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:30.460647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f1f64b23-8af4-47ce-bfc5-653f467c6a50 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:30.471420 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1f64b23-8af4-47ce-bfc5-653f467c6a50 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:30.478015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1f64b23-8af4-47ce-bfc5-653f467c6a50 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:30.479046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1f64b23-8af4-47ce-bfc5-653f467c6a50 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:30.480138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1f64b23-8af4-47ce-bfc5-653f467c6a50 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:30.559148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:30.565526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:30.576014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9b49a5e4-1160-4998-8810-e77a50387a5e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:30.579538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9b49a5e4-1160-4998-8810-e77a50387a5e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:30.612919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b49a5e4-1160-4998-8810-e77a50387a5e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:30.613735 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b49a5e4-1160-4998-8810-e77a50387a5e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:30.619616 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b49a5e4-1160-4998-8810-e77a50387a5e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:30.631743 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b49a5e4-1160-4998-8810-e77a50387a5e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:30.871267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f1f64b23-8af4-47ce-bfc5-653f467c6a50 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:30.882630 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f1f64b23-8af4-47ce-bfc5-653f467c6a50 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1310 microversion: 2.1 time: 0.431189 May 27 15:07:30.895317 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1250/2569] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:30 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1310 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:07:30.916483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9b49a5e4-1160-4998-8810-e77a50387a5e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:30.926704 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9b49a5e4-1160-4998-8810-e77a50387a5e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.363217 May 27 15:07:30.937604 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1320/2570] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:30 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:30.937604 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0a83807d-54f3-47ee-bac1-b724ca1f678f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:30.937604 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0a83807d-54f3-47ee-bac1-b724ca1f678f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:30.941762 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:30.945075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a83807d-54f3-47ee-bac1-b724ca1f678f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:30.945779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a83807d-54f3-47ee-bac1-b724ca1f678f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:30.946775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a83807d-54f3-47ee-bac1-b724ca1f678f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:30.947360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a83807d-54f3-47ee-bac1-b724ca1f678f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:31.166712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0a83807d-54f3-47ee-bac1-b724ca1f678f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:31.178489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1246815d-c7cf-4f2b-b3b4-1b1296c4b0ce tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1891189963", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "5e060146-66c4-492e-80f7-70a65c4297cc"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:31.192062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0a83807d-54f3-47ee-bac1-b724ca1f678f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:31.196081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0a83807d-54f3-47ee-bac1-b724ca1f678f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:31.200577 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0a83807d-54f3-47ee-bac1-b724ca1f678f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1740 microversion: 2.20 time: 0.270136 May 27 15:07:31.201776 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1321/2571] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:30 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1740 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:31.210845 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6e8cbe6c-37bc-44dc-9375-428e3a946879 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc780605280>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:31.249286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-1246815d-c7cf-4f2b-b3b4-1b1296c4b0ce tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] validate_networks() for [('5e060146-66c4-492e-80f7-70a65c4297cc', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:07:31.287207 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6e8cbe6c-37bc-44dc-9375-428e3a946879 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.083843 May 27 15:07:31.288358 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1322/2572] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:31 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:31.734090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-1246815d-c7cf-4f2b-b3b4-1b1296c4b0ce tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:07:31.734602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-1246815d-c7cf-4f2b-b3b4-1b1296c4b0ce tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:07:31.735298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-1246815d-c7cf-4f2b-b3b4-1b1296c4b0ce tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:07:31.736127 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-1246815d-c7cf-4f2b-b3b4-1b1296c4b0ce tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:07:31.736719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-1246815d-c7cf-4f2b-b3b4-1b1296c4b0ce tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:07:31.747117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1246815d-c7cf-4f2b-b3b4-1b1296c4b0ce tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:31.747592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1246815d-c7cf-4f2b-b3b4-1b1296c4b0ce tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:31.748429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1246815d-c7cf-4f2b-b3b4-1b1296c4b0ce tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:31.748922 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1246815d-c7cf-4f2b-b3b4-1b1296c4b0ce tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:31.767485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-1246815d-c7cf-4f2b-b3b4-1b1296c4b0ce tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Getting quotas for project 628e59220c154dcda54532c0b3606f2b. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:07:31.773581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-1246815d-c7cf-4f2b-b3b4-1b1296c4b0ce tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Getting quotas for user 55944b29f3ba44d8b08ae71ce65be230 and project 628e59220c154dcda54532c0b3606f2b. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:07:31.787708 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1246815d-c7cf-4f2b-b3b4-1b1296c4b0ce tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:07:31.790152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1246815d-c7cf-4f2b-b3b4-1b1296c4b0ce tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:07:31.838788 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1246815d-c7cf-4f2b-b3b4-1b1296c4b0ce tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938238 May 27 15:07:31.839454 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1251/2573] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:07:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:07:31.850116 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e71f817-047a-4e0a-b6ce-1962b721418f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:31.850748 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e71f817-047a-4e0a-b6ce-1962b721418f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:31.908835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a4093ce2-b0a6-41d7-b145-073766a1f536 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:31.909493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a4093ce2-b0a6-41d7-b145-073766a1f536 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:31.920047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4093ce2-b0a6-41d7-b145-073766a1f536 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:31.920515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4093ce2-b0a6-41d7-b145-073766a1f536 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:31.921498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4093ce2-b0a6-41d7-b145-073766a1f536 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:31.921951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4093ce2-b0a6-41d7-b145-073766a1f536 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:31.931891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e71f817-047a-4e0a-b6ce-1962b721418f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:31.941456 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e71f817-047a-4e0a-b6ce-1962b721418f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1218 microversion: 2.1 time: 0.095387 May 27 15:07:31.942748 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1323/2574] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:31 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:31.947694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f8b375f2-2c03-4f90-b47f-45e03905d186 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:31.948657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f8b375f2-2c03-4f90-b47f-45e03905d186 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:31.956936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8b375f2-2c03-4f90-b47f-45e03905d186 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:31.957666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8b375f2-2c03-4f90-b47f-45e03905d186 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:31.958606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8b375f2-2c03-4f90-b47f-45e03905d186 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:31.959197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8b375f2-2c03-4f90-b47f-45e03905d186 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:32.163023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a4093ce2-b0a6-41d7-b145-073766a1f536 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:32.172500 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a4093ce2-b0a6-41d7-b145-073766a1f536 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1310 microversion: 2.1 time: 0.271964 May 27 15:07:32.174244 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1252/2575] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:31 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1310 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:32.229548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-77fa09c4-1b73-4c5b-9f2e-40dba0f00c32 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:32.230709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-77fa09c4-1b73-4c5b-9f2e-40dba0f00c32 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:32.238884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-77fa09c4-1b73-4c5b-9f2e-40dba0f00c32 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:32.239771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-77fa09c4-1b73-4c5b-9f2e-40dba0f00c32 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:32.243118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-77fa09c4-1b73-4c5b-9f2e-40dba0f00c32 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:32.243894 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-77fa09c4-1b73-4c5b-9f2e-40dba0f00c32 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:32.269734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f8b375f2-2c03-4f90-b47f-45e03905d186 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:32.289274 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f8b375f2-2c03-4f90-b47f-45e03905d186 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.343331 May 27 15:07:32.291273 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1324/2576] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:31 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:32.306775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-58e0304e-025a-4b1e-9c7c-69d9a77ef753 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc7807ef3a0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:32.373708 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-58e0304e-025a-4b1e-9c7c-69d9a77ef753 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.072767 May 27 15:07:32.374643 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1325/2577] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:32 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:32.470640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-d6934c4e-5adf-4e05-9058-ff3f75c23dd6 req-e711d162-6a26-4cd3-b4a4-53dcbf3d24d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3e9f6b-d322-4c17-9b7a-dae9c0867822", "name": "network-vif-plugged", "status": "completed", "tag": "e8dc33c2-75df-4472-a438-c3f1dc3de0b4"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:32.483317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d6934c4e-5adf-4e05-9058-ff3f75c23dd6 req-e711d162-6a26-4cd3-b4a4-53dcbf3d24d7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:32.484167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d6934c4e-5adf-4e05-9058-ff3f75c23dd6 req-e711d162-6a26-4cd3-b4a4-53dcbf3d24d7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:32.521846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-77fa09c4-1b73-4c5b-9f2e-40dba0f00c32 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:32.522515 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-d6934c4e-5adf-4e05-9058-ff3f75c23dd6 req-e711d162-6a26-4cd3-b4a4-53dcbf3d24d7 service nova] Creating event network-vif-plugged:e8dc33c2-75df-4472-a438-c3f1dc3de0b4 for instance 9d3e9f6b-d322-4c17-9b7a-dae9c0867822 on n-h2-843621-1 May 27 15:07:32.529031 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-d6934c4e-5adf-4e05-9058-ff3f75c23dd6 req-e711d162-6a26-4cd3-b4a4-53dcbf3d24d7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064830 May 27 15:07:32.530186 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1326/2578] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:32.535389 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-77fa09c4-1b73-4c5b-9f2e-40dba0f00c32 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:32.537521 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-77fa09c4-1b73-4c5b-9f2e-40dba0f00c32 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:32.552881 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-77fa09c4-1b73-4c5b-9f2e-40dba0f00c32 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1722 microversion: 2.20 time: 0.336178 May 27 15:07:32.565985 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1253/2579] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:32 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:07:32.960505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-29e57edb-8b51-457f-9471-82d0743deebf tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:32.961631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-29e57edb-8b51-457f-9471-82d0743deebf tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:32.972028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29e57edb-8b51-457f-9471-82d0743deebf tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:32.973271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29e57edb-8b51-457f-9471-82d0743deebf tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:32.974147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29e57edb-8b51-457f-9471-82d0743deebf tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:32.974659 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29e57edb-8b51-457f-9471-82d0743deebf tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:33.043475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-29e57edb-8b51-457f-9471-82d0743deebf tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:33.052735 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-29e57edb-8b51-457f-9471-82d0743deebf tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1270 microversion: 2.1 time: 0.096395 May 27 15:07:33.052735 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1327/2580] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:32 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:33.191417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1f479012-3abd-4ad9-96fe-a6b84e0ecf80 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:33.192619 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1f479012-3abd-4ad9-96fe-a6b84e0ecf80 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:33.202439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f479012-3abd-4ad9-96fe-a6b84e0ecf80 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:33.203190 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f479012-3abd-4ad9-96fe-a6b84e0ecf80 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:33.204185 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f479012-3abd-4ad9-96fe-a6b84e0ecf80 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:33.205373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f479012-3abd-4ad9-96fe-a6b84e0ecf80 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:33.307435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4bf5bf0d-ba31-4177-9345-f1fc7921635f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:33.309743 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4bf5bf0d-ba31-4177-9345-f1fc7921635f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:33.317672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4bf5bf0d-ba31-4177-9345-f1fc7921635f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:33.318329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4bf5bf0d-ba31-4177-9345-f1fc7921635f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:33.319309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4bf5bf0d-ba31-4177-9345-f1fc7921635f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:33.320119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4bf5bf0d-ba31-4177-9345-f1fc7921635f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:33.556369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1f479012-3abd-4ad9-96fe-a6b84e0ecf80 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:33.567615 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1f479012-3abd-4ad9-96fe-a6b84e0ecf80 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1310 microversion: 2.1 time: 0.381449 May 27 15:07:33.568481 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1254/2581] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:33 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1310 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:07:33.576505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ab8aa550-90aa-4931-a031-df68185e12f8 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776d78790>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:33.613551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4bf5bf0d-ba31-4177-9345-f1fc7921635f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:33.623726 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4bf5bf0d-ba31-4177-9345-f1fc7921635f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.320353 May 27 15:07:33.642565 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1328/2582] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:33 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:33.650326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e4c3b5ce-81ef-43ec-993c-ab85438b3015 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:33.650953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e4c3b5ce-81ef-43ec-993c-ab85438b3015 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:33.664340 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ab8aa550-90aa-4931-a031-df68185e12f8 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.094753 May 27 15:07:33.664979 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1255/2583] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:33 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:33.670585 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4c3b5ce-81ef-43ec-993c-ab85438b3015 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:33.671120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4c3b5ce-81ef-43ec-993c-ab85438b3015 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:33.672048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4c3b5ce-81ef-43ec-993c-ab85438b3015 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:33.672503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4c3b5ce-81ef-43ec-993c-ab85438b3015 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:33.881920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e4c3b5ce-81ef-43ec-993c-ab85438b3015 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:33.892258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e4c3b5ce-81ef-43ec-993c-ab85438b3015 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:33.894544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e4c3b5ce-81ef-43ec-993c-ab85438b3015 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:33.896000 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e4c3b5ce-81ef-43ec-993c-ab85438b3015 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1722 microversion: 2.20 time: 0.252384 May 27 15:07:33.896655 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1329/2584] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:33 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:34.072601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-81384cac-962b-40db-b347-9bf9e20bb7a3 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:34.073236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-81384cac-962b-40db-b347-9bf9e20bb7a3 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:34.094066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81384cac-962b-40db-b347-9bf9e20bb7a3 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:34.095249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81384cac-962b-40db-b347-9bf9e20bb7a3 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:34.096789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81384cac-962b-40db-b347-9bf9e20bb7a3 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:34.097735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81384cac-962b-40db-b347-9bf9e20bb7a3 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:34.208372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-81384cac-962b-40db-b347-9bf9e20bb7a3 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:34.217170 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-81384cac-962b-40db-b347-9bf9e20bb7a3 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1270 microversion: 2.1 time: 0.151047 May 27 15:07:34.217747 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1256/2585] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:34 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1270 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:34.566928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-90348121-925b-41c0-a279-9e11d4fa6d45 req-62d3b0c4-adc3-4a30-8be6-6779ef467015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9604d14-4598-4d42-8bbf-8763103061a4", "name": "network-vif-plugged", "status": "completed", "tag": "648e11b1-5568-4d40-a6cd-7e3f346ef13b"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:34.586460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-31c03bf6-f03b-4336-a69f-c9fb1f5d23d6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:34.587898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-31c03bf6-f03b-4336-a69f-c9fb1f5d23d6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:34.596428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-31c03bf6-f03b-4336-a69f-c9fb1f5d23d6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:34.597668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-31c03bf6-f03b-4336-a69f-c9fb1f5d23d6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:34.598765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-31c03bf6-f03b-4336-a69f-c9fb1f5d23d6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:34.600120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-31c03bf6-f03b-4336-a69f-c9fb1f5d23d6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:34.600242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-90348121-925b-41c0-a279-9e11d4fa6d45 req-62d3b0c4-adc3-4a30-8be6-6779ef467015 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:34.605760 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-90348121-925b-41c0-a279-9e11d4fa6d45 req-62d3b0c4-adc3-4a30-8be6-6779ef467015 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:34.623639 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-90348121-925b-41c0-a279-9e11d4fa6d45 req-62d3b0c4-adc3-4a30-8be6-6779ef467015 service nova] Creating event network-vif-plugged:648e11b1-5568-4d40-a6cd-7e3f346ef13b for instance d9604d14-4598-4d42-8bbf-8763103061a4 on n-h1-843621-1 May 27 15:07:34.629732 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-90348121-925b-41c0-a279-9e11d4fa6d45 req-62d3b0c4-adc3-4a30-8be6-6779ef467015 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070307 May 27 15:07:34.630879 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1330/2586] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:34.646362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-24aaf396-d8a9-4cc8-ae2b-a17639bac646 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:34.648193 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-24aaf396-d8a9-4cc8-ae2b-a17639bac646 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:34.665666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24aaf396-d8a9-4cc8-ae2b-a17639bac646 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:34.666142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24aaf396-d8a9-4cc8-ae2b-a17639bac646 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:34.667265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24aaf396-d8a9-4cc8-ae2b-a17639bac646 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:34.667725 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24aaf396-d8a9-4cc8-ae2b-a17639bac646 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:34.894600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-31c03bf6-f03b-4336-a69f-c9fb1f5d23d6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:34.907626 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-31c03bf6-f03b-4336-a69f-c9fb1f5d23d6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1310 microversion: 2.1 time: 0.327442 May 27 15:07:34.915965 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1257/2587] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:34 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1310 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:34.929310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aeca54e5-90eb-436c-88f8-7864881acaaa tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776c9df70>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:34.938917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-24aaf396-d8a9-4cc8-ae2b-a17639bac646 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:34.975764 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-24aaf396-d8a9-4cc8-ae2b-a17639bac646 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.334489 May 27 15:07:34.988953 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1331/2588] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:34 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:35.033710 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-aeca54e5-90eb-436c-88f8-7864881acaaa tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.115885 May 27 15:07:35.045555 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1258/2589] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:34 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:35.050672 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7e61759b-4e90-4575-a544-85b6600755f2 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:35.051571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7e61759b-4e90-4575-a544-85b6600755f2 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:35.060244 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e61759b-4e90-4575-a544-85b6600755f2 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:35.060712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e61759b-4e90-4575-a544-85b6600755f2 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:35.062005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e61759b-4e90-4575-a544-85b6600755f2 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:35.062457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e61759b-4e90-4575-a544-85b6600755f2 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:35.102694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3ffd4908-a11f-456b-adb0-5284ed784ab4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1296913533", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:35.212643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-3ffd4908-a11f-456b-adb0-5284ed784ab4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] validate_networks() for [('93956e1e-5eb7-40a1-9d47-e750e9b86cdc', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:07:35.769542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7e61759b-4e90-4575-a544-85b6600755f2 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:35.783216 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7e61759b-4e90-4575-a544-85b6600755f2 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:35.785084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7e61759b-4e90-4575-a544-85b6600755f2 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:35.790497 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7e61759b-4e90-4575-a544-85b6600755f2 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1725 microversion: 2.20 time: 0.743773 May 27 15:07:35.791491 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1259/2590] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:35 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1725 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:35.823168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fb9fbcc2-ec4c-4a08-8853-40a2fc42f471 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:35.824774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fb9fbcc2-ec4c-4a08-8853-40a2fc42f471 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:35.843729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb9fbcc2-ec4c-4a08-8853-40a2fc42f471 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:35.844899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb9fbcc2-ec4c-4a08-8853-40a2fc42f471 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:35.850177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb9fbcc2-ec4c-4a08-8853-40a2fc42f471 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:35.850914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb9fbcc2-ec4c-4a08-8853-40a2fc42f471 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:36.051200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fb9fbcc2-ec4c-4a08-8853-40a2fc42f471 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:36.070793 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fb9fbcc2-ec4c-4a08-8853-40a2fc42f471 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1288 microversion: 2.1 time: 0.254243 May 27 15:07:36.071651 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1260/2591] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:35 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1288 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:36.095955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-68786d42-21b4-4428-9be9-e1aad7e00dfa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f14fba0c-76ab-454d-8482-dfde0063ee0c"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:36.097144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-68786d42-21b4-4428-9be9-e1aad7e00dfa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:36.114025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68786d42-21b4-4428-9be9-e1aad7e00dfa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:36.114967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68786d42-21b4-4428-9be9-e1aad7e00dfa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:36.123119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68786d42-21b4-4428-9be9-e1aad7e00dfa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:36.124549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68786d42-21b4-4428-9be9-e1aad7e00dfa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:36.506397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3ffd4908-a11f-456b-adb0-5284ed784ab4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:07:36.507568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3ffd4908-a11f-456b-adb0-5284ed784ab4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:07:36.508270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3ffd4908-a11f-456b-adb0-5284ed784ab4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:07:36.509300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3ffd4908-a11f-456b-adb0-5284ed784ab4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:07:36.510180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3ffd4908-a11f-456b-adb0-5284ed784ab4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:07:36.527013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3ffd4908-a11f-456b-adb0-5284ed784ab4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:36.527972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3ffd4908-a11f-456b-adb0-5284ed784ab4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:36.529898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3ffd4908-a11f-456b-adb0-5284ed784ab4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:36.530759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3ffd4908-a11f-456b-adb0-5284ed784ab4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:36.557501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-3ffd4908-a11f-456b-adb0-5284ed784ab4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Getting quotas for project 49b057ed8d9d43c780f96e5058dc5af8. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:07:36.568355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-3ffd4908-a11f-456b-adb0-5284ed784ab4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Getting quotas for user 2848a14967f74c49a4ed533b74f7a394 and project 49b057ed8d9d43c780f96e5058dc5af8. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:07:36.590119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3ffd4908-a11f-456b-adb0-5284ed784ab4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:07:36.594315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3ffd4908-a11f-456b-adb0-5284ed784ab4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:07:36.702238 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3ffd4908-a11f-456b-adb0-5284ed784ab4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.711914 May 27 15:07:36.703599 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1332/2592] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:07:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 1714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:07:36.711224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6a0a396b-b83c-48d8-9178-82da7e24bbae tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:36.712613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6a0a396b-b83c-48d8-9178-82da7e24bbae tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:36.726899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6a0a396b-b83c-48d8-9178-82da7e24bbae tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:36.727490 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6a0a396b-b83c-48d8-9178-82da7e24bbae tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:36.728983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6a0a396b-b83c-48d8-9178-82da7e24bbae tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:36.729601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6a0a396b-b83c-48d8-9178-82da7e24bbae tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:36.772278 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-68786d42-21b4-4428-9be9-e1aad7e00dfa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "POST /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.696299 May 27 15:07:36.778407 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1261/2593] 10.222.0.13 () {62 vars in 1363 bytes} [Fri May 27 15:07:36 2022] POST /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments => generated 188 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:07:36.780309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e23c27ac-11a2-4480-b13b-84927d5bc3d1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:36.781548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e23c27ac-11a2-4480-b13b-84927d5bc3d1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:36.795959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e23c27ac-11a2-4480-b13b-84927d5bc3d1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:36.796423 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e23c27ac-11a2-4480-b13b-84927d5bc3d1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:36.797232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e23c27ac-11a2-4480-b13b-84927d5bc3d1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:36.797935 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e23c27ac-11a2-4480-b13b-84927d5bc3d1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:37.085251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6a0a396b-b83c-48d8-9178-82da7e24bbae tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:37.101375 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6a0a396b-b83c-48d8-9178-82da7e24bbae tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1493 microversion: 2.1 time: 0.396940 May 27 15:07:37.102482 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1333/2594] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:36 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1493 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:37.110496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a65375bc-97e7-4f84-82df-69c9af1c85e5 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc77666c790>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:37.146450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e23c27ac-11a2-4480-b13b-84927d5bc3d1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:37.156736 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e23c27ac-11a2-4480-b13b-84927d5bc3d1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.382025 May 27 15:07:37.158811 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1262/2595] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:36 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:37.182414 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-6f12c234-22ae-41d4-8482-8157965226b7 req-15334535-f4d7-4b12-ad80-bb93388fd24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d17a653-7f3e-44d7-9b89-68b4b35c9175", "name": "network-vif-unplugged", "status": "completed", "tag": "f12487eb-11c2-4e49-877b-4fd161db40aa"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:37.195178 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a65375bc-97e7-4f84-82df-69c9af1c85e5 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.090630 May 27 15:07:37.201771 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1334/2596] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:37 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:37.202475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6f12c234-22ae-41d4-8482-8157965226b7 req-15334535-f4d7-4b12-ad80-bb93388fd24a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:37.202475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6f12c234-22ae-41d4-8482-8157965226b7 req-15334535-f4d7-4b12-ad80-bb93388fd24a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:37.204697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2ff0d9ef-51d8-479b-8e62-6ca77bcab34c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:37.205455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2ff0d9ef-51d8-479b-8e62-6ca77bcab34c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:37.236158 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.compute.server_external_events [req-6f12c234-22ae-41d4-8482-8157965226b7 req-15334535-f4d7-4b12-ad80-bb93388fd24a service nova] Unable to find a host for instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175. Dropping event network-vif-unplugged {{(pid=119249) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 27 15:07:37.237274 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-6f12c234-22ae-41d4-8482-8157965226b7 req-15334535-f4d7-4b12-ad80-bb93388fd24a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.077322 May 27 15:07:37.237896 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1263/2597] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 79 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 27 15:07:37.251489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1f356c7a-887e-4f72-a059-4bb16dec26b1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:37.252087 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1f356c7a-887e-4f72-a059-4bb16dec26b1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:37.269462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f356c7a-887e-4f72-a059-4bb16dec26b1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:37.270041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f356c7a-887e-4f72-a059-4bb16dec26b1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:37.271181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f356c7a-887e-4f72-a059-4bb16dec26b1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:37.272552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f356c7a-887e-4f72-a059-4bb16dec26b1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:37.354576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2ff0d9ef-51d8-479b-8e62-6ca77bcab34c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:37.367048 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2ff0d9ef-51d8-479b-8e62-6ca77bcab34c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1223 microversion: 2.1 time: 0.169973 May 27 15:07:37.384843 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1335/2598] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:37 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1223 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:37.398309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-270c166e-a6f2-4f0c-b350-e959fcfaf769 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:37.403648 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-270c166e-a6f2-4f0c-b350-e959fcfaf769 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:37.438898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-270c166e-a6f2-4f0c-b350-e959fcfaf769 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:37.439823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-270c166e-a6f2-4f0c-b350-e959fcfaf769 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:37.446271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-270c166e-a6f2-4f0c-b350-e959fcfaf769 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:37.446732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-270c166e-a6f2-4f0c-b350-e959fcfaf769 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:37.523834 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1f356c7a-887e-4f72-a059-4bb16dec26b1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "POST /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/action" status: 202 len: 0 microversion: 2.20 time: 0.283605 May 27 15:07:37.526073 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1264/2599] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 27 15:07:37 2022] POST /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 15:07:37.545451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dc178bdc-95ef-48ed-be07-0537358f0365 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:37.548114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dc178bdc-95ef-48ed-be07-0537358f0365 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:37.551057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-270c166e-a6f2-4f0c-b350-e959fcfaf769 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:37.561097 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-270c166e-a6f2-4f0c-b350-e959fcfaf769 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1276 microversion: 2.1 time: 0.174523 May 27 15:07:37.561876 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1336/2600] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:37 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:37.571979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc178bdc-95ef-48ed-be07-0537358f0365 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:37.572608 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc178bdc-95ef-48ed-be07-0537358f0365 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:37.577888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-84a9e833-dd9c-4751-9f03-b84c60c83c46 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:37.578553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-84a9e833-dd9c-4751-9f03-b84c60c83c46 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:37.586456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84a9e833-dd9c-4751-9f03-b84c60c83c46 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:37.587011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84a9e833-dd9c-4751-9f03-b84c60c83c46 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:37.588404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84a9e833-dd9c-4751-9f03-b84c60c83c46 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:37.588898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84a9e833-dd9c-4751-9f03-b84c60c83c46 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:37.595519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc178bdc-95ef-48ed-be07-0537358f0365 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:37.596552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc178bdc-95ef-48ed-be07-0537358f0365 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:37.909414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-84a9e833-dd9c-4751-9f03-b84c60c83c46 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:37.924548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-84a9e833-dd9c-4751-9f03-b84c60c83c46 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:37.926324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-84a9e833-dd9c-4751-9f03-b84c60c83c46 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:37.927817 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-84a9e833-dd9c-4751-9f03-b84c60c83c46 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1751 microversion: 2.20 time: 0.355052 May 27 15:07:37.937038 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1337/2601] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:37 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1751 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:37.973173 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dc178bdc-95ef-48ed-be07-0537358f0365 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1644 microversion: 2.1 time: 0.443461 May 27 15:07:37.989049 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1265/2602] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:37 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1644 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:37.997443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a75d980e-4bde-4f9c-b22b-8fccc81a76dd tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:37.998544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a75d980e-4bde-4f9c-b22b-8fccc81a76dd tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:38.016714 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a75d980e-4bde-4f9c-b22b-8fccc81a76dd tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:38.017628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a75d980e-4bde-4f9c-b22b-8fccc81a76dd tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:38.018672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a75d980e-4bde-4f9c-b22b-8fccc81a76dd tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:38.019848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a75d980e-4bde-4f9c-b22b-8fccc81a76dd tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:38.176136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8deca405-825c-4b0c-8a28-ecd3657c8f94 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:38.177429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8deca405-825c-4b0c-8a28-ecd3657c8f94 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:38.190061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8deca405-825c-4b0c-8a28-ecd3657c8f94 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:38.190682 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8deca405-825c-4b0c-8a28-ecd3657c8f94 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:38.191821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8deca405-825c-4b0c-8a28-ecd3657c8f94 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:38.192372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8deca405-825c-4b0c-8a28-ecd3657c8f94 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:38.404450 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a75d980e-4bde-4f9c-b22b-8fccc81a76dd tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1644 microversion: 2.1 time: 0.411579 May 27 15:07:38.405252 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1338/2603] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:37 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1644 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:38.428877 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e0d9b004-bc08-42b4-b852-36a7c30983ea tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc7765c35e0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:38.520569 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e0d9b004-bc08-42b4-b852-36a7c30983ea tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.113521 May 27 15:07:38.531265 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1339/2604] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:38 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:38.551391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8deca405-825c-4b0c-8a28-ecd3657c8f94 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:38.555399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:38.559150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a5570e7c-0e90-4db1-87fa-6c98ee74b90d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:38.564279 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a5570e7c-0e90-4db1-87fa-6c98ee74b90d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:38.569577 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8deca405-825c-4b0c-8a28-ecd3657c8f94 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.397702 May 27 15:07:38.574497 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1266/2605] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:38 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:38.575967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a5570e7c-0e90-4db1-87fa-6c98ee74b90d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:38.576525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a5570e7c-0e90-4db1-87fa-6c98ee74b90d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:38.577667 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a5570e7c-0e90-4db1-87fa-6c98ee74b90d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:38.578347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a5570e7c-0e90-4db1-87fa-6c98ee74b90d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:38.592324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3f56ab22-c01d-4572-9d58-b7a907f4bba6 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:38.594144 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:07:38.594144 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 15:07:38.597277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f56ab22-c01d-4572-9d58-b7a907f4bba6 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:38.598284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f56ab22-c01d-4572-9d58-b7a907f4bba6 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:38.601877 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f56ab22-c01d-4572-9d58-b7a907f4bba6 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:38.605279 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f56ab22-c01d-4572-9d58-b7a907f4bba6 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:38.661903 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3f56ab22-c01d-4572-9d58-b7a907f4bba6 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.085434 May 27 15:07:38.663892 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1267/2606] 10.222.0.13 () {58 vars in 1175 bytes} [Fri May 27 15:07:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:38.682272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4825fe88-7e0a-48da-8709-3466a22e5ba8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:38.683668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4825fe88-7e0a-48da-8709-3466a22e5ba8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:38.695815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4825fe88-7e0a-48da-8709-3466a22e5ba8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:38.697153 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4825fe88-7e0a-48da-8709-3466a22e5ba8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:38.698964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4825fe88-7e0a-48da-8709-3466a22e5ba8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:38.699529 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4825fe88-7e0a-48da-8709-3466a22e5ba8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:38.724115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a5570e7c-0e90-4db1-87fa-6c98ee74b90d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:38.738974 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a5570e7c-0e90-4db1-87fa-6c98ee74b90d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1275 microversion: 2.1 time: 0.202310 May 27 15:07:38.742514 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1340/2607] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:38 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1275 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:38.760738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fa195578-9629-47a7-a29a-5b0c3f05f482 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:38.761490 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fa195578-9629-47a7-a29a-5b0c3f05f482 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:38.781078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa195578-9629-47a7-a29a-5b0c3f05f482 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:38.783595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa195578-9629-47a7-a29a-5b0c3f05f482 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:38.784458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa195578-9629-47a7-a29a-5b0c3f05f482 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:38.784909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa195578-9629-47a7-a29a-5b0c3f05f482 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:38.944701 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:38.989663 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fa195578-9629-47a7-a29a-5b0c3f05f482 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822/action" status: 202 len: 0 microversion: 2.1 time: 0.243272 May 27 15:07:38.993865 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1341/2608] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:07:38 2022] POST /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:07:38.995788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4825fe88-7e0a-48da-8709-3466a22e5ba8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:39.010136 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4825fe88-7e0a-48da-8709-3466a22e5ba8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1318 microversion: 2.1 time: 0.344769 May 27 15:07:39.023552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-53066e60-064f-4e08-a1ae-4551f5b47da9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:39.023770 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1268/2609] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:38 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:39.026043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-53066e60-064f-4e08-a1ae-4551f5b47da9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:39.028999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-35a56edc-ff49-4e79-8035-73867d49a0a3 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:39.029697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-35a56edc-ff49-4e79-8035-73867d49a0a3 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:39.036433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35a56edc-ff49-4e79-8035-73867d49a0a3 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:39.036997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35a56edc-ff49-4e79-8035-73867d49a0a3 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:39.038051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35a56edc-ff49-4e79-8035-73867d49a0a3 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:39.038588 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35a56edc-ff49-4e79-8035-73867d49a0a3 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:39.044419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53066e60-064f-4e08-a1ae-4551f5b47da9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:39.046348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53066e60-064f-4e08-a1ae-4551f5b47da9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:39.049272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53066e60-064f-4e08-a1ae-4551f5b47da9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:39.049931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53066e60-064f-4e08-a1ae-4551f5b47da9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:39.374954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-53066e60-064f-4e08-a1ae-4551f5b47da9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:39.391455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-53066e60-064f-4e08-a1ae-4551f5b47da9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:39.393473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-53066e60-064f-4e08-a1ae-4551f5b47da9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:39.396000 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-53066e60-064f-4e08-a1ae-4551f5b47da9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1751 microversion: 2.20 time: 0.386397 May 27 15:07:39.398327 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1342/2610] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:39 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1751 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:39.484207 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-35a56edc-ff49-4e79-8035-73867d49a0a3 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1649 microversion: 2.1 time: 0.459234 May 27 15:07:39.497755 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1269/2611] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:39 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1649 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:39.534362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2826c932-b627-4222-8aca-3f0a2466db88 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776d4aa60>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:39.592630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c43659fc-7afc-461c-bf2f-6ad4ca21c6eb tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:39.596972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c43659fc-7afc-461c-bf2f-6ad4ca21c6eb tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:39.611154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c43659fc-7afc-461c-bf2f-6ad4ca21c6eb tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:39.627761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c43659fc-7afc-461c-bf2f-6ad4ca21c6eb tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:39.629000 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2826c932-b627-4222-8aca-3f0a2466db88 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.098323 May 27 15:07:39.630538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c43659fc-7afc-461c-bf2f-6ad4ca21c6eb tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:39.631426 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1343/2612] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:39 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:39.632204 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c43659fc-7afc-461c-bf2f-6ad4ca21c6eb tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:39.759324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dbb0e903-644d-464e-acc1-fcda4151b0ce tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:39.759904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dbb0e903-644d-464e-acc1-fcda4151b0ce tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:39.774499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dbb0e903-644d-464e-acc1-fcda4151b0ce tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:39.775018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dbb0e903-644d-464e-acc1-fcda4151b0ce tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:39.779329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dbb0e903-644d-464e-acc1-fcda4151b0ce tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:39.779488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dbb0e903-644d-464e-acc1-fcda4151b0ce tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:39.865901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c43659fc-7afc-461c-bf2f-6ad4ca21c6eb tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:39.875334 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c43659fc-7afc-461c-bf2f-6ad4ca21c6eb tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.286409 May 27 15:07:39.879145 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1270/2613] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:39 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:39.959003 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dbb0e903-644d-464e-acc1-fcda4151b0ce tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:39.968273 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dbb0e903-644d-464e-acc1-fcda4151b0ce tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1281 microversion: 2.1 time: 0.215295 May 27 15:07:39.968886 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1344/2614] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:39 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1281 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:07:40.028961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5d053f47-f02d-420f-beba-1efaa874e3c7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:40.030476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5d053f47-f02d-420f-beba-1efaa874e3c7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:40.043362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d053f47-f02d-420f-beba-1efaa874e3c7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:40.046787 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d053f47-f02d-420f-beba-1efaa874e3c7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:40.047831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d053f47-f02d-420f-beba-1efaa874e3c7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:40.049214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d053f47-f02d-420f-beba-1efaa874e3c7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:40.364147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5d053f47-f02d-420f-beba-1efaa874e3c7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:40.380237 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5d053f47-f02d-420f-beba-1efaa874e3c7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1318 microversion: 2.1 time: 0.355829 May 27 15:07:40.381179 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1271/2615] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:40 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:40.417740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2e0c1976-ec99-4896-87d7-30761f9ac182 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:40.418414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2e0c1976-ec99-4896-87d7-30761f9ac182 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:40.437096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e0c1976-ec99-4896-87d7-30761f9ac182 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:40.437631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e0c1976-ec99-4896-87d7-30761f9ac182 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:40.438488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e0c1976-ec99-4896-87d7-30761f9ac182 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:40.438944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e0c1976-ec99-4896-87d7-30761f9ac182 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:40.642977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-b07ae047-65c8-4d02-9a88-bf45a348f25c req-ede9fab9-49cd-4618-8c71-0123de8e18c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a59f3b5-daec-44ac-886e-2112ff3c8675", "tag": "920f6fd6-e492-42be-9e9e-e76c839e5b92"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:40.691987 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b07ae047-65c8-4d02-9a88-bf45a348f25c req-ede9fab9-49cd-4618-8c71-0123de8e18c0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:40.692447 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b07ae047-65c8-4d02-9a88-bf45a348f25c req-ede9fab9-49cd-4618-8c71-0123de8e18c0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:40.763054 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-b07ae047-65c8-4d02-9a88-bf45a348f25c req-ede9fab9-49cd-4618-8c71-0123de8e18c0 service nova] Creating event network-changed:920f6fd6-e492-42be-9e9e-e76c839e5b92 for instance 7a59f3b5-daec-44ac-886e-2112ff3c8675 on n-h2-843621-1 May 27 15:07:40.770137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2e0c1976-ec99-4896-87d7-30761f9ac182 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:40.779420 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-b07ae047-65c8-4d02-9a88-bf45a348f25c req-ede9fab9-49cd-4618-8c71-0123de8e18c0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.347100 May 27 15:07:40.787094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2e0c1976-ec99-4896-87d7-30761f9ac182 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:40.788353 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1272/2616] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:40.789320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2e0c1976-ec99-4896-87d7-30761f9ac182 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:40.792082 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2e0c1976-ec99-4896-87d7-30761f9ac182 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1753 microversion: 2.20 time: 0.378419 May 27 15:07:40.793926 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1345/2617] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:40 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1753 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:40.804092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e559b5a2-f99f-43ff-b438-4788c05a5766 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc7767b40d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:40.825922 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-120b40c6-f895-4ea3-865e-4e297775d154 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:40.826739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-120b40c6-f895-4ea3-865e-4e297775d154 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:40.841924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-120b40c6-f895-4ea3-865e-4e297775d154 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:40.845054 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-120b40c6-f895-4ea3-865e-4e297775d154 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:40.848448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-120b40c6-f895-4ea3-865e-4e297775d154 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:40.849016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-120b40c6-f895-4ea3-865e-4e297775d154 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:40.860137 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e559b5a2-f99f-43ff-b438-4788c05a5766 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.064924 May 27 15:07:40.861523 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1346/2618] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:40 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:40.898219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6eda51b7-77a6-42ce-84ac-dd6aa0c88fbd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:40.899170 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6eda51b7-77a6-42ce-84ac-dd6aa0c88fbd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:40.910614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6eda51b7-77a6-42ce-84ac-dd6aa0c88fbd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:40.911363 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6eda51b7-77a6-42ce-84ac-dd6aa0c88fbd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:40.912637 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6eda51b7-77a6-42ce-84ac-dd6aa0c88fbd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:40.913335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6eda51b7-77a6-42ce-84ac-dd6aa0c88fbd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:41.202621 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-120b40c6-f895-4ea3-865e-4e297775d154 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1629 microversion: 2.1 time: 0.412704 May 27 15:07:41.204648 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1273/2619] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:40 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1629 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:41.214548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b2c119aa-9ac3-49a6-b478-e4947eedd987 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:41.221001 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b2c119aa-9ac3-49a6-b478-e4947eedd987 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:41.231485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b2c119aa-9ac3-49a6-b478-e4947eedd987 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:41.235400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b2c119aa-9ac3-49a6-b478-e4947eedd987 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:41.238346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b2c119aa-9ac3-49a6-b478-e4947eedd987 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:41.239200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b2c119aa-9ac3-49a6-b478-e4947eedd987 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:41.298629 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6eda51b7-77a6-42ce-84ac-dd6aa0c88fbd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:41.314100 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6eda51b7-77a6-42ce-84ac-dd6aa0c88fbd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.417237 May 27 15:07:41.315181 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1347/2620] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:40 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:41.321709 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d2b80b99-8772-4749-81c1-08c564dc3c0a tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843621-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:41.322928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d2b80b99-8772-4749-81c1-08c564dc3c0a tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:41.347163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2b80b99-8772-4749-81c1-08c564dc3c0a tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:41.348828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2b80b99-8772-4749-81c1-08c564dc3c0a tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:41.382784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2b80b99-8772-4749-81c1-08c564dc3c0a tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:41.383983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2b80b99-8772-4749-81c1-08c564dc3c0a tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:41.463712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-d2b80b99-8772-4749-81c1-08c564dc3c0a tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lazy-loading 'flavor' on Instance uuid 9d3e9f6b-d322-4c17-9b7a-dae9c0867822 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:07:41.504400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d2b80b99-8772-4749-81c1-08c564dc3c0a tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Going to try to live migrate instance to n-h1-843621-1 {{(pid=119248) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 27 15:07:41.536084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b2c119aa-9ac3-49a6-b478-e4947eedd987 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:41.560687 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b2c119aa-9ac3-49a6-b478-e4947eedd987 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.354233 May 27 15:07:41.564550 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1274/2621] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:41 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:41.572080 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-156a427f-02d4-4ed8-a7c2-e37b13132a75 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:41.573130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-156a427f-02d4-4ed8-a7c2-e37b13132a75 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:41.590263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-156a427f-02d4-4ed8-a7c2-e37b13132a75 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:41.591059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-156a427f-02d4-4ed8-a7c2-e37b13132a75 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:41.592201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-156a427f-02d4-4ed8-a7c2-e37b13132a75 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:41.592923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-156a427f-02d4-4ed8-a7c2-e37b13132a75 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:41.781632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:41.889674 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-156a427f-02d4-4ed8-a7c2-e37b13132a75 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:41.897786 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-156a427f-02d4-4ed8-a7c2-e37b13132a75 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1318 microversion: 2.1 time: 0.330360 May 27 15:07:41.900792 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1275/2622] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:41 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:41.917864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d308ecf1-2183-4411-b452-222e57d6dbf4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:41.921313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d308ecf1-2183-4411-b452-222e57d6dbf4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:41.947337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d308ecf1-2183-4411-b452-222e57d6dbf4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:41.949644 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d308ecf1-2183-4411-b452-222e57d6dbf4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:41.951306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d308ecf1-2183-4411-b452-222e57d6dbf4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:41.961241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d308ecf1-2183-4411-b452-222e57d6dbf4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:42.457808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d308ecf1-2183-4411-b452-222e57d6dbf4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:42.469524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d308ecf1-2183-4411-b452-222e57d6dbf4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:42.471045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d308ecf1-2183-4411-b452-222e57d6dbf4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:42.472239 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d308ecf1-2183-4411-b452-222e57d6dbf4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1753 microversion: 2.20 time: 0.569708 May 27 15:07:42.497264 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1276/2623] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:41 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1753 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:42.521525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3fc49fab-e205-4f2f-ae79-e1d8a9b264d9 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776daa160>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:42.615518 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3fc49fab-e205-4f2f-ae79-e1d8a9b264d9 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.116949 May 27 15:07:42.616255 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1277/2624] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:42 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:42.625915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d982c21c-efe8-4e0c-8844-8b0d37a5535f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:42.625915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d982c21c-efe8-4e0c-8844-8b0d37a5535f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:42.645197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d982c21c-efe8-4e0c-8844-8b0d37a5535f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:42.645654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d982c21c-efe8-4e0c-8844-8b0d37a5535f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:42.646578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d982c21c-efe8-4e0c-8844-8b0d37a5535f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:42.647031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d982c21c-efe8-4e0c-8844-8b0d37a5535f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:42.839844 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d982c21c-efe8-4e0c-8844-8b0d37a5535f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:42.848830 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d982c21c-efe8-4e0c-8844-8b0d37a5535f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.231369 May 27 15:07:42.858723 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1278/2625] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:42 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:42.859436 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-70e03bb7-c6cf-45e7-81cd-333110fec8b9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:42.860104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-70e03bb7-c6cf-45e7-81cd-333110fec8b9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:42.866461 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70e03bb7-c6cf-45e7-81cd-333110fec8b9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:42.867176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70e03bb7-c6cf-45e7-81cd-333110fec8b9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:42.868159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70e03bb7-c6cf-45e7-81cd-333110fec8b9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:42.868602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70e03bb7-c6cf-45e7-81cd-333110fec8b9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:43.183284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-70e03bb7-c6cf-45e7-81cd-333110fec8b9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:43.195522 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-70e03bb7-c6cf-45e7-81cd-333110fec8b9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.341163 May 27 15:07:43.207358 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1279/2626] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:42 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:43.213605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-263f2b61-d7a2-4786-b650-07bcadbda0fb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:43.217081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-263f2b61-d7a2-4786-b650-07bcadbda0fb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:43.234069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-263f2b61-d7a2-4786-b650-07bcadbda0fb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:43.234572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-263f2b61-d7a2-4786-b650-07bcadbda0fb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:43.237156 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-263f2b61-d7a2-4786-b650-07bcadbda0fb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:43.237715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-263f2b61-d7a2-4786-b650-07bcadbda0fb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:43.487255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-263f2b61-d7a2-4786-b650-07bcadbda0fb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:43.498018 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-263f2b61-d7a2-4786-b650-07bcadbda0fb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1318 microversion: 2.1 time: 0.298707 May 27 15:07:43.499683 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1280/2627] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:43 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:43.504570 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-387c515b-ae58-4521-b892-05eb362e289e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:43.505535 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-387c515b-ae58-4521-b892-05eb362e289e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:43.515838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-387c515b-ae58-4521-b892-05eb362e289e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:43.516654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-387c515b-ae58-4521-b892-05eb362e289e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:43.518316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-387c515b-ae58-4521-b892-05eb362e289e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:43.519225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-387c515b-ae58-4521-b892-05eb362e289e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:43.780352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-387c515b-ae58-4521-b892-05eb362e289e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:43.793786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-387c515b-ae58-4521-b892-05eb362e289e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:43.796019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-387c515b-ae58-4521-b892-05eb362e289e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:43.797695 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-387c515b-ae58-4521-b892-05eb362e289e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1753 microversion: 2.20 time: 0.296831 May 27 15:07:43.799078 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1281/2628] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:43 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1753 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:43.817230 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-13b269f7-3427-4546-924c-32392abcc1b3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc7771c9310>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:43.925817 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-13b269f7-3427-4546-924c-32392abcc1b3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.125436 May 27 15:07:43.926442 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1282/2629] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:43 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:43.939027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-22fb1bd5-b4b0-4603-adce-ca6bc527f507 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:43.940240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-22fb1bd5-b4b0-4603-adce-ca6bc527f507 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:43.948974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-22fb1bd5-b4b0-4603-adce-ca6bc527f507 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:43.950408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-22fb1bd5-b4b0-4603-adce-ca6bc527f507 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:43.951919 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-22fb1bd5-b4b0-4603-adce-ca6bc527f507 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:43.952522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-22fb1bd5-b4b0-4603-adce-ca6bc527f507 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:44.305625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-22fb1bd5-b4b0-4603-adce-ca6bc527f507 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:44.318429 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-22fb1bd5-b4b0-4603-adce-ca6bc527f507 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.386710 May 27 15:07:44.319262 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1283/2630] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:43 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:44.347262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-347004e3-41bf-4209-b256-7346cd38ff9f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:44.347898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-347004e3-41bf-4209-b256-7346cd38ff9f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:44.373575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-347004e3-41bf-4209-b256-7346cd38ff9f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:44.375770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-347004e3-41bf-4209-b256-7346cd38ff9f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:44.376616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-347004e3-41bf-4209-b256-7346cd38ff9f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:44.377094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-347004e3-41bf-4209-b256-7346cd38ff9f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:44.714223 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d2b80b99-8772-4749-81c1-08c564dc3c0a tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822/action" status: 202 len: 0 microversion: 2.1 time: 3.397511 May 27 15:07:44.714891 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1348/2631] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:07:41 2022] POST /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822/action => generated 0 bytes in 3399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:07:44.725188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-fd138d53-3aab-4af1-b210-786bfe429231 req-2a4e1624-544c-4064-9e21-ac17e5685312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "166cc8cd-403c-4987-ac12-64336b9b2d18", "tag": "6d7dd124-8140-4cb8-b3c7-65570f85e106"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:44.759744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-fd138d53-3aab-4af1-b210-786bfe429231 req-2a4e1624-544c-4064-9e21-ac17e5685312 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:44.761625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-fd138d53-3aab-4af1-b210-786bfe429231 req-2a4e1624-544c-4064-9e21-ac17e5685312 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:44.806251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-347004e3-41bf-4209-b256-7346cd38ff9f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:44.818541 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-347004e3-41bf-4209-b256-7346cd38ff9f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.480937 May 27 15:07:44.819141 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1284/2632] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:44 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:44.823608 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2fa8220b-26e9-48d5-8ae7-0db7f5cc40da tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:44.825121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2fa8220b-26e9-48d5-8ae7-0db7f5cc40da tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:44.832022 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2fa8220b-26e9-48d5-8ae7-0db7f5cc40da tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:44.832763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2fa8220b-26e9-48d5-8ae7-0db7f5cc40da tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:44.833803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2fa8220b-26e9-48d5-8ae7-0db7f5cc40da tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:44.834651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2fa8220b-26e9-48d5-8ae7-0db7f5cc40da tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:44.836136 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-fd138d53-3aab-4af1-b210-786bfe429231 req-2a4e1624-544c-4064-9e21-ac17e5685312 service nova] Creating event network-changed:6d7dd124-8140-4cb8-b3c7-65570f85e106 for instance 166cc8cd-403c-4987-ac12-64336b9b2d18 on n-h1-843621-1 May 27 15:07:44.856952 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-fd138d53-3aab-4af1-b210-786bfe429231 req-2a4e1624-544c-4064-9e21-ac17e5685312 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135860 May 27 15:07:44.865615 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1349/2633] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:44.895176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-19346b7f-958b-4ae2-b0c0-ca3a0931f615 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:44.897061 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-19346b7f-958b-4ae2-b0c0-ca3a0931f615 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:44.936361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19346b7f-958b-4ae2-b0c0-ca3a0931f615 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:44.939594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19346b7f-958b-4ae2-b0c0-ca3a0931f615 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:44.946999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19346b7f-958b-4ae2-b0c0-ca3a0931f615 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:44.948275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19346b7f-958b-4ae2-b0c0-ca3a0931f615 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:45.297650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2fa8220b-26e9-48d5-8ae7-0db7f5cc40da tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:45.310739 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2fa8220b-26e9-48d5-8ae7-0db7f5cc40da tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1318 microversion: 2.1 time: 0.490500 May 27 15:07:45.314509 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1285/2634] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:44 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:45.327948 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-52dfb1b8-a462-4767-8a7a-b531ed92719b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:45.328581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-52dfb1b8-a462-4767-8a7a-b531ed92719b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:45.339881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52dfb1b8-a462-4767-8a7a-b531ed92719b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:45.340326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52dfb1b8-a462-4767-8a7a-b531ed92719b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:45.341136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52dfb1b8-a462-4767-8a7a-b531ed92719b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:45.341581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52dfb1b8-a462-4767-8a7a-b531ed92719b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:45.539992 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-19346b7f-958b-4ae2-b0c0-ca3a0931f615 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:45.549471 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-19346b7f-958b-4ae2-b0c0-ca3a0931f615 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1503 microversion: 2.1 time: 0.679277 May 27 15:07:45.556367 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1350/2635] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:44 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1503 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:45.569396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-061c0bb0-4414-41ff-8ecc-096c26374b24 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776e8ca60>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:45.630026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-52dfb1b8-a462-4767-8a7a-b531ed92719b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:45.634564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:45.643860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-52dfb1b8-a462-4767-8a7a-b531ed92719b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:45.645976 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-52dfb1b8-a462-4767-8a7a-b531ed92719b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:45.646854 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-52dfb1b8-a462-4767-8a7a-b531ed92719b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1753 microversion: 2.20 time: 0.331780 May 27 15:07:45.647899 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1286/2636] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:45 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1753 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:45.656793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3b8bf2d3-a7e5-4aa8-99de-b361ca0b1fa8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:45.657483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3b8bf2d3-a7e5-4aa8-99de-b361ca0b1fa8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:45.663078 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-061c0bb0-4414-41ff-8ecc-096c26374b24 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.103828 May 27 15:07:45.663951 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1351/2637] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:45 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:45.666122 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b8bf2d3-a7e5-4aa8-99de-b361ca0b1fa8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:45.666593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b8bf2d3-a7e5-4aa8-99de-b361ca0b1fa8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:45.668020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b8bf2d3-a7e5-4aa8-99de-b361ca0b1fa8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:45.668560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b8bf2d3-a7e5-4aa8-99de-b361ca0b1fa8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:45.837596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-45a3fa38-46a3-4522-9b8c-e1dfe0ce2f5d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:45.838319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-45a3fa38-46a3-4522-9b8c-e1dfe0ce2f5d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:45.846931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45a3fa38-46a3-4522-9b8c-e1dfe0ce2f5d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:45.847413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45a3fa38-46a3-4522-9b8c-e1dfe0ce2f5d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:45.848311 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45a3fa38-46a3-4522-9b8c-e1dfe0ce2f5d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:45.851133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45a3fa38-46a3-4522-9b8c-e1dfe0ce2f5d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:45.909738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3b8bf2d3-a7e5-4aa8-99de-b361ca0b1fa8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:45.927206 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3b8bf2d3-a7e5-4aa8-99de-b361ca0b1fa8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.276343 May 27 15:07:45.933089 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1287/2638] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:45 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:46.098166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-45a3fa38-46a3-4522-9b8c-e1dfe0ce2f5d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:46.108820 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-45a3fa38-46a3-4522-9b8c-e1dfe0ce2f5d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.275061 May 27 15:07:46.121059 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1352/2639] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:45 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:46.256994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-359220b8-5476-4b63-a429-1aa3d0850a90 req-d61714b1-3cce-4753-a8c9-9986cf2cd0ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a59f3b5-daec-44ac-886e-2112ff3c8675", "name": "network-vif-plugged", "status": "completed", "tag": "920f6fd6-e492-42be-9e9e-e76c839e5b92"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:46.273002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-359220b8-5476-4b63-a429-1aa3d0850a90 req-d61714b1-3cce-4753-a8c9-9986cf2cd0ac service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:46.273554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-359220b8-5476-4b63-a429-1aa3d0850a90 req-d61714b1-3cce-4753-a8c9-9986cf2cd0ac service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:46.291922 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-359220b8-5476-4b63-a429-1aa3d0850a90 req-d61714b1-3cce-4753-a8c9-9986cf2cd0ac service nova] Creating event network-vif-plugged:920f6fd6-e492-42be-9e9e-e76c839e5b92 for instance 7a59f3b5-daec-44ac-886e-2112ff3c8675 on n-h2-843621-1 May 27 15:07:46.300515 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-359220b8-5476-4b63-a429-1aa3d0850a90 req-d61714b1-3cce-4753-a8c9-9986cf2cd0ac service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047228 May 27 15:07:46.303872 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1288/2640] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:46.332612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-586ba29d-98e2-4637-9fe9-e58c7721cd59 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:46.333484 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-586ba29d-98e2-4637-9fe9-e58c7721cd59 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:46.350965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-586ba29d-98e2-4637-9fe9-e58c7721cd59 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:46.352878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-586ba29d-98e2-4637-9fe9-e58c7721cd59 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:46.353883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-586ba29d-98e2-4637-9fe9-e58c7721cd59 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:46.354544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-586ba29d-98e2-4637-9fe9-e58c7721cd59 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:46.546549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:46.569589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-586ba29d-98e2-4637-9fe9-e58c7721cd59 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:46.575284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-229b5a7e-4665-4099-be0a-e3660d69e1cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:46.576057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-229b5a7e-4665-4099-be0a-e3660d69e1cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:46.583391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-229b5a7e-4665-4099-be0a-e3660d69e1cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:46.584085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-229b5a7e-4665-4099-be0a-e3660d69e1cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:46.585054 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-229b5a7e-4665-4099-be0a-e3660d69e1cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:46.586177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-229b5a7e-4665-4099-be0a-e3660d69e1cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:46.597190 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-586ba29d-98e2-4637-9fe9-e58c7721cd59 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1318 microversion: 2.1 time: 0.260446 May 27 15:07:46.597861 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1353/2641] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:46 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:46.666237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e437939-c277-42fc-8327-e3180d0d25db tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:46.667105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e437939-c277-42fc-8327-e3180d0d25db tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:46.685159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e437939-c277-42fc-8327-e3180d0d25db tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:46.690486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e437939-c277-42fc-8327-e3180d0d25db tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:46.691568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e437939-c277-42fc-8327-e3180d0d25db tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:46.693167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e437939-c277-42fc-8327-e3180d0d25db tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:46.784008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-229b5a7e-4665-4099-be0a-e3660d69e1cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:46.806858 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-229b5a7e-4665-4099-be0a-e3660d69e1cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1503 microversion: 2.1 time: 0.231374 May 27 15:07:46.808772 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1289/2642] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:46 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1503 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:46.822978 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3af35ddd-8127-42d3-843b-f0a009241566 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776d9cd30>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:46.888785 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3af35ddd-8127-42d3-843b-f0a009241566 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.078834 May 27 15:07:46.889491 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1290/2643] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:46 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:46.948857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e437939-c277-42fc-8327-e3180d0d25db tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:46.952053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bd02a231-f63d-4103-8200-b6871b50fd81 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:46.953075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bd02a231-f63d-4103-8200-b6871b50fd81 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:46.962328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd02a231-f63d-4103-8200-b6871b50fd81 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:46.964568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd02a231-f63d-4103-8200-b6871b50fd81 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:46.966246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e437939-c277-42fc-8327-e3180d0d25db tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:46.967809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e437939-c277-42fc-8327-e3180d0d25db tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:46.968456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd02a231-f63d-4103-8200-b6871b50fd81 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:46.969028 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e437939-c277-42fc-8327-e3180d0d25db tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1753 microversion: 2.20 time: 0.306708 May 27 15:07:46.969778 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1354/2644] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:46 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1753 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:46.969907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd02a231-f63d-4103-8200-b6871b50fd81 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:47.126664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c0e7f349-d817-44a8-8d01-cec7dc36d4b6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:47.127636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c0e7f349-d817-44a8-8d01-cec7dc36d4b6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:47.139156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0e7f349-d817-44a8-8d01-cec7dc36d4b6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:47.149369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0e7f349-d817-44a8-8d01-cec7dc36d4b6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:47.150336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0e7f349-d817-44a8-8d01-cec7dc36d4b6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:47.150871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0e7f349-d817-44a8-8d01-cec7dc36d4b6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:47.222856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bd02a231-f63d-4103-8200-b6871b50fd81 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:47.238508 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bd02a231-f63d-4103-8200-b6871b50fd81 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.290567 May 27 15:07:47.251985 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1291/2645] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:46 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:47.353315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c0e7f349-d817-44a8-8d01-cec7dc36d4b6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:47.365252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=10 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:47.370632 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c0e7f349-d817-44a8-8d01-cec7dc36d4b6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.247791 May 27 15:07:47.372115 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1355/2646] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:47 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:07:47.618684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c30f7839-29e5-4ae3-958d-322f8f441838 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:47.619327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c30f7839-29e5-4ae3-958d-322f8f441838 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:47.628766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c30f7839-29e5-4ae3-958d-322f8f441838 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:47.629561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c30f7839-29e5-4ae3-958d-322f8f441838 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:47.631824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c30f7839-29e5-4ae3-958d-322f8f441838 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:47.631824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c30f7839-29e5-4ae3-958d-322f8f441838 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:47.821502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c30f7839-29e5-4ae3-958d-322f8f441838 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:47.826082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-96736d29-0646-46ec-bf96-b6e4cbbbdb4f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:47.827575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-96736d29-0646-46ec-bf96-b6e4cbbbdb4f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:47.831101 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c30f7839-29e5-4ae3-958d-322f8f441838 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1318 microversion: 2.1 time: 0.218864 May 27 15:07:47.833726 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1292/2647] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:47 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:47.838309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-96736d29-0646-46ec-bf96-b6e4cbbbdb4f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:47.845014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-96736d29-0646-46ec-bf96-b6e4cbbbdb4f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:47.846405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-96736d29-0646-46ec-bf96-b6e4cbbbdb4f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:47.847071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-96736d29-0646-46ec-bf96-b6e4cbbbdb4f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:47.908807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e73d6241-f6ae-49bf-a10e-30ec11380f41 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc780704f70>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:47.988462 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e73d6241-f6ae-49bf-a10e-30ec11380f41 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.088946 May 27 15:07:47.989673 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1293/2648] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:47 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:07:47.995781 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2938ad19-3b90-4088-91cf-202af6d88f70 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:47.996466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2938ad19-3b90-4088-91cf-202af6d88f70 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:48.006941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2938ad19-3b90-4088-91cf-202af6d88f70 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:48.007419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2938ad19-3b90-4088-91cf-202af6d88f70 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:48.010705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2938ad19-3b90-4088-91cf-202af6d88f70 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:48.010705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2938ad19-3b90-4088-91cf-202af6d88f70 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:48.058266 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-96736d29-0646-46ec-bf96-b6e4cbbbdb4f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:48.070286 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-96736d29-0646-46ec-bf96-b6e4cbbbdb4f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1503 microversion: 2.1 time: 0.247979 May 27 15:07:48.071531 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1356/2649] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:47 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1503 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:48.188133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2938ad19-3b90-4088-91cf-202af6d88f70 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:48.199450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2938ad19-3b90-4088-91cf-202af6d88f70 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:48.201342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2938ad19-3b90-4088-91cf-202af6d88f70 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:48.202646 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2938ad19-3b90-4088-91cf-202af6d88f70 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1753 microversion: 2.20 time: 0.212022 May 27 15:07:48.203458 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1294/2650] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:47 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1753 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:48.265024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d4cac87b-e0ae-495e-af0a-690bade260dc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:48.266497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d4cac87b-e0ae-495e-af0a-690bade260dc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:48.290841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4cac87b-e0ae-495e-af0a-690bade260dc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:48.291969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4cac87b-e0ae-495e-af0a-690bade260dc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:48.296607 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4cac87b-e0ae-495e-af0a-690bade260dc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:48.299248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4cac87b-e0ae-495e-af0a-690bade260dc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:48.392205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3a52d1f1-8a3d-4207-a2d1-02fe24a52374 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:48.392205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3a52d1f1-8a3d-4207-a2d1-02fe24a52374 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:48.401772 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:48.404322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a52d1f1-8a3d-4207-a2d1-02fe24a52374 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:48.406635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a52d1f1-8a3d-4207-a2d1-02fe24a52374 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:48.407454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a52d1f1-8a3d-4207-a2d1-02fe24a52374 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:48.407901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a52d1f1-8a3d-4207-a2d1-02fe24a52374 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:48.561647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d4cac87b-e0ae-495e-af0a-690bade260dc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:48.580206 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d4cac87b-e0ae-495e-af0a-690bade260dc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.325177 May 27 15:07:48.582687 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1357/2651] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:48 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:48.621549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:48.702688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3a52d1f1-8a3d-4207-a2d1-02fe24a52374 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:48.711181 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3a52d1f1-8a3d-4207-a2d1-02fe24a52374 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.325811 May 27 15:07:48.721596 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1295/2652] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:48 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:48.860083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b9a4f391-3dec-4ca9-a105-1dccdf4f5583 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:48.860937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b9a4f391-3dec-4ca9-a105-1dccdf4f5583 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:48.885210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9a4f391-3dec-4ca9-a105-1dccdf4f5583 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:48.886277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9a4f391-3dec-4ca9-a105-1dccdf4f5583 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:48.888532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9a4f391-3dec-4ca9-a105-1dccdf4f5583 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:48.889366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9a4f391-3dec-4ca9-a105-1dccdf4f5583 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:49.007162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2d734637-5da7-4137-8b0b-a213ea5ee72e tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776daaf70>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:49.079832 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2d734637-5da7-4137-8b0b-a213ea5ee72e tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.080329 May 27 15:07:49.082427 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1296/2653] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:48 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:49.094259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7fa4ca37-f586-4904-9ab9-ef7236eb8656 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:49.096557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7fa4ca37-f586-4904-9ab9-ef7236eb8656 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:49.112964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fa4ca37-f586-4904-9ab9-ef7236eb8656 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:49.113727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fa4ca37-f586-4904-9ab9-ef7236eb8656 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:49.114740 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fa4ca37-f586-4904-9ab9-ef7236eb8656 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:49.115374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fa4ca37-f586-4904-9ab9-ef7236eb8656 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:49.143692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b9a4f391-3dec-4ca9-a105-1dccdf4f5583 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:49.152405 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b9a4f391-3dec-4ca9-a105-1dccdf4f5583 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1507 microversion: 2.1 time: 0.302645 May 27 15:07:49.154644 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1358/2654] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:48 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1507 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:49.175968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-17f3e9c7-ee4a-4b0c-955c-96726a561e62 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:49.178694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-17f3e9c7-ee4a-4b0c-955c-96726a561e62 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:49.193180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-17f3e9c7-ee4a-4b0c-955c-96726a561e62 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:49.194243 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-17f3e9c7-ee4a-4b0c-955c-96726a561e62 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:49.195191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-17f3e9c7-ee4a-4b0c-955c-96726a561e62 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:49.195966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-17f3e9c7-ee4a-4b0c-955c-96726a561e62 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:49.274337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:49.442630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7fa4ca37-f586-4904-9ab9-ef7236eb8656 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:49.453392 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7fa4ca37-f586-4904-9ab9-ef7236eb8656 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1503 microversion: 2.1 time: 0.367624 May 27 15:07:49.454682 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1297/2655] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:49 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1503 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:49.463684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f672d187-17ba-4bf3-aa3e-80367ca0ebec tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:49.468260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f672d187-17ba-4bf3-aa3e-80367ca0ebec tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:49.488221 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f672d187-17ba-4bf3-aa3e-80367ca0ebec tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:49.489365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f672d187-17ba-4bf3-aa3e-80367ca0ebec tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:49.492284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f672d187-17ba-4bf3-aa3e-80367ca0ebec tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:49.495647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f672d187-17ba-4bf3-aa3e-80367ca0ebec tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:49.589012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-17f3e9c7-ee4a-4b0c-955c-96726a561e62 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:49.602959 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-17f3e9c7-ee4a-4b0c-955c-96726a561e62 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1507 microversion: 2.1 time: 0.431429 May 27 15:07:49.604126 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1359/2656] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:49 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1507 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:49.609706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-445b98cb-6955-4a99-a1de-a9c1650a4cd7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:49.610517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-445b98cb-6955-4a99-a1de-a9c1650a4cd7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:49.626216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-445b98cb-6955-4a99-a1de-a9c1650a4cd7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:49.627012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-445b98cb-6955-4a99-a1de-a9c1650a4cd7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:49.627976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-445b98cb-6955-4a99-a1de-a9c1650a4cd7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:49.628569 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-445b98cb-6955-4a99-a1de-a9c1650a4cd7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:49.851283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f672d187-17ba-4bf3-aa3e-80367ca0ebec tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:49.868334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f672d187-17ba-4bf3-aa3e-80367ca0ebec tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:49.876550 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f672d187-17ba-4bf3-aa3e-80367ca0ebec tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:49.883963 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f672d187-17ba-4bf3-aa3e-80367ca0ebec tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1753 microversion: 2.20 time: 0.427602 May 27 15:07:49.894539 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1298/2657] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:49 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1753 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:49.899577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e524e695-5566-4a2c-a852-4c885bd8fed1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "346e776e-8931-417f-87da-575810efb12b", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:49.909535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-445b98cb-6955-4a99-a1de-a9c1650a4cd7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:49.918910 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-445b98cb-6955-4a99-a1de-a9c1650a4cd7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.312911 May 27 15:07:49.919499 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1360/2658] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:49 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:49.921238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e524e695-5566-4a2c-a852-4c885bd8fed1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:49.930777 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e524e695-5566-4a2c-a852-4c885bd8fed1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:49.931293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e524e695-5566-4a2c-a852-4c885bd8fed1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:49.932345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e524e695-5566-4a2c-a852-4c885bd8fed1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:49.932663 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e524e695-5566-4a2c-a852-4c885bd8fed1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:49.937080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ed13a5f7-6d8e-4055-be52-da806de7ee03 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:49.937716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ed13a5f7-6d8e-4055-be52-da806de7ee03 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:49.945064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed13a5f7-6d8e-4055-be52-da806de7ee03 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:49.945753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed13a5f7-6d8e-4055-be52-da806de7ee03 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:49.946927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed13a5f7-6d8e-4055-be52-da806de7ee03 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:49.947589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed13a5f7-6d8e-4055-be52-da806de7ee03 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:50.072479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-e524e695-5566-4a2c-a852-4c885bd8fed1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:07:50.073194 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-e524e695-5566-4a2c-a852-4c885bd8fed1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:07:50.075687 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-e524e695-5566-4a2c-a852-4c885bd8fed1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:07:50.076273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-e524e695-5566-4a2c-a852-4c885bd8fed1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:07:50.077817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-e524e695-5566-4a2c-a852-4c885bd8fed1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:07:50.253009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e524e695-5566-4a2c-a852-4c885bd8fed1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:50.272791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e524e695-5566-4a2c-a852-4c885bd8fed1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:50.276262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e524e695-5566-4a2c-a852-4c885bd8fed1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:50.277171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e524e695-5566-4a2c-a852-4c885bd8fed1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:50.278311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e524e695-5566-4a2c-a852-4c885bd8fed1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:50.290592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ed13a5f7-6d8e-4055-be52-da806de7ee03 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:50.304163 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ed13a5f7-6d8e-4055-be52-da806de7ee03 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.383497 May 27 15:07:50.316957 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1361/2659] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:49 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:50.329085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f130b1da-1d11-4a6d-9a62-ebfdbad51a6c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776635820>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:50.359743 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e524e695-5566-4a2c-a852-4c885bd8fed1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "POST /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675/action" status: 202 len: 1109 microversion: 2.1 time: 0.469028 May 27 15:07:50.361843 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1299/2660] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:07:49 2022] POST /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675/action => generated 1109 bytes in 472 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 27 15:07:50.391428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7253b360-10ed-4696-98e9-9a4a1c674563 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:50.393170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7253b360-10ed-4696-98e9-9a4a1c674563 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:50.403041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7253b360-10ed-4696-98e9-9a4a1c674563 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:50.403938 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7253b360-10ed-4696-98e9-9a4a1c674563 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:50.405606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7253b360-10ed-4696-98e9-9a4a1c674563 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:50.412404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7253b360-10ed-4696-98e9-9a4a1c674563 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:50.523964 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f130b1da-1d11-4a6d-9a62-ebfdbad51a6c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.204424 May 27 15:07:50.533563 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1362/2661] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:50 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:50.537661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5b7ecf8b-b30c-4a1c-b8de-0f529720f7d6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:50.538324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5b7ecf8b-b30c-4a1c-b8de-0f529720f7d6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:50.545816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5b7ecf8b-b30c-4a1c-b8de-0f529720f7d6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:50.546574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5b7ecf8b-b30c-4a1c-b8de-0f529720f7d6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:50.547075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5b7ecf8b-b30c-4a1c-b8de-0f529720f7d6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:50.548072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5b7ecf8b-b30c-4a1c-b8de-0f529720f7d6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:50.735709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7253b360-10ed-4696-98e9-9a4a1c674563 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:50.747069 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7253b360-10ed-4696-98e9-9a4a1c674563 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1514 microversion: 2.1 time: 0.362854 May 27 15:07:50.748863 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1300/2662] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:50 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1514 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:50.788632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-4ab59e12-542c-4e0e-a2e2-09691b35c163 req-07f567e2-f377-4570-86bc-57f89d233818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3e9f6b-d322-4c17-9b7a-dae9c0867822", "name": "network-vif-unplugged", "status": "completed", "tag": "e8dc33c2-75df-4472-a438-c3f1dc3de0b4"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:50.805547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4ab59e12-542c-4e0e-a2e2-09691b35c163 req-07f567e2-f377-4570-86bc-57f89d233818 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:50.806075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4ab59e12-542c-4e0e-a2e2-09691b35c163 req-07f567e2-f377-4570-86bc-57f89d233818 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:50.854863 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-4ab59e12-542c-4e0e-a2e2-09691b35c163 req-07f567e2-f377-4570-86bc-57f89d233818 service nova] Creating event network-vif-unplugged:e8dc33c2-75df-4472-a438-c3f1dc3de0b4 for instance 9d3e9f6b-d322-4c17-9b7a-dae9c0867822 on n-h2-843621-1 May 27 15:07:50.896934 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-4ab59e12-542c-4e0e-a2e2-09691b35c163 req-07f567e2-f377-4570-86bc-57f89d233818 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144867 May 27 15:07:50.901523 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1301/2663] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:50.917265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f6575e71-7329-4830-bf11-1900efa79b61 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:50.917997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f6575e71-7329-4830-bf11-1900efa79b61 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:50.952994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6575e71-7329-4830-bf11-1900efa79b61 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:50.953817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6575e71-7329-4830-bf11-1900efa79b61 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:50.954683 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6575e71-7329-4830-bf11-1900efa79b61 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:50.955139 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6575e71-7329-4830-bf11-1900efa79b61 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:50.970540 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5b7ecf8b-b30c-4a1c-b8de-0f529720f7d6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:50.985586 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5b7ecf8b-b30c-4a1c-b8de-0f529720f7d6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1503 microversion: 2.1 time: 0.452718 May 27 15:07:50.987346 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1363/2664] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:50 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1503 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:50.992411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c080946d-731c-4964-a83e-f27dd7ca3749 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:50.995458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c080946d-731c-4964-a83e-f27dd7ca3749 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:51.013699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c080946d-731c-4964-a83e-f27dd7ca3749 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:51.015110 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c080946d-731c-4964-a83e-f27dd7ca3749 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:51.015974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c080946d-731c-4964-a83e-f27dd7ca3749 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:51.016442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c080946d-731c-4964-a83e-f27dd7ca3749 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:51.372333 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c080946d-731c-4964-a83e-f27dd7ca3749 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:51.385312 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c080946d-731c-4964-a83e-f27dd7ca3749 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.396163 May 27 15:07:51.400493 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1364/2665] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:50 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:51.412415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-36eaf65c-77eb-46ab-bf0b-826246098124 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:51.413368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-36eaf65c-77eb-46ab-bf0b-826246098124 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:51.422269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-36eaf65c-77eb-46ab-bf0b-826246098124 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:51.423046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-36eaf65c-77eb-46ab-bf0b-826246098124 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:51.424453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-36eaf65c-77eb-46ab-bf0b-826246098124 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:51.425774 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-36eaf65c-77eb-46ab-bf0b-826246098124 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:51.434975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f6575e71-7329-4830-bf11-1900efa79b61 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:51.453413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f6575e71-7329-4830-bf11-1900efa79b61 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:51.456361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f6575e71-7329-4830-bf11-1900efa79b61 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:51.458217 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f6575e71-7329-4830-bf11-1900efa79b61 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1753 microversion: 2.20 time: 0.555301 May 27 15:07:51.460113 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1302/2666] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:50 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1753 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:51.537444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4704f94f-12d3-42dc-8e7a-61c5c8cbcbcb tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776d3f8b0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:51.637766 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4704f94f-12d3-42dc-8e7a-61c5c8cbcbcb tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.094323 May 27 15:07:51.638614 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1303/2667] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:51 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:07:51.719414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-36eaf65c-77eb-46ab-bf0b-826246098124 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:51.729751 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-36eaf65c-77eb-46ab-bf0b-826246098124 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.327691 May 27 15:07:51.736542 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1365/2668] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:51 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:51.771925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-678684b5-0d17-40bd-997a-d677ca330fb8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:51.776778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-678684b5-0d17-40bd-997a-d677ca330fb8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:51.791055 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-678684b5-0d17-40bd-997a-d677ca330fb8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:51.792043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-678684b5-0d17-40bd-997a-d677ca330fb8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:51.794208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-678684b5-0d17-40bd-997a-d677ca330fb8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:51.794872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-678684b5-0d17-40bd-997a-d677ca330fb8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:52.003665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cb256355-548f-4a6c-9619-d2a723707004 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:52.004346 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cb256355-548f-4a6c-9619-d2a723707004 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:52.016310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb256355-548f-4a6c-9619-d2a723707004 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:52.016778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb256355-548f-4a6c-9619-d2a723707004 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:52.028621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb256355-548f-4a6c-9619-d2a723707004 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:52.029371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb256355-548f-4a6c-9619-d2a723707004 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:52.105438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-678684b5-0d17-40bd-997a-d677ca330fb8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:52.123064 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-678684b5-0d17-40bd-997a-d677ca330fb8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1514 microversion: 2.1 time: 0.360000 May 27 15:07:52.123064 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1304/2669] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:51 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1514 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:52.269383 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cb256355-548f-4a6c-9619-d2a723707004 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:52.289553 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cb256355-548f-4a6c-9619-d2a723707004 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1503 microversion: 2.1 time: 0.290186 May 27 15:07:52.290789 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1366/2670] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:51 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1503 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:07:52.403864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-906895e0-d694-4e6c-bb21-b043b357750f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:52.406537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-906895e0-d694-4e6c-bb21-b043b357750f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:52.417273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-906895e0-d694-4e6c-bb21-b043b357750f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:52.419247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-906895e0-d694-4e6c-bb21-b043b357750f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:52.420805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-906895e0-d694-4e6c-bb21-b043b357750f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:52.421929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-906895e0-d694-4e6c-bb21-b043b357750f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:52.489101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-215d108b-ae87-4be0-8e90-52f3b7cad18b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:52.491032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-215d108b-ae87-4be0-8e90-52f3b7cad18b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:52.512965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-215d108b-ae87-4be0-8e90-52f3b7cad18b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:52.525723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-215d108b-ae87-4be0-8e90-52f3b7cad18b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:52.527025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-215d108b-ae87-4be0-8e90-52f3b7cad18b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:52.529147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-215d108b-ae87-4be0-8e90-52f3b7cad18b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:52.779068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-215d108b-ae87-4be0-8e90-52f3b7cad18b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:52.797150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-215d108b-ae87-4be0-8e90-52f3b7cad18b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:52.801479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-215d108b-ae87-4be0-8e90-52f3b7cad18b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:52.825177 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-215d108b-ae87-4be0-8e90-52f3b7cad18b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1753 microversion: 2.20 time: 0.324728 May 27 15:07:52.825177 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1367/2671] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:52 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1753 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:52.825177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4a73000d-5804-4411-bdcf-9a0d4708cf84 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc7767401f0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:52.835215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-906895e0-d694-4e6c-bb21-b043b357750f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:52.861358 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-906895e0-d694-4e6c-bb21-b043b357750f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.461851 May 27 15:07:52.888552 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1305/2672] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:52 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:07:52.894532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c4174d35-24ff-47da-9152-256f74866d6c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:52.896019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c4174d35-24ff-47da-9152-256f74866d6c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:52.897655 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4a73000d-5804-4411-bdcf-9a0d4708cf84 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1421 microversion: 2.1 time: 0.079526 May 27 15:07:52.898489 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1368/2673] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:52 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1421 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:52.904755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c4174d35-24ff-47da-9152-256f74866d6c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:52.905159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c4174d35-24ff-47da-9152-256f74866d6c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:52.905941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c4174d35-24ff-47da-9152-256f74866d6c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:52.906381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c4174d35-24ff-47da-9152-256f74866d6c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:52.940047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-cdba5793-62cd-48c7-8308-f25b6e4ed44c req-dd9b89b9-8a74-4d07-8dc4-ef1ceb7e3af3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d3e9f6b-d322-4c17-9b7a-dae9c0867822", "tag": "e8dc33c2-75df-4472-a438-c3f1dc3de0b4"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:52.959187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-cdba5793-62cd-48c7-8308-f25b6e4ed44c req-dd9b89b9-8a74-4d07-8dc4-ef1ceb7e3af3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:52.960151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-cdba5793-62cd-48c7-8308-f25b6e4ed44c req-dd9b89b9-8a74-4d07-8dc4-ef1ceb7e3af3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:52.983803 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-cdba5793-62cd-48c7-8308-f25b6e4ed44c req-dd9b89b9-8a74-4d07-8dc4-ef1ceb7e3af3 service nova] Creating event network-changed:e8dc33c2-75df-4472-a438-c3f1dc3de0b4 for instance 9d3e9f6b-d322-4c17-9b7a-dae9c0867822 on n-h2-843621-1 May 27 15:07:53.085809 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-cdba5793-62cd-48c7-8308-f25b6e4ed44c req-dd9b89b9-8a74-4d07-8dc4-ef1ceb7e3af3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149299 May 27 15:07:53.086455 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1369/2674] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:07:53.142323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c4174d35-24ff-47da-9152-256f74866d6c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:53.142856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2a10510a-f307-488b-b58b-664baabfacb7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:53.143590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2a10510a-f307-488b-b58b-664baabfacb7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:53.146954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:53.148357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:53.153745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a10510a-f307-488b-b58b-664baabfacb7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:53.154348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a10510a-f307-488b-b58b-664baabfacb7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:53.155619 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a10510a-f307-488b-b58b-664baabfacb7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:53.156078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a10510a-f307-488b-b58b-664baabfacb7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:53.166910 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c4174d35-24ff-47da-9152-256f74866d6c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.277108 May 27 15:07:53.169155 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1306/2675] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:52 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:53.307634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5dc7ff83-4b45-49a5-88e4-d20f10202573 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:53.308386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5dc7ff83-4b45-49a5-88e4-d20f10202573 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:53.324600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5dc7ff83-4b45-49a5-88e4-d20f10202573 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:53.325488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5dc7ff83-4b45-49a5-88e4-d20f10202573 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:53.326491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5dc7ff83-4b45-49a5-88e4-d20f10202573 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:53.328607 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5dc7ff83-4b45-49a5-88e4-d20f10202573 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:53.514792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2a10510a-f307-488b-b58b-664baabfacb7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:53.534678 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2a10510a-f307-488b-b58b-664baabfacb7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1514 microversion: 2.1 time: 0.395622 May 27 15:07:53.562369 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1370/2676] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:53 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1514 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:07:53.721379 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5dc7ff83-4b45-49a5-88e4-d20f10202573 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:53.731043 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5dc7ff83-4b45-49a5-88e4-d20f10202573 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1503 microversion: 2.1 time: 0.427432 May 27 15:07:53.740552 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1307/2677] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:53 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1503 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:53.783555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-139971ec-d93f-4e66-9476-3ae448ee25bd req-73a9303b-a0c9-4f87-9864-ac7e9a35249c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "166cc8cd-403c-4987-ac12-64336b9b2d18", "name": "network-vif-plugged", "status": "completed", "tag": "6d7dd124-8140-4cb8-b3c7-65570f85e106"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:53.802925 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-139971ec-d93f-4e66-9476-3ae448ee25bd req-73a9303b-a0c9-4f87-9864-ac7e9a35249c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:53.803458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-139971ec-d93f-4e66-9476-3ae448ee25bd req-73a9303b-a0c9-4f87-9864-ac7e9a35249c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:53.821493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b4cceac6-9b16-43eb-b58d-6b873a5062ee tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:53.822034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b4cceac6-9b16-43eb-b58d-6b873a5062ee tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:53.838602 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-139971ec-d93f-4e66-9476-3ae448ee25bd req-73a9303b-a0c9-4f87-9864-ac7e9a35249c service nova] Creating event network-vif-plugged:6d7dd124-8140-4cb8-b3c7-65570f85e106 for instance 166cc8cd-403c-4987-ac12-64336b9b2d18 on n-h1-843621-1 May 27 15:07:53.844378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4cceac6-9b16-43eb-b58d-6b873a5062ee tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:53.844922 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4cceac6-9b16-43eb-b58d-6b873a5062ee tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:53.845894 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4cceac6-9b16-43eb-b58d-6b873a5062ee tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:53.846349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4cceac6-9b16-43eb-b58d-6b873a5062ee tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:53.868820 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-139971ec-d93f-4e66-9476-3ae448ee25bd req-73a9303b-a0c9-4f87-9864-ac7e9a35249c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088736 May 27 15:07:53.910759 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1371/2678] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:53.910759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-31ab7288-94c5-41e1-a225-0b380a54fe39 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:53.910759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-31ab7288-94c5-41e1-a225-0b380a54fe39 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:53.923804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-31ab7288-94c5-41e1-a225-0b380a54fe39 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:53.924270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-31ab7288-94c5-41e1-a225-0b380a54fe39 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:53.925108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-31ab7288-94c5-41e1-a225-0b380a54fe39 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:53.925540 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-31ab7288-94c5-41e1-a225-0b380a54fe39 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:54.162137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-31ab7288-94c5-41e1-a225-0b380a54fe39 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:54.172227 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-31ab7288-94c5-41e1-a225-0b380a54fe39 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.279161 May 27 15:07:54.173263 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1372/2679] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:53 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:54.179268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e249bad4-2688-4f44-9621-abab6dc1480d tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776e8ce50>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:54.184545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b4cceac6-9b16-43eb-b58d-6b873a5062ee tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:54.193204 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b4cceac6-9b16-43eb-b58d-6b873a5062ee tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:54.194725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b4cceac6-9b16-43eb-b58d-6b873a5062ee tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:54.195911 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b4cceac6-9b16-43eb-b58d-6b873a5062ee tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1753 microversion: 2.20 time: 0.378433 May 27 15:07:54.196471 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1308/2680] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:53 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1753 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:07:54.201832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c36d87a2-4279-47b3-a43f-e4ba13a1af9e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:54.202641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c36d87a2-4279-47b3-a43f-e4ba13a1af9e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:54.208971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c36d87a2-4279-47b3-a43f-e4ba13a1af9e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:54.209432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c36d87a2-4279-47b3-a43f-e4ba13a1af9e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:54.210217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c36d87a2-4279-47b3-a43f-e4ba13a1af9e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:54.210666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c36d87a2-4279-47b3-a43f-e4ba13a1af9e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:54.242286 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e249bad4-2688-4f44-9621-abab6dc1480d tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1430 microversion: 2.1 time: 0.065745 May 27 15:07:54.242286 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1373/2681] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:54 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1430 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:54.256299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4c547422-b575-42bc-9bbf-a6e83e0ec326 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776e13af0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:54.303182 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4c547422-b575-42bc-9bbf-a6e83e0ec326 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 200 len: 1430 microversion: 2.1 time: 0.050614 May 27 15:07:54.303765 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1374/2682] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:07:54 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 1430 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:54.315501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9f305c2a-bbd0-40da-befb-affa5e42518f tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:54.316119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9f305c2a-bbd0-40da-befb-affa5e42518f tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:54.323896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f305c2a-bbd0-40da-befb-affa5e42518f tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:54.325011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f305c2a-bbd0-40da-befb-affa5e42518f tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:54.325740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f305c2a-bbd0-40da-befb-affa5e42518f tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:54.326180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f305c2a-bbd0-40da-befb-affa5e42518f tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:54.387332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c36d87a2-4279-47b3-a43f-e4ba13a1af9e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:54.395244 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c36d87a2-4279-47b3-a43f-e4ba13a1af9e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.197434 May 27 15:07:54.395829 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1309/2683] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:54 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:54.484201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9f305c2a-bbd0-40da-befb-affa5e42518f tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:54.492988 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9f305c2a-bbd0-40da-befb-affa5e42518f tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1480 microversion: 2.1 time: 0.181215 May 27 15:07:54.493695 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1375/2684] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:54 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1480 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:54.568412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3d3fc192-e6d9-45de-8a72-6495dd1a2721 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:54.569056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3d3fc192-e6d9-45de-8a72-6495dd1a2721 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:54.575415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d3fc192-e6d9-45de-8a72-6495dd1a2721 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:54.575810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d3fc192-e6d9-45de-8a72-6495dd1a2721 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:54.576595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d3fc192-e6d9-45de-8a72-6495dd1a2721 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:54.577107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d3fc192-e6d9-45de-8a72-6495dd1a2721 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:54.722662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3d3fc192-e6d9-45de-8a72-6495dd1a2721 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:54.731482 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3d3fc192-e6d9-45de-8a72-6495dd1a2721 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1514 microversion: 2.1 time: 0.166339 May 27 15:07:54.732157 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1310/2685] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:54 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:54.747608 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b91d8774-ee0b-4284-9ef6-f444db0dc847 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:54.748230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b91d8774-ee0b-4284-9ef6-f444db0dc847 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:54.754785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b91d8774-ee0b-4284-9ef6-f444db0dc847 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:54.755273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b91d8774-ee0b-4284-9ef6-f444db0dc847 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:54.756035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b91d8774-ee0b-4284-9ef6-f444db0dc847 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:54.756486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b91d8774-ee0b-4284-9ef6-f444db0dc847 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:54.904187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b91d8774-ee0b-4284-9ef6-f444db0dc847 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:54.911855 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b91d8774-ee0b-4284-9ef6-f444db0dc847 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1503 microversion: 2.1 time: 0.168199 May 27 15:07:54.912437 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1376/2686] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:54 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:55.189584 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-10a02d13-ed2a-4843-91a1-bc9f5bf8394d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:55.190235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-10a02d13-ed2a-4843-91a1-bc9f5bf8394d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:55.197411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10a02d13-ed2a-4843-91a1-bc9f5bf8394d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:55.197872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10a02d13-ed2a-4843-91a1-bc9f5bf8394d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:55.198655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10a02d13-ed2a-4843-91a1-bc9f5bf8394d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:55.199104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10a02d13-ed2a-4843-91a1-bc9f5bf8394d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:55.217003 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-02e4a3e8-5f55-44ba-b41f-84995ce7dd3f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:55.217626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-02e4a3e8-5f55-44ba-b41f-84995ce7dd3f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:55.224082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02e4a3e8-5f55-44ba-b41f-84995ce7dd3f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:55.224537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02e4a3e8-5f55-44ba-b41f-84995ce7dd3f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:55.225338 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02e4a3e8-5f55-44ba-b41f-84995ce7dd3f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:55.225779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02e4a3e8-5f55-44ba-b41f-84995ce7dd3f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:55.412173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-10a02d13-ed2a-4843-91a1-bc9f5bf8394d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:55.425806 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-10a02d13-ed2a-4843-91a1-bc9f5bf8394d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.239653 May 27 15:07:55.435368 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1311/2687] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:55 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:55.442065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-02e4a3e8-5f55-44ba-b41f-84995ce7dd3f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:55.443332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4488fef6-9e0f-4176-938e-02ffd83c09e6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:55.444322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4488fef6-9e0f-4176-938e-02ffd83c09e6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:55.452599 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-02e4a3e8-5f55-44ba-b41f-84995ce7dd3f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:55.454084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4488fef6-9e0f-4176-938e-02ffd83c09e6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:55.454238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-02e4a3e8-5f55-44ba-b41f-84995ce7dd3f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:55.455238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4488fef6-9e0f-4176-938e-02ffd83c09e6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:55.455666 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-02e4a3e8-5f55-44ba-b41f-84995ce7dd3f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1753 microversion: 2.20 time: 0.243968 May 27 15:07:55.456741 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1377/2688] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:55 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1753 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:55.457187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4488fef6-9e0f-4176-938e-02ffd83c09e6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:55.457954 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4488fef6-9e0f-4176-938e-02ffd83c09e6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:55.515493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c3492d17-4ee0-447a-b913-2cf19a74685c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:55.516808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c3492d17-4ee0-447a-b913-2cf19a74685c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:55.529471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3492d17-4ee0-447a-b913-2cf19a74685c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:55.530285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3492d17-4ee0-447a-b913-2cf19a74685c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:55.531338 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3492d17-4ee0-447a-b913-2cf19a74685c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:55.531898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3492d17-4ee0-447a-b913-2cf19a74685c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:55.648822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4488fef6-9e0f-4176-938e-02ffd83c09e6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:55.656964 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4488fef6-9e0f-4176-938e-02ffd83c09e6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.218057 May 27 15:07:55.657557 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1312/2689] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:55 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:55.695957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c3492d17-4ee0-447a-b913-2cf19a74685c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:55.705803 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c3492d17-4ee0-447a-b913-2cf19a74685c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1480 microversion: 2.1 time: 0.196792 May 27 15:07:55.706661 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1378/2690] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:55 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1480 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:55.749252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3e92a7ad-781e-4098-96f7-5b414c43428c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:55.749873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3e92a7ad-781e-4098-96f7-5b414c43428c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:55.756009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e92a7ad-781e-4098-96f7-5b414c43428c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:55.756459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e92a7ad-781e-4098-96f7-5b414c43428c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:55.757338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e92a7ad-781e-4098-96f7-5b414c43428c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:55.757825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e92a7ad-781e-4098-96f7-5b414c43428c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:55.895267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3e92a7ad-781e-4098-96f7-5b414c43428c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:55.904054 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3e92a7ad-781e-4098-96f7-5b414c43428c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1514 microversion: 2.1 time: 0.159225 May 27 15:07:55.904776 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1313/2691] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:55 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:55.929243 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3a99ceab-d7dd-4d7f-bf6c-58c3763f331a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:55.929827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3a99ceab-d7dd-4d7f-bf6c-58c3763f331a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:55.936643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a99ceab-d7dd-4d7f-bf6c-58c3763f331a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:55.937123 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a99ceab-d7dd-4d7f-bf6c-58c3763f331a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:55.937901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a99ceab-d7dd-4d7f-bf6c-58c3763f331a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:55.938347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a99ceab-d7dd-4d7f-bf6c-58c3763f331a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:56.007612 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-647d8b29-93f4-48a3-9e5e-b1f37a6c23df tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:56.008113 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-647d8b29-93f4-48a3-9e5e-b1f37a6c23df tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:56.014359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-647d8b29-93f4-48a3-9e5e-b1f37a6c23df tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:56.014811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-647d8b29-93f4-48a3-9e5e-b1f37a6c23df tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:56.015574 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-647d8b29-93f4-48a3-9e5e-b1f37a6c23df tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:56.016013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-647d8b29-93f4-48a3-9e5e-b1f37a6c23df tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:56.041150 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-647d8b29-93f4-48a3-9e5e-b1f37a6c23df tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:07:56.075451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3a99ceab-d7dd-4d7f-bf6c-58c3763f331a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:56.084701 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3a99ceab-d7dd-4d7f-bf6c-58c3763f331a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1503 microversion: 2.1 time: 0.159263 May 27 15:07:56.085483 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1379/2692] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:55 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:56.121103 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-647d8b29-93f4-48a3-9e5e-b1f37a6c23df tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87" status: 204 len: 0 microversion: 2.1 time: 0.116959 May 27 15:07:56.122263 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1314/2693] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:07:56 2022] DELETE /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:07:56.130239 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ded55548-9e23-466e-a433-bcb3c0578555 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:56.130857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ded55548-9e23-466e-a433-bcb3c0578555 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:56.137139 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ded55548-9e23-466e-a433-bcb3c0578555 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:56.137591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ded55548-9e23-466e-a433-bcb3c0578555 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:56.138358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ded55548-9e23-466e-a433-bcb3c0578555 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:56.138798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ded55548-9e23-466e-a433-bcb3c0578555 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:56.271376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ded55548-9e23-466e-a433-bcb3c0578555 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b6df1a680e498b8f9014995a93f261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d729d0442554ca5a662cfabb7ea425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:56.279780 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ded55548-9e23-466e-a433-bcb3c0578555 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87" status: 200 len: 1665 microversion: 2.1 time: 0.153445 May 27 15:07:56.280367 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1380/2694] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:56 2022] GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:56.445265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ac84cd35-5a70-4420-a87d-ad93756e926a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:56.445964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ac84cd35-5a70-4420-a87d-ad93756e926a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:56.452777 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac84cd35-5a70-4420-a87d-ad93756e926a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:56.453223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac84cd35-5a70-4420-a87d-ad93756e926a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:56.454011 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac84cd35-5a70-4420-a87d-ad93756e926a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:56.454444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac84cd35-5a70-4420-a87d-ad93756e926a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:56.474140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4d7d5fea-a71a-45ec-bb42-303c00148960 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:56.474801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4d7d5fea-a71a-45ec-bb42-303c00148960 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:56.481752 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d7d5fea-a71a-45ec-bb42-303c00148960 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:56.482544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d7d5fea-a71a-45ec-bb42-303c00148960 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:56.483834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d7d5fea-a71a-45ec-bb42-303c00148960 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:56.484578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d7d5fea-a71a-45ec-bb42-303c00148960 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:56.489852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:56.871615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ac84cd35-5a70-4420-a87d-ad93756e926a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:56.879338 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ac84cd35-5a70-4420-a87d-ad93756e926a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.438393 May 27 15:07:56.879919 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1315/2695] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:56 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:56.884440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7e9b15b4-e810-4915-af49-a5959a95e41e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:56.885074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7e9b15b4-e810-4915-af49-a5959a95e41e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:56.891610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e9b15b4-e810-4915-af49-a5959a95e41e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:56.892064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e9b15b4-e810-4915-af49-a5959a95e41e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:56.892857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e9b15b4-e810-4915-af49-a5959a95e41e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:56.893297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e9b15b4-e810-4915-af49-a5959a95e41e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:56.902454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4d7d5fea-a71a-45ec-bb42-303c00148960 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:56.913685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4d7d5fea-a71a-45ec-bb42-303c00148960 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:56.916179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4d7d5fea-a71a-45ec-bb42-303c00148960 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:56.917902 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4d7d5fea-a71a-45ec-bb42-303c00148960 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 0.448023 May 27 15:07:56.918482 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1381/2696] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:56 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:07:56.923191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d2f5adf0-c348-4d7a-b55a-4c27221e31e4 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:56.923820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d2f5adf0-c348-4d7a-b55a-4c27221e31e4 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:56.930079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2f5adf0-c348-4d7a-b55a-4c27221e31e4 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:56.930660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2f5adf0-c348-4d7a-b55a-4c27221e31e4 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:56.931321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2f5adf0-c348-4d7a-b55a-4c27221e31e4 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:56.931772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2f5adf0-c348-4d7a-b55a-4c27221e31e4 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:57.090510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7e9b15b4-e810-4915-af49-a5959a95e41e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:57.098617 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7e9b15b4-e810-4915-af49-a5959a95e41e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.217670 May 27 15:07:57.099480 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1316/2697] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:56 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:57.105403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fe165c66-cb01-4c66-ba9d-c30fecc67564 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:57.106766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fe165c66-cb01-4c66-ba9d-c30fecc67564 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:57.112965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe165c66-cb01-4c66-ba9d-c30fecc67564 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:57.113420 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe165c66-cb01-4c66-ba9d-c30fecc67564 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:57.114181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe165c66-cb01-4c66-ba9d-c30fecc67564 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:57.114657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe165c66-cb01-4c66-ba9d-c30fecc67564 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:57.116103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d2f5adf0-c348-4d7a-b55a-4c27221e31e4 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:57.124563 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d2f5adf0-c348-4d7a-b55a-4c27221e31e4 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1480 microversion: 2.1 time: 0.205058 May 27 15:07:57.125176 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1382/2698] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:56 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1480 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:57.129928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-57843aa9-8a06-4de6-be80-f96c39638ef5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:57.130692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-57843aa9-8a06-4de6-be80-f96c39638ef5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:57.139597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57843aa9-8a06-4de6-be80-f96c39638ef5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:57.140096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57843aa9-8a06-4de6-be80-f96c39638ef5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:57.141135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57843aa9-8a06-4de6-be80-f96c39638ef5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:57.141466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57843aa9-8a06-4de6-be80-f96c39638ef5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:57.312897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fe165c66-cb01-4c66-ba9d-c30fecc67564 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:57.320775 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fe165c66-cb01-4c66-ba9d-c30fecc67564 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1514 microversion: 2.1 time: 0.219264 May 27 15:07:57.321465 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1317/2699] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:57 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1514 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:57.326607 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fbbb7bca-136d-45a7-9d85-5abda2329bbc tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:57.327317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fbbb7bca-136d-45a7-9d85-5abda2329bbc tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:57.334067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fbbb7bca-136d-45a7-9d85-5abda2329bbc tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:57.334526 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fbbb7bca-136d-45a7-9d85-5abda2329bbc tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:57.335310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fbbb7bca-136d-45a7-9d85-5abda2329bbc tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:57.335753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fbbb7bca-136d-45a7-9d85-5abda2329bbc tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:57.337825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-57843aa9-8a06-4de6-be80-f96c39638ef5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:57.347364 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-57843aa9-8a06-4de6-be80-f96c39638ef5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1503 microversion: 2.1 time: 0.221045 May 27 15:07:57.347887 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1383/2700] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:57 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:57.473178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fbbb7bca-136d-45a7-9d85-5abda2329bbc tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b6df1a680e498b8f9014995a93f261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d729d0442554ca5a662cfabb7ea425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:57.480748 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fbbb7bca-136d-45a7-9d85-5abda2329bbc tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87" status: 200 len: 1665 microversion: 2.1 time: 0.158231 May 27 15:07:57.481312 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1318/2701] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:57 2022] GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:57.897164 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-06bb24e6-312f-4c27-8208-c05fddcc2795 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:57.897675 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-06bb24e6-312f-4c27-8208-c05fddcc2795 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:57.904450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06bb24e6-312f-4c27-8208-c05fddcc2795 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:57.905011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06bb24e6-312f-4c27-8208-c05fddcc2795 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:57.905787 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06bb24e6-312f-4c27-8208-c05fddcc2795 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:57.906209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06bb24e6-312f-4c27-8208-c05fddcc2795 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:57.936759 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-121a6189-1024-4cd6-9987-a9c0a11b35b1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:57.938471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-121a6189-1024-4cd6-9987-a9c0a11b35b1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:57.945796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-121a6189-1024-4cd6-9987-a9c0a11b35b1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:57.946259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-121a6189-1024-4cd6-9987-a9c0a11b35b1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:57.947047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-121a6189-1024-4cd6-9987-a9c0a11b35b1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:57.947650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-121a6189-1024-4cd6-9987-a9c0a11b35b1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:58.127946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-06bb24e6-312f-4c27-8208-c05fddcc2795 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:58.138517 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-06bb24e6-312f-4c27-8208-c05fddcc2795 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.245462 May 27 15:07:58.144706 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1384/2702] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:57 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:58.146535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a750990a-2b28-465a-aa8e-f3e6edb46ee2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:58.147238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a750990a-2b28-465a-aa8e-f3e6edb46ee2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:58.155733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a750990a-2b28-465a-aa8e-f3e6edb46ee2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:58.156451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a750990a-2b28-465a-aa8e-f3e6edb46ee2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:58.157445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a750990a-2b28-465a-aa8e-f3e6edb46ee2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:58.157760 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a750990a-2b28-465a-aa8e-f3e6edb46ee2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:58.180139 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-121a6189-1024-4cd6-9987-a9c0a11b35b1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:58.189316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-121a6189-1024-4cd6-9987-a9c0a11b35b1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:58.199768 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-121a6189-1024-4cd6-9987-a9c0a11b35b1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:58.201133 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-121a6189-1024-4cd6-9987-a9c0a11b35b1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 0.269687 May 27 15:07:58.201729 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1319/2703] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:57 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:07:58.206504 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b209a926-c835-4455-bc86-b88b0eb0d3ae tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:58.207130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b209a926-c835-4455-bc86-b88b0eb0d3ae tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:58.216628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b209a926-c835-4455-bc86-b88b0eb0d3ae tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:58.217116 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b209a926-c835-4455-bc86-b88b0eb0d3ae tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:58.218097 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b209a926-c835-4455-bc86-b88b0eb0d3ae tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:58.218544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b209a926-c835-4455-bc86-b88b0eb0d3ae tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:58.453946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a750990a-2b28-465a-aa8e-f3e6edb46ee2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:58.474636 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a750990a-2b28-465a-aa8e-f3e6edb46ee2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.326963 May 27 15:07:58.475578 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1385/2704] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:58 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:58.497553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4b87c55c-69e7-4e18-8ef7-891cd6e5fa9a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:58.498192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4b87c55c-69e7-4e18-8ef7-891cd6e5fa9a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:58.507260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b87c55c-69e7-4e18-8ef7-891cd6e5fa9a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:58.507716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b87c55c-69e7-4e18-8ef7-891cd6e5fa9a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:58.508512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b87c55c-69e7-4e18-8ef7-891cd6e5fa9a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:58.508999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b87c55c-69e7-4e18-8ef7-891cd6e5fa9a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:58.536658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b209a926-c835-4455-bc86-b88b0eb0d3ae tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:58.547085 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b209a926-c835-4455-bc86-b88b0eb0d3ae tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1480 microversion: 2.1 time: 0.342438 May 27 15:07:58.549323 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1320/2705] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:58 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1480 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:58.561173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-01874e06-daa2-4981-8453-f895f68543d4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:58.561996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-01874e06-daa2-4981-8453-f895f68543d4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:58.581717 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01874e06-daa2-4981-8453-f895f68543d4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:58.582287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01874e06-daa2-4981-8453-f895f68543d4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:58.583361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01874e06-daa2-4981-8453-f895f68543d4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:58.584061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01874e06-daa2-4981-8453-f895f68543d4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:58.908645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4b87c55c-69e7-4e18-8ef7-891cd6e5fa9a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:58.917202 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4b87c55c-69e7-4e18-8ef7-891cd6e5fa9a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1514 microversion: 2.1 time: 0.438931 May 27 15:07:58.927503 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1386/2706] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:58 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1514 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:58.928443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9697788c-3286-4648-a062-6fc7dc38a62d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:58.941147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9697788c-3286-4648-a062-6fc7dc38a62d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:58.957978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9697788c-3286-4648-a062-6fc7dc38a62d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:58.962397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9697788c-3286-4648-a062-6fc7dc38a62d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:58.963441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9697788c-3286-4648-a062-6fc7dc38a62d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:58.964249 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9697788c-3286-4648-a062-6fc7dc38a62d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:59.259152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-01874e06-daa2-4981-8453-f895f68543d4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:59.262772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9697788c-3286-4648-a062-6fc7dc38a62d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b6df1a680e498b8f9014995a93f261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d729d0442554ca5a662cfabb7ea425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:59.263551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:59.278391 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-01874e06-daa2-4981-8453-f895f68543d4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1503 microversion: 2.1 time: 0.722884 May 27 15:07:59.281222 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1321/2707] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:58 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1503 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:59.288445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-7f7a8331-02ac-4e08-8502-d36e1d73422c req-65d9119c-6326-4368-ac68-87460f02235b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd42e7d1-e7c7-4c19-a13e-2e81332b4d87", "name": "network-vif-deleted", "tag": "d51d103b-92f4-4d90-87fa-825486231bb3"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:59.289697 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9697788c-3286-4648-a062-6fc7dc38a62d tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87" status: 200 len: 1598 microversion: 2.1 time: 0.364991 May 27 15:07:59.290291 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1387/2708] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:58 2022] GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 => generated 1598 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:59.309633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-653d5cd1-903a-4a60-827f-890996faa4f2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:59.316999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-653d5cd1-903a-4a60-827f-890996faa4f2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:59.326534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-653d5cd1-903a-4a60-827f-890996faa4f2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:59.329226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-653d5cd1-903a-4a60-827f-890996faa4f2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:59.333064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-653d5cd1-903a-4a60-827f-890996faa4f2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:59.333937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-653d5cd1-903a-4a60-827f-890996faa4f2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:59.337086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-7f7a8331-02ac-4e08-8502-d36e1d73422c req-65d9119c-6326-4368-ac68-87460f02235b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:59.337855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-7f7a8331-02ac-4e08-8502-d36e1d73422c req-65d9119c-6326-4368-ac68-87460f02235b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:59.375999 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-7f7a8331-02ac-4e08-8502-d36e1d73422c req-65d9119c-6326-4368-ac68-87460f02235b service nova] Creating event network-vif-deleted:d51d103b-92f4-4d90-87fa-825486231bb3 for instance cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 on n-h2-843621-1 May 27 15:07:59.383799 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-7f7a8331-02ac-4e08-8502-d36e1d73422c req-65d9119c-6326-4368-ac68-87460f02235b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100552 May 27 15:07:59.389336 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1322/2709] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:59.395834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-db4d2409-06c0-40e3-a6d3-c52cc8fb4edf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:59.397388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-db4d2409-06c0-40e3-a6d3-c52cc8fb4edf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:59.406056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db4d2409-06c0-40e3-a6d3-c52cc8fb4edf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:59.406978 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db4d2409-06c0-40e3-a6d3-c52cc8fb4edf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:59.408034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db4d2409-06c0-40e3-a6d3-c52cc8fb4edf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:59.408732 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db4d2409-06c0-40e3-a6d3-c52cc8fb4edf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:59.768730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-db4d2409-06c0-40e3-a6d3-c52cc8fb4edf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:59.770571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-653d5cd1-903a-4a60-827f-890996faa4f2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:59.779305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-db4d2409-06c0-40e3-a6d3-c52cc8fb4edf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:59.779542 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-653d5cd1-903a-4a60-827f-890996faa4f2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.482885 May 27 15:07:59.780421 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1388/2710] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:59 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:59.785931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6908d8c3-59d9-494f-a4f7-3a422e1f5f28 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:59.786765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6908d8c3-59d9-494f-a4f7-3a422e1f5f28 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:59.793594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-db4d2409-06c0-40e3-a6d3-c52cc8fb4edf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:07:59.795262 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-db4d2409-06c0-40e3-a6d3-c52cc8fb4edf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 0.404469 May 27 15:07:59.796363 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1323/2711] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:07:59 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:59.802214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e5a32692-4e88-4427-a1ec-f425642c8921 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:59.803161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e5a32692-4e88-4427-a1ec-f425642c8921 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:07:59.811759 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e5a32692-4e88-4427-a1ec-f425642c8921 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:59.812034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6908d8c3-59d9-494f-a4f7-3a422e1f5f28 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:59.812656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e5a32692-4e88-4427-a1ec-f425642c8921 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:59.818775 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e5a32692-4e88-4427-a1ec-f425642c8921 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:59.819762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e5a32692-4e88-4427-a1ec-f425642c8921 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:59.832826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6908d8c3-59d9-494f-a4f7-3a422e1f5f28 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:07:59.834251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6908d8c3-59d9-494f-a4f7-3a422e1f5f28 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:07:59.845334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6908d8c3-59d9-494f-a4f7-3a422e1f5f28 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:00.113047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e5a32692-4e88-4427-a1ec-f425642c8921 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:00.125261 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e5a32692-4e88-4427-a1ec-f425642c8921 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1480 microversion: 2.1 time: 0.327369 May 27 15:08:00.129474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6908d8c3-59d9-494f-a4f7-3a422e1f5f28 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:00.135795 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1324/2712] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:59 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1480 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:00.141395 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ef404a68-45ca-4fb9-b598-7677356d1430 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:00.142251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ef404a68-45ca-4fb9-b598-7677356d1430 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:00.149310 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6908d8c3-59d9-494f-a4f7-3a422e1f5f28 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.366700 May 27 15:08:00.150473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef404a68-45ca-4fb9-b598-7677356d1430 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:00.151164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef404a68-45ca-4fb9-b598-7677356d1430 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:00.152106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef404a68-45ca-4fb9-b598-7677356d1430 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:00.153266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef404a68-45ca-4fb9-b598-7677356d1430 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:00.160126 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1389/2713] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:07:59 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:00.303400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7ba28a1f-c7e1-4c7f-beca-6da46af56a95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:00.304903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7ba28a1f-c7e1-4c7f-beca-6da46af56a95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:00.314256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7ba28a1f-c7e1-4c7f-beca-6da46af56a95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:00.314976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7ba28a1f-c7e1-4c7f-beca-6da46af56a95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:00.315934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7ba28a1f-c7e1-4c7f-beca-6da46af56a95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:00.316526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7ba28a1f-c7e1-4c7f-beca-6da46af56a95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:00.363174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ef404a68-45ca-4fb9-b598-7677356d1430 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:00.374406 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ef404a68-45ca-4fb9-b598-7677356d1430 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1514 microversion: 2.1 time: 0.237234 May 27 15:08:00.375397 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1325/2714] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:00 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1514 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:00.388191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-09bb1488-e354-4c01-a182-5057a564c57f tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:00.389081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-09bb1488-e354-4c01-a182-5057a564c57f tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:00.397339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09bb1488-e354-4c01-a182-5057a564c57f tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:00.397803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09bb1488-e354-4c01-a182-5057a564c57f tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:00.398603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09bb1488-e354-4c01-a182-5057a564c57f tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:00.399054 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09bb1488-e354-4c01-a182-5057a564c57f tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:00.512994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-09bb1488-e354-4c01-a182-5057a564c57f tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b6df1a680e498b8f9014995a93f261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d729d0442554ca5a662cfabb7ea425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:00.521410 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-09bb1488-e354-4c01-a182-5057a564c57f tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87" status: 200 len: 1598 microversion: 2.1 time: 0.144094 May 27 15:08:00.530161 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1326/2715] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:00 2022] GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 => generated 1598 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:00.594099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7ba28a1f-c7e1-4c7f-beca-6da46af56a95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:00.618924 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7ba28a1f-c7e1-4c7f-beca-6da46af56a95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1503 microversion: 2.1 time: 0.326178 May 27 15:08:00.628842 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1390/2716] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:00 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1503 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:08:00.800646 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8da8c51e-82cb-4124-b161-9e62091d1f4a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:00.801556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8da8c51e-82cb-4124-b161-9e62091d1f4a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:00.816065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fc8910b6-1bf7-4de9-b43e-cf79c8be866d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:00.817127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fc8910b6-1bf7-4de9-b43e-cf79c8be866d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:00.822431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8da8c51e-82cb-4124-b161-9e62091d1f4a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:00.823314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8da8c51e-82cb-4124-b161-9e62091d1f4a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:00.824984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8da8c51e-82cb-4124-b161-9e62091d1f4a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:00.827686 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8da8c51e-82cb-4124-b161-9e62091d1f4a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:00.832328 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fc8910b6-1bf7-4de9-b43e-cf79c8be866d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:00.833136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fc8910b6-1bf7-4de9-b43e-cf79c8be866d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:00.834120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fc8910b6-1bf7-4de9-b43e-cf79c8be866d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:00.834774 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fc8910b6-1bf7-4de9-b43e-cf79c8be866d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:01.080344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fc8910b6-1bf7-4de9-b43e-cf79c8be866d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:01.084267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8da8c51e-82cb-4124-b161-9e62091d1f4a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:01.096097 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8da8c51e-82cb-4124-b161-9e62091d1f4a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.299398 May 27 15:08:01.097016 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1327/2717] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:00 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:01.101658 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fc8910b6-1bf7-4de9-b43e-cf79c8be866d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:01.103203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fc8910b6-1bf7-4de9-b43e-cf79c8be866d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:01.104414 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fc8910b6-1bf7-4de9-b43e-cf79c8be866d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 0.292670 May 27 15:08:01.108770 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1391/2718] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:00 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:01.144402 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-87947bb0-277e-436f-8d68-60900b0e4b0b tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:01.146392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-87947bb0-277e-436f-8d68-60900b0e4b0b tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:01.161762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87947bb0-277e-436f-8d68-60900b0e4b0b tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:01.168804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-85387e3d-37e3-4033-8123-b63b7e232f2b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:01.169648 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-85387e3d-37e3-4033-8123-b63b7e232f2b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:01.174582 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87947bb0-277e-436f-8d68-60900b0e4b0b tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:01.175846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87947bb0-277e-436f-8d68-60900b0e4b0b tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:01.177739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87947bb0-277e-436f-8d68-60900b0e4b0b tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:01.181961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85387e3d-37e3-4033-8123-b63b7e232f2b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:01.182677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85387e3d-37e3-4033-8123-b63b7e232f2b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:01.183681 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85387e3d-37e3-4033-8123-b63b7e232f2b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:01.184800 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85387e3d-37e3-4033-8123-b63b7e232f2b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:01.408119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-87947bb0-277e-436f-8d68-60900b0e4b0b tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:01.416135 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-87947bb0-277e-436f-8d68-60900b0e4b0b tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1480 microversion: 2.1 time: 0.276188 May 27 15:08:01.422387 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1328/2719] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:01 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1480 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:01.430619 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d74641eb-3d8d-4776-8c89-5a693c82c614 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:01.432789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d74641eb-3d8d-4776-8c89-5a693c82c614 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:01.435099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-85387e3d-37e3-4033-8123-b63b7e232f2b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:01.441101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d74641eb-3d8d-4776-8c89-5a693c82c614 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:01.441658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d74641eb-3d8d-4776-8c89-5a693c82c614 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:01.442511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d74641eb-3d8d-4776-8c89-5a693c82c614 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:01.443022 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d74641eb-3d8d-4776-8c89-5a693c82c614 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:01.443177 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-85387e3d-37e3-4033-8123-b63b7e232f2b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.279677 May 27 15:08:01.443727 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1392/2720] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:01 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:08:01.540015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-94bc291e-c928-4b4d-a0e2-afcdcc66feae tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:01.541199 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-94bc291e-c928-4b4d-a0e2-afcdcc66feae tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:01.554458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94bc291e-c928-4b4d-a0e2-afcdcc66feae tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:01.554936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94bc291e-c928-4b4d-a0e2-afcdcc66feae tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:01.555722 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94bc291e-c928-4b4d-a0e2-afcdcc66feae tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:01.556337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94bc291e-c928-4b4d-a0e2-afcdcc66feae tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:01.641184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d74641eb-3d8d-4776-8c89-5a693c82c614 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:01.645836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-94bc291e-c928-4b4d-a0e2-afcdcc66feae tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b6df1a680e498b8f9014995a93f261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d729d0442554ca5a662cfabb7ea425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:01.650141 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d74641eb-3d8d-4776-8c89-5a693c82c614 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1514 microversion: 2.1 time: 0.226249 May 27 15:08:01.650729 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1329/2721] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:01 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1514 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:01.660575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b4cc8c8c-3169-48f4-b5bf-ffc5733c6483 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:01.660575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b4cc8c8c-3169-48f4-b5bf-ffc5733c6483 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:01.660852 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-94bc291e-c928-4b4d-a0e2-afcdcc66feae tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87" status: 200 len: 1598 microversion: 2.1 time: 0.124195 May 27 15:08:01.664056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4cc8c8c-3169-48f4-b5bf-ffc5733c6483 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:01.664554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4cc8c8c-3169-48f4-b5bf-ffc5733c6483 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:01.665433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4cc8c8c-3169-48f4-b5bf-ffc5733c6483 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:01.666123 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4cc8c8c-3169-48f4-b5bf-ffc5733c6483 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:01.668873 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1393/2722] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:01 2022] GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 => generated 1598 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:08:01.833045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b4cc8c8c-3169-48f4-b5bf-ffc5733c6483 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:01.841956 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b4cc8c8c-3169-48f4-b5bf-ffc5733c6483 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1503 microversion: 2.1 time: 0.190183 May 27 15:08:01.842548 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1330/2723] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:01 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1503 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:02.113562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e5535a1-bca9-45e5-81a7-902ae296e434 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:02.114187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e5535a1-bca9-45e5-81a7-902ae296e434 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:02.121741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e5535a1-bca9-45e5-81a7-902ae296e434 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:02.122292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e5535a1-bca9-45e5-81a7-902ae296e434 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:02.123342 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e5535a1-bca9-45e5-81a7-902ae296e434 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:02.123961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e5535a1-bca9-45e5-81a7-902ae296e434 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:02.124506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3d7e1155-13fe-433b-bb0a-52fb0c8c5b2b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:02.125525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3d7e1155-13fe-433b-bb0a-52fb0c8c5b2b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:02.140838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d7e1155-13fe-433b-bb0a-52fb0c8c5b2b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:02.141772 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d7e1155-13fe-433b-bb0a-52fb0c8c5b2b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:02.142508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d7e1155-13fe-433b-bb0a-52fb0c8c5b2b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:02.143189 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d7e1155-13fe-433b-bb0a-52fb0c8c5b2b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:02.372098 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e5535a1-bca9-45e5-81a7-902ae296e434 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:02.383592 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e5535a1-bca9-45e5-81a7-902ae296e434 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.273722 May 27 15:08:02.383927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3d7e1155-13fe-433b-bb0a-52fb0c8c5b2b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:02.384793 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1394/2724] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:02 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:02.394114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3d7e1155-13fe-433b-bb0a-52fb0c8c5b2b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:02.409770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3d7e1155-13fe-433b-bb0a-52fb0c8c5b2b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:02.409770 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3d7e1155-13fe-433b-bb0a-52fb0c8c5b2b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 0.278214 May 27 15:08:02.409770 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1331/2725] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:02 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:02.434360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-15298d57-5ed8-4a85-8d55-cdf53191802c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:02.435152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-15298d57-5ed8-4a85-8d55-cdf53191802c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:02.442386 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-15298d57-5ed8-4a85-8d55-cdf53191802c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:02.443143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-15298d57-5ed8-4a85-8d55-cdf53191802c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:02.444052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-15298d57-5ed8-4a85-8d55-cdf53191802c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:02.444614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-15298d57-5ed8-4a85-8d55-cdf53191802c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:02.462605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d4b363e9-c193-41c5-a469-7f367948a90c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:02.463393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d4b363e9-c193-41c5-a469-7f367948a90c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:02.470598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d4b363e9-c193-41c5-a469-7f367948a90c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:02.471054 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d4b363e9-c193-41c5-a469-7f367948a90c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:02.472113 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d4b363e9-c193-41c5-a469-7f367948a90c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:02.472563 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d4b363e9-c193-41c5-a469-7f367948a90c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:02.676498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-15298d57-5ed8-4a85-8d55-cdf53191802c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:02.685865 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-15298d57-5ed8-4a85-8d55-cdf53191802c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1480 microversion: 2.1 time: 0.255615 May 27 15:08:02.687054 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1395/2726] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:02 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1480 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:02.693557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8a97037c-bd40-4272-9fa2-53aebd592bcd tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:02.694457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8a97037c-bd40-4272-9fa2-53aebd592bcd tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:02.697143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d4b363e9-c193-41c5-a469-7f367948a90c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:02.702464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a97037c-bd40-4272-9fa2-53aebd592bcd tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:02.702923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a97037c-bd40-4272-9fa2-53aebd592bcd tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:02.703766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a97037c-bd40-4272-9fa2-53aebd592bcd tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:02.704307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a97037c-bd40-4272-9fa2-53aebd592bcd tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:02.706472 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d4b363e9-c193-41c5-a469-7f367948a90c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.249398 May 27 15:08:02.707284 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1332/2727] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:02 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:08:02.715700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-435f5f49-a547-4973-bd68-1b97f859dd13 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:02.715700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-435f5f49-a547-4973-bd68-1b97f859dd13 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:02.724277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-435f5f49-a547-4973-bd68-1b97f859dd13 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:02.724765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-435f5f49-a547-4973-bd68-1b97f859dd13 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:02.725561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-435f5f49-a547-4973-bd68-1b97f859dd13 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:02.726016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-435f5f49-a547-4973-bd68-1b97f859dd13 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:02.829791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-435f5f49-a547-4973-bd68-1b97f859dd13 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b6df1a680e498b8f9014995a93f261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d729d0442554ca5a662cfabb7ea425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:02.839531 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-435f5f49-a547-4973-bd68-1b97f859dd13 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87" status: 200 len: 1598 microversion: 2.1 time: 0.131172 May 27 15:08:02.841168 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1333/2728] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:02 2022] GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 => generated 1598 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:02.863157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1b8eb81b-024c-4b21-890b-1e5eff0d8c5e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:02.863893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1b8eb81b-024c-4b21-890b-1e5eff0d8c5e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:02.878025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b8eb81b-024c-4b21-890b-1e5eff0d8c5e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:02.878634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b8eb81b-024c-4b21-890b-1e5eff0d8c5e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:02.879568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b8eb81b-024c-4b21-890b-1e5eff0d8c5e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:02.880119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b8eb81b-024c-4b21-890b-1e5eff0d8c5e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:02.962740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8a97037c-bd40-4272-9fa2-53aebd592bcd tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:02.971696 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8a97037c-bd40-4272-9fa2-53aebd592bcd tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1514 microversion: 2.1 time: 0.283258 May 27 15:08:02.982824 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1396/2729] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:02 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1514 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:03.087637 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1b8eb81b-024c-4b21-890b-1e5eff0d8c5e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:03.099962 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1b8eb81b-024c-4b21-890b-1e5eff0d8c5e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1503 microversion: 2.1 time: 0.243090 May 27 15:08:03.100789 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1334/2730] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:02 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1503 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:08:03.401548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-75865629-c3f8-4b37-baea-9e3858ba3ed2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:03.402185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-75865629-c3f8-4b37-baea-9e3858ba3ed2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:03.410382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75865629-c3f8-4b37-baea-9e3858ba3ed2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:03.413466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75865629-c3f8-4b37-baea-9e3858ba3ed2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:03.413466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75865629-c3f8-4b37-baea-9e3858ba3ed2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:03.413466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75865629-c3f8-4b37-baea-9e3858ba3ed2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:03.425105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4a7758f4-fb94-4d50-8ae6-3b908625d610 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:03.426117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4a7758f4-fb94-4d50-8ae6-3b908625d610 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:03.443447 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4a7758f4-fb94-4d50-8ae6-3b908625d610 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:03.444178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4a7758f4-fb94-4d50-8ae6-3b908625d610 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:03.445557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4a7758f4-fb94-4d50-8ae6-3b908625d610 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:03.446886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4a7758f4-fb94-4d50-8ae6-3b908625d610 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:03.633034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-75865629-c3f8-4b37-baea-9e3858ba3ed2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:03.639175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:03.655036 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-75865629-c3f8-4b37-baea-9e3858ba3ed2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.256300 May 27 15:08:03.662489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4a7758f4-fb94-4d50-8ae6-3b908625d610 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:03.666487 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1397/2731] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:03 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:03.680440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4a7758f4-fb94-4d50-8ae6-3b908625d610 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:03.681657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4a7758f4-fb94-4d50-8ae6-3b908625d610 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:03.683033 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4a7758f4-fb94-4d50-8ae6-3b908625d610 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 0.267152 May 27 15:08:03.695002 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1335/2732] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:03 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:03.711337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-791f067d-f8b4-4a5c-b8c8-09344b146ada tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:03.712214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-791f067d-f8b4-4a5c-b8c8-09344b146ada tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:03.719380 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-791f067d-f8b4-4a5c-b8c8-09344b146ada tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:03.719829 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-791f067d-f8b4-4a5c-b8c8-09344b146ada tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:03.720609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-791f067d-f8b4-4a5c-b8c8-09344b146ada tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:03.722662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-791f067d-f8b4-4a5c-b8c8-09344b146ada tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:03.728606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9a42c596-e4b2-42fe-bcf8-952b4c9679e8 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:03.729369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9a42c596-e4b2-42fe-bcf8-952b4c9679e8 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:03.735773 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a42c596-e4b2-42fe-bcf8-952b4c9679e8 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:03.736310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a42c596-e4b2-42fe-bcf8-952b4c9679e8 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:03.737353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a42c596-e4b2-42fe-bcf8-952b4c9679e8 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:03.737950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a42c596-e4b2-42fe-bcf8-952b4c9679e8 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:03.962333 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-791f067d-f8b4-4a5c-b8c8-09344b146ada tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:03.965384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9a42c596-e4b2-42fe-bcf8-952b4c9679e8 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:03.971269 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-791f067d-f8b4-4a5c-b8c8-09344b146ada tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1480 microversion: 2.1 time: 0.265546 May 27 15:08:03.974107 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9a42c596-e4b2-42fe-bcf8-952b4c9679e8 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.250503 May 27 15:08:03.974702 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1336/2733] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:03 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:03.980481 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ffe81067-d575-41d8-8156-42f9188f2da6 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:03.981342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ffe81067-d575-41d8-8156-42f9188f2da6 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:03.988369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ffe81067-d575-41d8-8156-42f9188f2da6 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:03.988945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ffe81067-d575-41d8-8156-42f9188f2da6 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:03.989734 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ffe81067-d575-41d8-8156-42f9188f2da6 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:03.990183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ffe81067-d575-41d8-8156-42f9188f2da6 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:03.991058 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1398/2734] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:03 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1480 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:04.008911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-abcdf6f4-937f-481f-acdc-f4d67054e376 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:04.009880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-abcdf6f4-937f-481f-acdc-f4d67054e376 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:04.018204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-abcdf6f4-937f-481f-acdc-f4d67054e376 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:04.019299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-abcdf6f4-937f-481f-acdc-f4d67054e376 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:04.020354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-abcdf6f4-937f-481f-acdc-f4d67054e376 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:04.021124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-abcdf6f4-937f-481f-acdc-f4d67054e376 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:04.076361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ffe81067-d575-41d8-8156-42f9188f2da6 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b6df1a680e498b8f9014995a93f261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d729d0442554ca5a662cfabb7ea425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:04.097102 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ffe81067-d575-41d8-8156-42f9188f2da6 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87" status: 200 len: 1598 microversion: 2.1 time: 0.119997 May 27 15:08:04.098644 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1337/2735] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:03 2022] GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 => generated 1598 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:04.119922 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-be8dd606-3488-4a82-9186-bd4e671b54cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:04.120620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-be8dd606-3488-4a82-9186-bd4e671b54cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:04.129134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be8dd606-3488-4a82-9186-bd4e671b54cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:04.129689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be8dd606-3488-4a82-9186-bd4e671b54cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:04.134738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be8dd606-3488-4a82-9186-bd4e671b54cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:04.134738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be8dd606-3488-4a82-9186-bd4e671b54cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:04.275991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-abcdf6f4-937f-481f-acdc-f4d67054e376 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:04.298013 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-abcdf6f4-937f-481f-acdc-f4d67054e376 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1514 microversion: 2.1 time: 0.302864 May 27 15:08:04.298921 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1399/2736] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:03 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1514 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:04.327339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-be8dd606-3488-4a82-9186-bd4e671b54cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:04.336328 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-be8dd606-3488-4a82-9186-bd4e671b54cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1503 microversion: 2.1 time: 0.220830 May 27 15:08:04.336961 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1338/2737] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:04 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:08:04.674504 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1f1d43ba-363d-44d9-87eb-7688414f0e3e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:04.675563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1f1d43ba-363d-44d9-87eb-7688414f0e3e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:04.684423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f1d43ba-363d-44d9-87eb-7688414f0e3e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:04.685606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f1d43ba-363d-44d9-87eb-7688414f0e3e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:04.686754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f1d43ba-363d-44d9-87eb-7688414f0e3e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:04.687278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f1d43ba-363d-44d9-87eb-7688414f0e3e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:04.703130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dc66291c-62fd-40cd-997d-c0f801c28cfd tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:04.704032 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dc66291c-62fd-40cd-997d-c0f801c28cfd tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:04.711507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc66291c-62fd-40cd-997d-c0f801c28cfd tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:04.712266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc66291c-62fd-40cd-997d-c0f801c28cfd tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:04.714165 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc66291c-62fd-40cd-997d-c0f801c28cfd tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:04.715286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc66291c-62fd-40cd-997d-c0f801c28cfd tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:04.720037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:04.941389 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1f1d43ba-363d-44d9-87eb-7688414f0e3e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:04.950516 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1f1d43ba-363d-44d9-87eb-7688414f0e3e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.280226 May 27 15:08:04.951835 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1400/2738] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:04 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:04.955386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dc66291c-62fd-40cd-997d-c0f801c28cfd tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:04.965431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dc66291c-62fd-40cd-997d-c0f801c28cfd tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:04.968125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dc66291c-62fd-40cd-997d-c0f801c28cfd tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:04.969657 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dc66291c-62fd-40cd-997d-c0f801c28cfd tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 0.270786 May 27 15:08:04.970650 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1339/2739] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:04 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:04.994415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c5726208-e517-4057-95e8-c28bc099574c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:04.995040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c5726208-e517-4057-95e8-c28bc099574c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:05.003015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c5726208-e517-4057-95e8-c28bc099574c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:05.003430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c5726208-e517-4057-95e8-c28bc099574c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:05.004226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c5726208-e517-4057-95e8-c28bc099574c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:05.004697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c5726208-e517-4057-95e8-c28bc099574c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:05.005005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-43fd0dd6-9a54-4830-bd45-fc339a25ef0c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:05.005744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-43fd0dd6-9a54-4830-bd45-fc339a25ef0c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:05.013928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43fd0dd6-9a54-4830-bd45-fc339a25ef0c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:05.014794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43fd0dd6-9a54-4830-bd45-fc339a25ef0c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:05.015927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43fd0dd6-9a54-4830-bd45-fc339a25ef0c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:05.016868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43fd0dd6-9a54-4830-bd45-fc339a25ef0c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:05.243924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-43fd0dd6-9a54-4830-bd45-fc339a25ef0c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:05.248075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c5726208-e517-4057-95e8-c28bc099574c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:05.254649 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-43fd0dd6-9a54-4830-bd45-fc339a25ef0c tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1480 microversion: 2.1 time: 0.254477 May 27 15:08:05.264759 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1340/2740] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:04 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1480 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:05.265204 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c5726208-e517-4057-95e8-c28bc099574c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.266504 May 27 15:08:05.265321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c36144f6-3110-4b3d-845c-b0774fd00b97 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:05.265321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c36144f6-3110-4b3d-845c-b0774fd00b97 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:05.266682 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1401/2741] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:04 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:05.271347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c36144f6-3110-4b3d-845c-b0774fd00b97 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:05.271791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c36144f6-3110-4b3d-845c-b0774fd00b97 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:05.272629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c36144f6-3110-4b3d-845c-b0774fd00b97 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:05.273223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c36144f6-3110-4b3d-845c-b0774fd00b97 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:05.319214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cf55236c-f590-4e8a-b4ad-d01b1176b833 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:05.319946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cf55236c-f590-4e8a-b4ad-d01b1176b833 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:05.331732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cf55236c-f590-4e8a-b4ad-d01b1176b833 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:05.332735 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cf55236c-f590-4e8a-b4ad-d01b1176b833 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:05.333125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cf55236c-f590-4e8a-b4ad-d01b1176b833 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:05.333466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cf55236c-f590-4e8a-b4ad-d01b1176b833 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:05.392917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c36144f6-3110-4b3d-845c-b0774fd00b97 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b6df1a680e498b8f9014995a93f261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d729d0442554ca5a662cfabb7ea425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:05.402611 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c36144f6-3110-4b3d-845c-b0774fd00b97 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87" status: 200 len: 1598 microversion: 2.1 time: 0.145752 May 27 15:08:05.403655 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1341/2742] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:05 2022] GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 => generated 1598 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:05.409349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cf0e79c4-b915-4244-817c-bc7789396883 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:05.410196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cf0e79c4-b915-4244-817c-bc7789396883 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:05.421524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:05.423989 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cf0e79c4-b915-4244-817c-bc7789396883 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:05.424522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cf0e79c4-b915-4244-817c-bc7789396883 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:05.425837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cf0e79c4-b915-4244-817c-bc7789396883 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:05.426356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cf0e79c4-b915-4244-817c-bc7789396883 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:05.598560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cf55236c-f590-4e8a-b4ad-d01b1176b833 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:05.609095 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cf55236c-f590-4e8a-b4ad-d01b1176b833 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1514 microversion: 2.1 time: 0.293514 May 27 15:08:05.610331 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1402/2743] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:05 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1514 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:05.634998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cf0e79c4-b915-4244-817c-bc7789396883 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:05.643677 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cf0e79c4-b915-4244-817c-bc7789396883 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1503 microversion: 2.1 time: 0.238455 May 27 15:08:05.648469 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1342/2744] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:05 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1503 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:05.968021 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e45101ee-ff83-4847-970b-b132de5cc904 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:05.968580 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e45101ee-ff83-4847-970b-b132de5cc904 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:05.975867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e45101ee-ff83-4847-970b-b132de5cc904 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:05.976332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e45101ee-ff83-4847-970b-b132de5cc904 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:05.977262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e45101ee-ff83-4847-970b-b132de5cc904 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:05.977712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e45101ee-ff83-4847-970b-b132de5cc904 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:05.987834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-48900fd5-f5ed-425f-ae27-cf48ca80c024 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:05.989128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-48900fd5-f5ed-425f-ae27-cf48ca80c024 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:05.998214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-48900fd5-f5ed-425f-ae27-cf48ca80c024 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:05.998333 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-48900fd5-f5ed-425f-ae27-cf48ca80c024 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:05.999238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-48900fd5-f5ed-425f-ae27-cf48ca80c024 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:05.999783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-48900fd5-f5ed-425f-ae27-cf48ca80c024 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:06.216989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e45101ee-ff83-4847-970b-b132de5cc904 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:06.226516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-48900fd5-f5ed-425f-ae27-cf48ca80c024 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:06.228663 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e45101ee-ff83-4847-970b-b132de5cc904 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1508 microversion: 2.1 time: 0.265052 May 27 15:08:06.229217 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1403/2745] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:05 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:06.240146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-48900fd5-f5ed-425f-ae27-cf48ca80c024 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:06.240146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-48900fd5-f5ed-425f-ae27-cf48ca80c024 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:06.241066 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-48900fd5-f5ed-425f-ae27-cf48ca80c024 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 0.257252 May 27 15:08:06.242107 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1343/2746] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:05 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:08:06.273969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-33906adc-69cc-4be6-92f9-6b9523bc85b4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:06.274694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-33906adc-69cc-4be6-92f9-6b9523bc85b4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:06.276087 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-def5105f-42df-4d7c-8d91-9e5b29c3f582 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:06.278086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-def5105f-42df-4d7c-8d91-9e5b29c3f582 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:06.282405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-33906adc-69cc-4be6-92f9-6b9523bc85b4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:06.282740 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-33906adc-69cc-4be6-92f9-6b9523bc85b4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:06.283612 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-33906adc-69cc-4be6-92f9-6b9523bc85b4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:06.284126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-33906adc-69cc-4be6-92f9-6b9523bc85b4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:06.287985 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-def5105f-42df-4d7c-8d91-9e5b29c3f582 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:06.289031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-def5105f-42df-4d7c-8d91-9e5b29c3f582 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:06.290265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-def5105f-42df-4d7c-8d91-9e5b29c3f582 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:06.290937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-def5105f-42df-4d7c-8d91-9e5b29c3f582 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:06.537909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-def5105f-42df-4d7c-8d91-9e5b29c3f582 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:06.541149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-33906adc-69cc-4be6-92f9-6b9523bc85b4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:06.551572 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-33906adc-69cc-4be6-92f9-6b9523bc85b4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.281418 May 27 15:08:06.552168 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1344/2747] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:06 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:06.557054 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ca59fc1f-39bf-4e2e-9438-5595b0969ac3 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:06.557690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ca59fc1f-39bf-4e2e-9438-5595b0969ac3 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:06.560446 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-def5105f-42df-4d7c-8d91-9e5b29c3f582 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1467 microversion: 2.1 time: 0.289503 May 27 15:08:06.560446 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1404/2748] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:06 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1467 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:08:06.564381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ca59fc1f-39bf-4e2e-9438-5595b0969ac3 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:06.564879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ca59fc1f-39bf-4e2e-9438-5595b0969ac3 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:06.565705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ca59fc1f-39bf-4e2e-9438-5595b0969ac3 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:06.566170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ca59fc1f-39bf-4e2e-9438-5595b0969ac3 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:06.578092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8d060e07-3d4f-4b31-ab1e-a35f1fd3ede3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc7768dfe50>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:06.629425 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8d060e07-3d4f-4b31-ab1e-a35f1fd3ede3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/346e776e-8931-417f-87da-575810efb12b" status: 200 len: 784 microversion: 2.1 time: 0.055619 May 27 15:08:06.646013 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1405/2749] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:08:06 2022] GET /compute/v2.1/images/346e776e-8931-417f-87da-575810efb12b => generated 784 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:08:06.646738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ca59fc1f-39bf-4e2e-9438-5595b0969ac3 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b6df1a680e498b8f9014995a93f261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d729d0442554ca5a662cfabb7ea425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:06.650890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-de7096fb-a35b-448e-8b48-f526469a4de6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:06.651512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-de7096fb-a35b-448e-8b48-f526469a4de6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:06.658078 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ca59fc1f-39bf-4e2e-9438-5595b0969ac3 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87" status: 200 len: 1598 microversion: 2.1 time: 0.103190 May 27 15:08:06.659257 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1345/2750] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:06 2022] GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 => generated 1598 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:06.660230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de7096fb-a35b-448e-8b48-f526469a4de6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:06.660716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de7096fb-a35b-448e-8b48-f526469a4de6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:06.661532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de7096fb-a35b-448e-8b48-f526469a4de6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:06.661976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de7096fb-a35b-448e-8b48-f526469a4de6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:06.669058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1913584b-2d48-4fcd-b699-e5c981c61ea9 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:06.679402 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1913584b-2d48-4fcd-b699-e5c981c61ea9 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017801 May 27 15:08:06.680606 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1346/2751] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 15:08:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:06.686508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d394bddc-9384-4385-90dc-06160256a073 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:06.687418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d394bddc-9384-4385-90dc-06160256a073 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:06.697161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d394bddc-9384-4385-90dc-06160256a073 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:06.698178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d394bddc-9384-4385-90dc-06160256a073 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:06.700176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d394bddc-9384-4385-90dc-06160256a073 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:06.700835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d394bddc-9384-4385-90dc-06160256a073 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:06.895991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-de7096fb-a35b-448e-8b48-f526469a4de6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:06.900118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d394bddc-9384-4385-90dc-06160256a073 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:06.904402 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-de7096fb-a35b-448e-8b48-f526469a4de6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1514 microversion: 2.1 time: 0.257220 May 27 15:08:06.909336 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1406/2752] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:06 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1514 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:06.909791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eed1dea7-c48d-4e4e-9597-f5bd922e6fad tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc77cbd1790>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:06.915531 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d394bddc-9384-4385-90dc-06160256a073 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1503 microversion: 2.1 time: 0.233464 May 27 15:08:06.916390 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1347/2753] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:06 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:07.248884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4bf7d54f-5abf-4fcb-bb95-1890f3ab2fc8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:07.249665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4bf7d54f-5abf-4fcb-bb95-1890f3ab2fc8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:07.257002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4bf7d54f-5abf-4fcb-bb95-1890f3ab2fc8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:07.257460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4bf7d54f-5abf-4fcb-bb95-1890f3ab2fc8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:07.258233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4bf7d54f-5abf-4fcb-bb95-1890f3ab2fc8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:07.258676 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4bf7d54f-5abf-4fcb-bb95-1890f3ab2fc8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:07.429926 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4bf7d54f-5abf-4fcb-bb95-1890f3ab2fc8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:07.441236 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4bf7d54f-5abf-4fcb-bb95-1890f3ab2fc8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1529 microversion: 2.1 time: 0.195122 May 27 15:08:07.441756 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-eed1dea7-c48d-4e4e-9597-f5bd922e6fad tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "DELETE /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 204 len: 0 microversion: 2.1 time: 0.535666 May 27 15:08:07.445936 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1407/2754] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:06 2022] DELETE /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:08:07.447823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c4114b01-7b9b-4d3b-9621-d74bb4a03bd1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:07.448640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c4114b01-7b9b-4d3b-9621-d74bb4a03bd1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:07.456293 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1348/2755] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:07 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1529 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:08:07.461355 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c9e2070e-9c9e-439a-bd90-00f6dc439439 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776b89700>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:07.467064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c4114b01-7b9b-4d3b-9621-d74bb4a03bd1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:07.467977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c4114b01-7b9b-4d3b-9621-d74bb4a03bd1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:07.469012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c4114b01-7b9b-4d3b-9621-d74bb4a03bd1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:07.472061 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c4114b01-7b9b-4d3b-9621-d74bb4a03bd1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:07.498046 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-c9e2070e-9c9e-439a-bd90-00f6dc439439 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] HTTP exception thrown: Image not found. May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c9e2070e-9c9e-439a-bd90-00f6dc439439 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Request method failure captured: May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e HTTP/1.1 May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOkLw3INIZDNXYbUpaDGNyrEDcC-bZsl9fj6FRXrQg_YTD8CZEo8hFSFoN3WtFgtoljuvf5OM8DZNuwL4vFZF7dsTQT28b9i-dO_pSu83obGi8ncL76MGF-9UaAhWcfo2EbOKE4fB3WiMkfixRMRzCiMtAU8FdeEAoaR5nxhT1-AkRc May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 6f9f274a9b24495fa40d9c8be7dcc3d5 May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesOneServerTestJSON-754826229 May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f9f274a9b24495fa40d9c8be7dcc3d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f9f274a9b24495fa40d9c8be7dcc3d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6f9f274a9b24495fa40d9c8be7dcc3d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6f9f274a9b24495fa40d9c8be7dcc3d5", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesOneServerTestJSON-754826229 May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 6f9f274a9b24495fa40d9c8be7dcc3d5 May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-754826229 May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesOneServerTestJSON-754826229-project May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: e745803913eb40a9bb7fb90f59d574c9 May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesOneServerTestJSON-754826229-project May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: exception: Image not found. May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '2dfc1723-7284-41e4-97f2-81f98f8e419e'} May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2dfc1723-7284-41e4-97f2-81f98f8e419e May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 27 15:08:07.500582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2dfc1723-7284-41e4-97f2-81f98f8e419e could not be found. May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:08:07.504500 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:08:07.510377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c9e2070e-9c9e-439a-bd90-00f6dc439439 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Returning 404 to user: Image not found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:08:07.511777 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c9e2070e-9c9e-439a-bd90-00f6dc439439 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 404 len: 62 microversion: 2.1 time: 0.054903 May 27 15:08:07.513178 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1349/2756] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:08:07 2022] GET /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:08:07.529296 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-569d670c-4a34-4868-9b09-953282fadfa1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1629138966"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:07.531877 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-569d670c-4a34-4868-9b09-953282fadfa1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:07.540450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-569d670c-4a34-4868-9b09-953282fadfa1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:07.541295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-569d670c-4a34-4868-9b09-953282fadfa1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:07.542320 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-569d670c-4a34-4868-9b09-953282fadfa1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:07.543536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-569d670c-4a34-4868-9b09-953282fadfa1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:07.819144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c4114b01-7b9b-4d3b-9621-d74bb4a03bd1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:07.834321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c4114b01-7b9b-4d3b-9621-d74bb4a03bd1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:07.837117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c4114b01-7b9b-4d3b-9621-d74bb4a03bd1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:07.838846 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c4114b01-7b9b-4d3b-9621-d74bb4a03bd1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 0.395170 May 27 15:08:07.849257 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1408/2757] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:07 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:07.856346 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b84948fa-4f9a-4b44-b20b-28f747a57c6b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:07.863664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b84948fa-4f9a-4b44-b20b-28f747a57c6b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:07.874070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b84948fa-4f9a-4b44-b20b-28f747a57c6b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:07.874820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b84948fa-4f9a-4b44-b20b-28f747a57c6b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:07.875790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b84948fa-4f9a-4b44-b20b-28f747a57c6b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:07.876392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b84948fa-4f9a-4b44-b20b-28f747a57c6b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:07.887145 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-569d670c-4a34-4868-9b09-953282fadfa1 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "POST /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4/action" status: 202 len: 0 microversion: 2.1 time: 0.362808 May 27 15:08:07.888804 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1350/2758] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:08:07 2022] POST /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) May 27 15:08:07.895162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e640b336-f23c-48a4-a862-61dd125a5352 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:07.896149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e640b336-f23c-48a4-a862-61dd125a5352 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:07.906619 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e640b336-f23c-48a4-a862-61dd125a5352 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:07.907328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e640b336-f23c-48a4-a862-61dd125a5352 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:07.908633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e640b336-f23c-48a4-a862-61dd125a5352 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:07.909539 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e640b336-f23c-48a4-a862-61dd125a5352 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:07.994906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e640b336-f23c-48a4-a862-61dd125a5352 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:07.997346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e640b336-f23c-48a4-a862-61dd125a5352 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:07.997919 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-e640b336-f23c-48a4-a862-61dd125a5352 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lazy-loading 'fault' on Instance uuid cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:08:08.087638 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e640b336-f23c-48a4-a862-61dd125a5352 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0b6df1a680e498b8f9014995a93f261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d729d0442554ca5a662cfabb7ea425b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:08.088461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b84948fa-4f9a-4b44-b20b-28f747a57c6b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:08.103206 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e640b336-f23c-48a4-a862-61dd125a5352 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87" status: 200 len: 1315 microversion: 2.1 time: 0.212877 May 27 15:08:08.105159 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b84948fa-4f9a-4b44-b20b-28f747a57c6b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.252843 May 27 15:08:08.105982 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1409/2759] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:07 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:08.114677 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1351/2760] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:07 2022] GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:08.121211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-af6c2718-c02b-4e74-b379-80ad3e401b41 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776890160>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:08.175836 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-af6c2718-c02b-4e74-b379-80ad3e401b41 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f" status: 200 len: 1427 microversion: 2.1 time: 0.059799 May 27 15:08:08.181706 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1410/2761] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:08:08 2022] GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f => generated 1427 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:08.186421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-75118d11-0221-4799-94d1-740ec8e5fb21 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:08.187489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-75118d11-0221-4799-94d1-740ec8e5fb21 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:08.199921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75118d11-0221-4799-94d1-740ec8e5fb21 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:08.200481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75118d11-0221-4799-94d1-740ec8e5fb21 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:08.201369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75118d11-0221-4799-94d1-740ec8e5fb21 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:08.201894 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75118d11-0221-4799-94d1-740ec8e5fb21 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:08.219132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-3eb8d729-7c87-43f9-8cf7-283633fba107 req-9a90d3d4-3ef2-4c42-9263-03f5693a9250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9604d14-4598-4d42-8bbf-8763103061a4", "name": "network-vif-unplugged", "status": "completed", "tag": "648e11b1-5568-4d40-a6cd-7e3f346ef13b"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:08.241501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3eb8d729-7c87-43f9-8cf7-283633fba107 req-9a90d3d4-3ef2-4c42-9263-03f5693a9250 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:08.242366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3eb8d729-7c87-43f9-8cf7-283633fba107 req-9a90d3d4-3ef2-4c42-9263-03f5693a9250 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:08.260748 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-3eb8d729-7c87-43f9-8cf7-283633fba107 req-9a90d3d4-3ef2-4c42-9263-03f5693a9250 service nova] Creating event network-vif-unplugged:648e11b1-5568-4d40-a6cd-7e3f346ef13b for instance d9604d14-4598-4d42-8bbf-8763103061a4 on n-h1-843621-1 May 27 15:08:08.266419 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-3eb8d729-7c87-43f9-8cf7-283633fba107 req-9a90d3d4-3ef2-4c42-9263-03f5693a9250 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151483 May 27 15:08:08.267403 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1352/2762] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:08.276074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6aef5b3c-4eda-436b-af32-e882522fa7f3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:08.276306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6aef5b3c-4eda-436b-af32-e882522fa7f3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:08.283149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6aef5b3c-4eda-436b-af32-e882522fa7f3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:08.283615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6aef5b3c-4eda-436b-af32-e882522fa7f3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:08.284405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6aef5b3c-4eda-436b-af32-e882522fa7f3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:08.284891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6aef5b3c-4eda-436b-af32-e882522fa7f3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:08.535105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-75118d11-0221-4799-94d1-740ec8e5fb21 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:08.549910 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-75118d11-0221-4799-94d1-740ec8e5fb21 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1514 microversion: 2.1 time: 0.372071 May 27 15:08:08.560348 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1411/2763] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:08 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1514 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:08.576323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6aef5b3c-4eda-436b-af32-e882522fa7f3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:08.586584 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6aef5b3c-4eda-436b-af32-e882522fa7f3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1503 microversion: 2.1 time: 0.315912 May 27 15:08:08.605845 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1353/2764] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:08 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1503 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:08.605845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-694dc8b8-103a-4167-a105-ee310f65a730 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:08.605845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-694dc8b8-103a-4167-a105-ee310f65a730 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:08.621989 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-694dc8b8-103a-4167-a105-ee310f65a730 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:08.622329 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-694dc8b8-103a-4167-a105-ee310f65a730 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:08.623161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-694dc8b8-103a-4167-a105-ee310f65a730 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:08.624415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-694dc8b8-103a-4167-a105-ee310f65a730 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:08.729777 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7bc1a89a-75e8-46ee-9c55-65061ed426d1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:08.730997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7bc1a89a-75e8-46ee-9c55-65061ed426d1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:08.737430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7bc1a89a-75e8-46ee-9c55-65061ed426d1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:08.737874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7bc1a89a-75e8-46ee-9c55-65061ed426d1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:08.738666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7bc1a89a-75e8-46ee-9c55-65061ed426d1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:08.745017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7bc1a89a-75e8-46ee-9c55-65061ed426d1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:08.772545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7bc1a89a-75e8-46ee-9c55-65061ed426d1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:08:08.865162 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7bc1a89a-75e8-46ee-9c55-65061ed426d1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "DELETE /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 204 len: 0 microversion: 2.32 time: 0.303450 May 27 15:08:08.866084 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1412/2765] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:08:08 2022] DELETE /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:08:08.873329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-be76d465-54fc-4f38-af9e-b2977628728f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:08.874037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-be76d465-54fc-4f38-af9e-b2977628728f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:08.881173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be76d465-54fc-4f38-af9e-b2977628728f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:08.881633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be76d465-54fc-4f38-af9e-b2977628728f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:08.882410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be76d465-54fc-4f38-af9e-b2977628728f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:08.882850 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be76d465-54fc-4f38-af9e-b2977628728f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:08.890503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-694dc8b8-103a-4167-a105-ee310f65a730 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:08.898629 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-694dc8b8-103a-4167-a105-ee310f65a730 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1529 microversion: 2.1 time: 0.309740 May 27 15:08:08.899304 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1354/2766] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:08 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1529 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:08.909856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f2d60b45-eac0-4166-accf-cf676faec473 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:08.910594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f2d60b45-eac0-4166-accf-cf676faec473 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:08.917022 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2d60b45-eac0-4166-accf-cf676faec473 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:08.917571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2d60b45-eac0-4166-accf-cf676faec473 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:08.918953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2d60b45-eac0-4166-accf-cf676faec473 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:08.919469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2d60b45-eac0-4166-accf-cf676faec473 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:09.114215 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-be76d465-54fc-4f38-af9e-b2977628728f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:09.125161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-be76d465-54fc-4f38-af9e-b2977628728f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:09.127183 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-be76d465-54fc-4f38-af9e-b2977628728f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:09.130385 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-be76d465-54fc-4f38-af9e-b2977628728f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 0.261976 May 27 15:08:09.131810 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1413/2767] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:08 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:09.137010 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e59e41c-38fc-489a-b0fe-4ac08eeae0e1 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:09.138693 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e59e41c-38fc-489a-b0fe-4ac08eeae0e1 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] [instance: cd42e7d1-e7c7-4c19-a13e-2e81332b4d87] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:09.146085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e59e41c-38fc-489a-b0fe-4ac08eeae0e1 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:09.147386 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e59e41c-38fc-489a-b0fe-4ac08eeae0e1 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:09.148710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e59e41c-38fc-489a-b0fe-4ac08eeae0e1 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:09.149489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e59e41c-38fc-489a-b0fe-4ac08eeae0e1 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:09.156505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f2d60b45-eac0-4166-accf-cf676faec473 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:09.166801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f2d60b45-eac0-4166-accf-cf676faec473 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:09.168855 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-0e59e41c-38fc-489a-b0fe-4ac08eeae0e1 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] HTTP exception thrown: Instance cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 could not be found. May 27 15:08:09.168992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f2d60b45-eac0-4166-accf-cf676faec473 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:09.170363 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f2d60b45-eac0-4166-accf-cf676faec473 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 2951 microversion: 2.32 time: 0.264946 May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e59e41c-38fc-489a-b0fe-4ac08eeae0e1 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Request method failure captured: May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 HTTP/1.1 May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOkRjvO6dkA3u-nsoMxSQh-CUMBrrsfNM2NhZ9LCXRxdye-cFT4mX_67KvTo150BkED_8CXUpVQerlN8ee6EoJmO-qYDnkCw30ckaw7SUFhrg3-MTOJ_GUVYeeqozGYXYdOya-pjYeoNfKV_iCC_XZc1_EszU60AceIAeb86nZN9VSI May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 6d729d0442554ca5a662cfabb7ea425b May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersTestFqdnHostnames-1152822559 May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6d729d0442554ca5a662cfabb7ea425b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6d729d0442554ca5a662cfabb7ea425b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6d729d0442554ca5a662cfabb7ea425b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6d729d0442554ca5a662cfabb7ea425b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersTestFqdnHostnames-1152822559 May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 6d729d0442554ca5a662cfabb7ea425b May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1152822559 May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersTestFqdnHostnames-1152822559-project May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: c0b6df1a680e498b8f9014995a93f261 May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersTestFqdnHostnames-1152822559-project May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 could not be found. May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'cd42e7d1-e7c7-4c19-a13e-2e81332b4d87'} May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 could not be found. May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 could not be found. May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:08:09.170645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:08:09.174639 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:08:09.174639 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:08:09.174639 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:08:09.174639 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:08:09.174639 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:08:09.174639 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 could not be found. May 27 15:08:09.174639 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:08:09.174639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e59e41c-38fc-489a-b0fe-4ac08eeae0e1 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Returning 404 to user: Instance cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:08:09.174639 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e59e41c-38fc-489a-b0fe-4ac08eeae0e1 tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87" status: 404 len: 111 microversion: 2.1 time: 0.038784 May 27 15:08:09.174639 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1414/2768] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:09 2022] GET /compute/v2.1/servers/cd42e7d1-e7c7-4c19-a13e-2e81332b4d87 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:08:09.181021 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1355/2769] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:08 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 2951 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:09.187457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6929a88b-ec28-422f-86b7-cdfebb2c0fcc tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] Calling method '.version_select at 0x7fc776bf6280>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:09.188499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3e763022-0164-45b3-9097-608a43821057 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:09.189207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3e763022-0164-45b3-9097-608a43821057 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:09.195892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e763022-0164-45b3-9097-608a43821057 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:09.196350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e763022-0164-45b3-9097-608a43821057 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:09.197308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e763022-0164-45b3-9097-608a43821057 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:09.198067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e763022-0164-45b3-9097-608a43821057 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:09.218342 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6929a88b-ec28-422f-86b7-cdfebb2c0fcc tempest-ServersTestFqdnHostnames-1152822559 tempest-ServersTestFqdnHostnames-1152822559-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-982888786" status: 202 len: 0 microversion: 2.1 time: 0.035893 May 27 15:08:09.219356 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1356/2770] 10.222.0.13 () {58 vars in 1217 bytes} [Fri May 27 15:08:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-982888786 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:08:09.225499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-83422943-a6e8-4532-9c0b-773507d7b26b tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776c53790>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:09.290274 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-83422943-a6e8-4532-9c0b-773507d7b26b tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f" status: 200 len: 1427 microversion: 2.1 time: 0.069538 May 27 15:08:09.290856 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1357/2771] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:08:09 2022] GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f => generated 1427 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:09.403838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3e763022-0164-45b3-9097-608a43821057 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:09.412049 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3e763022-0164-45b3-9097-608a43821057 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.237837 May 27 15:08:09.413075 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1415/2772] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:09 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:09.569110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-06e179c9-5ca4-467e-9d57-a89069a634ef tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:09.570177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-06e179c9-5ca4-467e-9d57-a89069a634ef tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:09.578268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-06e179c9-5ca4-467e-9d57-a89069a634ef tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:09.578831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-06e179c9-5ca4-467e-9d57-a89069a634ef tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:09.579702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-06e179c9-5ca4-467e-9d57-a89069a634ef tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:09.580570 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-06e179c9-5ca4-467e-9d57-a89069a634ef tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:09.616130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3aea91b2-1812-41f6-9d37-7207d8cebe0e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:09.617659 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3aea91b2-1812-41f6-9d37-7207d8cebe0e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:09.630650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3aea91b2-1812-41f6-9d37-7207d8cebe0e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:09.630650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3aea91b2-1812-41f6-9d37-7207d8cebe0e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:09.630650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3aea91b2-1812-41f6-9d37-7207d8cebe0e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:09.630650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3aea91b2-1812-41f6-9d37-7207d8cebe0e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:09.668250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:10.075498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-06e179c9-5ca4-467e-9d57-a89069a634ef tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:10.078277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3aea91b2-1812-41f6-9d37-7207d8cebe0e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:10.079605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:10.085086 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-06e179c9-5ca4-467e-9d57-a89069a634ef tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1514 microversion: 2.1 time: 0.521367 May 27 15:08:10.094827 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1358/2773] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:09 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1514 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:10.095020 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3aea91b2-1812-41f6-9d37-7207d8cebe0e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1503 microversion: 2.1 time: 0.476704 May 27 15:08:10.095116 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1ac82413-707f-4fe1-a007-5414f85310d3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:10.095116 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1ac82413-707f-4fe1-a007-5414f85310d3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:10.098493 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1416/2774] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:09 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1503 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:08:10.101332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ac82413-707f-4fe1-a007-5414f85310d3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:10.101798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ac82413-707f-4fe1-a007-5414f85310d3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:10.102590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ac82413-707f-4fe1-a007-5414f85310d3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:10.103041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ac82413-707f-4fe1-a007-5414f85310d3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:10.148915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-77580e87-3a6a-4a2f-a497-27efc85d8ed3 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:10.149686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-77580e87-3a6a-4a2f-a497-27efc85d8ed3 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:10.160597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77580e87-3a6a-4a2f-a497-27efc85d8ed3 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:10.161301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77580e87-3a6a-4a2f-a497-27efc85d8ed3 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:10.162249 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77580e87-3a6a-4a2f-a497-27efc85d8ed3 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:10.162936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77580e87-3a6a-4a2f-a497-27efc85d8ed3 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:10.298663 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1ac82413-707f-4fe1-a007-5414f85310d3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:10.309154 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1ac82413-707f-4fe1-a007-5414f85310d3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1529 microversion: 2.1 time: 0.219643 May 27 15:08:10.310020 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1359/2775] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:10 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1529 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:10.315048 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b5f6e35c-47a1-45fb-ae5a-b4f9c6164ee2 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:10.316166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b5f6e35c-47a1-45fb-ae5a-b4f9c6164ee2 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:10.322687 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b5f6e35c-47a1-45fb-ae5a-b4f9c6164ee2 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:10.323239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b5f6e35c-47a1-45fb-ae5a-b4f9c6164ee2 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:10.324135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b5f6e35c-47a1-45fb-ae5a-b4f9c6164ee2 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:10.324648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b5f6e35c-47a1-45fb-ae5a-b4f9c6164ee2 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:10.346455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-77580e87-3a6a-4a2f-a497-27efc85d8ed3 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:10.358367 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-77580e87-3a6a-4a2f-a497-27efc85d8ed3 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:10.360432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-77580e87-3a6a-4a2f-a497-27efc85d8ed3 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:10.361743 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-77580e87-3a6a-4a2f-a497-27efc85d8ed3 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 0.216860 May 27 15:08:10.362299 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1417/2776] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:10 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:10.373116 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-c77eb889-118a-4214-bb6f-b269e57fba2a req-6c77a71b-0ea3-4ee9-bf42-5bed94e5868c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1852d307-f34e-4a53-942f-145d41dc5c24", "name": "network-vif-plugged", "status": "completed", "tag": "0d3395a1-3889-43d9-8af7-cd140f2fee10"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:10.382023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c77eb889-118a-4214-bb6f-b269e57fba2a req-6c77a71b-0ea3-4ee9-bf42-5bed94e5868c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:10.382541 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c77eb889-118a-4214-bb6f-b269e57fba2a req-6c77a71b-0ea3-4ee9-bf42-5bed94e5868c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:10.394545 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-c77eb889-118a-4214-bb6f-b269e57fba2a req-6c77a71b-0ea3-4ee9-bf42-5bed94e5868c service nova] Creating event network-vif-plugged:0d3395a1-3889-43d9-8af7-cd140f2fee10 for instance 1852d307-f34e-4a53-942f-145d41dc5c24 on n-h1-843621-1 May 27 15:08:10.399624 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-c77eb889-118a-4214-bb6f-b269e57fba2a req-6c77a71b-0ea3-4ee9-bf42-5bed94e5868c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036047 May 27 15:08:10.400240 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1418/2777] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:10.405437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e1fff30e-d94f-4ad4-8c50-cdd7c07da23d tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc77716d940>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:10.454793 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e1fff30e-d94f-4ad4-8c50-cdd7c07da23d tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f" status: 200 len: 1427 microversion: 2.1 time: 0.053265 May 27 15:08:10.455327 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1419/2778] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:08:10 2022] GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:10.460164 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dcd129ab-3f83-4d72-be0d-b1d0defdc2ac tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:10.461091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dcd129ab-3f83-4d72-be0d-b1d0defdc2ac tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:10.468180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dcd129ab-3f83-4d72-be0d-b1d0defdc2ac tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:10.468637 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dcd129ab-3f83-4d72-be0d-b1d0defdc2ac tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:10.469513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dcd129ab-3f83-4d72-be0d-b1d0defdc2ac tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:10.469978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dcd129ab-3f83-4d72-be0d-b1d0defdc2ac tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:10.573573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b5f6e35c-47a1-45fb-ae5a-b4f9c6164ee2 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:10.583091 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b5f6e35c-47a1-45fb-ae5a-b4f9c6164ee2 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:10.584625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b5f6e35c-47a1-45fb-ae5a-b4f9c6164ee2 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:10.585926 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b5f6e35c-47a1-45fb-ae5a-b4f9c6164ee2 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 2951 microversion: 2.32 time: 0.274690 May 27 15:08:10.586495 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1360/2779] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:10 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 2951 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:10.633088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dcd129ab-3f83-4d72-be0d-b1d0defdc2ac tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:10.641055 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dcd129ab-3f83-4d72-be0d-b1d0defdc2ac tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.184505 May 27 15:08:10.642068 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1420/2780] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:10 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:11.101817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d6d2f335-a77e-41f7-a939-f442bd7be238 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:11.102494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d6d2f335-a77e-41f7-a939-f442bd7be238 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:11.107373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ed6100e9-7c4f-4cb3-9b16-ff1dbd3e3d95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:11.108098 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ed6100e9-7c4f-4cb3-9b16-ff1dbd3e3d95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:11.108948 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6d2f335-a77e-41f7-a939-f442bd7be238 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:11.109610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6d2f335-a77e-41f7-a939-f442bd7be238 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:11.110551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6d2f335-a77e-41f7-a939-f442bd7be238 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:11.111168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6d2f335-a77e-41f7-a939-f442bd7be238 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:11.116513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed6100e9-7c4f-4cb3-9b16-ff1dbd3e3d95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:11.117343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed6100e9-7c4f-4cb3-9b16-ff1dbd3e3d95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:11.118124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed6100e9-7c4f-4cb3-9b16-ff1dbd3e3d95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:11.118563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed6100e9-7c4f-4cb3-9b16-ff1dbd3e3d95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:11.432198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d6d2f335-a77e-41f7-a939-f442bd7be238 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:11.435869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ed6100e9-7c4f-4cb3-9b16-ff1dbd3e3d95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:11.440853 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d6d2f335-a77e-41f7-a939-f442bd7be238 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1514 microversion: 2.1 time: 0.342918 May 27 15:08:11.441685 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1361/2781] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:11 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1514 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:11.447396 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fd7b22ee-502a-424c-9452-cd764b5fff1b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:11.447584 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ed6100e9-7c4f-4cb3-9b16-ff1dbd3e3d95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1478 microversion: 2.1 time: 0.345578 May 27 15:08:11.448089 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1421/2782] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:11 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1478 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:11.448702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fd7b22ee-502a-424c-9452-cd764b5fff1b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:11.453446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-86046835-6f90-4493-a1bb-52aa777e21ca tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:11.454147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-86046835-6f90-4493-a1bb-52aa777e21ca tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:11.457055 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd7b22ee-502a-424c-9452-cd764b5fff1b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:11.458885 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd7b22ee-502a-424c-9452-cd764b5fff1b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:11.459931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd7b22ee-502a-424c-9452-cd764b5fff1b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:11.460571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd7b22ee-502a-424c-9452-cd764b5fff1b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:11.470805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-86046835-6f90-4493-a1bb-52aa777e21ca tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:11.471364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-86046835-6f90-4493-a1bb-52aa777e21ca tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:11.472468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-86046835-6f90-4493-a1bb-52aa777e21ca tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:11.473145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-86046835-6f90-4493-a1bb-52aa777e21ca tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:11.664486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-86046835-6f90-4493-a1bb-52aa777e21ca tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:11.675462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fd7b22ee-502a-424c-9452-cd764b5fff1b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:11.675879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-86046835-6f90-4493-a1bb-52aa777e21ca tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:11.677583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-86046835-6f90-4493-a1bb-52aa777e21ca tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:11.679242 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-86046835-6f90-4493-a1bb-52aa777e21ca tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 0.230151 May 27 15:08:11.679826 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1422/2783] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:11 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:11.683449 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fd7b22ee-502a-424c-9452-cd764b5fff1b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1529 microversion: 2.1 time: 0.240510 May 27 15:08:11.685001 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1362/2784] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:11 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1529 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:11.689356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9ea09f81-af90-469a-8844-5c1d4a4045c7 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '.version_select at 0x7fc776ca59d0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:11.691986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ea09f81-af90-469a-8844-5c1d4a4045c7 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:11.692444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ea09f81-af90-469a-8844-5c1d4a4045c7 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:11.694179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-52111897-b6b7-4d26-ab82-f50a1828f664 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776c3e040>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:11.700247 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9ea09f81-af90-469a-8844-5c1d4a4045c7 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 783 microversion: 2.1 time: 0.014071 May 27 15:08:11.700883 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1363/2785] 10.222.0.13 () {58 vars in 1142 bytes} [Fri May 27 15:08:11 2022] GET /compute/v2.1/os-migrations => generated 783 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:11.705752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8121b591-6929-4a68-9f4a-10a6abacfd7d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:11.706378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8121b591-6929-4a68-9f4a-10a6abacfd7d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:11.722914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8121b591-6929-4a68-9f4a-10a6abacfd7d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:11.723647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8121b591-6929-4a68-9f4a-10a6abacfd7d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:11.724637 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8121b591-6929-4a68-9f4a-10a6abacfd7d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:11.725183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8121b591-6929-4a68-9f4a-10a6abacfd7d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:11.766051 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-52111897-b6b7-4d26-ab82-f50a1828f664 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f" status: 200 len: 1427 microversion: 2.1 time: 0.084845 May 27 15:08:11.772247 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1423/2786] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:08:11 2022] GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:11.778474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0b00d98d-079e-41d9-952d-f4781dbd8db6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:11.779101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0b00d98d-079e-41d9-952d-f4781dbd8db6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:11.781156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:11.787341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0b00d98d-079e-41d9-952d-f4781dbd8db6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:11.787878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0b00d98d-079e-41d9-952d-f4781dbd8db6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:11.788700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0b00d98d-079e-41d9-952d-f4781dbd8db6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:11.789145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0b00d98d-079e-41d9-952d-f4781dbd8db6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:12.017847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8121b591-6929-4a68-9f4a-10a6abacfd7d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:12.032949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8121b591-6929-4a68-9f4a-10a6abacfd7d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:12.034680 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8121b591-6929-4a68-9f4a-10a6abacfd7d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:12.036140 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8121b591-6929-4a68-9f4a-10a6abacfd7d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 2951 microversion: 2.32 time: 0.334169 May 27 15:08:12.036910 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1364/2787] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:11 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 2951 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:12.041818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8c8ef511-97cc-4eb7-9e9b-3468d4398862 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:12.043426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8c8ef511-97cc-4eb7-9e9b-3468d4398862 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:12.050019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c8ef511-97cc-4eb7-9e9b-3468d4398862 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:12.053202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c8ef511-97cc-4eb7-9e9b-3468d4398862 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:12.057068 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c8ef511-97cc-4eb7-9e9b-3468d4398862 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:12.057721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c8ef511-97cc-4eb7-9e9b-3468d4398862 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:12.064305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0b00d98d-079e-41d9-952d-f4781dbd8db6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:12.075277 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0b00d98d-079e-41d9-952d-f4781dbd8db6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.301649 May 27 15:08:12.083903 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1424/2788] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:11 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:12.241673 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8c8ef511-97cc-4eb7-9e9b-3468d4398862 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1629 microversion: 2.1 time: 0.203464 May 27 15:08:12.248294 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1365/2789] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:12 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1629 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:12.433320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a74278cd-37d6-4121-8601-ab8b7a2bd843 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1086742026", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "2344c7a7-c142-4221-acc7-8131f1072282"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:12.461406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-174501c9-95fa-4df2-9666-510e87819fea tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:12.462272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-174501c9-95fa-4df2-9666-510e87819fea tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:12.472572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-174501c9-95fa-4df2-9666-510e87819fea tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:12.489138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-174501c9-95fa-4df2-9666-510e87819fea tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:12.490020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-174501c9-95fa-4df2-9666-510e87819fea tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:12.490519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-174501c9-95fa-4df2-9666-510e87819fea tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:12.531791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-a74278cd-37d6-4121-8601-ab8b7a2bd843 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] validate_networks() for [('2344c7a7-c142-4221-acc7-8131f1072282', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:08:12.899517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-174501c9-95fa-4df2-9666-510e87819fea tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:12.907998 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-174501c9-95fa-4df2-9666-510e87819fea tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1514 microversion: 2.1 time: 0.451658 May 27 15:08:12.918003 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1366/2790] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:12 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1514 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:12.923363 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8f0b8f2f-d92a-4370-a8a2-28195486294c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:12.924055 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8f0b8f2f-d92a-4370-a8a2-28195486294c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:12.930906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8f0b8f2f-d92a-4370-a8a2-28195486294c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:12.931595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8f0b8f2f-d92a-4370-a8a2-28195486294c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:12.932451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8f0b8f2f-d92a-4370-a8a2-28195486294c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:12.933140 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8f0b8f2f-d92a-4370-a8a2-28195486294c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:13.226702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8f0b8f2f-d92a-4370-a8a2-28195486294c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:13.243260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8f0b8f2f-d92a-4370-a8a2-28195486294c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:13.245350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8f0b8f2f-d92a-4370-a8a2-28195486294c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:13.249459 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8f0b8f2f-d92a-4370-a8a2-28195486294c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 0.330002 May 27 15:08:13.252405 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1367/2791] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:12 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:13.266522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-866cdf7c-7978-49c1-bb47-327ab40f0335 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:13.267227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-866cdf7c-7978-49c1-bb47-327ab40f0335 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:13.275192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-866cdf7c-7978-49c1-bb47-327ab40f0335 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:13.275606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-866cdf7c-7978-49c1-bb47-327ab40f0335 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:13.276488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-866cdf7c-7978-49c1-bb47-327ab40f0335 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:13.276968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-866cdf7c-7978-49c1-bb47-327ab40f0335 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:13.646464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-866cdf7c-7978-49c1-bb47-327ab40f0335 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:13.656482 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-866cdf7c-7978-49c1-bb47-327ab40f0335 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1529 microversion: 2.1 time: 0.402681 May 27 15:08:13.666029 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1368/2792] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:13 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1529 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:13.672000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0f7bcca6-46f8-4b80-9e98-854466773acd tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776cbeaf0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:13.738763 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a74278cd-37d6-4121-8601-ab8b7a2bd843 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:08:13.739774 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a74278cd-37d6-4121-8601-ab8b7a2bd843 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:08:13.740461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a74278cd-37d6-4121-8601-ab8b7a2bd843 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:08:13.741065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a74278cd-37d6-4121-8601-ab8b7a2bd843 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:08:13.741571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a74278cd-37d6-4121-8601-ab8b7a2bd843 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:08:13.753575 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0f7bcca6-46f8-4b80-9e98-854466773acd tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f" status: 200 len: 1427 microversion: 2.1 time: 0.091396 May 27 15:08:13.761842 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1369/2793] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:08:13 2022] GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:13.762608 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a74278cd-37d6-4121-8601-ab8b7a2bd843 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:13.764123 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a74278cd-37d6-4121-8601-ab8b7a2bd843 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:13.765824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a74278cd-37d6-4121-8601-ab8b7a2bd843 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:13.766598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a74278cd-37d6-4121-8601-ab8b7a2bd843 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:13.773677 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-71f768a4-9f32-410c-959a-36de90b101ba tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:13.775328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-71f768a4-9f32-410c-959a-36de90b101ba tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:13.784769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71f768a4-9f32-410c-959a-36de90b101ba tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:13.785537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71f768a4-9f32-410c-959a-36de90b101ba tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:13.786631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71f768a4-9f32-410c-959a-36de90b101ba tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:13.787261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71f768a4-9f32-410c-959a-36de90b101ba tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:13.814452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-a74278cd-37d6-4121-8601-ab8b7a2bd843 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Getting quotas for project e41b606a0de24f7fa9ea68af7064723b. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:08:13.820646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-a74278cd-37d6-4121-8601-ab8b7a2bd843 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Getting quotas for user 741a4f106a8f416891b90994e6ce9d40 and project e41b606a0de24f7fa9ea68af7064723b. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:08:13.850817 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a74278cd-37d6-4121-8601-ab8b7a2bd843 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:08:13.853185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a74278cd-37d6-4121-8601-ab8b7a2bd843 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:08:13.982467 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a74278cd-37d6-4121-8601-ab8b7a2bd843 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.553234 May 27 15:08:13.983988 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1425/2794] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:08:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:08:13.991145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-53ecd54a-df0b-4aa3-b8ae-a3470c04ad47 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:13.993125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-53ecd54a-df0b-4aa3-b8ae-a3470c04ad47 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:14.003776 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53ecd54a-df0b-4aa3-b8ae-a3470c04ad47 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:14.004246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53ecd54a-df0b-4aa3-b8ae-a3470c04ad47 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:14.006709 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53ecd54a-df0b-4aa3-b8ae-a3470c04ad47 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:14.010389 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53ecd54a-df0b-4aa3-b8ae-a3470c04ad47 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:14.761658 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-53ecd54a-df0b-4aa3-b8ae-a3470c04ad47 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:14.776117 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-53ecd54a-df0b-4aa3-b8ae-a3470c04ad47 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.790812 May 27 15:08:14.786500 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1426/2795] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:13 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:14.795974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-71f768a4-9f32-410c-959a-36de90b101ba tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:14.824862 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ca2fd584-9c01-4ba8-8dc5-bc90b0418325 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:14.824975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ca2fd584-9c01-4ba8-8dc5-bc90b0418325 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:14.837762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-71f768a4-9f32-410c-959a-36de90b101ba tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:14.840918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-71f768a4-9f32-410c-959a-36de90b101ba tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:14.844237 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-71f768a4-9f32-410c-959a-36de90b101ba tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 2930 microversion: 2.32 time: 1.080381 May 27 15:08:14.859304 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1370/2796] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:13 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 2930 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:14.859832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca2fd584-9c01-4ba8-8dc5-bc90b0418325 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:14.860389 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca2fd584-9c01-4ba8-8dc5-bc90b0418325 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:14.865484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fa57d95d-5278-4d2c-9ff7-e993becec11e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:14.866350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fa57d95d-5278-4d2c-9ff7-e993becec11e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:14.882009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca2fd584-9c01-4ba8-8dc5-bc90b0418325 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:14.882482 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca2fd584-9c01-4ba8-8dc5-bc90b0418325 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:14.895705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa57d95d-5278-4d2c-9ff7-e993becec11e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:14.897005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa57d95d-5278-4d2c-9ff7-e993becec11e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:14.905817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa57d95d-5278-4d2c-9ff7-e993becec11e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:14.908901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa57d95d-5278-4d2c-9ff7-e993becec11e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:15.174096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fa57d95d-5278-4d2c-9ff7-e993becec11e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:15.191579 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fa57d95d-5278-4d2c-9ff7-e993becec11e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1215 microversion: 2.1 time: 0.328456 May 27 15:08:15.193107 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1371/2797] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:14 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1215 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:15.207434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d06c25ac-95bf-4a14-aa57-514a10edf01e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:15.209887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d06c25ac-95bf-4a14-aa57-514a10edf01e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:15.226347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d06c25ac-95bf-4a14-aa57-514a10edf01e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:15.226812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d06c25ac-95bf-4a14-aa57-514a10edf01e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:15.238601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d06c25ac-95bf-4a14-aa57-514a10edf01e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:15.241678 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d06c25ac-95bf-4a14-aa57-514a10edf01e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:15.450842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ca2fd584-9c01-4ba8-8dc5-bc90b0418325 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:15.461491 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ca2fd584-9c01-4ba8-8dc5-bc90b0418325 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1514 microversion: 2.1 time: 0.668391 May 27 15:08:15.462922 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1427/2798] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:14 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1514 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:15.484355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-41c2e6ee-5eb3-462a-88f0-f84e36a95cfe tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:15.486002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-41c2e6ee-5eb3-462a-88f0-f84e36a95cfe tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:15.505483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41c2e6ee-5eb3-462a-88f0-f84e36a95cfe tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:15.506251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41c2e6ee-5eb3-462a-88f0-f84e36a95cfe tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:15.512661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41c2e6ee-5eb3-462a-88f0-f84e36a95cfe tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:15.514375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41c2e6ee-5eb3-462a-88f0-f84e36a95cfe tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:16.424555 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d06c25ac-95bf-4a14-aa57-514a10edf01e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:16.443816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d06c25ac-95bf-4a14-aa57-514a10edf01e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:16.446027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d06c25ac-95bf-4a14-aa57-514a10edf01e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:16.447288 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d06c25ac-95bf-4a14-aa57-514a10edf01e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 1.252051 May 27 15:08:16.458058 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1372/2799] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:15 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:16.461797 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-d48839f8-9b32-4424-90ae-5c891e3499fe req-77fbd579-2f83-49c0-9f46-70e720adb3e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "name": "network-vif-unplugged", "status": "completed", "tag": "71fcf64b-5a54-42bd-a04e-812ea701d6ba"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:16.489099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d48839f8-9b32-4424-90ae-5c891e3499fe req-77fbd579-2f83-49c0-9f46-70e720adb3e2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:16.490136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d48839f8-9b32-4424-90ae-5c891e3499fe req-77fbd579-2f83-49c0-9f46-70e720adb3e2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:16.520107 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-d48839f8-9b32-4424-90ae-5c891e3499fe req-77fbd579-2f83-49c0-9f46-70e720adb3e2 service nova] Creating event network-vif-unplugged:71fcf64b-5a54-42bd-a04e-812ea701d6ba for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:08:16.528627 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-d48839f8-9b32-4424-90ae-5c891e3499fe req-77fbd579-2f83-49c0-9f46-70e720adb3e2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076835 May 27 15:08:16.529864 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1373/2800] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:16.538656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-da0720c2-0f40-4594-ac93-96b218db8fae tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776b393a0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:16.621424 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-da0720c2-0f40-4594-ac93-96b218db8fae tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f" status: 200 len: 1427 microversion: 2.1 time: 0.090044 May 27 15:08:16.623071 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1374/2801] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:08:16 2022] GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:16.629805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-91c29daa-1ad4-4a12-a492-e951d6eaf136 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:16.630975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-91c29daa-1ad4-4a12-a492-e951d6eaf136 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:16.639073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-91c29daa-1ad4-4a12-a492-e951d6eaf136 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:16.639943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-91c29daa-1ad4-4a12-a492-e951d6eaf136 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:16.641079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-91c29daa-1ad4-4a12-a492-e951d6eaf136 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:16.641774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-91c29daa-1ad4-4a12-a492-e951d6eaf136 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:16.985391 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-41c2e6ee-5eb3-462a-88f0-f84e36a95cfe tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:16.996553 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-41c2e6ee-5eb3-462a-88f0-f84e36a95cfe tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1524 microversion: 2.1 time: 1.531923 May 27 15:08:17.008820 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1428/2802] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:15 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1524 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:17.015063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-127768b4-9d47-4fff-9d87-df67806b76b8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:17.016530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-127768b4-9d47-4fff-9d87-df67806b76b8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:17.029673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-127768b4-9d47-4fff-9d87-df67806b76b8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:17.030472 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-127768b4-9d47-4fff-9d87-df67806b76b8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:17.035021 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-127768b4-9d47-4fff-9d87-df67806b76b8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:17.035673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-127768b4-9d47-4fff-9d87-df67806b76b8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:17.354023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-91c29daa-1ad4-4a12-a492-e951d6eaf136 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:17.379568 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-91c29daa-1ad4-4a12-a492-e951d6eaf136 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.748518 May 27 15:08:17.382673 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1375/2803] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:16 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:17.403964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f1c921e0-2aa9-43ef-904e-2ba28485f319 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:17.407831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f1c921e0-2aa9-43ef-904e-2ba28485f319 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:17.445283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1c921e0-2aa9-43ef-904e-2ba28485f319 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:17.451155 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1c921e0-2aa9-43ef-904e-2ba28485f319 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:17.457374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1c921e0-2aa9-43ef-904e-2ba28485f319 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:17.458049 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1c921e0-2aa9-43ef-904e-2ba28485f319 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:17.602262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f1c921e0-2aa9-43ef-904e-2ba28485f319 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:17.615824 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f1c921e0-2aa9-43ef-904e-2ba28485f319 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1269 microversion: 2.1 time: 0.229219 May 27 15:08:17.618935 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1376/2804] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:17 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1269 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:17.632439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1afaeb30-174e-4427-a828-d814d33f1d77 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:17.634460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1afaeb30-174e-4427-a828-d814d33f1d77 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:17.653214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1afaeb30-174e-4427-a828-d814d33f1d77 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:17.653414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-127768b4-9d47-4fff-9d87-df67806b76b8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:17.654162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1afaeb30-174e-4427-a828-d814d33f1d77 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:17.655381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1afaeb30-174e-4427-a828-d814d33f1d77 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:17.656051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1afaeb30-174e-4427-a828-d814d33f1d77 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:17.669094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-127768b4-9d47-4fff-9d87-df67806b76b8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:17.671159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-127768b4-9d47-4fff-9d87-df67806b76b8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:17.678768 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-127768b4-9d47-4fff-9d87-df67806b76b8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 2863 microversion: 2.32 time: 0.668564 May 27 15:08:17.679950 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1429/2805] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:17 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 2863 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:17.693442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2d4aa239-0f8c-4b36-8508-53941de87003 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:17.694483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2d4aa239-0f8c-4b36-8508-53941de87003 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:17.702329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2d4aa239-0f8c-4b36-8508-53941de87003 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:17.709765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2d4aa239-0f8c-4b36-8508-53941de87003 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:17.714182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2d4aa239-0f8c-4b36-8508-53941de87003 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:17.715745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2d4aa239-0f8c-4b36-8508-53941de87003 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:17.994426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1afaeb30-174e-4427-a828-d814d33f1d77 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:18.005518 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1afaeb30-174e-4427-a828-d814d33f1d77 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1514 microversion: 2.1 time: 0.384782 May 27 15:08:18.015173 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1377/2806] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:17 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1514 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:18.045074 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2d4aa239-0f8c-4b36-8508-53941de87003 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:18.056751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2d4aa239-0f8c-4b36-8508-53941de87003 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:18.059088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2d4aa239-0f8c-4b36-8508-53941de87003 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:18.061911 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2d4aa239-0f8c-4b36-8508-53941de87003 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 0.380290 May 27 15:08:18.063125 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1430/2807] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:17 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:18.068284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b3242a09-979d-4b7f-8db6-fb4005aed454 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc780614ca0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:18.133135 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b3242a09-979d-4b7f-8db6-fb4005aed454 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f" status: 200 len: 1427 microversion: 2.1 time: 0.068534 May 27 15:08:18.134347 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1431/2808] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:08:18 2022] GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f => generated 1427 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:18.139878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e822b075-e146-498e-a7ae-2edb46d4a996 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:18.140722 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e822b075-e146-498e-a7ae-2edb46d4a996 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:18.150859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e822b075-e146-498e-a7ae-2edb46d4a996 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:18.151558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e822b075-e146-498e-a7ae-2edb46d4a996 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:18.152735 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e822b075-e146-498e-a7ae-2edb46d4a996 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:18.153392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e822b075-e146-498e-a7ae-2edb46d4a996 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:18.332883 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-100e4ff7-3a6b-4591-a5e8-68166ede5af2 req-216a117f-e54b-4259-ad36-88d9a7007c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "name": "network-vif-deleted", "tag": "f82a5a42-f473-44b2-b255-6b333e4f281b"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:18.366786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-100e4ff7-3a6b-4591-a5e8-68166ede5af2 req-216a117f-e54b-4259-ad36-88d9a7007c42 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:18.369726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-100e4ff7-3a6b-4591-a5e8-68166ede5af2 req-216a117f-e54b-4259-ad36-88d9a7007c42 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:18.419327 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e822b075-e146-498e-a7ae-2edb46d4a996 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:18.424964 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-100e4ff7-3a6b-4591-a5e8-68166ede5af2 req-216a117f-e54b-4259-ad36-88d9a7007c42 service nova] Creating event network-vif-deleted:f82a5a42-f473-44b2-b255-6b333e4f281b for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:08:18.428640 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e822b075-e146-498e-a7ae-2edb46d4a996 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1524 microversion: 2.1 time: 0.292884 May 27 15:08:18.429437 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1432/2809] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:18 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1524 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:18.435460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bd9c626e-8ebe-49c6-9fbb-8925593e0a4f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:18.436092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bd9c626e-8ebe-49c6-9fbb-8925593e0a4f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:18.437475 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-100e4ff7-3a6b-4591-a5e8-68166ede5af2 req-216a117f-e54b-4259-ad36-88d9a7007c42 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.403164 May 27 15:08:18.438270 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1378/2810] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:18.443226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd9c626e-8ebe-49c6-9fbb-8925593e0a4f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:18.443743 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd9c626e-8ebe-49c6-9fbb-8925593e0a4f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:18.444813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd9c626e-8ebe-49c6-9fbb-8925593e0a4f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:18.445420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd9c626e-8ebe-49c6-9fbb-8925593e0a4f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:18.636859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6825bf47-3956-4575-be9c-86f52c25cb86 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:18.636859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6825bf47-3956-4575-be9c-86f52c25cb86 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:18.649792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6825bf47-3956-4575-be9c-86f52c25cb86 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:18.651446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6825bf47-3956-4575-be9c-86f52c25cb86 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:18.654703 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6825bf47-3956-4575-be9c-86f52c25cb86 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:18.656226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6825bf47-3956-4575-be9c-86f52c25cb86 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:18.738849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:19.055076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bd9c626e-8ebe-49c6-9fbb-8925593e0a4f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:19.071856 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bd9c626e-8ebe-49c6-9fbb-8925593e0a4f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.641147 May 27 15:08:19.073616 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1433/2811] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:18 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:19.081238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-10a6c1d8-3a76-4c8d-a9c8-41abf14a1a1b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:19.082809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-10a6c1d8-3a76-4c8d-a9c8-41abf14a1a1b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:19.094028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10a6c1d8-3a76-4c8d-a9c8-41abf14a1a1b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:19.095963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10a6c1d8-3a76-4c8d-a9c8-41abf14a1a1b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:19.098117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10a6c1d8-3a76-4c8d-a9c8-41abf14a1a1b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:19.098999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10a6c1d8-3a76-4c8d-a9c8-41abf14a1a1b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:19.326222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6825bf47-3956-4575-be9c-86f52c25cb86 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:19.344967 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6825bf47-3956-4575-be9c-86f52c25cb86 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1311 microversion: 2.1 time: 0.714075 May 27 15:08:19.345944 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1379/2812] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:18 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1311 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:19.372793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-b0cc7349-3f3e-413b-a57c-fabaca5a400d req-094c7c3b-9314-4f1c-81d8-57fa02c7df96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "name": "network-vif-unplugged", "status": "completed", "tag": "ffdb865a-7004-4d4e-afa6-d0613ac33132"}, {"server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "name": "network-vif-unplugged", "status": "completed", "tag": "48a86e26-7a18-41f0-bb5d-f642d2334344"}, {"server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "name": "network-vif-unplugged", "status": "completed", "tag": "56ba96ed-73b1-4ad8-ad61-f82b64af6976"}, {"server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "name": "network-vif-unplugged", "status": "completed", "tag": "f318c091-0a24-4179-812b-dc1ec5baf655"}, {"server_uuid": "d9604d14-4598-4d42-8bbf-8763103061a4", "name": "network-vif-plugged", "status": "completed", "tag": "648e11b1-5568-4d40-a6cd-7e3f346ef13b"}, {"server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "name": "network-vif-unplugged", "status": "completed", "tag": "f82a5a42-f473-44b2-b255-6b333e4f281b"}, {"server_uuid": "3d17a653-7f3e-44d7-9b89-68b4b35c9175", "name": "network-vif-plugged", "status": "completed", "tag": "f12487eb-11c2-4e49-877b-4fd161db40aa"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:19.404241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b0cc7349-3f3e-413b-a57c-fabaca5a400d req-094c7c3b-9314-4f1c-81d8-57fa02c7df96 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:19.406103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b0cc7349-3f3e-413b-a57c-fabaca5a400d req-094c7c3b-9314-4f1c-81d8-57fa02c7df96 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:19.438739 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-b0cc7349-3f3e-413b-a57c-fabaca5a400d req-094c7c3b-9314-4f1c-81d8-57fa02c7df96 service nova] Creating event network-vif-unplugged:ffdb865a-7004-4d4e-afa6-d0613ac33132 for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:08:19.444621 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-b0cc7349-3f3e-413b-a57c-fabaca5a400d req-094c7c3b-9314-4f1c-81d8-57fa02c7df96 service nova] Creating event network-vif-unplugged:48a86e26-7a18-41f0-bb5d-f642d2334344 for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:08:19.448321 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-b0cc7349-3f3e-413b-a57c-fabaca5a400d req-094c7c3b-9314-4f1c-81d8-57fa02c7df96 service nova] Creating event network-vif-unplugged:56ba96ed-73b1-4ad8-ad61-f82b64af6976 for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:08:19.448321 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-b0cc7349-3f3e-413b-a57c-fabaca5a400d req-094c7c3b-9314-4f1c-81d8-57fa02c7df96 service nova] Creating event network-vif-unplugged:f318c091-0a24-4179-812b-dc1ec5baf655 for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:08:19.453313 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-b0cc7349-3f3e-413b-a57c-fabaca5a400d req-094c7c3b-9314-4f1c-81d8-57fa02c7df96 service nova] Creating event network-vif-plugged:648e11b1-5568-4d40-a6cd-7e3f346ef13b for instance d9604d14-4598-4d42-8bbf-8763103061a4 on n-h1-843621-1 May 27 15:08:19.454109 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-b0cc7349-3f3e-413b-a57c-fabaca5a400d req-094c7c3b-9314-4f1c-81d8-57fa02c7df96 service nova] Creating event network-vif-unplugged:f82a5a42-f473-44b2-b255-6b333e4f281b for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:08:19.454587 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-b0cc7349-3f3e-413b-a57c-fabaca5a400d req-094c7c3b-9314-4f1c-81d8-57fa02c7df96 service nova] Creating event network-vif-plugged:f12487eb-11c2-4e49-877b-4fd161db40aa for instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 on n-h2-843621-1 May 27 15:08:19.485845 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-b0cc7349-3f3e-413b-a57c-fabaca5a400d req-094c7c3b-9314-4f1c-81d8-57fa02c7df96 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1219 microversion: 2.1 time: 0.138178 May 27 15:08:19.487080 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1380/2813] 10.222.0.13 () {64 vars in 1318 bytes} [Fri May 27 15:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:19.493632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-97706d9d-eeb2-4606-9d47-2aba1793fac9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:19.494655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-97706d9d-eeb2-4606-9d47-2aba1793fac9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:19.502362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-97706d9d-eeb2-4606-9d47-2aba1793fac9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:19.503286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-97706d9d-eeb2-4606-9d47-2aba1793fac9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:19.504303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-97706d9d-eeb2-4606-9d47-2aba1793fac9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:19.504985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-97706d9d-eeb2-4606-9d47-2aba1793fac9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:19.708114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-10a6c1d8-3a76-4c8d-a9c8-41abf14a1a1b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:19.730025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-10a6c1d8-3a76-4c8d-a9c8-41abf14a1a1b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:19.736144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-10a6c1d8-3a76-4c8d-a9c8-41abf14a1a1b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:19.740368 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-10a6c1d8-3a76-4c8d-a9c8-41abf14a1a1b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 2750 microversion: 2.32 time: 0.663371 May 27 15:08:19.743771 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1434/2814] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:19 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 2750 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:19.753016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ff937e2a-dd54-43ef-8c67-6c789b88ab87 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:19.753886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ff937e2a-dd54-43ef-8c67-6c789b88ab87 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:19.762568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff937e2a-dd54-43ef-8c67-6c789b88ab87 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:19.764163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff937e2a-dd54-43ef-8c67-6c789b88ab87 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:19.766224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff937e2a-dd54-43ef-8c67-6c789b88ab87 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:19.766948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff937e2a-dd54-43ef-8c67-6c789b88ab87 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:20.200810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-97706d9d-eeb2-4606-9d47-2aba1793fac9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:20.248636 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-97706d9d-eeb2-4606-9d47-2aba1793fac9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1520 microversion: 2.1 time: 0.759970 May 27 15:08:20.255677 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1381/2815] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:19 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1520 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:20.272541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1e0453a8-d9e8-443e-b491-9343bfcaa893 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776b96f70>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:20.361832 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1e0453a8-d9e8-443e-b491-9343bfcaa893 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f" status: 200 len: 1427 microversion: 2.1 time: 0.104109 May 27 15:08:20.365763 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1382/2816] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:08:20 2022] GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f => generated 1427 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:20.373057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a10357e1-6f3f-44e0-9f0e-bac5b3113a9a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:20.378726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a10357e1-6f3f-44e0-9f0e-bac5b3113a9a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:20.392009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a10357e1-6f3f-44e0-9f0e-bac5b3113a9a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:20.392805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a10357e1-6f3f-44e0-9f0e-bac5b3113a9a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:20.393954 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a10357e1-6f3f-44e0-9f0e-bac5b3113a9a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:20.394767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a10357e1-6f3f-44e0-9f0e-bac5b3113a9a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:20.565761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ff937e2a-dd54-43ef-8c67-6c789b88ab87 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:20.575501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ff937e2a-dd54-43ef-8c67-6c789b88ab87 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:20.583671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ff937e2a-dd54-43ef-8c67-6c789b88ab87 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:20.592549 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ff937e2a-dd54-43ef-8c67-6c789b88ab87 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 0.839654 May 27 15:08:20.594824 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1435/2817] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:19 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:20.606303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-f068ecb6-8d52-4ddf-9bab-ac290f8ddc67 req-d6caef7e-d54a-4f3a-830c-6f5997356acd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec", "tag": "9adf6904-8e68-481c-93de-21a8ad9c0eed"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:20.624698 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-f068ecb6-8d52-4ddf-9bab-ac290f8ddc67 req-d6caef7e-d54a-4f3a-830c-6f5997356acd service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:20.630794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-f068ecb6-8d52-4ddf-9bab-ac290f8ddc67 req-d6caef7e-d54a-4f3a-830c-6f5997356acd service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:20.660126 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-f068ecb6-8d52-4ddf-9bab-ac290f8ddc67 req-d6caef7e-d54a-4f3a-830c-6f5997356acd service nova] Creating event network-changed:9adf6904-8e68-481c-93de-21a8ad9c0eed for instance ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec on n-h2-843621-1 May 27 15:08:20.666338 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-f068ecb6-8d52-4ddf-9bab-ac290f8ddc67 req-d6caef7e-d54a-4f3a-830c-6f5997356acd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069739 May 27 15:08:20.668128 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1436/2818] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:20.680404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-21153876-13b7-4260-ac53-38d0e459bc16 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:20.682586 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-21153876-13b7-4260-ac53-38d0e459bc16 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:20.701728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21153876-13b7-4260-ac53-38d0e459bc16 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:20.702449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21153876-13b7-4260-ac53-38d0e459bc16 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:20.703440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21153876-13b7-4260-ac53-38d0e459bc16 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:20.704057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21153876-13b7-4260-ac53-38d0e459bc16 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:20.976524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a10357e1-6f3f-44e0-9f0e-bac5b3113a9a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:20.998611 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a10357e1-6f3f-44e0-9f0e-bac5b3113a9a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1524 microversion: 2.1 time: 0.631192 May 27 15:08:20.999463 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1383/2819] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:20 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1524 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:21.012799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fb93a544-5b17-4ebb-be9e-88a0fb46e38f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:21.016429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fb93a544-5b17-4ebb-be9e-88a0fb46e38f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:21.036112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb93a544-5b17-4ebb-be9e-88a0fb46e38f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:21.042679 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb93a544-5b17-4ebb-be9e-88a0fb46e38f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:21.043822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb93a544-5b17-4ebb-be9e-88a0fb46e38f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:21.044437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb93a544-5b17-4ebb-be9e-88a0fb46e38f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:21.305707 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-21153876-13b7-4260-ac53-38d0e459bc16 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:21.316538 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-21153876-13b7-4260-ac53-38d0e459bc16 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.644867 May 27 15:08:21.331198 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1437/2820] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:20 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:21.343136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-18949291-cafa-4db0-933f-5a9a8bb3125b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:21.344537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-18949291-cafa-4db0-933f-5a9a8bb3125b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:21.414607 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18949291-cafa-4db0-933f-5a9a8bb3125b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:21.432959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18949291-cafa-4db0-933f-5a9a8bb3125b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:21.437459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18949291-cafa-4db0-933f-5a9a8bb3125b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:21.437947 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18949291-cafa-4db0-933f-5a9a8bb3125b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:21.456243 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:22.339080 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fb93a544-5b17-4ebb-be9e-88a0fb46e38f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:22.351401 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fb93a544-5b17-4ebb-be9e-88a0fb46e38f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1311 microversion: 2.1 time: 1.347889 May 27 15:08:22.354298 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1384/2821] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:20 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1311 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:22.365973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-6d014b66-ab10-4f8b-bb88-705fc63c9293 req-50334682-8934-4634-b735-ce339ff74bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "name": "network-vif-deleted", "tag": "ffdb865a-7004-4d4e-afa6-d0613ac33132"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:22.412936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6d014b66-ab10-4f8b-bb88-705fc63c9293 req-50334682-8934-4634-b735-ce339ff74bbf service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:22.414061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6d014b66-ab10-4f8b-bb88-705fc63c9293 req-50334682-8934-4634-b735-ce339ff74bbf service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:22.445706 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-6d014b66-ab10-4f8b-bb88-705fc63c9293 req-50334682-8934-4634-b735-ce339ff74bbf service nova] Creating event network-vif-deleted:ffdb865a-7004-4d4e-afa6-d0613ac33132 for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:08:22.461171 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-6d014b66-ab10-4f8b-bb88-705fc63c9293 req-50334682-8934-4634-b735-ce339ff74bbf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098578 May 27 15:08:22.464127 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1385/2822] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:22.475751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e85975a3-8e8a-458f-ad31-1fd9e159e5e2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:22.483379 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e85975a3-8e8a-458f-ad31-1fd9e159e5e2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:22.533050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e85975a3-8e8a-458f-ad31-1fd9e159e5e2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:22.537641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e85975a3-8e8a-458f-ad31-1fd9e159e5e2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:22.538627 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e85975a3-8e8a-458f-ad31-1fd9e159e5e2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:22.545261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e85975a3-8e8a-458f-ad31-1fd9e159e5e2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:22.778771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-18949291-cafa-4db0-933f-5a9a8bb3125b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:22.807192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-18949291-cafa-4db0-933f-5a9a8bb3125b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:22.809150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-18949291-cafa-4db0-933f-5a9a8bb3125b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:22.826368 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-18949291-cafa-4db0-933f-5a9a8bb3125b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 2704 microversion: 2.32 time: 1.503260 May 27 15:08:22.827292 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1438/2823] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:21 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 2704 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:22.832258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-247a295e-e2d8-4487-853c-2a9515ad35e2 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc780732310>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:23.487086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e85975a3-8e8a-458f-ad31-1fd9e159e5e2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:23.507602 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e85975a3-8e8a-458f-ad31-1fd9e159e5e2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1520 microversion: 2.1 time: 1.040922 May 27 15:08:23.515577 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1386/2824] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:22 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1520 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:23.537014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bd1973f3-e229-47ca-a3fb-56bcf7cbeb0b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:23.538801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bd1973f3-e229-47ca-a3fb-56bcf7cbeb0b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:23.566495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd1973f3-e229-47ca-a3fb-56bcf7cbeb0b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:23.567502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd1973f3-e229-47ca-a3fb-56bcf7cbeb0b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:23.568411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd1973f3-e229-47ca-a3fb-56bcf7cbeb0b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:23.569104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd1973f3-e229-47ca-a3fb-56bcf7cbeb0b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:23.793749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:23.833564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:24.119556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bd1973f3-e229-47ca-a3fb-56bcf7cbeb0b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:24.130757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bd1973f3-e229-47ca-a3fb-56bcf7cbeb0b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:24.137825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bd1973f3-e229-47ca-a3fb-56bcf7cbeb0b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:24.139657 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bd1973f3-e229-47ca-a3fb-56bcf7cbeb0b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 0.622396 May 27 15:08:24.140821 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1387/2825] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:23 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:24.146315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fdd4823c-5363-4feb-9a57-dc7a00bcbbef tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:24.147241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fdd4823c-5363-4feb-9a57-dc7a00bcbbef tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:24.173996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fdd4823c-5363-4feb-9a57-dc7a00bcbbef tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:24.174918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fdd4823c-5363-4feb-9a57-dc7a00bcbbef tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:24.176294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fdd4823c-5363-4feb-9a57-dc7a00bcbbef tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:24.178077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fdd4823c-5363-4feb-9a57-dc7a00bcbbef tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:25.031146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fdd4823c-5363-4feb-9a57-dc7a00bcbbef tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:25.059236 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fdd4823c-5363-4feb-9a57-dc7a00bcbbef tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1524 microversion: 2.1 time: 0.917028 May 27 15:08:25.065107 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1388/2826] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:24 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1524 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:25.081031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bd50de3a-00d7-4279-abfc-d41104ec8c3f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:25.085424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bd50de3a-00d7-4279-abfc-d41104ec8c3f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:25.113367 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd50de3a-00d7-4279-abfc-d41104ec8c3f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:25.113836 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd50de3a-00d7-4279-abfc-d41104ec8c3f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:25.114647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd50de3a-00d7-4279-abfc-d41104ec8c3f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:25.115102 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd50de3a-00d7-4279-abfc-d41104ec8c3f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:25.529392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bd50de3a-00d7-4279-abfc-d41104ec8c3f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:25.541265 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bd50de3a-00d7-4279-abfc-d41104ec8c3f tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.465046 May 27 15:08:25.545940 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1389/2827] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:25 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:25.562744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-98828cc8-a1b0-4877-bfbd-39cf3c54f9a1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:25.564108 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-98828cc8-a1b0-4877-bfbd-39cf3c54f9a1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:25.587200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98828cc8-a1b0-4877-bfbd-39cf3c54f9a1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:25.589319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98828cc8-a1b0-4877-bfbd-39cf3c54f9a1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:25.590899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98828cc8-a1b0-4877-bfbd-39cf3c54f9a1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:25.592065 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98828cc8-a1b0-4877-bfbd-39cf3c54f9a1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:25.956561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-98828cc8-a1b0-4877-bfbd-39cf3c54f9a1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:25.969922 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-98828cc8-a1b0-4877-bfbd-39cf3c54f9a1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1311 microversion: 2.1 time: 0.419798 May 27 15:08:25.971750 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1390/2828] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:25 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1311 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:25.984602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aa82f9d6-54cf-4334-b977-cfcfb0a473e6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:25.986845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-aa82f9d6-54cf-4334-b977-cfcfb0a473e6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:26.004867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa82f9d6-54cf-4334-b977-cfcfb0a473e6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:26.005961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa82f9d6-54cf-4334-b977-cfcfb0a473e6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:26.008614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa82f9d6-54cf-4334-b977-cfcfb0a473e6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:26.010397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa82f9d6-54cf-4334-b977-cfcfb0a473e6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:26.334247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-aa82f9d6-54cf-4334-b977-cfcfb0a473e6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:26.357488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-aa82f9d6-54cf-4334-b977-cfcfb0a473e6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:26.369923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-aa82f9d6-54cf-4334-b977-cfcfb0a473e6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:26.374949 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-aa82f9d6-54cf-4334-b977-cfcfb0a473e6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 2544 microversion: 2.32 time: 0.398676 May 27 15:08:26.378004 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1391/2829] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:25 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 2544 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:26.396038 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bedad3df-e089-40ec-ae0c-f41a72e46745 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:26.396984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bedad3df-e089-40ec-ae0c-f41a72e46745 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:26.414720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bedad3df-e089-40ec-ae0c-f41a72e46745 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:26.420783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bedad3df-e089-40ec-ae0c-f41a72e46745 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:26.421921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bedad3df-e089-40ec-ae0c-f41a72e46745 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:26.433796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bedad3df-e089-40ec-ae0c-f41a72e46745 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:27.589596 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bedad3df-e089-40ec-ae0c-f41a72e46745 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:27.616859 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bedad3df-e089-40ec-ae0c-f41a72e46745 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1520 microversion: 2.1 time: 1.237271 May 27 15:08:27.623583 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1392/2830] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:26 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1520 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:27.645417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-b9b14bc1-ec5b-483b-a3cf-7d35b97217a4 req-e7884ba0-04b5-4853-92be-36a570c3452f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "name": "network-vif-deleted", "tag": "56ba96ed-73b1-4ad8-ad61-f82b64af6976"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:27.679472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b9b14bc1-ec5b-483b-a3cf-7d35b97217a4 req-e7884ba0-04b5-4853-92be-36a570c3452f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:27.681538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b9b14bc1-ec5b-483b-a3cf-7d35b97217a4 req-e7884ba0-04b5-4853-92be-36a570c3452f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:27.729234 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-b9b14bc1-ec5b-483b-a3cf-7d35b97217a4 req-e7884ba0-04b5-4853-92be-36a570c3452f service nova] Creating event network-vif-deleted:56ba96ed-73b1-4ad8-ad61-f82b64af6976 for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:08:27.738860 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-b9b14bc1-ec5b-483b-a3cf-7d35b97217a4 req-e7884ba0-04b5-4853-92be-36a570c3452f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109525 May 27 15:08:27.740043 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1393/2831] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:27.750517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-d5c9ce3a-63ad-417a-88bb-2a2bb504ce4c req-4257ae1a-2b3c-4834-bdf7-2e0cc81bd138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a59f3b5-daec-44ac-886e-2112ff3c8675", "name": "network-vif-plugged", "status": "completed", "tag": "920f6fd6-e492-42be-9e9e-e76c839e5b92"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:27.760012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d5c9ce3a-63ad-417a-88bb-2a2bb504ce4c req-4257ae1a-2b3c-4834-bdf7-2e0cc81bd138 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:27.760880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d5c9ce3a-63ad-417a-88bb-2a2bb504ce4c req-4257ae1a-2b3c-4834-bdf7-2e0cc81bd138 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:27.809348 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-d5c9ce3a-63ad-417a-88bb-2a2bb504ce4c req-4257ae1a-2b3c-4834-bdf7-2e0cc81bd138 service nova] Creating event network-vif-plugged:920f6fd6-e492-42be-9e9e-e76c839e5b92 for instance 7a59f3b5-daec-44ac-886e-2112ff3c8675 on n-h2-843621-1 May 27 15:08:27.828039 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-d5c9ce3a-63ad-417a-88bb-2a2bb504ce4c req-4257ae1a-2b3c-4834-bdf7-2e0cc81bd138 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086231 May 27 15:08:27.835611 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1394/2832] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:27.848602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-11f421bd-0029-4ce9-a7af-79e04802a11b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:27.853114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-11f421bd-0029-4ce9-a7af-79e04802a11b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:27.869348 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11f421bd-0029-4ce9-a7af-79e04802a11b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:27.872382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11f421bd-0029-4ce9-a7af-79e04802a11b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:27.875623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11f421bd-0029-4ce9-a7af-79e04802a11b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:27.879353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11f421bd-0029-4ce9-a7af-79e04802a11b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:28.387844 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-11f421bd-0029-4ce9-a7af-79e04802a11b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:28.401723 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-11f421bd-0029-4ce9-a7af-79e04802a11b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:28.405448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-11f421bd-0029-4ce9-a7af-79e04802a11b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:28.410183 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-11f421bd-0029-4ce9-a7af-79e04802a11b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 0.569173 May 27 15:08:28.414334 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1395/2833] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:27 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:28.426369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3504da5c-11fb-4f8b-8e01-ebc92e36b70a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:28.427238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3504da5c-11fb-4f8b-8e01-ebc92e36b70a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:28.440129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:28.451122 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3504da5c-11fb-4f8b-8e01-ebc92e36b70a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:28.451886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3504da5c-11fb-4f8b-8e01-ebc92e36b70a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:28.454517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3504da5c-11fb-4f8b-8e01-ebc92e36b70a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:28.457151 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3504da5c-11fb-4f8b-8e01-ebc92e36b70a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:29.031553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3504da5c-11fb-4f8b-8e01-ebc92e36b70a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:29.044057 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3504da5c-11fb-4f8b-8e01-ebc92e36b70a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1524 microversion: 2.1 time: 0.628333 May 27 15:08:29.047739 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1396/2834] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:28 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1524 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:29.071171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-933296a1-56f7-4460-b582-223d678e59b9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:29.072744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-933296a1-56f7-4460-b582-223d678e59b9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:29.080373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-933296a1-56f7-4460-b582-223d678e59b9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:29.081098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-933296a1-56f7-4460-b582-223d678e59b9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:29.082242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-933296a1-56f7-4460-b582-223d678e59b9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:29.082889 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-933296a1-56f7-4460-b582-223d678e59b9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:29.624487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-933296a1-56f7-4460-b582-223d678e59b9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:29.690406 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-933296a1-56f7-4460-b582-223d678e59b9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.616302 May 27 15:08:29.691106 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1397/2835] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:29 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:29.714258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8b15180f-5311-4230-8c15-eb099b45a96b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:29.715518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8b15180f-5311-4230-8c15-eb099b45a96b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:29.738252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b15180f-5311-4230-8c15-eb099b45a96b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:29.738923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b15180f-5311-4230-8c15-eb099b45a96b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:29.748146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b15180f-5311-4230-8c15-eb099b45a96b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:29.748656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b15180f-5311-4230-8c15-eb099b45a96b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:30.306378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8b15180f-5311-4230-8c15-eb099b45a96b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:30.316448 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8b15180f-5311-4230-8c15-eb099b45a96b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1311 microversion: 2.1 time: 0.612283 May 27 15:08:30.334396 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1398/2836] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:29 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1311 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:30.338019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-24aab81a-59c5-4474-b316-529f0371a25c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:30.338659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-24aab81a-59c5-4474-b316-529f0371a25c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:30.361817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-24aab81a-59c5-4474-b316-529f0371a25c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:30.364463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-24aab81a-59c5-4474-b316-529f0371a25c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:30.365609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-24aab81a-59c5-4474-b316-529f0371a25c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:30.365824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-24aab81a-59c5-4474-b316-529f0371a25c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:30.711819 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-24aab81a-59c5-4474-b316-529f0371a25c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:30.715972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:30.746208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-24aab81a-59c5-4474-b316-529f0371a25c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:30.747928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-24aab81a-59c5-4474-b316-529f0371a25c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:30.760394 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-24aab81a-59c5-4474-b316-529f0371a25c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 2317 microversion: 2.32 time: 0.415067 May 27 15:08:30.764550 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1399/2837] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:30 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 2317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:30.794731 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bba6adc5-9f3e-470e-a291-3b15aa43b75e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:30.795506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bba6adc5-9f3e-470e-a291-3b15aa43b75e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:30.822778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bba6adc5-9f3e-470e-a291-3b15aa43b75e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:30.823247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bba6adc5-9f3e-470e-a291-3b15aa43b75e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:30.824643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bba6adc5-9f3e-470e-a291-3b15aa43b75e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:30.825149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bba6adc5-9f3e-470e-a291-3b15aa43b75e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:31.296614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bba6adc5-9f3e-470e-a291-3b15aa43b75e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:31.307610 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bba6adc5-9f3e-470e-a291-3b15aa43b75e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1505 microversion: 2.1 time: 0.540719 May 27 15:08:31.317870 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1400/2838] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:30 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1505 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:31.347537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d9952e31-4168-415a-9afe-7df401120d13 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:31.365812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d9952e31-4168-415a-9afe-7df401120d13 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:31.398410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9952e31-4168-415a-9afe-7df401120d13 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:31.400212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9952e31-4168-415a-9afe-7df401120d13 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:31.401304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9952e31-4168-415a-9afe-7df401120d13 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:31.404981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9952e31-4168-415a-9afe-7df401120d13 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:31.413187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:31.673066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d9952e31-4168-415a-9afe-7df401120d13 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:31.683647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d9952e31-4168-415a-9afe-7df401120d13 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:31.693933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d9952e31-4168-415a-9afe-7df401120d13 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:31.695460 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d9952e31-4168-415a-9afe-7df401120d13 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 0.376464 May 27 15:08:31.703102 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1401/2839] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:31 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:31.720196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-d2d6c799-408e-451c-9f90-56b50b023fed req-51a95b6d-afb7-4b53-bb8a-e07cbd0743fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "name": "network-vif-deleted", "tag": "48a86e26-7a18-41f0-bb5d-f642d2334344"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:31.741956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d2d6c799-408e-451c-9f90-56b50b023fed req-51a95b6d-afb7-4b53-bb8a-e07cbd0743fe service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:31.742937 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d2d6c799-408e-451c-9f90-56b50b023fed req-51a95b6d-afb7-4b53-bb8a-e07cbd0743fe service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:31.763443 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-d2d6c799-408e-451c-9f90-56b50b023fed req-51a95b6d-afb7-4b53-bb8a-e07cbd0743fe service nova] Creating event network-vif-deleted:48a86e26-7a18-41f0-bb5d-f642d2334344 for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:08:31.781206 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-d2d6c799-408e-451c-9f90-56b50b023fed req-51a95b6d-afb7-4b53-bb8a-e07cbd0743fe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068159 May 27 15:08:31.785289 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1402/2840] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:31.797929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-948e20de-f3e8-46e4-8ab7-6221fe02b818 req-51c0af5f-407c-4adb-be7b-478718a19ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec", "name": "network-vif-plugged", "status": "completed", "tag": "9adf6904-8e68-481c-93de-21a8ad9c0eed"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:31.811281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-948e20de-f3e8-46e4-8ab7-6221fe02b818 req-51c0af5f-407c-4adb-be7b-478718a19ef9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:31.811988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-948e20de-f3e8-46e4-8ab7-6221fe02b818 req-51c0af5f-407c-4adb-be7b-478718a19ef9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:31.824179 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-948e20de-f3e8-46e4-8ab7-6221fe02b818 req-51c0af5f-407c-4adb-be7b-478718a19ef9 service nova] Creating event network-vif-plugged:9adf6904-8e68-481c-93de-21a8ad9c0eed for instance ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec on n-h2-843621-1 May 27 15:08:31.830364 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-948e20de-f3e8-46e4-8ab7-6221fe02b818 req-51c0af5f-407c-4adb-be7b-478718a19ef9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043791 May 27 15:08:31.833191 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1403/2841] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:31.847365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-db611efe-0680-470a-8f02-eafffacce242 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:31.849924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-db611efe-0680-470a-8f02-eafffacce242 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:31.866613 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db611efe-0680-470a-8f02-eafffacce242 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:31.867611 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db611efe-0680-470a-8f02-eafffacce242 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:31.868571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db611efe-0680-470a-8f02-eafffacce242 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:31.871771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db611efe-0680-470a-8f02-eafffacce242 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:32.395302 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-db611efe-0680-470a-8f02-eafffacce242 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:32.403226 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-db611efe-0680-470a-8f02-eafffacce242 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1524 microversion: 2.1 time: 0.566211 May 27 15:08:32.403823 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1404/2842] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:31 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1524 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:32.425599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-062368fa-0792-40fa-8bc2-bc3ff3e12ec4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:32.426244 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-062368fa-0792-40fa-8bc2-bc3ff3e12ec4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:32.458214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-062368fa-0792-40fa-8bc2-bc3ff3e12ec4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:32.458455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-062368fa-0792-40fa-8bc2-bc3ff3e12ec4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:32.471116 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-062368fa-0792-40fa-8bc2-bc3ff3e12ec4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:32.471974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-062368fa-0792-40fa-8bc2-bc3ff3e12ec4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:32.797254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:32.818077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-062368fa-0792-40fa-8bc2-bc3ff3e12ec4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:32.826999 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-062368fa-0792-40fa-8bc2-bc3ff3e12ec4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.422062 May 27 15:08:32.845160 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1405/2843] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:32 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:32.859391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-66bc0657-faad-4363-a25b-486122c5bf3a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:32.861018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-66bc0657-faad-4363-a25b-486122c5bf3a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:32.882095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66bc0657-faad-4363-a25b-486122c5bf3a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:32.882621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66bc0657-faad-4363-a25b-486122c5bf3a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:32.883533 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66bc0657-faad-4363-a25b-486122c5bf3a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:32.884149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66bc0657-faad-4363-a25b-486122c5bf3a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:33.178621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-66bc0657-faad-4363-a25b-486122c5bf3a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:33.193196 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-66bc0657-faad-4363-a25b-486122c5bf3a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 200 len: 1505 microversion: 2.1 time: 0.342248 May 27 15:08:33.194144 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1406/2844] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:32 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 1505 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:33.199931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-808ce933-4e06-4cdb-8004-99f1aac7b3e8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:33.206228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-808ce933-4e06-4cdb-8004-99f1aac7b3e8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:33.213569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-808ce933-4e06-4cdb-8004-99f1aac7b3e8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:33.214533 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-808ce933-4e06-4cdb-8004-99f1aac7b3e8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:33.215592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-808ce933-4e06-4cdb-8004-99f1aac7b3e8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:33.216271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-808ce933-4e06-4cdb-8004-99f1aac7b3e8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:33.795394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-808ce933-4e06-4cdb-8004-99f1aac7b3e8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:33.809767 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-808ce933-4e06-4cdb-8004-99f1aac7b3e8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1311 microversion: 2.1 time: 0.614006 May 27 15:08:33.814395 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1407/2845] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:33 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1311 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:33.820800 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a1225b13-0876-4f4f-9e8a-484853842fe3 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:33.821431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a1225b13-0876-4f4f-9e8a-484853842fe3 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:33.851571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1225b13-0876-4f4f-9e8a-484853842fe3 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:33.851571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1225b13-0876-4f4f-9e8a-484853842fe3 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:33.852813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1225b13-0876-4f4f-9e8a-484853842fe3 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:33.854219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1225b13-0876-4f4f-9e8a-484853842fe3 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:34.083031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a1225b13-0876-4f4f-9e8a-484853842fe3 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:34.099154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a1225b13-0876-4f4f-9e8a-484853842fe3 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:34.102424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a1225b13-0876-4f4f-9e8a-484853842fe3 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:34.113847 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a1225b13-0876-4f4f-9e8a-484853842fe3 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.291106 May 27 15:08:34.124884 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1408/2846] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:33 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:34.129196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-747350f1-08a3-42d6-b119-6247d3e46548 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:34.129832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-747350f1-08a3-42d6-b119-6247d3e46548 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:34.142212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-747350f1-08a3-42d6-b119-6247d3e46548 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:34.145176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-747350f1-08a3-42d6-b119-6247d3e46548 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:34.146076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-747350f1-08a3-42d6-b119-6247d3e46548 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:34.149162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-747350f1-08a3-42d6-b119-6247d3e46548 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:34.721713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-747350f1-08a3-42d6-b119-6247d3e46548 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:34.736271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-747350f1-08a3-42d6-b119-6247d3e46548 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:34.745310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-747350f1-08a3-42d6-b119-6247d3e46548 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:34.747457 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-747350f1-08a3-42d6-b119-6247d3e46548 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 0.630074 May 27 15:08:34.753098 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1409/2847] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:34 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:34.759514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3b4da8b4-f499-45fe-b5bc-ffa035e5c76f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:34.760413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3b4da8b4-f499-45fe-b5bc-ffa035e5c76f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:34.780444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b4da8b4-f499-45fe-b5bc-ffa035e5c76f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:34.781036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b4da8b4-f499-45fe-b5bc-ffa035e5c76f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:34.781962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b4da8b4-f499-45fe-b5bc-ffa035e5c76f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:34.782437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b4da8b4-f499-45fe-b5bc-ffa035e5c76f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:34.852812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3b4da8b4-f499-45fe-b5bc-ffa035e5c76f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:08:35.059641 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3b4da8b4-f499-45fe-b5bc-ffa035e5c76f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 204 len: 0 microversion: 2.1 time: 0.302689 May 27 15:08:35.067134 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1410/2848] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:08:34 2022] DELETE /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:08:35.081090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3fa7a547-836b-42f0-b3c1-89d43f42bcc6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:35.094101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3fa7a547-836b-42f0-b3c1-89d43f42bcc6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:35.130168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fa7a547-836b-42f0-b3c1-89d43f42bcc6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:35.132502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fa7a547-836b-42f0-b3c1-89d43f42bcc6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:35.136362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fa7a547-836b-42f0-b3c1-89d43f42bcc6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:35.143234 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fa7a547-836b-42f0-b3c1-89d43f42bcc6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:35.491542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3fa7a547-836b-42f0-b3c1-89d43f42bcc6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:35.500865 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3fa7a547-836b-42f0-b3c1-89d43f42bcc6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1524 microversion: 2.1 time: 0.435447 May 27 15:08:35.504279 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1411/2849] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:35 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1524 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:35.508550 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-6fbde7a2-8039-4e20-88a8-a7c3749e98b8 req-94b731c8-0d71-47fe-885f-ade054bfac57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "257d655d-41a5-4a06-a70e-36c3b813d2ae", "name": "network-vif-deleted", "tag": "f318c091-0a24-4179-812b-dc1ec5baf655"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:35.535268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6fbde7a2-8039-4e20-88a8-a7c3749e98b8 req-94b731c8-0d71-47fe-885f-ade054bfac57 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:35.535268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6fbde7a2-8039-4e20-88a8-a7c3749e98b8 req-94b731c8-0d71-47fe-885f-ade054bfac57 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:35.556077 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-6fbde7a2-8039-4e20-88a8-a7c3749e98b8 req-94b731c8-0d71-47fe-885f-ade054bfac57 service nova] Creating event network-vif-deleted:f318c091-0a24-4179-812b-dc1ec5baf655 for instance 257d655d-41a5-4a06-a70e-36c3b813d2ae on n-h2-843621-1 May 27 15:08:35.562455 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-6fbde7a2-8039-4e20-88a8-a7c3749e98b8 req-94b731c8-0d71-47fe-885f-ade054bfac57 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057662 May 27 15:08:35.563595 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1412/2850] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:35.569470 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ea492530-c653-4a02-a6d8-9a8983db97c8 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:35.570508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ea492530-c653-4a02-a6d8-9a8983db97c8 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:35.591068 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea492530-c653-4a02-a6d8-9a8983db97c8 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:35.593186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea492530-c653-4a02-a6d8-9a8983db97c8 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:35.595832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea492530-c653-4a02-a6d8-9a8983db97c8 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:35.596416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea492530-c653-4a02-a6d8-9a8983db97c8 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:35.922551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ea492530-c653-4a02-a6d8-9a8983db97c8 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:35.931374 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ea492530-c653-4a02-a6d8-9a8983db97c8 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.366385 May 27 15:08:35.933041 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1413/2851] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:35 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:35.938274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d753fe87-061d-45b6-8b30-334b350a8258 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:35.938904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d753fe87-061d-45b6-8b30-334b350a8258 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:35.945871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d753fe87-061d-45b6-8b30-334b350a8258 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:35.946330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d753fe87-061d-45b6-8b30-334b350a8258 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:35.947117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d753fe87-061d-45b6-8b30-334b350a8258 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:35.947565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d753fe87-061d-45b6-8b30-334b350a8258 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:36.163755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d753fe87-061d-45b6-8b30-334b350a8258 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:36.175085 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d753fe87-061d-45b6-8b30-334b350a8258 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1494 microversion: 2.1 time: 0.240458 May 27 15:08:36.178349 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1414/2852] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:35 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1494 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:36.195993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9188b997-9b09-444c-823b-b822920105c2 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:36.198212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9188b997-9b09-444c-823b-b822920105c2 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:36.225615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9188b997-9b09-444c-823b-b822920105c2 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:36.226374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9188b997-9b09-444c-823b-b822920105c2 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:36.228909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9188b997-9b09-444c-823b-b822920105c2 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:36.233538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9188b997-9b09-444c-823b-b822920105c2 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:36.388627 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9188b997-9b09-444c-823b-b822920105c2 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:36.410734 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9188b997-9b09-444c-823b-b822920105c2 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:36.418898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9188b997-9b09-444c-823b-b822920105c2 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:36.420464 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9188b997-9b09-444c-823b-b822920105c2 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.239712 May 27 15:08:36.421197 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1415/2853] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:36 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:36.428299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2e102064-e4dc-480f-ab98-d58d25a8f76a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1243847253", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "5e060146-66c4-492e-80f7-70a65c4297cc"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:36.822261 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-247a295e-e2d8-4487-853c-2a9515ad35e2 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f" status: 200 len: 1427 microversion: 2.1 time: 13.993728 May 27 15:08:36.823184 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1439/2854] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:08:22 2022] GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f => generated 1427 bytes in 13995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:36.831452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-edfc9885-dfc3-4d57-8a4d-f3c4f69bcf31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:36.835943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-edfc9885-dfc3-4d57-8a4d-f3c4f69bcf31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:36.853157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-edfc9885-dfc3-4d57-8a4d-f3c4f69bcf31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:36.853699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-edfc9885-dfc3-4d57-8a4d-f3c4f69bcf31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:36.855332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-edfc9885-dfc3-4d57-8a4d-f3c4f69bcf31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:36.855816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-edfc9885-dfc3-4d57-8a4d-f3c4f69bcf31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:36.868409 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-2e102064-e4dc-480f-ab98-d58d25a8f76a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] validate_networks() for [('5e060146-66c4-492e-80f7-70a65c4297cc', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:08:37.507931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-edfc9885-dfc3-4d57-8a4d-f3c4f69bcf31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:37.518153 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-edfc9885-dfc3-4d57-8a4d-f3c4f69bcf31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:37.525003 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-edfc9885-dfc3-4d57-8a4d-f3c4f69bcf31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:37.546220 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-edfc9885-dfc3-4d57-8a4d-f3c4f69bcf31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1809 microversion: 2.20 time: 0.721286 May 27 15:08:37.552246 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1440/2855] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:36 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1809 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:37.571640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0cc55f7b-aeca-4e3e-bfd4-ebc2f073d9f4 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:37.575332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0cc55f7b-aeca-4e3e-bfd4-ebc2f073d9f4 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:37.601325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0cc55f7b-aeca-4e3e-bfd4-ebc2f073d9f4 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:37.601792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0cc55f7b-aeca-4e3e-bfd4-ebc2f073d9f4 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:37.607303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0cc55f7b-aeca-4e3e-bfd4-ebc2f073d9f4 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:37.609907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0cc55f7b-aeca-4e3e-bfd4-ebc2f073d9f4 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:38.632861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-2e102064-e4dc-480f-ab98-d58d25a8f76a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:08:38.634150 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-2e102064-e4dc-480f-ab98-d58d25a8f76a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:08:38.635697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-2e102064-e4dc-480f-ab98-d58d25a8f76a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:08:38.636947 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-2e102064-e4dc-480f-ab98-d58d25a8f76a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:08:38.637645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-2e102064-e4dc-480f-ab98-d58d25a8f76a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:08:38.666395 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e102064-e4dc-480f-ab98-d58d25a8f76a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:38.667246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e102064-e4dc-480f-ab98-d58d25a8f76a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:38.668408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e102064-e4dc-480f-ab98-d58d25a8f76a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:38.671963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e102064-e4dc-480f-ab98-d58d25a8f76a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:38.712645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-2e102064-e4dc-480f-ab98-d58d25a8f76a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Getting quotas for project 628e59220c154dcda54532c0b3606f2b. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:08:38.720382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-2e102064-e4dc-480f-ab98-d58d25a8f76a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Getting quotas for user 55944b29f3ba44d8b08ae71ce65be230 and project 628e59220c154dcda54532c0b3606f2b. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:08:38.736335 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2e102064-e4dc-480f-ab98-d58d25a8f76a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:08:38.739085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2e102064-e4dc-480f-ab98-d58d25a8f76a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:08:38.739304 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0cc55f7b-aeca-4e3e-bfd4-ebc2f073d9f4 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1645 microversion: 2.1 time: 1.185429 May 27 15:08:38.740523 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1441/2856] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:37 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1645 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:38.760261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2643383d-1304-40f3-b269-a55d4aff8a05 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:38.762400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2643383d-1304-40f3-b269-a55d4aff8a05 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:38.778020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2643383d-1304-40f3-b269-a55d4aff8a05 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:38.781552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2643383d-1304-40f3-b269-a55d4aff8a05 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:38.782567 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2643383d-1304-40f3-b269-a55d4aff8a05 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:38.783264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2643383d-1304-40f3-b269-a55d4aff8a05 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:38.849092 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2e102064-e4dc-480f-ab98-d58d25a8f76a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.426646 May 27 15:08:38.849946 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1416/2857] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:08:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:08:38.865980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6034039c-d154-485a-9d4b-a015e11c499a tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:38.869784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6034039c-d154-485a-9d4b-a015e11c499a tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:38.908357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6034039c-d154-485a-9d4b-a015e11c499a tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:38.913815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6034039c-d154-485a-9d4b-a015e11c499a tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:38.915071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6034039c-d154-485a-9d4b-a015e11c499a tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:38.919380 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6034039c-d154-485a-9d4b-a015e11c499a tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:38.987856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:39.533322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2643383d-1304-40f3-b269-a55d4aff8a05 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:39.556419 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2643383d-1304-40f3-b269-a55d4aff8a05 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1506 microversion: 2.1 time: 0.812365 May 27 15:08:39.568384 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1442/2858] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:38 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1506 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:39.590814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c2c491f4-b469-449c-b190-b5c4e10b51b8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:39.596232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c2c491f4-b469-449c-b190-b5c4e10b51b8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:39.607755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6034039c-d154-485a-9d4b-a015e11c499a tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:39.622736 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2c491f4-b469-449c-b190-b5c4e10b51b8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:39.625108 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6034039c-d154-485a-9d4b-a015e11c499a tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 0.773628 May 27 15:08:39.625974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2c491f4-b469-449c-b190-b5c4e10b51b8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:39.628783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2c491f4-b469-449c-b190-b5c4e10b51b8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:39.632818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2c491f4-b469-449c-b190-b5c4e10b51b8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:39.635807 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1417/2859] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:38 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:39.641000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-52e3bf77-624e-41fd-9c55-0fbbcf6bc172 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776ca5550>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:39.750922 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-52e3bf77-624e-41fd-9c55-0fbbcf6bc172 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f" status: 200 len: 1427 microversion: 2.1 time: 0.113822 May 27 15:08:39.751952 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1418/2860] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:08:39 2022] GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f => generated 1427 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:39.760558 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-0be1c998-6ae7-4c6e-8daf-689329e54940 req-7dfa62e5-f4b7-46d9-b177-4d15188f68ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a59f3b5-daec-44ac-886e-2112ff3c8675", "name": "network-vif-deleted", "tag": "920f6fd6-e492-42be-9e9e-e76c839e5b92"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:39.787043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0be1c998-6ae7-4c6e-8daf-689329e54940 req-7dfa62e5-f4b7-46d9-b177-4d15188f68ac service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:39.787477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0be1c998-6ae7-4c6e-8daf-689329e54940 req-7dfa62e5-f4b7-46d9-b177-4d15188f68ac service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:39.816616 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-0be1c998-6ae7-4c6e-8daf-689329e54940 req-7dfa62e5-f4b7-46d9-b177-4d15188f68ac service nova] Creating event network-vif-deleted:920f6fd6-e492-42be-9e9e-e76c839e5b92 for instance 7a59f3b5-daec-44ac-886e-2112ff3c8675 on n-h2-843621-1 May 27 15:08:39.839991 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-0be1c998-6ae7-4c6e-8daf-689329e54940 req-7dfa62e5-f4b7-46d9-b177-4d15188f68ac service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086176 May 27 15:08:39.846364 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1419/2861] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:39.857694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-557fc39f-95a7-4165-85b9-c14dc48403d8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:39.858601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-557fc39f-95a7-4165-85b9-c14dc48403d8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:39.869935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c2c491f4-b469-449c-b190-b5c4e10b51b8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:39.880760 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-557fc39f-95a7-4165-85b9-c14dc48403d8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:39.881744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-557fc39f-95a7-4165-85b9-c14dc48403d8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:39.884604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-557fc39f-95a7-4165-85b9-c14dc48403d8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:39.886023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-557fc39f-95a7-4165-85b9-c14dc48403d8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:39.890000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c2c491f4-b469-449c-b190-b5c4e10b51b8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:39.896155 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c2c491f4-b469-449c-b190-b5c4e10b51b8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:39.905860 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c2c491f4-b469-449c-b190-b5c4e10b51b8 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.332797 May 27 15:08:39.909502 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1443/2862] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:39 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:39.915911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1aa4aca7-0787-4ecc-8c1f-6ea633e3bef5 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:39.924937 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:08:39.924937 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:08:39.926956 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1aa4aca7-0787-4ecc-8c1f-6ea633e3bef5 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:39.929224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1aa4aca7-0787-4ecc-8c1f-6ea633e3bef5 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:39.930940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1aa4aca7-0787-4ecc-8c1f-6ea633e3bef5 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:39.933357 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1aa4aca7-0787-4ecc-8c1f-6ea633e3bef5 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:40.024924 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1aa4aca7-0787-4ecc-8c1f-6ea633e3bef5 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.114179 May 27 15:08:40.025934 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1444/2863] 10.222.0.13 () {58 vars in 1175 bytes} [Fri May 27 15:08:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:40.047463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-50263a4a-d200-4d7a-9397-a351d17d5dc2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:40.061587 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-50263a4a-d200-4d7a-9397-a351d17d5dc2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:40.086838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-50263a4a-d200-4d7a-9397-a351d17d5dc2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:40.095784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-50263a4a-d200-4d7a-9397-a351d17d5dc2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:40.097093 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-50263a4a-d200-4d7a-9397-a351d17d5dc2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:40.098267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-50263a4a-d200-4d7a-9397-a351d17d5dc2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:40.321666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-50263a4a-d200-4d7a-9397-a351d17d5dc2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:40.344499 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-50263a4a-d200-4d7a-9397-a351d17d5dc2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1222 microversion: 2.1 time: 0.316682 May 27 15:08:40.347562 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1445/2864] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:40 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1222 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:40.377468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-6306068b-0093-4d36-a063-eecb657f1ab5 req-ee8536f5-c1bf-4867-8f5a-6d6c0741777e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1852d307-f34e-4a53-942f-145d41dc5c24", "name": "network-vif-unplugged", "status": "completed", "tag": "0d3395a1-3889-43d9-8af7-cd140f2fee10"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:40.404480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-6306068b-0093-4d36-a063-eecb657f1ab5 req-ee8536f5-c1bf-4867-8f5a-6d6c0741777e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:40.414575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-6306068b-0093-4d36-a063-eecb657f1ab5 req-ee8536f5-c1bf-4867-8f5a-6d6c0741777e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:40.431625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-557fc39f-95a7-4165-85b9-c14dc48403d8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:40.451711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-557fc39f-95a7-4165-85b9-c14dc48403d8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:40.453982 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-6306068b-0093-4d36-a063-eecb657f1ab5 req-ee8536f5-c1bf-4867-8f5a-6d6c0741777e service nova] Creating event network-vif-unplugged:0d3395a1-3889-43d9-8af7-cd140f2fee10 for instance 1852d307-f34e-4a53-942f-145d41dc5c24 on n-h1-843621-1 May 27 15:08:40.458496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-557fc39f-95a7-4165-85b9-c14dc48403d8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:40.469495 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-557fc39f-95a7-4165-85b9-c14dc48403d8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1796 microversion: 2.20 time: 0.611882 May 27 15:08:40.470378 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1420/2865] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:39 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1796 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:40.474580 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-6306068b-0093-4d36-a063-eecb657f1ab5 req-ee8536f5-c1bf-4867-8f5a-6d6c0741777e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103964 May 27 15:08:40.478252 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1446/2866] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:40.579565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e120db2f-2734-4d22-9c24-eba088a41944 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:40.581932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e120db2f-2734-4d22-9c24-eba088a41944 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:40.600696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e120db2f-2734-4d22-9c24-eba088a41944 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:40.601706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e120db2f-2734-4d22-9c24-eba088a41944 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:40.602743 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e120db2f-2734-4d22-9c24-eba088a41944 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:40.603383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e120db2f-2734-4d22-9c24-eba088a41944 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:40.647551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9b95d431-8fe9-44d4-b0f9-edfb6febcca9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:40.648975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9b95d431-8fe9-44d4-b0f9-edfb6febcca9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:40.676592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b95d431-8fe9-44d4-b0f9-edfb6febcca9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:40.678594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b95d431-8fe9-44d4-b0f9-edfb6febcca9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:40.684985 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b95d431-8fe9-44d4-b0f9-edfb6febcca9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:40.686720 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b95d431-8fe9-44d4-b0f9-edfb6febcca9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:41.708338 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9b95d431-8fe9-44d4-b0f9-edfb6febcca9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:41.719501 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9b95d431-8fe9-44d4-b0f9-edfb6febcca9 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 1.079243 May 27 15:08:41.730860 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1447/2867] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:40 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:08:41.737502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-350d8c88-6a05-4d37-9f3b-b43476022324 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776990670>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:41.762204 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e120db2f-2734-4d22-9c24-eba088a41944 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:41.774900 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e120db2f-2734-4d22-9c24-eba088a41944 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1506 microversion: 2.1 time: 1.201046 May 27 15:08:41.777754 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1421/2868] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:40 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1506 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:41.804217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9f19a687-1945-4b40-828e-66a678431014 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:41.805802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9f19a687-1945-4b40-828e-66a678431014 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:41.822279 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-350d8c88-6a05-4d37-9f3b-b43476022324 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f" status: 200 len: 1427 microversion: 2.1 time: 0.090008 May 27 15:08:41.830035 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1448/2869] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:08:41 2022] GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:41.835856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2b8f7432-6f88-402b-b503-fc81fdbdea3b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:41.836477 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2b8f7432-6f88-402b-b503-fc81fdbdea3b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:41.838421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f19a687-1945-4b40-828e-66a678431014 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:41.839042 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f19a687-1945-4b40-828e-66a678431014 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:41.841429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f19a687-1945-4b40-828e-66a678431014 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:41.842221 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f19a687-1945-4b40-828e-66a678431014 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:41.856055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b8f7432-6f88-402b-b503-fc81fdbdea3b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:41.858882 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b8f7432-6f88-402b-b503-fc81fdbdea3b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:41.859866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b8f7432-6f88-402b-b503-fc81fdbdea3b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:41.862861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b8f7432-6f88-402b-b503-fc81fdbdea3b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:42.161322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2b8f7432-6f88-402b-b503-fc81fdbdea3b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:42.171519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9f19a687-1945-4b40-828e-66a678431014 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:42.213001 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2b8f7432-6f88-402b-b503-fc81fdbdea3b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1276 microversion: 2.1 time: 0.380236 May 27 15:08:42.216173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9f19a687-1945-4b40-828e-66a678431014 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:42.216363 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1449/2870] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:41 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1276 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:42.223226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9f19a687-1945-4b40-828e-66a678431014 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:42.225637 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9f19a687-1945-4b40-828e-66a678431014 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.436837 May 27 15:08:42.227709 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1422/2871] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:41 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:42.738523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c7471f9b-42b0-4e0c-9f21-acc88da9b786 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:42.739216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c7471f9b-42b0-4e0c-9f21-acc88da9b786 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:42.753364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c7471f9b-42b0-4e0c-9f21-acc88da9b786 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:42.756043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c7471f9b-42b0-4e0c-9f21-acc88da9b786 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:42.759789 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c7471f9b-42b0-4e0c-9f21-acc88da9b786 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:42.760970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c7471f9b-42b0-4e0c-9f21-acc88da9b786 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:42.795230 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-224feb18-475d-4f3a-a419-f37daa9b440f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:42.796232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-224feb18-475d-4f3a-a419-f37daa9b440f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:42.817597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-224feb18-475d-4f3a-a419-f37daa9b440f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:42.824977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-224feb18-475d-4f3a-a419-f37daa9b440f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:42.826227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-224feb18-475d-4f3a-a419-f37daa9b440f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:42.829237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-224feb18-475d-4f3a-a419-f37daa9b440f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:44.234205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-224feb18-475d-4f3a-a419-f37daa9b440f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:44.253528 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-224feb18-475d-4f3a-a419-f37daa9b440f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1506 microversion: 2.1 time: 1.463317 May 27 15:08:44.254814 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1423/2872] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:42 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1506 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:44.264333 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0ae7ad6c-208c-474a-b345-2d1b8e63f8e7 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776a800d0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:44.363968 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0ae7ad6c-208c-474a-b345-2d1b8e63f8e7 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f" status: 200 len: 1427 microversion: 2.1 time: 0.107832 May 27 15:08:44.370697 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1424/2873] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:08:44 2022] GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f => generated 1427 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:44.388897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-93a5f306-164b-4fb9-9854-e3a3ece35cfa tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:44.393274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-93a5f306-164b-4fb9-9854-e3a3ece35cfa tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:44.434966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93a5f306-164b-4fb9-9854-e3a3ece35cfa tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:44.441506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93a5f306-164b-4fb9-9854-e3a3ece35cfa tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:44.442629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93a5f306-164b-4fb9-9854-e3a3ece35cfa tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:44.448946 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93a5f306-164b-4fb9-9854-e3a3ece35cfa tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:44.525130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c7471f9b-42b0-4e0c-9f21-acc88da9b786 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:44.545557 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c7471f9b-42b0-4e0c-9f21-acc88da9b786 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1323 microversion: 2.1 time: 1.807484 May 27 15:08:44.546782 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1450/2874] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:42 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1323 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:44.556082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-df610a19-d317-4f8c-b8a8-eaefa083f661 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:44.558371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-df610a19-d317-4f8c-b8a8-eaefa083f661 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:44.581365 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df610a19-d317-4f8c-b8a8-eaefa083f661 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:44.582208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df610a19-d317-4f8c-b8a8-eaefa083f661 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:44.583987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df610a19-d317-4f8c-b8a8-eaefa083f661 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:44.585478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df610a19-d317-4f8c-b8a8-eaefa083f661 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:44.771027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-df610a19-d317-4f8c-b8a8-eaefa083f661 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:44.784566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-df610a19-d317-4f8c-b8a8-eaefa083f661 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:44.795296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-df610a19-d317-4f8c-b8a8-eaefa083f661 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:44.796836 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-df610a19-d317-4f8c-b8a8-eaefa083f661 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.248811 May 27 15:08:44.797906 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1451/2875] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:44 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:44.993320 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-93a5f306-164b-4fb9-9854-e3a3ece35cfa tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:45.027733 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-93a5f306-164b-4fb9-9854-e3a3ece35cfa tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1318 microversion: 2.1 time: 0.655420 May 27 15:08:45.037083 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1425/2876] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:44 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1318 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:45.271812 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cc83044f-3d34-41e5-9429-3b2aaf79e6d0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:45.272549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cc83044f-3d34-41e5-9429-3b2aaf79e6d0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:45.284418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cc83044f-3d34-41e5-9429-3b2aaf79e6d0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:45.284915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cc83044f-3d34-41e5-9429-3b2aaf79e6d0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:45.285726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cc83044f-3d34-41e5-9429-3b2aaf79e6d0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:45.286175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cc83044f-3d34-41e5-9429-3b2aaf79e6d0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:45.387898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6a908e6b-be40-43f8-9844-b13a172c91c3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776aca1f0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:45.451116 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6a908e6b-be40-43f8-9844-b13a172c91c3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f" status: 200 len: 1427 microversion: 2.1 time: 0.070905 May 27 15:08:45.485359 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1426/2877] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:08:45 2022] GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:08:45.563984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fabc35a9-158e-4154-908a-58f189522413 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:45.564802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fabc35a9-158e-4154-908a-58f189522413 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:45.572184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fabc35a9-158e-4154-908a-58f189522413 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:45.576496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fabc35a9-158e-4154-908a-58f189522413 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:45.577485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fabc35a9-158e-4154-908a-58f189522413 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:45.590977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fabc35a9-158e-4154-908a-58f189522413 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:46.539169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cc83044f-3d34-41e5-9429-3b2aaf79e6d0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:46.557431 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cc83044f-3d34-41e5-9429-3b2aaf79e6d0 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 200 len: 1449 microversion: 2.1 time: 1.286542 May 27 15:08:46.563465 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1452/2878] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:45 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 1449 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:46.577713 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c32cde52-6343-438b-85ca-f68106b4d066 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc3cce81-3f26-4484-b131-2356d3ff4684", "device": "/dev/xvdb"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:46.579721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c32cde52-6343-438b-85ca-f68106b4d066 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:46.595479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c32cde52-6343-438b-85ca-f68106b4d066 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:46.598256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c32cde52-6343-438b-85ca-f68106b4d066 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:46.601182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c32cde52-6343-438b-85ca-f68106b4d066 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:46.609924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c32cde52-6343-438b-85ca-f68106b4d066 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:47.091142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fabc35a9-158e-4154-908a-58f189522413 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:47.109248 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fabc35a9-158e-4154-908a-58f189522413 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1518 microversion: 2.1 time: 1.544924 May 27 15:08:47.140400 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1427/2879] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:45 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1518 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:47.192092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-748aecfd-29bd-42e7-b526-cdb7bf2e0033 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:47.194649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-748aecfd-29bd-42e7-b526-cdb7bf2e0033 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:47.220732 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-748aecfd-29bd-42e7-b526-cdb7bf2e0033 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:47.225716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-748aecfd-29bd-42e7-b526-cdb7bf2e0033 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:47.226854 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-748aecfd-29bd-42e7-b526-cdb7bf2e0033 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:47.227407 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-748aecfd-29bd-42e7-b526-cdb7bf2e0033 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:47.451500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-748aecfd-29bd-42e7-b526-cdb7bf2e0033 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:47.499178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-748aecfd-29bd-42e7-b526-cdb7bf2e0033 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:47.507333 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-748aecfd-29bd-42e7-b526-cdb7bf2e0033 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:47.515780 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-748aecfd-29bd-42e7-b526-cdb7bf2e0033 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.368861 May 27 15:08:47.519073 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1428/2880] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:47 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:47.543640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ad150ea8-7eff-4b80-acc8-4bf0a98273a2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:47.550280 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c32cde52-6343-438b-85ca-f68106b4d066 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "POST /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.985238 May 27 15:08:47.550724 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ad150ea8-7eff-4b80-acc8-4bf0a98273a2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:47.566037 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1453/2881] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 15:08:46 2022] POST /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments => generated 194 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:47.589775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-39f28c8b-123f-44b0-b097-e180ff52a1a3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc7806e4d30>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:47.601119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad150ea8-7eff-4b80-acc8-4bf0a98273a2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:47.605908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad150ea8-7eff-4b80-acc8-4bf0a98273a2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:47.608050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad150ea8-7eff-4b80-acc8-4bf0a98273a2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:47.608527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad150ea8-7eff-4b80-acc8-4bf0a98273a2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:47.733758 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-39f28c8b-123f-44b0-b097-e180ff52a1a3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f" status: 200 len: 1427 microversion: 2.1 time: 0.166335 May 27 15:08:47.734454 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1454/2882] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:08:47 2022] GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f => generated 1427 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:47.755701 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ab98f787-e406-437a-b816-5eddf3e12882 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:47.756410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ab98f787-e406-437a-b816-5eddf3e12882 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:47.790038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab98f787-e406-437a-b816-5eddf3e12882 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:47.795131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab98f787-e406-437a-b816-5eddf3e12882 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:47.799587 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab98f787-e406-437a-b816-5eddf3e12882 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:47.802097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab98f787-e406-437a-b816-5eddf3e12882 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:47.890429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ab98f787-e406-437a-b816-5eddf3e12882 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:08:47.918665 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.compute.api [None req-ab98f787-e406-437a-b816-5eddf3e12882 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Working on deleting snapshot 3b179c9e-2309-46ac-ab54-ad6aaaad5ec5 from shelved instance... May 27 15:08:48.252647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ad150ea8-7eff-4b80-acc8-4bf0a98273a2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:48.264282 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ad150ea8-7eff-4b80-acc8-4bf0a98273a2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1318 microversion: 2.1 time: 0.730021 May 27 15:08:48.265221 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1429/2883] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:47 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1318 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:48.286428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7dccc784-63b1-40f8-b3ec-d4eeecb8b476 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:48.287478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7dccc784-63b1-40f8-b3ec-d4eeecb8b476 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:48.310069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7dccc784-63b1-40f8-b3ec-d4eeecb8b476 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:48.310574 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7dccc784-63b1-40f8-b3ec-d4eeecb8b476 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:48.311414 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7dccc784-63b1-40f8-b3ec-d4eeecb8b476 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:48.311867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7dccc784-63b1-40f8-b3ec-d4eeecb8b476 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:48.379701 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-7dccc784-63b1-40f8-b3ec-d4eeecb8b476 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lazy-loading 'flavor' on Instance uuid 166cc8cd-403c-4987-ac12-64336b9b2d18 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:08:48.594383 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7dccc784-63b1-40f8-b3ec-d4eeecb8b476 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "POST /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18/action" status: 200 len: 32 microversion: 2.1 time: 0.317870 May 27 15:08:48.602949 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1430/2884] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:08:48 2022] POST /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18/action => generated 32 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:08:48.631260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-b117e5d1-5716-4146-ac44-63df95b5f675 req-7057bd1f-ef0a-4a37-bae8-ea8d394db992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3996f065-a4c2-40b5-9189-8fe1334f1d18", "tag": "1bcb594f-fe75-4ee2-b07a-dcae39e8c831"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:48.674909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b117e5d1-5716-4146-ac44-63df95b5f675 req-7057bd1f-ef0a-4a37-bae8-ea8d394db992 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:48.675292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b117e5d1-5716-4146-ac44-63df95b5f675 req-7057bd1f-ef0a-4a37-bae8-ea8d394db992 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:48.718594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:48.721320 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-b117e5d1-5716-4146-ac44-63df95b5f675 req-7057bd1f-ef0a-4a37-bae8-ea8d394db992 service nova] Creating event network-changed:1bcb594f-fe75-4ee2-b07a-dcae39e8c831 for instance 3996f065-a4c2-40b5-9189-8fe1334f1d18 on n-h2-843621-1 May 27 15:08:48.734347 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-b117e5d1-5716-4146-ac44-63df95b5f675 req-7057bd1f-ef0a-4a37-bae8-ea8d394db992 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127532 May 27 15:08:48.735953 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1431/2885] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:48.751861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-783d9541-f495-423a-828e-4370e3c21fd0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:48.752899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-783d9541-f495-423a-828e-4370e3c21fd0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:48.759144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:48.763910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-783d9541-f495-423a-828e-4370e3c21fd0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:48.764545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-783d9541-f495-423a-828e-4370e3c21fd0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:48.767096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-783d9541-f495-423a-828e-4370e3c21fd0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:48.769947 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-783d9541-f495-423a-828e-4370e3c21fd0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:48.920878 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-783d9541-f495-423a-828e-4370e3c21fd0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:48.934714 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-783d9541-f495-423a-828e-4370e3c21fd0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:48.940610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-783d9541-f495-423a-828e-4370e3c21fd0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:48.950315 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-783d9541-f495-423a-828e-4370e3c21fd0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.212104 May 27 15:08:48.951681 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1432/2886] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:48 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:48.956896 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7d23cd0a-de40-418f-9340-e2d87672d7d6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:48.957813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7d23cd0a-de40-418f-9340-e2d87672d7d6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:48.978256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d23cd0a-de40-418f-9340-e2d87672d7d6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:48.979182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d23cd0a-de40-418f-9340-e2d87672d7d6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:48.980812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d23cd0a-de40-418f-9340-e2d87672d7d6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:48.984502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d23cd0a-de40-418f-9340-e2d87672d7d6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:49.293490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7d23cd0a-de40-418f-9340-e2d87672d7d6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:49.301376 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7d23cd0a-de40-418f-9340-e2d87672d7d6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.348330 May 27 15:08:49.304993 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1433/2887] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:48 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:49.316535 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c167d86e-7f82-4895-bd48-4f83e460eb6a tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776b393a0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:49.951865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:49.956929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ab98f787-e406-437a-b816-5eddf3e12882 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Doing local delete in cell 57e0886a-3e0a-4a65-b585-e8d63742d44b(cell1) {{(pid=119248) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 27 15:08:49.960489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab98f787-e406-437a-b816-5eddf3e12882 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:49.971660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab98f787-e406-437a-b816-5eddf3e12882 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:49.972434 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.compute.api [None req-ab98f787-e406-437a-b816-5eddf3e12882 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 27 15:08:49.975552 n-d-843621-1 devstack@n-api.service[119248]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ab98f787-e406-437a-b816-5eddf3e12882 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [e0ae02f9-ab4d-4eb0-908d-57b2829c01d9] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 15:08:50.020704 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c167d86e-7f82-4895-bd48-4f83e460eb6a tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f" status: 200 len: 1436 microversion: 2.1 time: 0.714332 May 27 15:08:50.033040 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1434/2888] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:08:49 2022] GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f => generated 1436 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:50.050686 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-af80257d-b2c4-4eba-ba57-c0c21d70f498 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:50.051927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-af80257d-b2c4-4eba-ba57-c0c21d70f498 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:50.067031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af80257d-b2c4-4eba-ba57-c0c21d70f498 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:50.069436 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af80257d-b2c4-4eba-ba57-c0c21d70f498 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:50.070412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af80257d-b2c4-4eba-ba57-c0c21d70f498 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:50.073603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af80257d-b2c4-4eba-ba57-c0c21d70f498 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:50.396529 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-af80257d-b2c4-4eba-ba57-c0c21d70f498 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:50.405785 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-af80257d-b2c4-4eba-ba57-c0c21d70f498 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1318 microversion: 2.1 time: 0.371451 May 27 15:08:50.412714 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1435/2889] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:50 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:50.415540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c32c3be0-16a9-4884-9af0-938c5f0fb5b7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:50.416168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c32c3be0-16a9-4884-9af0-938c5f0fb5b7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:50.422882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c32c3be0-16a9-4884-9af0-938c5f0fb5b7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:50.423386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c32c3be0-16a9-4884-9af0-938c5f0fb5b7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:50.424143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c32c3be0-16a9-4884-9af0-938c5f0fb5b7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:50.424612 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c32c3be0-16a9-4884-9af0-938c5f0fb5b7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:50.530899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c32c3be0-16a9-4884-9af0-938c5f0fb5b7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:50.559400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c32c3be0-16a9-4884-9af0-938c5f0fb5b7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:50.563128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c32c3be0-16a9-4884-9af0-938c5f0fb5b7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:50.570122 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c32c3be0-16a9-4884-9af0-938c5f0fb5b7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.158267 May 27 15:08:50.571626 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1436/2890] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:50 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:50.578667 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dd841552-5c71-4b0b-9872-7ff443396f4f tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc776a80ee0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:50.699533 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dd841552-5c71-4b0b-9872-7ff443396f4f tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f" status: 200 len: 1436 microversion: 2.1 time: 0.125896 May 27 15:08:50.700904 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1437/2891] 10.222.0.13 () {58 vars in 1232 bytes} [Fri May 27 15:08:50 2022] GET /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f => generated 1436 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:50.713133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6baa1a07-2c70-4fe7-860f-5d560923c5e0 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:50.716352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6baa1a07-2c70-4fe7-860f-5d560923c5e0 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:50.735727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6baa1a07-2c70-4fe7-860f-5d560923c5e0 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:50.736870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6baa1a07-2c70-4fe7-860f-5d560923c5e0 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:50.741000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6baa1a07-2c70-4fe7-860f-5d560923c5e0 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:50.744230 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6baa1a07-2c70-4fe7-860f-5d560923c5e0 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:50.783403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:50.993344 n-d-843621-1 devstack@n-api.service[119248]: INFO oslo.messaging._drivers.impl_rabbit [None req-ab98f787-e406-437a-b816-5eddf3e12882 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [e0ae02f9-ab4d-4eb0-908d-57b2829c01d9] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49630. May 27 15:08:51.002285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-ab98f787-e406-437a-b816-5eddf3e12882 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] deallocate_for_instance() {{(pid=119248) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} May 27 15:08:51.028661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6baa1a07-2c70-4fe7-860f-5d560923c5e0 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:51.041870 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6baa1a07-2c70-4fe7-860f-5d560923c5e0 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.339361 May 27 15:08:51.043590 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1438/2892] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:50 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:51.048999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3b4f0227-0b4a-42ef-955c-5a0dd1f4b994 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:51.049807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3b4f0227-0b4a-42ef-955c-5a0dd1f4b994 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:51.057868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b4f0227-0b4a-42ef-955c-5a0dd1f4b994 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:51.058818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b4f0227-0b4a-42ef-955c-5a0dd1f4b994 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:51.059979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b4f0227-0b4a-42ef-955c-5a0dd1f4b994 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:51.061135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b4f0227-0b4a-42ef-955c-5a0dd1f4b994 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:51.267407 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3b4f0227-0b4a-42ef-955c-5a0dd1f4b994 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:51.277013 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3b4f0227-0b4a-42ef-955c-5a0dd1f4b994 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1467 microversion: 2.1 time: 0.231398 May 27 15:08:51.289320 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1439/2893] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:51 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1467 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:51.296056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2026b322-dfc9-489d-8704-fd15422f0488 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc780696280>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:52.032040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-ab98f787-e406-437a-b816-5eddf3e12882 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Updating instance_info_cache with network_info: [] {{(pid=119248) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 27 15:08:52.085474 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2026b322-dfc9-489d-8704-fd15422f0488 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "DELETE /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f" status: 204 len: 0 microversion: 2.1 time: 0.794064 May 27 15:08:52.088988 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1440/2894] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:51 2022] DELETE /compute/v2.1/images/bf2ebe60-1b12-4a2f-8199-ff0f479cb56f => generated 0 bytes in 796 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:08:52.091789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4286ebb6-9115-4fa0-9e08-138e119f223f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:52.092424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4286ebb6-9115-4fa0-9e08-138e119f223f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:52.108526 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4286ebb6-9115-4fa0-9e08-138e119f223f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:52.117342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4286ebb6-9115-4fa0-9e08-138e119f223f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:52.119141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4286ebb6-9115-4fa0-9e08-138e119f223f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:52.121622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4286ebb6-9115-4fa0-9e08-138e119f223f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:52.321508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4286ebb6-9115-4fa0-9e08-138e119f223f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:52.334266 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4286ebb6-9115-4fa0-9e08-138e119f223f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1318 microversion: 2.1 time: 0.246892 May 27 15:08:52.336042 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1441/2895] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:52 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:52.369040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7a10e764-43fe-40a8-a87a-18a89dd165c4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:52.375554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7a10e764-43fe-40a8-a87a-18a89dd165c4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:52.404594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:52.407505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a10e764-43fe-40a8-a87a-18a89dd165c4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:52.408640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a10e764-43fe-40a8-a87a-18a89dd165c4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:52.410103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a10e764-43fe-40a8-a87a-18a89dd165c4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:52.410909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a10e764-43fe-40a8-a87a-18a89dd165c4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:52.529089 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7a10e764-43fe-40a8-a87a-18a89dd165c4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:52.543524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7a10e764-43fe-40a8-a87a-18a89dd165c4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:52.545530 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7a10e764-43fe-40a8-a87a-18a89dd165c4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:52.546999 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7a10e764-43fe-40a8-a87a-18a89dd165c4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.209287 May 27 15:08:52.548276 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1442/2896] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:52 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:52.553567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-6e54129d-6452-4bae-868c-24942439bf77 req-d7245e43-cc71-4584-8523-9206817550f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1852d307-f34e-4a53-942f-145d41dc5c24", "name": "network-vif-deleted", "tag": "0d3395a1-3889-43d9-8af7-cd140f2fee10"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:52.562692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6e54129d-6452-4bae-868c-24942439bf77 req-d7245e43-cc71-4584-8523-9206817550f5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:52.563598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6e54129d-6452-4bae-868c-24942439bf77 req-d7245e43-cc71-4584-8523-9206817550f5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:52.579152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.compute.server_external_events [req-6e54129d-6452-4bae-868c-24942439bf77 req-d7245e43-cc71-4584-8523-9206817550f5 service nova] Unable to find a host for instance 1852d307-f34e-4a53-942f-145d41dc5c24. Dropping event network-vif-deleted {{(pid=119249) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 27 15:08:52.580815 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-6e54129d-6452-4bae-868c-24942439bf77 req-d7245e43-cc71-4584-8523-9206817550f5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.030930 May 27 15:08:52.585079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:52.588297 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1443/2897] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 27 15:08:52.594914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-29145af6-b37d-409a-91aa-427d0df28af2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:52.596388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-29145af6-b37d-409a-91aa-427d0df28af2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:52.605407 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-29145af6-b37d-409a-91aa-427d0df28af2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:52.606252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-29145af6-b37d-409a-91aa-427d0df28af2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:52.607274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-29145af6-b37d-409a-91aa-427d0df28af2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:52.608340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-29145af6-b37d-409a-91aa-427d0df28af2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:52.812624 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ab98f787-e406-437a-b816-5eddf3e12882 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 204 len: 0 microversion: 2.1 time: 5.065858 May 27 15:08:52.821696 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1455/2898] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:08:47 2022] DELETE /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 0 bytes in 5079 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:08:52.826428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-29145af6-b37d-409a-91aa-427d0df28af2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:52.831105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cb90cd35-3bd9-424c-a157-d60ca21af6e3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '.version_select at 0x7fc7806e8820>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:52.838378 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-29145af6-b37d-409a-91aa-427d0df28af2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.248005 May 27 15:08:52.839901 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1444/2899] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:52 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:52.846426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-704d7b50-9465-44b1-8b34-01c9ea68202d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:52.848144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-704d7b50-9465-44b1-8b34-01c9ea68202d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:52.864829 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-704d7b50-9465-44b1-8b34-01c9ea68202d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:52.865637 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-704d7b50-9465-44b1-8b34-01c9ea68202d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:52.867094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-704d7b50-9465-44b1-8b34-01c9ea68202d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:52.868405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-704d7b50-9465-44b1-8b34-01c9ea68202d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:52.878812 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-cb90cd35-3bd9-424c-a157-d60ca21af6e3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] HTTP exception thrown: Image not found. May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cb90cd35-3bd9-424c-a157-d60ca21af6e3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Request method failure captured: May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e HTTP/1.1 May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOkLw3INIZDNXYbUpaDGNyrEDcC-bZsl9fj6FRXrQg_YTD8CZEo8hFSFoN3WtFgtoljuvf5OM8DZNuwL4vFZF7dsTQT28b9i-dO_pSu83obGi8ncL76MGF-9UaAhWcfo2EbOKE4fB3WiMkfixRMRzCiMtAU8FdeEAoaR5nxhT1-AkRc May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 6f9f274a9b24495fa40d9c8be7dcc3d5 May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ImagesOneServerTestJSON-754826229 May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f9f274a9b24495fa40d9c8be7dcc3d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f9f274a9b24495fa40d9c8be7dcc3d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6f9f274a9b24495fa40d9c8be7dcc3d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6f9f274a9b24495fa40d9c8be7dcc3d5", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ImagesOneServerTestJSON-754826229 May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 6f9f274a9b24495fa40d9c8be7dcc3d5 May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-754826229 May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ImagesOneServerTestJSON-754826229-project May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: e745803913eb40a9bb7fb90f59d574c9 May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ImagesOneServerTestJSON-754826229-project May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: exception: Image not found. May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '2dfc1723-7284-41e4-97f2-81f98f8e419e'} May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2dfc1723-7284-41e4-97f2-81f98f8e419e to delete May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2dfc1723-7284-41e4-97f2-81f98f8e419e could not be found. May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:08:52.881942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 27 15:08:52.887482 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:08:52.897632 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cb90cd35-3bd9-424c-a157-d60ca21af6e3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Returning 404 to user: Image not found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:08:52.898756 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cb90cd35-3bd9-424c-a157-d60ca21af6e3 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "DELETE /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e" status: 404 len: 62 microversion: 2.1 time: 0.075540 May 27 15:08:52.899522 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1456/2900] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:52 2022] DELETE /compute/v2.1/images/2dfc1723-7284-41e4-97f2-81f98f8e419e => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:08:52.905346 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-704d7b50-9465-44b1-8b34-01c9ea68202d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance 1852d307-f34e-4a53-942f-145d41dc5c24 could not be found. May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-704d7b50-9465-44b1-8b34-01c9ea68202d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 HTTP/1.1 May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 1852d307-f34e-4a53-942f-145d41dc5c24 could not be found. May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '1852d307-f34e-4a53-942f-145d41dc5c24'} May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1852d307-f34e-4a53-942f-145d41dc5c24 could not be found. May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1852d307-f34e-4a53-942f-145d41dc5c24 could not be found. May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:08:52.907782 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:08:52.912123 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:08:52.912123 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:08:52.912123 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:08:52.912123 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:08:52.912123 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:08:52.912123 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1852d307-f34e-4a53-942f-145d41dc5c24 could not be found. May 27 15:08:52.912123 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:08:52.912582 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-704d7b50-9465-44b1-8b34-01c9ea68202d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance 1852d307-f34e-4a53-942f-145d41dc5c24 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:08:52.913508 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-704d7b50-9465-44b1-8b34-01c9ea68202d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 404 len: 111 microversion: 2.1 time: 0.072493 May 27 15:08:52.914418 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1445/2901] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:52 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:08:52.916162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8b0c6cbf-1365-44c0-9b21-14ff2be6e690 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:52.929872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8b0c6cbf-1365-44c0-9b21-14ff2be6e690 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:52.939176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b0c6cbf-1365-44c0-9b21-14ff2be6e690 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:52.939656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b0c6cbf-1365-44c0-9b21-14ff2be6e690 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:52.940441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b0c6cbf-1365-44c0-9b21-14ff2be6e690 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:52.940914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b0c6cbf-1365-44c0-9b21-14ff2be6e690 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:52.973424 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8b0c6cbf-1365-44c0-9b21-14ff2be6e690 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:08:53.017719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2cb04c57-c37a-4d97-ba0c-79ad7d1a5ddc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1475103160", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "a400f266-0bb2-420b-8500-ad7b63a44ef7"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:53.139578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-2cb04c57-c37a-4d97-ba0c-79ad7d1a5ddc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] validate_networks() for [('a400f266-0bb2-420b-8500-ad7b63a44ef7', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:08:53.157121 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8b0c6cbf-1365-44c0-9b21-14ff2be6e690 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 204 len: 0 microversion: 2.1 time: 0.250853 May 27 15:08:53.160267 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1457/2902] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:08:52 2022] DELETE /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:08:53.190829 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f7f15be1-e320-4671-a9f8-bb96de66255f tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:53.193870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f7f15be1-e320-4671-a9f8-bb96de66255f tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:53.228720 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7f15be1-e320-4671-a9f8-bb96de66255f tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:53.232778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7f15be1-e320-4671-a9f8-bb96de66255f tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:53.234333 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7f15be1-e320-4671-a9f8-bb96de66255f tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:53.235175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7f15be1-e320-4671-a9f8-bb96de66255f tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:53.573125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f7f15be1-e320-4671-a9f8-bb96de66255f tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:53.582858 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f7f15be1-e320-4671-a9f8-bb96de66255f tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1473 microversion: 2.1 time: 0.415298 May 27 15:08:53.583691 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1458/2903] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:53 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1473 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:53.594885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-94f02534-c5e6-41d3-8c4b-9fcf3076d98d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:53.597970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-94f02534-c5e6-41d3-8c4b-9fcf3076d98d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:53.608192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94f02534-c5e6-41d3-8c4b-9fcf3076d98d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:53.608932 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94f02534-c5e6-41d3-8c4b-9fcf3076d98d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:53.609909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94f02534-c5e6-41d3-8c4b-9fcf3076d98d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:53.610515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94f02534-c5e6-41d3-8c4b-9fcf3076d98d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:53.911612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-94f02534-c5e6-41d3-8c4b-9fcf3076d98d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:53.924904 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-94f02534-c5e6-41d3-8c4b-9fcf3076d98d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1318 microversion: 2.1 time: 0.340077 May 27 15:08:53.925672 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1459/2904] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:53 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:53.933632 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9fbbd52f-ad35-4b66-8fc2-8a96fd63d981 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:53.935146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9fbbd52f-ad35-4b66-8fc2-8a96fd63d981 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:53.944839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9fbbd52f-ad35-4b66-8fc2-8a96fd63d981 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:53.945450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9fbbd52f-ad35-4b66-8fc2-8a96fd63d981 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:53.949866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-2cb04c57-c37a-4d97-ba0c-79ad7d1a5ddc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:08:53.950483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-2cb04c57-c37a-4d97-ba0c-79ad7d1a5ddc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:08:53.951209 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-2cb04c57-c37a-4d97-ba0c-79ad7d1a5ddc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:08:53.951516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-2cb04c57-c37a-4d97-ba0c-79ad7d1a5ddc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:08:53.952010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-2cb04c57-c37a-4d97-ba0c-79ad7d1a5ddc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:08:53.954514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9fbbd52f-ad35-4b66-8fc2-8a96fd63d981 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:53.956275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9fbbd52f-ad35-4b66-8fc2-8a96fd63d981 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:53.972932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2cb04c57-c37a-4d97-ba0c-79ad7d1a5ddc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:53.973401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2cb04c57-c37a-4d97-ba0c-79ad7d1a5ddc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:53.974237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2cb04c57-c37a-4d97-ba0c-79ad7d1a5ddc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:53.974689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2cb04c57-c37a-4d97-ba0c-79ad7d1a5ddc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:54.003275 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-2cb04c57-c37a-4d97-ba0c-79ad7d1a5ddc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Getting quotas for project 37b5a0b0723a46c1b0755e824e32b776. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:08:54.011301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-2cb04c57-c37a-4d97-ba0c-79ad7d1a5ddc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Getting quotas for user 0536f4a5547545acaa06b6aad5d1fbe4 and project 37b5a0b0723a46c1b0755e824e32b776. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:08:54.035048 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2cb04c57-c37a-4d97-ba0c-79ad7d1a5ddc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:08:54.037797 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2cb04c57-c37a-4d97-ba0c-79ad7d1a5ddc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:08:54.064908 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9fbbd52f-ad35-4b66-8fc2-8a96fd63d981 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:54.076990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9fbbd52f-ad35-4b66-8fc2-8a96fd63d981 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:54.078953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9fbbd52f-ad35-4b66-8fc2-8a96fd63d981 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:54.080718 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9fbbd52f-ad35-4b66-8fc2-8a96fd63d981 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.153260 May 27 15:08:54.081398 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1460/2905] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:53 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:54.086538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9f591f92-61a4-484f-9f58-791698afa75d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:54.087153 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9f591f92-61a4-484f-9f58-791698afa75d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:54.100569 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f591f92-61a4-484f-9f58-791698afa75d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:54.101290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f591f92-61a4-484f-9f58-791698afa75d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:54.102236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f591f92-61a4-484f-9f58-791698afa75d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:54.102973 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f591f92-61a4-484f-9f58-791698afa75d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:54.133672 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2cb04c57-c37a-4d97-ba0c-79ad7d1a5ddc tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.117747 May 27 15:08:54.142581 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1446/2906] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:08:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:08:54.151290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-b62f9f8c-4dac-4f43-bc2b-6e1af49073b3 req-a70b1a52-3f2b-4e35-a355-c8b420ccef5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9604d14-4598-4d42-8bbf-8763103061a4", "name": "network-vif-unplugged", "status": "completed", "tag": "648e11b1-5568-4d40-a6cd-7e3f346ef13b"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:54.175232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b62f9f8c-4dac-4f43-bc2b-6e1af49073b3 req-a70b1a52-3f2b-4e35-a355-c8b420ccef5a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:54.175953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b62f9f8c-4dac-4f43-bc2b-6e1af49073b3 req-a70b1a52-3f2b-4e35-a355-c8b420ccef5a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:54.194665 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-b62f9f8c-4dac-4f43-bc2b-6e1af49073b3 req-a70b1a52-3f2b-4e35-a355-c8b420ccef5a service nova] Creating event network-vif-unplugged:648e11b1-5568-4d40-a6cd-7e3f346ef13b for instance d9604d14-4598-4d42-8bbf-8763103061a4 on n-h1-843621-1 May 27 15:08:54.203263 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-b62f9f8c-4dac-4f43-bc2b-6e1af49073b3 req-a70b1a52-3f2b-4e35-a355-c8b420ccef5a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063844 May 27 15:08:54.205496 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1447/2907] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:54.217037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6c1d633f-14c8-4d07-ab87-94e64f768ade tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:54.221598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6c1d633f-14c8-4d07-ab87-94e64f768ade tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:54.298760 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6c1d633f-14c8-4d07-ab87-94e64f768ade tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:54.310781 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6c1d633f-14c8-4d07-ab87-94e64f768ade tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1215 microversion: 2.1 time: 0.103861 May 27 15:08:54.311832 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1448/2908] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:54 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1215 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:54.353635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9f591f92-61a4-484f-9f58-791698afa75d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:54.367372 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9f591f92-61a4-484f-9f58-791698afa75d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.284722 May 27 15:08:54.368484 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1461/2909] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:54 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:54.424458 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-11a50807-88ce-45f9-9541-0def940d2a10 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:54.424999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-11a50807-88ce-45f9-9541-0def940d2a10 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:54.434641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11a50807-88ce-45f9-9541-0def940d2a10 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:54.435305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11a50807-88ce-45f9-9541-0def940d2a10 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:54.436628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11a50807-88ce-45f9-9541-0def940d2a10 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:54.437533 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11a50807-88ce-45f9-9541-0def940d2a10 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:54.477368 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-11a50807-88ce-45f9-9541-0def940d2a10 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments/f14fba0c-76ab-454d-8482-dfde0063ee0c" status: 200 len: 194 microversion: 2.20 time: 0.057175 May 27 15:08:54.478099 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1449/2910] 10.222.0.13 () {60 vars in 1453 bytes} [Fri May 27 15:08:54 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments/f14fba0c-76ab-454d-8482-dfde0063ee0c => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:08:54.604038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-efadaba3-25cb-4edb-a9cf-7a041c7091d0 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:54.605253 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-efadaba3-25cb-4edb-a9cf-7a041c7091d0 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:54.612917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-efadaba3-25cb-4edb-a9cf-7a041c7091d0 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:54.613567 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-efadaba3-25cb-4edb-a9cf-7a041c7091d0 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:54.614505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-efadaba3-25cb-4edb-a9cf-7a041c7091d0 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:54.615102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-efadaba3-25cb-4edb-a9cf-7a041c7091d0 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:54.773997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-efadaba3-25cb-4edb-a9cf-7a041c7091d0 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:54.784241 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-efadaba3-25cb-4edb-a9cf-7a041c7091d0 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1473 microversion: 2.1 time: 0.184467 May 27 15:08:54.785511 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1462/2911] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:54 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1473 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:54.943081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-49ee2820-0cec-4eff-996b-037b23728180 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:54.943813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-49ee2820-0cec-4eff-996b-037b23728180 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:54.951695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-49ee2820-0cec-4eff-996b-037b23728180 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:54.952485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-49ee2820-0cec-4eff-996b-037b23728180 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:54.954060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-49ee2820-0cec-4eff-996b-037b23728180 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:54.954827 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-49ee2820-0cec-4eff-996b-037b23728180 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:55.103928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c3044719-fc20-4bc7-8aa5-e7fe8999b860 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:55.105090 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c3044719-fc20-4bc7-8aa5-e7fe8999b860 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:55.124000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3044719-fc20-4bc7-8aa5-e7fe8999b860 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:55.128769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3044719-fc20-4bc7-8aa5-e7fe8999b860 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:55.130107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3044719-fc20-4bc7-8aa5-e7fe8999b860 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:55.130708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3044719-fc20-4bc7-8aa5-e7fe8999b860 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:55.171924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-49ee2820-0cec-4eff-996b-037b23728180 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:55.189090 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-49ee2820-0cec-4eff-996b-037b23728180 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1318 microversion: 2.1 time: 0.250192 May 27 15:08:55.199882 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1450/2912] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:54 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:55.229880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c3044719-fc20-4bc7-8aa5-e7fe8999b860 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:55.240801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c3044719-fc20-4bc7-8aa5-e7fe8999b860 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:55.242863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c3044719-fc20-4bc7-8aa5-e7fe8999b860 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:55.244193 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c3044719-fc20-4bc7-8aa5-e7fe8999b860 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.144708 May 27 15:08:55.246837 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1463/2913] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:55 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:08:55.331582 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0c9aa360-86bf-4591-b93a-7cc18255446c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:55.332615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0c9aa360-86bf-4591-b93a-7cc18255446c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:55.341032 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c9aa360-86bf-4591-b93a-7cc18255446c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:55.342081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c9aa360-86bf-4591-b93a-7cc18255446c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:55.343425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c9aa360-86bf-4591-b93a-7cc18255446c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:55.344025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c9aa360-86bf-4591-b93a-7cc18255446c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:55.387350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cb8d7930-4e8e-431b-b7f2-266a65923416 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:55.388813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cb8d7930-4e8e-431b-b7f2-266a65923416 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:55.403927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb8d7930-4e8e-431b-b7f2-266a65923416 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:55.406287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb8d7930-4e8e-431b-b7f2-266a65923416 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:55.407292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb8d7930-4e8e-431b-b7f2-266a65923416 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:55.413171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb8d7930-4e8e-431b-b7f2-266a65923416 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:55.554207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0c9aa360-86bf-4591-b93a-7cc18255446c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:55.566095 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0c9aa360-86bf-4591-b93a-7cc18255446c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1275 microversion: 2.1 time: 0.241536 May 27 15:08:55.569113 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1451/2914] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:55 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1275 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:55.734252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cb8d7930-4e8e-431b-b7f2-266a65923416 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:55.765484 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cb8d7930-4e8e-431b-b7f2-266a65923416 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.382638 May 27 15:08:55.769225 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1464/2915] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:55 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:55.802128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ce73639d-89e6-43bd-a724-23e6804f5466 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:55.803023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ce73639d-89e6-43bd-a724-23e6804f5466 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:55.810069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ce73639d-89e6-43bd-a724-23e6804f5466 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:55.810744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ce73639d-89e6-43bd-a724-23e6804f5466 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:55.811677 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ce73639d-89e6-43bd-a724-23e6804f5466 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:55.812268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ce73639d-89e6-43bd-a724-23e6804f5466 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:56.024705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ce73639d-89e6-43bd-a724-23e6804f5466 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e745803913eb40a9bb7fb90f59d574c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9f274a9b24495fa40d9c8be7dcc3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:56.039712 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ce73639d-89e6-43bd-a724-23e6804f5466 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 200 len: 1473 microversion: 2.1 time: 0.241307 May 27 15:08:56.040301 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1452/2916] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:55 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 1473 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:56.207149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-785a760b-5dac-4b54-9cb9-331b32145486 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:56.208767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-785a760b-5dac-4b54-9cb9-331b32145486 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:56.221263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-16a70869-3ed1-446c-87ee-59739d5adc13 req-1709e299-c487-4aa6-b140-3cb034297690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3996f065-a4c2-40b5-9189-8fe1334f1d18", "name": "network-vif-plugged", "status": "completed", "tag": "1bcb594f-fe75-4ee2-b07a-dcae39e8c831"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:56.245457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-785a760b-5dac-4b54-9cb9-331b32145486 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:56.246185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-785a760b-5dac-4b54-9cb9-331b32145486 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:56.247430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-785a760b-5dac-4b54-9cb9-331b32145486 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:56.249331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-785a760b-5dac-4b54-9cb9-331b32145486 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:56.251155 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-16a70869-3ed1-446c-87ee-59739d5adc13 req-1709e299-c487-4aa6-b140-3cb034297690 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:56.258543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-16a70869-3ed1-446c-87ee-59739d5adc13 req-1709e299-c487-4aa6-b140-3cb034297690 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:56.301603 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-16a70869-3ed1-446c-87ee-59739d5adc13 req-1709e299-c487-4aa6-b140-3cb034297690 service nova] Creating event network-vif-plugged:1bcb594f-fe75-4ee2-b07a-dcae39e8c831 for instance 3996f065-a4c2-40b5-9189-8fe1334f1d18 on n-h2-843621-1 May 27 15:08:56.315650 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-16a70869-3ed1-446c-87ee-59739d5adc13 req-1709e299-c487-4aa6-b140-3cb034297690 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098809 May 27 15:08:56.316638 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1453/2917] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:56.333981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f4556120-a994-42e2-85ed-518325fb7c48 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:56.334756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f4556120-a994-42e2-85ed-518325fb7c48 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:56.352208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4556120-a994-42e2-85ed-518325fb7c48 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:56.352702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4556120-a994-42e2-85ed-518325fb7c48 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:56.356002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4556120-a994-42e2-85ed-518325fb7c48 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:56.356451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4556120-a994-42e2-85ed-518325fb7c48 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:56.621984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f4556120-a994-42e2-85ed-518325fb7c48 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:56.643545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f4556120-a994-42e2-85ed-518325fb7c48 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:56.645123 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f4556120-a994-42e2-85ed-518325fb7c48 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:56.646500 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f4556120-a994-42e2-85ed-518325fb7c48 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.325817 May 27 15:08:56.647230 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1454/2918] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:56 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:56.657677 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-73cec49f-e3e1-4644-984b-ad6e4db012b1 req-e972b484-4c50-4fe1-b5d8-3cab4c8d8bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9604d14-4598-4d42-8bbf-8763103061a4", "name": "network-vif-deleted", "tag": "648e11b1-5568-4d40-a6cd-7e3f346ef13b"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:56.668346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-73cec49f-e3e1-4644-984b-ad6e4db012b1 req-e972b484-4c50-4fe1-b5d8-3cab4c8d8bae service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:56.668946 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-73cec49f-e3e1-4644-984b-ad6e4db012b1 req-e972b484-4c50-4fe1-b5d8-3cab4c8d8bae service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:56.684375 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-73cec49f-e3e1-4644-984b-ad6e4db012b1 req-e972b484-4c50-4fe1-b5d8-3cab4c8d8bae service nova] Creating event network-vif-deleted:648e11b1-5568-4d40-a6cd-7e3f346ef13b for instance d9604d14-4598-4d42-8bbf-8763103061a4 on n-h1-843621-1 May 27 15:08:56.691721 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-73cec49f-e3e1-4644-984b-ad6e4db012b1 req-e972b484-4c50-4fe1-b5d8-3cab4c8d8bae service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037488 May 27 15:08:56.693962 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1455/2919] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:56.703268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c1686986-1219-4141-85d7-9ab2702fa5f3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:56.704042 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c1686986-1219-4141-85d7-9ab2702fa5f3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:56.713763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1686986-1219-4141-85d7-9ab2702fa5f3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:56.715062 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1686986-1219-4141-85d7-9ab2702fa5f3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:56.716127 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1686986-1219-4141-85d7-9ab2702fa5f3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:56.717568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1686986-1219-4141-85d7-9ab2702fa5f3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:56.750185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-785a760b-5dac-4b54-9cb9-331b32145486 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:56.758541 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-785a760b-5dac-4b54-9cb9-331b32145486 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1318 microversion: 2.1 time: 0.555256 May 27 15:08:56.761959 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1465/2920] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:56 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1318 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:56.788205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2332c50b-7e9b-4847-a4f8-8ff3db44b73d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:56.789252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2332c50b-7e9b-4847-a4f8-8ff3db44b73d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:56.807535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2332c50b-7e9b-4847-a4f8-8ff3db44b73d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:56.808101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2332c50b-7e9b-4847-a4f8-8ff3db44b73d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:56.808883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2332c50b-7e9b-4847-a4f8-8ff3db44b73d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:56.809328 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2332c50b-7e9b-4847-a4f8-8ff3db44b73d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:56.822711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c1686986-1219-4141-85d7-9ab2702fa5f3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:56.831191 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c1686986-1219-4141-85d7-9ab2702fa5f3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1273 microversion: 2.1 time: 0.135755 May 27 15:08:56.832160 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1456/2921] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:56 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1273 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:57.056908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c719aa15-cd55-44ee-8324-dba9da8285a4 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:57.057455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c719aa15-cd55-44ee-8324-dba9da8285a4 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] [instance: d9604d14-4598-4d42-8bbf-8763103061a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:57.065892 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c719aa15-cd55-44ee-8324-dba9da8285a4 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:57.066361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c719aa15-cd55-44ee-8324-dba9da8285a4 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:57.067156 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c719aa15-cd55-44ee-8324-dba9da8285a4 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:57.067600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c719aa15-cd55-44ee-8324-dba9da8285a4 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:57.082941 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-c719aa15-cd55-44ee-8324-dba9da8285a4 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] HTTP exception thrown: Instance d9604d14-4598-4d42-8bbf-8763103061a4 could not be found. May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c719aa15-cd55-44ee-8324-dba9da8285a4 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Request method failure captured: May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 HTTP/1.1 May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOkLw3INIZDNXYbUpaDGNyrEDcC-bZsl9fj6FRXrQg_YTD8CZEo8hFSFoN3WtFgtoljuvf5OM8DZNuwL4vFZF7dsTQT28b9i-dO_pSu83obGi8ncL76MGF-9UaAhWcfo2EbOKE4fB3WiMkfixRMRzCiMtAU8FdeEAoaR5nxhT1-AkRc May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 6f9f274a9b24495fa40d9c8be7dcc3d5 May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ImagesOneServerTestJSON-754826229 May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f9f274a9b24495fa40d9c8be7dcc3d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6f9f274a9b24495fa40d9c8be7dcc3d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6f9f274a9b24495fa40d9c8be7dcc3d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6f9f274a9b24495fa40d9c8be7dcc3d5", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ImagesOneServerTestJSON-754826229 May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 6f9f274a9b24495fa40d9c8be7dcc3d5 May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-754826229 May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ImagesOneServerTestJSON-754826229-project May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: e745803913eb40a9bb7fb90f59d574c9 May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ImagesOneServerTestJSON-754826229-project May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance d9604d14-4598-4d42-8bbf-8763103061a4 could not be found. May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'd9604d14-4598-4d42-8bbf-8763103061a4'} May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9604d14-4598-4d42-8bbf-8763103061a4 could not be found. May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9604d14-4598-4d42-8bbf-8763103061a4 could not be found. May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:08:57.084631 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:08:57.088096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:08:57.088096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:08:57.088096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:08:57.088096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:08:57.088096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:08:57.088096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9604d14-4598-4d42-8bbf-8763103061a4 could not be found. May 27 15:08:57.088096 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:08:57.088096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c719aa15-cd55-44ee-8324-dba9da8285a4 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] Returning 404 to user: Instance d9604d14-4598-4d42-8bbf-8763103061a4 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:08:57.088096 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c719aa15-cd55-44ee-8324-dba9da8285a4 tempest-ImagesOneServerTestJSON-754826229 tempest-ImagesOneServerTestJSON-754826229-project] 10.222.0.13 "GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4" status: 404 len: 111 microversion: 2.1 time: 0.033218 May 27 15:08:57.088096 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1457/2922] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:57 2022] GET /compute/v2.1/servers/d9604d14-4598-4d42-8bbf-8763103061a4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:08:57.138452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2332c50b-7e9b-4847-a4f8-8ff3db44b73d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:57.149604 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2332c50b-7e9b-4847-a4f8-8ff3db44b73d tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.367785 May 27 15:08:57.151119 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1466/2923] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:56 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:57.667661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a70a119c-57b9-4bf5-bc3c-7626c9a18d89 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:57.669916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a70a119c-57b9-4bf5-bc3c-7626c9a18d89 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:57.688434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a70a119c-57b9-4bf5-bc3c-7626c9a18d89 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:57.689044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a70a119c-57b9-4bf5-bc3c-7626c9a18d89 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:57.689855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a70a119c-57b9-4bf5-bc3c-7626c9a18d89 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:57.690303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a70a119c-57b9-4bf5-bc3c-7626c9a18d89 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:57.788308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f6c3dc49-c2b4-47c5-8e88-b01643ed5501 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:57.789173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f6c3dc49-c2b4-47c5-8e88-b01643ed5501 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:57.802900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a70a119c-57b9-4bf5-bc3c-7626c9a18d89 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:57.812529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f6c3dc49-c2b4-47c5-8e88-b01643ed5501 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:57.815365 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f6c3dc49-c2b4-47c5-8e88-b01643ed5501 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:57.816528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a70a119c-57b9-4bf5-bc3c-7626c9a18d89 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:57.816923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f6c3dc49-c2b4-47c5-8e88-b01643ed5501 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:57.818296 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a70a119c-57b9-4bf5-bc3c-7626c9a18d89 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:57.818907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f6c3dc49-c2b4-47c5-8e88-b01643ed5501 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:57.830334 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a70a119c-57b9-4bf5-bc3c-7626c9a18d89 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.167030 May 27 15:08:57.831518 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1458/2924] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:57 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:57.850033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-528e58ce-203e-4e44-8b4e-ab826cc24f03 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:57.850998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-528e58ce-203e-4e44-8b4e-ab826cc24f03 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:57.875047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-528e58ce-203e-4e44-8b4e-ab826cc24f03 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:57.875955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-528e58ce-203e-4e44-8b4e-ab826cc24f03 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:57.877768 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-528e58ce-203e-4e44-8b4e-ab826cc24f03 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:57.880211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-528e58ce-203e-4e44-8b4e-ab826cc24f03 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:58.179431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-528e58ce-203e-4e44-8b4e-ab826cc24f03 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:58.194250 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-528e58ce-203e-4e44-8b4e-ab826cc24f03 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1315 microversion: 2.1 time: 0.341797 May 27 15:08:58.204322 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1459/2925] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:57 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:08:58.209154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-69eaa860-474b-4784-8963-a50ba149f144 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:58.209763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-69eaa860-474b-4784-8963-a50ba149f144 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:58.216977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69eaa860-474b-4784-8963-a50ba149f144 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:58.217436 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69eaa860-474b-4784-8963-a50ba149f144 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:58.218741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69eaa860-474b-4784-8963-a50ba149f144 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:58.219248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69eaa860-474b-4784-8963-a50ba149f144 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:58.255445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f6c3dc49-c2b4-47c5-8e88-b01643ed5501 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:58.266482 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f6c3dc49-c2b4-47c5-8e88-b01643ed5501 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1507 microversion: 2.1 time: 0.491944 May 27 15:08:58.268713 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1467/2926] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:57 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1507 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:58.285560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a231acd8-0a81-42e9-985b-014704ada0fe tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:58.286189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a231acd8-0a81-42e9-985b-014704ada0fe tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:58.293480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a231acd8-0a81-42e9-985b-014704ada0fe tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:58.294007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a231acd8-0a81-42e9-985b-014704ada0fe tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:58.295326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a231acd8-0a81-42e9-985b-014704ada0fe tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:58.295835 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a231acd8-0a81-42e9-985b-014704ada0fe tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:58.302731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=13,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:58.550823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-69eaa860-474b-4784-8963-a50ba149f144 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:58.561421 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-69eaa860-474b-4784-8963-a50ba149f144 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.355962 May 27 15:08:58.562011 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1460/2927] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:58 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:58.650702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a231acd8-0a81-42e9-985b-014704ada0fe tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:58.667011 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a231acd8-0a81-42e9-985b-014704ada0fe tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1507 microversion: 2.1 time: 0.380999 May 27 15:08:58.668194 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1468/2928] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:58 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1507 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:58.684752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-86d4d39d-6857-4de8-9da2-0791aad5ead1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:58.687105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-86d4d39d-6857-4de8-9da2-0791aad5ead1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:58.693449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-14f80e64-84f1-4b06-86aa-a06bae9b1816 req-63acaad0-db49-40b5-b175-cb74c1d8f507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f1bb984-1a95-44b2-b300-7a5986ca934a", "tag": "7d5b5621-1291-4caf-8754-cb86cd6b4daf"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:58.699376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-86d4d39d-6857-4de8-9da2-0791aad5ead1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:58.703131 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-86d4d39d-6857-4de8-9da2-0791aad5ead1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:58.704071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-14f80e64-84f1-4b06-86aa-a06bae9b1816 req-63acaad0-db49-40b5-b175-cb74c1d8f507 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:58.704949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-86d4d39d-6857-4de8-9da2-0791aad5ead1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:58.705348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-14f80e64-84f1-4b06-86aa-a06bae9b1816 req-63acaad0-db49-40b5-b175-cb74c1d8f507 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:58.705752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-86d4d39d-6857-4de8-9da2-0791aad5ead1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:58.721625 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-14f80e64-84f1-4b06-86aa-a06bae9b1816 req-63acaad0-db49-40b5-b175-cb74c1d8f507 service nova] Creating event network-changed:7d5b5621-1291-4caf-8754-cb86cd6b4daf for instance 5f1bb984-1a95-44b2-b300-7a5986ca934a on n-h2-843621-1 May 27 15:08:58.727626 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-14f80e64-84f1-4b06-86aa-a06bae9b1816 req-63acaad0-db49-40b5-b175-cb74c1d8f507 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036853 May 27 15:08:58.731260 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1469/2929] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:08:58.778361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:58.816030 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-86d4d39d-6857-4de8-9da2-0791aad5ead1 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "PUT /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1079 microversion: 2.1 time: 0.136762 May 27 15:08:58.817353 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1461/2930] 10.222.0.13 () {60 vars in 1255 bytes} [Fri May 27 15:08:58 2022] PUT /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1079 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:58.833525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-92ab41c2-b9f5-41ca-9ad4-c33200b9bfca tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:58.835127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-92ab41c2-b9f5-41ca-9ad4-c33200b9bfca tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:58.844130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-92ab41c2-b9f5-41ca-9ad4-c33200b9bfca tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:58.845060 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-92ab41c2-b9f5-41ca-9ad4-c33200b9bfca tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:58.848078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-92ab41c2-b9f5-41ca-9ad4-c33200b9bfca tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:58.848805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-92ab41c2-b9f5-41ca-9ad4-c33200b9bfca tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:58.850147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-475a6ecc-9fc2-41ca-9f1a-c6bd17616d22 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:58.851680 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-475a6ecc-9fc2-41ca-9f1a-c6bd17616d22 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:58.865618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-475a6ecc-9fc2-41ca-9f1a-c6bd17616d22 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:58.866344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-475a6ecc-9fc2-41ca-9f1a-c6bd17616d22 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:58.868077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-475a6ecc-9fc2-41ca-9f1a-c6bd17616d22 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:58.868802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-475a6ecc-9fc2-41ca-9f1a-c6bd17616d22 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:59.028580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-475a6ecc-9fc2-41ca-9f1a-c6bd17616d22 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:59.043392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-475a6ecc-9fc2-41ca-9f1a-c6bd17616d22 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:59.045514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-475a6ecc-9fc2-41ca-9f1a-c6bd17616d22 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:59.048637 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-475a6ecc-9fc2-41ca-9f1a-c6bd17616d22 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.202418 May 27 15:08:59.064061 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1462/2931] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:08:58 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:08:59.176868 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-92ab41c2-b9f5-41ca-9ad4-c33200b9bfca tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:59.187155 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-92ab41c2-b9f5-41ca-9ad4-c33200b9bfca tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1505 microversion: 2.1 time: 0.358366 May 27 15:08:59.187998 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1470/2932] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:58 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:59.203986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-174005dd-d967-4c87-8d60-3b65efc9b87e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:59.206136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-174005dd-d967-4c87-8d60-3b65efc9b87e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:59.212603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-174005dd-d967-4c87-8d60-3b65efc9b87e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:59.213093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-174005dd-d967-4c87-8d60-3b65efc9b87e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:59.214414 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-174005dd-d967-4c87-8d60-3b65efc9b87e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:59.218024 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-174005dd-d967-4c87-8d60-3b65efc9b87e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:59.226508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6dd3f542-39e9-4176-957e-a6e35a136f1a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:59.227242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6dd3f542-39e9-4176-957e-a6e35a136f1a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:59.238121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6dd3f542-39e9-4176-957e-a6e35a136f1a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:59.240403 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6dd3f542-39e9-4176-957e-a6e35a136f1a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:59.241267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6dd3f542-39e9-4176-957e-a6e35a136f1a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:59.241909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6dd3f542-39e9-4176-957e-a6e35a136f1a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:59.592250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-174005dd-d967-4c87-8d60-3b65efc9b87e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:59.600502 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-174005dd-d967-4c87-8d60-3b65efc9b87e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1505 microversion: 2.1 time: 0.400439 May 27 15:08:59.610417 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1463/2933] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:59 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:59.617052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5108c0cf-9d4c-49a9-9379-a7e6e5f1f739 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:59.618244 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5108c0cf-9d4c-49a9-9379-a7e6e5f1f739 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:59.636499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5108c0cf-9d4c-49a9-9379-a7e6e5f1f739 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:59.637297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5108c0cf-9d4c-49a9-9379-a7e6e5f1f739 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:59.639279 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5108c0cf-9d4c-49a9-9379-a7e6e5f1f739 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:59.641037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5108c0cf-9d4c-49a9-9379-a7e6e5f1f739 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:59.824356 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6dd3f542-39e9-4176-957e-a6e35a136f1a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:59.834957 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6dd3f542-39e9-4176-957e-a6e35a136f1a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1315 microversion: 2.1 time: 0.619002 May 27 15:08:59.845806 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1471/2934] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:59 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:59.851260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7c910442-5041-4d3e-80a9-a6167863a95b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "346e776e-8931-417f-87da-575810efb12b", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:08:59.853059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7c910442-5041-4d3e-80a9-a6167863a95b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:08:59.861840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c910442-5041-4d3e-80a9-a6167863a95b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:59.862525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c910442-5041-4d3e-80a9-a6167863a95b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:59.863465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c910442-5041-4d3e-80a9-a6167863a95b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:08:59.864064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c910442-5041-4d3e-80a9-a6167863a95b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:08:59.869085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5108c0cf-9d4c-49a9-9379-a7e6e5f1f739 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:08:59.877631 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5108c0cf-9d4c-49a9-9379-a7e6e5f1f739 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.265939 May 27 15:08:59.878218 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1464/2935] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:08:59 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:59.965056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-7c910442-5041-4d3e-80a9-a6167863a95b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:08:59.965485 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-7c910442-5041-4d3e-80a9-a6167863a95b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:08:59.965964 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-7c910442-5041-4d3e-80a9-a6167863a95b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:08:59.966375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-7c910442-5041-4d3e-80a9-a6167863a95b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:08:59.966790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-7c910442-5041-4d3e-80a9-a6167863a95b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:09:00.055045 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7c910442-5041-4d3e-80a9-a6167863a95b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:00.067272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d82dcb32-3594-4499-8039-cebe59f62816 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:00.068235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d82dcb32-3594-4499-8039-cebe59f62816 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:00.068776 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c910442-5041-4d3e-80a9-a6167863a95b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:00.069456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c910442-5041-4d3e-80a9-a6167863a95b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:00.070440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c910442-5041-4d3e-80a9-a6167863a95b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:00.071089 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c910442-5041-4d3e-80a9-a6167863a95b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:00.093668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d82dcb32-3594-4499-8039-cebe59f62816 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:00.094144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d82dcb32-3594-4499-8039-cebe59f62816 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:00.094963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d82dcb32-3594-4499-8039-cebe59f62816 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:00.095424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d82dcb32-3594-4499-8039-cebe59f62816 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:00.106149 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7c910442-5041-4d3e-80a9-a6167863a95b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "POST /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18/action" status: 202 len: 1111 microversion: 2.1 time: 0.258928 May 27 15:09:00.107675 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1472/2936] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:08:59 2022] POST /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18/action => generated 1111 bytes in 261 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 27 15:09:00.133994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b10b43e8-6c93-4646-a1c7-b1c23079e46d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:00.137124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b10b43e8-6c93-4646-a1c7-b1c23079e46d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:00.154383 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b10b43e8-6c93-4646-a1c7-b1c23079e46d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:00.157700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b10b43e8-6c93-4646-a1c7-b1c23079e46d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:00.159673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b10b43e8-6c93-4646-a1c7-b1c23079e46d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:00.161600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b10b43e8-6c93-4646-a1c7-b1c23079e46d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:00.304198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d82dcb32-3594-4499-8039-cebe59f62816 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:00.324875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d82dcb32-3594-4499-8039-cebe59f62816 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:00.332585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d82dcb32-3594-4499-8039-cebe59f62816 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:00.340968 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d82dcb32-3594-4499-8039-cebe59f62816 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.273357 May 27 15:09:00.342119 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1465/2937] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:00 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:09:00.530423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b10b43e8-6c93-4646-a1c7-b1c23079e46d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:00.542642 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b10b43e8-6c93-4646-a1c7-b1c23079e46d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.420593 May 27 15:09:00.543251 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1473/2938] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:00 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:00.853323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-31a8b22f-d391-4675-969f-a2ab6e7c71fa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:00.857712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-31a8b22f-d391-4675-969f-a2ab6e7c71fa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:00.867908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-31a8b22f-d391-4675-969f-a2ab6e7c71fa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:00.868621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-31a8b22f-d391-4675-969f-a2ab6e7c71fa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:00.869707 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-31a8b22f-d391-4675-969f-a2ab6e7c71fa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:00.871154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-31a8b22f-d391-4675-969f-a2ab6e7c71fa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:00.896321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5adbef6b-050a-42d0-9bf5-91d273b4a287 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:00.896882 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5adbef6b-050a-42d0-9bf5-91d273b4a287 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:00.908511 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5adbef6b-050a-42d0-9bf5-91d273b4a287 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:00.915348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5adbef6b-050a-42d0-9bf5-91d273b4a287 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:00.916287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5adbef6b-050a-42d0-9bf5-91d273b4a287 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:00.916825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5adbef6b-050a-42d0-9bf5-91d273b4a287 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:01.412866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5adbef6b-050a-42d0-9bf5-91d273b4a287 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:01.422543 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5adbef6b-050a-42d0-9bf5-91d273b4a287 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.530390 May 27 15:09:01.432060 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1474/2939] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:00 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:01.432060 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-078af6cb-491a-4fc7-8d93-41f042965cdc tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:01.432060 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-078af6cb-491a-4fc7-8d93-41f042965cdc tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:01.437020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:01.455020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-31a8b22f-d391-4675-969f-a2ab6e7c71fa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:01.467915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-078af6cb-491a-4fc7-8d93-41f042965cdc tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:01.468526 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-31a8b22f-d391-4675-969f-a2ab6e7c71fa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1315 microversion: 2.1 time: 0.618413 May 27 15:09:01.470101 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1466/2940] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:00 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:01.472308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-078af6cb-491a-4fc7-8d93-41f042965cdc tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:01.473401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-078af6cb-491a-4fc7-8d93-41f042965cdc tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:01.475382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-078af6cb-491a-4fc7-8d93-41f042965cdc tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:01.561790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fc1238f0-e95b-4ce5-bcb2-47fc3d7d4c2a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:01.562986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fc1238f0-e95b-4ce5-bcb2-47fc3d7d4c2a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:01.577214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc1238f0-e95b-4ce5-bcb2-47fc3d7d4c2a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:01.577864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc1238f0-e95b-4ce5-bcb2-47fc3d7d4c2a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:01.578853 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc1238f0-e95b-4ce5-bcb2-47fc3d7d4c2a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:01.579270 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc1238f0-e95b-4ce5-bcb2-47fc3d7d4c2a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:01.627789 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-078af6cb-491a-4fc7-8d93-41f042965cdc tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:01.639646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-078af6cb-491a-4fc7-8d93-41f042965cdc tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:01.641388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-078af6cb-491a-4fc7-8d93-41f042965cdc tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:01.642705 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-078af6cb-491a-4fc7-8d93-41f042965cdc tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.217945 May 27 15:09:01.643538 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1475/2941] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:01 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:09:02.141192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fc1238f0-e95b-4ce5-bcb2-47fc3d7d4c2a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:02.155469 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fc1238f0-e95b-4ce5-bcb2-47fc3d7d4c2a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.599864 May 27 15:09:02.156827 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1467/2942] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:01 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:02.443662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d662fed9-b0b6-4ae1-b8f4-a10a84fae510 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:02.444302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d662fed9-b0b6-4ae1-b8f4-a10a84fae510 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:02.459252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d662fed9-b0b6-4ae1-b8f4-a10a84fae510 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:02.459727 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d662fed9-b0b6-4ae1-b8f4-a10a84fae510 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:02.460550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d662fed9-b0b6-4ae1-b8f4-a10a84fae510 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:02.461044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d662fed9-b0b6-4ae1-b8f4-a10a84fae510 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:02.487352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5952dacd-8acf-4b2b-a5c1-c0f65018da16 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:02.488255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5952dacd-8acf-4b2b-a5c1-c0f65018da16 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:02.496979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5952dacd-8acf-4b2b-a5c1-c0f65018da16 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:02.497783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5952dacd-8acf-4b2b-a5c1-c0f65018da16 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:02.498806 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5952dacd-8acf-4b2b-a5c1-c0f65018da16 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:02.500300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5952dacd-8acf-4b2b-a5c1-c0f65018da16 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:02.771742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d662fed9-b0b6-4ae1-b8f4-a10a84fae510 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:02.794314 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d662fed9-b0b6-4ae1-b8f4-a10a84fae510 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.354842 May 27 15:09:02.795439 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1476/2943] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:02 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:02.805366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bee1dcb0-60ba-467a-a187-57a5f3d5d400 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:02.806248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bee1dcb0-60ba-467a-a187-57a5f3d5d400 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:02.821400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bee1dcb0-60ba-467a-a187-57a5f3d5d400 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:02.824664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bee1dcb0-60ba-467a-a187-57a5f3d5d400 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:02.827210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bee1dcb0-60ba-467a-a187-57a5f3d5d400 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:02.827914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bee1dcb0-60ba-467a-a187-57a5f3d5d400 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:02.969576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bee1dcb0-60ba-467a-a187-57a5f3d5d400 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:02.995904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bee1dcb0-60ba-467a-a187-57a5f3d5d400 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:02.998207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bee1dcb0-60ba-467a-a187-57a5f3d5d400 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:02.999686 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bee1dcb0-60ba-467a-a187-57a5f3d5d400 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.203109 May 27 15:09:03.000773 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1477/2944] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:02 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:09:03.018929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5952dacd-8acf-4b2b-a5c1-c0f65018da16 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:03.032689 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5952dacd-8acf-4b2b-a5c1-c0f65018da16 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1315 microversion: 2.1 time: 0.549160 May 27 15:09:03.033294 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1468/2945] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:02 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1315 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:03.172325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ab041a67-d183-4fcb-959a-8ce8f770f522 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:03.174036 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ab041a67-d183-4fcb-959a-8ce8f770f522 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:03.181503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab041a67-d183-4fcb-959a-8ce8f770f522 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:03.182362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab041a67-d183-4fcb-959a-8ce8f770f522 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:03.184977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab041a67-d183-4fcb-959a-8ce8f770f522 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:03.185718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab041a67-d183-4fcb-959a-8ce8f770f522 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:03.506056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ab041a67-d183-4fcb-959a-8ce8f770f522 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:03.520913 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ab041a67-d183-4fcb-959a-8ce8f770f522 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.352332 May 27 15:09:03.522779 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1478/2946] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:03 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:03.814864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bbbc2930-ac2f-496f-a858-5447b6585407 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:03.815536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bbbc2930-ac2f-496f-a858-5447b6585407 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:03.827682 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bbbc2930-ac2f-496f-a858-5447b6585407 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:03.829578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bbbc2930-ac2f-496f-a858-5447b6585407 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:03.831670 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bbbc2930-ac2f-496f-a858-5447b6585407 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:03.832303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bbbc2930-ac2f-496f-a858-5447b6585407 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:03.994382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:04.020260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3947500d-e03f-4f00-8cec-60f3d417ef70 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:04.021083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3947500d-e03f-4f00-8cec-60f3d417ef70 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:04.030990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3947500d-e03f-4f00-8cec-60f3d417ef70 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:04.034300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3947500d-e03f-4f00-8cec-60f3d417ef70 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:04.040553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3947500d-e03f-4f00-8cec-60f3d417ef70 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:04.041166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3947500d-e03f-4f00-8cec-60f3d417ef70 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:04.136426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bbbc2930-ac2f-496f-a858-5447b6585407 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:04.154689 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bbbc2930-ac2f-496f-a858-5447b6585407 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.335924 May 27 15:09:04.155605 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1469/2947] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:03 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:04.160738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-70ac5ca8-91e2-4e14-9ecb-483de32f1063 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:04.164395 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-70ac5ca8-91e2-4e14-9ecb-483de32f1063 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:04.180794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70ac5ca8-91e2-4e14-9ecb-483de32f1063 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:04.184163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70ac5ca8-91e2-4e14-9ecb-483de32f1063 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:04.185262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70ac5ca8-91e2-4e14-9ecb-483de32f1063 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:04.186116 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70ac5ca8-91e2-4e14-9ecb-483de32f1063 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:04.213219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3947500d-e03f-4f00-8cec-60f3d417ef70 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:04.228493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3947500d-e03f-4f00-8cec-60f3d417ef70 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:04.236130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3947500d-e03f-4f00-8cec-60f3d417ef70 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:04.238034 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3947500d-e03f-4f00-8cec-60f3d417ef70 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.222589 May 27 15:09:04.238998 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1479/2948] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:04 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:09:04.307387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=8 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:04.490653 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-70ac5ca8-91e2-4e14-9ecb-483de32f1063 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:04.499118 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-70ac5ca8-91e2-4e14-9ecb-483de32f1063 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1315 microversion: 2.1 time: 0.342274 May 27 15:09:04.516659 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1470/2949] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:04 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:04.537972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-10dd4758-30c0-43a7-a267-94ac014e426d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:04.538596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-10dd4758-30c0-43a7-a267-94ac014e426d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:04.552655 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10dd4758-30c0-43a7-a267-94ac014e426d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:04.553447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10dd4758-30c0-43a7-a267-94ac014e426d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:04.554413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10dd4758-30c0-43a7-a267-94ac014e426d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:04.555018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10dd4758-30c0-43a7-a267-94ac014e426d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:04.817420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-10dd4758-30c0-43a7-a267-94ac014e426d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:04.835249 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-10dd4758-30c0-43a7-a267-94ac014e426d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.299424 May 27 15:09:04.842627 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1480/2950] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:04 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:05.172620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9098c821-5fa4-463d-a597-6ccab2c2a4cd tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:05.174268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9098c821-5fa4-463d-a597-6ccab2c2a4cd tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:05.186577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9098c821-5fa4-463d-a597-6ccab2c2a4cd tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:05.188417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9098c821-5fa4-463d-a597-6ccab2c2a4cd tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:05.191665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9098c821-5fa4-463d-a597-6ccab2c2a4cd tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:05.192369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9098c821-5fa4-463d-a597-6ccab2c2a4cd tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:05.252404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-8ab42966-e449-4a55-95f4-314514068516 req-ef4e5c6d-1378-4a46-bcd9-21db7630fb22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f1bb984-1a95-44b2-b300-7a5986ca934a", "name": "network-vif-plugged", "status": "completed", "tag": "7d5b5621-1291-4caf-8754-cb86cd6b4daf"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:05.281577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-8ab42966-e449-4a55-95f4-314514068516 req-ef4e5c6d-1378-4a46-bcd9-21db7630fb22 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:05.282042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-8ab42966-e449-4a55-95f4-314514068516 req-ef4e5c6d-1378-4a46-bcd9-21db7630fb22 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:05.322406 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-8ab42966-e449-4a55-95f4-314514068516 req-ef4e5c6d-1378-4a46-bcd9-21db7630fb22 service nova] Creating event network-vif-plugged:7d5b5621-1291-4caf-8754-cb86cd6b4daf for instance 5f1bb984-1a95-44b2-b300-7a5986ca934a on n-h2-843621-1 May 27 15:09:05.349596 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-8ab42966-e449-4a55-95f4-314514068516 req-ef4e5c6d-1378-4a46-bcd9-21db7630fb22 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101851 May 27 15:09:05.373967 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1481/2951] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:09:05.380300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e8b29235-15b8-4955-b877-54f1f1edd93a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:05.381052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e8b29235-15b8-4955-b877-54f1f1edd93a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:05.387994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e8b29235-15b8-4955-b877-54f1f1edd93a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:05.388813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e8b29235-15b8-4955-b877-54f1f1edd93a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:05.392250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e8b29235-15b8-4955-b877-54f1f1edd93a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:05.392951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e8b29235-15b8-4955-b877-54f1f1edd93a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:05.684701 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e8b29235-15b8-4955-b877-54f1f1edd93a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:05.706529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e8b29235-15b8-4955-b877-54f1f1edd93a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:05.708974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e8b29235-15b8-4955-b877-54f1f1edd93a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:05.710406 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e8b29235-15b8-4955-b877-54f1f1edd93a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.335078 May 27 15:09:05.722544 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1482/2952] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:05 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:09:05.728486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5941d4ad-8b8e-4c5b-bbbc-afe7b2ece25e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:05.729420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5941d4ad-8b8e-4c5b-bbbc-afe7b2ece25e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:05.737390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5941d4ad-8b8e-4c5b-bbbc-afe7b2ece25e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:05.740150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5941d4ad-8b8e-4c5b-bbbc-afe7b2ece25e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:05.740150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5941d4ad-8b8e-4c5b-bbbc-afe7b2ece25e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:05.740150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5941d4ad-8b8e-4c5b-bbbc-afe7b2ece25e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:05.766160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9098c821-5fa4-463d-a597-6ccab2c2a4cd tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:05.780033 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9098c821-5fa4-463d-a597-6ccab2c2a4cd tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.610100 May 27 15:09:05.785346 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1471/2953] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:05 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:05.851218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a6061b33-832c-460e-a6b8-997a10e66717 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:05.852093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a6061b33-832c-460e-a6b8-997a10e66717 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:05.868623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a6061b33-832c-460e-a6b8-997a10e66717 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:05.874628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a6061b33-832c-460e-a6b8-997a10e66717 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:05.875716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a6061b33-832c-460e-a6b8-997a10e66717 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:05.877900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a6061b33-832c-460e-a6b8-997a10e66717 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:06.049435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5941d4ad-8b8e-4c5b-bbbc-afe7b2ece25e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:06.061315 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5941d4ad-8b8e-4c5b-bbbc-afe7b2ece25e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1315 microversion: 2.1 time: 0.337146 May 27 15:09:06.062261 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1483/2954] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:05 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:06.175971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a6061b33-832c-460e-a6b8-997a10e66717 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:06.186458 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a6061b33-832c-460e-a6b8-997a10e66717 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.340262 May 27 15:09:06.197457 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1472/2955] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:05 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:06.731066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-410db87b-5c9a-420f-bbc5-dc1ac2958cda tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:06.733205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-410db87b-5c9a-420f-bbc5-dc1ac2958cda tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:06.741505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-410db87b-5c9a-420f-bbc5-dc1ac2958cda tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:06.742137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-410db87b-5c9a-420f-bbc5-dc1ac2958cda tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:06.744326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-410db87b-5c9a-420f-bbc5-dc1ac2958cda tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:06.744815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-410db87b-5c9a-420f-bbc5-dc1ac2958cda tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:06.749533 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:06.846957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-410db87b-5c9a-420f-bbc5-dc1ac2958cda tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:06.857144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-410db87b-5c9a-420f-bbc5-dc1ac2958cda tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:06.859830 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-410db87b-5c9a-420f-bbc5-dc1ac2958cda tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:06.861933 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-410db87b-5c9a-420f-bbc5-dc1ac2958cda tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.135547 May 27 15:09:06.862693 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1484/2956] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:06 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:09:06.874065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6ea2053e-878f-457b-bea7-09b548c55b5e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:06.874947 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6ea2053e-878f-457b-bea7-09b548c55b5e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:06.881418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ea2053e-878f-457b-bea7-09b548c55b5e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:06.882110 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ea2053e-878f-457b-bea7-09b548c55b5e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:06.883061 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ea2053e-878f-457b-bea7-09b548c55b5e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:06.883664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ea2053e-878f-457b-bea7-09b548c55b5e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:06.970052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8740cc11-ff58-4a01-a810-d0335957caf4 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Action: 'create', calling method: .version_select at 0x7fc78063ee50>, body: {"keypair": {"name": "tempest-keypair-1462808567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLi+iwIcd9hNZdYfIKx85DKoZJF6gFCzox+YFd+JKtWeVtcUNhy9tIkSAAktoBboY23eCqY3tz5Of9MZlEARBWHhdpqRFqgnAEvAx8vmTGol7/H0RkF73Yt0O3HZ9OQuBQ=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:07.000288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-8740cc11-ff58-4a01-a810-d0335957caf4 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Getting quotas for project 2705ae487e96461190f67c996639b655. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:09:07.015981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-8740cc11-ff58-4a01-a810-d0335957caf4 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Getting quotas for user 5103576600c24a1e8321ae5667adaf0c and project 2705ae487e96461190f67c996639b655. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:09:07.072215 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8740cc11-ff58-4a01-a810-d0335957caf4 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.328099 May 27 15:09:07.074399 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1473/2957] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:09:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:09:07.090376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8850ce53-ea53-4b9c-a990-6194fa0405f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:07.091213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8850ce53-ea53-4b9c-a990-6194fa0405f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:07.098155 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6ea2053e-878f-457b-bea7-09b548c55b5e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:07.106458 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8850ce53-ea53-4b9c-a990-6194fa0405f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:07.107178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8850ce53-ea53-4b9c-a990-6194fa0405f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:07.108090 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6ea2053e-878f-457b-bea7-09b548c55b5e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.238243 May 27 15:09:07.108306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8850ce53-ea53-4b9c-a990-6194fa0405f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:07.108924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8850ce53-ea53-4b9c-a990-6194fa0405f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:07.112260 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1485/2958] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:06 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:07.203596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9a117b1b-428d-419d-99b2-a362bdc74f7f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:07.204914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9a117b1b-428d-419d-99b2-a362bdc74f7f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:07.215315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a117b1b-428d-419d-99b2-a362bdc74f7f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:07.218946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a117b1b-428d-419d-99b2-a362bdc74f7f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:07.220073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a117b1b-428d-419d-99b2-a362bdc74f7f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:07.220743 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a117b1b-428d-419d-99b2-a362bdc74f7f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:07.460888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8850ce53-ea53-4b9c-a990-6194fa0405f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:07.474987 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8850ce53-ea53-4b9c-a990-6194fa0405f4 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1502 microversion: 2.1 time: 0.399492 May 27 15:09:07.475570 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1474/2959] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:07 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1502 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:07.494383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-94f270ea-15b8-4758-861a-ab80054571a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:07.507721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94f270ea-15b8-4758-861a-ab80054571a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:07.508486 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94f270ea-15b8-4758-861a-ab80054571a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:07.556755 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9a117b1b-428d-419d-99b2-a362bdc74f7f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:07.569881 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9a117b1b-428d-419d-99b2-a362bdc74f7f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.368149 May 27 15:09:07.570578 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1486/2960] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:07 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:09:07.574611 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-94f270ea-15b8-4758-861a-ab80054571a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Going to try to stop instance {{(pid=119249) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 15:09:07.637691 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-94f270ea-15b8-4758-861a-ab80054571a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "POST /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a/action" status: 202 len: 0 microversion: 2.1 time: 0.147196 May 27 15:09:07.638999 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1475/2961] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:09:07 2022] POST /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:09:07.647745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b8fd2f81-6fbc-4732-85d5-53d806c2ffa3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:07.648462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b8fd2f81-6fbc-4732-85d5-53d806c2ffa3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:07.655493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b8fd2f81-6fbc-4732-85d5-53d806c2ffa3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:07.656115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b8fd2f81-6fbc-4732-85d5-53d806c2ffa3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:07.657225 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b8fd2f81-6fbc-4732-85d5-53d806c2ffa3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:07.657742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b8fd2f81-6fbc-4732-85d5-53d806c2ffa3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:07.844853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b8fd2f81-6fbc-4732-85d5-53d806c2ffa3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:07.854574 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b8fd2f81-6fbc-4732-85d5-53d806c2ffa3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1512 microversion: 2.1 time: 0.210981 May 27 15:09:07.855803 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1487/2962] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:07 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1512 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:07.883988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-57894aef-acb5-4a97-800a-2a9a889f4d7b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:07.885026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-57894aef-acb5-4a97-800a-2a9a889f4d7b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:07.892704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57894aef-acb5-4a97-800a-2a9a889f4d7b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:07.893452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57894aef-acb5-4a97-800a-2a9a889f4d7b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:07.894442 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57894aef-acb5-4a97-800a-2a9a889f4d7b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:07.895172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57894aef-acb5-4a97-800a-2a9a889f4d7b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:07.971208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-57894aef-acb5-4a97-800a-2a9a889f4d7b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:07.981560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-57894aef-acb5-4a97-800a-2a9a889f4d7b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:07.984406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-57894aef-acb5-4a97-800a-2a9a889f4d7b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:07.986549 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-57894aef-acb5-4a97-800a-2a9a889f4d7b tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.107659 May 27 15:09:07.988546 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1476/2963] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:07 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:09:08.125551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f77fa607-7046-4c2f-ab5d-8954bfb862c4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:08.126171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f77fa607-7046-4c2f-ab5d-8954bfb862c4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:08.136764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f77fa607-7046-4c2f-ab5d-8954bfb862c4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:08.138104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f77fa607-7046-4c2f-ab5d-8954bfb862c4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:08.140099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f77fa607-7046-4c2f-ab5d-8954bfb862c4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:08.141854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f77fa607-7046-4c2f-ab5d-8954bfb862c4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:08.325984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f77fa607-7046-4c2f-ab5d-8954bfb862c4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:08.335995 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f77fa607-7046-4c2f-ab5d-8954bfb862c4 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.214263 May 27 15:09:08.336603 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1488/2964] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:08 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:08.587233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-98a884b2-fe89-491d-bf53-722d95015d08 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:08.587860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-98a884b2-fe89-491d-bf53-722d95015d08 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:08.598719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98a884b2-fe89-491d-bf53-722d95015d08 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:08.599360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98a884b2-fe89-491d-bf53-722d95015d08 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:08.600316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98a884b2-fe89-491d-bf53-722d95015d08 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:08.613461 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98a884b2-fe89-491d-bf53-722d95015d08 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:08.817885 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-98a884b2-fe89-491d-bf53-722d95015d08 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:08.824719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:08.829619 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-98a884b2-fe89-491d-bf53-722d95015d08 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.246486 May 27 15:09:08.832396 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1477/2965] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:08 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:08.875534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-79be2d15-e633-4a37-a962-3af8937e4cd7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:08.877287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-79be2d15-e633-4a37-a962-3af8937e4cd7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:08.886815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-79be2d15-e633-4a37-a962-3af8937e4cd7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:08.887520 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-79be2d15-e633-4a37-a962-3af8937e4cd7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:08.889034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-79be2d15-e633-4a37-a962-3af8937e4cd7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:08.889641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-79be2d15-e633-4a37-a962-3af8937e4cd7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:09.007951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-32fbdb62-d300-4fe8-9784-70ccc02e153f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:09.008574 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-32fbdb62-d300-4fe8-9784-70ccc02e153f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:09.021876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32fbdb62-d300-4fe8-9784-70ccc02e153f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:09.022371 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32fbdb62-d300-4fe8-9784-70ccc02e153f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:09.023179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32fbdb62-d300-4fe8-9784-70ccc02e153f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:09.023636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32fbdb62-d300-4fe8-9784-70ccc02e153f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:09.056275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-79be2d15-e633-4a37-a962-3af8937e4cd7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:09.067151 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-79be2d15-e633-4a37-a962-3af8937e4cd7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1512 microversion: 2.1 time: 0.197534 May 27 15:09:09.067957 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1489/2966] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:08 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1512 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:09.155050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-32fbdb62-d300-4fe8-9784-70ccc02e153f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:09.165714 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-32fbdb62-d300-4fe8-9784-70ccc02e153f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:09.168579 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-32fbdb62-d300-4fe8-9784-70ccc02e153f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:09.170112 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-32fbdb62-d300-4fe8-9784-70ccc02e153f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.167748 May 27 15:09:09.183119 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1478/2967] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:09 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:09:09.364543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c054629e-c728-4919-85ea-a2fac3593129 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:09.366467 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c054629e-c728-4919-85ea-a2fac3593129 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:09.382384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c054629e-c728-4919-85ea-a2fac3593129 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:09.382927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c054629e-c728-4919-85ea-a2fac3593129 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:09.383782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c054629e-c728-4919-85ea-a2fac3593129 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:09.384238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c054629e-c728-4919-85ea-a2fac3593129 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:09.588205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c054629e-c728-4919-85ea-a2fac3593129 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:09.599223 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c054629e-c728-4919-85ea-a2fac3593129 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.247651 May 27 15:09:09.602907 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1490/2968] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:09 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:09.848962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-32dd0dc6-2659-48d1-b439-eee3844e246f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:09.849725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-32dd0dc6-2659-48d1-b439-eee3844e246f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:09.860499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:09.890856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32dd0dc6-2659-48d1-b439-eee3844e246f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:09.891726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32dd0dc6-2659-48d1-b439-eee3844e246f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:09.892849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32dd0dc6-2659-48d1-b439-eee3844e246f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:09.893548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32dd0dc6-2659-48d1-b439-eee3844e246f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:10.086068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1e8cb731-fa08-4d57-a8ac-8763da90e774 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:10.086694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1e8cb731-fa08-4d57-a8ac-8763da90e774 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:10.098255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-32dd0dc6-2659-48d1-b439-eee3844e246f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:10.113898 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-32dd0dc6-2659-48d1-b439-eee3844e246f tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.265706 May 27 15:09:10.116062 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1479/2969] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:09 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:10.121011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e8cb731-fa08-4d57-a8ac-8763da90e774 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:10.125059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e8cb731-fa08-4d57-a8ac-8763da90e774 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:10.126388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e8cb731-fa08-4d57-a8ac-8763da90e774 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:10.127443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e8cb731-fa08-4d57-a8ac-8763da90e774 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:10.190842 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3c0602a5-3f4d-45fe-b57e-1be6a1b09da0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:10.191473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3c0602a5-3f4d-45fe-b57e-1be6a1b09da0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:10.207057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3c0602a5-3f4d-45fe-b57e-1be6a1b09da0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:10.207784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3c0602a5-3f4d-45fe-b57e-1be6a1b09da0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:10.209370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3c0602a5-3f4d-45fe-b57e-1be6a1b09da0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:10.210036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3c0602a5-3f4d-45fe-b57e-1be6a1b09da0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:10.399784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3c0602a5-3f4d-45fe-b57e-1be6a1b09da0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:10.410242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3c0602a5-3f4d-45fe-b57e-1be6a1b09da0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:10.411873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3c0602a5-3f4d-45fe-b57e-1be6a1b09da0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:10.413190 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3c0602a5-3f4d-45fe-b57e-1be6a1b09da0 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.227721 May 27 15:09:10.414000 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1480/2970] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:10 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:09:10.467382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1e8cb731-fa08-4d57-a8ac-8763da90e774 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:10.489111 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1e8cb731-fa08-4d57-a8ac-8763da90e774 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1512 microversion: 2.1 time: 0.407270 May 27 15:09:10.499447 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1491/2971] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:10 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1512 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:09:10.623838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2084b9a4-9692-420a-a6c1-ac469abcaa3b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:10.624461 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2084b9a4-9692-420a-a6c1-ac469abcaa3b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:10.632035 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2084b9a4-9692-420a-a6c1-ac469abcaa3b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:10.632497 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2084b9a4-9692-420a-a6c1-ac469abcaa3b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:10.633340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2084b9a4-9692-420a-a6c1-ac469abcaa3b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:10.633782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2084b9a4-9692-420a-a6c1-ac469abcaa3b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:10.772524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2084b9a4-9692-420a-a6c1-ac469abcaa3b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:10.780328 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2084b9a4-9692-420a-a6c1-ac469abcaa3b tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.160831 May 27 15:09:10.782206 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1481/2972] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:10 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:11.132907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-39286405-2390-4d07-b4a9-4039b74a8c53 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:11.134202 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-39286405-2390-4d07-b4a9-4039b74a8c53 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:11.142860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39286405-2390-4d07-b4a9-4039b74a8c53 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:11.143588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39286405-2390-4d07-b4a9-4039b74a8c53 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:11.144783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39286405-2390-4d07-b4a9-4039b74a8c53 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:11.145771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39286405-2390-4d07-b4a9-4039b74a8c53 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:11.319223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-39286405-2390-4d07-b4a9-4039b74a8c53 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:11.327712 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-39286405-2390-4d07-b4a9-4039b74a8c53 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.198624 May 27 15:09:11.328312 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1492/2973] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:11 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:11.434074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-54b98149-8e1d-4375-9b15-793a327f4d5c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:11.434896 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-54b98149-8e1d-4375-9b15-793a327f4d5c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:11.444631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54b98149-8e1d-4375-9b15-793a327f4d5c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:11.445503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54b98149-8e1d-4375-9b15-793a327f4d5c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:11.446573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54b98149-8e1d-4375-9b15-793a327f4d5c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:11.447322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54b98149-8e1d-4375-9b15-793a327f4d5c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:11.507916 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b839d3bc-36ae-4428-8680-5d8df0c1e677 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:11.508288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b839d3bc-36ae-4428-8680-5d8df0c1e677 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:11.519402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b839d3bc-36ae-4428-8680-5d8df0c1e677 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:11.521994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b839d3bc-36ae-4428-8680-5d8df0c1e677 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:11.523030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b839d3bc-36ae-4428-8680-5d8df0c1e677 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:11.529362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b839d3bc-36ae-4428-8680-5d8df0c1e677 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:11.571651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-54b98149-8e1d-4375-9b15-793a327f4d5c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:11.595141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-54b98149-8e1d-4375-9b15-793a327f4d5c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:11.600803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-54b98149-8e1d-4375-9b15-793a327f4d5c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:11.602236 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-54b98149-8e1d-4375-9b15-793a327f4d5c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.173458 May 27 15:09:11.602913 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1482/2974] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:11 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:09:11.761977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b839d3bc-36ae-4428-8680-5d8df0c1e677 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:11.771898 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b839d3bc-36ae-4428-8680-5d8df0c1e677 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1512 microversion: 2.1 time: 0.268609 May 27 15:09:11.785733 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1493/2975] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:11 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1512 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:11.807877 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ab3b16e6-b121-4d7f-a54b-c7fdbbbad92e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:11.808889 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ab3b16e6-b121-4d7f-a54b-c7fdbbbad92e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:11.820997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab3b16e6-b121-4d7f-a54b-c7fdbbbad92e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:11.821757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab3b16e6-b121-4d7f-a54b-c7fdbbbad92e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:11.822664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab3b16e6-b121-4d7f-a54b-c7fdbbbad92e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:11.823767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab3b16e6-b121-4d7f-a54b-c7fdbbbad92e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:11.859241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-332b367b-251e-43a6-a079-c09ba014a53d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:11.859859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-332b367b-251e-43a6-a079-c09ba014a53d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:11.872192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-332b367b-251e-43a6-a079-c09ba014a53d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:11.872644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-332b367b-251e-43a6-a079-c09ba014a53d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:11.873468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-332b367b-251e-43a6-a079-c09ba014a53d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:11.873905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-332b367b-251e-43a6-a079-c09ba014a53d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:12.071419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ab3b16e6-b121-4d7f-a54b-c7fdbbbad92e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:12.083294 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ab3b16e6-b121-4d7f-a54b-c7fdbbbad92e tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.280880 May 27 15:09:12.088145 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1483/2976] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:11 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:12.344797 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b3e17cab-1d96-44b4-b24c-c26e7c8a29d6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:12.345613 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b3e17cab-1d96-44b4-b24c-c26e7c8a29d6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:12.360600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3e17cab-1d96-44b4-b24c-c26e7c8a29d6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:12.365280 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3e17cab-1d96-44b4-b24c-c26e7c8a29d6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:12.366536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3e17cab-1d96-44b4-b24c-c26e7c8a29d6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:12.373255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3e17cab-1d96-44b4-b24c-c26e7c8a29d6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:12.648410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b3e17cab-1d96-44b4-b24c-c26e7c8a29d6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:12.660332 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b3e17cab-1d96-44b4-b24c-c26e7c8a29d6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.318998 May 27 15:09:12.671936 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1484/2977] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:12 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:09:12.679453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4cda5ba1-b9f4-4b1e-8eb5-92ed59957066 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:12.680365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4cda5ba1-b9f4-4b1e-8eb5-92ed59957066 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:12.688507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4cda5ba1-b9f4-4b1e-8eb5-92ed59957066 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:12.689187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4cda5ba1-b9f4-4b1e-8eb5-92ed59957066 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:12.690158 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4cda5ba1-b9f4-4b1e-8eb5-92ed59957066 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:12.690803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4cda5ba1-b9f4-4b1e-8eb5-92ed59957066 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:12.828810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4cda5ba1-b9f4-4b1e-8eb5-92ed59957066 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:12.839132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4cda5ba1-b9f4-4b1e-8eb5-92ed59957066 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:12.840666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4cda5ba1-b9f4-4b1e-8eb5-92ed59957066 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:12.841889 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4cda5ba1-b9f4-4b1e-8eb5-92ed59957066 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.168458 May 27 15:09:12.842448 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1485/2978] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:12 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:09:12.857325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-30afd818-7523-4523-80f2-86e71db2f040 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:12.857954 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-30afd818-7523-4523-80f2-86e71db2f040 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:12.864952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30afd818-7523-4523-80f2-86e71db2f040 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:12.865608 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30afd818-7523-4523-80f2-86e71db2f040 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:12.867404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30afd818-7523-4523-80f2-86e71db2f040 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:12.868272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30afd818-7523-4523-80f2-86e71db2f040 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:13.050804 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-30afd818-7523-4523-80f2-86e71db2f040 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:13.059366 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-30afd818-7523-4523-80f2-86e71db2f040 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1512 microversion: 2.1 time: 0.215794 May 27 15:09:13.059882 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1486/2979] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:12 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1512 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:13.106556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cc36a552-b9f4-4b10-8b62-033898f328ac tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:13.107764 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cc36a552-b9f4-4b10-8b62-033898f328ac tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:13.115643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc36a552-b9f4-4b10-8b62-033898f328ac tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:13.116424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc36a552-b9f4-4b10-8b62-033898f328ac tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:13.117966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc36a552-b9f4-4b10-8b62-033898f328ac tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:13.118804 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc36a552-b9f4-4b10-8b62-033898f328ac tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:13.300838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cc36a552-b9f4-4b10-8b62-033898f328ac tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:13.310933 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cc36a552-b9f4-4b10-8b62-033898f328ac tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.209058 May 27 15:09:13.318780 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1487/2980] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:13 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:09:13.681099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5d80e6e0-6354-46d6-9cfc-300604f0e26b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:13.683009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5d80e6e0-6354-46d6-9cfc-300604f0e26b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:13.691623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d80e6e0-6354-46d6-9cfc-300604f0e26b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:13.692294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d80e6e0-6354-46d6-9cfc-300604f0e26b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:13.693357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d80e6e0-6354-46d6-9cfc-300604f0e26b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:13.694092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d80e6e0-6354-46d6-9cfc-300604f0e26b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:13.889260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5d80e6e0-6354-46d6-9cfc-300604f0e26b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:13.903135 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5d80e6e0-6354-46d6-9cfc-300604f0e26b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.228247 May 27 15:09:13.913399 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1488/2981] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:13 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:09:13.913399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-84a02997-75b4-422b-855c-d972d3356395 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:13.913399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-84a02997-75b4-422b-855c-d972d3356395 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:13.918146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84a02997-75b4-422b-855c-d972d3356395 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:13.918737 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84a02997-75b4-422b-855c-d972d3356395 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:13.919627 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84a02997-75b4-422b-855c-d972d3356395 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:13.920177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84a02997-75b4-422b-855c-d972d3356395 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:14.001122 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-84a02997-75b4-422b-855c-d972d3356395 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:14.016138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-84a02997-75b4-422b-855c-d972d3356395 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:14.018053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-84a02997-75b4-422b-855c-d972d3356395 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:14.019409 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-84a02997-75b4-422b-855c-d972d3356395 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.113753 May 27 15:09:14.020264 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1489/2982] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:13 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:09:14.075510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-040e23ed-1a96-4a5e-99ec-c5ff8f1c18ce tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:14.076136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-040e23ed-1a96-4a5e-99ec-c5ff8f1c18ce tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:14.084173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-040e23ed-1a96-4a5e-99ec-c5ff8f1c18ce tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:14.084914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-040e23ed-1a96-4a5e-99ec-c5ff8f1c18ce tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:14.085958 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-040e23ed-1a96-4a5e-99ec-c5ff8f1c18ce tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:14.086414 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-040e23ed-1a96-4a5e-99ec-c5ff8f1c18ce tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:14.264971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-040e23ed-1a96-4a5e-99ec-c5ff8f1c18ce tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:14.275923 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-040e23ed-1a96-4a5e-99ec-c5ff8f1c18ce tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1512 microversion: 2.1 time: 0.202973 May 27 15:09:14.286854 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1490/2983] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:14 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1512 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:09:14.331387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-edbf34b3-4fcc-4375-9957-f97c6803de61 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:14.332435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-edbf34b3-4fcc-4375-9957-f97c6803de61 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:14.342383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-edbf34b3-4fcc-4375-9957-f97c6803de61 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:14.342940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-edbf34b3-4fcc-4375-9957-f97c6803de61 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:14.344107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-edbf34b3-4fcc-4375-9957-f97c6803de61 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:14.344935 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-edbf34b3-4fcc-4375-9957-f97c6803de61 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:14.531531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-edbf34b3-4fcc-4375-9957-f97c6803de61 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:14.543424 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-edbf34b3-4fcc-4375-9957-f97c6803de61 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.219019 May 27 15:09:14.553295 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1491/2984] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:14 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:09:14.924938 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b9017dc4-e519-4043-9762-a757d4c8c008 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:14.926877 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b9017dc4-e519-4043-9762-a757d4c8c008 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:14.941550 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9017dc4-e519-4043-9762-a757d4c8c008 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:14.942541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9017dc4-e519-4043-9762-a757d4c8c008 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:14.947121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9017dc4-e519-4043-9762-a757d4c8c008 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:14.947662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9017dc4-e519-4043-9762-a757d4c8c008 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:15.155247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b9017dc4-e519-4043-9762-a757d4c8c008 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:15.165209 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b9017dc4-e519-4043-9762-a757d4c8c008 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.247842 May 27 15:09:15.178067 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1492/2985] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:14 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:15.187526 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1679158e-9997-44b8-8034-c3bdce19cfa7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:15.188163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1679158e-9997-44b8-8034-c3bdce19cfa7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:15.195507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1679158e-9997-44b8-8034-c3bdce19cfa7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:15.198606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1679158e-9997-44b8-8034-c3bdce19cfa7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:15.198606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1679158e-9997-44b8-8034-c3bdce19cfa7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:15.198606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1679158e-9997-44b8-8034-c3bdce19cfa7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:15.306242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1679158e-9997-44b8-8034-c3bdce19cfa7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:15.321892 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1679158e-9997-44b8-8034-c3bdce19cfa7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:15.324345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1679158e-9997-44b8-8034-c3bdce19cfa7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:15.325846 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1679158e-9997-44b8-8034-c3bdce19cfa7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.144098 May 27 15:09:15.326811 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1493/2986] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:15 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:09:15.332268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5c1e2235-6962-4c0f-92ca-4109252e6ca9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:15.333105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5c1e2235-6962-4c0f-92ca-4109252e6ca9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:15.340732 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c1e2235-6962-4c0f-92ca-4109252e6ca9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:15.341168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c1e2235-6962-4c0f-92ca-4109252e6ca9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:15.341984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c1e2235-6962-4c0f-92ca-4109252e6ca9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:15.342446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c1e2235-6962-4c0f-92ca-4109252e6ca9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:15.380973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:15.600895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5c1e2235-6962-4c0f-92ca-4109252e6ca9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:15.618867 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5c1e2235-6962-4c0f-92ca-4109252e6ca9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1512 microversion: 2.1 time: 0.290757 May 27 15:09:15.619578 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1494/2987] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:15 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1512 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:15.629094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d71ce9b8-95e7-42b8-b17e-d9aedc842fb6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:15.630364 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d71ce9b8-95e7-42b8-b17e-d9aedc842fb6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:15.643601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d71ce9b8-95e7-42b8-b17e-d9aedc842fb6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:15.644209 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d71ce9b8-95e7-42b8-b17e-d9aedc842fb6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:15.645227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d71ce9b8-95e7-42b8-b17e-d9aedc842fb6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:15.645711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d71ce9b8-95e7-42b8-b17e-d9aedc842fb6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:15.851967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d71ce9b8-95e7-42b8-b17e-d9aedc842fb6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:15.866492 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d71ce9b8-95e7-42b8-b17e-d9aedc842fb6 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.242260 May 27 15:09:15.867115 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1495/2988] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:15 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:16.188491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1f15a56b-a6d5-4c6f-8e85-27aed30979a8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:16.190029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1f15a56b-a6d5-4c6f-8e85-27aed30979a8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:16.202208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f15a56b-a6d5-4c6f-8e85-27aed30979a8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:16.203076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f15a56b-a6d5-4c6f-8e85-27aed30979a8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:16.204755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f15a56b-a6d5-4c6f-8e85-27aed30979a8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:16.205219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f15a56b-a6d5-4c6f-8e85-27aed30979a8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:16.279261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-332b367b-251e-43a6-a079-c09ba014a53d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lazy-loading 'services' on Instance uuid 3d17a653-7f3e-44d7-9b89-68b4b35c9175 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:09:16.436053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1f15a56b-a6d5-4c6f-8e85-27aed30979a8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:16.446513 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1f15a56b-a6d5-4c6f-8e85-27aed30979a8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.262252 May 27 15:09:16.458742 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1496/2989] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:16 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:16.463403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-37ba6f92-6bd3-4a79-92fe-8341c29c32c6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:16.464074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-37ba6f92-6bd3-4a79-92fe-8341c29c32c6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:16.479929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-37ba6f92-6bd3-4a79-92fe-8341c29c32c6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:16.480719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-37ba6f92-6bd3-4a79-92fe-8341c29c32c6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:16.481517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-37ba6f92-6bd3-4a79-92fe-8341c29c32c6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:16.482738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-37ba6f92-6bd3-4a79-92fe-8341c29c32c6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:16.570329 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-37ba6f92-6bd3-4a79-92fe-8341c29c32c6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:16.582312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-37ba6f92-6bd3-4a79-92fe-8341c29c32c6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:16.584288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-37ba6f92-6bd3-4a79-92fe-8341c29c32c6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:16.585496 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-37ba6f92-6bd3-4a79-92fe-8341c29c32c6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.127317 May 27 15:09:16.586054 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1497/2990] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:16 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:09:16.618974 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-332b367b-251e-43a6-a079-c09ba014a53d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments/f14fba0c-76ab-454d-8482-dfde0063ee0c" status: 202 len: 0 microversion: 2.20 time: 4.764778 May 27 15:09:16.620690 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1494/2991] 10.222.0.13 () {60 vars in 1456 bytes} [Fri May 27 15:09:11 2022] DELETE /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments/f14fba0c-76ab-454d-8482-dfde0063ee0c => generated 0 bytes in 4767 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 15:09:16.632420 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3f1b71c3-c02f-4e9b-a485-dea4370889de tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:16.633768 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3f1b71c3-c02f-4e9b-a485-dea4370889de tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:16.638084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fad60ef8-dc48-4ca5-8e3d-7cdae429f419 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:16.639012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fad60ef8-dc48-4ca5-8e3d-7cdae429f419 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:16.643276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f1b71c3-c02f-4e9b-a485-dea4370889de tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:16.644636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f1b71c3-c02f-4e9b-a485-dea4370889de tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:16.645529 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f1b71c3-c02f-4e9b-a485-dea4370889de tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:16.645981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f1b71c3-c02f-4e9b-a485-dea4370889de tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:16.654909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fad60ef8-dc48-4ca5-8e3d-7cdae429f419 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:16.655668 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fad60ef8-dc48-4ca5-8e3d-7cdae429f419 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:16.656848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fad60ef8-dc48-4ca5-8e3d-7cdae429f419 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:16.657321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fad60ef8-dc48-4ca5-8e3d-7cdae429f419 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:16.727313 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3f1b71c3-c02f-4e9b-a485-dea4370889de tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.101262 May 27 15:09:16.732067 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1498/2992] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:09:16 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:09:16.868013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fad60ef8-dc48-4ca5-8e3d-7cdae429f419 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:16.876577 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fad60ef8-dc48-4ca5-8e3d-7cdae429f419 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1512 microversion: 2.1 time: 0.243717 May 27 15:09:16.891383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-586b8402-8af4-400e-927e-17b22a0b1997 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:16.892015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-586b8402-8af4-400e-927e-17b22a0b1997 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:16.897855 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1495/2993] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:16 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1512 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:09:16.899690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-586b8402-8af4-400e-927e-17b22a0b1997 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:16.900159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-586b8402-8af4-400e-927e-17b22a0b1997 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:16.901021 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-586b8402-8af4-400e-927e-17b22a0b1997 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:16.901433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-586b8402-8af4-400e-927e-17b22a0b1997 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:17.035231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:17.105876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-586b8402-8af4-400e-927e-17b22a0b1997 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:17.115234 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-586b8402-8af4-400e-927e-17b22a0b1997 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.227523 May 27 15:09:17.125763 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1499/2994] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:16 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:17.465293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bb597bab-cd5e-43c3-8069-96d604b95998 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:17.466071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bb597bab-cd5e-43c3-8069-96d604b95998 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:17.482769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb597bab-cd5e-43c3-8069-96d604b95998 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:17.483528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb597bab-cd5e-43c3-8069-96d604b95998 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:17.484430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb597bab-cd5e-43c3-8069-96d604b95998 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:17.485111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb597bab-cd5e-43c3-8069-96d604b95998 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:17.606292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1dd481fc-c15a-4ba2-9292-0985092bd969 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:17.606948 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1dd481fc-c15a-4ba2-9292-0985092bd969 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:17.614096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1dd481fc-c15a-4ba2-9292-0985092bd969 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:17.614541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1dd481fc-c15a-4ba2-9292-0985092bd969 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:17.615319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1dd481fc-c15a-4ba2-9292-0985092bd969 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:17.615762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1dd481fc-c15a-4ba2-9292-0985092bd969 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:17.648011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bb597bab-cd5e-43c3-8069-96d604b95998 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:17.659871 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bb597bab-cd5e-43c3-8069-96d604b95998 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.199678 May 27 15:09:17.660951 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1496/2995] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:17 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:17.700316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1dd481fc-c15a-4ba2-9292-0985092bd969 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:17.710962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1dd481fc-c15a-4ba2-9292-0985092bd969 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:17.712529 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1dd481fc-c15a-4ba2-9292-0985092bd969 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:17.714472 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1dd481fc-c15a-4ba2-9292-0985092bd969 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.111697 May 27 15:09:17.719053 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1500/2996] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:17 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:09:17.739270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8d8f9872-1ca1-4c11-bdd2-a9e75cc65802 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:17.740323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8d8f9872-1ca1-4c11-bdd2-a9e75cc65802 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:17.747288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d8f9872-1ca1-4c11-bdd2-a9e75cc65802 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:17.747753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d8f9872-1ca1-4c11-bdd2-a9e75cc65802 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:17.748532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d8f9872-1ca1-4c11-bdd2-a9e75cc65802 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:17.749014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d8f9872-1ca1-4c11-bdd2-a9e75cc65802 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:17.780585 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8d8f9872-1ca1-4c11-bdd2-a9e75cc65802 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045280 May 27 15:09:17.781240 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1497/2997] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:09:17 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:09:17.893238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c0bd3a91-3ece-44c0-9af6-227136f85baa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:17.893962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c0bd3a91-3ece-44c0-9af6-227136f85baa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:17.901766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c0bd3a91-3ece-44c0-9af6-227136f85baa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:17.902341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c0bd3a91-3ece-44c0-9af6-227136f85baa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:17.903213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c0bd3a91-3ece-44c0-9af6-227136f85baa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:17.904015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c0bd3a91-3ece-44c0-9af6-227136f85baa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:18.066547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c0bd3a91-3ece-44c0-9af6-227136f85baa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:18.079846 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c0bd3a91-3ece-44c0-9af6-227136f85baa tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1512 microversion: 2.1 time: 0.190198 May 27 15:09:18.080454 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1501/2998] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:17 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1512 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:18.133204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3a41c909-bf08-4360-ba11-1bc8ad5bfd92 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:18.134081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3a41c909-bf08-4360-ba11-1bc8ad5bfd92 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:18.143915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a41c909-bf08-4360-ba11-1bc8ad5bfd92 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:18.144375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a41c909-bf08-4360-ba11-1bc8ad5bfd92 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:18.145195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a41c909-bf08-4360-ba11-1bc8ad5bfd92 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:18.145663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a41c909-bf08-4360-ba11-1bc8ad5bfd92 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:18.294358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3a41c909-bf08-4360-ba11-1bc8ad5bfd92 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:18.303545 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3a41c909-bf08-4360-ba11-1bc8ad5bfd92 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1524 microversion: 2.1 time: 0.174083 May 27 15:09:18.304125 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1498/2999] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:18 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1524 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:18.677238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-743f3ccd-fd7e-4bc1-bcbf-8236c896e20a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:18.678524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-743f3ccd-fd7e-4bc1-bcbf-8236c896e20a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:18.687224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-743f3ccd-fd7e-4bc1-bcbf-8236c896e20a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:18.687779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-743f3ccd-fd7e-4bc1-bcbf-8236c896e20a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:18.688641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-743f3ccd-fd7e-4bc1-bcbf-8236c896e20a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:18.689205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-743f3ccd-fd7e-4bc1-bcbf-8236c896e20a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:18.733209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-825911de-c699-44e3-8fe2-dc8bb584cae1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:18.733854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-825911de-c699-44e3-8fe2-dc8bb584cae1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:18.745570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-825911de-c699-44e3-8fe2-dc8bb584cae1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:18.746428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-825911de-c699-44e3-8fe2-dc8bb584cae1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:18.747441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-825911de-c699-44e3-8fe2-dc8bb584cae1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:18.748046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-825911de-c699-44e3-8fe2-dc8bb584cae1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:18.847895 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-825911de-c699-44e3-8fe2-dc8bb584cae1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:18.860664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-825911de-c699-44e3-8fe2-dc8bb584cae1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:18.863317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-825911de-c699-44e3-8fe2-dc8bb584cae1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:18.867095 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-825911de-c699-44e3-8fe2-dc8bb584cae1 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.135919 May 27 15:09:18.879177 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1499/3000] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:18 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:09:18.879501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-21d58774-c692-4186-b599-7452f37bc04c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:18.880615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-21d58774-c692-4186-b599-7452f37bc04c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:18.887760 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21d58774-c692-4186-b599-7452f37bc04c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:18.889063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21d58774-c692-4186-b599-7452f37bc04c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:18.892834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21d58774-c692-4186-b599-7452f37bc04c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:18.894054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21d58774-c692-4186-b599-7452f37bc04c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:18.899663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:18.931505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-743f3ccd-fd7e-4bc1-bcbf-8236c896e20a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:18.936415 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-21d58774-c692-4186-b599-7452f37bc04c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061296 May 27 15:09:18.940436 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1500/3001] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:09:18 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:09:18.943102 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-743f3ccd-fd7e-4bc1-bcbf-8236c896e20a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.269683 May 27 15:09:18.944038 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1502/3002] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:18 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:19.096994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f595bd4c-5ca8-4cf2-9285-440753665eb7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:19.097672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f595bd4c-5ca8-4cf2-9285-440753665eb7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:19.104106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f595bd4c-5ca8-4cf2-9285-440753665eb7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:19.104632 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f595bd4c-5ca8-4cf2-9285-440753665eb7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:19.105494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f595bd4c-5ca8-4cf2-9285-440753665eb7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:19.106004 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f595bd4c-5ca8-4cf2-9285-440753665eb7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:19.246360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f595bd4c-5ca8-4cf2-9285-440753665eb7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:19.254876 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f595bd4c-5ca8-4cf2-9285-440753665eb7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1512 microversion: 2.1 time: 0.162050 May 27 15:09:19.255456 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1501/3003] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:19 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:19.328174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ab326371-ace9-4983-8b71-ab447fe36038 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:19.328953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ab326371-ace9-4983-8b71-ab447fe36038 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:19.337021 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab326371-ace9-4983-8b71-ab447fe36038 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:19.337725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab326371-ace9-4983-8b71-ab447fe36038 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:19.339161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab326371-ace9-4983-8b71-ab447fe36038 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:19.339616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab326371-ace9-4983-8b71-ab447fe36038 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:19.485353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ab326371-ace9-4983-8b71-ab447fe36038 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:19.497122 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ab326371-ace9-4983-8b71-ab447fe36038 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1504 microversion: 2.1 time: 0.172702 May 27 15:09:19.497718 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1503/3004] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:19 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:19.514364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9004cc8f-1824-4360-950b-6a244ec65076 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Action: 'create', calling method: .version_select at 0x7fc780669310>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-223731568", "description": "tempest-description-1122600100"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:19.678318 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9004cc8f-1824-4360-950b-6a244ec65076 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.168221 May 27 15:09:19.680767 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1502/3005] 10.222.0.13 () {60 vars in 1179 bytes} [Fri May 27 15:09:19 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:09:19.690826 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3b37353f-6a94-4bdd-9aaa-d4442d087037 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-223731568"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:19.691411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3b37353f-6a94-4bdd-9aaa-d4442d087037 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:19.699385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b37353f-6a94-4bdd-9aaa-d4442d087037 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:19.699851 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b37353f-6a94-4bdd-9aaa-d4442d087037 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:19.700689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b37353f-6a94-4bdd-9aaa-d4442d087037 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:19.701149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b37353f-6a94-4bdd-9aaa-d4442d087037 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:19.849211 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.network.security_group_api [None req-3b37353f-6a94-4bdd-9aaa-d4442d087037 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Adding security group 20525896-e6fb-497f-a424-b5614b6ca51e to port 6d7dd124-8140-4cb8-b3c7-65570f85e106 May 27 15:09:19.892105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e2619bba-1a71-4f8d-8d62-884bec26aa6d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:19.892660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e2619bba-1a71-4f8d-8d62-884bec26aa6d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:19.906673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2619bba-1a71-4f8d-8d62-884bec26aa6d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:19.907145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2619bba-1a71-4f8d-8d62-884bec26aa6d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:19.908639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2619bba-1a71-4f8d-8d62-884bec26aa6d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:19.909505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2619bba-1a71-4f8d-8d62-884bec26aa6d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:20.005229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e2619bba-1a71-4f8d-8d62-884bec26aa6d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:20.014514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e2619bba-1a71-4f8d-8d62-884bec26aa6d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:20.016064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e2619bba-1a71-4f8d-8d62-884bec26aa6d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:20.017292 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e2619bba-1a71-4f8d-8d62-884bec26aa6d tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.134222 May 27 15:09:20.029108 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1503/3006] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:19 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:09:20.034790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2d2177ff-f80b-4a3d-b4f0-43b9dcb47f91 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:20.035977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2d2177ff-f80b-4a3d-b4f0-43b9dcb47f91 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:20.044020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2d2177ff-f80b-4a3d-b4f0-43b9dcb47f91 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:20.044483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2d2177ff-f80b-4a3d-b4f0-43b9dcb47f91 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:20.045467 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2d2177ff-f80b-4a3d-b4f0-43b9dcb47f91 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:20.046072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2d2177ff-f80b-4a3d-b4f0-43b9dcb47f91 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:20.079597 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2d2177ff-f80b-4a3d-b4f0-43b9dcb47f91 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049026 May 27 15:09:20.083871 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1504/3007] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:09:20 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:09:20.088809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5c1348f5-8f5c-4b14-ac16-6f054c592ca4 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:20.089612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5c1348f5-8f5c-4b14-ac16-6f054c592ca4 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:20.096054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c1348f5-8f5c-4b14-ac16-6f054c592ca4 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:20.096766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c1348f5-8f5c-4b14-ac16-6f054c592ca4 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:20.097994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c1348f5-8f5c-4b14-ac16-6f054c592ca4 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:20.098613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c1348f5-8f5c-4b14-ac16-6f054c592ca4 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:20.561960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5c1348f5-8f5c-4b14-ac16-6f054c592ca4 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:20.575244 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5c1348f5-8f5c-4b14-ac16-6f054c592ca4 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.489812 May 27 15:09:20.584658 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1505/3008] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:20 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:20.588909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e5b12a44-a005-426e-9f5d-1bcb66efcd30 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:20.589959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e5b12a44-a005-426e-9f5d-1bcb66efcd30 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:20.596438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5b12a44-a005-426e-9f5d-1bcb66efcd30 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:20.597101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5b12a44-a005-426e-9f5d-1bcb66efcd30 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:20.598024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5b12a44-a005-426e-9f5d-1bcb66efcd30 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:20.599223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5b12a44-a005-426e-9f5d-1bcb66efcd30 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:20.739721 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3b37353f-6a94-4bdd-9aaa-d4442d087037 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "POST /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18/action" status: 202 len: 0 microversion: 2.1 time: 1.052621 May 27 15:09:20.740627 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1504/3009] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:09:19 2022] POST /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18/action => generated 0 bytes in 1054 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:09:20.749227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-42cb788a-3050-48d4-a2ed-9ecf4da00398 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-223731568"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:20.750150 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-42cb788a-3050-48d4-a2ed-9ecf4da00398 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:20.763977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42cb788a-3050-48d4-a2ed-9ecf4da00398 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:20.764488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42cb788a-3050-48d4-a2ed-9ecf4da00398 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:20.765354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42cb788a-3050-48d4-a2ed-9ecf4da00398 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:20.765884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42cb788a-3050-48d4-a2ed-9ecf4da00398 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:20.970783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e5b12a44-a005-426e-9f5d-1bcb66efcd30 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:20.981503 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e5b12a44-a005-426e-9f5d-1bcb66efcd30 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1512 microversion: 2.1 time: 0.403234 May 27 15:09:20.993488 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1506/3010] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:20 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1512 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:20.993488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-3f099b9f-abff-4273-b5a2-3cc81d9c5a84 req-0c4d5157-b996-4c42-a909-62e90d58f973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "166cc8cd-403c-4987-ac12-64336b9b2d18", "tag": "6d7dd124-8140-4cb8-b3c7-65570f85e106"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:20.994169 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.network.security_group_api [None req-42cb788a-3050-48d4-a2ed-9ecf4da00398 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Removing security group 20525896-e6fb-497f-a424-b5614b6ca51e from port 6d7dd124-8140-4cb8-b3c7-65570f85e106 May 27 15:09:20.998157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3f099b9f-abff-4273-b5a2-3cc81d9c5a84 req-0c4d5157-b996-4c42-a909-62e90d58f973 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:20.998679 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3f099b9f-abff-4273-b5a2-3cc81d9c5a84 req-0c4d5157-b996-4c42-a909-62e90d58f973 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:21.012428 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-3f099b9f-abff-4273-b5a2-3cc81d9c5a84 req-0c4d5157-b996-4c42-a909-62e90d58f973 service nova] Creating event network-changed:6d7dd124-8140-4cb8-b3c7-65570f85e106 for instance 166cc8cd-403c-4987-ac12-64336b9b2d18 on n-h1-843621-1 May 27 15:09:21.022220 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-3f099b9f-abff-4273-b5a2-3cc81d9c5a84 req-0c4d5157-b996-4c42-a909-62e90d58f973 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037524 May 27 15:09:21.023082 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1507/3011] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:09:21.036081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-57950491-b458-4524-8953-bdcf1b0c965f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:21.037615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-57950491-b458-4524-8953-bdcf1b0c965f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:21.047488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57950491-b458-4524-8953-bdcf1b0c965f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:21.049026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57950491-b458-4524-8953-bdcf1b0c965f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:21.050695 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57950491-b458-4524-8953-bdcf1b0c965f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:21.051516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57950491-b458-4524-8953-bdcf1b0c965f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:21.181429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-57950491-b458-4524-8953-bdcf1b0c965f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:21.195005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-57950491-b458-4524-8953-bdcf1b0c965f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:21.196517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-57950491-b458-4524-8953-bdcf1b0c965f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:21.197772 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-57950491-b458-4524-8953-bdcf1b0c965f tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.166109 May 27 15:09:21.217203 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1508/3012] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:21 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:09:21.222621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1b601488-277d-4770-b0cd-a0e5e8289b4d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:21.224078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1b601488-277d-4770-b0cd-a0e5e8289b4d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:21.233014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b601488-277d-4770-b0cd-a0e5e8289b4d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:21.233706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b601488-277d-4770-b0cd-a0e5e8289b4d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:21.234638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b601488-277d-4770-b0cd-a0e5e8289b4d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:21.235231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b601488-277d-4770-b0cd-a0e5e8289b4d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:21.279990 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1b601488-277d-4770-b0cd-a0e5e8289b4d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061247 May 27 15:09:21.285791 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1509/3013] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:09:21 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:09:21.593023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-34fe15aa-7dd6-4ba9-a19f-4180e155b8d9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:21.593932 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-34fe15aa-7dd6-4ba9-a19f-4180e155b8d9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:21.607480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34fe15aa-7dd6-4ba9-a19f-4180e155b8d9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:21.607480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34fe15aa-7dd6-4ba9-a19f-4180e155b8d9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:21.607480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34fe15aa-7dd6-4ba9-a19f-4180e155b8d9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:21.607480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34fe15aa-7dd6-4ba9-a19f-4180e155b8d9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:21.725770 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-42cb788a-3050-48d4-a2ed-9ecf4da00398 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "POST /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18/action" status: 202 len: 0 microversion: 2.1 time: 0.980985 May 27 15:09:21.726986 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1505/3014] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:09:20 2022] POST /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18/action => generated 0 bytes in 983 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:09:21.739467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-42f7d55d-1014-4ec3-81cb-2c7bd5d7fc5c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Action: 'create', calling method: .version_select at 0x7fc7763fd670>, body: {"pool": null} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:21.977375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-34fe15aa-7dd6-4ba9-a19f-4180e155b8d9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:21.993036 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-34fe15aa-7dd6-4ba9-a19f-4180e155b8d9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.404078 May 27 15:09:21.993869 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1510/3015] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:21 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:22.001499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7cba0963-36b9-4b1c-b011-a94f8a431bf2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:22.001765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7cba0963-36b9-4b1c-b011-a94f8a431bf2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:22.014136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7cba0963-36b9-4b1c-b011-a94f8a431bf2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:22.014601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7cba0963-36b9-4b1c-b011-a94f8a431bf2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:22.015490 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7cba0963-36b9-4b1c-b011-a94f8a431bf2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:22.015939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7cba0963-36b9-4b1c-b011-a94f8a431bf2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:22.280542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7cba0963-36b9-4b1c-b011-a94f8a431bf2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:22.294211 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7cba0963-36b9-4b1c-b011-a94f8a431bf2 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1512 microversion: 2.1 time: 0.296916 May 27 15:09:22.295362 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1511/3016] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:21 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1512 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:09:22.300099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-08ff980a-0216-452f-8b34-ba4a8370414c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:22.300734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-08ff980a-0216-452f-8b34-ba4a8370414c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:22.307192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08ff980a-0216-452f-8b34-ba4a8370414c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:22.308350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08ff980a-0216-452f-8b34-ba4a8370414c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:22.309320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08ff980a-0216-452f-8b34-ba4a8370414c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:22.309754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08ff980a-0216-452f-8b34-ba4a8370414c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:22.397417 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-08ff980a-0216-452f-8b34-ba4a8370414c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:22.407190 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-08ff980a-0216-452f-8b34-ba4a8370414c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:22.409053 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-08ff980a-0216-452f-8b34-ba4a8370414c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:22.410501 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-08ff980a-0216-452f-8b34-ba4a8370414c tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.113999 May 27 15:09:22.411277 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1512/3017] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:22 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:09:22.416177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f4d6fa11-6a82-4948-9c07-20b5a159bbb8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:22.417907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f4d6fa11-6a82-4948-9c07-20b5a159bbb8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:22.424302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4d6fa11-6a82-4948-9c07-20b5a159bbb8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:22.425094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4d6fa11-6a82-4948-9c07-20b5a159bbb8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:22.426096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4d6fa11-6a82-4948-9c07-20b5a159bbb8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:22.426747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4d6fa11-6a82-4948-9c07-20b5a159bbb8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:22.462494 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f4d6fa11-6a82-4948-9c07-20b5a159bbb8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049961 May 27 15:09:22.464231 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1513/3018] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:09:22 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:09:23.009973 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f9b8d612-7119-4488-83b9-4bac521a2e42 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:23.011184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f9b8d612-7119-4488-83b9-4bac521a2e42 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:23.017953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9b8d612-7119-4488-83b9-4bac521a2e42 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:23.018409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9b8d612-7119-4488-83b9-4bac521a2e42 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:23.019181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9b8d612-7119-4488-83b9-4bac521a2e42 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:23.019625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9b8d612-7119-4488-83b9-4bac521a2e42 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:23.335292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f9b8d612-7119-4488-83b9-4bac521a2e42 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:23.347368 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f9b8d612-7119-4488-83b9-4bac521a2e42 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.341321 May 27 15:09:23.348990 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1514/3019] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:23 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:09:23.355103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-7668620c-12aa-4bf1-a9fb-f70baade79f7 req-ab4a30d3-1d7c-4619-949b-938b8c918f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "166cc8cd-403c-4987-ac12-64336b9b2d18", "tag": "6d7dd124-8140-4cb8-b3c7-65570f85e106"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:23.366198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-7668620c-12aa-4bf1-a9fb-f70baade79f7 req-ab4a30d3-1d7c-4619-949b-938b8c918f77 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:23.367600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-7668620c-12aa-4bf1-a9fb-f70baade79f7 req-ab4a30d3-1d7c-4619-949b-938b8c918f77 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:23.400405 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-7668620c-12aa-4bf1-a9fb-f70baade79f7 req-ab4a30d3-1d7c-4619-949b-938b8c918f77 service nova] Creating event network-changed:6d7dd124-8140-4cb8-b3c7-65570f85e106 for instance 166cc8cd-403c-4987-ac12-64336b9b2d18 on n-h1-843621-1 May 27 15:09:23.407188 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-7668620c-12aa-4bf1-a9fb-f70baade79f7 req-ab4a30d3-1d7c-4619-949b-938b8c918f77 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056725 May 27 15:09:23.408299 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1515/3020] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:09:23.415927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4a72ab04-f797-45e0-981e-b2ccacbbd989 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:23.417243 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4a72ab04-f797-45e0-981e-b2ccacbbd989 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:23.428363 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a72ab04-f797-45e0-981e-b2ccacbbd989 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:23.429960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a72ab04-f797-45e0-981e-b2ccacbbd989 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:23.431307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a72ab04-f797-45e0-981e-b2ccacbbd989 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:23.434304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a72ab04-f797-45e0-981e-b2ccacbbd989 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:23.668309 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-42f7d55d-1014-4ec3-81cb-2c7bd5d7fc5c tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.935802 May 27 15:09:23.669174 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1506/3021] 10.222.0.13 () {60 vars in 1169 bytes} [Fri May 27 15:09:21 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:09:23.674103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a2c6f3d9-58f3-415d-b8fc-53a1be47d646 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:23.675079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a2c6f3d9-58f3-415d-b8fc-53a1be47d646 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:23.684594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a2c6f3d9-58f3-415d-b8fc-53a1be47d646 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:23.686547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a2c6f3d9-58f3-415d-b8fc-53a1be47d646 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:23.688155 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a2c6f3d9-58f3-415d-b8fc-53a1be47d646 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:23.689373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a2c6f3d9-58f3-415d-b8fc-53a1be47d646 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:23.696829 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4a72ab04-f797-45e0-981e-b2ccacbbd989 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:23.707683 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4a72ab04-f797-45e0-981e-b2ccacbbd989 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1512 microversion: 2.1 time: 0.297369 May 27 15:09:23.708274 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1516/3022] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:23 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1512 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:23.712955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6d02f2fe-a064-454d-b622-952a57bd71ac tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:23.714440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6d02f2fe-a064-454d-b622-952a57bd71ac tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:23.722098 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d02f2fe-a064-454d-b622-952a57bd71ac tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:23.722564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d02f2fe-a064-454d-b622-952a57bd71ac tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:23.723345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d02f2fe-a064-454d-b622-952a57bd71ac tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:23.723791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d02f2fe-a064-454d-b622-952a57bd71ac tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:23.759582 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6d02f2fe-a064-454d-b622-952a57bd71ac tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050217 May 27 15:09:23.764016 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1517/3023] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:09:23 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:09:23.766683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-99ef7b7c-3bab-4316-94c3-a37b2f443519 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.41"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:23.767426 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-99ef7b7c-3bab-4316-94c3-a37b2f443519 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:23.774388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99ef7b7c-3bab-4316-94c3-a37b2f443519 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:23.774855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99ef7b7c-3bab-4316-94c3-a37b2f443519 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:23.780160 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99ef7b7c-3bab-4316-94c3-a37b2f443519 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:23.780629 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99ef7b7c-3bab-4316-94c3-a37b2f443519 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:23.807541 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99ef7b7c-3bab-4316-94c3-a37b2f443519 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Acquired lock "refresh_cache-166cc8cd-403c-4987-ac12-64336b9b2d18" {{(pid=119248) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 15:09:23.821909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a2c6f3d9-58f3-415d-b8fc-53a1be47d646 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:23.835926 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a2c6f3d9-58f3-415d-b8fc-53a1be47d646 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:23.838185 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a2c6f3d9-58f3-415d-b8fc-53a1be47d646 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:23.840741 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a2c6f3d9-58f3-415d-b8fc-53a1be47d646 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.170413 May 27 15:09:23.843238 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1507/3024] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:23 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:09:24.373843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e60640db-e65e-4b1e-9d64-95fbb9976305 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:24.374483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e60640db-e65e-4b1e-9d64-95fbb9976305 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:24.381646 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e60640db-e65e-4b1e-9d64-95fbb9976305 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:24.382406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e60640db-e65e-4b1e-9d64-95fbb9976305 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:24.383370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e60640db-e65e-4b1e-9d64-95fbb9976305 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:24.383993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e60640db-e65e-4b1e-9d64-95fbb9976305 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:24.898012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e60640db-e65e-4b1e-9d64-95fbb9976305 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:24.906880 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e60640db-e65e-4b1e-9d64-95fbb9976305 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.537313 May 27 15:09:24.907705 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1508/3025] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:24 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:09:24.912455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-23212262-55be-4855-8620-6e1b4f0b22d1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:24.913107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-23212262-55be-4855-8620-6e1b4f0b22d1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:24.920306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-23212262-55be-4855-8620-6e1b4f0b22d1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:24.921104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-23212262-55be-4855-8620-6e1b4f0b22d1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:24.922444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-23212262-55be-4855-8620-6e1b4f0b22d1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:24.923173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-23212262-55be-4855-8620-6e1b4f0b22d1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:25.171898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-23212262-55be-4855-8620-6e1b4f0b22d1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:25.182322 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-23212262-55be-4855-8620-6e1b4f0b22d1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1512 microversion: 2.1 time: 0.273184 May 27 15:09:25.193752 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1509/3026] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:24 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1512 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:25.199078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-afc5d048-b961-40ef-95f9-fa22460a2cab tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:25.200076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-afc5d048-b961-40ef-95f9-fa22460a2cab tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:25.207073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afc5d048-b961-40ef-95f9-fa22460a2cab tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:25.207544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afc5d048-b961-40ef-95f9-fa22460a2cab tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:25.208345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afc5d048-b961-40ef-95f9-fa22460a2cab tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:25.208806 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afc5d048-b961-40ef-95f9-fa22460a2cab tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:25.242150 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-afc5d048-b961-40ef-95f9-fa22460a2cab tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048157 May 27 15:09:25.247373 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1510/3027] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:09:25 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:09:25.252517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0726f0c6-524b-4721-92e1-c6b472eeeef4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:25.253179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0726f0c6-524b-4721-92e1-c6b472eeeef4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:25.262324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0726f0c6-524b-4721-92e1-c6b472eeeef4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:25.262324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0726f0c6-524b-4721-92e1-c6b472eeeef4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:25.262324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0726f0c6-524b-4721-92e1-c6b472eeeef4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:25.262657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0726f0c6-524b-4721-92e1-c6b472eeeef4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:25.374804 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0726f0c6-524b-4721-92e1-c6b472eeeef4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:25.395860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0726f0c6-524b-4721-92e1-c6b472eeeef4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:25.397455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0726f0c6-524b-4721-92e1-c6b472eeeef4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:25.398697 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0726f0c6-524b-4721-92e1-c6b472eeeef4 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.150495 May 27 15:09:25.399286 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1511/3028] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:25 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:09:25.562656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-99ef7b7c-3bab-4316-94c3-a37b2f443519 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Building network info cache for instance {{(pid=119248) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 27 15:09:25.581518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-9f0bd3bd-cfca-49f3-bbcd-0431469b7145 req-51d12f5c-45a7-49c6-95d0-d3684fb1bcd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "166cc8cd-403c-4987-ac12-64336b9b2d18", "tag": "6d7dd124-8140-4cb8-b3c7-65570f85e106"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:25.593330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-9f0bd3bd-cfca-49f3-bbcd-0431469b7145 req-51d12f5c-45a7-49c6-95d0-d3684fb1bcd8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:25.593790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-9f0bd3bd-cfca-49f3-bbcd-0431469b7145 req-51d12f5c-45a7-49c6-95d0-d3684fb1bcd8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:25.623793 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-9f0bd3bd-cfca-49f3-bbcd-0431469b7145 req-51d12f5c-45a7-49c6-95d0-d3684fb1bcd8 service nova] Creating event network-changed:6d7dd124-8140-4cb8-b3c7-65570f85e106 for instance 166cc8cd-403c-4987-ac12-64336b9b2d18 on n-h1-843621-1 May 27 15:09:25.638043 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-9f0bd3bd-cfca-49f3-bbcd-0431469b7145 req-51d12f5c-45a7-49c6-95d0-d3684fb1bcd8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059895 May 27 15:09:25.639191 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1512/3029] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:09:25.926034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b89c7b25-3f0c-422e-b428-e2176cc36202 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:25.931593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b89c7b25-3f0c-422e-b428-e2176cc36202 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:25.951297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b89c7b25-3f0c-422e-b428-e2176cc36202 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:25.960464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b89c7b25-3f0c-422e-b428-e2176cc36202 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:25.962547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b89c7b25-3f0c-422e-b428-e2176cc36202 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:25.966834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b89c7b25-3f0c-422e-b428-e2176cc36202 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:26.005221 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:26.242106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b89c7b25-3f0c-422e-b428-e2176cc36202 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:26.252003 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b89c7b25-3f0c-422e-b428-e2176cc36202 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.331951 May 27 15:09:26.254732 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1513/3030] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:25 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:26.268207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-923da907-e5f9-4342-b332-e033e59070db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:26.268870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-923da907-e5f9-4342-b332-e033e59070db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:26.285755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-923da907-e5f9-4342-b332-e033e59070db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:26.286312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-923da907-e5f9-4342-b332-e033e59070db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:26.287118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-923da907-e5f9-4342-b332-e033e59070db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:26.288410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-923da907-e5f9-4342-b332-e033e59070db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:26.720165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-99ef7b7c-3bab-4316-94c3-a37b2f443519 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Updating instance_info_cache with network_info: [{"id": "6d7dd124-8140-4cb8-b3c7-65570f85e106", "address": "fa:16:3e:6c:d6:ac", "network": {"id": "93956e1e-5eb7-40a1-9d47-e750e9b86cdc", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-970022701-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "49b057ed8d9d43c780f96e5058dc5af8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6d7dd124-81", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119248) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 27 15:09:26.723619 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-923da907-e5f9-4342-b332-e033e59070db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:26.726914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:26.735885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99ef7b7c-3bab-4316-94c3-a37b2f443519 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Releasing lock "refresh_cache-166cc8cd-403c-4987-ac12-64336b9b2d18" {{(pid=119248) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 15:09:26.736316 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-923da907-e5f9-4342-b332-e033e59070db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1512 microversion: 2.1 time: 0.480608 May 27 15:09:26.736783 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-99ef7b7c-3bab-4316-94c3-a37b2f443519 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "POST /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18/action" status: 202 len: 0 microversion: 2.1 time: 2.974515 May 27 15:09:26.737262 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1514/3031] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:26 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1512 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:26.743600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-09b4976c-cca1-47df-8abb-87efdf228bbb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:26.744443 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1518/3032] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:09:23 2022] POST /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18/action => generated 0 bytes in 2982 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 27 15:09:26.744941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-09b4976c-cca1-47df-8abb-87efdf228bbb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:26.752655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09b4976c-cca1-47df-8abb-87efdf228bbb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:26.753161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09b4976c-cca1-47df-8abb-87efdf228bbb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:26.753701 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-aadf0c22-ef3b-4805-93b3-393442d3742a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:26.753937 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09b4976c-cca1-47df-8abb-87efdf228bbb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:26.754326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-aadf0c22-ef3b-4805-93b3-393442d3742a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:26.754444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09b4976c-cca1-47df-8abb-87efdf228bbb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:26.765109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aadf0c22-ef3b-4805-93b3-393442d3742a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:26.765576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aadf0c22-ef3b-4805-93b3-393442d3742a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:26.766368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aadf0c22-ef3b-4805-93b3-393442d3742a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:26.766813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aadf0c22-ef3b-4805-93b3-393442d3742a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:26.799850 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-09b4976c-cca1-47df-8abb-87efdf228bbb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061257 May 27 15:09:26.800755 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1515/3033] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:09:26 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:09:26.812137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d721a559-2f95-41b6-939e-df507578c185 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.41"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:27.011542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-aadf0c22-ef3b-4805-93b3-393442d3742a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:27.030862 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-aadf0c22-ef3b-4805-93b3-393442d3742a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:27.039273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-aadf0c22-ef3b-4805-93b3-393442d3742a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4e5682baae1477f9d710d65918a2cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33fc05684054fbab26a8e2a7c848451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:27.042564 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-aadf0c22-ef3b-4805-93b3-393442d3742a tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 200 len: 1603 microversion: 2.32 time: 0.296900 May 27 15:09:27.044141 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1519/3034] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:26 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 1603 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:09:27.068846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d721a559-2f95-41b6-939e-df507578c185 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:27.080153 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d721a559-2f95-41b6-939e-df507578c185 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:27.080752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d721a559-2f95-41b6-939e-df507578c185 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:27.081847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d721a559-2f95-41b6-939e-df507578c185 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:27.082534 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d721a559-2f95-41b6-939e-df507578c185 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:27.270535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-165ceb75-9909-46c8-9e41-6aa00d18b3b2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:27.271384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-165ceb75-9909-46c8-9e41-6aa00d18b3b2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:27.286368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-165ceb75-9909-46c8-9e41-6aa00d18b3b2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:27.287428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-165ceb75-9909-46c8-9e41-6aa00d18b3b2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:27.291184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-165ceb75-9909-46c8-9e41-6aa00d18b3b2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:27.292313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-165ceb75-9909-46c8-9e41-6aa00d18b3b2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:27.625354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-165ceb75-9909-46c8-9e41-6aa00d18b3b2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:27.636086 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-165ceb75-9909-46c8-9e41-6aa00d18b3b2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1516 microversion: 2.1 time: 0.370788 May 27 15:09:27.639475 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1520/3035] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:27 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1516 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:09:27.711876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d721a559-2f95-41b6-939e-df507578c185 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Acquired lock "refresh_cache-166cc8cd-403c-4987-ac12-64336b9b2d18" {{(pid=119249) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 15:09:27.755168 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3d3c6125-11d7-40f8-983c-7140372951ff tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:27.758407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3d3c6125-11d7-40f8-983c-7140372951ff tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:27.777220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d3c6125-11d7-40f8-983c-7140372951ff tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:27.781480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d3c6125-11d7-40f8-983c-7140372951ff tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:27.787241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d3c6125-11d7-40f8-983c-7140372951ff tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:27.787986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d3c6125-11d7-40f8-983c-7140372951ff tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:28.368374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3d3c6125-11d7-40f8-983c-7140372951ff tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:28.376371 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3d3c6125-11d7-40f8-983c-7140372951ff tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1512 microversion: 2.1 time: 0.625723 May 27 15:09:28.376998 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1521/3036] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:27 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1512 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:09:28.390581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-74969053-eb39-4bc8-9d56-945c1552d319 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:28.391588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-74969053-eb39-4bc8-9d56-945c1552d319 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:28.408340 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74969053-eb39-4bc8-9d56-945c1552d319 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:28.408821 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74969053-eb39-4bc8-9d56-945c1552d319 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:28.409601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74969053-eb39-4bc8-9d56-945c1552d319 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:28.410043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74969053-eb39-4bc8-9d56-945c1552d319 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:28.476384 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-74969053-eb39-4bc8-9d56-945c1552d319 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098243 May 27 15:09:28.477021 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1522/3037] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:09:28 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:09:28.487801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f07068a4-bf38-4c2f-90c5-7126c53297e0 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:28.488646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f07068a4-bf38-4c2f-90c5-7126c53297e0 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:28.506699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f07068a4-bf38-4c2f-90c5-7126c53297e0 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:28.507433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f07068a4-bf38-4c2f-90c5-7126c53297e0 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:28.508373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f07068a4-bf38-4c2f-90c5-7126c53297e0 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:28.508990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f07068a4-bf38-4c2f-90c5-7126c53297e0 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:28.691163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-d721a559-2f95-41b6-939e-df507578c185 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Building network info cache for instance {{(pid=119249) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 27 15:09:29.032033 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f07068a4-bf38-4c2f-90c5-7126c53297e0 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1691 microversion: 2.1 time: 0.550702 May 27 15:09:29.036492 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1523/3038] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:28 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1691 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:29.047615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e61c77ef-f6a5-4d14-ab16-32adeb2868b6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:29.050436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e61c77ef-f6a5-4d14-ab16-32adeb2868b6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:29.071744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e61c77ef-f6a5-4d14-ab16-32adeb2868b6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:29.072209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e61c77ef-f6a5-4d14-ab16-32adeb2868b6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:29.075323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e61c77ef-f6a5-4d14-ab16-32adeb2868b6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:29.076049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e61c77ef-f6a5-4d14-ab16-32adeb2868b6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:29.132049 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-e61c77ef-f6a5-4d14-ab16-32adeb2868b6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] HTTP exception thrown: Instance 257d655d-41a5-4a06-a70e-36c3b813d2ae could not be found. May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e61c77ef-f6a5-4d14-ab16-32adeb2868b6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Request method failure captured: May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae HTTP/1.1 May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOei74_pEoqXsgbuf5nyLPsCNcxlvd8FMSkSbSz62GR83U8GdR-RGeJquqpPSBUbXXAA-pGmil2HHqlcMYj1mP0MqlmGrfzPzAsaVJYlrQO_AGT6oIjBTGC7UxHJZvLOcV2xkHJP_TDXBkbUBz_FVw7PRnQ6M4uEoe-xIN03Nvgy80M May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-Openstack-Nova-Api-Version: 2.32 May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: d33fc05684054fbab26a8e2a7c848451 May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-TaggedBootDevicesTest-1926511251 May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d33fc05684054fbab26a8e2a7c848451"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d33fc05684054fbab26a8e2a7c848451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d33fc05684054fbab26a8e2a7c848451"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d33fc05684054fbab26a8e2a7c848451", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-TaggedBootDevicesTest-1926511251 May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: d33fc05684054fbab26a8e2a7c848451 May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1926511251 May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-TaggedBootDevicesTest-1926511251-project May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: a4e5682baae1477f9d710d65918a2cad May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-TaggedBootDevicesTest-1926511251-project May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 257d655d-41a5-4a06-a70e-36c3b813d2ae could not be found. May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '257d655d-41a5-4a06-a70e-36c3b813d2ae'} May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 257d655d-41a5-4a06-a70e-36c3b813d2ae could not be found. May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 257d655d-41a5-4a06-a70e-36c3b813d2ae could not be found. May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:09:29.136943 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:09:29.140900 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:09:29.140900 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:09:29.140900 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:09:29.140900 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:09:29.140900 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:09:29.140900 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 257d655d-41a5-4a06-a70e-36c3b813d2ae could not be found. May 27 15:09:29.140900 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:09:29.151600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e61c77ef-f6a5-4d14-ab16-32adeb2868b6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Returning 404 to user: Instance 257d655d-41a5-4a06-a70e-36c3b813d2ae could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:09:29.154234 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e61c77ef-f6a5-4d14-ab16-32adeb2868b6 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 404 len: 111 microversion: 2.32 time: 0.115062 May 27 15:09:29.155581 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1524/3039] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:29 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:09:29.166974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cc6e4e25-56cb-459a-a3db-b4bad777877b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:29.175275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cc6e4e25-56cb-459a-a3db-b4bad777877b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:29.193831 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cc6e4e25-56cb-459a-a3db-b4bad777877b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:29.194422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cc6e4e25-56cb-459a-a3db-b4bad777877b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:29.195590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cc6e4e25-56cb-459a-a3db-b4bad777877b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:29.197099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cc6e4e25-56cb-459a-a3db-b4bad777877b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:29.520287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-d721a559-2f95-41b6-939e-df507578c185 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Updating instance_info_cache with network_info: [{"id": "6d7dd124-8140-4cb8-b3c7-65570f85e106", "address": "fa:16:3e:6c:d6:ac", "network": {"id": "93956e1e-5eb7-40a1-9d47-e750e9b86cdc", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-970022701-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "49b057ed8d9d43c780f96e5058dc5af8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6d7dd124-81", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119249) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 27 15:09:29.525085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cc6e4e25-56cb-459a-a3db-b4bad777877b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:29.539689 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cc6e4e25-56cb-459a-a3db-b4bad777877b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1522 microversion: 2.1 time: 0.382392 May 27 15:09:29.540639 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1525/3040] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:29 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:29.550817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d721a559-2f95-41b6-939e-df507578c185 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Releasing lock "refresh_cache-166cc8cd-403c-4987-ac12-64336b9b2d18" {{(pid=119249) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 15:09:29.550817 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d721a559-2f95-41b6-939e-df507578c185 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "POST /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18/action" status: 202 len: 0 microversion: 2.1 time: 2.745800 May 27 15:09:29.552628 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1516/3041] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:09:26 2022] POST /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18/action => generated 0 bytes in 2751 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 27 15:09:29.559383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-11ced194-0a66-4de3-82a5-fb26ae9d7b61 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-843621-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:29.561016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-adad20b9-6b11-4be7-8cd3-1ff915c17604 req-999c077d-f4a8-4201-8992-226a55976a53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "166cc8cd-403c-4987-ac12-64336b9b2d18", "tag": "6d7dd124-8140-4cb8-b3c7-65570f85e106"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:29.561171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-11ced194-0a66-4de3-82a5-fb26ae9d7b61 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:29.570431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:29.570859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11ced194-0a66-4de3-82a5-fb26ae9d7b61 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:29.571400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11ced194-0a66-4de3-82a5-fb26ae9d7b61 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:29.572261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11ced194-0a66-4de3-82a5-fb26ae9d7b61 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:29.573890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11ced194-0a66-4de3-82a5-fb26ae9d7b61 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:29.587296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-adad20b9-6b11-4be7-8cd3-1ff915c17604 req-999c077d-f4a8-4201-8992-226a55976a53 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:29.587934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-adad20b9-6b11-4be7-8cd3-1ff915c17604 req-999c077d-f4a8-4201-8992-226a55976a53 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:29.612211 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-adad20b9-6b11-4be7-8cd3-1ff915c17604 req-999c077d-f4a8-4201-8992-226a55976a53 service nova] Creating event network-changed:6d7dd124-8140-4cb8-b3c7-65570f85e106 for instance 166cc8cd-403c-4987-ac12-64336b9b2d18 on n-h1-843621-1 May 27 15:09:29.625022 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-11ced194-0a66-4de3-82a5-fb26ae9d7b61 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lazy-loading 'flavor' on Instance uuid ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:09:29.626576 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-adad20b9-6b11-4be7-8cd3-1ff915c17604 req-999c077d-f4a8-4201-8992-226a55976a53 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072962 May 27 15:09:29.627383 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1526/3042] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:09:29.644553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-11ced194-0a66-4de3-82a5-fb26ae9d7b61 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Going to try to live migrate instance to n-h1-843621-1 {{(pid=119249) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 27 15:09:29.653510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-314b4144-d744-4b53-b7ba-c055638190e7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '.version_select at 0x7fc78065f670>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:29.718129 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-314b4144-d744-4b53-b7ba-c055638190e7 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-469040580" status: 204 len: 0 microversion: 2.32 time: 0.086127 May 27 15:09:29.718724 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1527/3043] 10.222.0.13 () {60 vars in 1258 bytes} [Fri May 27 15:09:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-469040580 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:09:29.727007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a2f54e96-0df4-4a73-9120-a023f0ac0797 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:29.727747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a2f54e96-0df4-4a73-9120-a023f0ac0797 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:29.747097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a2f54e96-0df4-4a73-9120-a023f0ac0797 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:29.747554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a2f54e96-0df4-4a73-9120-a023f0ac0797 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:29.748344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a2f54e96-0df4-4a73-9120-a023f0ac0797 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:29.748810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a2f54e96-0df4-4a73-9120-a023f0ac0797 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:30.142902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a2f54e96-0df4-4a73-9120-a023f0ac0797 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:30.151495 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a2f54e96-0df4-4a73-9120-a023f0ac0797 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1512 microversion: 2.1 time: 0.428251 May 27 15:09:30.152173 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1528/3044] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:29 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1512 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:30.164434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c51d92a9-bec8-4cf5-8c8b-b5ddbfad56f7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:30.166621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c51d92a9-bec8-4cf5-8c8b-b5ddbfad56f7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:30.181001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c51d92a9-bec8-4cf5-8c8b-b5ddbfad56f7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:30.184666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c51d92a9-bec8-4cf5-8c8b-b5ddbfad56f7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:30.186160 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c51d92a9-bec8-4cf5-8c8b-b5ddbfad56f7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:30.187095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c51d92a9-bec8-4cf5-8c8b-b5ddbfad56f7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:30.270543 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c51d92a9-bec8-4cf5-8c8b-b5ddbfad56f7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.116946 May 27 15:09:30.271446 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1529/3045] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:09:30 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:09:30.275980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d1ceb316-2b69-4751-b1b0-9345abfacbff tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '.version_select at 0x7fc776063ca0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:32.767515 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d1ceb316-2b69-4751-b1b0-9345abfacbff tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/90b028e6-91f7-46fc-a881-59e54c64515b" status: 202 len: 0 microversion: 2.1 time: 2.494796 May 27 15:09:32.768307 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1530/3046] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 15:09:30 2022] DELETE /compute/v2.1/os-floating-ips/90b028e6-91f7-46fc-a881-59e54c64515b => generated 0 bytes in 2496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:09:32.774622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d772e4a3-31f1-4c88-9f45-968c875d06aa tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:32.775442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d772e4a3-31f1-4c88-9f45-968c875d06aa tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:32.789293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d772e4a3-31f1-4c88-9f45-968c875d06aa tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:32.793606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d772e4a3-31f1-4c88-9f45-968c875d06aa tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:32.794791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d772e4a3-31f1-4c88-9f45-968c875d06aa tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:32.795403 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d772e4a3-31f1-4c88-9f45-968c875d06aa tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:32.944717 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-11ced194-0a66-4de3-82a5-fb26ae9d7b61 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/action" status: 202 len: 0 microversion: 2.1 time: 3.390527 May 27 15:09:32.946309 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1517/3047] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:09:29 2022] POST /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/action => generated 0 bytes in 3393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:09:32.954066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-95a11c96-d31d-42a1-bd2f-75ac88583ea3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:32.954913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-95a11c96-d31d-42a1-bd2f-75ac88583ea3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:32.973840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-95a11c96-d31d-42a1-bd2f-75ac88583ea3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:32.982483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-95a11c96-d31d-42a1-bd2f-75ac88583ea3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:32.983594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-95a11c96-d31d-42a1-bd2f-75ac88583ea3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:32.984193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-95a11c96-d31d-42a1-bd2f-75ac88583ea3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:33.554150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d772e4a3-31f1-4c88-9f45-968c875d06aa tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:33.568213 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d772e4a3-31f1-4c88-9f45-968c875d06aa tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1522 microversion: 2.1 time: 0.798014 May 27 15:09:33.581201 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1531/3048] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:32 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1522 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:33.590762 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b694b4e4-93ad-4751-8d38-9a909bad181e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:33.591983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b694b4e4-93ad-4751-8d38-9a909bad181e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:33.604451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b694b4e4-93ad-4751-8d38-9a909bad181e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:33.605208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b694b4e4-93ad-4751-8d38-9a909bad181e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:33.606180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b694b4e4-93ad-4751-8d38-9a909bad181e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:33.607972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b694b4e4-93ad-4751-8d38-9a909bad181e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:33.716926 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b694b4e4-93ad-4751-8d38-9a909bad181e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.133657 May 27 15:09:33.717533 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1532/3049] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:09:33 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:09:33.725371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-23ac383f-bde4-4487-8202-78e18549b891 req-4b126ea9-fb7e-4c50-b5c7-0d0b6cb844e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3996f065-a4c2-40b5-9189-8fe1334f1d18", "name": "network-vif-unplugged", "status": "completed", "tag": "1bcb594f-fe75-4ee2-b07a-dcae39e8c831"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:33.748869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-23ac383f-bde4-4487-8202-78e18549b891 req-4b126ea9-fb7e-4c50-b5c7-0d0b6cb844e2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:33.749447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-23ac383f-bde4-4487-8202-78e18549b891 req-4b126ea9-fb7e-4c50-b5c7-0d0b6cb844e2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:33.777553 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-23ac383f-bde4-4487-8202-78e18549b891 req-4b126ea9-fb7e-4c50-b5c7-0d0b6cb844e2 service nova] Creating event network-vif-unplugged:1bcb594f-fe75-4ee2-b07a-dcae39e8c831 for instance 3996f065-a4c2-40b5-9189-8fe1334f1d18 on n-h2-843621-1 May 27 15:09:33.789477 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-23ac383f-bde4-4487-8202-78e18549b891 req-4b126ea9-fb7e-4c50-b5c7-0d0b6cb844e2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070322 May 27 15:09:33.789772 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-95a11c96-d31d-42a1-bd2f-75ac88583ea3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:33.793669 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1533/3050] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:09:33.808610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-025cad60-d276-4e5c-9d24-ae1bfd1b7b88 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '.version_select at 0x7fc77606df70>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:33.808875 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-95a11c96-d31d-42a1-bd2f-75ac88583ea3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1512 microversion: 2.1 time: 0.858114 May 27 15:09:33.818552 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1518/3051] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:32 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1512 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:33.833144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-68efe825-4921-43e8-903f-d0e2e194dde0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:33.833935 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-68efe825-4921-43e8-903f-d0e2e194dde0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:33.855988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68efe825-4921-43e8-903f-d0e2e194dde0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:33.856496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68efe825-4921-43e8-903f-d0e2e194dde0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:33.857328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68efe825-4921-43e8-903f-d0e2e194dde0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:33.857776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68efe825-4921-43e8-903f-d0e2e194dde0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:34.199810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-68efe825-4921-43e8-903f-d0e2e194dde0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:34.208446 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-68efe825-4921-43e8-903f-d0e2e194dde0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.397212 May 27 15:09:34.209621 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1519/3052] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:33 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:34.398578 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-025cad60-d276-4e5c-9d24-ae1bfd1b7b88 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "DELETE /compute/v2.1/os-security-groups/20525896-e6fb-497f-a424-b5614b6ca51e" status: 202 len: 0 microversion: 2.1 time: 0.602786 May 27 15:09:34.399408 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1534/3053] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:09:33 2022] DELETE /compute/v2.1/os-security-groups/20525896-e6fb-497f-a424-b5614b6ca51e => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:09:34.408424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f2f5c545-6b8d-4e7e-b2bf-8acebcccec89 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:34.409045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f2f5c545-6b8d-4e7e-b2bf-8acebcccec89 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:34.423622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2f5c545-6b8d-4e7e-b2bf-8acebcccec89 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:34.424101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2f5c545-6b8d-4e7e-b2bf-8acebcccec89 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:34.424936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2f5c545-6b8d-4e7e-b2bf-8acebcccec89 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:34.425518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2f5c545-6b8d-4e7e-b2bf-8acebcccec89 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:34.479499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f2f5c545-6b8d-4e7e-b2bf-8acebcccec89 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:09:34.587616 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0ac7b76d-58d5-4e92-9e48-5f6b0febaa19 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:34.590810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0ac7b76d-58d5-4e92-9e48-5f6b0febaa19 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:34.614527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ac7b76d-58d5-4e92-9e48-5f6b0febaa19 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:34.625889 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ac7b76d-58d5-4e92-9e48-5f6b0febaa19 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:34.627050 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ac7b76d-58d5-4e92-9e48-5f6b0febaa19 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:34.627699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ac7b76d-58d5-4e92-9e48-5f6b0febaa19 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:34.643426 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f2f5c545-6b8d-4e7e-b2bf-8acebcccec89 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "DELETE /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 204 len: 0 microversion: 2.1 time: 0.239202 May 27 15:09:34.644184 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1520/3054] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:09:34 2022] DELETE /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:09:34.662486 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9e60edb2-e572-426d-9cc6-f217ccaf3ec1 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:34.663221 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9e60edb2-e572-426d-9cc6-f217ccaf3ec1 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:34.679354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e60edb2-e572-426d-9cc6-f217ccaf3ec1 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:34.679829 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e60edb2-e572-426d-9cc6-f217ccaf3ec1 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:34.682949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e60edb2-e572-426d-9cc6-f217ccaf3ec1 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:34.684515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e60edb2-e572-426d-9cc6-f217ccaf3ec1 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:34.993677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0ac7b76d-58d5-4e92-9e48-5f6b0febaa19 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:35.007657 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0ac7b76d-58d5-4e92-9e48-5f6b0febaa19 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1522 microversion: 2.1 time: 0.422068 May 27 15:09:35.009655 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1535/3055] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:34 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:35.017967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9e60edb2-e572-426d-9cc6-f217ccaf3ec1 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:35.027379 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9e60edb2-e572-426d-9cc6-f217ccaf3ec1 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1510 microversion: 2.1 time: 0.377356 May 27 15:09:35.028140 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1521/3056] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:34 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1510 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:35.042315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5bc04ea7-ae24-4188-b55f-7947e537ad1a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:35.042935 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c5c3f516-b7e0-4c06-9b50-8fc5ef4a443e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:35.043757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5bc04ea7-ae24-4188-b55f-7947e537ad1a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:35.045658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c5c3f516-b7e0-4c06-9b50-8fc5ef4a443e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:35.058054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5bc04ea7-ae24-4188-b55f-7947e537ad1a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:35.060789 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5bc04ea7-ae24-4188-b55f-7947e537ad1a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:35.062647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c5c3f516-b7e0-4c06-9b50-8fc5ef4a443e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:35.062805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5bc04ea7-ae24-4188-b55f-7947e537ad1a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:35.063414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5bc04ea7-ae24-4188-b55f-7947e537ad1a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:35.068502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c5c3f516-b7e0-4c06-9b50-8fc5ef4a443e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:35.071252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c5c3f516-b7e0-4c06-9b50-8fc5ef4a443e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:35.071795 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c5c3f516-b7e0-4c06-9b50-8fc5ef4a443e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:35.171207 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5bc04ea7-ae24-4188-b55f-7947e537ad1a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.158392 May 27 15:09:35.171207 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1536/3057] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:09:35 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:09:35.225696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-33e64c3b-3033-43ad-9d4c-af6a6fa60fc4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:35.226315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-33e64c3b-3033-43ad-9d4c-af6a6fa60fc4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:35.234678 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-33e64c3b-3033-43ad-9d4c-af6a6fa60fc4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:35.235130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-33e64c3b-3033-43ad-9d4c-af6a6fa60fc4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:35.248481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-33e64c3b-3033-43ad-9d4c-af6a6fa60fc4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:35.249207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-33e64c3b-3033-43ad-9d4c-af6a6fa60fc4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:35.531997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c5c3f516-b7e0-4c06-9b50-8fc5ef4a443e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:35.544082 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c5c3f516-b7e0-4c06-9b50-8fc5ef4a443e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1489 microversion: 2.1 time: 0.510770 May 27 15:09:35.555646 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1522/3058] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:35 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1489 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:35.561901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9b9b3d08-edb4-46b8-bf02-90c024786c5a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:35.563148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9b9b3d08-edb4-46b8-bf02-90c024786c5a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:35.578477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b9b3d08-edb4-46b8-bf02-90c024786c5a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:35.586989 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b9b3d08-edb4-46b8-bf02-90c024786c5a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:35.589728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b9b3d08-edb4-46b8-bf02-90c024786c5a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:35.590979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b9b3d08-edb4-46b8-bf02-90c024786c5a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:35.627360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-33e64c3b-3033-43ad-9d4c-af6a6fa60fc4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:35.638683 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-33e64c3b-3033-43ad-9d4c-af6a6fa60fc4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.416808 May 27 15:09:35.642460 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1537/3059] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:35 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:09:35.653299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9b9b3d08-edb4-46b8-bf02-90c024786c5a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:09:35.831304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-1c5999b2-079f-49ef-94a5-16201c497cf2 req-e276d1b9-8d27-4764-9260-061b11c741ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3996f065-a4c2-40b5-9189-8fe1334f1d18", "name": "network-vif-plugged", "status": "completed", "tag": "1bcb594f-fe75-4ee2-b07a-dcae39e8c831"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:35.851145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-1c5999b2-079f-49ef-94a5-16201c497cf2 req-e276d1b9-8d27-4764-9260-061b11c741ad service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:35.851802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-1c5999b2-079f-49ef-94a5-16201c497cf2 req-e276d1b9-8d27-4764-9260-061b11c741ad service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:35.858354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:35.872183 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9b9b3d08-edb4-46b8-bf02-90c024786c5a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 204 len: 0 microversion: 2.1 time: 0.314610 May 27 15:09:35.873040 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1523/3060] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:09:35 2022] DELETE /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:09:35.888705 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-1c5999b2-079f-49ef-94a5-16201c497cf2 req-e276d1b9-8d27-4764-9260-061b11c741ad service nova] Creating event network-vif-plugged:1bcb594f-fe75-4ee2-b07a-dcae39e8c831 for instance 3996f065-a4c2-40b5-9189-8fe1334f1d18 on n-h2-843621-1 May 27 15:09:35.891803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ff7e8945-926d-40c8-8dba-b42bdddcba4f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:35.892541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ff7e8945-926d-40c8-8dba-b42bdddcba4f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:35.919900 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-1c5999b2-079f-49ef-94a5-16201c497cf2 req-e276d1b9-8d27-4764-9260-061b11c741ad service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089608 May 27 15:09:35.924552 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1538/3061] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:09:35.932621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff7e8945-926d-40c8-8dba-b42bdddcba4f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:35.933224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff7e8945-926d-40c8-8dba-b42bdddcba4f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:35.933867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff7e8945-926d-40c8-8dba-b42bdddcba4f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:35.934315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff7e8945-926d-40c8-8dba-b42bdddcba4f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:35.941968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=5,nova_cell1:RELEASE=1,nova_cell1:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:36.028041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e71a7a82-7e6f-4b38-85f6-9ab114e260be tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:36.028695 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e71a7a82-7e6f-4b38-85f6-9ab114e260be tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:36.049213 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e71a7a82-7e6f-4b38-85f6-9ab114e260be tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:36.049944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e71a7a82-7e6f-4b38-85f6-9ab114e260be tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:36.050889 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e71a7a82-7e6f-4b38-85f6-9ab114e260be tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:36.051505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e71a7a82-7e6f-4b38-85f6-9ab114e260be tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:36.394460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ff7e8945-926d-40c8-8dba-b42bdddcba4f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:36.403409 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ff7e8945-926d-40c8-8dba-b42bdddcba4f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1495 microversion: 2.1 time: 0.522515 May 27 15:09:36.408854 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1524/3062] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:35 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1495 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:36.422296 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0f339b31-17c1-4c34-a8a1-083a377abcd2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:36.426081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0f339b31-17c1-4c34-a8a1-083a377abcd2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:36.443931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0f339b31-17c1-4c34-a8a1-083a377abcd2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:36.449813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0f339b31-17c1-4c34-a8a1-083a377abcd2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:36.450960 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0f339b31-17c1-4c34-a8a1-083a377abcd2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:36.451824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0f339b31-17c1-4c34-a8a1-083a377abcd2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:36.697555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e71a7a82-7e6f-4b38-85f6-9ab114e260be tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:36.711008 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e71a7a82-7e6f-4b38-85f6-9ab114e260be tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1522 microversion: 2.1 time: 0.687916 May 27 15:09:36.711884 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1539/3063] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:36 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1522 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:09:36.728798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4d8a9f95-66d5-416b-acd1-b585f1835153 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:36.730581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4d8a9f95-66d5-416b-acd1-b585f1835153 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:36.740160 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d8a9f95-66d5-416b-acd1-b585f1835153 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:36.742613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d8a9f95-66d5-416b-acd1-b585f1835153 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:36.749579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d8a9f95-66d5-416b-acd1-b585f1835153 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:36.754558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d8a9f95-66d5-416b-acd1-b585f1835153 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:36.817445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:SELECT=98 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:36.832702 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4d8a9f95-66d5-416b-acd1-b585f1835153 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.119511 May 27 15:09:36.834348 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1540/3064] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:09:36 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:09:36.839914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0abd2a42-35d6-4608-b31c-0e3ec84bff60 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:36.841097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0abd2a42-35d6-4608-b31c-0e3ec84bff60 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:36.857410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0abd2a42-35d6-4608-b31c-0e3ec84bff60 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:36.857878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0abd2a42-35d6-4608-b31c-0e3ec84bff60 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:36.858858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0abd2a42-35d6-4608-b31c-0e3ec84bff60 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:36.859449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0abd2a42-35d6-4608-b31c-0e3ec84bff60 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:37.015421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0f339b31-17c1-4c34-a8a1-083a377abcd2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:37.027730 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0f339b31-17c1-4c34-a8a1-083a377abcd2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1510 microversion: 2.1 time: 0.618944 May 27 15:09:37.028895 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1525/3065] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:36 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1510 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:37.247115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0abd2a42-35d6-4608-b31c-0e3ec84bff60 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:37.262586 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0abd2a42-35d6-4608-b31c-0e3ec84bff60 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.426145 May 27 15:09:37.264070 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1541/3066] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:36 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:37.425460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3e03d27e-a6fe-41eb-91f7-54566d4e022d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:37.426160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3e03d27e-a6fe-41eb-91f7-54566d4e022d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:37.434683 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e03d27e-a6fe-41eb-91f7-54566d4e022d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:37.435152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e03d27e-a6fe-41eb-91f7-54566d4e022d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:37.436794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e03d27e-a6fe-41eb-91f7-54566d4e022d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:37.437556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e03d27e-a6fe-41eb-91f7-54566d4e022d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:37.733283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ad65ca3a-696e-4d73-b386-84d40c95833b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:37.734355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ad65ca3a-696e-4d73-b386-84d40c95833b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:37.750839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad65ca3a-696e-4d73-b386-84d40c95833b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:37.751481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad65ca3a-696e-4d73-b386-84d40c95833b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:37.753058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad65ca3a-696e-4d73-b386-84d40c95833b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:37.753814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad65ca3a-696e-4d73-b386-84d40c95833b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:37.766846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3e03d27e-a6fe-41eb-91f7-54566d4e022d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:37.781489 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3e03d27e-a6fe-41eb-91f7-54566d4e022d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1495 microversion: 2.1 time: 0.359233 May 27 15:09:37.795918 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1526/3067] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:37 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1495 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:37.846184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b9a88157-1ca4-4dba-a7e9-9469924a3702 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:37.847511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b9a88157-1ca4-4dba-a7e9-9469924a3702 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:37.855042 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9a88157-1ca4-4dba-a7e9-9469924a3702 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:37.855674 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9a88157-1ca4-4dba-a7e9-9469924a3702 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:37.856716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9a88157-1ca4-4dba-a7e9-9469924a3702 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:37.857359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9a88157-1ca4-4dba-a7e9-9469924a3702 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:37.913364 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b9a88157-1ca4-4dba-a7e9-9469924a3702 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071638 May 27 15:09:37.914624 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1527/3068] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:09:37 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:09:38.047254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-770e1006-8e30-4dd8-ab07-8fae0eae25b5 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:38.048233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-770e1006-8e30-4dd8-ab07-8fae0eae25b5 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:38.058450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-770e1006-8e30-4dd8-ab07-8fae0eae25b5 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:38.058906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-770e1006-8e30-4dd8-ab07-8fae0eae25b5 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:38.059689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-770e1006-8e30-4dd8-ab07-8fae0eae25b5 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:38.060130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-770e1006-8e30-4dd8-ab07-8fae0eae25b5 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:38.199237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ad65ca3a-696e-4d73-b386-84d40c95833b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:38.217162 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ad65ca3a-696e-4d73-b386-84d40c95833b tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1522 microversion: 2.1 time: 0.489638 May 27 15:09:38.226976 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1542/3069] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:37 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:38.236653 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fa4c54cc-d3b7-4628-a3e5-1b95ad03c504 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:38.237182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fa4c54cc-d3b7-4628-a3e5-1b95ad03c504 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:38.256818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa4c54cc-d3b7-4628-a3e5-1b95ad03c504 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:38.257956 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa4c54cc-d3b7-4628-a3e5-1b95ad03c504 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:38.259289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa4c54cc-d3b7-4628-a3e5-1b95ad03c504 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:38.261051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa4c54cc-d3b7-4628-a3e5-1b95ad03c504 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:38.309304 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-fa4c54cc-d3b7-4628-a3e5-1b95ad03c504 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] HTTP exception thrown: Instance 257d655d-41a5-4a06-a70e-36c3b813d2ae could not be found. May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fa4c54cc-d3b7-4628-a3e5-1b95ad03c504 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Request method failure captured: May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae HTTP/1.1 May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOei74_pEoqXsgbuf5nyLPsCNcxlvd8FMSkSbSz62GR83U8GdR-RGeJquqpPSBUbXXAA-pGmil2HHqlcMYj1mP0MqlmGrfzPzAsaVJYlrQO_AGT6oIjBTGC7UxHJZvLOcV2xkHJP_TDXBkbUBz_FVw7PRnQ6M4uEoe-xIN03Nvgy80M May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-Openstack-Nova-Api-Version: 2.32 May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: d33fc05684054fbab26a8e2a7c848451 May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-TaggedBootDevicesTest-1926511251 May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d33fc05684054fbab26a8e2a7c848451"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d33fc05684054fbab26a8e2a7c848451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d33fc05684054fbab26a8e2a7c848451"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d33fc05684054fbab26a8e2a7c848451", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-TaggedBootDevicesTest-1926511251 May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: d33fc05684054fbab26a8e2a7c848451 May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1926511251 May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-TaggedBootDevicesTest-1926511251-project May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: a4e5682baae1477f9d710d65918a2cad May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-TaggedBootDevicesTest-1926511251-project May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 257d655d-41a5-4a06-a70e-36c3b813d2ae could not be found. May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '257d655d-41a5-4a06-a70e-36c3b813d2ae'} May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 257d655d-41a5-4a06-a70e-36c3b813d2ae could not be found. May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:09:38.311643 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:09:38.315174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 257d655d-41a5-4a06-a70e-36c3b813d2ae could not be found. May 27 15:09:38.315174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:09:38.315174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:09:38.315174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:09:38.315174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:09:38.315174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:09:38.315174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:09:38.315174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:09:38.315174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:09:38.315174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 257d655d-41a5-4a06-a70e-36c3b813d2ae could not be found. May 27 15:09:38.315174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:09:38.315174 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fa4c54cc-d3b7-4628-a3e5-1b95ad03c504 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Returning 404 to user: Instance 257d655d-41a5-4a06-a70e-36c3b813d2ae could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:09:38.315174 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fa4c54cc-d3b7-4628-a3e5-1b95ad03c504 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "DELETE /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 404 len: 111 microversion: 2.32 time: 0.086252 May 27 15:09:38.323036 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1543/3070] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:09:38 2022] DELETE /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:09:38.332351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-7ade2071-e92a-4d6f-83d6-0a394ca336f0 req-b651d1a6-4c6b-4ecb-9bfb-1ba451eb7877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f1bb984-1a95-44b2-b300-7a5986ca934a", "name": "network-vif-deleted", "tag": "7d5b5621-1291-4caf-8754-cb86cd6b4daf"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:38.379075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-7ade2071-e92a-4d6f-83d6-0a394ca336f0 req-b651d1a6-4c6b-4ecb-9bfb-1ba451eb7877 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:38.379561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-7ade2071-e92a-4d6f-83d6-0a394ca336f0 req-b651d1a6-4c6b-4ecb-9bfb-1ba451eb7877 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:38.403967 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-7ade2071-e92a-4d6f-83d6-0a394ca336f0 req-b651d1a6-4c6b-4ecb-9bfb-1ba451eb7877 service nova] Creating event network-vif-deleted:7d5b5621-1291-4caf-8754-cb86cd6b4daf for instance 5f1bb984-1a95-44b2-b300-7a5986ca934a on n-h2-843621-1 May 27 15:09:38.429518 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-7ade2071-e92a-4d6f-83d6-0a394ca336f0 req-b651d1a6-4c6b-4ecb-9bfb-1ba451eb7877 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105131 May 27 15:09:38.438282 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1544/3071] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:09:38.447183 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cb9a2fb4-4250-404a-b488-d10b02c90109 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:38.461126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cb9a2fb4-4250-404a-b488-d10b02c90109 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:38.472362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-770e1006-8e30-4dd8-ab07-8fae0eae25b5 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848a14967f74c49a4ed533b74f7a394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b057ed8d9d43c780f96e5058dc5af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:38.473140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb9a2fb4-4250-404a-b488-d10b02c90109 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:38.473610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb9a2fb4-4250-404a-b488-d10b02c90109 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:38.474400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb9a2fb4-4250-404a-b488-d10b02c90109 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:38.474853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb9a2fb4-4250-404a-b488-d10b02c90109 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:38.484316 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-770e1006-8e30-4dd8-ab07-8fae0eae25b5 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 200 len: 1510 microversion: 2.1 time: 0.442620 May 27 15:09:38.497019 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1528/3072] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:38 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 1510 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:09:38.508761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ad5d2215-fd81-4215-868c-160a56d40a30 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:38.510654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ad5d2215-fd81-4215-868c-160a56d40a30 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] [instance: 257d655d-41a5-4a06-a70e-36c3b813d2ae] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:38.529210 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad5d2215-fd81-4215-868c-160a56d40a30 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:38.530013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad5d2215-fd81-4215-868c-160a56d40a30 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:38.532012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad5d2215-fd81-4215-868c-160a56d40a30 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:38.534822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad5d2215-fd81-4215-868c-160a56d40a30 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:38.566013 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-ad5d2215-fd81-4215-868c-160a56d40a30 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] HTTP exception thrown: Instance 257d655d-41a5-4a06-a70e-36c3b813d2ae could not be found. May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ad5d2215-fd81-4215-868c-160a56d40a30 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Request method failure captured: May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae HTTP/1.1 May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOei74_pEoqXsgbuf5nyLPsCNcxlvd8FMSkSbSz62GR83U8GdR-RGeJquqpPSBUbXXAA-pGmil2HHqlcMYj1mP0MqlmGrfzPzAsaVJYlrQO_AGT6oIjBTGC7UxHJZvLOcV2xkHJP_TDXBkbUBz_FVw7PRnQ6M4uEoe-xIN03Nvgy80M May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-Openstack-Nova-Api-Version: 2.32 May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: d33fc05684054fbab26a8e2a7c848451 May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TaggedBootDevicesTest-1926511251 May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d33fc05684054fbab26a8e2a7c848451"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d33fc05684054fbab26a8e2a7c848451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d33fc05684054fbab26a8e2a7c848451"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d33fc05684054fbab26a8e2a7c848451", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TaggedBootDevicesTest-1926511251 May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: d33fc05684054fbab26a8e2a7c848451 May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1926511251 May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TaggedBootDevicesTest-1926511251-project May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: a4e5682baae1477f9d710d65918a2cad May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TaggedBootDevicesTest-1926511251-project May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 257d655d-41a5-4a06-a70e-36c3b813d2ae could not be found. May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '257d655d-41a5-4a06-a70e-36c3b813d2ae'} May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 257d655d-41a5-4a06-a70e-36c3b813d2ae could not be found. May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 257d655d-41a5-4a06-a70e-36c3b813d2ae could not be found. May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:09:38.572210 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:09:38.577403 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:09:38.577403 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:09:38.577403 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:09:38.577403 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:09:38.577403 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:09:38.577403 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 257d655d-41a5-4a06-a70e-36c3b813d2ae could not be found. May 27 15:09:38.577403 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:09:38.579164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ad5d2215-fd81-4215-868c-160a56d40a30 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] Returning 404 to user: Instance 257d655d-41a5-4a06-a70e-36c3b813d2ae could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:09:38.586542 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ad5d2215-fd81-4215-868c-160a56d40a30 tempest-TaggedBootDevicesTest-1926511251 tempest-TaggedBootDevicesTest-1926511251-project] 10.222.0.13 "GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae" status: 404 len: 111 microversion: 2.32 time: 0.080266 May 27 15:09:38.591177 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1529/3073] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:38 2022] GET /compute/v2.1/servers/257d655d-41a5-4a06-a70e-36c3b813d2ae => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:09:38.663346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-15f33b28-8359-4461-b3bc-f49e4c4bcf5c req-125a1975-c5ce-4a98-9e4b-1fa07ca567a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "166cc8cd-403c-4987-ac12-64336b9b2d18", "name": "network-vif-deleted", "tag": "6d7dd124-8140-4cb8-b3c7-65570f85e106"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:38.676654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-15f33b28-8359-4461-b3bc-f49e4c4bcf5c req-125a1975-c5ce-4a98-9e4b-1fa07ca567a3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:38.681643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-15f33b28-8359-4461-b3bc-f49e4c4bcf5c req-125a1975-c5ce-4a98-9e4b-1fa07ca567a3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:38.705671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cb9a2fb4-4250-404a-b488-d10b02c90109 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:38.706154 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-15f33b28-8359-4461-b3bc-f49e4c4bcf5c req-125a1975-c5ce-4a98-9e4b-1fa07ca567a3 service nova] Creating event network-vif-deleted:6d7dd124-8140-4cb8-b3c7-65570f85e106 for instance 166cc8cd-403c-4987-ac12-64336b9b2d18 on n-h1-843621-1 May 27 15:09:38.715916 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-15f33b28-8359-4461-b3bc-f49e4c4bcf5c req-125a1975-c5ce-4a98-9e4b-1fa07ca567a3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056149 May 27 15:09:38.716724 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cb9a2fb4-4250-404a-b488-d10b02c90109 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.276702 May 27 15:09:38.717103 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1530/3074] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:09:38.730353 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1545/3075] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:38 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:38.800833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d8901ebd-acf7-48af-b67d-b6997e67264f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:38.802153 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d8901ebd-acf7-48af-b67d-b6997e67264f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:38.826051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8901ebd-acf7-48af-b67d-b6997e67264f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:38.826591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8901ebd-acf7-48af-b67d-b6997e67264f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:38.828048 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8901ebd-acf7-48af-b67d-b6997e67264f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:38.829169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8901ebd-acf7-48af-b67d-b6997e67264f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:38.889710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8901ebd-acf7-48af-b67d-b6997e67264f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:38.891043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8901ebd-acf7-48af-b67d-b6997e67264f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:38.891767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-d8901ebd-acf7-48af-b67d-b6997e67264f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lazy-loading 'fault' on Instance uuid 5f1bb984-1a95-44b2-b300-7a5986ca934a {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:09:38.926532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9716de6f-e7dd-4b2f-b196-69ad584aad83 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:38.927514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9716de6f-e7dd-4b2f-b196-69ad584aad83 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:38.944459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9716de6f-e7dd-4b2f-b196-69ad584aad83 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:38.944909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9716de6f-e7dd-4b2f-b196-69ad584aad83 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:38.945689 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9716de6f-e7dd-4b2f-b196-69ad584aad83 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:38.946167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9716de6f-e7dd-4b2f-b196-69ad584aad83 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:38.962359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d8901ebd-acf7-48af-b67d-b6997e67264f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:38.970746 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d8901ebd-acf7-48af-b67d-b6997e67264f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 200 len: 1305 microversion: 2.1 time: 0.174182 May 27 15:09:38.973297 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1531/3076] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:38 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 1305 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:38.982285 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9716de6f-e7dd-4b2f-b196-69ad584aad83 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058536 May 27 15:09:38.984248 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1546/3077] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:09:38 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:09:39.236629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b757a668-5837-4e5a-b147-3eba12da995a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:39.237808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b757a668-5837-4e5a-b147-3eba12da995a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:39.251344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b757a668-5837-4e5a-b147-3eba12da995a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:39.252220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b757a668-5837-4e5a-b147-3eba12da995a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:39.253464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b757a668-5837-4e5a-b147-3eba12da995a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:39.253917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b757a668-5837-4e5a-b147-3eba12da995a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:39.457191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b757a668-5837-4e5a-b147-3eba12da995a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:39.466321 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b757a668-5837-4e5a-b147-3eba12da995a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1507 microversion: 2.1 time: 0.234980 May 27 15:09:39.467253 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1532/3078] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:39 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1507 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:39.488822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e43f827-e0ee-4bf9-b96e-80f6bd12bb62 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:39.490583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e43f827-e0ee-4bf9-b96e-80f6bd12bb62 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:39.504504 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e43f827-e0ee-4bf9-b96e-80f6bd12bb62 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:39.505207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f3610087-f214-4f85-9cd5-38575757e1e2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:39.505952 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e43f827-e0ee-4bf9-b96e-80f6bd12bb62 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:39.506152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f3610087-f214-4f85-9cd5-38575757e1e2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] [instance: 166cc8cd-403c-4987-ac12-64336b9b2d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:39.507359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e43f827-e0ee-4bf9-b96e-80f6bd12bb62 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:39.508436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e43f827-e0ee-4bf9-b96e-80f6bd12bb62 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:39.513850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3610087-f214-4f85-9cd5-38575757e1e2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:39.514567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3610087-f214-4f85-9cd5-38575757e1e2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:39.516193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3610087-f214-4f85-9cd5-38575757e1e2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:39.516897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3610087-f214-4f85-9cd5-38575757e1e2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:39.535651 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-f3610087-f214-4f85-9cd5-38575757e1e2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] HTTP exception thrown: Instance 166cc8cd-403c-4987-ac12-64336b9b2d18 could not be found. May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f3610087-f214-4f85-9cd5-38575757e1e2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Request method failure captured: May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 HTTP/1.1 May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOk2J84fk7XxJLWGieQ7Ar22cwFb1nfwP02PMUHgGvaysVEb_SqqmY4zHPT3K0dQNL-aVo8pNFJGJU81BZ_ezvNHh-_GB58EiSJXpgdPxhBu-0RH2AQSETIOUknwRcau_IZW38aeAfNNOCKGaTz3nupepQFbKQe4lAi0yTSMTO9MJRU May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 49b057ed8d9d43c780f96e5058dc5af8 May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-247479347 May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49b057ed8d9d43c780f96e5058dc5af8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/49b057ed8d9d43c780f96e5058dc5af8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/49b057ed8d9d43c780f96e5058dc5af8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_49b057ed8d9d43c780f96e5058dc5af8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-247479347 May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 49b057ed8d9d43c780f96e5058dc5af8 May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-247479347 May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerRescueTestJSONUnderV235-247479347-project May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 2848a14967f74c49a4ed533b74f7a394 May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-247479347-project May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 166cc8cd-403c-4987-ac12-64336b9b2d18 could not be found. May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '166cc8cd-403c-4987-ac12-64336b9b2d18'} May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 166cc8cd-403c-4987-ac12-64336b9b2d18 could not be found. May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 166cc8cd-403c-4987-ac12-64336b9b2d18 could not be found. May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:09:39.537820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:09:39.542538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:09:39.542538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:09:39.542538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:09:39.542538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:09:39.542538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:09:39.542538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:09:39.542538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 166cc8cd-403c-4987-ac12-64336b9b2d18 could not be found. May 27 15:09:39.542538 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:09:39.544170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f3610087-f214-4f85-9cd5-38575757e1e2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] Returning 404 to user: Instance 166cc8cd-403c-4987-ac12-64336b9b2d18 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:09:39.545396 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f3610087-f214-4f85-9cd5-38575757e1e2 tempest-ServerRescueTestJSONUnderV235-247479347 tempest-ServerRescueTestJSONUnderV235-247479347-project] 10.222.0.13 "GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18" status: 404 len: 111 microversion: 2.1 time: 0.045594 May 27 15:09:39.546052 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1533/3079] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:39 2022] GET /compute/v2.1/servers/166cc8cd-403c-4987-ac12-64336b9b2d18 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:09:39.678553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e43f827-e0ee-4bf9-b96e-80f6bd12bb62 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:39.688414 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e43f827-e0ee-4bf9-b96e-80f6bd12bb62 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 200 len: 1507 microversion: 2.1 time: 0.205617 May 27 15:09:39.689381 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1547/3080] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:39 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 1507 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:39.710854 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1bb29cb2-3b00-44da-85d9-cc034cf01067 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:39.712342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1bb29cb2-3b00-44da-85d9-cc034cf01067 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:39.722746 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1bb29cb2-3b00-44da-85d9-cc034cf01067 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:39.723211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1bb29cb2-3b00-44da-85d9-cc034cf01067 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:39.724018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1bb29cb2-3b00-44da-85d9-cc034cf01067 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:39.724467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1bb29cb2-3b00-44da-85d9-cc034cf01067 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:39.743594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6ab22c87-6065-48d4-b1e7-ac45bbdfa1c1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:39.748569 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6ab22c87-6065-48d4-b1e7-ac45bbdfa1c1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:39.765409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ab22c87-6065-48d4-b1e7-ac45bbdfa1c1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:39.766976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ab22c87-6065-48d4-b1e7-ac45bbdfa1c1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:39.768223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1bb29cb2-3b00-44da-85d9-cc034cf01067 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:09:39.768474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ab22c87-6065-48d4-b1e7-ac45bbdfa1c1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:39.769343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ab22c87-6065-48d4-b1e7-ac45bbdfa1c1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:39.970424 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1bb29cb2-3b00-44da-85d9-cc034cf01067 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 204 len: 0 microversion: 2.1 time: 0.263725 May 27 15:09:39.972399 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1534/3081] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:09:39 2022] DELETE /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:09:39.991375 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5505cefa-6b63-4e4c-b5bb-da09e1f2aa3a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:39.998870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5505cefa-6b63-4e4c-b5bb-da09e1f2aa3a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:40.007828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5505cefa-6b63-4e4c-b5bb-da09e1f2aa3a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:40.008435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5505cefa-6b63-4e4c-b5bb-da09e1f2aa3a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:40.009830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5505cefa-6b63-4e4c-b5bb-da09e1f2aa3a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:40.011334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5505cefa-6b63-4e4c-b5bb-da09e1f2aa3a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:40.058075 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-5505cefa-6b63-4e4c-b5bb-da09e1f2aa3a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance 5f1bb984-1a95-44b2-b300-7a5986ca934a could not be found. May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5505cefa-6b63-4e4c-b5bb-da09e1f2aa3a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a HTTP/1.1 May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 5f1bb984-1a95-44b2-b300-7a5986ca934a could not be found. May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '5f1bb984-1a95-44b2-b300-7a5986ca934a'} May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1bb984-1a95-44b2-b300-7a5986ca934a could not be found. May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1bb984-1a95-44b2-b300-7a5986ca934a could not be found. May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:09:40.059802 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:09:40.064485 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:09:40.064485 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:09:40.064485 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:09:40.064485 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:09:40.064485 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:09:40.064485 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1bb984-1a95-44b2-b300-7a5986ca934a could not be found. May 27 15:09:40.064485 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:09:40.064485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5505cefa-6b63-4e4c-b5bb-da09e1f2aa3a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance 5f1bb984-1a95-44b2-b300-7a5986ca934a could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:09:40.064485 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5505cefa-6b63-4e4c-b5bb-da09e1f2aa3a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 404 len: 111 microversion: 2.1 time: 0.074708 May 27 15:09:40.066358 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1535/3082] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:39 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:09:40.079434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-89753b66-c3bb-41ca-b2d3-65d264b636eb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:40.080475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-89753b66-c3bb-41ca-b2d3-65d264b636eb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:40.116981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89753b66-c3bb-41ca-b2d3-65d264b636eb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:40.117442 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89753b66-c3bb-41ca-b2d3-65d264b636eb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:40.121182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89753b66-c3bb-41ca-b2d3-65d264b636eb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:40.121661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89753b66-c3bb-41ca-b2d3-65d264b636eb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:40.136011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6ab22c87-6065-48d4-b1e7-ac45bbdfa1c1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:40.145239 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6ab22c87-6065-48d4-b1e7-ac45bbdfa1c1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.411530 May 27 15:09:40.160389 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1548/3083] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:39 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:40.170264 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-89753b66-c3bb-41ca-b2d3-65d264b636eb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.096400 May 27 15:09:40.172207 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1536/3084] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:09:40 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:09:40.235675 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-55792b90-d394-4190-94b0-60a106432110 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-718860775", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "5e060146-66c4-492e-80f7-70a65c4297cc"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:40.250666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-61148143-2fa4-47b1-822a-cacb755ed7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-711339852", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "a400f266-0bb2-420b-8500-ad7b63a44ef7"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:40.303438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-55792b90-d394-4190-94b0-60a106432110 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] validate_networks() for [('5e060146-66c4-492e-80f7-70a65c4297cc', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:09:40.312198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-61148143-2fa4-47b1-822a-cacb755ed7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] validate_networks() for [('a400f266-0bb2-420b-8500-ad7b63a44ef7', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:09:41.117229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-55792b90-d394-4190-94b0-60a106432110 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:09:41.118549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-55792b90-d394-4190-94b0-60a106432110 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:09:41.119210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-55792b90-d394-4190-94b0-60a106432110 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:09:41.120179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-55792b90-d394-4190-94b0-60a106432110 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:09:41.121049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-55792b90-d394-4190-94b0-60a106432110 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:09:41.138599 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55792b90-d394-4190-94b0-60a106432110 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:41.139322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55792b90-d394-4190-94b0-60a106432110 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:41.140791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55792b90-d394-4190-94b0-60a106432110 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:41.141539 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55792b90-d394-4190-94b0-60a106432110 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:41.191470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-55792b90-d394-4190-94b0-60a106432110 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Getting quotas for project 628e59220c154dcda54532c0b3606f2b. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:09:41.214049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-55792b90-d394-4190-94b0-60a106432110 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Getting quotas for user 55944b29f3ba44d8b08ae71ce65be230 and project 628e59220c154dcda54532c0b3606f2b. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:09:41.251515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-55792b90-d394-4190-94b0-60a106432110 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:09:41.258433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-55792b90-d394-4190-94b0-60a106432110 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:09:41.343045 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-55792b90-d394-4190-94b0-60a106432110 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.111472 May 27 15:09:41.344462 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1549/3085] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:09:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:09:41.350150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a7aff849-1102-42f8-a283-2506bbd471f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:41.351072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a7aff849-1102-42f8-a283-2506bbd471f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:41.360588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a7aff849-1102-42f8-a283-2506bbd471f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:41.361501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a7aff849-1102-42f8-a283-2506bbd471f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:41.362568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a7aff849-1102-42f8-a283-2506bbd471f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:41.373284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a7aff849-1102-42f8-a283-2506bbd471f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:42.312712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-61148143-2fa4-47b1-822a-cacb755ed7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:09:42.314437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-61148143-2fa4-47b1-822a-cacb755ed7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:09:42.315301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-61148143-2fa4-47b1-822a-cacb755ed7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:09:42.316112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-61148143-2fa4-47b1-822a-cacb755ed7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:09:42.316929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-61148143-2fa4-47b1-822a-cacb755ed7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:09:42.330960 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-61148143-2fa4-47b1-822a-cacb755ed7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:42.331839 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-61148143-2fa4-47b1-822a-cacb755ed7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:42.332914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-61148143-2fa4-47b1-822a-cacb755ed7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:42.334824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-61148143-2fa4-47b1-822a-cacb755ed7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:42.379896 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-61148143-2fa4-47b1-822a-cacb755ed7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Getting quotas for project 37b5a0b0723a46c1b0755e824e32b776. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:09:42.388202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-61148143-2fa4-47b1-822a-cacb755ed7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Getting quotas for user 0536f4a5547545acaa06b6aad5d1fbe4 and project 37b5a0b0723a46c1b0755e824e32b776. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:09:42.404647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-61148143-2fa4-47b1-822a-cacb755ed7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:09:42.408797 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-61148143-2fa4-47b1-822a-cacb755ed7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:09:42.475173 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-61148143-2fa4-47b1-822a-cacb755ed7db tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.229212 May 27 15:09:42.476209 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1537/3086] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:09:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:09:42.482202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3af85d12-0291-44fe-9782-526484acf6a7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:42.483212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3af85d12-0291-44fe-9782-526484acf6a7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:42.490906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3af85d12-0291-44fe-9782-526484acf6a7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:42.491427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3af85d12-0291-44fe-9782-526484acf6a7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:42.492445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3af85d12-0291-44fe-9782-526484acf6a7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:42.493405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3af85d12-0291-44fe-9782-526484acf6a7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:42.527792 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3af85d12-0291-44fe-9782-526484acf6a7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050292 May 27 15:09:42.536081 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1538/3087] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:09:42 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:42.540643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d52a4262-bef7-4302-9e1a-ee62e3427aa9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:42.541846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d52a4262-bef7-4302-9e1a-ee62e3427aa9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:42.548717 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d52a4262-bef7-4302-9e1a-ee62e3427aa9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:42.549248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d52a4262-bef7-4302-9e1a-ee62e3427aa9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:42.550037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d52a4262-bef7-4302-9e1a-ee62e3427aa9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:42.550479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d52a4262-bef7-4302-9e1a-ee62e3427aa9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:42.808301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d52a4262-bef7-4302-9e1a-ee62e3427aa9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:42.817856 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d52a4262-bef7-4302-9e1a-ee62e3427aa9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1269 microversion: 2.1 time: 0.280777 May 27 15:09:42.830843 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1539/3088] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:42 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1269 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:42.835905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f1b60135-719b-4314-8cba-928a0fddb179 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:42.836467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f1b60135-719b-4314-8cba-928a0fddb179 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:43.020065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a7aff849-1102-42f8-a283-2506bbd471f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:43.074054 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a7aff849-1102-42f8-a283-2506bbd471f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 1.727901 May 27 15:09:43.079953 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1550/3089] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:41 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:43.121095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-caa80a11-a0ec-4014-8298-77a899006b80 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:43.121612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-caa80a11-a0ec-4014-8298-77a899006b80 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:43.151549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-caa80a11-a0ec-4014-8298-77a899006b80 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:43.152013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-caa80a11-a0ec-4014-8298-77a899006b80 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:43.152841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-caa80a11-a0ec-4014-8298-77a899006b80 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:43.153289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-caa80a11-a0ec-4014-8298-77a899006b80 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:43.169052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f1b60135-719b-4314-8cba-928a0fddb179 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:43.179594 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f1b60135-719b-4314-8cba-928a0fddb179 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1214 microversion: 2.1 time: 0.346067 May 27 15:09:43.181934 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1540/3090] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:42 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1214 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:43.189028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3bcbc9d6-4c86-4876-b0e7-914ddf547eeb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1222902765", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "9049bb9d-2a57-42ab-9f26-709e061f474c"}], "security_groups": [{"name": "tempest-securitygroup--672135062"}], "key_name": "tempest-keypair-1462808567", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "05b670f4-f411-4939-b86b-1a0bda1ac5bc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:43.204431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-caa80a11-a0ec-4014-8298-77a899006b80 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:09:43.414926 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-caa80a11-a0ec-4014-8298-77a899006b80 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 204 len: 0 microversion: 2.20 time: 0.318429 May 27 15:09:43.415538 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1551/3091] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:09:43 2022] DELETE /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:09:43.425636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cf64e2aa-a7e7-4455-b607-20ceb90fb0be tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:43.426348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cf64e2aa-a7e7-4455-b607-20ceb90fb0be tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:43.440457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cf64e2aa-a7e7-4455-b607-20ceb90fb0be tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:43.441165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cf64e2aa-a7e7-4455-b607-20ceb90fb0be tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:43.442113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cf64e2aa-a7e7-4455-b607-20ceb90fb0be tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:43.443453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cf64e2aa-a7e7-4455-b607-20ceb90fb0be tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:43.853366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-3bcbc9d6-4c86-4876-b0e7-914ddf547eeb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] validate_networks() for [('9049bb9d-2a57-42ab-9f26-709e061f474c', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:09:44.511623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cf64e2aa-a7e7-4455-b607-20ceb90fb0be tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:44.527048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cf64e2aa-a7e7-4455-b607-20ceb90fb0be tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:44.532597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cf64e2aa-a7e7-4455-b607-20ceb90fb0be tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:44.535680 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cf64e2aa-a7e7-4455-b607-20ceb90fb0be tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1724 microversion: 2.20 time: 1.114168 May 27 15:09:44.548938 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1552/3092] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:43 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1724 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:09:44.566196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b77d52a2-df80-4dd8-84d6-dfaafc5b37f7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:44.573835 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b77d52a2-df80-4dd8-84d6-dfaafc5b37f7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:44.581842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b77d52a2-df80-4dd8-84d6-dfaafc5b37f7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:44.585853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b77d52a2-df80-4dd8-84d6-dfaafc5b37f7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:44.586891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b77d52a2-df80-4dd8-84d6-dfaafc5b37f7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:44.588404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b77d52a2-df80-4dd8-84d6-dfaafc5b37f7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:44.775685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b77d52a2-df80-4dd8-84d6-dfaafc5b37f7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:44.786781 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b77d52a2-df80-4dd8-84d6-dfaafc5b37f7 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1275 microversion: 2.1 time: 0.236368 May 27 15:09:44.792259 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1553/3093] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:44 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1275 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:44.810152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ca4b37f9-0071-4ec6-a473-0e413e19fc4a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:44.811230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ca4b37f9-0071-4ec6-a473-0e413e19fc4a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:44.832747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca4b37f9-0071-4ec6-a473-0e413e19fc4a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:44.835980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca4b37f9-0071-4ec6-a473-0e413e19fc4a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:44.837995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca4b37f9-0071-4ec6-a473-0e413e19fc4a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:44.843401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca4b37f9-0071-4ec6-a473-0e413e19fc4a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:45.142328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-3bcbc9d6-4c86-4876-b0e7-914ddf547eeb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Getting quotas for project 2705ae487e96461190f67c996639b655. Resources: dict_keys(['metadata_items']) {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:09:45.148930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-3bcbc9d6-4c86-4876-b0e7-914ddf547eeb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Getting quotas for user 5103576600c24a1e8321ae5667adaf0c and project 2705ae487e96461190f67c996639b655. Resources: dict_keys(['metadata_items']) {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:09:45.180945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-3bcbc9d6-4c86-4876-b0e7-914ddf547eeb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:09:45.181624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-3bcbc9d6-4c86-4876-b0e7-914ddf547eeb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:09:45.182898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-3bcbc9d6-4c86-4876-b0e7-914ddf547eeb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:09:45.183471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-3bcbc9d6-4c86-4876-b0e7-914ddf547eeb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:09:45.184044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-3bcbc9d6-4c86-4876-b0e7-914ddf547eeb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:09:45.209026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3bcbc9d6-4c86-4876-b0e7-914ddf547eeb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:45.209773 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3bcbc9d6-4c86-4876-b0e7-914ddf547eeb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:45.210735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3bcbc9d6-4c86-4876-b0e7-914ddf547eeb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:45.211347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3bcbc9d6-4c86-4876-b0e7-914ddf547eeb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:45.257825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-3bcbc9d6-4c86-4876-b0e7-914ddf547eeb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Getting quotas for project 2705ae487e96461190f67c996639b655. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:09:45.273253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-3bcbc9d6-4c86-4876-b0e7-914ddf547eeb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Getting quotas for user 5103576600c24a1e8321ae5667adaf0c and project 2705ae487e96461190f67c996639b655. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:09:45.462484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3bcbc9d6-4c86-4876-b0e7-914ddf547eeb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:09:45.464839 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3bcbc9d6-4c86-4876-b0e7-914ddf547eeb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='05b670f4-f411-4939-b86b-1a0bda1ac5bc',volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:09:45.481851 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ca4b37f9-0071-4ec6-a473-0e413e19fc4a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:45.496312 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ca4b37f9-0071-4ec6-a473-0e413e19fc4a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.702161 May 27 15:09:45.498529 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1554/3094] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:44 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:45.504848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2c7398a6-201e-4bd9-bad8-380d36464c69 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:45.505713 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2c7398a6-201e-4bd9-bad8-380d36464c69 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:45.528828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2c7398a6-201e-4bd9-bad8-380d36464c69 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:45.530031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2c7398a6-201e-4bd9-bad8-380d36464c69 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:45.531274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2c7398a6-201e-4bd9-bad8-380d36464c69 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:45.531923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2c7398a6-201e-4bd9-bad8-380d36464c69 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:45.744095 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3bcbc9d6-4c86-4876-b0e7-914ddf547eeb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.560830 May 27 15:09:45.745400 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1541/3095] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:09:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 2563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:09:45.751690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-cc389e2f-d6a5-4da8-a174-89fab1d13d9d req-241d2af9-4d87-45ee-84c7-50b6fa1f30f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3996f065-a4c2-40b5-9189-8fe1334f1d18", "name": "network-vif-deleted", "tag": "1bcb594f-fe75-4ee2-b07a-dcae39e8c831"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:45.764011 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-cc389e2f-d6a5-4da8-a174-89fab1d13d9d req-241d2af9-4d87-45ee-84c7-50b6fa1f30f3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:45.765782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-cc389e2f-d6a5-4da8-a174-89fab1d13d9d req-241d2af9-4d87-45ee-84c7-50b6fa1f30f3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:45.771525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2c7398a6-201e-4bd9-bad8-380d36464c69 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:45.784233 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2c7398a6-201e-4bd9-bad8-380d36464c69 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1272 microversion: 2.1 time: 0.283773 May 27 15:09:45.784834 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1555/3096] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:45 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1272 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:45.799487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-818b12bd-6c82-4eb9-a3fe-2f11a17ea0d9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:45.800840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-818b12bd-6c82-4eb9-a3fe-2f11a17ea0d9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:45.804717 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-cc389e2f-d6a5-4da8-a174-89fab1d13d9d req-241d2af9-4d87-45ee-84c7-50b6fa1f30f3 service nova] Creating event network-vif-deleted:1bcb594f-fe75-4ee2-b07a-dcae39e8c831 for instance 3996f065-a4c2-40b5-9189-8fe1334f1d18 on n-h2-843621-1 May 27 15:09:45.812564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-818b12bd-6c82-4eb9-a3fe-2f11a17ea0d9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:45.812923 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-cc389e2f-d6a5-4da8-a174-89fab1d13d9d req-241d2af9-4d87-45ee-84c7-50b6fa1f30f3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064737 May 27 15:09:45.814072 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1542/3097] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:09:45.816110 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-818b12bd-6c82-4eb9-a3fe-2f11a17ea0d9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:45.817831 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-818b12bd-6c82-4eb9-a3fe-2f11a17ea0d9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:45.818285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-818b12bd-6c82-4eb9-a3fe-2f11a17ea0d9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:45.824399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-06b50ca4-6e85-4e66-83d5-8d710ec6b0ef tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:45.825434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-06b50ca4-6e85-4e66-83d5-8d710ec6b0ef tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:45.978165 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-06b50ca4-6e85-4e66-83d5-8d710ec6b0ef tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:45.986772 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-06b50ca4-6e85-4e66-83d5-8d710ec6b0ef tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1122 microversion: 2.1 time: 0.169419 May 27 15:09:46.004136 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1543/3098] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:45 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1122 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:46.014021 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4f8cef5d-780c-4306-a4d2-d55b2bff3d6c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:46.023453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4f8cef5d-780c-4306-a4d2-d55b2bff3d6c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:46.045592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f8cef5d-780c-4306-a4d2-d55b2bff3d6c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:46.046061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f8cef5d-780c-4306-a4d2-d55b2bff3d6c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:46.046871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f8cef5d-780c-4306-a4d2-d55b2bff3d6c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:46.047321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f8cef5d-780c-4306-a4d2-d55b2bff3d6c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:46.145372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-818b12bd-6c82-4eb9-a3fe-2f11a17ea0d9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:46.155226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-818b12bd-6c82-4eb9-a3fe-2f11a17ea0d9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:46.169416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-818b12bd-6c82-4eb9-a3fe-2f11a17ea0d9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:46.174213 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-818b12bd-6c82-4eb9-a3fe-2f11a17ea0d9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1724 microversion: 2.20 time: 0.387828 May 27 15:09:46.174809 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1556/3099] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:45 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1724 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:09:46.377696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4f8cef5d-780c-4306-a4d2-d55b2bff3d6c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:46.388603 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4f8cef5d-780c-4306-a4d2-d55b2bff3d6c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1317 microversion: 2.1 time: 0.392700 May 27 15:09:46.389221 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1544/3100] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:45 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:46.515132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0c322b8c-87bb-4537-957b-6a11bf4ece50 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:46.515985 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0c322b8c-87bb-4537-957b-6a11bf4ece50 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:46.524281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c322b8c-87bb-4537-957b-6a11bf4ece50 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:46.527312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c322b8c-87bb-4537-957b-6a11bf4ece50 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:46.528805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c322b8c-87bb-4537-957b-6a11bf4ece50 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:46.529287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c322b8c-87bb-4537-957b-6a11bf4ece50 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:46.802715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a0cd0786-5629-46ce-8fca-8e7fa59dd886 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:46.803382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a0cd0786-5629-46ce-8fca-8e7fa59dd886 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:46.825730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a0cd0786-5629-46ce-8fca-8e7fa59dd886 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:46.825730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a0cd0786-5629-46ce-8fca-8e7fa59dd886 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:46.826020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a0cd0786-5629-46ce-8fca-8e7fa59dd886 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:46.826275 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a0cd0786-5629-46ce-8fca-8e7fa59dd886 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:46.867573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:46.883431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0c322b8c-87bb-4537-957b-6a11bf4ece50 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:46.891451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:46.904168 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0c322b8c-87bb-4537-957b-6a11bf4ece50 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.391796 May 27 15:09:46.906744 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1557/3101] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:46 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:46.979020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a0cd0786-5629-46ce-8fca-8e7fa59dd886 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:46.992732 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a0cd0786-5629-46ce-8fca-8e7fa59dd886 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1272 microversion: 2.1 time: 0.194141 May 27 15:09:46.993603 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1545/3102] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:46 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:47.013727 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e4ef4ec4-dca7-49fc-912a-4e448eb84920 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:47.014856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e4ef4ec4-dca7-49fc-912a-4e448eb84920 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:47.046339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4ef4ec4-dca7-49fc-912a-4e448eb84920 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:47.046820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4ef4ec4-dca7-49fc-912a-4e448eb84920 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:47.048139 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4ef4ec4-dca7-49fc-912a-4e448eb84920 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:47.048590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4ef4ec4-dca7-49fc-912a-4e448eb84920 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:47.169320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e4ef4ec4-dca7-49fc-912a-4e448eb84920 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:47.180605 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e4ef4ec4-dca7-49fc-912a-4e448eb84920 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1220 microversion: 2.1 time: 0.172295 May 27 15:09:47.181597 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1558/3103] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:47 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1220 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:47.198075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-52ee12e5-88fc-4813-9afc-a47f970d25f5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:47.199003 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-52ee12e5-88fc-4813-9afc-a47f970d25f5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:47.207617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52ee12e5-88fc-4813-9afc-a47f970d25f5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:47.208592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52ee12e5-88fc-4813-9afc-a47f970d25f5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:47.209643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52ee12e5-88fc-4813-9afc-a47f970d25f5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:47.210277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52ee12e5-88fc-4813-9afc-a47f970d25f5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:47.293927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52ee12e5-88fc-4813-9afc-a47f970d25f5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:47.295841 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52ee12e5-88fc-4813-9afc-a47f970d25f5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:47.299036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-52ee12e5-88fc-4813-9afc-a47f970d25f5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lazy-loading 'fault' on Instance uuid 3d17a653-7f3e-44d7-9b89-68b4b35c9175 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:09:47.406599 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8aec313a-4f11-459d-961a-255d0642bb0a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:47.407589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8aec313a-4f11-459d-961a-255d0642bb0a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:47.422010 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8aec313a-4f11-459d-961a-255d0642bb0a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:47.422827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8aec313a-4f11-459d-961a-255d0642bb0a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:47.425518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8aec313a-4f11-459d-961a-255d0642bb0a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:47.432467 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8aec313a-4f11-459d-961a-255d0642bb0a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:47.787993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-52ee12e5-88fc-4813-9afc-a47f970d25f5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:47.805605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-52ee12e5-88fc-4813-9afc-a47f970d25f5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:47.811349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-52ee12e5-88fc-4813-9afc-a47f970d25f5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:47.814805 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-52ee12e5-88fc-4813-9afc-a47f970d25f5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 200 len: 1371 microversion: 2.20 time: 0.619186 May 27 15:09:47.816540 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1546/3104] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:47 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 1371 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:09:47.854757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-0b9a4ec8-ac26-4cda-ae59-67b9bfe991b0 req-2437a59f-ea92-4811-853f-32748853f7f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d17a653-7f3e-44d7-9b89-68b4b35c9175", "name": "network-vif-deleted", "tag": "f12487eb-11c2-4e49-877b-4fd161db40aa"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:47.862886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:47.880560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0b9a4ec8-ac26-4cda-ae59-67b9bfe991b0 req-2437a59f-ea92-4811-853f-32748853f7f4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:47.881455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0b9a4ec8-ac26-4cda-ae59-67b9bfe991b0 req-2437a59f-ea92-4811-853f-32748853f7f4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:47.933974 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-0b9a4ec8-ac26-4cda-ae59-67b9bfe991b0 req-2437a59f-ea92-4811-853f-32748853f7f4 service nova] Creating event network-vif-deleted:f12487eb-11c2-4e49-877b-4fd161db40aa for instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 on n-h2-843621-1 May 27 15:09:47.957705 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-0b9a4ec8-ac26-4cda-ae59-67b9bfe991b0 req-2437a59f-ea92-4811-853f-32748853f7f4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105787 May 27 15:09:47.961396 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1547/3105] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:09:47.976833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-04b085c3-aea0-4093-aafd-87141a378883 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:47.980478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-04b085c3-aea0-4093-aafd-87141a378883 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:48.004822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04b085c3-aea0-4093-aafd-87141a378883 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:48.004822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04b085c3-aea0-4093-aafd-87141a378883 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:48.005430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04b085c3-aea0-4093-aafd-87141a378883 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:48.007862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04b085c3-aea0-4093-aafd-87141a378883 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:48.261267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-04b085c3-aea0-4093-aafd-87141a378883 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:48.274880 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-04b085c3-aea0-4093-aafd-87141a378883 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.311458 May 27 15:09:48.276052 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1548/3106] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:47 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:48.285241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-987d50b9-5c46-4a5a-8af1-c136c8576030 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:48.285866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-987d50b9-5c46-4a5a-8af1-c136c8576030 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:48.304604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-987d50b9-5c46-4a5a-8af1-c136c8576030 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:48.308122 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-987d50b9-5c46-4a5a-8af1-c136c8576030 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:48.309507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-987d50b9-5c46-4a5a-8af1-c136c8576030 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:48.310139 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-987d50b9-5c46-4a5a-8af1-c136c8576030 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:48.600386 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8aec313a-4f11-459d-961a-255d0642bb0a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:48.611815 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8aec313a-4f11-459d-961a-255d0642bb0a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1317 microversion: 2.1 time: 1.207731 May 27 15:09:48.612821 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1559/3107] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:47 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1317 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:48.626309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-97953f75-ed52-45d8-a644-17e69944b692 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:48.626934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-97953f75-ed52-45d8-a644-17e69944b692 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:48.642880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-97953f75-ed52-45d8-a644-17e69944b692 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:48.643350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-97953f75-ed52-45d8-a644-17e69944b692 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:48.644144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-97953f75-ed52-45d8-a644-17e69944b692 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:48.649111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-97953f75-ed52-45d8-a644-17e69944b692 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:48.726764 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-987d50b9-5c46-4a5a-8af1-c136c8576030 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:48.736473 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-987d50b9-5c46-4a5a-8af1-c136c8576030 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1314 microversion: 2.1 time: 0.459350 May 27 15:09:48.743561 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1549/3108] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:48 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:48.790416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-97953f75-ed52-45d8-a644-17e69944b692 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:48.802681 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-97953f75-ed52-45d8-a644-17e69944b692 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1238 microversion: 2.1 time: 0.187679 May 27 15:09:48.807311 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1560/3109] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:48 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1238 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:48.836839 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2b947b1e-478d-4d51-9ad7-1a80569e3552 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:48.838100 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2b947b1e-478d-4d51-9ad7-1a80569e3552 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:48.847839 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2b947b1e-478d-4d51-9ad7-1a80569e3552 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:48.850900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2b947b1e-478d-4d51-9ad7-1a80569e3552 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:48.851882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2b947b1e-478d-4d51-9ad7-1a80569e3552 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:48.853776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2b947b1e-478d-4d51-9ad7-1a80569e3552 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:48.903299 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-2b947b1e-478d-4d51-9ad7-1a80569e3552 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] HTTP exception thrown: Instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 could not be found. May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2b947b1e-478d-4d51-9ad7-1a80569e3552 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Request method failure captured: May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 HTTP/1.1 May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOjF6rvMnwWf1fRJt26Wn5XRF7EUO5sXXuEaxwBKoPEc5z9FjH_7NDJRc_43kplV1FEfz14qdrP3ds-i24EyFzWma2Lu22che-wRMQA6x1MCvG29dubYGaP8v-OZu3yzAQ3lS3Tvm0No_avKhYFvwDITxqVSytbHmXvtMmmJ9LgNBbo May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-Openstack-Nova-Api-Version: 2.20 May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 3565af3212e74e83b5adc7465922a274 May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1265741676 May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3565af3212e74e83b5adc7465922a274"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3565af3212e74e83b5adc7465922a274"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3565af3212e74e83b5adc7465922a274"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3565af3212e74e83b5adc7465922a274", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1265741676 May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 3565af3212e74e83b5adc7465922a274 May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1265741676 May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-AttachVolumeShelveTestJSON-1265741676-project May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 13124d91fc454405af084784c6f447ab May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1265741676-project May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 could not be found. May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '3d17a653-7f3e-44d7-9b89-68b4b35c9175'} May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 could not be found. May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 could not be found. May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:09:48.907056 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:09:48.911115 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:09:48.911115 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:09:48.911115 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:09:48.911115 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:09:48.911115 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:09:48.911115 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:09:48.911115 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 could not be found. May 27 15:09:48.911115 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:09:48.912742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2b947b1e-478d-4d51-9ad7-1a80569e3552 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Returning 404 to user: Instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:09:48.918642 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2b947b1e-478d-4d51-9ad7-1a80569e3552 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 404 len: 111 microversion: 2.20 time: 0.087727 May 27 15:09:48.920215 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1550/3110] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:09:48 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:09:48.928579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b6e061f2-f1b2-4491-a4c2-99d64797aa93 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '.version_select at 0x7fc77601d940>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:48.971487 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b6e061f2-f1b2-4491-a4c2-99d64797aa93 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1612558958" status: 204 len: 0 microversion: 2.20 time: 0.046986 May 27 15:09:48.972802 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1561/3111] 10.222.0.13 () {60 vars in 1261 bytes} [Fri May 27 15:09:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1612558958 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:09:49.296184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d55132cc-95c1-4d5c-b8f9-fc5214d35633 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:49.297468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d55132cc-95c1-4d5c-b8f9-fc5214d35633 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:49.320838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d55132cc-95c1-4d5c-b8f9-fc5214d35633 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:49.323936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d55132cc-95c1-4d5c-b8f9-fc5214d35633 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:49.327958 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d55132cc-95c1-4d5c-b8f9-fc5214d35633 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:49.329442 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d55132cc-95c1-4d5c-b8f9-fc5214d35633 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:49.629142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-01dc69e7-c1a7-4893-af02-16ef1fe6c700 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:49.629765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-01dc69e7-c1a7-4893-af02-16ef1fe6c700 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:49.652325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-01dc69e7-c1a7-4893-af02-16ef1fe6c700 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:49.671055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-01dc69e7-c1a7-4893-af02-16ef1fe6c700 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:49.672414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-01dc69e7-c1a7-4893-af02-16ef1fe6c700 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:49.672868 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-01dc69e7-c1a7-4893-af02-16ef1fe6c700 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:50.629078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d55132cc-95c1-4d5c-b8f9-fc5214d35633 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:50.642596 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d55132cc-95c1-4d5c-b8f9-fc5214d35633 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 1.353701 May 27 15:09:50.645869 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1551/3112] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:49 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:50.655475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b85f65fb-241a-4e68-b518-921eafef9c6d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:50.658041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b85f65fb-241a-4e68-b518-921eafef9c6d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:50.673888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b85f65fb-241a-4e68-b518-921eafef9c6d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:50.676482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b85f65fb-241a-4e68-b518-921eafef9c6d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:50.677584 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b85f65fb-241a-4e68-b518-921eafef9c6d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:50.678869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b85f65fb-241a-4e68-b518-921eafef9c6d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:50.961322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b85f65fb-241a-4e68-b518-921eafef9c6d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:50.973507 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b85f65fb-241a-4e68-b518-921eafef9c6d tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1314 microversion: 2.1 time: 0.326012 May 27 15:09:50.976648 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1552/3113] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:50 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:50.997456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-95d7e3ec-5e38-442b-a650-6c8d1899a56a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:50.998805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-95d7e3ec-5e38-442b-a650-6c8d1899a56a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:51.012776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-95d7e3ec-5e38-442b-a650-6c8d1899a56a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:51.013914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-95d7e3ec-5e38-442b-a650-6c8d1899a56a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:51.016061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-95d7e3ec-5e38-442b-a650-6c8d1899a56a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:51.019690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-95d7e3ec-5e38-442b-a650-6c8d1899a56a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:51.106574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-01dc69e7-c1a7-4893-af02-16ef1fe6c700 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:51.110982 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-01dc69e7-c1a7-4893-af02-16ef1fe6c700 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1317 microversion: 2.1 time: 1.485619 May 27 15:09:51.117282 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1562/3114] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:49 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1317 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:51.220979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-95d7e3ec-5e38-442b-a650-6c8d1899a56a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:51.233172 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-95d7e3ec-5e38-442b-a650-6c8d1899a56a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1238 microversion: 2.1 time: 0.252828 May 27 15:09:51.234419 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1553/3115] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:50 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1238 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:51.662591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4ac183f7-985b-4c65-a203-b9a72850da86 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:51.663647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4ac183f7-985b-4c65-a203-b9a72850da86 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:51.673135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:51.674274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:51.679943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ac183f7-985b-4c65-a203-b9a72850da86 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:51.682150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ac183f7-985b-4c65-a203-b9a72850da86 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:51.683016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ac183f7-985b-4c65-a203-b9a72850da86 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:51.692004 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ac183f7-985b-4c65-a203-b9a72850da86 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:51.995248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7b57688a-c147-46c5-a36f-2ad239c650a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:51.996881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7b57688a-c147-46c5-a36f-2ad239c650a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:52.031379 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b57688a-c147-46c5-a36f-2ad239c650a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:52.032768 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b57688a-c147-46c5-a36f-2ad239c650a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:52.033602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b57688a-c147-46c5-a36f-2ad239c650a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:52.034233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b57688a-c147-46c5-a36f-2ad239c650a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:52.208021 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4ac183f7-985b-4c65-a203-b9a72850da86 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:52.219341 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4ac183f7-985b-4c65-a203-b9a72850da86 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.560873 May 27 15:09:52.219936 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1563/3116] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:51 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:52.252407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7e2b2240-00e4-47c5-b08d-aea8db59b42e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:52.260008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7e2b2240-00e4-47c5-b08d-aea8db59b42e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:52.275013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e2b2240-00e4-47c5-b08d-aea8db59b42e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:52.277878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e2b2240-00e4-47c5-b08d-aea8db59b42e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:52.278967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e2b2240-00e4-47c5-b08d-aea8db59b42e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:52.282941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e2b2240-00e4-47c5-b08d-aea8db59b42e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:53.003643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7b57688a-c147-46c5-a36f-2ad239c650a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:53.015182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7e2b2240-00e4-47c5-b08d-aea8db59b42e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:53.023787 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7b57688a-c147-46c5-a36f-2ad239c650a8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1314 microversion: 2.1 time: 1.033946 May 27 15:09:53.026557 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1554/3117] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:51 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1314 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:53.032087 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7e2b2240-00e4-47c5-b08d-aea8db59b42e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1317 microversion: 2.1 time: 0.794006 May 27 15:09:53.046099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fc7d369e-1487-42e0-9582-5960e1a88c19 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:53.047434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fc7d369e-1487-42e0-9582-5960e1a88c19 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:53.047613 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1564/3118] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:52 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1317 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:53.053634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-8a82e54c-b9ff-45ed-a657-b6ebd42c94d5 req-b2623449-0e89-4792-b209-949c569d2974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a29b1804-7072-488e-ba2d-5726d65fee2f", "tag": "8d69d638-3687-4f6a-a53f-b2f5f49aac1c"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:53.074960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-8a82e54c-b9ff-45ed-a657-b6ebd42c94d5 req-b2623449-0e89-4792-b209-949c569d2974 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:53.076797 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-8a82e54c-b9ff-45ed-a657-b6ebd42c94d5 req-b2623449-0e89-4792-b209-949c569d2974 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:53.087283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc7d369e-1487-42e0-9582-5960e1a88c19 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:53.096204 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc7d369e-1487-42e0-9582-5960e1a88c19 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:53.098229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc7d369e-1487-42e0-9582-5960e1a88c19 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:53.101958 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc7d369e-1487-42e0-9582-5960e1a88c19 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:53.110975 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-8a82e54c-b9ff-45ed-a657-b6ebd42c94d5 req-b2623449-0e89-4792-b209-949c569d2974 service nova] Creating event network-changed:8d69d638-3687-4f6a-a53f-b2f5f49aac1c for instance a29b1804-7072-488e-ba2d-5726d65fee2f on n-h1-843621-1 May 27 15:09:53.132470 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-8a82e54c-b9ff-45ed-a657-b6ebd42c94d5 req-b2623449-0e89-4792-b209-949c569d2974 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083259 May 27 15:09:53.137309 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1565/3119] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:09:53.151235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f6bd4e7b-13d5-474f-96ad-7cbfb993fe61 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Action: 'create', calling method: .version_select at 0x7fc78065fc10>, body: {"keypair": {"name": "tempest-keypair-104961567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKJwrzUq9pD7eDXP2bKREIhEBE0xqwKVb9TgyRHbk0fFk1eWbsPP6nsJ9a6VG86qg0wGFqsNqevkGPuGw/yJ1xaWD1mJJfTABNwc2X9o72ld9jHiqq0QJakzFiULDAOfw=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:53.165442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:53.204350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-f6bd4e7b-13d5-474f-96ad-7cbfb993fe61 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Getting quotas for project 3565af3212e74e83b5adc7465922a274. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:09:53.223411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-f6bd4e7b-13d5-474f-96ad-7cbfb993fe61 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Getting quotas for user 13124d91fc454405af084784c6f447ab and project 3565af3212e74e83b5adc7465922a274. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:09:53.321228 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f6bd4e7b-13d5-474f-96ad-7cbfb993fe61 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.181749 May 27 15:09:53.324298 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1566/3120] 10.222.0.13 () {62 vars in 1199 bytes} [Fri May 27 15:09:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 186 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 15:09:53.343402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9738978e-1752-4757-9c83-4a04bb9d124e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:53.344230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9738978e-1752-4757-9c83-4a04bb9d124e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:53.386792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fc7d369e-1487-42e0-9582-5960e1a88c19 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:53.388623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9738978e-1752-4757-9c83-4a04bb9d124e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:53.391264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9738978e-1752-4757-9c83-4a04bb9d124e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:53.395025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9738978e-1752-4757-9c83-4a04bb9d124e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:53.397676 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9738978e-1752-4757-9c83-4a04bb9d124e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:53.401428 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fc7d369e-1487-42e0-9582-5960e1a88c19 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1305 microversion: 2.1 time: 0.373601 May 27 15:09:53.404549 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1555/3121] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:53 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1305 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:53.871395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9738978e-1752-4757-9c83-4a04bb9d124e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:53.891503 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9738978e-1752-4757-9c83-4a04bb9d124e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.556133 May 27 15:09:53.894617 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1567/3122] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:53 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:54.043974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-14e1b854-c34c-46b1-a4f2-38224524bee9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:54.044597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-14e1b854-c34c-46b1-a4f2-38224524bee9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:54.054133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8b6c0717-9c51-45c5-a5dc-c433c14ef28d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:54.054751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8b6c0717-9c51-45c5-a5dc-c433c14ef28d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:54.068700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b6c0717-9c51-45c5-a5dc-c433c14ef28d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:54.070476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14e1b854-c34c-46b1-a4f2-38224524bee9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:54.070933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14e1b854-c34c-46b1-a4f2-38224524bee9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:54.071724 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14e1b854-c34c-46b1-a4f2-38224524bee9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:54.072222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14e1b854-c34c-46b1-a4f2-38224524bee9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:54.075443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b6c0717-9c51-45c5-a5dc-c433c14ef28d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:54.076341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b6c0717-9c51-45c5-a5dc-c433c14ef28d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:54.076815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b6c0717-9c51-45c5-a5dc-c433c14ef28d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:54.584058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-14e1b854-c34c-46b1-a4f2-38224524bee9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:54.597699 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-14e1b854-c34c-46b1-a4f2-38224524bee9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1314 microversion: 2.1 time: 0.560272 May 27 15:09:54.598867 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1556/3123] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:54 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:54.608434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3e83ded9-f6b4-4b1b-b243-8b012fa75ed9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:54.609367 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3e83ded9-f6b4-4b1b-b243-8b012fa75ed9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:54.623844 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e83ded9-f6b4-4b1b-b243-8b012fa75ed9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:54.625023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e83ded9-f6b4-4b1b-b243-8b012fa75ed9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:54.626406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e83ded9-f6b4-4b1b-b243-8b012fa75ed9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:54.628159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e83ded9-f6b4-4b1b-b243-8b012fa75ed9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:54.724934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8b6c0717-9c51-45c5-a5dc-c433c14ef28d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:54.735244 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8b6c0717-9c51-45c5-a5dc-c433c14ef28d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1317 microversion: 2.1 time: 0.685360 May 27 15:09:54.738043 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1568/3124] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:54 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1317 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:09:54.911822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6c658ae3-bfed-4ea0-a695-a47200694592 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:54.912822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6c658ae3-bfed-4ea0-a695-a47200694592 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:54.924440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c658ae3-bfed-4ea0-a695-a47200694592 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:54.925301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c658ae3-bfed-4ea0-a695-a47200694592 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:54.926965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c658ae3-bfed-4ea0-a695-a47200694592 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:54.927610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c658ae3-bfed-4ea0-a695-a47200694592 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:55.237265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:09:55.708016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3e83ded9-f6b4-4b1b-b243-8b012fa75ed9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:55.716478 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3e83ded9-f6b4-4b1b-b243-8b012fa75ed9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1305 microversion: 2.1 time: 1.116068 May 27 15:09:55.717097 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1557/3125] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:54 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1305 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:55.732232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-ae9bdc45-11b7-40c3-ba0c-0b3db8bc8063 req-32dca358-256d-4661-bb6c-59f18d301eda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6", "tag": "4b993dec-9e5f-4bf8-93f4-0f1265b53372"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:55.758399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ae9bdc45-11b7-40c3-ba0c-0b3db8bc8063 req-32dca358-256d-4661-bb6c-59f18d301eda service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:55.759095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ae9bdc45-11b7-40c3-ba0c-0b3db8bc8063 req-32dca358-256d-4661-bb6c-59f18d301eda service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:55.783807 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-ae9bdc45-11b7-40c3-ba0c-0b3db8bc8063 req-32dca358-256d-4661-bb6c-59f18d301eda service nova] Creating event network-changed:4b993dec-9e5f-4bf8-93f4-0f1265b53372 for instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 on n-h1-843621-1 May 27 15:09:55.790626 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-ae9bdc45-11b7-40c3-ba0c-0b3db8bc8063 req-32dca358-256d-4661-bb6c-59f18d301eda service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063634 May 27 15:09:55.793346 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1558/3126] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:09:55.801306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7c9eab56-427f-436b-b5c8-bc9c225bfae5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Action: 'create', calling method: .version_select at 0x7fc78064f5e0>, body: {"keypair": {"name": "tempest-keypair-977871244", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgEEHJvcLyOhEgvt2+51w00y01RHMYOUzLb2w+J9cCflnp6tMtKIbSSXlFUOVYKK3FLSq17SyqBuMvAj14EH9kbW/Jnae8hacIoFi5UXflR9WSZmEYQPAxHSzkrdhxdag=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:55.819743 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-7c9eab56-427f-436b-b5c8-bc9c225bfae5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Getting quotas for project e3657598de154fedbe5fcf2eb4fa9c94. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:09:55.826117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-7c9eab56-427f-436b-b5c8-bc9c225bfae5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Getting quotas for user 76881ea8722f45568bb04c26743b51d6 and project e3657598de154fedbe5fcf2eb4fa9c94. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:09:55.856519 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7c9eab56-427f-436b-b5c8-bc9c225bfae5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.060196 May 27 15:09:55.857843 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1559/3127] 10.222.0.13 () {62 vars in 1199 bytes} [Fri May 27 15:09:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 64 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 15:09:55.871226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-143f6a00-911b-4f75-aa48-39271bcedaf8 req-5c7df4f5-7842-48a5-84b8-81c9538c5d52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5803f6c5-8f5f-400f-b2c3-20c393b5f72c", "tag": "e5616912-9373-4b2e-ac8b-c7479952656c"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:55.880980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-143f6a00-911b-4f75-aa48-39271bcedaf8 req-5c7df4f5-7842-48a5-84b8-81c9538c5d52 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:55.881826 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-143f6a00-911b-4f75-aa48-39271bcedaf8 req-5c7df4f5-7842-48a5-84b8-81c9538c5d52 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:55.896607 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-143f6a00-911b-4f75-aa48-39271bcedaf8 req-5c7df4f5-7842-48a5-84b8-81c9538c5d52 service nova] Creating event network-changed:e5616912-9373-4b2e-ac8b-c7479952656c for instance 5803f6c5-8f5f-400f-b2c3-20c393b5f72c on n-h2-843621-1 May 27 15:09:55.902336 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-143f6a00-911b-4f75-aa48-39271bcedaf8 req-5c7df4f5-7842-48a5-84b8-81c9538c5d52 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042881 May 27 15:09:55.902959 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1560/3128] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:09:55.908318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3fe8e7e3-5865-4f15-af1e-0bc15d888f6c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:55.909302 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3fe8e7e3-5865-4f15-af1e-0bc15d888f6c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:55.917956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fe8e7e3-5865-4f15-af1e-0bc15d888f6c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:55.918804 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fe8e7e3-5865-4f15-af1e-0bc15d888f6c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:55.919766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fe8e7e3-5865-4f15-af1e-0bc15d888f6c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:55.920366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fe8e7e3-5865-4f15-af1e-0bc15d888f6c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:55.975209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6c658ae3-bfed-4ea0-a695-a47200694592 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:55.987056 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6c658ae3-bfed-4ea0-a695-a47200694592 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 1.079221 May 27 15:09:55.990942 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1569/3129] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:54 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:09:56.001757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-da48cd27-c6d7-4211-8118-7f1ab04a61bb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:56.002122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-da48cd27-c6d7-4211-8118-7f1ab04a61bb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:56.017349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da48cd27-c6d7-4211-8118-7f1ab04a61bb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:56.022304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da48cd27-c6d7-4211-8118-7f1ab04a61bb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:56.029267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da48cd27-c6d7-4211-8118-7f1ab04a61bb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:56.030460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da48cd27-c6d7-4211-8118-7f1ab04a61bb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:56.818540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3fe8e7e3-5865-4f15-af1e-0bc15d888f6c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:56.847457 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3fe8e7e3-5865-4f15-af1e-0bc15d888f6c tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1314 microversion: 2.1 time: 0.941875 May 27 15:09:56.857056 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1561/3130] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:55 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1314 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:56.861924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-da48cd27-c6d7-4211-8118-7f1ab04a61bb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:56.875857 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-da48cd27-c6d7-4211-8118-7f1ab04a61bb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1317 microversion: 2.1 time: 0.883726 May 27 15:09:56.876431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-67821941-a6af-4af1-8ea6-249b82f7cb5c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:56.877139 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-67821941-a6af-4af1-8ea6-249b82f7cb5c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:56.884760 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1570/3131] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:55 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1317 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:56.889753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67821941-a6af-4af1-8ea6-249b82f7cb5c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:56.892564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67821941-a6af-4af1-8ea6-249b82f7cb5c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:56.894557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67821941-a6af-4af1-8ea6-249b82f7cb5c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:56.895029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67821941-a6af-4af1-8ea6-249b82f7cb5c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:57.007419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-23c6090a-4f7e-4749-8d78-967f799b6825 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:57.008198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-23c6090a-4f7e-4749-8d78-967f799b6825 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:57.020492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23c6090a-4f7e-4749-8d78-967f799b6825 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:57.021348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23c6090a-4f7e-4749-8d78-967f799b6825 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:57.023440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23c6090a-4f7e-4749-8d78-967f799b6825 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:57.024848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23c6090a-4f7e-4749-8d78-967f799b6825 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:57.766579 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-67821941-a6af-4af1-8ea6-249b82f7cb5c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:57.776049 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-67821941-a6af-4af1-8ea6-249b82f7cb5c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1305 microversion: 2.1 time: 0.924033 May 27 15:09:57.780726 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1562/3132] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:56 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1305 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:57.865614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-727babbd-5d21-4ba0-ba7d-241f5e9580b6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:57.867050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-727babbd-5d21-4ba0-ba7d-241f5e9580b6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:57.880166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-727babbd-5d21-4ba0-ba7d-241f5e9580b6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:57.881275 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-727babbd-5d21-4ba0-ba7d-241f5e9580b6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:57.882459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-727babbd-5d21-4ba0-ba7d-241f5e9580b6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:57.883198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-727babbd-5d21-4ba0-ba7d-241f5e9580b6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:57.928976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-23c6090a-4f7e-4749-8d78-967f799b6825 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:57.944910 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-23c6090a-4f7e-4749-8d78-967f799b6825 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.938398 May 27 15:09:57.953339 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1571/3133] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:57 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:09:57.962555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f26a39fe-9a0f-41ac-ad40-40e819f08300 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:57.963893 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f26a39fe-9a0f-41ac-ad40-40e819f08300 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:57.978920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f26a39fe-9a0f-41ac-ad40-40e819f08300 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:57.979687 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f26a39fe-9a0f-41ac-ad40-40e819f08300 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:57.980788 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f26a39fe-9a0f-41ac-ad40-40e819f08300 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:57.981453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f26a39fe-9a0f-41ac-ad40-40e819f08300 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:58.425640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-727babbd-5d21-4ba0-ba7d-241f5e9580b6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:58.439283 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-727babbd-5d21-4ba0-ba7d-241f5e9580b6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1314 microversion: 2.1 time: 0.573229 May 27 15:09:58.448810 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1563/3134] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:57 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:58.511656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f26a39fe-9a0f-41ac-ad40-40e819f08300 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:58.527046 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f26a39fe-9a0f-41ac-ad40-40e819f08300 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1317 microversion: 2.1 time: 0.566916 May 27 15:09:58.528168 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1572/3135] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:57 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1317 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:58.660087 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-faca5031-f13e-45b8-8bcd-d166eb0c0bc7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1327670383", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ed0fab0f-90d3-413e-bda8-6f2ff4115a99"}, {"port": "958625ea-67d8-42d6-878e-1e264997c838", "tag": "port-1"}, {"port": "710a3bb3-e4d3-4b44-bf00-38bbf0d70d23", "tag": "port-2"}, {"uuid": "5e6f52f4-bc07-4b8b-a019-4b0566961100", "tag": "net-1"}, {"uuid": "5e6f52f4-bc07-4b8b-a019-4b0566961100"}, {"uuid": "6b98f681-3fa8-40f2-a7f7-34a2af073f3e", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "6b98f681-3fa8-40f2-a7f7-34a2af073f3e", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ea38b7e5-0d09-4d53-95dc-dfce69673c6b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "d9ed316f-ad6b-4578-950e-05904dd54e52", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "b3f45164-669f-4b1e-b63f-6e887e13e1dd", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2069045369"}], "key_name": "tempest-keypair-977871244", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:09:58.796259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-85a071d6-6b84-48a2-ab15-c14adb8d4b9f tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:58.797068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-85a071d6-6b84-48a2-ab15-c14adb8d4b9f tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:58.811915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85a071d6-6b84-48a2-ab15-c14adb8d4b9f tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:58.818004 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85a071d6-6b84-48a2-ab15-c14adb8d4b9f tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:58.819582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85a071d6-6b84-48a2-ab15-c14adb8d4b9f tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:58.821354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85a071d6-6b84-48a2-ab15-c14adb8d4b9f tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:59.140856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-faca5031-f13e-45b8-8bcd-d166eb0c0bc7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] validate_networks() for [('ed0fab0f-90d3-413e-bda8-6f2ff4115a99', None, None, None, None, None), (None, None, '958625ea-67d8-42d6-878e-1e264997c838', None, None, None), (None, None, '710a3bb3-e4d3-4b44-bf00-38bbf0d70d23', None, None, None), ('5e6f52f4-bc07-4b8b-a019-4b0566961100', None, None, None, None, None), ('5e6f52f4-bc07-4b8b-a019-4b0566961100', None, None, None, None, None), ('6b98f681-3fa8-40f2-a7f7-34a2af073f3e', '10.2.2.100', None, None, None, None), ('6b98f681-3fa8-40f2-a7f7-34a2af073f3e', '10.2.2.200', None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:09:59.284217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-85a071d6-6b84-48a2-ab15-c14adb8d4b9f tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:59.302388 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-85a071d6-6b84-48a2-ab15-c14adb8d4b9f tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1305 microversion: 2.1 time: 0.509802 May 27 15:09:59.309458 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1573/3136] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:58 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1305 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:09:59.325404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9ac707e3-5555-4fb7-b878-c8b9a4b1b4cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:09:59.328147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9ac707e3-5555-4fb7-b878-c8b9a4b1b4cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:09:59.349402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ac707e3-5555-4fb7-b878-c8b9a4b1b4cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:59.350203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ac707e3-5555-4fb7-b878-c8b9a4b1b4cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:59.351368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ac707e3-5555-4fb7-b878-c8b9a4b1b4cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:09:59.352088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ac707e3-5555-4fb7-b878-c8b9a4b1b4cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:09:59.937122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9ac707e3-5555-4fb7-b878-c8b9a4b1b4cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:09:59.945462 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9ac707e3-5555-4fb7-b878-c8b9a4b1b4cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.634573 May 27 15:09:59.946052 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1574/3137] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:09:59 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:09:59.966828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b7719822-5c8b-47e0-86a3-9a4ee8e4f6b4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-216711095", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7fbb2c43-5d8d-43c9-999b-43c445e0b1f6"}], "security_groups": [{"name": "tempest-securitygroup--2078529753"}], "key_name": "tempest-keypair-104961567", "user_data": "}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:00.258455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-b7719822-5c8b-47e0-86a3-9a4ee8e4f6b4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] validate_networks() for [('7fbb2c43-5d8d-43c9-999b-43c445e0b1f6', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:10:01.518039 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b7719822-5c8b-47e0-86a3-9a4ee8e4f6b4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:10:01.518624 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b7719822-5c8b-47e0-86a3-9a4ee8e4f6b4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:10:01.518933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b7719822-5c8b-47e0-86a3-9a4ee8e4f6b4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:10:01.519355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b7719822-5c8b-47e0-86a3-9a4ee8e4f6b4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:10:01.519759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b7719822-5c8b-47e0-86a3-9a4ee8e4f6b4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:10:01.551175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b7719822-5c8b-47e0-86a3-9a4ee8e4f6b4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:01.551870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b7719822-5c8b-47e0-86a3-9a4ee8e4f6b4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:01.554477 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b7719822-5c8b-47e0-86a3-9a4ee8e4f6b4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:01.558063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b7719822-5c8b-47e0-86a3-9a4ee8e4f6b4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:01.620191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-b7719822-5c8b-47e0-86a3-9a4ee8e4f6b4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Getting quotas for project 3565af3212e74e83b5adc7465922a274. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:10:01.628618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-b7719822-5c8b-47e0-86a3-9a4ee8e4f6b4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Getting quotas for user 13124d91fc454405af084784c6f447ab and project 3565af3212e74e83b5adc7465922a274. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:10:01.645269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b7719822-5c8b-47e0-86a3-9a4ee8e4f6b4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:10:01.648988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b7719822-5c8b-47e0-86a3-9a4ee8e4f6b4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:10:01.722498 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b7719822-5c8b-47e0-86a3-9a4ee8e4f6b4 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.768512 May 27 15:10:01.736094 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1575/3138] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 27 15:09:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1784 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 15:10:01.741403 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dbbb2993-f2a6-47a6-b77f-2ed8b9491133 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:01.741656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dbbb2993-f2a6-47a6-b77f-2ed8b9491133 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:01.757546 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dbbb2993-f2a6-47a6-b77f-2ed8b9491133 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:01.758019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dbbb2993-f2a6-47a6-b77f-2ed8b9491133 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:01.758823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dbbb2993-f2a6-47a6-b77f-2ed8b9491133 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:01.759377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dbbb2993-f2a6-47a6-b77f-2ed8b9491133 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:02.954787 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dbbb2993-f2a6-47a6-b77f-2ed8b9491133 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:02.969793 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dbbb2993-f2a6-47a6-b77f-2ed8b9491133 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1314 microversion: 2.1 time: 1.229417 May 27 15:10:02.971513 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1576/3139] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:01 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1314 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:02.997991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7138b260-338e-47c9-94f8-f49b92dea99e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:03.001968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7138b260-338e-47c9-94f8-f49b92dea99e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:03.024475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7138b260-338e-47c9-94f8-f49b92dea99e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:03.026861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7138b260-338e-47c9-94f8-f49b92dea99e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:03.028703 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7138b260-338e-47c9-94f8-f49b92dea99e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:03.030034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7138b260-338e-47c9-94f8-f49b92dea99e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:03.739706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7138b260-338e-47c9-94f8-f49b92dea99e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:03.743496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:03.748817 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7138b260-338e-47c9-94f8-f49b92dea99e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1317 microversion: 2.1 time: 0.775975 May 27 15:10:03.761062 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1577/3140] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:02 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1317 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:03.766258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8ba3d14a-ec6d-4df0-8464-88ed0cd291df tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:03.766866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8ba3d14a-ec6d-4df0-8464-88ed0cd291df tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:03.783518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ba3d14a-ec6d-4df0-8464-88ed0cd291df tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:03.783936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ba3d14a-ec6d-4df0-8464-88ed0cd291df tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:03.784745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ba3d14a-ec6d-4df0-8464-88ed0cd291df tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:03.785436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ba3d14a-ec6d-4df0-8464-88ed0cd291df tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:04.427112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8ba3d14a-ec6d-4df0-8464-88ed0cd291df tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:04.444287 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8ba3d14a-ec6d-4df0-8464-88ed0cd291df tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1305 microversion: 2.1 time: 0.681980 May 27 15:10:04.449232 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1578/3141] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:03 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1305 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:04.464661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d286bfa8-ce0e-462e-85af-ca12146acad2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:04.470704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d286bfa8-ce0e-462e-85af-ca12146acad2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:04.488185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d286bfa8-ce0e-462e-85af-ca12146acad2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:04.490694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d286bfa8-ce0e-462e-85af-ca12146acad2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:04.493092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d286bfa8-ce0e-462e-85af-ca12146acad2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:04.494513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d286bfa8-ce0e-462e-85af-ca12146acad2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:04.862978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d286bfa8-ce0e-462e-85af-ca12146acad2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:04.908376 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d286bfa8-ce0e-462e-85af-ca12146acad2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.457735 May 27 15:10:04.917456 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1579/3142] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:04 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:04.936385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fc25fc56-085f-4875-92e7-ee81821c9a6e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:04.937146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fc25fc56-085f-4875-92e7-ee81821c9a6e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:04.955454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fc25fc56-085f-4875-92e7-ee81821c9a6e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:04.960532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fc25fc56-085f-4875-92e7-ee81821c9a6e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:04.966611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fc25fc56-085f-4875-92e7-ee81821c9a6e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:04.972339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fc25fc56-085f-4875-92e7-ee81821c9a6e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:05.379322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fc25fc56-085f-4875-92e7-ee81821c9a6e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:05.392514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fc25fc56-085f-4875-92e7-ee81821c9a6e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:05.404723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fc25fc56-085f-4875-92e7-ee81821c9a6e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:05.410792 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fc25fc56-085f-4875-92e7-ee81821c9a6e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1338 microversion: 2.20 time: 0.487033 May 27 15:10:05.418551 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1580/3143] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:04 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1338 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:05.423651 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-64e5eeac-8879-48f9-a674-b23f6ee87a4f req-34e6902f-c0d3-479c-a82f-9d290193a48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a29b1804-7072-488e-ba2d-5726d65fee2f", "name": "network-vif-plugged", "status": "completed", "tag": "8d69d638-3687-4f6a-a53f-b2f5f49aac1c"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:05.471577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-64e5eeac-8879-48f9-a674-b23f6ee87a4f req-34e6902f-c0d3-479c-a82f-9d290193a48e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:05.478057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-64e5eeac-8879-48f9-a674-b23f6ee87a4f req-34e6902f-c0d3-479c-a82f-9d290193a48e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:05.526385 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-64e5eeac-8879-48f9-a674-b23f6ee87a4f req-34e6902f-c0d3-479c-a82f-9d290193a48e service nova] Creating event network-vif-plugged:8d69d638-3687-4f6a-a53f-b2f5f49aac1c for instance a29b1804-7072-488e-ba2d-5726d65fee2f on n-h1-843621-1 May 27 15:10:05.555281 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-64e5eeac-8879-48f9-a674-b23f6ee87a4f req-34e6902f-c0d3-479c-a82f-9d290193a48e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135143 May 27 15:10:05.560148 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1581/3144] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:05.571715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b4446714-e0f5-452a-9874-f436b743f8e9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:05.580104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b4446714-e0f5-452a-9874-f436b743f8e9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:05.607876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4446714-e0f5-452a-9874-f436b743f8e9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:05.608560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4446714-e0f5-452a-9874-f436b743f8e9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:05.610630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4446714-e0f5-452a-9874-f436b743f8e9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:05.612646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4446714-e0f5-452a-9874-f436b743f8e9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:05.837133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-faca5031-f13e-45b8-8bcd-d166eb0c0bc7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:10:05.838224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-faca5031-f13e-45b8-8bcd-d166eb0c0bc7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:10:05.838631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-faca5031-f13e-45b8-8bcd-d166eb0c0bc7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:10:05.839053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-faca5031-f13e-45b8-8bcd-d166eb0c0bc7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:10:05.839482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-faca5031-f13e-45b8-8bcd-d166eb0c0bc7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:10:05.845295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=24 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:05.854098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-faca5031-f13e-45b8-8bcd-d166eb0c0bc7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:05.854582 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-faca5031-f13e-45b8-8bcd-d166eb0c0bc7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:05.856300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-faca5031-f13e-45b8-8bcd-d166eb0c0bc7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:05.856810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-faca5031-f13e-45b8-8bcd-d166eb0c0bc7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:05.879227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-faca5031-f13e-45b8-8bcd-d166eb0c0bc7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Getting quotas for project e3657598de154fedbe5fcf2eb4fa9c94. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:10:05.886105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-faca5031-f13e-45b8-8bcd-d166eb0c0bc7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Getting quotas for user 76881ea8722f45568bb04c26743b51d6 and project e3657598de154fedbe5fcf2eb4fa9c94. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:10:05.987066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b4446714-e0f5-452a-9874-f436b743f8e9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:05.996186 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b4446714-e0f5-452a-9874-f436b743f8e9 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1314 microversion: 2.1 time: 0.434506 May 27 15:10:05.999394 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1582/3145] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:05 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:06.017696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a1378544-0800-4ad4-9ce5-1fe5bf34bda0 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:06.023138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a1378544-0800-4ad4-9ce5-1fe5bf34bda0 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:06.031944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a1378544-0800-4ad4-9ce5-1fe5bf34bda0 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:06.033934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a1378544-0800-4ad4-9ce5-1fe5bf34bda0 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:06.037094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a1378544-0800-4ad4-9ce5-1fe5bf34bda0 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:06.039210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a1378544-0800-4ad4-9ce5-1fe5bf34bda0 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:06.192104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-faca5031-f13e-45b8-8bcd-d166eb0c0bc7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:10:06.196790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-faca5031-f13e-45b8-8bcd-d166eb0c0bc7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ea38b7e5-0d09-4d53-95dc-dfce69673c6b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='d9ed316f-ad6b-4578-950e-05904dd54e52',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b3f45164-669f-4b1e-b63f-6e887e13e1dd',volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:10:06.334721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a1378544-0800-4ad4-9ce5-1fe5bf34bda0 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:06.343057 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a1378544-0800-4ad4-9ce5-1fe5bf34bda0 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1317 microversion: 2.1 time: 0.333147 May 27 15:10:06.343931 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1583/3146] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:06 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:06.358047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c06e280c-97aa-4817-92ab-7de1c6c11a26 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:06.359354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c06e280c-97aa-4817-92ab-7de1c6c11a26 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:06.373880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c06e280c-97aa-4817-92ab-7de1c6c11a26 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:06.374774 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c06e280c-97aa-4817-92ab-7de1c6c11a26 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:06.375714 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c06e280c-97aa-4817-92ab-7de1c6c11a26 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:06.376307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c06e280c-97aa-4817-92ab-7de1c6c11a26 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:06.827006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c06e280c-97aa-4817-92ab-7de1c6c11a26 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:06.834931 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c06e280c-97aa-4817-92ab-7de1c6c11a26 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1305 microversion: 2.1 time: 0.489744 May 27 15:10:06.842216 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1584/3147] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:06 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1305 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:06.937835 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-faca5031-f13e-45b8-8bcd-d166eb0c0bc7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 8.280575 May 27 15:10:06.938866 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1564/3148] 10.222.0.13 () {62 vars in 1188 bytes} [Fri May 27 15:09:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 8284 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 15:10:06.956783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0c0b2108-c67d-4f02-8c90-ab3583fce094 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:06.957941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0c0b2108-c67d-4f02-8c90-ab3583fce094 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:06.999308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c0b2108-c67d-4f02-8c90-ab3583fce094 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:06.999780 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c0b2108-c67d-4f02-8c90-ab3583fce094 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:07.000579 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c0b2108-c67d-4f02-8c90-ab3583fce094 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:07.001112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c0b2108-c67d-4f02-8c90-ab3583fce094 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:07.101972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-405bbe26-b79f-4c61-9094-c35965fa4278 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-587624509", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:07.207760 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-405bbe26-b79f-4c61-9094-c35965fa4278 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] validate_networks() for [('b6b01e33-e8d1-4864-8f1d-92e402b67af3', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:10:07.833435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0c0b2108-c67d-4f02-8c90-ab3583fce094 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:07.856968 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0c0b2108-c67d-4f02-8c90-ab3583fce094 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.916906 May 27 15:10:07.862285 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1565/3149] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:06 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:07.884241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cdbfb0c3-1401-404c-b111-16d87e2661f3 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:07.886200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cdbfb0c3-1401-404c-b111-16d87e2661f3 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:07.905826 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cdbfb0c3-1401-404c-b111-16d87e2661f3 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:07.907389 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cdbfb0c3-1401-404c-b111-16d87e2661f3 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:07.908917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cdbfb0c3-1401-404c-b111-16d87e2661f3 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:07.911055 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cdbfb0c3-1401-404c-b111-16d87e2661f3 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:07.921820 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:08.480430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cdbfb0c3-1401-404c-b111-16d87e2661f3 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:08.489176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cdbfb0c3-1401-404c-b111-16d87e2661f3 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:08.499913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cdbfb0c3-1401-404c-b111-16d87e2661f3 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:08.505512 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cdbfb0c3-1401-404c-b111-16d87e2661f3 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1406 microversion: 2.20 time: 0.641757 May 27 15:10:08.519694 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1566/3150] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:07 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1406 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:08.521848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e64c15e1-fdea-4260-8991-8f774e05a60a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:08.523261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e64c15e1-fdea-4260-8991-8f774e05a60a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:08.542718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e64c15e1-fdea-4260-8991-8f774e05a60a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:08.543188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e64c15e1-fdea-4260-8991-8f774e05a60a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:08.543986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e64c15e1-fdea-4260-8991-8f774e05a60a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:08.544434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e64c15e1-fdea-4260-8991-8f774e05a60a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:09.334241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-405bbe26-b79f-4c61-9094-c35965fa4278 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:10:09.335940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-405bbe26-b79f-4c61-9094-c35965fa4278 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:10:09.336958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-405bbe26-b79f-4c61-9094-c35965fa4278 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:10:09.338322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-405bbe26-b79f-4c61-9094-c35965fa4278 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:10:09.339286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-405bbe26-b79f-4c61-9094-c35965fa4278 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:10:09.377543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-405bbe26-b79f-4c61-9094-c35965fa4278 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:09.377995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-405bbe26-b79f-4c61-9094-c35965fa4278 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:09.382005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-405bbe26-b79f-4c61-9094-c35965fa4278 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:09.383941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-405bbe26-b79f-4c61-9094-c35965fa4278 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:09.419921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e64c15e1-fdea-4260-8991-8f774e05a60a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:09.422237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-405bbe26-b79f-4c61-9094-c35965fa4278 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Getting quotas for project 1f6efd5b16e5450d9eb9b454d05a775a. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:10:09.432433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-405bbe26-b79f-4c61-9094-c35965fa4278 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Getting quotas for user 645379b3a21548d8a4f4d6425b61319f and project 1f6efd5b16e5450d9eb9b454d05a775a. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:10:09.437505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e64c15e1-fdea-4260-8991-8f774e05a60a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:09.441999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e64c15e1-fdea-4260-8991-8f774e05a60a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:09.443965 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e64c15e1-fdea-4260-8991-8f774e05a60a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1519 microversion: 2.42 time: 0.935670 May 27 15:10:09.466197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-405bbe26-b79f-4c61-9094-c35965fa4278 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:10:09.469124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-405bbe26-b79f-4c61-9094-c35965fa4278 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:10:09.471774 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1567/3151] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:08 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1519 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:09.478674 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e1f26b1f-68b9-4e6d-89ed-3fdff5a8b446 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:09.479686 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e1f26b1f-68b9-4e6d-89ed-3fdff5a8b446 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:09.487924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1f26b1f-68b9-4e6d-89ed-3fdff5a8b446 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:09.488748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1f26b1f-68b9-4e6d-89ed-3fdff5a8b446 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:09.489932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1f26b1f-68b9-4e6d-89ed-3fdff5a8b446 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:09.491244 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1f26b1f-68b9-4e6d-89ed-3fdff5a8b446 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:09.571653 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-405bbe26-b79f-4c61-9094-c35965fa4278 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.728264 May 27 15:10:09.593252 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1585/3152] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:10:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 2750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:10:09.627684 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e350e49c-0af6-488f-91be-aa907a767957 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:09.628610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e350e49c-0af6-488f-91be-aa907a767957 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:09.657979 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e350e49c-0af6-488f-91be-aa907a767957 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:09.658829 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e350e49c-0af6-488f-91be-aa907a767957 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:09.660009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e350e49c-0af6-488f-91be-aa907a767957 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:09.663708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e350e49c-0af6-488f-91be-aa907a767957 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:10.029304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e1f26b1f-68b9-4e6d-89ed-3fdff5a8b446 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:10.041582 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e1f26b1f-68b9-4e6d-89ed-3fdff5a8b446 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1314 microversion: 2.1 time: 0.567689 May 27 15:10:10.060813 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1568/3153] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:09 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:10.069937 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-4827eac5-f2c9-4d3c-97fa-27b7d2722769 req-0dafc519-2cde-4518-be19-87cd1f885c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6", "name": "network-vif-plugged", "status": "completed", "tag": "4b993dec-9e5f-4bf8-93f4-0f1265b53372"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:10.097760 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4827eac5-f2c9-4d3c-97fa-27b7d2722769 req-0dafc519-2cde-4518-be19-87cd1f885c9c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:10.098468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4827eac5-f2c9-4d3c-97fa-27b7d2722769 req-0dafc519-2cde-4518-be19-87cd1f885c9c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:10.111992 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-4827eac5-f2c9-4d3c-97fa-27b7d2722769 req-0dafc519-2cde-4518-be19-87cd1f885c9c service nova] Creating event network-vif-plugged:4b993dec-9e5f-4bf8-93f4-0f1265b53372 for instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 on n-h1-843621-1 May 27 15:10:10.143768 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-4827eac5-f2c9-4d3c-97fa-27b7d2722769 req-0dafc519-2cde-4518-be19-87cd1f885c9c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081142 May 27 15:10:10.147529 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1569/3154] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:10.167833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-abf8d8be-8ef8-4f47-9628-116495b551fd tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:10.177471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-abf8d8be-8ef8-4f47-9628-116495b551fd tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:10.203245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-abf8d8be-8ef8-4f47-9628-116495b551fd tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:10.209493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-abf8d8be-8ef8-4f47-9628-116495b551fd tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:10.213768 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-abf8d8be-8ef8-4f47-9628-116495b551fd tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:10.216207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-abf8d8be-8ef8-4f47-9628-116495b551fd tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:11.296866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e350e49c-0af6-488f-91be-aa907a767957 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:11.317601 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e350e49c-0af6-488f-91be-aa907a767957 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1506 microversion: 2.1 time: 1.722605 May 27 15:10:11.329289 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1586/3155] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:09 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1506 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:11.332336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c184a9f8-e619-4782-8ff6-f82e6110fecc tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:11.337291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c184a9f8-e619-4782-8ff6-f82e6110fecc tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:11.360238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-abf8d8be-8ef8-4f47-9628-116495b551fd tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:11.378860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c184a9f8-e619-4782-8ff6-f82e6110fecc tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:11.381378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c184a9f8-e619-4782-8ff6-f82e6110fecc tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:11.382771 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-abf8d8be-8ef8-4f47-9628-116495b551fd tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1305 microversion: 2.1 time: 1.234203 May 27 15:10:11.386353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c184a9f8-e619-4782-8ff6-f82e6110fecc tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:11.387018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c184a9f8-e619-4782-8ff6-f82e6110fecc tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:11.394948 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1570/3156] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:10 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1305 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:11.400168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-641ebd4c-47c4-46c0-a94d-6b0c609886c7 req-8fe4d35e-b840-4eae-824e-4d64c8907cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7371c18-20d2-43f8-b0c6-0371079d8f20", "tag": "555c9e09-9066-4780-8d8a-91ccfe7dff8d"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:11.416831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-641ebd4c-47c4-46c0-a94d-6b0c609886c7 req-8fe4d35e-b840-4eae-824e-4d64c8907cd9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:11.417575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-641ebd4c-47c4-46c0-a94d-6b0c609886c7 req-8fe4d35e-b840-4eae-824e-4d64c8907cd9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:11.440600 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-641ebd4c-47c4-46c0-a94d-6b0c609886c7 req-8fe4d35e-b840-4eae-824e-4d64c8907cd9 service nova] Creating event network-changed:555c9e09-9066-4780-8d8a-91ccfe7dff8d for instance d7371c18-20d2-43f8-b0c6-0371079d8f20 on n-h2-843621-1 May 27 15:10:11.452083 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-641ebd4c-47c4-46c0-a94d-6b0c609886c7 req-8fe4d35e-b840-4eae-824e-4d64c8907cd9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055717 May 27 15:10:11.455092 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1571/3157] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:11.469216 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-76556249-6804-476b-acad-3ebaa39f8750 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:11.470145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-76556249-6804-476b-acad-3ebaa39f8750 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:11.487739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76556249-6804-476b-acad-3ebaa39f8750 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:11.488341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76556249-6804-476b-acad-3ebaa39f8750 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:11.489393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76556249-6804-476b-acad-3ebaa39f8750 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:11.490126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76556249-6804-476b-acad-3ebaa39f8750 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:11.706149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c184a9f8-e619-4782-8ff6-f82e6110fecc tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:11.723100 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c184a9f8-e619-4782-8ff6-f82e6110fecc tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.398497 May 27 15:10:11.730193 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1587/3158] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:11 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:11.735256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0a409eed-9103-4980-a43e-7ae388971cb4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:11.740060 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0a409eed-9103-4980-a43e-7ae388971cb4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:11.756472 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a409eed-9103-4980-a43e-7ae388971cb4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:11.763308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a409eed-9103-4980-a43e-7ae388971cb4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:11.765634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a409eed-9103-4980-a43e-7ae388971cb4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:11.777514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a409eed-9103-4980-a43e-7ae388971cb4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:11.946432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0a409eed-9103-4980-a43e-7ae388971cb4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:11.964904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-76556249-6804-476b-acad-3ebaa39f8750 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:11.969853 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0a409eed-9103-4980-a43e-7ae388971cb4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1273 microversion: 2.1 time: 0.238240 May 27 15:10:11.975512 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1588/3159] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:11 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1273 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:11.983735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-76556249-6804-476b-acad-3ebaa39f8750 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:11.987678 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-76556249-6804-476b-acad-3ebaa39f8750 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:11.990424 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-76556249-6804-476b-acad-3ebaa39f8750 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1406 microversion: 2.20 time: 0.533983 May 27 15:10:11.994201 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1572/3160] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:11 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1406 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:12.002631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-78778a43-7fce-4771-bb16-138b0e324f5e req-7d07f917-6975-4987-91f0-62c3e447b69a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec", "name": "network-vif-unplugged", "status": "completed", "tag": "9adf6904-8e68-481c-93de-21a8ad9c0eed"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:12.012717 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-45fc5a12-0d9b-4e1b-a9ce-398ad4063e5f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:12.024799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-45fc5a12-0d9b-4e1b-a9ce-398ad4063e5f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:12.050462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-78778a43-7fce-4771-bb16-138b0e324f5e req-7d07f917-6975-4987-91f0-62c3e447b69a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:12.052738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-78778a43-7fce-4771-bb16-138b0e324f5e req-7d07f917-6975-4987-91f0-62c3e447b69a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:12.054247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45fc5a12-0d9b-4e1b-a9ce-398ad4063e5f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:12.054956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45fc5a12-0d9b-4e1b-a9ce-398ad4063e5f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:12.057266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45fc5a12-0d9b-4e1b-a9ce-398ad4063e5f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:12.057961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45fc5a12-0d9b-4e1b-a9ce-398ad4063e5f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:12.107453 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-78778a43-7fce-4771-bb16-138b0e324f5e req-7d07f917-6975-4987-91f0-62c3e447b69a service nova] Creating event network-vif-unplugged:9adf6904-8e68-481c-93de-21a8ad9c0eed for instance ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec on n-h2-843621-1 May 27 15:10:12.124543 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-78778a43-7fce-4771-bb16-138b0e324f5e req-7d07f917-6975-4987-91f0-62c3e447b69a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136874 May 27 15:10:12.125736 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1589/3161] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:12.138644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-62617212-de26-449b-9d9d-8a399dee327f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:12.141231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-62617212-de26-449b-9d9d-8a399dee327f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:12.161656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62617212-de26-449b-9d9d-8a399dee327f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:12.162594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62617212-de26-449b-9d9d-8a399dee327f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:12.163599 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62617212-de26-449b-9d9d-8a399dee327f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:12.166876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62617212-de26-449b-9d9d-8a399dee327f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:12.237642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-45fc5a12-0d9b-4e1b-a9ce-398ad4063e5f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:12.251793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-45fc5a12-0d9b-4e1b-a9ce-398ad4063e5f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:12.276573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-45fc5a12-0d9b-4e1b-a9ce-398ad4063e5f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:12.278339 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-45fc5a12-0d9b-4e1b-a9ce-398ad4063e5f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1593 microversion: 2.42 time: 0.282564 May 27 15:10:12.283030 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1573/3162] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:11 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1593 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:12.297760 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b98ea865-504c-41d4-8e01-b0574f0d154a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:12.298715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b98ea865-504c-41d4-8e01-b0574f0d154a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:12.316228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b98ea865-504c-41d4-8e01-b0574f0d154a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:12.327081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b98ea865-504c-41d4-8e01-b0574f0d154a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:12.328481 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b98ea865-504c-41d4-8e01-b0574f0d154a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:12.328969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b98ea865-504c-41d4-8e01-b0574f0d154a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:12.543857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-62617212-de26-449b-9d9d-8a399dee327f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:12.559612 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-62617212-de26-449b-9d9d-8a399dee327f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1314 microversion: 2.1 time: 0.428640 May 27 15:10:12.565660 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1590/3163] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:12 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:12.592870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-91633ea9-344b-4d20-9558-b48a14fae63e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-457649292", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:12.715040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-91633ea9-344b-4d20-9558-b48a14fae63e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] validate_networks() for [('b6b01e33-e8d1-4864-8f1d-92e402b67af3', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:10:13.522969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b98ea865-504c-41d4-8e01-b0574f0d154a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:13.550920 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b98ea865-504c-41d4-8e01-b0574f0d154a tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1506 microversion: 2.1 time: 1.266486 May 27 15:10:13.559690 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1574/3164] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:12 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1506 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:13.565472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b46ead39-7cd4-49d9-b5d8-31d5f368c780 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:13.569078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b46ead39-7cd4-49d9-b5d8-31d5f368c780 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:13.603811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b46ead39-7cd4-49d9-b5d8-31d5f368c780 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:13.612629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b46ead39-7cd4-49d9-b5d8-31d5f368c780 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:13.613794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b46ead39-7cd4-49d9-b5d8-31d5f368c780 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:13.614467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b46ead39-7cd4-49d9-b5d8-31d5f368c780 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:14.347149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-91633ea9-344b-4d20-9558-b48a14fae63e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:10:14.348969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-91633ea9-344b-4d20-9558-b48a14fae63e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:10:14.349661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-91633ea9-344b-4d20-9558-b48a14fae63e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:10:14.350251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-91633ea9-344b-4d20-9558-b48a14fae63e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:10:14.350824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-91633ea9-344b-4d20-9558-b48a14fae63e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:10:14.387377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-91633ea9-344b-4d20-9558-b48a14fae63e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:14.387639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-91633ea9-344b-4d20-9558-b48a14fae63e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:14.394561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-91633ea9-344b-4d20-9558-b48a14fae63e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:14.395064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-91633ea9-344b-4d20-9558-b48a14fae63e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:14.434829 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b46ead39-7cd4-49d9-b5d8-31d5f368c780 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:14.443842 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b46ead39-7cd4-49d9-b5d8-31d5f368c780 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1305 microversion: 2.1 time: 0.882614 May 27 15:10:14.455168 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1575/3165] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:13 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1305 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:14.467208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ced450fd-bd26-49b0-b864-6cbac7ba4f54 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:14.469713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ced450fd-bd26-49b0-b864-6cbac7ba4f54 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:14.470575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-91633ea9-344b-4d20-9558-b48a14fae63e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Getting quotas for project 1f6efd5b16e5450d9eb9b454d05a775a. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:10:14.483319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ced450fd-bd26-49b0-b864-6cbac7ba4f54 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:14.487285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ced450fd-bd26-49b0-b864-6cbac7ba4f54 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:14.488419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ced450fd-bd26-49b0-b864-6cbac7ba4f54 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:14.489128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ced450fd-bd26-49b0-b864-6cbac7ba4f54 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:14.500961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-91633ea9-344b-4d20-9558-b48a14fae63e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Getting quotas for user 645379b3a21548d8a4f4d6425b61319f and project 1f6efd5b16e5450d9eb9b454d05a775a. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:10:14.537576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:14.553459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-91633ea9-344b-4d20-9558-b48a14fae63e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:10:14.555808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-91633ea9-344b-4d20-9558-b48a14fae63e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:10:14.694736 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-91633ea9-344b-4d20-9558-b48a14fae63e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.124015 May 27 15:10:14.697696 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1591/3166] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:10:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 2131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:10:14.706749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-db6f606d-47b3-41c2-9020-c0aa3bcf2d57 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:14.709450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-db6f606d-47b3-41c2-9020-c0aa3bcf2d57 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:14.748065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db6f606d-47b3-41c2-9020-c0aa3bcf2d57 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:14.748821 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db6f606d-47b3-41c2-9020-c0aa3bcf2d57 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:14.750964 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db6f606d-47b3-41c2-9020-c0aa3bcf2d57 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:14.751573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db6f606d-47b3-41c2-9020-c0aa3bcf2d57 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:14.848724 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ced450fd-bd26-49b0-b864-6cbac7ba4f54 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:14.861837 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ced450fd-bd26-49b0-b864-6cbac7ba4f54 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.404264 May 27 15:10:14.864254 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1576/3167] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:14 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:14.880514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c3b4586f-6799-4257-bebb-ba6f98fdecb0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:14.882685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c3b4586f-6799-4257-bebb-ba6f98fdecb0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:14.897028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3b4586f-6799-4257-bebb-ba6f98fdecb0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:14.902197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3b4586f-6799-4257-bebb-ba6f98fdecb0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:14.903293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3b4586f-6799-4257-bebb-ba6f98fdecb0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:14.905435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3b4586f-6799-4257-bebb-ba6f98fdecb0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:15.388928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c3b4586f-6799-4257-bebb-ba6f98fdecb0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:15.405150 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c3b4586f-6799-4257-bebb-ba6f98fdecb0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:15.408074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c3b4586f-6799-4257-bebb-ba6f98fdecb0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:15.412181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-db6f606d-47b3-41c2-9020-c0aa3bcf2d57 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:15.425331 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c3b4586f-6799-4257-bebb-ba6f98fdecb0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1661 microversion: 2.42 time: 0.551649 May 27 15:10:15.441479 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1577/3168] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:14 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1661 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:15.443016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-db6f606d-47b3-41c2-9020-c0aa3bcf2d57 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:15.450106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-08d22504-642e-4a58-a61b-c1e452352e00 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:15.451633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-db6f606d-47b3-41c2-9020-c0aa3bcf2d57 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:15.455460 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-db6f606d-47b3-41c2-9020-c0aa3bcf2d57 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1406 microversion: 2.20 time: 0.756494 May 27 15:10:15.456661 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1592/3169] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:14 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1406 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:15.461518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-08d22504-642e-4a58-a61b-c1e452352e00 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:15.467315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a600d64d-5357-4831-ae07-44f5433667fe tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:15.472290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a600d64d-5357-4831-ae07-44f5433667fe tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:15.477184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08d22504-642e-4a58-a61b-c1e452352e00 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:15.479354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08d22504-642e-4a58-a61b-c1e452352e00 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:15.482589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08d22504-642e-4a58-a61b-c1e452352e00 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:15.491059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08d22504-642e-4a58-a61b-c1e452352e00 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:15.509795 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a600d64d-5357-4831-ae07-44f5433667fe tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:15.510264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a600d64d-5357-4831-ae07-44f5433667fe tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:15.515840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a600d64d-5357-4831-ae07-44f5433667fe tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:15.516336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a600d64d-5357-4831-ae07-44f5433667fe tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:15.693795 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-08d22504-642e-4a58-a61b-c1e452352e00 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "PUT /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1078 microversion: 2.1 time: 0.250947 May 27 15:10:15.709238 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1578/3170] 10.222.0.13 () {60 vars in 1255 bytes} [Fri May 27 15:10:15 2022] PUT /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1078 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:15.716034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-5edd2815-790a-42e6-a638-f362972a8fd5 req-2d51c1ac-57b1-44dc-885b-2c53a4bea6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec", "tag": "9adf6904-8e68-481c-93de-21a8ad9c0eed"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:15.757632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-5edd2815-790a-42e6-a638-f362972a8fd5 req-2d51c1ac-57b1-44dc-885b-2c53a4bea6b9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:15.762141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-5edd2815-790a-42e6-a638-f362972a8fd5 req-2d51c1ac-57b1-44dc-885b-2c53a4bea6b9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:15.793764 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-5edd2815-790a-42e6-a638-f362972a8fd5 req-2d51c1ac-57b1-44dc-885b-2c53a4bea6b9 service nova] Creating event network-changed:9adf6904-8e68-481c-93de-21a8ad9c0eed for instance ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec on n-h2-843621-1 May 27 15:10:15.799209 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-5edd2815-790a-42e6-a638-f362972a8fd5 req-2d51c1ac-57b1-44dc-885b-2c53a4bea6b9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088415 May 27 15:10:15.800295 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1579/3171] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:15.816164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-20a5ae7d-7363-4345-9c30-c621fd56d742 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:15.818779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-20a5ae7d-7363-4345-9c30-c621fd56d742 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:15.827362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20a5ae7d-7363-4345-9c30-c621fd56d742 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:15.828220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20a5ae7d-7363-4345-9c30-c621fd56d742 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:15.829273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20a5ae7d-7363-4345-9c30-c621fd56d742 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:15.829947 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20a5ae7d-7363-4345-9c30-c621fd56d742 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:15.874057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:15.896459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:15.929743 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a600d64d-5357-4831-ae07-44f5433667fe tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:15.939361 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a600d64d-5357-4831-ae07-44f5433667fe tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1501 microversion: 2.1 time: 0.481304 May 27 15:10:15.947604 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1593/3172] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:15 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1501 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:15.956091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ecfcb3c1-237c-44d7-ad1e-bdd3eec99752 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:15.957066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ecfcb3c1-237c-44d7-ad1e-bdd3eec99752 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:15.963402 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-20a5ae7d-7363-4345-9c30-c621fd56d742 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:15.975530 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-20a5ae7d-7363-4345-9c30-c621fd56d742 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1225 microversion: 2.1 time: 0.173701 May 27 15:10:15.978679 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ecfcb3c1-237c-44d7-ad1e-bdd3eec99752 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:15.982955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ecfcb3c1-237c-44d7-ad1e-bdd3eec99752 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:15.984366 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1580/3173] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:15 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1225 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:15.985509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ecfcb3c1-237c-44d7-ad1e-bdd3eec99752 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:15.988849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ecfcb3c1-237c-44d7-ad1e-bdd3eec99752 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:16.005026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-984c62b5-5721-4bc6-9456-450dbee775a8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:16.006571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-984c62b5-5721-4bc6-9456-450dbee775a8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:16.030148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-984c62b5-5721-4bc6-9456-450dbee775a8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:16.030945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-984c62b5-5721-4bc6-9456-450dbee775a8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:16.032738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-984c62b5-5721-4bc6-9456-450dbee775a8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:16.035089 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-984c62b5-5721-4bc6-9456-450dbee775a8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:16.392337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-984c62b5-5721-4bc6-9456-450dbee775a8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:16.401781 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-984c62b5-5721-4bc6-9456-450dbee775a8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1504 microversion: 2.1 time: 0.414922 May 27 15:10:16.403320 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1581/3174] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:15 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1504 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:16.411494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2146697e-e3a6-469a-b1cb-4ec64e8433e3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:16.412138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2146697e-e3a6-469a-b1cb-4ec64e8433e3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:16.419431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2146697e-e3a6-469a-b1cb-4ec64e8433e3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:16.420125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2146697e-e3a6-469a-b1cb-4ec64e8433e3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:16.420969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2146697e-e3a6-469a-b1cb-4ec64e8433e3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:16.421949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2146697e-e3a6-469a-b1cb-4ec64e8433e3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:16.622807 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ecfcb3c1-237c-44d7-ad1e-bdd3eec99752 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:16.639192 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ecfcb3c1-237c-44d7-ad1e-bdd3eec99752 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1305 microversion: 2.1 time: 0.690173 May 27 15:10:16.644536 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1594/3175] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:15 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1305 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:16.656686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e0d32a0-abf2-44ab-b46f-0ab6e18f61a1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:16.663950 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e0d32a0-abf2-44ab-b46f-0ab6e18f61a1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:16.677713 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e0d32a0-abf2-44ab-b46f-0ab6e18f61a1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:16.678600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e0d32a0-abf2-44ab-b46f-0ab6e18f61a1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:16.688635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e0d32a0-abf2-44ab-b46f-0ab6e18f61a1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:16.689374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e0d32a0-abf2-44ab-b46f-0ab6e18f61a1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:16.746795 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-0e0d32a0-abf2-44ab-b46f-0ab6e18f61a1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lazy-loading 'flavor' on Instance uuid dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:10:16.865942 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:16.923433 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e0d32a0-abf2-44ab-b46f-0ab6e18f61a1 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "POST /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6/action" status: 202 len: 0 microversion: 2.1 time: 0.275546 May 27 15:10:16.927057 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1595/3176] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:10:16 2022] POST /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:10:16.943394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2146697e-e3a6-469a-b1cb-4ec64e8433e3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:16.945657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6c34cde3-4ec1-4b27-a48a-790ab1fc4085 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:16.946730 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6c34cde3-4ec1-4b27-a48a-790ab1fc4085 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:16.958236 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2146697e-e3a6-469a-b1cb-4ec64e8433e3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.553616 May 27 15:10:16.965042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c34cde3-4ec1-4b27-a48a-790ab1fc4085 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:16.965640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c34cde3-4ec1-4b27-a48a-790ab1fc4085 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:16.966287 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1582/3177] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:16 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:16.974864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8dd22c5d-d1d8-4d70-95d2-2e83fa5615cb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:16.976369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c34cde3-4ec1-4b27-a48a-790ab1fc4085 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:16.976883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c34cde3-4ec1-4b27-a48a-790ab1fc4085 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:16.977632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8dd22c5d-d1d8-4d70-95d2-2e83fa5615cb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:16.990465 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8dd22c5d-d1d8-4d70-95d2-2e83fa5615cb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:16.995504 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8dd22c5d-d1d8-4d70-95d2-2e83fa5615cb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:16.996642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8dd22c5d-d1d8-4d70-95d2-2e83fa5615cb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:16.998065 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8dd22c5d-d1d8-4d70-95d2-2e83fa5615cb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:17.464115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6c34cde3-4ec1-4b27-a48a-790ab1fc4085 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:17.481071 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6c34cde3-4ec1-4b27-a48a-790ab1fc4085 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1504 microversion: 2.1 time: 0.550112 May 27 15:10:17.481983 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1596/3178] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:16 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1504 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:17.494236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-65f0f658-85b3-40dc-b45a-8f6641508ac8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:17.494875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-65f0f658-85b3-40dc-b45a-8f6641508ac8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:17.512918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-65f0f658-85b3-40dc-b45a-8f6641508ac8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:17.513382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-65f0f658-85b3-40dc-b45a-8f6641508ac8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:17.514171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-65f0f658-85b3-40dc-b45a-8f6641508ac8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:17.514620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-65f0f658-85b3-40dc-b45a-8f6641508ac8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:17.516063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8dd22c5d-d1d8-4d70-95d2-2e83fa5615cb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:17.532438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8dd22c5d-d1d8-4d70-95d2-2e83fa5615cb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:17.536642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8dd22c5d-d1d8-4d70-95d2-2e83fa5615cb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:17.538540 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8dd22c5d-d1d8-4d70-95d2-2e83fa5615cb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1708 microversion: 2.42 time: 0.571113 May 27 15:10:17.541658 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1583/3179] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:16 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1708 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:17.552398 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5233257b-7020-4bab-89cc-d1d7928112f3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:17.559399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5233257b-7020-4bab-89cc-d1d7928112f3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:17.566721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:17.573886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5233257b-7020-4bab-89cc-d1d7928112f3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:17.574778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5233257b-7020-4bab-89cc-d1d7928112f3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:17.575816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5233257b-7020-4bab-89cc-d1d7928112f3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:17.576470 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5233257b-7020-4bab-89cc-d1d7928112f3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:17.580559 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:17.797179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-65f0f658-85b3-40dc-b45a-8f6641508ac8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:17.810253 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-65f0f658-85b3-40dc-b45a-8f6641508ac8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:17.812790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-65f0f658-85b3-40dc-b45a-8f6641508ac8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:17.814418 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-65f0f658-85b3-40dc-b45a-8f6641508ac8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1406 microversion: 2.20 time: 0.331526 May 27 15:10:17.815478 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1597/3180] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:17 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:17.823124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-97c9757b-ad0b-4b02-acbc-f4f0ac178b96 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:17.824038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-97c9757b-ad0b-4b02-acbc-f4f0ac178b96 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:17.835560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-97c9757b-ad0b-4b02-acbc-f4f0ac178b96 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:17.836329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-97c9757b-ad0b-4b02-acbc-f4f0ac178b96 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:17.837393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-97c9757b-ad0b-4b02-acbc-f4f0ac178b96 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:17.838839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-97c9757b-ad0b-4b02-acbc-f4f0ac178b96 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:17.897863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5233257b-7020-4bab-89cc-d1d7928112f3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:17.918643 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5233257b-7020-4bab-89cc-d1d7928112f3 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1509 microversion: 2.1 time: 0.373934 May 27 15:10:17.940225 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1584/3181] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:17 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1509 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:17.940225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-114d304f-4611-4347-94f8-984896910cf2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:17.954581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-114d304f-4611-4347-94f8-984896910cf2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:17.964875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-97c9757b-ad0b-4b02-acbc-f4f0ac178b96 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:17.968720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-114d304f-4611-4347-94f8-984896910cf2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:17.973682 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-114d304f-4611-4347-94f8-984896910cf2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:17.975292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-114d304f-4611-4347-94f8-984896910cf2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:17.977465 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-97c9757b-ad0b-4b02-acbc-f4f0ac178b96 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1279 microversion: 2.1 time: 0.160515 May 27 15:10:17.978813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-114d304f-4611-4347-94f8-984896910cf2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:17.989963 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1598/3182] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:17 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1279 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:18.000704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7abb8e21-74e8-44ad-81d6-229ec0969156 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:18.002126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7abb8e21-74e8-44ad-81d6-229ec0969156 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:18.008919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7abb8e21-74e8-44ad-81d6-229ec0969156 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:18.010868 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7abb8e21-74e8-44ad-81d6-229ec0969156 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:18.011725 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7abb8e21-74e8-44ad-81d6-229ec0969156 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:18.012233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7abb8e21-74e8-44ad-81d6-229ec0969156 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:18.117951 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-114d304f-4611-4347-94f8-984896910cf2 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "PUT /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1080 microversion: 2.1 time: 0.184014 May 27 15:10:18.126275 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1585/3183] 10.222.0.13 () {60 vars in 1255 bytes} [Fri May 27 15:10:17 2022] PUT /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1080 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:18.133284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-c20126b2-9eb9-49f3-a090-71c1d3f0b271 req-c902b6bd-2bad-443a-9724-bc0ddb69ba0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7371c18-20d2-43f8-b0c6-0371079d8f20", "name": "network-vif-plugged", "status": "completed", "tag": "555c9e09-9066-4780-8d8a-91ccfe7dff8d"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:18.151900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-c20126b2-9eb9-49f3-a090-71c1d3f0b271 req-c902b6bd-2bad-443a-9724-bc0ddb69ba0a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:18.155664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-c20126b2-9eb9-49f3-a090-71c1d3f0b271 req-c902b6bd-2bad-443a-9724-bc0ddb69ba0a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:18.192126 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-c20126b2-9eb9-49f3-a090-71c1d3f0b271 req-c902b6bd-2bad-443a-9724-bc0ddb69ba0a service nova] Creating event network-vif-plugged:555c9e09-9066-4780-8d8a-91ccfe7dff8d for instance d7371c18-20d2-43f8-b0c6-0371079d8f20 on n-h2-843621-1 May 27 15:10:18.200188 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-c20126b2-9eb9-49f3-a090-71c1d3f0b271 req-c902b6bd-2bad-443a-9724-bc0ddb69ba0a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072007 May 27 15:10:18.208885 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1586/3184] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:18.215799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-009880a7-c418-49aa-a466-2b611b41da97 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:18.216919 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-009880a7-c418-49aa-a466-2b611b41da97 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:18.232715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7abb8e21-74e8-44ad-81d6-229ec0969156 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:18.232908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-009880a7-c418-49aa-a466-2b611b41da97 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:18.233286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-009880a7-c418-49aa-a466-2b611b41da97 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:18.234273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-009880a7-c418-49aa-a466-2b611b41da97 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:18.234876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-009880a7-c418-49aa-a466-2b611b41da97 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:18.260610 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7abb8e21-74e8-44ad-81d6-229ec0969156 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1305 microversion: 2.1 time: 0.267575 May 27 15:10:18.261511 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1599/3185] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:17 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1305 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:18.284794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-44fa34cb-38d6-4761-b0a0-b9f4e9dcee74 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:18.286573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-44fa34cb-38d6-4761-b0a0-b9f4e9dcee74 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:18.300634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44fa34cb-38d6-4761-b0a0-b9f4e9dcee74 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:18.303167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44fa34cb-38d6-4761-b0a0-b9f4e9dcee74 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:18.305452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44fa34cb-38d6-4761-b0a0-b9f4e9dcee74 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:18.306777 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44fa34cb-38d6-4761-b0a0-b9f4e9dcee74 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:18.678363 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-009880a7-c418-49aa-a466-2b611b41da97 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:18.694207 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-009880a7-c418-49aa-a466-2b611b41da97 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.483650 May 27 15:10:18.703384 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1587/3186] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:18 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:18.703384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-026e3b02-d62b-4c20-9694-17673b5aad39 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:18.703384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-026e3b02-d62b-4c20-9694-17673b5aad39 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:18.718913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-026e3b02-d62b-4c20-9694-17673b5aad39 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:18.719374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-026e3b02-d62b-4c20-9694-17673b5aad39 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:18.720174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-026e3b02-d62b-4c20-9694-17673b5aad39 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:18.720621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-026e3b02-d62b-4c20-9694-17673b5aad39 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:18.721727 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-44fa34cb-38d6-4761-b0a0-b9f4e9dcee74 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:18.735955 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-44fa34cb-38d6-4761-b0a0-b9f4e9dcee74 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1506 microversion: 2.1 time: 0.470726 May 27 15:10:18.737651 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1600/3187] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:18 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1506 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:18.755756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-aae256b4-50f4-49c8-9044-a674257061a6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:18.756483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-aae256b4-50f4-49c8-9044-a674257061a6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:18.765974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aae256b4-50f4-49c8-9044-a674257061a6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:18.766902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aae256b4-50f4-49c8-9044-a674257061a6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:18.768409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aae256b4-50f4-49c8-9044-a674257061a6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:18.769042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aae256b4-50f4-49c8-9044-a674257061a6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:19.057067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-aae256b4-50f4-49c8-9044-a674257061a6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:19.073808 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-aae256b4-50f4-49c8-9044-a674257061a6 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1506 microversion: 2.1 time: 0.323920 May 27 15:10:19.074430 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1601/3188] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:18 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:19.081185 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-026e3b02-d62b-4c20-9694-17673b5aad39 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:19.100133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-026e3b02-d62b-4c20-9694-17673b5aad39 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:19.101649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-026e3b02-d62b-4c20-9694-17673b5aad39 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:19.105299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2a87dd26-4da1-48fe-914b-51ddf2dabc0e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:19.105679 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2a87dd26-4da1-48fe-914b-51ddf2dabc0e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:19.107745 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-026e3b02-d62b-4c20-9694-17673b5aad39 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1708 microversion: 2.42 time: 0.406780 May 27 15:10:19.108408 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1588/3189] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:18 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1708 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:19.116748 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a87dd26-4da1-48fe-914b-51ddf2dabc0e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:19.117319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a87dd26-4da1-48fe-914b-51ddf2dabc0e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:19.118092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a87dd26-4da1-48fe-914b-51ddf2dabc0e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:19.119002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a87dd26-4da1-48fe-914b-51ddf2dabc0e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:19.126376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-15783c32-02cb-44f7-8ffe-a2c9bf2fbe6f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:19.127082 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-15783c32-02cb-44f7-8ffe-a2c9bf2fbe6f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:19.143081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15783c32-02cb-44f7-8ffe-a2c9bf2fbe6f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:19.149600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15783c32-02cb-44f7-8ffe-a2c9bf2fbe6f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:19.150810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15783c32-02cb-44f7-8ffe-a2c9bf2fbe6f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:19.151384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15783c32-02cb-44f7-8ffe-a2c9bf2fbe6f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:19.565309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-15783c32-02cb-44f7-8ffe-a2c9bf2fbe6f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:19.568182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2a87dd26-4da1-48fe-914b-51ddf2dabc0e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:19.580537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2a87dd26-4da1-48fe-914b-51ddf2dabc0e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:19.582144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2a87dd26-4da1-48fe-914b-51ddf2dabc0e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:19.582269 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-15783c32-02cb-44f7-8ffe-a2c9bf2fbe6f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1492 microversion: 2.1 time: 0.472660 May 27 15:10:19.583451 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2a87dd26-4da1-48fe-914b-51ddf2dabc0e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1406 microversion: 2.20 time: 0.496561 May 27 15:10:19.584132 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1602/3190] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:19 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1406 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:19.594869 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1589/3191] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:19 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1492 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:19.608831 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-af3a1ad0-3f91-4cfc-bd68-999f7855652a req-765f13bc-0b8a-4620-8774-0a9b60912b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "445b2880-4df5-45f6-bba3-3af281cea45c", "tag": "c3906eca-7038-456e-89aa-ed8bbe73dafd"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:19.609078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c84aaa64-a79e-4880-863e-10b9a24f3e86 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:19.609515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c84aaa64-a79e-4880-863e-10b9a24f3e86 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:19.620165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-af3a1ad0-3f91-4cfc-bd68-999f7855652a req-765f13bc-0b8a-4620-8774-0a9b60912b30 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:19.620654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-af3a1ad0-3f91-4cfc-bd68-999f7855652a req-765f13bc-0b8a-4620-8774-0a9b60912b30 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:19.624506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c84aaa64-a79e-4880-863e-10b9a24f3e86 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:19.625168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c84aaa64-a79e-4880-863e-10b9a24f3e86 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:19.625979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c84aaa64-a79e-4880-863e-10b9a24f3e86 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:19.626595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c84aaa64-a79e-4880-863e-10b9a24f3e86 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:19.633865 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-af3a1ad0-3f91-4cfc-bd68-999f7855652a req-765f13bc-0b8a-4620-8774-0a9b60912b30 service nova] Creating event network-changed:c3906eca-7038-456e-89aa-ed8bbe73dafd for instance 445b2880-4df5-45f6-bba3-3af281cea45c on n-h1-843621-1 May 27 15:10:19.642615 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-af3a1ad0-3f91-4cfc-bd68-999f7855652a req-765f13bc-0b8a-4620-8774-0a9b60912b30 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037202 May 27 15:10:19.647813 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1603/3192] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:19.656008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-10dabd7b-abaa-49a5-b772-7eff697dc471 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:19.656607 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-10dabd7b-abaa-49a5-b772-7eff697dc471 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:19.672523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10dabd7b-abaa-49a5-b772-7eff697dc471 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:19.676139 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10dabd7b-abaa-49a5-b772-7eff697dc471 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:19.677054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10dabd7b-abaa-49a5-b772-7eff697dc471 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:19.677513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10dabd7b-abaa-49a5-b772-7eff697dc471 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:19.750381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-10dabd7b-abaa-49a5-b772-7eff697dc471 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:10:19.933434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c84aaa64-a79e-4880-863e-10b9a24f3e86 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:19.950913 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c84aaa64-a79e-4880-863e-10b9a24f3e86 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1321 microversion: 2.1 time: 0.345513 May 27 15:10:19.960771 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1590/3193] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:19 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:19.960771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0683555e-4af8-4f53-a39b-e0da06abcb1c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:19.960771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0683555e-4af8-4f53-a39b-e0da06abcb1c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:19.966889 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-10dabd7b-abaa-49a5-b772-7eff697dc471 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 204 len: 0 microversion: 2.1 time: 0.317569 May 27 15:10:19.972247 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1604/3194] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:10:19 2022] DELETE /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:10:19.973459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c7d2ec0c-1cf5-4a28-a977-d4d698d0b12a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:19.974058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c7d2ec0c-1cf5-4a28-a977-d4d698d0b12a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:19.979591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0683555e-4af8-4f53-a39b-e0da06abcb1c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:19.980048 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0683555e-4af8-4f53-a39b-e0da06abcb1c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:19.983298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0683555e-4af8-4f53-a39b-e0da06abcb1c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:19.983832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0683555e-4af8-4f53-a39b-e0da06abcb1c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:19.989245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c7d2ec0c-1cf5-4a28-a977-d4d698d0b12a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:19.989714 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c7d2ec0c-1cf5-4a28-a977-d4d698d0b12a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:19.990525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c7d2ec0c-1cf5-4a28-a977-d4d698d0b12a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:19.992495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c7d2ec0c-1cf5-4a28-a977-d4d698d0b12a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:20.057653 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c7d2ec0c-1cf5-4a28-a977-d4d698d0b12a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:10:20.181548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0683555e-4af8-4f53-a39b-e0da06abcb1c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:20.191967 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0683555e-4af8-4f53-a39b-e0da06abcb1c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1305 microversion: 2.1 time: 0.238906 May 27 15:10:20.193025 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1591/3195] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:19 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1305 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:20.198646 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d3ae9873-2084-4077-8cda-0846294fb66b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:20.199282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d3ae9873-2084-4077-8cda-0846294fb66b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:20.207321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d3ae9873-2084-4077-8cda-0846294fb66b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:20.207866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d3ae9873-2084-4077-8cda-0846294fb66b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:20.208761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d3ae9873-2084-4077-8cda-0846294fb66b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:20.209268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d3ae9873-2084-4077-8cda-0846294fb66b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:20.271414 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c7d2ec0c-1cf5-4a28-a977-d4d698d0b12a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 204 len: 0 microversion: 2.1 time: 0.301938 May 27 15:10:20.272056 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1605/3196] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:10:19 2022] DELETE /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:10:20.295666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a0436be6-6096-41a6-9836-dedee03b62c9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:20.296514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a0436be6-6096-41a6-9836-dedee03b62c9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:20.323863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a0436be6-6096-41a6-9836-dedee03b62c9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:20.324347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a0436be6-6096-41a6-9836-dedee03b62c9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:20.325200 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a0436be6-6096-41a6-9836-dedee03b62c9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:20.325648 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a0436be6-6096-41a6-9836-dedee03b62c9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:20.402381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a0436be6-6096-41a6-9836-dedee03b62c9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:10:20.419808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d3ae9873-2084-4077-8cda-0846294fb66b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:20.436855 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d3ae9873-2084-4077-8cda-0846294fb66b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.242597 May 27 15:10:20.448804 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1592/3197] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:20 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:20.454524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-517b6505-bc95-4c2f-a384-3b3af437cffc tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:20.456297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-517b6505-bc95-4c2f-a384-3b3af437cffc tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:20.464288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-517b6505-bc95-4c2f-a384-3b3af437cffc tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:20.465134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-517b6505-bc95-4c2f-a384-3b3af437cffc tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:20.466032 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-517b6505-bc95-4c2f-a384-3b3af437cffc tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:20.466748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-517b6505-bc95-4c2f-a384-3b3af437cffc tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:20.543660 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.compute.api [None req-a0436be6-6096-41a6-9836-dedee03b62c9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Instance is already in deleting state, ignoring this request May 27 15:10:20.546349 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a0436be6-6096-41a6-9836-dedee03b62c9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 204 len: 0 microversion: 2.1 time: 0.268075 May 27 15:10:20.557622 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1606/3198] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:10:20 2022] DELETE /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:10:20.575116 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-938b9d4d-132d-4265-9163-5ae2cef93c6b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:20.578571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-938b9d4d-132d-4265-9163-5ae2cef93c6b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:20.593945 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-938b9d4d-132d-4265-9163-5ae2cef93c6b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:20.595598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-938b9d4d-132d-4265-9163-5ae2cef93c6b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:20.598336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-938b9d4d-132d-4265-9163-5ae2cef93c6b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:20.599163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-938b9d4d-132d-4265-9163-5ae2cef93c6b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:20.848726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-938b9d4d-132d-4265-9163-5ae2cef93c6b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:20.877013 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-938b9d4d-132d-4265-9163-5ae2cef93c6b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1498 microversion: 2.1 time: 0.316229 May 27 15:10:20.878315 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1607/3199] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:20 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1498 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:20.887532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7e161145-9429-4403-a5dc-5767178db4a9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:20.899179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7e161145-9429-4403-a5dc-5767178db4a9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:20.915698 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e161145-9429-4403-a5dc-5767178db4a9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:20.916254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e161145-9429-4403-a5dc-5767178db4a9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:20.918140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e161145-9429-4403-a5dc-5767178db4a9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:20.918959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e161145-9429-4403-a5dc-5767178db4a9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:20.965830 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:21.048180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-517b6505-bc95-4c2f-a384-3b3af437cffc tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:21.062732 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-517b6505-bc95-4c2f-a384-3b3af437cffc tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:21.064292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-517b6505-bc95-4c2f-a384-3b3af437cffc tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:21.065556 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-517b6505-bc95-4c2f-a384-3b3af437cffc tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1755 microversion: 2.42 time: 0.615507 May 27 15:10:21.066137 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1593/3200] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:20 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1755 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:21.092722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-62511ac3-d820-4d97-b0bf-f1a0f973b13c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:21.098114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-62511ac3-d820-4d97-b0bf-f1a0f973b13c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:21.109387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-62511ac3-d820-4d97-b0bf-f1a0f973b13c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:21.109996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-62511ac3-d820-4d97-b0bf-f1a0f973b13c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:21.110838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-62511ac3-d820-4d97-b0bf-f1a0f973b13c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:21.111285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-62511ac3-d820-4d97-b0bf-f1a0f973b13c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:21.126807 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7e161145-9429-4403-a5dc-5767178db4a9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:21.137610 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7e161145-9429-4403-a5dc-5767178db4a9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1512 microversion: 2.1 time: 0.257586 May 27 15:10:21.138736 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1608/3201] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:20 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1512 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:21.143940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dd3c7b7e-b5f5-49ab-ac74-1c1beca7e15c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:21.144774 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dd3c7b7e-b5f5-49ab-ac74-1c1beca7e15c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:21.152372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd3c7b7e-b5f5-49ab-ac74-1c1beca7e15c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:21.153103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd3c7b7e-b5f5-49ab-ac74-1c1beca7e15c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:21.155113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd3c7b7e-b5f5-49ab-ac74-1c1beca7e15c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:21.155464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd3c7b7e-b5f5-49ab-ac74-1c1beca7e15c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:21.439524 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dd3c7b7e-b5f5-49ab-ac74-1c1beca7e15c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:21.451719 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dd3c7b7e-b5f5-49ab-ac74-1c1beca7e15c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1321 microversion: 2.1 time: 0.311668 May 27 15:10:21.455270 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1609/3202] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:21 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:21.465312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9c88e670-4107-44c9-99a5-189864f77bca tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:21.465960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9c88e670-4107-44c9-99a5-189864f77bca tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:21.483434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c88e670-4107-44c9-99a5-189864f77bca tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:21.483908 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c88e670-4107-44c9-99a5-189864f77bca tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:21.484741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c88e670-4107-44c9-99a5-189864f77bca tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:21.485199 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c88e670-4107-44c9-99a5-189864f77bca tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:21.508915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-62511ac3-d820-4d97-b0bf-f1a0f973b13c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:21.518956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-62511ac3-d820-4d97-b0bf-f1a0f973b13c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:21.522292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-62511ac3-d820-4d97-b0bf-f1a0f973b13c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:21.523557 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-62511ac3-d820-4d97-b0bf-f1a0f973b13c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1598 microversion: 2.20 time: 0.435141 May 27 15:10:21.524142 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1594/3203] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:21 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1598 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:21.548442 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dc6c834b-9536-42e6-9e09-5b6068a1e119 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:21.550760 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dc6c834b-9536-42e6-9e09-5b6068a1e119 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:21.560255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc6c834b-9536-42e6-9e09-5b6068a1e119 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:21.561097 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc6c834b-9536-42e6-9e09-5b6068a1e119 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:21.562351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc6c834b-9536-42e6-9e09-5b6068a1e119 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:21.563885 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc6c834b-9536-42e6-9e09-5b6068a1e119 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:21.846332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9c88e670-4107-44c9-99a5-189864f77bca tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:21.855441 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9c88e670-4107-44c9-99a5-189864f77bca tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1293 microversion: 2.1 time: 0.398556 May 27 15:10:21.866646 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1610/3204] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:21 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1293 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:21.877540 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5dc60175-9ee5-49bd-b5d9-eeb4790f9e1e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:21.878709 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5dc60175-9ee5-49bd-b5d9-eeb4790f9e1e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:21.886630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5dc60175-9ee5-49bd-b5d9-eeb4790f9e1e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:21.887326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5dc60175-9ee5-49bd-b5d9-eeb4790f9e1e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:21.888279 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5dc60175-9ee5-49bd-b5d9-eeb4790f9e1e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:21.890460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5dc60175-9ee5-49bd-b5d9-eeb4790f9e1e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:21.909477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dc6c834b-9536-42e6-9e09-5b6068a1e119 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:21.924452 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dc6c834b-9536-42e6-9e09-5b6068a1e119 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.380872 May 27 15:10:21.925079 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1595/3205] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:21 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:21.936647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7eb8aee0-aabe-4bdb-962f-e9377deb3f6b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:21.937314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7eb8aee0-aabe-4bdb-962f-e9377deb3f6b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:21.949879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7eb8aee0-aabe-4bdb-962f-e9377deb3f6b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:21.953010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7eb8aee0-aabe-4bdb-962f-e9377deb3f6b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:21.954007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7eb8aee0-aabe-4bdb-962f-e9377deb3f6b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:21.954524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7eb8aee0-aabe-4bdb-962f-e9377deb3f6b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:21.993392 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5dc60175-9ee5-49bd-b5d9-eeb4790f9e1e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.124662 May 27 15:10:21.995580 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1611/3206] 10.222.0.13 () {60 vars in 1315 bytes} [Fri May 27 15:10:21 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:10:22.088384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1e0ff6cf-3e35-4dab-baaa-8a3944c98d1c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:22.089561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1e0ff6cf-3e35-4dab-baaa-8a3944c98d1c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:22.097005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e0ff6cf-3e35-4dab-baaa-8a3944c98d1c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:22.101759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e0ff6cf-3e35-4dab-baaa-8a3944c98d1c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:22.107399 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e0ff6cf-3e35-4dab-baaa-8a3944c98d1c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:22.108720 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e0ff6cf-3e35-4dab-baaa-8a3944c98d1c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:23.143526 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7eb8aee0-aabe-4bdb-962f-e9377deb3f6b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:23.157408 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7eb8aee0-aabe-4bdb-962f-e9377deb3f6b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1498 microversion: 2.1 time: 1.231227 May 27 15:10:23.161358 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1596/3207] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:21 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1498 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:23.172412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-54aba2f0-57f0-400b-a0da-824a41940cbb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:23.174569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-54aba2f0-57f0-400b-a0da-824a41940cbb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:23.188405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54aba2f0-57f0-400b-a0da-824a41940cbb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:23.189151 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54aba2f0-57f0-400b-a0da-824a41940cbb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:23.190303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54aba2f0-57f0-400b-a0da-824a41940cbb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:23.190901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54aba2f0-57f0-400b-a0da-824a41940cbb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:23.346922 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1e0ff6cf-3e35-4dab-baaa-8a3944c98d1c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:23.379175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1e0ff6cf-3e35-4dab-baaa-8a3944c98d1c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:23.382942 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1e0ff6cf-3e35-4dab-baaa-8a3944c98d1c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:23.384428 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1e0ff6cf-3e35-4dab-baaa-8a3944c98d1c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1802 microversion: 2.42 time: 1.300297 May 27 15:10:23.397604 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1612/3208] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:22 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1802 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:23.404360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-64346d5e-8304-47a6-bcba-c69af889500a req-886c158d-542c-47ca-80eb-e4e660d6992d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bc393fb-711a-436a-8a25-c84ee30e8f3e", "tag": "98d574eb-93db-43b7-be0c-c41276934647"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:23.419557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-64346d5e-8304-47a6-bcba-c69af889500a req-886c158d-542c-47ca-80eb-e4e660d6992d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:23.420441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-64346d5e-8304-47a6-bcba-c69af889500a req-886c158d-542c-47ca-80eb-e4e660d6992d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:23.456658 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-64346d5e-8304-47a6-bcba-c69af889500a req-886c158d-542c-47ca-80eb-e4e660d6992d service nova] Creating event network-changed:98d574eb-93db-43b7-be0c-c41276934647 for instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e on n-h1-843621-1 May 27 15:10:23.461599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-54aba2f0-57f0-400b-a0da-824a41940cbb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:23.472610 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-64346d5e-8304-47a6-bcba-c69af889500a req-886c158d-542c-47ca-80eb-e4e660d6992d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072743 May 27 15:10:23.474238 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1613/3209] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:23.479400 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-54aba2f0-57f0-400b-a0da-824a41940cbb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1512 microversion: 2.1 time: 0.316567 May 27 15:10:23.481219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c940d9dc-2614-4920-ab6c-ba1bc7f7410b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:23.482879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c940d9dc-2614-4920-ab6c-ba1bc7f7410b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:23.489532 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1597/3210] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:23 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1512 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:23.495705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c940d9dc-2614-4920-ab6c-ba1bc7f7410b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:23.496288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c940d9dc-2614-4920-ab6c-ba1bc7f7410b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:23.497228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c940d9dc-2614-4920-ab6c-ba1bc7f7410b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:23.497677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c940d9dc-2614-4920-ab6c-ba1bc7f7410b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:23.501685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-58cf3c62-4c8b-4db2-81ce-e1d328e4e69b tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:23.502544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-58cf3c62-4c8b-4db2-81ce-e1d328e4e69b tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:23.510924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58cf3c62-4c8b-4db2-81ce-e1d328e4e69b tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:23.511625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58cf3c62-4c8b-4db2-81ce-e1d328e4e69b tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:23.521523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58cf3c62-4c8b-4db2-81ce-e1d328e4e69b tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:23.522296 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58cf3c62-4c8b-4db2-81ce-e1d328e4e69b tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:23.950867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c940d9dc-2614-4920-ab6c-ba1bc7f7410b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:23.960421 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c940d9dc-2614-4920-ab6c-ba1bc7f7410b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1321 microversion: 2.1 time: 0.484791 May 27 15:10:23.961211 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1614/3211] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:23 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1321 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:23.967142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4e584e26-8705-4c25-814e-a6237c3471b7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:23.967917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4e584e26-8705-4c25-814e-a6237c3471b7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:23.978018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e584e26-8705-4c25-814e-a6237c3471b7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:23.984538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-58cf3c62-4c8b-4db2-81ce-e1d328e4e69b tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:23.997872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e584e26-8705-4c25-814e-a6237c3471b7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:24.000908 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-58cf3c62-4c8b-4db2-81ce-e1d328e4e69b tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1293 microversion: 2.1 time: 0.503344 May 27 15:10:24.001189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e584e26-8705-4c25-814e-a6237c3471b7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:24.001917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e584e26-8705-4c25-814e-a6237c3471b7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:24.014688 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1598/3212] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:23 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1293 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:24.179617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7ab24db8-021a-4d7e-9817-cdcfb1e3c238 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:24.182488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7ab24db8-021a-4d7e-9817-cdcfb1e3c238 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:24.194457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ab24db8-021a-4d7e-9817-cdcfb1e3c238 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:24.194931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ab24db8-021a-4d7e-9817-cdcfb1e3c238 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:24.195739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ab24db8-021a-4d7e-9817-cdcfb1e3c238 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:24.196192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ab24db8-021a-4d7e-9817-cdcfb1e3c238 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:24.281032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4e584e26-8705-4c25-814e-a6237c3471b7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:24.292404 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4e584e26-8705-4c25-814e-a6237c3471b7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.329803 May 27 15:10:24.293049 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1615/3213] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:23 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:24.404559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bf966f7c-f565-46a7-a87b-d985c9c6a700 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:24.406273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bf966f7c-f565-46a7-a87b-d985c9c6a700 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:24.435903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf966f7c-f565-46a7-a87b-d985c9c6a700 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:24.436635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf966f7c-f565-46a7-a87b-d985c9c6a700 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:24.437908 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf966f7c-f565-46a7-a87b-d985c9c6a700 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:24.438527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf966f7c-f565-46a7-a87b-d985c9c6a700 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:24.444320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:24.461704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7ab24db8-021a-4d7e-9817-cdcfb1e3c238 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:24.477554 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7ab24db8-021a-4d7e-9817-cdcfb1e3c238 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1498 microversion: 2.1 time: 0.303304 May 27 15:10:24.483680 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1599/3214] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:24 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1498 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:10:24.503204 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c7492c70-d0a9-498c-9043-c30a5c7f2a69 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:24.504460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c7492c70-d0a9-498c-9043-c30a5c7f2a69 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:24.513851 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c7492c70-d0a9-498c-9043-c30a5c7f2a69 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:24.514679 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c7492c70-d0a9-498c-9043-c30a5c7f2a69 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:24.515685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c7492c70-d0a9-498c-9043-c30a5c7f2a69 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:24.516361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c7492c70-d0a9-498c-9043-c30a5c7f2a69 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:24.533925 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=22 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:24.879223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bf966f7c-f565-46a7-a87b-d985c9c6a700 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:24.895494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bf966f7c-f565-46a7-a87b-d985c9c6a700 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:24.898168 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bf966f7c-f565-46a7-a87b-d985c9c6a700 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:24.901020 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bf966f7c-f565-46a7-a87b-d985c9c6a700 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1849 microversion: 2.42 time: 0.501475 May 27 15:10:24.905440 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1616/3215] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:24 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1849 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:10:24.912640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-7c424383-aa08-4e63-80f8-474088fd3fb7 req-90d11658-702f-4bca-8e54-e0636990264c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7371c18-20d2-43f8-b0c6-0371079d8f20", "tag": "555c9e09-9066-4780-8d8a-91ccfe7dff8d"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:24.935232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-7c424383-aa08-4e63-80f8-474088fd3fb7 req-90d11658-702f-4bca-8e54-e0636990264c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:24.937166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-7c424383-aa08-4e63-80f8-474088fd3fb7 req-90d11658-702f-4bca-8e54-e0636990264c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:24.949795 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c7492c70-d0a9-498c-9043-c30a5c7f2a69 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:24.952814 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:24.965312 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c7492c70-d0a9-498c-9043-c30a5c7f2a69 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1512 microversion: 2.1 time: 0.466689 May 27 15:10:24.983776 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1600/3216] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:24 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1512 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:24.985668 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-7c424383-aa08-4e63-80f8-474088fd3fb7 req-90d11658-702f-4bca-8e54-e0636990264c service nova] Creating event network-changed:555c9e09-9066-4780-8d8a-91ccfe7dff8d for instance d7371c18-20d2-43f8-b0c6-0371079d8f20 on n-h2-843621-1 May 27 15:10:24.989641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dbefdf6c-8838-445e-9107-b2752a909049 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:24.990567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dbefdf6c-8838-445e-9107-b2752a909049 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:24.996309 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-7c424383-aa08-4e63-80f8-474088fd3fb7 req-90d11658-702f-4bca-8e54-e0636990264c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089146 May 27 15:10:24.996959 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1617/3217] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:25.024408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8f36560f-0efc-4c00-a861-e278368d991a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:25.026073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8f36560f-0efc-4c00-a861-e278368d991a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:25.029752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dbefdf6c-8838-445e-9107-b2752a909049 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:25.030673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dbefdf6c-8838-445e-9107-b2752a909049 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:25.031705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dbefdf6c-8838-445e-9107-b2752a909049 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:25.032375 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dbefdf6c-8838-445e-9107-b2752a909049 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:25.041711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f36560f-0efc-4c00-a861-e278368d991a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:25.042176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f36560f-0efc-4c00-a861-e278368d991a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:25.043633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f36560f-0efc-4c00-a861-e278368d991a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:25.044228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f36560f-0efc-4c00-a861-e278368d991a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:25.450370 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8f36560f-0efc-4c00-a861-e278368d991a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:25.454154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dbefdf6c-8838-445e-9107-b2752a909049 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:25.471873 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dbefdf6c-8838-445e-9107-b2752a909049 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1321 microversion: 2.1 time: 0.486205 May 27 15:10:25.474076 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1601/3218] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:24 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1321 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:25.474782 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8f36560f-0efc-4c00-a861-e278368d991a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1293 microversion: 2.1 time: 0.455254 May 27 15:10:25.475590 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1618/3219] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:25 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1293 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:25.481967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-74dc9bdc-c75c-4c5e-b217-9df317d424f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:25.482890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-74dc9bdc-c75c-4c5e-b217-9df317d424f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:25.494183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-74dc9bdc-c75c-4c5e-b217-9df317d424f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:25.495045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-74dc9bdc-c75c-4c5e-b217-9df317d424f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:25.496056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-74dc9bdc-c75c-4c5e-b217-9df317d424f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:25.502468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ed4eb996-aeab-4097-9d02-3b5fa91598b7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:25.502924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ed4eb996-aeab-4097-9d02-3b5fa91598b7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:25.506537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-74dc9bdc-c75c-4c5e-b217-9df317d424f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:25.513169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed4eb996-aeab-4097-9d02-3b5fa91598b7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:25.516986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed4eb996-aeab-4097-9d02-3b5fa91598b7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:25.518064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed4eb996-aeab-4097-9d02-3b5fa91598b7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:25.521988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed4eb996-aeab-4097-9d02-3b5fa91598b7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:25.988197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-74dc9bdc-c75c-4c5e-b217-9df317d424f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:25.994495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ed4eb996-aeab-4097-9d02-3b5fa91598b7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:26.004268 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ed4eb996-aeab-4097-9d02-3b5fa91598b7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1498 microversion: 2.1 time: 0.506670 May 27 15:10:26.006264 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-74dc9bdc-c75c-4c5e-b217-9df317d424f7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.529275 May 27 15:10:26.010168 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1619/3220] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:25 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1498 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:26.016094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-9af9c82a-1841-408e-928b-abbbe1304c98 req-22164f25-b554-4a2f-b6a1-52ed24a389a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "tag": "f670de18-c094-413a-a6ff-240c82cf0d14"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:26.017369 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1602/3221] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:25 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:26.023110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-00a09a20-d266-4516-ac13-fb02df0acd4a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:26.025894 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-00a09a20-d266-4516-ac13-fb02df0acd4a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:26.041739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-00a09a20-d266-4516-ac13-fb02df0acd4a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:26.044953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9af9c82a-1841-408e-928b-abbbe1304c98 req-22164f25-b554-4a2f-b6a1-52ed24a389a4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:26.045409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9af9c82a-1841-408e-928b-abbbe1304c98 req-22164f25-b554-4a2f-b6a1-52ed24a389a4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:26.050744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-00a09a20-d266-4516-ac13-fb02df0acd4a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:26.051941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-00a09a20-d266-4516-ac13-fb02df0acd4a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:26.052572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-00a09a20-d266-4516-ac13-fb02df0acd4a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:26.071126 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-9af9c82a-1841-408e-928b-abbbe1304c98 req-22164f25-b554-4a2f-b6a1-52ed24a389a4 service nova] Creating event network-changed:f670de18-c094-413a-a6ff-240c82cf0d14 for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:10:26.076041 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-9af9c82a-1841-408e-928b-abbbe1304c98 req-22164f25-b554-4a2f-b6a1-52ed24a389a4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064481 May 27 15:10:26.077099 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1620/3222] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:26.085986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a82348ff-48f9-4cdd-8b55-17a13f681f98 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:26.086773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a82348ff-48f9-4cdd-8b55-17a13f681f98 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:26.114739 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a82348ff-48f9-4cdd-8b55-17a13f681f98 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:26.114739 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a82348ff-48f9-4cdd-8b55-17a13f681f98 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:26.114739 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a82348ff-48f9-4cdd-8b55-17a13f681f98 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:26.114739 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a82348ff-48f9-4cdd-8b55-17a13f681f98 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:26.557542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a82348ff-48f9-4cdd-8b55-17a13f681f98 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:26.571440 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a82348ff-48f9-4cdd-8b55-17a13f681f98 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1512 microversion: 2.1 time: 0.491292 May 27 15:10:26.572884 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1621/3223] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:26 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1512 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:26.586207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3759abbf-dd49-4aee-9d12-8d2eb33a4c5a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:26.587128 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3759abbf-dd49-4aee-9d12-8d2eb33a4c5a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:26.605331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3759abbf-dd49-4aee-9d12-8d2eb33a4c5a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:26.607516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3759abbf-dd49-4aee-9d12-8d2eb33a4c5a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:26.608436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3759abbf-dd49-4aee-9d12-8d2eb33a4c5a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:26.611902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3759abbf-dd49-4aee-9d12-8d2eb33a4c5a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:26.678427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-00a09a20-d266-4516-ac13-fb02df0acd4a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:26.688765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-00a09a20-d266-4516-ac13-fb02df0acd4a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:26.690319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-00a09a20-d266-4516-ac13-fb02df0acd4a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:26.699373 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-00a09a20-d266-4516-ac13-fb02df0acd4a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1870 microversion: 2.42 time: 0.672867 May 27 15:10:26.700094 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1603/3224] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:26 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1870 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:26.706419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bd57c64c-2d8d-46df-893e-9afb96246a81 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:26.715025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bd57c64c-2d8d-46df-893e-9afb96246a81 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:26.730426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd57c64c-2d8d-46df-893e-9afb96246a81 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:26.731176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd57c64c-2d8d-46df-893e-9afb96246a81 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:26.734754 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd57c64c-2d8d-46df-893e-9afb96246a81 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:26.735432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd57c64c-2d8d-46df-893e-9afb96246a81 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:26.923736 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3759abbf-dd49-4aee-9d12-8d2eb33a4c5a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:26.937287 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3759abbf-dd49-4aee-9d12-8d2eb33a4c5a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1321 microversion: 2.1 time: 0.361051 May 27 15:10:26.947694 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1622/3225] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:26 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1321 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:26.953187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-11070d47-11d9-408b-9c82-92006fa709d4 req-80c6caaf-256e-456e-a194-7f41be8c5f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a29b1804-7072-488e-ba2d-5726d65fee2f", "name": "network-vif-unplugged", "status": "completed", "tag": "8d69d638-3687-4f6a-a53f-b2f5f49aac1c"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:26.961979 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-11070d47-11d9-408b-9c82-92006fa709d4 req-80c6caaf-256e-456e-a194-7f41be8c5f3e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:26.962875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-11070d47-11d9-408b-9c82-92006fa709d4 req-80c6caaf-256e-456e-a194-7f41be8c5f3e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:26.995470 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-11070d47-11d9-408b-9c82-92006fa709d4 req-80c6caaf-256e-456e-a194-7f41be8c5f3e service nova] Creating event network-vif-unplugged:8d69d638-3687-4f6a-a53f-b2f5f49aac1c for instance a29b1804-7072-488e-ba2d-5726d65fee2f on n-h1-843621-1 May 27 15:10:27.002668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bd57c64c-2d8d-46df-893e-9afb96246a81 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:27.014599 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bd57c64c-2d8d-46df-893e-9afb96246a81 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1293 microversion: 2.1 time: 0.311966 May 27 15:10:27.017456 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-11070d47-11d9-408b-9c82-92006fa709d4 req-80c6caaf-256e-456e-a194-7f41be8c5f3e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067337 May 27 15:10:27.027541 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1604/3226] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:26 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1293 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:27.029462 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1623/3227] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:27.036544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-61adba3a-6d53-4a60-865a-4314df07da7f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:27.042025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-61adba3a-6d53-4a60-865a-4314df07da7f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:27.042910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-68894d97-b08e-4155-add0-3ec8594697f4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:27.046911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-68894d97-b08e-4155-add0-3ec8594697f4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:27.058752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-61adba3a-6d53-4a60-865a-4314df07da7f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:27.062438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68894d97-b08e-4155-add0-3ec8594697f4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:27.063439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-61adba3a-6d53-4a60-865a-4314df07da7f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:27.065046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-61adba3a-6d53-4a60-865a-4314df07da7f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:27.065748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-61adba3a-6d53-4a60-865a-4314df07da7f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:27.066519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68894d97-b08e-4155-add0-3ec8594697f4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:27.070897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68894d97-b08e-4155-add0-3ec8594697f4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:27.072283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68894d97-b08e-4155-add0-3ec8594697f4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:27.195326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-61adba3a-6d53-4a60-865a-4314df07da7f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0536f4a5547545acaa06b6aad5d1fbe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b5a0b0723a46c1b0755e824e32b776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:27.210768 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-61adba3a-6d53-4a60-865a-4314df07da7f tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 200 len: 1456 microversion: 2.1 time: 0.181553 May 27 15:10:27.211210 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1605/3228] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:27 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 1456 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:27.289830 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-68894d97-b08e-4155-add0-3ec8594697f4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:27.303169 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-68894d97-b08e-4155-add0-3ec8594697f4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.269331 May 27 15:10:27.303805 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1624/3229] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:27 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:27.590775 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f63fd7f1-959e-40b4-a500-b32ce2e69af8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:27.592073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f63fd7f1-959e-40b4-a500-b32ce2e69af8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:27.601360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f63fd7f1-959e-40b4-a500-b32ce2e69af8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:27.602163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f63fd7f1-959e-40b4-a500-b32ce2e69af8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:27.603887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f63fd7f1-959e-40b4-a500-b32ce2e69af8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:27.604564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f63fd7f1-959e-40b4-a500-b32ce2e69af8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:27.726294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-66036bda-a632-49ab-a56b-c27f129d1923 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:27.726921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-66036bda-a632-49ab-a56b-c27f129d1923 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:27.735385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66036bda-a632-49ab-a56b-c27f129d1923 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:27.736288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66036bda-a632-49ab-a56b-c27f129d1923 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:27.737349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66036bda-a632-49ab-a56b-c27f129d1923 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:27.737958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66036bda-a632-49ab-a56b-c27f129d1923 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.005509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f63fd7f1-959e-40b4-a500-b32ce2e69af8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:28.019204 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f63fd7f1-959e-40b4-a500-b32ce2e69af8 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1512 microversion: 2.1 time: 0.432751 May 27 15:10:28.020566 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1606/3230] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:27 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1512 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:28.026506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ba1e80d2-7482-469f-95d2-eaf1af17d8aa tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:28.028451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ba1e80d2-7482-469f-95d2-eaf1af17d8aa tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:28.051014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ba1e80d2-7482-469f-95d2-eaf1af17d8aa tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.051856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ba1e80d2-7482-469f-95d2-eaf1af17d8aa tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.052964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ba1e80d2-7482-469f-95d2-eaf1af17d8aa tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.053772 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ba1e80d2-7482-469f-95d2-eaf1af17d8aa tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.121376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-66036bda-a632-49ab-a56b-c27f129d1923 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:28.154246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-66036bda-a632-49ab-a56b-c27f129d1923 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:28.156291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-66036bda-a632-49ab-a56b-c27f129d1923 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:28.157613 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-66036bda-a632-49ab-a56b-c27f129d1923 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1870 microversion: 2.42 time: 0.438270 May 27 15:10:28.158555 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1625/3231] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:27 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1870 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:28.165344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7b2ff4eb-f123-403d-bf51-fce3941fb8b8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:28.166335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7b2ff4eb-f123-403d-bf51-fce3941fb8b8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:28.175165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7b2ff4eb-f123-403d-bf51-fce3941fb8b8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.175929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7b2ff4eb-f123-403d-bf51-fce3941fb8b8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.176984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7b2ff4eb-f123-403d-bf51-fce3941fb8b8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.177608 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7b2ff4eb-f123-403d-bf51-fce3941fb8b8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.390745 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ba1e80d2-7482-469f-95d2-eaf1af17d8aa tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:28.401199 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ba1e80d2-7482-469f-95d2-eaf1af17d8aa tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1321 microversion: 2.1 time: 0.379152 May 27 15:10:28.401801 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1607/3232] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:28 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1321 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:28.417158 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c0921449-873d-4871-996e-8d3c937ef358 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:28.418524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c0921449-873d-4871-996e-8d3c937ef358 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:28.431564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c0921449-873d-4871-996e-8d3c937ef358 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.432039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c0921449-873d-4871-996e-8d3c937ef358 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.432871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c0921449-873d-4871-996e-8d3c937ef358 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.433917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c0921449-873d-4871-996e-8d3c937ef358 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.443835 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7b2ff4eb-f123-403d-bf51-fce3941fb8b8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:28.450838 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-c0921449-873d-4871-996e-8d3c937ef358 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 could not be found. May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c0921449-873d-4871-996e-8d3c937ef358 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 HTTP/1.1 May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 could not be found. May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6'} May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 could not be found. May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 could not be found. May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:28.452561 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:28.456732 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.456732 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:28.456732 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:28.456732 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:10:28.456732 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:10:28.456732 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 could not be found. May 27 15:10:28.456732 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:28.456732 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c0921449-873d-4871-996e-8d3c937ef358 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:10:28.456732 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c0921449-873d-4871-996e-8d3c937ef358 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 404 len: 111 microversion: 2.1 time: 0.051284 May 27 15:10:28.459782 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7b2ff4eb-f123-403d-bf51-fce3941fb8b8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1293 microversion: 2.1 time: 0.293194 May 27 15:10:28.460531 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1608/3233] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:28 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:10:28.461279 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1626/3234] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:28 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1293 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:28.467329 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-01ef8924-047a-4f06-84ed-313313d69809 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:28.468177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-01ef8924-047a-4f06-84ed-313313d69809 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:28.471875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-0d43785b-7fd7-48ca-83f4-7553a58c80c6 req-12b74939-22df-4685-a67d-61e71863372c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6", "name": "network-vif-deleted", "tag": "4b993dec-9e5f-4bf8-93f4-0f1265b53372"}, {"name": "network-changed", "server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "tag": "958625ea-67d8-42d6-878e-1e264997c838"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:28.476399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01ef8924-047a-4f06-84ed-313313d69809 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.476831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01ef8924-047a-4f06-84ed-313313d69809 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.478491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01ef8924-047a-4f06-84ed-313313d69809 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.478946 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01ef8924-047a-4f06-84ed-313313d69809 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.482472 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0d43785b-7fd7-48ca-83f4-7553a58c80c6 req-12b74939-22df-4685-a67d-61e71863372c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.483175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0d43785b-7fd7-48ca-83f4-7553a58c80c6 req-12b74939-22df-4685-a67d-61e71863372c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.497052 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-0d43785b-7fd7-48ca-83f4-7553a58c80c6 req-12b74939-22df-4685-a67d-61e71863372c service nova] Creating event network-vif-deleted:4b993dec-9e5f-4bf8-93f4-0f1265b53372 for instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 on n-h1-843621-1 May 27 15:10:28.498054 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-0d43785b-7fd7-48ca-83f4-7553a58c80c6 req-12b74939-22df-4685-a67d-61e71863372c service nova] Creating event network-changed:958625ea-67d8-42d6-878e-1e264997c838 for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:10:28.510539 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-0d43785b-7fd7-48ca-83f4-7553a58c80c6 req-12b74939-22df-4685-a67d-61e71863372c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.046787 May 27 15:10:28.511771 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1627/3235] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:28.517073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ec37ef53-efb5-4425-9ef0-7e763590f7e8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:28.517924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ec37ef53-efb5-4425-9ef0-7e763590f7e8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:28.525237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec37ef53-efb5-4425-9ef0-7e763590f7e8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.526850 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec37ef53-efb5-4425-9ef0-7e763590f7e8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.527893 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec37ef53-efb5-4425-9ef0-7e763590f7e8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.528977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec37ef53-efb5-4425-9ef0-7e763590f7e8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.559510 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-ec37ef53-efb5-4425-9ef0-7e763590f7e8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 could not be found. May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ec37ef53-efb5-4425-9ef0-7e763590f7e8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 HTTP/1.1 May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 could not be found. May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6'} May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 could not be found. May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:10:28.561462 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:10:28.565897 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 could not be found. May 27 15:10:28.565897 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.565897 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:28.565897 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.565897 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.565897 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:28.565897 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:28.565897 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:10:28.565897 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:10:28.565897 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 could not be found. May 27 15:10:28.565897 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.567885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ec37ef53-efb5-4425-9ef0-7e763590f7e8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:10:28.569258 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ec37ef53-efb5-4425-9ef0-7e763590f7e8 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 404 len: 111 microversion: 2.1 time: 0.056004 May 27 15:10:28.570343 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1628/3236] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:10:28 2022] DELETE /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:10:28.579508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e95acdb5-bdd7-48f9-b50e-93ff2024b119 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:28.580391 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e95acdb5-bdd7-48f9-b50e-93ff2024b119 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:28.587741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e95acdb5-bdd7-48f9-b50e-93ff2024b119 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.588444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e95acdb5-bdd7-48f9-b50e-93ff2024b119 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.589611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e95acdb5-bdd7-48f9-b50e-93ff2024b119 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.590219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e95acdb5-bdd7-48f9-b50e-93ff2024b119 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.598251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:28.611222 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-e95acdb5-bdd7-48f9-b50e-93ff2024b119 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 could not be found. May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e95acdb5-bdd7-48f9-b50e-93ff2024b119 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 HTTP/1.1 May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 could not be found. May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6'} May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 could not be found. May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 could not be found. May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:28.613554 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.618049 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.618049 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:28.618049 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:28.618049 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:10:28.618049 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:10:28.618049 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 could not be found. May 27 15:10:28.618049 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.621158 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e95acdb5-bdd7-48f9-b50e-93ff2024b119 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:10:28.622501 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e95acdb5-bdd7-48f9-b50e-93ff2024b119 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6" status: 404 len: 111 microversion: 2.1 time: 0.047273 May 27 15:10:28.623917 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1629/3237] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:28 2022] GET /compute/v2.1/servers/dc5852ea-b0d0-411a-8e88-e6a1f20b3ab6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:10:28.632425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-887b0132-47fd-48d4-87c8-1ea752c89bb7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:28.632964 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-887b0132-47fd-48d4-87c8-1ea752c89bb7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:28.641322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-887b0132-47fd-48d4-87c8-1ea752c89bb7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.641786 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-887b0132-47fd-48d4-87c8-1ea752c89bb7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.643093 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-887b0132-47fd-48d4-87c8-1ea752c89bb7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.643547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-887b0132-47fd-48d4-87c8-1ea752c89bb7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.664891 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-887b0132-47fd-48d4-87c8-1ea752c89bb7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance 5f1bb984-1a95-44b2-b300-7a5986ca934a could not be found. May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-887b0132-47fd-48d4-87c8-1ea752c89bb7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a HTTP/1.1 May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 5f1bb984-1a95-44b2-b300-7a5986ca934a could not be found. May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '5f1bb984-1a95-44b2-b300-7a5986ca934a'} May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1bb984-1a95-44b2-b300-7a5986ca934a could not be found. May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:10:28.666908 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:10:28.671668 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1bb984-1a95-44b2-b300-7a5986ca934a could not be found. May 27 15:10:28.671668 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.671668 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:28.671668 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.671668 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.671668 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:28.671668 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:28.671668 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:10:28.671668 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:10:28.671668 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1bb984-1a95-44b2-b300-7a5986ca934a could not be found. May 27 15:10:28.671668 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.671668 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-887b0132-47fd-48d4-87c8-1ea752c89bb7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance 5f1bb984-1a95-44b2-b300-7a5986ca934a could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:10:28.671668 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-887b0132-47fd-48d4-87c8-1ea752c89bb7 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 404 len: 111 microversion: 2.1 time: 0.042662 May 27 15:10:28.676828 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1630/3238] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:10:28 2022] DELETE /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:10:28.682984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-106c7027-7da2-441f-9ffa-2d6b76a4e44e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:28.684945 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-106c7027-7da2-441f-9ffa-2d6b76a4e44e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 5f1bb984-1a95-44b2-b300-7a5986ca934a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:28.686073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-01ef8924-047a-4f06-84ed-313313d69809 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:28.692413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-106c7027-7da2-441f-9ffa-2d6b76a4e44e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.693189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-106c7027-7da2-441f-9ffa-2d6b76a4e44e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.695285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-106c7027-7da2-441f-9ffa-2d6b76a4e44e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.695513 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-01ef8924-047a-4f06-84ed-313313d69809 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.232624 May 27 15:10:28.705927 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1609/3239] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:28 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:28.706046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-106c7027-7da2-441f-9ffa-2d6b76a4e44e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.714771 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-106c7027-7da2-441f-9ffa-2d6b76a4e44e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance 5f1bb984-1a95-44b2-b300-7a5986ca934a could not be found. May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-106c7027-7da2-441f-9ffa-2d6b76a4e44e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a HTTP/1.1 May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 5f1bb984-1a95-44b2-b300-7a5986ca934a could not be found. May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '5f1bb984-1a95-44b2-b300-7a5986ca934a'} May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1bb984-1a95-44b2-b300-7a5986ca934a could not be found. May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1bb984-1a95-44b2-b300-7a5986ca934a could not be found. May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:28.716330 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.724752 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.724752 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:28.724752 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:28.724752 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:10:28.724752 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:10:28.724752 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1bb984-1a95-44b2-b300-7a5986ca934a could not be found. May 27 15:10:28.724752 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.724752 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-106c7027-7da2-441f-9ffa-2d6b76a4e44e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance 5f1bb984-1a95-44b2-b300-7a5986ca934a could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:10:28.724752 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-106c7027-7da2-441f-9ffa-2d6b76a4e44e tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a" status: 404 len: 111 microversion: 2.1 time: 0.039269 May 27 15:10:28.724752 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1631/3240] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:28 2022] GET /compute/v2.1/servers/5f1bb984-1a95-44b2-b300-7a5986ca934a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:10:28.739329 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-82aba5bc-d3bf-4a43-a1df-491deb10953a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:28.739735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-82aba5bc-d3bf-4a43-a1df-491deb10953a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:28.750160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82aba5bc-d3bf-4a43-a1df-491deb10953a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.750627 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82aba5bc-d3bf-4a43-a1df-491deb10953a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.751425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82aba5bc-d3bf-4a43-a1df-491deb10953a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.755298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82aba5bc-d3bf-4a43-a1df-491deb10953a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.771154 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-82aba5bc-d3bf-4a43-a1df-491deb10953a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance 1852d307-f34e-4a53-942f-145d41dc5c24 could not be found. May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-82aba5bc-d3bf-4a43-a1df-491deb10953a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 HTTP/1.1 May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 1852d307-f34e-4a53-942f-145d41dc5c24 could not be found. May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '1852d307-f34e-4a53-942f-145d41dc5c24'} May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1852d307-f34e-4a53-942f-145d41dc5c24 could not be found. May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:10:28.774927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:10:28.779072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1852d307-f34e-4a53-942f-145d41dc5c24 could not be found. May 27 15:10:28.779072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:28.779072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:28.779072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:28.779072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.779072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:28.779072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:28.779072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:10:28.779072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:10:28.779072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1852d307-f34e-4a53-942f-145d41dc5c24 could not be found. May 27 15:10:28.779072 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:28.781336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-82aba5bc-d3bf-4a43-a1df-491deb10953a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance 1852d307-f34e-4a53-942f-145d41dc5c24 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:10:28.782434 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-82aba5bc-d3bf-4a43-a1df-491deb10953a tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 404 len: 111 microversion: 2.1 time: 0.058518 May 27 15:10:28.783537 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1610/3241] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:10:28 2022] DELETE /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:10:28.795204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d28f0488-0dfc-4d4d-9a1f-a862a2226afd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:28.795822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d28f0488-0dfc-4d4d-9a1f-a862a2226afd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 1852d307-f34e-4a53-942f-145d41dc5c24] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:28.804553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d28f0488-0dfc-4d4d-9a1f-a862a2226afd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.805305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d28f0488-0dfc-4d4d-9a1f-a862a2226afd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.806621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d28f0488-0dfc-4d4d-9a1f-a862a2226afd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.807404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d28f0488-0dfc-4d4d-9a1f-a862a2226afd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.825427 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-d28f0488-0dfc-4d4d-9a1f-a862a2226afd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance 1852d307-f34e-4a53-942f-145d41dc5c24 could not be found. May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d28f0488-0dfc-4d4d-9a1f-a862a2226afd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 HTTP/1.1 May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 1852d307-f34e-4a53-942f-145d41dc5c24 could not be found. May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '1852d307-f34e-4a53-942f-145d41dc5c24'} May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1852d307-f34e-4a53-942f-145d41dc5c24 could not be found. May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1852d307-f34e-4a53-942f-145d41dc5c24 could not be found. May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:28.827327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.831634 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.831634 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:28.831634 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:28.831634 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:10:28.831634 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:10:28.831634 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1852d307-f34e-4a53-942f-145d41dc5c24 could not be found. May 27 15:10:28.831634 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.831634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d28f0488-0dfc-4d4d-9a1f-a862a2226afd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance 1852d307-f34e-4a53-942f-145d41dc5c24 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:10:28.831634 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d28f0488-0dfc-4d4d-9a1f-a862a2226afd tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24" status: 404 len: 111 microversion: 2.1 time: 0.038327 May 27 15:10:28.833215 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1632/3242] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:28 2022] GET /compute/v2.1/servers/1852d307-f34e-4a53-942f-145d41dc5c24 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:10:28.838167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1d9278b2-84d5-43cd-b944-59ceaa6181ec tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:28.838905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1d9278b2-84d5-43cd-b944-59ceaa6181ec tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:28.845290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d9278b2-84d5-43cd-b944-59ceaa6181ec tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.846052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d9278b2-84d5-43cd-b944-59ceaa6181ec tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.847112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d9278b2-84d5-43cd-b944-59ceaa6181ec tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.847711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d9278b2-84d5-43cd-b944-59ceaa6181ec tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.867021 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-1d9278b2-84d5-43cd-b944-59ceaa6181ec tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance 841712c3-20ca-42ed-9c1f-22b88de952b6 could not be found. May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1d9278b2-84d5-43cd-b944-59ceaa6181ec tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 HTTP/1.1 May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 841712c3-20ca-42ed-9c1f-22b88de952b6 could not be found. May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '841712c3-20ca-42ed-9c1f-22b88de952b6'} May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 841712c3-20ca-42ed-9c1f-22b88de952b6 could not be found. May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:10:28.869480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:10:28.873652 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 841712c3-20ca-42ed-9c1f-22b88de952b6 could not be found. May 27 15:10:28.873652 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:28.873652 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:28.873652 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:28.873652 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.873652 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:28.873652 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:28.873652 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:10:28.873652 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:10:28.873652 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 841712c3-20ca-42ed-9c1f-22b88de952b6 could not be found. May 27 15:10:28.873652 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:28.873652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1d9278b2-84d5-43cd-b944-59ceaa6181ec tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance 841712c3-20ca-42ed-9c1f-22b88de952b6 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:10:28.873652 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1d9278b2-84d5-43cd-b944-59ceaa6181ec tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "DELETE /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 404 len: 111 microversion: 2.1 time: 0.036735 May 27 15:10:28.873652 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1611/3243] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:10:28 2022] DELETE /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:10:28.880167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ecb26775-1286-49b6-8e6a-b9ca060c5571 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:28.880830 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ecb26775-1286-49b6-8e6a-b9ca060c5571 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 841712c3-20ca-42ed-9c1f-22b88de952b6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:28.887180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:28.888987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ecb26775-1286-49b6-8e6a-b9ca060c5571 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.889708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ecb26775-1286-49b6-8e6a-b9ca060c5571 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.890684 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ecb26775-1286-49b6-8e6a-b9ca060c5571 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.891133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ecb26775-1286-49b6-8e6a-b9ca060c5571 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.924417 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-ecb26775-1286-49b6-8e6a-b9ca060c5571 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance 841712c3-20ca-42ed-9c1f-22b88de952b6 could not be found. May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ecb26775-1286-49b6-8e6a-b9ca060c5571 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 HTTP/1.1 May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 841712c3-20ca-42ed-9c1f-22b88de952b6 could not be found. May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '841712c3-20ca-42ed-9c1f-22b88de952b6'} May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 841712c3-20ca-42ed-9c1f-22b88de952b6 could not be found. May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 841712c3-20ca-42ed-9c1f-22b88de952b6 could not be found. May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:28.926686 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.930392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.930392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:28.930392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:28.930392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:10:28.930392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:10:28.930392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 841712c3-20ca-42ed-9c1f-22b88de952b6 could not be found. May 27 15:10:28.930392 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:28.931566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ecb26775-1286-49b6-8e6a-b9ca060c5571 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance 841712c3-20ca-42ed-9c1f-22b88de952b6 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:10:28.938249 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ecb26775-1286-49b6-8e6a-b9ca060c5571 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6" status: 404 len: 111 microversion: 2.1 time: 0.062011 May 27 15:10:28.938933 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1633/3244] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:28 2022] GET /compute/v2.1/servers/841712c3-20ca-42ed-9c1f-22b88de952b6 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:10:28.948035 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6672785b-671c-4cc9-ac87-8be07afc1551 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:28.948711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6672785b-671c-4cc9-ac87-8be07afc1551 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:28.955336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6672785b-671c-4cc9-ac87-8be07afc1551 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.955898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6672785b-671c-4cc9-ac87-8be07afc1551 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.956815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6672785b-671c-4cc9-ac87-8be07afc1551 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.957335 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6672785b-671c-4cc9-ac87-8be07afc1551 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.972593 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-6672785b-671c-4cc9-ac87-8be07afc1551 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance c814849f-c8b5-44a6-9727-654fcc92437c could not be found. May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6672785b-671c-4cc9-ac87-8be07afc1551 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c HTTP/1.1 May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance c814849f-c8b5-44a6-9727-654fcc92437c could not be found. May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'c814849f-c8b5-44a6-9727-654fcc92437c'} May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c814849f-c8b5-44a6-9727-654fcc92437c could not be found. May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:10:28.974325 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:10:28.978573 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c814849f-c8b5-44a6-9727-654fcc92437c could not be found. May 27 15:10:28.978573 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:28.978573 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:28.978573 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:28.978573 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:28.978573 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:28.978573 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:28.978573 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:10:28.978573 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:10:28.978573 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c814849f-c8b5-44a6-9727-654fcc92437c could not be found. May 27 15:10:28.978573 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:28.978573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6672785b-671c-4cc9-ac87-8be07afc1551 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance c814849f-c8b5-44a6-9727-654fcc92437c could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:10:28.978573 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6672785b-671c-4cc9-ac87-8be07afc1551 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 404 len: 111 microversion: 2.1 time: 0.032517 May 27 15:10:28.978573 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1612/3245] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:10:28 2022] DELETE /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:10:28.985833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8d7535d3-b668-44de-b9b2-1d6e217f2697 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:28.986811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8d7535d3-b668-44de-b9b2-1d6e217f2697 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: c814849f-c8b5-44a6-9727-654fcc92437c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:28.994403 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d7535d3-b668-44de-b9b2-1d6e217f2697 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.995180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d7535d3-b668-44de-b9b2-1d6e217f2697 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:28.996225 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d7535d3-b668-44de-b9b2-1d6e217f2697 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:28.996923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d7535d3-b668-44de-b9b2-1d6e217f2697 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:29.013860 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-8d7535d3-b668-44de-b9b2-1d6e217f2697 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance c814849f-c8b5-44a6-9727-654fcc92437c could not be found. May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8d7535d3-b668-44de-b9b2-1d6e217f2697 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c HTTP/1.1 May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance c814849f-c8b5-44a6-9727-654fcc92437c could not be found. May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'c814849f-c8b5-44a6-9727-654fcc92437c'} May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c814849f-c8b5-44a6-9727-654fcc92437c could not be found. May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c814849f-c8b5-44a6-9727-654fcc92437c could not be found. May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:29.015767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:29.019960 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:29.019960 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:29.019960 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:29.019960 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:10:29.019960 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:10:29.019960 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c814849f-c8b5-44a6-9727-654fcc92437c could not be found. May 27 15:10:29.019960 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:29.023835 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8d7535d3-b668-44de-b9b2-1d6e217f2697 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance c814849f-c8b5-44a6-9727-654fcc92437c could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:10:29.025000 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8d7535d3-b668-44de-b9b2-1d6e217f2697 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c" status: 404 len: 111 microversion: 2.1 time: 0.042994 May 27 15:10:29.026120 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1634/3246] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:28 2022] GET /compute/v2.1/servers/c814849f-c8b5-44a6-9727-654fcc92437c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:10:29.040963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-af241b76-e2cc-4706-b816-944aa8c4f58e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:29.042401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-af241b76-e2cc-4706-b816-944aa8c4f58e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:29.050933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af241b76-e2cc-4706-b816-944aa8c4f58e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:29.052031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af241b76-e2cc-4706-b816-944aa8c4f58e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:29.053630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af241b76-e2cc-4706-b816-944aa8c4f58e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:29.054353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af241b76-e2cc-4706-b816-944aa8c4f58e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:29.117359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af241b76-e2cc-4706-b816-944aa8c4f58e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:29.118067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af241b76-e2cc-4706-b816-944aa8c4f58e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:29.119777 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-af241b76-e2cc-4706-b816-944aa8c4f58e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lazy-loading 'fault' on Instance uuid a29b1804-7072-488e-ba2d-5726d65fee2f {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:10:29.180564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-591e034d-18a0-480c-b513-b22d2510cd3e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:29.182211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-591e034d-18a0-480c-b513-b22d2510cd3e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:29.206784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-591e034d-18a0-480c-b513-b22d2510cd3e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:29.216074 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-591e034d-18a0-480c-b513-b22d2510cd3e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:29.223674 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-591e034d-18a0-480c-b513-b22d2510cd3e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:29.224446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-591e034d-18a0-480c-b513-b22d2510cd3e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:29.238178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-af241b76-e2cc-4706-b816-944aa8c4f58e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:29.260095 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-af241b76-e2cc-4706-b816-944aa8c4f58e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1307 microversion: 2.1 time: 0.223708 May 27 15:10:29.260749 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1613/3247] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:29 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1307 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:29.320431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-920080f6-e42c-4107-9f9b-7587980446dd req-49918239-9d95-423c-bb2a-c118c394041d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "445b2880-4df5-45f6-bba3-3af281cea45c", "name": "network-vif-plugged", "status": "completed", "tag": "c3906eca-7038-456e-89aa-ed8bbe73dafd"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:29.330411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-920080f6-e42c-4107-9f9b-7587980446dd req-49918239-9d95-423c-bb2a-c118c394041d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:29.330872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-920080f6-e42c-4107-9f9b-7587980446dd req-49918239-9d95-423c-bb2a-c118c394041d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:29.372838 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-920080f6-e42c-4107-9f9b-7587980446dd req-49918239-9d95-423c-bb2a-c118c394041d service nova] Creating event network-vif-plugged:c3906eca-7038-456e-89aa-ed8bbe73dafd for instance 445b2880-4df5-45f6-bba3-3af281cea45c on n-h1-843621-1 May 27 15:10:29.378701 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-920080f6-e42c-4107-9f9b-7587980446dd req-49918239-9d95-423c-bb2a-c118c394041d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065088 May 27 15:10:29.379803 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1614/3248] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:10:29.424506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6d9c7a2b-839c-46a9-a29e-21473749fa08 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:29.425272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6d9c7a2b-839c-46a9-a29e-21473749fa08 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:29.438081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d9c7a2b-839c-46a9-a29e-21473749fa08 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:29.438557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d9c7a2b-839c-46a9-a29e-21473749fa08 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:29.439520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d9c7a2b-839c-46a9-a29e-21473749fa08 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:29.439979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d9c7a2b-839c-46a9-a29e-21473749fa08 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:29.644218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-591e034d-18a0-480c-b513-b22d2510cd3e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:29.660450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-591e034d-18a0-480c-b513-b22d2510cd3e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:29.668364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-591e034d-18a0-480c-b513-b22d2510cd3e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:29.670778 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-591e034d-18a0-480c-b513-b22d2510cd3e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1870 microversion: 2.42 time: 0.496607 May 27 15:10:29.673132 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1635/3249] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:29 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1870 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:29.684865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a3188fb3-89e2-4f65-ab28-6d53687277dd tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:29.689273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6d9c7a2b-839c-46a9-a29e-21473749fa08 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:29.693605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a3188fb3-89e2-4f65-ab28-6d53687277dd tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:29.699023 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6d9c7a2b-839c-46a9-a29e-21473749fa08 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1321 microversion: 2.1 time: 0.278688 May 27 15:10:29.706541 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a3188fb3-89e2-4f65-ab28-6d53687277dd tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:29.707967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a3188fb3-89e2-4f65-ab28-6d53687277dd tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:29.709957 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1615/3250] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:29 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:29.711753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a3188fb3-89e2-4f65-ab28-6d53687277dd tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:29.712401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a3188fb3-89e2-4f65-ab28-6d53687277dd tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:29.716789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2d000a80-9b88-41e3-9325-abf1dc1e03c9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:29.717646 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2d000a80-9b88-41e3-9325-abf1dc1e03c9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:29.725689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2d000a80-9b88-41e3-9325-abf1dc1e03c9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:29.726343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2d000a80-9b88-41e3-9325-abf1dc1e03c9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:29.727328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2d000a80-9b88-41e3-9325-abf1dc1e03c9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:29.728499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2d000a80-9b88-41e3-9325-abf1dc1e03c9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:29.967193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2d000a80-9b88-41e3-9325-abf1dc1e03c9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:29.981666 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2d000a80-9b88-41e3-9325-abf1dc1e03c9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.270306 May 27 15:10:29.986230 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1616/3251] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:29 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:30.042812 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a3188fb3-89e2-4f65-ab28-6d53687277dd tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:30.053253 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a3188fb3-89e2-4f65-ab28-6d53687277dd tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1293 microversion: 2.1 time: 0.374806 May 27 15:10:30.053886 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1636/3252] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:29 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1293 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:30.283392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7bf121ae-a6a8-4017-85ec-f8807d1b94a9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:30.289337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7bf121ae-a6a8-4017-85ec-f8807d1b94a9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:30.309611 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7bf121ae-a6a8-4017-85ec-f8807d1b94a9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:30.310091 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7bf121ae-a6a8-4017-85ec-f8807d1b94a9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:30.310893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7bf121ae-a6a8-4017-85ec-f8807d1b94a9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:30.313010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7bf121ae-a6a8-4017-85ec-f8807d1b94a9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:30.360597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7bf121ae-a6a8-4017-85ec-f8807d1b94a9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:30.361454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7bf121ae-a6a8-4017-85ec-f8807d1b94a9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:30.362145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-7bf121ae-a6a8-4017-85ec-f8807d1b94a9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lazy-loading 'fault' on Instance uuid a29b1804-7072-488e-ba2d-5726d65fee2f {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:10:30.407138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7bf121ae-a6a8-4017-85ec-f8807d1b94a9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:30.415912 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7bf121ae-a6a8-4017-85ec-f8807d1b94a9 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1307 microversion: 2.1 time: 0.140659 May 27 15:10:30.416619 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1617/3253] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:30 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1307 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:30.578010 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-0652b281-c4ad-4baf-9bf9-9da6ff24b49f req-33be0e4b-9b26-4d9b-85cd-e7f8b8df0a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a29b1804-7072-488e-ba2d-5726d65fee2f", "name": "network-vif-deleted", "tag": "8d69d638-3687-4f6a-a53f-b2f5f49aac1c"}, {"name": "network-changed", "server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "tag": "710a3bb3-e4d3-4b44-bf00-38bbf0d70d23"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:30.590249 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0652b281-c4ad-4baf-9bf9-9da6ff24b49f req-33be0e4b-9b26-4d9b-85cd-e7f8b8df0a8c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:30.591029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0652b281-c4ad-4baf-9bf9-9da6ff24b49f req-33be0e4b-9b26-4d9b-85cd-e7f8b8df0a8c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:30.622843 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-0652b281-c4ad-4baf-9bf9-9da6ff24b49f req-33be0e4b-9b26-4d9b-85cd-e7f8b8df0a8c service nova] Creating event network-vif-deleted:8d69d638-3687-4f6a-a53f-b2f5f49aac1c for instance a29b1804-7072-488e-ba2d-5726d65fee2f on n-h1-843621-1 May 27 15:10:30.623612 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-0652b281-c4ad-4baf-9bf9-9da6ff24b49f req-33be0e4b-9b26-4d9b-85cd-e7f8b8df0a8c service nova] Creating event network-changed:710a3bb3-e4d3-4b44-bf00-38bbf0d70d23 for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:10:30.643496 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-0652b281-c4ad-4baf-9bf9-9da6ff24b49f req-33be0e4b-9b26-4d9b-85cd-e7f8b8df0a8c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.070752 May 27 15:10:30.645058 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1637/3254] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:30.697330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5b893678-3f57-4e06-b136-0de851289cc6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:30.698267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5b893678-3f57-4e06-b136-0de851289cc6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:30.720078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9df86726-2819-4753-92c0-36cb852b6b6c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:30.721394 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9df86726-2819-4753-92c0-36cb852b6b6c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:30.726597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5b893678-3f57-4e06-b136-0de851289cc6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:30.731231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5b893678-3f57-4e06-b136-0de851289cc6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:30.733702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5b893678-3f57-4e06-b136-0de851289cc6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:30.734807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5b893678-3f57-4e06-b136-0de851289cc6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:30.737949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9df86726-2819-4753-92c0-36cb852b6b6c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:30.738805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9df86726-2819-4753-92c0-36cb852b6b6c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:30.740609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9df86726-2819-4753-92c0-36cb852b6b6c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:30.741314 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9df86726-2819-4753-92c0-36cb852b6b6c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:31.211011 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5b893678-3f57-4e06-b136-0de851289cc6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:31.253440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9df86726-2819-4753-92c0-36cb852b6b6c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:31.265340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5b893678-3f57-4e06-b136-0de851289cc6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:31.267406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5b893678-3f57-4e06-b136-0de851289cc6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:31.269756 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9df86726-2819-4753-92c0-36cb852b6b6c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1321 microversion: 2.1 time: 0.555842 May 27 15:10:31.270362 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1638/3255] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:30 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1321 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:31.273228 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5b893678-3f57-4e06-b136-0de851289cc6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.580346 May 27 15:10:31.277200 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1618/3256] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:30 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:31.287061 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cf734c1d-7691-4265-b928-91484f4e84c2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:31.288132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cf734c1d-7691-4265-b928-91484f4e84c2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:31.292332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-66e52881-0ccf-4190-a8bf-d54af1280787 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:31.293406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-66e52881-0ccf-4190-a8bf-d54af1280787 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:31.334258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66e52881-0ccf-4190-a8bf-d54af1280787 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:31.334542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cf734c1d-7691-4265-b928-91484f4e84c2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:31.335372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cf734c1d-7691-4265-b928-91484f4e84c2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:31.336578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66e52881-0ccf-4190-a8bf-d54af1280787 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:31.339109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cf734c1d-7691-4265-b928-91484f4e84c2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:31.340213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66e52881-0ccf-4190-a8bf-d54af1280787 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:31.343039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66e52881-0ccf-4190-a8bf-d54af1280787 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:31.343349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cf734c1d-7691-4265-b928-91484f4e84c2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:32.020621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-66e52881-0ccf-4190-a8bf-d54af1280787 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:32.031084 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-66e52881-0ccf-4190-a8bf-d54af1280787 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1293 microversion: 2.1 time: 0.752646 May 27 15:10:32.031899 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1619/3257] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:31 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1293 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:32.042620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5bd9985d-f9f6-4bfd-92fa-300bc21a72fb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:32.045767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5bd9985d-f9f6-4bfd-92fa-300bc21a72fb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:32.056840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5bd9985d-f9f6-4bfd-92fa-300bc21a72fb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:32.057590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5bd9985d-f9f6-4bfd-92fa-300bc21a72fb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:32.058459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5bd9985d-f9f6-4bfd-92fa-300bc21a72fb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:32.058913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5bd9985d-f9f6-4bfd-92fa-300bc21a72fb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:32.065337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:32.084725 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cf734c1d-7691-4265-b928-91484f4e84c2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:32.095763 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cf734c1d-7691-4265-b928-91484f4e84c2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.824337 May 27 15:10:32.106483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5bd9985d-f9f6-4bfd-92fa-300bc21a72fb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:32.106483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5bd9985d-f9f6-4bfd-92fa-300bc21a72fb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:32.106483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-5bd9985d-f9f6-4bfd-92fa-300bc21a72fb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lazy-loading 'fault' on Instance uuid a29b1804-7072-488e-ba2d-5726d65fee2f {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:10:32.110925 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1639/3258] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:31 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:32.115609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-5ba9a3da-d63f-4b0a-baf9-2f5295e49e90 req-f72ae760-8ab1-4998-95ad-992726a3bf43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5803f6c5-8f5f-400f-b2c3-20c393b5f72c", "name": "network-vif-plugged", "status": "completed", "tag": "e5616912-9373-4b2e-ac8b-c7479952656c"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:32.140290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-5ba9a3da-d63f-4b0a-baf9-2f5295e49e90 req-f72ae760-8ab1-4998-95ad-992726a3bf43 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:32.141195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-5ba9a3da-d63f-4b0a-baf9-2f5295e49e90 req-f72ae760-8ab1-4998-95ad-992726a3bf43 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:32.157531 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-5ba9a3da-d63f-4b0a-baf9-2f5295e49e90 req-f72ae760-8ab1-4998-95ad-992726a3bf43 service nova] Creating event network-vif-plugged:e5616912-9373-4b2e-ac8b-c7479952656c for instance 5803f6c5-8f5f-400f-b2c3-20c393b5f72c on n-h2-843621-1 May 27 15:10:32.166538 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-5ba9a3da-d63f-4b0a-baf9-2f5295e49e90 req-f72ae760-8ab1-4998-95ad-992726a3bf43 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053676 May 27 15:10:32.167747 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1640/3259] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:32.186457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5bd9985d-f9f6-4bfd-92fa-300bc21a72fb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55944b29f3ba44d8b08ae71ce65be230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e59220c154dcda54532c0b3606f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:32.202592 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5bd9985d-f9f6-4bfd-92fa-300bc21a72fb tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 200 len: 1307 microversion: 2.1 time: 0.159414 May 27 15:10:32.203636 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1620/3260] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:32 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 1307 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:32.303714 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ea23395b-dd97-49d5-b9fa-b5c0e81b9a7e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:32.305065 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-788d24dd-fd87-4faa-8b46-ee03049392b3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:32.306317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-788d24dd-fd87-4faa-8b46-ee03049392b3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:32.307517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ea23395b-dd97-49d5-b9fa-b5c0e81b9a7e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:32.339879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea23395b-dd97-49d5-b9fa-b5c0e81b9a7e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:32.341034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-788d24dd-fd87-4faa-8b46-ee03049392b3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:32.341757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-788d24dd-fd87-4faa-8b46-ee03049392b3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:32.343940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea23395b-dd97-49d5-b9fa-b5c0e81b9a7e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:32.344930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-788d24dd-fd87-4faa-8b46-ee03049392b3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:32.345657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-788d24dd-fd87-4faa-8b46-ee03049392b3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:32.346788 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea23395b-dd97-49d5-b9fa-b5c0e81b9a7e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:32.351900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea23395b-dd97-49d5-b9fa-b5c0e81b9a7e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:32.693776 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ea23395b-dd97-49d5-b9fa-b5c0e81b9a7e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:32.709102 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ea23395b-dd97-49d5-b9fa-b5c0e81b9a7e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1321 microversion: 2.1 time: 0.416255 May 27 15:10:32.719574 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1641/3261] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:32 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1321 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:10:32.735273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-316d3507-6390-4ed9-899f-8703f291aa33 req-28834e5d-082c-4e60-b444-8e0486948832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "tag": "100b1a63-83ab-408e-adb6-ce5865974f8f"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:32.777502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-316d3507-6390-4ed9-899f-8703f291aa33 req-28834e5d-082c-4e60-b444-8e0486948832 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:32.777960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-316d3507-6390-4ed9-899f-8703f291aa33 req-28834e5d-082c-4e60-b444-8e0486948832 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:32.813603 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-316d3507-6390-4ed9-899f-8703f291aa33 req-28834e5d-082c-4e60-b444-8e0486948832 service nova] Creating event network-changed:100b1a63-83ab-408e-adb6-ce5865974f8f for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:10:32.823772 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-316d3507-6390-4ed9-899f-8703f291aa33 req-28834e5d-082c-4e60-b444-8e0486948832 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094723 May 27 15:10:32.824401 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1642/3262] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:32.836009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-788d24dd-fd87-4faa-8b46-ee03049392b3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:32.847643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-788d24dd-fd87-4faa-8b46-ee03049392b3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:32.849724 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-788d24dd-fd87-4faa-8b46-ee03049392b3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:32.851774 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-788d24dd-fd87-4faa-8b46-ee03049392b3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.554596 May 27 15:10:32.864902 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1621/3263] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:32 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:10:33.050234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-52702c54-cc86-4b30-ba39-9fc54d434d45 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:33.051106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-52702c54-cc86-4b30-ba39-9fc54d434d45 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:33.062976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-52702c54-cc86-4b30-ba39-9fc54d434d45 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:33.065273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-52702c54-cc86-4b30-ba39-9fc54d434d45 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:33.066360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-52702c54-cc86-4b30-ba39-9fc54d434d45 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:33.067953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-52702c54-cc86-4b30-ba39-9fc54d434d45 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:33.114597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a73c0bad-4d94-4887-98e8-f0cd4f025689 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:33.115529 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a73c0bad-4d94-4887-98e8-f0cd4f025689 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:33.126115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a73c0bad-4d94-4887-98e8-f0cd4f025689 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:33.129675 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a73c0bad-4d94-4887-98e8-f0cd4f025689 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:33.132592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a73c0bad-4d94-4887-98e8-f0cd4f025689 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:33.133292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a73c0bad-4d94-4887-98e8-f0cd4f025689 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:33.506154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-52702c54-cc86-4b30-ba39-9fc54d434d45 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:33.521965 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-52702c54-cc86-4b30-ba39-9fc54d434d45 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1293 microversion: 2.1 time: 0.476471 May 27 15:10:33.525255 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1643/3264] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:33 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1293 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:33.538791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a968ee4e-6a5f-428e-b8f7-952bda40d2f5 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:33.543315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a968ee4e-6a5f-428e-b8f7-952bda40d2f5 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: a29b1804-7072-488e-ba2d-5726d65fee2f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:33.547800 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a73c0bad-4d94-4887-98e8-f0cd4f025689 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:33.566106 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a73c0bad-4d94-4887-98e8-f0cd4f025689 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.455658 May 27 15:10:33.566986 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1622/3265] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:33 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:33.572685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a968ee4e-6a5f-428e-b8f7-952bda40d2f5 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:33.572685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a968ee4e-6a5f-428e-b8f7-952bda40d2f5 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:33.573494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a968ee4e-6a5f-428e-b8f7-952bda40d2f5 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:33.574038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a968ee4e-6a5f-428e-b8f7-952bda40d2f5 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:33.597623 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-a968ee4e-6a5f-428e-b8f7-952bda40d2f5 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] HTTP exception thrown: Instance a29b1804-7072-488e-ba2d-5726d65fee2f could not be found. May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a968ee4e-6a5f-428e-b8f7-952bda40d2f5 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Request method failure captured: May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f HTTP/1.1 May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOkyBBz8C7HrLJu0oUMnkNASpg6UGBVQvSW39O3pWRwbFBg6Ls_K1tidQlDb4J_PEKzDxvmXKA-EySAPq9S6HmyuiqxBGwDVHDYwQhy0T1VChqZAlL8Q1gYyuhha0ZT95zbzNzByQ1DDxFkr6yA5l965EjlhtaklGGLcGgpLac_9NUU May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 628e59220c154dcda54532c0b3606f2b May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1150251928 May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/628e59220c154dcda54532c0b3606f2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/628e59220c154dcda54532c0b3606f2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/628e59220c154dcda54532c0b3606f2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_628e59220c154dcda54532c0b3606f2b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerDiskConfigTestJSON-1150251928 May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 628e59220c154dcda54532c0b3606f2b May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1150251928 May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerDiskConfigTestJSON-1150251928-project May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 55944b29f3ba44d8b08ae71ce65be230 May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerDiskConfigTestJSON-1150251928-project May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance a29b1804-7072-488e-ba2d-5726d65fee2f could not be found. May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'a29b1804-7072-488e-ba2d-5726d65fee2f'} May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a29b1804-7072-488e-ba2d-5726d65fee2f could not be found. May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a29b1804-7072-488e-ba2d-5726d65fee2f could not be found. May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:33.602210 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:33.607416 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:33.607416 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:33.607416 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:33.607416 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:10:33.607416 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:10:33.607416 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a29b1804-7072-488e-ba2d-5726d65fee2f could not be found. May 27 15:10:33.607416 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:33.610247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a968ee4e-6a5f-428e-b8f7-952bda40d2f5 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Returning 404 to user: Instance a29b1804-7072-488e-ba2d-5726d65fee2f could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:10:33.611234 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a968ee4e-6a5f-428e-b8f7-952bda40d2f5 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f" status: 404 len: 111 microversion: 2.1 time: 0.084667 May 27 15:10:33.612126 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1644/3266] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:33 2022] GET /compute/v2.1/servers/a29b1804-7072-488e-ba2d-5726d65fee2f => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:10:33.620972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a937fa8a-9f63-4221-ae95-57a82ceb043e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:33.621710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a937fa8a-9f63-4221-ae95-57a82ceb043e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:33.633406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a937fa8a-9f63-4221-ae95-57a82ceb043e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:33.634506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a937fa8a-9f63-4221-ae95-57a82ceb043e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:33.645466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a937fa8a-9f63-4221-ae95-57a82ceb043e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:33.646048 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a937fa8a-9f63-4221-ae95-57a82ceb043e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:33.681751 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-a937fa8a-9f63-4221-ae95-57a82ceb043e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] HTTP exception thrown: Instance 3996f065-a4c2-40b5-9189-8fe1334f1d18 could not be found. May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a937fa8a-9f63-4221-ae95-57a82ceb043e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Request method failure captured: May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 HTTP/1.1 May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOkyBBz8C7HrLJu0oUMnkNASpg6UGBVQvSW39O3pWRwbFBg6Ls_K1tidQlDb4J_PEKzDxvmXKA-EySAPq9S6HmyuiqxBGwDVHDYwQhy0T1VChqZAlL8Q1gYyuhha0ZT95zbzNzByQ1DDxFkr6yA5l965EjlhtaklGGLcGgpLac_9NUU May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 628e59220c154dcda54532c0b3606f2b May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1150251928 May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/628e59220c154dcda54532c0b3606f2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/628e59220c154dcda54532c0b3606f2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/628e59220c154dcda54532c0b3606f2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_628e59220c154dcda54532c0b3606f2b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerDiskConfigTestJSON-1150251928 May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 628e59220c154dcda54532c0b3606f2b May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1150251928 May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerDiskConfigTestJSON-1150251928-project May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 55944b29f3ba44d8b08ae71ce65be230 May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerDiskConfigTestJSON-1150251928-project May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 3996f065-a4c2-40b5-9189-8fe1334f1d18 could not be found. May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '3996f065-a4c2-40b5-9189-8fe1334f1d18'} May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3996f065-a4c2-40b5-9189-8fe1334f1d18 could not be found. May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:10:33.687977 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:10:33.692721 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3996f065-a4c2-40b5-9189-8fe1334f1d18 could not be found. May 27 15:10:33.692721 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:33.692721 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:33.692721 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:33.692721 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:33.692721 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:33.692721 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:33.692721 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:10:33.692721 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:10:33.692721 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3996f065-a4c2-40b5-9189-8fe1334f1d18 could not be found. May 27 15:10:33.692721 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:33.696493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a937fa8a-9f63-4221-ae95-57a82ceb043e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Returning 404 to user: Instance 3996f065-a4c2-40b5-9189-8fe1334f1d18 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:10:33.698393 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a937fa8a-9f63-4221-ae95-57a82ceb043e tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 404 len: 111 microversion: 2.1 time: 0.082191 May 27 15:10:33.703623 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1623/3267] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:10:33 2022] DELETE /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:10:33.711921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-760c7049-bdfc-4074-a57c-0007312d0a9c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:33.713382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-760c7049-bdfc-4074-a57c-0007312d0a9c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 3996f065-a4c2-40b5-9189-8fe1334f1d18] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:33.725768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-760c7049-bdfc-4074-a57c-0007312d0a9c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:33.726626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-760c7049-bdfc-4074-a57c-0007312d0a9c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:33.728341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-760c7049-bdfc-4074-a57c-0007312d0a9c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:33.729107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-760c7049-bdfc-4074-a57c-0007312d0a9c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:33.731029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b35eac60-1fde-4264-8dae-a04ed2f9194c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:33.731680 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b35eac60-1fde-4264-8dae-a04ed2f9194c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:33.746851 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b35eac60-1fde-4264-8dae-a04ed2f9194c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:33.747303 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-760c7049-bdfc-4074-a57c-0007312d0a9c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] HTTP exception thrown: Instance 3996f065-a4c2-40b5-9189-8fe1334f1d18 could not be found. May 27 15:10:33.747421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b35eac60-1fde-4264-8dae-a04ed2f9194c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:33.748103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b35eac60-1fde-4264-8dae-a04ed2f9194c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-760c7049-bdfc-4074-a57c-0007312d0a9c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Request method failure captured: May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 HTTP/1.1 May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOkyBBz8C7HrLJu0oUMnkNASpg6UGBVQvSW39O3pWRwbFBg6Ls_K1tidQlDb4J_PEKzDxvmXKA-EySAPq9S6HmyuiqxBGwDVHDYwQhy0T1VChqZAlL8Q1gYyuhha0ZT95zbzNzByQ1DDxFkr6yA5l965EjlhtaklGGLcGgpLac_9NUU May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 628e59220c154dcda54532c0b3606f2b May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1150251928 May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/628e59220c154dcda54532c0b3606f2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/628e59220c154dcda54532c0b3606f2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/628e59220c154dcda54532c0b3606f2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_628e59220c154dcda54532c0b3606f2b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerDiskConfigTestJSON-1150251928 May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 628e59220c154dcda54532c0b3606f2b May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1150251928 May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerDiskConfigTestJSON-1150251928-project May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 55944b29f3ba44d8b08ae71ce65be230 May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerDiskConfigTestJSON-1150251928-project May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 3996f065-a4c2-40b5-9189-8fe1334f1d18 could not be found. May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '3996f065-a4c2-40b5-9189-8fe1334f1d18'} May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3996f065-a4c2-40b5-9189-8fe1334f1d18 could not be found. May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3996f065-a4c2-40b5-9189-8fe1334f1d18 could not be found. May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:33.750121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:33.755971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:33.755971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:33.755971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:33.755971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:10:33.755971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:10:33.755971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3996f065-a4c2-40b5-9189-8fe1334f1d18 could not be found. May 27 15:10:33.755971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:33.756391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b35eac60-1fde-4264-8dae-a04ed2f9194c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:33.758921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-760c7049-bdfc-4074-a57c-0007312d0a9c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Returning 404 to user: Instance 3996f065-a4c2-40b5-9189-8fe1334f1d18 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:10:33.760197 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-760c7049-bdfc-4074-a57c-0007312d0a9c tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18" status: 404 len: 111 microversion: 2.1 time: 0.052264 May 27 15:10:33.761272 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1645/3268] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:33 2022] GET /compute/v2.1/servers/3996f065-a4c2-40b5-9189-8fe1334f1d18 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:10:33.769327 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee1d0d19-4dea-49a1-9f31-ce814cb85b18 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:33.770237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ee1d0d19-4dea-49a1-9f31-ce814cb85b18 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:33.778534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee1d0d19-4dea-49a1-9f31-ce814cb85b18 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:33.779363 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee1d0d19-4dea-49a1-9f31-ce814cb85b18 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:33.780409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee1d0d19-4dea-49a1-9f31-ce814cb85b18 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:33.781317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee1d0d19-4dea-49a1-9f31-ce814cb85b18 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:33.798693 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-ee1d0d19-4dea-49a1-9f31-ce814cb85b18 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] HTTP exception thrown: Instance 7a59f3b5-daec-44ac-886e-2112ff3c8675 could not be found. May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee1d0d19-4dea-49a1-9f31-ce814cb85b18 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Request method failure captured: May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 HTTP/1.1 May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOkyBBz8C7HrLJu0oUMnkNASpg6UGBVQvSW39O3pWRwbFBg6Ls_K1tidQlDb4J_PEKzDxvmXKA-EySAPq9S6HmyuiqxBGwDVHDYwQhy0T1VChqZAlL8Q1gYyuhha0ZT95zbzNzByQ1DDxFkr6yA5l965EjlhtaklGGLcGgpLac_9NUU May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 628e59220c154dcda54532c0b3606f2b May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1150251928 May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/628e59220c154dcda54532c0b3606f2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/628e59220c154dcda54532c0b3606f2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/628e59220c154dcda54532c0b3606f2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_628e59220c154dcda54532c0b3606f2b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerDiskConfigTestJSON-1150251928 May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 628e59220c154dcda54532c0b3606f2b May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1150251928 May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerDiskConfigTestJSON-1150251928-project May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 55944b29f3ba44d8b08ae71ce65be230 May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerDiskConfigTestJSON-1150251928-project May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 7a59f3b5-daec-44ac-886e-2112ff3c8675 could not be found. May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '7a59f3b5-daec-44ac-886e-2112ff3c8675'} May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a59f3b5-daec-44ac-886e-2112ff3c8675 could not be found. May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:10:33.800718 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:10:33.804384 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a59f3b5-daec-44ac-886e-2112ff3c8675 could not be found. May 27 15:10:33.804384 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:33.804384 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:33.804384 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:33.804384 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:33.804384 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:33.804384 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:33.804384 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:10:33.804384 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:10:33.804384 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a59f3b5-daec-44ac-886e-2112ff3c8675 could not be found. May 27 15:10:33.804384 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:33.807413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee1d0d19-4dea-49a1-9f31-ce814cb85b18 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Returning 404 to user: Instance 7a59f3b5-daec-44ac-886e-2112ff3c8675 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:10:33.809255 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ee1d0d19-4dea-49a1-9f31-ce814cb85b18 tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 404 len: 111 microversion: 2.1 time: 0.043998 May 27 15:10:33.810324 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1646/3269] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:10:33 2022] DELETE /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:10:33.820576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7cb6201f-c1c8-45d6-9885-70a68921014d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:33.825582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7cb6201f-c1c8-45d6-9885-70a68921014d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] [instance: 7a59f3b5-daec-44ac-886e-2112ff3c8675] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:33.843057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7cb6201f-c1c8-45d6-9885-70a68921014d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:33.843438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7cb6201f-c1c8-45d6-9885-70a68921014d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:33.844224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7cb6201f-c1c8-45d6-9885-70a68921014d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:33.844912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7cb6201f-c1c8-45d6-9885-70a68921014d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:33.871888 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-7cb6201f-c1c8-45d6-9885-70a68921014d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] HTTP exception thrown: Instance 7a59f3b5-daec-44ac-886e-2112ff3c8675 could not be found. May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7cb6201f-c1c8-45d6-9885-70a68921014d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Request method failure captured: May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 HTTP/1.1 May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOkyBBz8C7HrLJu0oUMnkNASpg6UGBVQvSW39O3pWRwbFBg6Ls_K1tidQlDb4J_PEKzDxvmXKA-EySAPq9S6HmyuiqxBGwDVHDYwQhy0T1VChqZAlL8Q1gYyuhha0ZT95zbzNzByQ1DDxFkr6yA5l965EjlhtaklGGLcGgpLac_9NUU May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 628e59220c154dcda54532c0b3606f2b May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1150251928 May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/628e59220c154dcda54532c0b3606f2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/628e59220c154dcda54532c0b3606f2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/628e59220c154dcda54532c0b3606f2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_628e59220c154dcda54532c0b3606f2b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerDiskConfigTestJSON-1150251928 May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 628e59220c154dcda54532c0b3606f2b May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1150251928 May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerDiskConfigTestJSON-1150251928-project May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 55944b29f3ba44d8b08ae71ce65be230 May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerDiskConfigTestJSON-1150251928-project May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 7a59f3b5-daec-44ac-886e-2112ff3c8675 could not be found. May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '7a59f3b5-daec-44ac-886e-2112ff3c8675'} May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a59f3b5-daec-44ac-886e-2112ff3c8675 could not be found. May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a59f3b5-daec-44ac-886e-2112ff3c8675 could not be found. May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:33.873401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:33.878820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:33.878820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:33.878820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:33.878820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:10:33.878820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:10:33.878820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a59f3b5-daec-44ac-886e-2112ff3c8675 could not be found. May 27 15:10:33.878820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:33.878820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7cb6201f-c1c8-45d6-9885-70a68921014d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] Returning 404 to user: Instance 7a59f3b5-daec-44ac-886e-2112ff3c8675 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:10:33.878820 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7cb6201f-c1c8-45d6-9885-70a68921014d tempest-ServerDiskConfigTestJSON-1150251928 tempest-ServerDiskConfigTestJSON-1150251928-project] 10.222.0.13 "GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675" status: 404 len: 111 microversion: 2.1 time: 0.058240 May 27 15:10:33.888777 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1647/3270] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:33 2022] GET /compute/v2.1/servers/7a59f3b5-daec-44ac-886e-2112ff3c8675 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:10:33.913822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-17ad871a-4ba7-43ba-8f62-00f2a98073b7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:33.914468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-17ad871a-4ba7-43ba-8f62-00f2a98073b7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:33.921913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-17ad871a-4ba7-43ba-8f62-00f2a98073b7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:33.922369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-17ad871a-4ba7-43ba-8f62-00f2a98073b7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:33.923156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-17ad871a-4ba7-43ba-8f62-00f2a98073b7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:33.923906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-17ad871a-4ba7-43ba-8f62-00f2a98073b7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:34.061535 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b35eac60-1fde-4264-8dae-a04ed2f9194c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:34.079083 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b35eac60-1fde-4264-8dae-a04ed2f9194c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1321 microversion: 2.1 time: 0.353181 May 27 15:10:34.082276 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1624/3271] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:33 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:34.445455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-17ad871a-4ba7-43ba-8f62-00f2a98073b7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:34.470754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-17ad871a-4ba7-43ba-8f62-00f2a98073b7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:34.472453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-17ad871a-4ba7-43ba-8f62-00f2a98073b7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:34.473949 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-17ad871a-4ba7-43ba-8f62-00f2a98073b7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.584097 May 27 15:10:34.477243 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1648/3272] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:33 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:34.540325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7b908390-d67f-415b-a8c9-5a82f5dd4937 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:34.541634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7b908390-d67f-415b-a8c9-5a82f5dd4937 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:34.554411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b908390-d67f-415b-a8c9-5a82f5dd4937 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:34.555117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b908390-d67f-415b-a8c9-5a82f5dd4937 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:34.555645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b908390-d67f-415b-a8c9-5a82f5dd4937 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:34.565674 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b908390-d67f-415b-a8c9-5a82f5dd4937 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:34.583781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-22c58680-caac-4bea-851d-dfce00d419d0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:34.584843 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-22c58680-caac-4bea-851d-dfce00d419d0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:34.621431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22c58680-caac-4bea-851d-dfce00d419d0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:34.621911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22c58680-caac-4bea-851d-dfce00d419d0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:34.622765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22c58680-caac-4bea-851d-dfce00d419d0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:34.628749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22c58680-caac-4bea-851d-dfce00d419d0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:35.242057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7b908390-d67f-415b-a8c9-5a82f5dd4937 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:35.267768 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7b908390-d67f-415b-a8c9-5a82f5dd4937 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1483 microversion: 2.1 time: 0.731523 May 27 15:10:35.286162 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1625/3273] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:34 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1483 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:35.313050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-53f11a8e-17ca-4d16-bb8b-06b3481a9c7b req-039a5b9f-c08c-4877-b6ac-7be9098c6186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "tag": "5befacb8-cfec-4bf9-a56e-4875b8d292ad"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:35.344615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-53f11a8e-17ca-4d16-bb8b-06b3481a9c7b req-039a5b9f-c08c-4877-b6ac-7be9098c6186 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:35.345645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-53f11a8e-17ca-4d16-bb8b-06b3481a9c7b req-039a5b9f-c08c-4877-b6ac-7be9098c6186 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:35.373283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-22c58680-caac-4bea-851d-dfce00d419d0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:35.381755 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-22c58680-caac-4bea-851d-dfce00d419d0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.802202 May 27 15:10:35.386337 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1649/3274] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:34 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:10:35.395025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-82ed0946-0cb3-4fbd-9f06-9af4613d7ea4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:35.409732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-82ed0946-0cb3-4fbd-9f06-9af4613d7ea4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:35.413173 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-53f11a8e-17ca-4d16-bb8b-06b3481a9c7b req-039a5b9f-c08c-4877-b6ac-7be9098c6186 service nova] Creating event network-changed:5befacb8-cfec-4bf9-a56e-4875b8d292ad for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:10:35.443159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82ed0946-0cb3-4fbd-9f06-9af4613d7ea4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:35.450090 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-53f11a8e-17ca-4d16-bb8b-06b3481a9c7b req-039a5b9f-c08c-4877-b6ac-7be9098c6186 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161891 May 27 15:10:35.454669 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1626/3275] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:35.456407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82ed0946-0cb3-4fbd-9f06-9af4613d7ea4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:35.466637 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82ed0946-0cb3-4fbd-9f06-9af4613d7ea4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:35.468919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82ed0946-0cb3-4fbd-9f06-9af4613d7ea4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:35.484515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-775fe1ef-6047-480c-9814-c37b9ac63b50 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:35.487662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-775fe1ef-6047-480c-9814-c37b9ac63b50 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:35.512365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-775fe1ef-6047-480c-9814-c37b9ac63b50 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:35.521168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-775fe1ef-6047-480c-9814-c37b9ac63b50 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:35.522489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-775fe1ef-6047-480c-9814-c37b9ac63b50 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:35.523367 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-775fe1ef-6047-480c-9814-c37b9ac63b50 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:35.812710 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-775fe1ef-6047-480c-9814-c37b9ac63b50 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.350507 May 27 15:10:35.813602 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1627/3276] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 15:10:35 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c/os-interface => generated 284 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:35.825514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cc59dd5f-8616-4594-b69e-a6c0882a5945 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:35.826963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cc59dd5f-8616-4594-b69e-a6c0882a5945 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:35.851215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc59dd5f-8616-4594-b69e-a6c0882a5945 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:35.851898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc59dd5f-8616-4594-b69e-a6c0882a5945 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:35.853143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc59dd5f-8616-4594-b69e-a6c0882a5945 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:35.853758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc59dd5f-8616-4594-b69e-a6c0882a5945 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:36.121000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-82ed0946-0cb3-4fbd-9f06-9af4613d7ea4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:36.136039 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-82ed0946-0cb3-4fbd-9f06-9af4613d7ea4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1321 microversion: 2.1 time: 0.748250 May 27 15:10:36.148027 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1650/3277] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:35 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1321 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:36.148027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-41c40cf3-4238-48bd-84e6-17c24481b358 req-2b419602-ba2c-4af1-ad3f-6e35327a96ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc393fb-711a-436a-8a25-c84ee30e8f3e", "name": "network-vif-plugged", "status": "completed", "tag": "98d574eb-93db-43b7-be0c-c41276934647"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:36.171285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-41c40cf3-4238-48bd-84e6-17c24481b358 req-2b419602-ba2c-4af1-ad3f-6e35327a96ed service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:36.172100 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-41c40cf3-4238-48bd-84e6-17c24481b358 req-2b419602-ba2c-4af1-ad3f-6e35327a96ed service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:36.200135 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-41c40cf3-4238-48bd-84e6-17c24481b358 req-2b419602-ba2c-4af1-ad3f-6e35327a96ed service nova] Creating event network-vif-plugged:98d574eb-93db-43b7-be0c-c41276934647 for instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e on n-h1-843621-1 May 27 15:10:36.220144 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-41c40cf3-4238-48bd-84e6-17c24481b358 req-2b419602-ba2c-4af1-ad3f-6e35327a96ed service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077901 May 27 15:10:36.224492 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1651/3278] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:36.404012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eedd0073-e43a-4ea5-9031-ae6744d94b91 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:36.404968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-eedd0073-e43a-4ea5-9031-ae6744d94b91 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:36.416705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cc59dd5f-8616-4594-b69e-a6c0882a5945 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:36.425505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eedd0073-e43a-4ea5-9031-ae6744d94b91 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:36.427908 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eedd0073-e43a-4ea5-9031-ae6744d94b91 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:36.429209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eedd0073-e43a-4ea5-9031-ae6744d94b91 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:36.431890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eedd0073-e43a-4ea5-9031-ae6744d94b91 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:36.434826 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cc59dd5f-8616-4594-b69e-a6c0882a5945 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:36.439151 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cc59dd5f-8616-4594-b69e-a6c0882a5945 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:36.443171 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cc59dd5f-8616-4594-b69e-a6c0882a5945 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.622485 May 27 15:10:36.461552 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1628/3279] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:35 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:36.661780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eedd0073-e43a-4ea5-9031-ae6744d94b91 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:36.689802 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-eedd0073-e43a-4ea5-9031-ae6744d94b91 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.290199 May 27 15:10:36.693447 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1652/3280] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:36 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:37.157762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0882d6b5-3987-474f-b1f2-ff5906494e9c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:37.159133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0882d6b5-3987-474f-b1f2-ff5906494e9c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:37.174979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0882d6b5-3987-474f-b1f2-ff5906494e9c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:37.176477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0882d6b5-3987-474f-b1f2-ff5906494e9c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:37.185071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0882d6b5-3987-474f-b1f2-ff5906494e9c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:37.186058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0882d6b5-3987-474f-b1f2-ff5906494e9c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:37.465510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-543fc812-06f4-466c-9abd-3bc375d78590 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:37.466710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-543fc812-06f4-466c-9abd-3bc375d78590 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:37.476736 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-543fc812-06f4-466c-9abd-3bc375d78590 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:37.481245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-543fc812-06f4-466c-9abd-3bc375d78590 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:37.483135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-543fc812-06f4-466c-9abd-3bc375d78590 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:37.484012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-543fc812-06f4-466c-9abd-3bc375d78590 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:37.487186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0882d6b5-3987-474f-b1f2-ff5906494e9c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:37.498440 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0882d6b5-3987-474f-b1f2-ff5906494e9c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1321 microversion: 2.1 time: 0.345806 May 27 15:10:37.506788 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1629/3281] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:37 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1321 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:37.710716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3efc6dab-56b6-4804-9248-2927cec873a5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:37.711435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3efc6dab-56b6-4804-9248-2927cec873a5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:37.721743 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3efc6dab-56b6-4804-9248-2927cec873a5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:37.724692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3efc6dab-56b6-4804-9248-2927cec873a5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:37.729728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3efc6dab-56b6-4804-9248-2927cec873a5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:37.737745 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3efc6dab-56b6-4804-9248-2927cec873a5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:38.625274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3efc6dab-56b6-4804-9248-2927cec873a5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:38.641987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-543fc812-06f4-466c-9abd-3bc375d78590 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:38.644095 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3efc6dab-56b6-4804-9248-2927cec873a5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.937974 May 27 15:10:38.654564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-543fc812-06f4-466c-9abd-3bc375d78590 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:38.656261 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1630/3282] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:37 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:10:38.660963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-543fc812-06f4-466c-9abd-3bc375d78590 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:38.663269 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-543fc812-06f4-466c-9abd-3bc375d78590 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 1.202382 May 27 15:10:38.669369 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1653/3283] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:37 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:10:38.671211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-509bb053-5172-42d2-9084-98c6cfe146cf req-04916d5e-31b0-42a8-b045-baa785de390c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "tag": "93591aab-dea0-4a1e-9aaa-fc28351a76bf"}, {"name": "network-changed", "server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "tag": "4fae3a94-8715-4a88-a516-e2014c141251"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:38.684107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-88d2d24f-d5a0-4266-93ff-6ca6bb204128 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:38.692176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-88d2d24f-d5a0-4266-93ff-6ca6bb204128 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:38.696228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:38.700799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-509bb053-5172-42d2-9084-98c6cfe146cf req-04916d5e-31b0-42a8-b045-baa785de390c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:38.703937 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-509bb053-5172-42d2-9084-98c6cfe146cf req-04916d5e-31b0-42a8-b045-baa785de390c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:38.706101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88d2d24f-d5a0-4266-93ff-6ca6bb204128 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:38.709178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88d2d24f-d5a0-4266-93ff-6ca6bb204128 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:38.710119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88d2d24f-d5a0-4266-93ff-6ca6bb204128 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:38.715466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88d2d24f-d5a0-4266-93ff-6ca6bb204128 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:38.746111 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-509bb053-5172-42d2-9084-98c6cfe146cf req-04916d5e-31b0-42a8-b045-baa785de390c service nova] Creating event network-changed:93591aab-dea0-4a1e-9aaa-fc28351a76bf for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:10:38.747390 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-509bb053-5172-42d2-9084-98c6cfe146cf req-04916d5e-31b0-42a8-b045-baa785de390c service nova] Creating event network-changed:4fae3a94-8715-4a88-a516-e2014c141251 for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:10:38.783626 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-509bb053-5172-42d2-9084-98c6cfe146cf req-04916d5e-31b0-42a8-b045-baa785de390c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.120441 May 27 15:10:38.788547 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1631/3284] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:39.119105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-88d2d24f-d5a0-4266-93ff-6ca6bb204128 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:39.127751 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-88d2d24f-d5a0-4266-93ff-6ca6bb204128 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1321 microversion: 2.1 time: 0.456802 May 27 15:10:39.137512 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1654/3285] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:38 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1321 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:39.663062 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ac9042ac-943b-4250-841f-8d50e303a573 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:39.664414 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ac9042ac-943b-4250-841f-8d50e303a573 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:39.684067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac9042ac-943b-4250-841f-8d50e303a573 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:39.684814 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac9042ac-943b-4250-841f-8d50e303a573 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:39.685793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac9042ac-943b-4250-841f-8d50e303a573 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:39.686426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac9042ac-943b-4250-841f-8d50e303a573 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:39.688811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6af9e0c2-86f4-4b93-8b42-bbd62bbf623f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:39.689586 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6af9e0c2-86f4-4b93-8b42-bbd62bbf623f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:39.701246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6af9e0c2-86f4-4b93-8b42-bbd62bbf623f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:39.707116 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6af9e0c2-86f4-4b93-8b42-bbd62bbf623f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:39.708189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6af9e0c2-86f4-4b93-8b42-bbd62bbf623f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:39.708823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6af9e0c2-86f4-4b93-8b42-bbd62bbf623f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:39.751915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:41.179810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ac9042ac-943b-4250-841f-8d50e303a573 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:41.186726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6af9e0c2-86f4-4b93-8b42-bbd62bbf623f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:41.196198 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ac9042ac-943b-4250-841f-8d50e303a573 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 1.538086 May 27 15:10:41.198566 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1632/3286] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:39 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:41.201496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6af9e0c2-86f4-4b93-8b42-bbd62bbf623f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:41.203268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6af9e0c2-86f4-4b93-8b42-bbd62bbf623f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:41.204611 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6af9e0c2-86f4-4b93-8b42-bbd62bbf623f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 1.520433 May 27 15:10:41.205387 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1655/3287] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:39 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:10:41.211677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3c38d612-00ef-4ccb-9a3a-df935b7fea52 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:41.219348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3c38d612-00ef-4ccb-9a3a-df935b7fea52 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:41.225670 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d862a515-f3d9-4c1e-a12d-a8cc60fa4af3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:41.227873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d862a515-f3d9-4c1e-a12d-a8cc60fa4af3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:41.232747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c38d612-00ef-4ccb-9a3a-df935b7fea52 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:41.238730 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c38d612-00ef-4ccb-9a3a-df935b7fea52 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:41.239844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c38d612-00ef-4ccb-9a3a-df935b7fea52 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:41.240423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c38d612-00ef-4ccb-9a3a-df935b7fea52 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:41.263925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d862a515-f3d9-4c1e-a12d-a8cc60fa4af3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:41.264461 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d862a515-f3d9-4c1e-a12d-a8cc60fa4af3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:41.265326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d862a515-f3d9-4c1e-a12d-a8cc60fa4af3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:41.265789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d862a515-f3d9-4c1e-a12d-a8cc60fa4af3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:41.907142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d862a515-f3d9-4c1e-a12d-a8cc60fa4af3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:41.915825 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d862a515-f3d9-4c1e-a12d-a8cc60fa4af3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1515 microversion: 2.1 time: 0.702720 May 27 15:10:41.916411 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1633/3288] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:41 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1515 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:41.942774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-ef728b2d-29d2-4f9a-b9c3-8c8c91dc49d0 req-bd8eaebb-8214-40c9-84be-d8e5d8420d1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5803f6c5-8f5f-400f-b2c3-20c393b5f72c", "tag": "e5616912-9373-4b2e-ac8b-c7479952656c"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:41.958700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3c38d612-00ef-4ccb-9a3a-df935b7fea52 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:41.967155 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ef728b2d-29d2-4f9a-b9c3-8c8c91dc49d0 req-bd8eaebb-8214-40c9-84be-d8e5d8420d1e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:41.969565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ef728b2d-29d2-4f9a-b9c3-8c8c91dc49d0 req-bd8eaebb-8214-40c9-84be-d8e5d8420d1e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:41.974159 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3c38d612-00ef-4ccb-9a3a-df935b7fea52 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1483 microversion: 2.1 time: 0.760690 May 27 15:10:41.979982 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1656/3289] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:41 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1483 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:42.038271 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-ef728b2d-29d2-4f9a-b9c3-8c8c91dc49d0 req-bd8eaebb-8214-40c9-84be-d8e5d8420d1e service nova] Creating event network-changed:e5616912-9373-4b2e-ac8b-c7479952656c for instance 5803f6c5-8f5f-400f-b2c3-20c393b5f72c on n-h2-843621-1 May 27 15:10:42.047059 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-ef728b2d-29d2-4f9a-b9c3-8c8c91dc49d0 req-bd8eaebb-8214-40c9-84be-d8e5d8420d1e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108208 May 27 15:10:42.049774 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1634/3290] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:42.059958 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-05e3a755-396a-4a8e-b294-795daf77207b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:42.070376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-05e3a755-396a-4a8e-b294-795daf77207b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:42.084578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05e3a755-396a-4a8e-b294-795daf77207b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:42.085354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05e3a755-396a-4a8e-b294-795daf77207b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:42.087556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05e3a755-396a-4a8e-b294-795daf77207b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:42.091125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05e3a755-396a-4a8e-b294-795daf77207b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:42.147701 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-05e3a755-396a-4a8e-b294-795daf77207b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lazy-loading 'flavor' on Instance uuid 3bc393fb-711a-436a-8a25-c84ee30e8f3e {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:10:42.321729 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5da6d89a-bf6f-4a90-9b3a-f573d579f2fd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1666467428", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "7010264f-5a80-44ce-b4c5-d0d7dbe6983c"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:42.325107 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-05e3a755-396a-4a8e-b294-795daf77207b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "POST /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e/action" status: 200 len: 32 microversion: 2.1 time: 0.268698 May 27 15:10:42.331301 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1635/3291] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:10:42 2022] POST /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e/action => generated 32 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:10:42.368025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-195354d9-28e0-4d01-bea5-e6938a119b81 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:42.387129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-195354d9-28e0-4d01-bea5-e6938a119b81 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:42.410949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-195354d9-28e0-4d01-bea5-e6938a119b81 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:42.414528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-195354d9-28e0-4d01-bea5-e6938a119b81 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:42.421632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-195354d9-28e0-4d01-bea5-e6938a119b81 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:42.424564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-195354d9-28e0-4d01-bea5-e6938a119b81 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:42.438303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-5da6d89a-bf6f-4a90-9b3a-f573d579f2fd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] validate_networks() for [('7010264f-5a80-44ce-b4c5-d0d7dbe6983c', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:10:42.957321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-195354d9-28e0-4d01-bea5-e6938a119b81 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:42.968299 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-195354d9-28e0-4d01-bea5-e6938a119b81 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.634291 May 27 15:10:42.973286 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1636/3292] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:42 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:43.020777 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9d6f7bc5-bbee-4db7-b89c-39aa8154b006 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:43.021572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9d6f7bc5-bbee-4db7-b89c-39aa8154b006 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:43.047772 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d6f7bc5-bbee-4db7-b89c-39aa8154b006 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:43.048219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d6f7bc5-bbee-4db7-b89c-39aa8154b006 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:43.049233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d6f7bc5-bbee-4db7-b89c-39aa8154b006 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:43.051875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d6f7bc5-bbee-4db7-b89c-39aa8154b006 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:43.112715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:43.569205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-5da6d89a-bf6f-4a90-9b3a-f573d579f2fd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:10:43.569988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-5da6d89a-bf6f-4a90-9b3a-f573d579f2fd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:10:43.569988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-5da6d89a-bf6f-4a90-9b3a-f573d579f2fd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:10:43.570412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-5da6d89a-bf6f-4a90-9b3a-f573d579f2fd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:10:43.571022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-5da6d89a-bf6f-4a90-9b3a-f573d579f2fd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:10:43.588510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5da6d89a-bf6f-4a90-9b3a-f573d579f2fd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:43.592429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5da6d89a-bf6f-4a90-9b3a-f573d579f2fd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:43.593692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5da6d89a-bf6f-4a90-9b3a-f573d579f2fd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:43.599149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5da6d89a-bf6f-4a90-9b3a-f573d579f2fd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:43.627739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9d6f7bc5-bbee-4db7-b89c-39aa8154b006 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:43.644151 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9d6f7bc5-bbee-4db7-b89c-39aa8154b006 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:43.648871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9d6f7bc5-bbee-4db7-b89c-39aa8154b006 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:43.651662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-5da6d89a-bf6f-4a90-9b3a-f573d579f2fd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Getting quotas for project 5f1274817f784f12ba47ba885010ec42. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:10:43.653310 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9d6f7bc5-bbee-4db7-b89c-39aa8154b006 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.667759 May 27 15:10:43.655594 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1637/3293] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:42 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:43.679390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6d0bf98a-5700-4c52-a3b5-99489426f28a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:43.680483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-5da6d89a-bf6f-4a90-9b3a-f573d579f2fd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Getting quotas for user b158ef703c064e15aa33f3ceaad971a8 and project 5f1274817f784f12ba47ba885010ec42. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:10:43.683651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6d0bf98a-5700-4c52-a3b5-99489426f28a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:43.707624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d0bf98a-5700-4c52-a3b5-99489426f28a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:43.711366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d0bf98a-5700-4c52-a3b5-99489426f28a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:43.713339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d0bf98a-5700-4c52-a3b5-99489426f28a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:43.719242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d0bf98a-5700-4c52-a3b5-99489426f28a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:43.722302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5da6d89a-bf6f-4a90-9b3a-f573d579f2fd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:10:43.731390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5da6d89a-bf6f-4a90-9b3a-f573d579f2fd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:10:43.874493 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5da6d89a-bf6f-4a90-9b3a-f573d579f2fd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.892928 May 27 15:10:43.875168 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1657/3294] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:10:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:10:43.965007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ecba869c-6ade-4519-98af-2fd270e57294 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1941732414", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "7010264f-5a80-44ce-b4c5-d0d7dbe6983c"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:44.070084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-ecba869c-6ade-4519-98af-2fd270e57294 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] validate_networks() for [('7010264f-5a80-44ce-b4c5-d0d7dbe6983c', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:10:44.118116 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6d0bf98a-5700-4c52-a3b5-99489426f28a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:44.134498 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6d0bf98a-5700-4c52-a3b5-99489426f28a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.477021 May 27 15:10:44.135354 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1638/3295] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:43 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:44.149462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-583c9b2e-6c3c-4d3a-8f41-3bafda4b4cc5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:44.150400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-583c9b2e-6c3c-4d3a-8f41-3bafda4b4cc5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:44.158267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-583c9b2e-6c3c-4d3a-8f41-3bafda4b4cc5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:44.163975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-583c9b2e-6c3c-4d3a-8f41-3bafda4b4cc5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:44.165981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-583c9b2e-6c3c-4d3a-8f41-3bafda4b4cc5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:44.167060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-583c9b2e-6c3c-4d3a-8f41-3bafda4b4cc5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:44.914077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-583c9b2e-6c3c-4d3a-8f41-3bafda4b4cc5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:44.938060 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-583c9b2e-6c3c-4d3a-8f41-3bafda4b4cc5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.801301 May 27 15:10:44.945383 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1639/3296] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:44 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:44.951232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b19e4ab6-4a23-4a6b-b6fe-83e0a18ff630 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:44.970139 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b19e4ab6-4a23-4a6b-b6fe-83e0a18ff630 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:44.991570 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b19e4ab6-4a23-4a6b-b6fe-83e0a18ff630 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:44.992364 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b19e4ab6-4a23-4a6b-b6fe-83e0a18ff630 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:44.994462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b19e4ab6-4a23-4a6b-b6fe-83e0a18ff630 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:44.995136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b19e4ab6-4a23-4a6b-b6fe-83e0a18ff630 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:45.780378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b19e4ab6-4a23-4a6b-b6fe-83e0a18ff630 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:45.830413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b19e4ab6-4a23-4a6b-b6fe-83e0a18ff630 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:45.832026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b19e4ab6-4a23-4a6b-b6fe-83e0a18ff630 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:45.844114 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b19e4ab6-4a23-4a6b-b6fe-83e0a18ff630 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.896658 May 27 15:10:45.845455 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1640/3297] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:44 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:45.865781 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d9b722d1-fee3-4338-aa1b-bc5a4a9a01de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:45.868283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d9b722d1-fee3-4338-aa1b-bc5a4a9a01de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:45.891643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9b722d1-fee3-4338-aa1b-bc5a4a9a01de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:45.897444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9b722d1-fee3-4338-aa1b-bc5a4a9a01de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:45.901957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ecba869c-6ade-4519-98af-2fd270e57294 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:10:45.902897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ecba869c-6ade-4519-98af-2fd270e57294 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:10:45.903937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ecba869c-6ade-4519-98af-2fd270e57294 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:10:45.904514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ecba869c-6ade-4519-98af-2fd270e57294 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:10:45.905230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ecba869c-6ade-4519-98af-2fd270e57294 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:10:45.908755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9b722d1-fee3-4338-aa1b-bc5a4a9a01de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:45.912468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9b722d1-fee3-4338-aa1b-bc5a4a9a01de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:45.939918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ecba869c-6ade-4519-98af-2fd270e57294 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:45.946178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ecba869c-6ade-4519-98af-2fd270e57294 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:45.950255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ecba869c-6ade-4519-98af-2fd270e57294 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:45.965028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ecba869c-6ade-4519-98af-2fd270e57294 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:46.044226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-ecba869c-6ade-4519-98af-2fd270e57294 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Getting quotas for project 5f1274817f784f12ba47ba885010ec42. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:10:46.062963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-ecba869c-6ade-4519-98af-2fd270e57294 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Getting quotas for user b158ef703c064e15aa33f3ceaad971a8 and project 5f1274817f784f12ba47ba885010ec42. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:10:46.095697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ecba869c-6ade-4519-98af-2fd270e57294 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:10:46.098488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ecba869c-6ade-4519-98af-2fd270e57294 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:10:46.245906 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ecba869c-6ade-4519-98af-2fd270e57294 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.282843 May 27 15:10:46.249299 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1658/3298] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:10:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 15:10:46.264364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9061af8d-1577-471d-a34d-a5a1e3614755 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:46.265833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9061af8d-1577-471d-a34d-a5a1e3614755 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:46.294073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9061af8d-1577-471d-a34d-a5a1e3614755 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:46.294920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9061af8d-1577-471d-a34d-a5a1e3614755 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:46.297137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9061af8d-1577-471d-a34d-a5a1e3614755 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:46.298816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9061af8d-1577-471d-a34d-a5a1e3614755 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:46.372721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d9b722d1-fee3-4338-aa1b-bc5a4a9a01de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:46.405300 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d9b722d1-fee3-4338-aa1b-bc5a4a9a01de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.540573 May 27 15:10:46.406686 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1641/3299] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:45 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:46.419785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-279a3e12-a57a-4067-a589-89a358aff293 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1475094685", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "451", "networks": [{"uuid": "7010264f-5a80-44ce-b4c5-d0d7dbe6983c"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:46.554240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-279a3e12-a57a-4067-a589-89a358aff293 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] validate_networks() for [('7010264f-5a80-44ce-b4c5-d0d7dbe6983c', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:10:46.973251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9061af8d-1577-471d-a34d-a5a1e3614755 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:46.993005 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9061af8d-1577-471d-a34d-a5a1e3614755 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.740745 May 27 15:10:47.011556 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1659/3300] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:46 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:47.016729 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f8a85115-0158-43bf-baad-081ce9794fd5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:47.017367 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f8a85115-0158-43bf-baad-081ce9794fd5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:47.049434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8a85115-0158-43bf-baad-081ce9794fd5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:47.050299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8a85115-0158-43bf-baad-081ce9794fd5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:47.051336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8a85115-0158-43bf-baad-081ce9794fd5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:47.052975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8a85115-0158-43bf-baad-081ce9794fd5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:47.718848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f8a85115-0158-43bf-baad-081ce9794fd5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:47.732852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f8a85115-0158-43bf-baad-081ce9794fd5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:47.734900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f8a85115-0158-43bf-baad-081ce9794fd5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:47.740841 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f8a85115-0158-43bf-baad-081ce9794fd5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.725770 May 27 15:10:47.744777 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1660/3301] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:47 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:47.762946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-636b9b96-802b-41d9-9f71-f02c205253b4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:47.764039 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-636b9b96-802b-41d9-9f71-f02c205253b4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:47.781123 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-636b9b96-802b-41d9-9f71-f02c205253b4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:47.786803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-636b9b96-802b-41d9-9f71-f02c205253b4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:47.788420 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-279a3e12-a57a-4067-a589-89a358aff293 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:10:47.788917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-279a3e12-a57a-4067-a589-89a358aff293 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:10:47.789417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-279a3e12-a57a-4067-a589-89a358aff293 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:10:47.789928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-636b9b96-802b-41d9-9f71-f02c205253b4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:47.790307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-279a3e12-a57a-4067-a589-89a358aff293 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:10:47.790743 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-279a3e12-a57a-4067-a589-89a358aff293 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:10:47.791115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-636b9b96-802b-41d9-9f71-f02c205253b4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:47.807736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-279a3e12-a57a-4067-a589-89a358aff293 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:47.808198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-279a3e12-a57a-4067-a589-89a358aff293 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:47.809050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-279a3e12-a57a-4067-a589-89a358aff293 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:47.809499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-279a3e12-a57a-4067-a589-89a358aff293 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:47.886396 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-279a3e12-a57a-4067-a589-89a358aff293 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Getting quotas for project 5f1274817f784f12ba47ba885010ec42. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:10:47.912595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-279a3e12-a57a-4067-a589-89a358aff293 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Getting quotas for user b158ef703c064e15aa33f3ceaad971a8 and project 5f1274817f784f12ba47ba885010ec42. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:10:47.963251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-279a3e12-a57a-4067-a589-89a358aff293 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:10:47.965685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-279a3e12-a57a-4067-a589-89a358aff293 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:10:48.049584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-636b9b96-802b-41d9-9f71-f02c205253b4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:48.065432 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-636b9b96-802b-41d9-9f71-f02c205253b4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.318488 May 27 15:10:48.066360 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1661/3302] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:47 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:48.083807 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6567d78f-c09d-48a6-ae5a-b755f76c4144 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:48.085925 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6567d78f-c09d-48a6-ae5a-b755f76c4144 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:48.098753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6567d78f-c09d-48a6-ae5a-b755f76c4144 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:48.103508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6567d78f-c09d-48a6-ae5a-b755f76c4144 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:48.107531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6567d78f-c09d-48a6-ae5a-b755f76c4144 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:48.108288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6567d78f-c09d-48a6-ae5a-b755f76c4144 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:48.122671 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-279a3e12-a57a-4067-a589-89a358aff293 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.714571 May 27 15:10:48.128013 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1642/3303] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:10:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:10:48.142660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1e46e758-4214-4f9e-8a95-a0496b3ae4cf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:48.154936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1e46e758-4214-4f9e-8a95-a0496b3ae4cf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:48.469740 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1e46e758-4214-4f9e-8a95-a0496b3ae4cf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:48.482135 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1e46e758-4214-4f9e-8a95-a0496b3ae4cf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1221 microversion: 2.1 time: 0.349439 May 27 15:10:48.488991 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1643/3304] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:48 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1221 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:48.610796 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6567d78f-c09d-48a6-ae5a-b755f76c4144 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:48.630454 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6567d78f-c09d-48a6-ae5a-b755f76c4144 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.554770 May 27 15:10:48.633022 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1662/3305] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:48 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:48.766651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c9556a4d-b478-4e15-b602-b812da8f5964 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:48.767562 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c9556a4d-b478-4e15-b602-b812da8f5964 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:48.792966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9556a4d-b478-4e15-b602-b812da8f5964 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:48.793566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9556a4d-b478-4e15-b602-b812da8f5964 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:48.798726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9556a4d-b478-4e15-b602-b812da8f5964 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:48.799192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9556a4d-b478-4e15-b602-b812da8f5964 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:48.872564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0d3874f3-3d52-4c05-b8c7-249e20cabb4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:48.873108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0d3874f3-3d52-4c05-b8c7-249e20cabb4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:48.902106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0d3874f3-3d52-4c05-b8c7-249e20cabb4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:48.903132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0d3874f3-3d52-4c05-b8c7-249e20cabb4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:48.910906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0d3874f3-3d52-4c05-b8c7-249e20cabb4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:48.915995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0d3874f3-3d52-4c05-b8c7-249e20cabb4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:48.979878 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-0d3874f3-3d52-4c05-b8c7-249e20cabb4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0d3874f3-3d52-4c05-b8c7-249e20cabb4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 HTTP/1.1 May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '74741255-3451-4856-af14-5320fa7e2d76'} May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:10:48.987151 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:10:48.991539 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. May 27 15:10:48.991539 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:48.991539 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:48.991539 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:48.991539 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:48.991539 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:48.991539 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:48.991539 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:10:48.991539 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:10:48.991539 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. May 27 15:10:48.991539 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:48.991539 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0d3874f3-3d52-4c05-b8c7-249e20cabb4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:10:48.995532 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0d3874f3-3d52-4c05-b8c7-249e20cabb4b tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "DELETE /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 404 len: 111 microversion: 2.1 time: 0.127519 May 27 15:10:48.999366 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1663/3306] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:10:48 2022] DELETE /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:10:49.013045 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f6b2a16c-b185-46dc-8307-6599da350100 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:49.013878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f6b2a16c-b185-46dc-8307-6599da350100 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 74741255-3451-4856-af14-5320fa7e2d76] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:49.035174 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f6b2a16c-b185-46dc-8307-6599da350100 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:49.035651 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f6b2a16c-b185-46dc-8307-6599da350100 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:49.043349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f6b2a16c-b185-46dc-8307-6599da350100 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:49.045173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f6b2a16c-b185-46dc-8307-6599da350100 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:49.088332 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-f6b2a16c-b185-46dc-8307-6599da350100 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f6b2a16c-b185-46dc-8307-6599da350100 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 HTTP/1.1 May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '74741255-3451-4856-af14-5320fa7e2d76'} May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:49.092283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:49.097755 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:49.097755 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:49.097755 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:49.097755 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:10:49.097755 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:10:49.097755 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. May 27 15:10:49.097755 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:49.101353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f6b2a16c-b185-46dc-8307-6599da350100 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance 74741255-3451-4856-af14-5320fa7e2d76 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:10:49.102998 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f6b2a16c-b185-46dc-8307-6599da350100 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76" status: 404 len: 111 microversion: 2.1 time: 0.100844 May 27 15:10:49.109068 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1664/3307] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:49 2022] GET /compute/v2.1/servers/74741255-3451-4856-af14-5320fa7e2d76 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:10:49.114354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e5d11d7d-4b6c-42fe-900d-c6e2f13c7684 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:49.121405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e5d11d7d-4b6c-42fe-900d-c6e2f13c7684 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:49.138669 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5d11d7d-4b6c-42fe-900d-c6e2f13c7684 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:49.139524 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5d11d7d-4b6c-42fe-900d-c6e2f13c7684 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:49.144000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5d11d7d-4b6c-42fe-900d-c6e2f13c7684 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:49.150122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5d11d7d-4b6c-42fe-900d-c6e2f13c7684 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:49.713833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c9556a4d-b478-4e15-b602-b812da8f5964 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:49.730974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c9556a4d-b478-4e15-b602-b812da8f5964 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:49.736652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c9556a4d-b478-4e15-b602-b812da8f5964 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:49.738940 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c9556a4d-b478-4e15-b602-b812da8f5964 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.980562 May 27 15:10:49.743656 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1644/3308] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:48 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:49.764063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-781e5cc0-c505-4390-8bb5-145960618608 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:49.766815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-781e5cc0-c505-4390-8bb5-145960618608 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 2834b60d-ed8c-48d6-bbf5-2daeec41f497] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:49.781571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-781e5cc0-c505-4390-8bb5-145960618608 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:49.782434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-781e5cc0-c505-4390-8bb5-145960618608 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:49.784848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-781e5cc0-c505-4390-8bb5-145960618608 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:49.787147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-781e5cc0-c505-4390-8bb5-145960618608 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:49.830959 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-781e5cc0-c505-4390-8bb5-145960618608 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 could not be found. May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-781e5cc0-c505-4390-8bb5-145960618608 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 HTTP/1.1 May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 could not be found. May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '2834b60d-ed8c-48d6-bbf5-2daeec41f497'} May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 could not be found. May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:10:49.834228 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:10:49.838304 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 could not be found. May 27 15:10:49.838304 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:49.838304 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:49.838304 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:49.838304 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:49.838304 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:49.838304 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:49.838304 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:10:49.838304 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:10:49.838304 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 could not be found. May 27 15:10:49.838304 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:10:49.847934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-781e5cc0-c505-4390-8bb5-145960618608 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:10:49.849497 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-781e5cc0-c505-4390-8bb5-145960618608 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497" status: 404 len: 111 microversion: 2.1 time: 0.104095 May 27 15:10:49.856639 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1645/3309] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:10:49 2022] DELETE /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:10:49.863995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7eb23b56-1179-4188-b90e-138ec8544308 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:49.865164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7eb23b56-1179-4188-b90e-138ec8544308 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:49.884007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7eb23b56-1179-4188-b90e-138ec8544308 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:49.885527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7eb23b56-1179-4188-b90e-138ec8544308 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:49.889705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7eb23b56-1179-4188-b90e-138ec8544308 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:49.891054 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7eb23b56-1179-4188-b90e-138ec8544308 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:50.045102 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7eb23b56-1179-4188-b90e-138ec8544308 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:50.055302 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7eb23b56-1179-4188-b90e-138ec8544308 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1273 microversion: 2.1 time: 0.196978 May 27 15:10:50.056483 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1646/3310] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:49 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1273 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:50.070340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3ed9d933-7dfa-4080-8e25-fc78a5d52c95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:50.073850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3ed9d933-7dfa-4080-8e25-fc78a5d52c95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:50.092033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ed9d933-7dfa-4080-8e25-fc78a5d52c95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:50.093957 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ed9d933-7dfa-4080-8e25-fc78a5d52c95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:50.101685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ed9d933-7dfa-4080-8e25-fc78a5d52c95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:50.103074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ed9d933-7dfa-4080-8e25-fc78a5d52c95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:50.150131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e5d11d7d-4b6c-42fe-900d-c6e2f13c7684 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:50.168062 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e5d11d7d-4b6c-42fe-900d-c6e2f13c7684 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 1.057671 May 27 15:10:50.168973 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1665/3311] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:49 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:50.198105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-31aee5da-c805-40e3-8d3b-693c9054a4f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:50.199958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-31aee5da-c805-40e3-8d3b-693c9054a4f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] [instance: 2834b60d-ed8c-48d6-bbf5-2daeec41f497] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:50.223357 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-31aee5da-c805-40e3-8d3b-693c9054a4f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:50.223889 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-31aee5da-c805-40e3-8d3b-693c9054a4f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:50.224899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-31aee5da-c805-40e3-8d3b-693c9054a4f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:50.226671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-31aee5da-c805-40e3-8d3b-693c9054a4f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:50.311401 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-31aee5da-c805-40e3-8d3b-693c9054a4f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] HTTP exception thrown: Instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 could not be found. May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-31aee5da-c805-40e3-8d3b-693c9054a4f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Request method failure captured: May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 HTTP/1.1 May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOhVDChK21tG2erTc76P1Sc_lcIZrxdz8SpB7k-gwNIDRNk7_-rNQEDtGgKdFhRjvN5XoC5IgRZG9eW22DxP7fh81t6i5WOY24JdQ4tcpTsv-zJTFlS_XdX7aY1kDxN77jz6nAtGaf7oSXRGwvlQ99AuatWTKYCpmLFwD2wyWFOaAm8 May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/37b5a0b0723a46c1b0755e824e32b776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_37b5a0b0723a46c1b0755e824e32b776", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-DeleteServersTestJSON-165909184 May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 37b5a0b0723a46c1b0755e824e32b776 May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-DeleteServersTestJSON-165909184 May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 0536f4a5547545acaa06b6aad5d1fbe4 May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-DeleteServersTestJSON-165909184-project May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 could not be found. May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '2834b60d-ed8c-48d6-bbf5-2daeec41f497'} May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 could not be found. May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 could not be found. May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:10:50.316167 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:50.320937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:10:50.320937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:10:50.320937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:10:50.320937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:10:50.320937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:10:50.320937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 could not be found. May 27 15:10:50.320937 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:10:50.323987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-31aee5da-c805-40e3-8d3b-693c9054a4f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] Returning 404 to user: Instance 2834b60d-ed8c-48d6-bbf5-2daeec41f497 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:10:50.325128 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-31aee5da-c805-40e3-8d3b-693c9054a4f6 tempest-DeleteServersTestJSON-165909184 tempest-DeleteServersTestJSON-165909184-project] 10.222.0.13 "GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497" status: 404 len: 111 microversion: 2.1 time: 0.155167 May 27 15:10:50.325872 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1666/3312] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:50 2022] GET /compute/v2.1/servers/2834b60d-ed8c-48d6-bbf5-2daeec41f497 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:10:50.507641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3ed9d933-7dfa-4080-8e25-fc78a5d52c95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:50.517016 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3ed9d933-7dfa-4080-8e25-fc78a5d52c95 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.454735 May 27 15:10:50.521010 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1647/3313] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:50 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:50.761348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ef34970d-2e48-4744-bc6b-8300f8b3a3d7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:50.762413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ef34970d-2e48-4744-bc6b-8300f8b3a3d7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:50.779274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef34970d-2e48-4744-bc6b-8300f8b3a3d7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:50.780337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef34970d-2e48-4744-bc6b-8300f8b3a3d7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:50.781751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef34970d-2e48-4744-bc6b-8300f8b3a3d7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:50.782665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef34970d-2e48-4744-bc6b-8300f8b3a3d7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:51.074655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7b4e34d6-a8a5-4363-a591-0fab26c5c2bf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:51.075048 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7b4e34d6-a8a5-4363-a591-0fab26c5c2bf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:51.093068 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b4e34d6-a8a5-4363-a591-0fab26c5c2bf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:51.093585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b4e34d6-a8a5-4363-a591-0fab26c5c2bf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:51.094384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b4e34d6-a8a5-4363-a591-0fab26c5c2bf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:51.094903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b4e34d6-a8a5-4363-a591-0fab26c5c2bf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:51.280440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7b4e34d6-a8a5-4363-a591-0fab26c5c2bf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:51.289863 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7b4e34d6-a8a5-4363-a591-0fab26c5c2bf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1279 microversion: 2.1 time: 0.220398 May 27 15:10:51.291080 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1648/3314] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:51 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1279 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:51.297660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c020355d-37b1-4a00-97c1-a51d7a8d35de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:51.298682 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c020355d-37b1-4a00-97c1-a51d7a8d35de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:51.308316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c020355d-37b1-4a00-97c1-a51d7a8d35de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:51.309315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c020355d-37b1-4a00-97c1-a51d7a8d35de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:51.310440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c020355d-37b1-4a00-97c1-a51d7a8d35de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:51.311449 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c020355d-37b1-4a00-97c1-a51d7a8d35de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:51.733440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ef34970d-2e48-4744-bc6b-8300f8b3a3d7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:51.794370 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ef34970d-2e48-4744-bc6b-8300f8b3a3d7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:51.801218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ef34970d-2e48-4744-bc6b-8300f8b3a3d7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:51.803416 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ef34970d-2e48-4744-bc6b-8300f8b3a3d7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 1.047523 May 27 15:10:51.806696 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1667/3315] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:50 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:51.813527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fcb8c27f-214a-4e6e-b4a7-47c69835465c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:51.814406 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fcb8c27f-214a-4e6e-b4a7-47c69835465c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:51.828984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fcb8c27f-214a-4e6e-b4a7-47c69835465c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:51.869349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fcb8c27f-214a-4e6e-b4a7-47c69835465c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:51.876196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fcb8c27f-214a-4e6e-b4a7-47c69835465c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:51.877511 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fcb8c27f-214a-4e6e-b4a7-47c69835465c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:52.125299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c020355d-37b1-4a00-97c1-a51d7a8d35de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:52.154175 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c020355d-37b1-4a00-97c1-a51d7a8d35de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.861641 May 27 15:10:52.156409 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1649/3316] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:51 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:52.183346 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fcb8c27f-214a-4e6e-b4a7-47c69835465c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:52.201277 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fcb8c27f-214a-4e6e-b4a7-47c69835465c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.391795 May 27 15:10:52.202505 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1668/3317] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:51 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:52.311386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8485bbbe-5a04-4a16-bca1-a741aec7ba89 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:52.312158 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8485bbbe-5a04-4a16-bca1-a741aec7ba89 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:52.319801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8485bbbe-5a04-4a16-bca1-a741aec7ba89 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:52.320564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8485bbbe-5a04-4a16-bca1-a741aec7ba89 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:52.322081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8485bbbe-5a04-4a16-bca1-a741aec7ba89 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:52.322842 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8485bbbe-5a04-4a16-bca1-a741aec7ba89 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:52.423028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8485bbbe-5a04-4a16-bca1-a741aec7ba89 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:52.434030 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8485bbbe-5a04-4a16-bca1-a741aec7ba89 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1279 microversion: 2.1 time: 0.128626 May 27 15:10:52.445951 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1650/3318] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:52 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1279 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:52.824762 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5cec2a54-abb2-4a5a-ba22-71ba495a4e07 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:52.826034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5cec2a54-abb2-4a5a-ba22-71ba495a4e07 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:52.834169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:52.837650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5cec2a54-abb2-4a5a-ba22-71ba495a4e07 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:52.838389 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5cec2a54-abb2-4a5a-ba22-71ba495a4e07 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:52.839522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5cec2a54-abb2-4a5a-ba22-71ba495a4e07 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:52.840148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5cec2a54-abb2-4a5a-ba22-71ba495a4e07 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:53.172910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8db0c735-a87f-4d3e-9838-92815e7d837c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:53.174260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8db0c735-a87f-4d3e-9838-92815e7d837c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:53.187573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8db0c735-a87f-4d3e-9838-92815e7d837c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:53.188419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8db0c735-a87f-4d3e-9838-92815e7d837c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:53.189473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8db0c735-a87f-4d3e-9838-92815e7d837c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:53.198190 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8db0c735-a87f-4d3e-9838-92815e7d837c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:53.281845 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5cec2a54-abb2-4a5a-ba22-71ba495a4e07 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:53.297226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5cec2a54-abb2-4a5a-ba22-71ba495a4e07 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:53.298901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5cec2a54-abb2-4a5a-ba22-71ba495a4e07 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:53.300626 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5cec2a54-abb2-4a5a-ba22-71ba495a4e07 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.480625 May 27 15:10:53.323483 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1669/3319] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:52 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:53.328542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e5cdb68c-27df-42dd-8608-cb259950568a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:53.329192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e5cdb68c-27df-42dd-8608-cb259950568a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:53.336510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5cdb68c-27df-42dd-8608-cb259950568a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:53.337866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5cdb68c-27df-42dd-8608-cb259950568a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:53.338930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5cdb68c-27df-42dd-8608-cb259950568a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:53.339795 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5cdb68c-27df-42dd-8608-cb259950568a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:53.611835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8db0c735-a87f-4d3e-9838-92815e7d837c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:53.624614 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8db0c735-a87f-4d3e-9838-92815e7d837c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.455724 May 27 15:10:53.625617 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1651/3320] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:53 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:10:53.631095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-82ccc11c-29b9-4a58-844d-ec85915599f4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:53.632031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-82ccc11c-29b9-4a58-844d-ec85915599f4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:53.639538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82ccc11c-29b9-4a58-844d-ec85915599f4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:53.640187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82ccc11c-29b9-4a58-844d-ec85915599f4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:53.641023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82ccc11c-29b9-4a58-844d-ec85915599f4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:53.641477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82ccc11c-29b9-4a58-844d-ec85915599f4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:53.727173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e5cdb68c-27df-42dd-8608-cb259950568a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:53.742934 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e5cdb68c-27df-42dd-8608-cb259950568a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.418018 May 27 15:10:53.761307 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1670/3321] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:53 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:53.795483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-82ccc11c-29b9-4a58-844d-ec85915599f4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:53.806032 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-82ccc11c-29b9-4a58-844d-ec85915599f4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1279 microversion: 2.1 time: 0.179026 May 27 15:10:53.807116 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1652/3322] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:53 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1279 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:54.321776 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-79c7e034-417d-43d7-b05e-4ee23d1c68e3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:54.322814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-79c7e034-417d-43d7-b05e-4ee23d1c68e3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:54.334297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-79c7e034-417d-43d7-b05e-4ee23d1c68e3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:54.335194 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-79c7e034-417d-43d7-b05e-4ee23d1c68e3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:54.338962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-79c7e034-417d-43d7-b05e-4ee23d1c68e3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:54.340628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-79c7e034-417d-43d7-b05e-4ee23d1c68e3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:54.969882 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-79c7e034-417d-43d7-b05e-4ee23d1c68e3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:54.994935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-79c7e034-417d-43d7-b05e-4ee23d1c68e3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:54.997056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-79c7e034-417d-43d7-b05e-4ee23d1c68e3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:54.998549 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-79c7e034-417d-43d7-b05e-4ee23d1c68e3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.682204 May 27 15:10:55.012423 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1671/3323] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:54 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:55.019551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7350c24b-86c8-442c-b28c-6991292b9339 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:55.020866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7350c24b-86c8-442c-b28c-6991292b9339 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:55.033839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7350c24b-86c8-442c-b28c-6991292b9339 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:55.034621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7350c24b-86c8-442c-b28c-6991292b9339 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:55.035761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7350c24b-86c8-442c-b28c-6991292b9339 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:55.037017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7350c24b-86c8-442c-b28c-6991292b9339 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:55.140457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-21f97685-9896-4c5c-a287-83b07bfeaf5b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:55.141880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-21f97685-9896-4c5c-a287-83b07bfeaf5b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:55.153119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21f97685-9896-4c5c-a287-83b07bfeaf5b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:55.154180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21f97685-9896-4c5c-a287-83b07bfeaf5b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:55.155857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21f97685-9896-4c5c-a287-83b07bfeaf5b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:55.157013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21f97685-9896-4c5c-a287-83b07bfeaf5b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:55.213532 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-21f97685-9896-4c5c-a287-83b07bfeaf5b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20/ips" status: 200 len: 152 microversion: 2.20 time: 0.746642 May 27 15:10:55.215273 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1653/3324] 10.222.0.13 () {60 vars in 1288 bytes} [Fri May 27 15:10:54 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20/ips => generated 152 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:10:55.230999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1ac2e970-7dc6-40ff-a826-50500ece588d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:55.232384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1ac2e970-7dc6-40ff-a826-50500ece588d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:55.247462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ac2e970-7dc6-40ff-a826-50500ece588d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:55.249039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ac2e970-7dc6-40ff-a826-50500ece588d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:55.250642 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7350c24b-86c8-442c-b28c-6991292b9339 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:55.251596 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ac2e970-7dc6-40ff-a826-50500ece588d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:55.254519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ac2e970-7dc6-40ff-a826-50500ece588d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:55.261110 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7350c24b-86c8-442c-b28c-6991292b9339 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.246742 May 27 15:10:55.275923 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1672/3325] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:55 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:55.288632 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ad75ca46-27c5-418a-a4c4-c3928b936f57 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:55.290658 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ad75ca46-27c5-418a-a4c4-c3928b936f57 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:55.302651 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad75ca46-27c5-418a-a4c4-c3928b936f57 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:55.303185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad75ca46-27c5-418a-a4c4-c3928b936f57 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:55.304247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad75ca46-27c5-418a-a4c4-c3928b936f57 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:55.304989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad75ca46-27c5-418a-a4c4-c3928b936f57 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:55.477132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ad75ca46-27c5-418a-a4c4-c3928b936f57 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:55.490373 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ad75ca46-27c5-418a-a4c4-c3928b936f57 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1279 microversion: 2.1 time: 0.225797 May 27 15:10:55.497863 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1673/3326] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:55 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1279 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:55.666538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2b6d3ae5-8912-4749-b910-92c94d6f2b69 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-712429699", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": "none"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:55.671634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1ac2e970-7dc6-40ff-a826-50500ece588d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:55.682685 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1ac2e970-7dc6-40ff-a826-50500ece588d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.465589 May 27 15:10:55.683883 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1654/3327] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:55 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:55.774268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-2b6d3ae5-8912-4749-b910-92c94d6f2b69 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:10:55.774703 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-2b6d3ae5-8912-4749-b910-92c94d6f2b69 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:10:55.775226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-2b6d3ae5-8912-4749-b910-92c94d6f2b69 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:10:55.775646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-2b6d3ae5-8912-4749-b910-92c94d6f2b69 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:10:55.776070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-2b6d3ae5-8912-4749-b910-92c94d6f2b69 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:10:55.790285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b6d3ae5-8912-4749-b910-92c94d6f2b69 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:55.790889 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b6d3ae5-8912-4749-b910-92c94d6f2b69 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:55.792566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b6d3ae5-8912-4749-b910-92c94d6f2b69 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:55.793141 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b6d3ae5-8912-4749-b910-92c94d6f2b69 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:55.826019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-2b6d3ae5-8912-4749-b910-92c94d6f2b69 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Getting quotas for project 0037dd3962414ff8846962fafd1366d1. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:10:55.832322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-2b6d3ae5-8912-4749-b910-92c94d6f2b69 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Getting quotas for user e092508233424efd8a374dd85ad6d71d and project 0037dd3962414ff8846962fafd1366d1. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:10:55.858837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2b6d3ae5-8912-4749-b910-92c94d6f2b69 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:10:55.861337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2b6d3ae5-8912-4749-b910-92c94d6f2b69 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 8b391c6d-2c42-4404-8155-412062aa0d81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:10:55.974106 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2b6d3ae5-8912-4749-b910-92c94d6f2b69 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.473968 May 27 15:10:55.975637 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1674/3328] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 27 15:10:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 15:10:55.991974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-de2da750-5376-4872-8e4f-1df677b1a5f3 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:55.993511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-de2da750-5376-4872-8e4f-1df677b1a5f3 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 8b391c6d-2c42-4404-8155-412062aa0d81] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:56.025936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3b6a21f7-4835-40e5-8f84-979417400f06 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:56.031654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3b6a21f7-4835-40e5-8f84-979417400f06 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:56.047968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b6a21f7-4835-40e5-8f84-979417400f06 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:56.050796 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b6a21f7-4835-40e5-8f84-979417400f06 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:56.051952 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b6a21f7-4835-40e5-8f84-979417400f06 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:56.053272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b6a21f7-4835-40e5-8f84-979417400f06 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:56.158423 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-de2da750-5376-4872-8e4f-1df677b1a5f3 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:56.186717 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-de2da750-5376-4872-8e4f-1df677b1a5f3 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:56.190388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-de2da750-5376-4872-8e4f-1df677b1a5f3 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:56.193397 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-de2da750-5376-4872-8e4f-1df677b1a5f3 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/8b391c6d-2c42-4404-8155-412062aa0d81" status: 200 len: 1277 microversion: 2.47 time: 0.206900 May 27 15:10:56.195622 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1655/3329] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:55 2022] GET /compute/v2.1/servers/8b391c6d-2c42-4404-8155-412062aa0d81 => generated 1277 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:56.288219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-674b7940-05a9-49d4-8182-806a410cfc39 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:56.288986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-674b7940-05a9-49d4-8182-806a410cfc39 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:56.312862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-674b7940-05a9-49d4-8182-806a410cfc39 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:56.318027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-674b7940-05a9-49d4-8182-806a410cfc39 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:56.319529 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-674b7940-05a9-49d4-8182-806a410cfc39 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:56.326136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-674b7940-05a9-49d4-8182-806a410cfc39 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:56.807594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-674b7940-05a9-49d4-8182-806a410cfc39 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:56.822315 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-674b7940-05a9-49d4-8182-806a410cfc39 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.536585 May 27 15:10:56.833452 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1656/3330] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:56 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:10:56.851610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b3a1351b-f4a3-48a9-ab97-4c3129a96649 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1912646247", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": "none"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:56.866146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3b6a21f7-4835-40e5-8f84-979417400f06 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:56.882988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:56.907680 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3b6a21f7-4835-40e5-8f84-979417400f06 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:56.919752 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3b6a21f7-4835-40e5-8f84-979417400f06 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:56.922501 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3b6a21f7-4835-40e5-8f84-979417400f06 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.904036 May 27 15:10:56.929847 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1675/3331] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:56 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:56.945641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f9d64d15-7f3e-4672-ae45-d322024ece17 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:56.948775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f9d64d15-7f3e-4672-ae45-d322024ece17 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:56.967880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9d64d15-7f3e-4672-ae45-d322024ece17 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:56.970095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9d64d15-7f3e-4672-ae45-d322024ece17 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:56.971299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9d64d15-7f3e-4672-ae45-d322024ece17 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:56.973432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9d64d15-7f3e-4672-ae45-d322024ece17 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:56.994466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-b3a1351b-f4a3-48a9-ab97-4c3129a96649 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:10:56.995244 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-b3a1351b-f4a3-48a9-ab97-4c3129a96649 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:10:56.996023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-b3a1351b-f4a3-48a9-ab97-4c3129a96649 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:10:56.996711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-b3a1351b-f4a3-48a9-ab97-4c3129a96649 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:10:56.997482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-b3a1351b-f4a3-48a9-ab97-4c3129a96649 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:10:57.014235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3a1351b-f4a3-48a9-ab97-4c3129a96649 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:57.015660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3a1351b-f4a3-48a9-ab97-4c3129a96649 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:57.017323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3a1351b-f4a3-48a9-ab97-4c3129a96649 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:57.018299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3a1351b-f4a3-48a9-ab97-4c3129a96649 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:57.054310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-b3a1351b-f4a3-48a9-ab97-4c3129a96649 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Getting quotas for project 0037dd3962414ff8846962fafd1366d1. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:10:57.066009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-b3a1351b-f4a3-48a9-ab97-4c3129a96649 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Getting quotas for user e092508233424efd8a374dd85ad6d71d and project 0037dd3962414ff8846962fafd1366d1. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:10:57.103539 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b3a1351b-f4a3-48a9-ab97-4c3129a96649 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:10:57.108092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b3a1351b-f4a3-48a9-ab97-4c3129a96649 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:10:57.244718 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b3a1351b-f4a3-48a9-ab97-4c3129a96649 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.409504 May 27 15:10:57.247363 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1657/3332] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 27 15:10:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 15:10:57.253636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ed0d5b59-d84f-4868-bedb-b2e1b3c4c6a7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:57.254698 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ed0d5b59-d84f-4868-bedb-b2e1b3c4c6a7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:57.280975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ed0d5b59-d84f-4868-bedb-b2e1b3c4c6a7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:57.283519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ed0d5b59-d84f-4868-bedb-b2e1b3c4c6a7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:57.286665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ed0d5b59-d84f-4868-bedb-b2e1b3c4c6a7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:57.289391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ed0d5b59-d84f-4868-bedb-b2e1b3c4c6a7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:57.379525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:10:57.401010 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f9d64d15-7f3e-4672-ae45-d322024ece17 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:57.420552 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f9d64d15-7f3e-4672-ae45-d322024ece17 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1321 microversion: 2.1 time: 0.486623 May 27 15:10:57.433208 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1676/3333] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:56 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1321 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:57.448258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-49feda81-fa5e-42b7-a141-1cc1ee28706d tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:57.448911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-49feda81-fa5e-42b7-a141-1cc1ee28706d tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:57.587928 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-49feda81-fa5e-42b7-a141-1cc1ee28706d tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "PUT /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 992 microversion: 2.47 time: 0.153382 May 27 15:10:57.601990 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1677/3334] 10.222.0.13 () {62 vars in 1296 bytes} [Fri May 27 15:10:57 2022] PUT /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 992 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:10:57.614221 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5cdaa638-e576-4ad3-b444-dcd232591d80 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:57.615639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5cdaa638-e576-4ad3-b444-dcd232591d80 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:57.638654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ed0d5b59-d84f-4868-bedb-b2e1b3c4c6a7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:57.653887 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ed0d5b59-d84f-4868-bedb-b2e1b3c4c6a7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1550 microversion: 2.1 time: 0.404171 May 27 15:10:57.655468 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1658/3335] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:57 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1550 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:57.668423 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-dc8a67ac-4ecf-476e-a68f-525469cb372f req-702ca096-8c45-4ba8-a980-43df79567540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce756610-6a39-4f3b-97c5-79cac2fdf255", "tag": "0deb9a0e-386b-404a-a01a-85e6358417ef"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:57.710862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-dc8a67ac-4ecf-476e-a68f-525469cb372f req-702ca096-8c45-4ba8-a980-43df79567540 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:57.711331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-dc8a67ac-4ecf-476e-a68f-525469cb372f req-702ca096-8c45-4ba8-a980-43df79567540 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:57.742185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5cdaa638-e576-4ad3-b444-dcd232591d80 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:57.750467 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-dc8a67ac-4ecf-476e-a68f-525469cb372f req-702ca096-8c45-4ba8-a980-43df79567540 service nova] Creating event network-changed:0deb9a0e-386b-404a-a01a-85e6358417ef for instance ce756610-6a39-4f3b-97c5-79cac2fdf255 on n-h1-843621-1 May 27 15:10:57.755532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5cdaa638-e576-4ad3-b444-dcd232591d80 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:57.757254 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-dc8a67ac-4ecf-476e-a68f-525469cb372f req-702ca096-8c45-4ba8-a980-43df79567540 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100395 May 27 15:10:57.758166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5cdaa638-e576-4ad3-b444-dcd232591d80 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:57.759998 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5cdaa638-e576-4ad3-b444-dcd232591d80 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1278 microversion: 2.47 time: 0.155937 May 27 15:10:57.764221 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1659/3336] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:10:57.771915 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1678/3337] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:57 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:57.843965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4e3dca3a-4eb6-4c2a-b5a7-d41a25589baf tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:57.846084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4e3dca3a-4eb6-4c2a-b5a7-d41a25589baf tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:57.873337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e3dca3a-4eb6-4c2a-b5a7-d41a25589baf tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:57.874680 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e3dca3a-4eb6-4c2a-b5a7-d41a25589baf tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:57.878546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e3dca3a-4eb6-4c2a-b5a7-d41a25589baf tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:57.897216 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e3dca3a-4eb6-4c2a-b5a7-d41a25589baf tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:57.952247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-198389a7-8e94-46c7-ae4b-9759d47b77d3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:57.953018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-198389a7-8e94-46c7-ae4b-9759d47b77d3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:57.977559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-198389a7-8e94-46c7-ae4b-9759d47b77d3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:57.982428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-198389a7-8e94-46c7-ae4b-9759d47b77d3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:57.986023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-198389a7-8e94-46c7-ae4b-9759d47b77d3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:58.002194 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-198389a7-8e94-46c7-ae4b-9759d47b77d3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:58.427252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4e3dca3a-4eb6-4c2a-b5a7-d41a25589baf tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:58.446517 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4e3dca3a-4eb6-4c2a-b5a7-d41a25589baf tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.609288 May 27 15:10:58.459477 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1660/3338] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:57 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:58.471590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5588b116-9773-4fab-9c68-a10530763769 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:58.474231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5588b116-9773-4fab-9c68-a10530763769 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:58.492785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5588b116-9773-4fab-9c68-a10530763769 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:58.493763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5588b116-9773-4fab-9c68-a10530763769 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:58.495268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5588b116-9773-4fab-9c68-a10530763769 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:58.498319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5588b116-9773-4fab-9c68-a10530763769 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:58.875479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-198389a7-8e94-46c7-ae4b-9759d47b77d3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:58.896818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-198389a7-8e94-46c7-ae4b-9759d47b77d3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:58.902954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-198389a7-8e94-46c7-ae4b-9759d47b77d3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:58.909881 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-198389a7-8e94-46c7-ae4b-9759d47b77d3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.963119 May 27 15:10:58.925757 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1679/3339] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:57 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:10:58.943920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-54033be6-fac5-4f81-90d7-3afd9cbcf309 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:58.948029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-54033be6-fac5-4f81-90d7-3afd9cbcf309 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:58.965208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-54033be6-fac5-4f81-90d7-3afd9cbcf309 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:58.966830 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-54033be6-fac5-4f81-90d7-3afd9cbcf309 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:58.968318 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-54033be6-fac5-4f81-90d7-3afd9cbcf309 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:58.969129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-54033be6-fac5-4f81-90d7-3afd9cbcf309 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:59.006101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5588b116-9773-4fab-9c68-a10530763769 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:59.069381 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5588b116-9773-4fab-9c68-a10530763769 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1321 microversion: 2.1 time: 0.606794 May 27 15:10:59.072533 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1661/3340] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:58 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1321 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:59.089359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bf15faec-d989-4257-a508-86ee708a6168 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:59.092116 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bf15faec-d989-4257-a508-86ee708a6168 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:59.109694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf15faec-d989-4257-a508-86ee708a6168 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:59.110962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf15faec-d989-4257-a508-86ee708a6168 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:59.113888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf15faec-d989-4257-a508-86ee708a6168 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:59.115477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf15faec-d989-4257-a508-86ee708a6168 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:59.338252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bf15faec-d989-4257-a508-86ee708a6168 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:59.379041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bf15faec-d989-4257-a508-86ee708a6168 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:59.384094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bf15faec-d989-4257-a508-86ee708a6168 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:59.388248 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bf15faec-d989-4257-a508-86ee708a6168 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1330 microversion: 2.47 time: 0.312742 May 27 15:10:59.389795 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1662/3341] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:10:59 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1330 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:10:59.424955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-54033be6-fac5-4f81-90d7-3afd9cbcf309 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:59.436398 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-54033be6-fac5-4f81-90d7-3afd9cbcf309 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1540 microversion: 2.1 time: 0.508786 May 27 15:10:59.437950 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1680/3342] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:58 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1540 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:59.477782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a8c4990a-7227-4f83-bfe8-4ca9e74c3200 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '.version_select at 0x7fc776bfa040>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:59.478697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e91d89f-ff32-4588-b3e4-fa471dd97c1b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:59.479726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e91d89f-ff32-4588-b3e4-fa471dd97c1b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:59.483598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a8c4990a-7227-4f83-bfe8-4ca9e74c3200 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:59.484058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a8c4990a-7227-4f83-bfe8-4ca9e74c3200 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:59.496286 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a8c4990a-7227-4f83-bfe8-4ca9e74c3200 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.037708 May 27 15:10:59.499975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e91d89f-ff32-4588-b3e4-fa471dd97c1b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:59.500433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e91d89f-ff32-4588-b3e4-fa471dd97c1b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:59.501258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e91d89f-ff32-4588-b3e4-fa471dd97c1b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:59.501707 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e91d89f-ff32-4588-b3e4-fa471dd97c1b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:59.505657 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1663/3343] 10.222.0.13 () {58 vars in 1142 bytes} [Fri May 27 15:10:59 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:59.512780 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-928c7387-240c-4709-a635-07768b385929 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:59.513441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-928c7387-240c-4709-a635-07768b385929 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:59.520953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-928c7387-240c-4709-a635-07768b385929 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:59.521409 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-928c7387-240c-4709-a635-07768b385929 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:59.522956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-928c7387-240c-4709-a635-07768b385929 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:59.523409 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-928c7387-240c-4709-a635-07768b385929 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:59.798214 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-928c7387-240c-4709-a635-07768b385929 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1691 microversion: 2.1 time: 0.291412 May 27 15:10:59.808706 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1664/3344] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:59 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1691 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:59.828032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e91d89f-ff32-4588-b3e4-fa471dd97c1b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:10:59.833515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a559b0d2-945a-4965-becc-535c0861f978 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:10:59.835039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a559b0d2-945a-4965-becc-535c0861f978 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:59.845840 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e91d89f-ff32-4588-b3e4-fa471dd97c1b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.381291 May 27 15:10:59.855455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a559b0d2-945a-4965-becc-535c0861f978 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:59.855455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a559b0d2-945a-4965-becc-535c0861f978 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:59.855455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a559b0d2-945a-4965-becc-535c0861f978 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:59.855455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a559b0d2-945a-4965-becc-535c0861f978 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:59.858111 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1681/3345] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:59 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:10:59.864729 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f7493221-f6f2-4e1e-954d-4063e4023a6a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:10:59.865476 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f7493221-f6f2-4e1e-954d-4063e4023a6a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:10:59.873631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7493221-f6f2-4e1e-954d-4063e4023a6a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:59.874704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7493221-f6f2-4e1e-954d-4063e4023a6a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:59.875724 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7493221-f6f2-4e1e-954d-4063e4023a6a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:10:59.876417 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7493221-f6f2-4e1e-954d-4063e4023a6a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:10:59.926451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-f7493221-f6f2-4e1e-954d-4063e4023a6a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lazy-loading 'flavor' on Instance uuid d7371c18-20d2-43f8-b0c6-0371079d8f20 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:11:00.195563 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a559b0d2-945a-4965-becc-535c0861f978 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1691 microversion: 2.1 time: 0.374922 May 27 15:11:00.215299 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1665/3346] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:10:59 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1691 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:11:00.230817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-594ad9eb-c2a7-47a5-96a4-900b604f1784 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:00.232660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-594ad9eb-c2a7-47a5-96a4-900b604f1784 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:00.247531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:00.250257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-594ad9eb-c2a7-47a5-96a4-900b604f1784 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:00.251236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-594ad9eb-c2a7-47a5-96a4-900b604f1784 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:00.253239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-594ad9eb-c2a7-47a5-96a4-900b604f1784 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:00.254466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-594ad9eb-c2a7-47a5-96a4-900b604f1784 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:00.398912 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f7493221-f6f2-4e1e-954d-4063e4023a6a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "POST /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20/action" status: 202 len: 0 microversion: 2.20 time: 0.537807 May 27 15:11:00.405618 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1682/3347] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 27 15:10:59 2022] POST /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 15:11:00.432043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7527e660-f1b7-4caa-b61a-68ecff47e803 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:00.432988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7527e660-f1b7-4caa-b61a-68ecff47e803 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:00.446763 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7527e660-f1b7-4caa-b61a-68ecff47e803 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:00.447593 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7527e660-f1b7-4caa-b61a-68ecff47e803 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:00.449753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7527e660-f1b7-4caa-b61a-68ecff47e803 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:00.450374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7527e660-f1b7-4caa-b61a-68ecff47e803 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:00.644939 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-594ad9eb-c2a7-47a5-96a4-900b604f1784 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:00.667253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-594ad9eb-c2a7-47a5-96a4-900b604f1784 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:00.682283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-594ad9eb-c2a7-47a5-96a4-900b604f1784 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:00.683975 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-594ad9eb-c2a7-47a5-96a4-900b604f1784 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.466938 May 27 15:11:00.685782 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1666/3348] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:00 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:00.699352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b682b719-7e58-4181-bb8e-1604fbdd7da7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:00.702347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b682b719-7e58-4181-bb8e-1604fbdd7da7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:00.720051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b682b719-7e58-4181-bb8e-1604fbdd7da7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:00.720918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b682b719-7e58-4181-bb8e-1604fbdd7da7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:00.722387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b682b719-7e58-4181-bb8e-1604fbdd7da7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:00.723197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b682b719-7e58-4181-bb8e-1604fbdd7da7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:00.742351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7527e660-f1b7-4caa-b61a-68ecff47e803 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:00.751680 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7527e660-f1b7-4caa-b61a-68ecff47e803 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1321 microversion: 2.1 time: 0.344356 May 27 15:11:00.752706 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1683/3349] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:00 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:00.758220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b4042342-d6dc-482e-8ddc-1073627dc934 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:00.759222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b4042342-d6dc-482e-8ddc-1073627dc934 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:00.766277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4042342-d6dc-482e-8ddc-1073627dc934 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:00.767119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4042342-d6dc-482e-8ddc-1073627dc934 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:00.768455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4042342-d6dc-482e-8ddc-1073627dc934 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:00.769387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4042342-d6dc-482e-8ddc-1073627dc934 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:00.835213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-b682b719-7e58-4181-bb8e-1604fbdd7da7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lazy-loading 'services' on Instance uuid ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:11:00.957948 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b682b719-7e58-4181-bb8e-1604fbdd7da7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments/fc3cce81-3f26-4484-b131-2356d3ff4684" status: 202 len: 0 microversion: 2.1 time: 0.268785 May 27 15:11:00.958593 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1667/3350] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 15:11:00 2022] DELETE /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments/fc3cce81-3f26-4484-b131-2356d3ff4684 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:11:00.989678 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4946edcb-383e-4779-afa8-041dd1f44a9f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:00.990424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4946edcb-383e-4779-afa8-041dd1f44a9f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:00.997914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4946edcb-383e-4779-afa8-041dd1f44a9f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:00.999563 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4946edcb-383e-4779-afa8-041dd1f44a9f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:01.000543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4946edcb-383e-4779-afa8-041dd1f44a9f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:01.001235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4946edcb-383e-4779-afa8-041dd1f44a9f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:01.052412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b4042342-d6dc-482e-8ddc-1073627dc934 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:01.081026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b4042342-d6dc-482e-8ddc-1073627dc934 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:01.083893 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b4042342-d6dc-482e-8ddc-1073627dc934 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:01.091560 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b4042342-d6dc-482e-8ddc-1073627dc934 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1723 microversion: 2.20 time: 0.335622 May 27 15:11:01.092380 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1684/3351] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:00 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1723 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:01.101851 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8d0bfeb6-fb7c-4a62-acc5-1b2aaa0240f3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:01.105167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8d0bfeb6-fb7c-4a62-acc5-1b2aaa0240f3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:01.122166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d0bfeb6-fb7c-4a62-acc5-1b2aaa0240f3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:01.124814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d0bfeb6-fb7c-4a62-acc5-1b2aaa0240f3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:01.126014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d0bfeb6-fb7c-4a62-acc5-1b2aaa0240f3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:01.129159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d0bfeb6-fb7c-4a62-acc5-1b2aaa0240f3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:01.145770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4946edcb-383e-4779-afa8-041dd1f44a9f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:01.162057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4946edcb-383e-4779-afa8-041dd1f44a9f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:01.164791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4946edcb-383e-4779-afa8-041dd1f44a9f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:01.166034 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4946edcb-383e-4779-afa8-041dd1f44a9f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1338 microversion: 2.47 time: 0.202223 May 27 15:11:01.166603 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1668/3352] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:00 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1338 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:01.176747 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bbb16389-1bba-4aec-b381-f302c03b2154 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:01.177828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bbb16389-1bba-4aec-b381-f302c03b2154 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:01.191940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bbb16389-1bba-4aec-b381-f302c03b2154 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:01.192388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bbb16389-1bba-4aec-b381-f302c03b2154 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:01.205999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bbb16389-1bba-4aec-b381-f302c03b2154 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:01.206943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bbb16389-1bba-4aec-b381-f302c03b2154 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:01.277088 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bbb16389-1bba-4aec-b381-f302c03b2154 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108108 May 27 15:11:01.279393 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1669/3353] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:11:01 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:01.374513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8d0bfeb6-fb7c-4a62-acc5-1b2aaa0240f3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:01.400808 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8d0bfeb6-fb7c-4a62-acc5-1b2aaa0240f3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.303629 May 27 15:11:01.402243 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1685/3354] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:01 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:01.466872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-b0b42bcf-6b57-4dba-8f36-0b5ca353fac3 req-875da4a9-7d0d-4b0a-bde9-29862a37b8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9", "tag": "060a8f37-46b9-487a-83a1-ccabf5cd0958"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:01.488578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b0b42bcf-6b57-4dba-8f36-0b5ca353fac3 req-875da4a9-7d0d-4b0a-bde9-29862a37b8b2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:01.489143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b0b42bcf-6b57-4dba-8f36-0b5ca353fac3 req-875da4a9-7d0d-4b0a-bde9-29862a37b8b2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:01.512217 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-b0b42bcf-6b57-4dba-8f36-0b5ca353fac3 req-875da4a9-7d0d-4b0a-bde9-29862a37b8b2 service nova] Creating event network-changed:060a8f37-46b9-487a-83a1-ccabf5cd0958 for instance f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9 on n-h2-843621-1 May 27 15:11:01.531442 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-b0b42bcf-6b57-4dba-8f36-0b5ca353fac3 req-875da4a9-7d0d-4b0a-bde9-29862a37b8b2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065709 May 27 15:11:01.534567 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1670/3355] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:01.712431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0b60dcc8-569a-4075-bcb4-83b3c55364fa tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:01.713077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0b60dcc8-569a-4075-bcb4-83b3c55364fa tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:01.720592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0b60dcc8-569a-4075-bcb4-83b3c55364fa tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:01.721106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0b60dcc8-569a-4075-bcb4-83b3c55364fa tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:01.721889 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0b60dcc8-569a-4075-bcb4-83b3c55364fa tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:01.722331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0b60dcc8-569a-4075-bcb4-83b3c55364fa tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:01.782486 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-40a7477c-895c-471e-9511-a540ed9530c7 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:01.785292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-40a7477c-895c-471e-9511-a540ed9530c7 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:01.816341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40a7477c-895c-471e-9511-a540ed9530c7 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:01.817161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40a7477c-895c-471e-9511-a540ed9530c7 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:01.818466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40a7477c-895c-471e-9511-a540ed9530c7 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:01.819229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40a7477c-895c-471e-9511-a540ed9530c7 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:02.278176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-40a7477c-895c-471e-9511-a540ed9530c7 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:02.294398 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-40a7477c-895c-471e-9511-a540ed9530c7 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1321 microversion: 2.1 time: 0.519057 May 27 15:11:02.297485 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1671/3356] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:01 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1321 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:02.311284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0b60dcc8-569a-4075-bcb4-83b3c55364fa tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:02.331187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-71f8d411-4d77-42ec-9fc8-fbbb077c0827 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:02.334501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-71f8d411-4d77-42ec-9fc8-fbbb077c0827 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:02.353544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0b60dcc8-569a-4075-bcb4-83b3c55364fa tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:02.357264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0b60dcc8-569a-4075-bcb4-83b3c55364fa tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:02.361645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71f8d411-4d77-42ec-9fc8-fbbb077c0827 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:02.363673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71f8d411-4d77-42ec-9fc8-fbbb077c0827 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:02.367978 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0b60dcc8-569a-4075-bcb4-83b3c55364fa tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.658450 May 27 15:11:02.368536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71f8d411-4d77-42ec-9fc8-fbbb077c0827 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:02.369780 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71f8d411-4d77-42ec-9fc8-fbbb077c0827 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:02.371312 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1686/3357] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:01 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:02.392548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-12aa77a5-4d9e-41c1-8053-97444b15af0e tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:02.394291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-12aa77a5-4d9e-41c1-8053-97444b15af0e tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:02.408447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12aa77a5-4d9e-41c1-8053-97444b15af0e tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:02.410502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12aa77a5-4d9e-41c1-8053-97444b15af0e tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:02.412246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12aa77a5-4d9e-41c1-8053-97444b15af0e tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:02.414801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12aa77a5-4d9e-41c1-8053-97444b15af0e tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:02.586317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-12aa77a5-4d9e-41c1-8053-97444b15af0e tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:02.606525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-12aa77a5-4d9e-41c1-8053-97444b15af0e tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:02.612960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-12aa77a5-4d9e-41c1-8053-97444b15af0e tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:02.614518 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-12aa77a5-4d9e-41c1-8053-97444b15af0e tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1336 microversion: 2.47 time: 0.238820 May 27 15:11:02.619483 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1687/3358] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:02 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1336 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:02.625269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-021ef510-68da-477e-87fe-7d104f6ec4e4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:02.626446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-021ef510-68da-477e-87fe-7d104f6ec4e4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:02.653854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-021ef510-68da-477e-87fe-7d104f6ec4e4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:02.654403 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-021ef510-68da-477e-87fe-7d104f6ec4e4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:02.655397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-021ef510-68da-477e-87fe-7d104f6ec4e4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:02.655861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-021ef510-68da-477e-87fe-7d104f6ec4e4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:02.725193 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-021ef510-68da-477e-87fe-7d104f6ec4e4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104254 May 27 15:11:02.728754 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1688/3359] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:11:02 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:02.735720 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5f858618-09cb-4de7-ad63-3fdc74e73d9b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:02.737349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5f858618-09cb-4de7-ad63-3fdc74e73d9b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:02.748342 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f858618-09cb-4de7-ad63-3fdc74e73d9b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:02.749509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f858618-09cb-4de7-ad63-3fdc74e73d9b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:02.751784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f858618-09cb-4de7-ad63-3fdc74e73d9b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:02.753469 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f858618-09cb-4de7-ad63-3fdc74e73d9b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:02.766156 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-71f8d411-4d77-42ec-9fc8-fbbb077c0827 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:02.788519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-71f8d411-4d77-42ec-9fc8-fbbb077c0827 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:02.790463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-71f8d411-4d77-42ec-9fc8-fbbb077c0827 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:02.792153 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-71f8d411-4d77-42ec-9fc8-fbbb077c0827 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1723 microversion: 2.20 time: 0.493108 May 27 15:11:02.797460 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1672/3360] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:02 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1723 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:03.094570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5f858618-09cb-4de7-ad63-3fdc74e73d9b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:03.108324 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5f858618-09cb-4de7-ad63-3fdc74e73d9b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.377712 May 27 15:11:03.109671 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1689/3361] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:02 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:03.323711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-715758af-f13f-41e3-850f-8c7fb5ae8a58 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:03.324710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-715758af-f13f-41e3-850f-8c7fb5ae8a58 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:03.342110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-715758af-f13f-41e3-850f-8c7fb5ae8a58 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:03.342967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-715758af-f13f-41e3-850f-8c7fb5ae8a58 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:03.344126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-715758af-f13f-41e3-850f-8c7fb5ae8a58 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:03.345027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-715758af-f13f-41e3-850f-8c7fb5ae8a58 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:03.391262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7340c5da-894a-4a3f-9f37-154593cacb08 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:03.392180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7340c5da-894a-4a3f-9f37-154593cacb08 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:03.405915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7340c5da-894a-4a3f-9f37-154593cacb08 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:03.415724 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7340c5da-894a-4a3f-9f37-154593cacb08 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:03.417298 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7340c5da-894a-4a3f-9f37-154593cacb08 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:03.417910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7340c5da-894a-4a3f-9f37-154593cacb08 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:03.817740 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-715758af-f13f-41e3-850f-8c7fb5ae8a58 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:03.835172 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-715758af-f13f-41e3-850f-8c7fb5ae8a58 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1321 microversion: 2.1 time: 0.518665 May 27 15:11:03.849177 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1673/3362] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:03 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1321 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:03.873875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-e71c0f74-7fa9-4456-ad45-f0c543addb2d req-cde02423-7257-4f1c-8032-3186c1292d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b31c16d8-ba5b-4938-944e-f151ec50b1b5", "tag": "745d0ba9-c0c3-41b4-8de7-3632ae78a3af"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:03.902652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-e71c0f74-7fa9-4456-ad45-f0c543addb2d req-cde02423-7257-4f1c-8032-3186c1292d96 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:03.903718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-e71c0f74-7fa9-4456-ad45-f0c543addb2d req-cde02423-7257-4f1c-8032-3186c1292d96 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:03.918680 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7340c5da-894a-4a3f-9f37-154593cacb08 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:03.940689 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-e71c0f74-7fa9-4456-ad45-f0c543addb2d req-cde02423-7257-4f1c-8032-3186c1292d96 service nova] Creating event network-changed:745d0ba9-c0c3-41b4-8de7-3632ae78a3af for instance b31c16d8-ba5b-4938-944e-f151ec50b1b5 on n-h1-843621-1 May 27 15:11:03.942649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7340c5da-894a-4a3f-9f37-154593cacb08 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:03.948091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7340c5da-894a-4a3f-9f37-154593cacb08 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:03.951414 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-e71c0f74-7fa9-4456-ad45-f0c543addb2d req-cde02423-7257-4f1c-8032-3186c1292d96 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096753 May 27 15:11:03.951760 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7340c5da-894a-4a3f-9f37-154593cacb08 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.565245 May 27 15:11:03.953791 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1674/3363] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:03.954127 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1690/3364] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:03 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:03.966193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f44481ba-c3a8-4ba1-b025-61c5b177d138 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:03.967806 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f44481ba-c3a8-4ba1-b025-61c5b177d138 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:03.977125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e287e533-47b4-4e73-92f5-5e462b6e180a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:03.979469 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e287e533-47b4-4e73-92f5-5e462b6e180a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:03.980172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f44481ba-c3a8-4ba1-b025-61c5b177d138 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:03.980638 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f44481ba-c3a8-4ba1-b025-61c5b177d138 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:03.981460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f44481ba-c3a8-4ba1-b025-61c5b177d138 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:03.981969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f44481ba-c3a8-4ba1-b025-61c5b177d138 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:03.991242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e287e533-47b4-4e73-92f5-5e462b6e180a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:03.992089 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e287e533-47b4-4e73-92f5-5e462b6e180a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:03.993571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e287e533-47b4-4e73-92f5-5e462b6e180a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:03.996740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e287e533-47b4-4e73-92f5-5e462b6e180a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:04.059999 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e287e533-47b4-4e73-92f5-5e462b6e180a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104460 May 27 15:11:04.061246 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1691/3365] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:11:03 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:04.073358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4e6cea9a-8b49-4fe6-b8a9-2ea86cce5a67 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:04.074550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4e6cea9a-8b49-4fe6-b8a9-2ea86cce5a67 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:04.083072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e6cea9a-8b49-4fe6-b8a9-2ea86cce5a67 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:04.083852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e6cea9a-8b49-4fe6-b8a9-2ea86cce5a67 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:04.085012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e6cea9a-8b49-4fe6-b8a9-2ea86cce5a67 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:04.085466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e6cea9a-8b49-4fe6-b8a9-2ea86cce5a67 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:04.123448 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:04.200499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f44481ba-c3a8-4ba1-b025-61c5b177d138 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:04.223720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f44481ba-c3a8-4ba1-b025-61c5b177d138 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:04.231656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f44481ba-c3a8-4ba1-b025-61c5b177d138 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:04.238956 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f44481ba-c3a8-4ba1-b025-61c5b177d138 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1336 microversion: 2.47 time: 0.281548 May 27 15:11:04.240958 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1675/3366] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:03 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1336 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:04.253017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a969df13-e917-4b13-bb7f-c5d1f25a8292 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:04.254770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a969df13-e917-4b13-bb7f-c5d1f25a8292 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:04.270291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a969df13-e917-4b13-bb7f-c5d1f25a8292 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:04.271518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a969df13-e917-4b13-bb7f-c5d1f25a8292 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:04.273284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a969df13-e917-4b13-bb7f-c5d1f25a8292 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:04.275141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a969df13-e917-4b13-bb7f-c5d1f25a8292 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:04.457489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4e6cea9a-8b49-4fe6-b8a9-2ea86cce5a67 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:04.496419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4e6cea9a-8b49-4fe6-b8a9-2ea86cce5a67 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:04.499224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4e6cea9a-8b49-4fe6-b8a9-2ea86cce5a67 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:04.501366 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4e6cea9a-8b49-4fe6-b8a9-2ea86cce5a67 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1723 microversion: 2.20 time: 0.438431 May 27 15:11:04.518399 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1692/3367] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:04 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1723 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:04.719000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a969df13-e917-4b13-bb7f-c5d1f25a8292 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:04.731269 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a969df13-e917-4b13-bb7f-c5d1f25a8292 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.486678 May 27 15:11:04.733419 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1676/3368] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:04 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:04.861156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9092f719-dcb2-4bf8-ba59-51edf60bcff4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:04.862563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9092f719-dcb2-4bf8-ba59-51edf60bcff4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:04.878006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9092f719-dcb2-4bf8-ba59-51edf60bcff4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:04.879131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9092f719-dcb2-4bf8-ba59-51edf60bcff4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:04.880818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9092f719-dcb2-4bf8-ba59-51edf60bcff4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:04.881833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9092f719-dcb2-4bf8-ba59-51edf60bcff4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:04.978514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-81085425-dc6d-499b-a958-6cd14909a086 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:04.980145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-81085425-dc6d-499b-a958-6cd14909a086 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:04.993616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81085425-dc6d-499b-a958-6cd14909a086 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:04.996361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81085425-dc6d-499b-a958-6cd14909a086 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:04.998569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81085425-dc6d-499b-a958-6cd14909a086 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:05.003335 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81085425-dc6d-499b-a958-6cd14909a086 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:05.009176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:05.545833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9092f719-dcb2-4bf8-ba59-51edf60bcff4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:05.561587 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9092f719-dcb2-4bf8-ba59-51edf60bcff4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1321 microversion: 2.1 time: 0.705846 May 27 15:11:05.562614 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1693/3369] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:04 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1321 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:05.572385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c33cf871-1ee0-4172-8057-840522057d12 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:05.576459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c33cf871-1ee0-4172-8057-840522057d12 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:05.590657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c33cf871-1ee0-4172-8057-840522057d12 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:05.591473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c33cf871-1ee0-4172-8057-840522057d12 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:05.593870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c33cf871-1ee0-4172-8057-840522057d12 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:05.595321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c33cf871-1ee0-4172-8057-840522057d12 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:05.647369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-81085425-dc6d-499b-a958-6cd14909a086 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:05.665980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-81085425-dc6d-499b-a958-6cd14909a086 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:05.669169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-81085425-dc6d-499b-a958-6cd14909a086 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:05.673758 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-81085425-dc6d-499b-a958-6cd14909a086 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.700203 May 27 15:11:05.674576 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1677/3370] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:04 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:11:05.679871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-399869e3-9853-46f4-aba4-f94b2e44f0f8 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:05.680968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-399869e3-9853-46f4-aba4-f94b2e44f0f8 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:05.693321 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c33cf871-1ee0-4172-8057-840522057d12 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127724 May 27 15:11:05.699610 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1694/3371] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:11:05 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:05.705986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0afb8ee8-727b-4e6d-9eef-20ee69b2f6a8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:05.706610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0afb8ee8-727b-4e6d-9eef-20ee69b2f6a8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:05.712818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-399869e3-9853-46f4-aba4-f94b2e44f0f8 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:05.713800 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-399869e3-9853-46f4-aba4-f94b2e44f0f8 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:05.714872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-399869e3-9853-46f4-aba4-f94b2e44f0f8 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:05.715520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-399869e3-9853-46f4-aba4-f94b2e44f0f8 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:05.725656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0afb8ee8-727b-4e6d-9eef-20ee69b2f6a8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:05.733402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0afb8ee8-727b-4e6d-9eef-20ee69b2f6a8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:05.735440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0afb8ee8-727b-4e6d-9eef-20ee69b2f6a8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:05.736206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0afb8ee8-727b-4e6d-9eef-20ee69b2f6a8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:05.829016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:05.854551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-399869e3-9853-46f4-aba4-f94b2e44f0f8 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:05.872458 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-399869e3-9853-46f4-aba4-f94b2e44f0f8 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:05.883839 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-399869e3-9853-46f4-aba4-f94b2e44f0f8 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:05.887579 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-399869e3-9853-46f4-aba4-f94b2e44f0f8 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1357 microversion: 2.47 time: 0.209465 May 27 15:11:05.896638 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1678/3372] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:05 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:05.921401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-90ef976f-2b90-4f18-bf83-f1246335bb19 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:05.923074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-90ef976f-2b90-4f18-bf83-f1246335bb19 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:05.941298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90ef976f-2b90-4f18-bf83-f1246335bb19 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:05.942255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90ef976f-2b90-4f18-bf83-f1246335bb19 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:05.943595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90ef976f-2b90-4f18-bf83-f1246335bb19 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:05.946560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90ef976f-2b90-4f18-bf83-f1246335bb19 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:06.155801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0afb8ee8-727b-4e6d-9eef-20ee69b2f6a8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:06.168020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0afb8ee8-727b-4e6d-9eef-20ee69b2f6a8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:06.169199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-90ef976f-2b90-4f18-bf83-f1246335bb19 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:06.170876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0afb8ee8-727b-4e6d-9eef-20ee69b2f6a8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:06.172520 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0afb8ee8-727b-4e6d-9eef-20ee69b2f6a8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1723 microversion: 2.20 time: 0.471495 May 27 15:11:06.177839 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-90ef976f-2b90-4f18-bf83-f1246335bb19 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.278973 May 27 15:11:06.178429 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1679/3373] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:05 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:06.185198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-efd66a32-e5a8-4cb3-84d9-b1544ac34a39 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "346e776e-8931-417f-87da-575810efb12b"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:06.187594 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1695/3374] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:05 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1723 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:06.198884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-efd66a32-e5a8-4cb3-84d9-b1544ac34a39 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:06.211419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efd66a32-e5a8-4cb3-84d9-b1544ac34a39 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:06.212345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efd66a32-e5a8-4cb3-84d9-b1544ac34a39 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:06.213818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efd66a32-e5a8-4cb3-84d9-b1544ac34a39 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:06.214539 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efd66a32-e5a8-4cb3-84d9-b1544ac34a39 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:06.307977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-efd66a32-e5a8-4cb3-84d9-b1544ac34a39 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:11:06.308405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-efd66a32-e5a8-4cb3-84d9-b1544ac34a39 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:11:06.308910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-efd66a32-e5a8-4cb3-84d9-b1544ac34a39 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:11:06.309328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-efd66a32-e5a8-4cb3-84d9-b1544ac34a39 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:11:06.309750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-efd66a32-e5a8-4cb3-84d9-b1544ac34a39 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:11:06.418058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-efd66a32-e5a8-4cb3-84d9-b1544ac34a39 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:06.432614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efd66a32-e5a8-4cb3-84d9-b1544ac34a39 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:06.434223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efd66a32-e5a8-4cb3-84d9-b1544ac34a39 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:06.436353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efd66a32-e5a8-4cb3-84d9-b1544ac34a39 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:06.438303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efd66a32-e5a8-4cb3-84d9-b1544ac34a39 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:06.512004 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-efd66a32-e5a8-4cb3-84d9-b1544ac34a39 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "POST /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43/action" status: 202 len: 1079 microversion: 2.47 time: 0.331357 May 27 15:11:06.514273 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1680/3375] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 27 15:11:06 2022] POST /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43/action => generated 1079 bytes in 335 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 27 15:11:06.530154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c5d9a90d-4209-45b2-a557-952158957c4e tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:06.531068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c5d9a90d-4209-45b2-a557-952158957c4e tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:06.537610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c5d9a90d-4209-45b2-a557-952158957c4e tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:06.538388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c5d9a90d-4209-45b2-a557-952158957c4e tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:06.540254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c5d9a90d-4209-45b2-a557-952158957c4e tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:06.540951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c5d9a90d-4209-45b2-a557-952158957c4e tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:06.591146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3b01dd4e-3db6-40f2-803e-14237797e12e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:06.593053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3b01dd4e-3db6-40f2-803e-14237797e12e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:06.618303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b01dd4e-3db6-40f2-803e-14237797e12e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:06.618569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b01dd4e-3db6-40f2-803e-14237797e12e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:06.623203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b01dd4e-3db6-40f2-803e-14237797e12e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:06.626596 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b01dd4e-3db6-40f2-803e-14237797e12e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:06.650501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c5d9a90d-4209-45b2-a557-952158957c4e tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:06.671711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c5d9a90d-4209-45b2-a557-952158957c4e tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:06.674899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c5d9a90d-4209-45b2-a557-952158957c4e tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:06.679020 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c5d9a90d-4209-45b2-a557-952158957c4e tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.152875 May 27 15:11:06.681138 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1696/3376] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:06 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:06.721638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0bd4c431-20ee-4dd0-ab73-eeb9979d2bfe tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:06.722396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0bd4c431-20ee-4dd0-ab73-eeb9979d2bfe tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:06.739379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bd4c431-20ee-4dd0-ab73-eeb9979d2bfe tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:06.741171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bd4c431-20ee-4dd0-ab73-eeb9979d2bfe tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:06.742065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bd4c431-20ee-4dd0-ab73-eeb9979d2bfe tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:06.745044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bd4c431-20ee-4dd0-ab73-eeb9979d2bfe tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:06.926874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3b01dd4e-3db6-40f2-803e-14237797e12e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:06.935053 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3b01dd4e-3db6-40f2-803e-14237797e12e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1321 microversion: 2.1 time: 0.358387 May 27 15:11:06.947473 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1681/3377] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:06 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1321 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:06.947473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fc0b436a-dfc8-499f-b294-1d2f158739c2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:06.947473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fc0b436a-dfc8-499f-b294-1d2f158739c2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:06.953358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc0b436a-dfc8-499f-b294-1d2f158739c2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:06.953818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc0b436a-dfc8-499f-b294-1d2f158739c2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:06.954598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc0b436a-dfc8-499f-b294-1d2f158739c2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:06.955067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc0b436a-dfc8-499f-b294-1d2f158739c2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:07.007556 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fc0b436a-dfc8-499f-b294-1d2f158739c2 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068384 May 27 15:11:07.008500 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1682/3378] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:11:06 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:07.109129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0bd4c431-20ee-4dd0-ab73-eeb9979d2bfe tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:07.118828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0bd4c431-20ee-4dd0-ab73-eeb9979d2bfe tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:07.120808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0bd4c431-20ee-4dd0-ab73-eeb9979d2bfe tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:07.122064 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0bd4c431-20ee-4dd0-ab73-eeb9979d2bfe tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.428629 May 27 15:11:07.123142 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1697/3379] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:06 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:11:07.196485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-58f96d66-5433-4d2e-bff7-7147e2221408 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:07.197603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-58f96d66-5433-4d2e-bff7-7147e2221408 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:07.204036 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-18c3b59e-65dd-4c75-a345-8f16d7baa04c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:07.205121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-18c3b59e-65dd-4c75-a345-8f16d7baa04c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:07.208693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:07.209910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=16 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:07.212924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58f96d66-5433-4d2e-bff7-7147e2221408 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:07.213390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58f96d66-5433-4d2e-bff7-7147e2221408 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:07.214955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58f96d66-5433-4d2e-bff7-7147e2221408 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:07.215547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58f96d66-5433-4d2e-bff7-7147e2221408 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:07.231416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18c3b59e-65dd-4c75-a345-8f16d7baa04c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:07.237576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18c3b59e-65dd-4c75-a345-8f16d7baa04c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:07.239410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18c3b59e-65dd-4c75-a345-8f16d7baa04c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:07.240773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18c3b59e-65dd-4c75-a345-8f16d7baa04c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:07.615773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-18c3b59e-65dd-4c75-a345-8f16d7baa04c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:07.631094 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-18c3b59e-65dd-4c75-a345-8f16d7baa04c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.430261 May 27 15:11:07.640386 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1698/3380] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:07 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:07.656699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-58f96d66-5433-4d2e-bff7-7147e2221408 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:07.665384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-58f96d66-5433-4d2e-bff7-7147e2221408 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:07.667018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-58f96d66-5433-4d2e-bff7-7147e2221408 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:07.668398 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-58f96d66-5433-4d2e-bff7-7147e2221408 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1723 microversion: 2.20 time: 0.480925 May 27 15:11:07.682246 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1683/3381] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:07 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1723 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:07.700473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e8893fcc-b03d-4158-b896-138638b8011b tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:07.701125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e8893fcc-b03d-4158-b896-138638b8011b tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:07.711603 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e8893fcc-b03d-4158-b896-138638b8011b tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:07.712343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e8893fcc-b03d-4158-b896-138638b8011b tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:07.713334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e8893fcc-b03d-4158-b896-138638b8011b tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:07.714217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e8893fcc-b03d-4158-b896-138638b8011b tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:07.748207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=20 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:07.850600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e8893fcc-b03d-4158-b896-138638b8011b tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:07.866043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e8893fcc-b03d-4158-b896-138638b8011b tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:07.868235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e8893fcc-b03d-4158-b896-138638b8011b tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:07.875675 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e8893fcc-b03d-4158-b896-138638b8011b tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.175441 May 27 15:11:07.879000 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1699/3382] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:07 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:11:07.956468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d28f7fd2-0db4-4eef-9791-11a2434bd79f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:07.958303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d28f7fd2-0db4-4eef-9791-11a2434bd79f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:07.983835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d28f7fd2-0db4-4eef-9791-11a2434bd79f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:07.984808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d28f7fd2-0db4-4eef-9791-11a2434bd79f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:07.989959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d28f7fd2-0db4-4eef-9791-11a2434bd79f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:07.990433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d28f7fd2-0db4-4eef-9791-11a2434bd79f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:08.021588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d271f2f9-08da-4e06-b88c-89e621ef18d7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:08.023479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d271f2f9-08da-4e06-b88c-89e621ef18d7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:08.049167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d271f2f9-08da-4e06-b88c-89e621ef18d7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:08.051758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d271f2f9-08da-4e06-b88c-89e621ef18d7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:08.055090 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d271f2f9-08da-4e06-b88c-89e621ef18d7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:08.056297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d271f2f9-08da-4e06-b88c-89e621ef18d7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:08.184590 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d271f2f9-08da-4e06-b88c-89e621ef18d7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169465 May 27 15:11:08.189993 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1700/3383] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:11:08 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:11:08.201020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-bbd06f56-57ea-4e6c-9bdd-e62204a59c66 req-453cbed8-70fc-4295-b37f-42ec72bbde88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce756610-6a39-4f3b-97c5-79cac2fdf255", "name": "network-vif-plugged", "status": "completed", "tag": "0deb9a0e-386b-404a-a01a-85e6358417ef"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:08.214907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-bbd06f56-57ea-4e6c-9bdd-e62204a59c66 req-453cbed8-70fc-4295-b37f-42ec72bbde88 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:08.215650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-bbd06f56-57ea-4e6c-9bdd-e62204a59c66 req-453cbed8-70fc-4295-b37f-42ec72bbde88 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:08.226394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d28f7fd2-0db4-4eef-9791-11a2434bd79f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:08.229994 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-bbd06f56-57ea-4e6c-9bdd-e62204a59c66 req-453cbed8-70fc-4295-b37f-42ec72bbde88 service nova] Creating event network-vif-plugged:0deb9a0e-386b-404a-a01a-85e6358417ef for instance ce756610-6a39-4f3b-97c5-79cac2fdf255 on n-h1-843621-1 May 27 15:11:08.235352 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d28f7fd2-0db4-4eef-9791-11a2434bd79f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1321 microversion: 2.1 time: 0.284288 May 27 15:11:08.236815 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-bbd06f56-57ea-4e6c-9bdd-e62204a59c66 req-453cbed8-70fc-4295-b37f-42ec72bbde88 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045269 May 27 15:11:08.248019 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1684/3385] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:07 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:08.248019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-540b425b-205f-402d-8c6c-8bf9db6a70fc tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:08.248019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-540b425b-205f-402d-8c6c-8bf9db6a70fc tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:08.249154 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1701/3385] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:08.259564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-540b425b-205f-402d-8c6c-8bf9db6a70fc tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:08.260797 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-540b425b-205f-402d-8c6c-8bf9db6a70fc tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:08.262103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-540b425b-205f-402d-8c6c-8bf9db6a70fc tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:08.262718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-540b425b-205f-402d-8c6c-8bf9db6a70fc tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:08.543982 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-540b425b-205f-402d-8c6c-8bf9db6a70fc tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:08.560122 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-540b425b-205f-402d-8c6c-8bf9db6a70fc tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:08.562120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-540b425b-205f-402d-8c6c-8bf9db6a70fc tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:08.563526 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-540b425b-205f-402d-8c6c-8bf9db6a70fc tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.321486 May 27 15:11:08.564322 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1685/3386] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:08 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:08.655026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9036ce4c-6b4c-4ad0-8b86-2909941666d1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:08.655733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9036ce4c-6b4c-4ad0-8b86-2909941666d1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:08.662676 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9036ce4c-6b4c-4ad0-8b86-2909941666d1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:08.663287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9036ce4c-6b4c-4ad0-8b86-2909941666d1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:08.664340 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9036ce4c-6b4c-4ad0-8b86-2909941666d1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:08.664912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9036ce4c-6b4c-4ad0-8b86-2909941666d1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:08.688040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6c694527-71c4-42a2-a65a-e4793d56175f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:08.688797 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6c694527-71c4-42a2-a65a-e4793d56175f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:08.699522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6c694527-71c4-42a2-a65a-e4793d56175f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:08.702787 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6c694527-71c4-42a2-a65a-e4793d56175f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:08.703706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6c694527-71c4-42a2-a65a-e4793d56175f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:08.704411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6c694527-71c4-42a2-a65a-e4793d56175f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:08.925766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9036ce4c-6b4c-4ad0-8b86-2909941666d1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:08.939318 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9036ce4c-6b4c-4ad0-8b86-2909941666d1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.290129 May 27 15:11:08.941314 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1702/3387] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:08 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:11:08.950934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e5bb19f-c6ae-4d6b-a7bb-2fd697369c38 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:08.951998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e5bb19f-c6ae-4d6b-a7bb-2fd697369c38 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:08.960073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e5bb19f-c6ae-4d6b-a7bb-2fd697369c38 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:08.962313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e5bb19f-c6ae-4d6b-a7bb-2fd697369c38 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:08.963662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e5bb19f-c6ae-4d6b-a7bb-2fd697369c38 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:08.964768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e5bb19f-c6ae-4d6b-a7bb-2fd697369c38 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:08.991964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6c694527-71c4-42a2-a65a-e4793d56175f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:09.018573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6c694527-71c4-42a2-a65a-e4793d56175f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:09.020151 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6c694527-71c4-42a2-a65a-e4793d56175f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:09.022000 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6c694527-71c4-42a2-a65a-e4793d56175f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1723 microversion: 2.20 time: 0.338588 May 27 15:11:09.028489 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1686/3388] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:08 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1723 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:09.097250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e5bb19f-c6ae-4d6b-a7bb-2fd697369c38 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:09.110388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e5bb19f-c6ae-4d6b-a7bb-2fd697369c38 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:09.112602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e5bb19f-c6ae-4d6b-a7bb-2fd697369c38 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:09.114092 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e5bb19f-c6ae-4d6b-a7bb-2fd697369c38 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.171361 May 27 15:11:09.114773 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1703/3389] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:08 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:09.203983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6c8ac448-f5cc-44a4-95ce-2b75c765edf4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:09.206128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6c8ac448-f5cc-44a4-95ce-2b75c765edf4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:09.214687 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6c8ac448-f5cc-44a4-95ce-2b75c765edf4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:09.215361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6c8ac448-f5cc-44a4-95ce-2b75c765edf4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:09.216418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6c8ac448-f5cc-44a4-95ce-2b75c765edf4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:09.217004 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6c8ac448-f5cc-44a4-95ce-2b75c765edf4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:09.254031 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6c8ac448-f5cc-44a4-95ce-2b75c765edf4 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054105 May 27 15:11:09.255368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0a980f96-91f1-4d33-825b-b25466af6903 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:09.260190 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1687/3390] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:11:09 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:09.260877 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0a980f96-91f1-4d33-825b-b25466af6903 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:09.267531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a980f96-91f1-4d33-825b-b25466af6903 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:09.268288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a980f96-91f1-4d33-825b-b25466af6903 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:09.269201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a980f96-91f1-4d33-825b-b25466af6903 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:09.269727 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a980f96-91f1-4d33-825b-b25466af6903 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:09.452381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0a980f96-91f1-4d33-825b-b25466af6903 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:09.460842 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0a980f96-91f1-4d33-825b-b25466af6903 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1321 microversion: 2.1 time: 0.209412 May 27 15:11:09.461808 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1704/3391] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:09 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:09.586019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-85480e90-b3a8-46f3-82b0-c1dc10408660 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:09.587516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-85480e90-b3a8-46f3-82b0-c1dc10408660 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:09.597895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85480e90-b3a8-46f3-82b0-c1dc10408660 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:09.598546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85480e90-b3a8-46f3-82b0-c1dc10408660 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:09.599909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85480e90-b3a8-46f3-82b0-c1dc10408660 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:09.601322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85480e90-b3a8-46f3-82b0-c1dc10408660 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:09.868136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-85480e90-b3a8-46f3-82b0-c1dc10408660 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:09.878670 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-85480e90-b3a8-46f3-82b0-c1dc10408660 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:09.880295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-85480e90-b3a8-46f3-82b0-c1dc10408660 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:09.881609 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-85480e90-b3a8-46f3-82b0-c1dc10408660 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.302025 May 27 15:11:09.882168 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1688/3392] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:09 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:09.968070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bf7d6ee9-bf5c-49cb-b397-dd525a88f5b9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:09.969379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bf7d6ee9-bf5c-49cb-b397-dd525a88f5b9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:09.982674 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf7d6ee9-bf5c-49cb-b397-dd525a88f5b9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:09.983895 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf7d6ee9-bf5c-49cb-b397-dd525a88f5b9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:09.985652 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf7d6ee9-bf5c-49cb-b397-dd525a88f5b9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:09.986480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf7d6ee9-bf5c-49cb-b397-dd525a88f5b9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:10.053565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dba41075-2695-4ff4-9096-9d02e6efc0c9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:10.056285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dba41075-2695-4ff4-9096-9d02e6efc0c9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:10.103696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dba41075-2695-4ff4-9096-9d02e6efc0c9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:10.112419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dba41075-2695-4ff4-9096-9d02e6efc0c9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:10.114174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dba41075-2695-4ff4-9096-9d02e6efc0c9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:10.115954 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dba41075-2695-4ff4-9096-9d02e6efc0c9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:10.370085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bf7d6ee9-bf5c-49cb-b397-dd525a88f5b9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:10.379555 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bf7d6ee9-bf5c-49cb-b397-dd525a88f5b9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.420623 May 27 15:11:10.380432 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1705/3393] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:09 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:10.387240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bf6ba22b-1314-4404-8417-e52e0f4c6291 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:10.388242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bf6ba22b-1314-4404-8417-e52e0f4c6291 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:10.396493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf6ba22b-1314-4404-8417-e52e0f4c6291 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:10.397419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf6ba22b-1314-4404-8417-e52e0f4c6291 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:10.398469 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf6ba22b-1314-4404-8417-e52e0f4c6291 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:10.399529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf6ba22b-1314-4404-8417-e52e0f4c6291 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:10.422462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dba41075-2695-4ff4-9096-9d02e6efc0c9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:10.444311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dba41075-2695-4ff4-9096-9d02e6efc0c9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:10.448880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dba41075-2695-4ff4-9096-9d02e6efc0c9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:10.451308 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dba41075-2695-4ff4-9096-9d02e6efc0c9 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1723 microversion: 2.20 time: 0.405461 May 27 15:11:10.467396 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1689/3394] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:10 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1723 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:10.476587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-99b331da-ccdc-442c-83fe-5c5f2a2f4b3c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:10.479519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-99b331da-ccdc-442c-83fe-5c5f2a2f4b3c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:10.494717 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99b331da-ccdc-442c-83fe-5c5f2a2f4b3c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:10.495834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99b331da-ccdc-442c-83fe-5c5f2a2f4b3c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:10.496983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99b331da-ccdc-442c-83fe-5c5f2a2f4b3c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:10.497817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99b331da-ccdc-442c-83fe-5c5f2a2f4b3c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:10.532092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bf6ba22b-1314-4404-8417-e52e0f4c6291 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:10.552721 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-99b331da-ccdc-442c-83fe-5c5f2a2f4b3c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093177 May 27 15:11:10.553936 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1690/3395] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:11:10 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:10.559785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bf6ba22b-1314-4404-8417-e52e0f4c6291 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:10.562830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e04e9bca-03d1-41c6-ba6b-8d80422f1159 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:10.563638 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e04e9bca-03d1-41c6-ba6b-8d80422f1159 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:10.564206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bf6ba22b-1314-4404-8417-e52e0f4c6291 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:10.567125 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bf6ba22b-1314-4404-8417-e52e0f4c6291 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.184927 May 27 15:11:10.569707 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1706/3396] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:10 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:10.574488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e04e9bca-03d1-41c6-ba6b-8d80422f1159 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:10.575560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e04e9bca-03d1-41c6-ba6b-8d80422f1159 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:10.576920 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e04e9bca-03d1-41c6-ba6b-8d80422f1159 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:10.578390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e04e9bca-03d1-41c6-ba6b-8d80422f1159 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:10.786285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e04e9bca-03d1-41c6-ba6b-8d80422f1159 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:10.790990 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:10.811494 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e04e9bca-03d1-41c6-ba6b-8d80422f1159 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1321 microversion: 2.1 time: 0.256259 May 27 15:11:10.852780 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1691/3397] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:10 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:10.906030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3a2e40e6-a64c-4018-91ef-ce677cf69a83 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:10.915196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3a2e40e6-a64c-4018-91ef-ce677cf69a83 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:10.939989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a2e40e6-a64c-4018-91ef-ce677cf69a83 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:10.940483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a2e40e6-a64c-4018-91ef-ce677cf69a83 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:10.941313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a2e40e6-a64c-4018-91ef-ce677cf69a83 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:10.941756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a2e40e6-a64c-4018-91ef-ce677cf69a83 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:11.414700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ab226426-49d9-4cb7-ac1b-6718cd5fd1de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:11.416443 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ab226426-49d9-4cb7-ac1b-6718cd5fd1de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:11.430332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab226426-49d9-4cb7-ac1b-6718cd5fd1de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:11.431094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab226426-49d9-4cb7-ac1b-6718cd5fd1de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:11.431613 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab226426-49d9-4cb7-ac1b-6718cd5fd1de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:11.434065 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab226426-49d9-4cb7-ac1b-6718cd5fd1de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:11.697013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3a2e40e6-a64c-4018-91ef-ce677cf69a83 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:11.705987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3a2e40e6-a64c-4018-91ef-ce677cf69a83 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:11.708629 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3a2e40e6-a64c-4018-91ef-ce677cf69a83 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:11.715075 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3a2e40e6-a64c-4018-91ef-ce677cf69a83 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.815943 May 27 15:11:11.729266 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1707/3398] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:10 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:11.746796 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-44b00777-6404-4f53-a4fb-34bd5abb18ac tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:11.748075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-44b00777-6404-4f53-a4fb-34bd5abb18ac tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:11.762486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:11.764665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44b00777-6404-4f53-a4fb-34bd5abb18ac tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:11.765348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44b00777-6404-4f53-a4fb-34bd5abb18ac tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:11.766544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44b00777-6404-4f53-a4fb-34bd5abb18ac tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:11.767187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44b00777-6404-4f53-a4fb-34bd5abb18ac tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:11.839576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ab226426-49d9-4cb7-ac1b-6718cd5fd1de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:11.850692 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ab226426-49d9-4cb7-ac1b-6718cd5fd1de tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.442045 May 27 15:11:11.851312 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1692/3399] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:11 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:11.868500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3acdd9e3-1712-423b-99b5-4244632d3db8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:11.870303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3acdd9e3-1712-423b-99b5-4244632d3db8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:11.884891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3acdd9e3-1712-423b-99b5-4244632d3db8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:11.888895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3acdd9e3-1712-423b-99b5-4244632d3db8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:11.890256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3acdd9e3-1712-423b-99b5-4244632d3db8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:11.890988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3acdd9e3-1712-423b-99b5-4244632d3db8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:11.956715 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3acdd9e3-1712-423b-99b5-4244632d3db8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092463 May 27 15:11:11.958342 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1693/3400] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:11:11 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:11.978649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ab0ddbf3-aa8d-44e2-9351-5fe28545affe tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:11.979279 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ab0ddbf3-aa8d-44e2-9351-5fe28545affe tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:11.989502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab0ddbf3-aa8d-44e2-9351-5fe28545affe tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:11.990272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab0ddbf3-aa8d-44e2-9351-5fe28545affe tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:11.992826 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab0ddbf3-aa8d-44e2-9351-5fe28545affe tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:11.993463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab0ddbf3-aa8d-44e2-9351-5fe28545affe tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:12.071100 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-44b00777-6404-4f53-a4fb-34bd5abb18ac tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:12.103158 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-44b00777-6404-4f53-a4fb-34bd5abb18ac tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:12.107039 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-44b00777-6404-4f53-a4fb-34bd5abb18ac tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:12.110898 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-44b00777-6404-4f53-a4fb-34bd5abb18ac tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1723 microversion: 2.20 time: 0.379897 May 27 15:11:12.114678 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1708/3401] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:11 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1723 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:12.121243 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bad3b8fb-f3aa-4e63-b473-816cce03091f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:12.122373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bad3b8fb-f3aa-4e63-b473-816cce03091f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:12.129277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bad3b8fb-f3aa-4e63-b473-816cce03091f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:12.133354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bad3b8fb-f3aa-4e63-b473-816cce03091f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:12.134873 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bad3b8fb-f3aa-4e63-b473-816cce03091f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:12.135536 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bad3b8fb-f3aa-4e63-b473-816cce03091f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:12.176611 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ab0ddbf3-aa8d-44e2-9351-5fe28545affe tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:12.193460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ab0ddbf3-aa8d-44e2-9351-5fe28545affe tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:12.199941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ab0ddbf3-aa8d-44e2-9351-5fe28545affe tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:12.202022 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ab0ddbf3-aa8d-44e2-9351-5fe28545affe tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.242361 May 27 15:11:12.203097 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1694/3402] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:11 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:12.211857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-272db389-e742-4cb2-b7e6-56f74214db36 req-56662e7d-a321-44b5-b7ff-e9d693c907f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9", "name": "network-vif-plugged", "status": "completed", "tag": "060a8f37-46b9-487a-83a1-ccabf5cd0958"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:12.231725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-272db389-e742-4cb2-b7e6-56f74214db36 req-56662e7d-a321-44b5-b7ff-e9d693c907f2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:12.232926 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-272db389-e742-4cb2-b7e6-56f74214db36 req-56662e7d-a321-44b5-b7ff-e9d693c907f2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:12.256140 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-272db389-e742-4cb2-b7e6-56f74214db36 req-56662e7d-a321-44b5-b7ff-e9d693c907f2 service nova] Creating event network-vif-plugged:060a8f37-46b9-487a-83a1-ccabf5cd0958 for instance f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9 on n-h2-843621-1 May 27 15:11:12.265942 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-272db389-e742-4cb2-b7e6-56f74214db36 req-56662e7d-a321-44b5-b7ff-e9d693c907f2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060250 May 27 15:11:12.268068 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1695/3403] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:12.388126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bad3b8fb-f3aa-4e63-b473-816cce03091f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:12.393483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:12.408582 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bad3b8fb-f3aa-4e63-b473-816cce03091f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1321 microversion: 2.1 time: 0.292246 May 27 15:11:12.411759 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1709/3404] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:12 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:12.563854 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0a28bfd3-392a-47a1-9674-3601ee2b6579 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1061140134", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "d3935e5b-c47f-4af9-b101-9637f24f8d89"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:12.636424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-0a28bfd3-392a-47a1-9674-3601ee2b6579 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] validate_networks() for [('d3935e5b-c47f-4af9-b101-9637f24f8d89', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:11:12.737702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9b1ea853-90a4-4cd8-ab5a-058761c07524 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:12.739184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9b1ea853-90a4-4cd8-ab5a-058761c07524 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:12.750170 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b1ea853-90a4-4cd8-ab5a-058761c07524 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:12.750927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b1ea853-90a4-4cd8-ab5a-058761c07524 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:12.754458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b1ea853-90a4-4cd8-ab5a-058761c07524 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:12.755626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b1ea853-90a4-4cd8-ab5a-058761c07524 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:13.095084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9b1ea853-90a4-4cd8-ab5a-058761c07524 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:13.108747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9b1ea853-90a4-4cd8-ab5a-058761c07524 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:13.111705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9b1ea853-90a4-4cd8-ab5a-058761c07524 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:13.113066 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9b1ea853-90a4-4cd8-ab5a-058761c07524 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.379446 May 27 15:11:13.113990 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1710/3405] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:12 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:13.120162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e2891e0a-1be6-4e54-ad0f-eaae4f7632b4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:13.121641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e2891e0a-1be6-4e54-ad0f-eaae4f7632b4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:13.128558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2891e0a-1be6-4e54-ad0f-eaae4f7632b4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:13.129097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2891e0a-1be6-4e54-ad0f-eaae4f7632b4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:13.130009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2891e0a-1be6-4e54-ad0f-eaae4f7632b4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:13.130655 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2891e0a-1be6-4e54-ad0f-eaae4f7632b4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:13.273292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-0a28bfd3-392a-47a1-9674-3601ee2b6579 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:11:13.274109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-0a28bfd3-392a-47a1-9674-3601ee2b6579 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:11:13.274776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-0a28bfd3-392a-47a1-9674-3601ee2b6579 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:11:13.275199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-0a28bfd3-392a-47a1-9674-3601ee2b6579 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:11:13.275622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-0a28bfd3-392a-47a1-9674-3601ee2b6579 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:11:13.291680 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a28bfd3-392a-47a1-9674-3601ee2b6579 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:13.292141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a28bfd3-392a-47a1-9674-3601ee2b6579 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:13.292988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a28bfd3-392a-47a1-9674-3601ee2b6579 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:13.293429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a28bfd3-392a-47a1-9674-3601ee2b6579 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:13.337705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-0a28bfd3-392a-47a1-9674-3601ee2b6579 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Getting quotas for project e92d4c75b7c44b1e87448d9bdf9621ae. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:11:13.345087 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-0a28bfd3-392a-47a1-9674-3601ee2b6579 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Getting quotas for user 48c676b007f0451f98480c38ec373df3 and project e92d4c75b7c44b1e87448d9bdf9621ae. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:11:13.380624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0a28bfd3-392a-47a1-9674-3601ee2b6579 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:11:13.384420 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0a28bfd3-392a-47a1-9674-3601ee2b6579 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] [instance: e91050bc-2362-4bbb-bd3f-2c4c3449d244] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:11:13.393449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e2891e0a-1be6-4e54-ad0f-eaae4f7632b4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:13.402239 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e2891e0a-1be6-4e54-ad0f-eaae4f7632b4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.286948 May 27 15:11:13.403737 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1711/3406] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:13 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:13.409007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8d6c6a51-3adb-4ae5-8f0d-0a548ecd40ef tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:13.410155 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8d6c6a51-3adb-4ae5-8f0d-0a548ecd40ef tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:13.417802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d6c6a51-3adb-4ae5-8f0d-0a548ecd40ef tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:13.418409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d6c6a51-3adb-4ae5-8f0d-0a548ecd40ef tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:13.419302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d6c6a51-3adb-4ae5-8f0d-0a548ecd40ef tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:13.419302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d6c6a51-3adb-4ae5-8f0d-0a548ecd40ef tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:13.456461 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0a28bfd3-392a-47a1-9674-3601ee2b6579 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.165738 May 27 15:11:13.457754 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1696/3407] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:11:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:11:13.463236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-862a3978-bfd7-4586-9144-bfcfe5ca10b8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:13.464115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-862a3978-bfd7-4586-9144-bfcfe5ca10b8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:13.471517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-862a3978-bfd7-4586-9144-bfcfe5ca10b8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:13.471978 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-862a3978-bfd7-4586-9144-bfcfe5ca10b8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:13.472801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-862a3978-bfd7-4586-9144-bfcfe5ca10b8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:13.473250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-862a3978-bfd7-4586-9144-bfcfe5ca10b8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:13.491937 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8d6c6a51-3adb-4ae5-8f0d-0a548ecd40ef tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086474 May 27 15:11:13.493732 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1712/3408] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:11:13 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:13.503740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bbddb480-6201-40dc-b56e-69c7f9ea3bae tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:13.504704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bbddb480-6201-40dc-b56e-69c7f9ea3bae tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:13.519249 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bbddb480-6201-40dc-b56e-69c7f9ea3bae tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:13.520524 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bbddb480-6201-40dc-b56e-69c7f9ea3bae tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:13.525268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bbddb480-6201-40dc-b56e-69c7f9ea3bae tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:13.526600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bbddb480-6201-40dc-b56e-69c7f9ea3bae tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:13.691139 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bbddb480-6201-40dc-b56e-69c7f9ea3bae tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:13.696850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-862a3978-bfd7-4586-9144-bfcfe5ca10b8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:13.704014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bbddb480-6201-40dc-b56e-69c7f9ea3bae tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:13.706055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bbddb480-6201-40dc-b56e-69c7f9ea3bae tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:13.707347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-862a3978-bfd7-4586-9144-bfcfe5ca10b8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:13.707989 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bbddb480-6201-40dc-b56e-69c7f9ea3bae tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.212178 May 27 15:11:13.710660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-862a3978-bfd7-4586-9144-bfcfe5ca10b8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:13.711998 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1713/3409] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:13 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:13.712840 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-862a3978-bfd7-4586-9144-bfcfe5ca10b8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1723 microversion: 2.20 time: 0.253821 May 27 15:11:13.713691 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1697/3410] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:13 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:13.718581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dc110c86-6c8b-491f-a711-55f28032589f tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:13.719400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dc110c86-6c8b-491f-a711-55f28032589f tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] [instance: e91050bc-2362-4bbb-bd3f-2c4c3449d244] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:13.741212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0abc9239-13b7-4f5a-b69e-0a0d26b77ac3 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:13.742810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0abc9239-13b7-4f5a-b69e-0a0d26b77ac3 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:13.751093 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0abc9239-13b7-4f5a-b69e-0a0d26b77ac3 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:13.751591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0abc9239-13b7-4f5a-b69e-0a0d26b77ac3 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:13.752387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0abc9239-13b7-4f5a-b69e-0a0d26b77ac3 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:13.752957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0abc9239-13b7-4f5a-b69e-0a0d26b77ac3 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:13.823059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dc110c86-6c8b-491f-a711-55f28032589f tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c676b007f0451f98480c38ec373df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d4c75b7c44b1e87448d9bdf9621ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:13.833925 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dc110c86-6c8b-491f-a711-55f28032589f tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] 10.222.0.13 "GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244" status: 200 len: 1225 microversion: 2.1 time: 0.118801 May 27 15:11:13.835102 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1698/3411] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:13 2022] GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244 => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:13.990275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0abc9239-13b7-4f5a-b69e-0a0d26b77ac3 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:14.009124 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0abc9239-13b7-4f5a-b69e-0a0d26b77ac3 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1321 microversion: 2.1 time: 0.295117 May 27 15:11:14.010140 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1714/3412] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:13 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:14.144020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-30313007-00ff-4380-87ab-b1bd940d59fd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:14.145699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-30313007-00ff-4380-87ab-b1bd940d59fd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:14.157650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30313007-00ff-4380-87ab-b1bd940d59fd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:14.158378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30313007-00ff-4380-87ab-b1bd940d59fd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:14.160245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30313007-00ff-4380-87ab-b1bd940d59fd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:14.161579 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30313007-00ff-4380-87ab-b1bd940d59fd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:14.408601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-30313007-00ff-4380-87ab-b1bd940d59fd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:14.420279 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-30313007-00ff-4380-87ab-b1bd940d59fd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:14.429186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-10fe4a2a-cd99-46a2-b57d-3ecd59e05eca tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:14.430369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-10fe4a2a-cd99-46a2-b57d-3ecd59e05eca tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:14.437750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-30313007-00ff-4380-87ab-b1bd940d59fd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:14.439972 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-30313007-00ff-4380-87ab-b1bd940d59fd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.308589 May 27 15:11:14.440197 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1699/3413] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:14 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:14.452072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10fe4a2a-cd99-46a2-b57d-3ecd59e05eca tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:14.452536 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10fe4a2a-cd99-46a2-b57d-3ecd59e05eca tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:14.453456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10fe4a2a-cd99-46a2-b57d-3ecd59e05eca tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:14.453926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10fe4a2a-cd99-46a2-b57d-3ecd59e05eca tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:14.514641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bd52f77e-6c25-4d46-a1e3-c7a671da78f9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:14.516141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bd52f77e-6c25-4d46-a1e3-c7a671da78f9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:14.537830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd52f77e-6c25-4d46-a1e3-c7a671da78f9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:14.538621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd52f77e-6c25-4d46-a1e3-c7a671da78f9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:14.540471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd52f77e-6c25-4d46-a1e3-c7a671da78f9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:14.541303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd52f77e-6c25-4d46-a1e3-c7a671da78f9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:14.606907 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bd52f77e-6c25-4d46-a1e3-c7a671da78f9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105444 May 27 15:11:14.611472 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1700/3414] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:11:14 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:11:14.663483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-10fe4a2a-cd99-46a2-b57d-3ecd59e05eca tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:14.671875 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-10fe4a2a-cd99-46a2-b57d-3ecd59e05eca tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.248880 May 27 15:11:14.672462 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1715/3415] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:14 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:11:14.732637 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-78f3f7e0-b3b2-475b-8886-c31fa5055926 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:14.733410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-78f3f7e0-b3b2-475b-8886-c31fa5055926 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:14.740659 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78f3f7e0-b3b2-475b-8886-c31fa5055926 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:14.741146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78f3f7e0-b3b2-475b-8886-c31fa5055926 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:14.742156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78f3f7e0-b3b2-475b-8886-c31fa5055926 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:14.742708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78f3f7e0-b3b2-475b-8886-c31fa5055926 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:14.742888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9ba6699b-c9c2-4256-875c-92d8c4a23aff tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:14.745906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9ba6699b-c9c2-4256-875c-92d8c4a23aff tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:14.766554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ba6699b-c9c2-4256-875c-92d8c4a23aff tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:14.766845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ba6699b-c9c2-4256-875c-92d8c4a23aff tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:14.769119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ba6699b-c9c2-4256-875c-92d8c4a23aff tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:14.770288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ba6699b-c9c2-4256-875c-92d8c4a23aff tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:14.879823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9ba6699b-c9c2-4256-875c-92d8c4a23aff tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:14.892145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9ba6699b-c9c2-4256-875c-92d8c4a23aff tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:14.900239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9ba6699b-c9c2-4256-875c-92d8c4a23aff tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:14.905025 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9ba6699b-c9c2-4256-875c-92d8c4a23aff tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.178735 May 27 15:11:14.906311 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1701/3416] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:14 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:14.918503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-21f336bf-c4d5-458b-a4d5-73f7b084b3b4 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:14.922135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-21f336bf-c4d5-458b-a4d5-73f7b084b3b4 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] [instance: e91050bc-2362-4bbb-bd3f-2c4c3449d244] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:14.951877 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21f336bf-c4d5-458b-a4d5-73f7b084b3b4 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:14.952472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21f336bf-c4d5-458b-a4d5-73f7b084b3b4 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:14.953463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21f336bf-c4d5-458b-a4d5-73f7b084b3b4 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:14.958255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21f336bf-c4d5-458b-a4d5-73f7b084b3b4 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:15.045002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-78f3f7e0-b3b2-475b-8886-c31fa5055926 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:15.058351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-78f3f7e0-b3b2-475b-8886-c31fa5055926 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:15.063802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-78f3f7e0-b3b2-475b-8886-c31fa5055926 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:15.067873 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-78f3f7e0-b3b2-475b-8886-c31fa5055926 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1723 microversion: 2.20 time: 0.338310 May 27 15:11:15.082964 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1716/3417] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:14 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1723 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:15.097614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-be99e0a6-0b1f-48d3-9e56-b6f7e3fffe53 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:15.098809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-be99e0a6-0b1f-48d3-9e56-b6f7e3fffe53 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:15.133784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be99e0a6-0b1f-48d3-9e56-b6f7e3fffe53 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:15.135093 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be99e0a6-0b1f-48d3-9e56-b6f7e3fffe53 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:15.137315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be99e0a6-0b1f-48d3-9e56-b6f7e3fffe53 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:15.140437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be99e0a6-0b1f-48d3-9e56-b6f7e3fffe53 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:15.144130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-21f336bf-c4d5-458b-a4d5-73f7b084b3b4 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c676b007f0451f98480c38ec373df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d4c75b7c44b1e87448d9bdf9621ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:15.157522 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-21f336bf-c4d5-458b-a4d5-73f7b084b3b4 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] 10.222.0.13 "GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244" status: 200 len: 1285 microversion: 2.1 time: 0.248361 May 27 15:11:15.159014 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1702/3418] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:14 2022] GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244 => generated 1285 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:15.169228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-a410b878-09cf-4356-a973-8b1b18e1d2d3 req-56aca307-b1fc-4f3a-9f71-ce7ca308fe9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31c16d8-ba5b-4938-944e-f151ec50b1b5", "name": "network-vif-plugged", "status": "completed", "tag": "745d0ba9-c0c3-41b4-8de7-3632ae78a3af"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:15.184192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-a410b878-09cf-4356-a973-8b1b18e1d2d3 req-56aca307-b1fc-4f3a-9f71-ce7ca308fe9f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:15.184890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-a410b878-09cf-4356-a973-8b1b18e1d2d3 req-56aca307-b1fc-4f3a-9f71-ce7ca308fe9f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:15.209359 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-a410b878-09cf-4356-a973-8b1b18e1d2d3 req-56aca307-b1fc-4f3a-9f71-ce7ca308fe9f service nova] Creating event network-vif-plugged:745d0ba9-c0c3-41b4-8de7-3632ae78a3af for instance b31c16d8-ba5b-4938-944e-f151ec50b1b5 on n-h1-843621-1 May 27 15:11:15.216966 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-a410b878-09cf-4356-a973-8b1b18e1d2d3 req-56aca307-b1fc-4f3a-9f71-ce7ca308fe9f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055978 May 27 15:11:15.218464 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1703/3419] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:15.240212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-556abb9b-4ef2-420e-9698-c1203dec6272 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:15.247881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-556abb9b-4ef2-420e-9698-c1203dec6272 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:15.248591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-556abb9b-4ef2-420e-9698-c1203dec6272 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Searching by: {'deleted': False, 'project_id': '2705ae487e96461190f67c996639b655'} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:11:15.261174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-556abb9b-4ef2-420e-9698-c1203dec6272 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:15.262757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-556abb9b-4ef2-420e-9698-c1203dec6272 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:15.263741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-556abb9b-4ef2-420e-9698-c1203dec6272 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:15.264527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-556abb9b-4ef2-420e-9698-c1203dec6272 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:15.376353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-be99e0a6-0b1f-48d3-9e56-b6f7e3fffe53 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:15.386492 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-be99e0a6-0b1f-48d3-9e56-b6f7e3fffe53 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1321 microversion: 2.1 time: 0.301803 May 27 15:11:15.391768 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1717/3420] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:15 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:15.447988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.multi_cell_list [None req-556abb9b-4ef2-420e-9698-c1203dec6272 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119249) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:11:15.462935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1d3afd42-1abc-4c39-b524-8ce15c99e726 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:15.464129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1d3afd42-1abc-4c39-b524-8ce15c99e726 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:15.485569 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d3afd42-1abc-4c39-b524-8ce15c99e726 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:15.487051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d3afd42-1abc-4c39-b524-8ce15c99e726 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:15.489231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d3afd42-1abc-4c39-b524-8ce15c99e726 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:15.489896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d3afd42-1abc-4c39-b524-8ce15c99e726 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:15.593323 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-556abb9b-4ef2-420e-9698-c1203dec6272 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.373185 May 27 15:11:15.594968 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1704/3421] 10.222.0.13 () {58 vars in 1124 bytes} [Fri May 27 15:11:15 2022] GET /compute/v2.1/servers => generated 344 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:15.612568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-92aa4ce7-0547-4cb2-835f-52ff19f2ddf3 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:15.618895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-92aa4ce7-0547-4cb2-835f-52ff19f2ddf3 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:15.620664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-92aa4ce7-0547-4cb2-835f-52ff19f2ddf3 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Searching by: {'deleted': False, 'project_id': '2705ae487e96461190f67c996639b655'} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:11:15.629879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-92aa4ce7-0547-4cb2-835f-52ff19f2ddf3 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:15.630662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-92aa4ce7-0547-4cb2-835f-52ff19f2ddf3 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:15.632473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-92aa4ce7-0547-4cb2-835f-52ff19f2ddf3 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:15.633259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-92aa4ce7-0547-4cb2-835f-52ff19f2ddf3 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:15.796577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.multi_cell_list [None req-92aa4ce7-0547-4cb2-835f-52ff19f2ddf3 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119249) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:11:15.848566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1d3afd42-1abc-4c39-b524-8ce15c99e726 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:15.864419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1d3afd42-1abc-4c39-b524-8ce15c99e726 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:15.866967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1d3afd42-1abc-4c39-b524-8ce15c99e726 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:15.868435 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1d3afd42-1abc-4c39-b524-8ce15c99e726 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.413323 May 27 15:11:15.881178 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1718/3422] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:15 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:11:15.886220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-693d64a5-f658-426b-b8a9-2d568c2c04df tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:15.887270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-693d64a5-f658-426b-b8a9-2d568c2c04df tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:15.896493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-693d64a5-f658-426b-b8a9-2d568c2c04df tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:15.897146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-693d64a5-f658-426b-b8a9-2d568c2c04df tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:15.897963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-693d64a5-f658-426b-b8a9-2d568c2c04df tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:15.898422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-693d64a5-f658-426b-b8a9-2d568c2c04df tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:15.926343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-92aa4ce7-0547-4cb2-835f-52ff19f2ddf3 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:15.934506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:15.937439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-92aa4ce7-0547-4cb2-835f-52ff19f2ddf3 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:15.938095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-92aa4ce7-0547-4cb2-835f-52ff19f2ddf3 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:15.946234 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-693d64a5-f658-426b-b8a9-2d568c2c04df tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063780 May 27 15:11:15.947052 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1719/3423] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:11:15 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:15.964029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6d3e85a8-e95d-423d-bffb-1f6c53504d4e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:15.965098 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6d3e85a8-e95d-423d-bffb-1f6c53504d4e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:15.975530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d3e85a8-e95d-423d-bffb-1f6c53504d4e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:15.975995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d3e85a8-e95d-423d-bffb-1f6c53504d4e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:15.976882 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d3e85a8-e95d-423d-bffb-1f6c53504d4e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:15.977841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d3e85a8-e95d-423d-bffb-1f6c53504d4e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:16.203225 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-92aa4ce7-0547-4cb2-835f-52ff19f2ddf3 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.596885 May 27 15:11:16.216715 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1705/3424] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 15:11:15 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:16.216715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2e202b20-70b3-4aa1-8e75-8b920e5483df tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:16.216715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2e202b20-70b3-4aa1-8e75-8b920e5483df tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:16.228967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e202b20-70b3-4aa1-8e75-8b920e5483df tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:16.229985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e202b20-70b3-4aa1-8e75-8b920e5483df tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:16.233211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e202b20-70b3-4aa1-8e75-8b920e5483df tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:16.234933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e202b20-70b3-4aa1-8e75-8b920e5483df tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:16.245289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6d3e85a8-e95d-423d-bffb-1f6c53504d4e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:16.258745 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6d3e85a8-e95d-423d-bffb-1f6c53504d4e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.309839 May 27 15:11:16.259833 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1720/3425] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:15 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:16.278175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-949a3973-6ea8-4b36-9533-b634987c6041 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:16.279040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-949a3973-6ea8-4b36-9533-b634987c6041 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:16.286638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-949a3973-6ea8-4b36-9533-b634987c6041 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:16.287306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-949a3973-6ea8-4b36-9533-b634987c6041 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:16.288198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-949a3973-6ea8-4b36-9533-b634987c6041 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:16.289006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-949a3973-6ea8-4b36-9533-b634987c6041 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:16.342795 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2e202b20-70b3-4aa1-8e75-8b920e5483df tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:16.358684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2e202b20-70b3-4aa1-8e75-8b920e5483df tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:16.362341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2e202b20-70b3-4aa1-8e75-8b920e5483df tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:16.364106 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2e202b20-70b3-4aa1-8e75-8b920e5483df tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.157089 May 27 15:11:16.378042 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1706/3426] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:16 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:16.391235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f5d8a128-6e0d-4b96-b0e6-dbdaba9d66b3 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:16.391866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f5d8a128-6e0d-4b96-b0e6-dbdaba9d66b3 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] [instance: e91050bc-2362-4bbb-bd3f-2c4c3449d244] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:16.410025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f5d8a128-6e0d-4b96-b0e6-dbdaba9d66b3 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:16.411308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f5d8a128-6e0d-4b96-b0e6-dbdaba9d66b3 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:16.412130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f5d8a128-6e0d-4b96-b0e6-dbdaba9d66b3 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:16.412577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f5d8a128-6e0d-4b96-b0e6-dbdaba9d66b3 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:16.545821 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-949a3973-6ea8-4b36-9533-b634987c6041 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:16.561458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-949a3973-6ea8-4b36-9533-b634987c6041 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:16.564665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-949a3973-6ea8-4b36-9533-b634987c6041 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:16.567321 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-949a3973-6ea8-4b36-9533-b634987c6041 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1744 microversion: 2.20 time: 0.296362 May 27 15:11:16.568733 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1721/3427] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:16 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1744 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:16.590806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c6ab2c71-e666-4792-9029-15b2b449fcc4 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:16.604647 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c6ab2c71-e666-4792-9029-15b2b449fcc4 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034551 May 27 15:11:16.606760 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1722/3428] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 15:11:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:16.618310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3a42bb4b-cf7f-432d-95a1-458c5760ff0a tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:16.619616 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3a42bb4b-cf7f-432d-95a1-458c5760ff0a tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:16.628364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a42bb4b-cf7f-432d-95a1-458c5760ff0a tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:16.628925 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a42bb4b-cf7f-432d-95a1-458c5760ff0a tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:16.630111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a42bb4b-cf7f-432d-95a1-458c5760ff0a tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:16.630571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a42bb4b-cf7f-432d-95a1-458c5760ff0a tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:16.631456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f5d8a128-6e0d-4b96-b0e6-dbdaba9d66b3 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c676b007f0451f98480c38ec373df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d4c75b7c44b1e87448d9bdf9621ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:16.642048 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f5d8a128-6e0d-4b96-b0e6-dbdaba9d66b3 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] 10.222.0.13 "GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244" status: 200 len: 1325 microversion: 2.1 time: 0.262345 May 27 15:11:16.642700 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1707/3429] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:16 2022] GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244 => generated 1325 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:16.792224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3a42bb4b-cf7f-432d-95a1-458c5760ff0a tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:16.801494 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3a42bb4b-cf7f-432d-95a1-458c5760ff0a tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1321 microversion: 2.1 time: 0.193390 May 27 15:11:16.802101 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1723/3430] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:16 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:16.887776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e788827b-4350-42a1-85df-24f968375618 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:16.888936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e788827b-4350-42a1-85df-24f968375618 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:16.896916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e788827b-4350-42a1-85df-24f968375618 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:16.898363 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e788827b-4350-42a1-85df-24f968375618 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:16.898363 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e788827b-4350-42a1-85df-24f968375618 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:16.899310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e788827b-4350-42a1-85df-24f968375618 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:16.973697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4b07389f-2596-4f2b-8b3f-df7df38b5235 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:16.982621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4b07389f-2596-4f2b-8b3f-df7df38b5235 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:16.999556 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b07389f-2596-4f2b-8b3f-df7df38b5235 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:17.000635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b07389f-2596-4f2b-8b3f-df7df38b5235 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:17.004417 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b07389f-2596-4f2b-8b3f-df7df38b5235 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:17.005395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b07389f-2596-4f2b-8b3f-df7df38b5235 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:17.075764 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4b07389f-2596-4f2b-8b3f-df7df38b5235 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116905 May 27 15:11:17.083795 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1724/3431] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:11:16 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:17.092221 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b96a9d54-82b2-4323-9f51-5de1e9868518 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:17.097790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b96a9d54-82b2-4323-9f51-5de1e9868518 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:17.106320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b96a9d54-82b2-4323-9f51-5de1e9868518 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:17.109142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b96a9d54-82b2-4323-9f51-5de1e9868518 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:17.112892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b96a9d54-82b2-4323-9f51-5de1e9868518 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:17.116281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b96a9d54-82b2-4323-9f51-5de1e9868518 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:17.170745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b96a9d54-82b2-4323-9f51-5de1e9868518 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:11:17.201837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e788827b-4350-42a1-85df-24f968375618 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:17.216150 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e788827b-4350-42a1-85df-24f968375618 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:17.217955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e788827b-4350-42a1-85df-24f968375618 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:17.219374 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e788827b-4350-42a1-85df-24f968375618 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.335739 May 27 15:11:17.225823 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1708/3432] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:16 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:17.262048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:17.280710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-77c3137c-13ee-47b4-8329-82b3ed859461 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:17.281805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-77c3137c-13ee-47b4-8329-82b3ed859461 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:17.290714 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-77c3137c-13ee-47b4-8329-82b3ed859461 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:17.291494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-77c3137c-13ee-47b4-8329-82b3ed859461 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:17.292606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-77c3137c-13ee-47b4-8329-82b3ed859461 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:17.293272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-77c3137c-13ee-47b4-8329-82b3ed859461 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:17.321677 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b96a9d54-82b2-4323-9f51-5de1e9868518 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 204 len: 0 microversion: 2.1 time: 0.234284 May 27 15:11:17.330263 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1725/3433] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:11:17 2022] DELETE /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:11:17.342817 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7718422c-e5ec-4282-a5e9-91d45234e45a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:17.344025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7718422c-e5ec-4282-a5e9-91d45234e45a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:17.387294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7718422c-e5ec-4282-a5e9-91d45234e45a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:17.387566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7718422c-e5ec-4282-a5e9-91d45234e45a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:17.388849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7718422c-e5ec-4282-a5e9-91d45234e45a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:17.389594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7718422c-e5ec-4282-a5e9-91d45234e45a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:17.505594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-77c3137c-13ee-47b4-8329-82b3ed859461 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:17.515849 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-77c3137c-13ee-47b4-8329-82b3ed859461 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.243266 May 27 15:11:17.516488 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1709/3434] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:17 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:11:17.521206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bc2e751e-f005-457a-9120-26e80643c4fe tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:17.521834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bc2e751e-f005-457a-9120-26e80643c4fe tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:17.540661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc2e751e-f005-457a-9120-26e80643c4fe tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:17.541238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc2e751e-f005-457a-9120-26e80643c4fe tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:17.542088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc2e751e-f005-457a-9120-26e80643c4fe tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:17.542752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc2e751e-f005-457a-9120-26e80643c4fe tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:17.560413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:17.611965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7718422c-e5ec-4282-a5e9-91d45234e45a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:17.625605 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7718422c-e5ec-4282-a5e9-91d45234e45a tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1607 microversion: 2.1 time: 0.293209 May 27 15:11:17.626705 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1726/3435] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:17 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1607 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:17.635719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bc2e751e-f005-457a-9120-26e80643c4fe tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:17.640610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-f2367698-081e-44a7-a29d-9662d4cfac32 req-c44c9efd-b1f1-4015-b5b2-71fe81a9943f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e91050bc-2362-4bbb-bd3f-2c4c3449d244", "tag": "da2f5dde-fd05-455a-8b41-6a0183d14e59"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:17.645500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bc2e751e-f005-457a-9120-26e80643c4fe tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:17.647210 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bc2e751e-f005-457a-9120-26e80643c4fe tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:17.648427 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bc2e751e-f005-457a-9120-26e80643c4fe tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.130953 May 27 15:11:17.649655 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1710/3436] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:17 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:17.654372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d8ff0291-b3b6-40a1-83f2-0098f2ae8944 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:17.654998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d8ff0291-b3b6-40a1-83f2-0098f2ae8944 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:17.656583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-f2367698-081e-44a7-a29d-9662d4cfac32 req-c44c9efd-b1f1-4015-b5b2-71fe81a9943f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:17.657223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-f2367698-081e-44a7-a29d-9662d4cfac32 req-c44c9efd-b1f1-4015-b5b2-71fe81a9943f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:17.672979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8ff0291-b3b6-40a1-83f2-0098f2ae8944 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:17.673528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8ff0291-b3b6-40a1-83f2-0098f2ae8944 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:17.674362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8ff0291-b3b6-40a1-83f2-0098f2ae8944 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:17.674810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8ff0291-b3b6-40a1-83f2-0098f2ae8944 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:17.690572 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-f2367698-081e-44a7-a29d-9662d4cfac32 req-c44c9efd-b1f1-4015-b5b2-71fe81a9943f service nova] Creating event network-changed:da2f5dde-fd05-455a-8b41-6a0183d14e59 for instance e91050bc-2362-4bbb-bd3f-2c4c3449d244 on n-h2-843621-1 May 27 15:11:17.703014 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-f2367698-081e-44a7-a29d-9662d4cfac32 req-c44c9efd-b1f1-4015-b5b2-71fe81a9943f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074886 May 27 15:11:17.703986 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1727/3437] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:17.719728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9f9f533f-22b5-4d34-88b6-da14b905e1e5 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:17.720486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9f9f533f-22b5-4d34-88b6-da14b905e1e5 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] [instance: e91050bc-2362-4bbb-bd3f-2c4c3449d244] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:17.727702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f9f533f-22b5-4d34-88b6-da14b905e1e5 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:17.728254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f9f533f-22b5-4d34-88b6-da14b905e1e5 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:17.729749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f9f533f-22b5-4d34-88b6-da14b905e1e5 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:17.729994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f9f533f-22b5-4d34-88b6-da14b905e1e5 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:17.921860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d8ff0291-b3b6-40a1-83f2-0098f2ae8944 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:17.936472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d8ff0291-b3b6-40a1-83f2-0098f2ae8944 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:17.938257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d8ff0291-b3b6-40a1-83f2-0098f2ae8944 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:17.939561 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d8ff0291-b3b6-40a1-83f2-0098f2ae8944 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1744 microversion: 2.20 time: 0.288939 May 27 15:11:17.940847 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1711/3438] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:17 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1744 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:17.947422 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5fdf1742-29e9-4b99-953a-0db8575b36dc tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:17.948026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5fdf1742-29e9-4b99-953a-0db8575b36dc tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:17.954797 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fdf1742-29e9-4b99-953a-0db8575b36dc tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:17.955553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fdf1742-29e9-4b99-953a-0db8575b36dc tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:17.956342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fdf1742-29e9-4b99-953a-0db8575b36dc tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:17.956812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fdf1742-29e9-4b99-953a-0db8575b36dc tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:17.985061 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9f9f533f-22b5-4d34-88b6-da14b905e1e5 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c676b007f0451f98480c38ec373df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d4c75b7c44b1e87448d9bdf9621ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:17.996456 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9f9f533f-22b5-4d34-88b6-da14b905e1e5 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] 10.222.0.13 "GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244" status: 200 len: 1325 microversion: 2.1 time: 0.288715 May 27 15:11:17.997651 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1728/3439] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:17 2022] GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244 => generated 1325 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:18.087395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-48629bc6-79be-48d4-9a8a-69903d3bdd1b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:18.088555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-48629bc6-79be-48d4-9a8a-69903d3bdd1b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:18.096733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48629bc6-79be-48d4-9a8a-69903d3bdd1b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:18.097525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48629bc6-79be-48d4-9a8a-69903d3bdd1b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:18.098776 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48629bc6-79be-48d4-9a8a-69903d3bdd1b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:18.099612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48629bc6-79be-48d4-9a8a-69903d3bdd1b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:18.146063 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-48629bc6-79be-48d4-9a8a-69903d3bdd1b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062502 May 27 15:11:18.163950 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1729/3440] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:11:18 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 15:11:18.169391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5fdf1742-29e9-4b99-953a-0db8575b36dc tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:18.179133 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5fdf1742-29e9-4b99-953a-0db8575b36dc tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1513 microversion: 2.1 time: 0.237124 May 27 15:11:18.193321 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1712/3441] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:17 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1513 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:18.197998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c6997392-2afc-4c35-b109-1680293f1c91 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:18.198953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c6997392-2afc-4c35-b109-1680293f1c91 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:18.215935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c6997392-2afc-4c35-b109-1680293f1c91 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:18.215935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c6997392-2afc-4c35-b109-1680293f1c91 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:18.215935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c6997392-2afc-4c35-b109-1680293f1c91 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:18.215935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c6997392-2afc-4c35-b109-1680293f1c91 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:18.238725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e9a7becd-6a47-4d24-9e84-6e4d05143f98 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:18.239595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e9a7becd-6a47-4d24-9e84-6e4d05143f98 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:18.250026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9a7becd-6a47-4d24-9e84-6e4d05143f98 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:18.253868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9a7becd-6a47-4d24-9e84-6e4d05143f98 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:18.254836 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9a7becd-6a47-4d24-9e84-6e4d05143f98 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:18.257256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9a7becd-6a47-4d24-9e84-6e4d05143f98 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:18.584189 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e9a7becd-6a47-4d24-9e84-6e4d05143f98 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:18.589437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c6997392-2afc-4c35-b109-1680293f1c91 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:18.596414 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e9a7becd-6a47-4d24-9e84-6e4d05143f98 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:18.599047 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c6997392-2afc-4c35-b109-1680293f1c91 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1513 microversion: 2.1 time: 0.406497 May 27 15:11:18.599660 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1730/3442] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:18 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1513 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:18.621624 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b5d95d45-a9b2-4149-ace3-e64fffee804d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:18.624269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b5d95d45-a9b2-4149-ace3-e64fffee804d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:18.627313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e9a7becd-6a47-4d24-9e84-6e4d05143f98 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:18.636191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5d95d45-a9b2-4149-ace3-e64fffee804d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:18.638801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5d95d45-a9b2-4149-ace3-e64fffee804d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:18.638801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5d95d45-a9b2-4149-ace3-e64fffee804d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:18.638801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5d95d45-a9b2-4149-ace3-e64fffee804d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:18.642518 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e9a7becd-6a47-4d24-9e84-6e4d05143f98 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.407210 May 27 15:11:18.644146 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1713/3443] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:18 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:11:18.649589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8d66d501-085a-4eac-85da-a8bdde80ff25 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:18.651445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8d66d501-085a-4eac-85da-a8bdde80ff25 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:18.659699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d66d501-085a-4eac-85da-a8bdde80ff25 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:18.660183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d66d501-085a-4eac-85da-a8bdde80ff25 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:18.661023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d66d501-085a-4eac-85da-a8bdde80ff25 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:18.661694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d66d501-085a-4eac-85da-a8bdde80ff25 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:18.933444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b5d95d45-a9b2-4149-ace3-e64fffee804d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:18.938497 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8d66d501-085a-4eac-85da-a8bdde80ff25 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:18.948271 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b5d95d45-a9b2-4149-ace3-e64fffee804d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.340193 May 27 15:11:18.949778 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1731/3444] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:18 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:18.953465 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8d66d501-085a-4eac-85da-a8bdde80ff25 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9" status: 200 len: 1513 microversion: 2.1 time: 0.307027 May 27 15:11:18.968695 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1714/3445] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:18 2022] GET /compute/v2.1/servers/f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9 => generated 1513 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:18.968695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4de8028e-aee3-402e-ad3b-20dab969f0de tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:18.968695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4de8028e-aee3-402e-ad3b-20dab969f0de tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:18.975610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4de8028e-aee3-402e-ad3b-20dab969f0de tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:18.975610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4de8028e-aee3-402e-ad3b-20dab969f0de tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:18.976184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4de8028e-aee3-402e-ad3b-20dab969f0de tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:18.976643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4de8028e-aee3-402e-ad3b-20dab969f0de tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:18.977627 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-76382d71-98e0-4159-bc73-bb3434d7173c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:18.978532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-76382d71-98e0-4159-bc73-bb3434d7173c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:18.986140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-76382d71-98e0-4159-bc73-bb3434d7173c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:18.987058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-76382d71-98e0-4159-bc73-bb3434d7173c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:18.987514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-76382d71-98e0-4159-bc73-bb3434d7173c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:18.988031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-76382d71-98e0-4159-bc73-bb3434d7173c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:19.144102 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4de8028e-aee3-402e-ad3b-20dab969f0de tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:19.155376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4de8028e-aee3-402e-ad3b-20dab969f0de tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:19.164248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4de8028e-aee3-402e-ad3b-20dab969f0de tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:19.165513 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4de8028e-aee3-402e-ad3b-20dab969f0de tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.204319 May 27 15:11:19.176397 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1715/3446] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:18 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:19.182086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8616992a-d601-4e3b-90fe-138255dd814b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:19.182993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8616992a-d601-4e3b-90fe-138255dd814b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:19.193278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8616992a-d601-4e3b-90fe-138255dd814b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:19.193744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8616992a-d601-4e3b-90fe-138255dd814b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:19.194719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8616992a-d601-4e3b-90fe-138255dd814b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:19.195174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8616992a-d601-4e3b-90fe-138255dd814b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:19.324558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-76382d71-98e0-4159-bc73-bb3434d7173c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:19.334172 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-76382d71-98e0-4159-bc73-bb3434d7173c tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1607 microversion: 2.1 time: 0.381965 May 27 15:11:19.335029 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1732/3447] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:18 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1607 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:19.346537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d950a8d0-0ae6-4f65-b502-c51f3cc02751 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:19.352045 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d950a8d0-0ae6-4f65-b502-c51f3cc02751 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:19.353243 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d950a8d0-0ae6-4f65-b502-c51f3cc02751 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '5f1274817f784f12ba47ba885010ec42'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:11:19.377442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d950a8d0-0ae6-4f65-b502-c51f3cc02751 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:19.378167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d950a8d0-0ae6-4f65-b502-c51f3cc02751 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:19.379169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d950a8d0-0ae6-4f65-b502-c51f3cc02751 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:19.379822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d950a8d0-0ae6-4f65-b502-c51f3cc02751 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:19.459721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8616992a-d601-4e3b-90fe-138255dd814b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:19.479185 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8616992a-d601-4e3b-90fe-138255dd814b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:19.480884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8616992a-d601-4e3b-90fe-138255dd814b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:19.482046 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8616992a-d601-4e3b-90fe-138255dd814b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1744 microversion: 2.20 time: 0.304102 May 27 15:11:19.505543 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1716/3448] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:19 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1744 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:19.511273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-abc977de-eaa0-4b19-9736-90138bd29d75 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:19.511901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-abc977de-eaa0-4b19-9736-90138bd29d75 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] [instance: e91050bc-2362-4bbb-bd3f-2c4c3449d244] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:19.518231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-abc977de-eaa0-4b19-9736-90138bd29d75 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:19.518697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-abc977de-eaa0-4b19-9736-90138bd29d75 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:19.519480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-abc977de-eaa0-4b19-9736-90138bd29d75 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:19.519926 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-abc977de-eaa0-4b19-9736-90138bd29d75 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:19.577399 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-d950a8d0-0ae6-4f65-b502-c51f3cc02751 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:11:19.720631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-abc977de-eaa0-4b19-9736-90138bd29d75 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c676b007f0451f98480c38ec373df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d4c75b7c44b1e87448d9bdf9621ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:19.738826 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-abc977de-eaa0-4b19-9736-90138bd29d75 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] 10.222.0.13 "GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244" status: 200 len: 1325 microversion: 2.1 time: 0.229928 May 27 15:11:19.739839 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1717/3449] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:19 2022] GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244 => generated 1325 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:19.750289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d950a8d0-0ae6-4f65-b502-c51f3cc02751 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:19.755289 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2e850d97-b372-4786-91c6-4ea025f7926b tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:19.757421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2e850d97-b372-4786-91c6-4ea025f7926b tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:19.774870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e850d97-b372-4786-91c6-4ea025f7926b tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:19.775083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d950a8d0-0ae6-4f65-b502-c51f3cc02751 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:19.775570 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e850d97-b372-4786-91c6-4ea025f7926b tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:19.777826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d950a8d0-0ae6-4f65-b502-c51f3cc02751 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:19.779154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e850d97-b372-4786-91c6-4ea025f7926b tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:19.783218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e850d97-b372-4786-91c6-4ea025f7926b tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:20.256167 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d950a8d0-0ae6-4f65-b502-c51f3cc02751 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.913420 May 27 15:11:20.258745 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1733/3450] 10.222.0.13 () {58 vars in 1166 bytes} [Fri May 27 15:11:19 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:20.264551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-05b6189e-e395-40dc-a2ab-68aa64aaa89f req-57c70a9a-442d-4c82-affe-aded45f0f2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7371c18-20d2-43f8-b0c6-0371079d8f20", "name": "network-vif-plugged", "status": "completed", "tag": "555c9e09-9066-4780-8d8a-91ccfe7dff8d"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:20.294649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-05b6189e-e395-40dc-a2ab-68aa64aaa89f req-57c70a9a-442d-4c82-affe-aded45f0f2b1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:20.295657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-05b6189e-e395-40dc-a2ab-68aa64aaa89f req-57c70a9a-442d-4c82-affe-aded45f0f2b1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:20.341428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2e850d97-b372-4786-91c6-4ea025f7926b tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:20.358587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2e850d97-b372-4786-91c6-4ea025f7926b tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:20.361277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2e850d97-b372-4786-91c6-4ea025f7926b tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:20.364285 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2e850d97-b372-4786-91c6-4ea025f7926b tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.621598 May 27 15:11:20.381208 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1718/3451] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:19 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:20.418744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d08dd916-2659-4768-8e89-19406cb2e3a5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:20.419508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d08dd916-2659-4768-8e89-19406cb2e3a5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:20.440126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d08dd916-2659-4768-8e89-19406cb2e3a5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:20.441576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d08dd916-2659-4768-8e89-19406cb2e3a5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:20.442602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d08dd916-2659-4768-8e89-19406cb2e3a5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:20.447196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d08dd916-2659-4768-8e89-19406cb2e3a5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:20.651078 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-05b6189e-e395-40dc-a2ab-68aa64aaa89f req-57c70a9a-442d-4c82-affe-aded45f0f2b1 service nova] Creating event network-vif-plugged:555c9e09-9066-4780-8d8a-91ccfe7dff8d for instance d7371c18-20d2-43f8-b0c6-0371079d8f20 on n-h2-843621-1 May 27 15:11:20.657951 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-05b6189e-e395-40dc-a2ab-68aa64aaa89f req-57c70a9a-442d-4c82-affe-aded45f0f2b1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.397190 May 27 15:11:20.662408 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1734/3452] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:20.670259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-00ceb25b-0923-4483-baaf-8cbee8ade8e7 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:20.671562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-00ceb25b-0923-4483-baaf-8cbee8ade8e7 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:20.682090 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-00ceb25b-0923-4483-baaf-8cbee8ade8e7 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:20.682888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-00ceb25b-0923-4483-baaf-8cbee8ade8e7 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:20.684005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-00ceb25b-0923-4483-baaf-8cbee8ade8e7 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:20.684754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-00ceb25b-0923-4483-baaf-8cbee8ade8e7 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:20.819488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-00ceb25b-0923-4483-baaf-8cbee8ade8e7 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:20.833700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-00ceb25b-0923-4483-baaf-8cbee8ade8e7 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:20.838615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-00ceb25b-0923-4483-baaf-8cbee8ade8e7 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:20.841404 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-00ceb25b-0923-4483-baaf-8cbee8ade8e7 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.177343 May 27 15:11:20.843866 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1735/3453] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:20 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:20.859858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-34c4595b-878d-4c7b-b9b5-fdef81089435 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:20.872963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-34c4595b-878d-4c7b-b9b5-fdef81089435 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:20.875949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-34c4595b-878d-4c7b-b9b5-fdef81089435 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1666467428', 'deleted': False, 'project_id': '5f1274817f784f12ba47ba885010ec42'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:11:20.896071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34c4595b-878d-4c7b-b9b5-fdef81089435 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:20.897107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34c4595b-878d-4c7b-b9b5-fdef81089435 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:20.901980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d08dd916-2659-4768-8e89-19406cb2e3a5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:20.902665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34c4595b-878d-4c7b-b9b5-fdef81089435 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:20.906205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34c4595b-878d-4c7b-b9b5-fdef81089435 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:20.939523 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d08dd916-2659-4768-8e89-19406cb2e3a5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1521 microversion: 2.1 time: 0.545335 May 27 15:11:20.940118 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1719/3454] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:20 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1521 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:20.962094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-336656e9-9af3-40dc-ab55-82b54335e7e8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:20.976173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-336656e9-9af3-40dc-ab55-82b54335e7e8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:21.005734 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-336656e9-9af3-40dc-ab55-82b54335e7e8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:21.006196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-336656e9-9af3-40dc-ab55-82b54335e7e8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:21.013218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-336656e9-9af3-40dc-ab55-82b54335e7e8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:21.016078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-336656e9-9af3-40dc-ab55-82b54335e7e8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:21.194024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-34c4595b-878d-4c7b-b9b5-fdef81089435 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:11:21.360787 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-34c4595b-878d-4c7b-b9b5-fdef81089435 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:21.390092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34c4595b-878d-4c7b-b9b5-fdef81089435 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:21.391207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34c4595b-878d-4c7b-b9b5-fdef81089435 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:21.489848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-336656e9-9af3-40dc-ab55-82b54335e7e8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:21.502619 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-336656e9-9af3-40dc-ab55-82b54335e7e8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1607 microversion: 2.1 time: 0.561390 May 27 15:11:21.506047 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1720/3455] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:20 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1607 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:21.517863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fc093be3-ff46-486f-9275-e7e4dbb1bdde tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:21.519959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fc093be3-ff46-486f-9275-e7e4dbb1bdde tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:21.536412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc093be3-ff46-486f-9275-e7e4dbb1bdde tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:21.540912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc093be3-ff46-486f-9275-e7e4dbb1bdde tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:21.542113 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc093be3-ff46-486f-9275-e7e4dbb1bdde tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:21.543762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc093be3-ff46-486f-9275-e7e4dbb1bdde tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:21.890294 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-34c4595b-878d-4c7b-b9b5-fdef81089435 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1666467428" status: 200 len: 1516 microversion: 2.1 time: 1.044654 May 27 15:11:21.892141 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1736/3456] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 15:11:20 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1666467428 => generated 1516 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:21.898171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6465b9e0-475e-42eb-bc99-9e223b285f42 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:21.912585 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6465b9e0-475e-42eb-bc99-9e223b285f42 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] [instance: e91050bc-2362-4bbb-bd3f-2c4c3449d244] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:21.938497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6465b9e0-475e-42eb-bc99-9e223b285f42 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:21.939076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6465b9e0-475e-42eb-bc99-9e223b285f42 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:21.941077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6465b9e0-475e-42eb-bc99-9e223b285f42 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:21.943236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6465b9e0-475e-42eb-bc99-9e223b285f42 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:22.111721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fc093be3-ff46-486f-9275-e7e4dbb1bdde tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:22.131816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fc093be3-ff46-486f-9275-e7e4dbb1bdde tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:22.133821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fc093be3-ff46-486f-9275-e7e4dbb1bdde tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:22.135183 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fc093be3-ff46-486f-9275-e7e4dbb1bdde tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1739 microversion: 2.20 time: 0.627844 May 27 15:11:22.152583 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1721/3457] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:21 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1739 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:22.157715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1c8efceb-b5c2-4468-8ddf-749419387c0a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:22.158384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1c8efceb-b5c2-4468-8ddf-749419387c0a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:22.198422 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c8efceb-b5c2-4468-8ddf-749419387c0a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:22.198887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c8efceb-b5c2-4468-8ddf-749419387c0a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:22.199798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c8efceb-b5c2-4468-8ddf-749419387c0a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:22.200314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c8efceb-b5c2-4468-8ddf-749419387c0a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:22.691840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6465b9e0-475e-42eb-bc99-9e223b285f42 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c676b007f0451f98480c38ec373df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d4c75b7c44b1e87448d9bdf9621ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:22.703707 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6465b9e0-475e-42eb-bc99-9e223b285f42 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] 10.222.0.13 "GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244" status: 200 len: 1325 microversion: 2.1 time: 0.806506 May 27 15:11:22.705178 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1737/3458] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:21 2022] GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244 => generated 1325 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:22.712317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cae10ba8-8784-4258-b877-60e1df8176f9 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:22.717539 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cae10ba8-8784-4258-b877-60e1df8176f9 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:22.735995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cae10ba8-8784-4258-b877-60e1df8176f9 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:22.741232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cae10ba8-8784-4258-b877-60e1df8176f9 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:22.742751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cae10ba8-8784-4258-b877-60e1df8176f9 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:22.743806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cae10ba8-8784-4258-b877-60e1df8176f9 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:22.790503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1c8efceb-b5c2-4468-8ddf-749419387c0a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:22.825709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1c8efceb-b5c2-4468-8ddf-749419387c0a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:22.832343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1c8efceb-b5c2-4468-8ddf-749419387c0a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:22.841164 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1c8efceb-b5c2-4468-8ddf-749419387c0a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.687255 May 27 15:11:22.865185 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1722/3459] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:22 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:22.884340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a02a4dc4-67c0-453c-bfb3-9401dc625a71 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:22.894036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a02a4dc4-67c0-453c-bfb3-9401dc625a71 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:22.897863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a02a4dc4-67c0-453c-bfb3-9401dc625a71 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '5f1274817f784f12ba47ba885010ec42'} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:11:22.957910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a02a4dc4-67c0-453c-bfb3-9401dc625a71 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:22.958987 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a02a4dc4-67c0-453c-bfb3-9401dc625a71 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:22.960051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a02a4dc4-67c0-453c-bfb3-9401dc625a71 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:22.960657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a02a4dc4-67c0-453c-bfb3-9401dc625a71 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:23.013708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cae10ba8-8784-4258-b877-60e1df8176f9 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:23.063133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cae10ba8-8784-4258-b877-60e1df8176f9 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:23.081390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cae10ba8-8784-4258-b877-60e1df8176f9 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:23.099656 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cae10ba8-8784-4258-b877-60e1df8176f9 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.378036 May 27 15:11:23.101533 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1738/3460] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:22 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:23.117499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-45868431-2e67-4ed3-94ad-bdc1553a1ca1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:23.118564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-45868431-2e67-4ed3-94ad-bdc1553a1ca1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:23.152551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45868431-2e67-4ed3-94ad-bdc1553a1ca1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:23.155718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45868431-2e67-4ed3-94ad-bdc1553a1ca1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:23.157295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45868431-2e67-4ed3-94ad-bdc1553a1ca1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:23.158906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45868431-2e67-4ed3-94ad-bdc1553a1ca1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:23.328126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.multi_cell_list [None req-a02a4dc4-67c0-453c-bfb3-9401dc625a71 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119249) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:11:23.421071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-45868431-2e67-4ed3-94ad-bdc1553a1ca1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:23.442235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a02a4dc4-67c0-453c-bfb3-9401dc625a71 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:23.443301 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-45868431-2e67-4ed3-94ad-bdc1553a1ca1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1501 microversion: 2.1 time: 0.332160 May 27 15:11:23.443996 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1739/3461] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:23 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1501 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:23.451194 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-76d449f1-67d5-403a-9e46-aba208aa25a9 req-78a5c3fd-cb3e-4fbf-a196-638acbde9bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5803f6c5-8f5f-400f-b2c3-20c393b5f72c", "name": "network-vif-deleted", "tag": "e5616912-9373-4b2e-ac8b-c7479952656c"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:23.452873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a02a4dc4-67c0-453c-bfb3-9401dc625a71 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:23.453536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a02a4dc4-67c0-453c-bfb3-9401dc625a71 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:23.466863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-76d449f1-67d5-403a-9e46-aba208aa25a9 req-78a5c3fd-cb3e-4fbf-a196-638acbde9bf1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:23.467945 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-76d449f1-67d5-403a-9e46-aba208aa25a9 req-78a5c3fd-cb3e-4fbf-a196-638acbde9bf1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:23.494829 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-76d449f1-67d5-403a-9e46-aba208aa25a9 req-78a5c3fd-cb3e-4fbf-a196-638acbde9bf1 service nova] Creating event network-vif-deleted:e5616912-9373-4b2e-ac8b-c7479952656c for instance 5803f6c5-8f5f-400f-b2c3-20c393b5f72c on n-h2-843621-1 May 27 15:11:23.515965 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-76d449f1-67d5-403a-9e46-aba208aa25a9 req-78a5c3fd-cb3e-4fbf-a196-638acbde9bf1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068231 May 27 15:11:23.517537 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1740/3462] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:23.528100 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a45e047f-788f-4a71-be65-a4b636fc9ac2 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:23.529639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a45e047f-788f-4a71-be65-a4b636fc9ac2 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:23.540085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a45e047f-788f-4a71-be65-a4b636fc9ac2 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:23.540588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a45e047f-788f-4a71-be65-a4b636fc9ac2 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:23.541663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a45e047f-788f-4a71-be65-a4b636fc9ac2 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:23.542131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a45e047f-788f-4a71-be65-a4b636fc9ac2 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:23.838654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a45e047f-788f-4a71-be65-a4b636fc9ac2 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:23.863618 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a45e047f-788f-4a71-be65-a4b636fc9ac2 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1253 microversion: 2.1 time: 0.344426 May 27 15:11:23.879726 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1741/3463] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:23 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1253 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:23.894373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-87a97c7d-3cac-431d-90e5-738e64d5491d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:23.901799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-87a97c7d-3cac-431d-90e5-738e64d5491d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:23.920312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87a97c7d-3cac-431d-90e5-738e64d5491d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:23.927616 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87a97c7d-3cac-431d-90e5-738e64d5491d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:23.932181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87a97c7d-3cac-431d-90e5-738e64d5491d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:23.932181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87a97c7d-3cac-431d-90e5-738e64d5491d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:23.980604 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a02a4dc4-67c0-453c-bfb3-9401dc625a71 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4522 microversion: 2.1 time: 1.112086 May 27 15:11:23.981400 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1723/3464] 10.222.0.13 () {58 vars in 1172 bytes} [Fri May 27 15:11:22 2022] GET /compute/v2.1/servers/detail?status=active => generated 4522 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:24.011074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dfd8e83f-b975-4be4-8259-6e0cf69435ea tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:24.012565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dfd8e83f-b975-4be4-8259-6e0cf69435ea tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:24.020417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dfd8e83f-b975-4be4-8259-6e0cf69435ea tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:24.021287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dfd8e83f-b975-4be4-8259-6e0cf69435ea tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:24.022455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dfd8e83f-b975-4be4-8259-6e0cf69435ea tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:24.023135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dfd8e83f-b975-4be4-8259-6e0cf69435ea tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:24.433090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dfd8e83f-b975-4be4-8259-6e0cf69435ea tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:24.441802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-87a97c7d-3cac-431d-90e5-738e64d5491d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:24.457588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-87a97c7d-3cac-431d-90e5-738e64d5491d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:24.458041 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dfd8e83f-b975-4be4-8259-6e0cf69435ea tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1516 microversion: 2.1 time: 0.460933 May 27 15:11:24.458643 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1724/3465] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:23 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1516 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:24.460143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-87a97c7d-3cac-431d-90e5-738e64d5491d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:24.462337 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-87a97c7d-3cac-431d-90e5-738e64d5491d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1739 microversion: 2.20 time: 0.575695 May 27 15:11:24.463143 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1742/3466] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:23 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1739 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:24.471024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a0b2dd1b-959e-48d5-9002-4d38aebfa487 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:24.472067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a0b2dd1b-959e-48d5-9002-4d38aebfa487 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:24.510966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-87a94fbb-cb10-40ea-af70-ff5d09eeb56e tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:24.512469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-87a94fbb-cb10-40ea-af70-ff5d09eeb56e tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] [instance: e91050bc-2362-4bbb-bd3f-2c4c3449d244] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:24.527081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a0b2dd1b-959e-48d5-9002-4d38aebfa487 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:24.528076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a0b2dd1b-959e-48d5-9002-4d38aebfa487 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:24.529073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a0b2dd1b-959e-48d5-9002-4d38aebfa487 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:24.529850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87a94fbb-cb10-40ea-af70-ff5d09eeb56e tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:24.530351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a0b2dd1b-959e-48d5-9002-4d38aebfa487 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:24.530870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87a94fbb-cb10-40ea-af70-ff5d09eeb56e tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:24.531910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87a94fbb-cb10-40ea-af70-ff5d09eeb56e tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:24.532591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87a94fbb-cb10-40ea-af70-ff5d09eeb56e tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:24.556501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:24.994444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-87a94fbb-cb10-40ea-af70-ff5d09eeb56e tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c676b007f0451f98480c38ec373df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d4c75b7c44b1e87448d9bdf9621ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:25.022198 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-87a94fbb-cb10-40ea-af70-ff5d09eeb56e tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] 10.222.0.13 "GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244" status: 200 len: 1325 microversion: 2.1 time: 0.525743 May 27 15:11:25.037430 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1725/3467] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:24 2022] GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244 => generated 1325 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:25.042873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dd568aad-5145-4a2c-abcb-7699e27322cf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:25.061925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dd568aad-5145-4a2c-abcb-7699e27322cf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:25.066805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.compute.servers [None req-dd568aad-5145-4a2c-abcb-7699e27322cf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Removing options 'limit' from query {{(pid=119249) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 27 15:11:25.072855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dd568aad-5145-4a2c-abcb-7699e27322cf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Searching by: {'deleted': False, 'project_id': '5f1274817f784f12ba47ba885010ec42'} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:11:25.083474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd568aad-5145-4a2c-abcb-7699e27322cf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:25.085463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd568aad-5145-4a2c-abcb-7699e27322cf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:25.089208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd568aad-5145-4a2c-abcb-7699e27322cf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:25.089882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd568aad-5145-4a2c-abcb-7699e27322cf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:25.138467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:25.157620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a0b2dd1b-959e-48d5-9002-4d38aebfa487 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:25.166695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dd568aad-5145-4a2c-abcb-7699e27322cf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:25.175767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a0b2dd1b-959e-48d5-9002-4d38aebfa487 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:25.178426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd568aad-5145-4a2c-abcb-7699e27322cf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:25.179090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd568aad-5145-4a2c-abcb-7699e27322cf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:25.186082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a0b2dd1b-959e-48d5-9002-4d38aebfa487 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:25.192099 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a0b2dd1b-959e-48d5-9002-4d38aebfa487 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.727614 May 27 15:11:25.201829 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1743/3468] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:24 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:25.212311 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-60653f04-9ca3-4c69-9fb2-c78a1f2a2f18 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:25.217303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-60653f04-9ca3-4c69-9fb2-c78a1f2a2f18 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:25.230838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-60653f04-9ca3-4c69-9fb2-c78a1f2a2f18 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:25.235453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-60653f04-9ca3-4c69-9fb2-c78a1f2a2f18 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:25.236295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-60653f04-9ca3-4c69-9fb2-c78a1f2a2f18 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:25.236800 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-60653f04-9ca3-4c69-9fb2-c78a1f2a2f18 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:25.401525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-60653f04-9ca3-4c69-9fb2-c78a1f2a2f18 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:25.428165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-60653f04-9ca3-4c69-9fb2-c78a1f2a2f18 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:25.434427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-60653f04-9ca3-4c69-9fb2-c78a1f2a2f18 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:25.438049 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-60653f04-9ca3-4c69-9fb2-c78a1f2a2f18 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.234529 May 27 15:11:25.441572 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1744/3469] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:25 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:25.448170 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8dd8340f-aedd-4d45-af62-28db40eb9390 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:25.454385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8dd8340f-aedd-4d45-af62-28db40eb9390 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: b6e091ec-7a65-486a-9eec-e83985a7367d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:25.466200 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dd568aad-5145-4a2c-abcb-7699e27322cf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.427487 May 27 15:11:25.467372 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1726/3470] 10.222.0.13 () {58 vars in 1160 bytes} [Fri May 27 15:11:25 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:25.473335 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e1a9e775-5bd3-4ff0-a626-33f33e7b96ce tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:25.474207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e1a9e775-5bd3-4ff0-a626-33f33e7b96ce tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:25.478562 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-8dd8340f-aedd-4d45-af62-28db40eb9390 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] HTTP exception thrown: Instance b6e091ec-7a65-486a-9eec-e83985a7367d could not be found. May 27 15:11:25.486892 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1a9e775-5bd3-4ff0-a626-33f33e7b96ce tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:25.487614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1a9e775-5bd3-4ff0-a626-33f33e7b96ce tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:25.488864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1a9e775-5bd3-4ff0-a626-33f33e7b96ce tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:25.489509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1a9e775-5bd3-4ff0-a626-33f33e7b96ce tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8dd8340f-aedd-4d45-af62-28db40eb9390 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Request method failure captured: May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/b6e091ec-7a65-486a-9eec-e83985a7367d/action HTTP/1.1 May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 14 May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOnNcWUaU6oQTw40A1oZOI-6OFKZaukve4P5LqW1FpCc9yhaxuLnjuKFUwlZoi0CeEpz5akQjaT-fGwv01A8fNadXXg4nlnoB_yvoYpc3lVED0AfYG3-niNxm_AITH-UuchLUVsnXh3asdpL1aml75HbLXXqw5pajtYuIua7x_Sa4qg May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 1f6efd5b16e5450d9eb9b454d05a775a May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1f6efd5b16e5450d9eb9b454d05a775a", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 1f6efd5b16e5450d9eb9b454d05a775a May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerRescueNegativeTestJSON-1538927199-project May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 645379b3a21548d8a4f4d6425b61319f May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1538927199-project May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: {"rescue": {}} May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance b6e091ec-7a65-486a-9eec-e83985a7367d could not be found. May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'b6e091ec-7a65-486a-9eec-e83985a7367d', 'body': {'rescue': {}}} May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6e091ec-7a65-486a-9eec-e83985a7367d could not be found. May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6e091ec-7a65-486a-9eec-e83985a7367d could not be found. May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:25.491095 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:25.496564 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:25.496564 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:25.496564 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:11:25.496564 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:11:25.496564 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6e091ec-7a65-486a-9eec-e83985a7367d could not be found. May 27 15:11:25.496564 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:25.498565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8dd8340f-aedd-4d45-af62-28db40eb9390 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Returning 404 to user: Instance b6e091ec-7a65-486a-9eec-e83985a7367d could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:11:25.499605 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8dd8340f-aedd-4d45-af62-28db40eb9390 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "POST /compute/v2.1/servers/b6e091ec-7a65-486a-9eec-e83985a7367d/action" status: 404 len: 111 microversion: 2.1 time: 0.056782 May 27 15:11:25.500366 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1745/3471] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:11:25 2022] POST /compute/v2.1/servers/b6e091ec-7a65-486a-9eec-e83985a7367d/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:11:25.509640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-33879be8-dfde-4a90-ba3f-f2a978cbdd3e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:25.515838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-33879be8-dfde-4a90-ba3f-f2a978cbdd3e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:25.518141 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-33879be8-dfde-4a90-ba3f-f2a978cbdd3e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '5f1274817f784f12ba47ba885010ec42'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:11:25.537647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-33879be8-dfde-4a90-ba3f-f2a978cbdd3e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:25.539897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-33879be8-dfde-4a90-ba3f-f2a978cbdd3e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:25.540937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-33879be8-dfde-4a90-ba3f-f2a978cbdd3e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:25.545115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-33879be8-dfde-4a90-ba3f-f2a978cbdd3e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:25.652421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e1a9e775-5bd3-4ff0-a626-33f33e7b96ce tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:25.662623 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e1a9e775-5bd3-4ff0-a626-33f33e7b96ce tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1253 microversion: 2.1 time: 0.193970 May 27 15:11:25.663765 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1727/3472] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:25 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1253 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:25.670275 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d687c506-40dc-4400-82fa-7f5358799c03 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:25.671258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d687c506-40dc-4400-82fa-7f5358799c03 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:25.688280 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d687c506-40dc-4400-82fa-7f5358799c03 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:25.689149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d687c506-40dc-4400-82fa-7f5358799c03 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:25.690260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d687c506-40dc-4400-82fa-7f5358799c03 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:25.690892 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d687c506-40dc-4400-82fa-7f5358799c03 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:25.856371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-33879be8-dfde-4a90-ba3f-f2a978cbdd3e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:11:25.971340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d687c506-40dc-4400-82fa-7f5358799c03 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:25.989593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d687c506-40dc-4400-82fa-7f5358799c03 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:25.993913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d687c506-40dc-4400-82fa-7f5358799c03 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:25.996222 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d687c506-40dc-4400-82fa-7f5358799c03 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1739 microversion: 2.20 time: 0.330120 May 27 15:11:25.998321 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1728/3473] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:25 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1739 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:26.004305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-64f37f80-da53-408d-b060-f48ee0a3017f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:26.005127 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-64f37f80-da53-408d-b060-f48ee0a3017f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:26.013963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64f37f80-da53-408d-b060-f48ee0a3017f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:26.014805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64f37f80-da53-408d-b060-f48ee0a3017f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:26.016032 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64f37f80-da53-408d-b060-f48ee0a3017f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:26.016828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64f37f80-da53-408d-b060-f48ee0a3017f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:26.089520 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-33879be8-dfde-4a90-ba3f-f2a978cbdd3e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.587810 May 27 15:11:26.090136 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1746/3474] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 15:11:25 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:26.104219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-e6a1e609-e682-4318-a665-b4bf36bfc7ee req-017572b0-63a6-4b5d-9f01-9cdca97c806c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e91050bc-2362-4bbb-bd3f-2c4c3449d244", "name": "network-vif-plugged", "status": "completed", "tag": "da2f5dde-fd05-455a-8b41-6a0183d14e59"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:26.155724 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e6a1e609-e682-4318-a665-b4bf36bfc7ee req-017572b0-63a6-4b5d-9f01-9cdca97c806c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:26.161640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e6a1e609-e682-4318-a665-b4bf36bfc7ee req-017572b0-63a6-4b5d-9f01-9cdca97c806c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:26.239250 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-e6a1e609-e682-4318-a665-b4bf36bfc7ee req-017572b0-63a6-4b5d-9f01-9cdca97c806c service nova] Creating event network-vif-plugged:da2f5dde-fd05-455a-8b41-6a0183d14e59 for instance e91050bc-2362-4bbb-bd3f-2c4c3449d244 on n-h2-843621-1 May 27 15:11:26.274623 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-e6a1e609-e682-4318-a665-b4bf36bfc7ee req-017572b0-63a6-4b5d-9f01-9cdca97c806c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170992 May 27 15:11:26.279724 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1747/3475] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:26.315516 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-64f37f80-da53-408d-b060-f48ee0a3017f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "POST /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c/action" status: 202 len: 0 microversion: 2.1 time: 0.307327 May 27 15:11:26.322378 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1729/3476] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:11:25 2022] POST /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:11:26.325209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-18b36ae1-07bd-4ce7-9161-7730a09fcf32 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:26.332624 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-18b36ae1-07bd-4ce7-9161-7730a09fcf32 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] [instance: e91050bc-2362-4bbb-bd3f-2c4c3449d244] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:26.340079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7f2b2cfc-bf11-4639-a5db-ef8b23b71901 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:26.347141 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18b36ae1-07bd-4ce7-9161-7730a09fcf32 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:26.350305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7f2b2cfc-bf11-4639-a5db-ef8b23b71901 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:26.350747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18b36ae1-07bd-4ce7-9161-7730a09fcf32 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:26.352402 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.compute.servers [None req-7f2b2cfc-bf11-4639-a5db-ef8b23b71901 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Removing options 'limit' from query {{(pid=119249) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 27 15:11:26.353679 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18b36ae1-07bd-4ce7-9161-7730a09fcf32 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:26.354812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7f2b2cfc-bf11-4639-a5db-ef8b23b71901 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Searching by: {'deleted': False, 'project_id': '5f1274817f784f12ba47ba885010ec42'} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:11:26.355291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18b36ae1-07bd-4ce7-9161-7730a09fcf32 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:26.373023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f2b2cfc-bf11-4639-a5db-ef8b23b71901 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:26.373493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f2b2cfc-bf11-4639-a5db-ef8b23b71901 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:26.374656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f2b2cfc-bf11-4639-a5db-ef8b23b71901 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:26.379587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f2b2cfc-bf11-4639-a5db-ef8b23b71901 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:26.468180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.multi_cell_list [None req-7f2b2cfc-bf11-4639-a5db-ef8b23b71901 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119249) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:11:26.598990 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7f2b2cfc-bf11-4639-a5db-ef8b23b71901 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.274823 May 27 15:11:26.602302 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1730/3477] 10.222.0.13 () {58 vars in 1149 bytes} [Fri May 27 15:11:26 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:26.623009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-217a5d1e-ae2f-4955-9337-c6aee8640603 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:26.627538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-217a5d1e-ae2f-4955-9337-c6aee8640603 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:26.651917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-217a5d1e-ae2f-4955-9337-c6aee8640603 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:26.654730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-217a5d1e-ae2f-4955-9337-c6aee8640603 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:26.657814 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-217a5d1e-ae2f-4955-9337-c6aee8640603 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:26.661376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-217a5d1e-ae2f-4955-9337-c6aee8640603 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:26.891285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-18b36ae1-07bd-4ce7-9161-7730a09fcf32 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c676b007f0451f98480c38ec373df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d4c75b7c44b1e87448d9bdf9621ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:26.913826 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-18b36ae1-07bd-4ce7-9161-7730a09fcf32 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] 10.222.0.13 "GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244" status: 200 len: 1325 microversion: 2.1 time: 0.627955 May 27 15:11:26.915249 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1748/3478] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:26 2022] GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244 => generated 1325 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:26.932696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2e12bd9f-fc30-46cd-8b6d-334b556048e6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:26.933234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2e12bd9f-fc30-46cd-8b6d-334b556048e6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:26.956423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e12bd9f-fc30-46cd-8b6d-334b556048e6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:26.956917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e12bd9f-fc30-46cd-8b6d-334b556048e6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:26.957702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e12bd9f-fc30-46cd-8b6d-334b556048e6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:26.958175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e12bd9f-fc30-46cd-8b6d-334b556048e6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:27.207599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-217a5d1e-ae2f-4955-9337-c6aee8640603 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:27.223194 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-217a5d1e-ae2f-4955-9337-c6aee8640603 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:27.224748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-217a5d1e-ae2f-4955-9337-c6aee8640603 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:27.225910 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-217a5d1e-ae2f-4955-9337-c6aee8640603 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.616222 May 27 15:11:27.226475 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1731/3479] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:26 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:27.244521 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3fcafc54-836e-4340-ba26-3bdb67bcf4c9 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:27.245252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3fcafc54-836e-4340-ba26-3bdb67bcf4c9 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:27.264216 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fcafc54-836e-4340-ba26-3bdb67bcf4c9 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:27.264700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fcafc54-836e-4340-ba26-3bdb67bcf4c9 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:27.265481 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fcafc54-836e-4340-ba26-3bdb67bcf4c9 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:27.265924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fcafc54-836e-4340-ba26-3bdb67bcf4c9 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:27.293408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2e12bd9f-fc30-46cd-8b6d-334b556048e6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:27.304059 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2e12bd9f-fc30-46cd-8b6d-334b556048e6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1501 microversion: 2.1 time: 0.387238 May 27 15:11:27.324964 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1749/3480] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:26 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1501 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:27.328423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e2847189-32af-4929-a72c-ed798f7d89c0 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:27.338238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e2847189-32af-4929-a72c-ed798f7d89c0 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:27.339123 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e2847189-32af-4929-a72c-ed798f7d89c0 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Searching by: {'deleted': False, 'project_id': '5f1274817f784f12ba47ba885010ec42'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:11:27.357217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2847189-32af-4929-a72c-ed798f7d89c0 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:27.357809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2847189-32af-4929-a72c-ed798f7d89c0 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:27.358633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2847189-32af-4929-a72c-ed798f7d89c0 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:27.359079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2847189-32af-4929-a72c-ed798f7d89c0 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:27.421563 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3fcafc54-836e-4340-ba26-3bdb67bcf4c9 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:27.444941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3fcafc54-836e-4340-ba26-3bdb67bcf4c9 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:27.447689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3fcafc54-836e-4340-ba26-3bdb67bcf4c9 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:27.455905 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3fcafc54-836e-4340-ba26-3bdb67bcf4c9 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.219001 May 27 15:11:27.456621 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1732/3481] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:27 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:27.469772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-e2847189-32af-4929-a72c-ed798f7d89c0 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:11:27.470018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4eeaaecb-0f54-4e0c-aee6-7ee35d3a22b8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:27.470018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4eeaaecb-0f54-4e0c-aee6-7ee35d3a22b8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:27.487285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4eeaaecb-0f54-4e0c-aee6-7ee35d3a22b8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:27.488720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4eeaaecb-0f54-4e0c-aee6-7ee35d3a22b8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:27.488720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4eeaaecb-0f54-4e0c-aee6-7ee35d3a22b8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:27.489159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4eeaaecb-0f54-4e0c-aee6-7ee35d3a22b8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:27.533805 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e2847189-32af-4929-a72c-ed798f7d89c0 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.218758 May 27 15:11:27.550538 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1750/3482] 10.222.0.13 () {58 vars in 1124 bytes} [Fri May 27 15:11:27 2022] GET /compute/v2.1/servers => generated 1012 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:27.559402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-05d0ea55-c069-4477-b508-bf74f4139550 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:27.564599 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-05d0ea55-c069-4477-b508-bf74f4139550 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:27.570249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4eeaaecb-0f54-4e0c-aee6-7ee35d3a22b8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:27.580055 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4eeaaecb-0f54-4e0c-aee6-7ee35d3a22b8 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1253 microversion: 2.1 time: 0.122054 May 27 15:11:27.580312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05d0ea55-c069-4477-b508-bf74f4139550 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:27.589659 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1733/3483] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:27 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1253 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:27.589897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05d0ea55-c069-4477-b508-bf74f4139550 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:27.589897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05d0ea55-c069-4477-b508-bf74f4139550 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:27.589897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05d0ea55-c069-4477-b508-bf74f4139550 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:27.590172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-539f5532-e03c-4814-846a-57954ba64628 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:27.590172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-539f5532-e03c-4814-846a-57954ba64628 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:27.599278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-539f5532-e03c-4814-846a-57954ba64628 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:27.600098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-539f5532-e03c-4814-846a-57954ba64628 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:27.601131 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-539f5532-e03c-4814-846a-57954ba64628 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:27.601726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-539f5532-e03c-4814-846a-57954ba64628 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:27.644051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-539f5532-e03c-4814-846a-57954ba64628 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lazy-loading 'flavor' on Instance uuid 445b2880-4df5-45f6-bba3-3af281cea45c {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:11:27.678160 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-539f5532-e03c-4814-846a-57954ba64628 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] HTTP exception thrown: Cannot 'rescue' instance 445b2880-4df5-45f6-bba3-3af281cea45c while it is in vm_state paused May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-539f5532-e03c-4814-846a-57954ba64628 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Request method failure captured: May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c/action HTTP/1.1 May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 14 May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOnNcWUaU6oQTw40A1oZOI-6OFKZaukve4P5LqW1FpCc9yhaxuLnjuKFUwlZoi0CeEpz5akQjaT-fGwv01A8fNadXXg4nlnoB_yvoYpc3lVED0AfYG3-niNxm_AITH-UuchLUVsnXh3asdpL1aml75HbLXXqw5pajtYuIua7x_Sa4qg May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1f6efd5b16e5450d9eb9b454d05a775a May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1f6efd5b16e5450d9eb9b454d05a775a", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1f6efd5b16e5450d9eb9b454d05a775a May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerRescueNegativeTestJSON-1538927199-project May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 645379b3a21548d8a4f4d6425b61319f May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1538927199-project May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: {"rescue": {}} May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: exception: Cannot 'rescue' instance 445b2880-4df5-45f6-bba3-3af281cea45c while it is in vm_state paused May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '445b2880-4df5-45f6-bba3-3af281cea45c', 'body': {'rescue': {}}} May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 445b2880-4df5-45f6-bba3-3af281cea45c in vm_state paused. Cannot rescue while the instance is in this state. May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 445b2880-4df5-45f6-bba3-3af281cea45c while it is in vm_state paused May 27 15:11:27.681531 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:27.686191 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:27.686191 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:27.686191 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:27.686191 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:27.686191 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:27.686191 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:11:27.686191 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:11:27.686191 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 445b2880-4df5-45f6-bba3-3af281cea45c while it is in vm_state paused May 27 15:11:27.686191 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:27.688156 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-539f5532-e03c-4814-846a-57954ba64628 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Returning 409 to user: Cannot 'rescue' instance 445b2880-4df5-45f6-bba3-3af281cea45c while it is in vm_state paused {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:11:27.689603 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-539f5532-e03c-4814-846a-57954ba64628 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "POST /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c/action" status: 409 len: 144 microversion: 2.1 time: 0.107370 May 27 15:11:27.694900 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1734/3484] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:11:27 2022] POST /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c/action => generated 144 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:11:27.705079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-16a1e8aa-0ed7-4a04-abab-7d3a5e2b1195 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:27.710377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-16a1e8aa-0ed7-4a04-abab-7d3a5e2b1195 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:27.712044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-16a1e8aa-0ed7-4a04-abab-7d3a5e2b1195 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '5f1274817f784f12ba47ba885010ec42'} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:11:27.730642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16a1e8aa-0ed7-4a04-abab-7d3a5e2b1195 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:27.731407 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16a1e8aa-0ed7-4a04-abab-7d3a5e2b1195 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:27.732397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16a1e8aa-0ed7-4a04-abab-7d3a5e2b1195 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:27.733143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16a1e8aa-0ed7-4a04-abab-7d3a5e2b1195 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:27.858926 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.multi_cell_list [None req-16a1e8aa-0ed7-4a04-abab-7d3a5e2b1195 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119249) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:11:27.925791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-05d0ea55-c069-4477-b508-bf74f4139550 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:27.937898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-05d0ea55-c069-4477-b508-bf74f4139550 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:27.940172 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-05d0ea55-c069-4477-b508-bf74f4139550 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:27.940929 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-05d0ea55-c069-4477-b508-bf74f4139550 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1739 microversion: 2.20 time: 0.389110 May 27 15:11:27.941991 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1751/3485] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:27 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1739 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:27.948515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e6f2f936-bb94-412b-8f7a-2174c143a9f4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:27.949093 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e6f2f936-bb94-412b-8f7a-2174c143a9f4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:27.955428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:27.957160 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e6f2f936-bb94-412b-8f7a-2174c143a9f4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:27.957923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e6f2f936-bb94-412b-8f7a-2174c143a9f4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:27.958719 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e6f2f936-bb94-412b-8f7a-2174c143a9f4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:27.959171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e6f2f936-bb94-412b-8f7a-2174c143a9f4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:28.038926 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-16a1e8aa-0ed7-4a04-abab-7d3a5e2b1195 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.341903 May 27 15:11:28.040232 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1735/3486] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 15:11:27 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:28.046324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aa242e06-bd9a-4a4c-bffb-30a5491586b6 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:28.047248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-aa242e06-bd9a-4a4c-bffb-30a5491586b6 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] [instance: e91050bc-2362-4bbb-bd3f-2c4c3449d244] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:28.056028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa242e06-bd9a-4a4c-bffb-30a5491586b6 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:28.057021 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa242e06-bd9a-4a4c-bffb-30a5491586b6 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:28.058113 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa242e06-bd9a-4a4c-bffb-30a5491586b6 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:28.058688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa242e06-bd9a-4a4c-bffb-30a5491586b6 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:28.106029 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e6f2f936-bb94-412b-8f7a-2174c143a9f4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "POST /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c/action" status: 202 len: 0 microversion: 2.1 time: 0.160811 May 27 15:11:28.125190 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1752/3487] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:11:27 2022] POST /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:11:28.155082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-63a82dd3-c54b-4ee1-a76e-67aa609bfa2d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:28.163333 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-63a82dd3-c54b-4ee1-a76e-67aa609bfa2d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:28.173840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.compute.servers [None req-63a82dd3-c54b-4ee1-a76e-67aa609bfa2d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Removing options 'limit' from query {{(pid=119248) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 27 15:11:28.175719 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-63a82dd3-c54b-4ee1-a76e-67aa609bfa2d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Searching by: {'deleted': False, 'project_id': '5f1274817f784f12ba47ba885010ec42'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:11:28.200213 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63a82dd3-c54b-4ee1-a76e-67aa609bfa2d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:28.201186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63a82dd3-c54b-4ee1-a76e-67aa609bfa2d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:28.215544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63a82dd3-c54b-4ee1-a76e-67aa609bfa2d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:28.221145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63a82dd3-c54b-4ee1-a76e-67aa609bfa2d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:28.314603 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-63a82dd3-c54b-4ee1-a76e-67aa609bfa2d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.185998 May 27 15:11:28.326969 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1753/3488] 10.222.0.13 () {58 vars in 1139 bytes} [Fri May 27 15:11:28 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:28.331663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-945f7815-b8dd-41a8-bcbb-45b8150f61f5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:28.332420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-945f7815-b8dd-41a8-bcbb-45b8150f61f5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:28.354057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-945f7815-b8dd-41a8-bcbb-45b8150f61f5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:28.354512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-945f7815-b8dd-41a8-bcbb-45b8150f61f5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:28.355353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-945f7815-b8dd-41a8-bcbb-45b8150f61f5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:28.355809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-945f7815-b8dd-41a8-bcbb-45b8150f61f5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:28.474663 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-aa242e06-bd9a-4a4c-bffb-30a5491586b6 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c676b007f0451f98480c38ec373df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d4c75b7c44b1e87448d9bdf9621ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:28.484481 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-aa242e06-bd9a-4a4c-bffb-30a5491586b6 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] 10.222.0.13 "GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244" status: 200 len: 1325 microversion: 2.1 time: 0.442701 May 27 15:11:28.493503 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1736/3489] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:28 2022] GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244 => generated 1325 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:28.498591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a1b82e67-73d0-4859-893a-0df781c3cb1f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:28.499202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a1b82e67-73d0-4859-893a-0df781c3cb1f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:28.514726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1b82e67-73d0-4859-893a-0df781c3cb1f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:28.515236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1b82e67-73d0-4859-893a-0df781c3cb1f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:28.516020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1b82e67-73d0-4859-893a-0df781c3cb1f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:28.516482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1b82e67-73d0-4859-893a-0df781c3cb1f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:28.786080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-945f7815-b8dd-41a8-bcbb-45b8150f61f5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:28.800277 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-945f7815-b8dd-41a8-bcbb-45b8150f61f5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1508 microversion: 2.1 time: 0.480432 May 27 15:11:28.800932 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1754/3490] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:28 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1508 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:28.810709 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7e1822ed-6266-4de6-8df6-b3f9b3bd4fad tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:28.824815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7e1822ed-6266-4de6-8df6-b3f9b3bd4fad tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:28.830361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7e1822ed-6266-4de6-8df6-b3f9b3bd4fad tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1666467428', 'deleted': False, 'project_id': '5f1274817f784f12ba47ba885010ec42'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:11:28.845131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e1822ed-6266-4de6-8df6-b3f9b3bd4fad tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:28.846826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e1822ed-6266-4de6-8df6-b3f9b3bd4fad tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:28.850177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e1822ed-6266-4de6-8df6-b3f9b3bd4fad tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:28.852311 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e1822ed-6266-4de6-8df6-b3f9b3bd4fad tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:28.852451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a1b82e67-73d0-4859-893a-0df781c3cb1f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:28.866040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a1b82e67-73d0-4859-893a-0df781c3cb1f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:28.868483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a1b82e67-73d0-4859-893a-0df781c3cb1f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:28.870511 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a1b82e67-73d0-4859-893a-0df781c3cb1f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.375673 May 27 15:11:28.872729 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1737/3491] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:28 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:28.877451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-010eb591-df94-4759-b78c-eec8298ad4bf tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:28.878156 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-010eb591-df94-4759-b78c-eec8298ad4bf tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:28.885155 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-010eb591-df94-4759-b78c-eec8298ad4bf tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:28.885735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-010eb591-df94-4759-b78c-eec8298ad4bf tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:28.886538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-010eb591-df94-4759-b78c-eec8298ad4bf tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:28.888036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-010eb591-df94-4759-b78c-eec8298ad4bf tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:28.991267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-010eb591-df94-4759-b78c-eec8298ad4bf tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:29.006263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-010eb591-df94-4759-b78c-eec8298ad4bf tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:29.009292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-010eb591-df94-4759-b78c-eec8298ad4bf tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:29.014761 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-010eb591-df94-4759-b78c-eec8298ad4bf tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.141353 May 27 15:11:29.015347 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1738/3492] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:28 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:29.021319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6216ce29-809d-413b-a725-6274c457b068 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:29.021936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6216ce29-809d-413b-a725-6274c457b068 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:29.031297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-7e1822ed-6266-4de6-8df6-b3f9b3bd4fad tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:11:29.034393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6216ce29-809d-413b-a725-6274c457b068 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:29.037071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6216ce29-809d-413b-a725-6274c457b068 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:29.038325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6216ce29-809d-413b-a725-6274c457b068 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:29.040147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6216ce29-809d-413b-a725-6274c457b068 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:29.114043 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7e1822ed-6266-4de6-8df6-b3f9b3bd4fad tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1666467428" status: 200 len: 346 microversion: 2.1 time: 0.311975 May 27 15:11:29.121626 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1755/3493] 10.222.0.13 () {58 vars in 1241 bytes} [Fri May 27 15:11:28 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1666467428 => generated 346 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:29.129208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b7afb956-bcdf-434a-a1aa-428821955121 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:29.131339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b7afb956-bcdf-434a-a1aa-428821955121 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:29.158100 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b7afb956-bcdf-434a-a1aa-428821955121 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:29.158609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b7afb956-bcdf-434a-a1aa-428821955121 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:29.159445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b7afb956-bcdf-434a-a1aa-428821955121 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:29.160231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b7afb956-bcdf-434a-a1aa-428821955121 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:29.192366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6216ce29-809d-413b-a725-6274c457b068 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:29.203659 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6216ce29-809d-413b-a725-6274c457b068 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1253 microversion: 2.1 time: 0.187235 May 27 15:11:29.212480 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1739/3494] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:29 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1253 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:29.212480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5f289ed4-5eee-415d-b675-3104ba096129 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:29.215667 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5f289ed4-5eee-415d-b675-3104ba096129 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:29.216314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5f289ed4-5eee-415d-b675-3104ba096129 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:29.277718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5f289ed4-5eee-415d-b675-3104ba096129 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Going to try to stop instance {{(pid=119249) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 15:11:29.332746 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:29.379459 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5f289ed4-5eee-415d-b675-3104ba096129 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "POST /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255/action" status: 202 len: 0 microversion: 2.1 time: 0.173493 May 27 15:11:29.383715 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1740/3495] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:11:29 2022] POST /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:11:29.395977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ceddd001-5457-4b9a-a90e-c6e9839e8d89 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:29.398754 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ceddd001-5457-4b9a-a90e-c6e9839e8d89 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:29.414680 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ceddd001-5457-4b9a-a90e-c6e9839e8d89 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:29.415258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ceddd001-5457-4b9a-a90e-c6e9839e8d89 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:29.418151 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ceddd001-5457-4b9a-a90e-c6e9839e8d89 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:29.418617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ceddd001-5457-4b9a-a90e-c6e9839e8d89 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:29.466373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b7afb956-bcdf-434a-a1aa-428821955121 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:29.483113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b7afb956-bcdf-434a-a1aa-428821955121 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:29.485703 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b7afb956-bcdf-434a-a1aa-428821955121 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:29.487899 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b7afb956-bcdf-434a-a1aa-428821955121 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1739 microversion: 2.20 time: 0.364905 May 27 15:11:29.489085 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1756/3496] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:29 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1739 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:29.532606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7d1948e8-a4f1-4207-ab6d-03fa7a36a299 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:29.533175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7d1948e8-a4f1-4207-ab6d-03fa7a36a299 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] [instance: e91050bc-2362-4bbb-bd3f-2c4c3449d244] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:29.556272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d1948e8-a4f1-4207-ab6d-03fa7a36a299 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:29.558105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d1948e8-a4f1-4207-ab6d-03fa7a36a299 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:29.559043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d1948e8-a4f1-4207-ab6d-03fa7a36a299 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:29.559538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d1948e8-a4f1-4207-ab6d-03fa7a36a299 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:29.683264 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ceddd001-5457-4b9a-a90e-c6e9839e8d89 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:29.693265 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ceddd001-5457-4b9a-a90e-c6e9839e8d89 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1523 microversion: 2.1 time: 0.308133 May 27 15:11:29.693862 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1741/3497] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:29 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:11:29.818996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f3d948ca-75f2-4658-853a-1a0fa76ff18c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:29.819756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f3d948ca-75f2-4658-853a-1a0fa76ff18c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:29.843831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3d948ca-75f2-4658-853a-1a0fa76ff18c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:29.844107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3d948ca-75f2-4658-853a-1a0fa76ff18c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:29.846266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3d948ca-75f2-4658-853a-1a0fa76ff18c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:29.849113 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3d948ca-75f2-4658-853a-1a0fa76ff18c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:29.916704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7d1948e8-a4f1-4207-ab6d-03fa7a36a299 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c676b007f0451f98480c38ec373df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d4c75b7c44b1e87448d9bdf9621ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:29.935916 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7d1948e8-a4f1-4207-ab6d-03fa7a36a299 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] 10.222.0.13 "GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244" status: 200 len: 1521 microversion: 2.1 time: 0.429617 May 27 15:11:29.948067 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1757/3498] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:29 2022] GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244 => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:29.948067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-35249001-e105-4a71-be8e-423a9c73681f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:29.948067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-35249001-e105-4a71-be8e-423a9c73681f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:29.966002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-35249001-e105-4a71-be8e-423a9c73681f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:29.966468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-35249001-e105-4a71-be8e-423a9c73681f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:29.967633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-35249001-e105-4a71-be8e-423a9c73681f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:29.968411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-35249001-e105-4a71-be8e-423a9c73681f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:30.359245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f3d948ca-75f2-4658-853a-1a0fa76ff18c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:30.372650 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f3d948ca-75f2-4658-853a-1a0fa76ff18c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1516 microversion: 2.1 time: 0.558603 May 27 15:11:30.373669 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1742/3499] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:29 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1516 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:30.379645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c9b6b6f6-76f3-41d6-ad04-2807454a770a tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:30.380193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c9b6b6f6-76f3-41d6-ad04-2807454a770a tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] [instance: e91050bc-2362-4bbb-bd3f-2c4c3449d244] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:30.387340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9b6b6f6-76f3-41d6-ad04-2807454a770a tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:30.387825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9b6b6f6-76f3-41d6-ad04-2807454a770a tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:30.388561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9b6b6f6-76f3-41d6-ad04-2807454a770a tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:30.389120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9b6b6f6-76f3-41d6-ad04-2807454a770a tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:30.405227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-35249001-e105-4a71-be8e-423a9c73681f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:30.418952 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-35249001-e105-4a71-be8e-423a9c73681f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:30.420494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-35249001-e105-4a71-be8e-423a9c73681f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:30.421758 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-35249001-e105-4a71-be8e-423a9c73681f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.483694 May 27 15:11:30.441195 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1758/3500] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:29 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:30.446056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5a414a5b-2d47-49a6-85b6-4f9bc4a27042 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:30.451946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5a414a5b-2d47-49a6-85b6-4f9bc4a27042 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:30.462749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a414a5b-2d47-49a6-85b6-4f9bc4a27042 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:30.463216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a414a5b-2d47-49a6-85b6-4f9bc4a27042 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:30.464024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a414a5b-2d47-49a6-85b6-4f9bc4a27042 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:30.464469 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a414a5b-2d47-49a6-85b6-4f9bc4a27042 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:30.478028 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-c9b6b6f6-76f3-41d6-ad04-2807454a770a tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] HTTP exception thrown: Action 999 not found May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c9b6b6f6-76f3-41d6-ad04-2807454a770a tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Request method failure captured: May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244/os-instance-actions/999 HTTP/1.1 May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOoQMAL_KUPLGriuIw18gMfR5sRePi_AbJJk0cBvQ5wyNH0Xf9-CM1ShxcASMlVREJg3LmZQcmiP8LTZZsi2eR2PTQGuMIpCnx6UiFemrDQY0OPHN_IoMYpUYiLAJhqHXnvK0hM6-zRhV9GhPgJRkWw-iW3B3XHF-VpQFbRiMptmw8A May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: e92d4c75b7c44b1e87448d9bdf9621ae May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-268838258 May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e92d4c75b7c44b1e87448d9bdf9621ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e92d4c75b7c44b1e87448d9bdf9621ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e92d4c75b7c44b1e87448d9bdf9621ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e92d4c75b7c44b1e87448d9bdf9621ae", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-268838258 May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: e92d4c75b7c44b1e87448d9bdf9621ae May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-268838258 May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-InstanceActionsNegativeTestJSON-268838258-project May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 48c676b007f0451f98480c38ec373df3 May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-268838258-project May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: exception: Action 999 not found May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'server_id': 'e91050bc-2362-4bbb-bd3f-2c4c3449d244', 'id': '999'} May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found May 27 15:11:30.484738 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:30.491216 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c9b6b6f6-76f3-41d6-ad04-2807454a770a tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Returning 404 to user: Action 999 not found {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:11:30.492359 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c9b6b6f6-76f3-41d6-ad04-2807454a770a tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] 10.222.0.13 "GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.117681 May 27 15:11:30.493203 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1743/3501] 10.222.0.13 () {58 vars in 1307 bytes} [Fri May 27 15:11:30 2022] GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244/os-instance-actions/999 => generated 66 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:11:30.501980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5f63c428-376c-4ad9-91c6-07f2e4b9bf8f tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:30.503132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5f63c428-376c-4ad9-91c6-07f2e4b9bf8f tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:30.521029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5f63c428-376c-4ad9-91c6-07f2e4b9bf8f tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:30.521492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5f63c428-376c-4ad9-91c6-07f2e4b9bf8f tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:30.522306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5f63c428-376c-4ad9-91c6-07f2e4b9bf8f tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:30.522758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5f63c428-376c-4ad9-91c6-07f2e4b9bf8f tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:30.629598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5a414a5b-2d47-49a6-85b6-4f9bc4a27042 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:30.655994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5f63c428-376c-4ad9-91c6-07f2e4b9bf8f tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:30.665364 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5f63c428-376c-4ad9-91c6-07f2e4b9bf8f tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1253 microversion: 2.1 time: 0.171072 May 27 15:11:30.666819 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1744/3502] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:30 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1253 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:30.672132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8abdb592-bf95-479d-b1ef-8ceb86b879ae tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Calling method '.version_select at 0x7fc776daa310>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:30.673016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8abdb592-bf95-479d-b1ef-8ceb86b879ae tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] [instance: 90abaa48-4e51-47b7-a5d0-e4727d7315ad] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:30.674473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5a414a5b-2d47-49a6-85b6-4f9bc4a27042 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:30.680374 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-8abdb592-bf95-479d-b1ef-8ceb86b879ae tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] HTTP exception thrown: Instance 90abaa48-4e51-47b7-a5d0-e4727d7315ad could not be found. May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8abdb592-bf95-479d-b1ef-8ceb86b879ae tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Request method failure captured: May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/90abaa48-4e51-47b7-a5d0-e4727d7315ad/os-instance-actions HTTP/1.1 May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOoQMAL_KUPLGriuIw18gMfR5sRePi_AbJJk0cBvQ5wyNH0Xf9-CM1ShxcASMlVREJg3LmZQcmiP8LTZZsi2eR2PTQGuMIpCnx6UiFemrDQY0OPHN_IoMYpUYiLAJhqHXnvK0hM6-zRhV9GhPgJRkWw-iW3B3XHF-VpQFbRiMptmw8A May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: e92d4c75b7c44b1e87448d9bdf9621ae May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-268838258 May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e92d4c75b7c44b1e87448d9bdf9621ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e92d4c75b7c44b1e87448d9bdf9621ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e92d4c75b7c44b1e87448d9bdf9621ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e92d4c75b7c44b1e87448d9bdf9621ae", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-268838258 May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: e92d4c75b7c44b1e87448d9bdf9621ae May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-268838258 May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-InstanceActionsNegativeTestJSON-268838258-project May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 48c676b007f0451f98480c38ec373df3 May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-268838258-project May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 90abaa48-4e51-47b7-a5d0-e4727d7315ad could not be found. May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'server_id': '90abaa48-4e51-47b7-a5d0-e4727d7315ad'} May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90abaa48-4e51-47b7-a5d0-e4727d7315ad could not be found. May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:11:30.682545 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:11:30.686734 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90abaa48-4e51-47b7-a5d0-e4727d7315ad could not be found. May 27 15:11:30.686734 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:30.686734 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:30.686734 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:30.686734 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:30.686734 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:30.686734 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:30.686734 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:11:30.686734 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:11:30.686734 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90abaa48-4e51-47b7-a5d0-e4727d7315ad could not be found. May 27 15:11:30.686734 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:30.687395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5a414a5b-2d47-49a6-85b6-4f9bc4a27042 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:30.689503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8abdb592-bf95-479d-b1ef-8ceb86b879ae tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Returning 404 to user: Instance 90abaa48-4e51-47b7-a5d0-e4727d7315ad could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:11:30.690580 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5a414a5b-2d47-49a6-85b6-4f9bc4a27042 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.250208 May 27 15:11:30.691058 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8abdb592-bf95-479d-b1ef-8ceb86b879ae tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] 10.222.0.13 "GET /compute/v2.1/servers/90abaa48-4e51-47b7-a5d0-e4727d7315ad/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.022656 May 27 15:11:30.692194 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1745/3503] 10.222.0.13 () {58 vars in 1295 bytes} [Fri May 27 15:11:30 2022] GET /compute/v2.1/servers/90abaa48-4e51-47b7-a5d0-e4727d7315ad/os-instance-actions => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:11:30.698817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0eff8701-93f7-42d7-9ced-9fd01b7f3f56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:30.699871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0eff8701-93f7-42d7-9ced-9fd01b7f3f56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:30.701832 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1759/3504] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:30 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:30.707956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0eff8701-93f7-42d7-9ced-9fd01b7f3f56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:30.708858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0eff8701-93f7-42d7-9ced-9fd01b7f3f56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:30.709902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0eff8701-93f7-42d7-9ced-9fd01b7f3f56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:30.710588 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0eff8701-93f7-42d7-9ced-9fd01b7f3f56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:30.726796 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9aeb9c09-2f0d-4604-bc63-cc299579e321 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:30.727771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9aeb9c09-2f0d-4604-bc63-cc299579e321 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] [instance: e91050bc-2362-4bbb-bd3f-2c4c3449d244] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:30.759323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9aeb9c09-2f0d-4604-bc63-cc299579e321 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:30.760065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9aeb9c09-2f0d-4604-bc63-cc299579e321 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:30.773907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9aeb9c09-2f0d-4604-bc63-cc299579e321 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:30.783578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9aeb9c09-2f0d-4604-bc63-cc299579e321 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:30.895580 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:30.920622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0eff8701-93f7-42d7-9ced-9fd01b7f3f56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:30.935256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0eff8701-93f7-42d7-9ced-9fd01b7f3f56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:30.938193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0eff8701-93f7-42d7-9ced-9fd01b7f3f56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:30.940394 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0eff8701-93f7-42d7-9ced-9fd01b7f3f56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1739 microversion: 2.20 time: 0.246705 May 27 15:11:30.941980 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1746/3505] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:30 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1739 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:30.948358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-00275218-592f-4198-9727-98d699833ebe tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:30.949345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-00275218-592f-4198-9727-98d699833ebe tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:30.956980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-00275218-592f-4198-9727-98d699833ebe tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:30.957775 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-00275218-592f-4198-9727-98d699833ebe tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:30.958805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-00275218-592f-4198-9727-98d699833ebe tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:30.959477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-00275218-592f-4198-9727-98d699833ebe tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:31.001484 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9aeb9c09-2f0d-4604-bc63-cc299579e321 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] [instance: e91050bc-2362-4bbb-bd3f-2c4c3449d244] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:11:31.177526 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-00275218-592f-4198-9727-98d699833ebe tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:31.195125 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-00275218-592f-4198-9727-98d699833ebe tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1523 microversion: 2.1 time: 0.251074 May 27 15:11:31.197155 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1747/3506] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:30 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:31.302537 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9aeb9c09-2f0d-4604-bc63-cc299579e321 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244" status: 204 len: 0 microversion: 2.1 time: 0.595647 May 27 15:11:31.309392 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1760/3507] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:11:30 2022] DELETE /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:11:31.320579 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-788b9e9d-b2a3-4a19-8799-3be8dd915ceb tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:31.322217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-788b9e9d-b2a3-4a19-8799-3be8dd915ceb tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] [instance: e91050bc-2362-4bbb-bd3f-2c4c3449d244] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:31.330681 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-788b9e9d-b2a3-4a19-8799-3be8dd915ceb tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:31.333614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-788b9e9d-b2a3-4a19-8799-3be8dd915ceb tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:31.335733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-788b9e9d-b2a3-4a19-8799-3be8dd915ceb tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:31.336376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-788b9e9d-b2a3-4a19-8799-3be8dd915ceb tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:31.445973 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4bfc46f7-86a6-4b7f-b422-7e056fbf4b01 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:31.447195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4bfc46f7-86a6-4b7f-b422-7e056fbf4b01 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:31.453436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:31.467045 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4bfc46f7-86a6-4b7f-b422-7e056fbf4b01 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:31.468091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4bfc46f7-86a6-4b7f-b422-7e056fbf4b01 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:31.469719 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4bfc46f7-86a6-4b7f-b422-7e056fbf4b01 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:31.471198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4bfc46f7-86a6-4b7f-b422-7e056fbf4b01 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:31.899061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-788b9e9d-b2a3-4a19-8799-3be8dd915ceb tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c676b007f0451f98480c38ec373df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d4c75b7c44b1e87448d9bdf9621ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:31.910200 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-788b9e9d-b2a3-4a19-8799-3be8dd915ceb tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] 10.222.0.13 "GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244" status: 200 len: 1527 microversion: 2.1 time: 0.599265 May 27 15:11:31.927521 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1748/3508] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:31 2022] GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244 => generated 1527 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:31.944198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bbaada9f-1c05-4754-bf1b-e5bf6aa11972 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:31.946179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bbaada9f-1c05-4754-bf1b-e5bf6aa11972 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:31.977016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bbaada9f-1c05-4754-bf1b-e5bf6aa11972 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:31.981828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bbaada9f-1c05-4754-bf1b-e5bf6aa11972 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:31.983108 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bbaada9f-1c05-4754-bf1b-e5bf6aa11972 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:31.983956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bbaada9f-1c05-4754-bf1b-e5bf6aa11972 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:32.099185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4bfc46f7-86a6-4b7f-b422-7e056fbf4b01 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:32.116239 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4bfc46f7-86a6-4b7f-b422-7e056fbf4b01 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:32.118604 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4bfc46f7-86a6-4b7f-b422-7e056fbf4b01 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:32.123736 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4bfc46f7-86a6-4b7f-b422-7e056fbf4b01 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.685623 May 27 15:11:32.126622 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1761/3509] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:31 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:11:32.146165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a61f76af-83c7-432d-a1f9-9d7d3f6a7389 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:32.149788 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a61f76af-83c7-432d-a1f9-9d7d3f6a7389 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:32.161518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bbaada9f-1c05-4754-bf1b-e5bf6aa11972 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:32.177158 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bbaada9f-1c05-4754-bf1b-e5bf6aa11972 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1253 microversion: 2.1 time: 0.244013 May 27 15:11:32.178026 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1749/3510] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:31 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1253 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:32.178649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a61f76af-83c7-432d-a1f9-9d7d3f6a7389 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:32.179307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a61f76af-83c7-432d-a1f9-9d7d3f6a7389 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:32.182157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a61f76af-83c7-432d-a1f9-9d7d3f6a7389 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:32.182880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a61f76af-83c7-432d-a1f9-9d7d3f6a7389 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:32.191025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e9e655bd-990b-4a12-9208-8706cac422f2 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:32.196503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e9e655bd-990b-4a12-9208-8706cac422f2 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:32.212061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9e655bd-990b-4a12-9208-8706cac422f2 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:32.212529 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9e655bd-990b-4a12-9208-8706cac422f2 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:32.213363 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9e655bd-990b-4a12-9208-8706cac422f2 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:32.213818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9e655bd-990b-4a12-9208-8706cac422f2 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:32.423398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a61f76af-83c7-432d-a1f9-9d7d3f6a7389 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:32.436115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a61f76af-83c7-432d-a1f9-9d7d3f6a7389 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:32.438990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a61f76af-83c7-432d-a1f9-9d7d3f6a7389 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:32.440594 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a61f76af-83c7-432d-a1f9-9d7d3f6a7389 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.311571 May 27 15:11:32.441912 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1762/3511] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:32 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:32.448427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-efe1ceda-a9ba-4db2-b166-a4cc90c1c172 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:32.449629 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-efe1ceda-a9ba-4db2-b166-a4cc90c1c172 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:32.457862 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-efe1ceda-a9ba-4db2-b166-a4cc90c1c172 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:32.459211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-efe1ceda-a9ba-4db2-b166-a4cc90c1c172 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:32.460968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-efe1ceda-a9ba-4db2-b166-a4cc90c1c172 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:32.461675 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-efe1ceda-a9ba-4db2-b166-a4cc90c1c172 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:32.644445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e9e655bd-990b-4a12-9208-8706cac422f2 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:32.661856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e9e655bd-990b-4a12-9208-8706cac422f2 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:32.666241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e9e655bd-990b-4a12-9208-8706cac422f2 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:32.668954 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e9e655bd-990b-4a12-9208-8706cac422f2 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1739 microversion: 2.20 time: 0.487819 May 27 15:11:32.669563 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1750/3512] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:32 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1739 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:32.788808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-efe1ceda-a9ba-4db2-b166-a4cc90c1c172 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:32.818815 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-efe1ceda-a9ba-4db2-b166-a4cc90c1c172 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1523 microversion: 2.1 time: 0.373485 May 27 15:11:32.834677 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1763/3513] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:32 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1523 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:32.939986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-04360e79-4212-43c6-ac1f-928fa031544c tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:32.940700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-04360e79-4212-43c6-ac1f-928fa031544c tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] [instance: e91050bc-2362-4bbb-bd3f-2c4c3449d244] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:32.955005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04360e79-4212-43c6-ac1f-928fa031544c tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:32.955775 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04360e79-4212-43c6-ac1f-928fa031544c tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:32.956794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04360e79-4212-43c6-ac1f-928fa031544c tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:32.960239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04360e79-4212-43c6-ac1f-928fa031544c tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:33.150553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3f6c88ed-c072-4cc8-b824-acef3c181418 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:33.151454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3f6c88ed-c072-4cc8-b824-acef3c181418 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:33.182892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f6c88ed-c072-4cc8-b824-acef3c181418 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:33.183573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f6c88ed-c072-4cc8-b824-acef3c181418 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:33.184440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f6c88ed-c072-4cc8-b824-acef3c181418 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:33.184930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f6c88ed-c072-4cc8-b824-acef3c181418 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:33.380595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-04360e79-4212-43c6-ac1f-928fa031544c tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c676b007f0451f98480c38ec373df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d4c75b7c44b1e87448d9bdf9621ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:33.400299 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-04360e79-4212-43c6-ac1f-928fa031544c tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] 10.222.0.13 "GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244" status: 200 len: 1527 microversion: 2.1 time: 0.464933 May 27 15:11:33.410661 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1751/3514] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:32 2022] GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244 => generated 1527 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:33.414161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-123116c1-82bf-4b46-8692-fa8678e442a2 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:33.414812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-123116c1-82bf-4b46-8692-fa8678e442a2 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:33.422161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:33.424195 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-123116c1-82bf-4b46-8692-fa8678e442a2 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:33.425004 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-123116c1-82bf-4b46-8692-fa8678e442a2 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:33.425961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-123116c1-82bf-4b46-8692-fa8678e442a2 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:33.426713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-123116c1-82bf-4b46-8692-fa8678e442a2 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:33.709257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-123116c1-82bf-4b46-8692-fa8678e442a2 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:33.745899 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-123116c1-82bf-4b46-8692-fa8678e442a2 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1253 microversion: 2.1 time: 0.342610 May 27 15:11:33.750843 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1752/3515] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:33 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1253 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:33.756290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ee4b8914-e43e-4465-a19d-a2d14c3af452 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:33.757229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ee4b8914-e43e-4465-a19d-a2d14c3af452 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:33.801649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ee4b8914-e43e-4465-a19d-a2d14c3af452 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:33.802617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ee4b8914-e43e-4465-a19d-a2d14c3af452 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:33.806338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ee4b8914-e43e-4465-a19d-a2d14c3af452 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:33.807189 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ee4b8914-e43e-4465-a19d-a2d14c3af452 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:33.843216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3f6c88ed-c072-4cc8-b824-acef3c181418 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:33.869117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3f6c88ed-c072-4cc8-b824-acef3c181418 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:33.877808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3f6c88ed-c072-4cc8-b824-acef3c181418 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:33.882037 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3f6c88ed-c072-4cc8-b824-acef3c181418 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.738223 May 27 15:11:33.884784 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1764/3516] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:33 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:33.900615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ff57dec1-18b0-4980-b40b-402a93d9946c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:33.912853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ff57dec1-18b0-4980-b40b-402a93d9946c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:33.933185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff57dec1-18b0-4980-b40b-402a93d9946c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:33.933647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff57dec1-18b0-4980-b40b-402a93d9946c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:33.934447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff57dec1-18b0-4980-b40b-402a93d9946c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:33.934914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff57dec1-18b0-4980-b40b-402a93d9946c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:34.019484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ee4b8914-e43e-4465-a19d-a2d14c3af452 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:34.037629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ee4b8914-e43e-4465-a19d-a2d14c3af452 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:34.041792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ee4b8914-e43e-4465-a19d-a2d14c3af452 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:34.045675 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ee4b8914-e43e-4465-a19d-a2d14c3af452 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.293297 May 27 15:11:34.047905 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1753/3517] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:33 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:34.056282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0a8d5887-b03d-4e88-9fb3-89874ccef64c tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:34.059020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0a8d5887-b03d-4e88-9fb3-89874ccef64c tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:34.084509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a8d5887-b03d-4e88-9fb3-89874ccef64c tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:34.086759 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a8d5887-b03d-4e88-9fb3-89874ccef64c tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:34.088114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a8d5887-b03d-4e88-9fb3-89874ccef64c tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:34.088916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a8d5887-b03d-4e88-9fb3-89874ccef64c tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:34.261823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ff57dec1-18b0-4980-b40b-402a93d9946c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:34.287710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ff57dec1-18b0-4980-b40b-402a93d9946c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:34.291557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ff57dec1-18b0-4980-b40b-402a93d9946c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:34.294124 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ff57dec1-18b0-4980-b40b-402a93d9946c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1739 microversion: 2.20 time: 0.403444 May 27 15:11:34.315697 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1765/3518] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:33 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1739 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:34.327137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-1dcf3db9-cdb1-45c6-af0c-74c1233a77eb req-f0d42cea-b88e-4efd-bf0e-abd4d9348687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e91050bc-2362-4bbb-bd3f-2c4c3449d244", "name": "network-vif-deleted", "tag": "da2f5dde-fd05-455a-8b41-6a0183d14e59"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:34.349858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-1dcf3db9-cdb1-45c6-af0c-74c1233a77eb req-f0d42cea-b88e-4efd-bf0e-abd4d9348687 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:34.352284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-1dcf3db9-cdb1-45c6-af0c-74c1233a77eb req-f0d42cea-b88e-4efd-bf0e-abd4d9348687 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:34.368642 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-1dcf3db9-cdb1-45c6-af0c-74c1233a77eb req-f0d42cea-b88e-4efd-bf0e-abd4d9348687 service nova] Creating event network-vif-deleted:da2f5dde-fd05-455a-8b41-6a0183d14e59 for instance e91050bc-2362-4bbb-bd3f-2c4c3449d244 on n-h2-843621-1 May 27 15:11:34.390668 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-1dcf3db9-cdb1-45c6-af0c-74c1233a77eb req-f0d42cea-b88e-4efd-bf0e-abd4d9348687 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071855 May 27 15:11:34.394687 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1766/3519] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:34.431087 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0a8d5887-b03d-4e88-9fb3-89874ccef64c tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:34.433734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e93a5ad6-0645-4931-89ed-a842122d62d1 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:34.434507 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e93a5ad6-0645-4931-89ed-a842122d62d1 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] [instance: e91050bc-2362-4bbb-bd3f-2c4c3449d244] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:34.449632 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0a8d5887-b03d-4e88-9fb3-89874ccef64c tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1523 microversion: 2.1 time: 0.400283 May 27 15:11:34.454572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e93a5ad6-0645-4931-89ed-a842122d62d1 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:34.455039 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e93a5ad6-0645-4931-89ed-a842122d62d1 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:34.456644 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1754/3520] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:34 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1523 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:34.459281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e93a5ad6-0645-4931-89ed-a842122d62d1 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:34.459840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e93a5ad6-0645-4931-89ed-a842122d62d1 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:34.543350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e93a5ad6-0645-4931-89ed-a842122d62d1 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:34.544026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e93a5ad6-0645-4931-89ed-a842122d62d1 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:34.544507 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-e93a5ad6-0645-4931-89ed-a842122d62d1 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lazy-loading 'fault' on Instance uuid e91050bc-2362-4bbb-bd3f-2c4c3449d244 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:11:34.625858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e93a5ad6-0645-4931-89ed-a842122d62d1 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48c676b007f0451f98480c38ec373df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d4c75b7c44b1e87448d9bdf9621ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:34.639544 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e93a5ad6-0645-4931-89ed-a842122d62d1 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] 10.222.0.13 "GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244" status: 200 len: 1315 microversion: 2.1 time: 0.216454 May 27 15:11:34.651248 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1767/3521] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:34 2022] GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:34.769774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-79b538d0-84ca-44e6-b9e5-5ebdad71d472 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:34.770930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-79b538d0-84ca-44e6-b9e5-5ebdad71d472 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:34.782002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79b538d0-84ca-44e6-b9e5-5ebdad71d472 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:34.782959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79b538d0-84ca-44e6-b9e5-5ebdad71d472 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:34.787268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79b538d0-84ca-44e6-b9e5-5ebdad71d472 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:34.791329 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79b538d0-84ca-44e6-b9e5-5ebdad71d472 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:34.906833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-08a72975-253c-435a-9975-5793992bd70e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:34.908611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-08a72975-253c-435a-9975-5793992bd70e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:34.923088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08a72975-253c-435a-9975-5793992bd70e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:34.923883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08a72975-253c-435a-9975-5793992bd70e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:34.926850 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08a72975-253c-435a-9975-5793992bd70e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:34.927495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08a72975-253c-435a-9975-5793992bd70e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:34.959656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-79b538d0-84ca-44e6-b9e5-5ebdad71d472 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:34.974548 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-79b538d0-84ca-44e6-b9e5-5ebdad71d472 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1253 microversion: 2.1 time: 0.212329 May 27 15:11:34.977226 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1755/3522] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:34 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1253 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:35.076060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c9260df3-fa64-4c07-9839-462b397a48fc tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:35.077846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c9260df3-fa64-4c07-9839-462b397a48fc tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:35.097661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9260df3-fa64-4c07-9839-462b397a48fc tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:35.098537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9260df3-fa64-4c07-9839-462b397a48fc tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:35.099667 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9260df3-fa64-4c07-9839-462b397a48fc tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:35.100376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9260df3-fa64-4c07-9839-462b397a48fc tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:35.158408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=14 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:35.234094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c9260df3-fa64-4c07-9839-462b397a48fc tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:35.249154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c9260df3-fa64-4c07-9839-462b397a48fc tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:35.252098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c9260df3-fa64-4c07-9839-462b397a48fc tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:35.256166 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c9260df3-fa64-4c07-9839-462b397a48fc tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.186851 May 27 15:11:35.264777 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1756/3523] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:35 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:35.318717 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-081631e4-dcc1-4183-8384-9521b359ec4b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:35.319353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-081631e4-dcc1-4183-8384-9521b359ec4b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:35.327186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-081631e4-dcc1-4183-8384-9521b359ec4b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:35.327643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-081631e4-dcc1-4183-8384-9521b359ec4b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:35.328430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-081631e4-dcc1-4183-8384-9521b359ec4b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:35.328899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-081631e4-dcc1-4183-8384-9521b359ec4b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:35.354578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-08a72975-253c-435a-9975-5793992bd70e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:35.374815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-08a72975-253c-435a-9975-5793992bd70e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:35.376480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-08a72975-253c-435a-9975-5793992bd70e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:35.377772 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-08a72975-253c-435a-9975-5793992bd70e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.474918 May 27 15:11:35.378459 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1768/3524] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:34 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:35.474341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5470c731-07cf-49b3-b434-a36f2247b6bf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:35.474901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5470c731-07cf-49b3-b434-a36f2247b6bf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:35.506748 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5470c731-07cf-49b3-b434-a36f2247b6bf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:35.507535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5470c731-07cf-49b3-b434-a36f2247b6bf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:35.515552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5470c731-07cf-49b3-b434-a36f2247b6bf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:35.516131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5470c731-07cf-49b3-b434-a36f2247b6bf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:35.966843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-081631e4-dcc1-4183-8384-9521b359ec4b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:35.975505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-081631e4-dcc1-4183-8384-9521b359ec4b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:35.977490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-081631e4-dcc1-4183-8384-9521b359ec4b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:35.983792 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-081631e4-dcc1-4183-8384-9521b359ec4b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1739 microversion: 2.20 time: 0.664705 May 27 15:11:35.984336 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1757/3525] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:35 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1739 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:36.002113 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-29cf286d-a7f4-4f7a-b8da-ea86c15a5b63 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:36.002861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-29cf286d-a7f4-4f7a-b8da-ea86c15a5b63 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] [instance: e91050bc-2362-4bbb-bd3f-2c4c3449d244] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:36.025892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5470c731-07cf-49b3-b434-a36f2247b6bf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:36.026730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-29cf286d-a7f4-4f7a-b8da-ea86c15a5b63 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:36.027197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-29cf286d-a7f4-4f7a-b8da-ea86c15a5b63 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:36.027984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-29cf286d-a7f4-4f7a-b8da-ea86c15a5b63 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:36.028432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-29cf286d-a7f4-4f7a-b8da-ea86c15a5b63 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:36.037224 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5470c731-07cf-49b3-b434-a36f2247b6bf tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1523 microversion: 2.1 time: 0.566774 May 27 15:11:36.048413 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1769/3526] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:35 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1523 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:36.053824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-da5c331c-b637-4d39-8a6e-7d3b52b623b9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:36.054638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-da5c331c-b637-4d39-8a6e-7d3b52b623b9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:36.083146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da5c331c-b637-4d39-8a6e-7d3b52b623b9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:36.083790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da5c331c-b637-4d39-8a6e-7d3b52b623b9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:36.085092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da5c331c-b637-4d39-8a6e-7d3b52b623b9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:36.086361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da5c331c-b637-4d39-8a6e-7d3b52b623b9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:36.087265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:36.096286 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-29cf286d-a7f4-4f7a-b8da-ea86c15a5b63 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] HTTP exception thrown: Instance e91050bc-2362-4bbb-bd3f-2c4c3449d244 could not be found. May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-29cf286d-a7f4-4f7a-b8da-ea86c15a5b63 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Request method failure captured: May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244 HTTP/1.1 May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOoQMAL_KUPLGriuIw18gMfR5sRePi_AbJJk0cBvQ5wyNH0Xf9-CM1ShxcASMlVREJg3LmZQcmiP8LTZZsi2eR2PTQGuMIpCnx6UiFemrDQY0OPHN_IoMYpUYiLAJhqHXnvK0hM6-zRhV9GhPgJRkWw-iW3B3XHF-VpQFbRiMptmw8A May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: e92d4c75b7c44b1e87448d9bdf9621ae May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-268838258 May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e92d4c75b7c44b1e87448d9bdf9621ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e92d4c75b7c44b1e87448d9bdf9621ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e92d4c75b7c44b1e87448d9bdf9621ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e92d4c75b7c44b1e87448d9bdf9621ae", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-268838258 May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: e92d4c75b7c44b1e87448d9bdf9621ae May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-268838258 May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-InstanceActionsNegativeTestJSON-268838258-project May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 48c676b007f0451f98480c38ec373df3 May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-268838258-project May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance e91050bc-2362-4bbb-bd3f-2c4c3449d244 could not be found. May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'e91050bc-2362-4bbb-bd3f-2c4c3449d244'} May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e91050bc-2362-4bbb-bd3f-2c4c3449d244 could not be found. May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e91050bc-2362-4bbb-bd3f-2c4c3449d244 could not be found. May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:36.100946 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:36.106428 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:36.106428 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:36.106428 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:36.106428 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:36.106428 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:11:36.106428 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:11:36.106428 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e91050bc-2362-4bbb-bd3f-2c4c3449d244 could not be found. May 27 15:11:36.106428 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:36.108969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-29cf286d-a7f4-4f7a-b8da-ea86c15a5b63 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] Returning 404 to user: Instance e91050bc-2362-4bbb-bd3f-2c4c3449d244 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:11:36.110412 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-29cf286d-a7f4-4f7a-b8da-ea86c15a5b63 tempest-InstanceActionsNegativeTestJSON-268838258 tempest-InstanceActionsNegativeTestJSON-268838258-project] 10.222.0.13 "GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244" status: 404 len: 111 microversion: 2.1 time: 0.124819 May 27 15:11:36.111634 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1758/3527] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:35 2022] GET /compute/v2.1/servers/e91050bc-2362-4bbb-bd3f-2c4c3449d244 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:11:36.220533 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-da5c331c-b637-4d39-8a6e-7d3b52b623b9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:36.233971 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-da5c331c-b637-4d39-8a6e-7d3b52b623b9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1253 microversion: 2.1 time: 0.184054 May 27 15:11:36.237970 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1770/3528] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:36 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1253 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:36.285940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a1ba66dc-df35-4950-a771-3b358f953baa tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:36.286621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a1ba66dc-df35-4950-a771-3b358f953baa tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:36.313898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1ba66dc-df35-4950-a771-3b358f953baa tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:36.318960 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1ba66dc-df35-4950-a771-3b358f953baa tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:36.321385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1ba66dc-df35-4950-a771-3b358f953baa tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:36.321385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1ba66dc-df35-4950-a771-3b358f953baa tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:36.396586 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3e232a1d-632a-4bf6-a32f-c80c9a0a91af tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:36.398126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3e232a1d-632a-4bf6-a32f-c80c9a0a91af tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:36.412053 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e232a1d-632a-4bf6-a32f-c80c9a0a91af tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:36.413613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e232a1d-632a-4bf6-a32f-c80c9a0a91af tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:36.416195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e232a1d-632a-4bf6-a32f-c80c9a0a91af tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:36.417055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e232a1d-632a-4bf6-a32f-c80c9a0a91af tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:36.535458 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a1ba66dc-df35-4950-a771-3b358f953baa tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:36.545479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a1ba66dc-df35-4950-a771-3b358f953baa tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:36.550852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a1ba66dc-df35-4950-a771-3b358f953baa tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:36.557068 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a1ba66dc-df35-4950-a771-3b358f953baa tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.271928 May 27 15:11:36.563589 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1759/3529] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:36 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:36.807504 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3e232a1d-632a-4bf6-a32f-c80c9a0a91af tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:36.818536 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3e232a1d-632a-4bf6-a32f-c80c9a0a91af tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:36.821430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3e232a1d-632a-4bf6-a32f-c80c9a0a91af tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:36.823157 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3e232a1d-632a-4bf6-a32f-c80c9a0a91af tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.430810 May 27 15:11:36.838384 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1771/3530] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:36 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:11:37.003834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ea8909ea-772a-4d1f-911d-29a0cf875690 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:37.005369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ea8909ea-772a-4d1f-911d-29a0cf875690 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:37.023504 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea8909ea-772a-4d1f-911d-29a0cf875690 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:37.024180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea8909ea-772a-4d1f-911d-29a0cf875690 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:37.025144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea8909ea-772a-4d1f-911d-29a0cf875690 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:37.026212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea8909ea-772a-4d1f-911d-29a0cf875690 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:37.055523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4d99fead-4140-4786-9029-cb8f2d1f7f84 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:37.056541 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4d99fead-4140-4786-9029-cb8f2d1f7f84 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:37.067957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d99fead-4140-4786-9029-cb8f2d1f7f84 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:37.074216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d99fead-4140-4786-9029-cb8f2d1f7f84 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:37.075269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d99fead-4140-4786-9029-cb8f2d1f7f84 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:37.077234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d99fead-4140-4786-9029-cb8f2d1f7f84 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:37.620477 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4d99fead-4140-4786-9029-cb8f2d1f7f84 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:37.637122 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4d99fead-4140-4786-9029-cb8f2d1f7f84 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1523 microversion: 2.1 time: 0.580613 May 27 15:11:37.645002 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1772/3531] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:37 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1523 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:37.659974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6336e430-5f7d-41cf-afa8-22b3e6c87369 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:37.662913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6336e430-5f7d-41cf-afa8-22b3e6c87369 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:37.679460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6336e430-5f7d-41cf-afa8-22b3e6c87369 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:37.680331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6336e430-5f7d-41cf-afa8-22b3e6c87369 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:37.681618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6336e430-5f7d-41cf-afa8-22b3e6c87369 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:37.684666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6336e430-5f7d-41cf-afa8-22b3e6c87369 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:37.690525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ea8909ea-772a-4d1f-911d-29a0cf875690 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:37.705176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ea8909ea-772a-4d1f-911d-29a0cf875690 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:37.706739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ea8909ea-772a-4d1f-911d-29a0cf875690 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:37.707951 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ea8909ea-772a-4d1f-911d-29a0cf875690 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1739 microversion: 2.20 time: 0.708611 May 27 15:11:37.708712 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1760/3532] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:36 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1739 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:11:37.743387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-48cac6f0-bb2f-4a66-948e-ba57d077306b tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:37.748469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-48cac6f0-bb2f-4a66-948e-ba57d077306b tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:37.768278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=14 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:37.770707 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-48cac6f0-bb2f-4a66-948e-ba57d077306b tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:37.774790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-48cac6f0-bb2f-4a66-948e-ba57d077306b tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:37.775715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-48cac6f0-bb2f-4a66-948e-ba57d077306b tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:37.776181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-48cac6f0-bb2f-4a66-948e-ba57d077306b tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:37.848992 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6336e430-5f7d-41cf-afa8-22b3e6c87369 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:37.873339 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6336e430-5f7d-41cf-afa8-22b3e6c87369 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1253 microversion: 2.1 time: 0.226231 May 27 15:11:37.874566 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1773/3533] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:37 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1253 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:37.881458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f06d7937-e756-4387-91aa-8428dd74ddb7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:37.882381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f06d7937-e756-4387-91aa-8428dd74ddb7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:37.891327 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f06d7937-e756-4387-91aa-8428dd74ddb7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:37.894413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f06d7937-e756-4387-91aa-8428dd74ddb7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:37.897671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f06d7937-e756-4387-91aa-8428dd74ddb7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:37.898474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f06d7937-e756-4387-91aa-8428dd74ddb7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:37.932800 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-48cac6f0-bb2f-4a66-948e-ba57d077306b tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:37.948045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-48cac6f0-bb2f-4a66-948e-ba57d077306b tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:37.949779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-48cac6f0-bb2f-4a66-948e-ba57d077306b tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:37.952792 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-48cac6f0-bb2f-4a66-948e-ba57d077306b tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.219972 May 27 15:11:37.954511 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1761/3534] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:37 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:38.261187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f06d7937-e756-4387-91aa-8428dd74ddb7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:38.276275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f06d7937-e756-4387-91aa-8428dd74ddb7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:38.278232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f06d7937-e756-4387-91aa-8428dd74ddb7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:38.279906 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f06d7937-e756-4387-91aa-8428dd74ddb7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.403478 May 27 15:11:38.281441 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1774/3535] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:37 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:38.656408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-98db66ff-ecaf-41a9-8ce8-e84f09acce3d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:38.657657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-98db66ff-ecaf-41a9-8ce8-e84f09acce3d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:38.668504 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98db66ff-ecaf-41a9-8ce8-e84f09acce3d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:38.669795 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98db66ff-ecaf-41a9-8ce8-e84f09acce3d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:38.671236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98db66ff-ecaf-41a9-8ce8-e84f09acce3d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:38.672141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98db66ff-ecaf-41a9-8ce8-e84f09acce3d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:38.746054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e1178837-a967-421b-8a95-c05277f4f25d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:38.791126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e1178837-a967-421b-8a95-c05277f4f25d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:38.828501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e1178837-a967-421b-8a95-c05277f4f25d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:38.832151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e1178837-a967-421b-8a95-c05277f4f25d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:38.843088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e1178837-a967-421b-8a95-c05277f4f25d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:38.843596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e1178837-a967-421b-8a95-c05277f4f25d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:38.884171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:38.924449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=12 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:39.159144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-98db66ff-ecaf-41a9-8ce8-e84f09acce3d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:39.183632 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-98db66ff-ecaf-41a9-8ce8-e84f09acce3d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1523 microversion: 2.1 time: 0.531537 May 27 15:11:39.203128 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1762/3536] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:38 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1523 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:39.210361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0c73cad0-29ea-4f0c-878a-7b048c4e2dc1 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:39.210964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0c73cad0-29ea-4f0c-878a-7b048c4e2dc1 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:39.238911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c73cad0-29ea-4f0c-878a-7b048c4e2dc1 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:39.239383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c73cad0-29ea-4f0c-878a-7b048c4e2dc1 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:39.245606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c73cad0-29ea-4f0c-878a-7b048c4e2dc1 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:39.246242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c73cad0-29ea-4f0c-878a-7b048c4e2dc1 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:39.306614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e1178837-a967-421b-8a95-c05277f4f25d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:39.327863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e1178837-a967-421b-8a95-c05277f4f25d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:39.329735 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e1178837-a967-421b-8a95-c05277f4f25d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:39.334105 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e1178837-a967-421b-8a95-c05277f4f25d tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1739 microversion: 2.20 time: 0.600256 May 27 15:11:39.335372 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1775/3537] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:38 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1739 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:39.386317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ffec2af5-eff1-4e72-8c0f-64513e07b992 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:39.394333 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ffec2af5-eff1-4e72-8c0f-64513e07b992 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:39.403588 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0c73cad0-29ea-4f0c-878a-7b048c4e2dc1 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:39.415398 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0c73cad0-29ea-4f0c-878a-7b048c4e2dc1 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1253 microversion: 2.1 time: 0.210544 May 27 15:11:39.416881 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1763/3538] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:39 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1253 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:39.422695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-acd7ac4d-aff4-472d-9c1b-7afe591d0445 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:39.423818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-acd7ac4d-aff4-472d-9c1b-7afe591d0445 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:39.432272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ffec2af5-eff1-4e72-8c0f-64513e07b992 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:39.433347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-acd7ac4d-aff4-472d-9c1b-7afe591d0445 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:39.433974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-acd7ac4d-aff4-472d-9c1b-7afe591d0445 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:39.434913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-acd7ac4d-aff4-472d-9c1b-7afe591d0445 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:39.435656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-acd7ac4d-aff4-472d-9c1b-7afe591d0445 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:39.436506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ffec2af5-eff1-4e72-8c0f-64513e07b992 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:39.438417 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ffec2af5-eff1-4e72-8c0f-64513e07b992 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:39.445234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ffec2af5-eff1-4e72-8c0f-64513e07b992 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:39.787580 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ffec2af5-eff1-4e72-8c0f-64513e07b992 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:39.810733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ffec2af5-eff1-4e72-8c0f-64513e07b992 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:39.818029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ffec2af5-eff1-4e72-8c0f-64513e07b992 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:39.823805 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ffec2af5-eff1-4e72-8c0f-64513e07b992 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1366 microversion: 2.47 time: 0.486896 May 27 15:11:39.830771 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1776/3539] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:39 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1366 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:39.883619 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-acd7ac4d-aff4-472d-9c1b-7afe591d0445 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:39.895000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-acd7ac4d-aff4-472d-9c1b-7afe591d0445 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:39.896478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-acd7ac4d-aff4-472d-9c1b-7afe591d0445 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:39.897719 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-acd7ac4d-aff4-472d-9c1b-7afe591d0445 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.479717 May 27 15:11:39.899035 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1764/3540] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:39 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:40.008022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ff58f8c0-f5a4-4b95-ba2a-b70d236f1ed1 tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-248037050", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:40.010433 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-ff58f8c0-f5a4-4b95-ba2a-b70d236f1ed1 tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] HTTP exception thrown: min_count must be <= max_count May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ff58f8c0-f5a4-4b95-ba2a-b70d236f1ed1 tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] Request method failure captured: May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 183 May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOorCgaKAKAw8yVc9IAR9gjP6AjihfGQY9ztpuCS4OAiy32mdfQVAgtjW089tgMscMn0G7ReMo-s6CptiFTSg39XU2mrGYrauUMKdDMimpXnV7RytpcGN6t6Flvxhqi8tpOmDx9LuvRD6yaQX-ssPExwbKy86qzb1p6wja6v30COLAc May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 258a88f8842548e7b0704bf3f7437184 May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1088926213 May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258a88f8842548e7b0704bf3f7437184"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258a88f8842548e7b0704bf3f7437184"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/258a88f8842548e7b0704bf3f7437184"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_258a88f8842548e7b0704bf3f7437184", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1088926213 May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 258a88f8842548e7b0704bf3f7437184 May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1088926213 May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-MultipleCreateNegativeTestJSON-1088926213-project May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 840128ae32784e189a69870454a4c086 May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1088926213-project May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-248037050", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "min_count": 3, "max_count": 2}} May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: exception: min_count must be <= max_count May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-248037050', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count May 27 15:11:40.012367 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:40.019092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ff58f8c0-f5a4-4b95-ba2a-b70d236f1ed1 tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] Returning 400 to user: min_count must be <= max_count {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:11:40.019986 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ff58f8c0-f5a4-4b95-ba2a-b70d236f1ed1 tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.187959 May 27 15:11:40.028601 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1777/3541] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:11:39 2022] POST /compute/v2.1/servers => generated 74 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 27 15:11:40.119625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c352f198-1104-44ed-8feb-27ba503e054c tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-82033406", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "max_count": 0}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c352f198-1104-44ed-8feb-27ba503e054c tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] Request method failure captured: May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 166 May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOorCgaKAKAw8yVc9IAR9gjP6AjihfGQY9ztpuCS4OAiy32mdfQVAgtjW089tgMscMn0G7ReMo-s6CptiFTSg39XU2mrGYrauUMKdDMimpXnV7RytpcGN6t6Flvxhqi8tpOmDx9LuvRD6yaQX-ssPExwbKy86qzb1p6wja6v30COLAc May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 258a88f8842548e7b0704bf3f7437184 May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1088926213 May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258a88f8842548e7b0704bf3f7437184"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258a88f8842548e7b0704bf3f7437184"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/258a88f8842548e7b0704bf3f7437184"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_258a88f8842548e7b0704bf3f7437184", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1088926213 May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 258a88f8842548e7b0704bf3f7437184 May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1088926213 May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-MultipleCreateNegativeTestJSON-1088926213-project May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 840128ae32784e189a69870454a4c086 May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1088926213-project May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-82033406", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "max_count": 0}} May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-82033406', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'max_count': 0}}} May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise error May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi On instance['server']: May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 0 May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:11:40.122662 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:11:40.127643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:11:40.127643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:11:40.127643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:11:40.127643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 27 15:11:40.127643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:40.127643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:40.127643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:40.127643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:40.127643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:40.127643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:40.127643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:11:40.127643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:11:40.127643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 27 15:11:40.127643 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:40.127643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c352f198-1104-44ed-8feb-27ba503e054c tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:11:40.130230 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c352f198-1104-44ed-8feb-27ba503e054c tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016809 May 27 15:11:40.133571 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1765/3542] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:11:40 2022] POST /compute/v2.1/servers => generated 130 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:11:40.190076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-63b3c10a-cda2-492e-9127-b761ee949ffb tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-530887808", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "max_count": 2.5}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-63b3c10a-cda2-492e-9127-b761ee949ffb tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] Request method failure captured: May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 169 May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOorCgaKAKAw8yVc9IAR9gjP6AjihfGQY9ztpuCS4OAiy32mdfQVAgtjW089tgMscMn0G7ReMo-s6CptiFTSg39XU2mrGYrauUMKdDMimpXnV7RytpcGN6t6Flvxhqi8tpOmDx9LuvRD6yaQX-ssPExwbKy86qzb1p6wja6v30COLAc May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 258a88f8842548e7b0704bf3f7437184 May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1088926213 May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258a88f8842548e7b0704bf3f7437184"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258a88f8842548e7b0704bf3f7437184"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/258a88f8842548e7b0704bf3f7437184"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_258a88f8842548e7b0704bf3f7437184", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1088926213 May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 258a88f8842548e7b0704bf3f7437184 May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1088926213 May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-MultipleCreateNegativeTestJSON-1088926213-project May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 840128ae32784e189a69870454a4c086 May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1088926213-project May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-530887808", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "max_count": 2.5}} May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-530887808', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'max_count': 2.5}}} May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance['server']: May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 2.5 May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:11:40.196736 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:11:40.204731 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:11:40.204731 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:11:40.204731 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:11:40.204731 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:11:40.204731 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 27 15:11:40.204731 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:40.204731 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:40.204731 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:40.204731 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:40.204731 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:40.204731 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:40.204731 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:11:40.204731 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:11:40.204731 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 27 15:11:40.204731 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:40.204731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-63b3c10a-cda2-492e-9127-b761ee949ffb tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:11:40.204731 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-63b3c10a-cda2-492e-9127-b761ee949ffb tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.010876 May 27 15:11:40.217942 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1778/3543] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:11:40 2022] POST /compute/v2.1/servers => generated 139 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:11:40.219325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-51ea7518-5b8c-47e5-b307-966ea1d62d21 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:40.220439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-51ea7518-5b8c-47e5-b307-966ea1d62d21 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:40.243363 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51ea7518-5b8c-47e5-b307-966ea1d62d21 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:40.243854 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51ea7518-5b8c-47e5-b307-966ea1d62d21 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:40.245128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51ea7518-5b8c-47e5-b307-966ea1d62d21 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:40.245581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51ea7518-5b8c-47e5-b307-966ea1d62d21 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:40.295216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f3a53e6a-8901-4643-b49f-6d2973c3b393 tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1949824983", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "min_count": 0}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f3a53e6a-8901-4643-b49f-6d2973c3b393 tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] Request method failure captured: May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 168 May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOorCgaKAKAw8yVc9IAR9gjP6AjihfGQY9ztpuCS4OAiy32mdfQVAgtjW089tgMscMn0G7ReMo-s6CptiFTSg39XU2mrGYrauUMKdDMimpXnV7RytpcGN6t6Flvxhqi8tpOmDx9LuvRD6yaQX-ssPExwbKy86qzb1p6wja6v30COLAc May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 258a88f8842548e7b0704bf3f7437184 May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1088926213 May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258a88f8842548e7b0704bf3f7437184"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258a88f8842548e7b0704bf3f7437184"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/258a88f8842548e7b0704bf3f7437184"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_258a88f8842548e7b0704bf3f7437184", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1088926213 May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 258a88f8842548e7b0704bf3f7437184 May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1088926213 May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-MultipleCreateNegativeTestJSON-1088926213-project May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 840128ae32784e189a69870454a4c086 May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1088926213-project May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1949824983", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "min_count": 0}} May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1949824983', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'min_count': 0}}} May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance['server']: May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 0 May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:11:40.298063 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:11:40.313967 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:11:40.313967 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:11:40.313967 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:11:40.313967 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:11:40.313967 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 27 15:11:40.313967 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:40.313967 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:40.313967 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:40.313967 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:40.313967 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:40.313967 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:40.313967 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:11:40.313967 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:11:40.313967 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 27 15:11:40.313967 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:40.313967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f3a53e6a-8901-4643-b49f-6d2973c3b393 tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:11:40.313967 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f3a53e6a-8901-4643-b49f-6d2973c3b393 tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.008512 May 27 15:11:40.313967 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1779/3544] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:11:40 2022] POST /compute/v2.1/servers => generated 130 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:11:40.373000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-44d12a8b-3dc3-4534-81a6-151f2d73ab31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:40.374525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-44d12a8b-3dc3-4534-81a6-151f2d73ab31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:40.396645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44d12a8b-3dc3-4534-81a6-151f2d73ab31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:40.400168 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44d12a8b-3dc3-4534-81a6-151f2d73ab31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:40.403616 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44d12a8b-3dc3-4534-81a6-151f2d73ab31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:40.404371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44d12a8b-3dc3-4534-81a6-151f2d73ab31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:40.675006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-51ea7518-5b8c-47e5-b307-966ea1d62d21 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:40.702429 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-51ea7518-5b8c-47e5-b307-966ea1d62d21 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1523 microversion: 2.1 time: 0.494713 May 27 15:11:40.712945 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1766/3545] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:40 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1523 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:40.719242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4753775e-bd1d-469d-bd08-e1ee16229bb2 tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2127351758", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "min_count": 2.5}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4753775e-bd1d-469d-bd08-e1ee16229bb2 tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] Request method failure captured: May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 170 May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOorCgaKAKAw8yVc9IAR9gjP6AjihfGQY9ztpuCS4OAiy32mdfQVAgtjW089tgMscMn0G7ReMo-s6CptiFTSg39XU2mrGYrauUMKdDMimpXnV7RytpcGN6t6Flvxhqi8tpOmDx9LuvRD6yaQX-ssPExwbKy86qzb1p6wja6v30COLAc May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 258a88f8842548e7b0704bf3f7437184 May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1088926213 May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258a88f8842548e7b0704bf3f7437184"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258a88f8842548e7b0704bf3f7437184"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/258a88f8842548e7b0704bf3f7437184"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_258a88f8842548e7b0704bf3f7437184", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1088926213 May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 258a88f8842548e7b0704bf3f7437184 May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1088926213 May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-MultipleCreateNegativeTestJSON-1088926213-project May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 840128ae32784e189a69870454a4c086 May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1088926213-project May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2127351758", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "min_count": 2.5}} May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2127351758', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'min_count': 2.5}}} May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise error May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi On instance['server']: May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 2.5 May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:11:40.721957 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:11:40.725770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:11:40.725770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:11:40.725770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:11:40.725770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:11:40.725770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 27 15:11:40.725770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:40.725770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:40.725770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:40.725770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:40.725770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:40.725770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:40.725770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:11:40.725770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:11:40.725770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 27 15:11:40.725770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:40.725770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4753775e-bd1d-469d-bd08-e1ee16229bb2 tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:11:40.725770 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4753775e-bd1d-469d-bd08-e1ee16229bb2 tempest-MultipleCreateNegativeTestJSON-1088926213 tempest-MultipleCreateNegativeTestJSON-1088926213-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011440 May 27 15:11:40.727042 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1767/3546] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:11:40 2022] POST /compute/v2.1/servers => generated 139 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:11:40.736707 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5e6f5de0-8986-4588-8591-d47502e9a5f9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:40.745944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5e6f5de0-8986-4588-8591-d47502e9a5f9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:40.760990 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e6f5de0-8986-4588-8591-d47502e9a5f9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:40.763930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e6f5de0-8986-4588-8591-d47502e9a5f9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:40.765084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e6f5de0-8986-4588-8591-d47502e9a5f9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:40.765554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e6f5de0-8986-4588-8591-d47502e9a5f9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:40.836514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-44d12a8b-3dc3-4534-81a6-151f2d73ab31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:40.858026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-44d12a8b-3dc3-4534-81a6-151f2d73ab31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:40.860606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-44d12a8b-3dc3-4534-81a6-151f2d73ab31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:40.871058 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-44d12a8b-3dc3-4534-81a6-151f2d73ab31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1739 microversion: 2.20 time: 0.521187 May 27 15:11:40.871666 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1780/3547] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:40 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1739 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:11:40.886667 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2ce567a6-900c-4332-a103-69beccd6eb95 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:40.887662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2ce567a6-900c-4332-a103-69beccd6eb95 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:40.904390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ce567a6-900c-4332-a103-69beccd6eb95 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:40.905530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ce567a6-900c-4332-a103-69beccd6eb95 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:40.909539 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ce567a6-900c-4332-a103-69beccd6eb95 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:40.911797 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ce567a6-900c-4332-a103-69beccd6eb95 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:40.927404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5e6f5de0-8986-4588-8591-d47502e9a5f9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:40.942002 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5e6f5de0-8986-4588-8591-d47502e9a5f9 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1253 microversion: 2.1 time: 0.214679 May 27 15:11:40.947354 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1768/3548] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:40 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1253 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:40.963831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5d493087-976b-4ab5-a8aa-95984f7c936d tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:40.965276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5d493087-976b-4ab5-a8aa-95984f7c936d tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:40.974392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d493087-976b-4ab5-a8aa-95984f7c936d tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:40.976173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d493087-976b-4ab5-a8aa-95984f7c936d tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:40.979002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d493087-976b-4ab5-a8aa-95984f7c936d tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:40.980599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d493087-976b-4ab5-a8aa-95984f7c936d tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:41.104068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2ce567a6-900c-4332-a103-69beccd6eb95 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:41.125407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2ce567a6-900c-4332-a103-69beccd6eb95 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:41.130472 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2ce567a6-900c-4332-a103-69beccd6eb95 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:41.136519 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2ce567a6-900c-4332-a103-69beccd6eb95 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1372 microversion: 2.47 time: 0.261810 May 27 15:11:41.137409 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1781/3549] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:40 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1372 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:41.405488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5d493087-976b-4ab5-a8aa-95984f7c936d tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:41.423756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5d493087-976b-4ab5-a8aa-95984f7c936d tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:41.438426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5d493087-976b-4ab5-a8aa-95984f7c936d tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:41.439649 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5d493087-976b-4ab5-a8aa-95984f7c936d tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.490740 May 27 15:11:41.456905 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1769/3550] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:40 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:41.721795 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-74b374ed-e633-4194-8258-66e39612521e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:41.723659 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-74b374ed-e633-4194-8258-66e39612521e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:41.738392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74b374ed-e633-4194-8258-66e39612521e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:41.741115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74b374ed-e633-4194-8258-66e39612521e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:41.743433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74b374ed-e633-4194-8258-66e39612521e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:41.745596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74b374ed-e633-4194-8258-66e39612521e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:41.892437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1756b678-89b7-4d42-94ce-baf2c7243e31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:41.894223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1756b678-89b7-4d42-94ce-baf2c7243e31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:41.923889 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1756b678-89b7-4d42-94ce-baf2c7243e31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:41.937635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1756b678-89b7-4d42-94ce-baf2c7243e31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:41.942093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1756b678-89b7-4d42-94ce-baf2c7243e31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:41.949162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1756b678-89b7-4d42-94ce-baf2c7243e31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:42.295430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-74b374ed-e633-4194-8258-66e39612521e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:42.318191 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-74b374ed-e633-4194-8258-66e39612521e tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1523 microversion: 2.1 time: 0.602301 May 27 15:11:42.321521 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1782/3551] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:41 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1523 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:11:42.326690 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4e6ff720-47b6-4454-8b16-36e11c3b14b5 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:42.344156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4e6ff720-47b6-4454-8b16-36e11c3b14b5 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:42.390669 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e6ff720-47b6-4454-8b16-36e11c3b14b5 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:42.391786 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e6ff720-47b6-4454-8b16-36e11c3b14b5 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:42.394046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e6ff720-47b6-4454-8b16-36e11c3b14b5 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:42.395229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e6ff720-47b6-4454-8b16-36e11c3b14b5 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:42.572761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1756b678-89b7-4d42-94ce-baf2c7243e31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:42.582598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1756b678-89b7-4d42-94ce-baf2c7243e31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:42.588248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1756b678-89b7-4d42-94ce-baf2c7243e31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:42.593131 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1756b678-89b7-4d42-94ce-baf2c7243e31 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1739 microversion: 2.20 time: 0.706705 May 27 15:11:42.594123 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1770/3552] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:41 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1739 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:11:42.610198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-faa664f0-1280-4208-ba01-078578f56f49 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:42.611298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-faa664f0-1280-4208-ba01-078578f56f49 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:42.621513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4e6ff720-47b6-4454-8b16-36e11c3b14b5 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:42.633592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-faa664f0-1280-4208-ba01-078578f56f49 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:42.635780 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4e6ff720-47b6-4454-8b16-36e11c3b14b5 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1253 microversion: 2.1 time: 0.312614 May 27 15:11:42.636603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-faa664f0-1280-4208-ba01-078578f56f49 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:42.638739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-faa664f0-1280-4208-ba01-078578f56f49 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:42.649609 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1783/3553] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:42 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1253 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:42.655056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-faa664f0-1280-4208-ba01-078578f56f49 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:42.660199 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f622fce0-463b-491b-9920-97c228cde1cb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:42.663451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f622fce0-463b-491b-9920-97c228cde1cb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:42.681720 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f622fce0-463b-491b-9920-97c228cde1cb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:42.682287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f622fce0-463b-491b-9920-97c228cde1cb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:42.683165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f622fce0-463b-491b-9920-97c228cde1cb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:42.683685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f622fce0-463b-491b-9920-97c228cde1cb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:43.003448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-faa664f0-1280-4208-ba01-078578f56f49 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:43.021748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-faa664f0-1280-4208-ba01-078578f56f49 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:43.024838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-faa664f0-1280-4208-ba01-078578f56f49 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:43.035061 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-faa664f0-1280-4208-ba01-078578f56f49 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1372 microversion: 2.47 time: 0.437227 May 27 15:11:43.044959 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1771/3554] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:42 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1372 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:43.168175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f622fce0-463b-491b-9920-97c228cde1cb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:43.183814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f622fce0-463b-491b-9920-97c228cde1cb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:43.189465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f622fce0-463b-491b-9920-97c228cde1cb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:43.191134 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f622fce0-463b-491b-9920-97c228cde1cb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.540250 May 27 15:11:43.193249 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1784/3555] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:42 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:43.339084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aa454956-5efc-4417-a41d-02c860aa53a5 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:43.340102 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-aa454956-5efc-4417-a41d-02c860aa53a5 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:43.352921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa454956-5efc-4417-a41d-02c860aa53a5 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:43.355407 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa454956-5efc-4417-a41d-02c860aa53a5 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:43.356776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa454956-5efc-4417-a41d-02c860aa53a5 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:43.363775 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa454956-5efc-4417-a41d-02c860aa53a5 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:43.614226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9465ed25-6d85-4cdc-a741-749be0ce89f8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:43.615658 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9465ed25-6d85-4cdc-a741-749be0ce89f8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:43.630135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9465ed25-6d85-4cdc-a741-749be0ce89f8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:43.637034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9465ed25-6d85-4cdc-a741-749be0ce89f8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:43.638188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9465ed25-6d85-4cdc-a741-749be0ce89f8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:43.638941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9465ed25-6d85-4cdc-a741-749be0ce89f8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:43.753433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-aa454956-5efc-4417-a41d-02c860aa53a5 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:43.767347 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-aa454956-5efc-4417-a41d-02c860aa53a5 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1523 microversion: 2.1 time: 0.433557 May 27 15:11:43.785214 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1772/3556] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:43 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1523 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:43.790194 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2c19f58f-5595-4d0f-99d3-e77da2d37cb1 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:43.790816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2c19f58f-5595-4d0f-99d3-e77da2d37cb1 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:43.809885 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c19f58f-5595-4d0f-99d3-e77da2d37cb1 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:43.809885 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c19f58f-5595-4d0f-99d3-e77da2d37cb1 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:43.810652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c19f58f-5595-4d0f-99d3-e77da2d37cb1 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:43.811292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c19f58f-5595-4d0f-99d3-e77da2d37cb1 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:43.952761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2c19f58f-5595-4d0f-99d3-e77da2d37cb1 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:43.963602 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2c19f58f-5595-4d0f-99d3-e77da2d37cb1 tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1253 microversion: 2.1 time: 0.177273 May 27 15:11:43.971618 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1773/3557] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:43 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1253 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:44.061690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-70f6e24c-4a05-4b70-85eb-cae08abd010f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:44.062474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-70f6e24c-4a05-4b70-85eb-cae08abd010f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:44.072253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70f6e24c-4a05-4b70-85eb-cae08abd010f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:44.081581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70f6e24c-4a05-4b70-85eb-cae08abd010f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:44.084243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70f6e24c-4a05-4b70-85eb-cae08abd010f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:44.090260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70f6e24c-4a05-4b70-85eb-cae08abd010f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:44.183867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9465ed25-6d85-4cdc-a741-749be0ce89f8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:44.196217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9465ed25-6d85-4cdc-a741-749be0ce89f8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:44.207044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9465ed25-6d85-4cdc-a741-749be0ce89f8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:44.213216 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9465ed25-6d85-4cdc-a741-749be0ce89f8 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1739 microversion: 2.20 time: 0.604071 May 27 15:11:44.214238 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1785/3558] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:43 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1739 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:44.231960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c4e14523-0337-40e9-a7e8-de4261b54dcb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:44.232754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c4e14523-0337-40e9-a7e8-de4261b54dcb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:44.250077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c4e14523-0337-40e9-a7e8-de4261b54dcb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:44.250555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c4e14523-0337-40e9-a7e8-de4261b54dcb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:44.251352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c4e14523-0337-40e9-a7e8-de4261b54dcb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:44.251803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c4e14523-0337-40e9-a7e8-de4261b54dcb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:44.286656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-70f6e24c-4a05-4b70-85eb-cae08abd010f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:44.303492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-70f6e24c-4a05-4b70-85eb-cae08abd010f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:44.309101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-70f6e24c-4a05-4b70-85eb-cae08abd010f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:44.312718 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-70f6e24c-4a05-4b70-85eb-cae08abd010f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1357 microversion: 2.47 time: 0.254828 May 27 15:11:44.328917 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1774/3559] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:44 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1357 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:44.337321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8350e02e-c484-4bc3-81b0-739e7f714ff5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:44.342602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8350e02e-c484-4bc3-81b0-739e7f714ff5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:44.343845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8350e02e-c484-4bc3-81b0-739e7f714ff5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Searching by: {'deleted': False, 'project_id': '0037dd3962414ff8846962fafd1366d1'} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:11:44.357980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8350e02e-c484-4bc3-81b0-739e7f714ff5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:44.365553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8350e02e-c484-4bc3-81b0-739e7f714ff5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:44.367477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8350e02e-c484-4bc3-81b0-739e7f714ff5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:44.369029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8350e02e-c484-4bc3-81b0-739e7f714ff5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:44.681635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.multi_cell_list [None req-8350e02e-c484-4bc3-81b0-739e7f714ff5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119249) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:11:44.895584 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8350e02e-c484-4bc3-81b0-739e7f714ff5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:44.922705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c4e14523-0337-40e9-a7e8-de4261b54dcb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:44.925725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8350e02e-c484-4bc3-81b0-739e7f714ff5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:44.930027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8350e02e-c484-4bc3-81b0-739e7f714ff5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:44.934866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c4e14523-0337-40e9-a7e8-de4261b54dcb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:44.950684 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c4e14523-0337-40e9-a7e8-de4261b54dcb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:44.952214 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c4e14523-0337-40e9-a7e8-de4261b54dcb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.736666 May 27 15:11:44.953312 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1786/3560] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:44 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:44.968880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9612fed1-dede-478b-a255-b3d7064741cd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:44.969795 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9612fed1-dede-478b-a255-b3d7064741cd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:44.976547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9612fed1-dede-478b-a255-b3d7064741cd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:44.979707 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9612fed1-dede-478b-a255-b3d7064741cd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:44.985056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9612fed1-dede-478b-a255-b3d7064741cd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:44.985910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9612fed1-dede-478b-a255-b3d7064741cd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:44.991165 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8350e02e-c484-4bc3-81b0-739e7f714ff5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:44.999064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8350e02e-c484-4bc3-81b0-739e7f714ff5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:45.230310 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8350e02e-c484-4bc3-81b0-739e7f714ff5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.899780 May 27 15:11:45.231302 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1775/3561] 10.222.0.13 () {60 vars in 1186 bytes} [Fri May 27 15:11:44 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:45.236950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-82203c96-ee6e-444c-9a9b-6af97d0636cb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:45.238105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-82203c96-ee6e-444c-9a9b-6af97d0636cb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:45.266798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82203c96-ee6e-444c-9a9b-6af97d0636cb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:45.267919 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82203c96-ee6e-444c-9a9b-6af97d0636cb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:45.271072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82203c96-ee6e-444c-9a9b-6af97d0636cb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:45.272365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82203c96-ee6e-444c-9a9b-6af97d0636cb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:45.428316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82203c96-ee6e-444c-9a9b-6af97d0636cb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:45.430201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82203c96-ee6e-444c-9a9b-6af97d0636cb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:45.432253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-82203c96-ee6e-444c-9a9b-6af97d0636cb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lazy-loading 'fault' on Instance uuid 5803f6c5-8f5f-400f-b2c3-20c393b5f72c {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:11:45.441603 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9612fed1-dede-478b-a255-b3d7064741cd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:45.450419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:45.455120 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9612fed1-dede-478b-a255-b3d7064741cd tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1523 microversion: 2.1 time: 0.500451 May 27 15:11:45.457162 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1787/3562] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:44 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1523 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:45.482816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-010d53ae-df92-417d-bd0f-34a772d81911 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:45.486450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-010d53ae-df92-417d-bd0f-34a772d81911 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:45.501001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-010d53ae-df92-417d-bd0f-34a772d81911 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:45.501937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-010d53ae-df92-417d-bd0f-34a772d81911 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:45.503534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-010d53ae-df92-417d-bd0f-34a772d81911 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:45.505399 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-010d53ae-df92-417d-bd0f-34a772d81911 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:45.600540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-82203c96-ee6e-444c-9a9b-6af97d0636cb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5103576600c24a1e8321ae5667adaf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2705ae487e96461190f67c996639b655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:45.620286 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-82203c96-ee6e-444c-9a9b-6af97d0636cb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 200 len: 1212 microversion: 2.1 time: 0.387617 May 27 15:11:45.626715 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1776/3563] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:45 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 1212 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:45.645010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3f9e546f-0793-4320-a030-ca9a42bd248f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:45.649771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3f9e546f-0793-4320-a030-ca9a42bd248f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:45.667315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f9e546f-0793-4320-a030-ca9a42bd248f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:45.670426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f9e546f-0793-4320-a030-ca9a42bd248f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:45.671372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f9e546f-0793-4320-a030-ca9a42bd248f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:45.674221 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f9e546f-0793-4320-a030-ca9a42bd248f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:45.752912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3f9e546f-0793-4320-a030-ca9a42bd248f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:11:45.909899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-010d53ae-df92-417d-bd0f-34a772d81911 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:45.930540 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-010d53ae-df92-417d-bd0f-34a772d81911 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:45.934512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-010d53ae-df92-417d-bd0f-34a772d81911 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:45.939141 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-010d53ae-df92-417d-bd0f-34a772d81911 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1721 microversion: 2.20 time: 0.457592 May 27 15:11:45.940480 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1788/3564] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:45 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1721 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:45.970869 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3f9e546f-0793-4320-a030-ca9a42bd248f tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 204 len: 0 microversion: 2.47 time: 0.340188 May 27 15:11:45.975516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f7dea598-86e1-41da-a372-b94f13d0cad6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:45.976860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f7dea598-86e1-41da-a372-b94f13d0cad6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:45.978345 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1777/3565] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:11:45 2022] DELETE /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:11:45.986577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aac3db6a-0290-4c33-9b19-651db2cd8855 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:45.990287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-aac3db6a-0290-4c33-9b19-651db2cd8855 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:45.998312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7dea598-86e1-41da-a372-b94f13d0cad6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:46.001718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7dea598-86e1-41da-a372-b94f13d0cad6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:46.005976 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aac3db6a-0290-4c33-9b19-651db2cd8855 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:46.006276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7dea598-86e1-41da-a372-b94f13d0cad6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:46.008068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7dea598-86e1-41da-a372-b94f13d0cad6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:46.010782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aac3db6a-0290-4c33-9b19-651db2cd8855 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:46.013735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aac3db6a-0290-4c33-9b19-651db2cd8855 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:46.016495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aac3db6a-0290-4c33-9b19-651db2cd8855 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:46.199240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-aac3db6a-0290-4c33-9b19-651db2cd8855 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:46.215203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-aac3db6a-0290-4c33-9b19-651db2cd8855 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:46.216950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-aac3db6a-0290-4c33-9b19-651db2cd8855 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:46.218461 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-aac3db6a-0290-4c33-9b19-651db2cd8855 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1363 microversion: 2.47 time: 0.238603 May 27 15:11:46.219467 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1778/3566] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:45 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:46.489848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-259cff03-47b8-4a5e-afe2-add9f40eded4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:46.490903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-259cff03-47b8-4a5e-afe2-add9f40eded4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:46.504641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-259cff03-47b8-4a5e-afe2-add9f40eded4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:46.511074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-259cff03-47b8-4a5e-afe2-add9f40eded4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:46.512225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-259cff03-47b8-4a5e-afe2-add9f40eded4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:46.513041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-259cff03-47b8-4a5e-afe2-add9f40eded4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:46.686768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f7dea598-86e1-41da-a372-b94f13d0cad6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:46.714214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f7dea598-86e1-41da-a372-b94f13d0cad6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:46.717105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f7dea598-86e1-41da-a372-b94f13d0cad6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:46.728085 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f7dea598-86e1-41da-a372-b94f13d0cad6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.754308 May 27 15:11:46.740445 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1789/3567] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:45 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:11:46.746286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cfc7cac8-8752-4d4b-96ba-9864def1317d tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:46.751096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cfc7cac8-8752-4d4b-96ba-9864def1317d tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] [instance: 5803f6c5-8f5f-400f-b2c3-20c393b5f72c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:46.769776 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cfc7cac8-8752-4d4b-96ba-9864def1317d tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:46.771888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cfc7cac8-8752-4d4b-96ba-9864def1317d tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:46.773529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cfc7cac8-8752-4d4b-96ba-9864def1317d tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:46.776132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cfc7cac8-8752-4d4b-96ba-9864def1317d tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:46.819749 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-cfc7cac8-8752-4d4b-96ba-9864def1317d tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] HTTP exception thrown: Instance 5803f6c5-8f5f-400f-b2c3-20c393b5f72c could not be found. May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cfc7cac8-8752-4d4b-96ba-9864def1317d tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Request method failure captured: May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c HTTP/1.1 May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOmSHEUIrIll_h-FOb2kENUbnozqGmw19o1ZQWdQcEF3oZS-Xas3rl0ZuG_7Dd6pM-PYIJmL0Oays_KMi73TH1Ensv1c-qVHZ5Gk47vysSE10BnDeB4IpMccIeY9rz-LYkTDhz4IItCI2zzJJinoV3mIV6W5a5o2vh0k5Pma6pQVnco May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 2705ae487e96461190f67c996639b655 May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersTestBootFromVolume-1513281707 May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2705ae487e96461190f67c996639b655"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2705ae487e96461190f67c996639b655"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2705ae487e96461190f67c996639b655"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2705ae487e96461190f67c996639b655", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersTestBootFromVolume-1513281707 May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 2705ae487e96461190f67c996639b655 May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1513281707 May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersTestBootFromVolume-1513281707-project May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 5103576600c24a1e8321ae5667adaf0c May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersTestBootFromVolume-1513281707-project May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 5803f6c5-8f5f-400f-b2c3-20c393b5f72c could not be found. May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '5803f6c5-8f5f-400f-b2c3-20c393b5f72c'} May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5803f6c5-8f5f-400f-b2c3-20c393b5f72c could not be found. May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5803f6c5-8f5f-400f-b2c3-20c393b5f72c could not be found. May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:46.824824 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:46.830169 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:46.830169 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:46.830169 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:46.830169 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:11:46.830169 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:11:46.830169 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5803f6c5-8f5f-400f-b2c3-20c393b5f72c could not be found. May 27 15:11:46.830169 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:46.832586 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cfc7cac8-8752-4d4b-96ba-9864def1317d tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Returning 404 to user: Instance 5803f6c5-8f5f-400f-b2c3-20c393b5f72c could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:11:46.834423 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cfc7cac8-8752-4d4b-96ba-9864def1317d tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c" status: 404 len: 111 microversion: 2.1 time: 0.092442 May 27 15:11:46.840459 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1790/3568] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:46 2022] GET /compute/v2.1/servers/5803f6c5-8f5f-400f-b2c3-20c393b5f72c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:11:46.846695 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2df2e24e-1ff4-45cb-bc84-2b46ecc04ecb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] Calling method '.version_select at 0x7fc77601d3a0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:46.880331 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2df2e24e-1ff4-45cb-bc84-2b46ecc04ecb tempest-ServersTestBootFromVolume-1513281707 tempest-ServersTestBootFromVolume-1513281707-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1462808567" status: 202 len: 0 microversion: 2.1 time: 0.038343 May 27 15:11:46.886316 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1791/3569] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 27 15:11:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1462808567 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:11:46.962449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f95dc136-22cd-41db-830c-a5a79e1b381c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:46.964006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f95dc136-22cd-41db-830c-a5a79e1b381c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:46.976518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f95dc136-22cd-41db-830c-a5a79e1b381c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:46.977474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f95dc136-22cd-41db-830c-a5a79e1b381c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:46.978564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f95dc136-22cd-41db-830c-a5a79e1b381c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:46.979332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f95dc136-22cd-41db-830c-a5a79e1b381c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:47.285004 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-259cff03-47b8-4a5e-afe2-add9f40eded4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:47.296667 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-259cff03-47b8-4a5e-afe2-add9f40eded4 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1523 microversion: 2.1 time: 0.812930 May 27 15:11:47.298895 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1779/3570] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:46 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1523 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:47.313406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-02bab0a2-a03f-4c1d-b7fe-06e136597048 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:47.314163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-02bab0a2-a03f-4c1d-b7fe-06e136597048 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:47.322101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-02bab0a2-a03f-4c1d-b7fe-06e136597048 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:47.322830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-02bab0a2-a03f-4c1d-b7fe-06e136597048 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:47.323778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-02bab0a2-a03f-4c1d-b7fe-06e136597048 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:47.324403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-02bab0a2-a03f-4c1d-b7fe-06e136597048 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:47.425269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-02bab0a2-a03f-4c1d-b7fe-06e136597048 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:47.439752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-02bab0a2-a03f-4c1d-b7fe-06e136597048 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:47.444948 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-02bab0a2-a03f-4c1d-b7fe-06e136597048 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:47.451424 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-02bab0a2-a03f-4c1d-b7fe-06e136597048 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1363 microversion: 2.47 time: 0.140221 May 27 15:11:47.452761 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1780/3571] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:47 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:47.483333 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f95dc136-22cd-41db-830c-a5a79e1b381c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:47.493755 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f95dc136-22cd-41db-830c-a5a79e1b381c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:47.495864 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f95dc136-22cd-41db-830c-a5a79e1b381c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:47.497121 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f95dc136-22cd-41db-830c-a5a79e1b381c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1721 microversion: 2.20 time: 0.539942 May 27 15:11:47.498411 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1792/3572] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:46 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1721 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:47.748570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6de8d278-9e7b-4d77-ab37-b5bee43c25cd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:47.749593 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6de8d278-9e7b-4d77-ab37-b5bee43c25cd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:47.761086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6de8d278-9e7b-4d77-ab37-b5bee43c25cd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:47.764252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6de8d278-9e7b-4d77-ab37-b5bee43c25cd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:47.769052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6de8d278-9e7b-4d77-ab37-b5bee43c25cd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:47.772246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6de8d278-9e7b-4d77-ab37-b5bee43c25cd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:47.928635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-75ede782-f1fa-49dc-a183-33af87a898e8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Action: 'create', calling method: .version_select at 0x7fc777289700>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-388199878", "policies": ["affinity"]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:47.981634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-75ede782-f1fa-49dc-a183-33af87a898e8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for project 513a8d6d211640118776fb143e6628a7. Resources: {'server_groups'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:11:47.999821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-75ede782-f1fa-49dc-a183-33af87a898e8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for user f1fa5e6e7eb549d8ba5b4bb520da69bb and project 513a8d6d211640118776fb143e6628a7. Resources: {'server_groups'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:11:48.165668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-75ede782-f1fa-49dc-a183-33af87a898e8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for project 513a8d6d211640118776fb143e6628a7. Resources: {'server_groups'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:11:48.172276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-75ede782-f1fa-49dc-a183-33af87a898e8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for user f1fa5e6e7eb549d8ba5b4bb520da69bb and project 513a8d6d211640118776fb143e6628a7. Resources: {'server_groups'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:11:48.205184 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-75ede782-f1fa-49dc-a183-33af87a898e8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.598909 May 27 15:11:48.209461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6de8d278-9e7b-4d77-ab37-b5bee43c25cd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:48.211531 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1781/3573] 10.222.0.13 () {60 vars in 1173 bytes} [Fri May 27 15:11:47 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:48.221142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-92d169ec-da2f-425b-9aae-f1b0bc4779e7 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:48.222246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-92d169ec-da2f-425b-9aae-f1b0bc4779e7 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:48.231450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6de8d278-9e7b-4d77-ab37-b5bee43c25cd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:48.234855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6de8d278-9e7b-4d77-ab37-b5bee43c25cd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:48.236308 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6de8d278-9e7b-4d77-ab37-b5bee43c25cd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.492291 May 27 15:11:48.250480 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1793/3574] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:47 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:11:48.250950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-92d169ec-da2f-425b-9aae-f1b0bc4779e7 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:48.251430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-92d169ec-da2f-425b-9aae-f1b0bc4779e7 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:48.252247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-92d169ec-da2f-425b-9aae-f1b0bc4779e7 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:48.252736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-92d169ec-da2f-425b-9aae-f1b0bc4779e7 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:48.256232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-47dede24-fc02-4a17-add2-8b9d2b58eb86 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Action: 'create', calling method: .version_select at 0x7fc780670310>, body: {"server_group": {"name": "tempest-server-group-1997601126", "policies": ["affinity"]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:48.292558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-47dede24-fc02-4a17-add2-8b9d2b58eb86 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for project 513a8d6d211640118776fb143e6628a7. Resources: {'server_groups'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:11:48.299033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-47dede24-fc02-4a17-add2-8b9d2b58eb86 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for user f1fa5e6e7eb549d8ba5b4bb520da69bb and project 513a8d6d211640118776fb143e6628a7. Resources: {'server_groups'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:11:48.300412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-92d169ec-da2f-425b-9aae-f1b0bc4779e7 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lazy-loading 'flavor' on Instance uuid 445b2880-4df5-45f6-bba3-3af281cea45c {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:11:48.338218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:48.376649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-47dede24-fc02-4a17-add2-8b9d2b58eb86 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for project 513a8d6d211640118776fb143e6628a7. Resources: {'server_groups'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:11:48.385144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-47dede24-fc02-4a17-add2-8b9d2b58eb86 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for user f1fa5e6e7eb549d8ba5b4bb520da69bb and project 513a8d6d211640118776fb143e6628a7. Resources: {'server_groups'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:11:48.403242 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-47dede24-fc02-4a17-add2-8b9d2b58eb86 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.150976 May 27 15:11:48.406200 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1794/3575] 10.222.0.13 () {60 vars in 1172 bytes} [Fri May 27 15:11:48 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:48.415023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-851bce0d-ef8f-4547-bfd9-5174b6148448 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:48.416333 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-851bce0d-ef8f-4547-bfd9-5174b6148448 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:48.427862 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-851bce0d-ef8f-4547-bfd9-5174b6148448 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:48.428585 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-851bce0d-ef8f-4547-bfd9-5174b6148448 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:48.430678 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-851bce0d-ef8f-4547-bfd9-5174b6148448 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:48.431322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-851bce0d-ef8f-4547-bfd9-5174b6148448 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:48.502411 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-92d169ec-da2f-425b-9aae-f1b0bc4779e7 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "POST /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c/action" status: 200 len: 32 microversion: 2.1 time: 0.288065 May 27 15:11:48.503742 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1782/3576] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:11:48 2022] POST /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c/action => generated 32 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:11:48.515759 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-8061d4a9-906b-48e7-b552-cecc71d14cb1 req-1105b3f2-9674-4a23-9184-4105a8c14c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7371c18-20d2-43f8-b0c6-0371079d8f20", "name": "network-vif-unplugged", "status": "completed", "tag": "555c9e09-9066-4780-8d8a-91ccfe7dff8d"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:48.551621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-8061d4a9-906b-48e7-b552-cecc71d14cb1 req-1105b3f2-9674-4a23-9184-4105a8c14c4a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:48.560234 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-8061d4a9-906b-48e7-b552-cecc71d14cb1 req-1105b3f2-9674-4a23-9184-4105a8c14c4a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:48.600537 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-8061d4a9-906b-48e7-b552-cecc71d14cb1 req-1105b3f2-9674-4a23-9184-4105a8c14c4a service nova] Creating event network-vif-unplugged:555c9e09-9066-4780-8d8a-91ccfe7dff8d for instance d7371c18-20d2-43f8-b0c6-0371079d8f20 on n-h2-843621-1 May 27 15:11:48.621720 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-8061d4a9-906b-48e7-b552-cecc71d14cb1 req-1105b3f2-9674-4a23-9184-4105a8c14c4a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117002 May 27 15:11:48.622701 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1783/3577] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:48.635623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9f10e607-e831-4417-90f5-43e136b1124b tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Action: 'create', calling method: .version_select at 0x7fc777691d30>, body: {"server_group": {"name": "tempest-server-group-1997601126", "policies": ["affinity"]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:48.681530 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-9f10e607-e831-4417-90f5-43e136b1124b tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for project 513a8d6d211640118776fb143e6628a7. Resources: {'server_groups'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:11:48.685585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:48.690297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-9f10e607-e831-4417-90f5-43e136b1124b tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for user f1fa5e6e7eb549d8ba5b4bb520da69bb and project 513a8d6d211640118776fb143e6628a7. Resources: {'server_groups'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:11:48.723227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-851bce0d-ef8f-4547-bfd9-5174b6148448 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:48.734802 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-851bce0d-ef8f-4547-bfd9-5174b6148448 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1523 microversion: 2.1 time: 0.326928 May 27 15:11:48.735707 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1795/3578] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:48 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1523 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:48.743071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6d58d197-b606-4ebd-8527-ae5feb73648a tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:48.743707 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6d58d197-b606-4ebd-8527-ae5feb73648a tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:48.755366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d58d197-b606-4ebd-8527-ae5feb73648a tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:48.755945 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d58d197-b606-4ebd-8527-ae5feb73648a tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:48.757184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d58d197-b606-4ebd-8527-ae5feb73648a tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:48.758028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d58d197-b606-4ebd-8527-ae5feb73648a tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:48.766676 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-9f10e607-e831-4417-90f5-43e136b1124b tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for project 513a8d6d211640118776fb143e6628a7. Resources: {'server_groups'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:11:48.787312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-9f10e607-e831-4417-90f5-43e136b1124b tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for user f1fa5e6e7eb549d8ba5b4bb520da69bb and project 513a8d6d211640118776fb143e6628a7. Resources: {'server_groups'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:11:48.827691 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9f10e607-e831-4417-90f5-43e136b1124b tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.197486 May 27 15:11:48.828304 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1784/3579] 10.222.0.13 () {60 vars in 1172 bytes} [Fri May 27 15:11:48 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:48.841630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c7d270bf-40f9-48b8-bdd1-a361367b9712 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:48.842373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c7d270bf-40f9-48b8-bdd1-a361367b9712 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:48.852475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d58d197-b606-4ebd-8527-ae5feb73648a tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:48.856739 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d58d197-b606-4ebd-8527-ae5feb73648a tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:48.857427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-6d58d197-b606-4ebd-8527-ae5feb73648a tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lazy-loading 'fault' on Instance uuid 6a9161f3-f34e-4efa-b089-d1e41f6f2e43 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:11:48.859567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c7d270bf-40f9-48b8-bdd1-a361367b9712 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:48.860013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c7d270bf-40f9-48b8-bdd1-a361367b9712 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:48.860840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c7d270bf-40f9-48b8-bdd1-a361367b9712 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:48.861293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c7d270bf-40f9-48b8-bdd1-a361367b9712 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:48.943716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6d58d197-b606-4ebd-8527-ae5feb73648a tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:48.960393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6d58d197-b606-4ebd-8527-ae5feb73648a tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:48.962267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6d58d197-b606-4ebd-8527-ae5feb73648a tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:48.963710 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6d58d197-b606-4ebd-8527-ae5feb73648a tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1368 microversion: 2.47 time: 0.227050 May 27 15:11:48.966180 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1796/3580] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:48 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:48.973983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d38d0c3d-ce5e-4be3-96f6-485f692dc906 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:48.986355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d38d0c3d-ce5e-4be3-96f6-485f692dc906 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:48.993797 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d38d0c3d-ce5e-4be3-96f6-485f692dc906 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:48.996482 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d38d0c3d-ce5e-4be3-96f6-485f692dc906 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:48.998157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d38d0c3d-ce5e-4be3-96f6-485f692dc906 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:49.003064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d38d0c3d-ce5e-4be3-96f6-485f692dc906 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:49.098789 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:49.121135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c7d270bf-40f9-48b8-bdd1-a361367b9712 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:49.138632 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c7d270bf-40f9-48b8-bdd1-a361367b9712 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1522 microversion: 2.1 time: 0.296945 May 27 15:11:49.138632 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1785/3581] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:48 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:49.144824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5008de1f-3b76-4a1b-ad91-c48ff7da90f2 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:49.202076 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5008de1f-3b76-4a1b-ad91-c48ff7da90f2 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/2f587961-f898-40bc-934f-b1c70b54565c" status: 204 len: 0 microversion: 2.1 time: 0.068183 May 27 15:11:49.204771 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1786/3582] 10.222.0.13 () {58 vars in 1265 bytes} [Fri May 27 15:11:49 2022] DELETE /compute/v2.1/os-server-groups/2f587961-f898-40bc-934f-b1c70b54565c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:11:49.216452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-98fc377a-20a9-4208-957d-7b982fc1d720 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:49.233058 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-98fc377a-20a9-4208-957d-7b982fc1d720 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.022532 May 27 15:11:49.239938 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1787/3583] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 15:11:49 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:49.246056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9c5e136f-db34-476d-be0f-7de3be000126 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:49.281400 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9c5e136f-db34-476d-be0f-7de3be000126 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/9a3f7cd9-cc7a-4c5d-820e-0c1002eb4798" status: 204 len: 0 microversion: 2.1 time: 0.040314 May 27 15:11:49.285868 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1788/3584] 10.222.0.13 () {58 vars in 1265 bytes} [Fri May 27 15:11:49 2022] DELETE /compute/v2.1/os-server-groups/9a3f7cd9-cc7a-4c5d-820e-0c1002eb4798 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:11:49.295529 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3fbaf4e2-40c5-4ae9-ab43-b24d00ff0eca tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:49.297464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3fbaf4e2-40c5-4ae9-ab43-b24d00ff0eca tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:49.309183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fbaf4e2-40c5-4ae9-ab43-b24d00ff0eca tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:49.310336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fbaf4e2-40c5-4ae9-ab43-b24d00ff0eca tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:49.312170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fbaf4e2-40c5-4ae9-ab43-b24d00ff0eca tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:49.313525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fbaf4e2-40c5-4ae9-ab43-b24d00ff0eca tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:49.322069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d38d0c3d-ce5e-4be3-96f6-485f692dc906 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:49.334607 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d38d0c3d-ce5e-4be3-96f6-485f692dc906 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:49.337514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d38d0c3d-ce5e-4be3-96f6-485f692dc906 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:49.342325 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d38d0c3d-ce5e-4be3-96f6-485f692dc906 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1721 microversion: 2.20 time: 0.372708 May 27 15:11:49.342936 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1797/3585] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:48 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1721 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:49.356393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9fa2169f-6968-4756-8247-91ad6b52f659 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:49.404247 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9fa2169f-6968-4756-8247-91ad6b52f659 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.060179 May 27 15:11:49.411484 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1798/3586] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 15:11:49 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:49.419607 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-588804fd-b35e-4a85-a9d3-8583019db1e9 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Action: 'create', calling method: .version_select at 0x7fc775fc41f0>, body: {"server_group": {"name": "tempest-server-group-708279040", "policies": ["affinity"]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:49.473894 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-588804fd-b35e-4a85-a9d3-8583019db1e9 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for project 513a8d6d211640118776fb143e6628a7. Resources: {'server_groups'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:11:49.490041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-588804fd-b35e-4a85-a9d3-8583019db1e9 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for user f1fa5e6e7eb549d8ba5b4bb520da69bb and project 513a8d6d211640118776fb143e6628a7. Resources: {'server_groups'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:11:49.608707 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-588804fd-b35e-4a85-a9d3-8583019db1e9 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for project 513a8d6d211640118776fb143e6628a7. Resources: {'server_groups'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:11:49.637893 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-588804fd-b35e-4a85-a9d3-8583019db1e9 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for user f1fa5e6e7eb549d8ba5b4bb520da69bb and project 513a8d6d211640118776fb143e6628a7. Resources: {'server_groups'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:11:49.667229 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-588804fd-b35e-4a85-a9d3-8583019db1e9 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.254350 May 27 15:11:49.668555 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1799/3587] 10.222.0.13 () {60 vars in 1172 bytes} [Fri May 27 15:11:49 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:11:49.680369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a3c92964-7a6a-4db2-af81-e09a09b8de3d tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:49.701687 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3fbaf4e2-40c5-4ae9-ab43-b24d00ff0eca tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:49.713926 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3fbaf4e2-40c5-4ae9-ab43-b24d00ff0eca tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:49.715485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3fbaf4e2-40c5-4ae9-ab43-b24d00ff0eca tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:49.716726 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3fbaf4e2-40c5-4ae9-ab43-b24d00ff0eca tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.429248 May 27 15:11:49.717294 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1789/3588] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:49 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:49.737562 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a3c92964-7a6a-4db2-af81-e09a09b8de3d tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/b842ca54-41a5-43e2-9c1e-08e5dafe5eb4" status: 204 len: 0 microversion: 2.1 time: 0.060534 May 27 15:11:49.740660 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1800/3589] 10.222.0.13 () {58 vars in 1265 bytes} [Fri May 27 15:11:49 2022] DELETE /compute/v2.1/os-server-groups/b842ca54-41a5-43e2-9c1e-08e5dafe5eb4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:11:49.752114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2d518734-98d7-4fd8-875f-2bab473e3162 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:49.759909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1b7019b6-da38-4f17-a1b7-ae67131e7167 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:49.761304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1b7019b6-da38-4f17-a1b7-ae67131e7167 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:49.764090 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2d518734-98d7-4fd8-875f-2bab473e3162 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.018735 May 27 15:11:49.766209 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1790/3590] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 15:11:49 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:49.780035 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d78f6db1-e109-4511-9d26-df3303760385 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Action: 'create', calling method: .version_select at 0x7fc77c097700>, body: {"server_group": {"name": "tempest-server-group-1680823818", "policies": ["anti-affinity"]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:49.783705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b7019b6-da38-4f17-a1b7-ae67131e7167 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:49.784527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b7019b6-da38-4f17-a1b7-ae67131e7167 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:49.785709 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b7019b6-da38-4f17-a1b7-ae67131e7167 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:49.786339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b7019b6-da38-4f17-a1b7-ae67131e7167 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:49.833710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-d78f6db1-e109-4511-9d26-df3303760385 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for project 513a8d6d211640118776fb143e6628a7. Resources: {'server_groups'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:11:49.855714 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-d78f6db1-e109-4511-9d26-df3303760385 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for user f1fa5e6e7eb549d8ba5b4bb520da69bb and project 513a8d6d211640118776fb143e6628a7. Resources: {'server_groups'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:11:50.009197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-d78f6db1-e109-4511-9d26-df3303760385 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for project 513a8d6d211640118776fb143e6628a7. Resources: {'server_groups'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:11:50.021866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-d78f6db1-e109-4511-9d26-df3303760385 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for user f1fa5e6e7eb549d8ba5b4bb520da69bb and project 513a8d6d211640118776fb143e6628a7. Resources: {'server_groups'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:11:50.058357 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1b7019b6-da38-4f17-a1b7-ae67131e7167 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:50.072291 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1b7019b6-da38-4f17-a1b7-ae67131e7167 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1523 microversion: 2.1 time: 0.322150 May 27 15:11:50.087381 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1801/3591] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:49 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1523 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:50.092476 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d78f6db1-e109-4511-9d26-df3303760385 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.316035 May 27 15:11:50.099175 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1791/3592] 10.222.0.13 () {60 vars in 1172 bytes} [Fri May 27 15:11:49 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:50.105203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1ae34514-5c16-4a91-9308-cc457b724889 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:50.105846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1ae34514-5c16-4a91-9308-cc457b724889 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:50.113768 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d6fe2bbc-89ae-40a2-9d24-c5b618d93778 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:50.123736 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1ae34514-5c16-4a91-9308-cc457b724889 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:50.124197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1ae34514-5c16-4a91-9308-cc457b724889 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:50.125255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1ae34514-5c16-4a91-9308-cc457b724889 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:50.125547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1ae34514-5c16-4a91-9308-cc457b724889 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:50.174440 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d6fe2bbc-89ae-40a2-9d24-c5b618d93778 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/fd11a295-4117-4d39-a42f-c136820bece8" status: 204 len: 0 microversion: 2.1 time: 0.070479 May 27 15:11:50.175342 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1792/3593] 10.222.0.13 () {58 vars in 1265 bytes} [Fri May 27 15:11:50 2022] DELETE /compute/v2.1/os-server-groups/fd11a295-4117-4d39-a42f-c136820bece8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:11:50.187546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a2ac71a8-b24f-4623-840e-2bea9b4a004f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:50.188182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a2ac71a8-b24f-4623-840e-2bea9b4a004f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:50.199154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a2ac71a8-b24f-4623-840e-2bea9b4a004f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:50.199736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a2ac71a8-b24f-4623-840e-2bea9b4a004f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:50.200418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a2ac71a8-b24f-4623-840e-2bea9b4a004f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:50.201545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a2ac71a8-b24f-4623-840e-2bea9b4a004f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:50.213336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1ae34514-5c16-4a91-9308-cc457b724889 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:50.213336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1ae34514-5c16-4a91-9308-cc457b724889 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:50.213336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-1ae34514-5c16-4a91-9308-cc457b724889 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lazy-loading 'fault' on Instance uuid 6a9161f3-f34e-4efa-b089-d1e41f6f2e43 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:11:50.307738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1ae34514-5c16-4a91-9308-cc457b724889 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:50.316698 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1ae34514-5c16-4a91-9308-cc457b724889 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:50.333359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1ae34514-5c16-4a91-9308-cc457b724889 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:50.337049 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1ae34514-5c16-4a91-9308-cc457b724889 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 200 len: 1368 microversion: 2.47 time: 0.248055 May 27 15:11:50.342208 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1802/3594] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:50 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:50.355817 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a0eb249f-c7b3-402d-b713-9d859de2a31b tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:50.394844 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a0eb249f-c7b3-402d-b713-9d859de2a31b tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.051232 May 27 15:11:50.396553 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1803/3595] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 15:11:50 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:50.421977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c5927aaa-4dfe-41ec-a0ce-27f000203937 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:50.424602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c5927aaa-4dfe-41ec-a0ce-27f000203937 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:50.454267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c5927aaa-4dfe-41ec-a0ce-27f000203937 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:50.455835 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c5927aaa-4dfe-41ec-a0ce-27f000203937 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:50.457423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c5927aaa-4dfe-41ec-a0ce-27f000203937 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:50.459485 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c5927aaa-4dfe-41ec-a0ce-27f000203937 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:50.649267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a2ac71a8-b24f-4623-840e-2bea9b4a004f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:50.668372 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a2ac71a8-b24f-4623-840e-2bea9b4a004f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1522 microversion: 2.1 time: 0.483295 May 27 15:11:50.684666 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1793/3596] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:50 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1522 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:50.698227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1232773697", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "322e1706-02e0-49b3-b95e-17acd1a1fec0"}]}, "os:scheduler_hints": {"group": "fea0c984-b14e-4758-bb63-73c0df3064e3"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:50.795953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] validate_networks() for [('322e1706-02e0-49b3-b95e-17acd1a1fec0', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:11:50.813683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c5927aaa-4dfe-41ec-a0ce-27f000203937 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:50.831345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c5927aaa-4dfe-41ec-a0ce-27f000203937 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:50.833181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c5927aaa-4dfe-41ec-a0ce-27f000203937 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:50.834500 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c5927aaa-4dfe-41ec-a0ce-27f000203937 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1721 microversion: 2.20 time: 0.436447 May 27 15:11:50.835575 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1804/3597] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:50 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1721 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:50.840315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ff70e386-f51d-4a22-9766-3d36e406f623 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:50.845649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ff70e386-f51d-4a22-9766-3d36e406f623 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:50.864420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff70e386-f51d-4a22-9766-3d36e406f623 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:50.865013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff70e386-f51d-4a22-9766-3d36e406f623 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:50.866052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff70e386-f51d-4a22-9766-3d36e406f623 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:50.866715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff70e386-f51d-4a22-9766-3d36e406f623 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:51.370497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ff70e386-f51d-4a22-9766-3d36e406f623 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:51.396011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ff70e386-f51d-4a22-9766-3d36e406f623 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:51.398704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ff70e386-f51d-4a22-9766-3d36e406f623 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:51.400736 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ff70e386-f51d-4a22-9766-3d36e406f623 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1891 microversion: 2.42 time: 0.564054 May 27 15:11:51.417564 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1805/3598] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:50 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1891 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:51.422862 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3988356e-328b-4e55-8321-c7c4e5327d2d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:51.429568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3988356e-328b-4e55-8321-c7c4e5327d2d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:51.457728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3988356e-328b-4e55-8321-c7c4e5327d2d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:51.459809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3988356e-328b-4e55-8321-c7c4e5327d2d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:51.466741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3988356e-328b-4e55-8321-c7c4e5327d2d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:51.467675 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3988356e-328b-4e55-8321-c7c4e5327d2d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:51.669557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:11:51.670890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:11:51.671595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:11:51.672208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:11:51.672866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:11:51.701945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:51.704921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:51.705972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:51.706617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:51.746022 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for project 513a8d6d211640118776fb143e6628a7. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:11:51.754537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for user f1fa5e6e7eb549d8ba5b4bb520da69bb and project 513a8d6d211640118776fb143e6628a7. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:11:51.784100 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:11:51.787999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] [instance: b105d0b6-f635-4072-a59b-954702fea503] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:11:51.862010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:51.875648 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3988356e-328b-4e55-8321-c7c4e5327d2d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:51.877983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119249) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} May 27 15:11:51.903733 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3988356e-328b-4e55-8321-c7c4e5327d2d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1500 microversion: 2.1 time: 0.484580 May 27 15:11:51.904347 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1806/3599] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:51 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1500 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:51.909310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for project 513a8d6d211640118776fb143e6628a7. Resources: {'server_group_members'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:11:51.917179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for user f1fa5e6e7eb549d8ba5b4bb520da69bb and project 513a8d6d211640118776fb143e6628a7. Resources: {'server_group_members'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:11:51.924851 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a744cb16-4fd4-4b54-815a-ea8a4759a8c4 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:51.925913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a744cb16-4fd4-4b54-815a-ea8a4759a8c4 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 6a9161f3-f34e-4efa-b089-d1e41f6f2e43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:51.940305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a744cb16-4fd4-4b54-815a-ea8a4759a8c4 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:51.949326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a744cb16-4fd4-4b54-815a-ea8a4759a8c4 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:51.950417 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a744cb16-4fd4-4b54-815a-ea8a4759a8c4 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:51.951040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a744cb16-4fd4-4b54-815a-ea8a4759a8c4 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:51.977313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for project 513a8d6d211640118776fb143e6628a7. Resources: {'server_group_members'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:11:51.983770 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-a744cb16-4fd4-4b54-815a-ea8a4759a8c4 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] HTTP exception thrown: Instance 6a9161f3-f34e-4efa-b089-d1e41f6f2e43 could not be found. May 27 15:11:51.984119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Getting quotas for user f1fa5e6e7eb549d8ba5b4bb520da69bb and project 513a8d6d211640118776fb143e6628a7. Resources: {'server_group_members'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a744cb16-4fd4-4b54-815a-ea8a4759a8c4 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Request method failure captured: May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 HTTP/1.1 May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOn-MSZeDHMWk7how2IRjzGAGwuKNcQ4Ul_IT0SWpjvzR2OpSEnCV38KFNrRq66YedwMYNrIosHc0_kzBDrwUS0fMJvozWDM0UcL7SO32UYVk61YL9AtPIQwELlWrAj9gc_EbVDWiC8xOEu-lpr4TE5_n5KAT2eo7OopK2rZXlLTFgA May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-Openstack-Nova-Api-Version: 2.47 May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 0037dd3962414ff8846962fafd1366d1 May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerShowV247Test-457128591 May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0037dd3962414ff8846962fafd1366d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0037dd3962414ff8846962fafd1366d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0037dd3962414ff8846962fafd1366d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0037dd3962414ff8846962fafd1366d1", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerShowV247Test-457128591 May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 0037dd3962414ff8846962fafd1366d1 May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerShowV247Test-457128591 May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerShowV247Test-457128591-project May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: e092508233424efd8a374dd85ad6d71d May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerShowV247Test-457128591-project May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 6a9161f3-f34e-4efa-b089-d1e41f6f2e43 could not be found. May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '6a9161f3-f34e-4efa-b089-d1e41f6f2e43'} May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a9161f3-f34e-4efa-b089-d1e41f6f2e43 could not be found. May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a9161f3-f34e-4efa-b089-d1e41f6f2e43 could not be found. May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:51.991585 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:51.997260 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:51.997260 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:51.997260 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:51.997260 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:11:51.997260 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:11:51.997260 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a9161f3-f34e-4efa-b089-d1e41f6f2e43 could not be found. May 27 15:11:51.997260 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:11:51.997260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a744cb16-4fd4-4b54-815a-ea8a4759a8c4 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Returning 404 to user: Instance 6a9161f3-f34e-4efa-b089-d1e41f6f2e43 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:11:51.997260 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a744cb16-4fd4-4b54-815a-ea8a4759a8c4 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43" status: 404 len: 111 microversion: 2.47 time: 0.088144 May 27 15:11:52.001293 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1807/3600] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:51 2022] GET /compute/v2.1/servers/6a9161f3-f34e-4efa-b089-d1e41f6f2e43 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:11:52.012009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c5fa8668-004f-441e-8609-77634f394511 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:52.016611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c5fa8668-004f-441e-8609-77634f394511 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:52.033273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c5fa8668-004f-441e-8609-77634f394511 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:52.033751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c5fa8668-004f-441e-8609-77634f394511 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:52.034587 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c5fa8668-004f-441e-8609-77634f394511 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:52.038038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c5fa8668-004f-441e-8609-77634f394511 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:52.064906 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3fe5a30c-b11a-4db1-9e45-f69671c0a26f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.377711 May 27 15:11:52.070985 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1794/3601] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:11:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:11:52.071566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9d0c779b-203a-434b-a39c-d3376744b710 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:52.072298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9d0c779b-203a-434b-a39c-d3376744b710 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:52.096385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d0c779b-203a-434b-a39c-d3376744b710 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:52.096608 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d0c779b-203a-434b-a39c-d3376744b710 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:52.097540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d0c779b-203a-434b-a39c-d3376744b710 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:52.098648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d0c779b-203a-434b-a39c-d3376744b710 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:52.369027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c5fa8668-004f-441e-8609-77634f394511 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:52.383485 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c5fa8668-004f-441e-8609-77634f394511 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1522 microversion: 2.1 time: 0.380956 May 27 15:11:52.397617 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1808/3602] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:52 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:52.417184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e16e21fd-e8fd-43cb-8636-b825e1444ece tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:52.430518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e16e21fd-e8fd-43cb-8636-b825e1444ece tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:52.446165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e16e21fd-e8fd-43cb-8636-b825e1444ece tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '5f1274817f784f12ba47ba885010ec42'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:11:52.465960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e16e21fd-e8fd-43cb-8636-b825e1444ece tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:52.468238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e16e21fd-e8fd-43cb-8636-b825e1444ece tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:52.470638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e16e21fd-e8fd-43cb-8636-b825e1444ece tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:52.474187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e16e21fd-e8fd-43cb-8636-b825e1444ece tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:52.544460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-e16e21fd-e8fd-43cb-8636-b825e1444ece tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:11:52.555967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9d0c779b-203a-434b-a39c-d3376744b710 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:52.582149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9d0c779b-203a-434b-a39c-d3376744b710 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:52.597439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9d0c779b-203a-434b-a39c-d3376744b710 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:52.600182 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9d0c779b-203a-434b-a39c-d3376744b710 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1664 microversion: 2.20 time: 0.532753 May 27 15:11:52.602009 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1795/3603] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:52 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1664 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:52.617243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-063c8d8a-8558-48e8-9826-be58a00e07bb tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:52.626532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-063c8d8a-8558-48e8-9826-be58a00e07bb tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 8b391c6d-2c42-4404-8155-412062aa0d81] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:52.638526 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-063c8d8a-8558-48e8-9826-be58a00e07bb tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:52.651393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-063c8d8a-8558-48e8-9826-be58a00e07bb tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:52.653576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-063c8d8a-8558-48e8-9826-be58a00e07bb tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:52.655292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-063c8d8a-8558-48e8-9826-be58a00e07bb tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:52.664549 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e16e21fd-e8fd-43cb-8636-b825e1444ece tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.263607 May 27 15:11:52.667354 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1809/3604] 10.222.0.13 () {58 vars in 1153 bytes} [Fri May 27 15:11:52 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:52.685053 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-662617b7-ebff-4934-8d14-153bad47d717 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:52.687870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-662617b7-ebff-4934-8d14-153bad47d717 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] [instance: b105d0b6-f635-4072-a59b-954702fea503] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:52.730639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-063c8d8a-8558-48e8-9826-be58a00e07bb tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 8b391c6d-2c42-4404-8155-412062aa0d81] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:11:52.828220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-662617b7-ebff-4934-8d14-153bad47d717 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5e6e7eb549d8ba5b4bb520da69bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513a8d6d211640118776fb143e6628a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:52.837584 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-662617b7-ebff-4934-8d14-153bad47d717 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503" status: 200 len: 1213 microversion: 2.1 time: 0.166993 May 27 15:11:52.844354 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1810/3605] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:52 2022] GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 => generated 1213 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:52.857167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ae5bebbd-46fe-498f-9078-77579dea47d9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:52.861418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ae5bebbd-46fe-498f-9078-77579dea47d9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:52.881289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ae5bebbd-46fe-498f-9078-77579dea47d9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:52.885343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ae5bebbd-46fe-498f-9078-77579dea47d9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:52.886392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ae5bebbd-46fe-498f-9078-77579dea47d9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:52.887095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ae5bebbd-46fe-498f-9078-77579dea47d9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:52.970244 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-063c8d8a-8558-48e8-9826-be58a00e07bb tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8b391c6d-2c42-4404-8155-412062aa0d81" status: 204 len: 0 microversion: 2.47 time: 0.364083 May 27 15:11:52.971089 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1796/3606] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:11:52 2022] DELETE /compute/v2.1/servers/8b391c6d-2c42-4404-8155-412062aa0d81 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:11:52.987369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fa7a245b-0fec-4855-9864-4b381d536f60 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65de822d-aa99-4b68-b5a3-d5c2fc114a06"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:52.990304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fa7a245b-0fec-4855-9864-4b381d536f60 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:53.008937 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa7a245b-0fec-4855-9864-4b381d536f60 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:53.010888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa7a245b-0fec-4855-9864-4b381d536f60 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:53.011736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa7a245b-0fec-4855-9864-4b381d536f60 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:53.024220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa7a245b-0fec-4855-9864-4b381d536f60 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:53.103701 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:53.383592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ae5bebbd-46fe-498f-9078-77579dea47d9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:53.408899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ae5bebbd-46fe-498f-9078-77579dea47d9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:53.416193 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ae5bebbd-46fe-498f-9078-77579dea47d9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:53.417762 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ae5bebbd-46fe-498f-9078-77579dea47d9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1879 microversion: 2.42 time: 0.570835 May 27 15:11:53.418461 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1811/3607] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:52 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1879 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:53.428822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e1652695-3c3f-4bd1-be58-1e428db6c9ea tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:53.445531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e1652695-3c3f-4bd1-be58-1e428db6c9ea tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:53.446457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e1652695-3c3f-4bd1-be58-1e428db6c9ea tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:53.513382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e1652695-3c3f-4bd1-be58-1e428db6c9ea tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Going to try to start instance {{(pid=119248) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 15:11:53.573927 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e1652695-3c3f-4bd1-be58-1e428db6c9ea tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "POST /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255/action" status: 202 len: 0 microversion: 2.1 time: 0.152850 May 27 15:11:53.576596 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1812/3608] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:11:53 2022] POST /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:11:53.585185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0f32faa9-646f-4cea-901f-9945a0346dcf tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:53.586712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0f32faa9-646f-4cea-901f-9945a0346dcf tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 8b391c6d-2c42-4404-8155-412062aa0d81] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:53.596093 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f32faa9-646f-4cea-901f-9945a0346dcf tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:53.597181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f32faa9-646f-4cea-901f-9945a0346dcf tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:53.598417 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f32faa9-646f-4cea-901f-9945a0346dcf tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:53.599167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f32faa9-646f-4cea-901f-9945a0346dcf tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:53.637146 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fa7a245b-0fec-4855-9864-4b381d536f60 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "POST /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.662952 May 27 15:11:53.637683 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1797/3609] 10.222.0.13 () {62 vars in 1363 bytes} [Fri May 27 15:11:52 2022] POST /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20/os-volume_attachments => generated 188 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:11:53.642693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aca4a252-23e1-45fd-866e-b180ee84bed4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:53.643323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-aca4a252-23e1-45fd-866e-b180ee84bed4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:53.663193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aca4a252-23e1-45fd-866e-b180ee84bed4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:53.664215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aca4a252-23e1-45fd-866e-b180ee84bed4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:53.665066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aca4a252-23e1-45fd-866e-b180ee84bed4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:53.665523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aca4a252-23e1-45fd-866e-b180ee84bed4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:53.685008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0f32faa9-646f-4cea-901f-9945a0346dcf tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:53.695426 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0f32faa9-646f-4cea-901f-9945a0346dcf tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:53.697373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0f32faa9-646f-4cea-901f-9945a0346dcf tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:53.698763 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0f32faa9-646f-4cea-901f-9945a0346dcf tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/8b391c6d-2c42-4404-8155-412062aa0d81" status: 200 len: 1362 microversion: 2.47 time: 0.120036 May 27 15:11:53.710032 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1813/3610] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:53 2022] GET /compute/v2.1/servers/8b391c6d-2c42-4404-8155-412062aa0d81 => generated 1362 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:53.710032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c0f539b8-34c6-4613-af1e-ff1184fa5402 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:53.710032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c0f539b8-34c6-4613-af1e-ff1184fa5402 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:53.711783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0f539b8-34c6-4613-af1e-ff1184fa5402 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:53.712260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0f539b8-34c6-4613-af1e-ff1184fa5402 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:53.713181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0f539b8-34c6-4613-af1e-ff1184fa5402 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:53.713635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0f539b8-34c6-4613-af1e-ff1184fa5402 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:54.096769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-aca4a252-23e1-45fd-866e-b180ee84bed4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:54.105655 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-aca4a252-23e1-45fd-866e-b180ee84bed4 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1522 microversion: 2.1 time: 0.466862 May 27 15:11:54.123584 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1798/3611] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:53 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1522 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:54.131040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6b3e06df-03ed-40ec-baa5-ee266b7d23c8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:54.131994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6b3e06df-03ed-40ec-baa5-ee266b7d23c8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] [instance: b105d0b6-f635-4072-a59b-954702fea503] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:54.147913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b3e06df-03ed-40ec-baa5-ee266b7d23c8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:54.150758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b3e06df-03ed-40ec-baa5-ee266b7d23c8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:54.151881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b3e06df-03ed-40ec-baa5-ee266b7d23c8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:54.152560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b3e06df-03ed-40ec-baa5-ee266b7d23c8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:54.201576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c0f539b8-34c6-4613-af1e-ff1184fa5402 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:54.211540 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c0f539b8-34c6-4613-af1e-ff1184fa5402 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1509 microversion: 2.1 time: 0.509217 May 27 15:11:54.221736 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1814/3612] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:53 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1509 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:54.227572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f1aae9b4-04e9-4294-9ad0-2c2c5f840f4a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:54.228470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f1aae9b4-04e9-4294-9ad0-2c2c5f840f4a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:54.235705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1aae9b4-04e9-4294-9ad0-2c2c5f840f4a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:54.236582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1aae9b4-04e9-4294-9ad0-2c2c5f840f4a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:54.237967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1aae9b4-04e9-4294-9ad0-2c2c5f840f4a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:54.238637 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1aae9b4-04e9-4294-9ad0-2c2c5f840f4a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:54.283163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6b3e06df-03ed-40ec-baa5-ee266b7d23c8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5e6e7eb549d8ba5b4bb520da69bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513a8d6d211640118776fb143e6628a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:54.292292 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6b3e06df-03ed-40ec-baa5-ee266b7d23c8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503" status: 200 len: 1265 microversion: 2.1 time: 0.167220 May 27 15:11:54.293257 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1799/3613] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:54 2022] GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:54.439683 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b9b7398b-e38b-4707-aa87-772d30d2de18 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:54.440401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b9b7398b-e38b-4707-aa87-772d30d2de18 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:54.452367 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9b7398b-e38b-4707-aa87-772d30d2de18 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:54.453235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9b7398b-e38b-4707-aa87-772d30d2de18 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:54.456631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9b7398b-e38b-4707-aa87-772d30d2de18 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:54.457223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9b7398b-e38b-4707-aa87-772d30d2de18 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:54.663754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:54.688247 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f1aae9b4-04e9-4294-9ad0-2c2c5f840f4a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20/os-volume_attachments/65de822d-aa99-4b68-b5a3-d5c2fc114a06" status: 202 len: 0 microversion: 2.20 time: 0.464876 May 27 15:11:54.688923 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1815/3614] 10.222.0.13 () {60 vars in 1456 bytes} [Fri May 27 15:11:54 2022] DELETE /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20/os-volume_attachments/65de822d-aa99-4b68-b5a3-d5c2fc114a06 => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 15:11:54.717229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-16b3246e-2bc2-4a2d-9ace-e1517fe659a5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:54.717856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-16b3246e-2bc2-4a2d-9ace-e1517fe659a5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 8b391c6d-2c42-4404-8155-412062aa0d81] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:54.727065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16b3246e-2bc2-4a2d-9ace-e1517fe659a5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:54.727547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16b3246e-2bc2-4a2d-9ace-e1517fe659a5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:54.728356 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16b3246e-2bc2-4a2d-9ace-e1517fe659a5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:54.728839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16b3246e-2bc2-4a2d-9ace-e1517fe659a5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:54.823248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b9b7398b-e38b-4707-aa87-772d30d2de18 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:54.852588 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b9b7398b-e38b-4707-aa87-772d30d2de18 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:54.858213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b9b7398b-e38b-4707-aa87-772d30d2de18 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:54.865290 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b9b7398b-e38b-4707-aa87-772d30d2de18 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1879 microversion: 2.42 time: 0.429720 May 27 15:11:54.870607 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1800/3615] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:54 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1879 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:11:54.895913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d0300e80-a867-4b51-a7ae-7977d10b8942 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:54.896627 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d0300e80-a867-4b51-a7ae-7977d10b8942 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:54.920603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d0300e80-a867-4b51-a7ae-7977d10b8942 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:54.921183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d0300e80-a867-4b51-a7ae-7977d10b8942 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:54.925391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d0300e80-a867-4b51-a7ae-7977d10b8942 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:54.927043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d0300e80-a867-4b51-a7ae-7977d10b8942 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:54.946211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-16b3246e-2bc2-4a2d-9ace-e1517fe659a5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:54.955698 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-16b3246e-2bc2-4a2d-9ace-e1517fe659a5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:54.959660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-16b3246e-2bc2-4a2d-9ace-e1517fe659a5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e092508233424efd8a374dd85ad6d71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0037dd3962414ff8846962fafd1366d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:54.961544 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-16b3246e-2bc2-4a2d-9ace-e1517fe659a5 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/8b391c6d-2c42-4404-8155-412062aa0d81" status: 200 len: 1362 microversion: 2.47 time: 0.248351 May 27 15:11:54.963438 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1816/3616] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:54 2022] GET /compute/v2.1/servers/8b391c6d-2c42-4404-8155-412062aa0d81 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:11:55.130980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-778acb54-4520-40c1-9400-94dab0d24cf1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:55.132186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-778acb54-4520-40c1-9400-94dab0d24cf1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:55.144522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-778acb54-4520-40c1-9400-94dab0d24cf1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:55.155093 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-778acb54-4520-40c1-9400-94dab0d24cf1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:55.157166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-778acb54-4520-40c1-9400-94dab0d24cf1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:55.157885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-778acb54-4520-40c1-9400-94dab0d24cf1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:55.219546 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d0300e80-a867-4b51-a7ae-7977d10b8942 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "POST /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20/action" status: 202 len: 0 microversion: 2.20 time: 0.342103 May 27 15:11:55.220193 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1801/3617] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 27 15:11:54 2022] POST /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 15:11:55.251155 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-91f2cc88-5fb4-4943-9db4-4c373834e3f1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:55.253224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-91f2cc88-5fb4-4943-9db4-4c373834e3f1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:55.310540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-91f2cc88-5fb4-4943-9db4-4c373834e3f1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:55.312646 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-91f2cc88-5fb4-4943-9db4-4c373834e3f1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:55.316790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-91f2cc88-5fb4-4943-9db4-4c373834e3f1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:55.320342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-91f2cc88-5fb4-4943-9db4-4c373834e3f1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:55.744769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-91f2cc88-5fb4-4943-9db4-4c373834e3f1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:55.765124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-91f2cc88-5fb4-4943-9db4-4c373834e3f1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:55.768326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-91f2cc88-5fb4-4943-9db4-4c373834e3f1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:55.772201 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-91f2cc88-5fb4-4943-9db4-4c373834e3f1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1672 microversion: 2.20 time: 0.543499 May 27 15:11:55.779407 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1802/3618] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:55 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1672 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:55.794917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d80a91a1-5045-4093-887e-39794c61d37f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:55.795725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d80a91a1-5045-4093-887e-39794c61d37f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:55.817113 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d80a91a1-5045-4093-887e-39794c61d37f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:55.817806 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d80a91a1-5045-4093-887e-39794c61d37f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:55.818604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d80a91a1-5045-4093-887e-39794c61d37f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:55.819048 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d80a91a1-5045-4093-887e-39794c61d37f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:56.555760 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-778acb54-4520-40c1-9400-94dab0d24cf1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:56.584805 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-778acb54-4520-40c1-9400-94dab0d24cf1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1522 microversion: 2.1 time: 1.456918 May 27 15:11:56.586350 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1817/3619] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:55 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1522 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:11:56.606487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f1018490-4b41-4017-aeb4-0dd7623af61f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:56.608191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f1018490-4b41-4017-aeb4-0dd7623af61f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] [instance: b105d0b6-f635-4072-a59b-954702fea503] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:56.613207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d80a91a1-5045-4093-887e-39794c61d37f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:56.624405 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d80a91a1-5045-4093-887e-39794c61d37f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1513 microversion: 2.1 time: 0.843776 May 27 15:11:56.625624 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1803/3620] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:55 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1513 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:56.628032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1018490-4b41-4017-aeb4-0dd7623af61f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:56.630407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1018490-4b41-4017-aeb4-0dd7623af61f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:56.632119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-527a7ea0-1ef7-41d4-8e11-7a8de185ef00 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:56.633860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-527a7ea0-1ef7-41d4-8e11-7a8de185ef00 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:56.634119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1018490-4b41-4017-aeb4-0dd7623af61f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:56.634656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1018490-4b41-4017-aeb4-0dd7623af61f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:56.647378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-527a7ea0-1ef7-41d4-8e11-7a8de185ef00 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:56.648295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-527a7ea0-1ef7-41d4-8e11-7a8de185ef00 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:56.649727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-527a7ea0-1ef7-41d4-8e11-7a8de185ef00 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:56.650490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-527a7ea0-1ef7-41d4-8e11-7a8de185ef00 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:57.182500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-527a7ea0-1ef7-41d4-8e11-7a8de185ef00 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:57.201527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f1018490-4b41-4017-aeb4-0dd7623af61f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5e6e7eb549d8ba5b4bb520da69bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513a8d6d211640118776fb143e6628a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:57.202295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-527a7ea0-1ef7-41d4-8e11-7a8de185ef00 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:57.205096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-527a7ea0-1ef7-41d4-8e11-7a8de185ef00 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:57.208516 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-527a7ea0-1ef7-41d4-8e11-7a8de185ef00 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1879 microversion: 2.42 time: 0.581395 May 27 15:11:57.212691 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1804/3621] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:56 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1879 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:57.217548 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f1018490-4b41-4017-aeb4-0dd7623af61f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503" status: 200 len: 1313 microversion: 2.1 time: 0.625805 May 27 15:11:57.221655 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1818/3622] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:56 2022] GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 => generated 1313 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:57.225887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b1c7c81c-a635-4cee-8114-8daa067f3db4 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:57.229312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b1c7c81c-a635-4cee-8114-8daa067f3db4 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] [instance: 8b391c6d-2c42-4404-8155-412062aa0d81] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:57.238060 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-632e1cb8-b3ee-4723-bc2b-bca761ae1414 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:57.245183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b1c7c81c-a635-4cee-8114-8daa067f3db4 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:57.245824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b1c7c81c-a635-4cee-8114-8daa067f3db4 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:57.246842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-632e1cb8-b3ee-4723-bc2b-bca761ae1414 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:57.247089 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b1c7c81c-a635-4cee-8114-8daa067f3db4 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:57.247693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b1c7c81c-a635-4cee-8114-8daa067f3db4 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:57.248567 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.compute.servers [None req-632e1cb8-b3ee-4723-bc2b-bca761ae1414 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Removing options 'limit' from query {{(pid=119248) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 27 15:11:57.249429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-632e1cb8-b3ee-4723-bc2b-bca761ae1414 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Searching by: {'deleted': False, 'project_id': '5f1274817f784f12ba47ba885010ec42'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:11:57.255531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-632e1cb8-b3ee-4723-bc2b-bca761ae1414 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:57.256004 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-632e1cb8-b3ee-4723-bc2b-bca761ae1414 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:57.256868 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-632e1cb8-b3ee-4723-bc2b-bca761ae1414 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:57.259925 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-632e1cb8-b3ee-4723-bc2b-bca761ae1414 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:57.262403 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-632e1cb8-b3ee-4723-bc2b-bca761ae1414 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.039510 May 27 15:11:57.264035 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1819/3623] 10.222.0.13 () {58 vars in 1139 bytes} [Fri May 27 15:11:57 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:11:57.265991 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-b1c7c81c-a635-4cee-8114-8daa067f3db4 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] HTTP exception thrown: Instance 8b391c6d-2c42-4404-8155-412062aa0d81 could not be found. May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b1c7c81c-a635-4cee-8114-8daa067f3db4 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Request method failure captured: May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/8b391c6d-2c42-4404-8155-412062aa0d81 HTTP/1.1 May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOn-MSZeDHMWk7how2IRjzGAGwuKNcQ4Ul_IT0SWpjvzR2OpSEnCV38KFNrRq66YedwMYNrIosHc0_kzBDrwUS0fMJvozWDM0UcL7SO32UYVk61YL9AtPIQwELlWrAj9gc_EbVDWiC8xOEu-lpr4TE5_n5KAT2eo7OopK2rZXlLTFgA May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-Openstack-Nova-Api-Version: 2.47 May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 0037dd3962414ff8846962fafd1366d1 May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerShowV247Test-457128591 May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0037dd3962414ff8846962fafd1366d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0037dd3962414ff8846962fafd1366d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0037dd3962414ff8846962fafd1366d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0037dd3962414ff8846962fafd1366d1", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerShowV247Test-457128591 May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 0037dd3962414ff8846962fafd1366d1 May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerShowV247Test-457128591 May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerShowV247Test-457128591-project May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: e092508233424efd8a374dd85ad6d71d May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerShowV247Test-457128591-project May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 8b391c6d-2c42-4404-8155-412062aa0d81 could not be found. May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '8b391c6d-2c42-4404-8155-412062aa0d81'} May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b391c6d-2c42-4404-8155-412062aa0d81 could not be found. May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b391c6d-2c42-4404-8155-412062aa0d81 could not be found. May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:11:57.270202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:57.275935 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:11:57.275935 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:11:57.275935 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:11:57.275935 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:11:57.275935 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:11:57.275935 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b391c6d-2c42-4404-8155-412062aa0d81 could not be found. May 27 15:11:57.275935 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:11:57.275935 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b1c7c81c-a635-4cee-8114-8daa067f3db4 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] Returning 404 to user: Instance 8b391c6d-2c42-4404-8155-412062aa0d81 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:11:57.275935 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b1c7c81c-a635-4cee-8114-8daa067f3db4 tempest-ServerShowV247Test-457128591 tempest-ServerShowV247Test-457128591-project] 10.222.0.13 "GET /compute/v2.1/servers/8b391c6d-2c42-4404-8155-412062aa0d81" status: 404 len: 111 microversion: 2.47 time: 0.058139 May 27 15:11:57.276734 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1805/3624] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:57 2022] GET /compute/v2.1/servers/8b391c6d-2c42-4404-8155-412062aa0d81 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:11:57.276972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ba18e47e-8f3a-461d-9b08-ddb03e681e39 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:57.278208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ba18e47e-8f3a-461d-9b08-ddb03e681e39 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:57.281918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:11:57.282070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aa091847-9dde-4872-9237-2628817c21b6 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:57.282666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-aa091847-9dde-4872-9237-2628817c21b6 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:57.288089 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba18e47e-8f3a-461d-9b08-ddb03e681e39 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:57.290153 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba18e47e-8f3a-461d-9b08-ddb03e681e39 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:57.291096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa091847-9dde-4872-9237-2628817c21b6 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:57.291354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba18e47e-8f3a-461d-9b08-ddb03e681e39 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:57.291550 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa091847-9dde-4872-9237-2628817c21b6 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:57.292120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba18e47e-8f3a-461d-9b08-ddb03e681e39 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:57.292334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa091847-9dde-4872-9237-2628817c21b6 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:57.292832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa091847-9dde-4872-9237-2628817c21b6 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:57.627882 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ba18e47e-8f3a-461d-9b08-ddb03e681e39 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:57.638667 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ba18e47e-8f3a-461d-9b08-ddb03e681e39 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:57.642514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ba18e47e-8f3a-461d-9b08-ddb03e681e39 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:57.648808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-aa091847-9dde-4872-9237-2628817c21b6 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:57.655647 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ba18e47e-8f3a-461d-9b08-ddb03e681e39 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1730 microversion: 2.20 time: 0.390029 May 27 15:11:57.662681 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1820/3625] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:57 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1730 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:57.664371 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-aa091847-9dde-4872-9237-2628817c21b6 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1513 microversion: 2.1 time: 0.382391 May 27 15:11:57.665180 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1806/3626] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:57 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1513 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:57.686094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-384c5041-42ab-48c8-bcb6-4e515fb1ef77 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:57.691429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-384c5041-42ab-48c8-bcb6-4e515fb1ef77 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:57.693445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-76a9fa6a-3ae2-4518-b4e9-0cd2b8971e98 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:57.694285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-76a9fa6a-3ae2-4518-b4e9-0cd2b8971e98 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:57.704999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76a9fa6a-3ae2-4518-b4e9-0cd2b8971e98 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:57.706902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-384c5041-42ab-48c8-bcb6-4e515fb1ef77 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:57.707646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-384c5041-42ab-48c8-bcb6-4e515fb1ef77 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:57.708609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-384c5041-42ab-48c8-bcb6-4e515fb1ef77 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:57.710009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76a9fa6a-3ae2-4518-b4e9-0cd2b8971e98 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:57.710661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-384c5041-42ab-48c8-bcb6-4e515fb1ef77 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:57.711631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76a9fa6a-3ae2-4518-b4e9-0cd2b8971e98 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:57.714003 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76a9fa6a-3ae2-4518-b4e9-0cd2b8971e98 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:58.402065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-384c5041-42ab-48c8-bcb6-4e515fb1ef77 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:58.412423 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-384c5041-42ab-48c8-bcb6-4e515fb1ef77 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1522 microversion: 2.1 time: 0.746413 May 27 15:11:58.413197 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1821/3627] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:57 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1522 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:58.419160 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-22b42101-a0a9-43d5-aa57-119295c66ef5 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:58.431967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-22b42101-a0a9-43d5-aa57-119295c66ef5 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] [instance: b105d0b6-f635-4072-a59b-954702fea503] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:58.436868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-76a9fa6a-3ae2-4518-b4e9-0cd2b8971e98 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:58.453756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22b42101-a0a9-43d5-aa57-119295c66ef5 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:58.454735 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22b42101-a0a9-43d5-aa57-119295c66ef5 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:58.456894 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22b42101-a0a9-43d5-aa57-119295c66ef5 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:58.457401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22b42101-a0a9-43d5-aa57-119295c66ef5 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:58.464289 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-76a9fa6a-3ae2-4518-b4e9-0cd2b8971e98 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9" status: 200 len: 1513 microversion: 2.1 time: 0.781882 May 27 15:11:58.464962 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1807/3628] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:57 2022] GET /compute/v2.1/servers/f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9 => generated 1513 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:58.469523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a4b2e758-b7a9-4173-a603-47ca6f62c7e3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:58.470147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a4b2e758-b7a9-4173-a603-47ca6f62c7e3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:58.486516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4b2e758-b7a9-4173-a603-47ca6f62c7e3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:58.486987 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4b2e758-b7a9-4173-a603-47ca6f62c7e3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:58.491860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4b2e758-b7a9-4173-a603-47ca6f62c7e3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:58.492415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4b2e758-b7a9-4173-a603-47ca6f62c7e3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:58.848409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-22b42101-a0a9-43d5-aa57-119295c66ef5 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5e6e7eb549d8ba5b4bb520da69bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513a8d6d211640118776fb143e6628a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:58.866828 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-22b42101-a0a9-43d5-aa57-119295c66ef5 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503" status: 200 len: 1313 microversion: 2.1 time: 0.449711 May 27 15:11:58.882906 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1822/3629] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:58 2022] GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:58.895551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e7587b4-abaa-4357-a02a-8a16f4f97453 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:58.896497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e7587b4-abaa-4357-a02a-8a16f4f97453 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:58.909177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e7587b4-abaa-4357-a02a-8a16f4f97453 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:58.910374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e7587b4-abaa-4357-a02a-8a16f4f97453 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:58.912008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e7587b4-abaa-4357-a02a-8a16f4f97453 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:58.913566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e7587b4-abaa-4357-a02a-8a16f4f97453 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:59.194433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a4b2e758-b7a9-4173-a603-47ca6f62c7e3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:59.198037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e7587b4-abaa-4357-a02a-8a16f4f97453 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:59.209574 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e7587b4-abaa-4357-a02a-8a16f4f97453 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1513 microversion: 2.1 time: 0.324281 May 27 15:11:59.210176 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1823/3630] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:58 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1513 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:11:59.211962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a4b2e758-b7a9-4173-a603-47ca6f62c7e3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:59.217640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-970d8e3b-47c1-4dde-ad92-1831eacf4195 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:59.218547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-970d8e3b-47c1-4dde-ad92-1831eacf4195 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:59.218672 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a4b2e758-b7a9-4173-a603-47ca6f62c7e3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:59.220096 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a4b2e758-b7a9-4173-a603-47ca6f62c7e3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1879 microversion: 2.42 time: 0.754101 May 27 15:11:59.223348 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1808/3631] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:58 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1879 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:59.227470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-970d8e3b-47c1-4dde-ad92-1831eacf4195 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:59.228331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-970d8e3b-47c1-4dde-ad92-1831eacf4195 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:59.229348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-970d8e3b-47c1-4dde-ad92-1831eacf4195 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:59.230818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-970d8e3b-47c1-4dde-ad92-1831eacf4195 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:59.246911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-99fdc235-a3f1-4ef4-841b-f135406523e6 req-437cef0a-151a-488b-a72a-36c05abddd69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b105d0b6-f635-4072-a59b-954702fea503", "tag": "fc414d61-a683-49c9-85d5-6f4f499fc6ec"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:11:59.271006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-99fdc235-a3f1-4ef4-841b-f135406523e6 req-437cef0a-151a-488b-a72a-36c05abddd69 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:59.271752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-99fdc235-a3f1-4ef4-841b-f135406523e6 req-437cef0a-151a-488b-a72a-36c05abddd69 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:59.301369 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-99fdc235-a3f1-4ef4-841b-f135406523e6 req-437cef0a-151a-488b-a72a-36c05abddd69 service nova] Creating event network-changed:fc414d61-a683-49c9-85d5-6f4f499fc6ec for instance b105d0b6-f635-4072-a59b-954702fea503 on n-h2-843621-1 May 27 15:11:59.317437 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-99fdc235-a3f1-4ef4-841b-f135406523e6 req-437cef0a-151a-488b-a72a-36c05abddd69 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080258 May 27 15:11:59.320486 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1809/3632] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:11:59.330007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-001f7738-8e1c-49a1-9a55-907df47d77f2 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:59.336251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-001f7738-8e1c-49a1-9a55-907df47d77f2 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:59.337691 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-001f7738-8e1c-49a1-9a55-907df47d77f2 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '5f1274817f784f12ba47ba885010ec42'} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:11:59.623105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-001f7738-8e1c-49a1-9a55-907df47d77f2 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:59.623573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-001f7738-8e1c-49a1-9a55-907df47d77f2 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:59.624409 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-001f7738-8e1c-49a1-9a55-907df47d77f2 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:59.632280 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-001f7738-8e1c-49a1-9a55-907df47d77f2 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:59.814325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-970d8e3b-47c1-4dde-ad92-1831eacf4195 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:59.829195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-970d8e3b-47c1-4dde-ad92-1831eacf4195 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:59.834009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-970d8e3b-47c1-4dde-ad92-1831eacf4195 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:11:59.835237 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-970d8e3b-47c1-4dde-ad92-1831eacf4195 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1730 microversion: 2.20 time: 0.622313 May 27 15:11:59.853969 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1824/3633] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:11:59 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1730 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:11:59.870144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e2775442-87b9-4341-9b3c-0174c536b86e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:11:59.870782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e2775442-87b9-4341-9b3c-0174c536b86e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:11:59.890257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.multi_cell_list [None req-001f7738-8e1c-49a1-9a55-907df47d77f2 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119249) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:11:59.891011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2775442-87b9-4341-9b3c-0174c536b86e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:59.892693 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2775442-87b9-4341-9b3c-0174c536b86e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:11:59.896996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2775442-87b9-4341-9b3c-0174c536b86e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:11:59.897643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2775442-87b9-4341-9b3c-0174c536b86e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:00.014165 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-001f7738-8e1c-49a1-9a55-907df47d77f2 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.690827 May 27 15:12:00.016631 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1810/3634] 10.222.0.13 () {58 vars in 1153 bytes} [Fri May 27 15:11:59 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:00.025237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c9a631ba-98e2-493c-90aa-f8354c387673 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:00.025988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c9a631ba-98e2-493c-90aa-f8354c387673 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] [instance: b105d0b6-f635-4072-a59b-954702fea503] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:00.049859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9a631ba-98e2-493c-90aa-f8354c387673 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:00.050674 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9a631ba-98e2-493c-90aa-f8354c387673 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:00.052226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9a631ba-98e2-493c-90aa-f8354c387673 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:00.056054 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c9a631ba-98e2-493c-90aa-f8354c387673 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:00.062610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:00.431112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e2775442-87b9-4341-9b3c-0174c536b86e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:00.445822 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e2775442-87b9-4341-9b3c-0174c536b86e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1522 microversion: 2.1 time: 0.589577 May 27 15:12:00.448588 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1825/3635] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:11:59 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1522 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:00.462078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3a98285a-ef6e-4ffe-bbe1-26fe492e2a84 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:00.463064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3a98285a-ef6e-4ffe-bbe1-26fe492e2a84 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:00.477090 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a98285a-ef6e-4ffe-bbe1-26fe492e2a84 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:00.477841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a98285a-ef6e-4ffe-bbe1-26fe492e2a84 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:00.479644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a98285a-ef6e-4ffe-bbe1-26fe492e2a84 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:00.481996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a98285a-ef6e-4ffe-bbe1-26fe492e2a84 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:00.496199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c9a631ba-98e2-493c-90aa-f8354c387673 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5e6e7eb549d8ba5b4bb520da69bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513a8d6d211640118776fb143e6628a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:00.509537 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c9a631ba-98e2-493c-90aa-f8354c387673 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503" status: 200 len: 1313 microversion: 2.1 time: 0.491799 May 27 15:12:00.514598 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1811/3636] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:00 2022] GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:00.530382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-de67c34d-73b2-44f1-bbea-6cb2e8a62430 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:00.534246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-de67c34d-73b2-44f1-bbea-6cb2e8a62430 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:00.551575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de67c34d-73b2-44f1-bbea-6cb2e8a62430 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:00.552033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de67c34d-73b2-44f1-bbea-6cb2e8a62430 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:00.553062 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de67c34d-73b2-44f1-bbea-6cb2e8a62430 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:00.559257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de67c34d-73b2-44f1-bbea-6cb2e8a62430 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:01.023899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3a98285a-ef6e-4ffe-bbe1-26fe492e2a84 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:01.033563 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3a98285a-ef6e-4ffe-bbe1-26fe492e2a84 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1513 microversion: 2.1 time: 0.583742 May 27 15:12:01.038491 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1826/3637] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:00 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1513 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:01.067281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-de67c34d-73b2-44f1-bbea-6cb2e8a62430 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:01.100646 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-de67c34d-73b2-44f1-bbea-6cb2e8a62430 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:01.104609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-de67c34d-73b2-44f1-bbea-6cb2e8a62430 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:01.107879 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-de67c34d-73b2-44f1-bbea-6cb2e8a62430 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1879 microversion: 2.42 time: 0.591169 May 27 15:12:01.110934 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1812/3638] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:00 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1879 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:01.125346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-390edb62-ca8b-48bc-9389-9cb554945b78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:01.128527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-390edb62-ca8b-48bc-9389-9cb554945b78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:01.148076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-390edb62-ca8b-48bc-9389-9cb554945b78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:01.151014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-390edb62-ca8b-48bc-9389-9cb554945b78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:01.152205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-390edb62-ca8b-48bc-9389-9cb554945b78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:01.152882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-390edb62-ca8b-48bc-9389-9cb554945b78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:01.405065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-aac35419-d909-4508-9785-d8d173993554 tempest-ExtensionsTest-1211644156 tempest-ExtensionsTest-1211644156-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:01.407172 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-aac35419-d909-4508-9785-d8d173993554 tempest-ExtensionsTest-1211644156 tempest-ExtensionsTest-1211644156-project] 10.222.0.13 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.367012 May 27 15:12:01.409988 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1827/3639] 10.222.0.13 () {58 vars in 1169 bytes} [Fri May 27 15:12:01 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:01.431489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-11e9e3ed-3cee-4a21-a511-42a16e873a8f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:01.432606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-11e9e3ed-3cee-4a21-a511-42a16e873a8f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:01.467615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-11e9e3ed-3cee-4a21-a511-42a16e873a8f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:01.468552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-11e9e3ed-3cee-4a21-a511-42a16e873a8f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:01.475623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-390edb62-ca8b-48bc-9389-9cb554945b78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:01.480515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-11e9e3ed-3cee-4a21-a511-42a16e873a8f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:01.481359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-11e9e3ed-3cee-4a21-a511-42a16e873a8f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:01.489670 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-390edb62-ca8b-48bc-9389-9cb554945b78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:01.493287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-390edb62-ca8b-48bc-9389-9cb554945b78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:01.496051 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-390edb62-ca8b-48bc-9389-9cb554945b78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1730 microversion: 2.20 time: 0.381908 May 27 15:12:01.497348 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1813/3640] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:01 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1730 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:01.503247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7cff9f0c-90bf-4394-9ff2-bb3ba9b4f2bf tempest-ExtensionsTest-1211644156 tempest-ExtensionsTest-1211644156-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:01.505814 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7cff9f0c-90bf-4394-9ff2-bb3ba9b4f2bf tempest-ExtensionsTest-1211644156 tempest-ExtensionsTest-1211644156-project] 10.222.0.13 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006665 May 27 15:12:01.531020 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1814/3641] 10.222.0.13 () {58 vars in 1133 bytes} [Fri May 27 15:12:01 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:12:01.537580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-887d854d-5361-4b7d-99e8-5fa7307cf250 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:01.539713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-887d854d-5361-4b7d-99e8-5fa7307cf250 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:01.552727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-887d854d-5361-4b7d-99e8-5fa7307cf250 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:01.553624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-887d854d-5361-4b7d-99e8-5fa7307cf250 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:01.556227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-887d854d-5361-4b7d-99e8-5fa7307cf250 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:01.557737 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-887d854d-5361-4b7d-99e8-5fa7307cf250 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:02.000164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=40 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:02.081415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-887d854d-5361-4b7d-99e8-5fa7307cf250 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:02.104212 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-887d854d-5361-4b7d-99e8-5fa7307cf250 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1522 microversion: 2.1 time: 0.571430 May 27 15:12:02.104847 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1815/3642] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:01 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1522 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:02.133079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-11e9e3ed-3cee-4a21-a511-42a16e873a8f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:02.157778 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-11e9e3ed-3cee-4a21-a511-42a16e873a8f tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9" status: 200 len: 1513 microversion: 2.1 time: 0.744209 May 27 15:12:02.158839 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e002a9d9-c07a-4bb7-b94a-94b53bc22d5f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:02.174676 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1828/3643] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:01 2022] GET /compute/v2.1/servers/f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9 => generated 1513 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:02.177115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e002a9d9-c07a-4bb7-b94a-94b53bc22d5f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] [instance: b105d0b6-f635-4072-a59b-954702fea503] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:02.186727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e002a9d9-c07a-4bb7-b94a-94b53bc22d5f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:02.187737 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e002a9d9-c07a-4bb7-b94a-94b53bc22d5f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:02.188834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e002a9d9-c07a-4bb7-b94a-94b53bc22d5f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:02.189767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e002a9d9-c07a-4bb7-b94a-94b53bc22d5f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:02.214571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c57aa7e5-a484-4f1b-b145-1d992c9c0623 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:02.217160 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c57aa7e5-a484-4f1b-b145-1d992c9c0623 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:02.249194 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c57aa7e5-a484-4f1b-b145-1d992c9c0623 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:02.251085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c57aa7e5-a484-4f1b-b145-1d992c9c0623 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:02.252095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c57aa7e5-a484-4f1b-b145-1d992c9c0623 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:02.253715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c57aa7e5-a484-4f1b-b145-1d992c9c0623 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:02.512125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:02.833620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=18 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:02.857340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e002a9d9-c07a-4bb7-b94a-94b53bc22d5f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5e6e7eb549d8ba5b4bb520da69bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513a8d6d211640118776fb143e6628a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:02.869765 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e002a9d9-c07a-4bb7-b94a-94b53bc22d5f tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503" status: 200 len: 1313 microversion: 2.1 time: 0.746308 May 27 15:12:02.871843 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1816/3644] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:02 2022] GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 => generated 1313 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:02.892942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ffea4460-b076-421f-8115-3de06f3dff14 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:02.893900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ffea4460-b076-421f-8115-3de06f3dff14 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:02.917857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ffea4460-b076-421f-8115-3de06f3dff14 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:02.920944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ffea4460-b076-421f-8115-3de06f3dff14 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:02.922064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ffea4460-b076-421f-8115-3de06f3dff14 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:02.924375 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ffea4460-b076-421f-8115-3de06f3dff14 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:03.094886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c57aa7e5-a484-4f1b-b145-1d992c9c0623 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:03.114345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c57aa7e5-a484-4f1b-b145-1d992c9c0623 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:03.140823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c57aa7e5-a484-4f1b-b145-1d992c9c0623 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:03.148991 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c57aa7e5-a484-4f1b-b145-1d992c9c0623 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1879 microversion: 2.42 time: 0.965258 May 27 15:12:03.151801 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1829/3645] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:02 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1879 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:03.168871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-525db804-d481-4d91-ad35-e07c52258678 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:03.170549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-525db804-d481-4d91-ad35-e07c52258678 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:03.193927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-525db804-d481-4d91-ad35-e07c52258678 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:03.195591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-525db804-d481-4d91-ad35-e07c52258678 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:03.197124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-525db804-d481-4d91-ad35-e07c52258678 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:03.198083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-525db804-d481-4d91-ad35-e07c52258678 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:03.691057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ffea4460-b076-421f-8115-3de06f3dff14 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:03.699859 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ffea4460-b076-421f-8115-3de06f3dff14 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1513 microversion: 2.1 time: 0.826097 May 27 15:12:03.719708 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1817/3646] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:02 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1513 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:03.753227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b8804094-bf35-4f17-b0ae-ccf658e49e98 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:03.754002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b8804094-bf35-4f17-b0ae-ccf658e49e98 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:03.797190 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-525db804-d481-4d91-ad35-e07c52258678 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:03.809944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-525db804-d481-4d91-ad35-e07c52258678 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:03.817410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-525db804-d481-4d91-ad35-e07c52258678 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:03.820853 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-525db804-d481-4d91-ad35-e07c52258678 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1730 microversion: 2.20 time: 0.665043 May 27 15:12:03.824390 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1830/3647] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:03 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1730 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:03.832414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-92a13aef-f45c-46a4-a9fe-2881b836e39c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-900998983", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "2344c7a7-c142-4221-acc7-8131f1072282"}], "block_device_mapping_v2": [{"uuid": "9e880180-566b-4d98-b6e8-673cf4f88a84", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:03.848796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8804094-bf35-4f17-b0ae-ccf658e49e98 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:03.849398 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8804094-bf35-4f17-b0ae-ccf658e49e98 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:03.850250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8804094-bf35-4f17-b0ae-ccf658e49e98 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:03.850698 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8804094-bf35-4f17-b0ae-ccf658e49e98 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:03.997032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-92a13aef-f45c-46a4-a9fe-2881b836e39c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] validate_networks() for [('2344c7a7-c142-4221-acc7-8131f1072282', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:12:04.286756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b8804094-bf35-4f17-b0ae-ccf658e49e98 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:04.302480 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b8804094-bf35-4f17-b0ae-ccf658e49e98 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1522 microversion: 2.1 time: 0.581418 May 27 15:12:04.314966 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1818/3648] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:03 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1522 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:04.323262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-398585e2-30c2-4cb6-a697-563b4998f62c tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:04.337612 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-398585e2-30c2-4cb6-a697-563b4998f62c tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:04.347649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-398585e2-30c2-4cb6-a697-563b4998f62c tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Searching by: {'deleted': False, 'project_id': '5f1274817f784f12ba47ba885010ec42'} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:12:04.354377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-398585e2-30c2-4cb6-a697-563b4998f62c tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:04.363332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-398585e2-30c2-4cb6-a697-563b4998f62c tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:04.364610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-398585e2-30c2-4cb6-a697-563b4998f62c tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:04.365284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-398585e2-30c2-4cb6-a697-563b4998f62c tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:04.412058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.multi_cell_list [None req-398585e2-30c2-4cb6-a697-563b4998f62c tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119249) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:12:04.503398 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-398585e2-30c2-4cb6-a697-563b4998f62c tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:04.521664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-398585e2-30c2-4cb6-a697-563b4998f62c tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:04.522107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-398585e2-30c2-4cb6-a697-563b4998f62c tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:05.463395 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-398585e2-30c2-4cb6-a697-563b4998f62c tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 4522 microversion: 2.1 time: 1.148347 May 27 15:12:05.463973 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1819/3649] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 15:12:04 2022] GET /compute/v2.1/servers/detail => generated 4522 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:05.481979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-38417ca5-f9b7-47b4-8703-64e170e05fc8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:05.483231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-38417ca5-f9b7-47b4-8703-64e170e05fc8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] [instance: b105d0b6-f635-4072-a59b-954702fea503] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:05.500852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38417ca5-f9b7-47b4-8703-64e170e05fc8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:05.509140 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38417ca5-f9b7-47b4-8703-64e170e05fc8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:05.509973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38417ca5-f9b7-47b4-8703-64e170e05fc8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:05.510419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38417ca5-f9b7-47b4-8703-64e170e05fc8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:05.530717 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-92a13aef-f45c-46a4-a9fe-2881b836e39c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:12:05.531823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-92a13aef-f45c-46a4-a9fe-2881b836e39c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:12:05.532443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-92a13aef-f45c-46a4-a9fe-2881b836e39c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:12:05.533023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-92a13aef-f45c-46a4-a9fe-2881b836e39c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:12:05.533616 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-92a13aef-f45c-46a4-a9fe-2881b836e39c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:12:05.550642 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-92a13aef-f45c-46a4-a9fe-2881b836e39c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:05.551271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-92a13aef-f45c-46a4-a9fe-2881b836e39c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:05.558701 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-92a13aef-f45c-46a4-a9fe-2881b836e39c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:05.559464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-92a13aef-f45c-46a4-a9fe-2881b836e39c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:05.596252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-92a13aef-f45c-46a4-a9fe-2881b836e39c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Getting quotas for project e41b606a0de24f7fa9ea68af7064723b. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:12:05.608011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-92a13aef-f45c-46a4-a9fe-2881b836e39c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Getting quotas for user 741a4f106a8f416891b90994e6ce9d40 and project e41b606a0de24f7fa9ea68af7064723b. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:12:05.775032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-92a13aef-f45c-46a4-a9fe-2881b836e39c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:12:05.778328 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-92a13aef-f45c-46a4-a9fe-2881b836e39c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9e880180-566b-4d98-b6e8-673cf4f88a84',volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:12:05.870326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-38417ca5-f9b7-47b4-8703-64e170e05fc8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5e6e7eb549d8ba5b4bb520da69bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513a8d6d211640118776fb143e6628a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:05.880081 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-38417ca5-f9b7-47b4-8703-64e170e05fc8 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503" status: 200 len: 1313 microversion: 2.1 time: 0.411383 May 27 15:12:05.889594 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1820/3650] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:05 2022] GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:05.905692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cfa55bbf-7511-4da2-85cd-e8462db18c0e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:05.907003 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cfa55bbf-7511-4da2-85cd-e8462db18c0e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:05.941857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfa55bbf-7511-4da2-85cd-e8462db18c0e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:05.945428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfa55bbf-7511-4da2-85cd-e8462db18c0e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:05.947293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfa55bbf-7511-4da2-85cd-e8462db18c0e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:05.952959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfa55bbf-7511-4da2-85cd-e8462db18c0e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:06.108909 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-92a13aef-f45c-46a4-a9fe-2881b836e39c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.283119 May 27 15:12:06.115329 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1831/3651] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:12:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:12:06.124826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-931c3266-4497-4366-9b04-a6abddce4c0c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:06.139228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-931c3266-4497-4366-9b04-a6abddce4c0c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:06.150751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-931c3266-4497-4366-9b04-a6abddce4c0c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:06.151531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-931c3266-4497-4366-9b04-a6abddce4c0c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:06.153085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-931c3266-4497-4366-9b04-a6abddce4c0c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:06.153085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-931c3266-4497-4366-9b04-a6abddce4c0c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:06.486077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cfa55bbf-7511-4da2-85cd-e8462db18c0e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:06.518242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cfa55bbf-7511-4da2-85cd-e8462db18c0e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:06.525399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cfa55bbf-7511-4da2-85cd-e8462db18c0e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:06.531445 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cfa55bbf-7511-4da2-85cd-e8462db18c0e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1879 microversion: 2.42 time: 0.640099 May 27 15:12:06.532460 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1821/3652] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:05 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1879 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:06.560221 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-792bb271-0721-40cd-9ff8-76fff6f093df tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:06.562484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-792bb271-0721-40cd-9ff8-76fff6f093df tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:06.607735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-792bb271-0721-40cd-9ff8-76fff6f093df tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:06.612430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-792bb271-0721-40cd-9ff8-76fff6f093df tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:06.615059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-792bb271-0721-40cd-9ff8-76fff6f093df tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:06.623828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-792bb271-0721-40cd-9ff8-76fff6f093df tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:06.657095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-931c3266-4497-4366-9b04-a6abddce4c0c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:06.677909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-931c3266-4497-4366-9b04-a6abddce4c0c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:06.682008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-931c3266-4497-4366-9b04-a6abddce4c0c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:06.685004 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-931c3266-4497-4366-9b04-a6abddce4c0c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1730 microversion: 2.20 time: 0.568319 May 27 15:12:06.690338 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1832/3653] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:06 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1730 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:06.720614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-616a7b37-9ad9-4bef-9bd4-ea8b684ed2eb tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:06.763918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-616a7b37-9ad9-4bef-9bd4-ea8b684ed2eb tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:06.765449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-616a7b37-9ad9-4bef-9bd4-ea8b684ed2eb tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Searching by: {'ip': '172.20.0.1', 'deleted': False, 'project_id': '5f1274817f784f12ba47ba885010ec42'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:12:06.942102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-616a7b37-9ad9-4bef-9bd4-ea8b684ed2eb tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:06.943445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-616a7b37-9ad9-4bef-9bd4-ea8b684ed2eb tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:06.945803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-616a7b37-9ad9-4bef-9bd4-ea8b684ed2eb tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:06.948281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-616a7b37-9ad9-4bef-9bd4-ea8b684ed2eb tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:07.127461 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-792bb271-0721-40cd-9ff8-76fff6f093df tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:07.146500 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-792bb271-0721-40cd-9ff8-76fff6f093df tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1502 microversion: 2.1 time: 0.612774 May 27 15:12:07.147266 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1822/3654] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:06 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1502 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:07.156792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-792bb271-0721-40cd-9ff8-76fff6f093df tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:07.156792 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-792bb271-0721-40cd-9ff8-76fff6f093df tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001087 May 27 15:12:07.156792 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1823/3655] 10.222.0.13 () {56 vars in 885 bytes} [Fri May 27 15:12:07 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 27 15:12:07.157143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-616a7b37-9ad9-4bef-9bd4-ea8b684ed2eb tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:12:07.176456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ebc67baf-7f4a-4014-8c67-f8ca9927b795 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:07.179442 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ebc67baf-7f4a-4014-8c67-f8ca9927b795 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:07.207239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ebc67baf-7f4a-4014-8c67-f8ca9927b795 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:07.208457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ebc67baf-7f4a-4014-8c67-f8ca9927b795 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:07.211541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ebc67baf-7f4a-4014-8c67-f8ca9927b795 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:07.212614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ebc67baf-7f4a-4014-8c67-f8ca9927b795 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:07.284524 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-616a7b37-9ad9-4bef-9bd4-ea8b684ed2eb tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers?ip=172.20.0.1" status: 200 len: 1012 microversion: 2.1 time: 0.591766 May 27 15:12:07.296085 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1833/3656] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 15:12:06 2022] GET /compute/v2.1/servers?ip=172.20.0.1 => generated 1012 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:07.301428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6179d96e-c8cb-4740-9362-6c9ba803e78b tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:07.302284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6179d96e-c8cb-4740-9362-6c9ba803e78b tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] [instance: b105d0b6-f635-4072-a59b-954702fea503] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:07.310669 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6179d96e-c8cb-4740-9362-6c9ba803e78b tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:07.311803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6179d96e-c8cb-4740-9362-6c9ba803e78b tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:07.312932 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6179d96e-c8cb-4740-9362-6c9ba803e78b tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:07.313680 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6179d96e-c8cb-4740-9362-6c9ba803e78b tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:07.382890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=98 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:07.435808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ebc67baf-7f4a-4014-8c67-f8ca9927b795 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:07.447893 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ebc67baf-7f4a-4014-8c67-f8ca9927b795 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1102 microversion: 2.1 time: 0.287534 May 27 15:12:07.448493 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1824/3657] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:07 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1102 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:07.469794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ebc67baf-7f4a-4014-8c67-f8ca9927b795 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:07.470985 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ebc67baf-7f4a-4014-8c67-f8ca9927b795 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002329 May 27 15:12:07.471400 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1825/3658] 10.222.0.13 () {54 vars in 1034 bytes} [Fri May 27 15:12:07 2022] GET /compute/v2/ => generated 379 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) May 27 15:12:07.476387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7bc97887-abfc-4c38-8d56-f0070d761c55 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edec6d4a-ade7-4734-9441-e8d36f01c371"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:07.479030 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7bc97887-abfc-4c38-8d56-f0070d761c55 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:07.495752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7bc97887-abfc-4c38-8d56-f0070d761c55 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:07.501496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7bc97887-abfc-4c38-8d56-f0070d761c55 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:07.502585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7bc97887-abfc-4c38-8d56-f0070d761c55 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:07.503194 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7bc97887-abfc-4c38-8d56-f0070d761c55 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:07.652387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6179d96e-c8cb-4740-9362-6c9ba803e78b tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5e6e7eb549d8ba5b4bb520da69bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513a8d6d211640118776fb143e6628a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:07.660770 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-7bc97887-abfc-4c38-8d56-f0070d761c55 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] HTTP exception thrown: Cannot 'attach_volume' instance 445b2880-4df5-45f6-bba3-3af281cea45c while it is in vm_state rescued May 27 15:12:07.671766 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6179d96e-c8cb-4740-9362-6c9ba803e78b tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503" status: 200 len: 1313 microversion: 2.1 time: 0.374216 May 27 15:12:07.673320 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1834/3659] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:07 2022] GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:07.678769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c42abe1d-f05a-42d8-8033-5d2d462a324d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7bc97887-abfc-4c38-8d56-f0070d761c55 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Request method failure captured: May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c/os-volume_attachments HTTP/1.1 May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 74 May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOnNcWUaU6oQTw40A1oZOI-6OFKZaukve4P5LqW1FpCc9yhaxuLnjuKFUwlZoi0CeEpz5akQjaT-fGwv01A8fNadXXg4nlnoB_yvoYpc3lVED0AfYG3-niNxm_AITH-UuchLUVsnXh3asdpL1aml75HbLXXqw5pajtYuIua7x_Sa4qg May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1f6efd5b16e5450d9eb9b454d05a775a May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1f6efd5b16e5450d9eb9b454d05a775a", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1f6efd5b16e5450d9eb9b454d05a775a May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerRescueNegativeTestJSON-1538927199-project May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 645379b3a21548d8a4f4d6425b61319f May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1538927199-project May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: {"volumeAttachment": {"volumeId": "edec6d4a-ade7-4734-9441-e8d36f01c371"}} May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: exception: Cannot 'attach_volume' instance 445b2880-4df5-45f6-bba3-3af281cea45c while it is in vm_state rescued May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'server_id': '445b2880-4df5-45f6-bba3-3af281cea45c', 'body': {'volumeAttachment': {'volumeId': 'edec6d4a-ade7-4734-9441-e8d36f01c371'}}} May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 445b2880-4df5-45f6-bba3-3af281cea45c in vm_state rescued. Cannot attach_volume while the instance is in this state. May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 27 15:12:07.689137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 15:12:07.693274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 15:12:07.693274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 15:12:07.693274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 445b2880-4df5-45f6-bba3-3af281cea45c while it is in vm_state rescued May 27 15:12:07.693274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:07.693274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:07.693274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:07.693274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:07.693274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:07.693274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:07.693274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:12:07.693274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:12:07.693274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 445b2880-4df5-45f6-bba3-3af281cea45c while it is in vm_state rescued May 27 15:12:07.693274 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:07.693274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7bc97887-abfc-4c38-8d56-f0070d761c55 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Returning 409 to user: Cannot 'attach_volume' instance 445b2880-4df5-45f6-bba3-3af281cea45c while it is in vm_state rescued {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:12:07.696839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c42abe1d-f05a-42d8-8033-5d2d462a324d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:07.697805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c42abe1d-f05a-42d8-8033-5d2d462a324d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '5f1274817f784f12ba47ba885010ec42'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:12:07.698491 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7bc97887-abfc-4c38-8d56-f0070d761c55 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "POST /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.225489 May 27 15:12:07.700033 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1826/3660] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 15:12:07 2022] POST /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c/os-volume_attachments => generated 152 bytes in 228 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:12:07.701972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7bc97887-abfc-4c38-8d56-f0070d761c55 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:07.704444 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7bc97887-abfc-4c38-8d56-f0070d761c55 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003323 May 27 15:12:07.709803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c42abe1d-f05a-42d8-8033-5d2d462a324d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:07.716601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c42abe1d-f05a-42d8-8033-5d2d462a324d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:07.719465 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1827/3661] 10.222.0.13 () {54 vars in 1040 bytes} [Fri May 27 15:12:07 2022] GET /compute/v2.1/ => generated 388 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:07.722147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c42abe1d-f05a-42d8-8033-5d2d462a324d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:07.724471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c42abe1d-f05a-42d8-8033-5d2d462a324d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:07.729205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8e10178d-59b2-4997-8dc2-1c8a984bdb68 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:07.730012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8e10178d-59b2-4997-8dc2-1c8a984bdb68 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:07.738090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e10178d-59b2-4997-8dc2-1c8a984bdb68 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:07.738722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e10178d-59b2-4997-8dc2-1c8a984bdb68 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:07.739926 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e10178d-59b2-4997-8dc2-1c8a984bdb68 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:07.740558 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e10178d-59b2-4997-8dc2-1c8a984bdb68 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:07.936124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-c42abe1d-f05a-42d8-8033-5d2d462a324d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:12:08.113875 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c42abe1d-f05a-42d8-8033-5d2d462a324d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.439171 May 27 15:12:08.121978 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1835/3662] 10.222.0.13 () {58 vars in 1211 bytes} [Fri May 27 15:12:07 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:08.134801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-76b8b3c1-b413-4dc1-9d58-a9e822886d96 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:08.135706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-76b8b3c1-b413-4dc1-9d58-a9e822886d96 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:08.152117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-76b8b3c1-b413-4dc1-9d58-a9e822886d96 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:08.154320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-76b8b3c1-b413-4dc1-9d58-a9e822886d96 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:08.155165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-76b8b3c1-b413-4dc1-9d58-a9e822886d96 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:08.156886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-76b8b3c1-b413-4dc1-9d58-a9e822886d96 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:08.251025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8e10178d-59b2-4997-8dc2-1c8a984bdb68 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:08.266323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8e10178d-59b2-4997-8dc2-1c8a984bdb68 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:08.273412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8e10178d-59b2-4997-8dc2-1c8a984bdb68 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:08.277239 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8e10178d-59b2-4997-8dc2-1c8a984bdb68 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1879 microversion: 2.42 time: 0.555540 May 27 15:12:08.281986 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1828/3663] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:07 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1879 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:08.291167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-822b7390-5043-4727-82d6-e0191c4d7927 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:08.292956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-822b7390-5043-4727-82d6-e0191c4d7927 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:08.310978 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-822b7390-5043-4727-82d6-e0191c4d7927 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:08.311616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-822b7390-5043-4727-82d6-e0191c4d7927 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:08.313719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-822b7390-5043-4727-82d6-e0191c4d7927 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:08.318056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-822b7390-5043-4727-82d6-e0191c4d7927 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:08.492254 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-822b7390-5043-4727-82d6-e0191c4d7927 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "POST /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c/action" status: 202 len: 0 microversion: 2.1 time: 0.206792 May 27 15:12:08.497993 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-76b8b3c1-b413-4dc1-9d58-a9e822886d96 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:08.498250 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1829/3664] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:12:08 2022] POST /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:12:08.505231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-91d4e5e9-9405-405a-9059-bdc73f538ad5 req-de8bc1fa-5a8e-4f04-ba34-f1ae06fd0dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b105d0b6-f635-4072-a59b-954702fea503", "name": "network-vif-plugged", "status": "completed", "tag": "fc414d61-a683-49c9-85d5-6f4f499fc6ec"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:08.517736 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-76b8b3c1-b413-4dc1-9d58-a9e822886d96 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:08.518627 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-91d4e5e9-9405-405a-9059-bdc73f538ad5 req-de8bc1fa-5a8e-4f04-ba34-f1ae06fd0dc6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:08.519433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-91d4e5e9-9405-405a-9059-bdc73f538ad5 req-de8bc1fa-5a8e-4f04-ba34-f1ae06fd0dc6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:08.519875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-76b8b3c1-b413-4dc1-9d58-a9e822886d96 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:08.521395 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-76b8b3c1-b413-4dc1-9d58-a9e822886d96 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1730 microversion: 2.20 time: 0.405626 May 27 15:12:08.544234 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-91d4e5e9-9405-405a-9059-bdc73f538ad5 req-de8bc1fa-5a8e-4f04-ba34-f1ae06fd0dc6 service nova] Creating event network-vif-plugged:fc414d61-a683-49c9-85d5-6f4f499fc6ec for instance b105d0b6-f635-4072-a59b-954702fea503 on n-h2-843621-1 May 27 15:12:08.546536 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1836/3665] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:08 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1730 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:08.548557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-76b8b3c1-b413-4dc1-9d58-a9e822886d96 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:08.552878 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-91d4e5e9-9405-405a-9059-bdc73f538ad5 req-de8bc1fa-5a8e-4f04-ba34-f1ae06fd0dc6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052395 May 27 15:12:08.553679 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1830/3666] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:08.556737 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-76b8b3c1-b413-4dc1-9d58-a9e822886d96 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.007064 May 27 15:12:08.558576 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1837/3667] 10.222.0.13 () {56 vars in 885 bytes} [Fri May 27 15:12:08 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 27 15:12:08.561364 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ea6cb0cf-c710-42c4-8f62-a6a89499ce85 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:08.566960 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ea6cb0cf-c710-42c4-8f62-a6a89499ce85 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:08.567812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ea6cb0cf-c710-42c4-8f62-a6a89499ce85 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '5f1274817f784f12ba47ba885010ec42'} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:12:08.569156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d83ce558-8c5e-4d84-8958-40f13f4499d1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:08.570995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d83ce558-8c5e-4d84-8958-40f13f4499d1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:08.575107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea6cb0cf-c710-42c4-8f62-a6a89499ce85 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:08.575571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea6cb0cf-c710-42c4-8f62-a6a89499ce85 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:08.576390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea6cb0cf-c710-42c4-8f62-a6a89499ce85 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:08.577460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea6cb0cf-c710-42c4-8f62-a6a89499ce85 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:08.588513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d83ce558-8c5e-4d84-8958-40f13f4499d1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:08.588996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d83ce558-8c5e-4d84-8958-40f13f4499d1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:08.591772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d83ce558-8c5e-4d84-8958-40f13f4499d1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:08.592256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d83ce558-8c5e-4d84-8958-40f13f4499d1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:08.638173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=9 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:08.693671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d83ce558-8c5e-4d84-8958-40f13f4499d1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:08.698482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:08.706550 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d83ce558-8c5e-4d84-8958-40f13f4499d1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1168 microversion: 2.1 time: 0.146619 May 27 15:12:08.707877 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1838/3668] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:08 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1168 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:08.713268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-44dcb470-f255-4eed-8c52-eeb18193c275 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:08.714534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-44dcb470-f255-4eed-8c52-eeb18193c275 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:08.723883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44dcb470-f255-4eed-8c52-eeb18193c275 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:08.724699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44dcb470-f255-4eed-8c52-eeb18193c275 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:08.726076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44dcb470-f255-4eed-8c52-eeb18193c275 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:08.726649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44dcb470-f255-4eed-8c52-eeb18193c275 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:08.748849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.multi_cell_list [None req-ea6cb0cf-c710-42c4-8f62-a6a89499ce85 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119249) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:12:08.844878 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ea6cb0cf-c710-42c4-8f62-a6a89499ce85 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.288923 May 27 15:12:08.851215 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1831/3669] 10.222.0.13 () {58 vars in 1195 bytes} [Fri May 27 15:12:08 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:08.856201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-707847d8-159f-424f-908a-acc5e8fb0a99 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:08.856993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-707847d8-159f-424f-908a-acc5e8fb0a99 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] [instance: b105d0b6-f635-4072-a59b-954702fea503] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:08.862512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:08.864215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-707847d8-159f-424f-908a-acc5e8fb0a99 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:08.864702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-707847d8-159f-424f-908a-acc5e8fb0a99 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:08.865544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-707847d8-159f-424f-908a-acc5e8fb0a99 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:08.865999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-707847d8-159f-424f-908a-acc5e8fb0a99 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:08.915055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-44dcb470-f255-4eed-8c52-eeb18193c275 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:08.953135 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-44dcb470-f255-4eed-8c52-eeb18193c275 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1510 microversion: 2.1 time: 0.243865 May 27 15:12:08.955390 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1839/3670] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:08 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1510 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:08.963884 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6da1271e-dc0b-425d-a802-1335092f1b69 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:08.989933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6da1271e-dc0b-425d-a802-1335092f1b69 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:08.990780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6da1271e-dc0b-425d-a802-1335092f1b69 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Searching by: {'name': '1666467428', 'deleted': False, 'project_id': '5f1274817f784f12ba47ba885010ec42'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:12:09.008822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6da1271e-dc0b-425d-a802-1335092f1b69 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:09.009492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6da1271e-dc0b-425d-a802-1335092f1b69 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:09.012392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6da1271e-dc0b-425d-a802-1335092f1b69 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:09.013205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6da1271e-dc0b-425d-a802-1335092f1b69 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:09.248114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-6da1271e-dc0b-425d-a802-1335092f1b69 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:12:09.363104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-707847d8-159f-424f-908a-acc5e8fb0a99 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5e6e7eb549d8ba5b4bb520da69bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513a8d6d211640118776fb143e6628a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:09.379432 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-707847d8-159f-424f-908a-acc5e8fb0a99 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503" status: 200 len: 1313 microversion: 2.1 time: 0.525087 May 27 15:12:09.381963 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1832/3671] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:08 2022] GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 => generated 1313 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:09.408415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b0f1dbd1-4828-461c-8117-d55cc0acbaeb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:09.415699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b0f1dbd1-4828-461c-8117-d55cc0acbaeb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:09.463583 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6da1271e-dc0b-425d-a802-1335092f1b69 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers?name=1666467428" status: 200 len: 346 microversion: 2.1 time: 0.506635 May 27 15:12:09.463815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b0f1dbd1-4828-461c-8117-d55cc0acbaeb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:09.464170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b0f1dbd1-4828-461c-8117-d55cc0acbaeb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:09.465143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b0f1dbd1-4828-461c-8117-d55cc0acbaeb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:09.465699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b0f1dbd1-4828-461c-8117-d55cc0acbaeb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:09.477736 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1840/3672] 10.222.0.13 () {58 vars in 1155 bytes} [Fri May 27 15:12:08 2022] GET /compute/v2.1/servers?name=1666467428 => generated 346 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:09.493163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f6409ebb-d239-48bc-8fe7-11308c31592d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:09.497525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f6409ebb-d239-48bc-8fe7-11308c31592d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:09.498286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f6409ebb-d239-48bc-8fe7-11308c31592d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '5f1274817f784f12ba47ba885010ec42'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:12:09.517003 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f6409ebb-d239-48bc-8fe7-11308c31592d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:09.517461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f6409ebb-d239-48bc-8fe7-11308c31592d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:09.518672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f6409ebb-d239-48bc-8fe7-11308c31592d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:09.518672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f6409ebb-d239-48bc-8fe7-11308c31592d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:09.722802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-f6409ebb-d239-48bc-8fe7-11308c31592d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:12:09.829227 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f6409ebb-d239-48bc-8fe7-11308c31592d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.349519 May 27 15:12:09.829946 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1841/3673] 10.222.0.13 () {58 vars in 1153 bytes} [Fri May 27 15:12:09 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:09.855081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e75e9cca-34bd-4fc4-89f6-adbae7308e4a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:09.855715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e75e9cca-34bd-4fc4-89f6-adbae7308e4a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:09.863223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e75e9cca-34bd-4fc4-89f6-adbae7308e4a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:09.863695 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e75e9cca-34bd-4fc4-89f6-adbae7308e4a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:09.864479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e75e9cca-34bd-4fc4-89f6-adbae7308e4a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:09.864949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e75e9cca-34bd-4fc4-89f6-adbae7308e4a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:10.795290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b0f1dbd1-4828-461c-8117-d55cc0acbaeb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:10.814433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b0f1dbd1-4828-461c-8117-d55cc0acbaeb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:10.822782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b0f1dbd1-4828-461c-8117-d55cc0acbaeb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:10.824146 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b0f1dbd1-4828-461c-8117-d55cc0acbaeb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1879 microversion: 2.42 time: 1.438946 May 27 15:12:10.842076 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1833/3674] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:09 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1879 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:10.853287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-07976912-8a55-4615-9248-de7ff92837ea tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:10.858266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-07976912-8a55-4615-9248-de7ff92837ea tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:10.880719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07976912-8a55-4615-9248-de7ff92837ea tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:10.883088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07976912-8a55-4615-9248-de7ff92837ea tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:10.884379 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07976912-8a55-4615-9248-de7ff92837ea tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:10.889838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07976912-8a55-4615-9248-de7ff92837ea tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:10.913963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e75e9cca-34bd-4fc4-89f6-adbae7308e4a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:10.928109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e75e9cca-34bd-4fc4-89f6-adbae7308e4a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:10.929598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e75e9cca-34bd-4fc4-89f6-adbae7308e4a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:10.930867 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e75e9cca-34bd-4fc4-89f6-adbae7308e4a tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1730 microversion: 2.20 time: 1.100029 May 27 15:12:10.931625 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1842/3675] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:09 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1730 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:10.956433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4446f5ae-f895-4725-9a65-103b66cb8ddc tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:10.972128 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4446f5ae-f895-4725-9a65-103b66cb8ddc tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:10.972867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4446f5ae-f895-4725-9a65-103b66cb8ddc tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-166646742', 'deleted': False, 'project_id': '5f1274817f784f12ba47ba885010ec42'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:12:10.995724 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4446f5ae-f895-4725-9a65-103b66cb8ddc tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:10.998912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4446f5ae-f895-4725-9a65-103b66cb8ddc tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:10.999592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4446f5ae-f895-4725-9a65-103b66cb8ddc tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:11.000137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4446f5ae-f895-4725-9a65-103b66cb8ddc tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:11.060727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-07976912-8a55-4615-9248-de7ff92837ea tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:11.070637 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-07976912-8a55-4615-9248-de7ff92837ea tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1168 microversion: 2.1 time: 0.237417 May 27 15:12:11.071222 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1834/3676] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:10 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1168 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:11.077423 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7c3f4d47-5df8-4e46-97b0-5c98d3f3f2ce tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:11.078046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7c3f4d47-5df8-4e46-97b0-5c98d3f3f2ce tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:11.087859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7c3f4d47-5df8-4e46-97b0-5c98d3f3f2ce tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:11.088321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7c3f4d47-5df8-4e46-97b0-5c98d3f3f2ce tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:11.090734 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7c3f4d47-5df8-4e46-97b0-5c98d3f3f2ce tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:11.091211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7c3f4d47-5df8-4e46-97b0-5c98d3f3f2ce tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:11.263056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-4446f5ae-f895-4725-9a65-103b66cb8ddc tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:12:11.442383 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4446f5ae-f895-4725-9a65-103b66cb8ddc tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-166646742" status: 200 len: 346 microversion: 2.1 time: 0.509125 May 27 15:12:11.453050 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1843/3677] 10.222.0.13 () {58 vars in 1227 bytes} [Fri May 27 15:12:10 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-166646742 => generated 346 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:11.468083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d9236675-7a52-4d10-919d-4af7dfab3b0e tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:11.469024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d9236675-7a52-4d10-919d-4af7dfab3b0e tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] [instance: b105d0b6-f635-4072-a59b-954702fea503] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:11.530597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d9236675-7a52-4d10-919d-4af7dfab3b0e tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:11.531646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d9236675-7a52-4d10-919d-4af7dfab3b0e tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:11.537755 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d9236675-7a52-4d10-919d-4af7dfab3b0e tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:11.539921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d9236675-7a52-4d10-919d-4af7dfab3b0e tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:11.683621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7c3f4d47-5df8-4e46-97b0-5c98d3f3f2ce tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:11.730271 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7c3f4d47-5df8-4e46-97b0-5c98d3f3f2ce tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1510 microversion: 2.1 time: 0.657535 May 27 15:12:11.732657 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1835/3678] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:11 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1510 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:11.743144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dcbf6416-6d4d-4044-bfc6-d204885e7680 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:11.744337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dcbf6416-6d4d-4044-bfc6-d204885e7680 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:11.757149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dcbf6416-6d4d-4044-bfc6-d204885e7680 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:11.757690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dcbf6416-6d4d-4044-bfc6-d204885e7680 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:11.759223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dcbf6416-6d4d-4044-bfc6-d204885e7680 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:11.760064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dcbf6416-6d4d-4044-bfc6-d204885e7680 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:11.940566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dcbf6416-6d4d-4044-bfc6-d204885e7680 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:12:12.082022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d9236675-7a52-4d10-919d-4af7dfab3b0e tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5e6e7eb549d8ba5b4bb520da69bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513a8d6d211640118776fb143e6628a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:12.094353 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d9236675-7a52-4d10-919d-4af7dfab3b0e tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503" status: 200 len: 1313 microversion: 2.1 time: 0.639476 May 27 15:12:12.095280 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1844/3679] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:11 2022] GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 => generated 1313 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:12.100167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2eaf9844-b479-42c6-8b7e-74a83d41a887 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:12.101461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2eaf9844-b479-42c6-8b7e-74a83d41a887 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:12.108381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2eaf9844-b479-42c6-8b7e-74a83d41a887 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:12.108907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2eaf9844-b479-42c6-8b7e-74a83d41a887 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:12.109686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2eaf9844-b479-42c6-8b7e-74a83d41a887 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:12.110127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2eaf9844-b479-42c6-8b7e-74a83d41a887 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:12.313023 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dcbf6416-6d4d-4044-bfc6-d204885e7680 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 204 len: 0 microversion: 2.1 time: 0.575864 May 27 15:12:12.320301 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1836/3680] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:12:11 2022] DELETE /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:12:12.342039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b9bea20c-d1c8-4900-af94-2817515818ab tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:12.343837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b9bea20c-d1c8-4900-af94-2817515818ab tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:12.371635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9bea20c-d1c8-4900-af94-2817515818ab tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:12.376187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9bea20c-d1c8-4900-af94-2817515818ab tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:12.380102 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9bea20c-d1c8-4900-af94-2817515818ab tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:12.381631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9bea20c-d1c8-4900-af94-2817515818ab tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:12.912432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2eaf9844-b479-42c6-8b7e-74a83d41a887 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:12.934882 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2eaf9844-b479-42c6-8b7e-74a83d41a887 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:12.940819 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2eaf9844-b479-42c6-8b7e-74a83d41a887 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:12.944089 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2eaf9844-b479-42c6-8b7e-74a83d41a887 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1879 microversion: 2.42 time: 0.847222 May 27 15:12:12.953548 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1845/3681] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:12 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1879 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:12.968259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7dbb025b-7745-457b-a2a3-a179dc15ee37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:12.971023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7dbb025b-7745-457b-a2a3-a179dc15ee37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:13.009468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7dbb025b-7745-457b-a2a3-a179dc15ee37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:13.011761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7dbb025b-7745-457b-a2a3-a179dc15ee37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:13.017071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7dbb025b-7745-457b-a2a3-a179dc15ee37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:13.020212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7dbb025b-7745-457b-a2a3-a179dc15ee37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:13.166199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b9bea20c-d1c8-4900-af94-2817515818ab tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:13.185656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b9bea20c-d1c8-4900-af94-2817515818ab tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:13.190400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b9bea20c-d1c8-4900-af94-2817515818ab tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:13.201339 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b9bea20c-d1c8-4900-af94-2817515818ab tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1730 microversion: 2.20 time: 0.877716 May 27 15:12:13.207356 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1837/3682] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:12 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1730 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:13.228961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7069dc97-67db-46d9-8c88-bbbaa2eee375 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:13.233636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7069dc97-67db-46d9-8c88-bbbaa2eee375 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:13.268196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7069dc97-67db-46d9-8c88-bbbaa2eee375 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:13.269966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7069dc97-67db-46d9-8c88-bbbaa2eee375 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:13.270890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7069dc97-67db-46d9-8c88-bbbaa2eee375 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:13.272356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7069dc97-67db-46d9-8c88-bbbaa2eee375 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:13.305220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7dbb025b-7745-457b-a2a3-a179dc15ee37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:13.320039 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7dbb025b-7745-457b-a2a3-a179dc15ee37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1168 microversion: 2.1 time: 0.364438 May 27 15:12:13.326902 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1846/3683] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:12 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1168 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:13.334293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e022d956-fd8f-4688-9af0-a2669b75839f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:13.337335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e022d956-fd8f-4688-9af0-a2669b75839f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:13.355545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e022d956-fd8f-4688-9af0-a2669b75839f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:13.368348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e022d956-fd8f-4688-9af0-a2669b75839f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:13.368348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e022d956-fd8f-4688-9af0-a2669b75839f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:13.368348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e022d956-fd8f-4688-9af0-a2669b75839f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:13.799072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7069dc97-67db-46d9-8c88-bbbaa2eee375 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:13.811939 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7069dc97-67db-46d9-8c88-bbbaa2eee375 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1519 microversion: 2.1 time: 0.602787 May 27 15:12:13.814172 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1838/3684] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:13 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1519 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:13.836397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-10f4273a-59b6-40f5-bf73-9a291dc98fee tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:13.837153 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-10f4273a-59b6-40f5-bf73-9a291dc98fee tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] [instance: b105d0b6-f635-4072-a59b-954702fea503] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:13.853911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10f4273a-59b6-40f5-bf73-9a291dc98fee tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:13.854368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10f4273a-59b6-40f5-bf73-9a291dc98fee tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:13.858471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10f4273a-59b6-40f5-bf73-9a291dc98fee tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:13.858966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10f4273a-59b6-40f5-bf73-9a291dc98fee tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:14.035807 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e022d956-fd8f-4688-9af0-a2669b75839f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:14.055240 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e022d956-fd8f-4688-9af0-a2669b75839f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1510 microversion: 2.1 time: 0.725204 May 27 15:12:14.068633 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1847/3685] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:13 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1510 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:14.089403 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-23fb98cd-1c8e-46fa-80e3-3b3b36365d18 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:14.090418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-23fb98cd-1c8e-46fa-80e3-3b3b36365d18 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:14.121249 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23fb98cd-1c8e-46fa-80e3-3b3b36365d18 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:14.121700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23fb98cd-1c8e-46fa-80e3-3b3b36365d18 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:14.129811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23fb98cd-1c8e-46fa-80e3-3b3b36365d18 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:14.130566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23fb98cd-1c8e-46fa-80e3-3b3b36365d18 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:15.114935 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:15.183014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-23fb98cd-1c8e-46fa-80e3-3b3b36365d18 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:15.198649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-23fb98cd-1c8e-46fa-80e3-3b3b36365d18 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:15.213157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-23fb98cd-1c8e-46fa-80e3-3b3b36365d18 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:15.215840 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-23fb98cd-1c8e-46fa-80e3-3b3b36365d18 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1879 microversion: 2.42 time: 1.144847 May 27 15:12:15.247363 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1848/3686] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:14 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1879 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:15.285292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-361ac9d7-82ee-453e-94e2-e40256ce007c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:15.290168 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-361ac9d7-82ee-453e-94e2-e40256ce007c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:15.311037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-361ac9d7-82ee-453e-94e2-e40256ce007c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:15.311423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-361ac9d7-82ee-453e-94e2-e40256ce007c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:15.329267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-361ac9d7-82ee-453e-94e2-e40256ce007c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:15.330188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-361ac9d7-82ee-453e-94e2-e40256ce007c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:15.623937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:15.699936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-10f4273a-59b6-40f5-bf73-9a291dc98fee tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5e6e7eb549d8ba5b4bb520da69bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513a8d6d211640118776fb143e6628a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:15.714363 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-10f4273a-59b6-40f5-bf73-9a291dc98fee tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503" status: 200 len: 1313 microversion: 2.1 time: 1.897975 May 27 15:12:15.716989 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1839/3687] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:13 2022] GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 => generated 1313 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:15.742790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-68008356-7b9d-4639-8cb9-e863f1d8bb78 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:15.747642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-68008356-7b9d-4639-8cb9-e863f1d8bb78 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:15.763202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68008356-7b9d-4639-8cb9-e863f1d8bb78 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:15.763902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68008356-7b9d-4639-8cb9-e863f1d8bb78 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:15.765201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68008356-7b9d-4639-8cb9-e863f1d8bb78 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:15.766927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-68008356-7b9d-4639-8cb9-e863f1d8bb78 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:15.812473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-361ac9d7-82ee-453e-94e2-e40256ce007c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:15.821766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-361ac9d7-82ee-453e-94e2-e40256ce007c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:15.823362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-361ac9d7-82ee-453e-94e2-e40256ce007c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:15.824561 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-361ac9d7-82ee-453e-94e2-e40256ce007c tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1730 microversion: 2.20 time: 0.575707 May 27 15:12:15.858657 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1849/3688] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:15 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1730 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:15.863815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-68008356-7b9d-4639-8cb9-e863f1d8bb78 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:15.877494 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-68008356-7b9d-4639-8cb9-e863f1d8bb78 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1168 microversion: 2.1 time: 0.159062 May 27 15:12:15.879429 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1840/3689] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:15 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1168 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:15.889700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bf539b7e-1a99-46b7-8b41-dcfd6c6c9f99 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:15.890327 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bf539b7e-1a99-46b7-8b41-dcfd6c6c9f99 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:15.893985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d62963d7-e0cc-4fcb-857e-5048b5ed0e73 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:15.895187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d62963d7-e0cc-4fcb-857e-5048b5ed0e73 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:15.909530 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d62963d7-e0cc-4fcb-857e-5048b5ed0e73 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:15.917405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf539b7e-1a99-46b7-8b41-dcfd6c6c9f99 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:15.920534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf539b7e-1a99-46b7-8b41-dcfd6c6c9f99 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:15.921360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf539b7e-1a99-46b7-8b41-dcfd6c6c9f99 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:15.921813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf539b7e-1a99-46b7-8b41-dcfd6c6c9f99 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:15.940594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d62963d7-e0cc-4fcb-857e-5048b5ed0e73 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:15.942774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d62963d7-e0cc-4fcb-857e-5048b5ed0e73 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:15.943245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d62963d7-e0cc-4fcb-857e-5048b5ed0e73 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:16.328858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d62963d7-e0cc-4fcb-857e-5048b5ed0e73 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:16.339683 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d62963d7-e0cc-4fcb-857e-5048b5ed0e73 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1510 microversion: 2.1 time: 0.458491 May 27 15:12:16.340052 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1841/3690] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:15 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1510 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:16.347041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bf539b7e-1a99-46b7-8b41-dcfd6c6c9f99 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:16.367670 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:16.383321 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bf539b7e-1a99-46b7-8b41-dcfd6c6c9f99 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1519 microversion: 2.1 time: 0.519530 May 27 15:12:16.384163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4baef7b3-371c-437b-a99a-52f8b63273c9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:16.385863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4baef7b3-371c-437b-a99a-52f8b63273c9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:16.386291 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1850/3691] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:15 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1519 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:16.402564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4baef7b3-371c-437b-a99a-52f8b63273c9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:16.403786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4baef7b3-371c-437b-a99a-52f8b63273c9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:16.405473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4baef7b3-371c-437b-a99a-52f8b63273c9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:16.409382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4baef7b3-371c-437b-a99a-52f8b63273c9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:16.701180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4baef7b3-371c-437b-a99a-52f8b63273c9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:16.717082 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4baef7b3-371c-437b-a99a-52f8b63273c9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:16.718596 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4baef7b3-371c-437b-a99a-52f8b63273c9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:16.719796 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4baef7b3-371c-437b-a99a-52f8b63273c9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1879 microversion: 2.42 time: 0.347869 May 27 15:12:16.720359 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1842/3692] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:16 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1879 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:16.735741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-62fe9b35-a171-4056-b20c-e12a24dedf03 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:16.736623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-62fe9b35-a171-4056-b20c-e12a24dedf03 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] [instance: b105d0b6-f635-4072-a59b-954702fea503] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:16.747286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62fe9b35-a171-4056-b20c-e12a24dedf03 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:16.748034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62fe9b35-a171-4056-b20c-e12a24dedf03 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:16.749186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62fe9b35-a171-4056-b20c-e12a24dedf03 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:16.750223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62fe9b35-a171-4056-b20c-e12a24dedf03 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:16.880257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fbdcef00-a201-4433-bc4e-22390ccc949b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:16.881334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fbdcef00-a201-4433-bc4e-22390ccc949b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:16.895460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fbdcef00-a201-4433-bc4e-22390ccc949b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:16.897750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fbdcef00-a201-4433-bc4e-22390ccc949b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:16.901373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fbdcef00-a201-4433-bc4e-22390ccc949b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:16.903576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fbdcef00-a201-4433-bc4e-22390ccc949b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:16.918059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-62fe9b35-a171-4056-b20c-e12a24dedf03 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5e6e7eb549d8ba5b4bb520da69bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513a8d6d211640118776fb143e6628a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:16.927859 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-62fe9b35-a171-4056-b20c-e12a24dedf03 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503" status: 200 len: 1499 microversion: 2.1 time: 0.196024 May 27 15:12:16.929678 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1851/3693] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:16 2022] GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 => generated 1499 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:16.934982 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0001b44c-e24e-4a59-9b2c-c1675e67c08a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:16.935938 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0001b44c-e24e-4a59-9b2c-c1675e67c08a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:16.944655 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0001b44c-e24e-4a59-9b2c-c1675e67c08a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:16.945565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0001b44c-e24e-4a59-9b2c-c1675e67c08a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:16.946760 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0001b44c-e24e-4a59-9b2c-c1675e67c08a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:16.947459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0001b44c-e24e-4a59-9b2c-c1675e67c08a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:17.199805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fbdcef00-a201-4433-bc4e-22390ccc949b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:17.220251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fbdcef00-a201-4433-bc4e-22390ccc949b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:17.223938 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fbdcef00-a201-4433-bc4e-22390ccc949b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:17.226176 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fbdcef00-a201-4433-bc4e-22390ccc949b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1730 microversion: 2.20 time: 0.350100 May 27 15:12:17.228439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0001b44c-e24e-4a59-9b2c-c1675e67c08a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:17.239800 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0001b44c-e24e-4a59-9b2c-c1675e67c08a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1210 microversion: 2.1 time: 0.308370 May 27 15:12:17.240921 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1852/3695] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:16 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1210 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:17.241143 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1843/3695] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:16 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1730 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:12:17.254307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-27663d90-a67c-45a3-9a26-c7624391da74 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:17.272334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.compute.server_groups [None req-27663d90-a67c-45a3-9a26-c7624391da74 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Querying cell 57e0886a-3e0a-4a65-b585-e8d63742d44b(cell1) for 1 instances {{(pid=119248) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 27 15:12:17.273968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27663d90-a67c-45a3-9a26-c7624391da74 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:17.274720 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27663d90-a67c-45a3-9a26-c7624391da74 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:17.295438 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-27663d90-a67c-45a3-9a26-c7624391da74 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/fea0c984-b14e-4758-bb63-73c0df3064e3" status: 200 len: 221 microversion: 2.1 time: 0.053000 May 27 15:12:17.296720 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1853/3696] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 15:12:17 2022] GET /compute/v2.1/os-server-groups/fea0c984-b14e-4758-bb63-73c0df3064e3 => generated 221 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:17.308143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ad74b480-bf6e-494f-8978-f9e8070231d3 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:17.308952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ad74b480-bf6e-494f-8978-f9e8070231d3 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] [instance: b105d0b6-f635-4072-a59b-954702fea503] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:17.323164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad74b480-bf6e-494f-8978-f9e8070231d3 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:17.323673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad74b480-bf6e-494f-8978-f9e8070231d3 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:17.324485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad74b480-bf6e-494f-8978-f9e8070231d3 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:17.333016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad74b480-bf6e-494f-8978-f9e8070231d3 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:17.364011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b0900edb-02e5-49db-91fb-340d8c581ce8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:17.364550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b0900edb-02e5-49db-91fb-340d8c581ce8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:17.374151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b0900edb-02e5-49db-91fb-340d8c581ce8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:17.374607 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b0900edb-02e5-49db-91fb-340d8c581ce8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:17.375391 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b0900edb-02e5-49db-91fb-340d8c581ce8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:17.381168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ad74b480-bf6e-494f-8978-f9e8070231d3 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] [instance: b105d0b6-f635-4072-a59b-954702fea503] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:12:17.382566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b0900edb-02e5-49db-91fb-340d8c581ce8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:17.461203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:17.553147 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ad74b480-bf6e-494f-8978-f9e8070231d3 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503" status: 204 len: 0 microversion: 2.1 time: 0.249246 May 27 15:12:17.556634 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1844/3697] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:12:17 2022] DELETE /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:12:17.564112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-81884fbf-db8c-4c9e-9bc6-192c0a22b301 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:17.564851 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-81884fbf-db8c-4c9e-9bc6-192c0a22b301 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:17.580962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81884fbf-db8c-4c9e-9bc6-192c0a22b301 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:17.583872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81884fbf-db8c-4c9e-9bc6-192c0a22b301 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:17.585691 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81884fbf-db8c-4c9e-9bc6-192c0a22b301 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:17.591495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81884fbf-db8c-4c9e-9bc6-192c0a22b301 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:17.604052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b0900edb-02e5-49db-91fb-340d8c581ce8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:17.613779 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b0900edb-02e5-49db-91fb-340d8c581ce8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1510 microversion: 2.1 time: 0.256428 May 27 15:12:17.615398 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1854/3698] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:17 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1510 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:17.621162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b045510f-3a6e-4a6f-b96c-7a4702d7af77 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:17.622107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b045510f-3a6e-4a6f-b96c-7a4702d7af77 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] [instance: b105d0b6-f635-4072-a59b-954702fea503] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:17.629665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b045510f-3a6e-4a6f-b96c-7a4702d7af77 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:17.630339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b045510f-3a6e-4a6f-b96c-7a4702d7af77 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:17.631304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b045510f-3a6e-4a6f-b96c-7a4702d7af77 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:17.632099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b045510f-3a6e-4a6f-b96c-7a4702d7af77 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:18.469608 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-81884fbf-db8c-4c9e-9bc6-192c0a22b301 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:18.493269 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-81884fbf-db8c-4c9e-9bc6-192c0a22b301 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1519 microversion: 2.1 time: 0.933455 May 27 15:12:18.498335 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1845/3699] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:17 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1519 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:18.507907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b17c9b50-b328-40f2-ad53-39a8f43ed477 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:18.510517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b17c9b50-b328-40f2-ad53-39a8f43ed477 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:18.530356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b17c9b50-b328-40f2-ad53-39a8f43ed477 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:18.532161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b17c9b50-b328-40f2-ad53-39a8f43ed477 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:18.533180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b17c9b50-b328-40f2-ad53-39a8f43ed477 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:18.535324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b17c9b50-b328-40f2-ad53-39a8f43ed477 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:18.644598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b045510f-3a6e-4a6f-b96c-7a4702d7af77 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5e6e7eb549d8ba5b4bb520da69bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513a8d6d211640118776fb143e6628a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:18.657792 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b045510f-3a6e-4a6f-b96c-7a4702d7af77 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503" status: 200 len: 1505 microversion: 2.1 time: 1.041154 May 27 15:12:18.661461 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1855/3700] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:17 2022] GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 => generated 1505 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:18.676333 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-809e6711-de64-43b9-85a5-46b2527bf2bb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:18.677933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-809e6711-de64-43b9-85a5-46b2527bf2bb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:18.693398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-809e6711-de64-43b9-85a5-46b2527bf2bb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:18.695313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-809e6711-de64-43b9-85a5-46b2527bf2bb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:18.698921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:18.699114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-809e6711-de64-43b9-85a5-46b2527bf2bb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:18.699901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-809e6711-de64-43b9-85a5-46b2527bf2bb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:19.114749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b17c9b50-b328-40f2-ad53-39a8f43ed477 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:19.132114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b17c9b50-b328-40f2-ad53-39a8f43ed477 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:19.133898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-809e6711-de64-43b9-85a5-46b2527bf2bb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:19.134417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b17c9b50-b328-40f2-ad53-39a8f43ed477 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:19.136131 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b17c9b50-b328-40f2-ad53-39a8f43ed477 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1879 microversion: 2.42 time: 0.635985 May 27 15:12:19.136912 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1846/3701] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:18 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1879 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:19.150070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-809e6711-de64-43b9-85a5-46b2527bf2bb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:19.150957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-809e6711-de64-43b9-85a5-46b2527bf2bb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:19.153345 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-809e6711-de64-43b9-85a5-46b2527bf2bb tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1730 microversion: 2.20 time: 0.488751 May 27 15:12:19.164439 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1856/3702] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:18 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1730 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:19.165620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b14a3195-fed5-4a77-abf8-a65ebbddfd55 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:19.166240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b14a3195-fed5-4a77-abf8-a65ebbddfd55 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:19.167862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c3799b27-c6cf-43c3-bcbb-f67cf41956de tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:19.168745 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c3799b27-c6cf-43c3-bcbb-f67cf41956de tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:19.176610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3799b27-c6cf-43c3-bcbb-f67cf41956de tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:19.181237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3799b27-c6cf-43c3-bcbb-f67cf41956de tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:19.182298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3799b27-c6cf-43c3-bcbb-f67cf41956de tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:19.182971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3799b27-c6cf-43c3-bcbb-f67cf41956de tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:19.185222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b14a3195-fed5-4a77-abf8-a65ebbddfd55 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:19.185755 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b14a3195-fed5-4a77-abf8-a65ebbddfd55 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:19.186535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b14a3195-fed5-4a77-abf8-a65ebbddfd55 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:19.186978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b14a3195-fed5-4a77-abf8-a65ebbddfd55 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:19.491301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b14a3195-fed5-4a77-abf8-a65ebbddfd55 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:19.511211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c3799b27-c6cf-43c3-bcbb-f67cf41956de tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:19.512820 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b14a3195-fed5-4a77-abf8-a65ebbddfd55 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1510 microversion: 2.1 time: 0.355205 May 27 15:12:19.514053 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1857/3703] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:19 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1510 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:19.519081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-3d898be7-4dce-4aa6-845d-ce98954fa3c2 req-dc97ac26-95bf-4b2c-80b6-16b4acbfe483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31c16d8-ba5b-4938-944e-f151ec50b1b5", "name": "network-vif-deleted", "tag": "745d0ba9-c0c3-41b4-8de7-3632ae78a3af"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:19.526362 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c3799b27-c6cf-43c3-bcbb-f67cf41956de tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1210 microversion: 2.1 time: 0.374014 May 27 15:12:19.527525 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1847/3704] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:19 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1210 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:19.545785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3d898be7-4dce-4aa6-845d-ce98954fa3c2 req-dc97ac26-95bf-4b2c-80b6-16b4acbfe483 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:19.546627 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3d898be7-4dce-4aa6-845d-ce98954fa3c2 req-dc97ac26-95bf-4b2c-80b6-16b4acbfe483 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:19.570599 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-3d898be7-4dce-4aa6-845d-ce98954fa3c2 req-dc97ac26-95bf-4b2c-80b6-16b4acbfe483 service nova] Creating event network-vif-deleted:745d0ba9-c0c3-41b4-8de7-3632ae78a3af for instance b31c16d8-ba5b-4938-944e-f151ec50b1b5 on n-h1-843621-1 May 27 15:12:19.578591 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-3d898be7-4dce-4aa6-845d-ce98954fa3c2 req-dc97ac26-95bf-4b2c-80b6-16b4acbfe483 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062802 May 27 15:12:19.580079 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1858/3705] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:19.587086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9f22b5cb-01f6-4b00-8ec6-ed6c0df60f01 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:19.588072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9f22b5cb-01f6-4b00-8ec6-ed6c0df60f01 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:19.599703 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f22b5cb-01f6-4b00-8ec6-ed6c0df60f01 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:19.603191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f22b5cb-01f6-4b00-8ec6-ed6c0df60f01 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:19.605472 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f22b5cb-01f6-4b00-8ec6-ed6c0df60f01 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:19.610535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f22b5cb-01f6-4b00-8ec6-ed6c0df60f01 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:19.686503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3829feca-b3b1-4d33-a937-204b5c37d2c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Action: 'create', calling method: .version_select at 0x7fc7806ca430>, body: {"keypair": {"name": "tempest-keypair-347502631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdSnN9uDfQNWHdYIsSTitO9J5aA+mfHfHufttZ6Z88TJpq1VoLaiBgnReULCOzDbs4WM/LvxIAEkynAfEDIFgHfsRCc0RU0veA8Ca1K4ELlw+FLa0NnsDEXFfcZGtnIIg=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:19.712261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-3829feca-b3b1-4d33-a937-204b5c37d2c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Getting quotas for project b5f46e715eda47c19c4df5eda3091eab. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:12:19.722830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-3829feca-b3b1-4d33-a937-204b5c37d2c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Getting quotas for user c4d5eff0d83a4108b853931be9d170d1 and project b5f46e715eda47c19c4df5eda3091eab. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:12:19.723076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9f22b5cb-01f6-4b00-8ec6-ed6c0df60f01 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:19.734976 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9f22b5cb-01f6-4b00-8ec6-ed6c0df60f01 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 200 len: 1477 microversion: 2.1 time: 0.153097 May 27 15:12:19.735590 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1859/3706] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:19 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 1477 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:19.751218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee595f0c-54b7-494b-8afc-fdf8b0432c01 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:19.752047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ee595f0c-54b7-494b-8afc-fdf8b0432c01 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] [instance: b105d0b6-f635-4072-a59b-954702fea503] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:19.759057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee595f0c-54b7-494b-8afc-fdf8b0432c01 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:19.759742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee595f0c-54b7-494b-8afc-fdf8b0432c01 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:19.760704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee595f0c-54b7-494b-8afc-fdf8b0432c01 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:19.761302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee595f0c-54b7-494b-8afc-fdf8b0432c01 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:19.778836 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3829feca-b3b1-4d33-a937-204b5c37d2c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.249957 May 27 15:12:19.782536 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1848/3707] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:12:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:20.081836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ee595f0c-54b7-494b-8afc-fdf8b0432c01 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5e6e7eb549d8ba5b4bb520da69bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513a8d6d211640118776fb143e6628a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:20.098576 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ee595f0c-54b7-494b-8afc-fdf8b0432c01 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503" status: 200 len: 1505 microversion: 2.1 time: 0.350567 May 27 15:12:20.098576 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1860/3708] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:19 2022] GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:20.156025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0c5c7365-1fff-4d8f-97a0-90b3b5470464 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:20.156941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0c5c7365-1fff-4d8f-97a0-90b3b5470464 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:20.172333 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-04a9d08c-dadf-4353-8468-68db84fe3c78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:20.172942 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-04a9d08c-dadf-4353-8468-68db84fe3c78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:20.188374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c5c7365-1fff-4d8f-97a0-90b3b5470464 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:20.189689 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04a9d08c-dadf-4353-8468-68db84fe3c78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:20.190190 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04a9d08c-dadf-4353-8468-68db84fe3c78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:20.190784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c5c7365-1fff-4d8f-97a0-90b3b5470464 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:20.192470 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c5c7365-1fff-4d8f-97a0-90b3b5470464 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:20.196234 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c5c7365-1fff-4d8f-97a0-90b3b5470464 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:20.196561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04a9d08c-dadf-4353-8468-68db84fe3c78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:20.198740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04a9d08c-dadf-4353-8468-68db84fe3c78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:20.880471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-04a9d08c-dadf-4353-8468-68db84fe3c78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:20.894994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-04a9d08c-dadf-4353-8468-68db84fe3c78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:20.899705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-04a9d08c-dadf-4353-8468-68db84fe3c78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:20.904376 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-04a9d08c-dadf-4353-8468-68db84fe3c78 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1730 microversion: 2.20 time: 0.735680 May 27 15:12:20.906634 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1861/3709] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:20 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1730 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:12:20.919864 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4122948d-fce8-4349-a246-16c933948056 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:20.920800 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4122948d-fce8-4349-a246-16c933948056 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:20.926604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0c5c7365-1fff-4d8f-97a0-90b3b5470464 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:20.938188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4122948d-fce8-4349-a246-16c933948056 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:20.939086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4122948d-fce8-4349-a246-16c933948056 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:20.941406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0c5c7365-1fff-4d8f-97a0-90b3b5470464 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:20.942615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4122948d-fce8-4349-a246-16c933948056 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:20.943353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4122948d-fce8-4349-a246-16c933948056 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:20.947156 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0c5c7365-1fff-4d8f-97a0-90b3b5470464 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:20.956604 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0c5c7365-1fff-4d8f-97a0-90b3b5470464 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1879 microversion: 2.42 time: 0.799080 May 27 15:12:20.957298 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1849/3710] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:20 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1879 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:20.976942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ce4810cd-2b06-424b-9917-bdd6631bcc5d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:20.977858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ce4810cd-2b06-424b-9917-bdd6631bcc5d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:21.000213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ce4810cd-2b06-424b-9917-bdd6631bcc5d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:21.006761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ce4810cd-2b06-424b-9917-bdd6631bcc5d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:21.010001 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ce4810cd-2b06-424b-9917-bdd6631bcc5d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:21.011802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ce4810cd-2b06-424b-9917-bdd6631bcc5d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:21.129784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=12 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:21.597339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4122948d-fce8-4349-a246-16c933948056 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:21.626176 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4122948d-fce8-4349-a246-16c933948056 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1516 microversion: 2.1 time: 0.718088 May 27 15:12:21.662923 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1862/3711] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:20 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1516 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:21.690261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-83b77d14-a098-4a86-b1c8-2fead0c6dffe tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:21.691446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-83b77d14-a098-4a86-b1c8-2fead0c6dffe tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: b31c16d8-ba5b-4938-944e-f151ec50b1b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:21.728605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-83b77d14-a098-4a86-b1c8-2fead0c6dffe tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:21.729358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-83b77d14-a098-4a86-b1c8-2fead0c6dffe tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:21.732459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-83b77d14-a098-4a86-b1c8-2fead0c6dffe tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:21.733170 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-83b77d14-a098-4a86-b1c8-2fead0c6dffe tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:21.762273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ce4810cd-2b06-424b-9917-bdd6631bcc5d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:21.794779 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ce4810cd-2b06-424b-9917-bdd6631bcc5d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1210 microversion: 2.1 time: 0.833053 May 27 15:12:21.797491 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1850/3712] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:20 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1210 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:21.812479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-048cf562-99ea-49c0-ae50-f6ea6ec99dad tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:21.816112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-048cf562-99ea-49c0-ae50-f6ea6ec99dad tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] [instance: b105d0b6-f635-4072-a59b-954702fea503] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:21.834300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-048cf562-99ea-49c0-ae50-f6ea6ec99dad tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:21.835696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-048cf562-99ea-49c0-ae50-f6ea6ec99dad tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:21.837097 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-83b77d14-a098-4a86-b1c8-2fead0c6dffe tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] HTTP exception thrown: Instance b31c16d8-ba5b-4938-944e-f151ec50b1b5 could not be found. May 27 15:12:21.838209 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-048cf562-99ea-49c0-ae50-f6ea6ec99dad tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:21.838994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-048cf562-99ea-49c0-ae50-f6ea6ec99dad tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-83b77d14-a098-4a86-b1c8-2fead0c6dffe tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Request method failure captured: May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 HTTP/1.1 May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOnx_3W4NSSIJfU5WYZQefToF0f8g_ZyV7jzsr9VbhxPYF9TN9B1uaOccfJPhrUam2ztNf5mmp2Ch2sFsFs4rVd4hAFgjj_3MOQZKUykJiGHsrRcprANP9d3BumIz4UaEwuG3ZMiTEajtfRuX40mlrK1zVTz0LBxfjyy4xq8iZ3CcDI May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 5f1274817f784f12ba47ba885010ec42 May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ListServerFiltersTestJSON-471271800 May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5f1274817f784f12ba47ba885010ec42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5f1274817f784f12ba47ba885010ec42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5f1274817f784f12ba47ba885010ec42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5f1274817f784f12ba47ba885010ec42", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ListServerFiltersTestJSON-471271800 May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 5f1274817f784f12ba47ba885010ec42 May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-471271800 May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ListServerFiltersTestJSON-471271800-project May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b158ef703c064e15aa33f3ceaad971a8 May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ListServerFiltersTestJSON-471271800-project May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance b31c16d8-ba5b-4938-944e-f151ec50b1b5 could not be found. May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'b31c16d8-ba5b-4938-944e-f151ec50b1b5'} May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b31c16d8-ba5b-4938-944e-f151ec50b1b5 could not be found. May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b31c16d8-ba5b-4938-944e-f151ec50b1b5 could not be found. May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:21.842195 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:12:21.847974 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:21.847974 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:21.847974 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:21.847974 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:12:21.847974 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:12:21.847974 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b31c16d8-ba5b-4938-944e-f151ec50b1b5 could not be found. May 27 15:12:21.847974 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:12:21.847974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-83b77d14-a098-4a86-b1c8-2fead0c6dffe tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Returning 404 to user: Instance b31c16d8-ba5b-4938-944e-f151ec50b1b5 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:12:21.847974 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-83b77d14-a098-4a86-b1c8-2fead0c6dffe tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5" status: 404 len: 111 microversion: 2.1 time: 0.178885 May 27 15:12:21.853804 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1863/3713] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:21 2022] GET /compute/v2.1/servers/b31c16d8-ba5b-4938-944e-f151ec50b1b5 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:12:21.873587 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-048cf562-99ea-49c0-ae50-f6ea6ec99dad tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] HTTP exception thrown: Instance b105d0b6-f635-4072-a59b-954702fea503 could not be found. May 27 15:12:21.874264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-71479dad-9044-43b3-9063-6434ad229e0a req-3ac15325-ea17-4c1b-8893-80d96e1074c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0315e4-284c-4269-86ea-b5ac6e3b4084", "tag": "06db990f-6e8f-4fb3-b9b9-a0416d4a7cef"}, {"server_uuid": "b105d0b6-f635-4072-a59b-954702fea503", "name": "network-vif-deleted", "tag": "fc414d61-a683-49c9-85d5-6f4f499fc6ec"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-048cf562-99ea-49c0-ae50-f6ea6ec99dad tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Request method failure captured: May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 HTTP/1.1 May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOozSVeuxAk9FFQnGfMJlOfi5W_yEPjevfPLundGlhRtx5FpuBY_7ay-mh9ONBFouQ1JFb3LXQNpMg2vDguV1KmovspsKjlLjECE036dxynzbELSAZHsWOs-gBhB19KUE-OzFFod66wSkkh4l50Bp2JKvvodKmulW4MtilZ_ggMUE1M May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 513a8d6d211640118776fb143e6628a7 May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/513a8d6d211640118776fb143e6628a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/513a8d6d211640118776fb143e6628a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/513a8d6d211640118776fb143e6628a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_513a8d6d211640118776fb143e6628a7", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 513a8d6d211640118776fb143e6628a7 May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerGroupTestJSON-1366507305-project May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: f1fa5e6e7eb549d8ba5b4bb520da69bb May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerGroupTestJSON-1366507305-project May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance b105d0b6-f635-4072-a59b-954702fea503 could not be found. May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'b105d0b6-f635-4072-a59b-954702fea503'} May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b105d0b6-f635-4072-a59b-954702fea503 could not be found. May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b105d0b6-f635-4072-a59b-954702fea503 could not be found. May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:21.877144 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:21.886451 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:21.886451 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:21.886451 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:21.886451 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:12:21.886451 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:12:21.886451 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b105d0b6-f635-4072-a59b-954702fea503 could not be found. May 27 15:12:21.886451 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:21.890390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-048cf562-99ea-49c0-ae50-f6ea6ec99dad tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Returning 404 to user: Instance b105d0b6-f635-4072-a59b-954702fea503 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:12:21.892191 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-048cf562-99ea-49c0-ae50-f6ea6ec99dad tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503" status: 404 len: 111 microversion: 2.1 time: 0.091108 May 27 15:12:21.893367 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1851/3714] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:21 2022] GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:12:21.897621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-71479dad-9044-43b3-9063-6434ad229e0a req-3ac15325-ea17-4c1b-8893-80d96e1074c9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:21.901559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-71479dad-9044-43b3-9063-6434ad229e0a req-3ac15325-ea17-4c1b-8893-80d96e1074c9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:21.904061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-de6c15e3-1351-436e-b23a-f798369d21f2 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:21.904962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-de6c15e3-1351-436e-b23a-f798369d21f2 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:21.922247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de6c15e3-1351-436e-b23a-f798369d21f2 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:21.923086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de6c15e3-1351-436e-b23a-f798369d21f2 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:21.924200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de6c15e3-1351-436e-b23a-f798369d21f2 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:21.924938 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de6c15e3-1351-436e-b23a-f798369d21f2 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:21.930572 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-71479dad-9044-43b3-9063-6434ad229e0a req-3ac15325-ea17-4c1b-8893-80d96e1074c9 service nova] Creating event network-changed:06db990f-6e8f-4fb3-b9b9-a0416d4a7cef for instance 0e0315e4-284c-4269-86ea-b5ac6e3b4084 on n-h1-843621-1 May 27 15:12:21.934689 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-71479dad-9044-43b3-9063-6434ad229e0a req-3ac15325-ea17-4c1b-8893-80d96e1074c9 service nova] Creating event network-vif-deleted:fc414d61-a683-49c9-85d5-6f4f499fc6ec for instance b105d0b6-f635-4072-a59b-954702fea503 on n-h2-843621-1 May 27 15:12:21.955850 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-71479dad-9044-43b3-9063-6434ad229e0a req-3ac15325-ea17-4c1b-8893-80d96e1074c9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.100499 May 27 15:12:21.959914 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1864/3715] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:21.976569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-de6c15e3-1351-436e-b23a-f798369d21f2 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:12:21.981756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2ea66cbe-9bc3-4c74-b275-8800de259510 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:21.995506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:22.043063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.compute.server_groups [None req-2ea66cbe-9bc3-4c74-b275-8800de259510 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Querying cell 57e0886a-3e0a-4a65-b585-e8d63742d44b(cell1) for 1 instances {{(pid=119248) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 27 15:12:22.043886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ea66cbe-9bc3-4c74-b275-8800de259510 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:22.044351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ea66cbe-9bc3-4c74-b275-8800de259510 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:22.090129 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2ea66cbe-9bc3-4c74-b275-8800de259510 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.127519 May 27 15:12:22.090733 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1865/3716] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 15:12:21 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:22.107459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7be0b826-a6d2-409d-a9b3-8740c70b65fa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:22.115786 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7be0b826-a6d2-409d-a9b3-8740c70b65fa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:22.139162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7be0b826-a6d2-409d-a9b3-8740c70b65fa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:22.149754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7be0b826-a6d2-409d-a9b3-8740c70b65fa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:22.150781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7be0b826-a6d2-409d-a9b3-8740c70b65fa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:22.151459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7be0b826-a6d2-409d-a9b3-8740c70b65fa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:22.185990 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-de6c15e3-1351-436e-b23a-f798369d21f2 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9" status: 204 len: 0 microversion: 2.1 time: 0.287051 May 27 15:12:22.188871 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1852/3717] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:12:21 2022] DELETE /compute/v2.1/servers/f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:12:22.206420 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4b5f2961-e612-49b3-b6b4-762171b5e42f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:22.207892 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4b5f2961-e612-49b3-b6b4-762171b5e42f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:22.228532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b5f2961-e612-49b3-b6b4-762171b5e42f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:22.229050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b5f2961-e612-49b3-b6b4-762171b5e42f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:22.237493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b5f2961-e612-49b3-b6b4-762171b5e42f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:22.238928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b5f2961-e612-49b3-b6b4-762171b5e42f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:22.940528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7be0b826-a6d2-409d-a9b3-8740c70b65fa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:22.950277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7be0b826-a6d2-409d-a9b3-8740c70b65fa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:22.960801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7be0b826-a6d2-409d-a9b3-8740c70b65fa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:22.965627 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7be0b826-a6d2-409d-a9b3-8740c70b65fa tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1730 microversion: 2.20 time: 0.867496 May 27 15:12:22.966339 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1866/3718] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:22 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1730 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:22.980182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-527ad8e6-952d-42d1-aba1-ed805279253c tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:23.044380 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.compute.server_groups [None req-527ad8e6-952d-42d1-aba1-ed805279253c tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Querying cell 57e0886a-3e0a-4a65-b585-e8d63742d44b(cell1) for 1 instances {{(pid=119248) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 27 15:12:23.045255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-527ad8e6-952d-42d1-aba1-ed805279253c tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:23.045714 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-527ad8e6-952d-42d1-aba1-ed805279253c tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:23.092502 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-527ad8e6-952d-42d1-aba1-ed805279253c tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/fea0c984-b14e-4758-bb63-73c0df3064e3" status: 200 len: 183 microversion: 2.1 time: 0.125034 May 27 15:12:23.093151 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1867/3719] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 15:12:22 2022] GET /compute/v2.1/os-server-groups/fea0c984-b14e-4758-bb63-73c0df3064e3 => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:23.126911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1db74c6e-7172-458f-8ae0-a87a7036eff6 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:23.127549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1db74c6e-7172-458f-8ae0-a87a7036eff6 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:23.155483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1db74c6e-7172-458f-8ae0-a87a7036eff6 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:23.161812 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1db74c6e-7172-458f-8ae0-a87a7036eff6 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:23.164091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1db74c6e-7172-458f-8ae0-a87a7036eff6 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:23.165030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1db74c6e-7172-458f-8ae0-a87a7036eff6 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:23.261460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4b5f2961-e612-49b3-b6b4-762171b5e42f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:23.273220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4b5f2961-e612-49b3-b6b4-762171b5e42f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:23.278523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4b5f2961-e612-49b3-b6b4-762171b5e42f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:23.282920 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4b5f2961-e612-49b3-b6b4-762171b5e42f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1879 microversion: 2.42 time: 1.092466 May 27 15:12:23.288565 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1853/3720] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:22 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1879 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:23.311603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8c90e159-1ac6-4005-a57e-492a686db5c8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:23.312519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8c90e159-1ac6-4005-a57e-492a686db5c8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:23.325464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c90e159-1ac6-4005-a57e-492a686db5c8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:23.326581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c90e159-1ac6-4005-a57e-492a686db5c8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:23.327924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c90e159-1ac6-4005-a57e-492a686db5c8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:23.328619 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c90e159-1ac6-4005-a57e-492a686db5c8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:23.922123 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1db74c6e-7172-458f-8ae0-a87a7036eff6 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:23.931765 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1db74c6e-7172-458f-8ae0-a87a7036eff6 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9" status: 200 len: 1519 microversion: 2.1 time: 0.825546 May 27 15:12:23.936296 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1868/3721] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:23 2022] GET /compute/v2.1/servers/f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9 => generated 1519 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:23.954347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-808c0850-907e-48d0-967c-d509891fe0ed tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:23.956537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-808c0850-907e-48d0-967c-d509891fe0ed tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] [instance: b105d0b6-f635-4072-a59b-954702fea503] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:23.985668 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-808c0850-907e-48d0-967c-d509891fe0ed tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:23.997588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-808c0850-907e-48d0-967c-d509891fe0ed tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:24.004944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-808c0850-907e-48d0-967c-d509891fe0ed tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:24.005626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-808c0850-907e-48d0-967c-d509891fe0ed tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:24.039982 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8c90e159-1ac6-4005-a57e-492a686db5c8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:24.051343 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8c90e159-1ac6-4005-a57e-492a686db5c8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1210 microversion: 2.1 time: 0.757442 May 27 15:12:24.057316 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1854/3722] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:23 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1210 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:24.059753 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-808c0850-907e-48d0-967c-d509891fe0ed tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] HTTP exception thrown: Instance b105d0b6-f635-4072-a59b-954702fea503 could not be found. May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-808c0850-907e-48d0-967c-d509891fe0ed tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Request method failure captured: May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 HTTP/1.1 May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOozSVeuxAk9FFQnGfMJlOfi5W_yEPjevfPLundGlhRtx5FpuBY_7ay-mh9ONBFouQ1JFb3LXQNpMg2vDguV1KmovspsKjlLjECE036dxynzbELSAZHsWOs-gBhB19KUE-OzFFod66wSkkh4l50Bp2JKvvodKmulW4MtilZ_ggMUE1M May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 513a8d6d211640118776fb143e6628a7 May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/513a8d6d211640118776fb143e6628a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/513a8d6d211640118776fb143e6628a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/513a8d6d211640118776fb143e6628a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_513a8d6d211640118776fb143e6628a7", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 513a8d6d211640118776fb143e6628a7 May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerGroupTestJSON-1366507305-project May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: f1fa5e6e7eb549d8ba5b4bb520da69bb May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerGroupTestJSON-1366507305-project May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance b105d0b6-f635-4072-a59b-954702fea503 could not be found. May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'b105d0b6-f635-4072-a59b-954702fea503'} May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b105d0b6-f635-4072-a59b-954702fea503 could not be found. May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:12:24.062391 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:12:24.067575 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b105d0b6-f635-4072-a59b-954702fea503 could not be found. May 27 15:12:24.067575 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:12:24.067575 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:24.067575 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:12:24.067575 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:24.067575 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:24.067575 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:24.067575 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:12:24.067575 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:12:24.067575 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b105d0b6-f635-4072-a59b-954702fea503 could not be found. May 27 15:12:24.067575 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:12:24.072438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-808c0850-907e-48d0-967c-d509891fe0ed tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Returning 404 to user: Instance b105d0b6-f635-4072-a59b-954702fea503 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:12:24.079994 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-808c0850-907e-48d0-967c-d509891fe0ed tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503" status: 404 len: 111 microversion: 2.1 time: 0.141123 May 27 15:12:24.081539 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1869/3723] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:12:23 2022] DELETE /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:12:24.087218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0de7f808-669e-4b2e-acd6-e71ea2cd7b69 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:24.088135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-d272f09c-86ab-4792-827b-2823dfaa507a req-48353d30-e809-4fae-b0c2-a60867880ecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "name": "network-vif-plugged", "status": "completed", "tag": "100b1a63-83ab-408e-adb6-ce5865974f8f"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:24.098336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0de7f808-669e-4b2e-acd6-e71ea2cd7b69 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:24.112387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d272f09c-86ab-4792-827b-2823dfaa507a req-48353d30-e809-4fae-b0c2-a60867880ecc service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:24.118376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d272f09c-86ab-4792-827b-2823dfaa507a req-48353d30-e809-4fae-b0c2-a60867880ecc service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:24.123517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0de7f808-669e-4b2e-acd6-e71ea2cd7b69 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:24.125797 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0de7f808-669e-4b2e-acd6-e71ea2cd7b69 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:24.129418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0de7f808-669e-4b2e-acd6-e71ea2cd7b69 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:24.132830 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0de7f808-669e-4b2e-acd6-e71ea2cd7b69 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:24.169154 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-d272f09c-86ab-4792-827b-2823dfaa507a req-48353d30-e809-4fae-b0c2-a60867880ecc service nova] Creating event network-vif-plugged:100b1a63-83ab-408e-adb6-ce5865974f8f for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:12:24.182197 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-d272f09c-86ab-4792-827b-2823dfaa507a req-48353d30-e809-4fae-b0c2-a60867880ecc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122312 May 27 15:12:24.188799 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1855/3724] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:24.209632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-87466c6b-d8e4-45c2-aad0-9e1931492a7c tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:24.213927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-87466c6b-d8e4-45c2-aad0-9e1931492a7c tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] [instance: b105d0b6-f635-4072-a59b-954702fea503] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:24.254053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87466c6b-d8e4-45c2-aad0-9e1931492a7c tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:24.256369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87466c6b-d8e4-45c2-aad0-9e1931492a7c tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:24.259899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87466c6b-d8e4-45c2-aad0-9e1931492a7c tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:24.261488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87466c6b-d8e4-45c2-aad0-9e1931492a7c tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:24.301038 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-87466c6b-d8e4-45c2-aad0-9e1931492a7c tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] HTTP exception thrown: Instance b105d0b6-f635-4072-a59b-954702fea503 could not be found. May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-87466c6b-d8e4-45c2-aad0-9e1931492a7c tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Request method failure captured: May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 HTTP/1.1 May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOozSVeuxAk9FFQnGfMJlOfi5W_yEPjevfPLundGlhRtx5FpuBY_7ay-mh9ONBFouQ1JFb3LXQNpMg2vDguV1KmovspsKjlLjECE036dxynzbELSAZHsWOs-gBhB19KUE-OzFFod66wSkkh4l50Bp2JKvvodKmulW4MtilZ_ggMUE1M May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 513a8d6d211640118776fb143e6628a7 May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/513a8d6d211640118776fb143e6628a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/513a8d6d211640118776fb143e6628a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/513a8d6d211640118776fb143e6628a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_513a8d6d211640118776fb143e6628a7", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 513a8d6d211640118776fb143e6628a7 May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerGroupTestJSON-1366507305-project May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: f1fa5e6e7eb549d8ba5b4bb520da69bb May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerGroupTestJSON-1366507305-project May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance b105d0b6-f635-4072-a59b-954702fea503 could not be found. May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'b105d0b6-f635-4072-a59b-954702fea503'} May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b105d0b6-f635-4072-a59b-954702fea503 could not be found. May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b105d0b6-f635-4072-a59b-954702fea503 could not be found. May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:24.304514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:24.309457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:24.309457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:24.309457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:24.309457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:12:24.309457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:12:24.309457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b105d0b6-f635-4072-a59b-954702fea503 could not be found. May 27 15:12:24.309457 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:24.310186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-87466c6b-d8e4-45c2-aad0-9e1931492a7c tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Returning 404 to user: Instance b105d0b6-f635-4072-a59b-954702fea503 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:12:24.313052 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-87466c6b-d8e4-45c2-aad0-9e1931492a7c tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503" status: 404 len: 111 microversion: 2.1 time: 0.122765 May 27 15:12:24.315268 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1856/3725] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:24 2022] GET /compute/v2.1/servers/b105d0b6-f635-4072-a59b-954702fea503 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:12:24.326146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-045c91fa-b5a9-4f66-863e-7a1aa565ccd0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:24.328968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-045c91fa-b5a9-4f66-863e-7a1aa565ccd0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:24.346074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-045c91fa-b5a9-4f66-863e-7a1aa565ccd0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:24.349090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-045c91fa-b5a9-4f66-863e-7a1aa565ccd0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:24.350196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-045c91fa-b5a9-4f66-863e-7a1aa565ccd0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:24.351442 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-045c91fa-b5a9-4f66-863e-7a1aa565ccd0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:25.071111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0de7f808-669e-4b2e-acd6-e71ea2cd7b69 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:25.080471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0de7f808-669e-4b2e-acd6-e71ea2cd7b69 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:25.089460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0de7f808-669e-4b2e-acd6-e71ea2cd7b69 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:25.102181 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0de7f808-669e-4b2e-acd6-e71ea2cd7b69 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1730 microversion: 2.20 time: 1.018670 May 27 15:12:25.105799 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1870/3726] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:24 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1730 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:25.117888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-45119db2-39a6-406a-8162-2c5351403b68 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:25.135585 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-45119db2-39a6-406a-8162-2c5351403b68 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] HTTP exception thrown: Instance group fd11a295-4117-4d39-a42f-c136820bece8 could not be found. May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-45119db2-39a6-406a-8162-2c5351403b68 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Request method failure captured: May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/os-server-groups/fd11a295-4117-4d39-a42f-c136820bece8 HTTP/1.1 May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOozSVeuxAk9FFQnGfMJlOfi5W_yEPjevfPLundGlhRtx5FpuBY_7ay-mh9ONBFouQ1JFb3LXQNpMg2vDguV1KmovspsKjlLjECE036dxynzbELSAZHsWOs-gBhB19KUE-OzFFod66wSkkh4l50Bp2JKvvodKmulW4MtilZ_ggMUE1M May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 513a8d6d211640118776fb143e6628a7 May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/513a8d6d211640118776fb143e6628a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/513a8d6d211640118776fb143e6628a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/513a8d6d211640118776fb143e6628a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_513a8d6d211640118776fb143e6628a7", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 513a8d6d211640118776fb143e6628a7 May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerGroupTestJSON-1366507305-project May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: f1fa5e6e7eb549d8ba5b4bb520da69bb May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerGroupTestJSON-1366507305-project May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance group fd11a295-4117-4d39-a42f-c136820bece8 could not be found. May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'fd11a295-4117-4d39-a42f-c136820bece8'} May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fd11a295-4117-4d39-a42f-c136820bece8 could not be found. May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fd11a295-4117-4d39-a42f-c136820bece8 could not be found. May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:12:25.159779 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:25.163678 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:25.163678 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:25.163678 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:12:25.163678 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:12:25.163678 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fd11a295-4117-4d39-a42f-c136820bece8 could not be found. May 27 15:12:25.163678 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:12:25.167280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-45119db2-39a6-406a-8162-2c5351403b68 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Returning 404 to user: Instance group fd11a295-4117-4d39-a42f-c136820bece8 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:12:25.168512 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-45119db2-39a6-406a-8162-2c5351403b68 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/fd11a295-4117-4d39-a42f-c136820bece8" status: 404 len: 117 microversion: 2.1 time: 0.058560 May 27 15:12:25.169427 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1871/3727] 10.222.0.13 () {58 vars in 1265 bytes} [Fri May 27 15:12:25 2022] DELETE /compute/v2.1/os-server-groups/fd11a295-4117-4d39-a42f-c136820bece8 => generated 117 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:12:25.174521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-24038a4e-435c-4003-86dd-789d57701c3d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:25.177537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-24038a4e-435c-4003-86dd-789d57701c3d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:25.195845 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24038a4e-435c-4003-86dd-789d57701c3d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:25.196633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24038a4e-435c-4003-86dd-789d57701c3d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:25.197778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24038a4e-435c-4003-86dd-789d57701c3d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:25.198565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24038a4e-435c-4003-86dd-789d57701c3d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:25.273399 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24038a4e-435c-4003-86dd-789d57701c3d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:25.274112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24038a4e-435c-4003-86dd-789d57701c3d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:25.274891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-24038a4e-435c-4003-86dd-789d57701c3d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lazy-loading 'fault' on Instance uuid f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:12:25.282994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:25.329691 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-045c91fa-b5a9-4f66-863e-7a1aa565ccd0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:25.346232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-045c91fa-b5a9-4f66-863e-7a1aa565ccd0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:25.348056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-045c91fa-b5a9-4f66-863e-7a1aa565ccd0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:25.355284 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-045c91fa-b5a9-4f66-863e-7a1aa565ccd0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1879 microversion: 2.42 time: 1.038723 May 27 15:12:25.374316 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1857/3728] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:24 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1879 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:25.379365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-9fbc04a5-8a5d-4bcc-abae-776bc8d03793 req-28b393e2-9583-4d5d-b6df-7399b1fe3fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9", "name": "network-vif-deleted", "tag": "060a8f37-46b9-487a-83a1-ccabf5cd0958"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:25.421460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-9fbc04a5-8a5d-4bcc-abae-776bc8d03793 req-28b393e2-9583-4d5d-b6df-7399b1fe3fb4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:25.425489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-9fbc04a5-8a5d-4bcc-abae-776bc8d03793 req-28b393e2-9583-4d5d-b6df-7399b1fe3fb4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:25.449623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-24038a4e-435c-4003-86dd-789d57701c3d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:25.458230 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-24038a4e-435c-4003-86dd-789d57701c3d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9" status: 200 len: 1311 microversion: 2.1 time: 0.287553 May 27 15:12:25.465139 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1872/3729] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:25 2022] GET /compute/v2.1/servers/f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9 => generated 1311 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:25.470196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0c0dc030-420a-4c6f-924d-ebe51f9b45ab tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:25.470823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0c0dc030-420a-4c6f-924d-ebe51f9b45ab tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:25.478220 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-9fbc04a5-8a5d-4bcc-abae-776bc8d03793 req-28b393e2-9583-4d5d-b6df-7399b1fe3fb4 service nova] Creating event network-vif-deleted:060a8f37-46b9-487a-83a1-ccabf5cd0958 for instance f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9 on n-h2-843621-1 May 27 15:12:25.490901 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-9fbc04a5-8a5d-4bcc-abae-776bc8d03793 req-28b393e2-9583-4d5d-b6df-7399b1fe3fb4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114790 May 27 15:12:25.492617 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1858/3730] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:25.506246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d6187b40-8961-4406-b6e2-973fbe9af625 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:25.516758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c0dc030-420a-4c6f-924d-ebe51f9b45ab tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:25.518188 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-d6187b40-8961-4406-b6e2-973fbe9af625 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] HTTP exception thrown: Instance group b842ca54-41a5-43e2-9c1e-08e5dafe5eb4 could not be found. May 27 15:12:25.518598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c0dc030-420a-4c6f-924d-ebe51f9b45ab tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:25.519445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c0dc030-420a-4c6f-924d-ebe51f9b45ab tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d6187b40-8961-4406-b6e2-973fbe9af625 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Request method failure captured: May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/os-server-groups/b842ca54-41a5-43e2-9c1e-08e5dafe5eb4 HTTP/1.1 May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOozSVeuxAk9FFQnGfMJlOfi5W_yEPjevfPLundGlhRtx5FpuBY_7ay-mh9ONBFouQ1JFb3LXQNpMg2vDguV1KmovspsKjlLjECE036dxynzbELSAZHsWOs-gBhB19KUE-OzFFod66wSkkh4l50Bp2JKvvodKmulW4MtilZ_ggMUE1M May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 513a8d6d211640118776fb143e6628a7 May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/513a8d6d211640118776fb143e6628a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/513a8d6d211640118776fb143e6628a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/513a8d6d211640118776fb143e6628a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_513a8d6d211640118776fb143e6628a7", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 513a8d6d211640118776fb143e6628a7 May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerGroupTestJSON-1366507305-project May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: f1fa5e6e7eb549d8ba5b4bb520da69bb May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerGroupTestJSON-1366507305-project May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance group b842ca54-41a5-43e2-9c1e-08e5dafe5eb4 could not be found. May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'b842ca54-41a5-43e2-9c1e-08e5dafe5eb4'} May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b842ca54-41a5-43e2-9c1e-08e5dafe5eb4 could not be found. May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b842ca54-41a5-43e2-9c1e-08e5dafe5eb4 could not be found. May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:25.521178 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:25.525653 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:25.525653 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:25.525653 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:12:25.525653 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:12:25.525653 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b842ca54-41a5-43e2-9c1e-08e5dafe5eb4 could not be found. May 27 15:12:25.525653 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:25.526063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c0dc030-420a-4c6f-924d-ebe51f9b45ab tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:25.526905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d6187b40-8961-4406-b6e2-973fbe9af625 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Returning 404 to user: Instance group b842ca54-41a5-43e2-9c1e-08e5dafe5eb4 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:12:25.528071 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d6187b40-8961-4406-b6e2-973fbe9af625 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/b842ca54-41a5-43e2-9c1e-08e5dafe5eb4" status: 404 len: 117 microversion: 2.1 time: 0.034071 May 27 15:12:25.528930 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1859/3731] 10.222.0.13 () {58 vars in 1265 bytes} [Fri May 27 15:12:25 2022] DELETE /compute/v2.1/os-server-groups/b842ca54-41a5-43e2-9c1e-08e5dafe5eb4 => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:12:25.537829 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-73fab098-5860-4ec2-8708-58f15909d259 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:25.548850 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-73fab098-5860-4ec2-8708-58f15909d259 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] HTTP exception thrown: Instance group 9a3f7cd9-cc7a-4c5d-820e-0c1002eb4798 could not be found. May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-73fab098-5860-4ec2-8708-58f15909d259 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Request method failure captured: May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/os-server-groups/9a3f7cd9-cc7a-4c5d-820e-0c1002eb4798 HTTP/1.1 May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOozSVeuxAk9FFQnGfMJlOfi5W_yEPjevfPLundGlhRtx5FpuBY_7ay-mh9ONBFouQ1JFb3LXQNpMg2vDguV1KmovspsKjlLjECE036dxynzbELSAZHsWOs-gBhB19KUE-OzFFod66wSkkh4l50Bp2JKvvodKmulW4MtilZ_ggMUE1M May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 513a8d6d211640118776fb143e6628a7 May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/513a8d6d211640118776fb143e6628a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/513a8d6d211640118776fb143e6628a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/513a8d6d211640118776fb143e6628a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_513a8d6d211640118776fb143e6628a7", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 513a8d6d211640118776fb143e6628a7 May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerGroupTestJSON-1366507305-project May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: f1fa5e6e7eb549d8ba5b4bb520da69bb May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerGroupTestJSON-1366507305-project May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance group 9a3f7cd9-cc7a-4c5d-820e-0c1002eb4798 could not be found. May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '9a3f7cd9-cc7a-4c5d-820e-0c1002eb4798'} May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9a3f7cd9-cc7a-4c5d-820e-0c1002eb4798 could not be found. May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9a3f7cd9-cc7a-4c5d-820e-0c1002eb4798 could not be found. May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:25.551020 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:25.557067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:25.557067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:25.557067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:12:25.557067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:12:25.557067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9a3f7cd9-cc7a-4c5d-820e-0c1002eb4798 could not be found. May 27 15:12:25.557067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:25.558551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-73fab098-5860-4ec2-8708-58f15909d259 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Returning 404 to user: Instance group 9a3f7cd9-cc7a-4c5d-820e-0c1002eb4798 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:12:25.559593 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-73fab098-5860-4ec2-8708-58f15909d259 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/9a3f7cd9-cc7a-4c5d-820e-0c1002eb4798" status: 404 len: 117 microversion: 2.1 time: 0.026333 May 27 15:12:25.563084 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1860/3732] 10.222.0.13 () {58 vars in 1265 bytes} [Fri May 27 15:12:25 2022] DELETE /compute/v2.1/os-server-groups/9a3f7cd9-cc7a-4c5d-820e-0c1002eb4798 => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:12:25.577947 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e8e831c9-6164-4f56-a3d7-e4abba891a55 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:25.598314 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-e8e831c9-6164-4f56-a3d7-e4abba891a55 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] HTTP exception thrown: Instance group 2f587961-f898-40bc-934f-b1c70b54565c could not be found. May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e8e831c9-6164-4f56-a3d7-e4abba891a55 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Request method failure captured: May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/os-server-groups/2f587961-f898-40bc-934f-b1c70b54565c HTTP/1.1 May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOozSVeuxAk9FFQnGfMJlOfi5W_yEPjevfPLundGlhRtx5FpuBY_7ay-mh9ONBFouQ1JFb3LXQNpMg2vDguV1KmovspsKjlLjECE036dxynzbELSAZHsWOs-gBhB19KUE-OzFFod66wSkkh4l50Bp2JKvvodKmulW4MtilZ_ggMUE1M May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 513a8d6d211640118776fb143e6628a7 May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/513a8d6d211640118776fb143e6628a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/513a8d6d211640118776fb143e6628a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/513a8d6d211640118776fb143e6628a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_513a8d6d211640118776fb143e6628a7", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 513a8d6d211640118776fb143e6628a7 May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerGroupTestJSON-1366507305 May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerGroupTestJSON-1366507305-project May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: f1fa5e6e7eb549d8ba5b4bb520da69bb May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerGroupTestJSON-1366507305-project May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance group 2f587961-f898-40bc-934f-b1c70b54565c could not be found. May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '2f587961-f898-40bc-934f-b1c70b54565c'} May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2f587961-f898-40bc-934f-b1c70b54565c could not be found. May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2f587961-f898-40bc-934f-b1c70b54565c could not be found. May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:25.599825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:25.604458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:25.604458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:25.604458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:12:25.604458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:12:25.604458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2f587961-f898-40bc-934f-b1c70b54565c could not be found. May 27 15:12:25.604458 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:25.604458 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e8e831c9-6164-4f56-a3d7-e4abba891a55 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Returning 404 to user: Instance group 2f587961-f898-40bc-934f-b1c70b54565c could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:12:25.604458 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e8e831c9-6164-4f56-a3d7-e4abba891a55 tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/2f587961-f898-40bc-934f-b1c70b54565c" status: 404 len: 117 microversion: 2.1 time: 0.039029 May 27 15:12:25.609033 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1861/3733] 10.222.0.13 () {58 vars in 1265 bytes} [Fri May 27 15:12:25 2022] DELETE /compute/v2.1/os-server-groups/2f587961-f898-40bc-934f-b1c70b54565c => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:12:25.625915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1bb19b18-c6c6-4ad7-b4ad-bef03466faad tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:25.706297 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1bb19b18-c6c6-4ad7-b4ad-bef03466faad tempest-ServerGroupTestJSON-1366507305 tempest-ServerGroupTestJSON-1366507305-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/fea0c984-b14e-4758-bb63-73c0df3064e3" status: 204 len: 0 microversion: 2.1 time: 0.096077 May 27 15:12:25.706904 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1862/3734] 10.222.0.13 () {58 vars in 1265 bytes} [Fri May 27 15:12:25 2022] DELETE /compute/v2.1/os-server-groups/fea0c984-b14e-4758-bb63-73c0df3064e3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:12:25.932614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7c22b55b-4d26-4581-beb5-3ac9fcbaac24 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Action: 'create', calling method: .version_select at 0x7fc7806cab80>, body: {"keypair": {"name": "tempest-keypair-1014226516", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMV5IZGx0GxSC6eJzCteJXRoXxkX2cS+RCI8qaZpZaWi4iTj/lybJZ2ZZFPq0nxvqMoz9/zqdW9/Tiq9wxseDrojCtMdSo572WUXUO0IkDX18PVgrvhTAQWsf9xVMrCpoQ=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:25.965434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-7c22b55b-4d26-4581-beb5-3ac9fcbaac24 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Getting quotas for project 1f6efd5b16e5450d9eb9b454d05a775a. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:12:25.967946 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:25.984908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-7c22b55b-4d26-4581-beb5-3ac9fcbaac24 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Getting quotas for user 645379b3a21548d8a4f4d6425b61319f and project 1f6efd5b16e5450d9eb9b454d05a775a. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:12:26.043336 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7c22b55b-4d26-4581-beb5-3ac9fcbaac24 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.115113 May 27 15:12:26.044526 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1863/3735] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:12:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:26.124117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e97390b1-c429-4ffe-af7e-de870d6be7d7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:26.125148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e97390b1-c429-4ffe-af7e-de870d6be7d7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:26.135206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0c0dc030-420a-4c6f-924d-ebe51f9b45ab tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:26.144069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e97390b1-c429-4ffe-af7e-de870d6be7d7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:26.150775 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0c0dc030-420a-4c6f-924d-ebe51f9b45ab tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1210 microversion: 2.1 time: 0.684392 May 27 15:12:26.151764 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1873/3736] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:25 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1210 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:26.164450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e97390b1-c429-4ffe-af7e-de870d6be7d7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:26.165752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e97390b1-c429-4ffe-af7e-de870d6be7d7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:26.166737 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e97390b1-c429-4ffe-af7e-de870d6be7d7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:26.250984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a89a96ff-5575-47ca-870e-cd5a95a0b1c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-749423634", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "0bc9374f-60b1-4209-bbdf-f1e39c23a303"}], "security_groups": [{"name": "tempest-securitygroup--1861832176"}], "key_name": "tempest-keypair-347502631", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:26.678863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-a89a96ff-5575-47ca-870e-cd5a95a0b1c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] validate_networks() for [('0bc9374f-60b1-4209-bbdf-f1e39c23a303', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:12:26.687504 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e97390b1-c429-4ffe-af7e-de870d6be7d7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:26.711690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e97390b1-c429-4ffe-af7e-de870d6be7d7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:26.720495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e97390b1-c429-4ffe-af7e-de870d6be7d7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:26.728235 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e97390b1-c429-4ffe-af7e-de870d6be7d7 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1730 microversion: 2.20 time: 0.608366 May 27 15:12:26.729350 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1864/3737] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:26 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1730 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:12:26.764517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-2a287a83-097e-4011-a4e6-6ad9ae543ed0 req-3ec55af0-c4ab-4bb2-bfb2-ade4a80096fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "name": "network-vif-plugged", "status": "completed", "tag": "4fae3a94-8715-4a88-a516-e2014c141251"}, {"server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "name": "network-vif-plugged", "status": "completed", "tag": "f670de18-c094-413a-a6ff-240c82cf0d14"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:26.798046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2a287a83-097e-4011-a4e6-6ad9ae543ed0 req-3ec55af0-c4ab-4bb2-bfb2-ade4a80096fb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:26.798514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2a287a83-097e-4011-a4e6-6ad9ae543ed0 req-3ec55af0-c4ab-4bb2-bfb2-ade4a80096fb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:26.854238 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-2a287a83-097e-4011-a4e6-6ad9ae543ed0 req-3ec55af0-c4ab-4bb2-bfb2-ade4a80096fb service nova] Creating event network-vif-plugged:4fae3a94-8715-4a88-a516-e2014c141251 for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:12:26.856649 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-2a287a83-097e-4011-a4e6-6ad9ae543ed0 req-3ec55af0-c4ab-4bb2-bfb2-ade4a80096fb service nova] Creating event network-vif-plugged:f670de18-c094-413a-a6ff-240c82cf0d14 for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:12:26.877413 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-2a287a83-097e-4011-a4e6-6ad9ae543ed0 req-3ec55af0-c4ab-4bb2-bfb2-ade4a80096fb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.122699 May 27 15:12:26.878310 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1865/3738] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:26.903550 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-14a2f0ec-3253-4f9e-b237-978f4e896c14 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:26.906490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-14a2f0ec-3253-4f9e-b237-978f4e896c14 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:26.922026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14a2f0ec-3253-4f9e-b237-978f4e896c14 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:26.923902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14a2f0ec-3253-4f9e-b237-978f4e896c14 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:26.925954 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14a2f0ec-3253-4f9e-b237-978f4e896c14 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:26.926864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14a2f0ec-3253-4f9e-b237-978f4e896c14 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:27.630367 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-14a2f0ec-3253-4f9e-b237-978f4e896c14 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:27.650009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-14a2f0ec-3253-4f9e-b237-978f4e896c14 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:27.651659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-14a2f0ec-3253-4f9e-b237-978f4e896c14 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:27.656837 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-14a2f0ec-3253-4f9e-b237-978f4e896c14 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1879 microversion: 2.42 time: 0.774280 May 27 15:12:27.658226 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1866/3739] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:26 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1879 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:27.672586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7147dc30-4118-430c-bf69-747431714863 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:27.676816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7147dc30-4118-430c-bf69-747431714863 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:27.699652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7147dc30-4118-430c-bf69-747431714863 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:27.701074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7147dc30-4118-430c-bf69-747431714863 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:27.704787 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7147dc30-4118-430c-bf69-747431714863 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:27.706227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7147dc30-4118-430c-bf69-747431714863 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:27.765812 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-7147dc30-4118-430c-bf69-747431714863 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] HTTP exception thrown: Instance f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9 could not be found. May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7147dc30-4118-430c-bf69-747431714863 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Request method failure captured: May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9 HTTP/1.1 May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOnx_3W4NSSIJfU5WYZQefToF0f8g_ZyV7jzsr9VbhxPYF9TN9B1uaOccfJPhrUam2ztNf5mmp2Ch2sFsFs4rVd4hAFgjj_3MOQZKUykJiGHsrRcprANP9d3BumIz4UaEwuG3ZMiTEajtfRuX40mlrK1zVTz0LBxfjyy4xq8iZ3CcDI May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 5f1274817f784f12ba47ba885010ec42 May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ListServerFiltersTestJSON-471271800 May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5f1274817f784f12ba47ba885010ec42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5f1274817f784f12ba47ba885010ec42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5f1274817f784f12ba47ba885010ec42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5f1274817f784f12ba47ba885010ec42", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ListServerFiltersTestJSON-471271800 May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 5f1274817f784f12ba47ba885010ec42 May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-471271800 May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ListServerFiltersTestJSON-471271800-project May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b158ef703c064e15aa33f3ceaad971a8 May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ListServerFiltersTestJSON-471271800-project May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9 could not be found. May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9'} May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9 could not be found. May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9 could not be found. May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:27.769184 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:27.774177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:27.774177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:27.774177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:27.774177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:12:27.774177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:12:27.774177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9 could not be found. May 27 15:12:27.774177 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:27.775542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7147dc30-4118-430c-bf69-747431714863 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Returning 404 to user: Instance f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:12:27.776766 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7147dc30-4118-430c-bf69-747431714863 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9" status: 404 len: 111 microversion: 2.1 time: 0.117391 May 27 15:12:27.777626 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1867/3740] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:27 2022] GET /compute/v2.1/servers/f1a13e47-8ae1-471b-9dd1-e6ae0e3c24b9 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:12:27.783190 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3f748f0c-1b7c-40a2-be7e-1316c3b897e5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:27.784057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3f748f0c-1b7c-40a2-be7e-1316c3b897e5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:27.791490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f748f0c-1b7c-40a2-be7e-1316c3b897e5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:27.792176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f748f0c-1b7c-40a2-be7e-1316c3b897e5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:27.793280 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f748f0c-1b7c-40a2-be7e-1316c3b897e5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:27.793921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f748f0c-1b7c-40a2-be7e-1316c3b897e5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:27.929008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-a89a96ff-5575-47ca-870e-cd5a95a0b1c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Getting quotas for project b5f46e715eda47c19c4df5eda3091eab. Resources: dict_keys(['metadata_items']) {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:12:27.967331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-a89a96ff-5575-47ca-870e-cd5a95a0b1c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Getting quotas for user c4d5eff0d83a4108b853931be9d170d1 and project b5f46e715eda47c19c4df5eda3091eab. Resources: dict_keys(['metadata_items']) {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:12:28.015856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a89a96ff-5575-47ca-870e-cd5a95a0b1c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:12:28.017417 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a89a96ff-5575-47ca-870e-cd5a95a0b1c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:12:28.019616 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a89a96ff-5575-47ca-870e-cd5a95a0b1c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:12:28.024395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a89a96ff-5575-47ca-870e-cd5a95a0b1c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:12:28.025207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-a89a96ff-5575-47ca-870e-cd5a95a0b1c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:12:28.054243 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a89a96ff-5575-47ca-870e-cd5a95a0b1c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:28.057168 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a89a96ff-5575-47ca-870e-cd5a95a0b1c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:28.059228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a89a96ff-5575-47ca-870e-cd5a95a0b1c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:28.061945 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a89a96ff-5575-47ca-870e-cd5a95a0b1c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:28.119561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-a89a96ff-5575-47ca-870e-cd5a95a0b1c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Getting quotas for project b5f46e715eda47c19c4df5eda3091eab. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:12:28.136640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-a89a96ff-5575-47ca-870e-cd5a95a0b1c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Getting quotas for user c4d5eff0d83a4108b853931be9d170d1 and project b5f46e715eda47c19c4df5eda3091eab. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:12:28.172517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a89a96ff-5575-47ca-870e-cd5a95a0b1c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:12:28.180464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a89a96ff-5575-47ca-870e-cd5a95a0b1c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:12:28.207024 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3f748f0c-1b7c-40a2-be7e-1316c3b897e5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:28.230661 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3f748f0c-1b7c-40a2-be7e-1316c3b897e5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1210 microversion: 2.1 time: 0.448650 May 27 15:12:28.231594 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1868/3741] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:27 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1210 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:28.241429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-15e20998-f1a5-46bb-9320-c7fdcf509691 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:28.242585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-15e20998-f1a5-46bb-9320-c7fdcf509691 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:28.259049 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15e20998-f1a5-46bb-9320-c7fdcf509691 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:28.259802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15e20998-f1a5-46bb-9320-c7fdcf509691 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:28.261089 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15e20998-f1a5-46bb-9320-c7fdcf509691 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:28.261781 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15e20998-f1a5-46bb-9320-c7fdcf509691 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:28.298330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:28.335754 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a89a96ff-5575-47ca-870e-cd5a95a0b1c3 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.087499 May 27 15:12:28.342923 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1874/3742] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:12:26 2022] POST /compute/v2.1/servers => generated 407 bytes in 2098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 15:12:28.350680 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-29627dc0-8460-4601-a540-03df256d6705 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:28.351458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-29627dc0-8460-4601-a540-03df256d6705 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:28.358651 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29627dc0-8460-4601-a540-03df256d6705 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:28.359349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29627dc0-8460-4601-a540-03df256d6705 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:28.361343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29627dc0-8460-4601-a540-03df256d6705 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:28.362421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29627dc0-8460-4601-a540-03df256d6705 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:28.461746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-29627dc0-8460-4601-a540-03df256d6705 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:12:28.641680 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-15e20998-f1a5-46bb-9320-c7fdcf509691 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:28.658460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-15e20998-f1a5-46bb-9320-c7fdcf509691 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:28.664794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-15e20998-f1a5-46bb-9320-c7fdcf509691 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:28.667830 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-15e20998-f1a5-46bb-9320-c7fdcf509691 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1730 microversion: 2.20 time: 0.432662 May 27 15:12:28.669906 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1869/3743] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:28 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1730 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:28.682055 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e50cd9fe-3ec9-47d8-8b07-c904f236791f tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:28.682918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e50cd9fe-3ec9-47d8-8b07-c904f236791f tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:28.690246 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-29627dc0-8460-4601-a540-03df256d6705 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 204 len: 0 microversion: 2.1 time: 0.345252 May 27 15:12:28.692842 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1875/3744] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:12:28 2022] DELETE /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:12:28.705415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-389dced8-559f-4d4a-a090-051cd5913a12 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:28.710218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-389dced8-559f-4d4a-a090-051cd5913a12 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:28.736788 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-389dced8-559f-4d4a-a090-051cd5913a12 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:28.740169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-389dced8-559f-4d4a-a090-051cd5913a12 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:28.742451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-389dced8-559f-4d4a-a090-051cd5913a12 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:28.744002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-389dced8-559f-4d4a-a090-051cd5913a12 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:28.823922 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e50cd9fe-3ec9-47d8-8b07-c904f236791f tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d5eff0d83a4108b853931be9d170d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:28.836150 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e50cd9fe-3ec9-47d8-8b07-c904f236791f tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d" status: 200 len: 1268 microversion: 2.1 time: 0.162569 May 27 15:12:28.837615 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1870/3745] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:28 2022] GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:28.846531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-899784f3-dd69-4e22-a421-7faeb117548d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:28.848157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-899784f3-dd69-4e22-a421-7faeb117548d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:28.859561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-899784f3-dd69-4e22-a421-7faeb117548d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:28.860541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-899784f3-dd69-4e22-a421-7faeb117548d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:28.861713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-899784f3-dd69-4e22-a421-7faeb117548d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:28.862666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-899784f3-dd69-4e22-a421-7faeb117548d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:29.515191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-389dced8-559f-4d4a-a090-051cd5913a12 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:29.540014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-389dced8-559f-4d4a-a090-051cd5913a12 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:29.547984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-389dced8-559f-4d4a-a090-051cd5913a12 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:29.551792 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-389dced8-559f-4d4a-a090-051cd5913a12 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1879 microversion: 2.42 time: 0.855149 May 27 15:12:29.554899 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1876/3746] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:28 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1879 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:29.596304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-13e7895f-0540-456d-bac2-bdfd6d2c8010 req-d2261b92-04e5-4a1a-9b00-8d0a0c5d5af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "name": "network-vif-plugged", "status": "completed", "tag": "958625ea-67d8-42d6-878e-1e264997c838"}, {"server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "name": "network-vif-plugged", "status": "completed", "tag": "93591aab-dea0-4a1e-9aaa-fc28351a76bf"}, {"server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "name": "network-vif-plugged", "status": "completed", "tag": "5befacb8-cfec-4bf9-a56e-4875b8d292ad"}, {"server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "name": "network-vif-plugged", "status": "completed", "tag": "710a3bb3-e4d3-4b44-bf00-38bbf0d70d23"}, {"server_uuid": "d7371c18-20d2-43f8-b0c6-0371079d8f20", "name": "network-vif-plugged", "status": "completed", "tag": "555c9e09-9066-4780-8d8a-91ccfe7dff8d"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:29.638410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-13e7895f-0540-456d-bac2-bdfd6d2c8010 req-d2261b92-04e5-4a1a-9b00-8d0a0c5d5af7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:29.647597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-13e7895f-0540-456d-bac2-bdfd6d2c8010 req-d2261b92-04e5-4a1a-9b00-8d0a0c5d5af7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:29.683636 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-13e7895f-0540-456d-bac2-bdfd6d2c8010 req-d2261b92-04e5-4a1a-9b00-8d0a0c5d5af7 service nova] Creating event network-vif-plugged:958625ea-67d8-42d6-878e-1e264997c838 for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:12:29.707692 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-13e7895f-0540-456d-bac2-bdfd6d2c8010 req-d2261b92-04e5-4a1a-9b00-8d0a0c5d5af7 service nova] Creating event network-vif-plugged:93591aab-dea0-4a1e-9aaa-fc28351a76bf for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:12:29.708513 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-13e7895f-0540-456d-bac2-bdfd6d2c8010 req-d2261b92-04e5-4a1a-9b00-8d0a0c5d5af7 service nova] Creating event network-vif-plugged:5befacb8-cfec-4bf9-a56e-4875b8d292ad for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:12:29.714074 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-13e7895f-0540-456d-bac2-bdfd6d2c8010 req-d2261b92-04e5-4a1a-9b00-8d0a0c5d5af7 service nova] Creating event network-vif-plugged:710a3bb3-e4d3-4b44-bf00-38bbf0d70d23 for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:12:29.715226 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-13e7895f-0540-456d-bac2-bdfd6d2c8010 req-d2261b92-04e5-4a1a-9b00-8d0a0c5d5af7 service nova] Creating event network-vif-plugged:555c9e09-9066-4780-8d8a-91ccfe7dff8d for instance d7371c18-20d2-43f8-b0c6-0371079d8f20 on n-h2-843621-1 May 27 15:12:29.761926 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-13e7895f-0540-456d-bac2-bdfd6d2c8010 req-d2261b92-04e5-4a1a-9b00-8d0a0c5d5af7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.204229 May 27 15:12:29.765607 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1877/3747] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:29.777418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a4d144cc-4b06-474a-9585-53074d96df37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:29.780460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a4d144cc-4b06-474a-9585-53074d96df37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:29.790668 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4d144cc-4b06-474a-9585-53074d96df37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:29.791260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4d144cc-4b06-474a-9585-53074d96df37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:29.792254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4d144cc-4b06-474a-9585-53074d96df37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:29.793095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4d144cc-4b06-474a-9585-53074d96df37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:29.795431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-899784f3-dd69-4e22-a421-7faeb117548d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:29.807217 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-899784f3-dd69-4e22-a421-7faeb117548d tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1519 microversion: 2.1 time: 0.967033 May 27 15:12:29.807809 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1871/3748] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:28 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1519 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:29.816842 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f9c49198-8eb8-4895-9a9e-1b1cd55b48a1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:29.817477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f9c49198-8eb8-4895-9a9e-1b1cd55b48a1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:29.865208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f9c49198-8eb8-4895-9a9e-1b1cd55b48a1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:29.866966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f9c49198-8eb8-4895-9a9e-1b1cd55b48a1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:29.870216 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f9c49198-8eb8-4895-9a9e-1b1cd55b48a1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:29.875284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f9c49198-8eb8-4895-9a9e-1b1cd55b48a1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:30.150648 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a4d144cc-4b06-474a-9585-53074d96df37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:30.161497 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a4d144cc-4b06-474a-9585-53074d96df37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1210 microversion: 2.1 time: 0.394341 May 27 15:12:30.178046 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1878/3749] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:29 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1210 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:30.184489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0f3667b5-d084-4638-8bbd-ef2b9137faba tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:30.185519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0f3667b5-d084-4638-8bbd-ef2b9137faba tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:30.194118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f3667b5-d084-4638-8bbd-ef2b9137faba tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:30.195072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f3667b5-d084-4638-8bbd-ef2b9137faba tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:30.196488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f3667b5-d084-4638-8bbd-ef2b9137faba tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:30.197275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f3667b5-d084-4638-8bbd-ef2b9137faba tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:30.302587 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0f3667b5-d084-4638-8bbd-ef2b9137faba tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d5eff0d83a4108b853931be9d170d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:30.315208 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0f3667b5-d084-4638-8bbd-ef2b9137faba tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d" status: 200 len: 1338 microversion: 2.1 time: 0.133474 May 27 15:12:30.316463 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1879/3750] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:30 2022] GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d => generated 1338 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:30.324514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b19dcd7e-21aa-484e-a41c-b3c51fd7df37 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-366535849", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6b01e33-e8d1-4864-8f1d-92e402b67af3"}], "security_groups": [{"name": "tempest-securitygroup--2111630933"}], "key_name": "tempest-keypair-1014226516", "user_data": "}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:30.418085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f9c49198-8eb8-4895-9a9e-1b1cd55b48a1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:30.446476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f9c49198-8eb8-4895-9a9e-1b1cd55b48a1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:30.448074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f9c49198-8eb8-4895-9a9e-1b1cd55b48a1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:30.455576 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f9c49198-8eb8-4895-9a9e-1b1cd55b48a1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1730 microversion: 2.20 time: 0.645580 May 27 15:12:30.458871 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1872/3751] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:29 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1730 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:30.528013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-b19dcd7e-21aa-484e-a41c-b3c51fd7df37 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] validate_networks() for [('b6b01e33-e8d1-4864-8f1d-92e402b67af3', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:12:30.583410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d53cccf1-ce69-4656-9520-8c4281674af6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:30.584641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d53cccf1-ce69-4656-9520-8c4281674af6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:30.600944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d53cccf1-ce69-4656-9520-8c4281674af6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:30.601782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d53cccf1-ce69-4656-9520-8c4281674af6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:30.602767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d53cccf1-ce69-4656-9520-8c4281674af6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:30.603372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d53cccf1-ce69-4656-9520-8c4281674af6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:30.958146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d53cccf1-ce69-4656-9520-8c4281674af6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:30.971441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d53cccf1-ce69-4656-9520-8c4281674af6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:30.973505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d53cccf1-ce69-4656-9520-8c4281674af6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:30.977712 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d53cccf1-ce69-4656-9520-8c4281674af6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1879 microversion: 2.42 time: 0.400378 May 27 15:12:30.979354 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1873/3752] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:30 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1879 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:30.988654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-70d650f9-63de-459e-9521-c9af89a7fd07 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:30.989655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-70d650f9-63de-459e-9521-c9af89a7fd07 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:31.000089 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70d650f9-63de-459e-9521-c9af89a7fd07 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:31.000726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70d650f9-63de-459e-9521-c9af89a7fd07 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:31.001950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70d650f9-63de-459e-9521-c9af89a7fd07 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:31.002557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70d650f9-63de-459e-9521-c9af89a7fd07 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:31.646696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b19dcd7e-21aa-484e-a41c-b3c51fd7df37 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:12:31.647799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b19dcd7e-21aa-484e-a41c-b3c51fd7df37 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:12:31.648152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b19dcd7e-21aa-484e-a41c-b3c51fd7df37 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:12:31.648579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b19dcd7e-21aa-484e-a41c-b3c51fd7df37 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:12:31.649025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b19dcd7e-21aa-484e-a41c-b3c51fd7df37 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:12:31.675986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-70d650f9-63de-459e-9521-c9af89a7fd07 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:31.687743 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-70d650f9-63de-459e-9521-c9af89a7fd07 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1519 microversion: 2.1 time: 0.707160 May 27 15:12:31.688336 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1874/3753] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:30 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1519 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:31.695268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b19dcd7e-21aa-484e-a41c-b3c51fd7df37 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:31.697412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b19dcd7e-21aa-484e-a41c-b3c51fd7df37 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:31.700123 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-71d33495-c9d2-4b29-9a85-1898ed9d7eef tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:31.700782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-71d33495-c9d2-4b29-9a85-1898ed9d7eef tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:31.701902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b19dcd7e-21aa-484e-a41c-b3c51fd7df37 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:31.702564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b19dcd7e-21aa-484e-a41c-b3c51fd7df37 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:31.715778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71d33495-c9d2-4b29-9a85-1898ed9d7eef tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:31.721696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71d33495-c9d2-4b29-9a85-1898ed9d7eef tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:31.723395 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71d33495-c9d2-4b29-9a85-1898ed9d7eef tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:31.726261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71d33495-c9d2-4b29-9a85-1898ed9d7eef tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:31.750165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-b19dcd7e-21aa-484e-a41c-b3c51fd7df37 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Getting quotas for project 1f6efd5b16e5450d9eb9b454d05a775a. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:12:31.763626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-b19dcd7e-21aa-484e-a41c-b3c51fd7df37 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Getting quotas for user 645379b3a21548d8a4f4d6425b61319f and project 1f6efd5b16e5450d9eb9b454d05a775a. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:12:31.831903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b19dcd7e-21aa-484e-a41c-b3c51fd7df37 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:12:31.840163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b19dcd7e-21aa-484e-a41c-b3c51fd7df37 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:12:31.975331 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b19dcd7e-21aa-484e-a41c-b3c51fd7df37 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.657467 May 27 15:12:31.985144 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1880/3754] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:12:30 2022] POST /compute/v2.1/servers => generated 409 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:12:31.991575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d6bbafe4-1161-4764-8b99-0b7c9519b806 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:31.993312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d6bbafe4-1161-4764-8b99-0b7c9519b806 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:31.993473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-71d33495-c9d2-4b29-9a85-1898ed9d7eef tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:32.011471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d6bbafe4-1161-4764-8b99-0b7c9519b806 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:32.013271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d6bbafe4-1161-4764-8b99-0b7c9519b806 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:32.016454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d6bbafe4-1161-4764-8b99-0b7c9519b806 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:32.017604 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d6bbafe4-1161-4764-8b99-0b7c9519b806 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:32.027215 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-71d33495-c9d2-4b29-9a85-1898ed9d7eef tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1198 microversion: 2.1 time: 0.335332 May 27 15:12:32.038056 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1875/3755] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:31 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1198 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:32.299015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d6bbafe4-1161-4764-8b99-0b7c9519b806 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d5eff0d83a4108b853931be9d170d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:32.314401 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d6bbafe4-1161-4764-8b99-0b7c9519b806 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d" status: 200 len: 1394 microversion: 2.1 time: 0.327023 May 27 15:12:32.314997 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1881/3756] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:31 2022] GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d => generated 1394 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:32.323517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a12d0fac-3aba-47fb-bb45-0b13e4d95c6b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:32.330588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a12d0fac-3aba-47fb-bb45-0b13e4d95c6b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:32.346067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a12d0fac-3aba-47fb-bb45-0b13e4d95c6b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:32.347840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a12d0fac-3aba-47fb-bb45-0b13e4d95c6b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:32.351320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a12d0fac-3aba-47fb-bb45-0b13e4d95c6b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:32.353279 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a12d0fac-3aba-47fb-bb45-0b13e4d95c6b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:32.570739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e430238d-f494-42d5-839f-4936be2ed7d4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1553753432", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "1133486f-d0a2-4dd7-bfb6-fd34c038b95b"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:32.731470 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-e430238d-f494-42d5-839f-4936be2ed7d4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] validate_networks() for [('1133486f-d0a2-4dd7-bfb6-fd34c038b95b', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:12:32.800836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a12d0fac-3aba-47fb-bb45-0b13e4d95c6b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:32.813803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a12d0fac-3aba-47fb-bb45-0b13e4d95c6b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:32.815322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a12d0fac-3aba-47fb-bb45-0b13e4d95c6b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:32.821514 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a12d0fac-3aba-47fb-bb45-0b13e4d95c6b tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1730 microversion: 2.20 time: 0.502984 May 27 15:12:32.824486 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1882/3757] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:32 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1730 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:32.833833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fc2d6ce9-0719-4395-809c-ce36237aa513 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:32.834460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fc2d6ce9-0719-4395-809c-ce36237aa513 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:32.955618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fc2d6ce9-0719-4395-809c-ce36237aa513 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:32.967281 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fc2d6ce9-0719-4395-809c-ce36237aa513 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1245 microversion: 2.1 time: 0.141572 May 27 15:12:32.978571 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1883/3758] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:32 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1245 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:32.988494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-16f1089d-c7ca-40f1-9bf5-6bb5ee8fd3da tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:32.988494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-16f1089d-c7ca-40f1-9bf5-6bb5ee8fd3da tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:33.008054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16f1089d-c7ca-40f1-9bf5-6bb5ee8fd3da tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:33.019308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16f1089d-c7ca-40f1-9bf5-6bb5ee8fd3da tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:33.020434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16f1089d-c7ca-40f1-9bf5-6bb5ee8fd3da tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:33.022928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16f1089d-c7ca-40f1-9bf5-6bb5ee8fd3da tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:33.432995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-16f1089d-c7ca-40f1-9bf5-6bb5ee8fd3da tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:33.446905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-16f1089d-c7ca-40f1-9bf5-6bb5ee8fd3da tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:33.451527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-16f1089d-c7ca-40f1-9bf5-6bb5ee8fd3da tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:33.455913 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-16f1089d-c7ca-40f1-9bf5-6bb5ee8fd3da tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 2836 microversion: 2.42 time: 0.476752 May 27 15:12:33.456793 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1884/3759] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:32 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 2836 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:33.479933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7844d81e-ddae-4437-be40-bd805fa5a154 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:33.480574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7844d81e-ddae-4437-be40-bd805fa5a154 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:33.495541 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7844d81e-ddae-4437-be40-bd805fa5a154 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:33.496265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7844d81e-ddae-4437-be40-bd805fa5a154 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:33.497252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7844d81e-ddae-4437-be40-bd805fa5a154 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:33.497697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7844d81e-ddae-4437-be40-bd805fa5a154 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:33.759183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-e430238d-f494-42d5-839f-4936be2ed7d4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:12:33.759655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-e430238d-f494-42d5-839f-4936be2ed7d4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:12:33.760159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-e430238d-f494-42d5-839f-4936be2ed7d4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:12:33.760869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-e430238d-f494-42d5-839f-4936be2ed7d4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:12:33.761515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-e430238d-f494-42d5-839f-4936be2ed7d4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:12:33.762825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7844d81e-ddae-4437-be40-bd805fa5a154 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158ef703c064e15aa33f3ceaad971a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1274817f784f12ba47ba885010ec42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:33.771283 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7844d81e-ddae-4437-be40-bd805fa5a154 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 200 len: 1519 microversion: 2.1 time: 0.313250 May 27 15:12:33.773170 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1885/3760] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:33 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 1519 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:33.778660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e430238d-f494-42d5-839f-4936be2ed7d4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:33.779365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e430238d-f494-42d5-839f-4936be2ed7d4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:33.780708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4fc7263e-b46a-4113-96c0-0372fa629b02 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:33.781771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e430238d-f494-42d5-839f-4936be2ed7d4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:33.782993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e430238d-f494-42d5-839f-4936be2ed7d4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:33.783145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4fc7263e-b46a-4113-96c0-0372fa629b02 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:33.806099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4fc7263e-b46a-4113-96c0-0372fa629b02 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:33.807592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4fc7263e-b46a-4113-96c0-0372fa629b02 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:33.808620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4fc7263e-b46a-4113-96c0-0372fa629b02 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:33.810669 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4fc7263e-b46a-4113-96c0-0372fa629b02 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:33.828751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-e430238d-f494-42d5-839f-4936be2ed7d4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Getting quotas for project ada5914cea884080bbd23769fe91eb43. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:12:33.842315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-e430238d-f494-42d5-839f-4936be2ed7d4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Getting quotas for user 63b1e31883914fc9ad74440a00da8c92 and project ada5914cea884080bbd23769fe91eb43. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:12:33.875864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e430238d-f494-42d5-839f-4936be2ed7d4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:12:33.884272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e430238d-f494-42d5-839f-4936be2ed7d4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] [instance: 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:12:33.992460 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e430238d-f494-42d5-839f-4936be2ed7d4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.952967 May 27 15:12:33.993762 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1876/3761] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:12:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:12:34.001387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9031290f-8d63-4892-bb14-13b225d5aed8 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:34.002293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9031290f-8d63-4892-bb14-13b225d5aed8 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:34.011545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9031290f-8d63-4892-bb14-13b225d5aed8 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.012239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9031290f-8d63-4892-bb14-13b225d5aed8 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.013287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9031290f-8d63-4892-bb14-13b225d5aed8 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.013885 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9031290f-8d63-4892-bb14-13b225d5aed8 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.301228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4fc7263e-b46a-4113-96c0-0372fa629b02 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:34.309011 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4fc7263e-b46a-4113-96c0-0372fa629b02 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1198 microversion: 2.1 time: 0.534573 May 27 15:12:34.319506 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1886/3762] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:33 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1198 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:34.326119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a89b740e-2a25-4216-8e7c-7ef662394a43 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:34.326725 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a89b740e-2a25-4216-8e7c-7ef662394a43 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:34.336315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a89b740e-2a25-4216-8e7c-7ef662394a43 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.336814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a89b740e-2a25-4216-8e7c-7ef662394a43 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.338000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a89b740e-2a25-4216-8e7c-7ef662394a43 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.350880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a89b740e-2a25-4216-8e7c-7ef662394a43 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.514506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9031290f-8d63-4892-bb14-13b225d5aed8 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d5eff0d83a4108b853931be9d170d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:34.532277 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9031290f-8d63-4892-bb14-13b225d5aed8 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d" status: 200 len: 1394 microversion: 2.1 time: 0.537026 May 27 15:12:34.544859 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1877/3763] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:33 2022] GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d => generated 1394 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:34.551060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fa6149ba-d85a-46e8-92bd-0d6b162234e1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:34.551983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fa6149ba-d85a-46e8-92bd-0d6b162234e1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:34.560624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa6149ba-d85a-46e8-92bd-0d6b162234e1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.562728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa6149ba-d85a-46e8-92bd-0d6b162234e1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.563872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa6149ba-d85a-46e8-92bd-0d6b162234e1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.564735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa6149ba-d85a-46e8-92bd-0d6b162234e1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.591802 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a89b740e-2a25-4216-8e7c-7ef662394a43 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.270648 May 27 15:12:34.592814 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1887/3764] 10.222.0.13 () {60 vars in 1315 bytes} [Fri May 27 15:12:34 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d/os-interface => generated 1832 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:34.597779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-3cae8ee8-6f0e-4053-b6f9-7553007a4429 req-fa77d17d-2d10-49b1-9b31-8ae265e68503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b200dfd-ec26-41af-9dd2-d82d6f476d6d", "tag": "227ff72f-f1a5-4b57-8615-ad52676cf026"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:34.606891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:34.624718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3cae8ee8-6f0e-4053-b6f9-7553007a4429 req-fa77d17d-2d10-49b1-9b31-8ae265e68503 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.625181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3cae8ee8-6f0e-4053-b6f9-7553007a4429 req-fa77d17d-2d10-49b1-9b31-8ae265e68503 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.657823 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-3cae8ee8-6f0e-4053-b6f9-7553007a4429 req-fa77d17d-2d10-49b1-9b31-8ae265e68503 service nova] Creating event network-changed:227ff72f-f1a5-4b57-8615-ad52676cf026 for instance 2b200dfd-ec26-41af-9dd2-d82d6f476d6d on n-h2-843621-1 May 27 15:12:34.669412 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-3cae8ee8-6f0e-4053-b6f9-7553007a4429 req-fa77d17d-2d10-49b1-9b31-8ae265e68503 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074395 May 27 15:12:34.670896 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1888/3765] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:34.685829 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ec890d99-ce1e-4192-8e6d-b56ee13f4ceb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:34.687111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ec890d99-ce1e-4192-8e6d-b56ee13f4ceb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:34.701511 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec890d99-ce1e-4192-8e6d-b56ee13f4ceb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.702314 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec890d99-ce1e-4192-8e6d-b56ee13f4ceb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.703353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec890d99-ce1e-4192-8e6d-b56ee13f4ceb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.703969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec890d99-ce1e-4192-8e6d-b56ee13f4ceb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.815375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ec890d99-ce1e-4192-8e6d-b56ee13f4ceb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:34.827467 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ec890d99-ce1e-4192-8e6d-b56ee13f4ceb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1303 microversion: 2.1 time: 0.154998 May 27 15:12:34.837655 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1889/3766] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:34 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1303 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:34.847957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ab5289e4-8168-4d83-921f-63f7df45dfad tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:34.848589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ab5289e4-8168-4d83-921f-63f7df45dfad tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] [instance: 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:34.856247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab5289e4-8168-4d83-921f-63f7df45dfad tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.857354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab5289e4-8168-4d83-921f-63f7df45dfad tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.858527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab5289e4-8168-4d83-921f-63f7df45dfad tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:34.859085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab5289e4-8168-4d83-921f-63f7df45dfad tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:34.978978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ab5289e4-8168-4d83-921f-63f7df45dfad tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b1e31883914fc9ad74440a00da8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada5914cea884080bbd23769fe91eb43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:34.988031 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ab5289e4-8168-4d83-921f-63f7df45dfad tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea" status: 200 len: 1220 microversion: 2.1 time: 0.158494 May 27 15:12:34.989032 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1890/3767] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:34 2022] GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea => generated 1220 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:34.995530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d5e2238b-9178-423d-b6c9-b477e2b49fd3 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:34.996431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d5e2238b-9178-423d-b6c9-b477e2b49fd3 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] [instance: ce756610-6a39-4f3b-97c5-79cac2fdf255] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:35.003605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5e2238b-9178-423d-b6c9-b477e2b49fd3 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:35.004884 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5e2238b-9178-423d-b6c9-b477e2b49fd3 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:35.006846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5e2238b-9178-423d-b6c9-b477e2b49fd3 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:35.007657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5e2238b-9178-423d-b6c9-b477e2b49fd3 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:35.018831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fa6149ba-d85a-46e8-92bd-0d6b162234e1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:35.024618 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-d5e2238b-9178-423d-b6c9-b477e2b49fd3 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] HTTP exception thrown: Instance ce756610-6a39-4f3b-97c5-79cac2fdf255 could not be found. May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d5e2238b-9178-423d-b6c9-b477e2b49fd3 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Request method failure captured: May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 HTTP/1.1 May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOnx_3W4NSSIJfU5WYZQefToF0f8g_ZyV7jzsr9VbhxPYF9TN9B1uaOccfJPhrUam2ztNf5mmp2Ch2sFsFs4rVd4hAFgjj_3MOQZKUykJiGHsrRcprANP9d3BumIz4UaEwuG3ZMiTEajtfRuX40mlrK1zVTz0LBxfjyy4xq8iZ3CcDI May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 5f1274817f784f12ba47ba885010ec42 May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ListServerFiltersTestJSON-471271800 May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5f1274817f784f12ba47ba885010ec42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5f1274817f784f12ba47ba885010ec42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5f1274817f784f12ba47ba885010ec42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5f1274817f784f12ba47ba885010ec42", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ListServerFiltersTestJSON-471271800 May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 5f1274817f784f12ba47ba885010ec42 May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-471271800 May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ListServerFiltersTestJSON-471271800-project May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b158ef703c064e15aa33f3ceaad971a8 May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ListServerFiltersTestJSON-471271800-project May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance ce756610-6a39-4f3b-97c5-79cac2fdf255 could not be found. May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'ce756610-6a39-4f3b-97c5-79cac2fdf255'} May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce756610-6a39-4f3b-97c5-79cac2fdf255 could not be found. May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce756610-6a39-4f3b-97c5-79cac2fdf255 could not be found. May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:35.026349 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:12:35.030789 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:35.030789 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:35.030789 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:35.030789 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:12:35.030789 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:12:35.030789 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce756610-6a39-4f3b-97c5-79cac2fdf255 could not be found. May 27 15:12:35.030789 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:12:35.030789 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d5e2238b-9178-423d-b6c9-b477e2b49fd3 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] Returning 404 to user: Instance ce756610-6a39-4f3b-97c5-79cac2fdf255 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:12:35.030789 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d5e2238b-9178-423d-b6c9-b477e2b49fd3 tempest-ListServerFiltersTestJSON-471271800 tempest-ListServerFiltersTestJSON-471271800-project] 10.222.0.13 "GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255" status: 404 len: 111 microversion: 2.1 time: 0.037271 May 27 15:12:35.030789 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1891/3768] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:34 2022] GET /compute/v2.1/servers/ce756610-6a39-4f3b-97c5-79cac2fdf255 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:12:35.038355 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fa6149ba-d85a-46e8-92bd-0d6b162234e1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:35.040186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fa6149ba-d85a-46e8-92bd-0d6b162234e1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:35.041519 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fa6149ba-d85a-46e8-92bd-0d6b162234e1 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1717 microversion: 2.20 time: 0.495235 May 27 15:12:35.042172 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1878/3769] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:34 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1717 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:35.326211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-313c5b52-a074-4ccb-9ab8-e5e816818540 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:35.326738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-313c5b52-a074-4ccb-9ab8-e5e816818540 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:35.333450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-313c5b52-a074-4ccb-9ab8-e5e816818540 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:35.333914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-313c5b52-a074-4ccb-9ab8-e5e816818540 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:35.335241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-313c5b52-a074-4ccb-9ab8-e5e816818540 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:35.335872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-313c5b52-a074-4ccb-9ab8-e5e816818540 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:35.340606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:35.551098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-20d5d00b-6456-47a0-afa5-764f29735690 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:35.552731 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-20d5d00b-6456-47a0-afa5-764f29735690 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:35.560606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20d5d00b-6456-47a0-afa5-764f29735690 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:35.561250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20d5d00b-6456-47a0-afa5-764f29735690 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:35.562047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20d5d00b-6456-47a0-afa5-764f29735690 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:35.562491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20d5d00b-6456-47a0-afa5-764f29735690 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:35.607435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-313c5b52-a074-4ccb-9ab8-e5e816818540 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:35.617133 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-313c5b52-a074-4ccb-9ab8-e5e816818540 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1198 microversion: 2.1 time: 0.295045 May 27 15:12:35.618022 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1892/3770] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:35 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1198 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:35.833728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-20d5d00b-6456-47a0-afa5-764f29735690 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d5eff0d83a4108b853931be9d170d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:35.848312 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-20d5d00b-6456-47a0-afa5-764f29735690 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d" status: 200 len: 1394 microversion: 2.1 time: 0.301747 May 27 15:12:35.849650 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1879/3771] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:35 2022] GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d => generated 1394 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:35.851461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c76035fb-aafc-4d62-bc93-7e9f1ac84ef8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:35.852115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c76035fb-aafc-4d62-bc93-7e9f1ac84ef8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:35.860656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c76035fb-aafc-4d62-bc93-7e9f1ac84ef8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:35.861613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c76035fb-aafc-4d62-bc93-7e9f1ac84ef8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:35.862433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c76035fb-aafc-4d62-bc93-7e9f1ac84ef8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:35.862899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c76035fb-aafc-4d62-bc93-7e9f1ac84ef8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:36.010745 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8da79c3a-cc11-4560-a69e-edadfc8de400 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:36.011807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8da79c3a-cc11-4560-a69e-edadfc8de400 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] [instance: 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:36.044415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8da79c3a-cc11-4560-a69e-edadfc8de400 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:36.047203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8da79c3a-cc11-4560-a69e-edadfc8de400 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:36.049664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8da79c3a-cc11-4560-a69e-edadfc8de400 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:36.050152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8da79c3a-cc11-4560-a69e-edadfc8de400 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:36.053723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c76035fb-aafc-4d62-bc93-7e9f1ac84ef8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:36.061879 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c76035fb-aafc-4d62-bc93-7e9f1ac84ef8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1303 microversion: 2.1 time: 0.219382 May 27 15:12:36.062475 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1893/3772] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:35 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1303 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:36.253119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8da79c3a-cc11-4560-a69e-edadfc8de400 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b1e31883914fc9ad74440a00da8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada5914cea884080bbd23769fe91eb43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:36.261921 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8da79c3a-cc11-4560-a69e-edadfc8de400 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea" status: 200 len: 1276 microversion: 2.1 time: 0.259051 May 27 15:12:36.262517 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1880/3773] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:36 2022] GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea => generated 1276 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:36.456623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-57ca46a7-fb64-4f62-9afe-3f3e2e938fc3 req-4fd752a1-7ee5-4a68-ace1-fff4f86e23d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "tag": "f670de18-c094-413a-a6ff-240c82cf0d14"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:36.468099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-57ca46a7-fb64-4f62-9afe-3f3e2e938fc3 req-4fd752a1-7ee5-4a68-ace1-fff4f86e23d6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:36.468569 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-57ca46a7-fb64-4f62-9afe-3f3e2e938fc3 req-4fd752a1-7ee5-4a68-ace1-fff4f86e23d6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:36.482553 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-57ca46a7-fb64-4f62-9afe-3f3e2e938fc3 req-4fd752a1-7ee5-4a68-ace1-fff4f86e23d6 service nova] Creating event network-changed:f670de18-c094-413a-a6ff-240c82cf0d14 for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:12:36.498625 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-57ca46a7-fb64-4f62-9afe-3f3e2e938fc3 req-4fd752a1-7ee5-4a68-ace1-fff4f86e23d6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045566 May 27 15:12:36.499566 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1894/3774] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:36.639779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-15c73e44-bf2d-4cba-b136-d87e645af51e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:36.640798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-15c73e44-bf2d-4cba-b136-d87e645af51e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:36.650699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15c73e44-bf2d-4cba-b136-d87e645af51e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:36.651438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15c73e44-bf2d-4cba-b136-d87e645af51e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:36.652810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15c73e44-bf2d-4cba-b136-d87e645af51e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:36.653548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15c73e44-bf2d-4cba-b136-d87e645af51e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:36.745227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-8326aac8-d079-46e2-9524-59f27804fe02 req-6f72ecfc-cf4c-437f-914e-98ee680423a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce756610-6a39-4f3b-97c5-79cac2fdf255", "name": "network-vif-deleted", "tag": "0deb9a0e-386b-404a-a01a-85e6358417ef"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:36.774459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-8326aac8-d079-46e2-9524-59f27804fe02 req-6f72ecfc-cf4c-437f-914e-98ee680423a3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:36.774459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-8326aac8-d079-46e2-9524-59f27804fe02 req-6f72ecfc-cf4c-437f-914e-98ee680423a3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:36.811654 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-8326aac8-d079-46e2-9524-59f27804fe02 req-6f72ecfc-cf4c-437f-914e-98ee680423a3 service nova] Creating event network-vif-deleted:0deb9a0e-386b-404a-a01a-85e6358417ef for instance ce756610-6a39-4f3b-97c5-79cac2fdf255 on n-h1-843621-1 May 27 15:12:36.822926 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-8326aac8-d079-46e2-9524-59f27804fe02 req-6f72ecfc-cf4c-437f-914e-98ee680423a3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081750 May 27 15:12:36.825158 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1895/3775] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:12:36.867073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-732aa9f1-090d-4cb3-a57f-53740db3ccbd tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:36.868051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-732aa9f1-090d-4cb3-a57f-53740db3ccbd tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:36.879605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-732aa9f1-090d-4cb3-a57f-53740db3ccbd tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:36.880221 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-732aa9f1-090d-4cb3-a57f-53740db3ccbd tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:36.886018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-732aa9f1-090d-4cb3-a57f-53740db3ccbd tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:36.888620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-732aa9f1-090d-4cb3-a57f-53740db3ccbd tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:37.031899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-15c73e44-bf2d-4cba-b136-d87e645af51e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:37.041372 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-15c73e44-bf2d-4cba-b136-d87e645af51e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1198 microversion: 2.1 time: 0.410165 May 27 15:12:37.041969 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1881/3776] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:36 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1198 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:37.080345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b180eb01-1172-4565-872c-9ae09f2de83a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:37.081154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b180eb01-1172-4565-872c-9ae09f2de83a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:37.093922 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b180eb01-1172-4565-872c-9ae09f2de83a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:37.094385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b180eb01-1172-4565-872c-9ae09f2de83a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:37.097621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b180eb01-1172-4565-872c-9ae09f2de83a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:37.099205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b180eb01-1172-4565-872c-9ae09f2de83a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:38.045938 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-732aa9f1-090d-4cb3-a57f-53740db3ccbd tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d5eff0d83a4108b853931be9d170d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:38.074788 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-732aa9f1-090d-4cb3-a57f-53740db3ccbd tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d" status: 200 len: 1394 microversion: 2.1 time: 1.212567 May 27 15:12:38.087648 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1896/3777] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:36 2022] GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d => generated 1394 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:38.094605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0af589ad-5704-4ee0-ba43-a56e076208b7 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:38.095585 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0af589ad-5704-4ee0-ba43-a56e076208b7 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] [instance: 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:38.113316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0af589ad-5704-4ee0-ba43-a56e076208b7 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:38.114052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0af589ad-5704-4ee0-ba43-a56e076208b7 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:38.115080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0af589ad-5704-4ee0-ba43-a56e076208b7 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:38.115884 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0af589ad-5704-4ee0-ba43-a56e076208b7 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:38.156485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b180eb01-1172-4565-872c-9ae09f2de83a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:38.164519 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b180eb01-1172-4565-872c-9ae09f2de83a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1371 microversion: 2.1 time: 1.089115 May 27 15:12:38.173091 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1882/3778] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:37 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1371 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:38.183380 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8e3192b5-09dd-46d3-b5f0-dfb294128f4f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:38.184575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8e3192b5-09dd-46d3-b5f0-dfb294128f4f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:38.213593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e3192b5-09dd-46d3-b5f0-dfb294128f4f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:38.214060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e3192b5-09dd-46d3-b5f0-dfb294128f4f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:38.214864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e3192b5-09dd-46d3-b5f0-dfb294128f4f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:38.215309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e3192b5-09dd-46d3-b5f0-dfb294128f4f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:38.689980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0af589ad-5704-4ee0-ba43-a56e076208b7 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b1e31883914fc9ad74440a00da8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada5914cea884080bbd23769fe91eb43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:38.702942 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0af589ad-5704-4ee0-ba43-a56e076208b7 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea" status: 200 len: 1324 microversion: 2.1 time: 0.610441 May 27 15:12:38.706334 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1897/3779] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:38 2022] GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea => generated 1324 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:38.752843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8e3192b5-09dd-46d3-b5f0-dfb294128f4f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:38.761181 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8e3192b5-09dd-46d3-b5f0-dfb294128f4f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1198 microversion: 2.1 time: 0.585069 May 27 15:12:38.766618 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1883/3780] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:38 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1198 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:38.938550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-9f9181f9-51e9-4467-b52e-8816c922e643 req-634ea550-1822-47ed-9ec9-5b3e3b833c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae7e4fc8-75b6-4e3f-9fca-7e5920957283", "tag": "89fb6ad5-bc61-4f1c-b96b-4295cadf203e"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:38.952349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9f9181f9-51e9-4467-b52e-8816c922e643 req-634ea550-1822-47ed-9ec9-5b3e3b833c8d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:38.953122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9f9181f9-51e9-4467-b52e-8816c922e643 req-634ea550-1822-47ed-9ec9-5b3e3b833c8d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:38.992589 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-9f9181f9-51e9-4467-b52e-8816c922e643 req-634ea550-1822-47ed-9ec9-5b3e3b833c8d service nova] Creating event network-changed:89fb6ad5-bc61-4f1c-b96b-4295cadf203e for instance ae7e4fc8-75b6-4e3f-9fca-7e5920957283 on n-h1-843621-1 May 27 15:12:38.999217 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-9f9181f9-51e9-4467-b52e-8816c922e643 req-634ea550-1822-47ed-9ec9-5b3e3b833c8d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068715 May 27 15:12:39.000413 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1898/3781] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:12:39.093097 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-47b52de5-545b-426f-a423-621172494627 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:39.094971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-47b52de5-545b-426f-a423-621172494627 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:39.103439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-47b52de5-545b-426f-a423-621172494627 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:39.104774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-47b52de5-545b-426f-a423-621172494627 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:39.105873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-47b52de5-545b-426f-a423-621172494627 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:39.106569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-47b52de5-545b-426f-a423-621172494627 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:39.185614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a06d7c9d-dc24-4633-a503-f1279a90be05 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:39.186177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a06d7c9d-dc24-4633-a503-f1279a90be05 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:39.203479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a06d7c9d-dc24-4633-a503-f1279a90be05 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:39.204096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a06d7c9d-dc24-4633-a503-f1279a90be05 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:39.204784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a06d7c9d-dc24-4633-a503-f1279a90be05 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:39.211124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a06d7c9d-dc24-4633-a503-f1279a90be05 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:39.461836 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-47b52de5-545b-426f-a423-621172494627 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d5eff0d83a4108b853931be9d170d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:39.475682 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-47b52de5-545b-426f-a423-621172494627 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d" status: 200 len: 1394 microversion: 2.1 time: 0.387115 May 27 15:12:39.490385 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1884/3782] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:39 2022] GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d => generated 1394 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:39.631611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a06d7c9d-dc24-4633-a503-f1279a90be05 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:39.643322 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a06d7c9d-dc24-4633-a503-f1279a90be05 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1371 microversion: 2.1 time: 0.464712 May 27 15:12:39.649016 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1899/3783] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:39 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1371 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:39.722659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-250b0c07-7940-42e7-b700-903d877150e2 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:39.723235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-250b0c07-7940-42e7-b700-903d877150e2 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] [instance: 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:39.731948 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-250b0c07-7940-42e7-b700-903d877150e2 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:39.732629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-250b0c07-7940-42e7-b700-903d877150e2 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:39.734490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-250b0c07-7940-42e7-b700-903d877150e2 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:39.734650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-250b0c07-7940-42e7-b700-903d877150e2 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:39.782539 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fb7a7bda-6e8d-4c85-979e-f4741b71ee76 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:39.783646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fb7a7bda-6e8d-4c85-979e-f4741b71ee76 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:39.791159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb7a7bda-6e8d-4c85-979e-f4741b71ee76 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:39.791867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb7a7bda-6e8d-4c85-979e-f4741b71ee76 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:39.792903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb7a7bda-6e8d-4c85-979e-f4741b71ee76 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:39.793710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb7a7bda-6e8d-4c85-979e-f4741b71ee76 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:40.055464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-250b0c07-7940-42e7-b700-903d877150e2 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b1e31883914fc9ad74440a00da8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada5914cea884080bbd23769fe91eb43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:40.072950 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-250b0c07-7940-42e7-b700-903d877150e2 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea" status: 200 len: 1324 microversion: 2.1 time: 0.352633 May 27 15:12:40.075860 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1885/3784] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:39 2022] GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea => generated 1324 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:40.103542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fb7a7bda-6e8d-4c85-979e-f4741b71ee76 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:40.114120 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fb7a7bda-6e8d-4c85-979e-f4741b71ee76 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1198 microversion: 2.1 time: 0.336679 May 27 15:12:40.115342 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1900/3785] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:39 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1198 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:40.498085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4107a9ce-1f37-4b68-b80c-cd0f2429cebd tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:40.498718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4107a9ce-1f37-4b68-b80c-cd0f2429cebd tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:40.512766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4107a9ce-1f37-4b68-b80c-cd0f2429cebd tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:40.514586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4107a9ce-1f37-4b68-b80c-cd0f2429cebd tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:40.517822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4107a9ce-1f37-4b68-b80c-cd0f2429cebd tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:40.518762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4107a9ce-1f37-4b68-b80c-cd0f2429cebd tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:40.663348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-61959692-a7c1-4b27-b843-8229069d209d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:40.664335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-61959692-a7c1-4b27-b843-8229069d209d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:40.679012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-61959692-a7c1-4b27-b843-8229069d209d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:40.679485 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-61959692-a7c1-4b27-b843-8229069d209d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:40.680300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-61959692-a7c1-4b27-b843-8229069d209d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:40.680778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-61959692-a7c1-4b27-b843-8229069d209d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:40.723199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4107a9ce-1f37-4b68-b80c-cd0f2429cebd tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d5eff0d83a4108b853931be9d170d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:40.735699 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4107a9ce-1f37-4b68-b80c-cd0f2429cebd tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d" status: 200 len: 1394 microversion: 2.1 time: 0.239567 May 27 15:12:40.736327 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1886/3786] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:40 2022] GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d => generated 1394 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:40.893691 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-61959692-a7c1-4b27-b843-8229069d209d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:40.904087 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-61959692-a7c1-4b27-b843-8229069d209d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1371 microversion: 2.1 time: 0.244539 May 27 15:12:40.905373 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1901/3787] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:40 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:41.044699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-b86361c8-5a4d-4c5d-897e-c30d3be62539 req-03d4efe8-8496-450b-80d2-759b1e599d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b200dfd-ec26-41af-9dd2-d82d6f476d6d", "name": "network-vif-plugged", "status": "completed", "tag": "227ff72f-f1a5-4b57-8615-ad52676cf026"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:41.061519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-b86361c8-5a4d-4c5d-897e-c30d3be62539 req-03d4efe8-8496-450b-80d2-759b1e599d5a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:41.064236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-b86361c8-5a4d-4c5d-897e-c30d3be62539 req-03d4efe8-8496-450b-80d2-759b1e599d5a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:41.104942 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-b86361c8-5a4d-4c5d-897e-c30d3be62539 req-03d4efe8-8496-450b-80d2-759b1e599d5a service nova] Creating event network-vif-plugged:227ff72f-f1a5-4b57-8615-ad52676cf026 for instance 2b200dfd-ec26-41af-9dd2-d82d6f476d6d on n-h2-843621-1 May 27 15:12:41.113836 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-b86361c8-5a4d-4c5d-897e-c30d3be62539 req-03d4efe8-8496-450b-80d2-759b1e599d5a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074905 May 27 15:12:41.116361 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1902/3788] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:41.126583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f9074005-3d22-4e18-902f-511eb496bb98 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:41.127668 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f9074005-3d22-4e18-902f-511eb496bb98 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] [instance: 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:41.139779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9074005-3d22-4e18-902f-511eb496bb98 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:41.140489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9074005-3d22-4e18-902f-511eb496bb98 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:41.141813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9074005-3d22-4e18-902f-511eb496bb98 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:41.142474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f9074005-3d22-4e18-902f-511eb496bb98 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:41.284045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-51e542ce-ed8a-41a8-bc2d-83697a87a131 req-d0458cf5-0394-476c-b071-6b7e943145a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea", "tag": "10b9a1e0-5700-4f1f-92db-df6325c1bac9"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:41.294200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-51e542ce-ed8a-41a8-bc2d-83697a87a131 req-d0458cf5-0394-476c-b071-6b7e943145a9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:41.295040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-51e542ce-ed8a-41a8-bc2d-83697a87a131 req-d0458cf5-0394-476c-b071-6b7e943145a9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:41.310898 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-51e542ce-ed8a-41a8-bc2d-83697a87a131 req-d0458cf5-0394-476c-b071-6b7e943145a9 service nova] Creating event network-changed:10b9a1e0-5700-4f1f-92db-df6325c1bac9 for instance 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea on n-h2-843621-1 May 27 15:12:41.316643 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-51e542ce-ed8a-41a8-bc2d-83697a87a131 req-d0458cf5-0394-476c-b071-6b7e943145a9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.292209 May 27 15:12:41.318141 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1887/3789] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:12:41.326570 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bf4f899b-71b4-4d3a-927f-2d3178ea28a7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:41.327730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bf4f899b-71b4-4d3a-927f-2d3178ea28a7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:41.336011 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf4f899b-71b4-4d3a-927f-2d3178ea28a7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:41.336835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf4f899b-71b4-4d3a-927f-2d3178ea28a7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:41.338076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf4f899b-71b4-4d3a-927f-2d3178ea28a7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:41.339321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf4f899b-71b4-4d3a-927f-2d3178ea28a7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:41.352620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:41.544661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f9074005-3d22-4e18-902f-511eb496bb98 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b1e31883914fc9ad74440a00da8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada5914cea884080bbd23769fe91eb43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:41.552413 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f9074005-3d22-4e18-902f-511eb496bb98 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea" status: 200 len: 1324 microversion: 2.1 time: 0.433510 May 27 15:12:41.553066 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1903/3790] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:41 2022] GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea => generated 1324 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:41.613599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bf4f899b-71b4-4d3a-927f-2d3178ea28a7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:41.625043 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bf4f899b-71b4-4d3a-927f-2d3178ea28a7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1198 microversion: 2.1 time: 0.305066 May 27 15:12:41.627291 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1888/3791] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:41 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1198 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:41.753196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-28e02e61-854e-4005-9b12-976fe4a9999a tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:41.753958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-28e02e61-854e-4005-9b12-976fe4a9999a tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:41.758633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:41.769888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-28e02e61-854e-4005-9b12-976fe4a9999a tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:41.781602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-28e02e61-854e-4005-9b12-976fe4a9999a tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:41.782717 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-28e02e61-854e-4005-9b12-976fe4a9999a tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:41.783375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-28e02e61-854e-4005-9b12-976fe4a9999a tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:41.921767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-66c00351-ebc0-4e6f-b740-4ec6b80c26cf tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:41.922398 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-66c00351-ebc0-4e6f-b740-4ec6b80c26cf tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:41.932545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66c00351-ebc0-4e6f-b740-4ec6b80c26cf tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:41.936751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66c00351-ebc0-4e6f-b740-4ec6b80c26cf tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:41.937673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66c00351-ebc0-4e6f-b740-4ec6b80c26cf tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:41.938367 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66c00351-ebc0-4e6f-b740-4ec6b80c26cf tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:42.153573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-28e02e61-854e-4005-9b12-976fe4a9999a tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d5eff0d83a4108b853931be9d170d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:42.163611 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-28e02e61-854e-4005-9b12-976fe4a9999a tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d" status: 200 len: 1394 microversion: 2.1 time: 0.414042 May 27 15:12:42.165407 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1904/3792] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:41 2022] GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d => generated 1394 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:42.232726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-66c00351-ebc0-4e6f-b740-4ec6b80c26cf tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:42.242637 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-66c00351-ebc0-4e6f-b740-4ec6b80c26cf tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1371 microversion: 2.1 time: 0.324675 May 27 15:12:42.244227 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1889/3793] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:41 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1371 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:42.572170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-29548a70-0348-433d-9029-44e8d06fbb02 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:42.573223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-29548a70-0348-433d-9029-44e8d06fbb02 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] [instance: 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:42.590317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-29548a70-0348-433d-9029-44e8d06fbb02 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:42.591182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-29548a70-0348-433d-9029-44e8d06fbb02 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:42.592219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-29548a70-0348-433d-9029-44e8d06fbb02 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:42.592825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-29548a70-0348-433d-9029-44e8d06fbb02 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:42.782845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-29548a70-0348-433d-9029-44e8d06fbb02 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b1e31883914fc9ad74440a00da8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada5914cea884080bbd23769fe91eb43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:42.792769 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-29548a70-0348-433d-9029-44e8d06fbb02 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea" status: 200 len: 1324 microversion: 2.1 time: 0.225787 May 27 15:12:42.794012 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1890/3794] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:42 2022] GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea => generated 1324 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:42.799983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-873ec382-7e94-4aee-b137-dfb059129d9a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:42.801094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-873ec382-7e94-4aee-b137-dfb059129d9a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:42.808241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-873ec382-7e94-4aee-b137-dfb059129d9a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:42.808998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-873ec382-7e94-4aee-b137-dfb059129d9a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:42.809911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-873ec382-7e94-4aee-b137-dfb059129d9a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:42.810714 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-873ec382-7e94-4aee-b137-dfb059129d9a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:42.855212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3c8ac342-79bc-4aeb-90d8-ad2f59f13b8e tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-60340169", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "679655d2-a742-4023-9597-82c7470228c7"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:42.944585 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-3c8ac342-79bc-4aeb-90d8-ad2f59f13b8e tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] validate_networks() for [('679655d2-a742-4023-9597-82c7470228c7', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:12:42.963896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=18 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:43.066346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-873ec382-7e94-4aee-b137-dfb059129d9a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:43.075744 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-873ec382-7e94-4aee-b137-dfb059129d9a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1198 microversion: 2.1 time: 0.280376 May 27 15:12:43.076343 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1891/3795] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:42 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1198 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:43.182568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-13d66f9b-0be8-436c-8549-8403bc1a0c68 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:43.183568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-13d66f9b-0be8-436c-8549-8403bc1a0c68 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:43.201050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13d66f9b-0be8-436c-8549-8403bc1a0c68 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:43.201893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13d66f9b-0be8-436c-8549-8403bc1a0c68 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:43.202865 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13d66f9b-0be8-436c-8549-8403bc1a0c68 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:43.203831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13d66f9b-0be8-436c-8549-8403bc1a0c68 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:43.535938 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-13d66f9b-0be8-436c-8549-8403bc1a0c68 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d5eff0d83a4108b853931be9d170d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:43.545394 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-13d66f9b-0be8-436c-8549-8403bc1a0c68 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d" status: 200 len: 1394 microversion: 2.1 time: 0.369025 May 27 15:12:43.547555 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1892/3796] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:43 2022] GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d => generated 1394 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:43.577096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-51c53f06-6b5c-4757-9518-27b6aa5c5596 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:43.577874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-51c53f06-6b5c-4757-9518-27b6aa5c5596 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:43.591172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51c53f06-6b5c-4757-9518-27b6aa5c5596 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:43.591645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51c53f06-6b5c-4757-9518-27b6aa5c5596 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:43.592474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51c53f06-6b5c-4757-9518-27b6aa5c5596 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:43.592949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51c53f06-6b5c-4757-9518-27b6aa5c5596 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:43.759318 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3c8ac342-79bc-4aeb-90d8-ad2f59f13b8e tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:12:43.759933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3c8ac342-79bc-4aeb-90d8-ad2f59f13b8e tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:12:43.760933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3c8ac342-79bc-4aeb-90d8-ad2f59f13b8e tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:12:43.761823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3c8ac342-79bc-4aeb-90d8-ad2f59f13b8e tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:12:43.762355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3c8ac342-79bc-4aeb-90d8-ad2f59f13b8e tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:12:43.792008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c8ac342-79bc-4aeb-90d8-ad2f59f13b8e tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:43.795721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c8ac342-79bc-4aeb-90d8-ad2f59f13b8e tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:43.797846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c8ac342-79bc-4aeb-90d8-ad2f59f13b8e tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:43.802255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c8ac342-79bc-4aeb-90d8-ad2f59f13b8e tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:43.802495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:43.843595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-51c53f06-6b5c-4757-9518-27b6aa5c5596 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:43.857657 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-51c53f06-6b5c-4757-9518-27b6aa5c5596 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1371 microversion: 2.1 time: 0.308088 May 27 15:12:43.859116 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1893/3797] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:43 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1371 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:43.865522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-be0648db-23ea-4fa5-9a1a-2e9fc1753081 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:43.866683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-3c8ac342-79bc-4aeb-90d8-ad2f59f13b8e tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Getting quotas for project 4a2ec376b67a4b62886183fd5041a582. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:12:43.873783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-be0648db-23ea-4fa5-9a1a-2e9fc1753081 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] [instance: 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:43.881583 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=16 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:43.886449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-3c8ac342-79bc-4aeb-90d8-ad2f59f13b8e tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Getting quotas for user bd15db99e887484783bdb07197b5efc8 and project 4a2ec376b67a4b62886183fd5041a582. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:12:43.900330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be0648db-23ea-4fa5-9a1a-2e9fc1753081 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:43.905602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be0648db-23ea-4fa5-9a1a-2e9fc1753081 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:43.907053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be0648db-23ea-4fa5-9a1a-2e9fc1753081 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:43.918195 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be0648db-23ea-4fa5-9a1a-2e9fc1753081 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:43.926480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3c8ac342-79bc-4aeb-90d8-ad2f59f13b8e tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:12:43.945455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3c8ac342-79bc-4aeb-90d8-ad2f59f13b8e tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:12:44.063766 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3c8ac342-79bc-4aeb-90d8-ad2f59f13b8e tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.607192 May 27 15:12:44.065781 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1905/3798] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:12:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:12:44.075194 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-203758a9-4c9c-457d-aad5-19c39b6f1562 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:44.075933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-203758a9-4c9c-457d-aad5-19c39b6f1562 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:44.229542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-203758a9-4c9c-457d-aad5-19c39b6f1562 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd15db99e887484783bdb07197b5efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2ec376b67a4b62886183fd5041a582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:44.243641 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-203758a9-4c9c-457d-aad5-19c39b6f1562 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864" status: 200 len: 1215 microversion: 2.1 time: 0.172586 May 27 15:12:44.244251 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1906/3799] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:44 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864 => generated 1215 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:44.258396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7b6376f3-1bad-4c24-88f9-1038f09163af tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:44.259284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7b6376f3-1bad-4c24-88f9-1038f09163af tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:44.273964 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7b6376f3-1bad-4c24-88f9-1038f09163af tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:44.275876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7b6376f3-1bad-4c24-88f9-1038f09163af tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:44.277041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7b6376f3-1bad-4c24-88f9-1038f09163af tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:44.280213 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7b6376f3-1bad-4c24-88f9-1038f09163af tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:44.289950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-be0648db-23ea-4fa5-9a1a-2e9fc1753081 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b1e31883914fc9ad74440a00da8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada5914cea884080bbd23769fe91eb43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:44.304044 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-be0648db-23ea-4fa5-9a1a-2e9fc1753081 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea" status: 200 len: 1324 microversion: 2.1 time: 0.443362 May 27 15:12:44.307326 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1894/3800] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:43 2022] GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea => generated 1324 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:44.313152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-27eae999-e17f-487d-8ac5-2f6c46088aec req-60d2b771-f545-4bf9-aa51-3366ecb85670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0315e4-284c-4269-86ea-b5ac6e3b4084", "name": "network-vif-plugged", "status": "completed", "tag": "06db990f-6e8f-4fb3-b9b9-a0416d4a7cef"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:44.328153 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-27eae999-e17f-487d-8ac5-2f6c46088aec req-60d2b771-f545-4bf9-aa51-3366ecb85670 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:44.329044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-27eae999-e17f-487d-8ac5-2f6c46088aec req-60d2b771-f545-4bf9-aa51-3366ecb85670 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:44.347193 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-27eae999-e17f-487d-8ac5-2f6c46088aec req-60d2b771-f545-4bf9-aa51-3366ecb85670 service nova] Creating event network-vif-plugged:06db990f-6e8f-4fb3-b9b9-a0416d4a7cef for instance 0e0315e4-284c-4269-86ea-b5ac6e3b4084 on n-h1-843621-1 May 27 15:12:44.374314 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-27eae999-e17f-487d-8ac5-2f6c46088aec req-60d2b771-f545-4bf9-aa51-3366ecb85670 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065125 May 27 15:12:44.376410 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1895/3801] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:44.568310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-177b00f3-047d-4fa0-b923-4a5888d39959 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:44.570372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-177b00f3-047d-4fa0-b923-4a5888d39959 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:44.580071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7b6376f3-1bad-4c24-88f9-1038f09163af tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:44.590064 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7b6376f3-1bad-4c24-88f9-1038f09163af tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1198 microversion: 2.1 time: 0.341779 May 27 15:12:44.592129 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1907/3802] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:44 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1198 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:44.604924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-177b00f3-047d-4fa0-b923-4a5888d39959 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:44.605758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-177b00f3-047d-4fa0-b923-4a5888d39959 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:44.607389 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-177b00f3-047d-4fa0-b923-4a5888d39959 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:44.608561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-177b00f3-047d-4fa0-b923-4a5888d39959 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:44.847354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-177b00f3-047d-4fa0-b923-4a5888d39959 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d5eff0d83a4108b853931be9d170d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:44.861570 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-177b00f3-047d-4fa0-b923-4a5888d39959 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d" status: 200 len: 1574 microversion: 2.1 time: 0.300651 May 27 15:12:44.863021 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1896/3803] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:44 2022] GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d => generated 1574 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:44.883017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-245c71dd-a487-462a-a352-f884f2f95382 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:44.883831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-245c71dd-a487-462a-a352-f884f2f95382 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:44.885274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-75e7fa7a-dda1-4a6f-bf68-39fa111a5e30 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:44.890071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-75e7fa7a-dda1-4a6f-bf68-39fa111a5e30 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:44.902478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75e7fa7a-dda1-4a6f-bf68-39fa111a5e30 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:44.903204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75e7fa7a-dda1-4a6f-bf68-39fa111a5e30 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:44.907126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-245c71dd-a487-462a-a352-f884f2f95382 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:44.907698 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75e7fa7a-dda1-4a6f-bf68-39fa111a5e30 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:44.908525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75e7fa7a-dda1-4a6f-bf68-39fa111a5e30 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:44.912262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-245c71dd-a487-462a-a352-f884f2f95382 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:44.914226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-245c71dd-a487-462a-a352-f884f2f95382 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:44.914897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-245c71dd-a487-462a-a352-f884f2f95382 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:45.090627 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-245c71dd-a487-462a-a352-f884f2f95382 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.212115 May 27 15:12:45.091267 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1897/3804] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 15:12:44 2022] GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d/os-interface => generated 284 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:45.261345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-88374c6d-475c-4b7d-aaab-9d94bb17c72a tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:45.262452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-88374c6d-475c-4b7d-aaab-9d94bb17c72a tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:45.270034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-88374c6d-475c-4b7d-aaab-9d94bb17c72a tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:45.270763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-88374c6d-475c-4b7d-aaab-9d94bb17c72a tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:45.271741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-88374c6d-475c-4b7d-aaab-9d94bb17c72a tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:45.272964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-88374c6d-475c-4b7d-aaab-9d94bb17c72a tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:45.274567 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-75e7fa7a-dda1-4a6f-bf68-39fa111a5e30 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:45.283341 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-75e7fa7a-dda1-4a6f-bf68-39fa111a5e30 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1371 microversion: 2.1 time: 0.406457 May 27 15:12:45.292911 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1908/3805] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:44 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1371 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:45.329534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-81a3d448-5134-4047-b484-91692c06767c tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:45.332591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-81a3d448-5134-4047-b484-91692c06767c tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] [instance: 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:45.342335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-81a3d448-5134-4047-b484-91692c06767c tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:45.342870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-81a3d448-5134-4047-b484-91692c06767c tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:45.344081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-81a3d448-5134-4047-b484-91692c06767c tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:45.344792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-81a3d448-5134-4047-b484-91692c06767c tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:45.405896 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-88374c6d-475c-4b7d-aaab-9d94bb17c72a tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd15db99e887484783bdb07197b5efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2ec376b67a4b62886183fd5041a582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:45.418094 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-88374c6d-475c-4b7d-aaab-9d94bb17c72a tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864" status: 200 len: 1211 microversion: 2.1 time: 0.160833 May 27 15:12:45.422607 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1898/3806] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:45 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864 => generated 1211 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:45.571820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-81a3d448-5134-4047-b484-91692c06767c tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b1e31883914fc9ad74440a00da8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada5914cea884080bbd23769fe91eb43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:45.583840 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-81a3d448-5134-4047-b484-91692c06767c tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea" status: 200 len: 1324 microversion: 2.1 time: 0.265497 May 27 15:12:45.586018 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1909/3807] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:45 2022] GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea => generated 1324 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:45.613629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d7dbe180-458b-4f1b-9bb0-452771dbc500 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:45.614553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d7dbe180-458b-4f1b-9bb0-452771dbc500 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:45.624261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d7dbe180-458b-4f1b-9bb0-452771dbc500 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:45.627266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d7dbe180-458b-4f1b-9bb0-452771dbc500 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:45.628667 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d7dbe180-458b-4f1b-9bb0-452771dbc500 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:45.629325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d7dbe180-458b-4f1b-9bb0-452771dbc500 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:45.887919 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d7dbe180-458b-4f1b-9bb0-452771dbc500 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:45.902787 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d7dbe180-458b-4f1b-9bb0-452771dbc500 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1198 microversion: 2.1 time: 0.292024 May 27 15:12:45.912252 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1899/3808] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:45 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1198 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:46.309498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1e843925-5e13-4b3a-9060-f29ab0a15ab0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:46.311495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1e843925-5e13-4b3a-9060-f29ab0a15ab0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:46.321731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e843925-5e13-4b3a-9060-f29ab0a15ab0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:46.323456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e843925-5e13-4b3a-9060-f29ab0a15ab0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:46.325248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e843925-5e13-4b3a-9060-f29ab0a15ab0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:46.326277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e843925-5e13-4b3a-9060-f29ab0a15ab0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:46.438498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2338910d-2e36-46c1-8ba3-eff79ce28f0f tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:46.439136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2338910d-2e36-46c1-8ba3-eff79ce28f0f tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:46.449661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2338910d-2e36-46c1-8ba3-eff79ce28f0f tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:46.450411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2338910d-2e36-46c1-8ba3-eff79ce28f0f tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:46.451425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2338910d-2e36-46c1-8ba3-eff79ce28f0f tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:46.452076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2338910d-2e36-46c1-8ba3-eff79ce28f0f tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:46.954360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2338910d-2e36-46c1-8ba3-eff79ce28f0f tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd15db99e887484783bdb07197b5efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2ec376b67a4b62886183fd5041a582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:46.971127 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2338910d-2e36-46c1-8ba3-eff79ce28f0f tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864" status: 200 len: 1315 microversion: 2.1 time: 0.536839 May 27 15:12:46.973432 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1900/3809] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:46 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864 => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:46.991980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b1a95566-676d-43cf-a68d-583de16856b1 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:46.993785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b1a95566-676d-43cf-a68d-583de16856b1 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] [instance: 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:47.007360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b1a95566-676d-43cf-a68d-583de16856b1 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:47.007820 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b1a95566-676d-43cf-a68d-583de16856b1 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:47.008597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b1a95566-676d-43cf-a68d-583de16856b1 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:47.009094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b1a95566-676d-43cf-a68d-583de16856b1 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:47.034816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1e843925-5e13-4b3a-9060-f29ab0a15ab0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:47.049210 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1e843925-5e13-4b3a-9060-f29ab0a15ab0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1371 microversion: 2.1 time: 0.747186 May 27 15:12:47.050844 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1910/3810] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:46 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1371 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:47.057808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3568ee32-8d9a-4b98-972d-cc83eb74a338 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:47.058676 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3568ee32-8d9a-4b98-972d-cc83eb74a338 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:47.066880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3568ee32-8d9a-4b98-972d-cc83eb74a338 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:47.067821 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3568ee32-8d9a-4b98-972d-cc83eb74a338 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:47.069399 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3568ee32-8d9a-4b98-972d-cc83eb74a338 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:47.070001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3568ee32-8d9a-4b98-972d-cc83eb74a338 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:47.356055 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b1a95566-676d-43cf-a68d-583de16856b1 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b1e31883914fc9ad74440a00da8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada5914cea884080bbd23769fe91eb43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:47.372987 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b1a95566-676d-43cf-a68d-583de16856b1 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea" status: 200 len: 1324 microversion: 2.1 time: 0.393701 May 27 15:12:47.374225 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1901/3811] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:46 2022] GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea => generated 1324 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:47.384856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-48773edb-d526-4f65-bd02-0154ca2fa840 req-0aea2e67-f957-409b-b0fd-8602511bee17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea", "name": "network-vif-plugged", "status": "completed", "tag": "10b9a1e0-5700-4f1f-92db-df6325c1bac9"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:47.396411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:47.400405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-48773edb-d526-4f65-bd02-0154ca2fa840 req-0aea2e67-f957-409b-b0fd-8602511bee17 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:47.401079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-48773edb-d526-4f65-bd02-0154ca2fa840 req-0aea2e67-f957-409b-b0fd-8602511bee17 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:47.424208 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-48773edb-d526-4f65-bd02-0154ca2fa840 req-0aea2e67-f957-409b-b0fd-8602511bee17 service nova] Creating event network-vif-plugged:10b9a1e0-5700-4f1f-92db-df6325c1bac9 for instance 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea on n-h2-843621-1 May 27 15:12:47.429667 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-48773edb-d526-4f65-bd02-0154ca2fa840 req-0aea2e67-f957-409b-b0fd-8602511bee17 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053903 May 27 15:12:47.430614 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1902/3812] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:47.437251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b576cf30-5a7f-4b97-b542-f7fb69482752 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:47.438247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b576cf30-5a7f-4b97-b542-f7fb69482752 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:47.459170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b576cf30-5a7f-4b97-b542-f7fb69482752 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:47.460611 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b576cf30-5a7f-4b97-b542-f7fb69482752 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:47.461835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b576cf30-5a7f-4b97-b542-f7fb69482752 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:47.462993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b576cf30-5a7f-4b97-b542-f7fb69482752 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:47.468973 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3568ee32-8d9a-4b98-972d-cc83eb74a338 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:47.489125 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3568ee32-8d9a-4b98-972d-cc83eb74a338 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1382 microversion: 2.1 time: 0.435758 May 27 15:12:47.494637 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1911/3813] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:47 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1382 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:47.504984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-6454eb42-629e-44bf-97bc-8e2acf7f5878 req-ca1d51fc-f728-49f7-b487-b615a0ba300f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b200dfd-ec26-41af-9dd2-d82d6f476d6d", "tag": "227ff72f-f1a5-4b57-8615-ad52676cf026"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:47.539353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-6454eb42-629e-44bf-97bc-8e2acf7f5878 req-ca1d51fc-f728-49f7-b487-b615a0ba300f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:47.541725 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-6454eb42-629e-44bf-97bc-8e2acf7f5878 req-ca1d51fc-f728-49f7-b487-b615a0ba300f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:47.567581 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-6454eb42-629e-44bf-97bc-8e2acf7f5878 req-ca1d51fc-f728-49f7-b487-b615a0ba300f service nova] Creating event network-changed:227ff72f-f1a5-4b57-8615-ad52676cf026 for instance 2b200dfd-ec26-41af-9dd2-d82d6f476d6d on n-h2-843621-1 May 27 15:12:47.583416 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-6454eb42-629e-44bf-97bc-8e2acf7f5878 req-ca1d51fc-f728-49f7-b487-b615a0ba300f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086829 May 27 15:12:47.584920 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1912/3814] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:47.781196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b576cf30-5a7f-4b97-b542-f7fb69482752 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d5eff0d83a4108b853931be9d170d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:47.790765 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b576cf30-5a7f-4b97-b542-f7fb69482752 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d" status: 200 len: 1574 microversion: 2.1 time: 0.358683 May 27 15:12:47.791365 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1903/3815] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:47 2022] GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d => generated 1574 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:48.015520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dea0a9f8-196b-40ee-a7ef-3bc4ffcb49f5 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:48.016353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dea0a9f8-196b-40ee-a7ef-3bc4ffcb49f5 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:48.030756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dea0a9f8-196b-40ee-a7ef-3bc4ffcb49f5 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:48.031234 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dea0a9f8-196b-40ee-a7ef-3bc4ffcb49f5 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:48.032042 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dea0a9f8-196b-40ee-a7ef-3bc4ffcb49f5 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:48.032593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dea0a9f8-196b-40ee-a7ef-3bc4ffcb49f5 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:48.104032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-46e66ab6-b3a0-40a8-80cf-c0ab52256dd4 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:48.111404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-46e66ab6-b3a0-40a8-80cf-c0ab52256dd4 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:48.121235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-46e66ab6-b3a0-40a8-80cf-c0ab52256dd4 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:48.122234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-46e66ab6-b3a0-40a8-80cf-c0ab52256dd4 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:48.123469 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-46e66ab6-b3a0-40a8-80cf-c0ab52256dd4 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:48.124549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-46e66ab6-b3a0-40a8-80cf-c0ab52256dd4 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:48.263972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dea0a9f8-196b-40ee-a7ef-3bc4ffcb49f5 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd15db99e887484783bdb07197b5efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2ec376b67a4b62886183fd5041a582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:48.278022 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dea0a9f8-196b-40ee-a7ef-3bc4ffcb49f5 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864" status: 200 len: 1315 microversion: 2.1 time: 0.267131 May 27 15:12:48.280607 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1904/3816] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:48 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:48.287570 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d675b36f-6dcd-4737-be83-de599c543080 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:48.295082 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d675b36f-6dcd-4737-be83-de599c543080 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:48.311443 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d675b36f-6dcd-4737-be83-de599c543080 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:48.312415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d675b36f-6dcd-4737-be83-de599c543080 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:48.313902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d675b36f-6dcd-4737-be83-de599c543080 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:48.314598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d675b36f-6dcd-4737-be83-de599c543080 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:48.552392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:48.560459 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-46e66ab6-b3a0-40a8-80cf-c0ab52256dd4 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1533 microversion: 2.1 time: 0.974301 May 27 15:12:48.572184 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1913/3817] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:47 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1533 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:48.577837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-4e36aa58-5372-4d7a-bcd9-d99655ef6ce0 req-0fc84571-0dd3-4024-8385-9e53f572c3de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70325c3b-8ac4-4d4e-a4bd-bf9a20750864", "tag": "f0a4ae70-53df-486f-8a4c-2f31d664e450"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:48.578177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d675b36f-6dcd-4737-be83-de599c543080 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:48.587055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-4e36aa58-5372-4d7a-bcd9-d99655ef6ce0 req-0fc84571-0dd3-4024-8385-9e53f572c3de service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:48.587316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-4e36aa58-5372-4d7a-bcd9-d99655ef6ce0 req-0fc84571-0dd3-4024-8385-9e53f572c3de service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:48.587629 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d675b36f-6dcd-4737-be83-de599c543080 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1371 microversion: 2.1 time: 0.305466 May 27 15:12:48.596728 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1905/3818] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:48 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1371 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:48.596728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dd025793-9427-4e09-a478-bd62add1f5d1 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:48.596728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dd025793-9427-4e09-a478-bd62add1f5d1 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] [instance: 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:48.601609 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-4e36aa58-5372-4d7a-bcd9-d99655ef6ce0 req-0fc84571-0dd3-4024-8385-9e53f572c3de service nova] Creating event network-changed:f0a4ae70-53df-486f-8a4c-2f31d664e450 for instance 70325c3b-8ac4-4d4e-a4bd-bf9a20750864 on n-h2-843621-1 May 27 15:12:48.607582 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd025793-9427-4e09-a478-bd62add1f5d1 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:48.608537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd025793-9427-4e09-a478-bd62add1f5d1 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:48.609257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd025793-9427-4e09-a478-bd62add1f5d1 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:48.610299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd025793-9427-4e09-a478-bd62add1f5d1 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:48.617761 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-4e36aa58-5372-4d7a-bcd9-d99655ef6ce0 req-0fc84571-0dd3-4024-8385-9e53f572c3de service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043872 May 27 15:12:48.621670 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1914/3819] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:48.633995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:48.642191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-06e95552-3430-4bf6-b0d6-4e26b8391826 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:48.643098 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-06e95552-3430-4bf6-b0d6-4e26b8391826 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:48.652049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06e95552-3430-4bf6-b0d6-4e26b8391826 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:48.652885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06e95552-3430-4bf6-b0d6-4e26b8391826 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:48.654181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06e95552-3430-4bf6-b0d6-4e26b8391826 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:48.654808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06e95552-3430-4bf6-b0d6-4e26b8391826 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:48.883054 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dd025793-9427-4e09-a478-bd62add1f5d1 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b1e31883914fc9ad74440a00da8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada5914cea884080bbd23769fe91eb43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:48.893296 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dd025793-9427-4e09-a478-bd62add1f5d1 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea" status: 200 len: 1324 microversion: 2.1 time: 0.303579 May 27 15:12:48.895005 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1906/3820] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:48 2022] GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea => generated 1324 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:48.903267 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-06e95552-3430-4bf6-b0d6-4e26b8391826 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1533 microversion: 2.1 time: 0.266167 May 27 15:12:48.904330 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1915/3821] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:48 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1533 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:48.921556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d1197b4e-88a0-48dd-b17c-26917b27cf75 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:48.923104 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:12:48.923104 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 15:12:48.924557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1197b4e-88a0-48dd-b17c-26917b27cf75 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:48.925237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1197b4e-88a0-48dd-b17c-26917b27cf75 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:48.926875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1197b4e-88a0-48dd-b17c-26917b27cf75 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:48.927534 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1197b4e-88a0-48dd-b17c-26917b27cf75 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:48.958119 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d1197b4e-88a0-48dd-b17c-26917b27cf75 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040602 May 27 15:12:48.966856 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1907/3822] 10.222.0.13 () {58 vars in 1175 bytes} [Fri May 27 15:12:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:48.971575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-57863f0e-d8e4-4216-ba52-bd156dd8b6b9 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-843621-1", "block_migration": false, "disk_over_commit": false}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:48.973385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-57863f0e-d8e4-4216-ba52-bd156dd8b6b9 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:48.981490 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57863f0e-d8e4-4216-ba52-bd156dd8b6b9 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:48.982204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57863f0e-d8e4-4216-ba52-bd156dd8b6b9 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:48.983146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57863f0e-d8e4-4216-ba52-bd156dd8b6b9 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:48.983623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57863f0e-d8e4-4216-ba52-bd156dd8b6b9 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:49.027213 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-57863f0e-d8e4-4216-ba52-bd156dd8b6b9 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lazy-loading 'flavor' on Instance uuid 0e0315e4-284c-4269-86ea-b5ac6e3b4084 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:12:49.041406 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-57863f0e-d8e4-4216-ba52-bd156dd8b6b9 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Going to try to live migrate instance to n-h2-843621-1 {{(pid=119248) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 27 15:12:49.297901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-16593eec-aa1a-48f4-8a5c-4bb8e5ec3cb7 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:49.301197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-16593eec-aa1a-48f4-8a5c-4bb8e5ec3cb7 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:49.310902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16593eec-aa1a-48f4-8a5c-4bb8e5ec3cb7 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:49.312236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16593eec-aa1a-48f4-8a5c-4bb8e5ec3cb7 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:49.313733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16593eec-aa1a-48f4-8a5c-4bb8e5ec3cb7 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:49.314788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16593eec-aa1a-48f4-8a5c-4bb8e5ec3cb7 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:49.542999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-16593eec-aa1a-48f4-8a5c-4bb8e5ec3cb7 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd15db99e887484783bdb07197b5efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2ec376b67a4b62886183fd5041a582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:49.553175 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-16593eec-aa1a-48f4-8a5c-4bb8e5ec3cb7 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864" status: 200 len: 1315 microversion: 2.1 time: 0.261834 May 27 15:12:49.554805 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1908/3823] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:49 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:49.559757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-46e47226-1c04-4455-a87e-9b2aca15adfd req-8e0da496-cc1f-41d3-8f95-cde6c50545a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae7e4fc8-75b6-4e3f-9fca-7e5920957283", "name": "network-vif-plugged", "status": "completed", "tag": "89fb6ad5-bc61-4f1c-b96b-4295cadf203e"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:49.568997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-46e47226-1c04-4455-a87e-9b2aca15adfd req-8e0da496-cc1f-41d3-8f95-cde6c50545a5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:49.569458 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-46e47226-1c04-4455-a87e-9b2aca15adfd req-8e0da496-cc1f-41d3-8f95-cde6c50545a5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:49.582308 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-46e47226-1c04-4455-a87e-9b2aca15adfd req-8e0da496-cc1f-41d3-8f95-cde6c50545a5 service nova] Creating event network-vif-plugged:89fb6ad5-bc61-4f1c-b96b-4295cadf203e for instance ae7e4fc8-75b6-4e3f-9fca-7e5920957283 on n-h1-843621-1 May 27 15:12:49.602471 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-46e47226-1c04-4455-a87e-9b2aca15adfd req-8e0da496-cc1f-41d3-8f95-cde6c50545a5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042881 May 27 15:12:49.603431 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1909/3824] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:49.610476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f88f1f25-ed93-4f44-922b-972992f0762f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:49.611294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f88f1f25-ed93-4f44-922b-972992f0762f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:49.621457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f88f1f25-ed93-4f44-922b-972992f0762f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:49.622026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f88f1f25-ed93-4f44-922b-972992f0762f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:49.623084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f88f1f25-ed93-4f44-922b-972992f0762f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:49.623739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f88f1f25-ed93-4f44-922b-972992f0762f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:49.832071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f88f1f25-ed93-4f44-922b-972992f0762f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:49.846865 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f88f1f25-ed93-4f44-922b-972992f0762f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1371 microversion: 2.1 time: 0.241610 May 27 15:12:49.847513 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1910/3825] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:49 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:49.913177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-84793093-eea2-4604-8ddc-d53431cb409b tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:49.914308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-84793093-eea2-4604-8ddc-d53431cb409b tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] [instance: 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:49.923009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84793093-eea2-4604-8ddc-d53431cb409b tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:49.928911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84793093-eea2-4604-8ddc-d53431cb409b tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:49.929939 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84793093-eea2-4604-8ddc-d53431cb409b tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:49.931756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84793093-eea2-4604-8ddc-d53431cb409b tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:50.155890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-84793093-eea2-4604-8ddc-d53431cb409b tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b1e31883914fc9ad74440a00da8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada5914cea884080bbd23769fe91eb43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:50.175900 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-84793093-eea2-4604-8ddc-d53431cb409b tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea" status: 200 len: 1519 microversion: 2.1 time: 0.266450 May 27 15:12:50.180747 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1911/3826] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:49 2022] GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea => generated 1519 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:50.340740 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7d97c817-44a8-4af3-98a5-4152f4a04e10 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1267897596", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "1133486f-d0a2-4dd7-bfb6-fd34c038b95b"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7d97c817-44a8-4af3-98a5-4152f4a04e10 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Request method failure captured: May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 243 May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOpf2I-SrkE2oGSeh-kyKV0XSnOqdDOSDZHg4Te5JgFGWMLV5XkqJzsNkyMWnX34xCWokWPER-ZIbF4lzW9OR3_-Hk17dr2IkjtaOAxECYnzcKEXvHv57x-85s88PmwHq9DoDjrTVRi0KDEpxGWVTKUnY-i9axbljZwjM7OH5B76wqg May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: ada5914cea884080bbd23769fe91eb43 May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-829927427", "name": "tempest-ServicesTestJSON-Service-488439402", "endpoints": []}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ada5914cea884080bbd23769fe91eb43", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "tempest-ServicesTestJSON-Type-781023997", "name": "tempest-ServicesTestJSON-Service-709070595", "endpoints": []}, {"type": "tempest-ServicesTestJSON-Type-132700515", "name": "tempest-ServicesTestJSON-Service-541304433", "endpoints": []}] May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: ada5914cea884080bbd23769fe91eb43 May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerMetadataNegativeTestJSON-441300394-project May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 63b1e31883914fc9ad74440a00da8c92 May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-441300394-project May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1267897596", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "1133486f-d0a2-4dd7-bfb6-fd34c038b95b"}]}} May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1267897596', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '1133486f-d0a2-4dd7-bfb6-fd34c038b95b'}]}}} May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise error May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi On instance['server']: May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'': 'data1'} May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:12:50.346514 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7d97c817-44a8-4af3-98a5-4152f4a04e10 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7d97c817-44a8-4af3-98a5-4152f4a04e10 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.017292 May 27 15:12:50.354002 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1912/3827] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:12:50 2022] POST /compute/v2.1/servers => generated 175 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 27 15:12:50.379220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1e99fcbd-a7f4-42fb-8667-b1cee4074b53 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:50.380093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1e99fcbd-a7f4-42fb-8667-b1cee4074b53 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] [instance: 278bc625-ed3c-4c0f-bfcf-5c7a30c70609] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:50.392815 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-1e99fcbd-a7f4-42fb-8667-b1cee4074b53 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] HTTP exception thrown: Instance 278bc625-ed3c-4c0f-bfcf-5c7a30c70609 could not be found. May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1e99fcbd-a7f4-42fb-8667-b1cee4074b53 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Request method failure captured: May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/278bc625-ed3c-4c0f-bfcf-5c7a30c70609/metadata HTTP/1.1 May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOpf2I-SrkE2oGSeh-kyKV0XSnOqdDOSDZHg4Te5JgFGWMLV5XkqJzsNkyMWnX34xCWokWPER-ZIbF4lzW9OR3_-Hk17dr2IkjtaOAxECYnzcKEXvHv57x-85s88PmwHq9DoDjrTVRi0KDEpxGWVTKUnY-i9axbljZwjM7OH5B76wqg May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: ada5914cea884080bbd23769fe91eb43 May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-829927427", "name": "tempest-ServicesTestJSON-Service-488439402", "endpoints": []}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ada5914cea884080bbd23769fe91eb43", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "tempest-ServicesTestJSON-Type-781023997", "name": "tempest-ServicesTestJSON-Service-709070595", "endpoints": []}, {"type": "tempest-ServicesTestJSON-Type-132700515", "name": "tempest-ServicesTestJSON-Service-541304433", "endpoints": []}] May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: ada5914cea884080bbd23769fe91eb43 May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerMetadataNegativeTestJSON-441300394-project May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 63b1e31883914fc9ad74440a00da8c92 May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-441300394-project May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 278bc625-ed3c-4c0f-bfcf-5c7a30c70609 could not be found. May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'server_id': '278bc625-ed3c-4c0f-bfcf-5c7a30c70609'} May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 278bc625-ed3c-4c0f-bfcf-5c7a30c70609 could not be found. May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 278bc625-ed3c-4c0f-bfcf-5c7a30c70609 could not be found. May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.397498 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:50.404146 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.404146 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:50.404146 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:50.404146 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:50.404146 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:12:50.404146 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:12:50.404146 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 278bc625-ed3c-4c0f-bfcf-5c7a30c70609 could not be found. May 27 15:12:50.404146 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.404146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1e99fcbd-a7f4-42fb-8667-b1cee4074b53 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Returning 404 to user: Instance 278bc625-ed3c-4c0f-bfcf-5c7a30c70609 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:12:50.404146 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1e99fcbd-a7f4-42fb-8667-b1cee4074b53 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "GET /compute/v2.1/servers/278bc625-ed3c-4c0f-bfcf-5c7a30c70609/metadata" status: 404 len: 111 microversion: 2.1 time: 0.031403 May 27 15:12:50.404146 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1913/3828] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 15:12:50 2022] GET /compute/v2.1/servers/278bc625-ed3c-4c0f-bfcf-5c7a30c70609/metadata => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:12:50.574401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bd202e8e-7aa0-46bd-b11e-0edf638d4762 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:50.575047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bd202e8e-7aa0-46bd-b11e-0edf638d4762 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:50.581777 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd202e8e-7aa0-46bd-b11e-0edf638d4762 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:50.582244 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd202e8e-7aa0-46bd-b11e-0edf638d4762 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:50.583033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd202e8e-7aa0-46bd-b11e-0edf638d4762 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:50.583485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd202e8e-7aa0-46bd-b11e-0edf638d4762 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:50.751119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bd202e8e-7aa0-46bd-b11e-0edf638d4762 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd15db99e887484783bdb07197b5efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2ec376b67a4b62886183fd5041a582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:50.761787 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bd202e8e-7aa0-46bd-b11e-0edf638d4762 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864" status: 200 len: 1315 microversion: 2.1 time: 0.191618 May 27 15:12:50.762536 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1914/3829] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:50 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:50.767699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2c5fe0b3-4787-403f-928c-41846051e172 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-424626085", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1133486f-d0a2-4dd7-bfb6-fd34c038b95b"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2c5fe0b3-4787-403f-928c-41846051e172 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Request method failure captured: May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 498 May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOpf2I-SrkE2oGSeh-kyKV0XSnOqdDOSDZHg4Te5JgFGWMLV5XkqJzsNkyMWnX34xCWokWPER-ZIbF4lzW9OR3_-Hk17dr2IkjtaOAxECYnzcKEXvHv57x-85s88PmwHq9DoDjrTVRi0KDEpxGWVTKUnY-i9axbljZwjM7OH5B76wqg May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: ada5914cea884080bbd23769fe91eb43 May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-829927427", "name": "tempest-ServicesTestJSON-Service-488439402", "endpoints": []}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ada5914cea884080bbd23769fe91eb43", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "tempest-ServicesTestJSON-Type-781023997", "name": "tempest-ServicesTestJSON-Service-709070595", "endpoints": []}, {"type": "tempest-ServicesTestJSON-Type-132700515", "name": "tempest-ServicesTestJSON-Service-541304433", "endpoints": []}] May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: ada5914cea884080bbd23769fe91eb43 May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerMetadataNegativeTestJSON-441300394-project May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 63b1e31883914fc9ad74440a00da8c92 May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-441300394-project May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-424626085", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1133486f-d0a2-4dd7-bfb6-fd34c038b95b"}]}} May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-424626085', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1133486f-d0a2-4dd7-bfb6-fd34c038b95b'}]}}} May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise error May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.771097 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi On instance['server']: May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:12:50.774338 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.777707 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2c5fe0b3-4787-403f-928c-41846051e172 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:12:50.778637 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2c5fe0b3-4787-403f-928c-41846051e172 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.014871 May 27 15:12:50.779213 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1915/3830] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:12:50 2022] POST /compute/v2.1/servers => generated 687 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:12:50.831544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ceaedce2-6ced-481a-b173-42964d8d7fa9 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-323189674", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1133486f-d0a2-4dd7-bfb6-fd34c038b95b"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ceaedce2-6ced-481a-b173-42964d8d7fa9 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Request method failure captured: May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 499 May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOpf2I-SrkE2oGSeh-kyKV0XSnOqdDOSDZHg4Te5JgFGWMLV5XkqJzsNkyMWnX34xCWokWPER-ZIbF4lzW9OR3_-Hk17dr2IkjtaOAxECYnzcKEXvHv57x-85s88PmwHq9DoDjrTVRi0KDEpxGWVTKUnY-i9axbljZwjM7OH5B76wqg May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: ada5914cea884080bbd23769fe91eb43 May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-829927427", "name": "tempest-ServicesTestJSON-Service-488439402", "endpoints": []}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ada5914cea884080bbd23769fe91eb43", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "tempest-ServicesTestJSON-Type-781023997", "name": "tempest-ServicesTestJSON-Service-709070595", "endpoints": []}, {"type": "tempest-ServicesTestJSON-Type-132700515", "name": "tempest-ServicesTestJSON-Service-541304433", "endpoints": []}] May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: ada5914cea884080bbd23769fe91eb43 May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerMetadataNegativeTestJSON-441300394-project May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 63b1e31883914fc9ad74440a00da8c92 May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-441300394-project May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-323189674", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1133486f-d0a2-4dd7-bfb6-fd34c038b95b"}]}} May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-323189674', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1133486f-d0a2-4dd7-bfb6-fd34c038b95b'}]}}} May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise error May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.834883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi On instance['server']: May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ceaedce2-6ced-481a-b173-42964d8d7fa9 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:12:50.838183 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ceaedce2-6ced-481a-b173-42964d8d7fa9 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.009246 May 27 15:12:50.841873 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1916/3831] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:12:50 2022] POST /compute/v2.1/servers => generated 689 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:12:50.866302 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bb8926e0-c255-4910-8046-2ab70121c3cd tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:50.866983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bb8926e0-c255-4910-8046-2ab70121c3cd tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:50.876435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb8926e0-c255-4910-8046-2ab70121c3cd tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:50.876839 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb8926e0-c255-4910-8046-2ab70121c3cd tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:50.877660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb8926e0-c255-4910-8046-2ab70121c3cd tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:50.878109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb8926e0-c255-4910-8046-2ab70121c3cd tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:51.029660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bb8926e0-c255-4910-8046-2ab70121c3cd tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:51.039346 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bb8926e0-c255-4910-8046-2ab70121c3cd tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1371 microversion: 2.1 time: 0.178303 May 27 15:12:51.040444 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1917/3832] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:50 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:51.047305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8b88909b-5b89-4949-9d99-de6859d1c878 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1654224028", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1133486f-d0a2-4dd7-bfb6-fd34c038b95b"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8b88909b-5b89-4949-9d99-de6859d1c878 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Request method failure captured: May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 754 May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOpf2I-SrkE2oGSeh-kyKV0XSnOqdDOSDZHg4Te5JgFGWMLV5XkqJzsNkyMWnX34xCWokWPER-ZIbF4lzW9OR3_-Hk17dr2IkjtaOAxECYnzcKEXvHv57x-85s88PmwHq9DoDjrTVRi0KDEpxGWVTKUnY-i9axbljZwjM7OH5B76wqg May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: ada5914cea884080bbd23769fe91eb43 May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-829927427", "name": "tempest-ServicesTestJSON-Service-488439402", "endpoints": []}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ada5914cea884080bbd23769fe91eb43", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "tempest-ServicesTestJSON-Type-781023997", "name": "tempest-ServicesTestJSON-Service-709070595", "endpoints": []}, {"type": "tempest-ServicesTestJSON-Type-132700515", "name": "tempest-ServicesTestJSON-Service-541304433", "endpoints": []}] May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: ada5914cea884080bbd23769fe91eb43 May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerMetadataNegativeTestJSON-441300394-project May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 63b1e31883914fc9ad74440a00da8c92 May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-441300394-project May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1654224028", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1133486f-d0a2-4dd7-bfb6-fd34c038b95b"}]}} May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1654224028', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1133486f-d0a2-4dd7-bfb6-fd34c038b95b'}]}}} May 27 15:12:51.050592 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise error May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi On instance['server']: May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:12:51.053413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:12:51.062974 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:12:51.062974 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:51.062974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8b88909b-5b89-4949-9d99-de6859d1c878 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:12:51.062974 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8b88909b-5b89-4949-9d99-de6859d1c878 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.011072 May 27 15:12:51.062974 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1918/3833] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:12:51 2022] POST /compute/v2.1/servers => generated 1197 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) May 27 15:12:51.180128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5c6ba42c-74c7-4693-8306-8c4f30784225 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-201687408", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1133486f-d0a2-4dd7-bfb6-fd34c038b95b"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5c6ba42c-74c7-4693-8306-8c4f30784225 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Request method failure captured: May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 1265 May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOpf2I-SrkE2oGSeh-kyKV0XSnOqdDOSDZHg4Te5JgFGWMLV5XkqJzsNkyMWnX34xCWokWPER-ZIbF4lzW9OR3_-Hk17dr2IkjtaOAxECYnzcKEXvHv57x-85s88PmwHq9DoDjrTVRi0KDEpxGWVTKUnY-i9axbljZwjM7OH5B76wqg May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: ada5914cea884080bbd23769fe91eb43 May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-829927427", "name": "tempest-ServicesTestJSON-Service-488439402", "endpoints": []}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ada5914cea884080bbd23769fe91eb43", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "tempest-ServicesTestJSON-Type-781023997", "name": "tempest-ServicesTestJSON-Service-709070595", "endpoints": []}, {"type": "tempest-ServicesTestJSON-Type-132700515", "name": "tempest-ServicesTestJSON-Service-541304433", "endpoints": []}] May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: ada5914cea884080bbd23769fe91eb43 May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerMetadataNegativeTestJSON-441300394-project May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 63b1e31883914fc9ad74440a00da8c92 May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-441300394-project May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-201687408", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1133486f-d0a2-4dd7-bfb6-fd34c038b95b"}]}} May 27 15:12:51.183949 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:12:51.186427 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:12:51.186427 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-201687408', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1133486f-d0a2-4dd7-bfb6-fd34c038b95b'}]}}} May 27 15:12:51.186427 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:12:51.186427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:51.186427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:12:51.186427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:12:51.186427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:12:51.186427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise error May 27 15:12:51.186427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:12:51.186427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:51.186427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 27 15:12:51.186427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 27 15:12:51.186427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 27 15:12:51.186427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 27 15:12:51.186427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 27 15:12:51.186427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:51.186427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi On instance['server']: May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:12:51.187495 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:12:51.189296 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 27 15:12:51.189296 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:51.189296 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5c6ba42c-74c7-4693-8306-8c4f30784225 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:12:51.189296 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5c6ba42c-74c7-4693-8306-8c4f30784225 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.009715 May 27 15:12:51.189296 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1919/3834] 10.222.0.13 () {60 vars in 1147 bytes} [Fri May 27 15:12:51 2022] POST /compute/v2.1/servers => generated 2221 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) May 27 15:12:51.195833 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-57863f0e-d8e4-4216-ba52-bd156dd8b6b9 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084/action" status: 202 len: 0 microversion: 2.1 time: 2.229228 May 27 15:12:51.197107 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1916/3835] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:12:48 2022] POST /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084/action => generated 0 bytes in 2231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:12:51.199334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7a0416f1-9f3e-4015-8f3a-64dc5a038cb4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:51.199911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7a0416f1-9f3e-4015-8f3a-64dc5a038cb4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] [instance: 42399a7e-cc1e-420f-90b6-ec9c0952725f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:51.205279 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b88a74ed-2d87-41d4-9b90-b64d27006052 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:51.205810 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-7a0416f1-9f3e-4015-8f3a-64dc5a038cb4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] HTTP exception thrown: Instance 42399a7e-cc1e-420f-90b6-ec9c0952725f could not be found. May 27 15:12:51.205962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b88a74ed-2d87-41d4-9b90-b64d27006052 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7a0416f1-9f3e-4015-8f3a-64dc5a038cb4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Request method failure captured: May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/42399a7e-cc1e-420f-90b6-ec9c0952725f/metadata/test2 HTTP/1.1 May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOpf2I-SrkE2oGSeh-kyKV0XSnOqdDOSDZHg4Te5JgFGWMLV5XkqJzsNkyMWnX34xCWokWPER-ZIbF4lzW9OR3_-Hk17dr2IkjtaOAxECYnzcKEXvHv57x-85s88PmwHq9DoDjrTVRi0KDEpxGWVTKUnY-i9axbljZwjM7OH5B76wqg May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: ada5914cea884080bbd23769fe91eb43 May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-829927427", "name": "tempest-ServicesTestJSON-Service-488439402", "endpoints": []}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ada5914cea884080bbd23769fe91eb43", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "tempest-ServicesTestJSON-Type-781023997", "name": "tempest-ServicesTestJSON-Service-709070595", "endpoints": []}, {"type": "tempest-ServicesTestJSON-Type-132700515", "name": "tempest-ServicesTestJSON-Service-541304433", "endpoints": []}] May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: ada5914cea884080bbd23769fe91eb43 May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerMetadataNegativeTestJSON-441300394-project May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 63b1e31883914fc9ad74440a00da8c92 May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-441300394-project May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 42399a7e-cc1e-420f-90b6-ec9c0952725f could not be found. May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'server_id': '42399a7e-cc1e-420f-90b6-ec9c0952725f', 'id': 'test2'} May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42399a7e-cc1e-420f-90b6-ec9c0952725f could not be found. May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42399a7e-cc1e-420f-90b6-ec9c0952725f could not be found. May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:51.207630 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:51.211868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:51.211868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:51.211868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:51.211868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:51.211868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:12:51.211868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:12:51.211868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42399a7e-cc1e-420f-90b6-ec9c0952725f could not be found. May 27 15:12:51.211868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:51.213773 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7a0416f1-9f3e-4015-8f3a-64dc5a038cb4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Returning 404 to user: Instance 42399a7e-cc1e-420f-90b6-ec9c0952725f could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:12:51.214446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b88a74ed-2d87-41d4-9b90-b64d27006052 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:51.214914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b88a74ed-2d87-41d4-9b90-b64d27006052 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:51.215703 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7a0416f1-9f3e-4015-8f3a-64dc5a038cb4 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "GET /compute/v2.1/servers/42399a7e-cc1e-420f-90b6-ec9c0952725f/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.021596 May 27 15:12:51.215842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b88a74ed-2d87-41d4-9b90-b64d27006052 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:51.216469 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b88a74ed-2d87-41d4-9b90-b64d27006052 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:51.225782 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1920/3836] 10.222.0.13 () {58 vars in 1280 bytes} [Fri May 27 15:12:51 2022] GET /compute/v2.1/servers/42399a7e-cc1e-420f-90b6-ec9c0952725f/metadata/test2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:12:51.232265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d8b1d2fd-f34b-4991-aa15-4a9a7ff61658 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:51.232774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d8b1d2fd-f34b-4991-aa15-4a9a7ff61658 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] [instance: 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:51.239150 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8b1d2fd-f34b-4991-aa15-4a9a7ff61658 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:51.239617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8b1d2fd-f34b-4991-aa15-4a9a7ff61658 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:51.240465 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8b1d2fd-f34b-4991-aa15-4a9a7ff61658 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:51.241456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8b1d2fd-f34b-4991-aa15-4a9a7ff61658 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:51.268549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d8b1d2fd-f34b-4991-aa15-4a9a7ff61658 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] [instance: 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:12:51.362194 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d8b1d2fd-f34b-4991-aa15-4a9a7ff61658 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea" status: 204 len: 0 microversion: 2.1 time: 0.134341 May 27 15:12:51.366699 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1921/3837] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:12:51 2022] DELETE /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:12:51.374792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-663cc4a2-74ec-4735-96a4-4d3708ecb441 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:51.375783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-663cc4a2-74ec-4735-96a4-4d3708ecb441 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] [instance: 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:51.381531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b88a74ed-2d87-41d4-9b90-b64d27006052 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:51.385472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-663cc4a2-74ec-4735-96a4-4d3708ecb441 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:51.385963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-663cc4a2-74ec-4735-96a4-4d3708ecb441 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:51.386752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-663cc4a2-74ec-4735-96a4-4d3708ecb441 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:51.387420 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-663cc4a2-74ec-4735-96a4-4d3708ecb441 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:51.389166 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b88a74ed-2d87-41d4-9b90-b64d27006052 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.187742 May 27 15:12:51.390101 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1917/3838] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:51 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:51.542193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-663cc4a2-74ec-4735-96a4-4d3708ecb441 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b1e31883914fc9ad74440a00da8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada5914cea884080bbd23769fe91eb43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:51.550137 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-663cc4a2-74ec-4735-96a4-4d3708ecb441 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea" status: 200 len: 1525 microversion: 2.1 time: 0.180932 May 27 15:12:51.550726 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1922/3839] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:51 2022] GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea => generated 1525 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:51.782505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9fc9c05e-0a4f-4166-92b2-e03b441b113d tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:51.783400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9fc9c05e-0a4f-4166-92b2-e03b441b113d tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:51.790976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9fc9c05e-0a4f-4166-92b2-e03b441b113d tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:51.791444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9fc9c05e-0a4f-4166-92b2-e03b441b113d tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:51.792236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9fc9c05e-0a4f-4166-92b2-e03b441b113d tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:51.792704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9fc9c05e-0a4f-4166-92b2-e03b441b113d tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:51.963435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9fc9c05e-0a4f-4166-92b2-e03b441b113d tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd15db99e887484783bdb07197b5efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2ec376b67a4b62886183fd5041a582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:51.975951 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9fc9c05e-0a4f-4166-92b2-e03b441b113d tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864" status: 200 len: 1315 microversion: 2.1 time: 0.196740 May 27 15:12:51.976550 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1918/3840] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:51 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:52.056569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fe2845cf-38a4-4bf4-af0a-c52f4eea8a0e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:52.057809 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fe2845cf-38a4-4bf4-af0a-c52f4eea8a0e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:52.065952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe2845cf-38a4-4bf4-af0a-c52f4eea8a0e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:52.066435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe2845cf-38a4-4bf4-af0a-c52f4eea8a0e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:52.067454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe2845cf-38a4-4bf4-af0a-c52f4eea8a0e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:52.067913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe2845cf-38a4-4bf4-af0a-c52f4eea8a0e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:52.241479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fe2845cf-38a4-4bf4-af0a-c52f4eea8a0e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:52.252047 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fe2845cf-38a4-4bf4-af0a-c52f4eea8a0e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1371 microversion: 2.1 time: 0.199338 May 27 15:12:52.253118 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1923/3841] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:52 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:52.407700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-98b8d555-1299-4b7b-83c0-0e11806b2b5d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:52.408413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-98b8d555-1299-4b7b-83c0-0e11806b2b5d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:52.417310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98b8d555-1299-4b7b-83c0-0e11806b2b5d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:52.417814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98b8d555-1299-4b7b-83c0-0e11806b2b5d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:52.418612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98b8d555-1299-4b7b-83c0-0e11806b2b5d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:52.419063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98b8d555-1299-4b7b-83c0-0e11806b2b5d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:52.569662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1d730f26-8db8-4d01-a1f6-7d4926c7adbc tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:52.571283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1d730f26-8db8-4d01-a1f6-7d4926c7adbc tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] [instance: 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:52.577625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-98b8d555-1299-4b7b-83c0-0e11806b2b5d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:52.578809 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d730f26-8db8-4d01-a1f6-7d4926c7adbc tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:52.579404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d730f26-8db8-4d01-a1f6-7d4926c7adbc tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:52.580320 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d730f26-8db8-4d01-a1f6-7d4926c7adbc tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:52.581463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d730f26-8db8-4d01-a1f6-7d4926c7adbc tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:52.587719 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-98b8d555-1299-4b7b-83c0-0e11806b2b5d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.184800 May 27 15:12:52.599106 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1919/3842] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:52 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:52.775443 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1d730f26-8db8-4d01-a1f6-7d4926c7adbc tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b1e31883914fc9ad74440a00da8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada5914cea884080bbd23769fe91eb43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:52.785306 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1d730f26-8db8-4d01-a1f6-7d4926c7adbc tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea" status: 200 len: 1525 microversion: 2.1 time: 0.220190 May 27 15:12:52.786278 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1924/3843] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:52 2022] GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea => generated 1525 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:52.994277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ed558659-1219-4e5e-a1c0-bde66032b8ef tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:52.995395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ed558659-1219-4e5e-a1c0-bde66032b8ef tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:53.003279 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed558659-1219-4e5e-a1c0-bde66032b8ef tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:53.003749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed558659-1219-4e5e-a1c0-bde66032b8ef tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:53.004537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed558659-1219-4e5e-a1c0-bde66032b8ef tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:53.005015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed558659-1219-4e5e-a1c0-bde66032b8ef tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:53.192695 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ed558659-1219-4e5e-a1c0-bde66032b8ef tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd15db99e887484783bdb07197b5efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2ec376b67a4b62886183fd5041a582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:53.209950 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ed558659-1219-4e5e-a1c0-bde66032b8ef tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864" status: 200 len: 1315 microversion: 2.1 time: 0.219219 May 27 15:12:53.210722 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1920/3844] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:52 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:53.273192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d23c85d3-a598-4569-909f-2ebc33efb5f6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:53.273942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d23c85d3-a598-4569-909f-2ebc33efb5f6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:53.280321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d23c85d3-a598-4569-909f-2ebc33efb5f6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:53.280819 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d23c85d3-a598-4569-909f-2ebc33efb5f6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:53.281950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d23c85d3-a598-4569-909f-2ebc33efb5f6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:53.282679 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d23c85d3-a598-4569-909f-2ebc33efb5f6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:53.456366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d23c85d3-a598-4569-909f-2ebc33efb5f6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:53.467097 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d23c85d3-a598-4569-909f-2ebc33efb5f6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1565 microversion: 2.1 time: 0.198879 May 27 15:12:53.470716 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1925/3845] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:53 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1565 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:53.485594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-be46befc-f3b5-4edc-b030-7e28d9aa7cd0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:53.486547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-be46befc-f3b5-4edc-b030-7e28d9aa7cd0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:53.493906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be46befc-f3b5-4edc-b030-7e28d9aa7cd0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:53.494716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be46befc-f3b5-4edc-b030-7e28d9aa7cd0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:53.495798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be46befc-f3b5-4edc-b030-7e28d9aa7cd0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:53.496998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be46befc-f3b5-4edc-b030-7e28d9aa7cd0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:53.597274 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-be46befc-f3b5-4edc-b030-7e28d9aa7cd0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116303 May 27 15:12:53.598233 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1921/3846] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 15:12:53 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:53.616052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-eb801906-76da-4f5e-9de7-e7671901ec37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:53.617661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-eb801906-76da-4f5e-9de7-e7671901ec37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:53.638312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb801906-76da-4f5e-9de7-e7671901ec37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:53.639618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb801906-76da-4f5e-9de7-e7671901ec37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:53.640578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb801906-76da-4f5e-9de7-e7671901ec37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:53.641294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb801906-76da-4f5e-9de7-e7671901ec37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:53.809404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9d08ed29-3963-4eb9-b8ac-3ba8201cb238 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:53.812314 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9d08ed29-3963-4eb9-b8ac-3ba8201cb238 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] [instance: 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:53.837288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:53.842885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9d08ed29-3963-4eb9-b8ac-3ba8201cb238 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:53.843794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9d08ed29-3963-4eb9-b8ac-3ba8201cb238 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:53.848499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9d08ed29-3963-4eb9-b8ac-3ba8201cb238 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:53.849275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9d08ed29-3963-4eb9-b8ac-3ba8201cb238 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:54.136053 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9d08ed29-3963-4eb9-b8ac-3ba8201cb238 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b1e31883914fc9ad74440a00da8c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada5914cea884080bbd23769fe91eb43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:54.146304 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9d08ed29-3963-4eb9-b8ac-3ba8201cb238 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea" status: 200 len: 1483 microversion: 2.1 time: 0.344539 May 27 15:12:54.148096 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1922/3847] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:53 2022] GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea => generated 1483 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:54.153275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-5d0abff1-eec8-4bf1-854b-c9f2d615e795 req-9556a5df-001f-4bd2-a588-87b3e5090d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea", "name": "network-vif-deleted", "tag": "10b9a1e0-5700-4f1f-92db-df6325c1bac9"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:54.163728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-5d0abff1-eec8-4bf1-854b-c9f2d615e795 req-9556a5df-001f-4bd2-a588-87b3e5090d70 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:54.164641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-5d0abff1-eec8-4bf1-854b-c9f2d615e795 req-9556a5df-001f-4bd2-a588-87b3e5090d70 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:54.181629 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-5d0abff1-eec8-4bf1-854b-c9f2d615e795 req-9556a5df-001f-4bd2-a588-87b3e5090d70 service nova] Creating event network-vif-deleted:10b9a1e0-5700-4f1f-92db-df6325c1bac9 for instance 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea on n-h2-843621-1 May 27 15:12:54.189215 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-5d0abff1-eec8-4bf1-854b-c9f2d615e795 req-9556a5df-001f-4bd2-a588-87b3e5090d70 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039141 May 27 15:12:54.190147 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1923/3848] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:54.196662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-eb801906-76da-4f5e-9de7-e7671901ec37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:54.217077 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-eb801906-76da-4f5e-9de7-e7671901ec37 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.612760 May 27 15:12:54.218167 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1926/3849] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:53 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:54.235550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-70ca9361-2f3a-48d3-ad77-fcb2463bbfbb tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:54.236335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-70ca9361-2f3a-48d3-ad77-fcb2463bbfbb tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:54.242791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=8 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:54.245771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-70ca9361-2f3a-48d3-ad77-fcb2463bbfbb tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:54.246752 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-70ca9361-2f3a-48d3-ad77-fcb2463bbfbb tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:54.248042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-70ca9361-2f3a-48d3-ad77-fcb2463bbfbb tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:54.248871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-70ca9361-2f3a-48d3-ad77-fcb2463bbfbb tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:54.530850 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-70ca9361-2f3a-48d3-ad77-fcb2463bbfbb tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd15db99e887484783bdb07197b5efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2ec376b67a4b62886183fd5041a582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:54.544957 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-70ca9361-2f3a-48d3-ad77-fcb2463bbfbb tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864" status: 200 len: 1315 microversion: 2.1 time: 0.315131 May 27 15:12:54.546428 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1924/3850] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:54 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:55.166642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-448df0a9-0895-4b68-a927-596f1b0d07f9 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:55.166642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-448df0a9-0895-4b68-a927-596f1b0d07f9 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] [instance: 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:55.177654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-448df0a9-0895-4b68-a927-596f1b0d07f9 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:55.179821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-448df0a9-0895-4b68-a927-596f1b0d07f9 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:55.181160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-448df0a9-0895-4b68-a927-596f1b0d07f9 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:55.181782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-448df0a9-0895-4b68-a927-596f1b0d07f9 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:55.199651 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-448df0a9-0895-4b68-a927-596f1b0d07f9 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] HTTP exception thrown: Instance 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea could not be found. May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-448df0a9-0895-4b68-a927-596f1b0d07f9 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Request method failure captured: May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea HTTP/1.1 May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOpf2I-SrkE2oGSeh-kyKV0XSnOqdDOSDZHg4Te5JgFGWMLV5XkqJzsNkyMWnX34xCWokWPER-ZIbF4lzW9OR3_-Hk17dr2IkjtaOAxECYnzcKEXvHv57x-85s88PmwHq9DoDjrTVRi0KDEpxGWVTKUnY-i9axbljZwjM7OH5B76wqg May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: ada5914cea884080bbd23769fe91eb43 May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-829927427", "name": "tempest-ServicesTestJSON-Service-488439402", "endpoints": []}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ada5914cea884080bbd23769fe91eb43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ada5914cea884080bbd23769fe91eb43", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "tempest-ServicesTestJSON-Type-781023997", "name": "tempest-ServicesTestJSON-Service-709070595", "endpoints": []}, {"type": "tempest-ServicesTestJSON-Type-132700515", "name": "tempest-ServicesTestJSON-Service-541304433", "endpoints": []}] May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: ada5914cea884080bbd23769fe91eb43 May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-441300394 May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerMetadataNegativeTestJSON-441300394-project May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 63b1e31883914fc9ad74440a00da8c92 May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-441300394-project May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea could not be found. May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea'} May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea could not be found. May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:12:55.201702 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:12:55.206752 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:12:55.206752 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea could not be found. May 27 15:12:55.206752 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:55.206752 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:12:55.206752 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:55.206752 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:12:55.206752 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:12:55.206752 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:12:55.206752 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:12:55.206752 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:12:55.206752 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea could not be found. May 27 15:12:55.206752 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:12:55.206752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-448df0a9-0895-4b68-a927-596f1b0d07f9 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] Returning 404 to user: Instance 0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:12:55.206752 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-448df0a9-0895-4b68-a927-596f1b0d07f9 tempest-ServerMetadataNegativeTestJSON-441300394 tempest-ServerMetadataNegativeTestJSON-441300394-project] 10.222.0.13 "GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea" status: 404 len: 111 microversion: 2.1 time: 0.042638 May 27 15:12:55.206752 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1927/3851] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:55 2022] GET /compute/v2.1/servers/0671b2f0-fbe2-4dfd-a11f-bc1fa919b5ea => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:12:55.239559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b5ed46cc-1edd-433d-9208-415838fdcd03 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:55.240196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b5ed46cc-1edd-433d-9208-415838fdcd03 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:55.251335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5ed46cc-1edd-433d-9208-415838fdcd03 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:55.252025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5ed46cc-1edd-433d-9208-415838fdcd03 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:55.252992 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5ed46cc-1edd-433d-9208-415838fdcd03 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:55.253547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5ed46cc-1edd-433d-9208-415838fdcd03 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:55.310077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-95112058-501b-4532-9a1e-a01a98599711 req-d908296e-9ae8-4166-ba63-2537f685a04f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae7e4fc8-75b6-4e3f-9fca-7e5920957283", "tag": "89fb6ad5-bc61-4f1c-b96b-4295cadf203e"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:55.341989 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-95112058-501b-4532-9a1e-a01a98599711 req-d908296e-9ae8-4166-ba63-2537f685a04f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:55.342594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-95112058-501b-4532-9a1e-a01a98599711 req-d908296e-9ae8-4166-ba63-2537f685a04f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:55.382241 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-95112058-501b-4532-9a1e-a01a98599711 req-d908296e-9ae8-4166-ba63-2537f685a04f service nova] Creating event network-changed:89fb6ad5-bc61-4f1c-b96b-4295cadf203e for instance ae7e4fc8-75b6-4e3f-9fca-7e5920957283 on n-h1-843621-1 May 27 15:12:55.401622 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-95112058-501b-4532-9a1e-a01a98599711 req-d908296e-9ae8-4166-ba63-2537f685a04f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094719 May 27 15:12:55.402452 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1928/3852] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:12:55.579062 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a60ac8f2-2db6-437c-9a34-226b330c4e12 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:55.580598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a60ac8f2-2db6-437c-9a34-226b330c4e12 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:55.601335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b5ed46cc-1edd-433d-9208-415838fdcd03 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:55.606373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a60ac8f2-2db6-437c-9a34-226b330c4e12 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:55.607184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a60ac8f2-2db6-437c-9a34-226b330c4e12 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:55.608287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a60ac8f2-2db6-437c-9a34-226b330c4e12 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:55.610086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a60ac8f2-2db6-437c-9a34-226b330c4e12 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:55.627050 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b5ed46cc-1edd-433d-9208-415838fdcd03 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.391629 May 27 15:12:55.640170 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1925/3853] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:55 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:55.957609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a60ac8f2-2db6-437c-9a34-226b330c4e12 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd15db99e887484783bdb07197b5efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2ec376b67a4b62886183fd5041a582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:55.978700 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a60ac8f2-2db6-437c-9a34-226b330c4e12 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864" status: 200 len: 1315 microversion: 2.1 time: 0.411510 May 27 15:12:55.979902 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1929/3854] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:55 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:56.659737 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-937d74fb-bc3d-4a1a-8ded-db5fb7ee99cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:56.661162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-937d74fb-bc3d-4a1a-8ded-db5fb7ee99cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:56.678494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-937d74fb-bc3d-4a1a-8ded-db5fb7ee99cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:56.679901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-937d74fb-bc3d-4a1a-8ded-db5fb7ee99cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:56.682810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-937d74fb-bc3d-4a1a-8ded-db5fb7ee99cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:56.683535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-937d74fb-bc3d-4a1a-8ded-db5fb7ee99cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:56.983062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-937d74fb-bc3d-4a1a-8ded-db5fb7ee99cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:57.005609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-656a2adc-35c3-47dd-975e-15bb0227c2c4 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:57.008092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-656a2adc-35c3-47dd-975e-15bb0227c2c4 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:57.035002 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-937d74fb-bc3d-4a1a-8ded-db5fb7ee99cd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.370300 May 27 15:12:57.035926 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-656a2adc-35c3-47dd-975e-15bb0227c2c4 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:57.036543 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1926/3855] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:56 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:57.038791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-656a2adc-35c3-47dd-975e-15bb0227c2c4 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:57.039993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-656a2adc-35c3-47dd-975e-15bb0227c2c4 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:57.040711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-656a2adc-35c3-47dd-975e-15bb0227c2c4 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:57.294783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-b31cbd49-929c-40b7-8f05-69fa996d1f81 req-2dd7938f-81c5-4971-91e8-6eded00e6ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70325c3b-8ac4-4d4e-a4bd-bf9a20750864", "name": "network-vif-plugged", "status": "completed", "tag": "f0a4ae70-53df-486f-8a4c-2f31d664e450"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:57.312177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-b31cbd49-929c-40b7-8f05-69fa996d1f81 req-2dd7938f-81c5-4971-91e8-6eded00e6ce6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:57.319356 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-b31cbd49-929c-40b7-8f05-69fa996d1f81 req-2dd7938f-81c5-4971-91e8-6eded00e6ce6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:57.342879 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-b31cbd49-929c-40b7-8f05-69fa996d1f81 req-2dd7938f-81c5-4971-91e8-6eded00e6ce6 service nova] Creating event network-vif-plugged:f0a4ae70-53df-486f-8a4c-2f31d664e450 for instance 70325c3b-8ac4-4d4e-a4bd-bf9a20750864 on n-h2-843621-1 May 27 15:12:57.359908 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-b31cbd49-929c-40b7-8f05-69fa996d1f81 req-2dd7938f-81c5-4971-91e8-6eded00e6ce6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073743 May 27 15:12:57.362180 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1927/3856] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:57.449823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-656a2adc-35c3-47dd-975e-15bb0227c2c4 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd15db99e887484783bdb07197b5efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2ec376b67a4b62886183fd5041a582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:57.460660 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-656a2adc-35c3-47dd-975e-15bb0227c2c4 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864" status: 200 len: 1315 microversion: 2.1 time: 0.462658 May 27 15:12:57.461306 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1930/3857] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:56 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864 => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:58.060887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4dd998bf-0364-4275-8ed8-ef2275b99985 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:58.063072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4dd998bf-0364-4275-8ed8-ef2275b99985 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:58.076609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4dd998bf-0364-4275-8ed8-ef2275b99985 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:58.077810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4dd998bf-0364-4275-8ed8-ef2275b99985 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:58.079403 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4dd998bf-0364-4275-8ed8-ef2275b99985 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:58.080407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4dd998bf-0364-4275-8ed8-ef2275b99985 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:58.349609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4dd998bf-0364-4275-8ed8-ef2275b99985 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:58.370804 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4dd998bf-0364-4275-8ed8-ef2275b99985 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.317757 May 27 15:12:58.380766 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1928/3858] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:58 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:58.479882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-35e1bc82-3651-493b-b84c-3dc553af1212 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:58.481299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-35e1bc82-3651-493b-b84c-3dc553af1212 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:58.492088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35e1bc82-3651-493b-b84c-3dc553af1212 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:58.492711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35e1bc82-3651-493b-b84c-3dc553af1212 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:58.493771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35e1bc82-3651-493b-b84c-3dc553af1212 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:58.494323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35e1bc82-3651-493b-b84c-3dc553af1212 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:58.502635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:58.715469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-35e1bc82-3651-493b-b84c-3dc553af1212 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd15db99e887484783bdb07197b5efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2ec376b67a4b62886183fd5041a582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:58.727517 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-35e1bc82-3651-493b-b84c-3dc553af1212 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864" status: 200 len: 1315 microversion: 2.1 time: 0.252518 May 27 15:12:58.729596 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1931/3859] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:58 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:59.077842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ec5202fe-eb99-4d19-bc16-7022d573437c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-631503209", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": "none"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:12:59.086625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:59.157218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ec5202fe-eb99-4d19-bc16-7022d573437c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:12:59.157594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ec5202fe-eb99-4d19-bc16-7022d573437c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:12:59.158080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ec5202fe-eb99-4d19-bc16-7022d573437c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:12:59.158953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ec5202fe-eb99-4d19-bc16-7022d573437c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:12:59.159378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ec5202fe-eb99-4d19-bc16-7022d573437c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:12:59.170349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec5202fe-eb99-4d19-bc16-7022d573437c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:59.170853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec5202fe-eb99-4d19-bc16-7022d573437c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:59.171544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec5202fe-eb99-4d19-bc16-7022d573437c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:59.172009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec5202fe-eb99-4d19-bc16-7022d573437c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:59.192264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-ec5202fe-eb99-4d19-bc16-7022d573437c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Getting quotas for project fd9a95e31edf4e7ca9019cb14151549c. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:12:59.201407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-ec5202fe-eb99-4d19-bc16-7022d573437c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Getting quotas for user 0b902b3ddc5b4bc3b00cdaa810f11c92 and project fd9a95e31edf4e7ca9019cb14151549c. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:12:59.216379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ec5202fe-eb99-4d19-bc16-7022d573437c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:12:59.219554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ec5202fe-eb99-4d19-bc16-7022d573437c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:12:59.290548 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ec5202fe-eb99-4d19-bc16-7022d573437c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.539813 May 27 15:12:59.292125 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1929/3860] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 27 15:12:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 15:12:59.302660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-20bc47f3-2ec5-4ff3-84ca-7eb7221afff1 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:59.304819 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-20bc47f3-2ec5-4ff3-84ca-7eb7221afff1 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:59.306874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:59.375715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-20bc47f3-2ec5-4ff3-84ca-7eb7221afff1 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:59.387039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-20bc47f3-2ec5-4ff3-84ca-7eb7221afff1 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:59.389347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-20bc47f3-2ec5-4ff3-84ca-7eb7221afff1 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:59.390888 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-20bc47f3-2ec5-4ff3-84ca-7eb7221afff1 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1277 microversion: 2.54 time: 0.092425 May 27 15:12:59.391478 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1932/3861] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:12:59 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:59.395767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-68995787-6453-4d65-ab60-49a3ce3e0fcd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:59.396392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-68995787-6453-4d65-ab60-49a3ce3e0fcd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:59.412439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68995787-6453-4d65-ab60-49a3ce3e0fcd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:59.413017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68995787-6453-4d65-ab60-49a3ce3e0fcd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:59.413814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68995787-6453-4d65-ab60-49a3ce3e0fcd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:59.414337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68995787-6453-4d65-ab60-49a3ce3e0fcd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:59.630942 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-68995787-6453-4d65-ab60-49a3ce3e0fcd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:59.643991 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-68995787-6453-4d65-ab60-49a3ce3e0fcd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.251833 May 27 15:12:59.645392 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1930/3862] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:59 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:12:59.748159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ac1eb999-7ba1-47f7-b11d-0527a3c028c1 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:59.749219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ac1eb999-7ba1-47f7-b11d-0527a3c028c1 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:12:59.766530 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac1eb999-7ba1-47f7-b11d-0527a3c028c1 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:59.767879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac1eb999-7ba1-47f7-b11d-0527a3c028c1 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:59.769409 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac1eb999-7ba1-47f7-b11d-0527a3c028c1 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:59.770555 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac1eb999-7ba1-47f7-b11d-0527a3c028c1 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:59.965297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ac1eb999-7ba1-47f7-b11d-0527a3c028c1 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd15db99e887484783bdb07197b5efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2ec376b67a4b62886183fd5041a582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:12:59.981493 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ac1eb999-7ba1-47f7-b11d-0527a3c028c1 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864" status: 200 len: 1503 microversion: 2.1 time: 0.238366 May 27 15:12:59.993523 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1933/3863] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:12:59 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864 => generated 1503 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:00.005227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-79bb9dd6-63a2-4c4e-bcd3-1e72b06f449b tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:00.005928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-79bb9dd6-63a2-4c4e-bcd3-1e72b06f449b tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:00.013585 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-79bb9dd6-63a2-4c4e-bcd3-1e72b06f449b tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:00.014470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-79bb9dd6-63a2-4c4e-bcd3-1e72b06f449b tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:00.015620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-79bb9dd6-63a2-4c4e-bcd3-1e72b06f449b tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:00.016416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-79bb9dd6-63a2-4c4e-bcd3-1e72b06f449b tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:00.041668 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:00.058233 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-79bb9dd6-63a2-4c4e-bcd3-1e72b06f449b tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864/ips" status: 200 len: 108 microversion: 2.1 time: 0.059946 May 27 15:13:00.059560 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1931/3864] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 15:12:59 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864/ips => generated 108 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:00.076397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-97786f55-3000-4753-8569-692c3d8b04c2 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:00.078865 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-97786f55-3000-4753-8569-692c3d8b04c2 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:00.096720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-97786f55-3000-4753-8569-692c3d8b04c2 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:00.099789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-97786f55-3000-4753-8569-692c3d8b04c2 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:00.100694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-97786f55-3000-4753-8569-692c3d8b04c2 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:00.101047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-97786f55-3000-4753-8569-692c3d8b04c2 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:00.142383 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-97786f55-3000-4753-8569-692c3d8b04c2 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864/ips" status: 200 len: 108 microversion: 2.1 time: 0.074747 May 27 15:13:00.148977 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1934/3865] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 15:13:00 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864/ips => generated 108 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:00.157124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b917ebf7-dd4b-4cbb-b74e-bc7c6d38698a tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:00.158738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b917ebf7-dd4b-4cbb-b74e-bc7c6d38698a tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:00.171574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b917ebf7-dd4b-4cbb-b74e-bc7c6d38698a tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:00.172042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b917ebf7-dd4b-4cbb-b74e-bc7c6d38698a tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:00.172875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b917ebf7-dd4b-4cbb-b74e-bc7c6d38698a tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:00.173369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b917ebf7-dd4b-4cbb-b74e-bc7c6d38698a tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:00.207548 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b917ebf7-dd4b-4cbb-b74e-bc7c6d38698a tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864/ips/tempest-ServerAddressesTestJSON-267427048-network" status: 200 len: 93 microversion: 2.1 time: 0.056364 May 27 15:13:00.208883 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1932/3866] 10.222.0.13 () {58 vars in 1397 bytes} [Fri May 27 15:13:00 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864/ips/tempest-ServerAddressesTestJSON-267427048-network => generated 93 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:13:00.221941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d457f8a5-fae6-4018-be87-932d031b7e30 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:00.223121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d457f8a5-fae6-4018-be87-932d031b7e30 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:00.236337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d457f8a5-fae6-4018-be87-932d031b7e30 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:00.237431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d457f8a5-fae6-4018-be87-932d031b7e30 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:00.238551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d457f8a5-fae6-4018-be87-932d031b7e30 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:00.239372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d457f8a5-fae6-4018-be87-932d031b7e30 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:00.280453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d457f8a5-fae6-4018-be87-932d031b7e30 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:13:00.412897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3f5d2e71-dd5e-43b4-a053-72c8014a3c63 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:00.413566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3f5d2e71-dd5e-43b4-a053-72c8014a3c63 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:00.424952 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f5d2e71-dd5e-43b4-a053-72c8014a3c63 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:00.425686 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d457f8a5-fae6-4018-be87-932d031b7e30 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "DELETE /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864" status: 204 len: 0 microversion: 2.1 time: 0.209441 May 27 15:13:00.426768 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1935/3867] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:13:00 2022] DELETE /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:13:00.427045 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f5d2e71-dd5e-43b4-a053-72c8014a3c63 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:00.429935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f5d2e71-dd5e-43b4-a053-72c8014a3c63 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:00.430997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f5d2e71-dd5e-43b4-a053-72c8014a3c63 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:00.437762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5a19e7f7-bedd-47d9-9860-d0f03b226a7f tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:00.438818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5a19e7f7-bedd-47d9-9860-d0f03b226a7f tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:00.448249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5a19e7f7-bedd-47d9-9860-d0f03b226a7f tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:00.448249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5a19e7f7-bedd-47d9-9860-d0f03b226a7f tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:00.449153 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5a19e7f7-bedd-47d9-9860-d0f03b226a7f tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:00.449603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5a19e7f7-bedd-47d9-9860-d0f03b226a7f tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:00.544048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3f5d2e71-dd5e-43b4-a053-72c8014a3c63 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:00.557173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3f5d2e71-dd5e-43b4-a053-72c8014a3c63 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:00.559486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3f5d2e71-dd5e-43b4-a053-72c8014a3c63 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:00.561553 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3f5d2e71-dd5e-43b4-a053-72c8014a3c63 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1329 microversion: 2.54 time: 0.153255 May 27 15:13:00.562785 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1933/3868] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:00 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1329 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:13:00.663646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8372873e-2e10-4e98-80de-6cba9fe1a430 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:00.664791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8372873e-2e10-4e98-80de-6cba9fe1a430 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:00.676106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8372873e-2e10-4e98-80de-6cba9fe1a430 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:00.676571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8372873e-2e10-4e98-80de-6cba9fe1a430 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:00.681349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8372873e-2e10-4e98-80de-6cba9fe1a430 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:00.681883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8372873e-2e10-4e98-80de-6cba9fe1a430 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:01.139016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5a19e7f7-bedd-47d9-9860-d0f03b226a7f tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd15db99e887484783bdb07197b5efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2ec376b67a4b62886183fd5041a582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:01.163858 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5a19e7f7-bedd-47d9-9860-d0f03b226a7f tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864" status: 200 len: 1509 microversion: 2.1 time: 0.730847 May 27 15:13:01.165136 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1936/3869] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:00 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864 => generated 1509 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:01.228033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8372873e-2e10-4e98-80de-6cba9fe1a430 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:01.241480 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8372873e-2e10-4e98-80de-6cba9fe1a430 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.582264 May 27 15:13:01.242517 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1934/3870] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:00 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:01.586504 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-02ca0f74-e3ee-441f-8b42-9bc84712b8ad tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:01.587837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-02ca0f74-e3ee-441f-8b42-9bc84712b8ad tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:01.595244 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-02ca0f74-e3ee-441f-8b42-9bc84712b8ad tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:01.596088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-02ca0f74-e3ee-441f-8b42-9bc84712b8ad tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:01.597268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-02ca0f74-e3ee-441f-8b42-9bc84712b8ad tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:01.598069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-02ca0f74-e3ee-441f-8b42-9bc84712b8ad tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:01.701315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-02ca0f74-e3ee-441f-8b42-9bc84712b8ad tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:01.712433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-02ca0f74-e3ee-441f-8b42-9bc84712b8ad tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:01.714857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-02ca0f74-e3ee-441f-8b42-9bc84712b8ad tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:01.716460 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-02ca0f74-e3ee-441f-8b42-9bc84712b8ad tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1337 microversion: 2.54 time: 0.135449 May 27 15:13:01.717104 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1937/3871] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:01 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1337 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:02.182999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c63a05a1-d413-435f-bb50-48240cd94ebf tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:02.183595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c63a05a1-d413-435f-bb50-48240cd94ebf tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:02.191842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c63a05a1-d413-435f-bb50-48240cd94ebf tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:02.192757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c63a05a1-d413-435f-bb50-48240cd94ebf tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:02.193345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c63a05a1-d413-435f-bb50-48240cd94ebf tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:02.194181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c63a05a1-d413-435f-bb50-48240cd94ebf tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:02.261779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1ae75137-fd4f-4251-a9e5-9f2cd6ab4426 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:02.264775 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1ae75137-fd4f-4251-a9e5-9f2cd6ab4426 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:02.278895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ae75137-fd4f-4251-a9e5-9f2cd6ab4426 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:02.281867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ae75137-fd4f-4251-a9e5-9f2cd6ab4426 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:02.284803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ae75137-fd4f-4251-a9e5-9f2cd6ab4426 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:02.286326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ae75137-fd4f-4251-a9e5-9f2cd6ab4426 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:02.452073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c63a05a1-d413-435f-bb50-48240cd94ebf tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd15db99e887484783bdb07197b5efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2ec376b67a4b62886183fd5041a582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:02.469978 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c63a05a1-d413-435f-bb50-48240cd94ebf tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864" status: 200 len: 1509 microversion: 2.1 time: 0.291754 May 27 15:13:02.474863 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1935/3872] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:02 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864 => generated 1509 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:02.531396 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1ae75137-fd4f-4251-a9e5-9f2cd6ab4426 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:02.544747 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1ae75137-fd4f-4251-a9e5-9f2cd6ab4426 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.286654 May 27 15:13:02.545616 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1938/3873] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:02 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:02.737084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fbc74367-1e20-4ef3-8c41-aa5753716ea9 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:02.738121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fbc74367-1e20-4ef3-8c41-aa5753716ea9 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:02.746478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fbc74367-1e20-4ef3-8c41-aa5753716ea9 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:02.747201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fbc74367-1e20-4ef3-8c41-aa5753716ea9 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:02.748246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fbc74367-1e20-4ef3-8c41-aa5753716ea9 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:02.748963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fbc74367-1e20-4ef3-8c41-aa5753716ea9 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:02.828987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fbc74367-1e20-4ef3-8c41-aa5753716ea9 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:02.844009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fbc74367-1e20-4ef3-8c41-aa5753716ea9 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:02.845761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fbc74367-1e20-4ef3-8c41-aa5753716ea9 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:02.847370 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fbc74367-1e20-4ef3-8c41-aa5753716ea9 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1335 microversion: 2.54 time: 0.114833 May 27 15:13:02.848311 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1936/3874] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:02 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1335 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:03.487911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ad349a51-a616-4298-93d7-5096dc890c26 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:03.489189 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ad349a51-a616-4298-93d7-5096dc890c26 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:03.497382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad349a51-a616-4298-93d7-5096dc890c26 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:03.498248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad349a51-a616-4298-93d7-5096dc890c26 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:03.499286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad349a51-a616-4298-93d7-5096dc890c26 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:03.499822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad349a51-a616-4298-93d7-5096dc890c26 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:03.562894 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0ebc42ec-c9fa-415d-8d57-ea9acef52039 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:03.564581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0ebc42ec-c9fa-415d-8d57-ea9acef52039 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:03.577001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ebc42ec-c9fa-415d-8d57-ea9acef52039 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:03.577870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ebc42ec-c9fa-415d-8d57-ea9acef52039 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:03.578863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ebc42ec-c9fa-415d-8d57-ea9acef52039 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:03.579492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ebc42ec-c9fa-415d-8d57-ea9acef52039 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:03.726527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ad349a51-a616-4298-93d7-5096dc890c26 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd15db99e887484783bdb07197b5efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2ec376b67a4b62886183fd5041a582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:03.739564 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ad349a51-a616-4298-93d7-5096dc890c26 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864" status: 200 len: 1509 microversion: 2.1 time: 0.256564 May 27 15:13:03.751002 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1939/3875] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:03 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864 => generated 1509 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:03.814718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0ebc42ec-c9fa-415d-8d57-ea9acef52039 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:03.825273 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0ebc42ec-c9fa-415d-8d57-ea9acef52039 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.265720 May 27 15:13:03.826561 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1937/3876] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:03 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:03.872953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7b105c95-914b-4e03-8d27-8d58316c4062 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:03.873904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7b105c95-914b-4e03-8d27-8d58316c4062 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:03.883418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b105c95-914b-4e03-8d27-8d58316c4062 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:03.884271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b105c95-914b-4e03-8d27-8d58316c4062 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:03.885571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b105c95-914b-4e03-8d27-8d58316c4062 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:03.885979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b105c95-914b-4e03-8d27-8d58316c4062 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:03.937751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-2a4f8fd4-ae3e-47d8-8d93-ca66e8ebb55d req-1566e547-0194-43d6-b454-9d15a37dd175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70325c3b-8ac4-4d4e-a4bd-bf9a20750864", "name": "network-vif-deleted", "tag": "f0a4ae70-53df-486f-8a4c-2f31d664e450"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:03.947490 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2a4f8fd4-ae3e-47d8-8d93-ca66e8ebb55d req-1566e547-0194-43d6-b454-9d15a37dd175 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:03.948425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2a4f8fd4-ae3e-47d8-8d93-ca66e8ebb55d req-1566e547-0194-43d6-b454-9d15a37dd175 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:03.962090 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-2a4f8fd4-ae3e-47d8-8d93-ca66e8ebb55d req-1566e547-0194-43d6-b454-9d15a37dd175 service nova] Creating event network-vif-deleted:f0a4ae70-53df-486f-8a4c-2f31d664e450 for instance 70325c3b-8ac4-4d4e-a4bd-bf9a20750864 on n-h2-843621-1 May 27 15:13:03.968086 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-2a4f8fd4-ae3e-47d8-8d93-ca66e8ebb55d req-1566e547-0194-43d6-b454-9d15a37dd175 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033977 May 27 15:13:03.969495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7b105c95-914b-4e03-8d27-8d58316c4062 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:03.972499 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1938/3877] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:13:03.981794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7b105c95-914b-4e03-8d27-8d58316c4062 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:03.983721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7b105c95-914b-4e03-8d27-8d58316c4062 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:03.985349 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7b105c95-914b-4e03-8d27-8d58316c4062 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1335 microversion: 2.54 time: 0.119649 May 27 15:13:03.986406 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1940/3878] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:03 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1335 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:04.760712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-21e3dd61-8cb0-449d-868a-0b8f3f752116 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:04.761635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-21e3dd61-8cb0-449d-868a-0b8f3f752116 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:04.773864 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21e3dd61-8cb0-449d-868a-0b8f3f752116 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:04.774636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21e3dd61-8cb0-449d-868a-0b8f3f752116 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:04.775525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21e3dd61-8cb0-449d-868a-0b8f3f752116 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:04.776217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21e3dd61-8cb0-449d-868a-0b8f3f752116 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:04.818044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21e3dd61-8cb0-449d-868a-0b8f3f752116 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:04.819589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21e3dd61-8cb0-449d-868a-0b8f3f752116 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:04.820258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-21e3dd61-8cb0-449d-868a-0b8f3f752116 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lazy-loading 'fault' on Instance uuid 70325c3b-8ac4-4d4e-a4bd-bf9a20750864 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:13:04.848852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c07abd2d-da3a-45a9-8694-8d2571fea549 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:04.855153 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c07abd2d-da3a-45a9-8694-8d2571fea549 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:04.874973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c07abd2d-da3a-45a9-8694-8d2571fea549 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:04.875968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c07abd2d-da3a-45a9-8694-8d2571fea549 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:04.877345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c07abd2d-da3a-45a9-8694-8d2571fea549 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:04.878169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c07abd2d-da3a-45a9-8694-8d2571fea549 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:04.886290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-21e3dd61-8cb0-449d-868a-0b8f3f752116 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd15db99e887484783bdb07197b5efc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2ec376b67a4b62886183fd5041a582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:04.909282 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-21e3dd61-8cb0-449d-868a-0b8f3f752116 tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864" status: 200 len: 1305 microversion: 2.1 time: 0.153304 May 27 15:13:04.922388 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1939/3879] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:04 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864 => generated 1305 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:05.006527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-024c8941-5275-4643-918b-226e0b18daa0 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:05.007159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-024c8941-5275-4643-918b-226e0b18daa0 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:05.013926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-024c8941-5275-4643-918b-226e0b18daa0 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:05.014389 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-024c8941-5275-4643-918b-226e0b18daa0 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:05.015171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-024c8941-5275-4643-918b-226e0b18daa0 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:05.015843 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-024c8941-5275-4643-918b-226e0b18daa0 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:05.121781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-024c8941-5275-4643-918b-226e0b18daa0 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:05.136259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-024c8941-5275-4643-918b-226e0b18daa0 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:05.139146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-024c8941-5275-4643-918b-226e0b18daa0 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:05.140057 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-024c8941-5275-4643-918b-226e0b18daa0 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1356 microversion: 2.54 time: 0.137974 May 27 15:13:05.140898 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1940/3880] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:05 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1356 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:13:05.167264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6e32f969-7d3b-4865-9491-0d3be5ee3116 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Action: 'create', calling method: .version_select at 0x7fc780747dc0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-2127025798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEEx4tZZ0NlDTeMAZzp5xyUpY6gGCJ2fw9SXx1MJxmqroeiEgbqGf6KJfcd6Fp7DqS7AYeIAE2SNljvWy/34lHkC/neL46C2dA3jWF7BJp79Q5SrxzAnqd5/DgulXndXQ=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:05.169608 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c07abd2d-da3a-45a9-8694-8d2571fea549 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:05.179282 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c07abd2d-da3a-45a9-8694-8d2571fea549 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.339759 May 27 15:13:05.184776 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-6e32f969-7d3b-4865-9491-0d3be5ee3116 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Getting quotas for project fd9a95e31edf4e7ca9019cb14151549c. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:13:05.190191 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1941/3881] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:04 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:05.191558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-6e32f969-7d3b-4865-9491-0d3be5ee3116 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Getting quotas for user 0b902b3ddc5b4bc3b00cdaa810f11c92 and project fd9a95e31edf4e7ca9019cb14151549c. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:13:05.229615 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6e32f969-7d3b-4865-9491-0d3be5ee3116 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.067416 May 27 15:13:05.230294 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1941/3882] 10.222.0.13 () {62 vars in 1199 bytes} [Fri May 27 15:13:05 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 27 15:13:05.241806 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5a0b3fdb-cd85-4db5-8104-aa33ef9c41c2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-2127025798", "imageRef": "346e776e-8931-417f-87da-575810efb12b"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:05.243619 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5a0b3fdb-cd85-4db5-8104-aa33ef9c41c2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:05.250620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5a0b3fdb-cd85-4db5-8104-aa33ef9c41c2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:05.251476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5a0b3fdb-cd85-4db5-8104-aa33ef9c41c2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:05.252358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5a0b3fdb-cd85-4db5-8104-aa33ef9c41c2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:05.252924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5a0b3fdb-cd85-4db5-8104-aa33ef9c41c2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:05.364620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-5a0b3fdb-cd85-4db5-8104-aa33ef9c41c2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:13:05.366037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-5a0b3fdb-cd85-4db5-8104-aa33ef9c41c2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:13:05.366743 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-5a0b3fdb-cd85-4db5-8104-aa33ef9c41c2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:13:05.367655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-5a0b3fdb-cd85-4db5-8104-aa33ef9c41c2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:13:05.368056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-5a0b3fdb-cd85-4db5-8104-aa33ef9c41c2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:13:05.470470 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5a0b3fdb-cd85-4db5-8104-aa33ef9c41c2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:05.477323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5a0b3fdb-cd85-4db5-8104-aa33ef9c41c2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:05.477729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5a0b3fdb-cd85-4db5-8104-aa33ef9c41c2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:05.478530 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5a0b3fdb-cd85-4db5-8104-aa33ef9c41c2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:05.478982 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5a0b3fdb-cd85-4db5-8104-aa33ef9c41c2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:05.523333 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5a0b3fdb-cd85-4db5-8104-aa33ef9c41c2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "POST /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e/action" status: 202 len: 1139 microversion: 2.54 time: 0.286160 May 27 15:13:05.523981 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1942/3883] 10.222.0.13 () {62 vars in 1319 bytes} [Fri May 27 15:13:05 2022] POST /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e/action => generated 1139 bytes in 288 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 27 15:13:05.546113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0bc358b4-13fc-4692-a058-bd7c3a82a80c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:05.547769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0bc358b4-13fc-4692-a058-bd7c3a82a80c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:05.558969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bc358b4-13fc-4692-a058-bd7c3a82a80c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:05.560023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bc358b4-13fc-4692-a058-bd7c3a82a80c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:05.561311 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bc358b4-13fc-4692-a058-bd7c3a82a80c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:05.561995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bc358b4-13fc-4692-a058-bd7c3a82a80c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:05.666659 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0bc358b4-13fc-4692-a058-bd7c3a82a80c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:05.679970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0bc358b4-13fc-4692-a058-bd7c3a82a80c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:05.682218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0bc358b4-13fc-4692-a058-bd7c3a82a80c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:05.683451 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0bc358b4-13fc-4692-a058-bd7c3a82a80c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.142962 May 27 15:13:05.685461 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1942/3884] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:05 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:05.936910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2da40d23-1271-4756-9b93-637e05ba1feb tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:05.937542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2da40d23-1271-4756-9b93-637e05ba1feb tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] [instance: 70325c3b-8ac4-4d4e-a4bd-bf9a20750864] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:05.946141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2da40d23-1271-4756-9b93-637e05ba1feb tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:05.946671 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2da40d23-1271-4756-9b93-637e05ba1feb tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:05.948040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2da40d23-1271-4756-9b93-637e05ba1feb tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:05.948650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2da40d23-1271-4756-9b93-637e05ba1feb tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:05.967310 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-2da40d23-1271-4756-9b93-637e05ba1feb tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] HTTP exception thrown: Instance 70325c3b-8ac4-4d4e-a4bd-bf9a20750864 could not be found. May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2da40d23-1271-4756-9b93-637e05ba1feb tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Request method failure captured: May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864 HTTP/1.1 May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOpqYb_osZU1v6xG58wIKPK_0vNqicV3EYZT9myWcwfLMLy4D9HPsWnrm0X2jDZdPc3t3B0sPYmvQzoJBuYbyaqfqMjuAoXr8rkTXNhhL3MAiyesl-ovGt75AwtZ0CsMYmmeo0ZtuQ1HMnwLXoKrlxhtKPR4BIW5T_5b9D7UoAOrI04 May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 4a2ec376b67a4b62886183fd5041a582 May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerAddressesTestJSON-1555831270 May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a2ec376b67a4b62886183fd5041a582"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4a2ec376b67a4b62886183fd5041a582"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4a2ec376b67a4b62886183fd5041a582"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4a2ec376b67a4b62886183fd5041a582", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerAddressesTestJSON-1555831270 May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 4a2ec376b67a4b62886183fd5041a582 May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1555831270 May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerAddressesTestJSON-1555831270-project May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: bd15db99e887484783bdb07197b5efc8 May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerAddressesTestJSON-1555831270-project May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 70325c3b-8ac4-4d4e-a4bd-bf9a20750864 could not be found. May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '70325c3b-8ac4-4d4e-a4bd-bf9a20750864'} May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70325c3b-8ac4-4d4e-a4bd-bf9a20750864 could not be found. May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70325c3b-8ac4-4d4e-a4bd-bf9a20750864 could not be found. May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:05.969327 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:05.975276 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:05.975276 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:05.975276 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:05.975276 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:13:05.975276 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:13:05.975276 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70325c3b-8ac4-4d4e-a4bd-bf9a20750864 could not be found. May 27 15:13:05.975276 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:05.975276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2da40d23-1271-4756-9b93-637e05ba1feb tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] Returning 404 to user: Instance 70325c3b-8ac4-4d4e-a4bd-bf9a20750864 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:05.975276 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2da40d23-1271-4756-9b93-637e05ba1feb tempest-ServerAddressesTestJSON-1555831270 tempest-ServerAddressesTestJSON-1555831270-project] 10.222.0.13 "GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864" status: 404 len: 111 microversion: 2.1 time: 0.044856 May 27 15:13:05.975970 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1943/3885] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:05 2022] GET /compute/v2.1/servers/70325c3b-8ac4-4d4e-a4bd-bf9a20750864 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:13:06.196495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-80374ed1-8b78-487a-9e1b-2365f48169dc tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:06.197703 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-80374ed1-8b78-487a-9e1b-2365f48169dc tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:06.206116 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-80374ed1-8b78-487a-9e1b-2365f48169dc tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:06.206955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-80374ed1-8b78-487a-9e1b-2365f48169dc tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:06.207919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-80374ed1-8b78-487a-9e1b-2365f48169dc tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:06.208517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-80374ed1-8b78-487a-9e1b-2365f48169dc tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:06.483240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-80374ed1-8b78-487a-9e1b-2365f48169dc tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:06.494815 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-80374ed1-8b78-487a-9e1b-2365f48169dc tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.302548 May 27 15:13:06.496296 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1943/3886] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:06 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:06.704586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-13f032d7-932c-41f5-8201-2f09c1c251e2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:06.705274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-13f032d7-932c-41f5-8201-2f09c1c251e2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:06.712269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13f032d7-932c-41f5-8201-2f09c1c251e2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:06.716187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13f032d7-932c-41f5-8201-2f09c1c251e2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:06.717063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13f032d7-932c-41f5-8201-2f09c1c251e2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:06.717690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13f032d7-932c-41f5-8201-2f09c1c251e2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:06.875642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-13f032d7-932c-41f5-8201-2f09c1c251e2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:06.898234 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-13f032d7-932c-41f5-8201-2f09c1c251e2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:06.906088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-13f032d7-932c-41f5-8201-2f09c1c251e2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:06.908230 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-13f032d7-932c-41f5-8201-2f09c1c251e2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.208121 May 27 15:13:06.915659 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1944/3887] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:06 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:07.514029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-42656f8b-1ae2-4027-a510-1736f0b0eae0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:07.516743 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-42656f8b-1ae2-4027-a510-1736f0b0eae0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:07.528204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-42656f8b-1ae2-4027-a510-1736f0b0eae0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:07.528685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-42656f8b-1ae2-4027-a510-1736f0b0eae0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:07.529543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-42656f8b-1ae2-4027-a510-1736f0b0eae0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:07.530026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-42656f8b-1ae2-4027-a510-1736f0b0eae0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:07.708694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-42656f8b-1ae2-4027-a510-1736f0b0eae0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:07.718696 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-42656f8b-1ae2-4027-a510-1736f0b0eae0 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.210612 May 27 15:13:07.719293 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1944/3888] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:07 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:07.930691 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1dd07335-726a-443b-9b60-729e06ecd76f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:07.931912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1dd07335-726a-443b-9b60-729e06ecd76f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:07.941779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1dd07335-726a-443b-9b60-729e06ecd76f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:07.942441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1dd07335-726a-443b-9b60-729e06ecd76f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:07.945075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1dd07335-726a-443b-9b60-729e06ecd76f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:07.945075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1dd07335-726a-443b-9b60-729e06ecd76f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:08.040180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1dd07335-726a-443b-9b60-729e06ecd76f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:08.046945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:08.058189 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1dd07335-726a-443b-9b60-729e06ecd76f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:08.061035 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1dd07335-726a-443b-9b60-729e06ecd76f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:08.062289 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1dd07335-726a-443b-9b60-729e06ecd76f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.137079 May 27 15:13:08.062863 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1945/3889] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:07 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:08.530220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0821b7a3-7970-4723-a712-ff275e6ff30f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:08.532902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0821b7a3-7970-4723-a712-ff275e6ff30f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:08.544871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0821b7a3-7970-4723-a712-ff275e6ff30f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:08.545892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0821b7a3-7970-4723-a712-ff275e6ff30f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:08.548397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0821b7a3-7970-4723-a712-ff275e6ff30f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:08.549994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0821b7a3-7970-4723-a712-ff275e6ff30f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:08.597781 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0821b7a3-7970-4723-a712-ff275e6ff30f tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.075313 May 27 15:13:08.605083 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1945/3890] 10.222.0.13 () {60 vars in 1342 bytes} [Fri May 27 15:13:08 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:08.695218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1da9d1b5-1a42-4282-97e2-4bf2fabf3848 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:08.695730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1da9d1b5-1a42-4282-97e2-4bf2fabf3848 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:08.701146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:08.711269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1da9d1b5-1a42-4282-97e2-4bf2fabf3848 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:08.712095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1da9d1b5-1a42-4282-97e2-4bf2fabf3848 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:08.713489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1da9d1b5-1a42-4282-97e2-4bf2fabf3848 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:08.714646 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1da9d1b5-1a42-4282-97e2-4bf2fabf3848 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:08.740948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e4e3e043-3702-430c-bca1-277610d84684 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:08.742439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e4e3e043-3702-430c-bca1-277610d84684 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:08.753218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4e3e043-3702-430c-bca1-277610d84684 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:08.754379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4e3e043-3702-430c-bca1-277610d84684 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:08.756139 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4e3e043-3702-430c-bca1-277610d84684 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:08.757198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4e3e043-3702-430c-bca1-277610d84684 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:08.767546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1da9d1b5-1a42-4282-97e2-4bf2fabf3848 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:13:08.922613 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1da9d1b5-1a42-4282-97e2-4bf2fabf3848 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 204 len: 0 microversion: 2.20 time: 0.230383 May 27 15:13:08.930222 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1946/3891] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:13:08 2022] DELETE /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:13:08.938821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cb7244f7-11de-4655-9c5e-3186620dd111 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:08.940470 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cb7244f7-11de-4655-9c5e-3186620dd111 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:08.949595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cb7244f7-11de-4655-9c5e-3186620dd111 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:08.950634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cb7244f7-11de-4655-9c5e-3186620dd111 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:08.951580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cb7244f7-11de-4655-9c5e-3186620dd111 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:08.952125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cb7244f7-11de-4655-9c5e-3186620dd111 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:09.104990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e4e3e043-3702-430c-bca1-277610d84684 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:09.122721 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e4e3e043-3702-430c-bca1-277610d84684 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.388580 May 27 15:13:09.132932 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1946/3892] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:08 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:09.145661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b4bea012-7469-48f7-a759-1665ed88ae41 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:09.147567 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b4bea012-7469-48f7-a759-1665ed88ae41 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:09.157715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4bea012-7469-48f7-a759-1665ed88ae41 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:09.158193 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4bea012-7469-48f7-a759-1665ed88ae41 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:09.159370 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4bea012-7469-48f7-a759-1665ed88ae41 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:09.159945 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4bea012-7469-48f7-a759-1665ed88ae41 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:09.182458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:09.210772 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cb7244f7-11de-4655-9c5e-3186620dd111 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:09.220506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cb7244f7-11de-4655-9c5e-3186620dd111 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:09.222251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cb7244f7-11de-4655-9c5e-3186620dd111 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:09.223771 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cb7244f7-11de-4655-9c5e-3186620dd111 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1723 microversion: 2.20 time: 0.292319 May 27 15:13:09.224506 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1947/3893] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:08 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:09.275088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b4bea012-7469-48f7-a759-1665ed88ae41 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:09.292897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b4bea012-7469-48f7-a759-1665ed88ae41 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:09.298347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b4bea012-7469-48f7-a759-1665ed88ae41 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:09.300654 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b4bea012-7469-48f7-a759-1665ed88ae41 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.161573 May 27 15:13:09.304886 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1947/3894] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:09 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:10.148395 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a3e9fc20-05f6-4837-8de3-9682775061bd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:10.150771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a3e9fc20-05f6-4837-8de3-9682775061bd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:10.153699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:10.177798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3e9fc20-05f6-4837-8de3-9682775061bd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:10.178574 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3e9fc20-05f6-4837-8de3-9682775061bd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:10.179872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3e9fc20-05f6-4837-8de3-9682775061bd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:10.180331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3e9fc20-05f6-4837-8de3-9682775061bd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:10.244532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-23a02cf1-21e7-4792-b627-fee36ed304bc tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:10.246522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-23a02cf1-21e7-4792-b627-fee36ed304bc tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:10.254859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23a02cf1-21e7-4792-b627-fee36ed304bc tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:10.257132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23a02cf1-21e7-4792-b627-fee36ed304bc tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:10.258079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23a02cf1-21e7-4792-b627-fee36ed304bc tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:10.258621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23a02cf1-21e7-4792-b627-fee36ed304bc tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:10.485860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a3e9fc20-05f6-4837-8de3-9682775061bd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:10.500227 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a3e9fc20-05f6-4837-8de3-9682775061bd tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.357791 May 27 15:13:10.501220 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1948/3895] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:10 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:10.511099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a499dd22-f677-4126-ab5d-bd22f28efe48 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:10.512776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a499dd22-f677-4126-ab5d-bd22f28efe48 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:10.523009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a499dd22-f677-4126-ab5d-bd22f28efe48 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:10.524262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a499dd22-f677-4126-ab5d-bd22f28efe48 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:10.525638 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a499dd22-f677-4126-ab5d-bd22f28efe48 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:10.527206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a499dd22-f677-4126-ab5d-bd22f28efe48 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:10.533181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-23a02cf1-21e7-4792-b627-fee36ed304bc tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:10.547520 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-23a02cf1-21e7-4792-b627-fee36ed304bc tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:10.551013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-23a02cf1-21e7-4792-b627-fee36ed304bc tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:10.560601 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-23a02cf1-21e7-4792-b627-fee36ed304bc tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1723 microversion: 2.20 time: 0.313877 May 27 15:13:10.578250 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1948/3896] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:10 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1723 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:10.648628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a499dd22-f677-4126-ab5d-bd22f28efe48 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:10.658898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a499dd22-f677-4126-ab5d-bd22f28efe48 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:10.660426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a499dd22-f677-4126-ab5d-bd22f28efe48 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:10.661999 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a499dd22-f677-4126-ab5d-bd22f28efe48 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.158608 May 27 15:13:10.663445 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1949/3897] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:10 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:11.519349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cad8e9fd-2c2e-45c1-8068-4d076b5b8211 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:11.519918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cad8e9fd-2c2e-45c1-8068-4d076b5b8211 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:11.531028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cad8e9fd-2c2e-45c1-8068-4d076b5b8211 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:11.531785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cad8e9fd-2c2e-45c1-8068-4d076b5b8211 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:11.532830 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cad8e9fd-2c2e-45c1-8068-4d076b5b8211 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:11.533484 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cad8e9fd-2c2e-45c1-8068-4d076b5b8211 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:11.583588 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-92ba619c-d9ab-4271-bb79-03b114b48421 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:11.590641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-92ba619c-d9ab-4271-bb79-03b114b48421 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:11.603510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-92ba619c-d9ab-4271-bb79-03b114b48421 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:11.614540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-92ba619c-d9ab-4271-bb79-03b114b48421 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:11.616312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-92ba619c-d9ab-4271-bb79-03b114b48421 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:11.629463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-92ba619c-d9ab-4271-bb79-03b114b48421 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:11.825313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cad8e9fd-2c2e-45c1-8068-4d076b5b8211 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:11.833435 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cad8e9fd-2c2e-45c1-8068-4d076b5b8211 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.319391 May 27 15:13:11.834267 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1949/3898] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:11 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:11.846385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-58525107-217f-4b37-a4c1-a26a80063ae5 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:11.847292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-58525107-217f-4b37-a4c1-a26a80063ae5 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:11.855631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-58525107-217f-4b37-a4c1-a26a80063ae5 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:11.856379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-58525107-217f-4b37-a4c1-a26a80063ae5 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:11.857526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-58525107-217f-4b37-a4c1-a26a80063ae5 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:11.858259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-58525107-217f-4b37-a4c1-a26a80063ae5 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:11.864245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:11.887539 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-92ba619c-d9ab-4271-bb79-03b114b48421 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:11.899261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-92ba619c-d9ab-4271-bb79-03b114b48421 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:11.901188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-92ba619c-d9ab-4271-bb79-03b114b48421 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:11.912641 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-92ba619c-d9ab-4271-bb79-03b114b48421 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1723 microversion: 2.20 time: 0.331760 May 27 15:13:11.913557 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1950/3899] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:11 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1723 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:13:11.956158 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-58525107-217f-4b37-a4c1-a26a80063ae5 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:11.975951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-58525107-217f-4b37-a4c1-a26a80063ae5 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:11.978437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-58525107-217f-4b37-a4c1-a26a80063ae5 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:11.980426 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-58525107-217f-4b37-a4c1-a26a80063ae5 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.145057 May 27 15:13:11.981297 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1950/3900] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:11 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:12.850512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-55056164-e033-4d05-ac0d-55bd48c875c5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:12.851402 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-55056164-e033-4d05-ac0d-55bd48c875c5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:12.858688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-55056164-e033-4d05-ac0d-55bd48c875c5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:12.859126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-55056164-e033-4d05-ac0d-55bd48c875c5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:12.860010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-55056164-e033-4d05-ac0d-55bd48c875c5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:12.860578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-55056164-e033-4d05-ac0d-55bd48c875c5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:12.935993 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e46f7956-cfa1-4800-ba48-2bc84f407b73 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:12.936631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e46f7956-cfa1-4800-ba48-2bc84f407b73 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:12.952641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e46f7956-cfa1-4800-ba48-2bc84f407b73 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:12.955030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e46f7956-cfa1-4800-ba48-2bc84f407b73 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:12.957287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e46f7956-cfa1-4800-ba48-2bc84f407b73 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:12.959554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e46f7956-cfa1-4800-ba48-2bc84f407b73 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:13.101603 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e46f7956-cfa1-4800-ba48-2bc84f407b73 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:13.119554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e46f7956-cfa1-4800-ba48-2bc84f407b73 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:13.122504 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e46f7956-cfa1-4800-ba48-2bc84f407b73 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:13.125651 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e46f7956-cfa1-4800-ba48-2bc84f407b73 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1655 microversion: 2.20 time: 0.194614 May 27 15:13:13.125883 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-55056164-e033-4d05-ac0d-55bd48c875c5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:13.127576 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1951/3901] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:12 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1655 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:13.136118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c55c96a4-b4d3-4706-9b8b-461a3fadedfc tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:13.137888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c55c96a4-b4d3-4706-9b8b-461a3fadedfc tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:13.149104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c55c96a4-b4d3-4706-9b8b-461a3fadedfc tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:13.149909 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-55056164-e033-4d05-ac0d-55bd48c875c5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.303903 May 27 15:13:13.150075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c55c96a4-b4d3-4706-9b8b-461a3fadedfc tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:13.150620 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1951/3902] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:12 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:13.150879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c55c96a4-b4d3-4706-9b8b-461a3fadedfc tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:13.151778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c55c96a4-b4d3-4706-9b8b-461a3fadedfc tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:13.233397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c55c96a4-b4d3-4706-9b8b-461a3fadedfc tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:13.243281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c55c96a4-b4d3-4706-9b8b-461a3fadedfc tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:13.245071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c55c96a4-b4d3-4706-9b8b-461a3fadedfc tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:13.246769 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c55c96a4-b4d3-4706-9b8b-461a3fadedfc tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.117700 May 27 15:13:13.247422 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1952/3903] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:13 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:13.803233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-4cad255c-85da-422e-8e40-f87327520ab0 req-d8424736-0c3b-4236-bf50-59708911513a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7371c18-20d2-43f8-b0c6-0371079d8f20", "name": "network-vif-deleted", "tag": "555c9e09-9066-4780-8d8a-91ccfe7dff8d"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:13.838868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4cad255c-85da-422e-8e40-f87327520ab0 req-d8424736-0c3b-4236-bf50-59708911513a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:13.839311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4cad255c-85da-422e-8e40-f87327520ab0 req-d8424736-0c3b-4236-bf50-59708911513a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:13.870577 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-4cad255c-85da-422e-8e40-f87327520ab0 req-d8424736-0c3b-4236-bf50-59708911513a service nova] Creating event network-vif-deleted:555c9e09-9066-4780-8d8a-91ccfe7dff8d for instance d7371c18-20d2-43f8-b0c6-0371079d8f20 on n-h2-843621-1 May 27 15:13:13.900504 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-4cad255c-85da-422e-8e40-f87327520ab0 req-d8424736-0c3b-4236-bf50-59708911513a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097379 May 27 15:13:13.903469 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1952/3904] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:14.152542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-590952ef-a4af-4d03-ad3f-5fb0f0319b56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:14.153159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-590952ef-a4af-4d03-ad3f-5fb0f0319b56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:14.169191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-590952ef-a4af-4d03-ad3f-5fb0f0319b56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:14.170186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-546b8af1-118a-45a6-9271-103b5e3c398f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:14.171138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-546b8af1-118a-45a6-9271-103b5e3c398f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:14.172571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-590952ef-a4af-4d03-ad3f-5fb0f0319b56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:14.173903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-590952ef-a4af-4d03-ad3f-5fb0f0319b56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:14.178791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-590952ef-a4af-4d03-ad3f-5fb0f0319b56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:14.183124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-546b8af1-118a-45a6-9271-103b5e3c398f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:14.185760 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-546b8af1-118a-45a6-9271-103b5e3c398f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:14.186756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-546b8af1-118a-45a6-9271-103b5e3c398f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:14.187392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-546b8af1-118a-45a6-9271-103b5e3c398f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:14.284366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-590952ef-a4af-4d03-ad3f-5fb0f0319b56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:14.285734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-590952ef-a4af-4d03-ad3f-5fb0f0319b56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:14.286225 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-590952ef-a4af-4d03-ad3f-5fb0f0319b56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lazy-loading 'fault' on Instance uuid d7371c18-20d2-43f8-b0c6-0371079d8f20 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:13:14.561169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-590952ef-a4af-4d03-ad3f-5fb0f0319b56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:14.589237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-590952ef-a4af-4d03-ad3f-5fb0f0319b56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:14.606535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-590952ef-a4af-4d03-ad3f-5fb0f0319b56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13124d91fc454405af084784c6f447ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565af3212e74e83b5adc7465922a274', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:14.616213 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-590952ef-a4af-4d03-ad3f-5fb0f0319b56 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 200 len: 1370 microversion: 2.20 time: 0.467966 May 27 15:13:14.617450 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1953/3905] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:14 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 1370 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:13:14.687950 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-22510484-0de5-4f9c-9309-04c9bf233515 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:14.695450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-22510484-0de5-4f9c-9309-04c9bf233515 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:14.744948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22510484-0de5-4f9c-9309-04c9bf233515 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:14.744948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22510484-0de5-4f9c-9309-04c9bf233515 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:14.747416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22510484-0de5-4f9c-9309-04c9bf233515 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:14.750790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22510484-0de5-4f9c-9309-04c9bf233515 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:15.088615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-22510484-0de5-4f9c-9309-04c9bf233515 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:15.108333 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-22510484-0de5-4f9c-9309-04c9bf233515 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:15.119064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-22510484-0de5-4f9c-9309-04c9bf233515 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:15.123962 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-22510484-0de5-4f9c-9309-04c9bf233515 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.503882 May 27 15:13:15.125439 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1954/3906] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:14 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:15.346310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-546b8af1-118a-45a6-9271-103b5e3c398f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:15.362472 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-546b8af1-118a-45a6-9271-103b5e3c398f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 1.197968 May 27 15:13:15.377889 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1953/3907] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:14 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:15.669123 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=10 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:15.692930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-16f6d3a3-3cc3-45b1-9067-a039df11bfed tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:15.699991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-16f6d3a3-3cc3-45b1-9067-a039df11bfed tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:15.713820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16f6d3a3-3cc3-45b1-9067-a039df11bfed tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:15.714292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16f6d3a3-3cc3-45b1-9067-a039df11bfed tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:15.733944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16f6d3a3-3cc3-45b1-9067-a039df11bfed tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:15.739579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16f6d3a3-3cc3-45b1-9067-a039df11bfed tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:15.785031 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-16f6d3a3-3cc3-45b1-9067-a039df11bfed tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] HTTP exception thrown: Instance d7371c18-20d2-43f8-b0c6-0371079d8f20 could not be found. May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-16f6d3a3-3cc3-45b1-9067-a039df11bfed tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Request method failure captured: May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 HTTP/1.1 May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOjF6rvMnwWf1fRJt26Wn5XRF7EUO5sXXuEaxwBKoPEc5z9FjH_7NDJRc_43kplV1FEfz14qdrP3ds-i24EyFzWma2Lu22che-wRMQA6x1MCvG29dubYGaP8v-OZu3yzAQ3lS3Tvm0No_avKhYFvwDITxqVSytbHmXvtMmmJ9LgNBbo May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-Openstack-Nova-Api-Version: 2.20 May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 3565af3212e74e83b5adc7465922a274 May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1265741676 May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3565af3212e74e83b5adc7465922a274"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3565af3212e74e83b5adc7465922a274"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3565af3212e74e83b5adc7465922a274"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3565af3212e74e83b5adc7465922a274", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1265741676 May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 3565af3212e74e83b5adc7465922a274 May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1265741676 May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AttachVolumeShelveTestJSON-1265741676-project May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 13124d91fc454405af084784c6f447ab May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1265741676-project May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance d7371c18-20d2-43f8-b0c6-0371079d8f20 could not be found. May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'd7371c18-20d2-43f8-b0c6-0371079d8f20'} May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7371c18-20d2-43f8-b0c6-0371079d8f20 could not be found. May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7371c18-20d2-43f8-b0c6-0371079d8f20 could not be found. May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:15.795557 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:15.803066 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:15.803066 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:15.803066 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:15.803066 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:15.803066 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:13:15.803066 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:13:15.803066 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7371c18-20d2-43f8-b0c6-0371079d8f20 could not be found. May 27 15:13:15.803066 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:15.806772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-16f6d3a3-3cc3-45b1-9067-a039df11bfed tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Returning 404 to user: Instance d7371c18-20d2-43f8-b0c6-0371079d8f20 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:15.808719 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-16f6d3a3-3cc3-45b1-9067-a039df11bfed tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 404 len: 111 microversion: 2.20 time: 0.160867 May 27 15:13:15.814018 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1955/3908] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:15 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:13:15.823495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ee5d830e-84ed-4083-8a0b-17f87d658fec tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '.version_select at 0x7fc776c9d940>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:15.857215 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ee5d830e-84ed-4083-8a0b-17f87d658fec tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-104961567" status: 204 len: 0 microversion: 2.20 time: 0.040225 May 27 15:13:15.863815 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1954/3909] 10.222.0.13 () {60 vars in 1258 bytes} [Fri May 27 15:13:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-104961567 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:13:15.977624 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-ff244e3c-4701-4815-9b37-738540de54d0 req-427b9f5a-a280-4df5-99a4-d9b117336bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0315e4-284c-4269-86ea-b5ac6e3b4084", "name": "network-vif-unplugged", "status": "completed", "tag": "06db990f-6e8f-4fb3-b9b9-a0416d4a7cef"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:15.993508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-ff244e3c-4701-4815-9b37-738540de54d0 req-427b9f5a-a280-4df5-99a4-d9b117336bfd service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:15.994046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-ff244e3c-4701-4815-9b37-738540de54d0 req-427b9f5a-a280-4df5-99a4-d9b117336bfd service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:16.025079 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-ff244e3c-4701-4815-9b37-738540de54d0 req-427b9f5a-a280-4df5-99a4-d9b117336bfd service nova] Creating event network-vif-unplugged:06db990f-6e8f-4fb3-b9b9-a0416d4a7cef for instance 0e0315e4-284c-4269-86ea-b5ac6e3b4084 on n-h1-843621-1 May 27 15:13:16.045086 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-ff244e3c-4701-4815-9b37-738540de54d0 req-427b9f5a-a280-4df5-99a4-d9b117336bfd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071404 May 27 15:13:16.047759 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1956/3910] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:16.160871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5468fdfd-1a66-4f76-962f-9f632d527846 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:16.161359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5468fdfd-1a66-4f76-962f-9f632d527846 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:16.179887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5468fdfd-1a66-4f76-962f-9f632d527846 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:16.181811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5468fdfd-1a66-4f76-962f-9f632d527846 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:16.184786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5468fdfd-1a66-4f76-962f-9f632d527846 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:16.185259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5468fdfd-1a66-4f76-962f-9f632d527846 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:16.372529 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5468fdfd-1a66-4f76-962f-9f632d527846 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:16.388263 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fceeac5f-3b1e-4ae3-975b-361fa9eec9c7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:16.389338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5468fdfd-1a66-4f76-962f-9f632d527846 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:16.389707 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fceeac5f-3b1e-4ae3-975b-361fa9eec9c7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:16.392430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5468fdfd-1a66-4f76-962f-9f632d527846 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:16.398561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fceeac5f-3b1e-4ae3-975b-361fa9eec9c7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:16.399342 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fceeac5f-3b1e-4ae3-975b-361fa9eec9c7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:16.400490 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5468fdfd-1a66-4f76-962f-9f632d527846 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.254021 May 27 15:13:16.400734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fceeac5f-3b1e-4ae3-975b-361fa9eec9c7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:16.401288 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1955/3911] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:16 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:16.412976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fceeac5f-3b1e-4ae3-975b-361fa9eec9c7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:16.864646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fceeac5f-3b1e-4ae3-975b-361fa9eec9c7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:16.882670 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fceeac5f-3b1e-4ae3-975b-361fa9eec9c7 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.499145 May 27 15:13:16.883323 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1957/3912] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:16 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:17.420856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-664aa6e4-3a40-41be-a077-09f125f4f41f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:17.425672 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-664aa6e4-3a40-41be-a077-09f125f4f41f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:17.431098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-664aa6e4-3a40-41be-a077-09f125f4f41f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:17.431867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-664aa6e4-3a40-41be-a077-09f125f4f41f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:17.433009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-664aa6e4-3a40-41be-a077-09f125f4f41f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:17.433561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-664aa6e4-3a40-41be-a077-09f125f4f41f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:17.600497 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-664aa6e4-3a40-41be-a077-09f125f4f41f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:17.611865 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-664aa6e4-3a40-41be-a077-09f125f4f41f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:17.613634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-664aa6e4-3a40-41be-a077-09f125f4f41f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:17.616416 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-664aa6e4-3a40-41be-a077-09f125f4f41f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.200474 May 27 15:13:17.617960 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1956/3913] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:17 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:17.908784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1c7b7998-fb30-4437-97a0-f8b925fca7b5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:17.910027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1c7b7998-fb30-4437-97a0-f8b925fca7b5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:17.923703 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1c7b7998-fb30-4437-97a0-f8b925fca7b5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:17.924166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1c7b7998-fb30-4437-97a0-f8b925fca7b5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:17.925814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1c7b7998-fb30-4437-97a0-f8b925fca7b5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:17.926525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1c7b7998-fb30-4437-97a0-f8b925fca7b5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:18.139761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-95c9a314-e6b4-4f25-852a-fe3d0f133db9 req-42727b8f-2220-4896-ba3c-55dc3482c7fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0315e4-284c-4269-86ea-b5ac6e3b4084", "tag": "06db990f-6e8f-4fb3-b9b9-a0416d4a7cef"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:18.166290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-95c9a314-e6b4-4f25-852a-fe3d0f133db9 req-42727b8f-2220-4896-ba3c-55dc3482c7fb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:18.167854 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-95c9a314-e6b4-4f25-852a-fe3d0f133db9 req-42727b8f-2220-4896-ba3c-55dc3482c7fb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:18.231113 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-95c9a314-e6b4-4f25-852a-fe3d0f133db9 req-42727b8f-2220-4896-ba3c-55dc3482c7fb service nova] Creating event network-changed:06db990f-6e8f-4fb3-b9b9-a0416d4a7cef for instance 0e0315e4-284c-4269-86ea-b5ac6e3b4084 on n-h1-843621-1 May 27 15:13:18.246130 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-95c9a314-e6b4-4f25-852a-fe3d0f133db9 req-42727b8f-2220-4896-ba3c-55dc3482c7fb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112979 May 27 15:13:18.252503 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1957/3914] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:13:18.340836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1c7b7998-fb30-4437-97a0-f8b925fca7b5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:18.352332 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1c7b7998-fb30-4437-97a0-f8b925fca7b5 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.449818 May 27 15:13:18.356422 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1958/3915] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:17 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:18.637863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8d4194f9-a6e7-4962-9eec-d5d535b2f4d3 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:18.639053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8d4194f9-a6e7-4962-9eec-d5d535b2f4d3 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:18.652797 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d4194f9-a6e7-4962-9eec-d5d535b2f4d3 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:18.664166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d4194f9-a6e7-4962-9eec-d5d535b2f4d3 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:18.665247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d4194f9-a6e7-4962-9eec-d5d535b2f4d3 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:18.665904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d4194f9-a6e7-4962-9eec-d5d535b2f4d3 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:18.857211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8d4194f9-a6e7-4962-9eec-d5d535b2f4d3 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:18.876077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8d4194f9-a6e7-4962-9eec-d5d535b2f4d3 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:18.883064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8d4194f9-a6e7-4962-9eec-d5d535b2f4d3 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:18.890064 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8d4194f9-a6e7-4962-9eec-d5d535b2f4d3 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.256522 May 27 15:13:18.893808 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1958/3916] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:18 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:19.379268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-da968f3c-5d88-4b44-a3f3-86bc8d465737 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:19.381274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-da968f3c-5d88-4b44-a3f3-86bc8d465737 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:19.407739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da968f3c-5d88-4b44-a3f3-86bc8d465737 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:19.409057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da968f3c-5d88-4b44-a3f3-86bc8d465737 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:19.413471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da968f3c-5d88-4b44-a3f3-86bc8d465737 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:19.417362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da968f3c-5d88-4b44-a3f3-86bc8d465737 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:19.478205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bda1e47b-cf4b-4dc9-bd9f-de633f8a42ab tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Action: 'create', calling method: .version_select at 0x7fc7769ad5e0>, body: {"keypair": {"name": "tempest-keypair-1202279322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJsiKCQV4Hww9ZYwSa3sewIBXC10PTa1jRW2Ni6KICDHHW6DqGQV7TPkhVZZFrY1TPlHv8+vzBsnDxiBeWtVvP08FlriMx3WhGPGJKGXudwdrJQ6qIJbt/Umioqfam0/w=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:19.502769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-bda1e47b-cf4b-4dc9-bd9f-de633f8a42ab tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Getting quotas for project 73054e8eb659476bb30aa574d7251758. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:13:19.510452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-bda1e47b-cf4b-4dc9-bd9f-de633f8a42ab tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Getting quotas for user 6fdf02b03cac44cb89d2cf3b373fb9e1 and project 73054e8eb659476bb30aa574d7251758. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:13:19.549298 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bda1e47b-cf4b-4dc9-bd9f-de633f8a42ab tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.591595 May 27 15:13:19.552273 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1959/3917] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:13:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:19.722463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-da968f3c-5d88-4b44-a3f3-86bc8d465737 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:19.739302 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-da968f3c-5d88-4b44-a3f3-86bc8d465737 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.369484 May 27 15:13:19.742649 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1959/3918] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:19 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:19.913994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d9b9e033-9af5-40ff-b567-52cdcd1c0926 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:19.915042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d9b9e033-9af5-40ff-b567-52cdcd1c0926 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:19.929823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:19.932283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d9b9e033-9af5-40ff-b567-52cdcd1c0926 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:19.933055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d9b9e033-9af5-40ff-b567-52cdcd1c0926 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:19.935530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d9b9e033-9af5-40ff-b567-52cdcd1c0926 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:19.939712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d9b9e033-9af5-40ff-b567-52cdcd1c0926 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:20.071388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d9b9e033-9af5-40ff-b567-52cdcd1c0926 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:20.088113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d9b9e033-9af5-40ff-b567-52cdcd1c0926 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:20.091684 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d9b9e033-9af5-40ff-b567-52cdcd1c0926 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:20.093846 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d9b9e033-9af5-40ff-b567-52cdcd1c0926 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.185382 May 27 15:13:20.109218 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1960/3919] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:19 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:20.762217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c096d180-03f0-4881-9071-1a8d632f3ab3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:20.763665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c096d180-03f0-4881-9071-1a8d632f3ab3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:20.782642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c096d180-03f0-4881-9071-1a8d632f3ab3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:20.789453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c096d180-03f0-4881-9071-1a8d632f3ab3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:20.790773 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c096d180-03f0-4881-9071-1a8d632f3ab3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:20.791315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c096d180-03f0-4881-9071-1a8d632f3ab3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:21.116134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d06397e6-beb2-4444-99e2-a3ea9e68f7b2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:21.116796 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d06397e6-beb2-4444-99e2-a3ea9e68f7b2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:21.144475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d06397e6-beb2-4444-99e2-a3ea9e68f7b2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:21.145187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d06397e6-beb2-4444-99e2-a3ea9e68f7b2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:21.151685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d06397e6-beb2-4444-99e2-a3ea9e68f7b2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:21.154254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d06397e6-beb2-4444-99e2-a3ea9e68f7b2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:21.520288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d06397e6-beb2-4444-99e2-a3ea9e68f7b2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:21.539236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d06397e6-beb2-4444-99e2-a3ea9e68f7b2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:21.546076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d06397e6-beb2-4444-99e2-a3ea9e68f7b2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:21.549835 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d06397e6-beb2-4444-99e2-a3ea9e68f7b2 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.438975 May 27 15:13:21.557649 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1961/3920] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:21 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:13:21.773934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c096d180-03f0-4881-9071-1a8d632f3ab3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:21.783497 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c096d180-03f0-4881-9071-1a8d632f3ab3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 1.028195 May 27 15:13:21.784077 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1960/3921] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:20 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:22.592758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a203e2ef-3665-45cb-b0b8-92f398cbd355 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:22.593426 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a203e2ef-3665-45cb-b0b8-92f398cbd355 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:22.611154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a203e2ef-3665-45cb-b0b8-92f398cbd355 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:22.611626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a203e2ef-3665-45cb-b0b8-92f398cbd355 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:22.612617 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a203e2ef-3665-45cb-b0b8-92f398cbd355 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:22.613532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a203e2ef-3665-45cb-b0b8-92f398cbd355 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:22.778667 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a203e2ef-3665-45cb-b0b8-92f398cbd355 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:22.792696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a203e2ef-3665-45cb-b0b8-92f398cbd355 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:22.794401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a203e2ef-3665-45cb-b0b8-92f398cbd355 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:22.804380 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a203e2ef-3665-45cb-b0b8-92f398cbd355 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.232181 May 27 15:13:22.806618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4fa265e8-ffa3-4756-b08f-211d84b23e64 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:22.807313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4fa265e8-ffa3-4756-b08f-211d84b23e64 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:22.823941 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1962/3922] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:22 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:22.826021 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4fa265e8-ffa3-4756-b08f-211d84b23e64 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:22.828288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4fa265e8-ffa3-4756-b08f-211d84b23e64 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:22.829516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4fa265e8-ffa3-4756-b08f-211d84b23e64 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:22.830261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4fa265e8-ffa3-4756-b08f-211d84b23e64 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:22.850610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b0a66860-40ec-484e-bcc5-d925500a066c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-166841780", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd9b0c1e-1337-41c4-ad51-76af42807fc2"}], "security_groups": [{"name": "tempest-securitygroup--1996503364"}], "key_name": "tempest-keypair-1202279322", "user_data": "}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:23.230492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-b0a66860-40ec-484e-bcc5-d925500a066c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] validate_networks() for [('bd9b0c1e-1337-41c4-ad51-76af42807fc2', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:13:23.277305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4fa265e8-ffa3-4756-b08f-211d84b23e64 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:23.289766 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4fa265e8-ffa3-4756-b08f-211d84b23e64 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.487098 May 27 15:13:23.290379 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1961/3923] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:22 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:23.832724 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-79c2ebd8-1e1f-44ca-9bdc-3677334c838d tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:23.833412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-79c2ebd8-1e1f-44ca-9bdc-3677334c838d tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:23.847287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79c2ebd8-1e1f-44ca-9bdc-3677334c838d tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:23.847762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79c2ebd8-1e1f-44ca-9bdc-3677334c838d tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:23.852982 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79c2ebd8-1e1f-44ca-9bdc-3677334c838d tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:23.853472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79c2ebd8-1e1f-44ca-9bdc-3677334c838d tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:24.065244 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-79c2ebd8-1e1f-44ca-9bdc-3677334c838d tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:24.078159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-79c2ebd8-1e1f-44ca-9bdc-3677334c838d tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:24.083107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-79c2ebd8-1e1f-44ca-9bdc-3677334c838d tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:24.088169 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-79c2ebd8-1e1f-44ca-9bdc-3677334c838d tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.261242 May 27 15:13:24.090672 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1962/3924] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:23 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:13:24.310070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-471a8f77-8eec-4222-afd5-4a115a8a6c3d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:24.310696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-471a8f77-8eec-4222-afd5-4a115a8a6c3d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:24.317359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-471a8f77-8eec-4222-afd5-4a115a8a6c3d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:24.321273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-471a8f77-8eec-4222-afd5-4a115a8a6c3d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:24.322278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-471a8f77-8eec-4222-afd5-4a115a8a6c3d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:24.329257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-471a8f77-8eec-4222-afd5-4a115a8a6c3d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:24.334857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:24.660928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-471a8f77-8eec-4222-afd5-4a115a8a6c3d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:24.673853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b0a66860-40ec-484e-bcc5-d925500a066c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:13:24.675048 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-471a8f77-8eec-4222-afd5-4a115a8a6c3d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.370853 May 27 15:13:24.692536 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1963/3925] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:24 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:24.696181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b0a66860-40ec-484e-bcc5-d925500a066c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:13:24.697379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b0a66860-40ec-484e-bcc5-d925500a066c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:13:24.698704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b0a66860-40ec-484e-bcc5-d925500a066c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:13:24.700194 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b0a66860-40ec-484e-bcc5-d925500a066c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:13:24.723246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b0a66860-40ec-484e-bcc5-d925500a066c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:24.726067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b0a66860-40ec-484e-bcc5-d925500a066c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:24.727805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b0a66860-40ec-484e-bcc5-d925500a066c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:24.728841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b0a66860-40ec-484e-bcc5-d925500a066c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:24.773548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-b0a66860-40ec-484e-bcc5-d925500a066c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Getting quotas for project 73054e8eb659476bb30aa574d7251758. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:13:24.786873 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-b0a66860-40ec-484e-bcc5-d925500a066c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Getting quotas for user 6fdf02b03cac44cb89d2cf3b373fb9e1 and project 73054e8eb659476bb30aa574d7251758. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:13:24.811388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b0a66860-40ec-484e-bcc5-d925500a066c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:13:24.814187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b0a66860-40ec-484e-bcc5-d925500a066c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:13:24.879086 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b0a66860-40ec-484e-bcc5-d925500a066c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.032909 May 27 15:13:24.892465 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f7156d70-2022-4500-bab7-5a0e65d0902d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:24.895853 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f7156d70-2022-4500-bab7-5a0e65d0902d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:24.902122 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1963/3926] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:13:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 2057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:13:25.017394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f7156d70-2022-4500-bab7-5a0e65d0902d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:25.027076 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f7156d70-2022-4500-bab7-5a0e65d0902d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1237 microversion: 2.1 time: 0.139457 May 27 15:13:25.032643 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1964/3927] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:24 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1237 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:25.112148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8ae4c54d-0d91-4f90-9330-9f3f5f7f5b1f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:25.113205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8ae4c54d-0d91-4f90-9330-9f3f5f7f5b1f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:25.125592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ae4c54d-0d91-4f90-9330-9f3f5f7f5b1f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:25.127368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ae4c54d-0d91-4f90-9330-9f3f5f7f5b1f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:25.129170 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ae4c54d-0d91-4f90-9330-9f3f5f7f5b1f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:25.131563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ae4c54d-0d91-4f90-9330-9f3f5f7f5b1f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:25.213114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b37a33ff-9ff6-4ab6-84bf-e46c7e908806 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:25.215025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b37a33ff-9ff6-4ab6-84bf-e46c7e908806 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:25.235009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b37a33ff-9ff6-4ab6-84bf-e46c7e908806 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:25.236297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b37a33ff-9ff6-4ab6-84bf-e46c7e908806 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:25.238076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b37a33ff-9ff6-4ab6-84bf-e46c7e908806 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:25.239049 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b37a33ff-9ff6-4ab6-84bf-e46c7e908806 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:25.261332 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-b37a33ff-9ff6-4ab6-84bf-e46c7e908806 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] HTTP exception thrown: Instance d7371c18-20d2-43f8-b0c6-0371079d8f20 could not be found. May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b37a33ff-9ff6-4ab6-84bf-e46c7e908806 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Request method failure captured: May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 HTTP/1.1 May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOjF6rvMnwWf1fRJt26Wn5XRF7EUO5sXXuEaxwBKoPEc5z9FjH_7NDJRc_43kplV1FEfz14qdrP3ds-i24EyFzWma2Lu22che-wRMQA6x1MCvG29dubYGaP8v-OZu3yzAQ3lS3Tvm0No_avKhYFvwDITxqVSytbHmXvtMmmJ9LgNBbo May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-Openstack-Nova-Api-Version: 2.20 May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 3565af3212e74e83b5adc7465922a274 May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1265741676 May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3565af3212e74e83b5adc7465922a274"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3565af3212e74e83b5adc7465922a274"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3565af3212e74e83b5adc7465922a274"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3565af3212e74e83b5adc7465922a274", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1265741676 May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 3565af3212e74e83b5adc7465922a274 May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1265741676 May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-AttachVolumeShelveTestJSON-1265741676-project May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 13124d91fc454405af084784c6f447ab May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1265741676-project May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance d7371c18-20d2-43f8-b0c6-0371079d8f20 could not be found. May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'd7371c18-20d2-43f8-b0c6-0371079d8f20'} May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7371c18-20d2-43f8-b0c6-0371079d8f20 could not be found. May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:13:25.263767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:13:25.271361 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7371c18-20d2-43f8-b0c6-0371079d8f20 could not be found. May 27 15:13:25.271361 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:25.271361 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:25.271361 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:25.271361 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:25.271361 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:25.271361 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:25.271361 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:13:25.271361 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:13:25.271361 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7371c18-20d2-43f8-b0c6-0371079d8f20 could not be found. May 27 15:13:25.271361 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:25.271361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b37a33ff-9ff6-4ab6-84bf-e46c7e908806 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Returning 404 to user: Instance d7371c18-20d2-43f8-b0c6-0371079d8f20 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:25.271361 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b37a33ff-9ff6-4ab6-84bf-e46c7e908806 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 404 len: 111 microversion: 2.20 time: 0.059570 May 27 15:13:25.285246 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1965/3928] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:13:25 2022] DELETE /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:13:25.294532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8ae4c54d-0d91-4f90-9330-9f3f5f7f5b1f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:25.305883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8ae4c54d-0d91-4f90-9330-9f3f5f7f5b1f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:25.306740 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8aace301-f9ad-4ff9-bcac-af798f077cdf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:25.309011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8ae4c54d-0d91-4f90-9330-9f3f5f7f5b1f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:25.310776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8aace301-f9ad-4ff9-bcac-af798f077cdf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: d7371c18-20d2-43f8-b0c6-0371079d8f20] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:25.311185 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8ae4c54d-0d91-4f90-9330-9f3f5f7f5b1f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.204359 May 27 15:13:25.312549 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1964/3929] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:25 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:25.325796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8aace301-f9ad-4ff9-bcac-af798f077cdf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:25.326654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8aace301-f9ad-4ff9-bcac-af798f077cdf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:25.328607 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8aace301-f9ad-4ff9-bcac-af798f077cdf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:25.329698 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8aace301-f9ad-4ff9-bcac-af798f077cdf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:25.361560 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-8aace301-f9ad-4ff9-bcac-af798f077cdf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] HTTP exception thrown: Instance d7371c18-20d2-43f8-b0c6-0371079d8f20 could not be found. May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8aace301-f9ad-4ff9-bcac-af798f077cdf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Request method failure captured: May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 HTTP/1.1 May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOjF6rvMnwWf1fRJt26Wn5XRF7EUO5sXXuEaxwBKoPEc5z9FjH_7NDJRc_43kplV1FEfz14qdrP3ds-i24EyFzWma2Lu22che-wRMQA6x1MCvG29dubYGaP8v-OZu3yzAQ3lS3Tvm0No_avKhYFvwDITxqVSytbHmXvtMmmJ9LgNBbo May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-Openstack-Nova-Api-Version: 2.20 May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 3565af3212e74e83b5adc7465922a274 May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1265741676 May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3565af3212e74e83b5adc7465922a274"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3565af3212e74e83b5adc7465922a274"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3565af3212e74e83b5adc7465922a274"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3565af3212e74e83b5adc7465922a274", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1265741676 May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 3565af3212e74e83b5adc7465922a274 May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1265741676 May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-AttachVolumeShelveTestJSON-1265741676-project May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 13124d91fc454405af084784c6f447ab May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1265741676-project May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance d7371c18-20d2-43f8-b0c6-0371079d8f20 could not be found. May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'd7371c18-20d2-43f8-b0c6-0371079d8f20'} May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7371c18-20d2-43f8-b0c6-0371079d8f20 could not be found. May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7371c18-20d2-43f8-b0c6-0371079d8f20 could not be found. May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:25.367916 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:25.375450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:25.375450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:25.375450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:25.375450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:25.375450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:13:25.375450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:13:25.375450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7371c18-20d2-43f8-b0c6-0371079d8f20 could not be found. May 27 15:13:25.375450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:25.379508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8aace301-f9ad-4ff9-bcac-af798f077cdf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Returning 404 to user: Instance d7371c18-20d2-43f8-b0c6-0371079d8f20 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:25.381850 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8aace301-f9ad-4ff9-bcac-af798f077cdf tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20" status: 404 len: 111 microversion: 2.20 time: 0.088943 May 27 15:13:25.383281 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1966/3930] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:25 2022] GET /compute/v2.1/servers/d7371c18-20d2-43f8-b0c6-0371079d8f20 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:13:25.702079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9edde512-9858-4794-8b84-41bcf313ccaf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:25.703583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9edde512-9858-4794-8b84-41bcf313ccaf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:25.715257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9edde512-9858-4794-8b84-41bcf313ccaf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:25.719809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9edde512-9858-4794-8b84-41bcf313ccaf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:25.722466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9edde512-9858-4794-8b84-41bcf313ccaf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:25.725344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9edde512-9858-4794-8b84-41bcf313ccaf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:26.054973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fb248862-0e55-4b8c-970f-98095b513c15 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:26.056954 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fb248862-0e55-4b8c-970f-98095b513c15 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:26.082508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb248862-0e55-4b8c-970f-98095b513c15 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:26.084369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb248862-0e55-4b8c-970f-98095b513c15 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:26.085541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb248862-0e55-4b8c-970f-98095b513c15 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:26.086276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb248862-0e55-4b8c-970f-98095b513c15 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:26.166080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9edde512-9858-4794-8b84-41bcf313ccaf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:26.197344 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9edde512-9858-4794-8b84-41bcf313ccaf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.500276 May 27 15:13:26.198719 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1965/3931] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:25 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:26.219069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d781cce3-bcad-4013-874b-44504a226d1b tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:26.235908 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d781cce3-bcad-4013-874b-44504a226d1b tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c4d5eff0d83a4108b853931be9d170d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:26.237799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d781cce3-bcad-4013-874b-44504a226d1b tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Searching by: {'deleted': False, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:13:26.256414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d781cce3-bcad-4013-874b-44504a226d1b tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:26.264772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d781cce3-bcad-4013-874b-44504a226d1b tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:26.266706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d781cce3-bcad-4013-874b-44504a226d1b tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:26.267777 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d781cce3-bcad-4013-874b-44504a226d1b tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:26.281226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fb248862-0e55-4b8c-970f-98095b513c15 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:26.294714 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fb248862-0e55-4b8c-970f-98095b513c15 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1233 microversion: 2.1 time: 0.247313 May 27 15:13:26.295365 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1967/3932] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:26 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1233 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:26.325911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-d781cce3-bcad-4013-874b-44504a226d1b tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:13:26.336056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-140fe8ba-54cb-4ea7-b790-db818e3f0677 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:26.337707 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-140fe8ba-54cb-4ea7-b790-db818e3f0677 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:26.354893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-140fe8ba-54cb-4ea7-b790-db818e3f0677 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:26.355685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-140fe8ba-54cb-4ea7-b790-db818e3f0677 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:26.356815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-140fe8ba-54cb-4ea7-b790-db818e3f0677 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:26.357986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-140fe8ba-54cb-4ea7-b790-db818e3f0677 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:26.439097 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d781cce3-bcad-4013-874b-44504a226d1b tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.226991 May 27 15:13:26.441095 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1966/3933] 10.222.0.13 () {58 vars in 1124 bytes} [Fri May 27 15:13:26 2022] GET /compute/v2.1/servers => generated 333 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:26.456572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8f29025f-95a8-4b74-a2d7-e6d94fe46e85 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:26.463344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8f29025f-95a8-4b74-a2d7-e6d94fe46e85 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c4d5eff0d83a4108b853931be9d170d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:26.464956 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8f29025f-95a8-4b74-a2d7-e6d94fe46e85 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Searching by: {'deleted': False, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:13:26.473484 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f29025f-95a8-4b74-a2d7-e6d94fe46e85 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:26.475293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f29025f-95a8-4b74-a2d7-e6d94fe46e85 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:26.476823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f29025f-95a8-4b74-a2d7-e6d94fe46e85 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:26.477695 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f29025f-95a8-4b74-a2d7-e6d94fe46e85 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:26.506353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-140fe8ba-54cb-4ea7-b790-db818e3f0677 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:26.534024 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-140fe8ba-54cb-4ea7-b790-db818e3f0677 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:26.536322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-140fe8ba-54cb-4ea7-b790-db818e3f0677 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:26.540520 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-140fe8ba-54cb-4ea7-b790-db818e3f0677 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.209354 May 27 15:13:26.545069 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1968/3934] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:26 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:26.640262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-8f29025f-95a8-4b74-a2d7-e6d94fe46e85 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:13:26.757656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8f29025f-95a8-4b74-a2d7-e6d94fe46e85 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d5eff0d83a4108b853931be9d170d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:26.769074 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f29025f-95a8-4b74-a2d7-e6d94fe46e85 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:26.769846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f29025f-95a8-4b74-a2d7-e6d94fe46e85 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:26.934210 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8f29025f-95a8-4b74-a2d7-e6d94fe46e85 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.483333 May 27 15:13:26.956020 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1967/3935] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 15:13:26 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:26.968352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-20472b81-0b25-4a62-b85f-19c058f57560 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:26.984029 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-20472b81-0b25-4a62-b85f-19c058f57560 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021308 May 27 15:13:26.994447 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1969/3936] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 15:13:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:13:27.221177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-22465073-2c30-434a-a6c8-4f3a43bd6fba tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:27.222685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-22465073-2c30-434a-a6c8-4f3a43bd6fba tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:27.232524 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22465073-2c30-434a-a6c8-4f3a43bd6fba tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:27.233399 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22465073-2c30-434a-a6c8-4f3a43bd6fba tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:27.234989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22465073-2c30-434a-a6c8-4f3a43bd6fba tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:27.235881 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22465073-2c30-434a-a6c8-4f3a43bd6fba tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:27.270607 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:27.313787 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8aaabc85-1343-4d9f-a42a-3d2fc72cce13 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:27.315488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8aaabc85-1343-4d9f-a42a-3d2fc72cce13 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:27.329507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8aaabc85-1343-4d9f-a42a-3d2fc72cce13 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:27.331429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8aaabc85-1343-4d9f-a42a-3d2fc72cce13 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:27.334436 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8aaabc85-1343-4d9f-a42a-3d2fc72cce13 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:27.335388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8aaabc85-1343-4d9f-a42a-3d2fc72cce13 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:27.498064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8aaabc85-1343-4d9f-a42a-3d2fc72cce13 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:27.511302 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8aaabc85-1343-4d9f-a42a-3d2fc72cce13 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1295 microversion: 2.1 time: 0.201680 May 27 15:13:27.512557 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1970/3937] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:27 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1295 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:27.531433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-22465073-2c30-434a-a6c8-4f3a43bd6fba tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:27.547672 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-22465073-2c30-434a-a6c8-4f3a43bd6fba tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.333486 May 27 15:13:27.563875 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1968/3938] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:27 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:27.584238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0b6b60cd-48e6-430f-b46c-0b42022b0eb4 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:27.585327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0b6b60cd-48e6-430f-b46c-0b42022b0eb4 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:27.592507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b6b60cd-48e6-430f-b46c-0b42022b0eb4 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:27.593224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b6b60cd-48e6-430f-b46c-0b42022b0eb4 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:27.595701 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b6b60cd-48e6-430f-b46c-0b42022b0eb4 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:27.596391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b6b60cd-48e6-430f-b46c-0b42022b0eb4 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:27.683604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0b6b60cd-48e6-430f-b46c-0b42022b0eb4 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:27.701326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0b6b60cd-48e6-430f-b46c-0b42022b0eb4 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:27.703179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0b6b60cd-48e6-430f-b46c-0b42022b0eb4 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:27.704404 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0b6b60cd-48e6-430f-b46c-0b42022b0eb4 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.124918 May 27 15:13:27.717110 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1971/3939] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:27 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:13:27.976637 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dfddee73-fd11-4e17-8340-f2bdeefe2f48 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:27.977193 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dfddee73-fd11-4e17-8340-f2bdeefe2f48 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:27.990803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dfddee73-fd11-4e17-8340-f2bdeefe2f48 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:27.991525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dfddee73-fd11-4e17-8340-f2bdeefe2f48 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:27.993642 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dfddee73-fd11-4e17-8340-f2bdeefe2f48 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:27.994170 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dfddee73-fd11-4e17-8340-f2bdeefe2f48 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:28.057504 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dfddee73-fd11-4e17-8340-f2bdeefe2f48 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:13:28.189172 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dfddee73-fd11-4e17-8340-f2bdeefe2f48 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d" status: 204 len: 0 microversion: 2.1 time: 0.221005 May 27 15:13:28.191145 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1969/3940] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:13:27 2022] DELETE /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:13:28.203084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3c181c5b-8b8e-4d15-95b0-f604d0071277 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:28.203720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3c181c5b-8b8e-4d15-95b0-f604d0071277 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:28.219227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3c181c5b-8b8e-4d15-95b0-f604d0071277 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:28.222308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3c181c5b-8b8e-4d15-95b0-f604d0071277 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:28.223433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3c181c5b-8b8e-4d15-95b0-f604d0071277 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:28.226427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3c181c5b-8b8e-4d15-95b0-f604d0071277 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:28.541501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7a9bb4fa-7258-4fe0-8d5d-5667508288f3 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:28.542397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7a9bb4fa-7258-4fe0-8d5d-5667508288f3 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:28.557878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a9bb4fa-7258-4fe0-8d5d-5667508288f3 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:28.558350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a9bb4fa-7258-4fe0-8d5d-5667508288f3 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:28.559270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a9bb4fa-7258-4fe0-8d5d-5667508288f3 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:28.559638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a9bb4fa-7258-4fe0-8d5d-5667508288f3 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:28.609103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3c181c5b-8b8e-4d15-95b0-f604d0071277 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d5eff0d83a4108b853931be9d170d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:28.640079 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3c181c5b-8b8e-4d15-95b0-f604d0071277 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d" status: 200 len: 1698 microversion: 2.1 time: 0.440883 May 27 15:13:28.641682 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1972/3941] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:28 2022] GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d => generated 1698 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:28.662759 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1370a97c-216d-431b-884d-8aecf614445d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:28.665501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1370a97c-216d-431b-884d-8aecf614445d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:28.679078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7a9bb4fa-7258-4fe0-8d5d-5667508288f3 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:28.682825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1370a97c-216d-431b-884d-8aecf614445d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:28.683823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1370a97c-216d-431b-884d-8aecf614445d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:28.686106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1370a97c-216d-431b-884d-8aecf614445d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:28.686919 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1370a97c-216d-431b-884d-8aecf614445d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:28.695561 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7a9bb4fa-7258-4fe0-8d5d-5667508288f3 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1295 microversion: 2.1 time: 0.159477 May 27 15:13:28.696167 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1970/3942] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:28 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1295 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:28.726571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5ad4af8b-7309-4b36-ae7b-3b44363e3c46 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:28.727196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5ad4af8b-7309-4b36-ae7b-3b44363e3c46 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:28.744856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ad4af8b-7309-4b36-ae7b-3b44363e3c46 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:28.745581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ad4af8b-7309-4b36-ae7b-3b44363e3c46 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:28.746384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ad4af8b-7309-4b36-ae7b-3b44363e3c46 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:28.746866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5ad4af8b-7309-4b36-ae7b-3b44363e3c46 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:28.951985 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5ad4af8b-7309-4b36-ae7b-3b44363e3c46 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:28.968971 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5ad4af8b-7309-4b36-ae7b-3b44363e3c46 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:28.977041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5ad4af8b-7309-4b36-ae7b-3b44363e3c46 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:28.979626 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5ad4af8b-7309-4b36-ae7b-3b44363e3c46 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.256749 May 27 15:13:28.981421 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1971/3943] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:28 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:13:28.990957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4afd6b7b-668d-4cee-86e7-8f31ed5a2964 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:28.992478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4afd6b7b-668d-4cee-86e7-8f31ed5a2964 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:29.008415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4afd6b7b-668d-4cee-86e7-8f31ed5a2964 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:29.011356 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4afd6b7b-668d-4cee-86e7-8f31ed5a2964 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:29.014043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4afd6b7b-668d-4cee-86e7-8f31ed5a2964 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:29.015128 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4afd6b7b-668d-4cee-86e7-8f31ed5a2964 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:29.029926 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1370a97c-216d-431b-884d-8aecf614445d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:29.040628 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1370a97c-216d-431b-884d-8aecf614445d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.396793 May 27 15:13:29.041597 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1973/3944] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:28 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:29.654362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4afd6b7b-668d-4cee-86e7-8f31ed5a2964 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:29.668080 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8af7f616-a624-4085-a622-12a298515d3c tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:29.669085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8af7f616-a624-4085-a622-12a298515d3c tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:29.671940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4afd6b7b-668d-4cee-86e7-8f31ed5a2964 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:29.674727 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4afd6b7b-668d-4cee-86e7-8f31ed5a2964 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:29.676061 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4afd6b7b-668d-4cee-86e7-8f31ed5a2964 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 2955 microversion: 2.42 time: 0.693026 May 27 15:13:29.676633 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1972/3945] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:28 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 2955 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:29.680809 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8af7f616-a624-4085-a622-12a298515d3c tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:29.681276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8af7f616-a624-4085-a622-12a298515d3c tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:29.682349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8af7f616-a624-4085-a622-12a298515d3c tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:29.682809 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8af7f616-a624-4085-a622-12a298515d3c tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:29.703734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ab7c45bd-e34b-4235-900a-d5b0fea78a32 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:29.704329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ab7c45bd-e34b-4235-900a-d5b0fea78a32 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:29.717736 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab7c45bd-e34b-4235-900a-d5b0fea78a32 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:29.719095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab7c45bd-e34b-4235-900a-d5b0fea78a32 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:29.720940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab7c45bd-e34b-4235-900a-d5b0fea78a32 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:29.721457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab7c45bd-e34b-4235-900a-d5b0fea78a32 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:29.930621 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ab7c45bd-e34b-4235-900a-d5b0fea78a32 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.231416 May 27 15:13:29.941069 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1973/3946] 10.222.0.13 () {60 vars in 1315 bytes} [Fri May 27 15:13:29 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d/os-interface => generated 1832 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:13:29.943735 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3356450e-4fa2-4a49-bd42-e96a736bef3c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:29.944447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3356450e-4fa2-4a49-bd42-e96a736bef3c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:29.952267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3356450e-4fa2-4a49-bd42-e96a736bef3c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:29.953028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3356450e-4fa2-4a49-bd42-e96a736bef3c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:29.953963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3356450e-4fa2-4a49-bd42-e96a736bef3c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:29.955206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3356450e-4fa2-4a49-bd42-e96a736bef3c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:30.043564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8af7f616-a624-4085-a622-12a298515d3c tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d5eff0d83a4108b853931be9d170d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:30.061174 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8af7f616-a624-4085-a622-12a298515d3c tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d" status: 200 len: 1698 microversion: 2.1 time: 0.395332 May 27 15:13:30.068891 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1974/3947] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:29 2022] GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d => generated 1698 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:30.081119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fb22d006-e51c-4a9e-89a4-037efff4f3ad tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:30.081776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fb22d006-e51c-4a9e-89a4-037efff4f3ad tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:30.095043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb22d006-e51c-4a9e-89a4-037efff4f3ad tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:30.095832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb22d006-e51c-4a9e-89a4-037efff4f3ad tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:30.097231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb22d006-e51c-4a9e-89a4-037efff4f3ad tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:30.097886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb22d006-e51c-4a9e-89a4-037efff4f3ad tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:30.228536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fb22d006-e51c-4a9e-89a4-037efff4f3ad tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:30.228876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3356450e-4fa2-4a49-bd42-e96a736bef3c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:30.237237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fb22d006-e51c-4a9e-89a4-037efff4f3ad tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:30.239099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fb22d006-e51c-4a9e-89a4-037efff4f3ad tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:30.241276 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fb22d006-e51c-4a9e-89a4-037efff4f3ad tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.171315 May 27 15:13:30.242083 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1975/3948] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:30 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:30.247538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8cd9bf4c-c94c-49d8-a7c8-630666d863b6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:30.248755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8cd9bf4c-c94c-49d8-a7c8-630666d863b6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:30.256532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8cd9bf4c-c94c-49d8-a7c8-630666d863b6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:30.257430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8cd9bf4c-c94c-49d8-a7c8-630666d863b6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:30.258464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8cd9bf4c-c94c-49d8-a7c8-630666d863b6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:30.259140 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8cd9bf4c-c94c-49d8-a7c8-630666d863b6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:30.262805 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3356450e-4fa2-4a49-bd42-e96a736bef3c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1363 microversion: 2.1 time: 0.322355 May 27 15:13:30.264983 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1974/3949] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:29 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:30.428225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8cd9bf4c-c94c-49d8-a7c8-630666d863b6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:30.437833 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8cd9bf4c-c94c-49d8-a7c8-630666d863b6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1392 microversion: 2.1 time: 0.194278 May 27 15:13:30.438577 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1976/3950] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:30 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1392 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:31.080716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-81983a98-bf8b-4ce8-9e01-4617cd6a6f44 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:31.081373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-81983a98-bf8b-4ce8-9e01-4617cd6a6f44 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:31.096994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-81983a98-bf8b-4ce8-9e01-4617cd6a6f44 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:31.097454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-81983a98-bf8b-4ce8-9e01-4617cd6a6f44 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:31.104522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-81983a98-bf8b-4ce8-9e01-4617cd6a6f44 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:31.105481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-81983a98-bf8b-4ce8-9e01-4617cd6a6f44 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:31.261290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a5bc7f17-46db-4e36-9c00-289021bff725 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:31.262635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a5bc7f17-46db-4e36-9c00-289021bff725 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:31.270242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a5bc7f17-46db-4e36-9c00-289021bff725 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:31.271057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a5bc7f17-46db-4e36-9c00-289021bff725 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:31.272030 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a5bc7f17-46db-4e36-9c00-289021bff725 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:31.272645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a5bc7f17-46db-4e36-9c00-289021bff725 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:31.739628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a5bc7f17-46db-4e36-9c00-289021bff725 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:31.775377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a5bc7f17-46db-4e36-9c00-289021bff725 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:31.781467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a5bc7f17-46db-4e36-9c00-289021bff725 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:31.792329 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a5bc7f17-46db-4e36-9c00-289021bff725 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.531674 May 27 15:13:31.794398 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1977/3951] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:31 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:13:31.834540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c2eb8945-67f0-4497-906f-15ebefbbf352 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:31.835441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c2eb8945-67f0-4497-906f-15ebefbbf352 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:31.847084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2eb8945-67f0-4497-906f-15ebefbbf352 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:31.848283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2eb8945-67f0-4497-906f-15ebefbbf352 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:31.850405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2eb8945-67f0-4497-906f-15ebefbbf352 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:31.851385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2eb8945-67f0-4497-906f-15ebefbbf352 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:32.183879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-81983a98-bf8b-4ce8-9e01-4617cd6a6f44 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d5eff0d83a4108b853931be9d170d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:32.199142 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-81983a98-bf8b-4ce8-9e01-4617cd6a6f44 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d" status: 200 len: 1698 microversion: 2.1 time: 1.122886 May 27 15:13:32.204351 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1975/3952] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:31 2022] GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d => generated 1698 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:32.209366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-993f8704-75f7-458b-a390-eeb3bd60b654 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:32.222098 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-993f8704-75f7-458b-a390-eeb3bd60b654 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:32.241997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-993f8704-75f7-458b-a390-eeb3bd60b654 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:32.243963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-993f8704-75f7-458b-a390-eeb3bd60b654 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:32.249107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-993f8704-75f7-458b-a390-eeb3bd60b654 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:32.249792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-993f8704-75f7-458b-a390-eeb3bd60b654 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:32.479094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c2eb8945-67f0-4497-906f-15ebefbbf352 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:32.488998 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c2eb8945-67f0-4497-906f-15ebefbbf352 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1363 microversion: 2.1 time: 0.669366 May 27 15:13:32.494264 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1978/3953] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:31 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1363 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:32.559365 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-993f8704-75f7-458b-a390-eeb3bd60b654 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:32.568807 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-993f8704-75f7-458b-a390-eeb3bd60b654 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1382 microversion: 2.1 time: 0.362691 May 27 15:13:32.586518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5002e6da-840a-40bd-98d0-8f1e715c94f6 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '.version_select at 0x7fc776d54e50>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:32.590023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5002e6da-840a-40bd-98d0-8f1e715c94f6 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:32.590964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5002e6da-840a-40bd-98d0-8f1e715c94f6 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:32.592920 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1976/3954] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:32 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1382 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:32.605119 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5002e6da-840a-40bd-98d0-8f1e715c94f6 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/os-migrations" status: 200 len: 1553 microversion: 2.1 time: 0.022509 May 27 15:13:32.606690 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1979/3955] 10.222.0.13 () {58 vars in 1142 bytes} [Fri May 27 15:13:32 2022] GET /compute/v2.1/os-migrations => generated 1553 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:32.638663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-267597a8-160d-42b4-ab47-1a26bff93076 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:32.639414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-267597a8-160d-42b4-ab47-1a26bff93076 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:32.654259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-267597a8-160d-42b4-ab47-1a26bff93076 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:32.655220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-267597a8-160d-42b4-ab47-1a26bff93076 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:32.656793 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-267597a8-160d-42b4-ab47-1a26bff93076 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:32.657462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-267597a8-160d-42b4-ab47-1a26bff93076 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:32.824309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-81f12935-54b7-4a7b-9649-350ae16e57ee tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:32.825942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-81f12935-54b7-4a7b-9649-350ae16e57ee tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:32.837025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81f12935-54b7-4a7b-9649-350ae16e57ee tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:32.838821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81f12935-54b7-4a7b-9649-350ae16e57ee tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:32.842337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81f12935-54b7-4a7b-9649-350ae16e57ee tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:32.843593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81f12935-54b7-4a7b-9649-350ae16e57ee tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:32.959103 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-267597a8-160d-42b4-ab47-1a26bff93076 tempest-LiveMigrationTest-718483991 tempest-LiveMigrationTest-718483991-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1533 microversion: 2.1 time: 0.326216 May 27 15:13:32.978382 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1977/3956] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:32 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1533 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:33.019121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f974c055-81ce-4504-bfc9-94e1de665835 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:33.020018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f974c055-81ce-4504-bfc9-94e1de665835 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:33.055266 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f974c055-81ce-4504-bfc9-94e1de665835 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:33.056239 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f974c055-81ce-4504-bfc9-94e1de665835 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:33.057691 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f974c055-81ce-4504-bfc9-94e1de665835 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:33.058453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f974c055-81ce-4504-bfc9-94e1de665835 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:33.078624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-81f12935-54b7-4a7b-9649-350ae16e57ee tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:33.121374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-81f12935-54b7-4a7b-9649-350ae16e57ee tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:33.148568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-81f12935-54b7-4a7b-9649-350ae16e57ee tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:33.155365 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-81f12935-54b7-4a7b-9649-350ae16e57ee tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.334214 May 27 15:13:33.168205 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1980/3957] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:32 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:33.178323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-83a6c943-e81b-407a-9f62-fedc943f28a0 req-3c6ce4ab-5aa6-430a-86d2-04923d8fd92c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00d1ab07-fd5f-4c23-8ee7-fdc018c73376", "tag": "754ea1e4-0201-4c60-83c7-b66cc166cf98"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:33.197450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-83a6c943-e81b-407a-9f62-fedc943f28a0 req-3c6ce4ab-5aa6-430a-86d2-04923d8fd92c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:33.197756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-83a6c943-e81b-407a-9f62-fedc943f28a0 req-3c6ce4ab-5aa6-430a-86d2-04923d8fd92c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:33.199800 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f974c055-81ce-4504-bfc9-94e1de665835 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:13:33.236203 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-83a6c943-e81b-407a-9f62-fedc943f28a0 req-3c6ce4ab-5aa6-430a-86d2-04923d8fd92c service nova] Creating event network-changed:754ea1e4-0201-4c60-83c7-b66cc166cf98 for instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 on n-h1-843621-1 May 27 15:13:33.247734 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-83a6c943-e81b-407a-9f62-fedc943f28a0 req-3c6ce4ab-5aa6-430a-86d2-04923d8fd92c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076767 May 27 15:13:33.254961 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1981/3958] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:33.273040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d90c35e2-a2ee-4206-8389-b14591256d24 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:33.274935 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d90c35e2-a2ee-4206-8389-b14591256d24 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:33.291559 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d90c35e2-a2ee-4206-8389-b14591256d24 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:33.292016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d90c35e2-a2ee-4206-8389-b14591256d24 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:33.296979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d90c35e2-a2ee-4206-8389-b14591256d24 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:33.297671 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d90c35e2-a2ee-4206-8389-b14591256d24 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:33.575638 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f974c055-81ce-4504-bfc9-94e1de665835 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 204 len: 0 microversion: 2.1 time: 0.565797 May 27 15:13:33.577642 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1978/3959] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:13:33 2022] DELETE /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:13:33.590768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9cbca4a0-7416-428f-955b-d6e329125474 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:33.592522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9cbca4a0-7416-428f-955b-d6e329125474 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:33.605490 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cbca4a0-7416-428f-955b-d6e329125474 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:33.606597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cbca4a0-7416-428f-955b-d6e329125474 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:33.609104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cbca4a0-7416-428f-955b-d6e329125474 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:33.610280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cbca4a0-7416-428f-955b-d6e329125474 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:33.884431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d90c35e2-a2ee-4206-8389-b14591256d24 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4d5eff0d83a4108b853931be9d170d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f46e715eda47c19c4df5eda3091eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:33.940504 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d90c35e2-a2ee-4206-8389-b14591256d24 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d" status: 200 len: 1630 microversion: 2.1 time: 0.682992 May 27 15:13:33.945492 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1982/3960] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:33 2022] GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d => generated 1630 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:33.953088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ac277f30-4b7c-401a-91da-f099384cb119 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:33.956559 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ac277f30-4b7c-401a-91da-f099384cb119 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:33.970606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac277f30-4b7c-401a-91da-f099384cb119 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:33.971251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac277f30-4b7c-401a-91da-f099384cb119 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:33.972323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac277f30-4b7c-401a-91da-f099384cb119 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:33.972956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac277f30-4b7c-401a-91da-f099384cb119 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:34.180122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9cbca4a0-7416-428f-955b-d6e329125474 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:34.224803 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9cbca4a0-7416-428f-955b-d6e329125474 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1363 microversion: 2.1 time: 0.640209 May 27 15:13:34.224803 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1979/3961] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:33 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1363 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:34.260260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b3aa393a-d2a3-4788-9180-bdcea5ce40df tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:34.261266 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b3aa393a-d2a3-4788-9180-bdcea5ce40df tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:34.280476 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b3aa393a-d2a3-4788-9180-bdcea5ce40df tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:34.281224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b3aa393a-d2a3-4788-9180-bdcea5ce40df tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:34.282199 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b3aa393a-d2a3-4788-9180-bdcea5ce40df tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:34.283840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b3aa393a-d2a3-4788-9180-bdcea5ce40df tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:34.298891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ac277f30-4b7c-401a-91da-f099384cb119 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:34.318780 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ac277f30-4b7c-401a-91da-f099384cb119 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1388 microversion: 2.1 time: 0.370732 May 27 15:13:34.319900 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1983/3962] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:33 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1388 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:34.702604 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b3aa393a-d2a3-4788-9180-bdcea5ce40df tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:34.714524 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b3aa393a-d2a3-4788-9180-bdcea5ce40df tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:34.716034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b3aa393a-d2a3-4788-9180-bdcea5ce40df tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:34.725548 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b3aa393a-d2a3-4788-9180-bdcea5ce40df tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.479102 May 27 15:13:34.726154 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1980/3963] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:34 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:34.965512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-84e0b303-dd66-4e90-90d1-62606a20cc9e tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:34.966876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-84e0b303-dd66-4e90-90d1-62606a20cc9e tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] [instance: 2b200dfd-ec26-41af-9dd2-d82d6f476d6d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:34.979331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84e0b303-dd66-4e90-90d1-62606a20cc9e tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:34.980839 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84e0b303-dd66-4e90-90d1-62606a20cc9e tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:34.982145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84e0b303-dd66-4e90-90d1-62606a20cc9e tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:34.983094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84e0b303-dd66-4e90-90d1-62606a20cc9e tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:35.007082 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-84e0b303-dd66-4e90-90d1-62606a20cc9e tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] HTTP exception thrown: Instance 2b200dfd-ec26-41af-9dd2-d82d6f476d6d could not be found. May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-84e0b303-dd66-4e90-90d1-62606a20cc9e tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Request method failure captured: May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d HTTP/1.1 May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOpSg2X89EfOzBae72X-jhID8CMJdXxaovhbq4qVz7-F4VqHfovjhsPotEvIWDgMFJK0Zl5cjiv3CWSPfivrwPGnXaboq-vw62zIW0BNM4pKGnHyisyBST2z2rYaLZXIdD0LbB700B1FLxtecfdqIl2zobRAahqD76yWEE2-HNCNn0Q May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: b5f46e715eda47c19c4df5eda3091eab May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersTestJSON-148584068 May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b5f46e715eda47c19c4df5eda3091eab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b5f46e715eda47c19c4df5eda3091eab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b5f46e715eda47c19c4df5eda3091eab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b5f46e715eda47c19c4df5eda3091eab", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersTestJSON-148584068 May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: b5f46e715eda47c19c4df5eda3091eab May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersTestJSON-148584068 May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersTestJSON-148584068-project May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: c4d5eff0d83a4108b853931be9d170d1 May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersTestJSON-148584068-project May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 2b200dfd-ec26-41af-9dd2-d82d6f476d6d could not be found. May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '2b200dfd-ec26-41af-9dd2-d82d6f476d6d'} May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b200dfd-ec26-41af-9dd2-d82d6f476d6d could not be found. May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b200dfd-ec26-41af-9dd2-d82d6f476d6d could not be found. May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:35.010308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:35.018412 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:35.018412 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:35.018412 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:13:35.018412 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:13:35.018412 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b200dfd-ec26-41af-9dd2-d82d6f476d6d could not be found. May 27 15:13:35.018412 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:35.020561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-84e0b303-dd66-4e90-90d1-62606a20cc9e tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Returning 404 to user: Instance 2b200dfd-ec26-41af-9dd2-d82d6f476d6d could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:35.022422 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-84e0b303-dd66-4e90-90d1-62606a20cc9e tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d" status: 404 len: 111 microversion: 2.1 time: 0.062295 May 27 15:13:35.028125 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1984/3964] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:34 2022] GET /compute/v2.1/servers/2b200dfd-ec26-41af-9dd2-d82d6f476d6d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:13:35.033266 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-200b5f09-5ff1-4f9d-a7b0-69853f29ee41 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] Calling method '.version_select at 0x7fc7806141f0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:35.062168 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-200b5f09-5ff1-4f9d-a7b0-69853f29ee41 tempest-ServersTestJSON-148584068 tempest-ServersTestJSON-148584068-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-347502631" status: 202 len: 0 microversion: 2.1 time: 0.032749 May 27 15:13:35.063200 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1981/3965] 10.222.0.13 () {58 vars in 1217 bytes} [Fri May 27 15:13:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-347502631 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:13:35.244307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dd526af0-34f4-412e-a92b-c61c3057201a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:35.244967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dd526af0-34f4-412e-a92b-c61c3057201a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:35.261828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:35.264332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd526af0-34f4-412e-a92b-c61c3057201a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:35.264892 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd526af0-34f4-412e-a92b-c61c3057201a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:35.266104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd526af0-34f4-412e-a92b-c61c3057201a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:35.270581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd526af0-34f4-412e-a92b-c61c3057201a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:35.277347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:35.324420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-cb498fbf-61b1-4fac-bf4d-2d0591720dc0 req-5d850a06-7fe9-47b6-8d4a-30234f70fae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b200dfd-ec26-41af-9dd2-d82d6f476d6d", "name": "network-vif-deleted", "tag": "227ff72f-f1a5-4b57-8615-ad52676cf026"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:35.358338 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-cb498fbf-61b1-4fac-bf4d-2d0591720dc0 req-5d850a06-7fe9-47b6-8d4a-30234f70fae2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:35.358726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-cb498fbf-61b1-4fac-bf4d-2d0591720dc0 req-5d850a06-7fe9-47b6-8d4a-30234f70fae2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:35.373994 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-cb498fbf-61b1-4fac-bf4d-2d0591720dc0 req-5d850a06-7fe9-47b6-8d4a-30234f70fae2 service nova] Creating event network-vif-deleted:227ff72f-f1a5-4b57-8615-ad52676cf026 for instance 2b200dfd-ec26-41af-9dd2-d82d6f476d6d on n-h2-843621-1 May 27 15:13:35.380151 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-cb498fbf-61b1-4fac-bf4d-2d0591720dc0 req-5d850a06-7fe9-47b6-8d4a-30234f70fae2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060021 May 27 15:13:35.382900 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1982/3966] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:13:35.389304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ddf98f0a-d0f3-4a16-b98c-e6c0e4ba981c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:35.390270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ddf98f0a-d0f3-4a16-b98c-e6c0e4ba981c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:35.397761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ddf98f0a-d0f3-4a16-b98c-e6c0e4ba981c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:35.398774 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ddf98f0a-d0f3-4a16-b98c-e6c0e4ba981c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:35.399903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ddf98f0a-d0f3-4a16-b98c-e6c0e4ba981c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:35.400575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ddf98f0a-d0f3-4a16-b98c-e6c0e4ba981c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:35.635801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ddf98f0a-d0f3-4a16-b98c-e6c0e4ba981c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:35.655748 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:35.666289 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ddf98f0a-d0f3-4a16-b98c-e6c0e4ba981c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1346 microversion: 2.1 time: 0.280578 May 27 15:13:35.666918 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1983/3967] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:35 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1346 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:35.684270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8c2c8fd1-ed98-40b6-98b0-381b51dfaee5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:35.685640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8c2c8fd1-ed98-40b6-98b0-381b51dfaee5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:35.705324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8c2c8fd1-ed98-40b6-98b0-381b51dfaee5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:35.706773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8c2c8fd1-ed98-40b6-98b0-381b51dfaee5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:35.707773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8c2c8fd1-ed98-40b6-98b0-381b51dfaee5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:35.710575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8c2c8fd1-ed98-40b6-98b0-381b51dfaee5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:35.718028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dd526af0-34f4-412e-a92b-c61c3057201a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:35.752307 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dd526af0-34f4-412e-a92b-c61c3057201a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1363 microversion: 2.1 time: 0.504911 May 27 15:13:35.755464 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1985/3968] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:35 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1363 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:35.760423 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bc0b4dbc-635d-4d74-906b-09231748bd27 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:35.761083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bc0b4dbc-635d-4d74-906b-09231748bd27 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:35.774485 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-8c2c8fd1-ed98-40b6-98b0-381b51dfaee5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] HTTP exception thrown: Instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 could not be found. May 27 15:13:35.780992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc0b4dbc-635d-4d74-906b-09231748bd27 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:35.781833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc0b4dbc-635d-4d74-906b-09231748bd27 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:35.783616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc0b4dbc-635d-4d74-906b-09231748bd27 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:35.784512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc0b4dbc-635d-4d74-906b-09231748bd27 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8c2c8fd1-ed98-40b6-98b0-381b51dfaee5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Request method failure captured: May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 HTTP/1.1 May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOjF6rvMnwWf1fRJt26Wn5XRF7EUO5sXXuEaxwBKoPEc5z9FjH_7NDJRc_43kplV1FEfz14qdrP3ds-i24EyFzWma2Lu22che-wRMQA6x1MCvG29dubYGaP8v-OZu3yzAQ3lS3Tvm0No_avKhYFvwDITxqVSytbHmXvtMmmJ9LgNBbo May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-Openstack-Nova-Api-Version: 2.20 May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 3565af3212e74e83b5adc7465922a274 May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1265741676 May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3565af3212e74e83b5adc7465922a274"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3565af3212e74e83b5adc7465922a274"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3565af3212e74e83b5adc7465922a274"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3565af3212e74e83b5adc7465922a274", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1265741676 May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 3565af3212e74e83b5adc7465922a274 May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1265741676 May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AttachVolumeShelveTestJSON-1265741676-project May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 13124d91fc454405af084784c6f447ab May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1265741676-project May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 could not be found. May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '3d17a653-7f3e-44d7-9b89-68b4b35c9175'} May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 could not be found. May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:13:35.784631 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:13:35.790012 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 could not be found. May 27 15:13:35.790012 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:35.790012 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:35.790012 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:35.790012 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:35.790012 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:35.790012 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:35.790012 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:13:35.790012 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:13:35.790012 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 could not be found. May 27 15:13:35.790012 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:35.790012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8c2c8fd1-ed98-40b6-98b0-381b51dfaee5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Returning 404 to user: Instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:35.793860 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8c2c8fd1-ed98-40b6-98b0-381b51dfaee5 tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 404 len: 111 microversion: 2.20 time: 0.117792 May 27 15:13:35.797904 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1984/3969] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:13:35 2022] DELETE /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:13:35.810865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9e85786a-e2da-4d3f-93a1-d8c2a0c7573e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:35.811899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9e85786a-e2da-4d3f-93a1-d8c2a0c7573e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] [instance: 3d17a653-7f3e-44d7-9b89-68b4b35c9175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:35.843280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e85786a-e2da-4d3f-93a1-d8c2a0c7573e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:35.843968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e85786a-e2da-4d3f-93a1-d8c2a0c7573e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:35.845177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e85786a-e2da-4d3f-93a1-d8c2a0c7573e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:35.849390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e85786a-e2da-4d3f-93a1-d8c2a0c7573e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:35.896940 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-9e85786a-e2da-4d3f-93a1-d8c2a0c7573e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] HTTP exception thrown: Instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 could not be found. May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9e85786a-e2da-4d3f-93a1-d8c2a0c7573e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Request method failure captured: May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 HTTP/1.1 May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOjF6rvMnwWf1fRJt26Wn5XRF7EUO5sXXuEaxwBKoPEc5z9FjH_7NDJRc_43kplV1FEfz14qdrP3ds-i24EyFzWma2Lu22che-wRMQA6x1MCvG29dubYGaP8v-OZu3yzAQ3lS3Tvm0No_avKhYFvwDITxqVSytbHmXvtMmmJ9LgNBbo May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-Openstack-Nova-Api-Version: 2.20 May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 3565af3212e74e83b5adc7465922a274 May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1265741676 May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3565af3212e74e83b5adc7465922a274"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3565af3212e74e83b5adc7465922a274"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3565af3212e74e83b5adc7465922a274"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3565af3212e74e83b5adc7465922a274", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1265741676 May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 3565af3212e74e83b5adc7465922a274 May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1265741676 May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AttachVolumeShelveTestJSON-1265741676-project May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 13124d91fc454405af084784c6f447ab May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1265741676-project May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 could not be found. May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '3d17a653-7f3e-44d7-9b89-68b4b35c9175'} May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 could not be found. May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 could not be found. May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:35.905368 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:35.910283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:35.910283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:35.910283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:35.910283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:35.910283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:13:35.910283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:13:35.910283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 could not be found. May 27 15:13:35.910283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:35.910283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9e85786a-e2da-4d3f-93a1-d8c2a0c7573e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] Returning 404 to user: Instance 3d17a653-7f3e-44d7-9b89-68b4b35c9175 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:35.910283 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9e85786a-e2da-4d3f-93a1-d8c2a0c7573e tempest-AttachVolumeShelveTestJSON-1265741676 tempest-AttachVolumeShelveTestJSON-1265741676-project] 10.222.0.13 "GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175" status: 404 len: 111 microversion: 2.20 time: 0.108289 May 27 15:13:35.916890 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1985/3970] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:35 2022] GET /compute/v2.1/servers/3d17a653-7f3e-44d7-9b89-68b4b35c9175 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:13:35.973704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bc0b4dbc-635d-4d74-906b-09231748bd27 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:35.989891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bc0b4dbc-635d-4d74-906b-09231748bd27 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:35.994633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bc0b4dbc-635d-4d74-906b-09231748bd27 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:35.996264 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bc0b4dbc-635d-4d74-906b-09231748bd27 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1408 microversion: 2.54 time: 0.239743 May 27 15:13:35.996873 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1986/3971] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:35 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1408 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:36.687623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-734df1d1-6e94-48af-aefe-44dc098f1174 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:36.697165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-734df1d1-6e94-48af-aefe-44dc098f1174 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:36.700493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:36.715562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-734df1d1-6e94-48af-aefe-44dc098f1174 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:36.716290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-734df1d1-6e94-48af-aefe-44dc098f1174 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:36.717286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-734df1d1-6e94-48af-aefe-44dc098f1174 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:36.717937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-734df1d1-6e94-48af-aefe-44dc098f1174 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:36.758948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=12 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:36.779791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1fea37be-1eef-4ebf-bbaa-a427ceade7bf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:36.780869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1fea37be-1eef-4ebf-bbaa-a427ceade7bf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:36.793913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1fea37be-1eef-4ebf-bbaa-a427ceade7bf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:36.794706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1fea37be-1eef-4ebf-bbaa-a427ceade7bf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:36.798347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1fea37be-1eef-4ebf-bbaa-a427ceade7bf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:36.799451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1fea37be-1eef-4ebf-bbaa-a427ceade7bf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:37.372809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-734df1d1-6e94-48af-aefe-44dc098f1174 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:37.385326 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-734df1d1-6e94-48af-aefe-44dc098f1174 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1183 microversion: 2.1 time: 0.704310 May 27 15:13:37.388749 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1986/3972] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:36 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1183 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:37.394421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4f7938f1-c565-4924-9cd8-ea3f99b920ff tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:37.403268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4f7938f1-c565-4924-9cd8-ea3f99b920ff tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:37.421280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4f7938f1-c565-4924-9cd8-ea3f99b920ff tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:37.422402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4f7938f1-c565-4924-9cd8-ea3f99b920ff tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:37.423470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4f7938f1-c565-4924-9cd8-ea3f99b920ff tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:37.424148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4f7938f1-c565-4924-9cd8-ea3f99b920ff tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:37.572647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4f7938f1-c565-4924-9cd8-ea3f99b920ff tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:37.590247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4f7938f1-c565-4924-9cd8-ea3f99b920ff tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:37.592353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4f7938f1-c565-4924-9cd8-ea3f99b920ff tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:37.595753 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4f7938f1-c565-4924-9cd8-ea3f99b920ff tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1426 microversion: 2.54 time: 0.205544 May 27 15:13:37.609043 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1987/3973] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:37 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1426 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:37.675370 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-8eeea5a4-06f5-4c4f-94ac-c9200a01711b req-4aca361b-cf29-4856-a61d-c394cc784d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0315e4-284c-4269-86ea-b5ac6e3b4084", "name": "network-vif-deleted", "tag": "06db990f-6e8f-4fb3-b9b9-a0416d4a7cef"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:37.687215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1fea37be-1eef-4ebf-bbaa-a427ceade7bf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:37.696296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-8eeea5a4-06f5-4c4f-94ac-c9200a01711b req-4aca361b-cf29-4856-a61d-c394cc784d98 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:37.697580 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-8eeea5a4-06f5-4c4f-94ac-c9200a01711b req-4aca361b-cf29-4856-a61d-c394cc784d98 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:37.698223 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1fea37be-1eef-4ebf-bbaa-a427ceade7bf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1363 microversion: 2.1 time: 0.922844 May 27 15:13:37.703449 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1987/3974] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:36 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1363 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:37.711888 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-8eeea5a4-06f5-4c4f-94ac-c9200a01711b req-4aca361b-cf29-4856-a61d-c394cc784d98 service nova] Creating event network-vif-deleted:06db990f-6e8f-4fb3-b9b9-a0416d4a7cef for instance 0e0315e4-284c-4269-86ea-b5ac6e3b4084 on n-h2-843621-1 May 27 15:13:37.717317 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-8eeea5a4-06f5-4c4f-94ac-c9200a01711b req-4aca361b-cf29-4856-a61d-c394cc784d98 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047832 May 27 15:13:37.730086 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1988/3975] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:13:38.404377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-947e3de2-b8a7-49c2-95c9-0a1c24926c58 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:38.405559 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-947e3de2-b8a7-49c2-95c9-0a1c24926c58 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:38.441601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-947e3de2-b8a7-49c2-95c9-0a1c24926c58 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:38.449591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-947e3de2-b8a7-49c2-95c9-0a1c24926c58 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:38.456815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-947e3de2-b8a7-49c2-95c9-0a1c24926c58 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:38.457867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-947e3de2-b8a7-49c2-95c9-0a1c24926c58 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:38.635568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-72143c42-02a2-4475-9bcd-0ceeeb6e886c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:38.636311 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-72143c42-02a2-4475-9bcd-0ceeeb6e886c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:38.649422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72143c42-02a2-4475-9bcd-0ceeeb6e886c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:38.654411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72143c42-02a2-4475-9bcd-0ceeeb6e886c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:38.655597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72143c42-02a2-4475-9bcd-0ceeeb6e886c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:38.656252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72143c42-02a2-4475-9bcd-0ceeeb6e886c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:38.758494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-947e3de2-b8a7-49c2-95c9-0a1c24926c58 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:38.769772 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-947e3de2-b8a7-49c2-95c9-0a1c24926c58 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1183 microversion: 2.1 time: 0.371025 May 27 15:13:38.770870 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1988/3976] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:38 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1183 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:38.778764 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fbbad7b8-134d-4eab-879f-19db2c7965f6 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:38.779557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fbbad7b8-134d-4eab-879f-19db2c7965f6 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:38.785793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:38.789649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fbbad7b8-134d-4eab-879f-19db2c7965f6 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:38.790306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fbbad7b8-134d-4eab-879f-19db2c7965f6 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:38.791143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fbbad7b8-134d-4eab-879f-19db2c7965f6 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:38.791722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fbbad7b8-134d-4eab-879f-19db2c7965f6 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:38.865329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-72143c42-02a2-4475-9bcd-0ceeeb6e886c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:38.878540 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-72143c42-02a2-4475-9bcd-0ceeeb6e886c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:38.881566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-72143c42-02a2-4475-9bcd-0ceeeb6e886c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:38.883601 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-72143c42-02a2-4475-9bcd-0ceeeb6e886c tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1414 microversion: 2.54 time: 0.252491 May 27 15:13:38.885132 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1989/3977] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:38 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1414 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:13:39.122227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fbbad7b8-134d-4eab-879f-19db2c7965f6 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:39.146313 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fbbad7b8-134d-4eab-879f-19db2c7965f6 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1363 microversion: 2.1 time: 0.363400 May 27 15:13:39.154117 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1989/3978] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:38 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1363 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:39.789021 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2c206fe1-b564-480c-a6c6-92e6d7b3924c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:39.789639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2c206fe1-b564-480c-a6c6-92e6d7b3924c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:39.809464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2c206fe1-b564-480c-a6c6-92e6d7b3924c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:39.810285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2c206fe1-b564-480c-a6c6-92e6d7b3924c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:39.811473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2c206fe1-b564-480c-a6c6-92e6d7b3924c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:39.812275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2c206fe1-b564-480c-a6c6-92e6d7b3924c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:39.907294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9273f167-ca6f-49b8-9f20-e1d65751f695 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:39.908977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9273f167-ca6f-49b8-9f20-e1d65751f695 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:39.947835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9273f167-ca6f-49b8-9f20-e1d65751f695 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:39.948972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9273f167-ca6f-49b8-9f20-e1d65751f695 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:39.950291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9273f167-ca6f-49b8-9f20-e1d65751f695 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:39.950974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9273f167-ca6f-49b8-9f20-e1d65751f695 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:40.020206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2c206fe1-b564-480c-a6c6-92e6d7b3924c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:40.034887 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2c206fe1-b564-480c-a6c6-92e6d7b3924c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1183 microversion: 2.1 time: 0.249630 May 27 15:13:40.035730 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1990/3979] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:39 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:40.152514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9273f167-ca6f-49b8-9f20-e1d65751f695 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:40.165564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f56bfc71-8697-4a38-9df4-50f762122db4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:40.166666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f56bfc71-8697-4a38-9df4-50f762122db4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:40.186029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f56bfc71-8697-4a38-9df4-50f762122db4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:40.188484 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f56bfc71-8697-4a38-9df4-50f762122db4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:40.192214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f56bfc71-8697-4a38-9df4-50f762122db4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:40.194827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f56bfc71-8697-4a38-9df4-50f762122db4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:40.199528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9273f167-ca6f-49b8-9f20-e1d65751f695 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:40.206034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9273f167-ca6f-49b8-9f20-e1d65751f695 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:40.216739 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9273f167-ca6f-49b8-9f20-e1d65751f695 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1399 microversion: 2.54 time: 0.316104 May 27 15:13:40.220427 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1990/3980] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:39 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1399 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:40.241461 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f3e84301-aa0b-4cb2-98b9-44ddebe7423f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '.version_select at 0x7fc776c60b80>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:40.275795 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f3e84301-aa0b-4cb2-98b9-44ddebe7423f tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2127025798" status: 204 len: 0 microversion: 2.54 time: 0.038727 May 27 15:13:40.289284 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1991/3981] 10.222.0.13 () {60 vars in 1318 bytes} [Fri May 27 15:13:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2127025798 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 27 15:13:40.305564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-651ce4f3-2ccd-4aa9-9815-4aa550ddbf32 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:40.309275 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-651ce4f3-2ccd-4aa9-9815-4aa550ddbf32 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:40.335272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-651ce4f3-2ccd-4aa9-9815-4aa550ddbf32 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:40.335272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-651ce4f3-2ccd-4aa9-9815-4aa550ddbf32 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:40.335782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-651ce4f3-2ccd-4aa9-9815-4aa550ddbf32 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:40.336237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-651ce4f3-2ccd-4aa9-9815-4aa550ddbf32 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:40.418852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-651ce4f3-2ccd-4aa9-9815-4aa550ddbf32 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:13:40.649109 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-651ce4f3-2ccd-4aa9-9815-4aa550ddbf32 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 204 len: 0 microversion: 2.54 time: 0.350880 May 27 15:13:40.651908 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1992/3982] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:13:40 2022] DELETE /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:13:40.682829 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-013164ee-e173-482e-8b08-257dee84535a tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:40.684185 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-013164ee-e173-482e-8b08-257dee84535a tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:40.713827 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-013164ee-e173-482e-8b08-257dee84535a tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:40.717942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-013164ee-e173-482e-8b08-257dee84535a tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:40.721518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-013164ee-e173-482e-8b08-257dee84535a tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:40.721518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-013164ee-e173-482e-8b08-257dee84535a tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:40.934958 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-013164ee-e173-482e-8b08-257dee84535a tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:40.961658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-013164ee-e173-482e-8b08-257dee84535a tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:40.965034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-013164ee-e173-482e-8b08-257dee84535a tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:40.969807 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-013164ee-e173-482e-8b08-257dee84535a tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1405 microversion: 2.54 time: 0.309653 May 27 15:13:40.972943 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1993/3983] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:40 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1405 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:41.057612 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3d02cc81-76db-4581-9f89-5f2ef813713f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:41.058735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3d02cc81-76db-4581-9f89-5f2ef813713f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:41.080513 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d02cc81-76db-4581-9f89-5f2ef813713f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:41.081721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d02cc81-76db-4581-9f89-5f2ef813713f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:41.083898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d02cc81-76db-4581-9f89-5f2ef813713f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:41.084949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d02cc81-76db-4581-9f89-5f2ef813713f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:41.231769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f56bfc71-8697-4a38-9df4-50f762122db4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:41.241509 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f56bfc71-8697-4a38-9df4-50f762122db4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1363 microversion: 2.1 time: 1.081586 May 27 15:13:41.255866 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1991/3984] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:40 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1363 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:41.291653 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3d02cc81-76db-4581-9f89-5f2ef813713f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:41.303716 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3d02cc81-76db-4581-9f89-5f2ef813713f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1183 microversion: 2.1 time: 0.255816 May 27 15:13:41.304602 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1994/3985] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:41 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:41.992015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e263bf66-0496-4a8f-943d-37043069f04a tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:41.992655 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e263bf66-0496-4a8f-943d-37043069f04a tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:42.005094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e263bf66-0496-4a8f-943d-37043069f04a tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:42.005905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e263bf66-0496-4a8f-943d-37043069f04a tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:42.006901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e263bf66-0496-4a8f-943d-37043069f04a tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:42.007547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e263bf66-0496-4a8f-943d-37043069f04a tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:42.142988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e263bf66-0496-4a8f-943d-37043069f04a tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:42.152196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e263bf66-0496-4a8f-943d-37043069f04a tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:42.154332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e263bf66-0496-4a8f-943d-37043069f04a tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b902b3ddc5b4bc3b00cdaa810f11c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9a95e31edf4e7ca9019cb14151549c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:42.156010 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e263bf66-0496-4a8f-943d-37043069f04a tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 200 len: 1405 microversion: 2.54 time: 0.168354 May 27 15:13:42.157233 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1992/3986] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:41 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:42.266265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bfeca1c5-aeb7-4876-849f-b952a09803fa tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:42.267602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bfeca1c5-aeb7-4876-849f-b952a09803fa tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:42.295693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bfeca1c5-aeb7-4876-849f-b952a09803fa tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:42.298451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bfeca1c5-aeb7-4876-849f-b952a09803fa tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:42.303284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bfeca1c5-aeb7-4876-849f-b952a09803fa tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:42.305662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bfeca1c5-aeb7-4876-849f-b952a09803fa tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:42.327869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c844b51b-1252-4601-8da8-b615be709937 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:42.329436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c844b51b-1252-4601-8da8-b615be709937 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:42.350797 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c844b51b-1252-4601-8da8-b615be709937 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:42.352048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c844b51b-1252-4601-8da8-b615be709937 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:42.358073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c844b51b-1252-4601-8da8-b615be709937 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:42.359394 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c844b51b-1252-4601-8da8-b615be709937 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:42.593913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c844b51b-1252-4601-8da8-b615be709937 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:42.631992 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c844b51b-1252-4601-8da8-b615be709937 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1183 microversion: 2.1 time: 0.294039 May 27 15:13:42.643372 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1993/3987] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:42 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1183 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:42.934156 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bfeca1c5-aeb7-4876-849f-b952a09803fa tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:42.949556 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bfeca1c5-aeb7-4876-849f-b952a09803fa tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1363 microversion: 2.1 time: 0.690371 May 27 15:13:42.950288 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1995/3988] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:42 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1363 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:43.183818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bf160bb4-a111-4083-a866-5a25356c4705 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:43.184661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bf160bb4-a111-4083-a866-5a25356c4705 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] [instance: fe57cb4b-9069-4149-a7bf-8b76e4a5b48e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:43.188389 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:43.202376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf160bb4-a111-4083-a866-5a25356c4705 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:43.207905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf160bb4-a111-4083-a866-5a25356c4705 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:43.213465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf160bb4-a111-4083-a866-5a25356c4705 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:43.214993 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf160bb4-a111-4083-a866-5a25356c4705 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:43.253925 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-bf160bb4-a111-4083-a866-5a25356c4705 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] HTTP exception thrown: Instance fe57cb4b-9069-4149-a7bf-8b76e4a5b48e could not be found. May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bf160bb4-a111-4083-a866-5a25356c4705 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Request method failure captured: May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e HTTP/1.1 May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOp6TpIQzsdA5aH_vztGwfY2xEZ1FeG0o86GXYkWZbd2zcOUp2Iad46X7CTiaE_34rVu6waGNvTo9YazG5_xnPAUiuuLGBLaxT86lQyIlg-vjrGeeO9xPqtlmmUKV3nulb-66y_s9Y4BihZiVDcY6Kro_SC21lNcWmBHTx4ZUuaCMhA May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-Openstack-Nova-Api-Version: 2.54 May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: fd9a95e31edf4e7ca9019cb14151549c May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerShowV254Test-1250541603 May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fd9a95e31edf4e7ca9019cb14151549c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fd9a95e31edf4e7ca9019cb14151549c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fd9a95e31edf4e7ca9019cb14151549c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fd9a95e31edf4e7ca9019cb14151549c", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerShowV254Test-1250541603 May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: fd9a95e31edf4e7ca9019cb14151549c May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerShowV254Test-1250541603 May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerShowV254Test-1250541603-project May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 0b902b3ddc5b4bc3b00cdaa810f11c92 May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerShowV254Test-1250541603-project May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance fe57cb4b-9069-4149-a7bf-8b76e4a5b48e could not be found. May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'fe57cb4b-9069-4149-a7bf-8b76e4a5b48e'} May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe57cb4b-9069-4149-a7bf-8b76e4a5b48e could not be found. May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe57cb4b-9069-4149-a7bf-8b76e4a5b48e could not be found. May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:43.257050 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:43.262702 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:43.262702 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:43.262702 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:43.262702 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:13:43.262702 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:13:43.262702 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe57cb4b-9069-4149-a7bf-8b76e4a5b48e could not be found. May 27 15:13:43.262702 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:43.266436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bf160bb4-a111-4083-a866-5a25356c4705 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] Returning 404 to user: Instance fe57cb4b-9069-4149-a7bf-8b76e4a5b48e could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:43.267696 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bf160bb4-a111-4083-a866-5a25356c4705 tempest-ServerShowV254Test-1250541603 tempest-ServerShowV254Test-1250541603-project] 10.222.0.13 "GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e" status: 404 len: 111 microversion: 2.54 time: 0.088158 May 27 15:13:43.268904 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1994/3989] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:13:43 2022] GET /compute/v2.1/servers/fe57cb4b-9069-4149-a7bf-8b76e4a5b48e => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:13:43.651494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-24136612-4024-4485-82db-7d11c9fb1078 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:43.652125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-24136612-4024-4485-82db-7d11c9fb1078 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:43.659331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-24136612-4024-4485-82db-7d11c9fb1078 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:43.659790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-24136612-4024-4485-82db-7d11c9fb1078 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:43.660567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-24136612-4024-4485-82db-7d11c9fb1078 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:43.671434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-24136612-4024-4485-82db-7d11c9fb1078 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:43.862051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-24136612-4024-4485-82db-7d11c9fb1078 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:43.882316 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-24136612-4024-4485-82db-7d11c9fb1078 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1183 microversion: 2.1 time: 0.234541 May 27 15:13:43.903004 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1996/3990] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:43 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:43.967038 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f64f21d1-5b19-41c5-9552-58dba25df033 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:43.967691 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f64f21d1-5b19-41c5-9552-58dba25df033 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:43.981189 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f64f21d1-5b19-41c5-9552-58dba25df033 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:43.986512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f64f21d1-5b19-41c5-9552-58dba25df033 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:43.988426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f64f21d1-5b19-41c5-9552-58dba25df033 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:43.990460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f64f21d1-5b19-41c5-9552-58dba25df033 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:44.383413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f64f21d1-5b19-41c5-9552-58dba25df033 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:44.396135 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f64f21d1-5b19-41c5-9552-58dba25df033 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1363 microversion: 2.1 time: 0.433003 May 27 15:13:44.406686 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1997/3991] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:43 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1363 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:44.573112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-afa0f6f2-275b-4492-8997-43be8910ccae req-e783fcea-ce63-476e-b631-14db17f5d8b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d1ab07-fd5f-4c23-8ee7-fdc018c73376", "name": "network-vif-plugged", "status": "completed", "tag": "754ea1e4-0201-4c60-83c7-b66cc166cf98"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:44.603666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-afa0f6f2-275b-4492-8997-43be8910ccae req-e783fcea-ce63-476e-b631-14db17f5d8b4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:44.605436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-afa0f6f2-275b-4492-8997-43be8910ccae req-e783fcea-ce63-476e-b631-14db17f5d8b4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:44.670202 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-afa0f6f2-275b-4492-8997-43be8910ccae req-e783fcea-ce63-476e-b631-14db17f5d8b4 service nova] Creating event network-vif-plugged:754ea1e4-0201-4c60-83c7-b66cc166cf98 for instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 on n-h1-843621-1 May 27 15:13:44.683240 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-afa0f6f2-275b-4492-8997-43be8910ccae req-e783fcea-ce63-476e-b631-14db17f5d8b4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.865482 May 27 15:13:44.693976 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1995/3992] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:13:44.920413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5cb6b12f-b474-4920-bb70-fbb5b23d5fd3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:44.921134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5cb6b12f-b474-4920-bb70-fbb5b23d5fd3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:44.943456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5cb6b12f-b474-4920-bb70-fbb5b23d5fd3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:44.944012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5cb6b12f-b474-4920-bb70-fbb5b23d5fd3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:44.944882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5cb6b12f-b474-4920-bb70-fbb5b23d5fd3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:44.945361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5cb6b12f-b474-4920-bb70-fbb5b23d5fd3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:45.166815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5cb6b12f-b474-4920-bb70-fbb5b23d5fd3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:45.175862 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5cb6b12f-b474-4920-bb70-fbb5b23d5fd3 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1183 microversion: 2.1 time: 0.259618 May 27 15:13:45.176455 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1998/3993] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:44 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1183 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:45.416241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-48fa0582-fb63-4fc1-a0a4-f81cc2e6c55d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:45.417214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-48fa0582-fb63-4fc1-a0a4-f81cc2e6c55d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:45.438910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48fa0582-fb63-4fc1-a0a4-f81cc2e6c55d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:45.439550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48fa0582-fb63-4fc1-a0a4-f81cc2e6c55d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:45.440544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48fa0582-fb63-4fc1-a0a4-f81cc2e6c55d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:45.441349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48fa0582-fb63-4fc1-a0a4-f81cc2e6c55d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:45.855154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-48fa0582-fb63-4fc1-a0a4-f81cc2e6c55d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:45.905630 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-48fa0582-fb63-4fc1-a0a4-f81cc2e6c55d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1363 microversion: 2.1 time: 0.495017 May 27 15:13:45.921983 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1996/3994] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:45 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1363 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:46.191820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee9f0d24-29b2-492f-bc10-0d96179f16ed tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:46.194031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ee9f0d24-29b2-492f-bc10-0d96179f16ed tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:46.212945 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee9f0d24-29b2-492f-bc10-0d96179f16ed tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:46.217402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee9f0d24-29b2-492f-bc10-0d96179f16ed tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:46.223049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee9f0d24-29b2-492f-bc10-0d96179f16ed tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:46.224304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee9f0d24-29b2-492f-bc10-0d96179f16ed tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:46.266348 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d34f64f0-43c6-4550-968c-9bdc72d42121 tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] Action: 'create', calling method: .version_select at 0x7fc776ab2670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1443730594", "metadata": {"Type": "work"}}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d34f64f0-43c6-4550-968c-9bdc72d42121 tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] Request method failure captured: May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 122 May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOqpsRkTCGE8RB5x2mhGw6Dt21-j8eJha_P66wqvec44kd5nqaVgbrx70t7ikucrxGYwIhpFkn-zVAvu7E2F9HsATj70iMrf54Ig5dhUOBEoDiLwS5jdlgPSvMK9KzSg6YNSfAxVXFzy8m17Kyka2ZwnXm42IJcgjezxXFEnEIAbXWc May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 9b26533779364db2b41ebf10184b7a9d May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-VolumesNegativeTest-1128288806 May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9b26533779364db2b41ebf10184b7a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9b26533779364db2b41ebf10184b7a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9b26533779364db2b41ebf10184b7a9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9b26533779364db2b41ebf10184b7a9d", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-VolumesNegativeTest-1128288806 May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 9b26533779364db2b41ebf10184b7a9d May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-VolumesNegativeTest-1128288806 May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-VolumesNegativeTest-1128288806-project May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 3158552eb6b04768978a68cca243a324 May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-VolumesNegativeTest-1128288806-project May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1443730594", "metadata": {"Type": "work"}}} May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1443730594', 'metadata': {'Type': 'work'}}}} May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise error May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi '#$%' May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:13:46.269799 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:13:46.274994 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 15:13:46.274994 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.274994 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:46.274994 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.274994 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.274994 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:46.274994 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:46.274994 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:13:46.274994 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:13:46.274994 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 15:13:46.274994 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.277896 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d34f64f0-43c6-4550-968c-9bdc72d42121 tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:46.280475 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d34f64f0-43c6-4550-968c-9bdc72d42121 tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.556748 May 27 15:13:46.283173 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 1999/3995] 10.222.0.13 () {60 vars in 1155 bytes} [Fri May 27 15:13:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 560 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:13:46.299952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e3c62cc2-48c7-4a1c-800b-74b1baba08e5 tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] Action: 'create', calling method: .version_select at 0x7fc7771dbca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-155960585", "metadata": {"Type": "work"}}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e3c62cc2-48c7-4a1c-800b-74b1baba08e5 tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] Request method failure captured: May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 119 May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOqpsRkTCGE8RB5x2mhGw6Dt21-j8eJha_P66wqvec44kd5nqaVgbrx70t7ikucrxGYwIhpFkn-zVAvu7E2F9HsATj70iMrf54Ig5dhUOBEoDiLwS5jdlgPSvMK9KzSg6YNSfAxVXFzy8m17Kyka2ZwnXm42IJcgjezxXFEnEIAbXWc May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 9b26533779364db2b41ebf10184b7a9d May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-VolumesNegativeTest-1128288806 May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9b26533779364db2b41ebf10184b7a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9b26533779364db2b41ebf10184b7a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9b26533779364db2b41ebf10184b7a9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9b26533779364db2b41ebf10184b7a9d", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-VolumesNegativeTest-1128288806 May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 9b26533779364db2b41ebf10184b7a9d May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-VolumesNegativeTest-1128288806 May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-VolumesNegativeTest-1128288806-project May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 3158552eb6b04768978a68cca243a324 May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-VolumesNegativeTest-1128288806-project May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-155960585", "metadata": {"Type": "work"}}} May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-155960585', 'metadata': {'Type': 'work'}}}} May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise error May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi '0' May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:13:46.309610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:13:46.314021 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 15:13:46.314021 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.314021 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:46.314021 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.314021 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.314021 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:46.314021 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:46.314021 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:13:46.314021 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:13:46.314021 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 15:13:46.314021 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.315464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e3c62cc2-48c7-4a1c-800b-74b1baba08e5 tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:46.316540 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e3c62cc2-48c7-4a1c-800b-74b1baba08e5 tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.028438 May 27 15:13:46.319044 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2000/3996] 10.222.0.13 () {60 vars in 1155 bytes} [Fri May 27 15:13:46 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:13:46.331345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7055a76c-5a19-4115-a68b-586248db9ffc tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] Action: 'create', calling method: .version_select at 0x7fc776bca550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-911637109", "metadata": {"Type": "work"}}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7055a76c-5a19-4115-a68b-586248db9ffc tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] Request method failure captured: May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 118 May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOqpsRkTCGE8RB5x2mhGw6Dt21-j8eJha_P66wqvec44kd5nqaVgbrx70t7ikucrxGYwIhpFkn-zVAvu7E2F9HsATj70iMrf54Ig5dhUOBEoDiLwS5jdlgPSvMK9KzSg6YNSfAxVXFzy8m17Kyka2ZwnXm42IJcgjezxXFEnEIAbXWc May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 9b26533779364db2b41ebf10184b7a9d May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-VolumesNegativeTest-1128288806 May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9b26533779364db2b41ebf10184b7a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9b26533779364db2b41ebf10184b7a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9b26533779364db2b41ebf10184b7a9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9b26533779364db2b41ebf10184b7a9d", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-VolumesNegativeTest-1128288806 May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 9b26533779364db2b41ebf10184b7a9d May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-VolumesNegativeTest-1128288806 May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-VolumesNegativeTest-1128288806-project May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 3158552eb6b04768978a68cca243a324 May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-VolumesNegativeTest-1128288806-project May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-911637109", "metadata": {"Type": "work"}}} May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-911637109', 'metadata': {'Type': 'work'}}}} May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise error May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi '' May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:13:46.337074 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:13:46.341692 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 15:13:46.341692 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.341692 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:46.341692 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.341692 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.341692 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:46.341692 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:46.341692 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:13:46.341692 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:13:46.341692 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 15:13:46.341692 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.344942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7055a76c-5a19-4115-a68b-586248db9ffc tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:46.346016 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7055a76c-5a19-4115-a68b-586248db9ffc tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020813 May 27 15:13:46.347260 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2001/3997] 10.222.0.13 () {60 vars in 1155 bytes} [Fri May 27 15:13:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:13:46.366701 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b1996c9e-12c3-446c-b1cf-7a14bbeff6dd tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] Calling method '.version_select at 0x7fc776ab2160>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:46.415652 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-b1996c9e-12c3-446c-b1cf-7a14bbeff6dd tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] HTTP exception thrown: Volume tempest-invalid-1363770752 could not be found. May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b1996c9e-12c3-446c-b1cf-7a14bbeff6dd tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] Request method failure captured: May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1363770752 HTTP/1.1 May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOqpsRkTCGE8RB5x2mhGw6Dt21-j8eJha_P66wqvec44kd5nqaVgbrx70t7ikucrxGYwIhpFkn-zVAvu7E2F9HsATj70iMrf54Ig5dhUOBEoDiLwS5jdlgPSvMK9KzSg6YNSfAxVXFzy8m17Kyka2ZwnXm42IJcgjezxXFEnEIAbXWc May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 9b26533779364db2b41ebf10184b7a9d May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-VolumesNegativeTest-1128288806 May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9b26533779364db2b41ebf10184b7a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9b26533779364db2b41ebf10184b7a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9b26533779364db2b41ebf10184b7a9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9b26533779364db2b41ebf10184b7a9d", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-VolumesNegativeTest-1128288806 May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 9b26533779364db2b41ebf10184b7a9d May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-VolumesNegativeTest-1128288806 May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-VolumesNegativeTest-1128288806-project May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 3158552eb6b04768978a68cca243a324 May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-VolumesNegativeTest-1128288806-project May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: exception: Volume tempest-invalid-1363770752 could not be found. May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'tempest-invalid-1363770752'} May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1363770752 could not be found. (HTTP 404) (Request-ID: req-aab2cd2b-0e86-44be-b9b3-463fe774919a) May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:13:46.418016 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1363770752 could not be found. May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1363770752 could not be found. May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1363770752 could not be found. May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b1996c9e-12c3-446c-b1cf-7a14bbeff6dd tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] Returning 404 to user: Volume tempest-invalid-1363770752 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b1996c9e-12c3-446c-b1cf-7a14bbeff6dd tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1363770752" status: 404 len: 99 microversion: 2.1 time: 0.063669 May 27 15:13:46.422367 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2002/3998] 10.222.0.13 () {58 vars in 1217 bytes} [Fri May 27 15:13:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1363770752 => generated 99 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:13:46.440771 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a0cc9a08-0b51-40fe-9c14-e060a6171780 tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006376 May 27 15:13:46.441425 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2003/3999] 10.222.0.13 () {58 vars in 1139 bytes} [Fri May 27 15:13:46 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 15:13:46.451679 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d2f70f19-ca46-4d61-8b30-c874203ab511 tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004033 May 27 15:13:46.464648 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2004/4000] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 15:13:46 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 15:13:46.473236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b224f672-f595-409a-b7e0-cd813f68bc21 tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] Calling method '.version_select at 0x7fc776b815e0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:46.483192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ee9f0d24-29b2-492f-bc10-0d96179f16ed tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:46.492009 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ee9f0d24-29b2-492f-bc10-0d96179f16ed tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1183 microversion: 2.1 time: 0.304021 May 27 15:13:46.503105 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1997/4001] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:46 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1183 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:46.537953 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-b224f672-f595-409a-b7e0-cd813f68bc21 tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] HTTP exception thrown: Volume d5393538-f8fb-48c1-8315-03b0b5a87721 could not be found. May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b224f672-f595-409a-b7e0-cd813f68bc21 tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] Request method failure captured: May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/os-volumes/d5393538-f8fb-48c1-8315-03b0b5a87721 HTTP/1.1 May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOqpsRkTCGE8RB5x2mhGw6Dt21-j8eJha_P66wqvec44kd5nqaVgbrx70t7ikucrxGYwIhpFkn-zVAvu7E2F9HsATj70iMrf54Ig5dhUOBEoDiLwS5jdlgPSvMK9KzSg6YNSfAxVXFzy8m17Kyka2ZwnXm42IJcgjezxXFEnEIAbXWc May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 9b26533779364db2b41ebf10184b7a9d May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-VolumesNegativeTest-1128288806 May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9b26533779364db2b41ebf10184b7a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9b26533779364db2b41ebf10184b7a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9b26533779364db2b41ebf10184b7a9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9b26533779364db2b41ebf10184b7a9d", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-VolumesNegativeTest-1128288806 May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 9b26533779364db2b41ebf10184b7a9d May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-VolumesNegativeTest-1128288806 May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-VolumesNegativeTest-1128288806-project May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 3158552eb6b04768978a68cca243a324 May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-VolumesNegativeTest-1128288806-project May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: exception: Volume d5393538-f8fb-48c1-8315-03b0b5a87721 could not be found. May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'd5393538-f8fb-48c1-8315-03b0b5a87721'} May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d5393538-f8fb-48c1-8315-03b0b5a87721 could not be found. (HTTP 404) (Request-ID: req-2c41c466-d659-4c57-bcf1-682dbfd86144) May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:13:46.539986 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d5393538-f8fb-48c1-8315-03b0b5a87721 could not be found. May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d5393538-f8fb-48c1-8315-03b0b5a87721 could not be found. May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d5393538-f8fb-48c1-8315-03b0b5a87721 could not be found. May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b224f672-f595-409a-b7e0-cd813f68bc21 tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] Returning 404 to user: Volume d5393538-f8fb-48c1-8315-03b0b5a87721 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b224f672-f595-409a-b7e0-cd813f68bc21 tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/d5393538-f8fb-48c1-8315-03b0b5a87721" status: 404 len: 109 microversion: 2.1 time: 0.075670 May 27 15:13:46.544249 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2005/4002] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 15:13:46 2022] DELETE /compute/v2.1/os-volumes/d5393538-f8fb-48c1-8315-03b0b5a87721 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:13:46.553151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0a443ad0-09b5-443a-8611-896ffcca6a13 tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] Calling method '.version_select at 0x7fc780614ca0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:46.604413 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-0a443ad0-09b5-443a-8611-896ffcca6a13 tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] HTTP exception thrown: Volume 09c940d5-8435-4c02-9b1e-ed51958db704 could not be found. May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0a443ad0-09b5-443a-8611-896ffcca6a13 tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] Request method failure captured: May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-volumes/09c940d5-8435-4c02-9b1e-ed51958db704 HTTP/1.1 May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOqpsRkTCGE8RB5x2mhGw6Dt21-j8eJha_P66wqvec44kd5nqaVgbrx70t7ikucrxGYwIhpFkn-zVAvu7E2F9HsATj70iMrf54Ig5dhUOBEoDiLwS5jdlgPSvMK9KzSg6YNSfAxVXFzy8m17Kyka2ZwnXm42IJcgjezxXFEnEIAbXWc May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 9b26533779364db2b41ebf10184b7a9d May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-VolumesNegativeTest-1128288806 May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9b26533779364db2b41ebf10184b7a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9b26533779364db2b41ebf10184b7a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9b26533779364db2b41ebf10184b7a9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9b26533779364db2b41ebf10184b7a9d", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-VolumesNegativeTest-1128288806 May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 9b26533779364db2b41ebf10184b7a9d May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-VolumesNegativeTest-1128288806 May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-VolumesNegativeTest-1128288806-project May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 3158552eb6b04768978a68cca243a324 May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-VolumesNegativeTest-1128288806-project May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: exception: Volume 09c940d5-8435-4c02-9b1e-ed51958db704 could not be found. May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '09c940d5-8435-4c02-9b1e-ed51958db704'} May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 09c940d5-8435-4c02-9b1e-ed51958db704 could not be found. (HTTP 404) (Request-ID: req-78cab302-2d8a-426a-a6c8-cf9f3b05a2ed) May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:13:46.608486 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 09c940d5-8435-4c02-9b1e-ed51958db704 could not be found. May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 09c940d5-8435-4c02-9b1e-ed51958db704 could not be found. May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 09c940d5-8435-4c02-9b1e-ed51958db704 could not be found. May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0a443ad0-09b5-443a-8611-896ffcca6a13 tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] Returning 404 to user: Volume 09c940d5-8435-4c02-9b1e-ed51958db704 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:46.613319 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0a443ad0-09b5-443a-8611-896ffcca6a13 tempest-VolumesNegativeTest-1128288806 tempest-VolumesNegativeTest-1128288806-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/09c940d5-8435-4c02-9b1e-ed51958db704" status: 404 len: 109 microversion: 2.1 time: 0.062564 May 27 15:13:46.619310 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1998/4003] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:13:46 2022] GET /compute/v2.1/os-volumes/09c940d5-8435-4c02-9b1e-ed51958db704 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:13:47.027910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-87523040-5f09-4b09-995f-c2b23209ccc4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:47.028803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-87523040-5f09-4b09-995f-c2b23209ccc4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:47.043438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87523040-5f09-4b09-995f-c2b23209ccc4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:47.043910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87523040-5f09-4b09-995f-c2b23209ccc4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:47.051515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87523040-5f09-4b09-995f-c2b23209ccc4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:47.053554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87523040-5f09-4b09-995f-c2b23209ccc4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:47.519129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1e3ff1fb-7886-46f7-8c96-50e78e01745b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:47.521306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1e3ff1fb-7886-46f7-8c96-50e78e01745b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:47.532019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e3ff1fb-7886-46f7-8c96-50e78e01745b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:47.532537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e3ff1fb-7886-46f7-8c96-50e78e01745b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:47.535251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e3ff1fb-7886-46f7-8c96-50e78e01745b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:47.536011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e3ff1fb-7886-46f7-8c96-50e78e01745b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:47.613174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-87523040-5f09-4b09-995f-c2b23209ccc4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:47.627877 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-87523040-5f09-4b09-995f-c2b23209ccc4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1363 microversion: 2.1 time: 0.604521 May 27 15:13:47.637426 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2006/4004] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:47 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1363 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:47.652993 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1e3ff1fb-7886-46f7-8c96-50e78e01745b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:47.666205 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1e3ff1fb-7886-46f7-8c96-50e78e01745b tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1183 microversion: 2.1 time: 0.150711 May 27 15:13:47.683667 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 1999/4005] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:47 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:48.650102 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e2d4a942-d8ec-4c4f-8bc5-542bf9f2fd15 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:48.651091 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e2d4a942-d8ec-4c4f-8bc5-542bf9f2fd15 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:48.671239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e2d4a942-d8ec-4c4f-8bc5-542bf9f2fd15 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:48.671813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e2d4a942-d8ec-4c4f-8bc5-542bf9f2fd15 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:48.676496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e2d4a942-d8ec-4c4f-8bc5-542bf9f2fd15 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:48.679103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e2d4a942-d8ec-4c4f-8bc5-542bf9f2fd15 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:48.701046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f8af0ff6-ad47-4121-9909-e8bc33163fb6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:48.701799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f8af0ff6-ad47-4121-9909-e8bc33163fb6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:48.714885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8af0ff6-ad47-4121-9909-e8bc33163fb6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:48.717171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8af0ff6-ad47-4121-9909-e8bc33163fb6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:48.718078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8af0ff6-ad47-4121-9909-e8bc33163fb6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:48.724910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8af0ff6-ad47-4121-9909-e8bc33163fb6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:48.933092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f8af0ff6-ad47-4121-9909-e8bc33163fb6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:48.943209 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f8af0ff6-ad47-4121-9909-e8bc33163fb6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1183 microversion: 2.1 time: 0.246687 May 27 15:13:48.943812 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2000/4006] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:48 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:13:48.977038 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e2d4a942-d8ec-4c4f-8bc5-542bf9f2fd15 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:48.987069 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e2d4a942-d8ec-4c4f-8bc5-542bf9f2fd15 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1549 microversion: 2.1 time: 0.345092 May 27 15:13:48.988951 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2007/4007] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:48 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1549 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:49.005482 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2bf333ce-ff9c-4d2d-a649-1cb049b485a0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:49.006523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2bf333ce-ff9c-4d2d-a649-1cb049b485a0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:49.015981 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bf333ce-ff9c-4d2d-a649-1cb049b485a0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:49.016770 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bf333ce-ff9c-4d2d-a649-1cb049b485a0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:49.017801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bf333ce-ff9c-4d2d-a649-1cb049b485a0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:49.018952 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bf333ce-ff9c-4d2d-a649-1cb049b485a0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:49.139170 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2bf333ce-ff9c-4d2d-a649-1cb049b485a0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.138138 May 27 15:13:49.139779 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2001/4008] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 15:13:48 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:49.966255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e36385ce-5c01-45f6-9c01-9f451fa2874a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:49.969315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e36385ce-5c01-45f6-9c01-9f451fa2874a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:49.997057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e36385ce-5c01-45f6-9c01-9f451fa2874a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:50.003138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e36385ce-5c01-45f6-9c01-9f451fa2874a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:50.006181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e36385ce-5c01-45f6-9c01-9f451fa2874a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:50.006667 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e36385ce-5c01-45f6-9c01-9f451fa2874a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:50.018376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:13:50.133503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e36385ce-5c01-45f6-9c01-9f451fa2874a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:13:50.138275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2bf333ce-ff9c-4d2d-a649-1cb049b485a0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:50.139946 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2bf333ce-ff9c-4d2d-a649-1cb049b485a0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002010 May 27 15:13:50.140889 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2002/4009] 10.222.0.13 () {56 vars in 885 bytes} [Fri May 27 15:13:50 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 27 15:13:50.154737 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e36385ce-5c01-45f6-9c01-9f451fa2874a tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 200 len: 1183 microversion: 2.1 time: 0.196940 May 27 15:13:50.167976 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2008/4010] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:49 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 1183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:13:51.173909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4ada1f2a-fdec-4685-ba13-d8d35f661691 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:13:51.174536 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4ada1f2a-fdec-4685-ba13-d8d35f661691 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 0e0315e4-284c-4269-86ea-b5ac6e3b4084] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:13:51.191796 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ada1f2a-fdec-4685-ba13-d8d35f661691 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:51.192341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ada1f2a-fdec-4685-ba13-d8d35f661691 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:51.193203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ada1f2a-fdec-4685-ba13-d8d35f661691 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:51.193681 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ada1f2a-fdec-4685-ba13-d8d35f661691 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:51.218908 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-4ada1f2a-fdec-4685-ba13-d8d35f661691 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] HTTP exception thrown: Instance 0e0315e4-284c-4269-86ea-b5ac6e3b4084 could not be found. May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4ada1f2a-fdec-4685-ba13-d8d35f661691 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Request method failure captured: May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 HTTP/1.1 May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOj2jpNC52ZsK4myoCllT0b1Inti4XROB6FL76UCz_8X1hnKSbBdk-3DBHAyCIXgfm7_uIL1C0uLm3pwBgGr2jbX4c3pIp6KV9JizqGD1Vy5fvRK_NnpMJKhZn6NtWBVYiTpGpcShs3VhFjd2V-8euCwjXFFYmpwiG1yKX0YMR83zcE May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: e41b606a0de24f7fa9ea68af7064723b May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-LiveMigrationTest-432386350 May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e41b606a0de24f7fa9ea68af7064723b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e41b606a0de24f7fa9ea68af7064723b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e41b606a0de24f7fa9ea68af7064723b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e41b606a0de24f7fa9ea68af7064723b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-LiveMigrationTest-432386350 May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: e41b606a0de24f7fa9ea68af7064723b May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-LiveMigrationTest-432386350 May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-LiveMigrationTest-432386350-project May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 741a4f106a8f416891b90994e6ce9d40 May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-LiveMigrationTest-432386350-project May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 0e0315e4-284c-4269-86ea-b5ac6e3b4084 could not be found. May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '0e0315e4-284c-4269-86ea-b5ac6e3b4084'} May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e0315e4-284c-4269-86ea-b5ac6e3b4084 could not be found. May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e0315e4-284c-4269-86ea-b5ac6e3b4084 could not be found. May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:51.220501 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:13:51.229338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:13:51.229338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:13:51.229338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:13:51.229338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:13:51.229338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e0315e4-284c-4269-86ea-b5ac6e3b4084 could not be found. May 27 15:13:51.229338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:13:51.233458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4ada1f2a-fdec-4685-ba13-d8d35f661691 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Returning 404 to user: Instance 0e0315e4-284c-4269-86ea-b5ac6e3b4084 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:13:51.234395 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4ada1f2a-fdec-4685-ba13-d8d35f661691 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084" status: 404 len: 111 microversion: 2.1 time: 0.064293 May 27 15:13:51.235227 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2003/4011] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:13:51 2022] GET /compute/v2.1/servers/0e0315e4-284c-4269-86ea-b5ac6e3b4084 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:13:52.284527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-0bf96b81-f59d-42fa-8d87-c6cab6c6158c req-428a1d5b-b186-4e93-a9da-d3d6d2f29884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00d1ab07-fd5f-4c23-8ee7-fdc018c73376", "tag": "754ea1e4-0201-4c60-83c7-b66cc166cf98"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:13:52.308629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0bf96b81-f59d-42fa-8d87-c6cab6c6158c req-428a1d5b-b186-4e93-a9da-d3d6d2f29884 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:52.309271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0bf96b81-f59d-42fa-8d87-c6cab6c6158c req-428a1d5b-b186-4e93-a9da-d3d6d2f29884 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:52.334885 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-0bf96b81-f59d-42fa-8d87-c6cab6c6158c req-428a1d5b-b186-4e93-a9da-d3d6d2f29884 service nova] Creating event network-changed:754ea1e4-0201-4c60-83c7-b66cc166cf98 for instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 on n-h1-843621-1 May 27 15:13:52.346665 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-0bf96b81-f59d-42fa-8d87-c6cab6c6158c req-428a1d5b-b186-4e93-a9da-d3d6d2f29884 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.638477 May 27 15:13:52.349999 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2009/4012] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:13:58.880820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b17f4945-eaac-40c0-b1a1-71a1b3ab6a95 tempest-ComputeTenantNetworksTest-1134127467 tempest-ComputeTenantNetworksTest-1134127467-project] Calling method '.version_select at 0x7fc7806059d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:00.483890 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b17f4945-eaac-40c0-b1a1-71a1b3ab6a95 tempest-ComputeTenantNetworksTest-1134127467 tempest-ComputeTenantNetworksTest-1134127467-project] 10.222.0.13 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.920155 May 27 15:14:00.489360 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2004/4013] 10.222.0.13 () {58 vars in 1157 bytes} [Fri May 27 15:13:58 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:00.497319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6afbb73e-37f7-4378-aa08-7d85c8d80771 tempest-ComputeTenantNetworksTest-1134127467 tempest-ComputeTenantNetworksTest-1134127467-project] Calling method '.version_select at 0x7fc780653820>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:00.726394 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6afbb73e-37f7-4378-aa08-7d85c8d80771 tempest-ComputeTenantNetworksTest-1134127467 tempest-ComputeTenantNetworksTest-1134127467-project] 10.222.0.13 "GET /compute/v2.1/os-tenant-networks/46ae429b-13f1-4638-ab8e-15f476a4dfab" status: 200 len: 139 microversion: 2.1 time: 0.235216 May 27 15:14:00.727124 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2010/4014] 10.222.0.13 () {58 vars in 1268 bytes} [Fri May 27 15:14:00 2022] GET /compute/v2.1/os-tenant-networks/46ae429b-13f1-4638-ab8e-15f476a4dfab => generated 139 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:01.183185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=15 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:01.198529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=82 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:01.469556 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5675718e-65ed-4bbf-8cf2-b3322c67348e tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Action: 'create', calling method: .version_select at 0x7fc7807fff70>, body: {"keypair": {"name": "tempest-keypair-179467863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh2nTGT2Kl6J3OWxI7ro7ecc+eM/44MFgW+mHjZbl0LlMnIqT8ur/bd15ZfnEm3RpjY15YTYsFegIa/WdyVokV/Qm8OSj9E+gw0Rxhxw8o1YdR7jl5IkR8kIcUXPFbVNQ=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:01.516980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-5675718e-65ed-4bbf-8cf2-b3322c67348e tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Getting quotas for project 1f9e44f6c5ea48f19eb7300d0f51c481. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:14:01.534136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-5675718e-65ed-4bbf-8cf2-b3322c67348e tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Getting quotas for user e34c074be1734483bf9619f8c2216abc and project 1f9e44f6c5ea48f19eb7300d0f51c481. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:14:01.608818 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5675718e-65ed-4bbf-8cf2-b3322c67348e tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.749405 May 27 15:14:01.609447 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2005/4015] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:14:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:04.733018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b871ab48-1a7d-4c7a-8de2-dd63599305cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:04.733969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b871ab48-1a7d-4c7a-8de2-dd63599305cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:04.739915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:04.741955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:04.769057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b871ab48-1a7d-4c7a-8de2-dd63599305cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:04.769778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b871ab48-1a7d-4c7a-8de2-dd63599305cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:04.770976 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b871ab48-1a7d-4c7a-8de2-dd63599305cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:04.772358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b871ab48-1a7d-4c7a-8de2-dd63599305cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:04.831566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b871ab48-1a7d-4c7a-8de2-dd63599305cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:14:05.002588 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b871ab48-1a7d-4c7a-8de2-dd63599305cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 204 len: 0 microversion: 2.1 time: 0.275873 May 27 15:14:05.004030 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2011/4016] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:14:04 2022] DELETE /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:14:05.017372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2f645fac-4a67-4df0-bb44-b413c3f539f9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:05.018084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2f645fac-4a67-4df0-bb44-b413c3f539f9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:05.030026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2f645fac-4a67-4df0-bb44-b413c3f539f9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:05.033395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2f645fac-4a67-4df0-bb44-b413c3f539f9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:05.034326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2f645fac-4a67-4df0-bb44-b413c3f539f9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:05.037262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2f645fac-4a67-4df0-bb44-b413c3f539f9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:05.619186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2f645fac-4a67-4df0-bb44-b413c3f539f9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:05.644159 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2f645fac-4a67-4df0-bb44-b413c3f539f9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1500 microversion: 2.1 time: 0.635525 May 27 15:14:05.646482 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2006/4017] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:05 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1500 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:06.306888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-200f1f2c-9cc3-4255-bfaf-b82d32bfbb5a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1146822671", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e9fae2c8-4659-482e-a497-6bf0ef4d626a"}], "security_groups": [{"name": "tempest-securitygroup--822216019"}], "key_name": "tempest-keypair-179467863", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:06.489676 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-200f1f2c-9cc3-4255-bfaf-b82d32bfbb5a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] validate_networks() for [('e9fae2c8-4659-482e-a497-6bf0ef4d626a', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:14:06.671300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a43d80fc-d4c7-4261-9caa-40fa02e824cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:06.672024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a43d80fc-d4c7-4261-9caa-40fa02e824cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:06.682115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a43d80fc-d4c7-4261-9caa-40fa02e824cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:06.683057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a43d80fc-d4c7-4261-9caa-40fa02e824cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:06.684173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a43d80fc-d4c7-4261-9caa-40fa02e824cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:06.684910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a43d80fc-d4c7-4261-9caa-40fa02e824cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:07.790700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a43d80fc-d4c7-4261-9caa-40fa02e824cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:07.806185 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a43d80fc-d4c7-4261-9caa-40fa02e824cf tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 200 len: 1500 microversion: 2.1 time: 1.142230 May 27 15:14:07.808489 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2007/4018] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:06 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 1500 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:07.824251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-3f755ce5-6b61-4e1c-bbbb-47027504cc48 req-dd49e09e-ffee-4fd6-85c0-857a37895e1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec", "name": "network-vif-deleted", "tag": "9adf6904-8e68-481c-93de-21a8ad9c0eed"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:07.843487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3f755ce5-6b61-4e1c-bbbb-47027504cc48 req-dd49e09e-ffee-4fd6-85c0-857a37895e1f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:07.843956 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3f755ce5-6b61-4e1c-bbbb-47027504cc48 req-dd49e09e-ffee-4fd6-85c0-857a37895e1f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:07.875144 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-3f755ce5-6b61-4e1c-bbbb-47027504cc48 req-dd49e09e-ffee-4fd6-85c0-857a37895e1f service nova] Creating event network-vif-deleted:9adf6904-8e68-481c-93de-21a8ad9c0eed for instance ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec on n-h1-843621-1 May 27 15:14:07.896098 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-3f755ce5-6b61-4e1c-bbbb-47027504cc48 req-dd49e09e-ffee-4fd6-85c0-857a37895e1f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077120 May 27 15:14:07.899360 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2008/4019] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:08.725039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-200f1f2c-9cc3-4255-bfaf-b82d32bfbb5a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Getting quotas for project 1f9e44f6c5ea48f19eb7300d0f51c481. Resources: dict_keys(['metadata_items']) {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:14:08.734230 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-200f1f2c-9cc3-4255-bfaf-b82d32bfbb5a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Getting quotas for user e34c074be1734483bf9619f8c2216abc and project 1f9e44f6c5ea48f19eb7300d0f51c481. Resources: dict_keys(['metadata_items']) {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:14:08.766525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-200f1f2c-9cc3-4255-bfaf-b82d32bfbb5a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:14:08.767950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-200f1f2c-9cc3-4255-bfaf-b82d32bfbb5a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:14:08.768972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-200f1f2c-9cc3-4255-bfaf-b82d32bfbb5a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:14:08.769836 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-200f1f2c-9cc3-4255-bfaf-b82d32bfbb5a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:14:08.771208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-200f1f2c-9cc3-4255-bfaf-b82d32bfbb5a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:14:08.811460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-200f1f2c-9cc3-4255-bfaf-b82d32bfbb5a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:08.812242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-200f1f2c-9cc3-4255-bfaf-b82d32bfbb5a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:08.827864 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fb27a69d-66d2-4cee-9b1c-dfec22b0273f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:08.828922 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fb27a69d-66d2-4cee-9b1c-dfec22b0273f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:08.834250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-200f1f2c-9cc3-4255-bfaf-b82d32bfbb5a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:08.837505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-200f1f2c-9cc3-4255-bfaf-b82d32bfbb5a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:08.842877 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb27a69d-66d2-4cee-9b1c-dfec22b0273f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:08.849463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb27a69d-66d2-4cee-9b1c-dfec22b0273f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:08.850842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb27a69d-66d2-4cee-9b1c-dfec22b0273f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:08.851549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb27a69d-66d2-4cee-9b1c-dfec22b0273f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:08.886145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-200f1f2c-9cc3-4255-bfaf-b82d32bfbb5a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Getting quotas for project 1f9e44f6c5ea48f19eb7300d0f51c481. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:14:08.894107 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-fb27a69d-66d2-4cee-9b1c-dfec22b0273f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] HTTP exception thrown: Instance ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec could not be found. May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fb27a69d-66d2-4cee-9b1c-dfec22b0273f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Request method failure captured: May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec HTTP/1.1 May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOj2jpNC52ZsK4myoCllT0b1Inti4XROB6FL76UCz_8X1hnKSbBdk-3DBHAyCIXgfm7_uIL1C0uLm3pwBgGr2jbX4c3pIp6KV9JizqGD1Vy5fvRK_NnpMJKhZn6NtWBVYiTpGpcShs3VhFjd2V-8euCwjXFFYmpwiG1yKX0YMR83zcE May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: e41b606a0de24f7fa9ea68af7064723b May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-LiveMigrationTest-432386350 May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e41b606a0de24f7fa9ea68af7064723b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e41b606a0de24f7fa9ea68af7064723b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e41b606a0de24f7fa9ea68af7064723b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e41b606a0de24f7fa9ea68af7064723b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-LiveMigrationTest-432386350 May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: e41b606a0de24f7fa9ea68af7064723b May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-LiveMigrationTest-432386350 May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-LiveMigrationTest-432386350-project May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 741a4f106a8f416891b90994e6ce9d40 May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-LiveMigrationTest-432386350-project May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec could not be found. May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec'} May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec could not be found. May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec could not be found. May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:14:08.898881 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:08.905898 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:14:08.905898 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:14:08.905898 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:14:08.905898 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:14:08.905898 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec could not be found. May 27 15:14:08.905898 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:14:08.910686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fb27a69d-66d2-4cee-9b1c-dfec22b0273f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Returning 404 to user: Instance ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:14:08.910836 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-200f1f2c-9cc3-4255-bfaf-b82d32bfbb5a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Getting quotas for user e34c074be1734483bf9619f8c2216abc and project 1f9e44f6c5ea48f19eb7300d0f51c481. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:14:08.911946 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fb27a69d-66d2-4cee-9b1c-dfec22b0273f tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec" status: 404 len: 111 microversion: 2.1 time: 0.090091 May 27 15:14:08.913813 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2009/4020] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:08 2022] GET /compute/v2.1/servers/ed1c1b5f-8a41-4cd7-a3a7-5fc0b5ef77ec => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:14:08.925064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-39d6390e-0290-4863-9d55-d18ff03341ec tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:08.927012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-39d6390e-0290-4863-9d55-d18ff03341ec tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:08.936040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39d6390e-0290-4863-9d55-d18ff03341ec tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:08.937605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39d6390e-0290-4863-9d55-d18ff03341ec tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:08.938858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39d6390e-0290-4863-9d55-d18ff03341ec tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:08.945785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-200f1f2c-9cc3-4255-bfaf-b82d32bfbb5a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:14:08.948896 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-200f1f2c-9cc3-4255-bfaf-b82d32bfbb5a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:14:08.951267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39d6390e-0290-4863-9d55-d18ff03341ec tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:09.026016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-39d6390e-0290-4863-9d55-d18ff03341ec tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:14:09.052024 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-200f1f2c-9cc3-4255-bfaf-b82d32bfbb5a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.750685 May 27 15:14:09.059123 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2012/4021] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:14:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 2759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:14:09.077882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-765fd779-2ef4-44bb-8868-b5b396089b6d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:09.078585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-765fd779-2ef4-44bb-8868-b5b396089b6d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:09.298468 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-39d6390e-0290-4863-9d55-d18ff03341ec tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 204 len: 0 microversion: 2.1 time: 0.380555 May 27 15:14:09.299825 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2010/4022] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:14:08 2022] DELETE /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:14:09.324886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-06194d1f-fd18-4982-89c2-94c736f60f3e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:09.329109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-06194d1f-fd18-4982-89c2-94c736f60f3e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:09.339304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06194d1f-fd18-4982-89c2-94c736f60f3e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:09.339953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06194d1f-fd18-4982-89c2-94c736f60f3e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:09.340915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-765fd779-2ef4-44bb-8868-b5b396089b6d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:09.341243 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06194d1f-fd18-4982-89c2-94c736f60f3e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:09.341243 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06194d1f-fd18-4982-89c2-94c736f60f3e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:09.360477 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-765fd779-2ef4-44bb-8868-b5b396089b6d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1277 microversion: 2.1 time: 0.295402 May 27 15:14:09.367111 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2013/4023] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:09 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1277 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:09.891106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-06194d1f-fd18-4982-89c2-94c736f60f3e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:09.905289 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-06194d1f-fd18-4982-89c2-94c736f60f3e tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1484 microversion: 2.1 time: 0.598611 May 27 15:14:09.906317 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2011/4024] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:09 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1484 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:10.381541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2a96d984-7049-4724-b940-6342da1f6a8b tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:10.382169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2a96d984-7049-4724-b940-6342da1f6a8b tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:10.410191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a96d984-7049-4724-b940-6342da1f6a8b tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:10.420277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a96d984-7049-4724-b940-6342da1f6a8b tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:10.421658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a96d984-7049-4724-b940-6342da1f6a8b tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:10.425578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a96d984-7049-4724-b940-6342da1f6a8b tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:10.622494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2a96d984-7049-4724-b940-6342da1f6a8b tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:10.632201 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2a96d984-7049-4724-b940-6342da1f6a8b tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1329 microversion: 2.1 time: 0.254987 May 27 15:14:10.632664 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2014/4025] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:10 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1329 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:10.921918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e04f4e8c-2e8c-4f94-b7aa-996c1d41b0c8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:10.922527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e04f4e8c-2e8c-4f94-b7aa-996c1d41b0c8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:10.953315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e04f4e8c-2e8c-4f94-b7aa-996c1d41b0c8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:10.953782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e04f4e8c-2e8c-4f94-b7aa-996c1d41b0c8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:10.965247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e04f4e8c-2e8c-4f94-b7aa-996c1d41b0c8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:10.965786 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e04f4e8c-2e8c-4f94-b7aa-996c1d41b0c8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:11.486981 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e04f4e8c-2e8c-4f94-b7aa-996c1d41b0c8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:11.498108 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e04f4e8c-2e8c-4f94-b7aa-996c1d41b0c8 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 200 len: 1484 microversion: 2.1 time: 0.579937 May 27 15:14:11.499688 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2012/4026] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:10 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 1484 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:11.653069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dc0974aa-b69f-4615-aaf5-35f9989169e8 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:11.654446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dc0974aa-b69f-4615-aaf5-35f9989169e8 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:11.664643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc0974aa-b69f-4615-aaf5-35f9989169e8 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:11.665372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc0974aa-b69f-4615-aaf5-35f9989169e8 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:11.666354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc0974aa-b69f-4615-aaf5-35f9989169e8 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:11.668003 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc0974aa-b69f-4615-aaf5-35f9989169e8 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:11.771112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dc0974aa-b69f-4615-aaf5-35f9989169e8 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:11.782939 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dc0974aa-b69f-4615-aaf5-35f9989169e8 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1335 microversion: 2.1 time: 0.134684 May 27 15:14:11.786270 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2015/4027] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:11 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1335 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:11.808773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-dbc51683-a22e-4469-8331-512e2fbe909e req-7ee50662-82c2-4696-aa57-2666ca6f581d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3e9f6b-d322-4c17-9b7a-dae9c0867822", "name": "network-vif-deleted", "tag": "e8dc33c2-75df-4472-a438-c3f1dc3de0b4"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:11.813545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:11.827742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-dbc51683-a22e-4469-8331-512e2fbe909e req-7ee50662-82c2-4696-aa57-2666ca6f581d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:11.828200 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-dbc51683-a22e-4469-8331-512e2fbe909e req-7ee50662-82c2-4696-aa57-2666ca6f581d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:11.871746 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-dbc51683-a22e-4469-8331-512e2fbe909e req-7ee50662-82c2-4696-aa57-2666ca6f581d service nova] Creating event network-vif-deleted:e8dc33c2-75df-4472-a438-c3f1dc3de0b4 for instance 9d3e9f6b-d322-4c17-9b7a-dae9c0867822 on n-h1-843621-1 May 27 15:14:11.887281 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-dbc51683-a22e-4469-8331-512e2fbe909e req-7ee50662-82c2-4696-aa57-2666ca6f581d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082773 May 27 15:14:11.888196 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2013/4028] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:12.515705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-99c8bcbb-647b-4f38-be6e-e0a251e8a55c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:12.516343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-99c8bcbb-647b-4f38-be6e-e0a251e8a55c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 9d3e9f6b-d322-4c17-9b7a-dae9c0867822] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:12.523464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99c8bcbb-647b-4f38-be6e-e0a251e8a55c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:12.524248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99c8bcbb-647b-4f38-be6e-e0a251e8a55c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:12.525312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99c8bcbb-647b-4f38-be6e-e0a251e8a55c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:12.525973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99c8bcbb-647b-4f38-be6e-e0a251e8a55c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:12.546747 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-99c8bcbb-647b-4f38-be6e-e0a251e8a55c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] HTTP exception thrown: Instance 9d3e9f6b-d322-4c17-9b7a-dae9c0867822 could not be found. May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-99c8bcbb-647b-4f38-be6e-e0a251e8a55c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Request method failure captured: May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 HTTP/1.1 May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOj2jpNC52ZsK4myoCllT0b1Inti4XROB6FL76UCz_8X1hnKSbBdk-3DBHAyCIXgfm7_uIL1C0uLm3pwBgGr2jbX4c3pIp6KV9JizqGD1Vy5fvRK_NnpMJKhZn6NtWBVYiTpGpcShs3VhFjd2V-8euCwjXFFYmpwiG1yKX0YMR83zcE May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: e41b606a0de24f7fa9ea68af7064723b May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-LiveMigrationTest-432386350 May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e41b606a0de24f7fa9ea68af7064723b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e41b606a0de24f7fa9ea68af7064723b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e41b606a0de24f7fa9ea68af7064723b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e41b606a0de24f7fa9ea68af7064723b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-LiveMigrationTest-432386350 May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: e41b606a0de24f7fa9ea68af7064723b May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-LiveMigrationTest-432386350 May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-LiveMigrationTest-432386350-project May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 741a4f106a8f416891b90994e6ce9d40 May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-LiveMigrationTest-432386350-project May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 9d3e9f6b-d322-4c17-9b7a-dae9c0867822 could not be found. May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '9d3e9f6b-d322-4c17-9b7a-dae9c0867822'} May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d3e9f6b-d322-4c17-9b7a-dae9c0867822 could not be found. May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d3e9f6b-d322-4c17-9b7a-dae9c0867822 could not be found. May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:14:12.549337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:12.553919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:14:12.553919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:14:12.553919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:14:12.553919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:14:12.553919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d3e9f6b-d322-4c17-9b7a-dae9c0867822 could not be found. May 27 15:14:12.553919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:14:12.555832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-99c8bcbb-647b-4f38-be6e-e0a251e8a55c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Returning 404 to user: Instance 9d3e9f6b-d322-4c17-9b7a-dae9c0867822 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:14:12.557168 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-99c8bcbb-647b-4f38-be6e-e0a251e8a55c tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822" status: 404 len: 111 microversion: 2.1 time: 0.045598 May 27 15:14:12.558358 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2016/4029] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:12 2022] GET /compute/v2.1/servers/9d3e9f6b-d322-4c17-9b7a-dae9c0867822 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:14:12.567484 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f33603e2-333d-458c-96a6-617760e5e6c1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:12.568966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f33603e2-333d-458c-96a6-617760e5e6c1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:12.576231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f33603e2-333d-458c-96a6-617760e5e6c1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:12.577082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f33603e2-333d-458c-96a6-617760e5e6c1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:12.578181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f33603e2-333d-458c-96a6-617760e5e6c1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:12.578848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f33603e2-333d-458c-96a6-617760e5e6c1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:12.666313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f33603e2-333d-458c-96a6-617760e5e6c1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:14:12.782338 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f33603e2-333d-458c-96a6-617760e5e6c1 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "DELETE /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 204 len: 0 microversion: 2.1 time: 0.219761 May 27 15:14:12.787898 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2014/4030] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:14:12 2022] DELETE /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:14:12.796212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e5270760-85a6-4eef-a416-425288f76ca9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:12.797161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e5270760-85a6-4eef-a416-425288f76ca9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:12.800420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5edead88-66b5-45b3-b69f-dc56cfe9e446 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:12.801962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5edead88-66b5-45b3-b69f-dc56cfe9e446 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:12.809606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5edead88-66b5-45b3-b69f-dc56cfe9e446 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:12.810063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5edead88-66b5-45b3-b69f-dc56cfe9e446 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:12.810863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5edead88-66b5-45b3-b69f-dc56cfe9e446 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:12.811569 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5edead88-66b5-45b3-b69f-dc56cfe9e446 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:12.819161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e5270760-85a6-4eef-a416-425288f76ca9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:12.819864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e5270760-85a6-4eef-a416-425288f76ca9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:12.821251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e5270760-85a6-4eef-a416-425288f76ca9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:12.822001 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e5270760-85a6-4eef-a416-425288f76ca9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:12.999994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5edead88-66b5-45b3-b69f-dc56cfe9e446 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:13.013464 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5edead88-66b5-45b3-b69f-dc56cfe9e446 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1335 microversion: 2.1 time: 0.217529 May 27 15:14:13.015175 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2015/4031] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:12 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1335 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:13.284759 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e5270760-85a6-4eef-a416-425288f76ca9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:13.309023 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e5270760-85a6-4eef-a416-425288f76ca9 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1500 microversion: 2.1 time: 0.514199 May 27 15:14:13.311539 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2017/4032] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:12 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1500 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:14.034428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7acc126a-99be-4b59-b92a-38264cf99fc5 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:14.035113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7acc126a-99be-4b59-b92a-38264cf99fc5 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:14.045408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7acc126a-99be-4b59-b92a-38264cf99fc5 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:14.046640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7acc126a-99be-4b59-b92a-38264cf99fc5 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:14.047827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7acc126a-99be-4b59-b92a-38264cf99fc5 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:14.048895 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7acc126a-99be-4b59-b92a-38264cf99fc5 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:14.328945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9e60f019-51b6-4704-92c2-fd960796517d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:14.330459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9e60f019-51b6-4704-92c2-fd960796517d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:14.344860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7acc126a-99be-4b59-b92a-38264cf99fc5 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:14.352658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e60f019-51b6-4704-92c2-fd960796517d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:14.353188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e60f019-51b6-4704-92c2-fd960796517d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:14.354365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e60f019-51b6-4704-92c2-fd960796517d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:14.356941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e60f019-51b6-4704-92c2-fd960796517d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:14.383447 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7acc126a-99be-4b59-b92a-38264cf99fc5 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1402 microversion: 2.1 time: 0.354195 May 27 15:14:14.385248 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2016/4033] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:14 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1402 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:14.742145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9e60f019-51b6-4704-92c2-fd960796517d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:14.752045 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9e60f019-51b6-4704-92c2-fd960796517d tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1500 microversion: 2.1 time: 0.427198 May 27 15:14:14.753394 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2018/4034] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:14 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1500 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:15.403657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9718fc0c-1afa-4bf8-a4de-a0864b39dc20 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:15.404396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9718fc0c-1afa-4bf8-a4de-a0864b39dc20 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:15.419636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9718fc0c-1afa-4bf8-a4de-a0864b39dc20 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:15.420122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9718fc0c-1afa-4bf8-a4de-a0864b39dc20 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:15.424340 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9718fc0c-1afa-4bf8-a4de-a0864b39dc20 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:15.425742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9718fc0c-1afa-4bf8-a4de-a0864b39dc20 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:15.771653 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1006c8e4-f0fc-4aeb-ab1f-f90c90d09eb6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:15.773347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1006c8e4-f0fc-4aeb-ab1f-f90c90d09eb6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:15.781146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1006c8e4-f0fc-4aeb-ab1f-f90c90d09eb6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:15.781827 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1006c8e4-f0fc-4aeb-ab1f-f90c90d09eb6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:15.782771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1006c8e4-f0fc-4aeb-ab1f-f90c90d09eb6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:15.783505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1006c8e4-f0fc-4aeb-ab1f-f90c90d09eb6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:15.822343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9718fc0c-1afa-4bf8-a4de-a0864b39dc20 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:15.853778 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9718fc0c-1afa-4bf8-a4de-a0864b39dc20 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1402 microversion: 2.1 time: 0.450908 May 27 15:14:15.856808 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2017/4035] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:15 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1402 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:15.921741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1006c8e4-f0fc-4aeb-ab1f-f90c90d09eb6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '741a4f106a8f416891b90994e6ce9d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41b606a0de24f7fa9ea68af7064723b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:15.940894 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1006c8e4-f0fc-4aeb-ab1f-f90c90d09eb6 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 200 len: 1458 microversion: 2.1 time: 0.173319 May 27 15:14:15.942906 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2019/4036] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:15 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 1458 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:16.149729 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-7d9d897a-cacd-4508-8461-c31621d2c046 req-76fed577-7cc0-44b0-82f7-45fc631262c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43977f10-b575-4abc-877b-2877ded82fee", "name": "network-vif-deleted", "tag": "32123a21-d6ba-4e17-af90-97a4d6efb2fa"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:16.171035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-7d9d897a-cacd-4508-8461-c31621d2c046 req-76fed577-7cc0-44b0-82f7-45fc631262c5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:16.171035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-7d9d897a-cacd-4508-8461-c31621d2c046 req-76fed577-7cc0-44b0-82f7-45fc631262c5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:16.213344 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-7d9d897a-cacd-4508-8461-c31621d2c046 req-76fed577-7cc0-44b0-82f7-45fc631262c5 service nova] Creating event network-vif-deleted:32123a21-d6ba-4e17-af90-97a4d6efb2fa for instance 43977f10-b575-4abc-877b-2877ded82fee on n-h1-843621-1 May 27 15:14:16.224309 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-7d9d897a-cacd-4508-8461-c31621d2c046 req-76fed577-7cc0-44b0-82f7-45fc631262c5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082820 May 27 15:14:16.227591 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2018/4037] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:16.874837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0a92475e-529b-4363-aaaf-22cadf68bb89 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:16.875675 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0a92475e-529b-4363-aaaf-22cadf68bb89 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:16.897509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a92475e-529b-4363-aaaf-22cadf68bb89 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:16.898250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a92475e-529b-4363-aaaf-22cadf68bb89 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:16.901762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a92475e-529b-4363-aaaf-22cadf68bb89 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:16.902679 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a92475e-529b-4363-aaaf-22cadf68bb89 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:16.969434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-42982a95-4f9e-4e80-b756-d2bd69d73079 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:16.970365 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-42982a95-4f9e-4e80-b756-d2bd69d73079 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] [instance: 43977f10-b575-4abc-877b-2877ded82fee] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:16.986475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-42982a95-4f9e-4e80-b756-d2bd69d73079 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:16.989793 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-42982a95-4f9e-4e80-b756-d2bd69d73079 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:16.994169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-42982a95-4f9e-4e80-b756-d2bd69d73079 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:16.995499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-42982a95-4f9e-4e80-b756-d2bd69d73079 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:17.024385 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-42982a95-4f9e-4e80-b756-d2bd69d73079 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] HTTP exception thrown: Instance 43977f10-b575-4abc-877b-2877ded82fee could not be found. May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-42982a95-4f9e-4e80-b756-d2bd69d73079 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Request method failure captured: May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee HTTP/1.1 May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOj2jpNC52ZsK4myoCllT0b1Inti4XROB6FL76UCz_8X1hnKSbBdk-3DBHAyCIXgfm7_uIL1C0uLm3pwBgGr2jbX4c3pIp6KV9JizqGD1Vy5fvRK_NnpMJKhZn6NtWBVYiTpGpcShs3VhFjd2V-8euCwjXFFYmpwiG1yKX0YMR83zcE May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: e41b606a0de24f7fa9ea68af7064723b May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-LiveMigrationTest-432386350 May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e41b606a0de24f7fa9ea68af7064723b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e41b606a0de24f7fa9ea68af7064723b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e41b606a0de24f7fa9ea68af7064723b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e41b606a0de24f7fa9ea68af7064723b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-LiveMigrationTest-432386350 May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: e41b606a0de24f7fa9ea68af7064723b May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-LiveMigrationTest-432386350 May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-LiveMigrationTest-432386350-project May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 741a4f106a8f416891b90994e6ce9d40 May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-LiveMigrationTest-432386350-project May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 43977f10-b575-4abc-877b-2877ded82fee could not be found. May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '43977f10-b575-4abc-877b-2877ded82fee'} May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43977f10-b575-4abc-877b-2877ded82fee could not be found. May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43977f10-b575-4abc-877b-2877ded82fee could not be found. May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:14:17.026401 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:17.031443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:14:17.031443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:14:17.031443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:14:17.031443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:14:17.031443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43977f10-b575-4abc-877b-2877ded82fee could not be found. May 27 15:14:17.031443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:14:17.032862 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-42982a95-4f9e-4e80-b756-d2bd69d73079 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] Returning 404 to user: Instance 43977f10-b575-4abc-877b-2877ded82fee could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:14:17.033935 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-42982a95-4f9e-4e80-b756-d2bd69d73079 tempest-LiveMigrationTest-432386350 tempest-LiveMigrationTest-432386350-project] 10.222.0.13 "GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee" status: 404 len: 111 microversion: 2.1 time: 0.078128 May 27 15:14:17.038820 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2019/4038] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:16 2022] GET /compute/v2.1/servers/43977f10-b575-4abc-877b-2877ded82fee => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:14:17.444213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0a92475e-529b-4363-aaaf-22cadf68bb89 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:17.454107 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0a92475e-529b-4363-aaaf-22cadf68bb89 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1402 microversion: 2.1 time: 0.584601 May 27 15:14:17.456491 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2020/4039] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:16 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1402 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:18.268958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-2509850e-74c8-4505-b778-e76d31ee313d req-9e4835ba-cca2-400a-9778-0c1efa0743b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be660a8b-14e9-4236-ad83-c671d7d71c13", "tag": "3f02e49e-6281-45ea-b276-47de220cb62a"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:18.281894 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2509850e-74c8-4505-b778-e76d31ee313d req-9e4835ba-cca2-400a-9778-0c1efa0743b2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:18.282485 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2509850e-74c8-4505-b778-e76d31ee313d req-9e4835ba-cca2-400a-9778-0c1efa0743b2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:18.299404 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-2509850e-74c8-4505-b778-e76d31ee313d req-9e4835ba-cca2-400a-9778-0c1efa0743b2 service nova] Creating event network-changed:3f02e49e-6281-45ea-b276-47de220cb62a for instance be660a8b-14e9-4236-ad83-c671d7d71c13 on n-h2-843621-1 May 27 15:14:18.306064 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-2509850e-74c8-4505-b778-e76d31ee313d req-9e4835ba-cca2-400a-9778-0c1efa0743b2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045182 May 27 15:14:18.308308 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2020/4040] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:18.474562 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fae1801c-3e12-405d-b40d-9372c78b7267 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:18.475879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fae1801c-3e12-405d-b40d-9372c78b7267 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:18.484961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fae1801c-3e12-405d-b40d-9372c78b7267 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:18.485417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fae1801c-3e12-405d-b40d-9372c78b7267 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:18.487029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fae1801c-3e12-405d-b40d-9372c78b7267 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:18.487691 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fae1801c-3e12-405d-b40d-9372c78b7267 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:18.672647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fae1801c-3e12-405d-b40d-9372c78b7267 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:18.682445 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fae1801c-3e12-405d-b40d-9372c78b7267 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1402 microversion: 2.1 time: 0.214031 May 27 15:14:18.683233 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2021/4041] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:18 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1402 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:19.719671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-32a61ef4-ded2-4a78-b75c-af21faa46234 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:19.722023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-32a61ef4-ded2-4a78-b75c-af21faa46234 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:19.739788 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32a61ef4-ded2-4a78-b75c-af21faa46234 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:19.742070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32a61ef4-ded2-4a78-b75c-af21faa46234 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:19.742903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32a61ef4-ded2-4a78-b75c-af21faa46234 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:19.743361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32a61ef4-ded2-4a78-b75c-af21faa46234 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:20.076408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-32a61ef4-ded2-4a78-b75c-af21faa46234 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:20.088877 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-32a61ef4-ded2-4a78-b75c-af21faa46234 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1402 microversion: 2.1 time: 0.388876 May 27 15:14:20.088877 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2021/4042] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:19 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1402 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:20.708228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:20.709023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=12 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:20.918282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7f40a331-7a43-4d37-a259-01d727f19431 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Action: 'create', calling method: .version_select at 0x7fc780621ee0>, body: {"keypair": {"name": "tempest-keypair-1883981137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKyH715FSy6GC3RKuK/XDBikP6JIityhlioVn3k8+If9LeyZNVu5gHR/tbcJq14GNF2H9/Y6z19GZXwM/t/I1lDrnxqMUSXbPqH6rTdmRs6BEOkkEu6+KbJ4GMRu1rVtQ=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:20.951161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-7f40a331-7a43-4d37-a259-01d727f19431 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Getting quotas for project 5a9a825b1ade46e3a702ae19c7c53f6b. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:14:20.973449 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-7f40a331-7a43-4d37-a259-01d727f19431 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Getting quotas for user 59f88a11fc4b4bf6b4a807ccffee1fab and project 5a9a825b1ade46e3a702ae19c7c53f6b. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:14:21.021958 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7f40a331-7a43-4d37-a259-01d727f19431 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.318732 May 27 15:14:21.023856 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2022/4043] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:14:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:21.104834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-939d3dc7-66bf-4306-90e4-85bf390c390c tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:21.107347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-939d3dc7-66bf-4306-90e4-85bf390c390c tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:21.122588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-939d3dc7-66bf-4306-90e4-85bf390c390c tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:21.123405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-939d3dc7-66bf-4306-90e4-85bf390c390c tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:21.125681 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-939d3dc7-66bf-4306-90e4-85bf390c390c tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:21.126654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-939d3dc7-66bf-4306-90e4-85bf390c390c tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:21.514602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-939d3dc7-66bf-4306-90e4-85bf390c390c tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:21.527202 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-939d3dc7-66bf-4306-90e4-85bf390c390c tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1402 microversion: 2.1 time: 0.428408 May 27 15:14:21.532482 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2022/4044] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:21 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1402 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:22.550372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-875cbf54-e7ba-4bce-88a4-654c8dcbc4ca tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:22.552571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-875cbf54-e7ba-4bce-88a4-654c8dcbc4ca tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:22.560211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-875cbf54-e7ba-4bce-88a4-654c8dcbc4ca tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:22.560981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-875cbf54-e7ba-4bce-88a4-654c8dcbc4ca tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:22.561951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-875cbf54-e7ba-4bce-88a4-654c8dcbc4ca tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:22.562566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-875cbf54-e7ba-4bce-88a4-654c8dcbc4ca tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:22.806838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-875cbf54-e7ba-4bce-88a4-654c8dcbc4ca tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:22.825270 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-875cbf54-e7ba-4bce-88a4-654c8dcbc4ca tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1402 microversion: 2.1 time: 0.279085 May 27 15:14:22.826520 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2023/4045] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:22 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1402 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:23.850784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-85c0a707-0594-471d-8a23-e14c2c167205 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:23.851447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-85c0a707-0594-471d-8a23-e14c2c167205 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:23.883017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85c0a707-0594-471d-8a23-e14c2c167205 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:23.883487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85c0a707-0594-471d-8a23-e14c2c167205 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:23.884309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85c0a707-0594-471d-8a23-e14c2c167205 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:23.884779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85c0a707-0594-471d-8a23-e14c2c167205 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:23.902139 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:24.221997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-85c0a707-0594-471d-8a23-e14c2c167205 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:24.233836 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-85c0a707-0594-471d-8a23-e14c2c167205 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1402 microversion: 2.1 time: 0.395283 May 27 15:14:24.245992 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2023/4046] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:23 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1402 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:24.255712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b7c214bd-166e-476c-b488-9e36f9f644b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-508039946", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5506dc4-66e1-4bd2-af40-7ec96debefd9"}], "security_groups": [{"name": "tempest-securitygroup--1720933805"}], "key_name": "tempest-keypair-1883981137", "user_data": "}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:24.476882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-b7c214bd-166e-476c-b488-9e36f9f644b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] validate_networks() for [('b5506dc4-66e1-4bd2-af40-7ec96debefd9', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:14:25.219928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-b7c214bd-166e-476c-b488-9e36f9f644b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:14:25.221095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-b7c214bd-166e-476c-b488-9e36f9f644b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:14:25.222391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-b7c214bd-166e-476c-b488-9e36f9f644b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:14:25.223237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-b7c214bd-166e-476c-b488-9e36f9f644b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:14:25.225188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-b7c214bd-166e-476c-b488-9e36f9f644b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:14:25.240912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7c214bd-166e-476c-b488-9e36f9f644b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:25.241805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7c214bd-166e-476c-b488-9e36f9f644b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:25.243554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7c214bd-166e-476c-b488-9e36f9f644b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:25.245398 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7c214bd-166e-476c-b488-9e36f9f644b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:25.279276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-b7c214bd-166e-476c-b488-9e36f9f644b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Getting quotas for project 5a9a825b1ade46e3a702ae19c7c53f6b. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:14:25.286143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-b7c214bd-166e-476c-b488-9e36f9f644b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Getting quotas for user 59f88a11fc4b4bf6b4a807ccffee1fab and project 5a9a825b1ade46e3a702ae19c7c53f6b. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:14:25.300269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b7c214bd-166e-476c-b488-9e36f9f644b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:14:25.303425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b7c214bd-166e-476c-b488-9e36f9f644b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:14:25.373055 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b7c214bd-166e-476c-b488-9e36f9f644b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.123533 May 27 15:14:25.377863 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2024/4047] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:14:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 15:14:25.387900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c1457bd6-f8ee-45a6-9d66-2b4f0872c7f4 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:25.388538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c1457bd6-f8ee-45a6-9d66-2b4f0872c7f4 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:25.405756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1457bd6-f8ee-45a6-9d66-2b4f0872c7f4 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:25.406228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1457bd6-f8ee-45a6-9d66-2b4f0872c7f4 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:25.407038 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1457bd6-f8ee-45a6-9d66-2b4f0872c7f4 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:25.407487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1457bd6-f8ee-45a6-9d66-2b4f0872c7f4 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:25.492515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1fd8af14-43c9-41f7-b5af-aedb4f9f088e tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] Action: 'update', calling method: .version_select at 0x7fc7807b60d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:25.614763 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1fd8af14-43c9-41f7-b5af-aedb4f9f088e tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:25.615233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1fd8af14-43c9-41f7-b5af-aedb4f9f088e tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:25.616055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1fd8af14-43c9-41f7-b5af-aedb4f9f088e tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:25.616503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1fd8af14-43c9-41f7-b5af-aedb4f9f088e tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:25.725144 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1fd8af14-43c9-41f7-b5af-aedb4f9f088e tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/8bdddbff68124bb48b5eae767b3e7aae" status: 200 len: 148 microversion: 2.57 time: 0.475897 May 27 15:14:25.730640 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2024/4048] 10.222.0.13 () {62 vars in 1302 bytes} [Fri May 27 15:14:25 2022] PUT /compute/v2.1/os-quota-sets/8bdddbff68124bb48b5eae767b3e7aae => generated 148 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:14:25.735925 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9d48272a-4df9-457a-99f6-f6464e07faec tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:25.736945 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9d48272a-4df9-457a-99f6-f6464e07faec tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:25.748167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c1457bd6-f8ee-45a6-9d66-2b4f0872c7f4 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:25.756495 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c1457bd6-f8ee-45a6-9d66-2b4f0872c7f4 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1402 microversion: 2.1 time: 0.377475 May 27 15:14:25.757111 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2025/4049] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:25 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1402 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:25.770140 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c53c3dfb-766d-430c-afaf-e7389212d651 tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] Calling method '.version_select at 0x7fc7806bc550>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:25.852914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9d48272a-4df9-457a-99f6-f6464e07faec tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:25.862832 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9d48272a-4df9-457a-99f6-f6464e07faec tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2" status: 200 len: 1241 microversion: 2.1 time: 0.133307 May 27 15:14:25.886399 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2025/4050] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:25 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 => generated 1241 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:25.897511 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-889f4c33-4bd1-4746-aad2-1027009fd9c3 req-ece92be2-4e0a-49f0-af66-ffd1b263d14b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be660a8b-14e9-4236-ad83-c671d7d71c13", "name": "network-vif-plugged", "status": "completed", "tag": "3f02e49e-6281-45ea-b276-47de220cb62a"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:25.924196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-889f4c33-4bd1-4746-aad2-1027009fd9c3 req-ece92be2-4e0a-49f0-af66-ffd1b263d14b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:25.924879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-889f4c33-4bd1-4746-aad2-1027009fd9c3 req-ece92be2-4e0a-49f0-af66-ffd1b263d14b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:25.952600 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-889f4c33-4bd1-4746-aad2-1027009fd9c3 req-ece92be2-4e0a-49f0-af66-ffd1b263d14b service nova] Creating event network-vif-plugged:3f02e49e-6281-45ea-b276-47de220cb62a for instance be660a8b-14e9-4236-ad83-c671d7d71c13 on n-h2-843621-1 May 27 15:14:25.969608 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-889f4c33-4bd1-4746-aad2-1027009fd9c3 req-ece92be2-4e0a-49f0-af66-ffd1b263d14b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080149 May 27 15:14:25.971624 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2026/4051] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:26.140001 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c53c3dfb-766d-430c-afaf-e7389212d651 tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:26.140461 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c53c3dfb-766d-430c-afaf-e7389212d651 tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:26.141355 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c53c3dfb-766d-430c-afaf-e7389212d651 tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:26.141796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c53c3dfb-766d-430c-afaf-e7389212d651 tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:26.181470 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c53c3dfb-766d-430c-afaf-e7389212d651 tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/8bdddbff68124bb48b5eae767b3e7aae/detail" status: 200 len: 463 microversion: 2.57 time: 0.415841 May 27 15:14:26.182780 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2026/4052] 10.222.0.13 () {60 vars in 1303 bytes} [Fri May 27 15:14:25 2022] GET /compute/v2.1/os-quota-sets/8bdddbff68124bb48b5eae767b3e7aae/detail => generated 463 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:14:26.460562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-892bf169-fcac-4e6b-957e-d51d6dae4092 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e3a1808-b4f3-48b4-950e-0b2fbbd53210"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:26.461790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-892bf169-fcac-4e6b-957e-d51d6dae4092 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:26.480062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-892bf169-fcac-4e6b-957e-d51d6dae4092 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:26.482068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-892bf169-fcac-4e6b-957e-d51d6dae4092 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:26.485299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-892bf169-fcac-4e6b-957e-d51d6dae4092 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:26.486070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-892bf169-fcac-4e6b-957e-d51d6dae4092 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:26.558761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0746bd40-3c8c-4e8a-9893-ee439172d3bb tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] Action: 'update', calling method: .version_select at 0x7fc78067f280>, body: {"quota_set": {"ram": "2048"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:26.820784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0746bd40-3c8c-4e8a-9893-ee439172d3bb tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:26.821315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0746bd40-3c8c-4e8a-9893-ee439172d3bb tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:26.822063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0746bd40-3c8c-4e8a-9893-ee439172d3bb tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:26.825375 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0746bd40-3c8c-4e8a-9893-ee439172d3bb tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:26.862160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:26.889206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0746bd40-3c8c-4e8a-9893-ee439172d3bb tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:26.889735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0746bd40-3c8c-4e8a-9893-ee439172d3bb tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:26.892419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0746bd40-3c8c-4e8a-9893-ee439172d3bb tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:26.893030 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0746bd40-3c8c-4e8a-9893-ee439172d3bb tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:27.019304 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0746bd40-3c8c-4e8a-9893-ee439172d3bb tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-quota-sets/8bdddbff68124bb48b5eae767b3e7aae?user_id=2ac30dee886b4f788ce77931be2058c6" status: 200 len: 148 microversion: 2.57 time: 0.464828 May 27 15:14:27.022059 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2027/4053] 10.222.0.13 () {62 vars in 1383 bytes} [Fri May 27 15:14:26 2022] PUT /compute/v2.1/os-quota-sets/8bdddbff68124bb48b5eae767b3e7aae?user_id=2ac30dee886b4f788ce77931be2058c6 => generated 148 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:14:27.038525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2d9daa94-f072-4547-849a-05a2b99163a7 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:27.039457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2d9daa94-f072-4547-849a-05a2b99163a7 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:27.046160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2d9daa94-f072-4547-849a-05a2b99163a7 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:27.046999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2d9daa94-f072-4547-849a-05a2b99163a7 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:27.047990 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2d9daa94-f072-4547-849a-05a2b99163a7 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:27.048634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2d9daa94-f072-4547-849a-05a2b99163a7 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:27.055623 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-892bf169-fcac-4e6b-957e-d51d6dae4092 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "POST /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.594038 May 27 15:14:27.059765 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2027/4054] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 15:14:26 2022] POST /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 194 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:27.074367 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fb69c485-5794-460f-ae01-002fc76d6382 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:27.076705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fb69c485-5794-460f-ae01-002fc76d6382 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:27.115871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb69c485-5794-460f-ae01-002fc76d6382 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:27.120120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb69c485-5794-460f-ae01-002fc76d6382 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:27.123700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb69c485-5794-460f-ae01-002fc76d6382 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:27.124174 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb69c485-5794-460f-ae01-002fc76d6382 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:27.329939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fb69c485-5794-460f-ae01-002fc76d6382 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:27.344019 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fb69c485-5794-460f-ae01-002fc76d6382 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2" status: 200 len: 1311 microversion: 2.1 time: 0.282043 May 27 15:14:27.345565 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2028/4055] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:27 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 => generated 1311 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:27.353606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e8197ab5-393b-4081-9b64-9faee233b717 tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] Calling method '.version_select at 0x7fc7767b4d30>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:27.588125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2d9daa94-f072-4547-849a-05a2b99163a7 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:27.601193 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2d9daa94-f072-4547-849a-05a2b99163a7 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1402 microversion: 2.1 time: 0.570727 May 27 15:14:27.602030 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2028/4056] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:27 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1402 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:27.897746 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e8197ab5-393b-4081-9b64-9faee233b717 tempest-QuotasAdminTestV257-1209327065 tempest-QuotasAdminTestV257-1209327065-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/8bdddbff68124bb48b5eae767b3e7aae?user_id=2ac30dee886b4f788ce77931be2058c6" status: 200 len: 190 microversion: 2.57 time: 0.550168 May 27 15:14:27.899171 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2029/4057] 10.222.0.13 () {60 vars in 1363 bytes} [Fri May 27 15:14:27 2022] GET /compute/v2.1/os-quota-sets/8bdddbff68124bb48b5eae767b3e7aae?user_id=2ac30dee886b4f788ce77931be2058c6 => generated 190 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:14:28.376148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0d32d2c0-d5d2-4f76-9825-667090b78c06 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:28.376879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0d32d2c0-d5d2-4f76-9825-667090b78c06 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:28.387381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0d32d2c0-d5d2-4f76-9825-667090b78c06 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:28.387844 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0d32d2c0-d5d2-4f76-9825-667090b78c06 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:28.391620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0d32d2c0-d5d2-4f76-9825-667090b78c06 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:28.392178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0d32d2c0-d5d2-4f76-9825-667090b78c06 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:28.620426 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ac4f1c87-0470-4f2c-86e4-ae29e3f2b56f tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:28.622264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ac4f1c87-0470-4f2c-86e4-ae29e3f2b56f tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:28.638433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac4f1c87-0470-4f2c-86e4-ae29e3f2b56f tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:28.641104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac4f1c87-0470-4f2c-86e4-ae29e3f2b56f tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:28.642848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac4f1c87-0470-4f2c-86e4-ae29e3f2b56f tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:28.646900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac4f1c87-0470-4f2c-86e4-ae29e3f2b56f tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:28.788295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0d32d2c0-d5d2-4f76-9825-667090b78c06 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:28.804046 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0d32d2c0-d5d2-4f76-9825-667090b78c06 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2" status: 200 len: 1367 microversion: 2.1 time: 0.434983 May 27 15:14:28.804959 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2029/4058] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:28 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 => generated 1367 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:28.923957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ac4f1c87-0470-4f2c-86e4-ae29e3f2b56f tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:28.935973 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ac4f1c87-0470-4f2c-86e4-ae29e3f2b56f tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1590 microversion: 2.1 time: 0.319782 May 27 15:14:28.941012 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2030/4059] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:28 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1590 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:28.959501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e030d45b-b573-42db-a7ec-d12b75327226 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:28.960029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e030d45b-b573-42db-a7ec-d12b75327226 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:28.970778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e030d45b-b573-42db-a7ec-d12b75327226 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:28.971448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e030d45b-b573-42db-a7ec-d12b75327226 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:28.972564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e030d45b-b573-42db-a7ec-d12b75327226 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:28.973225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e030d45b-b573-42db-a7ec-d12b75327226 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:29.452766 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e030d45b-b573-42db-a7ec-d12b75327226 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.499524 May 27 15:14:29.460406 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2030/4060] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 15:14:28 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13/os-interface => generated 285 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:29.821181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eb1343a7-d879-42b6-99f9-49e83ab787e7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:29.821803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-eb1343a7-d879-42b6-99f9-49e83ab787e7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:29.834815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb1343a7-d879-42b6-99f9-49e83ab787e7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:29.835608 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb1343a7-d879-42b6-99f9-49e83ab787e7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:29.841992 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb1343a7-d879-42b6-99f9-49e83ab787e7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:29.842523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb1343a7-d879-42b6-99f9-49e83ab787e7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:30.670050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-fdc156c8-de25-470a-946a-4ed0cac7b7d7 req-f58d3a8e-0444-4009-a869-74fc4be17f1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37f90068-386b-4593-a1b7-a5e2232395b2", "tag": "d7a1cbf6-dfcf-4666-9602-d832d9cba47b"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:30.686738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-fdc156c8-de25-470a-946a-4ed0cac7b7d7 req-f58d3a8e-0444-4009-a869-74fc4be17f1e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:30.687598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-fdc156c8-de25-470a-946a-4ed0cac7b7d7 req-f58d3a8e-0444-4009-a869-74fc4be17f1e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:30.695674 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:30.710537 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-fdc156c8-de25-470a-946a-4ed0cac7b7d7 req-f58d3a8e-0444-4009-a869-74fc4be17f1e service nova] Creating event network-changed:d7a1cbf6-dfcf-4666-9602-d832d9cba47b for instance 37f90068-386b-4593-a1b7-a5e2232395b2 on n-h1-843621-1 May 27 15:14:30.717625 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-fdc156c8-de25-470a-946a-4ed0cac7b7d7 req-f58d3a8e-0444-4009-a869-74fc4be17f1e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051380 May 27 15:14:30.718638 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2031/4061] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:14:30.751299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eb1343a7-d879-42b6-99f9-49e83ab787e7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:30.762889 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-eb1343a7-d879-42b6-99f9-49e83ab787e7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2" status: 200 len: 1367 microversion: 2.1 time: 0.945485 May 27 15:14:30.767991 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2031/4062] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:29 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 => generated 1367 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:31.745538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d50fe27b-b8be-4099-8ffc-d43d84110183 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:31.746710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d50fe27b-b8be-4099-8ffc-d43d84110183 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:31.764936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d50fe27b-b8be-4099-8ffc-d43d84110183 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:31.768917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d50fe27b-b8be-4099-8ffc-d43d84110183 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:31.774028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d50fe27b-b8be-4099-8ffc-d43d84110183 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:31.774508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d50fe27b-b8be-4099-8ffc-d43d84110183 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:31.789374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0f1a634e-6a35-450a-841f-0cc1462ed40c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:31.791085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0f1a634e-6a35-450a-841f-0cc1462ed40c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:31.818555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:31.828283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f1a634e-6a35-450a-841f-0cc1462ed40c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:31.830769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f1a634e-6a35-450a-841f-0cc1462ed40c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:31.834733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f1a634e-6a35-450a-841f-0cc1462ed40c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:31.837880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f1a634e-6a35-450a-841f-0cc1462ed40c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:32.328046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d50fe27b-b8be-4099-8ffc-d43d84110183 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:32.342994 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d50fe27b-b8be-4099-8ffc-d43d84110183 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1590 microversion: 2.1 time: 0.603923 May 27 15:14:32.346516 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2032/4063] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:31 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1590 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:32.365192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0f1a634e-6a35-450a-841f-0cc1462ed40c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:32.380328 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0f1a634e-6a35-450a-841f-0cc1462ed40c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2" status: 200 len: 1367 microversion: 2.1 time: 0.594191 May 27 15:14:32.381675 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2032/4064] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:31 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 => generated 1367 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:32.898863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-65851bb8-c020-4b1d-a544-49ca36535e86 req-4a606614-962f-4605-afad-886a91fe7dff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be660a8b-14e9-4236-ad83-c671d7d71c13", "tag": "3f02e49e-6281-45ea-b276-47de220cb62a"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:32.926346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-65851bb8-c020-4b1d-a544-49ca36535e86 req-4a606614-962f-4605-afad-886a91fe7dff service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:32.927455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-65851bb8-c020-4b1d-a544-49ca36535e86 req-4a606614-962f-4605-afad-886a91fe7dff service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:32.971330 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-65851bb8-c020-4b1d-a544-49ca36535e86 req-4a606614-962f-4605-afad-886a91fe7dff service nova] Creating event network-changed:3f02e49e-6281-45ea-b276-47de220cb62a for instance be660a8b-14e9-4236-ad83-c671d7d71c13 on n-h2-843621-1 May 27 15:14:32.983077 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-65851bb8-c020-4b1d-a544-49ca36535e86 req-4a606614-962f-4605-afad-886a91fe7dff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088089 May 27 15:14:32.992894 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2033/4065] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:33.434757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-887db60a-51b5-4c64-9e53-998504dfc878 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:33.437321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-887db60a-51b5-4c64-9e53-998504dfc878 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:33.469651 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-887db60a-51b5-4c64-9e53-998504dfc878 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:33.470912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-887db60a-51b5-4c64-9e53-998504dfc878 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:33.472719 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-887db60a-51b5-4c64-9e53-998504dfc878 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:33.473871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-887db60a-51b5-4c64-9e53-998504dfc878 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:33.957159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-887db60a-51b5-4c64-9e53-998504dfc878 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:33.970848 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-887db60a-51b5-4c64-9e53-998504dfc878 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2" status: 200 len: 1367 microversion: 2.1 time: 0.567243 May 27 15:14:33.973096 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2033/4066] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:33 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 => generated 1367 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:34.991378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6372da6e-12b0-418a-aea0-5e989d0471f9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:34.992100 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6372da6e-12b0-418a-aea0-5e989d0471f9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:35.013511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6372da6e-12b0-418a-aea0-5e989d0471f9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:35.013985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6372da6e-12b0-418a-aea0-5e989d0471f9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:35.014783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6372da6e-12b0-418a-aea0-5e989d0471f9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:35.015232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6372da6e-12b0-418a-aea0-5e989d0471f9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:35.612649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6372da6e-12b0-418a-aea0-5e989d0471f9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:35.623916 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6372da6e-12b0-418a-aea0-5e989d0471f9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2" status: 200 len: 1367 microversion: 2.1 time: 0.638193 May 27 15:14:35.625593 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2034/4067] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:34 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 => generated 1367 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:36.217791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:36.480864 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c1968a1a-010d-470b-81dc-2ae3e997a487 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1091082809", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:36.590393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-c1968a1a-010d-470b-81dc-2ae3e997a487 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] validate_networks() for None {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:14:36.643157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a74a2260-c2fa-48d8-899a-bd4eeb977900 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:36.644031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a74a2260-c2fa-48d8-899a-bd4eeb977900 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:36.662893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a74a2260-c2fa-48d8-899a-bd4eeb977900 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:36.663602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a74a2260-c2fa-48d8-899a-bd4eeb977900 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:36.664925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a74a2260-c2fa-48d8-899a-bd4eeb977900 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:36.665701 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a74a2260-c2fa-48d8-899a-bd4eeb977900 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:36.910940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=9 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:36.989793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=24 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:37.001645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a74a2260-c2fa-48d8-899a-bd4eeb977900 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:37.020003 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a74a2260-c2fa-48d8-899a-bd4eeb977900 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2" status: 200 len: 1367 microversion: 2.1 time: 0.381093 May 27 15:14:37.020610 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2035/4068] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:36 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 => generated 1367 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:37.082610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-c1968a1a-010d-470b-81dc-2ae3e997a487 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:14:37.083046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-c1968a1a-010d-470b-81dc-2ae3e997a487 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:14:37.083514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-c1968a1a-010d-470b-81dc-2ae3e997a487 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:14:37.084128 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-c1968a1a-010d-470b-81dc-2ae3e997a487 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:14:37.084742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-c1968a1a-010d-470b-81dc-2ae3e997a487 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:14:37.100423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c1968a1a-010d-470b-81dc-2ae3e997a487 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:37.101794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c1968a1a-010d-470b-81dc-2ae3e997a487 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:37.104768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c1968a1a-010d-470b-81dc-2ae3e997a487 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:37.105425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c1968a1a-010d-470b-81dc-2ae3e997a487 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:37.172643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-c1968a1a-010d-470b-81dc-2ae3e997a487 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Getting quotas for project f1946861ca5a407f9b6ea2624fca1c80. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:14:37.184959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-c1968a1a-010d-470b-81dc-2ae3e997a487 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Getting quotas for user 3d79c875c4f04c3caaef620c4ea4b7a1 and project f1946861ca5a407f9b6ea2624fca1c80. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:14:37.229631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c1968a1a-010d-470b-81dc-2ae3e997a487 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:14:37.235226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c1968a1a-010d-470b-81dc-2ae3e997a487 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:14:37.319328 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c1968a1a-010d-470b-81dc-2ae3e997a487 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.113856 May 27 15:14:37.335170 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2034/4069] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:14:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:14:37.420432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fb0ee1c0-d80c-4dff-9f16-760bcbfbda71 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2120332838", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:37.525331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-fb0ee1c0-d80c-4dff-9f16-760bcbfbda71 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] validate_networks() for None {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:14:38.038866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6925dbba-c528-4b9f-9dd6-cdaca8f0f2c8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:38.039508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6925dbba-c528-4b9f-9dd6-cdaca8f0f2c8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:38.048257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6925dbba-c528-4b9f-9dd6-cdaca8f0f2c8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:38.048755 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6925dbba-c528-4b9f-9dd6-cdaca8f0f2c8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:38.058192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6925dbba-c528-4b9f-9dd6-cdaca8f0f2c8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:38.058914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6925dbba-c528-4b9f-9dd6-cdaca8f0f2c8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:38.122486 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-fb0ee1c0-d80c-4dff-9f16-760bcbfbda71 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:14:38.123034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-fb0ee1c0-d80c-4dff-9f16-760bcbfbda71 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:14:38.123677 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-fb0ee1c0-d80c-4dff-9f16-760bcbfbda71 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:14:38.124205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-fb0ee1c0-d80c-4dff-9f16-760bcbfbda71 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:14:38.125024 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-fb0ee1c0-d80c-4dff-9f16-760bcbfbda71 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:14:38.147738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb0ee1c0-d80c-4dff-9f16-760bcbfbda71 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:38.149712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb0ee1c0-d80c-4dff-9f16-760bcbfbda71 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:38.152720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb0ee1c0-d80c-4dff-9f16-760bcbfbda71 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:38.153371 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb0ee1c0-d80c-4dff-9f16-760bcbfbda71 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:38.211715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-fb0ee1c0-d80c-4dff-9f16-760bcbfbda71 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Getting quotas for project f1946861ca5a407f9b6ea2624fca1c80. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:14:38.235101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-fb0ee1c0-d80c-4dff-9f16-760bcbfbda71 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Getting quotas for user 3d79c875c4f04c3caaef620c4ea4b7a1 and project f1946861ca5a407f9b6ea2624fca1c80. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:14:38.288290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fb0ee1c0-d80c-4dff-9f16-760bcbfbda71 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:14:38.291989 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fb0ee1c0-d80c-4dff-9f16-760bcbfbda71 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:14:38.397766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6925dbba-c528-4b9f-9dd6-cdaca8f0f2c8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:38.410351 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6925dbba-c528-4b9f-9dd6-cdaca8f0f2c8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2" status: 200 len: 1367 microversion: 2.1 time: 0.373801 May 27 15:14:38.412540 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2035/4070] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:38 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 => generated 1367 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:38.419014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-409b96c1-385e-4e93-ad1b-8e361615b498 req-a7e499dc-e9ff-4177-a16a-898c3ac469dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37f90068-386b-4593-a1b7-a5e2232395b2", "name": "network-vif-plugged", "status": "completed", "tag": "d7a1cbf6-dfcf-4666-9602-d832d9cba47b"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:38.445937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-409b96c1-385e-4e93-ad1b-8e361615b498 req-a7e499dc-e9ff-4177-a16a-898c3ac469dd service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:38.447740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-409b96c1-385e-4e93-ad1b-8e361615b498 req-a7e499dc-e9ff-4177-a16a-898c3ac469dd service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:38.476883 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fb0ee1c0-d80c-4dff-9f16-760bcbfbda71 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.060278 May 27 15:14:38.481244 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-409b96c1-385e-4e93-ad1b-8e361615b498 req-a7e499dc-e9ff-4177-a16a-898c3ac469dd service nova] Creating event network-vif-plugged:d7a1cbf6-dfcf-4666-9602-d832d9cba47b for instance 37f90068-386b-4593-a1b7-a5e2232395b2 on n-h1-843621-1 May 27 15:14:38.481481 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2036/4071] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:14:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:14:38.491479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-622b508a-6285-44bc-b8ce-db0f0d310275 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:38.494979 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-409b96c1-385e-4e93-ad1b-8e361615b498 req-a7e499dc-e9ff-4177-a16a-898c3ac469dd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079607 May 27 15:14:38.496366 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2036/4072] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:38.501496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-622b508a-6285-44bc-b8ce-db0f0d310275 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:38.664565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-622b508a-6285-44bc-b8ce-db0f0d310275 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:38.697785 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-622b508a-6285-44bc-b8ce-db0f0d310275 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c" status: 200 len: 1214 microversion: 2.1 time: 0.211314 May 27 15:14:38.698523 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2037/4073] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:38 2022] GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c => generated 1214 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:39.432414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a68ceee9-75f7-426b-ac1b-bd858b6fc79f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:39.433314 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a68ceee9-75f7-426b-ac1b-bd858b6fc79f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:39.460009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a68ceee9-75f7-426b-ac1b-bd858b6fc79f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:39.462235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a68ceee9-75f7-426b-ac1b-bd858b6fc79f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:39.463101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a68ceee9-75f7-426b-ac1b-bd858b6fc79f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:39.473932 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a68ceee9-75f7-426b-ac1b-bd858b6fc79f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:39.686862 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a68ceee9-75f7-426b-ac1b-bd858b6fc79f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:39.706236 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a68ceee9-75f7-426b-ac1b-bd858b6fc79f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2" status: 200 len: 1367 microversion: 2.1 time: 0.281940 May 27 15:14:39.707685 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2037/4074] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:39 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:39.715414 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9b92a355-73b2-4e2a-abd8-deaa6d55daba tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:39.716110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9b92a355-73b2-4e2a-abd8-deaa6d55daba tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:39.725671 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b92a355-73b2-4e2a-abd8-deaa6d55daba tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:39.726133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b92a355-73b2-4e2a-abd8-deaa6d55daba tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:39.726931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b92a355-73b2-4e2a-abd8-deaa6d55daba tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:39.727382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b92a355-73b2-4e2a-abd8-deaa6d55daba tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:39.859657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9b92a355-73b2-4e2a-abd8-deaa6d55daba tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:39.872596 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9b92a355-73b2-4e2a-abd8-deaa6d55daba tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c" status: 200 len: 1266 microversion: 2.1 time: 0.161795 May 27 15:14:39.873624 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2038/4075] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:39 2022] GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:40.727711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3cf1f553-0d14-4f6a-8834-174d71614b1e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:40.728460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3cf1f553-0d14-4f6a-8834-174d71614b1e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:40.756656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3cf1f553-0d14-4f6a-8834-174d71614b1e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:40.757158 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3cf1f553-0d14-4f6a-8834-174d71614b1e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:40.757973 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3cf1f553-0d14-4f6a-8834-174d71614b1e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:40.759760 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3cf1f553-0d14-4f6a-8834-174d71614b1e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:40.889751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a641fd09-2b61-4ed0-8fc9-9107c9a60372 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:40.890616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a641fd09-2b61-4ed0-8fc9-9107c9a60372 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:40.899007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a641fd09-2b61-4ed0-8fc9-9107c9a60372 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:40.901902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a641fd09-2b61-4ed0-8fc9-9107c9a60372 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:40.904928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a641fd09-2b61-4ed0-8fc9-9107c9a60372 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:40.905797 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a641fd09-2b61-4ed0-8fc9-9107c9a60372 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:40.932196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3cf1f553-0d14-4f6a-8834-174d71614b1e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:40.944639 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3cf1f553-0d14-4f6a-8834-174d71614b1e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2" status: 200 len: 1557 microversion: 2.1 time: 0.223735 May 27 15:14:40.952149 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2038/4076] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:40 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 => generated 1557 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:40.970235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b4ad2f42-ffad-43bc-b780-ad0da2a987ef tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:40.970761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b4ad2f42-ffad-43bc-b780-ad0da2a987ef tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:40.989055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4ad2f42-ffad-43bc-b780-ad0da2a987ef tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:40.990003 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4ad2f42-ffad-43bc-b780-ad0da2a987ef tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:40.991592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4ad2f42-ffad-43bc-b780-ad0da2a987ef tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:40.992590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4ad2f42-ffad-43bc-b780-ad0da2a987ef tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:40.997634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a641fd09-2b61-4ed0-8fc9-9107c9a60372 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:41.006274 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a641fd09-2b61-4ed0-8fc9-9107c9a60372 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c" status: 200 len: 1272 microversion: 2.1 time: 0.120260 May 27 15:14:41.017508 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2039/4077] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:40 2022] GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c => generated 1272 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:41.082318 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b4ad2f42-ffad-43bc-b780-ad0da2a987ef tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117903 May 27 15:14:41.083189 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2039/4078] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 15:14:40 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:42.026687 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1a366366-4952-4494-bfd9-6b53453b9034 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:42.027331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1a366366-4952-4494-bfd9-6b53453b9034 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:42.043015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a366366-4952-4494-bfd9-6b53453b9034 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:42.043482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a366366-4952-4494-bfd9-6b53453b9034 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:42.044275 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a366366-4952-4494-bfd9-6b53453b9034 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:42.049904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a366366-4952-4494-bfd9-6b53453b9034 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:42.756213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1a366366-4952-4494-bfd9-6b53453b9034 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:42.770252 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1a366366-4952-4494-bfd9-6b53453b9034 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c" status: 200 len: 1314 microversion: 2.1 time: 0.746768 May 27 15:14:42.775929 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2040/4079] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:42 2022] GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c => generated 1314 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:43.737646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-d15179c4-a1b6-4162-b7ad-d0ade99a0606 req-ee4e32db-6a08-4e6f-81f7-d2d9ff3cbed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37f90068-386b-4593-a1b7-a5e2232395b2", "tag": "d7a1cbf6-dfcf-4666-9602-d832d9cba47b"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:43.765210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d15179c4-a1b6-4162-b7ad-d0ade99a0606 req-ee4e32db-6a08-4e6f-81f7-d2d9ff3cbed6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:43.767111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d15179c4-a1b6-4162-b7ad-d0ade99a0606 req-ee4e32db-6a08-4e6f-81f7-d2d9ff3cbed6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:43.794723 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-d15179c4-a1b6-4162-b7ad-d0ade99a0606 req-ee4e32db-6a08-4e6f-81f7-d2d9ff3cbed6 service nova] Creating event network-changed:d7a1cbf6-dfcf-4666-9602-d832d9cba47b for instance 37f90068-386b-4593-a1b7-a5e2232395b2 on n-h1-843621-1 May 27 15:14:43.795732 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f688d62a-7962-45d6-aec1-5509dc336f97 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:43.796379 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f688d62a-7962-45d6-aec1-5509dc336f97 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:43.814595 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-d15179c4-a1b6-4162-b7ad-d0ade99a0606 req-ee4e32db-6a08-4e6f-81f7-d2d9ff3cbed6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085118 May 27 15:14:43.819111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f688d62a-7962-45d6-aec1-5509dc336f97 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:43.820743 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f688d62a-7962-45d6-aec1-5509dc336f97 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:43.824218 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2040/4080] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:43.825003 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f688d62a-7962-45d6-aec1-5509dc336f97 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:43.826375 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f688d62a-7962-45d6-aec1-5509dc336f97 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:44.065331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f688d62a-7962-45d6-aec1-5509dc336f97 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:44.079592 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f688d62a-7962-45d6-aec1-5509dc336f97 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c" status: 200 len: 1314 microversion: 2.1 time: 0.287915 May 27 15:14:44.090197 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2041/4081] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:43 2022] GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:45.100481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-00f84620-9df0-491e-959b-dd6b331a733c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:45.102892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-00f84620-9df0-491e-959b-dd6b331a733c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:45.117639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-00f84620-9df0-491e-959b-dd6b331a733c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:45.118456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-00f84620-9df0-491e-959b-dd6b331a733c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:45.121306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-00f84620-9df0-491e-959b-dd6b331a733c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:45.126143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-00f84620-9df0-491e-959b-dd6b331a733c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:45.389854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-00f84620-9df0-491e-959b-dd6b331a733c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:45.407897 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-00f84620-9df0-491e-959b-dd6b331a733c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c" status: 200 len: 1314 microversion: 2.1 time: 0.312685 May 27 15:14:45.408694 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2041/4082] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:45 2022] GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:46.425051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-98a89af2-6d2f-4bc1-94ac-bcc3283983ec tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:46.426527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-98a89af2-6d2f-4bc1-94ac-bcc3283983ec tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:46.434252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98a89af2-6d2f-4bc1-94ac-bcc3283983ec tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:46.435051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98a89af2-6d2f-4bc1-94ac-bcc3283983ec tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:46.435926 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98a89af2-6d2f-4bc1-94ac-bcc3283983ec tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:46.436457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98a89af2-6d2f-4bc1-94ac-bcc3283983ec tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:46.602222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-98a89af2-6d2f-4bc1-94ac-bcc3283983ec tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:46.611737 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-98a89af2-6d2f-4bc1-94ac-bcc3283983ec tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c" status: 200 len: 1314 microversion: 2.1 time: 0.190665 May 27 15:14:46.613202 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2042/4083] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:46 2022] GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:46.829779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-61379138-1674-4dae-b21c-8cb73503f2f1 req-76363043-a693-4fd9-b7ce-cbe56aa07d6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eea408d-b686-46e2-8b8e-cdb192bfb37c", "tag": "0b10cb3b-9d88-4747-9685-8d02404d4d66"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:46.842554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-61379138-1674-4dae-b21c-8cb73503f2f1 req-76363043-a693-4fd9-b7ce-cbe56aa07d6b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:46.843592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-61379138-1674-4dae-b21c-8cb73503f2f1 req-76363043-a693-4fd9-b7ce-cbe56aa07d6b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:46.872059 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-61379138-1674-4dae-b21c-8cb73503f2f1 req-76363043-a693-4fd9-b7ce-cbe56aa07d6b service nova] Creating event network-changed:0b10cb3b-9d88-4747-9685-8d02404d4d66 for instance 6eea408d-b686-46e2-8b8e-cdb192bfb37c on n-h2-843621-1 May 27 15:14:46.879818 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-61379138-1674-4dae-b21c-8cb73503f2f1 req-76363043-a693-4fd9-b7ce-cbe56aa07d6b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056772 May 27 15:14:46.881241 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2042/4084] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:47.629403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-62281b35-a660-41c9-b319-0ce97ac587f1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:47.630266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-62281b35-a660-41c9-b319-0ce97ac587f1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:47.638576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-62281b35-a660-41c9-b319-0ce97ac587f1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:47.639750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-62281b35-a660-41c9-b319-0ce97ac587f1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:47.639876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-62281b35-a660-41c9-b319-0ce97ac587f1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:47.640287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-62281b35-a660-41c9-b319-0ce97ac587f1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:47.807713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-62281b35-a660-41c9-b319-0ce97ac587f1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:47.816765 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-62281b35-a660-41c9-b319-0ce97ac587f1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c" status: 200 len: 1314 microversion: 2.1 time: 0.190849 May 27 15:14:47.817880 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2043/4085] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:47 2022] GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:48.836341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7ec7d855-46dc-4614-95fb-4a4bc9626f02 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:48.837366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7ec7d855-46dc-4614-95fb-4a4bc9626f02 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:48.839396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:48.840152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=20 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:48.848773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7ec7d855-46dc-4614-95fb-4a4bc9626f02 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:48.849870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7ec7d855-46dc-4614-95fb-4a4bc9626f02 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:48.850766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7ec7d855-46dc-4614-95fb-4a4bc9626f02 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:48.851953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7ec7d855-46dc-4614-95fb-4a4bc9626f02 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:48.905338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-984ed10a-955e-4be0-b963-ff0bf8bde5f4 req-03f53c47-c72f-420e-9718-ca46d12abb48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38fbe9fb-a213-462c-a8af-ad601edd4928", "tag": "2c770865-695e-4c59-acf2-cd06a2ac073c"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:48.909798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:48.912434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=8 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:48.919918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-984ed10a-955e-4be0-b963-ff0bf8bde5f4 req-03f53c47-c72f-420e-9718-ca46d12abb48 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:48.920488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-984ed10a-955e-4be0-b963-ff0bf8bde5f4 req-03f53c47-c72f-420e-9718-ca46d12abb48 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:48.932619 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-984ed10a-955e-4be0-b963-ff0bf8bde5f4 req-03f53c47-c72f-420e-9718-ca46d12abb48 service nova] Creating event network-changed:2c770865-695e-4c59-acf2-cd06a2ac073c for instance 38fbe9fb-a213-462c-a8af-ad601edd4928 on n-h2-843621-1 May 27 15:14:48.938637 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-984ed10a-955e-4be0-b963-ff0bf8bde5f4 req-03f53c47-c72f-420e-9718-ca46d12abb48 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036977 May 27 15:14:48.939310 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2044/4086] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:49.100565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7ec7d855-46dc-4614-95fb-4a4bc9626f02 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:49.109792 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7ec7d855-46dc-4614-95fb-4a4bc9626f02 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c" status: 200 len: 1314 microversion: 2.1 time: 0.278223 May 27 15:14:49.120479 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2043/4087] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:48 2022] GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:49.731785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5888da68-7a3c-404e-abfd-0c2dd791a001 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:49.732884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5888da68-7a3c-404e-abfd-0c2dd791a001 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:49.741769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5888da68-7a3c-404e-abfd-0c2dd791a001 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:49.742263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5888da68-7a3c-404e-abfd-0c2dd791a001 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:49.743036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5888da68-7a3c-404e-abfd-0c2dd791a001 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:49.743494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5888da68-7a3c-404e-abfd-0c2dd791a001 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:49.770263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-5888da68-7a3c-404e-abfd-0c2dd791a001 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lazy-loading 'flavor' on Instance uuid ae7e4fc8-75b6-4e3f-9fca-7e5920957283 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:14:49.949031 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5888da68-7a3c-404e-abfd-0c2dd791a001 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "POST /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/action" status: 200 len: 32 microversion: 2.1 time: 0.222696 May 27 15:14:49.951251 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2045/4088] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:14:49 2022] POST /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/action => generated 32 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:14:49.963492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5b39b79d-6229-429a-99b4-2402a04fe59b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:49.964581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5b39b79d-6229-429a-99b4-2402a04fe59b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:49.978391 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5b39b79d-6229-429a-99b4-2402a04fe59b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:49.979299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5b39b79d-6229-429a-99b4-2402a04fe59b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:49.980755 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5b39b79d-6229-429a-99b4-2402a04fe59b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:49.981527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5b39b79d-6229-429a-99b4-2402a04fe59b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:50.164301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2437b893-559e-436e-b20f-05f30f756c7a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1726795172 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1726795172-project-admin] Calling method '.version_select at 0x7fc776f240d0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:50.166978 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:14:50.166978 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 15:14:50.169079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2437b893-559e-436e-b20f-05f30f756c7a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1726795172 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1726795172-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:50.169642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2437b893-559e-436e-b20f-05f30f756c7a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1726795172 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1726795172-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:50.190090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2437b893-559e-436e-b20f-05f30f756c7a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1726795172 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1726795172-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:50.190972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2437b893-559e-436e-b20f-05f30f756c7a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1726795172 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1726795172-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:50.203135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2437b893-559e-436e-b20f-05f30f756c7a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1726795172 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1726795172-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:50.204013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2437b893-559e-436e-b20f-05f30f756c7a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1726795172 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1726795172-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:50.212040 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2437b893-559e-436e-b20f-05f30f756c7a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1726795172 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1726795172-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.212344 May 27 15:14:50.213427 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2046/4089] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 15:14:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:50.228029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7bd0a554-a4eb-41c8-a11e-6bf61b2fd5eb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:50.228283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5b39b79d-6229-429a-99b4-2402a04fe59b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:50.230455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7bd0a554-a4eb-41c8-a11e-6bf61b2fd5eb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:50.232961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:50.242869 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5b39b79d-6229-429a-99b4-2402a04fe59b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1736 microversion: 2.1 time: 0.285481 May 27 15:14:50.245318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7bd0a554-a4eb-41c8-a11e-6bf61b2fd5eb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:50.245815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7bd0a554-a4eb-41c8-a11e-6bf61b2fd5eb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:50.246966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7bd0a554-a4eb-41c8-a11e-6bf61b2fd5eb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:50.247351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7bd0a554-a4eb-41c8-a11e-6bf61b2fd5eb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:50.248622 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2044/4090] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:49 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1736 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:50.548563 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7bd0a554-a4eb-41c8-a11e-6bf61b2fd5eb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:50.558849 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7bd0a554-a4eb-41c8-a11e-6bf61b2fd5eb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c" status: 200 len: 1314 microversion: 2.1 time: 0.343992 May 27 15:14:50.559590 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2047/4091] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:50 2022] GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:51.273384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2302e6b8-b67f-4a28-a488-e81b09446bf5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:51.274713 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2302e6b8-b67f-4a28-a488-e81b09446bf5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:51.290655 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2302e6b8-b67f-4a28-a488-e81b09446bf5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:51.291885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2302e6b8-b67f-4a28-a488-e81b09446bf5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:51.293348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2302e6b8-b67f-4a28-a488-e81b09446bf5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:51.294289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2302e6b8-b67f-4a28-a488-e81b09446bf5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:51.579987 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5849831b-03b2-407a-8c1e-8462772d49ba tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:51.581284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5849831b-03b2-407a-8c1e-8462772d49ba tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:51.590448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5849831b-03b2-407a-8c1e-8462772d49ba tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:51.591484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5849831b-03b2-407a-8c1e-8462772d49ba tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:51.593359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5849831b-03b2-407a-8c1e-8462772d49ba tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:51.594019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5849831b-03b2-407a-8c1e-8462772d49ba tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:51.605572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2302e6b8-b67f-4a28-a488-e81b09446bf5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:51.619989 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2302e6b8-b67f-4a28-a488-e81b09446bf5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1736 microversion: 2.1 time: 0.354349 May 27 15:14:51.621815 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2045/4092] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:51 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1736 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:51.922449 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5849831b-03b2-407a-8c1e-8462772d49ba tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:51.941404 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5849831b-03b2-407a-8c1e-8462772d49ba tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c" status: 200 len: 1314 microversion: 2.1 time: 0.365425 May 27 15:14:51.942863 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2048/4093] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:51 2022] GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:52.639319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e4d2dcc3-64d1-4246-a1d6-ed603a385af3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:52.640633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e4d2dcc3-64d1-4246-a1d6-ed603a385af3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:52.647649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4d2dcc3-64d1-4246-a1d6-ed603a385af3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:52.648201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4d2dcc3-64d1-4246-a1d6-ed603a385af3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:52.649299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4d2dcc3-64d1-4246-a1d6-ed603a385af3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:52.649865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4d2dcc3-64d1-4246-a1d6-ed603a385af3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:52.868232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e4d2dcc3-64d1-4246-a1d6-ed603a385af3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:52.877725 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e4d2dcc3-64d1-4246-a1d6-ed603a385af3 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1736 microversion: 2.1 time: 0.242264 May 27 15:14:52.880970 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2046/4094] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:52 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1736 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:52.960505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d655dc73-0bee-4581-b017-01a90516eda1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:52.962060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d655dc73-0bee-4581-b017-01a90516eda1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:52.971182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d655dc73-0bee-4581-b017-01a90516eda1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:52.971502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d655dc73-0bee-4581-b017-01a90516eda1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:52.972942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d655dc73-0bee-4581-b017-01a90516eda1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:52.973505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d655dc73-0bee-4581-b017-01a90516eda1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:52.991437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:53.259043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d655dc73-0bee-4581-b017-01a90516eda1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:53.272692 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d655dc73-0bee-4581-b017-01a90516eda1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c" status: 200 len: 1314 microversion: 2.1 time: 0.315022 May 27 15:14:53.282720 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2049/4095] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:52 2022] GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:53.825660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-dfa9b85b-338f-49fe-b904-cd0a9d3d014d req-7ca9477a-2dc3-4e5b-a84c-ba43c5c88330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eea408d-b686-46e2-8b8e-cdb192bfb37c", "name": "network-vif-plugged", "status": "completed", "tag": "0b10cb3b-9d88-4747-9685-8d02404d4d66"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:53.837027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-dfa9b85b-338f-49fe-b904-cd0a9d3d014d req-7ca9477a-2dc3-4e5b-a84c-ba43c5c88330 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:53.837788 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-dfa9b85b-338f-49fe-b904-cd0a9d3d014d req-7ca9477a-2dc3-4e5b-a84c-ba43c5c88330 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:53.854912 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-dfa9b85b-338f-49fe-b904-cd0a9d3d014d req-7ca9477a-2dc3-4e5b-a84c-ba43c5c88330 service nova] Creating event network-vif-plugged:0b10cb3b-9d88-4747-9685-8d02404d4d66 for instance 6eea408d-b686-46e2-8b8e-cdb192bfb37c on n-h2-843621-1 May 27 15:14:53.863491 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-dfa9b85b-338f-49fe-b904-cd0a9d3d014d req-7ca9477a-2dc3-4e5b-a84c-ba43c5c88330 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041951 May 27 15:14:53.866607 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2047/4096] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:53.897169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c0102b25-364f-44bc-bfdd-8506d81f1a95 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:53.898015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c0102b25-364f-44bc-bfdd-8506d81f1a95 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:53.911725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c0102b25-364f-44bc-bfdd-8506d81f1a95 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:53.912770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c0102b25-364f-44bc-bfdd-8506d81f1a95 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:53.916351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c0102b25-364f-44bc-bfdd-8506d81f1a95 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:53.917184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c0102b25-364f-44bc-bfdd-8506d81f1a95 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:54.217289 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c0102b25-364f-44bc-bfdd-8506d81f1a95 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:54.234101 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c0102b25-364f-44bc-bfdd-8506d81f1a95 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1736 microversion: 2.1 time: 0.342430 May 27 15:14:54.235261 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2050/4097] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:53 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1736 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:54.291901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3dfb3ad6-8e83-441b-b71c-da9bcffb2ac8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:54.293205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3dfb3ad6-8e83-441b-b71c-da9bcffb2ac8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:54.303282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3dfb3ad6-8e83-441b-b71c-da9bcffb2ac8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:54.304227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3dfb3ad6-8e83-441b-b71c-da9bcffb2ac8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:54.304793 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3dfb3ad6-8e83-441b-b71c-da9bcffb2ac8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:54.305360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3dfb3ad6-8e83-441b-b71c-da9bcffb2ac8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:54.738490 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3dfb3ad6-8e83-441b-b71c-da9bcffb2ac8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:54.757060 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3dfb3ad6-8e83-441b-b71c-da9bcffb2ac8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c" status: 200 len: 1314 microversion: 2.1 time: 0.470773 May 27 15:14:54.758767 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2048/4098] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:54 2022] GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:55.255981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8a6c27c7-9c05-4309-a6f4-4b48537b6449 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:55.257941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8a6c27c7-9c05-4309-a6f4-4b48537b6449 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:55.274782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a6c27c7-9c05-4309-a6f4-4b48537b6449 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:55.274782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a6c27c7-9c05-4309-a6f4-4b48537b6449 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:55.275713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a6c27c7-9c05-4309-a6f4-4b48537b6449 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:55.278315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a6c27c7-9c05-4309-a6f4-4b48537b6449 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:55.544084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8a6c27c7-9c05-4309-a6f4-4b48537b6449 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:55.558974 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8a6c27c7-9c05-4309-a6f4-4b48537b6449 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1736 microversion: 2.1 time: 0.308659 May 27 15:14:55.586768 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2051/4099] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:55 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1736 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:55.783932 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e052e459-19f6-4d4b-a327-f4b4ed0c3def tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:55.785813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e052e459-19f6-4d4b-a327-f4b4ed0c3def tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:55.814549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e052e459-19f6-4d4b-a327-f4b4ed0c3def tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:55.815407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e052e459-19f6-4d4b-a327-f4b4ed0c3def tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:55.817344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e052e459-19f6-4d4b-a327-f4b4ed0c3def tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:55.818060 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e052e459-19f6-4d4b-a327-f4b4ed0c3def tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:55.884464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-af26530c-b1c6-45fa-88db-563885819017 req-826c85b8-8a2b-467c-9b9c-be3bfbabc190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38fbe9fb-a213-462c-a8af-ad601edd4928", "name": "network-vif-plugged", "status": "completed", "tag": "2c770865-695e-4c59-acf2-cd06a2ac073c"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:55.898103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-af26530c-b1c6-45fa-88db-563885819017 req-826c85b8-8a2b-467c-9b9c-be3bfbabc190 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:55.898841 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-af26530c-b1c6-45fa-88db-563885819017 req-826c85b8-8a2b-467c-9b9c-be3bfbabc190 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:55.911679 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-af26530c-b1c6-45fa-88db-563885819017 req-826c85b8-8a2b-467c-9b9c-be3bfbabc190 service nova] Creating event network-vif-plugged:2c770865-695e-4c59-acf2-cd06a2ac073c for instance 38fbe9fb-a213-462c-a8af-ad601edd4928 on n-h2-843621-1 May 27 15:14:55.917481 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-af26530c-b1c6-45fa-88db-563885819017 req-826c85b8-8a2b-467c-9b9c-be3bfbabc190 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037319 May 27 15:14:55.918972 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2052/4100] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:14:56.083516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e052e459-19f6-4d4b-a327-f4b4ed0c3def tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:56.094349 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e052e459-19f6-4d4b-a327-f4b4ed0c3def tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c" status: 200 len: 1464 microversion: 2.1 time: 0.319771 May 27 15:14:56.095990 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2049/4101] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:55 2022] GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c => generated 1464 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:56.117321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5d2d0c8e-8d3f-4f23-8487-3fb3cbb17565 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:56.119377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5d2d0c8e-8d3f-4f23-8487-3fb3cbb17565 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:56.132409 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d2d0c8e-8d3f-4f23-8487-3fb3cbb17565 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:56.134708 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d2d0c8e-8d3f-4f23-8487-3fb3cbb17565 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:56.136136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d2d0c8e-8d3f-4f23-8487-3fb3cbb17565 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:56.137114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d2d0c8e-8d3f-4f23-8487-3fb3cbb17565 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:56.355927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5d2d0c8e-8d3f-4f23-8487-3fb3cbb17565 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:56.366552 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5d2d0c8e-8d3f-4f23-8487-3fb3cbb17565 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1314 microversion: 2.1 time: 0.258227 May 27 15:14:56.367740 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2053/4102] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:56 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:56.585702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-94772e44-81fa-43a7-bdcb-e57cf5fe7e93 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:56.586480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-94772e44-81fa-43a7-bdcb-e57cf5fe7e93 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:56.595040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94772e44-81fa-43a7-bdcb-e57cf5fe7e93 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:56.595621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94772e44-81fa-43a7-bdcb-e57cf5fe7e93 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:56.596664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94772e44-81fa-43a7-bdcb-e57cf5fe7e93 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:56.597910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94772e44-81fa-43a7-bdcb-e57cf5fe7e93 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:56.838359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-94772e44-81fa-43a7-bdcb-e57cf5fe7e93 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:56.848396 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-94772e44-81fa-43a7-bdcb-e57cf5fe7e93 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1736 microversion: 2.1 time: 0.266596 May 27 15:14:56.849540 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2050/4103] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:56 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1736 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:57.385070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8e94265d-3943-4146-ab7e-b521326438ea tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:57.385607 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8e94265d-3943-4146-ab7e-b521326438ea tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:57.388493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:57.393870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e94265d-3943-4146-ab7e-b521326438ea tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:57.394913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e94265d-3943-4146-ab7e-b521326438ea tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:57.395694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e94265d-3943-4146-ab7e-b521326438ea tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:57.396141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e94265d-3943-4146-ab7e-b521326438ea tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:57.576666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8e94265d-3943-4146-ab7e-b521326438ea tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:57.586039 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8e94265d-3943-4146-ab7e-b521326438ea tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1314 microversion: 2.1 time: 0.204992 May 27 15:14:57.586636 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2054/4104] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:57 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:57.866795 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b9f97418-2343-4a89-af3d-abde0ad64e1e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:57.867761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b9f97418-2343-4a89-af3d-abde0ad64e1e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:57.876148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9f97418-2343-4a89-af3d-abde0ad64e1e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:57.876761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9f97418-2343-4a89-af3d-abde0ad64e1e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:57.879212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9f97418-2343-4a89-af3d-abde0ad64e1e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:57.879927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9f97418-2343-4a89-af3d-abde0ad64e1e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:58.141104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b9f97418-2343-4a89-af3d-abde0ad64e1e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:58.149897 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b9f97418-2343-4a89-af3d-abde0ad64e1e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1736 microversion: 2.1 time: 0.287432 May 27 15:14:58.162935 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2051/4105] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:57 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1736 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:58.606444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1654fa5f-2780-49cf-8460-dfe81981ea9d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:58.607078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1654fa5f-2780-49cf-8460-dfe81981ea9d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:58.616932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1654fa5f-2780-49cf-8460-dfe81981ea9d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:58.617490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1654fa5f-2780-49cf-8460-dfe81981ea9d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:58.618787 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1654fa5f-2780-49cf-8460-dfe81981ea9d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:58.619385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1654fa5f-2780-49cf-8460-dfe81981ea9d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:58.791834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1654fa5f-2780-49cf-8460-dfe81981ea9d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:58.805050 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1654fa5f-2780-49cf-8460-dfe81981ea9d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1463 microversion: 2.1 time: 0.203008 May 27 15:14:58.806187 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2055/4106] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:58 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1463 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:58.944968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9aa6e5fa-b3eb-4335-b80a-bfc5c0a07e9e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-233368893", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "38fbe9fb-a213-462c-a8af-ad601edd4928"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:59.006943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-9aa6e5fa-b3eb-4335-b80a-bfc5c0a07e9e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] validate_networks() for None {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:14:59.170046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-adbe09d0-4fbf-4bc7-b8ff-b80160a739eb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:59.171029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-adbe09d0-4fbf-4bc7-b8ff-b80160a739eb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:59.179164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-adbe09d0-4fbf-4bc7-b8ff-b80160a739eb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:59.179735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-adbe09d0-4fbf-4bc7-b8ff-b80160a739eb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:59.180655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-adbe09d0-4fbf-4bc7-b8ff-b80160a739eb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:59.181207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-adbe09d0-4fbf-4bc7-b8ff-b80160a739eb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:59.288577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-9aa6e5fa-b3eb-4335-b80a-bfc5c0a07e9e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:14:59.289314 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-9aa6e5fa-b3eb-4335-b80a-bfc5c0a07e9e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:14:59.289892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-9aa6e5fa-b3eb-4335-b80a-bfc5c0a07e9e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:14:59.290387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-9aa6e5fa-b3eb-4335-b80a-bfc5c0a07e9e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:14:59.291147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-9aa6e5fa-b3eb-4335-b80a-bfc5c0a07e9e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:14:59.302773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9aa6e5fa-b3eb-4335-b80a-bfc5c0a07e9e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:59.303514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9aa6e5fa-b3eb-4335-b80a-bfc5c0a07e9e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:59.304416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9aa6e5fa-b3eb-4335-b80a-bfc5c0a07e9e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:59.304933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9aa6e5fa-b3eb-4335-b80a-bfc5c0a07e9e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:59.328131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-9aa6e5fa-b3eb-4335-b80a-bfc5c0a07e9e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Getting quotas for project f1946861ca5a407f9b6ea2624fca1c80. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:14:59.334794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-9aa6e5fa-b3eb-4335-b80a-bfc5c0a07e9e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Getting quotas for user 3d79c875c4f04c3caaef620c4ea4b7a1 and project f1946861ca5a407f9b6ea2624fca1c80. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:14:59.361131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9aa6e5fa-b3eb-4335-b80a-bfc5c0a07e9e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:14:59.365584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9aa6e5fa-b3eb-4335-b80a-bfc5c0a07e9e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 514bdfae-084f-425f-a04a-a5b9b5d4184a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:14:59.387115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-adbe09d0-4fbf-4bc7-b8ff-b80160a739eb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:59.399310 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-adbe09d0-4fbf-4bc7-b8ff-b80160a739eb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1736 microversion: 2.1 time: 0.233357 May 27 15:14:59.400950 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2056/4107] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:59 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1736 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:59.447558 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9aa6e5fa-b3eb-4335-b80a-bfc5c0a07e9e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506976 May 27 15:14:59.455009 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2052/4108] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:14:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:14:59.460973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f883269c-e10b-40b6-85a5-ef0ae765af12 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:59.461878 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f883269c-e10b-40b6-85a5-ef0ae765af12 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 514bdfae-084f-425f-a04a-a5b9b5d4184a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:59.539771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f883269c-e10b-40b6-85a5-ef0ae765af12 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:59.551227 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f883269c-e10b-40b6-85a5-ef0ae765af12 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a" status: 200 len: 1213 microversion: 2.1 time: 0.094378 May 27 15:14:59.560752 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2057/4109] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:14:59 2022] GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:00.421456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-69862b04-54f3-469b-97b7-34c56c0e476f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:00.422175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-69862b04-54f3-469b-97b7-34c56c0e476f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:00.434496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-69862b04-54f3-469b-97b7-34c56c0e476f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:00.434968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-69862b04-54f3-469b-97b7-34c56c0e476f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:00.435816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-69862b04-54f3-469b-97b7-34c56c0e476f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:00.436396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-69862b04-54f3-469b-97b7-34c56c0e476f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:00.570061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1383c4a9-fc33-4c7c-98e6-a55cb9adadbb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:00.571374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1383c4a9-fc33-4c7c-98e6-a55cb9adadbb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 514bdfae-084f-425f-a04a-a5b9b5d4184a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:00.597615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1383c4a9-fc33-4c7c-98e6-a55cb9adadbb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:00.598371 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1383c4a9-fc33-4c7c-98e6-a55cb9adadbb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:00.599459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1383c4a9-fc33-4c7c-98e6-a55cb9adadbb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:00.600215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1383c4a9-fc33-4c7c-98e6-a55cb9adadbb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:00.754156 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1383c4a9-fc33-4c7c-98e6-a55cb9adadbb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:00.764838 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1383c4a9-fc33-4c7c-98e6-a55cb9adadbb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a" status: 200 len: 1273 microversion: 2.1 time: 0.200305 May 27 15:15:00.766419 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2058/4110] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:00 2022] GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a => generated 1273 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:00.782436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-69862b04-54f3-469b-97b7-34c56c0e476f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:00.795152 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-69862b04-54f3-469b-97b7-34c56c0e476f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1736 microversion: 2.1 time: 0.378881 May 27 15:15:00.796426 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2053/4111] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:00 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1736 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:01.784084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d11cebb9-0302-4ca7-9916-f2eafcbed7bb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:01.785887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d11cebb9-0302-4ca7-9916-f2eafcbed7bb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 514bdfae-084f-425f-a04a-a5b9b5d4184a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:01.794232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d11cebb9-0302-4ca7-9916-f2eafcbed7bb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:01.795320 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d11cebb9-0302-4ca7-9916-f2eafcbed7bb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:01.796369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d11cebb9-0302-4ca7-9916-f2eafcbed7bb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:01.797075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d11cebb9-0302-4ca7-9916-f2eafcbed7bb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:01.814034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e67fe4d-ee17-4f58-a2b4-c1ff9a326896 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:01.814726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e67fe4d-ee17-4f58-a2b4-c1ff9a326896 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:01.830313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e67fe4d-ee17-4f58-a2b4-c1ff9a326896 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:01.831022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e67fe4d-ee17-4f58-a2b4-c1ff9a326896 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:01.833537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e67fe4d-ee17-4f58-a2b4-c1ff9a326896 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:01.834913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e67fe4d-ee17-4f58-a2b4-c1ff9a326896 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:02.150509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d11cebb9-0302-4ca7-9916-f2eafcbed7bb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:02.161418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e67fe4d-ee17-4f58-a2b4-c1ff9a326896 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:02.161664 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d11cebb9-0302-4ca7-9916-f2eafcbed7bb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a" status: 200 len: 1313 microversion: 2.1 time: 0.382118 May 27 15:15:02.162379 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2059/4112] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:01 2022] GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:02.173096 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e67fe4d-ee17-4f58-a2b4-c1ff9a326896 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1736 microversion: 2.1 time: 0.362936 May 27 15:15:02.173915 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2054/4113] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:01 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1736 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:02.849878 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-a4b07bd4-ffb7-42a6-951d-3a67125411c1 req-b00f4a82-8254-49a9-9e93-0fd607ef20ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514bdfae-084f-425f-a04a-a5b9b5d4184a", "tag": "fa998565-7f0d-41f4-87c2-e9a7d18d495b"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:02.860934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-a4b07bd4-ffb7-42a6-951d-3a67125411c1 req-b00f4a82-8254-49a9-9e93-0fd607ef20ad service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:02.861656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-a4b07bd4-ffb7-42a6-951d-3a67125411c1 req-b00f4a82-8254-49a9-9e93-0fd607ef20ad service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:02.891859 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-a4b07bd4-ffb7-42a6-951d-3a67125411c1 req-b00f4a82-8254-49a9-9e93-0fd607ef20ad service nova] Creating event network-changed:fa998565-7f0d-41f4-87c2-e9a7d18d495b for instance 514bdfae-084f-425f-a04a-a5b9b5d4184a on n-h2-843621-1 May 27 15:15:02.899862 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-a4b07bd4-ffb7-42a6-951d-3a67125411c1 req-b00f4a82-8254-49a9-9e93-0fd607ef20ad service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054342 May 27 15:15:02.903157 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2060/4114] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:15:03.187985 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-339c1c01-fce6-4438-9218-b217f766d88c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:03.190495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-339c1c01-fce6-4438-9218-b217f766d88c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 514bdfae-084f-425f-a04a-a5b9b5d4184a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:03.193619 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7fa980ac-7712-4063-aa67-74c32073e860 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:03.194636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7fa980ac-7712-4063-aa67-74c32073e860 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:03.197430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:03.205924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-339c1c01-fce6-4438-9218-b217f766d88c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:03.207881 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-339c1c01-fce6-4438-9218-b217f766d88c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:03.209295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-339c1c01-fce6-4438-9218-b217f766d88c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:03.210086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-339c1c01-fce6-4438-9218-b217f766d88c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:03.215791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fa980ac-7712-4063-aa67-74c32073e860 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:03.217061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fa980ac-7712-4063-aa67-74c32073e860 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:03.219188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fa980ac-7712-4063-aa67-74c32073e860 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:03.220246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fa980ac-7712-4063-aa67-74c32073e860 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:03.929020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7fa980ac-7712-4063-aa67-74c32073e860 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:03.940073 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7fa980ac-7712-4063-aa67-74c32073e860 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1736 microversion: 2.1 time: 0.752083 May 27 15:15:03.940722 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2061/4115] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:03 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1736 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:03.944756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-339c1c01-fce6-4438-9218-b217f766d88c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:03.951959 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-339c1c01-fce6-4438-9218-b217f766d88c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a" status: 200 len: 1313 microversion: 2.1 time: 0.773046 May 27 15:15:03.952559 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2055/4116] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:03 2022] GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a => generated 1313 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:04.959720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9702dede-8a6e-4f5d-996a-17efb29b8338 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:04.960355 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9702dede-8a6e-4f5d-996a-17efb29b8338 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:04.971083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bc3c1867-f9e1-45c2-abc3-1120d74aefa5 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:04.971652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9702dede-8a6e-4f5d-996a-17efb29b8338 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:04.972513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bc3c1867-f9e1-45c2-abc3-1120d74aefa5 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 514bdfae-084f-425f-a04a-a5b9b5d4184a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:04.974898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9702dede-8a6e-4f5d-996a-17efb29b8338 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:04.976394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9702dede-8a6e-4f5d-996a-17efb29b8338 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:04.977083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9702dede-8a6e-4f5d-996a-17efb29b8338 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:04.979734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc3c1867-f9e1-45c2-abc3-1120d74aefa5 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:04.980201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc3c1867-f9e1-45c2-abc3-1120d74aefa5 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:04.981033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc3c1867-f9e1-45c2-abc3-1120d74aefa5 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:04.981486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc3c1867-f9e1-45c2-abc3-1120d74aefa5 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:05.434485 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bc3c1867-f9e1-45c2-abc3-1120d74aefa5 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:05.449947 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9702dede-8a6e-4f5d-996a-17efb29b8338 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:05.450621 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bc3c1867-f9e1-45c2-abc3-1120d74aefa5 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a" status: 200 len: 1313 microversion: 2.1 time: 0.480275 May 27 15:15:05.451379 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2056/4117] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:04 2022] GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a => generated 1313 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:05.470147 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9702dede-8a6e-4f5d-996a-17efb29b8338 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1736 microversion: 2.1 time: 0.515075 May 27 15:15:05.470754 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2062/4118] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:04 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1736 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:05.845049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-41f99f35-5c87-4797-a7e9-ec68ef519c0a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:05.851993 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-41f99f35-5c87-4797-a7e9-ec68ef519c0a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:05.853379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-41f99f35-5c87-4797-a7e9-ec68ef519c0a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Searching by: {'deleted': False, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:15:05.860010 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41f99f35-5c87-4797-a7e9-ec68ef519c0a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:05.860651 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41f99f35-5c87-4797-a7e9-ec68ef519c0a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:05.861684 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41f99f35-5c87-4797-a7e9-ec68ef519c0a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:05.863870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41f99f35-5c87-4797-a7e9-ec68ef519c0a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:05.895065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-41f99f35-5c87-4797-a7e9-ec68ef519c0a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:15:05.933047 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-41f99f35-5c87-4797-a7e9-ec68ef519c0a tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.094563 May 27 15:15:05.934686 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2057/4119] 10.222.0.13 () {58 vars in 1124 bytes} [Fri May 27 15:15:05 2022] GET /compute/v2.1/servers => generated 340 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:05.947896 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-93c8d8e8-9790-4031-bcba-c801f879a955 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:05.953411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-93c8d8e8-9790-4031-bcba-c801f879a955 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:05.955402 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-93c8d8e8-9790-4031-bcba-c801f879a955 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Searching by: {'deleted': False, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481'} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:15:05.962938 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93c8d8e8-9790-4031-bcba-c801f879a955 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:05.963532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93c8d8e8-9790-4031-bcba-c801f879a955 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:05.964266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93c8d8e8-9790-4031-bcba-c801f879a955 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:05.964798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93c8d8e8-9790-4031-bcba-c801f879a955 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:05.997725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.multi_cell_list [None req-93c8d8e8-9790-4031-bcba-c801f879a955 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119249) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:15:06.042450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-93c8d8e8-9790-4031-bcba-c801f879a955 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:06.049034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93c8d8e8-9790-4031-bcba-c801f879a955 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:06.049499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93c8d8e8-9790-4031-bcba-c801f879a955 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:06.227338 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-93c8d8e8-9790-4031-bcba-c801f879a955 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.283647 May 27 15:15:06.228622 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2063/4120] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 15:15:05 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:06.246535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3df1f5f4-9972-45e9-b8aa-d8f629c98986 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:06.257660 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3df1f5f4-9972-45e9-b8aa-d8f629c98986 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015620 May 27 15:15:06.258538 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2058/4121] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 15:15:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:06.467523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a6d03b84-92de-4e80-9c59-84ba086ca9fb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:06.468273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a6d03b84-92de-4e80-9c59-84ba086ca9fb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 514bdfae-084f-425f-a04a-a5b9b5d4184a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:06.474651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a6d03b84-92de-4e80-9c59-84ba086ca9fb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:06.475148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a6d03b84-92de-4e80-9c59-84ba086ca9fb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:06.475953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a6d03b84-92de-4e80-9c59-84ba086ca9fb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:06.476406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a6d03b84-92de-4e80-9c59-84ba086ca9fb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:06.655798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a6d03b84-92de-4e80-9c59-84ba086ca9fb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:06.663391 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a6d03b84-92de-4e80-9c59-84ba086ca9fb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a" status: 200 len: 1313 microversion: 2.1 time: 0.199712 May 27 15:15:06.672689 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2064/4122] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:06 2022] GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:06.680474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-709ef8ca-d948-458d-9d16-c379fefd610d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:06.680903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-709ef8ca-d948-458d-9d16-c379fefd610d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:06.687232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-709ef8ca-d948-458d-9d16-c379fefd610d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:06.687690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-709ef8ca-d948-458d-9d16-c379fefd610d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:06.688462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-709ef8ca-d948-458d-9d16-c379fefd610d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:06.689118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-709ef8ca-d948-458d-9d16-c379fefd610d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:06.721721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-709ef8ca-d948-458d-9d16-c379fefd610d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:15:06.724351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8e36f760-58a1-45c7-b0eb-c139f4d5b334 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:06.725004 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8e36f760-58a1-45c7-b0eb-c139f4d5b334 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:06.732030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e36f760-58a1-45c7-b0eb-c139f4d5b334 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:06.732729 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e36f760-58a1-45c7-b0eb-c139f4d5b334 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:06.733190 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e36f760-58a1-45c7-b0eb-c139f4d5b334 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:06.733640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e36f760-58a1-45c7-b0eb-c139f4d5b334 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:06.822764 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-709ef8ca-d948-458d-9d16-c379fefd610d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "DELETE /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 204 len: 0 microversion: 2.1 time: 0.145807 May 27 15:15:06.827456 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2065/4123] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:15:06 2022] DELETE /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:15:06.834375 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-31ef24bd-9f35-4a60-b8c8-ec6a26a758f3 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:06.835266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-31ef24bd-9f35-4a60-b8c8-ec6a26a758f3 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:06.842788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-31ef24bd-9f35-4a60-b8c8-ec6a26a758f3 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:06.843648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-31ef24bd-9f35-4a60-b8c8-ec6a26a758f3 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:06.844835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-31ef24bd-9f35-4a60-b8c8-ec6a26a758f3 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:06.845434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-31ef24bd-9f35-4a60-b8c8-ec6a26a758f3 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:06.850286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:06.885841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8e36f760-58a1-45c7-b0eb-c139f4d5b334 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:06.893573 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8e36f760-58a1-45c7-b0eb-c139f4d5b334 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1736 microversion: 2.1 time: 0.408589 May 27 15:15:06.903449 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2059/4124] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:06 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1736 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:07.002083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-31ef24bd-9f35-4a60-b8c8-ec6a26a758f3 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:07.010980 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-31ef24bd-9f35-4a60-b8c8-ec6a26a758f3 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1715 microversion: 2.1 time: 0.181945 May 27 15:15:07.011571 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2066/4125] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:06 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1715 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:07.680528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5d78341a-d328-4750-b337-b1840cce00ca tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:07.684040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5d78341a-d328-4750-b337-b1840cce00ca tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 514bdfae-084f-425f-a04a-a5b9b5d4184a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:07.695821 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5d78341a-d328-4750-b337-b1840cce00ca tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:07.697381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5d78341a-d328-4750-b337-b1840cce00ca tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:07.698420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5d78341a-d328-4750-b337-b1840cce00ca tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:07.699075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5d78341a-d328-4750-b337-b1840cce00ca tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:07.901376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5d78341a-d328-4750-b337-b1840cce00ca tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:07.911940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ae69d541-d33e-46f1-a218-404c161a3280 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:07.912944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ae69d541-d33e-46f1-a218-404c161a3280 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:07.920228 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5d78341a-d328-4750-b337-b1840cce00ca tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a" status: 200 len: 1313 microversion: 2.1 time: 0.244631 May 27 15:15:07.921649 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2060/4126] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:07 2022] GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:07.925979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae69d541-d33e-46f1-a218-404c161a3280 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:07.926645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae69d541-d33e-46f1-a218-404c161a3280 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:07.927650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae69d541-d33e-46f1-a218-404c161a3280 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:07.928328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae69d541-d33e-46f1-a218-404c161a3280 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:08.029117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e6ac6688-d868-4104-96df-65cd0c789324 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:08.031410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e6ac6688-d868-4104-96df-65cd0c789324 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:08.038868 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e6ac6688-d868-4104-96df-65cd0c789324 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:08.039681 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e6ac6688-d868-4104-96df-65cd0c789324 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:08.048173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e6ac6688-d868-4104-96df-65cd0c789324 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:08.049439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e6ac6688-d868-4104-96df-65cd0c789324 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:08.145376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ae69d541-d33e-46f1-a218-404c161a3280 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:08.154644 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ae69d541-d33e-46f1-a218-404c161a3280 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1736 microversion: 2.1 time: 0.247500 May 27 15:15:08.155462 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2067/4127] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:07 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1736 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:08.227608 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e6ac6688-d868-4104-96df-65cd0c789324 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:08.246330 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e6ac6688-d868-4104-96df-65cd0c789324 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1715 microversion: 2.1 time: 0.221814 May 27 15:15:08.248710 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2061/4128] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:08 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1715 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:08.937518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-88ca422e-a54c-4e95-9423-67d66c7a5b81 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:08.938785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-88ca422e-a54c-4e95-9423-67d66c7a5b81 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 514bdfae-084f-425f-a04a-a5b9b5d4184a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:08.946310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-88ca422e-a54c-4e95-9423-67d66c7a5b81 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:08.946756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-88ca422e-a54c-4e95-9423-67d66c7a5b81 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:08.947548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-88ca422e-a54c-4e95-9423-67d66c7a5b81 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:08.948006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-88ca422e-a54c-4e95-9423-67d66c7a5b81 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:09.139808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-88ca422e-a54c-4e95-9423-67d66c7a5b81 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:09.148632 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-88ca422e-a54c-4e95-9423-67d66c7a5b81 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a" status: 200 len: 1313 microversion: 2.1 time: 0.215881 May 27 15:15:09.158568 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2068/4129] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:08 2022] GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:09.173624 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1f9ce176-aadf-4e5f-9733-c7752b60e3d0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:09.174884 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1f9ce176-aadf-4e5f-9733-c7752b60e3d0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:09.185491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f9ce176-aadf-4e5f-9733-c7752b60e3d0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:09.186124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f9ce176-aadf-4e5f-9733-c7752b60e3d0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:09.187071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f9ce176-aadf-4e5f-9733-c7752b60e3d0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:09.187693 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f9ce176-aadf-4e5f-9733-c7752b60e3d0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:09.266512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-12d4c440-e866-45f8-8534-3323f459fc6f tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:09.267272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-12d4c440-e866-45f8-8534-3323f459fc6f tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:09.278778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12d4c440-e866-45f8-8534-3323f459fc6f tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:09.279311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12d4c440-e866-45f8-8534-3323f459fc6f tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:09.280319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12d4c440-e866-45f8-8534-3323f459fc6f tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:09.280904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12d4c440-e866-45f8-8534-3323f459fc6f tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:09.346088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:09.478899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1f9ce176-aadf-4e5f-9733-c7752b60e3d0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:09.492534 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1f9ce176-aadf-4e5f-9733-c7752b60e3d0 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1736 microversion: 2.1 time: 0.324813 May 27 15:15:09.494589 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2062/4130] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:09 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1736 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:09.537650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-12d4c440-e866-45f8-8534-3323f459fc6f tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:09.546489 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-12d4c440-e866-45f8-8534-3323f459fc6f tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1715 microversion: 2.1 time: 0.284118 May 27 15:15:09.556787 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2069/4131] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:09 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1715 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:09.752622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-c2e44002-bed9-4778-9ec3-a3dbcd2c49ef req-ff16b90a-5a94-4da5-ab91-c4851cc8d510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514bdfae-084f-425f-a04a-a5b9b5d4184a", "name": "network-vif-plugged", "status": "completed", "tag": "fa998565-7f0d-41f4-87c2-e9a7d18d495b"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:09.784008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c2e44002-bed9-4778-9ec3-a3dbcd2c49ef req-ff16b90a-5a94-4da5-ab91-c4851cc8d510 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:09.787491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c2e44002-bed9-4778-9ec3-a3dbcd2c49ef req-ff16b90a-5a94-4da5-ab91-c4851cc8d510 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:09.811444 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-c2e44002-bed9-4778-9ec3-a3dbcd2c49ef req-ff16b90a-5a94-4da5-ab91-c4851cc8d510 service nova] Creating event network-vif-plugged:fa998565-7f0d-41f4-87c2-e9a7d18d495b for instance 514bdfae-084f-425f-a04a-a5b9b5d4184a on n-h2-843621-1 May 27 15:15:09.821906 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-c2e44002-bed9-4778-9ec3-a3dbcd2c49ef req-ff16b90a-5a94-4da5-ab91-c4851cc8d510 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090979 May 27 15:15:09.823231 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2063/4132] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:15:10.168013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e6e0adb8-aec9-46ef-8877-e9bb6143b0c0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:10.168887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e6e0adb8-aec9-46ef-8877-e9bb6143b0c0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 514bdfae-084f-425f-a04a-a5b9b5d4184a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:10.181453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e6e0adb8-aec9-46ef-8877-e9bb6143b0c0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:10.181924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e6e0adb8-aec9-46ef-8877-e9bb6143b0c0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:10.183890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e6e0adb8-aec9-46ef-8877-e9bb6143b0c0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:10.184338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e6e0adb8-aec9-46ef-8877-e9bb6143b0c0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:10.229962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-a02a2f54-b9f1-4972-998f-b6eaac947e55 req-b374c4e2-ad6e-4163-bd19-9bf06d6cb2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be660a8b-14e9-4236-ad83-c671d7d71c13", "name": "network-vif-deleted", "tag": "3f02e49e-6281-45ea-b276-47de220cb62a"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:10.240606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-a02a2f54-b9f1-4972-998f-b6eaac947e55 req-b374c4e2-ad6e-4163-bd19-9bf06d6cb2f5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:10.241995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-a02a2f54-b9f1-4972-998f-b6eaac947e55 req-b374c4e2-ad6e-4163-bd19-9bf06d6cb2f5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:10.246860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:10.262749 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-a02a2f54-b9f1-4972-998f-b6eaac947e55 req-b374c4e2-ad6e-4163-bd19-9bf06d6cb2f5 service nova] Creating event network-vif-deleted:3f02e49e-6281-45ea-b276-47de220cb62a for instance be660a8b-14e9-4236-ad83-c671d7d71c13 on n-h2-843621-1 May 27 15:15:10.275314 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-a02a2f54-b9f1-4972-998f-b6eaac947e55 req-b374c4e2-ad6e-4163-bd19-9bf06d6cb2f5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049531 May 27 15:15:10.281555 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2064/4133] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:15:10.511706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e6e0adb8-aec9-46ef-8877-e9bb6143b0c0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:10.511951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6efc2dbc-1a5f-4a5d-8dc5-fa4b53e85496 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:10.513524 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6efc2dbc-1a5f-4a5d-8dc5-fa4b53e85496 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:10.523367 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6efc2dbc-1a5f-4a5d-8dc5-fa4b53e85496 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:10.524026 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e6e0adb8-aec9-46ef-8877-e9bb6143b0c0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a" status: 200 len: 1313 microversion: 2.1 time: 0.362086 May 27 15:15:10.524331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6efc2dbc-1a5f-4a5d-8dc5-fa4b53e85496 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:10.525493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6efc2dbc-1a5f-4a5d-8dc5-fa4b53e85496 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:10.526232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6efc2dbc-1a5f-4a5d-8dc5-fa4b53e85496 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:10.533860 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2070/4134] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:10 2022] GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:10.564016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e30e5a92-c4d3-4bc6-93a4-a1b31d533875 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:10.564659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e30e5a92-c4d3-4bc6-93a4-a1b31d533875 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:10.574325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e30e5a92-c4d3-4bc6-93a4-a1b31d533875 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:10.579087 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e30e5a92-c4d3-4bc6-93a4-a1b31d533875 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:10.580235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e30e5a92-c4d3-4bc6-93a4-a1b31d533875 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:10.580974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e30e5a92-c4d3-4bc6-93a4-a1b31d533875 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:10.659541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e30e5a92-c4d3-4bc6-93a4-a1b31d533875 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:10.660401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e30e5a92-c4d3-4bc6-93a4-a1b31d533875 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:10.663122 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-e30e5a92-c4d3-4bc6-93a4-a1b31d533875 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lazy-loading 'fault' on Instance uuid be660a8b-14e9-4236-ad83-c671d7d71c13 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:15:10.771256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6efc2dbc-1a5f-4a5d-8dc5-fa4b53e85496 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:10.783754 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e30e5a92-c4d3-4bc6-93a4-a1b31d533875 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:10.785636 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6efc2dbc-1a5f-4a5d-8dc5-fa4b53e85496 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1716 microversion: 2.1 time: 0.278553 May 27 15:15:10.786479 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2065/4135] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:10 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1716 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:10.793162 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e30e5a92-c4d3-4bc6-93a4-a1b31d533875 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1367 microversion: 2.1 time: 0.232877 May 27 15:15:10.796097 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2071/4136] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:10 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:10.855693 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e90fbf1d-cdfe-4997-8dbf-2e52deb10c25 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:10.856605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e90fbf1d-cdfe-4997-8dbf-2e52deb10c25 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:10.873226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e90fbf1d-cdfe-4997-8dbf-2e52deb10c25 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:10.873916 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e90fbf1d-cdfe-4997-8dbf-2e52deb10c25 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:10.874894 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e90fbf1d-cdfe-4997-8dbf-2e52deb10c25 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:10.876099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e90fbf1d-cdfe-4997-8dbf-2e52deb10c25 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:10.979509 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-e90fbf1d-cdfe-4997-8dbf-2e52deb10c25 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] HTTP exception thrown: Cannot 'detach_volume' instance ae7e4fc8-75b6-4e3f-9fca-7e5920957283 while it is in vm_state rescued May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e90fbf1d-cdfe-4997-8dbf-2e52deb10c25 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Request method failure captured: May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments/4e3a1808-b4f3-48b4-950e-0b2fbbd53210 HTTP/1.1 May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOnNcWUaU6oQTw40A1oZOI-6OFKZaukve4P5LqW1FpCc9yhaxuLnjuKFUwlZoi0CeEpz5akQjaT-fGwv01A8fNadXXg4nlnoB_yvoYpc3lVED0AfYG3-niNxm_AITH-UuchLUVsnXh3asdpL1aml75HbLXXqw5pajtYuIua7x_Sa4qg May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 1f6efd5b16e5450d9eb9b454d05a775a May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1f6efd5b16e5450d9eb9b454d05a775a", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 1f6efd5b16e5450d9eb9b454d05a775a May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerRescueNegativeTestJSON-1538927199-project May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 645379b3a21548d8a4f4d6425b61319f May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1538927199-project May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: exception: Cannot 'detach_volume' instance ae7e4fc8-75b6-4e3f-9fca-7e5920957283 while it is in vm_state rescued May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'server_id': 'ae7e4fc8-75b6-4e3f-9fca-7e5920957283', 'id': '4e3a1808-b4f3-48b4-950e-0b2fbbd53210'} May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ae7e4fc8-75b6-4e3f-9fca-7e5920957283 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ae7e4fc8-75b6-4e3f-9fca-7e5920957283 while it is in vm_state rescued May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:15:10.982508 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:10.988207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:10.988207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:10.988207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:15:10.988207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:15:10.988207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ae7e4fc8-75b6-4e3f-9fca-7e5920957283 while it is in vm_state rescued May 27 15:15:10.988207 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:15:10.991193 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e90fbf1d-cdfe-4997-8dbf-2e52deb10c25 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Returning 409 to user: Cannot 'detach_volume' instance ae7e4fc8-75b6-4e3f-9fca-7e5920957283 while it is in vm_state rescued {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:15:10.992284 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e90fbf1d-cdfe-4997-8dbf-2e52deb10c25 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments/4e3a1808-b4f3-48b4-950e-0b2fbbd53210" status: 409 len: 152 microversion: 2.1 time: 0.142859 May 27 15:15:10.993366 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2066/4137] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 15:15:10 2022] DELETE /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments/4e3a1808-b4f3-48b4-950e-0b2fbbd53210 => generated 152 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:15:11.001756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6ff7ec62-6d40-49d5-afcd-b90a76ad71b8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:11.002303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6ff7ec62-6d40-49d5-afcd-b90a76ad71b8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:11.015193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ff7ec62-6d40-49d5-afcd-b90a76ad71b8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:11.015712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ff7ec62-6d40-49d5-afcd-b90a76ad71b8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:11.019904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ff7ec62-6d40-49d5-afcd-b90a76ad71b8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:11.024793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ff7ec62-6d40-49d5-afcd-b90a76ad71b8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:11.155958 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6ff7ec62-6d40-49d5-afcd-b90a76ad71b8 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "POST /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/action" status: 202 len: 0 microversion: 2.1 time: 0.156499 May 27 15:15:11.157221 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2072/4138] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:15:10 2022] POST /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:15:11.170998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-41ba046f-4410-4b4f-971a-9df68ec2e730 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:11.173169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-41ba046f-4410-4b4f-971a-9df68ec2e730 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:11.185692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41ba046f-4410-4b4f-971a-9df68ec2e730 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:11.187596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41ba046f-4410-4b4f-971a-9df68ec2e730 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:11.190374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41ba046f-4410-4b4f-971a-9df68ec2e730 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:11.192410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41ba046f-4410-4b4f-971a-9df68ec2e730 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:11.458981 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-41ba046f-4410-4b4f-971a-9df68ec2e730 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:11.483098 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-41ba046f-4410-4b4f-971a-9df68ec2e730 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1724 microversion: 2.1 time: 0.313203 May 27 15:15:11.484249 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2067/4139] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:11 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1724 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:11.547747 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-65c05ec5-7617-40ac-bd69-4581576cf717 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:11.549621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-65c05ec5-7617-40ac-bd69-4581576cf717 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 514bdfae-084f-425f-a04a-a5b9b5d4184a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:11.562510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65c05ec5-7617-40ac-bd69-4581576cf717 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:11.563338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65c05ec5-7617-40ac-bd69-4581576cf717 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:11.567146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65c05ec5-7617-40ac-bd69-4581576cf717 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:11.568170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65c05ec5-7617-40ac-bd69-4581576cf717 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:11.778391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-65c05ec5-7617-40ac-bd69-4581576cf717 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:11.792061 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-65c05ec5-7617-40ac-bd69-4581576cf717 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a" status: 200 len: 1462 microversion: 2.1 time: 0.254122 May 27 15:15:11.795029 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2073/4140] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:11 2022] GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a => generated 1462 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:11.817833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2beeb32e-aeca-451f-b43e-01b279949b8d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:11.819577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2beeb32e-aeca-451f-b43e-01b279949b8d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:11.845640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2beeb32e-aeca-451f-b43e-01b279949b8d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:11.847349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2beeb32e-aeca-451f-b43e-01b279949b8d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:11.848246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2beeb32e-aeca-451f-b43e-01b279949b8d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:11.848993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2beeb32e-aeca-451f-b43e-01b279949b8d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:11.909012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2beeb32e-aeca-451f-b43e-01b279949b8d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:11.909934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2beeb32e-aeca-451f-b43e-01b279949b8d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:11.910654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-2beeb32e-aeca-451f-b43e-01b279949b8d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lazy-loading 'fault' on Instance uuid be660a8b-14e9-4236-ad83-c671d7d71c13 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:15:11.968532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2beeb32e-aeca-451f-b43e-01b279949b8d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34c074be1734483bf9619f8c2216abc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9e44f6c5ea48f19eb7300d0f51c481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:11.979843 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2beeb32e-aeca-451f-b43e-01b279949b8d tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 200 len: 1367 microversion: 2.1 time: 0.168248 May 27 15:15:11.990410 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2074/4141] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:11 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:12.026683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-30f578ef-648b-40c7-98f3-8b990a4cdfb5 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:12.036273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-30f578ef-648b-40c7-98f3-8b990a4cdfb5 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Searching by: {'deleted': False, 'project_id': 'e5b60120f6ac4dc185e06626fe939019'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:15:12.047075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30f578ef-648b-40c7-98f3-8b990a4cdfb5 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.047773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30f578ef-648b-40c7-98f3-8b990a4cdfb5 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:12.048988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30f578ef-648b-40c7-98f3-8b990a4cdfb5 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.050694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30f578ef-648b-40c7-98f3-8b990a4cdfb5 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:12.081900 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-30f578ef-648b-40c7-98f3-8b990a4cdfb5 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.273857 May 27 15:15:12.082464 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2068/4142] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 15:15:11 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:15:12.100630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-529921b1-4e21-4aa2-89a9-ed8cd4fad58b tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:12.106536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-529921b1-4e21-4aa2-89a9-ed8cd4fad58b tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Searching by: {'deleted': False} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:15:12.113624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-529921b1-4e21-4aa2-89a9-ed8cd4fad58b tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.114165 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-529921b1-4e21-4aa2-89a9-ed8cd4fad58b tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:12.115226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-529921b1-4e21-4aa2-89a9-ed8cd4fad58b tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.115871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-529921b1-4e21-4aa2-89a9-ed8cd4fad58b tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:12.231778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.multi_cell_list [None req-529921b1-4e21-4aa2-89a9-ed8cd4fad58b tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=119249) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:15:12.329410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-529921b1-4e21-4aa2-89a9-ed8cd4fad58b tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.329910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-529921b1-4e21-4aa2-89a9-ed8cd4fad58b tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:12.501001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d3955b02-8757-46ef-b231-0ad1db734b21 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:12.501628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d3955b02-8757-46ef-b231-0ad1db734b21 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:12.509936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d3955b02-8757-46ef-b231-0ad1db734b21 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.510793 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d3955b02-8757-46ef-b231-0ad1db734b21 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:12.511649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d3955b02-8757-46ef-b231-0ad1db734b21 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.512193 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d3955b02-8757-46ef-b231-0ad1db734b21 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:12.773526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d3955b02-8757-46ef-b231-0ad1db734b21 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:12.788031 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d3955b02-8757-46ef-b231-0ad1db734b21 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1724 microversion: 2.1 time: 0.290095 May 27 15:15:12.789131 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-529921b1-4e21-4aa2-89a9-ed8cd4fad58b tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 16564 microversion: 2.1 time: 0.692657 May 27 15:15:12.800701 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2075/4143] 10.222.0.13 () {58 vars in 1170 bytes} [Fri May 27 15:15:12 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 16564 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 15:15:12.801068 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2069/4144] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:12 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:12.817418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c7849496-7c0c-4f6d-9260-dd85a286598f tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:12.821129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c7849496-7c0c-4f6d-9260-dd85a286598f tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Searching by: {'deleted': False, 'project_id': 'e5b60120f6ac4dc185e06626fe939019'} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:15:12.826046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c7849496-7c0c-4f6d-9260-dd85a286598f tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.826436 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c7849496-7c0c-4f6d-9260-dd85a286598f tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:12.827225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c7849496-7c0c-4f6d-9260-dd85a286598f tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.827689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c7849496-7c0c-4f6d-9260-dd85a286598f tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:12.855552 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c7849496-7c0c-4f6d-9260-dd85a286598f tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?tenant_id=f1946861ca5a407f9b6ea2624fca1c80" status: 200 len: 15 microversion: 2.1 time: 0.041741 May 27 15:15:12.856154 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2076/4145] 10.222.0.13 () {58 vars in 1230 bytes} [Fri May 27 15:15:12 2022] GET /compute/v2.1/servers/detail?tenant_id=f1946861ca5a407f9b6ea2624fca1c80 => generated 15 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:15:12.870902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-91816ad2-8cfd-4e6c-9ada-bd48025c9e4c tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:12.876069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-91816ad2-8cfd-4e6c-9ada-bd48025c9e4c tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Searching by: {'tenant_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'deleted': False} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:15:12.881141 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-91816ad2-8cfd-4e6c-9ada-bd48025c9e4c tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.881594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-91816ad2-8cfd-4e6c-9ada-bd48025c9e4c tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:12.882682 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-91816ad2-8cfd-4e6c-9ada-bd48025c9e4c tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.883198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-91816ad2-8cfd-4e6c-9ada-bd48025c9e4c tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:12.915244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-91816ad2-8cfd-4e6c-9ada-bd48025c9e4c tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:15:12.963796 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-91816ad2-8cfd-4e6c-9ada-bd48025c9e4c tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.964427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-91816ad2-8cfd-4e6c-9ada-bd48025c9e4c tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:12.999902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cfa11f14-d019-44b1-b51b-1153cdc3b255 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:12.999902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cfa11f14-d019-44b1-b51b-1153cdc3b255 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] [instance: be660a8b-14e9-4236-ad83-c671d7d71c13] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:13.006008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfa11f14-d019-44b1-b51b-1153cdc3b255 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.006509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfa11f14-d019-44b1-b51b-1153cdc3b255 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.007301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfa11f14-d019-44b1-b51b-1153cdc3b255 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.007847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfa11f14-d019-44b1-b51b-1153cdc3b255 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.022489 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-cfa11f14-d019-44b1-b51b-1153cdc3b255 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] HTTP exception thrown: Instance be660a8b-14e9-4236-ad83-c671d7d71c13 could not be found. May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cfa11f14-d019-44b1-b51b-1153cdc3b255 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Request method failure captured: May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 HTTP/1.1 May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOq4xE9szMZgOcKUroHw60nGFYyiM1SV0PkkbZB39YR0Dw6aTJmAKuy_laor7mSPhkxspXWbQneRBqhCiMvKvgqjO3l3U5qWn6Jr7nfNWKrkuTwM_f553jHeeremXcUwHVsq9SG1iSiIStrRaH9FjXeiExwh6sRKDmq0rm_mEk5e3B0 May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1f9e44f6c5ea48f19eb7300d0f51c481 May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersTestManualDisk-135985252 May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f9e44f6c5ea48f19eb7300d0f51c481"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f9e44f6c5ea48f19eb7300d0f51c481"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1f9e44f6c5ea48f19eb7300d0f51c481"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1f9e44f6c5ea48f19eb7300d0f51c481", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersTestManualDisk-135985252 May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1f9e44f6c5ea48f19eb7300d0f51c481 May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersTestManualDisk-135985252 May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersTestManualDisk-135985252-project May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: e34c074be1734483bf9619f8c2216abc May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersTestManualDisk-135985252-project May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance be660a8b-14e9-4236-ad83-c671d7d71c13 could not be found. May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'be660a8b-14e9-4236-ad83-c671d7d71c13'} May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be660a8b-14e9-4236-ad83-c671d7d71c13 could not be found. May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be660a8b-14e9-4236-ad83-c671d7d71c13 could not be found. May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:13.024392 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:15:13.029192 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:13.029192 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:13.029192 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:13.029192 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:15:13.029192 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:15:13.029192 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be660a8b-14e9-4236-ad83-c671d7d71c13 could not be found. May 27 15:15:13.029192 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:15:13.029192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cfa11f14-d019-44b1-b51b-1153cdc3b255 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Returning 404 to user: Instance be660a8b-14e9-4236-ad83-c671d7d71c13 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:15:13.029192 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cfa11f14-d019-44b1-b51b-1153cdc3b255 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13" status: 404 len: 111 microversion: 2.1 time: 0.031143 May 27 15:15:13.029192 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2077/4146] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:12 2022] GET /compute/v2.1/servers/be660a8b-14e9-4236-ad83-c671d7d71c13 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:15:13.035847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0a6294da-a8fc-4d2b-abd8-b76cada07fe2 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] Calling method '.version_select at 0x7fc776ae0670>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:13.059088 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0a6294da-a8fc-4d2b-abd8-b76cada07fe2 tempest-ServersTestManualDisk-135985252 tempest-ServersTestManualDisk-135985252-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-179467863" status: 202 len: 0 microversion: 2.1 time: 0.028360 May 27 15:15:13.059990 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2078/4147] 10.222.0.13 () {58 vars in 1217 bytes} [Fri May 27 15:15:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-179467863 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:15:13.205585 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-91816ad2-8cfd-4e6c-9ada-bd48025c9e4c tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f1946861ca5a407f9b6ea2624fca1c80" status: 200 len: 4825 microversion: 2.1 time: 0.337418 May 27 15:15:13.207329 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2070/4148] 10.222.0.13 () {58 vars in 1256 bytes} [Fri May 27 15:15:12 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f1946861ca5a407f9b6ea2624fca1c80 => generated 4825 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:13.225950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0fd8a62f-bfe5-4c59-9c12-c095b039c937 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:13.231615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0fd8a62f-bfe5-4c59-9c12-c095b039c937 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Searching by: {'tenant_id': 'e5b60120f6ac4dc185e06626fe939019', 'deleted': False} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:15:13.241615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0fd8a62f-bfe5-4c59-9c12-c095b039c937 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.243534 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0fd8a62f-bfe5-4c59-9c12-c095b039c937 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.245261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0fd8a62f-bfe5-4c59-9c12-c095b039c937 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.246478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0fd8a62f-bfe5-4c59-9c12-c095b039c937 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.285774 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0fd8a62f-bfe5-4c59-9c12-c095b039c937 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e5b60120f6ac4dc185e06626fe939019" status: 200 len: 15 microversion: 2.1 time: 0.064020 May 27 15:15:13.296947 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2079/4149] 10.222.0.13 () {58 vars in 1256 bytes} [Fri May 27 15:15:13 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e5b60120f6ac4dc185e06626fe939019 => generated 15 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:15:13.308584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a4215855-08f4-4b00-ac40-25199ea68034 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:13.318561 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a4215855-08f4-4b00-ac40-25199ea68034 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.019646 May 27 15:15:13.319654 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2071/4150] 10.222.0.13 () {58 vars in 1188 bytes} [Fri May 27 15:15:13 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 15:15:13.340003 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-40b09352-fbd3-4f6d-87ab-c0a6e90fa4da tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:13.341456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-40b09352-fbd3-4f6d-87ab-c0a6e90fa4da tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:13.352350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40b09352-fbd3-4f6d-87ab-c0a6e90fa4da tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.353377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40b09352-fbd3-4f6d-87ab-c0a6e90fa4da tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.355081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40b09352-fbd3-4f6d-87ab-c0a6e90fa4da tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.355991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40b09352-fbd3-4f6d-87ab-c0a6e90fa4da tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.474156 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-40b09352-fbd3-4f6d-87ab-c0a6e90fa4da tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928/action" status: 202 len: 0 microversion: 2.1 time: 0.140398 May 27 15:15:13.475796 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2080/4151] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:15:13 2022] POST /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:15:13.485262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3461673d-4ced-43d3-b0be-67ad861269f7 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:13.495127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3461673d-4ced-43d3-b0be-67ad861269f7 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:13.498978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3461673d-4ced-43d3-b0be-67ad861269f7 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:15:13.511578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3461673d-4ced-43d3-b0be-67ad861269f7 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.512833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3461673d-4ced-43d3-b0be-67ad861269f7 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.514207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3461673d-4ced-43d3-b0be-67ad861269f7 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.518142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3461673d-4ced-43d3-b0be-67ad861269f7 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.558683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-3461673d-4ced-43d3-b0be-67ad861269f7 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:15:13.602487 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3461673d-4ced-43d3-b0be-67ad861269f7 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.122698 May 27 15:15:13.603576 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2072/4152] 10.222.0.13 () {58 vars in 1149 bytes} [Fri May 27 15:15:13 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:13.614411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ae900b55-1133-4550-877d-45699905b79e tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:13.616351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ae900b55-1133-4550-877d-45699905b79e tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:13.628815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae900b55-1133-4550-877d-45699905b79e tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.629270 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae900b55-1133-4550-877d-45699905b79e tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.630056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae900b55-1133-4550-877d-45699905b79e tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.630492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae900b55-1133-4550-877d-45699905b79e tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.672472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:13.743045 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ae900b55-1133-4550-877d-45699905b79e tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928/action" status: 202 len: 0 microversion: 2.1 time: 0.132985 May 27 15:15:13.743633 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2081/4153] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:15:13 2022] POST /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:15:13.763375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-62930d88-202e-41b6-9e2e-688f93656da1 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:13.764556 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-62930d88-202e-41b6-9e2e-688f93656da1 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:13.771394 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62930d88-202e-41b6-9e2e-688f93656da1 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.771963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62930d88-202e-41b6-9e2e-688f93656da1 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.772888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62930d88-202e-41b6-9e2e-688f93656da1 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.773410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62930d88-202e-41b6-9e2e-688f93656da1 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.808623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4b1021ed-8566-4ac8-8340-4b3f8e9844c9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:13.809350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4b1021ed-8566-4ac8-8340-4b3f8e9844c9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:13.821275 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b1021ed-8566-4ac8-8340-4b3f8e9844c9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.825996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b1021ed-8566-4ac8-8340-4b3f8e9844c9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.826919 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b1021ed-8566-4ac8-8340-4b3f8e9844c9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.827416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b1021ed-8566-4ac8-8340-4b3f8e9844c9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:14.261325 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-62930d88-202e-41b6-9e2e-688f93656da1 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1614 microversion: 2.1 time: 0.512909 May 27 15:15:14.273084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4b1021ed-8566-4ac8-8340-4b3f8e9844c9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:14.274598 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2073/4154] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:13 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1614 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:14.279349 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4b1021ed-8566-4ac8-8340-4b3f8e9844c9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1724 microversion: 2.1 time: 0.475536 May 27 15:15:14.281779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7103b9ef-2c57-4a62-9ba6-7074b2ec5106 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:14.281923 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2082/4155] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:13 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1724 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:14.282700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7103b9ef-2c57-4a62-9ba6-7074b2ec5106 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:14.290466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7103b9ef-2c57-4a62-9ba6-7074b2ec5106 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:14.290833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7103b9ef-2c57-4a62-9ba6-7074b2ec5106 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:14.291992 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7103b9ef-2c57-4a62-9ba6-7074b2ec5106 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:14.292469 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7103b9ef-2c57-4a62-9ba6-7074b2ec5106 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:14.526878 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7103b9ef-2c57-4a62-9ba6-7074b2ec5106 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1614 microversion: 2.1 time: 0.249741 May 27 15:15:14.539434 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2074/4156] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:14 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1614 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:14.553308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b085b929-e6a5-4cdc-81cd-d45a07da1ed6 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:14.564448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b085b929-e6a5-4cdc-81cd-d45a07da1ed6 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Searching by: {'host': 'n-h2-843621-1', 'deleted': False} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:15:14.574942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b085b929-e6a5-4cdc-81cd-d45a07da1ed6 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:14.575686 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b085b929-e6a5-4cdc-81cd-d45a07da1ed6 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:14.576933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b085b929-e6a5-4cdc-81cd-d45a07da1ed6 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:14.577653 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b085b929-e6a5-4cdc-81cd-d45a07da1ed6 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:14.757370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.multi_cell_list [None req-b085b929-e6a5-4cdc-81cd-d45a07da1ed6 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=119249) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:15:14.829752 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b085b929-e6a5-4cdc-81cd-d45a07da1ed6 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] 10.222.0.13 "GET /compute/v2.1/servers?host=n-h2-843621-1&all_tenants=1" status: 200 len: 1310 microversion: 2.1 time: 0.283803 May 27 15:15:14.832028 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2083/4157] 10.222.0.13 () {58 vars in 1189 bytes} [Fri May 27 15:15:14 2022] GET /compute/v2.1/servers?host=n-h2-843621-1&all_tenants=1 => generated 1310 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:14.843487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9da67a15-bf71-460a-8b12-63a5099b6ff4 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:14.849236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9da67a15-bf71-460a-8b12-63a5099b6ff4 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:15:14.855234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9da67a15-bf71-460a-8b12-63a5099b6ff4 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:14.856050 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9da67a15-bf71-460a-8b12-63a5099b6ff4 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:14.857161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9da67a15-bf71-460a-8b12-63a5099b6ff4 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:14.857845 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9da67a15-bf71-460a-8b12-63a5099b6ff4 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:14.956363 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9da67a15-bf71-460a-8b12-63a5099b6ff4 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] 10.222.0.13 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.116688 May 27 15:15:14.961672 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2075/4158] 10.222.0.13 () {58 vars in 1195 bytes} [Fri May 27 15:15:14 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:15:14.971428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5b07656c-7569-405e-94f9-a75201acb76d tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:14.972730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5b07656c-7569-405e-94f9-a75201acb76d tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:14.986072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5b07656c-7569-405e-94f9-a75201acb76d tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:14.986072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5b07656c-7569-405e-94f9-a75201acb76d tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:14.986772 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5b07656c-7569-405e-94f9-a75201acb76d tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:14.988037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5b07656c-7569-405e-94f9-a75201acb76d tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:15.102504 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5b07656c-7569-405e-94f9-a75201acb76d tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928/action" status: 202 len: 0 microversion: 2.1 time: 0.134677 May 27 15:15:15.104096 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2084/4159] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:15:14 2022] POST /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:15:15.114462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-616fb219-5a6f-4b33-b3b7-15da5cf8fd53 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "346e776e-8931-417f-87da-575810efb12b"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:15.115941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-616fb219-5a6f-4b33-b3b7-15da5cf8fd53 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:15.122702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-616fb219-5a6f-4b33-b3b7-15da5cf8fd53 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:15.123188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-616fb219-5a6f-4b33-b3b7-15da5cf8fd53 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:15.124171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-616fb219-5a6f-4b33-b3b7-15da5cf8fd53 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:15.124716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-616fb219-5a6f-4b33-b3b7-15da5cf8fd53 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:15.213760 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-616fb219-5a6f-4b33-b3b7-15da5cf8fd53 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:15:15.214478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-616fb219-5a6f-4b33-b3b7-15da5cf8fd53 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:15:15.215102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-616fb219-5a6f-4b33-b3b7-15da5cf8fd53 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:15:15.215673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-616fb219-5a6f-4b33-b3b7-15da5cf8fd53 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:15:15.216333 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-616fb219-5a6f-4b33-b3b7-15da5cf8fd53 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:15:15.301319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1419fecb-90f3-4ce5-84d2-e2636911fe69 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:15.302600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1419fecb-90f3-4ce5-84d2-e2636911fe69 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:15.302721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-616fb219-5a6f-4b33-b3b7-15da5cf8fd53 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:15.317142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1419fecb-90f3-4ce5-84d2-e2636911fe69 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:15.318843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1419fecb-90f3-4ce5-84d2-e2636911fe69 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:15.319981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1419fecb-90f3-4ce5-84d2-e2636911fe69 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:15.320656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1419fecb-90f3-4ce5-84d2-e2636911fe69 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:15.321355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-616fb219-5a6f-4b33-b3b7-15da5cf8fd53 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:15.322513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-616fb219-5a6f-4b33-b3b7-15da5cf8fd53 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:15.323351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-616fb219-5a6f-4b33-b3b7-15da5cf8fd53 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:15.324950 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-616fb219-5a6f-4b33-b3b7-15da5cf8fd53 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:15.371453 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-616fb219-5a6f-4b33-b3b7-15da5cf8fd53 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "POST /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928/action" status: 202 len: 1067 microversion: 2.1 time: 0.261692 May 27 15:15:15.372476 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2076/4160] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:15:15 2022] POST /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928/action => generated 1067 bytes in 264 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 27 15:15:15.386743 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-66c6d985-cdf5-4ccc-93a5-42ad2dec5583 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:15.387621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-66c6d985-cdf5-4ccc-93a5-42ad2dec5583 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:15.402539 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66c6d985-cdf5-4ccc-93a5-42ad2dec5583 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:15.403548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66c6d985-cdf5-4ccc-93a5-42ad2dec5583 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:15.405033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66c6d985-cdf5-4ccc-93a5-42ad2dec5583 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:15.405665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66c6d985-cdf5-4ccc-93a5-42ad2dec5583 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:15.859285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1419fecb-90f3-4ce5-84d2-e2636911fe69 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:15.869186 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1419fecb-90f3-4ce5-84d2-e2636911fe69 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1730 microversion: 2.1 time: 0.574205 May 27 15:15:15.869851 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2085/4161] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:15 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1730 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:15.880086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-66c6d985-cdf5-4ccc-93a5-42ad2dec5583 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:15.888828 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-66c6d985-cdf5-4ccc-93a5-42ad2dec5583 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1471 microversion: 2.1 time: 0.506462 May 27 15:15:15.889498 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2077/4162] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:15 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1471 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:15.890779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f02329b1-9220-4b6e-8910-5815f9781e59 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:15.891291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f02329b1-9220-4b6e-8910-5815f9781e59 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:15.899285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f02329b1-9220-4b6e-8910-5815f9781e59 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:15.900141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f02329b1-9220-4b6e-8910-5815f9781e59 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:15.901258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f02329b1-9220-4b6e-8910-5815f9781e59 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:15.901878 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f02329b1-9220-4b6e-8910-5815f9781e59 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:16.085439 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f02329b1-9220-4b6e-8910-5815f9781e59 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.201279 May 27 15:15:16.094375 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2086/4163] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 15:15:15 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-interface => generated 284 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:16.907355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e300212-0a52-491c-885e-8c78f5d987ca tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:16.907996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e300212-0a52-491c-885e-8c78f5d987ca tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:16.928201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e300212-0a52-491c-885e-8c78f5d987ca tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:16.928750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e300212-0a52-491c-885e-8c78f5d987ca tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:16.929522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e300212-0a52-491c-885e-8c78f5d987ca tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:16.929968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e300212-0a52-491c-885e-8c78f5d987ca tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:17.463983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-33d66f26-12e2-4eae-be9a-190b9566b761 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:17.464636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-33d66f26-12e2-4eae-be9a-190b9566b761 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:17.475120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-33d66f26-12e2-4eae-be9a-190b9566b761 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:17.499597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-33d66f26-12e2-4eae-be9a-190b9566b761 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:17.502786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-33d66f26-12e2-4eae-be9a-190b9566b761 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:17.503471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-33d66f26-12e2-4eae-be9a-190b9566b761 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:17.541164 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-33d66f26-12e2-4eae-be9a-190b9566b761 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376/ips" status: 200 len: 146 microversion: 2.1 time: 0.081995 May 27 15:15:17.542211 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2087/4164] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 15:15:17 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376/ips => generated 146 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:15:17.696736 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e300212-0a52-491c-885e-8c78f5d987ca tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:17.704939 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e300212-0a52-491c-885e-8c78f5d987ca tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1471 microversion: 2.1 time: 0.801417 May 27 15:15:17.716693 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2078/4165] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:16 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1471 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:18.535138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-39c9ccc7-8ba7-4416-a981-fe3fb8f9e642 req-75366a2e-5a31-43f1-90a3-c970fa742e8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae7e4fc8-75b6-4e3f-9fca-7e5920957283", "tag": "89fb6ad5-bc61-4f1c-b96b-4295cadf203e"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:18.592355 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-39c9ccc7-8ba7-4416-a981-fe3fb8f9e642 req-75366a2e-5a31-43f1-90a3-c970fa742e8a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:18.593173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-39c9ccc7-8ba7-4416-a981-fe3fb8f9e642 req-75366a2e-5a31-43f1-90a3-c970fa742e8a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:18.643391 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-39c9ccc7-8ba7-4416-a981-fe3fb8f9e642 req-75366a2e-5a31-43f1-90a3-c970fa742e8a service nova] Creating event network-changed:89fb6ad5-bc61-4f1c-b96b-4295cadf203e for instance ae7e4fc8-75b6-4e3f-9fca-7e5920957283 on n-h1-843621-1 May 27 15:15:18.661887 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-39c9ccc7-8ba7-4416-a981-fe3fb8f9e642 req-75366a2e-5a31-43f1-90a3-c970fa742e8a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136816 May 27 15:15:18.665810 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2088/4166] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:18.724433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a1da4d79-12e0-4395-b25e-979524a7e975 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:18.725244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a1da4d79-12e0-4395-b25e-979524a7e975 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:18.739051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a1da4d79-12e0-4395-b25e-979524a7e975 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:18.741473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a1da4d79-12e0-4395-b25e-979524a7e975 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:18.742435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a1da4d79-12e0-4395-b25e-979524a7e975 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:18.743001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a1da4d79-12e0-4395-b25e-979524a7e975 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:19.769415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a1da4d79-12e0-4395-b25e-979524a7e975 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:19.787276 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a1da4d79-12e0-4395-b25e-979524a7e975 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1471 microversion: 2.1 time: 1.065075 May 27 15:15:19.797002 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2079/4167] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:18 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1471 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:20.751170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-15d825be-4057-4133-b62c-a49651a81d83 req-51ed5cde-58c7-42af-a3d6-e69936e1046d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae7e4fc8-75b6-4e3f-9fca-7e5920957283", "tag": "89fb6ad5-bc61-4f1c-b96b-4295cadf203e"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:20.769435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-15d825be-4057-4133-b62c-a49651a81d83 req-51ed5cde-58c7-42af-a3d6-e69936e1046d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:20.770339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-15d825be-4057-4133-b62c-a49651a81d83 req-51ed5cde-58c7-42af-a3d6-e69936e1046d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:20.784911 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-15d825be-4057-4133-b62c-a49651a81d83 req-51ed5cde-58c7-42af-a3d6-e69936e1046d service nova] Creating event network-changed:89fb6ad5-bc61-4f1c-b96b-4295cadf203e for instance ae7e4fc8-75b6-4e3f-9fca-7e5920957283 on n-h1-843621-1 May 27 15:15:20.823925 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5dbaffb4-66be-49dc-9674-f1f4c673e80e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:20.826851 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5dbaffb4-66be-49dc-9674-f1f4c673e80e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:20.848113 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-15d825be-4057-4133-b62c-a49651a81d83 req-51ed5cde-58c7-42af-a3d6-e69936e1046d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106600 May 27 15:15:20.855264 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2089/4168] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:20.876227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5dbaffb4-66be-49dc-9674-f1f4c673e80e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:20.880766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5dbaffb4-66be-49dc-9674-f1f4c673e80e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:20.883837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5dbaffb4-66be-49dc-9674-f1f4c673e80e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:20.884613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5dbaffb4-66be-49dc-9674-f1f4c673e80e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:21.290593 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5dbaffb4-66be-49dc-9674-f1f4c673e80e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:21.296099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:21.329002 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5dbaffb4-66be-49dc-9674-f1f4c673e80e tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1471 microversion: 2.1 time: 0.527486 May 27 15:15:21.333282 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2080/4169] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:20 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1471 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:22.017928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8c4cbacb-711a-4c50-8999-6cac4708b317 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6346e75d-e250-4125-8b2d-be6b8c9b8b0f"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:22.019993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8c4cbacb-711a-4c50-8999-6cac4708b317 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:22.027159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c4cbacb-711a-4c50-8999-6cac4708b317 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:22.027687 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c4cbacb-711a-4c50-8999-6cac4708b317 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:22.028733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c4cbacb-711a-4c50-8999-6cac4708b317 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:22.029445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c4cbacb-711a-4c50-8999-6cac4708b317 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:22.314878 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:22.352548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8ae4c6ac-ba26-4ba0-a327-74bbfa208fa6 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:22.364780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8ae4c6ac-ba26-4ba0-a327-74bbfa208fa6 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:22.380789 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ae4c6ac-ba26-4ba0-a327-74bbfa208fa6 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:22.381746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ae4c6ac-ba26-4ba0-a327-74bbfa208fa6 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:22.383408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ae4c6ac-ba26-4ba0-a327-74bbfa208fa6 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:22.386340 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ae4c6ac-ba26-4ba0-a327-74bbfa208fa6 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:22.433450 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8c4cbacb-711a-4c50-8999-6cac4708b317 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "POST /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.420305 May 27 15:15:22.434543 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2090/4170] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 15:15:22 2022] POST /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376/os-volume_attachments => generated 194 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:22.849375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8ae4c6ac-ba26-4ba0-a327-74bbfa208fa6 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:22.871998 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8ae4c6ac-ba26-4ba0-a327-74bbfa208fa6 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1471 microversion: 2.1 time: 0.518274 May 27 15:15:22.882839 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2081/4171] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:22 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1471 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:23.891827 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1b5b1e57-46dc-4296-9436-13dd55748e62 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:23.892545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1b5b1e57-46dc-4296-9436-13dd55748e62 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:23.932749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b5b1e57-46dc-4296-9436-13dd55748e62 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:23.932749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b5b1e57-46dc-4296-9436-13dd55748e62 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:23.932749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b5b1e57-46dc-4296-9436-13dd55748e62 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:23.932749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b5b1e57-46dc-4296-9436-13dd55748e62 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:24.303594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1b5b1e57-46dc-4296-9436-13dd55748e62 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:24.319030 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1b5b1e57-46dc-4296-9436-13dd55748e62 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1477 microversion: 2.1 time: 0.431542 May 27 15:15:24.328890 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2091/4172] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:23 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1477 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:25.338141 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d0835e7d-f12f-4c67-aa44-30aee37ce0be tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:25.339453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d0835e7d-f12f-4c67-aa44-30aee37ce0be tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:25.343634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:25.345586 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=12 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:25.373364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0835e7d-f12f-4c67-aa44-30aee37ce0be tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:25.374336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0835e7d-f12f-4c67-aa44-30aee37ce0be tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:25.376939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0835e7d-f12f-4c67-aa44-30aee37ce0be tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:25.379781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0835e7d-f12f-4c67-aa44-30aee37ce0be tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:25.711314 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d0835e7d-f12f-4c67-aa44-30aee37ce0be tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:25.722629 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d0835e7d-f12f-4c67-aa44-30aee37ce0be tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1477 microversion: 2.1 time: 0.389190 May 27 15:15:25.726443 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2082/4173] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:25 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1477 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:26.038951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-1ea23b10-16ef-4c70-aedf-e4092fb29b85 req-0f0561f4-b169-421b-95cc-d27d54057fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38fbe9fb-a213-462c-a8af-ad601edd4928", "name": "network-vif-unplugged", "status": "completed", "tag": "2c770865-695e-4c59-acf2-cd06a2ac073c"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:26.060283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=10 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:26.069843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-1ea23b10-16ef-4c70-aedf-e4092fb29b85 req-0f0561f4-b169-421b-95cc-d27d54057fd1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:26.071703 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-1ea23b10-16ef-4c70-aedf-e4092fb29b85 req-0f0561f4-b169-421b-95cc-d27d54057fd1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:26.098714 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-1ea23b10-16ef-4c70-aedf-e4092fb29b85 req-0f0561f4-b169-421b-95cc-d27d54057fd1 service nova] Creating event network-vif-unplugged:2c770865-695e-4c59-acf2-cd06a2ac073c for instance 38fbe9fb-a213-462c-a8af-ad601edd4928 on n-h2-843621-1 May 27 15:15:26.114319 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-1ea23b10-16ef-4c70-aedf-e4092fb29b85 req-0f0561f4-b169-421b-95cc-d27d54057fd1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077189 May 27 15:15:26.116961 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2092/4174] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:26.740444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-acca26cc-6b8d-4e22-8a78-51f9bc5a2b73 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:26.741272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-acca26cc-6b8d-4e22-8a78-51f9bc5a2b73 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:26.759570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-acca26cc-6b8d-4e22-8a78-51f9bc5a2b73 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:26.760219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-acca26cc-6b8d-4e22-8a78-51f9bc5a2b73 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:26.761226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-acca26cc-6b8d-4e22-8a78-51f9bc5a2b73 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:26.762566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-acca26cc-6b8d-4e22-8a78-51f9bc5a2b73 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:27.022881 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-acca26cc-6b8d-4e22-8a78-51f9bc5a2b73 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:27.034565 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-acca26cc-6b8d-4e22-8a78-51f9bc5a2b73 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1477 microversion: 2.1 time: 0.298913 May 27 15:15:27.046174 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2083/4175] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:26 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1477 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:28.056330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f0180503-2d9f-451d-8825-a4bcc599117f tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:28.057251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f0180503-2d9f-451d-8825-a4bcc599117f tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:28.069380 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:28.071579 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0180503-2d9f-451d-8825-a4bcc599117f tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:28.072270 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0180503-2d9f-451d-8825-a4bcc599117f tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:28.073398 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0180503-2d9f-451d-8825-a4bcc599117f tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:28.074105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0180503-2d9f-451d-8825-a4bcc599117f tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:28.501260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-6e2f4525-a538-438c-bf9c-c821355092a0 req-ed191dee-a15f-45ce-9cd4-7e9d995e8d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38fbe9fb-a213-462c-a8af-ad601edd4928", "name": "network-vif-plugged", "status": "completed", "tag": "2c770865-695e-4c59-acf2-cd06a2ac073c"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:28.523807 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-6e2f4525-a538-438c-bf9c-c821355092a0 req-ed191dee-a15f-45ce-9cd4-7e9d995e8d5b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:28.524538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-6e2f4525-a538-438c-bf9c-c821355092a0 req-ed191dee-a15f-45ce-9cd4-7e9d995e8d5b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:28.533421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f0180503-2d9f-451d-8825-a4bcc599117f tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:28.546158 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-6e2f4525-a538-438c-bf9c-c821355092a0 req-ed191dee-a15f-45ce-9cd4-7e9d995e8d5b service nova] Creating event network-vif-plugged:2c770865-695e-4c59-acf2-cd06a2ac073c for instance 38fbe9fb-a213-462c-a8af-ad601edd4928 on n-h2-843621-1 May 27 15:15:28.546527 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f0180503-2d9f-451d-8825-a4bcc599117f tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1477 microversion: 2.1 time: 0.495781 May 27 15:15:28.547746 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2093/4176] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:28 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1477 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:28.564733 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-6e2f4525-a538-438c-bf9c-c821355092a0 req-ed191dee-a15f-45ce-9cd4-7e9d995e8d5b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066837 May 27 15:15:28.568002 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2084/4177] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:29.565899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-be75e3ec-ec64-46a3-9e70-4fcb8a727e16 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:29.567133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-be75e3ec-ec64-46a3-9e70-4fcb8a727e16 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:29.574726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be75e3ec-ec64-46a3-9e70-4fcb8a727e16 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:29.575484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be75e3ec-ec64-46a3-9e70-4fcb8a727e16 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:29.576271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be75e3ec-ec64-46a3-9e70-4fcb8a727e16 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:29.576736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be75e3ec-ec64-46a3-9e70-4fcb8a727e16 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:29.740021 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-be75e3ec-ec64-46a3-9e70-4fcb8a727e16 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:29.753948 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-be75e3ec-ec64-46a3-9e70-4fcb8a727e16 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1477 microversion: 2.1 time: 0.193164 May 27 15:15:29.763415 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2094/4178] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:29 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1477 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:30.775324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ae0236bb-2ac7-47d7-8ba7-9e8f8d810591 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:30.776040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ae0236bb-2ac7-47d7-8ba7-9e8f8d810591 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:30.793142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ae0236bb-2ac7-47d7-8ba7-9e8f8d810591 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:30.794232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ae0236bb-2ac7-47d7-8ba7-9e8f8d810591 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:30.795482 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ae0236bb-2ac7-47d7-8ba7-9e8f8d810591 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:30.805219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ae0236bb-2ac7-47d7-8ba7-9e8f8d810591 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:31.116566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ae0236bb-2ac7-47d7-8ba7-9e8f8d810591 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:31.130471 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ae0236bb-2ac7-47d7-8ba7-9e8f8d810591 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1463 microversion: 2.1 time: 0.361117 May 27 15:15:31.143012 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2085/4179] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:30 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1463 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:31.161430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b63df1af-0493-4923-be19-131c08997df3 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:31.162231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b63df1af-0493-4923-be19-131c08997df3 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:31.172062 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b63df1af-0493-4923-be19-131c08997df3 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:31.172520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b63df1af-0493-4923-be19-131c08997df3 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:31.173333 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b63df1af-0493-4923-be19-131c08997df3 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:31.173778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b63df1af-0493-4923-be19-131c08997df3 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:31.650856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b63df1af-0493-4923-be19-131c08997df3 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:31.661188 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b63df1af-0493-4923-be19-131c08997df3 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1463 microversion: 2.1 time: 0.504358 May 27 15:15:31.663432 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2095/4180] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:31 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1463 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:31.689536 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-897d1de6-7fab-4f89-9ab3-129d8e9a3602 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "346e776e-8931-417f-87da-575810efb12b"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:31.694412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-897d1de6-7fab-4f89-9ab3-129d8e9a3602 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:31.712157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-897d1de6-7fab-4f89-9ab3-129d8e9a3602 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:31.714692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-897d1de6-7fab-4f89-9ab3-129d8e9a3602 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:31.717106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-897d1de6-7fab-4f89-9ab3-129d8e9a3602 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:31.718517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-897d1de6-7fab-4f89-9ab3-129d8e9a3602 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:31.856202 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-897d1de6-7fab-4f89-9ab3-129d8e9a3602 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:15:31.857620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-897d1de6-7fab-4f89-9ab3-129d8e9a3602 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:15:31.858473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-897d1de6-7fab-4f89-9ab3-129d8e9a3602 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:15:31.859084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-897d1de6-7fab-4f89-9ab3-129d8e9a3602 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:15:31.859685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-897d1de6-7fab-4f89-9ab3-129d8e9a3602 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:15:31.960929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-897d1de6-7fab-4f89-9ab3-129d8e9a3602 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:31.973589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-897d1de6-7fab-4f89-9ab3-129d8e9a3602 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:31.974057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-897d1de6-7fab-4f89-9ab3-129d8e9a3602 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:31.979452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-897d1de6-7fab-4f89-9ab3-129d8e9a3602 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:31.980075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-897d1de6-7fab-4f89-9ab3-129d8e9a3602 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:32.081096 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-897d1de6-7fab-4f89-9ab3-129d8e9a3602 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "POST /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928/action" status: 202 len: 1067 microversion: 2.1 time: 0.404042 May 27 15:15:32.090242 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2086/4181] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:15:31 2022] POST /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928/action => generated 1067 bytes in 414 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 27 15:15:32.108638 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-21c19f02-7537-48e2-a517-b2e3077972f8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:32.110662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-21c19f02-7537-48e2-a517-b2e3077972f8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:32.124500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21c19f02-7537-48e2-a517-b2e3077972f8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:32.125231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21c19f02-7537-48e2-a517-b2e3077972f8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:32.126777 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21c19f02-7537-48e2-a517-b2e3077972f8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:32.127539 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21c19f02-7537-48e2-a517-b2e3077972f8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:32.195488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=6,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:32.781363 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-21c19f02-7537-48e2-a517-b2e3077972f8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:32.790002 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-21c19f02-7537-48e2-a517-b2e3077972f8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1472 microversion: 2.1 time: 0.688346 May 27 15:15:32.800203 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2096/4182] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:32 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1472 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:33.819953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8a1f2c4e-3219-4f09-b2f4-604c9ddff814 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:33.826420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8a1f2c4e-3219-4f09-b2f4-604c9ddff814 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:33.849926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=74 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:33.855788 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a1f2c4e-3219-4f09-b2f4-604c9ddff814 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:33.856487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a1f2c4e-3219-4f09-b2f4-604c9ddff814 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:33.861184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a1f2c4e-3219-4f09-b2f4-604c9ddff814 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:33.861929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a1f2c4e-3219-4f09-b2f4-604c9ddff814 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:34.313830 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8a1f2c4e-3219-4f09-b2f4-604c9ddff814 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:34.324942 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8a1f2c4e-3219-4f09-b2f4-604c9ddff814 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1472 microversion: 2.1 time: 0.511992 May 27 15:15:34.334122 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2087/4183] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:33 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1472 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:35.338105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3acf4e59-b557-4d2f-8c9e-2045330c7adb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:35.358046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3ecd6a31-9203-4a2b-89b6-319a9ceeeeda tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:35.358046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3ecd6a31-9203-4a2b-89b6-319a9ceeeeda tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:35.358514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3acf4e59-b557-4d2f-8c9e-2045330c7adb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:35.389232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3acf4e59-b557-4d2f-8c9e-2045330c7adb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:35.396218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3ecd6a31-9203-4a2b-89b6-319a9ceeeeda tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:35.399476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3acf4e59-b557-4d2f-8c9e-2045330c7adb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:35.403148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3acf4e59-b557-4d2f-8c9e-2045330c7adb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:35.405917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3ecd6a31-9203-4a2b-89b6-319a9ceeeeda tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:35.407152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3acf4e59-b557-4d2f-8c9e-2045330c7adb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:35.417534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3ecd6a31-9203-4a2b-89b6-319a9ceeeeda tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:35.418876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3ecd6a31-9203-4a2b-89b6-319a9ceeeeda tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:35.591935 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3acf4e59-b557-4d2f-8c9e-2045330c7adb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:15:36.003997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3ecd6a31-9203-4a2b-89b6-319a9ceeeeda tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:36.016336 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3ecd6a31-9203-4a2b-89b6-319a9ceeeeda tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1472 microversion: 2.1 time: 0.669703 May 27 15:15:36.026861 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2088/4184] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:35 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1472 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:36.134994 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3acf4e59-b557-4d2f-8c9e-2045330c7adb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 204 len: 0 microversion: 2.42 time: 1.287962 May 27 15:15:36.135986 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2097/4185] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:15:34 2022] DELETE /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 0 bytes in 1290 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 27 15:15:36.145357 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-df3b0d33-22d8-41d5-9f67-4ec48a3eb442 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:36.146018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-df3b0d33-22d8-41d5-9f67-4ec48a3eb442 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:36.220715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df3b0d33-22d8-41d5-9f67-4ec48a3eb442 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:36.226278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df3b0d33-22d8-41d5-9f67-4ec48a3eb442 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.065s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:36.227374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df3b0d33-22d8-41d5-9f67-4ec48a3eb442 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:36.234639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df3b0d33-22d8-41d5-9f67-4ec48a3eb442 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:36.760561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-df3b0d33-22d8-41d5-9f67-4ec48a3eb442 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:36.778724 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-df3b0d33-22d8-41d5-9f67-4ec48a3eb442 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:36.783158 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-df3b0d33-22d8-41d5-9f67-4ec48a3eb442 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:36.786470 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-df3b0d33-22d8-41d5-9f67-4ec48a3eb442 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 2961 microversion: 2.42 time: 0.646103 May 27 15:15:36.797181 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2089/4186] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:15:36 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 2961 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:36.822661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fb8fb6f9-b350-4723-bc24-2f7295a4bfce tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1955889184", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "d5c2e8b3-0362-4bef-8a4f-b01a88199aa6"}, {"uuid": "aa0fbc6e-d76e-41f2-9d7a-7c54ebd5a356"}, {"uuid": "d5c2e8b3-0362-4bef-8a4f-b01a88199aa6"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:36.933085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-fb8fb6f9-b350-4723-bc24-2f7295a4bfce tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] validate_networks() for [('d5c2e8b3-0362-4bef-8a4f-b01a88199aa6', None, None, None, None, None), ('aa0fbc6e-d76e-41f2-9d7a-7c54ebd5a356', None, None, None, None, None), ('d5c2e8b3-0362-4bef-8a4f-b01a88199aa6', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:15:37.047095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ceb5f0ed-b246-442b-abb7-9caa21bd1d24 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:37.047979 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ceb5f0ed-b246-442b-abb7-9caa21bd1d24 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:37.058694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ceb5f0ed-b246-442b-abb7-9caa21bd1d24 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:37.059250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ceb5f0ed-b246-442b-abb7-9caa21bd1d24 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:37.061331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ceb5f0ed-b246-442b-abb7-9caa21bd1d24 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:37.066546 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ceb5f0ed-b246-442b-abb7-9caa21bd1d24 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:37.710075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ceb5f0ed-b246-442b-abb7-9caa21bd1d24 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:37.718469 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ceb5f0ed-b246-442b-abb7-9caa21bd1d24 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1472 microversion: 2.1 time: 0.675698 May 27 15:15:37.726470 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2090/4187] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:37 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1472 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:37.816136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0841de2b-b688-499a-906e-dc8af9bdd6f6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:37.817045 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0841de2b-b688-499a-906e-dc8af9bdd6f6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:37.845178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0841de2b-b688-499a-906e-dc8af9bdd6f6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:37.845700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0841de2b-b688-499a-906e-dc8af9bdd6f6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:37.846579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0841de2b-b688-499a-906e-dc8af9bdd6f6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:37.849857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0841de2b-b688-499a-906e-dc8af9bdd6f6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:38.603548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0841de2b-b688-499a-906e-dc8af9bdd6f6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:38.623981 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0841de2b-b688-499a-906e-dc8af9bdd6f6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:38.625673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0841de2b-b688-499a-906e-dc8af9bdd6f6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:38.646091 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0841de2b-b688-499a-906e-dc8af9bdd6f6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 2961 microversion: 2.42 time: 0.834321 May 27 15:15:38.660234 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2091/4188] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:15:37 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 2961 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:38.738236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a86d0280-4084-4248-bcbe-79b0dc87a6a8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:38.738869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a86d0280-4084-4248-bcbe-79b0dc87a6a8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:38.761131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a86d0280-4084-4248-bcbe-79b0dc87a6a8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:38.769428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a86d0280-4084-4248-bcbe-79b0dc87a6a8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:38.770309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a86d0280-4084-4248-bcbe-79b0dc87a6a8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:38.770780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a86d0280-4084-4248-bcbe-79b0dc87a6a8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:39.325076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a86d0280-4084-4248-bcbe-79b0dc87a6a8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:39.342248 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a86d0280-4084-4248-bcbe-79b0dc87a6a8 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1472 microversion: 2.1 time: 0.608384 May 27 15:15:39.343543 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2092/4189] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:38 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1472 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:39.700305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-311d50da-13a0-4b0b-b437-4c24b6c9e5bf tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:39.701362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-311d50da-13a0-4b0b-b437-4c24b6c9e5bf tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:39.722501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-311d50da-13a0-4b0b-b437-4c24b6c9e5bf tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:39.726294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-311d50da-13a0-4b0b-b437-4c24b6c9e5bf tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:39.729947 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-311d50da-13a0-4b0b-b437-4c24b6c9e5bf tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:39.732906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-311d50da-13a0-4b0b-b437-4c24b6c9e5bf tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:40.273259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-fb8fb6f9-b350-4723-bc24-2f7295a4bfce tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:15:40.273842 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-fb8fb6f9-b350-4723-bc24-2f7295a4bfce tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:15:40.274144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-fb8fb6f9-b350-4723-bc24-2f7295a4bfce tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:15:40.282301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-fb8fb6f9-b350-4723-bc24-2f7295a4bfce tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:15:40.282765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-fb8fb6f9-b350-4723-bc24-2f7295a4bfce tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:15:40.299882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb8fb6f9-b350-4723-bc24-2f7295a4bfce tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:40.300333 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb8fb6f9-b350-4723-bc24-2f7295a4bfce tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:40.314130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb8fb6f9-b350-4723-bc24-2f7295a4bfce tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:40.315050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb8fb6f9-b350-4723-bc24-2f7295a4bfce tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:40.357882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-fb8fb6f9-b350-4723-bc24-2f7295a4bfce tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Getting quotas for project 42c0be30e5494716a16b458fe631f6ee. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:15:40.366779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-fb8fb6f9-b350-4723-bc24-2f7295a4bfce tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Getting quotas for user 1ae937c9ae1a44029ec336114f22df83 and project 42c0be30e5494716a16b458fe631f6ee. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:15:40.388194 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-311d50da-13a0-4b0b-b437-4c24b6c9e5bf tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:40.407451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-311d50da-13a0-4b0b-b437-4c24b6c9e5bf tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:40.415920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-311d50da-13a0-4b0b-b437-4c24b6c9e5bf tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:40.417555 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-311d50da-13a0-4b0b-b437-4c24b6c9e5bf tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 2961 microversion: 2.42 time: 0.722869 May 27 15:15:40.425635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fb8fb6f9-b350-4723-bc24-2f7295a4bfce tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:15:40.428155 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fb8fb6f9-b350-4723-bc24-2f7295a4bfce tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:15:40.428542 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2093/4190] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:15:39 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 2961 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:40.459583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b557c33a-dcad-4e3e-9fe7-96ffe7fb55b2 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:40.461613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b557c33a-dcad-4e3e-9fe7-96ffe7fb55b2 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:40.473445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b557c33a-dcad-4e3e-9fe7-96ffe7fb55b2 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:40.473912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b557c33a-dcad-4e3e-9fe7-96ffe7fb55b2 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:40.474771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b557c33a-dcad-4e3e-9fe7-96ffe7fb55b2 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:40.475222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b557c33a-dcad-4e3e-9fe7-96ffe7fb55b2 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:40.549370 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fb8fb6f9-b350-4723-bc24-2f7295a4bfce tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.738171 May 27 15:15:40.550743 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2098/4191] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:15:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 3740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:15:40.569268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a63b2ccc-968d-455d-8746-559f25fd5b3f tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:40.571399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a63b2ccc-968d-455d-8746-559f25fd5b3f tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:40.781516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a63b2ccc-968d-455d-8746-559f25fd5b3f tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:40.798080 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a63b2ccc-968d-455d-8746-559f25fd5b3f tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1213 microversion: 2.1 time: 0.232144 May 27 15:15:40.798716 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2099/4192] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:40 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1213 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:40.858401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b557c33a-dcad-4e3e-9fe7-96ffe7fb55b2 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:40.874988 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b557c33a-dcad-4e3e-9fe7-96ffe7fb55b2 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1472 microversion: 2.1 time: 0.443683 May 27 15:15:40.879448 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2094/4193] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:40 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1472 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:41.449873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5e433021-f4cb-475e-803f-0212ba68b52e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:41.451491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5e433021-f4cb-475e-803f-0212ba68b52e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:41.498403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e433021-f4cb-475e-803f-0212ba68b52e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:41.499212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e433021-f4cb-475e-803f-0212ba68b52e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:41.503903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e433021-f4cb-475e-803f-0212ba68b52e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:41.504382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e433021-f4cb-475e-803f-0212ba68b52e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:41.815751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-84894619-80fe-45e5-8ad9-8c5f009cd241 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:41.816610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-84894619-80fe-45e5-8ad9-8c5f009cd241 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:41.832912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84894619-80fe-45e5-8ad9-8c5f009cd241 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:41.848327 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84894619-80fe-45e5-8ad9-8c5f009cd241 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:41.859394 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84894619-80fe-45e5-8ad9-8c5f009cd241 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:41.865849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84894619-80fe-45e5-8ad9-8c5f009cd241 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:42.437032 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5e433021-f4cb-475e-803f-0212ba68b52e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:42.448185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-84894619-80fe-45e5-8ad9-8c5f009cd241 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:42.475007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5e433021-f4cb-475e-803f-0212ba68b52e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:42.481236 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-84894619-80fe-45e5-8ad9-8c5f009cd241 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1209 microversion: 2.1 time: 0.668800 May 27 15:15:42.482319 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2095/4194] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:41 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1209 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:42.492657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5e433021-f4cb-475e-803f-0212ba68b52e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:42.492657 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5e433021-f4cb-475e-803f-0212ba68b52e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 2940 microversion: 2.42 time: 1.044374 May 27 15:15:42.512319 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2100/4195] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:15:41 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 2940 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:42.517479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-28003e5d-9920-4d7f-a3dd-80da210d8766 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:42.518241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-28003e5d-9920-4d7f-a3dd-80da210d8766 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:42.545656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-28003e5d-9920-4d7f-a3dd-80da210d8766 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:42.546381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-28003e5d-9920-4d7f-a3dd-80da210d8766 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:42.547800 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-28003e5d-9920-4d7f-a3dd-80da210d8766 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:42.555298 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-28003e5d-9920-4d7f-a3dd-80da210d8766 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:42.585571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:42.999736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-5ddb2155-29b5-4b4d-9aff-a11014566281 req-72f00eca-bdea-43c8-9c4b-cc5dff54fa7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "name": "network-vif-unplugged", "status": "completed", "tag": "100b1a63-83ab-408e-adb6-ce5865974f8f"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:43.032875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-5ddb2155-29b5-4b4d-9aff-a11014566281 req-72f00eca-bdea-43c8-9c4b-cc5dff54fa7d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:43.033333 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-5ddb2155-29b5-4b4d-9aff-a11014566281 req-72f00eca-bdea-43c8-9c4b-cc5dff54fa7d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:43.079475 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-5ddb2155-29b5-4b4d-9aff-a11014566281 req-72f00eca-bdea-43c8-9c4b-cc5dff54fa7d service nova] Creating event network-vif-unplugged:100b1a63-83ab-408e-adb6-ce5865974f8f for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:15:43.093444 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-5ddb2155-29b5-4b4d-9aff-a11014566281 req-72f00eca-bdea-43c8-9c4b-cc5dff54fa7d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100989 May 27 15:15:43.096132 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2101/4196] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:15:43.500794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9064990f-b022-4d79-b369-2d84a79413cc tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:43.501544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9064990f-b022-4d79-b369-2d84a79413cc tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:43.513057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9064990f-b022-4d79-b369-2d84a79413cc tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:43.520798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9064990f-b022-4d79-b369-2d84a79413cc tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:43.522078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9064990f-b022-4d79-b369-2d84a79413cc tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:43.522701 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9064990f-b022-4d79-b369-2d84a79413cc tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:43.713605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9064990f-b022-4d79-b369-2d84a79413cc tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:43.723102 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9064990f-b022-4d79-b369-2d84a79413cc tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1271 microversion: 2.1 time: 0.227066 May 27 15:15:43.723701 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2102/4197] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:43 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1271 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:43.741326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-28003e5d-9920-4d7f-a3dd-80da210d8766 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:43.742005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4ca62755-0553-4c08-b880-33a3e504ec62 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:43.742805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4ca62755-0553-4c08-b880-33a3e504ec62 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:43.756606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4ca62755-0553-4c08-b880-33a3e504ec62 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:43.757285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4ca62755-0553-4c08-b880-33a3e504ec62 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:43.758084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4ca62755-0553-4c08-b880-33a3e504ec62 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:43.758533 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4ca62755-0553-4c08-b880-33a3e504ec62 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:43.765405 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-28003e5d-9920-4d7f-a3dd-80da210d8766 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1472 microversion: 2.1 time: 1.269895 May 27 15:15:43.766177 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2096/4198] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:42 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1472 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:44.227824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4ca62755-0553-4c08-b880-33a3e504ec62 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:44.247874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4ca62755-0553-4c08-b880-33a3e504ec62 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:44.257428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4ca62755-0553-4c08-b880-33a3e504ec62 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:44.275797 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4ca62755-0553-4c08-b880-33a3e504ec62 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 2919 microversion: 2.42 time: 0.545915 May 27 15:15:44.282908 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2103/4199] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:15:43 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 2919 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:44.511512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-54f97624-5391-4af6-9dca-91c65d701ed8 req-615af86a-bb37-4e91-a995-3f9a76d05f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "name": "network-vif-deleted", "tag": "93591aab-dea0-4a1e-9aaa-fc28351a76bf"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:44.540437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-54f97624-5391-4af6-9dca-91c65d701ed8 req-615af86a-bb37-4e91-a995-3f9a76d05f86 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:44.541022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-54f97624-5391-4af6-9dca-91c65d701ed8 req-615af86a-bb37-4e91-a995-3f9a76d05f86 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:44.568664 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-54f97624-5391-4af6-9dca-91c65d701ed8 req-615af86a-bb37-4e91-a995-3f9a76d05f86 service nova] Creating event network-vif-deleted:93591aab-dea0-4a1e-9aaa-fc28351a76bf for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:15:44.581239 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-54f97624-5391-4af6-9dca-91c65d701ed8 req-615af86a-bb37-4e91-a995-3f9a76d05f86 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074127 May 27 15:15:44.584981 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2097/4200] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:44.745983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-79da6336-db79-4594-b859-cf927d129f49 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:44.755580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-79da6336-db79-4594-b859-cf927d129f49 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:44.782879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79da6336-db79-4594-b859-cf927d129f49 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:44.783354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79da6336-db79-4594-b859-cf927d129f49 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:44.787276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eb848e40-f305-45c6-98d3-9c02b9daf5b0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:44.788122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-eb848e40-f305-45c6-98d3-9c02b9daf5b0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:44.789870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79da6336-db79-4594-b859-cf927d129f49 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:44.798716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79da6336-db79-4594-b859-cf927d129f49 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:44.805351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb848e40-f305-45c6-98d3-9c02b9daf5b0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:44.811258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb848e40-f305-45c6-98d3-9c02b9daf5b0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:44.812301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb848e40-f305-45c6-98d3-9c02b9daf5b0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:44.812874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb848e40-f305-45c6-98d3-9c02b9daf5b0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:45.039739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-79da6336-db79-4594-b859-cf927d129f49 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:45.050267 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-79da6336-db79-4594-b859-cf927d129f49 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1271 microversion: 2.1 time: 0.312272 May 27 15:15:45.062526 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2104/4201] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:44 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1271 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:45.201615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-f03b1f42-7185-4c8a-b9ba-5d1fa20f1c46 req-e514a41e-8520-4a83-bd5b-dcf220b9151b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "name": "network-vif-unplugged", "status": "completed", "tag": "4fae3a94-8715-4a88-a516-e2014c141251"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:45.220444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f03b1f42-7185-4c8a-b9ba-5d1fa20f1c46 req-e514a41e-8520-4a83-bd5b-dcf220b9151b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:45.225519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f03b1f42-7185-4c8a-b9ba-5d1fa20f1c46 req-e514a41e-8520-4a83-bd5b-dcf220b9151b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:45.260986 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-f03b1f42-7185-4c8a-b9ba-5d1fa20f1c46 req-e514a41e-8520-4a83-bd5b-dcf220b9151b service nova] Creating event network-vif-unplugged:4fae3a94-8715-4a88-a516-e2014c141251 for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:15:45.278888 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-f03b1f42-7185-4c8a-b9ba-5d1fa20f1c46 req-e514a41e-8520-4a83-bd5b-dcf220b9151b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079118 May 27 15:15:45.281714 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2105/4202] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:15:45.318234 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-96545b6b-e917-4a52-bd23-cae6ab57a02f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:45.319073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-96545b6b-e917-4a52-bd23-cae6ab57a02f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:45.333592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96545b6b-e917-4a52-bd23-cae6ab57a02f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:45.334378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96545b6b-e917-4a52-bd23-cae6ab57a02f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:45.335985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96545b6b-e917-4a52-bd23-cae6ab57a02f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:45.337176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96545b6b-e917-4a52-bd23-cae6ab57a02f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:45.347613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eb848e40-f305-45c6-98d3-9c02b9daf5b0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:45.356865 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-eb848e40-f305-45c6-98d3-9c02b9daf5b0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1472 microversion: 2.1 time: 0.576184 May 27 15:15:45.361080 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2098/4203] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:44 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1472 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:45.723502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-96545b6b-e917-4a52-bd23-cae6ab57a02f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:45.740573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-96545b6b-e917-4a52-bd23-cae6ab57a02f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:45.749127 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-96545b6b-e917-4a52-bd23-cae6ab57a02f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:45.750441 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-96545b6b-e917-4a52-bd23-cae6ab57a02f tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 2758 microversion: 2.42 time: 0.438664 May 27 15:15:45.762883 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2106/4204] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:15:45 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 2758 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:46.074385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1d46236f-831a-4544-b765-0556ef885e13 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:46.075154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1d46236f-831a-4544-b765-0556ef885e13 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:46.086259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d46236f-831a-4544-b765-0556ef885e13 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:46.090627 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d46236f-831a-4544-b765-0556ef885e13 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:46.093326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d46236f-831a-4544-b765-0556ef885e13 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:46.093915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d46236f-831a-4544-b765-0556ef885e13 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:46.238670 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a1042b6e-2d88-4c53-b72a-b982fe88d54a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:46.248980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1042b6e-2d88-4c53-b72a-b982fe88d54a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:46.254362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1042b6e-2d88-4c53-b72a-b982fe88d54a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:46.310869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a1042b6e-2d88-4c53-b72a-b982fe88d54a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Going to try to stop instance {{(pid=119249) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 15:15:46.396426 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a1042b6e-2d88-4c53-b72a-b982fe88d54a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "POST /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376/action" status: 202 len: 0 microversion: 2.1 time: 0.161862 May 27 15:15:46.398642 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2107/4205] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:15:46 2022] POST /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:15:46.405632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4636c63b-b10b-4d55-b75a-5a6dce4855c7 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:46.416383 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1d46236f-831a-4544-b765-0556ef885e13 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:46.424991 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1d46236f-831a-4544-b765-0556ef885e13 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1313 microversion: 2.1 time: 0.356887 May 27 15:15:46.425798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4636c63b-b10b-4d55-b75a-5a6dce4855c7 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:46.430361 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2099/4206] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:46 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:46.435143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2bab8063-651d-4713-8fa9-29b2f67b4691 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:46.440998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4636c63b-b10b-4d55-b75a-5a6dce4855c7 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:46.441847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4636c63b-b10b-4d55-b75a-5a6dce4855c7 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:46.442872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4636c63b-b10b-4d55-b75a-5a6dce4855c7 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:46.443824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4636c63b-b10b-4d55-b75a-5a6dce4855c7 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:46.444916 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2bab8063-651d-4713-8fa9-29b2f67b4691 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:46.456896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bab8063-651d-4713-8fa9-29b2f67b4691 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:46.457362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bab8063-651d-4713-8fa9-29b2f67b4691 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:46.458167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bab8063-651d-4713-8fa9-29b2f67b4691 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:46.458618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bab8063-651d-4713-8fa9-29b2f67b4691 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:46.848150 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4636c63b-b10b-4d55-b75a-5a6dce4855c7 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:46.864031 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4636c63b-b10b-4d55-b75a-5a6dce4855c7 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1472 microversion: 2.1 time: 0.460423 May 27 15:15:46.865424 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2108/4207] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:46 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1472 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:46.884640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2bab8063-651d-4713-8fa9-29b2f67b4691 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:46.887222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1584e0c9-aa19-44a1-b671-71faf6c9b962 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:46.889392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1584e0c9-aa19-44a1-b671-71faf6c9b962 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:46.900161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1584e0c9-aa19-44a1-b671-71faf6c9b962 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:46.901248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1584e0c9-aa19-44a1-b671-71faf6c9b962 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:46.901376 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2bab8063-651d-4713-8fa9-29b2f67b4691 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.461849 May 27 15:15:46.901970 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2100/4208] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:46 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:46.903023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1584e0c9-aa19-44a1-b671-71faf6c9b962 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:46.903720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1584e0c9-aa19-44a1-b671-71faf6c9b962 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:47.098859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1584e0c9-aa19-44a1-b671-71faf6c9b962 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:47.108713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1584e0c9-aa19-44a1-b671-71faf6c9b962 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:47.110217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1584e0c9-aa19-44a1-b671-71faf6c9b962 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:47.111471 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1584e0c9-aa19-44a1-b671-71faf6c9b962 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 2711 microversion: 2.42 time: 0.232442 May 27 15:15:47.112065 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2109/4209] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:15:46 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 2711 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:47.331186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-125265ad-a12d-4781-a417-7087dbf1ddc5 req-c6a07bd6-de09-4b77-a6dd-42273b29755e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "name": "network-vif-unplugged", "status": "completed", "tag": "f670de18-c094-413a-a6ff-240c82cf0d14"}, {"server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "name": "network-vif-unplugged", "status": "completed", "tag": "5befacb8-cfec-4bf9-a56e-4875b8d292ad"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:47.342894 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-125265ad-a12d-4781-a417-7087dbf1ddc5 req-c6a07bd6-de09-4b77-a6dd-42273b29755e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:47.343581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-125265ad-a12d-4781-a417-7087dbf1ddc5 req-c6a07bd6-de09-4b77-a6dd-42273b29755e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:47.360300 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-125265ad-a12d-4781-a417-7087dbf1ddc5 req-c6a07bd6-de09-4b77-a6dd-42273b29755e service nova] Creating event network-vif-unplugged:f670de18-c094-413a-a6ff-240c82cf0d14 for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:15:47.361037 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-125265ad-a12d-4781-a417-7087dbf1ddc5 req-c6a07bd6-de09-4b77-a6dd-42273b29755e service nova] Creating event network-vif-unplugged:5befacb8-cfec-4bf9-a56e-4875b8d292ad for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:15:47.368308 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-125265ad-a12d-4781-a417-7087dbf1ddc5 req-c6a07bd6-de09-4b77-a6dd-42273b29755e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.041130 May 27 15:15:47.369653 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2101/4210] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:47.446261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a601f53b-19ed-46a2-bed6-01ddefb695c2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:47.446815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a601f53b-19ed-46a2-bed6-01ddefb695c2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:47.461246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a601f53b-19ed-46a2-bed6-01ddefb695c2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:47.461993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a601f53b-19ed-46a2-bed6-01ddefb695c2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:47.463368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a601f53b-19ed-46a2-bed6-01ddefb695c2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:47.464052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a601f53b-19ed-46a2-bed6-01ddefb695c2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:47.659421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a601f53b-19ed-46a2-bed6-01ddefb695c2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:47.671139 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a601f53b-19ed-46a2-bed6-01ddefb695c2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1313 microversion: 2.1 time: 0.232443 May 27 15:15:47.684498 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2110/4211] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:47 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:47.848437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-73f56285-7598-4711-956f-ec32096ab549 req-76334220-64c8-4f14-beef-3c8808501c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "name": "network-vif-deleted", "tag": "f670de18-c094-413a-a6ff-240c82cf0d14"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:47.864042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-73f56285-7598-4711-956f-ec32096ab549 req-76334220-64c8-4f14-beef-3c8808501c15 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:47.865228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-73f56285-7598-4711-956f-ec32096ab549 req-76334220-64c8-4f14-beef-3c8808501c15 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:47.882307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-71fbeccc-fd26-48ca-b4e1-454adf46da1d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:47.883747 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-71fbeccc-fd26-48ca-b4e1-454adf46da1d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:47.893612 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71fbeccc-fd26-48ca-b4e1-454adf46da1d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:47.895712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71fbeccc-fd26-48ca-b4e1-454adf46da1d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:47.896802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71fbeccc-fd26-48ca-b4e1-454adf46da1d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:47.899647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71fbeccc-fd26-48ca-b4e1-454adf46da1d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:47.902807 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-73f56285-7598-4711-956f-ec32096ab549 req-76334220-64c8-4f14-beef-3c8808501c15 service nova] Creating event network-vif-deleted:f670de18-c094-413a-a6ff-240c82cf0d14 for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:15:47.925602 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-73f56285-7598-4711-956f-ec32096ab549 req-76334220-64c8-4f14-beef-3c8808501c15 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080797 May 27 15:15:47.926767 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2102/4212] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:47.944647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-63cc5ba0-d5b6-4956-a671-e9662b4bda30 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:47.950102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-63cc5ba0-d5b6-4956-a671-e9662b4bda30 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:47.976253 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63cc5ba0-d5b6-4956-a671-e9662b4bda30 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:47.977981 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63cc5ba0-d5b6-4956-a671-e9662b4bda30 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:47.981261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63cc5ba0-d5b6-4956-a671-e9662b4bda30 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:47.983950 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63cc5ba0-d5b6-4956-a671-e9662b4bda30 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:48.648338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-71fbeccc-fd26-48ca-b4e1-454adf46da1d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:48.654958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-63cc5ba0-d5b6-4956-a671-e9662b4bda30 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:48.657415 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-71fbeccc-fd26-48ca-b4e1-454adf46da1d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1472 microversion: 2.1 time: 0.779067 May 27 15:15:48.661619 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2111/4213] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:47 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1472 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:48.664401 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-63cc5ba0-d5b6-4956-a671-e9662b4bda30 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.736005 May 27 15:15:48.665182 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2103/4214] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:47 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:48.675744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-36481fe5-a670-4ca1-8614-9facaf6e8bd9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:48.676786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-36481fe5-a670-4ca1-8614-9facaf6e8bd9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:48.690874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6c8a8930-0652-49fd-8c42-5c6db737808e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:48.691502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6c8a8930-0652-49fd-8c42-5c6db737808e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:48.699520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36481fe5-a670-4ca1-8614-9facaf6e8bd9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:48.702443 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36481fe5-a670-4ca1-8614-9facaf6e8bd9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:48.702686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c8a8930-0652-49fd-8c42-5c6db737808e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:48.703668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36481fe5-a670-4ca1-8614-9facaf6e8bd9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:48.706492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c8a8930-0652-49fd-8c42-5c6db737808e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:48.706715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36481fe5-a670-4ca1-8614-9facaf6e8bd9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:48.707331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c8a8930-0652-49fd-8c42-5c6db737808e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:48.707781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c8a8930-0652-49fd-8c42-5c6db737808e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:49.050476 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6c8a8930-0652-49fd-8c42-5c6db737808e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:49.059899 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6c8a8930-0652-49fd-8c42-5c6db737808e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1334 microversion: 2.1 time: 0.372901 May 27 15:15:49.064537 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2104/4215] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:48 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1334 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:49.075109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-36481fe5-a670-4ca1-8614-9facaf6e8bd9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:49.097269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-36481fe5-a670-4ca1-8614-9facaf6e8bd9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:49.101830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-36481fe5-a670-4ca1-8614-9facaf6e8bd9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:49.107175 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-36481fe5-a670-4ca1-8614-9facaf6e8bd9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 2373 microversion: 2.42 time: 0.442650 May 27 15:15:49.108025 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2112/4216] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:15:48 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 2373 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:49.682572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7f718f5b-b475-4b44-af3d-dbf088b1fa0d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:49.684385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7f718f5b-b475-4b44-af3d-dbf088b1fa0d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:49.696894 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2fd45ebc-f4ea-410f-9189-7ec6c6221b46 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:49.698306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2fd45ebc-f4ea-410f-9189-7ec6c6221b46 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:49.732054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f718f5b-b475-4b44-af3d-dbf088b1fa0d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:49.735370 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f718f5b-b475-4b44-af3d-dbf088b1fa0d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:49.737581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f718f5b-b475-4b44-af3d-dbf088b1fa0d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:49.738362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2fd45ebc-f4ea-410f-9189-7ec6c6221b46 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:49.739919 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2fd45ebc-f4ea-410f-9189-7ec6c6221b46 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:49.741564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2fd45ebc-f4ea-410f-9189-7ec6c6221b46 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:49.742747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f718f5b-b475-4b44-af3d-dbf088b1fa0d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:49.749129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2fd45ebc-f4ea-410f-9189-7ec6c6221b46 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:49.868187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:50.079728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2fd45ebc-f4ea-410f-9189-7ec6c6221b46 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:50.089531 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2fd45ebc-f4ea-410f-9189-7ec6c6221b46 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.401198 May 27 15:15:50.097590 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2113/4217] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:49 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:50.107790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-db2cfdec-d135-4e98-8a8b-397a87ef9390 req-78aced85-95bf-46d6-b04c-671646f31c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "name": "network-vif-deleted", "tag": "100b1a63-83ab-408e-adb6-ce5865974f8f"}, {"server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "name": "network-vif-deleted", "tag": "5befacb8-cfec-4bf9-a56e-4875b8d292ad"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:50.114971 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7f718f5b-b475-4b44-af3d-dbf088b1fa0d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:50.131007 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7f718f5b-b475-4b44-af3d-dbf088b1fa0d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1472 microversion: 2.1 time: 0.455267 May 27 15:15:50.132603 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2105/4218] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:49 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1472 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:50.140112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3b502570-bff7-4d5f-aef5-2ab7c5ef2c65 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:50.141082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3b502570-bff7-4d5f-aef5-2ab7c5ef2c65 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:50.142808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-db2cfdec-d135-4e98-8a8b-397a87ef9390 req-78aced85-95bf-46d6-b04c-671646f31c72 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:50.146263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-db2cfdec-d135-4e98-8a8b-397a87ef9390 req-78aced85-95bf-46d6-b04c-671646f31c72 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:50.150294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b502570-bff7-4d5f-aef5-2ab7c5ef2c65 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:50.151059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b502570-bff7-4d5f-aef5-2ab7c5ef2c65 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:50.152103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b502570-bff7-4d5f-aef5-2ab7c5ef2c65 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:50.152967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b502570-bff7-4d5f-aef5-2ab7c5ef2c65 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:50.189741 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-db2cfdec-d135-4e98-8a8b-397a87ef9390 req-78aced85-95bf-46d6-b04c-671646f31c72 service nova] Creating event network-vif-deleted:100b1a63-83ab-408e-adb6-ce5865974f8f for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:15:50.190626 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-db2cfdec-d135-4e98-8a8b-397a87ef9390 req-78aced85-95bf-46d6-b04c-671646f31c72 service nova] Creating event network-vif-deleted:5befacb8-cfec-4bf9-a56e-4875b8d292ad for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:15:50.202715 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-db2cfdec-d135-4e98-8a8b-397a87ef9390 req-78aced85-95bf-46d6-b04c-671646f31c72 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.103819 May 27 15:15:50.210073 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2114/4219] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:50.216037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-813c4713-c35a-480d-9c45-b6f23767928d tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:50.221823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-813c4713-c35a-480d-9c45-b6f23767928d tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:50.229274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-813c4713-c35a-480d-9c45-b6f23767928d tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:50.230107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-813c4713-c35a-480d-9c45-b6f23767928d tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:50.231142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-813c4713-c35a-480d-9c45-b6f23767928d tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:50.231900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-813c4713-c35a-480d-9c45-b6f23767928d tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:50.335741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:50.658471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3b502570-bff7-4d5f-aef5-2ab7c5ef2c65 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:50.689073 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3b502570-bff7-4d5f-aef5-2ab7c5ef2c65 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1355 microversion: 2.1 time: 0.554300 May 27 15:15:50.692294 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2106/4220] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:50 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1355 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:50.709138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-813c4713-c35a-480d-9c45-b6f23767928d tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:50.722007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-813c4713-c35a-480d-9c45-b6f23767928d tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:50.723970 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-813c4713-c35a-480d-9c45-b6f23767928d tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:50.725501 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-813c4713-c35a-480d-9c45-b6f23767928d tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 2212 microversion: 2.42 time: 0.514140 May 27 15:15:50.726283 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2115/4221] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:15:50 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 2212 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:51.118583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ecd0e004-3952-4150-8044-0453bbc3414a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:51.119208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ecd0e004-3952-4150-8044-0453bbc3414a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:51.138420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ecd0e004-3952-4150-8044-0453bbc3414a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:51.138887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ecd0e004-3952-4150-8044-0453bbc3414a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:51.139685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ecd0e004-3952-4150-8044-0453bbc3414a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:51.141894 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ecd0e004-3952-4150-8044-0453bbc3414a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:51.153445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ae0a0bdb-063b-48ef-8f0e-efd924000899 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:51.154709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ae0a0bdb-063b-48ef-8f0e-efd924000899 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:51.166001 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=8 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:51.181716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae0a0bdb-063b-48ef-8f0e-efd924000899 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:51.183179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae0a0bdb-063b-48ef-8f0e-efd924000899 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:51.184376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae0a0bdb-063b-48ef-8f0e-efd924000899 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:51.193561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae0a0bdb-063b-48ef-8f0e-efd924000899 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:51.483722 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ecd0e004-3952-4150-8044-0453bbc3414a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:51.503238 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ecd0e004-3952-4150-8044-0453bbc3414a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.392264 May 27 15:15:51.513589 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2107/4222] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:51 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:51.549896 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ae0a0bdb-063b-48ef-8f0e-efd924000899 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:51.558385 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ae0a0bdb-063b-48ef-8f0e-efd924000899 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1472 microversion: 2.1 time: 0.411844 May 27 15:15:51.562164 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2116/4223] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:51 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1472 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:51.715645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cd2bbec9-b504-4ebb-a9cb-9228d38f477d tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:51.717291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cd2bbec9-b504-4ebb-a9cb-9228d38f477d tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:51.741422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cd2bbec9-b504-4ebb-a9cb-9228d38f477d tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:51.742514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cd2bbec9-b504-4ebb-a9cb-9228d38f477d tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:51.750788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e74447bd-6679-483f-b8b0-9b4f835f5df5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:51.751459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e74447bd-6679-483f-b8b0-9b4f835f5df5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:51.756723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cd2bbec9-b504-4ebb-a9cb-9228d38f477d tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:51.757436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cd2bbec9-b504-4ebb-a9cb-9228d38f477d tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:51.768899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e74447bd-6679-483f-b8b0-9b4f835f5df5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:51.769848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e74447bd-6679-483f-b8b0-9b4f835f5df5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:51.770886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e74447bd-6679-483f-b8b0-9b4f835f5df5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:51.772512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e74447bd-6679-483f-b8b0-9b4f835f5df5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:52.115268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e74447bd-6679-483f-b8b0-9b4f835f5df5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:52.153149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cd2bbec9-b504-4ebb-a9cb-9228d38f477d tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:52.161772 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e74447bd-6679-483f-b8b0-9b4f835f5df5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:52.165536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e74447bd-6679-483f-b8b0-9b4f835f5df5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:52.166105 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cd2bbec9-b504-4ebb-a9cb-9228d38f477d tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1355 microversion: 2.1 time: 0.455683 May 27 15:15:52.171747 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e74447bd-6679-483f-b8b0-9b4f835f5df5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.427142 May 27 15:15:52.172897 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2108/4224] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:51 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1355 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:52.174691 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2117/4225] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:15:51 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:52.522786 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-04ac8c77-e2f2-4b36-ae9c-e060f0e38ecf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:52.524095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-04ac8c77-e2f2-4b36-ae9c-e060f0e38ecf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:52.542970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04ac8c77-e2f2-4b36-ae9c-e060f0e38ecf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:52.545960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04ac8c77-e2f2-4b36-ae9c-e060f0e38ecf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:52.547050 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04ac8c77-e2f2-4b36-ae9c-e060f0e38ecf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:52.547515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04ac8c77-e2f2-4b36-ae9c-e060f0e38ecf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:52.583431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-530919ba-dea9-4c69-be8c-eea0ae01f343 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:52.584853 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-530919ba-dea9-4c69-be8c-eea0ae01f343 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:52.593461 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-530919ba-dea9-4c69-be8c-eea0ae01f343 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:52.594471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-530919ba-dea9-4c69-be8c-eea0ae01f343 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:52.596516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-530919ba-dea9-4c69-be8c-eea0ae01f343 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:52.597269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-530919ba-dea9-4c69-be8c-eea0ae01f343 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:52.905854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-04ac8c77-e2f2-4b36-ae9c-e060f0e38ecf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:52.916113 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-04ac8c77-e2f2-4b36-ae9c-e060f0e38ecf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.398951 May 27 15:15:52.921375 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2109/4226] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:52 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:52.935908 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-b2b49abf-0bf5-400b-a7fe-21f111c4ac93 req-10b3e37b-a9d4-4736-81a4-5dee3e4ecbdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d", "name": "network-vif-deleted", "tag": "4fae3a94-8715-4a88-a516-e2014c141251"}, {"name": "network-changed", "server_uuid": "117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44", "tag": "8694e71a-6b70-4c7e-afe3-e17a6b86d8e9"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:52.957884 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-b2b49abf-0bf5-400b-a7fe-21f111c4ac93 req-10b3e37b-a9d4-4736-81a4-5dee3e4ecbdc service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:52.958362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-b2b49abf-0bf5-400b-a7fe-21f111c4ac93 req-10b3e37b-a9d4-4736-81a4-5dee3e4ecbdc service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:52.982547 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-b2b49abf-0bf5-400b-a7fe-21f111c4ac93 req-10b3e37b-a9d4-4736-81a4-5dee3e4ecbdc service nova] Creating event network-vif-deleted:4fae3a94-8715-4a88-a516-e2014c141251 for instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d on n-h2-843621-1 May 27 15:15:52.989624 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-b2b49abf-0bf5-400b-a7fe-21f111c4ac93 req-10b3e37b-a9d4-4736-81a4-5dee3e4ecbdc service nova] Creating event network-changed:8694e71a-6b70-4c7e-afe3-e17a6b86d8e9 for instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 on n-h1-843621-1 May 27 15:15:53.016620 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-b2b49abf-0bf5-400b-a7fe-21f111c4ac93 req-10b3e37b-a9d4-4736-81a4-5dee3e4ecbdc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.093885 May 27 15:15:53.023220 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2110/4227] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:53.080303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-530919ba-dea9-4c69-be8c-eea0ae01f343 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:53.094437 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-530919ba-dea9-4c69-be8c-eea0ae01f343 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1472 microversion: 2.1 time: 0.518620 May 27 15:15:53.097254 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2118/4228] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:52 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1472 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:53.199132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-df849b83-8955-4018-9d32-1c02b930631a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:53.202410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-df849b83-8955-4018-9d32-1c02b930631a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:53.205967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-89565b71-dfb2-423b-a920-40b12ef685ad tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:53.209339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-89565b71-dfb2-423b-a920-40b12ef685ad tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:53.228012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df849b83-8955-4018-9d32-1c02b930631a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.233088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df849b83-8955-4018-9d32-1c02b930631a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:53.236454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df849b83-8955-4018-9d32-1c02b930631a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.237647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df849b83-8955-4018-9d32-1c02b930631a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:53.242921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89565b71-dfb2-423b-a920-40b12ef685ad tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.245234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89565b71-dfb2-423b-a920-40b12ef685ad tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:53.246704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89565b71-dfb2-423b-a920-40b12ef685ad tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.249251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89565b71-dfb2-423b-a920-40b12ef685ad tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:53.381990 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-df849b83-8955-4018-9d32-1c02b930631a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:53.404433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-df849b83-8955-4018-9d32-1c02b930631a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:53.410697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-df849b83-8955-4018-9d32-1c02b930631a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:53.420993 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-df849b83-8955-4018-9d32-1c02b930631a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.220921 May 27 15:15:53.434911 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2119/4229] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:15:53 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:15:53.611187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-89565b71-dfb2-423b-a920-40b12ef685ad tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:53.623161 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-89565b71-dfb2-423b-a920-40b12ef685ad tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1355 microversion: 2.1 time: 0.436175 May 27 15:15:53.633612 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2111/4230] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:53 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1355 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:53.935338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-88ad980e-c7f0-4ba6-b47b-234e1f1baecb tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:53.936115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-88ad980e-c7f0-4ba6-b47b-234e1f1baecb tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:53.950708 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-88ad980e-c7f0-4ba6-b47b-234e1f1baecb tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.952143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-88ad980e-c7f0-4ba6-b47b-234e1f1baecb tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:53.953127 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-88ad980e-c7f0-4ba6-b47b-234e1f1baecb tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.955155 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-88ad980e-c7f0-4ba6-b47b-234e1f1baecb tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:54.119062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-84783566-aaf2-49e2-bd10-b789a7536cf0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:54.120132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-84783566-aaf2-49e2-bd10-b789a7536cf0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:54.144552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84783566-aaf2-49e2-bd10-b789a7536cf0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:54.145072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84783566-aaf2-49e2-bd10-b789a7536cf0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:54.147221 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84783566-aaf2-49e2-bd10-b789a7536cf0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:54.147922 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84783566-aaf2-49e2-bd10-b789a7536cf0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:54.237828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-88ad980e-c7f0-4ba6-b47b-234e1f1baecb tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:54.246999 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-88ad980e-c7f0-4ba6-b47b-234e1f1baecb tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.316049 May 27 15:15:54.251196 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2120/4231] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:53 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:54.443086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5fd69e1d-f3ba-42d3-b2d8-6f4114d2afa6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:54.443874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5fd69e1d-f3ba-42d3-b2d8-6f4114d2afa6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:54.453839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-84783566-aaf2-49e2-bd10-b789a7536cf0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:54.455739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fd69e1d-f3ba-42d3-b2d8-6f4114d2afa6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:54.459284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fd69e1d-f3ba-42d3-b2d8-6f4114d2afa6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:54.460445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fd69e1d-f3ba-42d3-b2d8-6f4114d2afa6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:54.461789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fd69e1d-f3ba-42d3-b2d8-6f4114d2afa6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:54.469478 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-84783566-aaf2-49e2-bd10-b789a7536cf0 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1472 microversion: 2.1 time: 0.361302 May 27 15:15:54.470090 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2112/4232] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:54 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1472 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:54.582345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5fd69e1d-f3ba-42d3-b2d8-6f4114d2afa6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:54.598185 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5fd69e1d-f3ba-42d3-b2d8-6f4114d2afa6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:54.600220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5fd69e1d-f3ba-42d3-b2d8-6f4114d2afa6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:54.608986 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5fd69e1d-f3ba-42d3-b2d8-6f4114d2afa6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.169715 May 27 15:15:54.612880 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2121/4233] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:15:54 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:54.640936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-797ef361-b093-4cb4-9078-5670b5b54f27 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:54.641629 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-797ef361-b093-4cb4-9078-5670b5b54f27 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:54.653479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-797ef361-b093-4cb4-9078-5670b5b54f27 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:54.653744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-797ef361-b093-4cb4-9078-5670b5b54f27 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:54.654584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-797ef361-b093-4cb4-9078-5670b5b54f27 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:54.655052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-797ef361-b093-4cb4-9078-5670b5b54f27 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:55.010565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-797ef361-b093-4cb4-9078-5670b5b54f27 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:55.019896 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-797ef361-b093-4cb4-9078-5670b5b54f27 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1355 microversion: 2.1 time: 0.382872 May 27 15:15:55.031777 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2113/4234] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:54 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1355 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:55.056025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-a248f078-d057-4e2a-bb03-97dc5042f3b7 req-c9e9cba9-3d72-4ca4-af46-f61826cf21c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44", "tag": "f99d4329-b5be-4d81-bfda-4d57a16a90a3"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:55.086303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-a248f078-d057-4e2a-bb03-97dc5042f3b7 req-c9e9cba9-3d72-4ca4-af46-f61826cf21c5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:55.086772 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-a248f078-d057-4e2a-bb03-97dc5042f3b7 req-c9e9cba9-3d72-4ca4-af46-f61826cf21c5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:55.120489 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-a248f078-d057-4e2a-bb03-97dc5042f3b7 req-c9e9cba9-3d72-4ca4-af46-f61826cf21c5 service nova] Creating event network-changed:f99d4329-b5be-4d81-bfda-4d57a16a90a3 for instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 on n-h1-843621-1 May 27 15:15:55.143751 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-a248f078-d057-4e2a-bb03-97dc5042f3b7 req-c9e9cba9-3d72-4ca4-af46-f61826cf21c5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091047 May 27 15:15:55.146298 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2122/4235] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:55.271518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d7ea783f-59d9-4991-b469-4b12bb24d1f7 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:55.272305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d7ea783f-59d9-4991-b469-4b12bb24d1f7 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:55.295948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7ea783f-59d9-4991-b469-4b12bb24d1f7 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:55.296635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7ea783f-59d9-4991-b469-4b12bb24d1f7 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:55.299532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7ea783f-59d9-4991-b469-4b12bb24d1f7 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:55.306718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7ea783f-59d9-4991-b469-4b12bb24d1f7 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:55.493733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f30474e0-53b0-4345-8513-eeeca3db3304 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:55.498103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f30474e0-53b0-4345-8513-eeeca3db3304 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:55.510929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f30474e0-53b0-4345-8513-eeeca3db3304 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:55.511758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f30474e0-53b0-4345-8513-eeeca3db3304 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:55.512872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f30474e0-53b0-4345-8513-eeeca3db3304 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:55.513729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f30474e0-53b0-4345-8513-eeeca3db3304 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:55.619383 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d7ea783f-59d9-4991-b469-4b12bb24d1f7 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:55.632691 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d7ea783f-59d9-4991-b469-4b12bb24d1f7 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.367190 May 27 15:15:55.638139 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2114/4236] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:55 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:55.652920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-394f3b17-89a0-41ce-bd9d-486855150bd9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:55.653853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-394f3b17-89a0-41ce-bd9d-486855150bd9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:55.673262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-394f3b17-89a0-41ce-bd9d-486855150bd9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:55.677769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-394f3b17-89a0-41ce-bd9d-486855150bd9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:55.682076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-394f3b17-89a0-41ce-bd9d-486855150bd9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:55.687313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-394f3b17-89a0-41ce-bd9d-486855150bd9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:55.726597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:55.875841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-394f3b17-89a0-41ce-bd9d-486855150bd9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:55.894571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-394f3b17-89a0-41ce-bd9d-486855150bd9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:55.902131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-394f3b17-89a0-41ce-bd9d-486855150bd9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:55.903437 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-394f3b17-89a0-41ce-bd9d-486855150bd9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.263348 May 27 15:15:55.904038 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2115/4237] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:15:55 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:55.962974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f30474e0-53b0-4345-8513-eeeca3db3304 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:55.975542 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f30474e0-53b0-4345-8513-eeeca3db3304 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1472 microversion: 2.1 time: 0.489813 May 27 15:15:55.976741 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2123/4238] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:55 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1472 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:56.037159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3e531bea-32eb-4d6a-8240-3ea9af716305 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:56.038056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3e531bea-32eb-4d6a-8240-3ea9af716305 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:56.045793 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e531bea-32eb-4d6a-8240-3ea9af716305 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:56.052790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e531bea-32eb-4d6a-8240-3ea9af716305 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:56.053822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e531bea-32eb-4d6a-8240-3ea9af716305 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:56.057064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e531bea-32eb-4d6a-8240-3ea9af716305 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:56.339832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3e531bea-32eb-4d6a-8240-3ea9af716305 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:56.353413 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3e531bea-32eb-4d6a-8240-3ea9af716305 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1355 microversion: 2.1 time: 0.317454 May 27 15:15:56.354736 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2116/4239] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:56 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1355 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:56.656960 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-731d9b80-dcf4-4f57-bd99-ed36c97bb9cb tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:56.658752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-731d9b80-dcf4-4f57-bd99-ed36c97bb9cb tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:56.666896 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-731d9b80-dcf4-4f57-bd99-ed36c97bb9cb tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:56.667627 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-731d9b80-dcf4-4f57-bd99-ed36c97bb9cb tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:56.668584 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-731d9b80-dcf4-4f57-bd99-ed36c97bb9cb tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:56.669219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-731d9b80-dcf4-4f57-bd99-ed36c97bb9cb tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:56.839277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-731d9b80-dcf4-4f57-bd99-ed36c97bb9cb tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:56.849029 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-731d9b80-dcf4-4f57-bd99-ed36c97bb9cb tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.196012 May 27 15:15:56.859413 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2124/4240] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:56 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:56.924625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-aff05b15-cdc2-450a-bfa0-31e764a0b4f1 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:56.925633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-aff05b15-cdc2-450a-bfa0-31e764a0b4f1 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:56.936488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aff05b15-cdc2-450a-bfa0-31e764a0b4f1 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:56.937015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aff05b15-cdc2-450a-bfa0-31e764a0b4f1 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:56.937931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aff05b15-cdc2-450a-bfa0-31e764a0b4f1 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:56.938324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aff05b15-cdc2-450a-bfa0-31e764a0b4f1 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:56.993704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1cbc5cf6-1eea-48dd-b973-8f6617a4d8d1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:56.994364 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1cbc5cf6-1eea-48dd-b973-8f6617a4d8d1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:57.001389 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1cbc5cf6-1eea-48dd-b973-8f6617a4d8d1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:57.007901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1cbc5cf6-1eea-48dd-b973-8f6617a4d8d1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:57.009000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1cbc5cf6-1eea-48dd-b973-8f6617a4d8d1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:57.009683 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1cbc5cf6-1eea-48dd-b973-8f6617a4d8d1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:57.032575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-aff05b15-cdc2-450a-bfa0-31e764a0b4f1 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:57.044043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-aff05b15-cdc2-450a-bfa0-31e764a0b4f1 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:57.047133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-aff05b15-cdc2-450a-bfa0-31e764a0b4f1 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:57.048901 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-aff05b15-cdc2-450a-bfa0-31e764a0b4f1 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.130276 May 27 15:15:57.050137 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2117/4241] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:15:56 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:57.254437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1cbc5cf6-1eea-48dd-b973-8f6617a4d8d1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:57.271896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-81f68279-9dad-498a-a2d9-9d0fe462d2fe req-8aea3b45-09c7-4d2c-b3db-ba6c35567b6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44", "tag": "9ec1c794-7419-421d-bf77-36d41479ca12"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:57.294647 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1cbc5cf6-1eea-48dd-b973-8f6617a4d8d1 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1472 microversion: 2.1 time: 0.300140 May 27 15:15:57.313037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-81f68279-9dad-498a-a2d9-9d0fe462d2fe req-8aea3b45-09c7-4d2c-b3db-ba6c35567b6c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:57.315462 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2125/4242] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:56 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1472 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:57.320065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-81f68279-9dad-498a-a2d9-9d0fe462d2fe req-8aea3b45-09c7-4d2c-b3db-ba6c35567b6c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:57.338370 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-81f68279-9dad-498a-a2d9-9d0fe462d2fe req-8aea3b45-09c7-4d2c-b3db-ba6c35567b6c service nova] Creating event network-changed:9ec1c794-7419-421d-bf77-36d41479ca12 for instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 on n-h1-843621-1 May 27 15:15:57.355669 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-81f68279-9dad-498a-a2d9-9d0fe462d2fe req-8aea3b45-09c7-4d2c-b3db-ba6c35567b6c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091717 May 27 15:15:57.359203 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2118/4243] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:15:57.379489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b8796863-f244-4f11-88ea-f9830b876d51 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:57.380114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b8796863-f244-4f11-88ea-f9830b876d51 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:57.396279 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8796863-f244-4f11-88ea-f9830b876d51 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:57.396829 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8796863-f244-4f11-88ea-f9830b876d51 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:57.397641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8796863-f244-4f11-88ea-f9830b876d51 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:57.401186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8796863-f244-4f11-88ea-f9830b876d51 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:57.639769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b8796863-f244-4f11-88ea-f9830b876d51 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:57.650267 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b8796863-f244-4f11-88ea-f9830b876d51 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1355 microversion: 2.1 time: 0.273244 May 27 15:15:57.651402 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2126/4244] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:57 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1355 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:57.868608 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d0c57ffb-197e-4109-85be-387f0bfaa2f7 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:57.869647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d0c57ffb-197e-4109-85be-387f0bfaa2f7 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:57.877629 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0c57ffb-197e-4109-85be-387f0bfaa2f7 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:57.878238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0c57ffb-197e-4109-85be-387f0bfaa2f7 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:57.879140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0c57ffb-197e-4109-85be-387f0bfaa2f7 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:57.879657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0c57ffb-197e-4109-85be-387f0bfaa2f7 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:58.019767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d0c57ffb-197e-4109-85be-387f0bfaa2f7 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:58.029734 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d0c57ffb-197e-4109-85be-387f0bfaa2f7 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.166153 May 27 15:15:58.033041 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2119/4245] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:57 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:58.068793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-60a067db-1329-49e5-8906-c35e96eeed52 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:58.069522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-60a067db-1329-49e5-8906-c35e96eeed52 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:58.077560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-60a067db-1329-49e5-8906-c35e96eeed52 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:58.078024 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-60a067db-1329-49e5-8906-c35e96eeed52 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:58.078836 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-60a067db-1329-49e5-8906-c35e96eeed52 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:58.079413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-60a067db-1329-49e5-8906-c35e96eeed52 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:58.151928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-60a067db-1329-49e5-8906-c35e96eeed52 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:58.162318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-60a067db-1329-49e5-8906-c35e96eeed52 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:58.163838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-60a067db-1329-49e5-8906-c35e96eeed52 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:58.165069 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-60a067db-1329-49e5-8906-c35e96eeed52 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.101556 May 27 15:15:58.165638 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2127/4246] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:15:58 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:58.318235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bc770a08-c208-477d-8ca0-ab9599de3316 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:58.319304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bc770a08-c208-477d-8ca0-ab9599de3316 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:58.326289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc770a08-c208-477d-8ca0-ab9599de3316 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:58.326754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc770a08-c208-477d-8ca0-ab9599de3316 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:58.327561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc770a08-c208-477d-8ca0-ab9599de3316 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:58.328061 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc770a08-c208-477d-8ca0-ab9599de3316 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:58.494456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bc770a08-c208-477d-8ca0-ab9599de3316 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:58.503465 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bc770a08-c208-477d-8ca0-ab9599de3316 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1472 microversion: 2.1 time: 0.189143 May 27 15:15:58.504157 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2120/4247] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:58 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:58.667802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-25c65d86-d17a-4421-b329-19f7d0ad7d4e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:58.668556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-25c65d86-d17a-4421-b329-19f7d0ad7d4e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:58.670695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:58.682490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-25c65d86-d17a-4421-b329-19f7d0ad7d4e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:58.682490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-25c65d86-d17a-4421-b329-19f7d0ad7d4e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:58.683324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-25c65d86-d17a-4421-b329-19f7d0ad7d4e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:58.683836 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-25c65d86-d17a-4421-b329-19f7d0ad7d4e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:58.875920 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-25c65d86-d17a-4421-b329-19f7d0ad7d4e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:58.884618 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-25c65d86-d17a-4421-b329-19f7d0ad7d4e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1355 microversion: 2.1 time: 0.221079 May 27 15:15:58.885561 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2128/4248] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:58 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1355 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:59.047745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d1030a09-1d97-46f6-9c54-f5b1762c0ce4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:59.048711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d1030a09-1d97-46f6-9c54-f5b1762c0ce4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:59.064210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d1030a09-1d97-46f6-9c54-f5b1762c0ce4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:59.065491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d1030a09-1d97-46f6-9c54-f5b1762c0ce4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:59.066518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d1030a09-1d97-46f6-9c54-f5b1762c0ce4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:59.067118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d1030a09-1d97-46f6-9c54-f5b1762c0ce4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:59.183563 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8c7b2c69-5a09-4ff8-befd-0ed98a0255c3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:59.184191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8c7b2c69-5a09-4ff8-befd-0ed98a0255c3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:59.196350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c7b2c69-5a09-4ff8-befd-0ed98a0255c3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:59.197190 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c7b2c69-5a09-4ff8-befd-0ed98a0255c3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:59.201773 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c7b2c69-5a09-4ff8-befd-0ed98a0255c3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:59.202467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c7b2c69-5a09-4ff8-befd-0ed98a0255c3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:59.260393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d1030a09-1d97-46f6-9c54-f5b1762c0ce4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:59.269625 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d1030a09-1d97-46f6-9c54-f5b1762c0ce4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.225949 May 27 15:15:59.270496 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2121/4249] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:59 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:59.296118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8c7b2c69-5a09-4ff8-befd-0ed98a0255c3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:59.307277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8c7b2c69-5a09-4ff8-befd-0ed98a0255c3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:59.309139 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8c7b2c69-5a09-4ff8-befd-0ed98a0255c3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:59.310523 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8c7b2c69-5a09-4ff8-befd-0ed98a0255c3 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.131026 May 27 15:15:59.311642 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2129/4250] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:15:59 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:59.520291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b7c82014-9ed1-4393-9f50-5caad9c36cea tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:59.521566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b7c82014-9ed1-4393-9f50-5caad9c36cea tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:59.528566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b7c82014-9ed1-4393-9f50-5caad9c36cea tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:59.529293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b7c82014-9ed1-4393-9f50-5caad9c36cea tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:59.530245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b7c82014-9ed1-4393-9f50-5caad9c36cea tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:59.530857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b7c82014-9ed1-4393-9f50-5caad9c36cea tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:59.688178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b7c82014-9ed1-4393-9f50-5caad9c36cea tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:59.699978 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b7c82014-9ed1-4393-9f50-5caad9c36cea tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1478 microversion: 2.1 time: 0.183452 May 27 15:15:59.710675 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2122/4251] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:59 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1478 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:59.905101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fd7c0bbc-975e-41ca-bc4b-8f54c34dc414 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:59.905727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fd7c0bbc-975e-41ca-bc4b-8f54c34dc414 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:59.913624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd7c0bbc-975e-41ca-bc4b-8f54c34dc414 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:59.914089 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd7c0bbc-975e-41ca-bc4b-8f54c34dc414 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:59.914880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd7c0bbc-975e-41ca-bc4b-8f54c34dc414 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:59.915324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd7c0bbc-975e-41ca-bc4b-8f54c34dc414 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:00.147177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fd7c0bbc-975e-41ca-bc4b-8f54c34dc414 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:00.165708 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fd7c0bbc-975e-41ca-bc4b-8f54c34dc414 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1355 microversion: 2.1 time: 0.266356 May 27 15:16:00.166841 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2130/4252] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:15:59 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1355 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:00.291355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9fdf8d25-3d02-4296-819c-eb8e402052b6 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:00.292776 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9fdf8d25-3d02-4296-819c-eb8e402052b6 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:00.301152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9fdf8d25-3d02-4296-819c-eb8e402052b6 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:00.301752 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9fdf8d25-3d02-4296-819c-eb8e402052b6 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:00.303044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9fdf8d25-3d02-4296-819c-eb8e402052b6 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:00.303590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9fdf8d25-3d02-4296-819c-eb8e402052b6 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:00.342144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8b80b88a-c862-4bba-a8bd-e3ff28d61aba tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:00.353725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8b80b88a-c862-4bba-a8bd-e3ff28d61aba tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:00.365182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b80b88a-c862-4bba-a8bd-e3ff28d61aba tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:00.365952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b80b88a-c862-4bba-a8bd-e3ff28d61aba tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:00.366916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b80b88a-c862-4bba-a8bd-e3ff28d61aba tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:00.378213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b80b88a-c862-4bba-a8bd-e3ff28d61aba tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:00.439991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:00.513780 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8b80b88a-c862-4bba-a8bd-e3ff28d61aba tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:00.530562 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8b80b88a-c862-4bba-a8bd-e3ff28d61aba tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:00.534946 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8b80b88a-c862-4bba-a8bd-e3ff28d61aba tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:00.545220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9fdf8d25-3d02-4296-819c-eb8e402052b6 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:00.546457 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8b80b88a-c862-4bba-a8bd-e3ff28d61aba tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.208458 May 27 15:16:00.547635 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2131/4253] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:00 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:00.562388 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9fdf8d25-3d02-4296-819c-eb8e402052b6 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.277138 May 27 15:16:00.563737 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2123/4254] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:00 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:00.717553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-acfffb47-8ecc-4263-aa75-44e6487b4a22 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:00.718320 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-acfffb47-8ecc-4263-aa75-44e6487b4a22 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:00.726306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-acfffb47-8ecc-4263-aa75-44e6487b4a22 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:00.727013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-acfffb47-8ecc-4263-aa75-44e6487b4a22 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:00.728009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-acfffb47-8ecc-4263-aa75-44e6487b4a22 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:00.728523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-acfffb47-8ecc-4263-aa75-44e6487b4a22 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:00.944099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-acfffb47-8ecc-4263-aa75-44e6487b4a22 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:00.952402 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-acfffb47-8ecc-4263-aa75-44e6487b4a22 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1478 microversion: 2.1 time: 0.239535 May 27 15:16:00.955715 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2132/4255] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:00 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1478 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:01.185682 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f4102993-529b-4910-bf76-e707b284e8ee tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:01.186320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f4102993-529b-4910-bf76-e707b284e8ee tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:01.197476 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4102993-529b-4910-bf76-e707b284e8ee tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:01.197947 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4102993-529b-4910-bf76-e707b284e8ee tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:01.198748 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4102993-529b-4910-bf76-e707b284e8ee tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:01.199203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4102993-529b-4910-bf76-e707b284e8ee tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:01.411675 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f4102993-529b-4910-bf76-e707b284e8ee tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:01.419874 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f4102993-529b-4910-bf76-e707b284e8ee tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1355 microversion: 2.1 time: 0.240170 May 27 15:16:01.430459 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2124/4256] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:01 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1355 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:01.566913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5846859a-6ae6-4fa5-880e-4ece887b3ee7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:01.568260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5846859a-6ae6-4fa5-880e-4ece887b3ee7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:01.579431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ec5ae987-c593-400d-8332-4e1e6eb72d75 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:01.580719 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ec5ae987-c593-400d-8332-4e1e6eb72d75 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:01.587675 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5846859a-6ae6-4fa5-880e-4ece887b3ee7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:01.592485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5846859a-6ae6-4fa5-880e-4ece887b3ee7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:01.593564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5846859a-6ae6-4fa5-880e-4ece887b3ee7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:01.593826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec5ae987-c593-400d-8332-4e1e6eb72d75 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:01.594521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec5ae987-c593-400d-8332-4e1e6eb72d75 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:01.596085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec5ae987-c593-400d-8332-4e1e6eb72d75 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:01.596418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5846859a-6ae6-4fa5-880e-4ece887b3ee7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:01.598149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec5ae987-c593-400d-8332-4e1e6eb72d75 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:01.771536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5846859a-6ae6-4fa5-880e-4ece887b3ee7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:01.790886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5846859a-6ae6-4fa5-880e-4ece887b3ee7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:01.805949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5846859a-6ae6-4fa5-880e-4ece887b3ee7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:01.810093 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5846859a-6ae6-4fa5-880e-4ece887b3ee7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.247583 May 27 15:16:01.812274 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2133/4257] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:01 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:01.936115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ec5ae987-c593-400d-8332-4e1e6eb72d75 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:01.944394 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ec5ae987-c593-400d-8332-4e1e6eb72d75 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.368789 May 27 15:16:01.949009 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2125/4258] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:01 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:01.971350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6f746b7b-65d5-4d43-a39c-106f15b84914 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:01.972064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6f746b7b-65d5-4d43-a39c-106f15b84914 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:01.983213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f746b7b-65d5-4d43-a39c-106f15b84914 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:01.983691 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f746b7b-65d5-4d43-a39c-106f15b84914 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:01.985484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f746b7b-65d5-4d43-a39c-106f15b84914 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:01.985947 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f746b7b-65d5-4d43-a39c-106f15b84914 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:02.209844 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6f746b7b-65d5-4d43-a39c-106f15b84914 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:02.217957 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6f746b7b-65d5-4d43-a39c-106f15b84914 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1478 microversion: 2.1 time: 0.251932 May 27 15:16:02.218533 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2134/4259] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:01 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1478 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:02.328566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-baf38391-7cc8-4d3c-a2f1-90e39803056c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:02.328998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-baf38391-7cc8-4d3c-a2f1-90e39803056c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:02.342654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-baf38391-7cc8-4d3c-a2f1-90e39803056c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:02.343113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-baf38391-7cc8-4d3c-a2f1-90e39803056c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:02.343900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-baf38391-7cc8-4d3c-a2f1-90e39803056c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:02.344350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-baf38391-7cc8-4d3c-a2f1-90e39803056c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:02.394348 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-baf38391-7cc8-4d3c-a2f1-90e39803056c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/ips" status: 200 len: 149 microversion: 2.1 time: 0.071739 May 27 15:16:02.395287 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2126/4260] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 15:16:02 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/ips => generated 149 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:02.439800 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-deadc6cd-c7c8-40ce-a48c-c38074d4697b tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:02.440738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-deadc6cd-c7c8-40ce-a48c-c38074d4697b tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:02.448895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-deadc6cd-c7c8-40ce-a48c-c38074d4697b tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:02.449291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-deadc6cd-c7c8-40ce-a48c-c38074d4697b tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:02.450085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-deadc6cd-c7c8-40ce-a48c-c38074d4697b tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:02.450679 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-deadc6cd-c7c8-40ce-a48c-c38074d4697b tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:02.772312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-deadc6cd-c7c8-40ce-a48c-c38074d4697b tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:02.782358 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-deadc6cd-c7c8-40ce-a48c-c38074d4697b tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1355 microversion: 2.1 time: 0.347394 May 27 15:16:02.793142 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2135/4261] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:02 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1355 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:02.832520 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5a8071f6-2682-44c0-bc67-de14964bf208 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:02.833344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5a8071f6-2682-44c0-bc67-de14964bf208 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:02.842073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a8071f6-2682-44c0-bc67-de14964bf208 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:02.842899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a8071f6-2682-44c0-bc67-de14964bf208 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:02.844284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a8071f6-2682-44c0-bc67-de14964bf208 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:02.845139 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a8071f6-2682-44c0-bc67-de14964bf208 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:02.951790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5a8071f6-2682-44c0-bc67-de14964bf208 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:02.962811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-646d1bdd-8c18-4ed7-b793-1a2029ddf371 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:02.963602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-646d1bdd-8c18-4ed7-b793-1a2029ddf371 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:02.980286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5a8071f6-2682-44c0-bc67-de14964bf208 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:02.984914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-646d1bdd-8c18-4ed7-b793-1a2029ddf371 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:02.988381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-646d1bdd-8c18-4ed7-b793-1a2029ddf371 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:02.989395 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-646d1bdd-8c18-4ed7-b793-1a2029ddf371 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:02.991832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5a8071f6-2682-44c0-bc67-de14964bf208 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:02.992105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-646d1bdd-8c18-4ed7-b793-1a2029ddf371 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:03.000246 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5a8071f6-2682-44c0-bc67-de14964bf208 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.172454 May 27 15:16:03.002648 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2127/4262] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:02 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:03.155913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-d353d7e7-6930-48e9-b3f2-e93f19540a04 req-f1ad880f-8e06-49bb-b350-425acce12706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38fbe9fb-a213-462c-a8af-ad601edd4928", "name": "network-vif-unplugged", "status": "completed", "tag": "2c770865-695e-4c59-acf2-cd06a2ac073c"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:03.169981 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d353d7e7-6930-48e9-b3f2-e93f19540a04 req-f1ad880f-8e06-49bb-b350-425acce12706 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:03.173622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d353d7e7-6930-48e9-b3f2-e93f19540a04 req-f1ad880f-8e06-49bb-b350-425acce12706 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:03.198806 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-d353d7e7-6930-48e9-b3f2-e93f19540a04 req-f1ad880f-8e06-49bb-b350-425acce12706 service nova] Creating event network-vif-unplugged:2c770865-695e-4c59-acf2-cd06a2ac073c for instance 38fbe9fb-a213-462c-a8af-ad601edd4928 on n-h2-843621-1 May 27 15:16:03.238842 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-d353d7e7-6930-48e9-b3f2-e93f19540a04 req-f1ad880f-8e06-49bb-b350-425acce12706 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089210 May 27 15:16:03.241174 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2128/4263] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:03.259710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-67457eba-0468-4e2e-ad83-472d15211ecb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:03.262718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-67457eba-0468-4e2e-ad83-472d15211ecb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:03.297994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67457eba-0468-4e2e-ad83-472d15211ecb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:03.298459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67457eba-0468-4e2e-ad83-472d15211ecb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:03.301969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67457eba-0468-4e2e-ad83-472d15211ecb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:03.307609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67457eba-0468-4e2e-ad83-472d15211ecb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:03.367258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-646d1bdd-8c18-4ed7-b793-1a2029ddf371 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:03.381789 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-646d1bdd-8c18-4ed7-b793-1a2029ddf371 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.423393 May 27 15:16:03.403530 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2136/4264] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:02 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:03.676557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-67457eba-0468-4e2e-ad83-472d15211ecb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:03.693964 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-67457eba-0468-4e2e-ad83-472d15211ecb tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1478 microversion: 2.1 time: 0.450393 May 27 15:16:03.694558 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2129/4265] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:03 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1478 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:03.801206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8287d60f-7a5b-438b-a12c-00dbdbab3ab9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:03.802452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8287d60f-7a5b-438b-a12c-00dbdbab3ab9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:03.819705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8287d60f-7a5b-438b-a12c-00dbdbab3ab9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:03.820460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8287d60f-7a5b-438b-a12c-00dbdbab3ab9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:03.821505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8287d60f-7a5b-438b-a12c-00dbdbab3ab9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:03.822117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8287d60f-7a5b-438b-a12c-00dbdbab3ab9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:04.021132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0385ca2f-3dfe-4a8c-81d5-a61809842904 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:04.022549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0385ca2f-3dfe-4a8c-81d5-a61809842904 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:04.034223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=86 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:04.037191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0385ca2f-3dfe-4a8c-81d5-a61809842904 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:04.037828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0385ca2f-3dfe-4a8c-81d5-a61809842904 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:04.041672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0385ca2f-3dfe-4a8c-81d5-a61809842904 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:04.042352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0385ca2f-3dfe-4a8c-81d5-a61809842904 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:04.206908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8287d60f-7a5b-438b-a12c-00dbdbab3ab9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:04.221831 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8287d60f-7a5b-438b-a12c-00dbdbab3ab9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1355 microversion: 2.1 time: 0.425186 May 27 15:16:04.223085 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2137/4266] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:03 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1355 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:04.265287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0385ca2f-3dfe-4a8c-81d5-a61809842904 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:04.275738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0385ca2f-3dfe-4a8c-81d5-a61809842904 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:04.288400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0385ca2f-3dfe-4a8c-81d5-a61809842904 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:04.290072 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0385ca2f-3dfe-4a8c-81d5-a61809842904 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.273532 May 27 15:16:04.305324 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2130/4267] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:04 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:16:04.414540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3f15d133-8092-4319-a499-9464d1f48f40 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:04.415881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3f15d133-8092-4319-a499-9464d1f48f40 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:04.434040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f15d133-8092-4319-a499-9464d1f48f40 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:04.449478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f15d133-8092-4319-a499-9464d1f48f40 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:04.451538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f15d133-8092-4319-a499-9464d1f48f40 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:04.453228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f15d133-8092-4319-a499-9464d1f48f40 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:04.713159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a30b3844-441c-4f2a-bdc7-67398e8492fd tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:04.714273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a30b3844-441c-4f2a-bdc7-67398e8492fd tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:04.724492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a30b3844-441c-4f2a-bdc7-67398e8492fd tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:04.729871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a30b3844-441c-4f2a-bdc7-67398e8492fd tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:04.734946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a30b3844-441c-4f2a-bdc7-67398e8492fd tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:04.735909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a30b3844-441c-4f2a-bdc7-67398e8492fd tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:04.775815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3f15d133-8092-4319-a499-9464d1f48f40 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:04.793939 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3f15d133-8092-4319-a499-9464d1f48f40 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.386729 May 27 15:16:04.794978 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2138/4268] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:04 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:04.999235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a30b3844-441c-4f2a-bdc7-67398e8492fd tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:05.008561 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a30b3844-441c-4f2a-bdc7-67398e8492fd tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1478 microversion: 2.1 time: 0.300894 May 27 15:16:05.009769 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2131/4269] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:04 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1478 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:05.240010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-06743059-2d1b-4d61-abfa-efa9d6a8bf99 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:05.240661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-06743059-2d1b-4d61-abfa-efa9d6a8bf99 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:05.256576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-06743059-2d1b-4d61-abfa-efa9d6a8bf99 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:05.257862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-06743059-2d1b-4d61-abfa-efa9d6a8bf99 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:05.260135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-06743059-2d1b-4d61-abfa-efa9d6a8bf99 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:05.262966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-06743059-2d1b-4d61-abfa-efa9d6a8bf99 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:05.314279 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ccbaabbd-468c-4c92-926a-a7af46e6b4df tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:05.315813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ccbaabbd-468c-4c92-926a-a7af46e6b4df tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:05.329851 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccbaabbd-468c-4c92-926a-a7af46e6b4df tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:05.332002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccbaabbd-468c-4c92-926a-a7af46e6b4df tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:05.334639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccbaabbd-468c-4c92-926a-a7af46e6b4df tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:05.335352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccbaabbd-468c-4c92-926a-a7af46e6b4df tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:05.566716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ccbaabbd-468c-4c92-926a-a7af46e6b4df tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:05.591513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ccbaabbd-468c-4c92-926a-a7af46e6b4df tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:05.594826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ccbaabbd-468c-4c92-926a-a7af46e6b4df tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:05.597025 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ccbaabbd-468c-4c92-926a-a7af46e6b4df tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.287749 May 27 15:16:05.598340 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2132/4270] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:05 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:16:05.815060 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b40e764a-91d9-491a-8e8e-357ab4278793 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:05.815704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b40e764a-91d9-491a-8e8e-357ab4278793 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:05.827180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b40e764a-91d9-491a-8e8e-357ab4278793 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:05.827655 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b40e764a-91d9-491a-8e8e-357ab4278793 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:05.835125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b40e764a-91d9-491a-8e8e-357ab4278793 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:05.836422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b40e764a-91d9-491a-8e8e-357ab4278793 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:05.859208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-06743059-2d1b-4d61-abfa-efa9d6a8bf99 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:05.875120 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-06743059-2d1b-4d61-abfa-efa9d6a8bf99 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1355 microversion: 2.1 time: 0.638998 May 27 15:16:05.888252 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2139/4271] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:05 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1355 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:06.026121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9042ed41-58ef-448b-8d48-570bce17f60c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:06.027141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9042ed41-58ef-448b-8d48-570bce17f60c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:06.035382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9042ed41-58ef-448b-8d48-570bce17f60c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:06.040258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9042ed41-58ef-448b-8d48-570bce17f60c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:06.041520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9042ed41-58ef-448b-8d48-570bce17f60c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:06.042304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9042ed41-58ef-448b-8d48-570bce17f60c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:06.201195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b40e764a-91d9-491a-8e8e-357ab4278793 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:06.205290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:06.214320 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b40e764a-91d9-491a-8e8e-357ab4278793 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.404296 May 27 15:16:06.231627 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2133/4272] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:05 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:06.278090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9042ed41-58ef-448b-8d48-570bce17f60c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:06.290457 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9042ed41-58ef-448b-8d48-570bce17f60c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1478 microversion: 2.1 time: 0.267882 May 27 15:16:06.292693 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2140/4273] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:06 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1478 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:06.586034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-3ad0e81c-c6dc-45bf-92de-52b75f2a1404 req-5f4c4491-e7da-49b0-ac46-d3dd601ba371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38fbe9fb-a213-462c-a8af-ad601edd4928", "name": "network-vif-plugged", "status": "completed", "tag": "2c770865-695e-4c59-acf2-cd06a2ac073c"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:06.607424 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3ad0e81c-c6dc-45bf-92de-52b75f2a1404 req-5f4c4491-e7da-49b0-ac46-d3dd601ba371 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:06.609186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3ad0e81c-c6dc-45bf-92de-52b75f2a1404 req-5f4c4491-e7da-49b0-ac46-d3dd601ba371 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:06.628109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-eb47bbcc-055b-43da-a4b5-f3875c0cf167 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:06.628810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-eb47bbcc-055b-43da-a4b5-f3875c0cf167 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:06.638177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb47bbcc-055b-43da-a4b5-f3875c0cf167 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:06.642900 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-3ad0e81c-c6dc-45bf-92de-52b75f2a1404 req-5f4c4491-e7da-49b0-ac46-d3dd601ba371 service nova] Creating event network-vif-plugged:2c770865-695e-4c59-acf2-cd06a2ac073c for instance 38fbe9fb-a213-462c-a8af-ad601edd4928 on n-h2-843621-1 May 27 15:16:06.643404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb47bbcc-055b-43da-a4b5-f3875c0cf167 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:06.644546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb47bbcc-055b-43da-a4b5-f3875c0cf167 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:06.645200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb47bbcc-055b-43da-a4b5-f3875c0cf167 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:06.655956 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-3ad0e81c-c6dc-45bf-92de-52b75f2a1404 req-5f4c4491-e7da-49b0-ac46-d3dd601ba371 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074160 May 27 15:16:06.659785 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2134/4274] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:06.821700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-eb47bbcc-055b-43da-a4b5-f3875c0cf167 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:06.839276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-eb47bbcc-055b-43da-a4b5-f3875c0cf167 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:06.841246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-eb47bbcc-055b-43da-a4b5-f3875c0cf167 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:06.842684 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-eb47bbcc-055b-43da-a4b5-f3875c0cf167 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.229360 May 27 15:16:06.855586 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2141/4275] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:06 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:16:06.897125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-23cd7e16-e4ac-42f5-986e-4ab215622a7d tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:06.898384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-23cd7e16-e4ac-42f5-986e-4ab215622a7d tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:06.922802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23cd7e16-e4ac-42f5-986e-4ab215622a7d tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:06.927468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23cd7e16-e4ac-42f5-986e-4ab215622a7d tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:06.930348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23cd7e16-e4ac-42f5-986e-4ab215622a7d tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:06.933032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23cd7e16-e4ac-42f5-986e-4ab215622a7d tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.136704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f991d820-b1ae-42e2-8f20-c6562748aaae tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd3b47c5-a0fb-4399-a109-adf81bc08492"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:07.137869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f991d820-b1ae-42e2-8f20-c6562748aaae tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:07.148784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f991d820-b1ae-42e2-8f20-c6562748aaae tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:07.149495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f991d820-b1ae-42e2-8f20-c6562748aaae tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.150444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f991d820-b1ae-42e2-8f20-c6562748aaae tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:07.152805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-23cd7e16-e4ac-42f5-986e-4ab215622a7d tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:07.153528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f991d820-b1ae-42e2-8f20-c6562748aaae tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.164397 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-23cd7e16-e4ac-42f5-986e-4ab215622a7d tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1355 microversion: 2.1 time: 0.272613 May 27 15:16:07.168732 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2135/4276] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:06 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1355 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:07.240200 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-64a0abb1-a351-4664-89cc-1b280968dba1 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:07.241173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-64a0abb1-a351-4664-89cc-1b280968dba1 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:07.249782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-64a0abb1-a351-4664-89cc-1b280968dba1 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:07.250352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-64a0abb1-a351-4664-89cc-1b280968dba1 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.251237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-64a0abb1-a351-4664-89cc-1b280968dba1 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:07.251958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-64a0abb1-a351-4664-89cc-1b280968dba1 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.588104 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f991d820-b1ae-42e2-8f20-c6562748aaae tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "POST /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.454742 May 27 15:16:07.596695 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2142/4277] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 15:16:07 2022] POST /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments => generated 194 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:07.608077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e81e2b40-7039-40a2-943a-806456104f88 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:07.609237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e81e2b40-7039-40a2-943a-806456104f88 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:07.621781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-64a0abb1-a351-4664-89cc-1b280968dba1 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:07.635332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e81e2b40-7039-40a2-943a-806456104f88 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:07.636245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e81e2b40-7039-40a2-943a-806456104f88 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.639514 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-64a0abb1-a351-4664-89cc-1b280968dba1 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.404464 May 27 15:16:07.640452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e81e2b40-7039-40a2-943a-806456104f88 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:07.641732 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2136/4278] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:07 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:07.642927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e81e2b40-7039-40a2-943a-806456104f88 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.863992 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1b8df796-bf7c-41fa-91c5-d631fd7eeafd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:07.865059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1b8df796-bf7c-41fa-91c5-d631fd7eeafd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:07.876113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b8df796-bf7c-41fa-91c5-d631fd7eeafd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:07.878590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b8df796-bf7c-41fa-91c5-d631fd7eeafd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.879713 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b8df796-bf7c-41fa-91c5-d631fd7eeafd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:07.883998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e81e2b40-7039-40a2-943a-806456104f88 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:07.894628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b8df796-bf7c-41fa-91c5-d631fd7eeafd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.899480 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e81e2b40-7039-40a2-943a-806456104f88 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1478 microversion: 2.1 time: 0.293061 May 27 15:16:07.900530 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2143/4279] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:07 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1478 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:07.984846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1b8df796-bf7c-41fa-91c5-d631fd7eeafd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:07.997772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1b8df796-bf7c-41fa-91c5-d631fd7eeafd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:07.999388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1b8df796-bf7c-41fa-91c5-d631fd7eeafd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:08.000708 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1b8df796-bf7c-41fa-91c5-d631fd7eeafd tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.141590 May 27 15:16:08.002683 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2137/4280] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:07 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:08.183324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-057ab906-3f39-43b9-89b4-ad54c8b796f2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:08.183955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-057ab906-3f39-43b9-89b4-ad54c8b796f2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:08.202953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-057ab906-3f39-43b9-89b4-ad54c8b796f2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.203688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-057ab906-3f39-43b9-89b4-ad54c8b796f2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:08.206178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-057ab906-3f39-43b9-89b4-ad54c8b796f2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.206830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-057ab906-3f39-43b9-89b4-ad54c8b796f2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:08.526075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-057ab906-3f39-43b9-89b4-ad54c8b796f2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:08.537705 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-057ab906-3f39-43b9-89b4-ad54c8b796f2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1355 microversion: 2.1 time: 0.358046 May 27 15:16:08.539422 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2144/4281] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:08 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1355 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:08.660906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-801de132-280f-4945-a9ab-fc8d3e3cc7be tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:08.661628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-801de132-280f-4945-a9ab-fc8d3e3cc7be tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:08.677082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-801de132-280f-4945-a9ab-fc8d3e3cc7be tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.679244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-801de132-280f-4945-a9ab-fc8d3e3cc7be tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:08.681163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-801de132-280f-4945-a9ab-fc8d3e3cc7be tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.687142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-801de132-280f-4945-a9ab-fc8d3e3cc7be tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:08.702708 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-2d8ae847-276e-4cfe-8771-958951493d08 req-af9e41e2-e81e-4917-ad47-268fa3d59116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44", "name": "network-vif-plugged", "status": "completed", "tag": "9ec1c794-7419-421d-bf77-36d41479ca12"}, {"server_uuid": "117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44", "name": "network-vif-plugged", "status": "completed", "tag": "8694e71a-6b70-4c7e-afe3-e17a6b86d8e9"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:08.717695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2d8ae847-276e-4cfe-8771-958951493d08 req-af9e41e2-e81e-4917-ad47-268fa3d59116 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.722305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2d8ae847-276e-4cfe-8771-958951493d08 req-af9e41e2-e81e-4917-ad47-268fa3d59116 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:08.744984 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-2d8ae847-276e-4cfe-8771-958951493d08 req-af9e41e2-e81e-4917-ad47-268fa3d59116 service nova] Creating event network-vif-plugged:9ec1c794-7419-421d-bf77-36d41479ca12 for instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 on n-h1-843621-1 May 27 15:16:08.751117 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-2d8ae847-276e-4cfe-8771-958951493d08 req-af9e41e2-e81e-4917-ad47-268fa3d59116 service nova] Creating event network-vif-plugged:8694e71a-6b70-4c7e-afe3-e17a6b86d8e9 for instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 on n-h1-843621-1 May 27 15:16:08.766150 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-2d8ae847-276e-4cfe-8771-958951493d08 req-af9e41e2-e81e-4917-ad47-268fa3d59116 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068862 May 27 15:16:08.767474 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2145/4282] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:08.918186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-695941e2-d83b-4bf7-87bc-1fcc7847355c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:08.918467 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-801de132-280f-4945-a9ab-fc8d3e3cc7be tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:08.919335 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-695941e2-d83b-4bf7-87bc-1fcc7847355c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:08.927202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-695941e2-d83b-4bf7-87bc-1fcc7847355c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.932517 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-801de132-280f-4945-a9ab-fc8d3e3cc7be tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.276776 May 27 15:16:08.933481 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-695941e2-d83b-4bf7-87bc-1fcc7847355c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:08.934774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-695941e2-d83b-4bf7-87bc-1fcc7847355c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.935466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-695941e2-d83b-4bf7-87bc-1fcc7847355c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:08.945117 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2138/4283] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:08 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:09.026694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fec2c48a-a525-4062-abaa-cb1c6cb90ba7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:09.027315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fec2c48a-a525-4062-abaa-cb1c6cb90ba7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:09.036863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fec2c48a-a525-4062-abaa-cb1c6cb90ba7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.038866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fec2c48a-a525-4062-abaa-cb1c6cb90ba7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.040940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fec2c48a-a525-4062-abaa-cb1c6cb90ba7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.042737 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fec2c48a-a525-4062-abaa-cb1c6cb90ba7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.171071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fec2c48a-a525-4062-abaa-cb1c6cb90ba7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:09.184993 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fec2c48a-a525-4062-abaa-cb1c6cb90ba7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:09.191342 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fec2c48a-a525-4062-abaa-cb1c6cb90ba7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:09.192937 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fec2c48a-a525-4062-abaa-cb1c6cb90ba7 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.170514 May 27 15:16:09.194039 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2139/4284] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:09 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:16:09.244269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-695941e2-d83b-4bf7-87bc-1fcc7847355c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:09.256243 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-695941e2-d83b-4bf7-87bc-1fcc7847355c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1463 microversion: 2.1 time: 0.342239 May 27 15:16:09.257270 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2146/4285] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:08 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1463 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:09.282014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-16a1e170-db5a-4a25-8219-85d969b58944 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:09.283923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-16a1e170-db5a-4a25-8219-85d969b58944 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:09.290962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16a1e170-db5a-4a25-8219-85d969b58944 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.292346 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16a1e170-db5a-4a25-8219-85d969b58944 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.293676 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16a1e170-db5a-4a25-8219-85d969b58944 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.294306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16a1e170-db5a-4a25-8219-85d969b58944 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.418951 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-16a1e170-db5a-4a25-8219-85d969b58944 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928/action" status: 202 len: 0 microversion: 2.1 time: 0.140615 May 27 15:16:09.421446 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2140/4286] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:16:09 2022] POST /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:16:09.429718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-07907a22-8cfa-4fc3-abf9-2aca560f1766 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:09.430807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-07907a22-8cfa-4fc3-abf9-2aca560f1766 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:09.441124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07907a22-8cfa-4fc3-abf9-2aca560f1766 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.442165 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07907a22-8cfa-4fc3-abf9-2aca560f1766 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.443177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07907a22-8cfa-4fc3-abf9-2aca560f1766 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.443955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07907a22-8cfa-4fc3-abf9-2aca560f1766 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.472745 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:09.487987 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07907a22-8cfa-4fc3-abf9-2aca560f1766 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.489923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07907a22-8cfa-4fc3-abf9-2aca560f1766 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.490643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-07907a22-8cfa-4fc3-abf9-2aca560f1766 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lazy-loading 'fault' on Instance uuid 38fbe9fb-a213-462c-a8af-ad601edd4928 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:16:09.556120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-77f21b87-1ad5-4b6e-ae5b-2e4fcebef0f2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:09.557156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-77f21b87-1ad5-4b6e-ae5b-2e4fcebef0f2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:09.569989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77f21b87-1ad5-4b6e-ae5b-2e4fcebef0f2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.572400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77f21b87-1ad5-4b6e-ae5b-2e4fcebef0f2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.576662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77f21b87-1ad5-4b6e-ae5b-2e4fcebef0f2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.582025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77f21b87-1ad5-4b6e-ae5b-2e4fcebef0f2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.700787 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-07907a22-8cfa-4fc3-abf9-2aca560f1766 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1597 microversion: 2.1 time: 0.275639 May 27 15:16:09.701391 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2147/4287] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:09 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1597 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:09.725609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-23430d54-e808-4b85-8fe9-c607301a7d1c tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:09.726750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-23430d54-e808-4b85-8fe9-c607301a7d1c tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:09.743107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-23430d54-e808-4b85-8fe9-c607301a7d1c tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.743572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-23430d54-e808-4b85-8fe9-c607301a7d1c tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.745071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-23430d54-e808-4b85-8fe9-c607301a7d1c tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.746478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-23430d54-e808-4b85-8fe9-c607301a7d1c tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.870980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-77f21b87-1ad5-4b6e-ae5b-2e4fcebef0f2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:09.882954 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-77f21b87-1ad5-4b6e-ae5b-2e4fcebef0f2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1355 microversion: 2.1 time: 0.330976 May 27 15:16:09.884613 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2141/4288] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:09 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1355 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:09.910864 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-23430d54-e808-4b85-8fe9-c607301a7d1c tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928/action" status: 202 len: 0 microversion: 2.1 time: 0.196693 May 27 15:16:09.915315 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2148/4289] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:16:09 2022] POST /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:16:09.924519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e17155db-f822-42a0-90db-d01b92edca26 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:09.925461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e17155db-f822-42a0-90db-d01b92edca26 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:09.933803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e17155db-f822-42a0-90db-d01b92edca26 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.934562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e17155db-f822-42a0-90db-d01b92edca26 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.935428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e17155db-f822-42a0-90db-d01b92edca26 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.935811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e17155db-f822-42a0-90db-d01b92edca26 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.950508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4f6e7a70-e008-4d24-bab4-34e68db5e817 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:09.951492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4f6e7a70-e008-4d24-bab4-34e68db5e817 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:09.961934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f6e7a70-e008-4d24-bab4-34e68db5e817 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.964023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f6e7a70-e008-4d24-bab4-34e68db5e817 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.965784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f6e7a70-e008-4d24-bab4-34e68db5e817 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.966669 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f6e7a70-e008-4d24-bab4-34e68db5e817 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:10.226524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4f6e7a70-e008-4d24-bab4-34e68db5e817 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:10.232319 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e17155db-f822-42a0-90db-d01b92edca26 tempest-ServersAdminTestJSON-1575380302 tempest-ServersAdminTestJSON-1575380302-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1614 microversion: 2.1 time: 0.313783 May 27 15:16:10.233384 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2142/4290] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:09 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1614 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:10.238377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c8e1c557-aa5a-4095-bebd-69b2a644cabb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:10.239220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c8e1c557-aa5a-4095-bebd-69b2a644cabb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:10.247990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8e1c557-aa5a-4095-bebd-69b2a644cabb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:10.249069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8e1c557-aa5a-4095-bebd-69b2a644cabb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:10.249420 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4f6e7a70-e008-4d24-bab4-34e68db5e817 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.301355 May 27 15:16:10.250228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8e1c557-aa5a-4095-bebd-69b2a644cabb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:10.250839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8e1c557-aa5a-4095-bebd-69b2a644cabb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:10.261145 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2149/4291] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:09 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:10.266655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-284f6398-60fb-45e9-96a7-0c88ca5626a9 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:10.267164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-284f6398-60fb-45e9-96a7-0c88ca5626a9 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 514bdfae-084f-425f-a04a-a5b9b5d4184a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:10.274999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-284f6398-60fb-45e9-96a7-0c88ca5626a9 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:10.275456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-284f6398-60fb-45e9-96a7-0c88ca5626a9 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:10.276342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-284f6398-60fb-45e9-96a7-0c88ca5626a9 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:10.276816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-284f6398-60fb-45e9-96a7-0c88ca5626a9 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:10.306369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-284f6398-60fb-45e9-96a7-0c88ca5626a9 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 514bdfae-084f-425f-a04a-a5b9b5d4184a] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:16:10.326424 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c8e1c557-aa5a-4095-bebd-69b2a644cabb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:10.341094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c8e1c557-aa5a-4095-bebd-69b2a644cabb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:10.342709 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c8e1c557-aa5a-4095-bebd-69b2a644cabb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:10.343939 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c8e1c557-aa5a-4095-bebd-69b2a644cabb tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.109453 May 27 15:16:10.356875 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2143/4292] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:10 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:10.434090 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-284f6398-60fb-45e9-96a7-0c88ca5626a9 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "DELETE /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a" status: 204 len: 0 microversion: 2.1 time: 0.171425 May 27 15:16:10.436847 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2150/4293] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:16:10 2022] DELETE /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:16:10.445091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d2250f5b-77bd-4a70-8c5d-5383b32cba5d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:10.445661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d2250f5b-77bd-4a70-8c5d-5383b32cba5d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 514bdfae-084f-425f-a04a-a5b9b5d4184a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:10.453269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2250f5b-77bd-4a70-8c5d-5383b32cba5d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:10.453737 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2250f5b-77bd-4a70-8c5d-5383b32cba5d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:10.454536 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2250f5b-77bd-4a70-8c5d-5383b32cba5d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:10.455758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2250f5b-77bd-4a70-8c5d-5383b32cba5d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:10.635388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d2250f5b-77bd-4a70-8c5d-5383b32cba5d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:10.645894 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d2250f5b-77bd-4a70-8c5d-5383b32cba5d tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a" status: 200 len: 1468 microversion: 2.1 time: 0.205070 May 27 15:16:10.646864 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2144/4294] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:10 2022] GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a => generated 1468 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:10.788999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-8e47a06a-330b-485c-856d-0e5fc3888a50 req-dd61f8b0-8a43-40dd-a505-057e9530c5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44", "name": "network-vif-plugged", "status": "completed", "tag": "f99d4329-b5be-4d81-bfda-4d57a16a90a3"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:10.799864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-8e47a06a-330b-485c-856d-0e5fc3888a50 req-dd61f8b0-8a43-40dd-a505-057e9530c5e8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:10.800298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-8e47a06a-330b-485c-856d-0e5fc3888a50 req-dd61f8b0-8a43-40dd-a505-057e9530c5e8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:10.813969 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-8e47a06a-330b-485c-856d-0e5fc3888a50 req-dd61f8b0-8a43-40dd-a505-057e9530c5e8 service nova] Creating event network-vif-plugged:f99d4329-b5be-4d81-bfda-4d57a16a90a3 for instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 on n-h1-843621-1 May 27 15:16:10.822923 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-8e47a06a-330b-485c-856d-0e5fc3888a50 req-dd61f8b0-8a43-40dd-a505-057e9530c5e8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039407 May 27 15:16:10.826768 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2151/4295] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:10.901687 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1d81bb87-02be-4f94-bb34-83d6ae366df8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:10.902308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1d81bb87-02be-4f94-bb34-83d6ae366df8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:10.909792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d81bb87-02be-4f94-bb34-83d6ae366df8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:10.910564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d81bb87-02be-4f94-bb34-83d6ae366df8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:10.911505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d81bb87-02be-4f94-bb34-83d6ae366df8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:10.912055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d81bb87-02be-4f94-bb34-83d6ae366df8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:11.103813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1d81bb87-02be-4f94-bb34-83d6ae366df8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:11.113660 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1d81bb87-02be-4f94-bb34-83d6ae366df8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1355 microversion: 2.1 time: 0.216143 May 27 15:16:11.114270 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2145/4296] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:10 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1355 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:11.269861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1c2eb13c-e44c-435f-a9f3-b7b4607a7dc5 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:11.270966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1c2eb13c-e44c-435f-a9f3-b7b4607a7dc5 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:11.279881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c2eb13c-e44c-435f-a9f3-b7b4607a7dc5 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:11.280767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c2eb13c-e44c-435f-a9f3-b7b4607a7dc5 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:11.281771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c2eb13c-e44c-435f-a9f3-b7b4607a7dc5 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:11.282737 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c2eb13c-e44c-435f-a9f3-b7b4607a7dc5 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:11.364056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0bb293ee-761f-4eb5-a913-2ffdd381f22e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:11.365499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0bb293ee-761f-4eb5-a913-2ffdd381f22e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:11.379214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bb293ee-761f-4eb5-a913-2ffdd381f22e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:11.380578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bb293ee-761f-4eb5-a913-2ffdd381f22e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:11.381560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bb293ee-761f-4eb5-a913-2ffdd381f22e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:11.382329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bb293ee-761f-4eb5-a913-2ffdd381f22e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:11.487665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0bb293ee-761f-4eb5-a913-2ffdd381f22e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:11.497664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0bb293ee-761f-4eb5-a913-2ffdd381f22e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:11.499561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0bb293ee-761f-4eb5-a913-2ffdd381f22e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:11.500662 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0bb293ee-761f-4eb5-a913-2ffdd381f22e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.141374 May 27 15:16:11.504717 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2146/4297] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:11 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:16:11.504915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1c2eb13c-e44c-435f-a9f3-b7b4607a7dc5 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:11.512273 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1c2eb13c-e44c-435f-a9f3-b7b4607a7dc5 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.248088 May 27 15:16:11.531072 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2152/4298] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:11 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:11.664985 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-66045fcf-479b-4a44-a81c-eb21bdccdb5c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:11.666857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-66045fcf-479b-4a44-a81c-eb21bdccdb5c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 514bdfae-084f-425f-a04a-a5b9b5d4184a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:11.673313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66045fcf-479b-4a44-a81c-eb21bdccdb5c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:11.675147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66045fcf-479b-4a44-a81c-eb21bdccdb5c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:11.677278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66045fcf-479b-4a44-a81c-eb21bdccdb5c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:11.677278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66045fcf-479b-4a44-a81c-eb21bdccdb5c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:11.836412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-66045fcf-479b-4a44-a81c-eb21bdccdb5c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:11.847037 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-66045fcf-479b-4a44-a81c-eb21bdccdb5c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a" status: 200 len: 1468 microversion: 2.1 time: 0.186576 May 27 15:16:11.848271 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2147/4299] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:11 2022] GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a => generated 1468 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:12.145657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d96d578d-3c0e-4361-9c82-5667efaa21d3 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:12.146285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d96d578d-3c0e-4361-9c82-5667efaa21d3 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:12.156585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d96d578d-3c0e-4361-9c82-5667efaa21d3 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:12.157087 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d96d578d-3c0e-4361-9c82-5667efaa21d3 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:12.158647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d96d578d-3c0e-4361-9c82-5667efaa21d3 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:12.159446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d96d578d-3c0e-4361-9c82-5667efaa21d3 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:12.434210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-fb74876e-25f2-47d9-a0f1-51407ef79343 req-fc45fae7-9eb8-489d-855d-a72d656a4903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514bdfae-084f-425f-a04a-a5b9b5d4184a", "name": "network-vif-deleted", "tag": "fa998565-7f0d-41f4-87c2-e9a7d18d495b"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:12.448735 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-fb74876e-25f2-47d9-a0f1-51407ef79343 req-fc45fae7-9eb8-489d-855d-a72d656a4903 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:12.449427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-fb74876e-25f2-47d9-a0f1-51407ef79343 req-fc45fae7-9eb8-489d-855d-a72d656a4903 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:12.466167 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-fb74876e-25f2-47d9-a0f1-51407ef79343 req-fc45fae7-9eb8-489d-855d-a72d656a4903 service nova] Creating event network-vif-deleted:fa998565-7f0d-41f4-87c2-e9a7d18d495b for instance 514bdfae-084f-425f-a04a-a5b9b5d4184a on n-h2-843621-1 May 27 15:16:12.467322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d96d578d-3c0e-4361-9c82-5667efaa21d3 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:12.474655 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d96d578d-3c0e-4361-9c82-5667efaa21d3 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1355 microversion: 2.1 time: 0.333322 May 27 15:16:12.477875 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-fb74876e-25f2-47d9-a0f1-51407ef79343 req-fc45fae7-9eb8-489d-855d-a72d656a4903 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047950 May 27 15:16:12.488916 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2153/4300] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:12 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1355 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:12.490714 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2148/4301] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:12.533824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ebc98c4b-c8c1-4dad-927e-3a156f52857c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:12.534841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ebc98c4b-c8c1-4dad-927e-3a156f52857c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:12.541009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3fa894c3-3742-4670-abe6-4fc58ae6f02a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:12.541752 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ebc98c4b-c8c1-4dad-927e-3a156f52857c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:12.542221 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ebc98c4b-c8c1-4dad-927e-3a156f52857c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:12.543011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ebc98c4b-c8c1-4dad-927e-3a156f52857c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:12.543522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ebc98c4b-c8c1-4dad-927e-3a156f52857c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:12.551166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3fa894c3-3742-4670-abe6-4fc58ae6f02a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:12.571858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fa894c3-3742-4670-abe6-4fc58ae6f02a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:12.577024 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fa894c3-3742-4670-abe6-4fc58ae6f02a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:12.579364 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fa894c3-3742-4670-abe6-4fc58ae6f02a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:12.581864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fa894c3-3742-4670-abe6-4fc58ae6f02a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:12.695646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ebc98c4b-c8c1-4dad-927e-3a156f52857c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:12.710775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ebc98c4b-c8c1-4dad-927e-3a156f52857c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:12.712789 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ebc98c4b-c8c1-4dad-927e-3a156f52857c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:12.723858 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ebc98c4b-c8c1-4dad-927e-3a156f52857c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.194512 May 27 15:16:12.724399 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2149/4302] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:12 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:12.864087 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-af0c33a2-a6a8-4d68-b85f-3faffa268476 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:12.864993 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-af0c33a2-a6a8-4d68-b85f-3faffa268476 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 514bdfae-084f-425f-a04a-a5b9b5d4184a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:12.906627 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af0c33a2-a6a8-4d68-b85f-3faffa268476 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:12.907098 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af0c33a2-a6a8-4d68-b85f-3faffa268476 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:12.907943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af0c33a2-a6a8-4d68-b85f-3faffa268476 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:12.908400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af0c33a2-a6a8-4d68-b85f-3faffa268476 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:12.974074 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:13.030600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af0c33a2-a6a8-4d68-b85f-3faffa268476 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:13.031274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af0c33a2-a6a8-4d68-b85f-3faffa268476 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:13.031566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-af0c33a2-a6a8-4d68-b85f-3faffa268476 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lazy-loading 'fault' on Instance uuid 514bdfae-084f-425f-a04a-a5b9b5d4184a {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:16:13.037931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3fa894c3-3742-4670-abe6-4fc58ae6f02a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:13.054383 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3fa894c3-3742-4670-abe6-4fc58ae6f02a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.522268 May 27 15:16:13.059275 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2154/4303] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:12 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:13.104262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-af0c33a2-a6a8-4d68-b85f-3faffa268476 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:13.114761 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-af0c33a2-a6a8-4d68-b85f-3faffa268476 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a" status: 200 len: 1303 microversion: 2.1 time: 0.255093 May 27 15:16:13.126403 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2150/4304] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:12 2022] GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a => generated 1303 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:13.491462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-81ada064-de35-4175-9359-6352573cdcf9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:13.492335 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-81ada064-de35-4175-9359-6352573cdcf9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:13.500491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81ada064-de35-4175-9359-6352573cdcf9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:13.500970 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81ada064-de35-4175-9359-6352573cdcf9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:13.501902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81ada064-de35-4175-9359-6352573cdcf9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:13.502502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81ada064-de35-4175-9359-6352573cdcf9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:13.728017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-81ada064-de35-4175-9359-6352573cdcf9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:13.738464 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-81ada064-de35-4175-9359-6352573cdcf9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1805 microversion: 2.1 time: 0.250748 May 27 15:16:13.742506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e433dba-1782-44d7-a61a-3e2cf19dcf89 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:13.743698 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e433dba-1782-44d7-a61a-3e2cf19dcf89 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:13.754431 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2155/4305] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:13 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1805 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:13.759498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1f47c072-c424-4f6b-a482-866eb10a4cd8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:13.760095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1f47c072-c424-4f6b-a482-866eb10a4cd8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:13.762251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e433dba-1782-44d7-a61a-3e2cf19dcf89 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:13.762706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e433dba-1782-44d7-a61a-3e2cf19dcf89 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:13.763479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e433dba-1782-44d7-a61a-3e2cf19dcf89 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:13.763931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e433dba-1782-44d7-a61a-3e2cf19dcf89 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:13.788041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f47c072-c424-4f6b-a482-866eb10a4cd8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:13.788419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f47c072-c424-4f6b-a482-866eb10a4cd8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:13.789234 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f47c072-c424-4f6b-a482-866eb10a4cd8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:13.790196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f47c072-c424-4f6b-a482-866eb10a4cd8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:13.818169 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1f47c072-c424-4f6b-a482-866eb10a4cd8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44/ips" status: 200 len: 218 microversion: 2.1 time: 0.062577 May 27 15:16:13.819400 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2156/4306] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 15:16:13 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44/ips => generated 218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:13.836287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e433dba-1782-44d7-a61a-3e2cf19dcf89 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:13.846873 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e433dba-1782-44d7-a61a-3e2cf19dcf89 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:13.847090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d6fcfe0c-8673-4260-98e5-86e11e9f875e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:13.848103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d6fcfe0c-8673-4260-98e5-86e11e9f875e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:13.848493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e433dba-1782-44d7-a61a-3e2cf19dcf89 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:13.849706 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e433dba-1782-44d7-a61a-3e2cf19dcf89 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.111432 May 27 15:16:13.850805 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2151/4307] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:13 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:13.865982 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6fcfe0c-8673-4260-98e5-86e11e9f875e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:13.866430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6fcfe0c-8673-4260-98e5-86e11e9f875e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:13.867191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6fcfe0c-8673-4260-98e5-86e11e9f875e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:13.867710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6fcfe0c-8673-4260-98e5-86e11e9f875e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:13.894731 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d6fcfe0c-8673-4260-98e5-86e11e9f875e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:16:14.033008 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d6fcfe0c-8673-4260-98e5-86e11e9f875e tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "DELETE /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 204 len: 0 microversion: 2.1 time: 0.197423 May 27 15:16:14.037724 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2157/4308] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:16:13 2022] DELETE /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:16:14.047295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-69391fd6-9ba5-41a0-a3bc-0e899df35d16 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:14.048258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-69391fd6-9ba5-41a0-a3bc-0e899df35d16 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:14.056378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-69391fd6-9ba5-41a0-a3bc-0e899df35d16 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:14.056872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-69391fd6-9ba5-41a0-a3bc-0e899df35d16 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:14.057878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-69391fd6-9ba5-41a0-a3bc-0e899df35d16 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:14.058820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-69391fd6-9ba5-41a0-a3bc-0e899df35d16 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:14.089171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1bfc974d-0899-4d4f-8aec-4776ffda1bc0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:14.089874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1bfc974d-0899-4d4f-8aec-4776ffda1bc0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:14.105467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1bfc974d-0899-4d4f-8aec-4776ffda1bc0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:14.105974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1bfc974d-0899-4d4f-8aec-4776ffda1bc0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:14.106934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1bfc974d-0899-4d4f-8aec-4776ffda1bc0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:14.107397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1bfc974d-0899-4d4f-8aec-4776ffda1bc0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:14.297802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-69391fd6-9ba5-41a0-a3bc-0e899df35d16 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:14.306846 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-69391fd6-9ba5-41a0-a3bc-0e899df35d16 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1811 microversion: 2.1 time: 0.264581 May 27 15:16:14.311755 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2152/4309] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:14 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1811 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:14.320917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3560af2a-3f96-43cc-9fb2-49e06d052d1b tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:14.321852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3560af2a-3f96-43cc-9fb2-49e06d052d1b tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 514bdfae-084f-425f-a04a-a5b9b5d4184a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:14.332002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3560af2a-3f96-43cc-9fb2-49e06d052d1b tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:14.332425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3560af2a-3f96-43cc-9fb2-49e06d052d1b tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:14.333220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3560af2a-3f96-43cc-9fb2-49e06d052d1b tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:14.333654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3560af2a-3f96-43cc-9fb2-49e06d052d1b tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:14.373122 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-3560af2a-3f96-43cc-9fb2-49e06d052d1b tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] HTTP exception thrown: Instance 514bdfae-084f-425f-a04a-a5b9b5d4184a could not be found. May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3560af2a-3f96-43cc-9fb2-49e06d052d1b tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Request method failure captured: May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a HTTP/1.1 May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOraC2nMLJWhwI4YZcBTKxpWUEd-ybTPTl5W8L27VSjR8kZNCh7z16te_Dkdn9TCAzw0XvW11YRlIBK5XUHDhd0vMzd0y5-4qAkVIBSG9p-ti6kijVcafp8LvIFusUGmMZUgRU3Y537_HrFqFRMsXGntkDPKnZHTIPqVQR9bH7enzBs May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: f1946861ca5a407f9b6ea2624fca1c80 May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersAdminTestJSON-449872593 May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f1946861ca5a407f9b6ea2624fca1c80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f1946861ca5a407f9b6ea2624fca1c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f1946861ca5a407f9b6ea2624fca1c80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f1946861ca5a407f9b6ea2624fca1c80", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersAdminTestJSON-449872593 May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: f1946861ca5a407f9b6ea2624fca1c80 May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersAdminTestJSON-449872593 May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersAdminTestJSON-449872593-project May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 3d79c875c4f04c3caaef620c4ea4b7a1 May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersAdminTestJSON-449872593-project May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 514bdfae-084f-425f-a04a-a5b9b5d4184a could not be found. May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '514bdfae-084f-425f-a04a-a5b9b5d4184a'} May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 514bdfae-084f-425f-a04a-a5b9b5d4184a could not be found. May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 514bdfae-084f-425f-a04a-a5b9b5d4184a could not be found. May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:14.376077 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:14.383799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:14.383799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:14.383799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:14.383799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:16:14.383799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:16:14.383799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 514bdfae-084f-425f-a04a-a5b9b5d4184a could not be found. May 27 15:16:14.383799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:14.383799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3560af2a-3f96-43cc-9fb2-49e06d052d1b tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Returning 404 to user: Instance 514bdfae-084f-425f-a04a-a5b9b5d4184a could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:16:14.387965 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3560af2a-3f96-43cc-9fb2-49e06d052d1b tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a" status: 404 len: 111 microversion: 2.1 time: 0.069767 May 27 15:16:14.394003 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2153/4310] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:14 2022] GET /compute/v2.1/servers/514bdfae-084f-425f-a04a-a5b9b5d4184a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:16:14.408243 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0c49181d-6087-409f-a417-ad04f0214e37 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:14.410816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0c49181d-6087-409f-a417-ad04f0214e37 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:14.412008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1bfc974d-0899-4d4f-8aec-4776ffda1bc0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:14.422012 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1bfc974d-0899-4d4f-8aec-4776ffda1bc0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.346761 May 27 15:16:14.431964 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2158/4311] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:14 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:14.432150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c49181d-6087-409f-a417-ad04f0214e37 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:14.432150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c49181d-6087-409f-a417-ad04f0214e37 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:14.432150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c49181d-6087-409f-a417-ad04f0214e37 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:14.432150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c49181d-6087-409f-a417-ad04f0214e37 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:14.482793 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0c49181d-6087-409f-a417-ad04f0214e37 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:16:14.594444 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0c49181d-6087-409f-a417-ad04f0214e37 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c" status: 204 len: 0 microversion: 2.1 time: 0.193354 May 27 15:16:14.595282 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2154/4312] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:16:14 2022] DELETE /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:16:14.607418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d7734da5-6756-42b2-86a3-6f16de4d534c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:14.609062 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d7734da5-6756-42b2-86a3-6f16de4d534c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:14.616956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d7734da5-6756-42b2-86a3-6f16de4d534c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:14.616956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d7734da5-6756-42b2-86a3-6f16de4d534c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:14.617764 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d7734da5-6756-42b2-86a3-6f16de4d534c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:14.618463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d7734da5-6756-42b2-86a3-6f16de4d534c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:14.769394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d7734da5-6756-42b2-86a3-6f16de4d534c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:14.778286 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d7734da5-6756-42b2-86a3-6f16de4d534c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c" status: 200 len: 1470 microversion: 2.1 time: 0.176199 May 27 15:16:14.779467 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2159/4313] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:14 2022] GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c => generated 1470 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:14.870526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-679f0330-a599-4c2d-8167-47bc5ba2c870 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:14.872779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-679f0330-a599-4c2d-8167-47bc5ba2c870 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:14.877852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-679f0330-a599-4c2d-8167-47bc5ba2c870 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:14.879939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-679f0330-a599-4c2d-8167-47bc5ba2c870 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:14.879939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-679f0330-a599-4c2d-8167-47bc5ba2c870 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:14.879939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-679f0330-a599-4c2d-8167-47bc5ba2c870 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:14.946307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-679f0330-a599-4c2d-8167-47bc5ba2c870 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:14.956494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-679f0330-a599-4c2d-8167-47bc5ba2c870 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:14.958429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-679f0330-a599-4c2d-8167-47bc5ba2c870 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:14.961522 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-679f0330-a599-4c2d-8167-47bc5ba2c870 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.094142 May 27 15:16:14.970394 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2155/4314] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:14 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:15.333232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a3602d89-57d5-4440-a585-b687a17ca0c7 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:15.333232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a3602d89-57d5-4440-a585-b687a17ca0c7 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:15.339868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3602d89-57d5-4440-a585-b687a17ca0c7 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:15.340463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3602d89-57d5-4440-a585-b687a17ca0c7 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:15.341243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3602d89-57d5-4440-a585-b687a17ca0c7 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:15.341688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3602d89-57d5-4440-a585-b687a17ca0c7 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:15.344735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:15.440454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-db3b735d-47c7-48eb-bfd4-a2437ceec78d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:15.441606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-db3b735d-47c7-48eb-bfd4-a2437ceec78d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:15.452839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db3b735d-47c7-48eb-bfd4-a2437ceec78d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:15.453639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db3b735d-47c7-48eb-bfd4-a2437ceec78d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:15.455970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db3b735d-47c7-48eb-bfd4-a2437ceec78d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:15.467860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db3b735d-47c7-48eb-bfd4-a2437ceec78d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:15.594725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a3602d89-57d5-4440-a585-b687a17ca0c7 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:15.607058 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a3602d89-57d5-4440-a585-b687a17ca0c7 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1811 microversion: 2.1 time: 0.279251 May 27 15:16:15.608299 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2160/4315] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:15 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1811 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:15.712636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-db3b735d-47c7-48eb-bfd4-a2437ceec78d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:15.739463 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-db3b735d-47c7-48eb-bfd4-a2437ceec78d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.303961 May 27 15:16:15.744145 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2156/4316] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:15 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:15.796392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-26065fbe-85ae-4de0-9e44-e8a88fd194b3 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:15.797058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-26065fbe-85ae-4de0-9e44-e8a88fd194b3 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:15.805126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26065fbe-85ae-4de0-9e44-e8a88fd194b3 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:15.805563 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26065fbe-85ae-4de0-9e44-e8a88fd194b3 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:15.806448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26065fbe-85ae-4de0-9e44-e8a88fd194b3 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:15.806882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26065fbe-85ae-4de0-9e44-e8a88fd194b3 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:15.979887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a46dd616-fac3-4f82-a154-2abbd505779e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:15.981284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a46dd616-fac3-4f82-a154-2abbd505779e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:15.991265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-26065fbe-85ae-4de0-9e44-e8a88fd194b3 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:16.000289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a46dd616-fac3-4f82-a154-2abbd505779e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:16.002533 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a46dd616-fac3-4f82-a154-2abbd505779e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:16.005021 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a46dd616-fac3-4f82-a154-2abbd505779e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:16.007075 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-26065fbe-85ae-4de0-9e44-e8a88fd194b3 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c" status: 200 len: 1470 microversion: 2.1 time: 0.215211 May 27 15:16:16.007861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a46dd616-fac3-4f82-a154-2abbd505779e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:16.017282 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2161/4317] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:15 2022] GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c => generated 1470 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:16.120207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a46dd616-fac3-4f82-a154-2abbd505779e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:16.133025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a46dd616-fac3-4f82-a154-2abbd505779e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:16.135410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a46dd616-fac3-4f82-a154-2abbd505779e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:16.138763 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a46dd616-fac3-4f82-a154-2abbd505779e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.161602 May 27 15:16:16.138763 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2157/4318] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:15 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:16:16.652251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6863b2fc-4f80-430a-a715-0d7aa4893249 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:16.652949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6863b2fc-4f80-430a-a715-0d7aa4893249 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:16.660803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6863b2fc-4f80-430a-a715-0d7aa4893249 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:16.661253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6863b2fc-4f80-430a-a715-0d7aa4893249 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:16.662229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6863b2fc-4f80-430a-a715-0d7aa4893249 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:16.662667 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6863b2fc-4f80-430a-a715-0d7aa4893249 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:16.761474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-47ad0fbb-ea8b-4778-b5d7-683c3f6e0a3f tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:16.762092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-47ad0fbb-ea8b-4778-b5d7-683c3f6e0a3f tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:16.781094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47ad0fbb-ea8b-4778-b5d7-683c3f6e0a3f tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:16.781568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47ad0fbb-ea8b-4778-b5d7-683c3f6e0a3f tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:16.782380 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47ad0fbb-ea8b-4778-b5d7-683c3f6e0a3f tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:16.783401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47ad0fbb-ea8b-4778-b5d7-683c3f6e0a3f tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:17.244711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6863b2fc-4f80-430a-a715-0d7aa4893249 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:17.257841 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6863b2fc-4f80-430a-a715-0d7aa4893249 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1811 microversion: 2.1 time: 0.609334 May 27 15:16:17.271968 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2162/4319] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:16 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1811 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:17.271968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b8838785-e0f2-4efc-bcbc-657cc29e805c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:17.272334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b8838785-e0f2-4efc-bcbc-657cc29e805c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:17.284224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8838785-e0f2-4efc-bcbc-657cc29e805c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:17.285187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8838785-e0f2-4efc-bcbc-657cc29e805c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:17.286231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8838785-e0f2-4efc-bcbc-657cc29e805c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:17.286928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8838785-e0f2-4efc-bcbc-657cc29e805c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:17.379892 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8838785-e0f2-4efc-bcbc-657cc29e805c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:17.380459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8838785-e0f2-4efc-bcbc-657cc29e805c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:17.381040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-b8838785-e0f2-4efc-bcbc-657cc29e805c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lazy-loading 'fault' on Instance uuid 6eea408d-b686-46e2-8b8e-cdb192bfb37c {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:16:17.399977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-47ad0fbb-ea8b-4778-b5d7-683c3f6e0a3f tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:17.430842 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-47ad0fbb-ea8b-4778-b5d7-683c3f6e0a3f tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1724 microversion: 2.1 time: 0.673047 May 27 15:16:17.431529 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2158/4320] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:16 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1724 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:17.441762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b8838785-e0f2-4efc-bcbc-657cc29e805c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:17.447270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-3994f950-9635-47c8-bfdd-6ae2630ab422 req-82d62ef6-2ecc-4bd3-b0d2-9b35d9eb12bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eea408d-b686-46e2-8b8e-cdb192bfb37c", "name": "network-vif-deleted", "tag": "0b10cb3b-9d88-4747-9685-8d02404d4d66"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:17.448392 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b8838785-e0f2-4efc-bcbc-657cc29e805c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c" status: 200 len: 1304 microversion: 2.1 time: 0.183355 May 27 15:16:17.449716 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2163/4321] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:17 2022] GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c => generated 1304 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:17.462700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3994f950-9635-47c8-bfdd-6ae2630ab422 req-82d62ef6-2ecc-4bd3-b0d2-9b35d9eb12bc service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:17.463156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3994f950-9635-47c8-bfdd-6ae2630ab422 req-82d62ef6-2ecc-4bd3-b0d2-9b35d9eb12bc service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:17.467532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e47661f8-c38f-497c-8c82-45f270a5f10c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:17.468389 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e47661f8-c38f-497c-8c82-45f270a5f10c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:17.486531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e47661f8-c38f-497c-8c82-45f270a5f10c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:17.487359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e47661f8-c38f-497c-8c82-45f270a5f10c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:17.488367 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e47661f8-c38f-497c-8c82-45f270a5f10c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:17.489047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e47661f8-c38f-497c-8c82-45f270a5f10c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:17.498043 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-3994f950-9635-47c8-bfdd-6ae2630ab422 req-82d62ef6-2ecc-4bd3-b0d2-9b35d9eb12bc service nova] Creating event network-vif-deleted:0b10cb3b-9d88-4747-9685-8d02404d4d66 for instance 6eea408d-b686-46e2-8b8e-cdb192bfb37c on n-h2-843621-1 May 27 15:16:17.504341 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-3994f950-9635-47c8-bfdd-6ae2630ab422 req-82d62ef6-2ecc-4bd3-b0d2-9b35d9eb12bc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071598 May 27 15:16:17.506090 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2159/4322] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:17.630508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e47661f8-c38f-497c-8c82-45f270a5f10c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:17.644556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e47661f8-c38f-497c-8c82-45f270a5f10c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:17.655682 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e47661f8-c38f-497c-8c82-45f270a5f10c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:17.657492 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e47661f8-c38f-497c-8c82-45f270a5f10c tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.206384 May 27 15:16:17.670089 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2164/4323] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:17 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:18.281271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-082d82cc-72e3-48cc-a030-6693cf793ef8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:18.282174 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-082d82cc-72e3-48cc-a030-6693cf793ef8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:18.289737 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-082d82cc-72e3-48cc-a030-6693cf793ef8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.290451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-082d82cc-72e3-48cc-a030-6693cf793ef8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:18.291430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-082d82cc-72e3-48cc-a030-6693cf793ef8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.292254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-082d82cc-72e3-48cc-a030-6693cf793ef8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:18.455956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-eaa459db-df9f-464f-bbea-b6e7d016a179 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:18.457560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-eaa459db-df9f-464f-bbea-b6e7d016a179 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:18.471170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eaa459db-df9f-464f-bbea-b6e7d016a179 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.472109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eaa459db-df9f-464f-bbea-b6e7d016a179 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:18.473547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eaa459db-df9f-464f-bbea-b6e7d016a179 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.474442 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eaa459db-df9f-464f-bbea-b6e7d016a179 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:18.511237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-082d82cc-72e3-48cc-a030-6693cf793ef8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:18.524254 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-082d82cc-72e3-48cc-a030-6693cf793ef8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 200 len: 1769 microversion: 2.1 time: 0.248454 May 27 15:16:18.525629 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2160/4324] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:18 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 1769 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:18.530841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dd1c5685-26b0-434d-80ba-6adff891632c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:18.531468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dd1c5685-26b0-434d-80ba-6adff891632c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 6eea408d-b686-46e2-8b8e-cdb192bfb37c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:18.538682 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd1c5685-26b0-434d-80ba-6adff891632c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.539470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd1c5685-26b0-434d-80ba-6adff891632c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:18.541191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd1c5685-26b0-434d-80ba-6adff891632c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.541911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd1c5685-26b0-434d-80ba-6adff891632c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:18.562330 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-dd1c5685-26b0-434d-80ba-6adff891632c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] HTTP exception thrown: Instance 6eea408d-b686-46e2-8b8e-cdb192bfb37c could not be found. May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dd1c5685-26b0-434d-80ba-6adff891632c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Request method failure captured: May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c HTTP/1.1 May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOraC2nMLJWhwI4YZcBTKxpWUEd-ybTPTl5W8L27VSjR8kZNCh7z16te_Dkdn9TCAzw0XvW11YRlIBK5XUHDhd0vMzd0y5-4qAkVIBSG9p-ti6kijVcafp8LvIFusUGmMZUgRU3Y537_HrFqFRMsXGntkDPKnZHTIPqVQR9bH7enzBs May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: f1946861ca5a407f9b6ea2624fca1c80 May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersAdminTestJSON-449872593 May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f1946861ca5a407f9b6ea2624fca1c80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f1946861ca5a407f9b6ea2624fca1c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f1946861ca5a407f9b6ea2624fca1c80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f1946861ca5a407f9b6ea2624fca1c80", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersAdminTestJSON-449872593 May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: f1946861ca5a407f9b6ea2624fca1c80 May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersAdminTestJSON-449872593 May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersAdminTestJSON-449872593-project May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 3d79c875c4f04c3caaef620c4ea4b7a1 May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersAdminTestJSON-449872593-project May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 6eea408d-b686-46e2-8b8e-cdb192bfb37c could not be found. May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '6eea408d-b686-46e2-8b8e-cdb192bfb37c'} May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eea408d-b686-46e2-8b8e-cdb192bfb37c could not be found. May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eea408d-b686-46e2-8b8e-cdb192bfb37c could not be found. May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:18.564159 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:18.568990 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:18.568990 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:18.568990 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:18.568990 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:16:18.568990 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:16:18.568990 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eea408d-b686-46e2-8b8e-cdb192bfb37c could not be found. May 27 15:16:18.568990 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:18.568990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dd1c5685-26b0-434d-80ba-6adff891632c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Returning 404 to user: Instance 6eea408d-b686-46e2-8b8e-cdb192bfb37c could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:16:18.568990 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dd1c5685-26b0-434d-80ba-6adff891632c tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c" status: 404 len: 111 microversion: 2.1 time: 0.038814 May 27 15:16:18.568990 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2161/4325] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:18 2022] GET /compute/v2.1/servers/6eea408d-b686-46e2-8b8e-cdb192bfb37c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:16:18.575929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-12fa1d67-9dc4-4836-83da-cb720529b5ae tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:18.576450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-12fa1d67-9dc4-4836-83da-cb720529b5ae tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:18.587442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12fa1d67-9dc4-4836-83da-cb720529b5ae tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.587917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12fa1d67-9dc4-4836-83da-cb720529b5ae tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:18.588752 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12fa1d67-9dc4-4836-83da-cb720529b5ae tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.590254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12fa1d67-9dc4-4836-83da-cb720529b5ae tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:18.635943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-12fa1d67-9dc4-4836-83da-cb720529b5ae tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:16:18.758322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-eaa459db-df9f-464f-bbea-b6e7d016a179 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:18.768810 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-12fa1d67-9dc4-4836-83da-cb720529b5ae tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "DELETE /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 204 len: 0 microversion: 2.1 time: 0.195612 May 27 15:16:18.771612 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-eaa459db-df9f-464f-bbea-b6e7d016a179 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1701 microversion: 2.1 time: 0.325331 May 27 15:16:18.784991 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2162/4326] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:16:18 2022] DELETE /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:16:18.786022 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2165/4327] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:18 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1701 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:18.791475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-79a89019-23c3-4e9c-879a-78ac607e7adf tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:18.792101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-79a89019-23c3-4e9c-879a-78ac607e7adf tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:18.792996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a18a9662-6e76-44c0-a7cd-e8e05bb95cf9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:18.793786 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a18a9662-6e76-44c0-a7cd-e8e05bb95cf9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:18.798377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79a89019-23c3-4e9c-879a-78ac607e7adf tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.798848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79a89019-23c3-4e9c-879a-78ac607e7adf tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:18.799630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79a89019-23c3-4e9c-879a-78ac607e7adf tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.800080 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79a89019-23c3-4e9c-879a-78ac607e7adf tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:18.805125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a18a9662-6e76-44c0-a7cd-e8e05bb95cf9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.805636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a18a9662-6e76-44c0-a7cd-e8e05bb95cf9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:18.808793 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a18a9662-6e76-44c0-a7cd-e8e05bb95cf9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.809921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a18a9662-6e76-44c0-a7cd-e8e05bb95cf9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:18.906077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a18a9662-6e76-44c0-a7cd-e8e05bb95cf9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:18.916397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a18a9662-6e76-44c0-a7cd-e8e05bb95cf9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:18.918293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a18a9662-6e76-44c0-a7cd-e8e05bb95cf9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:18.919695 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a18a9662-6e76-44c0-a7cd-e8e05bb95cf9 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.141621 May 27 15:16:18.920574 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2163/4328] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:18 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:18.935845 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8bfaba56-7014-4cdb-a3f5-7d2be8607f22 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:18.942864 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8bfaba56-7014-4cdb-a3f5-7d2be8607f22 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.943368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8bfaba56-7014-4cdb-a3f5-7d2be8607f22 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:18.967615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8bfaba56-7014-4cdb-a3f5-7d2be8607f22 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Going to try to start instance {{(pid=119248) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 15:16:18.973356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-79a89019-23c3-4e9c-879a-78ac607e7adf tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:18.981837 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-79a89019-23c3-4e9c-879a-78ac607e7adf tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1469 microversion: 2.1 time: 0.194335 May 27 15:16:18.982823 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2166/4329] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:18 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1469 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:18.993573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:19.013645 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8bfaba56-7014-4cdb-a3f5-7d2be8607f22 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "POST /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376/action" status: 202 len: 0 microversion: 2.1 time: 0.081493 May 27 15:16:19.014258 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2164/4330] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:16:18 2022] POST /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:16:19.023132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bc544334-aed4-4f01-98ee-896f272780bf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:19.023830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bc544334-aed4-4f01-98ee-896f272780bf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:19.030428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc544334-aed4-4f01-98ee-896f272780bf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:19.031135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc544334-aed4-4f01-98ee-896f272780bf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:19.032081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc544334-aed4-4f01-98ee-896f272780bf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:19.033377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc544334-aed4-4f01-98ee-896f272780bf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:19.230375 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bc544334-aed4-4f01-98ee-896f272780bf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:19.239092 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bc544334-aed4-4f01-98ee-896f272780bf tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1710 microversion: 2.1 time: 0.219775 May 27 15:16:19.239720 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2167/4331] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:19 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1710 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:19.538141 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-446e02e8-efc9-4306-b820-8e1130a36a39 req-ecf13941-d500-4239-9d48-6f3e750817d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44", "name": "network-vif-deleted", "tag": "f99d4329-b5be-4d81-bfda-4d57a16a90a3"}, {"server_uuid": "117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44", "name": "network-vif-deleted", "tag": "8694e71a-6b70-4c7e-afe3-e17a6b86d8e9"}, {"server_uuid": "117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44", "name": "network-vif-deleted", "tag": "9ec1c794-7419-421d-bf77-36d41479ca12"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:19.546494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-446e02e8-efc9-4306-b820-8e1130a36a39 req-ecf13941-d500-4239-9d48-6f3e750817d0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:19.547195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-446e02e8-efc9-4306-b820-8e1130a36a39 req-ecf13941-d500-4239-9d48-6f3e750817d0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:19.547802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ecb4d37a-365d-4700-8b83-834a712a8ccf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:19.549103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ecb4d37a-365d-4700-8b83-834a712a8ccf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:19.558656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecb4d37a-365d-4700-8b83-834a712a8ccf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:19.559916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecb4d37a-365d-4700-8b83-834a712a8ccf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:19.560385 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-446e02e8-efc9-4306-b820-8e1130a36a39 req-ecf13941-d500-4239-9d48-6f3e750817d0 service nova] Creating event network-vif-deleted:f99d4329-b5be-4d81-bfda-4d57a16a90a3 for instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 on n-h1-843621-1 May 27 15:16:19.561016 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-446e02e8-efc9-4306-b820-8e1130a36a39 req-ecf13941-d500-4239-9d48-6f3e750817d0 service nova] Creating event network-vif-deleted:8694e71a-6b70-4c7e-afe3-e17a6b86d8e9 for instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 on n-h1-843621-1 May 27 15:16:19.561742 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-446e02e8-efc9-4306-b820-8e1130a36a39 req-ecf13941-d500-4239-9d48-6f3e750817d0 service nova] Creating event network-vif-deleted:9ec1c794-7419-421d-bf77-36d41479ca12 for instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 on n-h1-843621-1 May 27 15:16:19.561874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecb4d37a-365d-4700-8b83-834a712a8ccf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:19.562213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecb4d37a-365d-4700-8b83-834a712a8ccf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:19.567856 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-446e02e8-efc9-4306-b820-8e1130a36a39 req-ecf13941-d500-4239-9d48-6f3e750817d0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.036741 May 27 15:16:19.568592 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2165/4332] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:19.577675 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-ecb4d37a-365d-4700-8b83-834a712a8ccf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] HTTP exception thrown: Instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 could not be found. May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ecb4d37a-365d-4700-8b83-834a712a8ccf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Request method failure captured: May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 HTTP/1.1 May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOsUdBMh5v-ULiWL1KqcPs684D08fihdMblmDCUjtgxsHJ-eomFfJ17KNeIUKxQRQEdzdUVKgFJSQRi06Cl_aSMXu1Cv6oUFC5FssiRVYu1aJurFjj0OQxtgWRiIx86sH0xWJLewdpYqHDHIDLA0KSp_PlLgM9TRdHLwbZRBVWTPHfA May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 42c0be30e5494716a16b458fe631f6ee May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersTestMultiNic-764646204 May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/42c0be30e5494716a16b458fe631f6ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/42c0be30e5494716a16b458fe631f6ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/42c0be30e5494716a16b458fe631f6ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_42c0be30e5494716a16b458fe631f6ee", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersTestMultiNic-764646204 May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 42c0be30e5494716a16b458fe631f6ee May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersTestMultiNic-764646204 May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersTestMultiNic-764646204-project May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 1ae937c9ae1a44029ec336114f22df83 May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersTestMultiNic-764646204-project May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 could not be found. May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44'} May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 could not be found. May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 could not be found. May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:19.579352 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:19.586524 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:19.586524 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:19.586524 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:19.586524 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:16:19.586524 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:16:19.586524 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 could not be found. May 27 15:16:19.586524 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:19.586524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ecb4d37a-365d-4700-8b83-834a712a8ccf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Returning 404 to user: Instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:16:19.586524 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ecb4d37a-365d-4700-8b83-834a712a8ccf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 404 len: 111 microversion: 2.1 time: 0.040813 May 27 15:16:19.586524 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2168/4333] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:19 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:16:19.940735 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-06ec787e-9923-40d7-b8ab-30a64838b274 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:19.941718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-06ec787e-9923-40d7-b8ab-30a64838b274 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:19.948595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06ec787e-9923-40d7-b8ab-30a64838b274 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:19.949327 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06ec787e-9923-40d7-b8ab-30a64838b274 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:19.950297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06ec787e-9923-40d7-b8ab-30a64838b274 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:19.950891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06ec787e-9923-40d7-b8ab-30a64838b274 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:19.999475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-70fb3204-7460-4a61-a028-909a67bd5611 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:19.999999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-70fb3204-7460-4a61-a028-909a67bd5611 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:20.022633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70fb3204-7460-4a61-a028-909a67bd5611 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:20.026511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70fb3204-7460-4a61-a028-909a67bd5611 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:20.027450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70fb3204-7460-4a61-a028-909a67bd5611 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:20.029512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70fb3204-7460-4a61-a028-909a67bd5611 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:20.058304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-06ec787e-9923-40d7-b8ab-30a64838b274 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:20.070657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-06ec787e-9923-40d7-b8ab-30a64838b274 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:20.072430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-06ec787e-9923-40d7-b8ab-30a64838b274 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:20.073889 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-06ec787e-9923-40d7-b8ab-30a64838b274 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.139158 May 27 15:16:20.074970 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2166/4334] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:19 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:20.234234 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-70fb3204-7460-4a61-a028-909a67bd5611 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:20.243769 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-70fb3204-7460-4a61-a028-909a67bd5611 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1469 microversion: 2.1 time: 0.248515 May 27 15:16:20.244946 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2169/4335] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:19 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1469 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:20.260628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b009fbc3-b63b-4e43-82d1-9437fc266ccc tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:20.261526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b009fbc3-b63b-4e43-82d1-9437fc266ccc tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:20.269258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b009fbc3-b63b-4e43-82d1-9437fc266ccc tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:20.271635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b009fbc3-b63b-4e43-82d1-9437fc266ccc tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:20.272635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b009fbc3-b63b-4e43-82d1-9437fc266ccc tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:20.273291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b009fbc3-b63b-4e43-82d1-9437fc266ccc tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:20.483907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b009fbc3-b63b-4e43-82d1-9437fc266ccc tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:20.503417 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b009fbc3-b63b-4e43-82d1-9437fc266ccc tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1710 microversion: 2.1 time: 0.246405 May 27 15:16:20.505448 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2167/4336] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:20 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1710 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:21.094110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0959325a-137c-4588-9eb4-bc5eae0ece61 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:21.096279 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0959325a-137c-4588-9eb4-bc5eae0ece61 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:21.105199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:21.109988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0959325a-137c-4588-9eb4-bc5eae0ece61 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:21.111481 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0959325a-137c-4588-9eb4-bc5eae0ece61 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:21.112755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0959325a-137c-4588-9eb4-bc5eae0ece61 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:21.113594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0959325a-137c-4588-9eb4-bc5eae0ece61 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:21.263263 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0c3bfeeb-9093-42fe-acfc-494baf8a9b1a tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:21.264542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0c3bfeeb-9093-42fe-acfc-494baf8a9b1a tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:21.266565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0959325a-137c-4588-9eb4-bc5eae0ece61 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:21.280778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c3bfeeb-9093-42fe-acfc-494baf8a9b1a tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:21.286781 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0959325a-137c-4588-9eb4-bc5eae0ece61 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:21.289174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0959325a-137c-4588-9eb4-bc5eae0ece61 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:21.290673 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0959325a-137c-4588-9eb4-bc5eae0ece61 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.201244 May 27 15:16:21.291785 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2170/4337] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:21 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:21.303767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c3bfeeb-9093-42fe-acfc-494baf8a9b1a tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:21.308080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c3bfeeb-9093-42fe-acfc-494baf8a9b1a tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:21.310349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c3bfeeb-9093-42fe-acfc-494baf8a9b1a tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:21.388570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c3bfeeb-9093-42fe-acfc-494baf8a9b1a tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:21.389085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c3bfeeb-9093-42fe-acfc-494baf8a9b1a tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:21.389749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-0c3bfeeb-9093-42fe-acfc-494baf8a9b1a tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lazy-loading 'fault' on Instance uuid 38fbe9fb-a213-462c-a8af-ad601edd4928 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:16:21.446345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0c3bfeeb-9093-42fe-acfc-494baf8a9b1a tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d79c875c4f04c3caaef620c4ea4b7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1946861ca5a407f9b6ea2624fca1c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:21.471290 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0c3bfeeb-9093-42fe-acfc-494baf8a9b1a tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 200 len: 1304 microversion: 2.1 time: 0.209781 May 27 15:16:21.473325 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2168/4338] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:21 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 1304 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:21.523082 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c198596d-9460-4879-96f6-66b66c680b89 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:21.523757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c198596d-9460-4879-96f6-66b66c680b89 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:21.543200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c198596d-9460-4879-96f6-66b66c680b89 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:21.545181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c198596d-9460-4879-96f6-66b66c680b89 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:21.549125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c198596d-9460-4879-96f6-66b66c680b89 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:21.550026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c198596d-9460-4879-96f6-66b66c680b89 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:21.589071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-f6b78b76-071f-4450-81bf-076bd846e7ed req-88b16a2b-cf83-4588-87b6-2ed33008d2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38fbe9fb-a213-462c-a8af-ad601edd4928", "name": "network-vif-deleted", "tag": "2c770865-695e-4c59-acf2-cd06a2ac073c"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:21.609481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-f6b78b76-071f-4450-81bf-076bd846e7ed req-88b16a2b-cf83-4588-87b6-2ed33008d2e1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:21.610219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-f6b78b76-071f-4450-81bf-076bd846e7ed req-88b16a2b-cf83-4588-87b6-2ed33008d2e1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:21.635970 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-f6b78b76-071f-4450-81bf-076bd846e7ed req-88b16a2b-cf83-4588-87b6-2ed33008d2e1 service nova] Creating event network-vif-deleted:2c770865-695e-4c59-acf2-cd06a2ac073c for instance 38fbe9fb-a213-462c-a8af-ad601edd4928 on n-h2-843621-1 May 27 15:16:21.645703 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-f6b78b76-071f-4450-81bf-076bd846e7ed req-88b16a2b-cf83-4588-87b6-2ed33008d2e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063367 May 27 15:16:21.651529 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2169/4339] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:21.792734 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c198596d-9460-4879-96f6-66b66c680b89 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:21.802207 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c198596d-9460-4879-96f6-66b66c680b89 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1714 microversion: 2.1 time: 0.283720 May 27 15:16:21.803562 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2171/4340] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:21 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1714 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:22.316047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-835b5047-89a7-4f14-a90e-4cf55ce6c6da tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:22.317946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-835b5047-89a7-4f14-a90e-4cf55ce6c6da tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:22.332523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-835b5047-89a7-4f14-a90e-4cf55ce6c6da tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:22.333044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-835b5047-89a7-4f14-a90e-4cf55ce6c6da tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:22.333836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-835b5047-89a7-4f14-a90e-4cf55ce6c6da tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:22.334422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-835b5047-89a7-4f14-a90e-4cf55ce6c6da tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:22.416739 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-835b5047-89a7-4f14-a90e-4cf55ce6c6da tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:22.427446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-835b5047-89a7-4f14-a90e-4cf55ce6c6da tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:22.429159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-835b5047-89a7-4f14-a90e-4cf55ce6c6da tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:22.430498 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-835b5047-89a7-4f14-a90e-4cf55ce6c6da tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.123461 May 27 15:16:22.431169 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2170/4341] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:22 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:22.490985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b39df46e-8498-46d2-be91-0fa81fa28459 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:22.491616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b39df46e-8498-46d2-be91-0fa81fa28459 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] [instance: 38fbe9fb-a213-462c-a8af-ad601edd4928] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:22.499920 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b39df46e-8498-46d2-be91-0fa81fa28459 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:22.500371 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b39df46e-8498-46d2-be91-0fa81fa28459 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:22.501452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b39df46e-8498-46d2-be91-0fa81fa28459 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:22.502051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b39df46e-8498-46d2-be91-0fa81fa28459 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:22.516459 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-b39df46e-8498-46d2-be91-0fa81fa28459 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] HTTP exception thrown: Instance 38fbe9fb-a213-462c-a8af-ad601edd4928 could not be found. May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b39df46e-8498-46d2-be91-0fa81fa28459 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Request method failure captured: May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 HTTP/1.1 May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOraC2nMLJWhwI4YZcBTKxpWUEd-ybTPTl5W8L27VSjR8kZNCh7z16te_Dkdn9TCAzw0XvW11YRlIBK5XUHDhd0vMzd0y5-4qAkVIBSG9p-ti6kijVcafp8LvIFusUGmMZUgRU3Y537_HrFqFRMsXGntkDPKnZHTIPqVQR9bH7enzBs May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: f1946861ca5a407f9b6ea2624fca1c80 May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersAdminTestJSON-449872593 May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f1946861ca5a407f9b6ea2624fca1c80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f1946861ca5a407f9b6ea2624fca1c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f1946861ca5a407f9b6ea2624fca1c80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f1946861ca5a407f9b6ea2624fca1c80", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersAdminTestJSON-449872593 May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: f1946861ca5a407f9b6ea2624fca1c80 May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersAdminTestJSON-449872593 May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersAdminTestJSON-449872593-project May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 3d79c875c4f04c3caaef620c4ea4b7a1 May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersAdminTestJSON-449872593-project May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 38fbe9fb-a213-462c-a8af-ad601edd4928 could not be found. May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '38fbe9fb-a213-462c-a8af-ad601edd4928'} May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38fbe9fb-a213-462c-a8af-ad601edd4928 could not be found. May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38fbe9fb-a213-462c-a8af-ad601edd4928 could not be found. May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:22.518919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:22.525790 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:22.525790 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:22.525790 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:22.525790 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:16:22.525790 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:16:22.525790 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38fbe9fb-a213-462c-a8af-ad601edd4928 could not be found. May 27 15:16:22.525790 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:22.525790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b39df46e-8498-46d2-be91-0fa81fa28459 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] Returning 404 to user: Instance 38fbe9fb-a213-462c-a8af-ad601edd4928 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:16:22.525790 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b39df46e-8498-46d2-be91-0fa81fa28459 tempest-ServersAdminTestJSON-449872593 tempest-ServersAdminTestJSON-449872593-project] 10.222.0.13 "GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928" status: 404 len: 111 microversion: 2.1 time: 0.034311 May 27 15:16:22.525790 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2172/4342] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:22 2022] GET /compute/v2.1/servers/38fbe9fb-a213-462c-a8af-ad601edd4928 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:16:23.463106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-53373ed8-efaa-4c11-89e0-7c997a6116c0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:23.464694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-53373ed8-efaa-4c11-89e0-7c997a6116c0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:23.482327 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53373ed8-efaa-4c11-89e0-7c997a6116c0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:23.484440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53373ed8-efaa-4c11-89e0-7c997a6116c0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:23.489440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53373ed8-efaa-4c11-89e0-7c997a6116c0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:23.490326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53373ed8-efaa-4c11-89e0-7c997a6116c0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:23.629422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-53373ed8-efaa-4c11-89e0-7c997a6116c0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:23.641166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-53373ed8-efaa-4c11-89e0-7c997a6116c0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:23.644808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-53373ed8-efaa-4c11-89e0-7c997a6116c0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:23.646517 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-53373ed8-efaa-4c11-89e0-7c997a6116c0 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.197629 May 27 15:16:23.657869 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2171/4343] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:23 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:23.683866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-54c7faae-f02f-4a92-a291-b21f84bc0fcf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-613464812", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "45113fa4-66d3-4846-b31a-0b4d3fd62ede"}, {"uuid": "acfc3713-7370-407b-8bcf-3c7379810da6"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:23.768995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-54c7faae-f02f-4a92-a291-b21f84bc0fcf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] validate_networks() for [('45113fa4-66d3-4846-b31a-0b4d3fd62ede', None, None, None, None, None), ('acfc3713-7370-407b-8bcf-3c7379810da6', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:16:24.597136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-54c7faae-f02f-4a92-a291-b21f84bc0fcf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:16:24.597559 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-54c7faae-f02f-4a92-a291-b21f84bc0fcf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:16:24.598490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-54c7faae-f02f-4a92-a291-b21f84bc0fcf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:16:24.599752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-54c7faae-f02f-4a92-a291-b21f84bc0fcf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:16:24.600349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-54c7faae-f02f-4a92-a291-b21f84bc0fcf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:16:24.612328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54c7faae-f02f-4a92-a291-b21f84bc0fcf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:24.612813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54c7faae-f02f-4a92-a291-b21f84bc0fcf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:24.613789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54c7faae-f02f-4a92-a291-b21f84bc0fcf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:24.614366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54c7faae-f02f-4a92-a291-b21f84bc0fcf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:24.634553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-54c7faae-f02f-4a92-a291-b21f84bc0fcf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Getting quotas for project 42c0be30e5494716a16b458fe631f6ee. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:16:24.640581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-54c7faae-f02f-4a92-a291-b21f84bc0fcf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Getting quotas for user 1ae937c9ae1a44029ec336114f22df83 and project 42c0be30e5494716a16b458fe631f6ee. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:16:24.653916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-54c7faae-f02f-4a92-a291-b21f84bc0fcf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:16:24.657007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-54c7faae-f02f-4a92-a291-b21f84bc0fcf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:16:24.666992 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-172c4447-117c-4cd9-af3b-5da8cd3971e6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:24.668654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-172c4447-117c-4cd9-af3b-5da8cd3971e6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:24.672042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:24.679331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-172c4447-117c-4cd9-af3b-5da8cd3971e6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:24.680041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-172c4447-117c-4cd9-af3b-5da8cd3971e6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:24.681037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-172c4447-117c-4cd9-af3b-5da8cd3971e6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:24.682334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-172c4447-117c-4cd9-af3b-5da8cd3971e6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:24.754001 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-54c7faae-f02f-4a92-a291-b21f84bc0fcf tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.073946 May 27 15:16:24.756609 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2173/4344] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:16:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 15:16:24.773181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dbcd466c-b8c2-4fa9-a179-6fc4abbefebe tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:24.774247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dbcd466c-b8c2-4fa9-a179-6fc4abbefebe tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:24.807031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-172c4447-117c-4cd9-af3b-5da8cd3971e6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:24.832209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-172c4447-117c-4cd9-af3b-5da8cd3971e6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:24.833985 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-172c4447-117c-4cd9-af3b-5da8cd3971e6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:24.835239 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-172c4447-117c-4cd9-af3b-5da8cd3971e6 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.172122 May 27 15:16:24.835815 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2172/4345] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:24 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:16:24.887484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dbcd466c-b8c2-4fa9-a179-6fc4abbefebe tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:24.898600 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dbcd466c-b8c2-4fa9-a179-6fc4abbefebe tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 200 len: 1212 microversion: 2.1 time: 0.134894 May 27 15:16:24.899184 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2174/4346] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:24 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 1212 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:25.856598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-186d384f-f4ad-4e0b-8946-bff6a1a2332a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:25.857861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-186d384f-f4ad-4e0b-8946-bff6a1a2332a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:25.875494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-186d384f-f4ad-4e0b-8946-bff6a1a2332a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:25.881512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-186d384f-f4ad-4e0b-8946-bff6a1a2332a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:25.887469 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-186d384f-f4ad-4e0b-8946-bff6a1a2332a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:25.888199 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-186d384f-f4ad-4e0b-8946-bff6a1a2332a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:25.920751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1ba9cadb-97e2-4df3-b4e8-fead6b50c753 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:25.922423 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1ba9cadb-97e2-4df3-b4e8-fead6b50c753 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:25.956927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ba9cadb-97e2-4df3-b4e8-fead6b50c753 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:25.957403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ba9cadb-97e2-4df3-b4e8-fead6b50c753 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:25.960659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ba9cadb-97e2-4df3-b4e8-fead6b50c753 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:25.971326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ba9cadb-97e2-4df3-b4e8-fead6b50c753 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:26.049221 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-186d384f-f4ad-4e0b-8946-bff6a1a2332a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:26.068260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-186d384f-f4ad-4e0b-8946-bff6a1a2332a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:26.072657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-186d384f-f4ad-4e0b-8946-bff6a1a2332a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:26.074986 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-186d384f-f4ad-4e0b-8946-bff6a1a2332a tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.224217 May 27 15:16:26.076684 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2173/4347] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:25 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:26.094032 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1ba9cadb-97e2-4df3-b4e8-fead6b50c753 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:26.105746 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1ba9cadb-97e2-4df3-b4e8-fead6b50c753 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 200 len: 1264 microversion: 2.1 time: 0.192742 May 27 15:16:26.106706 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2175/4348] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:25 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:26.700513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3d4eaf48-fba1-4e7a-ae27-e9e00e960c74 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1501913731", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:26.781530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-3d4eaf48-fba1-4e7a-ae27-e9e00e960c74 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] validate_networks() for None {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:16:27.028377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3d4eaf48-fba1-4e7a-ae27-e9e00e960c74 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:16:27.029146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3d4eaf48-fba1-4e7a-ae27-e9e00e960c74 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:16:27.029379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3d4eaf48-fba1-4e7a-ae27-e9e00e960c74 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:16:27.029796 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3d4eaf48-fba1-4e7a-ae27-e9e00e960c74 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:16:27.030348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3d4eaf48-fba1-4e7a-ae27-e9e00e960c74 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:16:27.047403 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d4eaf48-fba1-4e7a-ae27-e9e00e960c74 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:27.048726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d4eaf48-fba1-4e7a-ae27-e9e00e960c74 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:27.049748 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d4eaf48-fba1-4e7a-ae27-e9e00e960c74 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:27.051103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d4eaf48-fba1-4e7a-ae27-e9e00e960c74 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:27.099292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6d27fba5-535b-444d-87fa-c66e939cab03 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:27.100453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6d27fba5-535b-444d-87fa-c66e939cab03 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:27.102983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-3d4eaf48-fba1-4e7a-ae27-e9e00e960c74 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Getting quotas for project 6ee6b3dae0924634a0d0d319ac0be692. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:16:27.109970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-3d4eaf48-fba1-4e7a-ae27-e9e00e960c74 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Getting quotas for user 693e50b119084e849e6a701c0d1f8037 and project 6ee6b3dae0924634a0d0d319ac0be692. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:16:27.111596 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d27fba5-535b-444d-87fa-c66e939cab03 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:27.115351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d27fba5-535b-444d-87fa-c66e939cab03 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:27.122663 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d27fba5-535b-444d-87fa-c66e939cab03 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:27.123696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d27fba5-535b-444d-87fa-c66e939cab03 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:27.145319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3d4eaf48-fba1-4e7a-ae27-e9e00e960c74 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:16:27.149898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3d4eaf48-fba1-4e7a-ae27-e9e00e960c74 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:16:27.211305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6d27fba5-535b-444d-87fa-c66e939cab03 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:27.228484 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3d4eaf48-fba1-4e7a-ae27-e9e00e960c74 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676882 May 27 15:16:27.229968 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2174/4349] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:16:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:16:27.239095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3e88edfb-64de-4865-ae40-3ca78b588c02 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:27.239976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3e88edfb-64de-4865-ae40-3ca78b588c02 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:27.249381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e88edfb-64de-4865-ae40-3ca78b588c02 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:27.250071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e88edfb-64de-4865-ae40-3ca78b588c02 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:27.252208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e88edfb-64de-4865-ae40-3ca78b588c02 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:27.252951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e88edfb-64de-4865-ae40-3ca78b588c02 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:27.268314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6d27fba5-535b-444d-87fa-c66e939cab03 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:27.276734 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6d27fba5-535b-444d-87fa-c66e939cab03 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:27.278063 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6d27fba5-535b-444d-87fa-c66e939cab03 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.186656 May 27 15:16:27.283283 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2176/4350] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:27 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:16:27.301603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-58d2f1b6-1c9b-4922-affd-2ce3d1b45e09 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:27.302967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-58d2f1b6-1c9b-4922-affd-2ce3d1b45e09 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:27.480966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-58d2f1b6-1c9b-4922-affd-2ce3d1b45e09 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:27.494663 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-58d2f1b6-1c9b-4922-affd-2ce3d1b45e09 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca" status: 200 len: 1222 microversion: 2.1 time: 0.208975 May 27 15:16:27.495698 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2177/4351] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:27 2022] GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca => generated 1222 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:27.633463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3e88edfb-64de-4865-ae40-3ca78b588c02 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:27.644604 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3e88edfb-64de-4865-ae40-3ca78b588c02 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 200 len: 1312 microversion: 2.1 time: 0.413089 May 27 15:16:27.654396 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2175/4352] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:27 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 1312 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:28.297876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d902367b-7c90-4bb8-8dee-54d5c012ef29 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:28.299755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d902367b-7c90-4bb8-8dee-54d5c012ef29 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:28.314334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d902367b-7c90-4bb8-8dee-54d5c012ef29 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:28.315374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d902367b-7c90-4bb8-8dee-54d5c012ef29 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:28.317007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d902367b-7c90-4bb8-8dee-54d5c012ef29 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:28.317684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d902367b-7c90-4bb8-8dee-54d5c012ef29 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:28.431690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d902367b-7c90-4bb8-8dee-54d5c012ef29 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:28.443494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d902367b-7c90-4bb8-8dee-54d5c012ef29 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:28.445404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d902367b-7c90-4bb8-8dee-54d5c012ef29 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:28.446929 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d902367b-7c90-4bb8-8dee-54d5c012ef29 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.153258 May 27 15:16:28.447895 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2178/4353] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:28 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:28.518716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-29440647-4d70-46ea-8f14-2280c182fc38 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:28.525647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-29440647-4d70-46ea-8f14-2280c182fc38 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:28.539047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29440647-4d70-46ea-8f14-2280c182fc38 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:28.539817 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29440647-4d70-46ea-8f14-2280c182fc38 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:28.541166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29440647-4d70-46ea-8f14-2280c182fc38 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:28.541977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29440647-4d70-46ea-8f14-2280c182fc38 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:28.631984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-29440647-4d70-46ea-8f14-2280c182fc38 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:28.643100 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-29440647-4d70-46ea-8f14-2280c182fc38 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca" status: 200 len: 1274 microversion: 2.1 time: 0.134850 May 27 15:16:28.643927 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2176/4354] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:28 2022] GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca => generated 1274 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:28.663847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1bb00e18-6082-40c7-8fb3-1b769832c9b8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:28.664940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1bb00e18-6082-40c7-8fb3-1b769832c9b8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:28.674200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1bb00e18-6082-40c7-8fb3-1b769832c9b8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:28.674921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1bb00e18-6082-40c7-8fb3-1b769832c9b8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:28.676181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1bb00e18-6082-40c7-8fb3-1b769832c9b8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:28.677007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1bb00e18-6082-40c7-8fb3-1b769832c9b8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:28.881507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1bb00e18-6082-40c7-8fb3-1b769832c9b8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:28.891818 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1bb00e18-6082-40c7-8fb3-1b769832c9b8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 200 len: 1333 microversion: 2.1 time: 0.232690 May 27 15:16:28.893336 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2179/4355] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:28 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 1333 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:29.478214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-21e186ea-cfaf-48a0-88d7-a0dd78abf0a8 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:29.479140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-21e186ea-cfaf-48a0-88d7-a0dd78abf0a8 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:29.485455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21e186ea-cfaf-48a0-88d7-a0dd78abf0a8 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:29.486646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21e186ea-cfaf-48a0-88d7-a0dd78abf0a8 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:29.487425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21e186ea-cfaf-48a0-88d7-a0dd78abf0a8 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:29.488049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21e186ea-cfaf-48a0-88d7-a0dd78abf0a8 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:29.570858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-21e186ea-cfaf-48a0-88d7-a0dd78abf0a8 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:29.582435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-21e186ea-cfaf-48a0-88d7-a0dd78abf0a8 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:29.584898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-21e186ea-cfaf-48a0-88d7-a0dd78abf0a8 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:29.586170 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-21e186ea-cfaf-48a0-88d7-a0dd78abf0a8 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.111849 May 27 15:16:29.600289 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2177/4356] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:29 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:29.654512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-0c626338-f961-4d38-8518-f56e1ba4fe8a req-1e5a4781-84c1-43b8-a6e2-7fd8dae1c5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d717563-18ef-4ab7-82ca-4db0ddecc056", "tag": "2f43cda6-2b75-4cc2-b7dd-71adee2e0af3"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:29.668812 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ceecf175-dcd5-48a0-a87b-608e1ce3d161 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:29.675476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0c626338-f961-4d38-8518-f56e1ba4fe8a req-1e5a4781-84c1-43b8-a6e2-7fd8dae1c5f2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:29.675923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0c626338-f961-4d38-8518-f56e1ba4fe8a req-1e5a4781-84c1-43b8-a6e2-7fd8dae1c5f2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:29.679256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ceecf175-dcd5-48a0-a87b-608e1ce3d161 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:29.688206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ceecf175-dcd5-48a0-a87b-608e1ce3d161 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:29.691251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ceecf175-dcd5-48a0-a87b-608e1ce3d161 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:29.697793 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ceecf175-dcd5-48a0-a87b-608e1ce3d161 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:29.698329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ceecf175-dcd5-48a0-a87b-608e1ce3d161 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:29.704894 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-0c626338-f961-4d38-8518-f56e1ba4fe8a req-1e5a4781-84c1-43b8-a6e2-7fd8dae1c5f2 service nova] Creating event network-changed:2f43cda6-2b75-4cc2-b7dd-71adee2e0af3 for instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 on n-h2-843621-1 May 27 15:16:29.718007 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-0c626338-f961-4d38-8518-f56e1ba4fe8a req-1e5a4781-84c1-43b8-a6e2-7fd8dae1c5f2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068687 May 27 15:16:29.719635 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2180/4357] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:29.785112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ceecf175-dcd5-48a0-a87b-608e1ce3d161 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:29.794226 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ceecf175-dcd5-48a0-a87b-608e1ce3d161 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca" status: 200 len: 1280 microversion: 2.1 time: 0.132276 May 27 15:16:29.805218 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2178/4358] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:29 2022] GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca => generated 1280 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:29.927115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7f885f0a-ba45-4dc8-8a27-c65c2f08fbd0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:29.930475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7f885f0a-ba45-4dc8-8a27-c65c2f08fbd0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:29.941384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f885f0a-ba45-4dc8-8a27-c65c2f08fbd0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:29.941980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f885f0a-ba45-4dc8-8a27-c65c2f08fbd0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:29.943027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f885f0a-ba45-4dc8-8a27-c65c2f08fbd0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:29.943550 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f885f0a-ba45-4dc8-8a27-c65c2f08fbd0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:29.946659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:30.108626 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7f885f0a-ba45-4dc8-8a27-c65c2f08fbd0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:30.120546 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7f885f0a-ba45-4dc8-8a27-c65c2f08fbd0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 200 len: 1333 microversion: 2.1 time: 0.213735 May 27 15:16:30.131456 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2181/4359] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:29 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 1333 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:30.617427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c60210cc-1ed6-4b14-b863-76f2b060e0ca tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:30.618982 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c60210cc-1ed6-4b14-b863-76f2b060e0ca tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:30.628379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c60210cc-1ed6-4b14-b863-76f2b060e0ca tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:30.629213 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c60210cc-1ed6-4b14-b863-76f2b060e0ca tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:30.630368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c60210cc-1ed6-4b14-b863-76f2b060e0ca tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:30.631245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c60210cc-1ed6-4b14-b863-76f2b060e0ca tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:30.717573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c60210cc-1ed6-4b14-b863-76f2b060e0ca tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:30.728047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c60210cc-1ed6-4b14-b863-76f2b060e0ca tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:30.730261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c60210cc-1ed6-4b14-b863-76f2b060e0ca tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:30.731694 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c60210cc-1ed6-4b14-b863-76f2b060e0ca tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.128548 May 27 15:16:30.732505 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2179/4360] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:30 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:30.811441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-26096e08-d3b3-4bc4-8ca6-2a8e0db7125e tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:30.816124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-26096e08-d3b3-4bc4-8ca6-2a8e0db7125e tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:30.823823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26096e08-d3b3-4bc4-8ca6-2a8e0db7125e tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:30.824583 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26096e08-d3b3-4bc4-8ca6-2a8e0db7125e tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:30.825763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26096e08-d3b3-4bc4-8ca6-2a8e0db7125e tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:30.826386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26096e08-d3b3-4bc4-8ca6-2a8e0db7125e tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:31.021733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-26096e08-d3b3-4bc4-8ca6-2a8e0db7125e tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:31.029445 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-26096e08-d3b3-4bc4-8ca6-2a8e0db7125e tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca" status: 200 len: 1322 microversion: 2.1 time: 0.221844 May 27 15:16:31.030799 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2182/4361] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:30 2022] GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:31.138819 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9cc61f92-f661-4382-bd37-86fd1e011b50 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:31.140026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9cc61f92-f661-4382-bd37-86fd1e011b50 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:31.147330 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cc61f92-f661-4382-bd37-86fd1e011b50 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:31.149216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cc61f92-f661-4382-bd37-86fd1e011b50 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:31.152127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cc61f92-f661-4382-bd37-86fd1e011b50 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:31.153106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cc61f92-f661-4382-bd37-86fd1e011b50 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:31.312261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9cc61f92-f661-4382-bd37-86fd1e011b50 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:31.321274 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9cc61f92-f661-4382-bd37-86fd1e011b50 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 200 len: 1333 microversion: 2.1 time: 0.186400 May 27 15:16:31.321872 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2180/4362] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:31 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 1333 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:31.760482 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-bdb23731-7048-4653-bb72-8498ca08da3f req-f420e0ba-2768-4a84-8f17-3cb8631827cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d717563-18ef-4ab7-82ca-4db0ddecc056", "tag": "71d5695d-38cb-41d1-a233-2711158af338"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:31.767704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6870eca6-10c4-4528-af32-cbfe2ff8b1a5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:31.768347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6870eca6-10c4-4528-af32-cbfe2ff8b1a5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:31.780968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6870eca6-10c4-4528-af32-cbfe2ff8b1a5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:31.783997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6870eca6-10c4-4528-af32-cbfe2ff8b1a5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:31.785043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6870eca6-10c4-4528-af32-cbfe2ff8b1a5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:31.789366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6870eca6-10c4-4528-af32-cbfe2ff8b1a5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:31.789903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-bdb23731-7048-4653-bb72-8498ca08da3f req-f420e0ba-2768-4a84-8f17-3cb8631827cf service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:31.794448 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-bdb23731-7048-4653-bb72-8498ca08da3f req-f420e0ba-2768-4a84-8f17-3cb8631827cf service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:31.811289 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-bdb23731-7048-4653-bb72-8498ca08da3f req-f420e0ba-2768-4a84-8f17-3cb8631827cf service nova] Creating event network-changed:71d5695d-38cb-41d1-a233-2711158af338 for instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 on n-h2-843621-1 May 27 15:16:31.820588 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-bdb23731-7048-4653-bb72-8498ca08da3f req-f420e0ba-2768-4a84-8f17-3cb8631827cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071298 May 27 15:16:31.826156 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2181/4363] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:31.877546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6870eca6-10c4-4528-af32-cbfe2ff8b1a5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:31.887405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6870eca6-10c4-4528-af32-cbfe2ff8b1a5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:31.888984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6870eca6-10c4-4528-af32-cbfe2ff8b1a5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:31.890232 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6870eca6-10c4-4528-af32-cbfe2ff8b1a5 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.143481 May 27 15:16:31.891264 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2183/4364] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:31 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:32.047729 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cac669f3-a972-4180-b4b1-553565231647 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:32.049379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cac669f3-a972-4180-b4b1-553565231647 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:32.057039 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cac669f3-a972-4180-b4b1-553565231647 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:32.057900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cac669f3-a972-4180-b4b1-553565231647 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:32.059251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cac669f3-a972-4180-b4b1-553565231647 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:32.059932 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cac669f3-a972-4180-b4b1-553565231647 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:32.235607 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cac669f3-a972-4180-b4b1-553565231647 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:32.255145 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cac669f3-a972-4180-b4b1-553565231647 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca" status: 200 len: 1322 microversion: 2.1 time: 0.211759 May 27 15:16:32.256181 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2182/4365] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:32 2022] GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:32.338538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-73fd8b93-694f-4474-9409-bcf80453eb8f tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:32.339754 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-73fd8b93-694f-4474-9409-bcf80453eb8f tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:32.348984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73fd8b93-694f-4474-9409-bcf80453eb8f tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:32.349859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73fd8b93-694f-4474-9409-bcf80453eb8f tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:32.351684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73fd8b93-694f-4474-9409-bcf80453eb8f tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:32.352227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73fd8b93-694f-4474-9409-bcf80453eb8f tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:32.530069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-73fd8b93-694f-4474-9409-bcf80453eb8f tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:32.539253 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-73fd8b93-694f-4474-9409-bcf80453eb8f tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 200 len: 1333 microversion: 2.1 time: 0.204586 May 27 15:16:32.540067 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2184/4366] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:32 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 1333 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:32.910562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f95a9820-dda2-4648-b165-19032f2a786b tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:32.911355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f95a9820-dda2-4648-b165-19032f2a786b tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:32.918515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f95a9820-dda2-4648-b165-19032f2a786b tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:32.918976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f95a9820-dda2-4648-b165-19032f2a786b tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:32.919759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f95a9820-dda2-4648-b165-19032f2a786b tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:32.920263 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f95a9820-dda2-4648-b165-19032f2a786b tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:32.936459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:32.986827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f95a9820-dda2-4648-b165-19032f2a786b tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:32.996209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f95a9820-dda2-4648-b165-19032f2a786b tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:32.997913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f95a9820-dda2-4648-b165-19032f2a786b tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:32.999082 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f95a9820-dda2-4648-b165-19032f2a786b tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.092485 May 27 15:16:32.999676 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2183/4367] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:32 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:33.278000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f65e56ed-cb54-4597-bc21-16a757cffb5f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:33.278593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f65e56ed-cb54-4597-bc21-16a757cffb5f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:33.285666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f65e56ed-cb54-4597-bc21-16a757cffb5f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:33.286124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f65e56ed-cb54-4597-bc21-16a757cffb5f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:33.286888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f65e56ed-cb54-4597-bc21-16a757cffb5f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:33.287326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f65e56ed-cb54-4597-bc21-16a757cffb5f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:33.418692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f65e56ed-cb54-4597-bc21-16a757cffb5f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:33.426937 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f65e56ed-cb54-4597-bc21-16a757cffb5f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca" status: 200 len: 1322 microversion: 2.1 time: 0.157334 May 27 15:16:33.427514 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2185/4368] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:33 2022] GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:33.555473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-34ef44f7-5713-42aa-9c6a-b8f8eb0ad3ea tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:33.555987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-34ef44f7-5713-42aa-9c6a-b8f8eb0ad3ea tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:33.562244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34ef44f7-5713-42aa-9c6a-b8f8eb0ad3ea tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:33.562705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34ef44f7-5713-42aa-9c6a-b8f8eb0ad3ea tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:33.563483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34ef44f7-5713-42aa-9c6a-b8f8eb0ad3ea tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:33.563932 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34ef44f7-5713-42aa-9c6a-b8f8eb0ad3ea tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:33.710319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-34ef44f7-5713-42aa-9c6a-b8f8eb0ad3ea tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:33.718329 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-34ef44f7-5713-42aa-9c6a-b8f8eb0ad3ea tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 200 len: 1333 microversion: 2.1 time: 0.166768 May 27 15:16:33.718912 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2184/4369] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:33 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 1333 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:33.857518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-736cafdc-ece9-46c8-bb3d-88fdf6dd2cec req-4006a63e-7352-485d-b4b2-d0a2160aa85e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e3ab31c-07b1-4bb7-9999-47ada1e50bca", "tag": "a84b7bca-8c79-4ff2-a56b-b21b6e7fb298"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:33.866576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-736cafdc-ece9-46c8-bb3d-88fdf6dd2cec req-4006a63e-7352-485d-b4b2-d0a2160aa85e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:33.867035 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-736cafdc-ece9-46c8-bb3d-88fdf6dd2cec req-4006a63e-7352-485d-b4b2-d0a2160aa85e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:33.880001 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-736cafdc-ece9-46c8-bb3d-88fdf6dd2cec req-4006a63e-7352-485d-b4b2-d0a2160aa85e service nova] Creating event network-changed:a84b7bca-8c79-4ff2-a56b-b21b6e7fb298 for instance 0e3ab31c-07b1-4bb7-9999-47ada1e50bca on n-h1-843621-1 May 27 15:16:33.886112 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-736cafdc-ece9-46c8-bb3d-88fdf6dd2cec req-4006a63e-7352-485d-b4b2-d0a2160aa85e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033261 May 27 15:16:33.886924 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2186/4370] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:34.019497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cb17a248-14c8-45f6-99a8-8326abf05bed tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:34.020763 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cb17a248-14c8-45f6-99a8-8326abf05bed tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:34.029025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb17a248-14c8-45f6-99a8-8326abf05bed tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:34.029496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb17a248-14c8-45f6-99a8-8326abf05bed tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:34.031295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb17a248-14c8-45f6-99a8-8326abf05bed tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:34.031758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb17a248-14c8-45f6-99a8-8326abf05bed tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:34.102927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cb17a248-14c8-45f6-99a8-8326abf05bed tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:34.112373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cb17a248-14c8-45f6-99a8-8326abf05bed tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:34.114272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cb17a248-14c8-45f6-99a8-8326abf05bed tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:34.115469 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cb17a248-14c8-45f6-99a8-8326abf05bed tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1604 microversion: 2.42 time: 0.100677 May 27 15:16:34.116026 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2185/4371] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:34 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1604 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:34.446295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fdd26fb4-3d11-4350-aff1-b8e4c45ef8b8 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:34.447006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fdd26fb4-3d11-4350-aff1-b8e4c45ef8b8 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:34.455545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fdd26fb4-3d11-4350-aff1-b8e4c45ef8b8 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:34.456010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fdd26fb4-3d11-4350-aff1-b8e4c45ef8b8 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:34.456835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fdd26fb4-3d11-4350-aff1-b8e4c45ef8b8 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:34.457287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fdd26fb4-3d11-4350-aff1-b8e4c45ef8b8 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:34.625612 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fdd26fb4-3d11-4350-aff1-b8e4c45ef8b8 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:34.630046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:34.638941 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fdd26fb4-3d11-4350-aff1-b8e4c45ef8b8 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca" status: 200 len: 1322 microversion: 2.1 time: 0.197750 May 27 15:16:34.639899 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2187/4372] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:34 2022] GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:34.735962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2c22c5b0-ba7f-4253-976c-dda460cad9c8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:34.736589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2c22c5b0-ba7f-4253-976c-dda460cad9c8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:34.743176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2c22c5b0-ba7f-4253-976c-dda460cad9c8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:34.743632 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2c22c5b0-ba7f-4253-976c-dda460cad9c8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:34.744422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2c22c5b0-ba7f-4253-976c-dda460cad9c8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:34.744883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2c22c5b0-ba7f-4253-976c-dda460cad9c8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:34.886643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2c22c5b0-ba7f-4253-976c-dda460cad9c8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:34.894589 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2c22c5b0-ba7f-4253-976c-dda460cad9c8 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 200 len: 1333 microversion: 2.1 time: 0.163012 May 27 15:16:34.895182 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2186/4373] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:34 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 1333 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:35.136302 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ac0459a1-4bea-4915-8d41-e03bfda996de tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:35.136969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ac0459a1-4bea-4915-8d41-e03bfda996de tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:35.146986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac0459a1-4bea-4915-8d41-e03bfda996de tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:35.147649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac0459a1-4bea-4915-8d41-e03bfda996de tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:35.148879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac0459a1-4bea-4915-8d41-e03bfda996de tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:35.149493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac0459a1-4bea-4915-8d41-e03bfda996de tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:35.206304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac0459a1-4bea-4915-8d41-e03bfda996de tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:35.216868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac0459a1-4bea-4915-8d41-e03bfda996de tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:35.217578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-ac0459a1-4bea-4915-8d41-e03bfda996de tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lazy-loading 'fault' on Instance uuid 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:16:35.279933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ac0459a1-4bea-4915-8d41-e03bfda996de tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:35.285419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f5ca70e2-ccb6-4fb5-aef7-30873aeb385a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:35.285906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f5ca70e2-ccb6-4fb5-aef7-30873aeb385a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:35.298451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ac0459a1-4bea-4915-8d41-e03bfda996de tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:35.299955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ac0459a1-4bea-4915-8d41-e03bfda996de tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76881ea8722f45568bb04c26743b51d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3657598de154fedbe5fcf2eb4fa9c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:35.305172 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f5ca70e2-ccb6-4fb5-aef7-30873aeb385a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:35.305645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f5ca70e2-ccb6-4fb5-aef7-30873aeb385a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:35.306425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f5ca70e2-ccb6-4fb5-aef7-30873aeb385a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:35.306869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f5ca70e2-ccb6-4fb5-aef7-30873aeb385a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:35.311960 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ac0459a1-4bea-4915-8d41-e03bfda996de tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 200 len: 1609 microversion: 2.42 time: 0.179727 May 27 15:16:35.312925 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2188/4374] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:35 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 1609 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:35.655510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dc458611-c63a-4296-a0bd-47783ce9f3b4 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:35.656203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dc458611-c63a-4296-a0bd-47783ce9f3b4 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:35.667673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc458611-c63a-4296-a0bd-47783ce9f3b4 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:35.668211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc458611-c63a-4296-a0bd-47783ce9f3b4 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:35.669311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc458611-c63a-4296-a0bd-47783ce9f3b4 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:35.671791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc458611-c63a-4296-a0bd-47783ce9f3b4 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:35.867836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-f5ca70e2-ccb6-4fb5-aef7-30873aeb385a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lazy-loading 'services' on Instance uuid ae7e4fc8-75b6-4e3f-9fca-7e5920957283 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:16:35.904979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dc458611-c63a-4296-a0bd-47783ce9f3b4 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:35.914383 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dc458611-c63a-4296-a0bd-47783ce9f3b4 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca" status: 200 len: 1322 microversion: 2.1 time: 0.262499 May 27 15:16:35.917661 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2189/4375] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:35 2022] GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:35.922300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-280de454-6449-4136-aea3-3a8a9f9c9f9a tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:35.923541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-280de454-6449-4136-aea3-3a8a9f9c9f9a tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:35.929709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-280de454-6449-4136-aea3-3a8a9f9c9f9a tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:35.930163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-280de454-6449-4136-aea3-3a8a9f9c9f9a tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:35.930958 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-280de454-6449-4136-aea3-3a8a9f9c9f9a tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:35.931398 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-280de454-6449-4136-aea3-3a8a9f9c9f9a tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:36.097159 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f5ca70e2-ccb6-4fb5-aef7-30873aeb385a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments/4e3a1808-b4f3-48b4-950e-0b2fbbd53210" status: 202 len: 0 microversion: 2.1 time: 0.820008 May 27 15:16:36.101067 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2187/4376] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 15:16:35 2022] DELETE /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments/4e3a1808-b4f3-48b4-950e-0b2fbbd53210 => generated 0 bytes in 823 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:16:36.109457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-280de454-6449-4136-aea3-3a8a9f9c9f9a tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:36.114146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-89710b26-ff21-4e03-8e49-9f4970635d66 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:36.115276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-89710b26-ff21-4e03-8e49-9f4970635d66 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:36.122811 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-280de454-6449-4136-aea3-3a8a9f9c9f9a tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 200 len: 1333 microversion: 2.1 time: 0.203163 May 27 15:16:36.123406 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2190/4377] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:35 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 1333 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:36.131762 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89710b26-ff21-4e03-8e49-9f4970635d66 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:36.132879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89710b26-ff21-4e03-8e49-9f4970635d66 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:36.133914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89710b26-ff21-4e03-8e49-9f4970635d66 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:36.134600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89710b26-ff21-4e03-8e49-9f4970635d66 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:36.179895 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-89710b26-ff21-4e03-8e49-9f4970635d66 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077247 May 27 15:16:36.181120 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2188/4378] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:16:36 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:36.332157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2031d387-7e4f-4a13-af50-8e4aac1b5b67 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:36.333135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2031d387-7e4f-4a13-af50-8e4aac1b5b67 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:36.346818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2031d387-7e4f-4a13-af50-8e4aac1b5b67 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:36.349385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2031d387-7e4f-4a13-af50-8e4aac1b5b67 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:36.352555 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2031d387-7e4f-4a13-af50-8e4aac1b5b67 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:36.355937 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2031d387-7e4f-4a13-af50-8e4aac1b5b67 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:36.397709 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-2031d387-7e4f-4a13-af50-8e4aac1b5b67 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] HTTP exception thrown: Instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d could not be found. May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2031d387-7e4f-4a13-af50-8e4aac1b5b67 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Request method failure captured: May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d HTTP/1.1 May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOlvpMJqPAy13mY14EnWOW7pXJg6l-zUQ_Vn0d24t6dZTV3ynuxOf1vv4hcJawdb-5ALgR7M1LOK6qhSMHY00H3C-Rr9THBcuNrXjS-0Tc3FvDkHuZi0O7V7MtyfKHwIDIiNlLtd3LvFqrvTanhJyK7skCL933Hf-jc73Clc-D2y_vw May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-Openstack-Nova-Api-Version: 2.42 May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: e3657598de154fedbe5fcf2eb4fa9c94 May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1952039750 May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e3657598de154fedbe5fcf2eb4fa9c94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e3657598de154fedbe5fcf2eb4fa9c94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e3657598de154fedbe5fcf2eb4fa9c94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e3657598de154fedbe5fcf2eb4fa9c94", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1952039750 May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: e3657598de154fedbe5fcf2eb4fa9c94 May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1952039750 May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TaggedBootDevicesTest_v242-1952039750-project May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 76881ea8722f45568bb04c26743b51d6 May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1952039750-project May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d could not be found. May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d'} May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d could not be found. May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d could not be found. May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:36.399712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:36.405727 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:36.405727 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:36.405727 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:36.405727 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:36.405727 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:16:36.405727 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:16:36.405727 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d could not be found. May 27 15:16:36.405727 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:36.405727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2031d387-7e4f-4a13-af50-8e4aac1b5b67 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Returning 404 to user: Instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:16:36.407834 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2031d387-7e4f-4a13-af50-8e4aac1b5b67 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 404 len: 111 microversion: 2.42 time: 0.079072 May 27 15:16:36.407834 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2191/4379] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:36 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:16:36.416275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c6b14441-1961-4392-aa1a-dc49b5ed9783 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '.version_select at 0x7fc775f364c0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:36.439330 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c6b14441-1961-4392-aa1a-dc49b5ed9783 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-977871244" status: 204 len: 0 microversion: 2.42 time: 0.026483 May 27 15:16:36.440920 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2189/4380] 10.222.0.13 () {60 vars in 1258 bytes} [Fri May 27 15:16:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-977871244 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:16:36.932341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c2b5296d-a2b8-464c-8d71-71a8f1079e3b tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:36.932931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c2b5296d-a2b8-464c-8d71-71a8f1079e3b tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:36.948465 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2b5296d-a2b8-464c-8d71-71a8f1079e3b tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:36.949047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2b5296d-a2b8-464c-8d71-71a8f1079e3b tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:36.949894 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2b5296d-a2b8-464c-8d71-71a8f1079e3b tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:36.950348 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2b5296d-a2b8-464c-8d71-71a8f1079e3b tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:37.140041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-08ea0afe-6481-484d-917f-52d422b6fddd tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:37.140947 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-08ea0afe-6481-484d-917f-52d422b6fddd tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:37.144923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:37.145602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:37.158537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08ea0afe-6481-484d-917f-52d422b6fddd tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:37.159071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08ea0afe-6481-484d-917f-52d422b6fddd tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:37.160408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08ea0afe-6481-484d-917f-52d422b6fddd tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:37.160408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08ea0afe-6481-484d-917f-52d422b6fddd tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:37.222877 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c2b5296d-a2b8-464c-8d71-71a8f1079e3b tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:37.236504 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c2b5296d-a2b8-464c-8d71-71a8f1079e3b tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca" status: 200 len: 1322 microversion: 2.1 time: 0.308901 May 27 15:16:37.238461 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2192/4381] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:36 2022] GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:37.243835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4117f240-5790-42a1-a1fe-62d3c2530b82 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:37.245536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4117f240-5790-42a1-a1fe-62d3c2530b82 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:37.254479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4117f240-5790-42a1-a1fe-62d3c2530b82 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:37.255624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4117f240-5790-42a1-a1fe-62d3c2530b82 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:37.256687 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4117f240-5790-42a1-a1fe-62d3c2530b82 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:37.257378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4117f240-5790-42a1-a1fe-62d3c2530b82 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:37.300199 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4117f240-5790-42a1-a1fe-62d3c2530b82 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060338 May 27 15:16:37.304854 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2193/4382] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:16:37 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:37.458538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-08ea0afe-6481-484d-917f-52d422b6fddd tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:37.467269 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-08ea0afe-6481-484d-917f-52d422b6fddd tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 200 len: 1333 microversion: 2.1 time: 0.331082 May 27 15:16:37.469408 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2190/4383] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:37 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 1333 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:38.254184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2b2f3326-e41e-4d18-badc-ee0b9ba6f261 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:38.255531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2b2f3326-e41e-4d18-badc-ee0b9ba6f261 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:38.261200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=10 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:38.265132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2b2f3326-e41e-4d18-badc-ee0b9ba6f261 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:38.266135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2b2f3326-e41e-4d18-badc-ee0b9ba6f261 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:38.267336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2b2f3326-e41e-4d18-badc-ee0b9ba6f261 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:38.268122 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2b2f3326-e41e-4d18-badc-ee0b9ba6f261 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:38.316851 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ed71f402-d9a7-42c8-8b94-b8be4756276b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:38.318260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ed71f402-d9a7-42c8-8b94-b8be4756276b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:38.332704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed71f402-d9a7-42c8-8b94-b8be4756276b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:38.335787 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed71f402-d9a7-42c8-8b94-b8be4756276b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:38.337101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed71f402-d9a7-42c8-8b94-b8be4756276b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:38.339185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed71f402-d9a7-42c8-8b94-b8be4756276b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:38.392857 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ed71f402-d9a7-42c8-8b94-b8be4756276b tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080652 May 27 15:16:38.397834 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2191/4384] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:16:38 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:38.502019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee9e91ca-81be-49ae-934e-90a6058695e1 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:38.504367 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ee9e91ca-81be-49ae-934e-90a6058695e1 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:38.522799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee9e91ca-81be-49ae-934e-90a6058695e1 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:38.523371 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2b2f3326-e41e-4d18-badc-ee0b9ba6f261 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:38.525845 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee9e91ca-81be-49ae-934e-90a6058695e1 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:38.528502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee9e91ca-81be-49ae-934e-90a6058695e1 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:38.530214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee9e91ca-81be-49ae-934e-90a6058695e1 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:38.531852 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2b2f3326-e41e-4d18-badc-ee0b9ba6f261 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca" status: 200 len: 1322 microversion: 2.1 time: 0.282025 May 27 15:16:38.532707 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2194/4385] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:38 2022] GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:38.726781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ee9e91ca-81be-49ae-934e-90a6058695e1 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:38.736691 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ee9e91ca-81be-49ae-934e-90a6058695e1 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 200 len: 1333 microversion: 2.1 time: 0.241384 May 27 15:16:38.738635 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2192/4386] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:38 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 1333 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:38.896716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-c762764c-eaab-4f70-bf33-56bf548a55b5 req-02e677f7-01b9-4d07-bf8d-40d868699ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d717563-18ef-4ab7-82ca-4db0ddecc056", "name": "network-vif-plugged", "status": "completed", "tag": "71d5695d-38cb-41d1-a233-2711158af338"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:38.913170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-c762764c-eaab-4f70-bf33-56bf548a55b5 req-02e677f7-01b9-4d07-bf8d-40d868699ba5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:38.917705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-c762764c-eaab-4f70-bf33-56bf548a55b5 req-02e677f7-01b9-4d07-bf8d-40d868699ba5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:38.947871 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-c762764c-eaab-4f70-bf33-56bf548a55b5 req-02e677f7-01b9-4d07-bf8d-40d868699ba5 service nova] Creating event network-vif-plugged:71d5695d-38cb-41d1-a233-2711158af338 for instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 on n-h2-843621-1 May 27 15:16:38.961779 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-c762764c-eaab-4f70-bf33-56bf548a55b5 req-02e677f7-01b9-4d07-bf8d-40d868699ba5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076722 May 27 15:16:38.962719 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2195/4387] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:39.405073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fd46d9a4-a083-4a0a-a16e-0df6d8fafde7 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:39.406085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fd46d9a4-a083-4a0a-a16e-0df6d8fafde7 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:39.417571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd46d9a4-a083-4a0a-a16e-0df6d8fafde7 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:39.418052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd46d9a4-a083-4a0a-a16e-0df6d8fafde7 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:39.421579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd46d9a4-a083-4a0a-a16e-0df6d8fafde7 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:39.422437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd46d9a4-a083-4a0a-a16e-0df6d8fafde7 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:39.471717 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fd46d9a4-a083-4a0a-a16e-0df6d8fafde7 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071041 May 27 15:16:39.476989 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2193/4388] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:16:39 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:39.556177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e1844ba7-ff72-403e-b91d-2aa5215ecda8 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:39.557707 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e1844ba7-ff72-403e-b91d-2aa5215ecda8 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:39.568180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1844ba7-ff72-403e-b91d-2aa5215ecda8 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:39.569419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1844ba7-ff72-403e-b91d-2aa5215ecda8 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:39.572434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1844ba7-ff72-403e-b91d-2aa5215ecda8 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:39.573841 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1844ba7-ff72-403e-b91d-2aa5215ecda8 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:39.755473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a20ed684-f92c-4ab5-9c04-2cf1a51f5adb tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:39.756109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a20ed684-f92c-4ab5-9c04-2cf1a51f5adb tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:39.784531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a20ed684-f92c-4ab5-9c04-2cf1a51f5adb tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:39.785027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a20ed684-f92c-4ab5-9c04-2cf1a51f5adb tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:39.786005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a20ed684-f92c-4ab5-9c04-2cf1a51f5adb tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:39.786464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a20ed684-f92c-4ab5-9c04-2cf1a51f5adb tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:39.884877 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e1844ba7-ff72-403e-b91d-2aa5215ecda8 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:39.906026 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e1844ba7-ff72-403e-b91d-2aa5215ecda8 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca" status: 200 len: 1322 microversion: 2.1 time: 0.359013 May 27 15:16:39.916483 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2196/4389] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:39 2022] GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:40.207521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a20ed684-f92c-4ab5-9c04-2cf1a51f5adb tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:40.224021 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a20ed684-f92c-4ab5-9c04-2cf1a51f5adb tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 200 len: 1333 microversion: 2.1 time: 0.471562 May 27 15:16:40.226128 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2194/4390] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:39 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 1333 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:40.484928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-18ddcd23-0781-4ef3-b693-c5ec22d0fce1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:40.485966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-18ddcd23-0781-4ef3-b693-c5ec22d0fce1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:40.505647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-18ddcd23-0781-4ef3-b693-c5ec22d0fce1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:40.506120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-18ddcd23-0781-4ef3-b693-c5ec22d0fce1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:40.506925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-18ddcd23-0781-4ef3-b693-c5ec22d0fce1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:40.507382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-18ddcd23-0781-4ef3-b693-c5ec22d0fce1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:40.597018 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-18ddcd23-0781-4ef3-b693-c5ec22d0fce1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117145 May 27 15:16:40.606070 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2197/4391] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:16:40 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:40.923923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d854a555-e3b4-4741-bd45-86f68120d60c tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:40.925315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d854a555-e3b4-4741-bd45-86f68120d60c tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:40.936048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d854a555-e3b4-4741-bd45-86f68120d60c tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:40.936905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d854a555-e3b4-4741-bd45-86f68120d60c tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:40.938016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d854a555-e3b4-4741-bd45-86f68120d60c tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:40.939240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d854a555-e3b4-4741-bd45-86f68120d60c tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:41.004575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-2b18f25e-28d5-442e-b7f6-97e09387592e req-0708d2aa-8713-46cb-8f84-5a537367e3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d717563-18ef-4ab7-82ca-4db0ddecc056", "name": "network-vif-plugged", "status": "completed", "tag": "2f43cda6-2b75-4cc2-b7dd-71adee2e0af3"}, {"server_uuid": "0e3ab31c-07b1-4bb7-9999-47ada1e50bca", "name": "network-vif-plugged", "status": "completed", "tag": "a84b7bca-8c79-4ff2-a56b-b21b6e7fb298"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:41.029935 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2b18f25e-28d5-442e-b7f6-97e09387592e req-0708d2aa-8713-46cb-8f84-5a537367e3fc service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:41.034638 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2b18f25e-28d5-442e-b7f6-97e09387592e req-0708d2aa-8713-46cb-8f84-5a537367e3fc service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:41.098400 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-2b18f25e-28d5-442e-b7f6-97e09387592e req-0708d2aa-8713-46cb-8f84-5a537367e3fc service nova] Creating event network-vif-plugged:2f43cda6-2b75-4cc2-b7dd-71adee2e0af3 for instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 on n-h2-843621-1 May 27 15:16:41.098938 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-2b18f25e-28d5-442e-b7f6-97e09387592e req-0708d2aa-8713-46cb-8f84-5a537367e3fc service nova] Creating event network-vif-plugged:a84b7bca-8c79-4ff2-a56b-b21b6e7fb298 for instance 0e3ab31c-07b1-4bb7-9999-47ada1e50bca on n-h1-843621-1 May 27 15:16:41.115920 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-2b18f25e-28d5-442e-b7f6-97e09387592e req-0708d2aa-8713-46cb-8f84-5a537367e3fc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.120597 May 27 15:16:41.118986 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2198/4392] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:41.246351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-eb27f0ce-7a21-4cc8-a805-47141f1ea582 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:41.247261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-eb27f0ce-7a21-4cc8-a805-47141f1ea582 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:41.278979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb27f0ce-7a21-4cc8-a805-47141f1ea582 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:41.279495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb27f0ce-7a21-4cc8-a805-47141f1ea582 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:41.280346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb27f0ce-7a21-4cc8-a805-47141f1ea582 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:41.280831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb27f0ce-7a21-4cc8-a805-47141f1ea582 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:41.628666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-eb27f0ce-7a21-4cc8-a805-47141f1ea582 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:41.639845 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-eb27f0ce-7a21-4cc8-a805-47141f1ea582 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 200 len: 1333 microversion: 2.1 time: 0.399962 May 27 15:16:41.659249 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2199/4393] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:41 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 1333 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:41.665574 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6ebe2827-04ae-4ec6-9c92-41b35a8d5091 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:41.668526 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6ebe2827-04ae-4ec6-9c92-41b35a8d5091 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:41.680859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ebe2827-04ae-4ec6-9c92-41b35a8d5091 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:41.681808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ebe2827-04ae-4ec6-9c92-41b35a8d5091 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:41.682791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ebe2827-04ae-4ec6-9c92-41b35a8d5091 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:41.683245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ebe2827-04ae-4ec6-9c92-41b35a8d5091 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:41.687438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:41.758927 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6ebe2827-04ae-4ec6-9c92-41b35a8d5091 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097946 May 27 15:16:41.767743 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2200/4394] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:16:41 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:42.161824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d854a555-e3b4-4741-bd45-86f68120d60c tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:42.179139 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d854a555-e3b4-4741-bd45-86f68120d60c tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca" status: 200 len: 1322 microversion: 2.1 time: 1.258941 May 27 15:16:42.193084 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2195/4395] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:40 2022] GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca => generated 1322 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:42.288706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3b4e92ee-e304-4a7d-bc0b-ab004727ab30 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:42.289208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3b4e92ee-e304-4a7d-bc0b-ab004727ab30 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:42.297754 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b4e92ee-e304-4a7d-bc0b-ab004727ab30 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:42.298667 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b4e92ee-e304-4a7d-bc0b-ab004727ab30 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:42.310505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b4e92ee-e304-4a7d-bc0b-ab004727ab30 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:42.311324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b4e92ee-e304-4a7d-bc0b-ab004727ab30 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:42.343105 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-3b4e92ee-e304-4a7d-bc0b-ab004727ab30 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] HTTP exception thrown: Instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d could not be found. May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3b4e92ee-e304-4a7d-bc0b-ab004727ab30 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Request method failure captured: May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d HTTP/1.1 May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOlvpMJqPAy13mY14EnWOW7pXJg6l-zUQ_Vn0d24t6dZTV3ynuxOf1vv4hcJawdb-5ALgR7M1LOK6qhSMHY00H3C-Rr9THBcuNrXjS-0Tc3FvDkHuZi0O7V7MtyfKHwIDIiNlLtd3LvFqrvTanhJyK7skCL933Hf-jc73Clc-D2y_vw May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-Openstack-Nova-Api-Version: 2.42 May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: e3657598de154fedbe5fcf2eb4fa9c94 May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1952039750 May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e3657598de154fedbe5fcf2eb4fa9c94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e3657598de154fedbe5fcf2eb4fa9c94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e3657598de154fedbe5fcf2eb4fa9c94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e3657598de154fedbe5fcf2eb4fa9c94", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1952039750 May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: e3657598de154fedbe5fcf2eb4fa9c94 May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1952039750 May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TaggedBootDevicesTest_v242-1952039750-project May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 76881ea8722f45568bb04c26743b51d6 May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1952039750-project May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d could not be found. May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d'} May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d could not be found. May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:16:42.347697 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:16:42.352767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d could not be found. May 27 15:16:42.352767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:42.352767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:42.352767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:42.352767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:42.352767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:42.352767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:42.352767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:16:42.352767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:16:42.352767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d could not be found. May 27 15:16:42.352767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:42.352767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3b4e92ee-e304-4a7d-bc0b-ab004727ab30 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Returning 404 to user: Instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:16:42.360400 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3b4e92ee-e304-4a7d-bc0b-ab004727ab30 tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 404 len: 111 microversion: 2.42 time: 0.064199 May 27 15:16:42.364001 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2201/4396] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:16:42 2022] DELETE /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:16:42.373177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2a4262be-054d-43ea-95a5-0dc17d9d223e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:42.374038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2a4262be-054d-43ea-95a5-0dc17d9d223e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] [instance: 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:42.401623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a4262be-054d-43ea-95a5-0dc17d9d223e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:42.402354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a4262be-054d-43ea-95a5-0dc17d9d223e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:42.404738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a4262be-054d-43ea-95a5-0dc17d9d223e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:42.406750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a4262be-054d-43ea-95a5-0dc17d9d223e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:42.442333 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-2a4262be-054d-43ea-95a5-0dc17d9d223e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] HTTP exception thrown: Instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d could not be found. May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2a4262be-054d-43ea-95a5-0dc17d9d223e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Request method failure captured: May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d HTTP/1.1 May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOlvpMJqPAy13mY14EnWOW7pXJg6l-zUQ_Vn0d24t6dZTV3ynuxOf1vv4hcJawdb-5ALgR7M1LOK6qhSMHY00H3C-Rr9THBcuNrXjS-0Tc3FvDkHuZi0O7V7MtyfKHwIDIiNlLtd3LvFqrvTanhJyK7skCL933Hf-jc73Clc-D2y_vw May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-Openstack-Nova-Api-Version: 2.42 May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: e3657598de154fedbe5fcf2eb4fa9c94 May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1952039750 May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e3657598de154fedbe5fcf2eb4fa9c94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e3657598de154fedbe5fcf2eb4fa9c94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e3657598de154fedbe5fcf2eb4fa9c94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e3657598de154fedbe5fcf2eb4fa9c94", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1952039750 May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: e3657598de154fedbe5fcf2eb4fa9c94 May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1952039750 May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-TaggedBootDevicesTest_v242-1952039750-project May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 76881ea8722f45568bb04c26743b51d6 May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1952039750-project May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d could not be found. May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d'} May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d could not be found. May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d could not be found. May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:42.444165 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:42.453131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:42.453131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:42.453131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:42.453131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:42.453131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:16:42.453131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:16:42.453131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d could not be found. May 27 15:16:42.453131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:42.453131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2a4262be-054d-43ea-95a5-0dc17d9d223e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] Returning 404 to user: Instance 1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:16:42.462435 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2a4262be-054d-43ea-95a5-0dc17d9d223e tempest-TaggedBootDevicesTest_v242-1952039750 tempest-TaggedBootDevicesTest_v242-1952039750-project] 10.222.0.13 "GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d" status: 404 len: 111 microversion: 2.42 time: 0.094224 May 27 15:16:42.466528 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2196/4397] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:16:42 2022] GET /compute/v2.1/servers/1e52d3a5-c4b9-4cbc-a8f8-51d4c5c7b79d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:16:42.661570 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-277e0c16-9cee-4bc1-a3ff-5855614e9703 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:42.663166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-277e0c16-9cee-4bc1-a3ff-5855614e9703 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:42.684986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-277e0c16-9cee-4bc1-a3ff-5855614e9703 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:42.687242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-277e0c16-9cee-4bc1-a3ff-5855614e9703 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:42.688323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-277e0c16-9cee-4bc1-a3ff-5855614e9703 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:42.690517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-277e0c16-9cee-4bc1-a3ff-5855614e9703 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:42.777510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b8f8cd23-8120-4cf2-a91c-a7b08ecec844 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:42.779655 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b8f8cd23-8120-4cf2-a91c-a7b08ecec844 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:42.792739 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b8f8cd23-8120-4cf2-a91c-a7b08ecec844 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:42.793528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b8f8cd23-8120-4cf2-a91c-a7b08ecec844 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:42.794641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b8f8cd23-8120-4cf2-a91c-a7b08ecec844 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:42.796459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b8f8cd23-8120-4cf2-a91c-a7b08ecec844 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:42.876614 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b8f8cd23-8120-4cf2-a91c-a7b08ecec844 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102934 May 27 15:16:42.882442 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2197/4398] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:16:42 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:16:43.114797 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-277e0c16-9cee-4bc1-a3ff-5855614e9703 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:43.139102 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-277e0c16-9cee-4bc1-a3ff-5855614e9703 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 200 len: 1333 microversion: 2.1 time: 0.483489 May 27 15:16:43.152113 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2202/4399] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:42 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 1333 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:43.199125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2eed1c3e-0ce7-4532-b7b0-6d4b4c69ba9e tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:43.199959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2eed1c3e-0ce7-4532-b7b0-6d4b4c69ba9e tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:43.214249 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2eed1c3e-0ce7-4532-b7b0-6d4b4c69ba9e tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:43.215003 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2eed1c3e-0ce7-4532-b7b0-6d4b4c69ba9e tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:43.217924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2eed1c3e-0ce7-4532-b7b0-6d4b4c69ba9e tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:43.218508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2eed1c3e-0ce7-4532-b7b0-6d4b4c69ba9e tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:43.580097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2eed1c3e-0ce7-4532-b7b0-6d4b4c69ba9e tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:43.592424 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2eed1c3e-0ce7-4532-b7b0-6d4b4c69ba9e tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca" status: 200 len: 1322 microversion: 2.1 time: 0.397670 May 27 15:16:43.594598 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2198/4400] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:43 2022] GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:43.890192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-08ef5cd5-776b-4b60-a34b-27c47e7ab018 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:43.892135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-08ef5cd5-776b-4b60-a34b-27c47e7ab018 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:43.921277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08ef5cd5-776b-4b60-a34b-27c47e7ab018 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:43.926715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08ef5cd5-776b-4b60-a34b-27c47e7ab018 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:43.927625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08ef5cd5-776b-4b60-a34b-27c47e7ab018 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:43.928186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08ef5cd5-776b-4b60-a34b-27c47e7ab018 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:43.991975 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-08ef5cd5-776b-4b60-a34b-27c47e7ab018 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106051 May 27 15:16:43.996100 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2203/4401] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:16:43 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:44.168741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-63db56d9-0525-46d5-b5ed-cfcd02c0a650 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:44.169662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-63db56d9-0525-46d5-b5ed-cfcd02c0a650 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:44.178882 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63db56d9-0525-46d5-b5ed-cfcd02c0a650 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:44.183311 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63db56d9-0525-46d5-b5ed-cfcd02c0a650 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:44.184531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63db56d9-0525-46d5-b5ed-cfcd02c0a650 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:44.197077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63db56d9-0525-46d5-b5ed-cfcd02c0a650 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:44.405821 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-63db56d9-0525-46d5-b5ed-cfcd02c0a650 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:44.417598 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-63db56d9-0525-46d5-b5ed-cfcd02c0a650 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 200 len: 1668 microversion: 2.1 time: 0.252695 May 27 15:16:44.429712 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2199/4402] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:44 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 1668 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:44.436608 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-67dbd772-31f1-4bf0-9fb4-8e5c9ee65ac6 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:44.437536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-67dbd772-31f1-4bf0-9fb4-8e5c9ee65ac6 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:44.444972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67dbd772-31f1-4bf0-9fb4-8e5c9ee65ac6 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:44.445766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67dbd772-31f1-4bf0-9fb4-8e5c9ee65ac6 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:44.446764 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67dbd772-31f1-4bf0-9fb4-8e5c9ee65ac6 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:44.447415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67dbd772-31f1-4bf0-9fb4-8e5c9ee65ac6 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:44.478064 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-67dbd772-31f1-4bf0-9fb4-8e5c9ee65ac6 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056/ips" status: 200 len: 179 microversion: 2.1 time: 0.046518 May 27 15:16:44.484192 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2204/4403] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 15:16:44 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056/ips => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:44.489902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a417bcee-aa06-4851-844e-b40ff8f93c74 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:44.490665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a417bcee-aa06-4851-844e-b40ff8f93c74 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:44.498277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a417bcee-aa06-4851-844e-b40ff8f93c74 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:44.498939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a417bcee-aa06-4851-844e-b40ff8f93c74 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:44.499947 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a417bcee-aa06-4851-844e-b40ff8f93c74 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:44.500563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a417bcee-aa06-4851-844e-b40ff8f93c74 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:44.530262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a417bcee-aa06-4851-844e-b40ff8f93c74 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:16:44.568197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:44.611311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-de6b43f5-621b-4fde-9c14-1a6115075a99 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:44.612739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-de6b43f5-621b-4fde-9c14-1a6115075a99 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:44.635000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de6b43f5-621b-4fde-9c14-1a6115075a99 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:44.640094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de6b43f5-621b-4fde-9c14-1a6115075a99 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:44.645867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de6b43f5-621b-4fde-9c14-1a6115075a99 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:44.646871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de6b43f5-621b-4fde-9c14-1a6115075a99 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:44.700910 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a417bcee-aa06-4851-844e-b40ff8f93c74 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 204 len: 0 microversion: 2.1 time: 0.208813 May 27 15:16:44.709893 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2200/4404] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:16:44 2022] DELETE /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:16:44.738160 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d36551fe-16d3-4792-b3e5-83644e5428b0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:44.740530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d36551fe-16d3-4792-b3e5-83644e5428b0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:44.755656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d36551fe-16d3-4792-b3e5-83644e5428b0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:44.756448 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d36551fe-16d3-4792-b3e5-83644e5428b0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:44.760822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d36551fe-16d3-4792-b3e5-83644e5428b0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:44.761638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d36551fe-16d3-4792-b3e5-83644e5428b0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:45.058069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-de6b43f5-621b-4fde-9c14-1a6115075a99 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:45.069286 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-de6b43f5-621b-4fde-9c14-1a6115075a99 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca" status: 200 len: 1471 microversion: 2.1 time: 0.461968 May 27 15:16:45.071589 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2205/4405] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:44 2022] GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca => generated 1471 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:45.086019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-38b4c173-a0ce-4c9d-bb99-078b4ad39e93 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:45.087486 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-38b4c173-a0ce-4c9d-bb99-078b4ad39e93 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:45.101526 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38b4c173-a0ce-4c9d-bb99-078b4ad39e93 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:45.102855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d36551fe-16d3-4792-b3e5-83644e5428b0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:45.104593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38b4c173-a0ce-4c9d-bb99-078b4ad39e93 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:45.108198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38b4c173-a0ce-4c9d-bb99-078b4ad39e93 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:45.111009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38b4c173-a0ce-4c9d-bb99-078b4ad39e93 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:45.114389 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d36551fe-16d3-4792-b3e5-83644e5428b0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 200 len: 1674 microversion: 2.1 time: 0.400137 May 27 15:16:45.124567 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2201/4406] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:44 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 1674 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:45.198858 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-38b4c173-a0ce-4c9d-bb99-078b4ad39e93 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125212 May 27 15:16:45.199746 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2206/4407] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:16:45 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:45.230920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-11596161-de69-4ecf-8ad4-6f8601c415b3 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:45.231506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-11596161-de69-4ecf-8ad4-6f8601c415b3 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] [instance: 3f0fde9d-d789-4b33-b1cf-dfd21b3c88f2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:45.244091 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-11596161-de69-4ecf-8ad4-6f8601c415b3 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] HTTP exception thrown: Instance 3f0fde9d-d789-4b33-b1cf-dfd21b3c88f2 could not be found. May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-11596161-de69-4ecf-8ad4-6f8601c415b3 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Request method failure captured: May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/3f0fde9d-d789-4b33-b1cf-dfd21b3c88f2/action HTTP/1.1 May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 15 May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOtKXyBzn1qTQDzhhjbYVLSxE4he1OA31l7iTl6ykztqC3Iqk5DRiClRarektfll_wYKWRyxwdJMHkGwQr3OC2ePe3wY_TDp4M9zR881WqaLrkqtz5QNNcWP6jmcETZsgjthCkPvajxT9gKn-Fo_UPZjvVVZzILsM_qN5XgtNIG-4Jw May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 9625a34fc3e04cfbbcce69d0959a81ab May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1546060325 May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9625a34fc3e04cfbbcce69d0959a81ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9625a34fc3e04cfbbcce69d0959a81ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9625a34fc3e04cfbbcce69d0959a81ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9625a34fc3e04cfbbcce69d0959a81ab", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1546060325 May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 9625a34fc3e04cfbbcce69d0959a81ab May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1546060325 May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersAdminNegativeTestJSON-1546060325-project-admin May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: d708c33209ca452d834a7093d7814971 May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1546060325-project-admin May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: {"migrate": {}} May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 3f0fde9d-d789-4b33-b1cf-dfd21b3c88f2 could not be found. May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '3f0fde9d-d789-4b33-b1cf-dfd21b3c88f2', 'body': {'migrate': {}}} May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f0fde9d-d789-4b33-b1cf-dfd21b3c88f2 could not be found. May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f0fde9d-d789-4b33-b1cf-dfd21b3c88f2 could not be found. May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:45.262315 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:45.268580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:45.268580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:45.268580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:16:45.268580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:16:45.268580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f0fde9d-d789-4b33-b1cf-dfd21b3c88f2 could not be found. May 27 15:16:45.268580 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:45.268580 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-11596161-de69-4ecf-8ad4-6f8601c415b3 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Returning 404 to user: Instance 3f0fde9d-d789-4b33-b1cf-dfd21b3c88f2 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:16:45.268580 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-11596161-de69-4ecf-8ad4-6f8601c415b3 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/3f0fde9d-d789-4b33-b1cf-dfd21b3c88f2/action" status: 404 len: 111 microversion: 2.1 time: 0.139235 May 27 15:16:45.270959 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2202/4408] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:16:45 2022] POST /compute/v2.1/servers/3f0fde9d-d789-4b33-b1cf-dfd21b3c88f2/action => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:16:45.314160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-21afad1e-4d3e-4df9-a2ca-0c2adc4d613f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1925000478", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:45.392405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-21afad1e-4d3e-4df9-a2ca-0c2adc4d613f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] validate_networks() for None {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:16:45.656517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-21afad1e-4d3e-4df9-a2ca-0c2adc4d613f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:16:45.657037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-21afad1e-4d3e-4df9-a2ca-0c2adc4d613f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:16:45.658065 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-21afad1e-4d3e-4df9-a2ca-0c2adc4d613f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:16:45.658492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-21afad1e-4d3e-4df9-a2ca-0c2adc4d613f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:16:45.658999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-21afad1e-4d3e-4df9-a2ca-0c2adc4d613f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:16:45.684458 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21afad1e-4d3e-4df9-a2ca-0c2adc4d613f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:45.685039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21afad1e-4d3e-4df9-a2ca-0c2adc4d613f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:45.687377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21afad1e-4d3e-4df9-a2ca-0c2adc4d613f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:45.687377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21afad1e-4d3e-4df9-a2ca-0c2adc4d613f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:45.724472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-21afad1e-4d3e-4df9-a2ca-0c2adc4d613f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Getting quotas for project 6ee6b3dae0924634a0d0d319ac0be692. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:16:45.730654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:45.732897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-21afad1e-4d3e-4df9-a2ca-0c2adc4d613f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Getting quotas for user 693e50b119084e849e6a701c0d1f8037 and project 6ee6b3dae0924634a0d0d319ac0be692. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:16:45.753965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-21afad1e-4d3e-4df9-a2ca-0c2adc4d613f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:16:45.756505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-21afad1e-4d3e-4df9-a2ca-0c2adc4d613f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:16:45.777643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-91134a45-3c17-48b0-893d-a738c7dc983d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Action: 'create', calling method: .version_select at 0x7fc775fed4c0>, body: {"keypair": {"name": "tempest-keypair-1706732672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOo2l/HXupNpJybYpwzqfXuzaeOS9HampJHNRwugeV5EQ+cU2jLW9IA3OQX2qLkWWv64OfJvjZjfbRU5x0BDvrO5IVlLr5OGgVbAodK66VCvsxu8SCO6rt/LepbVgVKU0Q=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:45.825575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-91134a45-3c17-48b0-893d-a738c7dc983d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Getting quotas for project 5a9a825b1ade46e3a702ae19c7c53f6b. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:16:45.850493 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-21afad1e-4d3e-4df9-a2ca-0c2adc4d613f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525592 May 27 15:16:45.857589 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2207/4409] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:16:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:16:45.865795 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-91134a45-3c17-48b0-893d-a738c7dc983d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Getting quotas for user 59f88a11fc4b4bf6b4a807ccffee1fab and project 5a9a825b1ade46e3a702ae19c7c53f6b. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:16:45.866362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dfd39ad0-baab-4d32-a8f9-b583b996c802 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:45.868211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dfd39ad0-baab-4d32-a8f9-b583b996c802 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:45.927313 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-91134a45-3c17-48b0-893d-a738c7dc983d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.153222 May 27 15:16:45.928565 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2203/4410] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:16:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:46.045595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dfd39ad0-baab-4d32-a8f9-b583b996c802 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:46.055794 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dfd39ad0-baab-4d32-a8f9-b583b996c802 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da" status: 200 len: 1222 microversion: 2.1 time: 0.195165 May 27 15:16:46.065660 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2208/4411] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:45 2022] GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da => generated 1222 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:46.135014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-19055e28-ebc3-48c7-b973-482c1b81026b tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:46.135906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-19055e28-ebc3-48c7-b973-482c1b81026b tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:46.148410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19055e28-ebc3-48c7-b973-482c1b81026b tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:46.151780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19055e28-ebc3-48c7-b973-482c1b81026b tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:46.152657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19055e28-ebc3-48c7-b973-482c1b81026b tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:46.154782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19055e28-ebc3-48c7-b973-482c1b81026b tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:46.212144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-930991f6-1cb8-492a-af69-3fa0eb309e9f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:46.214669 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-930991f6-1cb8-492a-af69-3fa0eb309e9f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:46.227496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-930991f6-1cb8-492a-af69-3fa0eb309e9f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:46.228028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-930991f6-1cb8-492a-af69-3fa0eb309e9f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:46.228987 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-930991f6-1cb8-492a-af69-3fa0eb309e9f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:46.229489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-930991f6-1cb8-492a-af69-3fa0eb309e9f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:46.305341 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-930991f6-1cb8-492a-af69-3fa0eb309e9f tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098650 May 27 15:16:46.310677 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2209/4412] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:16:46 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:16:46.604362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-19055e28-ebc3-48c7-b973-482c1b81026b tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:46.615890 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-19055e28-ebc3-48c7-b973-482c1b81026b tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 200 len: 1674 microversion: 2.1 time: 0.486962 May 27 15:16:46.621274 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2204/4413] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:46 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 1674 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:47.073537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-98fde48a-a86c-48c3-a4f0-7b7f5fd3311d tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:47.074155 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-98fde48a-a86c-48c3-a4f0-7b7f5fd3311d tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:47.087119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98fde48a-a86c-48c3-a4f0-7b7f5fd3311d tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:47.087805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98fde48a-a86c-48c3-a4f0-7b7f5fd3311d tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:47.092721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98fde48a-a86c-48c3-a4f0-7b7f5fd3311d tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:47.093496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98fde48a-a86c-48c3-a4f0-7b7f5fd3311d tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:47.199576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-ae6682f6-5ee0-49b4-8c32-db377982cf9e req-99aeff67-b7c8-45d7-9071-b1fd37c1b536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d717563-18ef-4ab7-82ca-4db0ddecc056", "name": "network-vif-deleted", "tag": "2f43cda6-2b75-4cc2-b7dd-71adee2e0af3"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:47.228926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-ae6682f6-5ee0-49b4-8c32-db377982cf9e req-99aeff67-b7c8-45d7-9071-b1fd37c1b536 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:47.230000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-ae6682f6-5ee0-49b4-8c32-db377982cf9e req-99aeff67-b7c8-45d7-9071-b1fd37c1b536 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:47.267137 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-ae6682f6-5ee0-49b4-8c32-db377982cf9e req-99aeff67-b7c8-45d7-9071-b1fd37c1b536 service nova] Creating event network-vif-deleted:2f43cda6-2b75-4cc2-b7dd-71adee2e0af3 for instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 on n-h2-843621-1 May 27 15:16:47.274569 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-ae6682f6-5ee0-49b4-8c32-db377982cf9e req-99aeff67-b7c8-45d7-9071-b1fd37c1b536 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078626 May 27 15:16:47.275629 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2205/4414] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:47.323001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-028abb92-8141-4a35-9289-98683211784d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:47.326009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-028abb92-8141-4a35-9289-98683211784d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:47.352037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:47.365347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-028abb92-8141-4a35-9289-98683211784d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:47.366954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-028abb92-8141-4a35-9289-98683211784d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:47.369181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-028abb92-8141-4a35-9289-98683211784d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:47.370453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-028abb92-8141-4a35-9289-98683211784d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:47.387618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-98fde48a-a86c-48c3-a4f0-7b7f5fd3311d tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:47.399347 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-98fde48a-a86c-48c3-a4f0-7b7f5fd3311d tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da" status: 200 len: 1218 microversion: 2.1 time: 0.329812 May 27 15:16:47.404751 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2210/4415] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:47 2022] GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da => generated 1218 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:47.472121 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-028abb92-8141-4a35-9289-98683211784d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155596 May 27 15:16:47.472932 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2206/4416] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:16:47 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:47.636689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d388ca68-4d5f-49e4-98b3-986264f38ba9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:47.637806 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d388ca68-4d5f-49e4-98b3-986264f38ba9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:47.663816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d388ca68-4d5f-49e4-98b3-986264f38ba9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:47.665325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d388ca68-4d5f-49e4-98b3-986264f38ba9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:47.666292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d388ca68-4d5f-49e4-98b3-986264f38ba9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:47.667772 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d388ca68-4d5f-49e4-98b3-986264f38ba9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:48.019476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d388ca68-4d5f-49e4-98b3-986264f38ba9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:48.028189 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d388ca68-4d5f-49e4-98b3-986264f38ba9 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 200 len: 1495 microversion: 2.1 time: 0.396490 May 27 15:16:48.029349 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2211/4417] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:47 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 1495 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:48.422978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f97f1ad0-d982-4d01-b25f-bf3891d99508 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:48.423603 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f97f1ad0-d982-4d01-b25f-bf3891d99508 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:48.440767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f97f1ad0-d982-4d01-b25f-bf3891d99508 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:48.442122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f97f1ad0-d982-4d01-b25f-bf3891d99508 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:48.442951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f97f1ad0-d982-4d01-b25f-bf3891d99508 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:48.446141 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f97f1ad0-d982-4d01-b25f-bf3891d99508 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:48.484125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a206fc06-ae94-42c0-96e0-4514aca02af6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:48.485758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a206fc06-ae94-42c0-96e0-4514aca02af6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:48.518193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a206fc06-ae94-42c0-96e0-4514aca02af6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:48.518593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a206fc06-ae94-42c0-96e0-4514aca02af6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:48.519430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a206fc06-ae94-42c0-96e0-4514aca02af6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:48.519880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a206fc06-ae94-42c0-96e0-4514aca02af6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:48.590828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f97f1ad0-d982-4d01-b25f-bf3891d99508 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:48.600992 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f97f1ad0-d982-4d01-b25f-bf3891d99508 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da" status: 200 len: 1280 microversion: 2.1 time: 0.185070 May 27 15:16:48.614635 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2207/4418] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:48 2022] GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da => generated 1280 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:48.615245 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a206fc06-ae94-42c0-96e0-4514aca02af6 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135030 May 27 15:16:48.615841 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2212/4419] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:16:48 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:49.051505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4c7141d5-4d5c-4a1b-91fb-206eef429ba0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:49.056804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4c7141d5-4d5c-4a1b-91fb-206eef429ba0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:49.083509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c7141d5-4d5c-4a1b-91fb-206eef429ba0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:49.084266 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c7141d5-4d5c-4a1b-91fb-206eef429ba0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:49.086229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c7141d5-4d5c-4a1b-91fb-206eef429ba0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:49.098589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c7141d5-4d5c-4a1b-91fb-206eef429ba0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:49.245854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4c7141d5-4d5c-4a1b-91fb-206eef429ba0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ae937c9ae1a44029ec336114f22df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c0be30e5494716a16b458fe631f6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:49.258621 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4c7141d5-4d5c-4a1b-91fb-206eef429ba0 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 200 len: 1453 microversion: 2.1 time: 0.215775 May 27 15:16:49.259700 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2208/4420] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:49 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 1453 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:49.328453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-d17792c5-bd46-458b-bddf-b3b611b7f916 req-cb443776-86fa-4f58-bb87-e9953e1762cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d717563-18ef-4ab7-82ca-4db0ddecc056", "name": "network-vif-deleted", "tag": "71d5695d-38cb-41d1-a233-2711158af338"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:49.372906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d17792c5-bd46-458b-bddf-b3b611b7f916 req-cb443776-86fa-4f58-bb87-e9953e1762cd service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:49.373367 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d17792c5-bd46-458b-bddf-b3b611b7f916 req-cb443776-86fa-4f58-bb87-e9953e1762cd service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:49.399642 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-d17792c5-bd46-458b-bddf-b3b611b7f916 req-cb443776-86fa-4f58-bb87-e9953e1762cd service nova] Creating event network-vif-deleted:71d5695d-38cb-41d1-a233-2711158af338 for instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 on n-h2-843621-1 May 27 15:16:49.414309 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-d17792c5-bd46-458b-bddf-b3b611b7f916 req-cb443776-86fa-4f58-bb87-e9953e1762cd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091833 May 27 15:16:49.416661 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2213/4421] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:49.619753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-72c432c5-00fb-4ae7-bd89-47b040c9205b tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:49.622168 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-72c432c5-00fb-4ae7-bd89-47b040c9205b tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:49.630041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-716af124-d2b5-45dd-9af1-095fa523f399 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:49.631410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-716af124-d2b5-45dd-9af1-095fa523f399 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:49.634255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72c432c5-00fb-4ae7-bd89-47b040c9205b tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:49.635592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72c432c5-00fb-4ae7-bd89-47b040c9205b tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:49.636652 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72c432c5-00fb-4ae7-bd89-47b040c9205b tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:49.639001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72c432c5-00fb-4ae7-bd89-47b040c9205b tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:49.652121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-716af124-d2b5-45dd-9af1-095fa523f399 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:49.652618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-716af124-d2b5-45dd-9af1-095fa523f399 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:49.653525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-716af124-d2b5-45dd-9af1-095fa523f399 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:49.653982 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-716af124-d2b5-45dd-9af1-095fa523f399 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:49.722214 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-716af124-d2b5-45dd-9af1-095fa523f399 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098430 May 27 15:16:49.723495 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2214/4422] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:16:49 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:16:49.773836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-72c432c5-00fb-4ae7-bd89-47b040c9205b tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:49.790562 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-72c432c5-00fb-4ae7-bd89-47b040c9205b tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da" status: 200 len: 1280 microversion: 2.1 time: 0.175329 May 27 15:16:49.792166 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2209/4423] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:49 2022] GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da => generated 1280 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:50.280248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2fb2a3be-2d23-4805-9088-25d19f85cc43 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:50.281150 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2fb2a3be-2d23-4805-9088-25d19f85cc43 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:50.291233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2fb2a3be-2d23-4805-9088-25d19f85cc43 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:50.295654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2fb2a3be-2d23-4805-9088-25d19f85cc43 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:50.296783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2fb2a3be-2d23-4805-9088-25d19f85cc43 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:50.298071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2fb2a3be-2d23-4805-9088-25d19f85cc43 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:50.329534 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-2fb2a3be-2d23-4805-9088-25d19f85cc43 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] HTTP exception thrown: Instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 could not be found. May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2fb2a3be-2d23-4805-9088-25d19f85cc43 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Request method failure captured: May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 HTTP/1.1 May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOsUdBMh5v-ULiWL1KqcPs684D08fihdMblmDCUjtgxsHJ-eomFfJ17KNeIUKxQRQEdzdUVKgFJSQRi06Cl_aSMXu1Cv6oUFC5FssiRVYu1aJurFjj0OQxtgWRiIx86sH0xWJLewdpYqHDHIDLA0KSp_PlLgM9TRdHLwbZRBVWTPHfA May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 42c0be30e5494716a16b458fe631f6ee May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersTestMultiNic-764646204 May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/42c0be30e5494716a16b458fe631f6ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/42c0be30e5494716a16b458fe631f6ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/42c0be30e5494716a16b458fe631f6ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_42c0be30e5494716a16b458fe631f6ee", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersTestMultiNic-764646204 May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 42c0be30e5494716a16b458fe631f6ee May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersTestMultiNic-764646204 May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersTestMultiNic-764646204-project May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 1ae937c9ae1a44029ec336114f22df83 May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersTestMultiNic-764646204-project May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 could not be found. May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '4d717563-18ef-4ab7-82ca-4db0ddecc056'} May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 could not be found. May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 could not be found. May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:50.338767 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:50.345435 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:50.345435 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:50.345435 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:50.345435 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:16:50.345435 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:16:50.345435 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 could not be found. May 27 15:16:50.345435 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:50.345435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2fb2a3be-2d23-4805-9088-25d19f85cc43 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Returning 404 to user: Instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:16:50.347702 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2fb2a3be-2d23-4805-9088-25d19f85cc43 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 404 len: 111 microversion: 2.1 time: 0.068450 May 27 15:16:50.369806 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2215/4424] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:50 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:16:50.686448 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f2450757-62da-4f38-8207-ae930b86b289 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1553543537", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5506dc4-66e1-4bd2-af40-7ec96debefd9"}], "security_groups": [{"name": "tempest-securitygroup--386175789"}], "key_name": "tempest-keypair-1706732672", "user_data": "}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:50.734199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-afe31125-3961-46ac-bfb1-9305d18fa710 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:50.735319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-afe31125-3961-46ac-bfb1-9305d18fa710 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:50.753350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afe31125-3961-46ac-bfb1-9305d18fa710 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:50.760407 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afe31125-3961-46ac-bfb1-9305d18fa710 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:50.770044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afe31125-3961-46ac-bfb1-9305d18fa710 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:50.770769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afe31125-3961-46ac-bfb1-9305d18fa710 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:50.825220 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-afe31125-3961-46ac-bfb1-9305d18fa710 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094934 May 27 15:16:50.826742 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2216/4425] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:16:50 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:16:50.832983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0f6a2e06-8aa7-472b-8fb1-7a7c5329ab60 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:50.842894 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0f6a2e06-8aa7-472b-8fb1-7a7c5329ab60 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:50.898622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0f6a2e06-8aa7-472b-8fb1-7a7c5329ab60 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:50.900587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0f6a2e06-8aa7-472b-8fb1-7a7c5329ab60 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:50.901784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0f6a2e06-8aa7-472b-8fb1-7a7c5329ab60 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:50.905566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0f6a2e06-8aa7-472b-8fb1-7a7c5329ab60 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:51.519885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-f2450757-62da-4f38-8207-ae930b86b289 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] validate_networks() for [('b5506dc4-66e1-4bd2-af40-7ec96debefd9', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:16:51.906736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0f6a2e06-8aa7-472b-8fb1-7a7c5329ab60 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:51.923168 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0f6a2e06-8aa7-472b-8fb1-7a7c5329ab60 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da" status: 200 len: 1322 microversion: 2.1 time: 1.093848 May 27 15:16:51.925682 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2217/4426] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:50 2022] GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da => generated 1322 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:51.937150 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-71287812-d44f-4036-aa43-2892900db8fd tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:51.942432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-71287812-d44f-4036-aa43-2892900db8fd tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:51.958667 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71287812-d44f-4036-aa43-2892900db8fd tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:51.960385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71287812-d44f-4036-aa43-2892900db8fd tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:51.963462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71287812-d44f-4036-aa43-2892900db8fd tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:51.966255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71287812-d44f-4036-aa43-2892900db8fd tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:52.118027 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-71287812-d44f-4036-aa43-2892900db8fd tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191019 May 27 15:16:52.119705 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2218/4427] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:16:51 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:52.337866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-36de18bb-94dd-41c6-a613-b49b1e0c8402 req-87daa165-046b-4280-a783-807e55676210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdf51b0d-7630-4588-bae9-e50accb2d1da", "tag": "cfe4b2b8-979e-4e68-aae5-ec9bc705186d"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:52.366480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-36de18bb-94dd-41c6-a613-b49b1e0c8402 req-87daa165-046b-4280-a783-807e55676210 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:52.375891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-36de18bb-94dd-41c6-a613-b49b1e0c8402 req-87daa165-046b-4280-a783-807e55676210 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:52.427121 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-36de18bb-94dd-41c6-a613-b49b1e0c8402 req-87daa165-046b-4280-a783-807e55676210 service nova] Creating event network-changed:cfe4b2b8-979e-4e68-aae5-ec9bc705186d for instance bdf51b0d-7630-4588-bae9-e50accb2d1da on n-h2-843621-1 May 27 15:16:52.455152 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-36de18bb-94dd-41c6-a613-b49b1e0c8402 req-87daa165-046b-4280-a783-807e55676210 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123166 May 27 15:16:52.456651 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2219/4428] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:16:52.604218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f2450757-62da-4f38-8207-ae930b86b289 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:16:52.605283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f2450757-62da-4f38-8207-ae930b86b289 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:16:52.605939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f2450757-62da-4f38-8207-ae930b86b289 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:16:52.606528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f2450757-62da-4f38-8207-ae930b86b289 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:16:52.607118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f2450757-62da-4f38-8207-ae930b86b289 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:16:52.631526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f2450757-62da-4f38-8207-ae930b86b289 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:52.638559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f2450757-62da-4f38-8207-ae930b86b289 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:52.639721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f2450757-62da-4f38-8207-ae930b86b289 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:52.640345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f2450757-62da-4f38-8207-ae930b86b289 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:52.714405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-f2450757-62da-4f38-8207-ae930b86b289 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Getting quotas for project 5a9a825b1ade46e3a702ae19c7c53f6b. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:16:52.731970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-f2450757-62da-4f38-8207-ae930b86b289 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Getting quotas for user 59f88a11fc4b4bf6b4a807ccffee1fab and project 5a9a825b1ade46e3a702ae19c7c53f6b. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:16:52.784335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f2450757-62da-4f38-8207-ae930b86b289 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:16:52.786762 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f2450757-62da-4f38-8207-ae930b86b289 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:16:52.926904 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f2450757-62da-4f38-8207-ae930b86b289 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.247957 May 27 15:16:52.937000 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2210/4429] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:16:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 2259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:16:52.943931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ec4fd201-fb79-4b40-86ab-7a0f82bfa8a5 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:52.944718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ec4fd201-fb79-4b40-86ab-7a0f82bfa8a5 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:52.950619 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c6f2ab82-109e-4d46-b983-43b8687b2f3a tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:52.954795 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c6f2ab82-109e-4d46-b983-43b8687b2f3a tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:52.969369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c6f2ab82-109e-4d46-b983-43b8687b2f3a tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:52.971923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c6f2ab82-109e-4d46-b983-43b8687b2f3a tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:52.974595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c6f2ab82-109e-4d46-b983-43b8687b2f3a tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:52.975341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c6f2ab82-109e-4d46-b983-43b8687b2f3a tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:53.066766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ec4fd201-fb79-4b40-86ab-7a0f82bfa8a5 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:53.075350 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ec4fd201-fb79-4b40-86ab-7a0f82bfa8a5 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 200 len: 1242 microversion: 2.1 time: 0.137334 May 27 15:16:53.084336 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2220/4430] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:52 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 1242 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:53.130845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3e7c6606-1698-47d5-a64d-b5974c9b3761 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:53.131791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3e7c6606-1698-47d5-a64d-b5974c9b3761 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:53.151386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e7c6606-1698-47d5-a64d-b5974c9b3761 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:53.152068 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e7c6606-1698-47d5-a64d-b5974c9b3761 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:53.153079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e7c6606-1698-47d5-a64d-b5974c9b3761 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:53.153910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e7c6606-1698-47d5-a64d-b5974c9b3761 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:53.258977 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3e7c6606-1698-47d5-a64d-b5974c9b3761 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128744 May 27 15:16:53.259648 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2221/4431] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:16:53 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:16:53.393016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c6f2ab82-109e-4d46-b983-43b8687b2f3a tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:53.409788 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c6f2ab82-109e-4d46-b983-43b8687b2f3a tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da" status: 200 len: 1322 microversion: 2.1 time: 0.471233 May 27 15:16:53.412069 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2211/4432] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:52 2022] GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da => generated 1322 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:54.096293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3d41dfcd-0460-4f8f-8921-cdd08765e3ff tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:54.096953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3d41dfcd-0460-4f8f-8921-cdd08765e3ff tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:54.272082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3bb867bc-c4ff-439e-a66b-cc66703cccef tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:54.274914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3bb867bc-c4ff-439e-a66b-cc66703cccef tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:54.295522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3bb867bc-c4ff-439e-a66b-cc66703cccef tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:54.296070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3bb867bc-c4ff-439e-a66b-cc66703cccef tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:54.296807 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3bb867bc-c4ff-439e-a66b-cc66703cccef tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:54.297257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3bb867bc-c4ff-439e-a66b-cc66703cccef tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:54.306148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3d41dfcd-0460-4f8f-8921-cdd08765e3ff tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:54.334485 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3d41dfcd-0460-4f8f-8921-cdd08765e3ff tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 200 len: 1242 microversion: 2.1 time: 0.245428 May 27 15:16:54.335307 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2222/4433] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:54 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 1242 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:54.411782 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3bb867bc-c4ff-439e-a66b-cc66703cccef tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137378 May 27 15:16:54.413318 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2212/4434] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:16:54 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:16:54.428955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b45e5c48-8493-4a1e-87a8-4389f45c6023 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:54.430122 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b45e5c48-8493-4a1e-87a8-4389f45c6023 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:54.444292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b45e5c48-8493-4a1e-87a8-4389f45c6023 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:54.445167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b45e5c48-8493-4a1e-87a8-4389f45c6023 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:54.446419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b45e5c48-8493-4a1e-87a8-4389f45c6023 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:54.447039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b45e5c48-8493-4a1e-87a8-4389f45c6023 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:54.505186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:54.702607 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b45e5c48-8493-4a1e-87a8-4389f45c6023 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:54.729848 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b45e5c48-8493-4a1e-87a8-4389f45c6023 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da" status: 200 len: 1322 microversion: 2.1 time: 0.304023 May 27 15:16:54.742269 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2223/4435] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:54 2022] GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:55.378038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6674070a-60d6-43a4-87cd-5b375df2885a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:55.378680 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6674070a-60d6-43a4-87cd-5b375df2885a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:55.404378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6674070a-60d6-43a4-87cd-5b375df2885a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:55.406708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6674070a-60d6-43a4-87cd-5b375df2885a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:55.409931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6674070a-60d6-43a4-87cd-5b375df2885a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:55.429169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e32ff8ed-1d59-45ea-8568-2d95e5a08281 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:55.431609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e32ff8ed-1d59-45ea-8568-2d95e5a08281 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:55.444728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6674070a-60d6-43a4-87cd-5b375df2885a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:55.455351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e32ff8ed-1d59-45ea-8568-2d95e5a08281 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:55.472920 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e32ff8ed-1d59-45ea-8568-2d95e5a08281 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:55.474118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e32ff8ed-1d59-45ea-8568-2d95e5a08281 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:55.475486 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e32ff8ed-1d59-45ea-8568-2d95e5a08281 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:55.578672 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e32ff8ed-1d59-45ea-8568-2d95e5a08281 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158914 May 27 15:16:55.579404 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2224/4436] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:16:55 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:16:55.728214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6674070a-60d6-43a4-87cd-5b375df2885a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:55.749650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4abbb160-9afa-4c0d-ad5a-e444403240ad tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:55.750523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4abbb160-9afa-4c0d-ad5a-e444403240ad tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:55.756648 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6674070a-60d6-43a4-87cd-5b375df2885a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 200 len: 1294 microversion: 2.1 time: 0.408908 May 27 15:16:55.764119 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2213/4437] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:55 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 1294 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:55.767479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:55.769655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4abbb160-9afa-4c0d-ad5a-e444403240ad tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:55.773807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4abbb160-9afa-4c0d-ad5a-e444403240ad tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:55.784286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4abbb160-9afa-4c0d-ad5a-e444403240ad tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:55.784966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4abbb160-9afa-4c0d-ad5a-e444403240ad tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:56.584979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4abbb160-9afa-4c0d-ad5a-e444403240ad tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:56.592626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e4a465e4-c294-4936-9bf3-d5f2887d8231 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:56.593628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e4a465e4-c294-4936-9bf3-d5f2887d8231 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:56.604582 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4abbb160-9afa-4c0d-ad5a-e444403240ad tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da" status: 200 len: 1322 microversion: 2.1 time: 0.840433 May 27 15:16:56.605475 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2225/4438] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:55 2022] GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da => generated 1322 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:56.612457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4a465e4-c294-4936-9bf3-d5f2887d8231 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:56.613140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4a465e4-c294-4936-9bf3-d5f2887d8231 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:56.613987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4a465e4-c294-4936-9bf3-d5f2887d8231 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:56.614441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4a465e4-c294-4936-9bf3-d5f2887d8231 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:56.725142 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e4a465e4-c294-4936-9bf3-d5f2887d8231 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136193 May 27 15:16:56.734878 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2214/4439] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:16:56 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:16:56.775538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c36ff206-50ff-4ca3-a521-6b7ab01d12e2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:56.776179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c36ff206-50ff-4ca3-a521-6b7ab01d12e2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:56.802124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c36ff206-50ff-4ca3-a521-6b7ab01d12e2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:56.802124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c36ff206-50ff-4ca3-a521-6b7ab01d12e2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:56.802745 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c36ff206-50ff-4ca3-a521-6b7ab01d12e2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:56.803251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c36ff206-50ff-4ca3-a521-6b7ab01d12e2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:57.127526 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c36ff206-50ff-4ca3-a521-6b7ab01d12e2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:57.137260 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c36ff206-50ff-4ca3-a521-6b7ab01d12e2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 200 len: 1300 microversion: 2.1 time: 0.365351 May 27 15:16:57.151050 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2226/4440] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:56 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 1300 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:57.622811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d2157370-dbdf-4e5c-b042-8d26cf3f4943 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:57.624423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d2157370-dbdf-4e5c-b042-8d26cf3f4943 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:57.641129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2157370-dbdf-4e5c-b042-8d26cf3f4943 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:57.656434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2157370-dbdf-4e5c-b042-8d26cf3f4943 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:57.665427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2157370-dbdf-4e5c-b042-8d26cf3f4943 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:57.668183 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2157370-dbdf-4e5c-b042-8d26cf3f4943 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:57.744432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-30054aa6-c07a-465f-932c-dcb5d42500a1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:57.746642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-30054aa6-c07a-465f-932c-dcb5d42500a1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:57.773059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30054aa6-c07a-465f-932c-dcb5d42500a1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:57.774404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30054aa6-c07a-465f-932c-dcb5d42500a1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:57.777083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30054aa6-c07a-465f-932c-dcb5d42500a1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:57.778368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30054aa6-c07a-465f-932c-dcb5d42500a1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:57.862707 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-30054aa6-c07a-465f-932c-dcb5d42500a1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.124175 May 27 15:16:57.863833 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2227/4441] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:16:57 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283/os-volume_attachments => generated 25 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:16:57.869072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a544a496-0ce7-49a2-ba2a-39a1255f43bd tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:57.869889 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a544a496-0ce7-49a2-ba2a-39a1255f43bd tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:57.879040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a544a496-0ce7-49a2-ba2a-39a1255f43bd tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:57.879774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a544a496-0ce7-49a2-ba2a-39a1255f43bd tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:57.881562 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a544a496-0ce7-49a2-ba2a-39a1255f43bd tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:57.882330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a544a496-0ce7-49a2-ba2a-39a1255f43bd tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:57.901433 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-a544a496-0ce7-49a2-ba2a-39a1255f43bd tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] HTTP exception thrown: Instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 could not be found. May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a544a496-0ce7-49a2-ba2a-39a1255f43bd tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Request method failure captured: May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 HTTP/1.1 May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOsUdBMh5v-ULiWL1KqcPs684D08fihdMblmDCUjtgxsHJ-eomFfJ17KNeIUKxQRQEdzdUVKgFJSQRi06Cl_aSMXu1Cv6oUFC5FssiRVYu1aJurFjj0OQxtgWRiIx86sH0xWJLewdpYqHDHIDLA0KSp_PlLgM9TRdHLwbZRBVWTPHfA May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 42c0be30e5494716a16b458fe631f6ee May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersTestMultiNic-764646204 May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/42c0be30e5494716a16b458fe631f6ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/42c0be30e5494716a16b458fe631f6ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/42c0be30e5494716a16b458fe631f6ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_42c0be30e5494716a16b458fe631f6ee", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersTestMultiNic-764646204 May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 42c0be30e5494716a16b458fe631f6ee May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersTestMultiNic-764646204 May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersTestMultiNic-764646204-project May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 1ae937c9ae1a44029ec336114f22df83 May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersTestMultiNic-764646204-project May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 could not be found. May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '4d717563-18ef-4ab7-82ca-4db0ddecc056'} May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 could not be found. May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:16:57.903820 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 could not be found. May 27 15:16:57.908665 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:57.908665 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:57.908665 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:57.908665 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:57.908665 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:57.908665 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:57.908665 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:16:57.908665 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:16:57.908665 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 could not be found. May 27 15:16:57.908665 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:57.913138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a544a496-0ce7-49a2-ba2a-39a1255f43bd tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Returning 404 to user: Instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:16:57.914296 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a544a496-0ce7-49a2-ba2a-39a1255f43bd tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 404 len: 111 microversion: 2.1 time: 0.049318 May 27 15:16:57.915430 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2228/4442] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:16:57 2022] DELETE /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:16:57.946988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-85c15e46-10b6-46a0-8818-7576b5bb4557 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:57.948058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-85c15e46-10b6-46a0-8818-7576b5bb4557 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 4d717563-18ef-4ab7-82ca-4db0ddecc056] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:57.974541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85c15e46-10b6-46a0-8818-7576b5bb4557 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:57.976416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85c15e46-10b6-46a0-8818-7576b5bb4557 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:57.978976 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85c15e46-10b6-46a0-8818-7576b5bb4557 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:57.979541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85c15e46-10b6-46a0-8818-7576b5bb4557 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.021548 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-85c15e46-10b6-46a0-8818-7576b5bb4557 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] HTTP exception thrown: Instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 could not be found. May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-85c15e46-10b6-46a0-8818-7576b5bb4557 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Request method failure captured: May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 HTTP/1.1 May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOsUdBMh5v-ULiWL1KqcPs684D08fihdMblmDCUjtgxsHJ-eomFfJ17KNeIUKxQRQEdzdUVKgFJSQRi06Cl_aSMXu1Cv6oUFC5FssiRVYu1aJurFjj0OQxtgWRiIx86sH0xWJLewdpYqHDHIDLA0KSp_PlLgM9TRdHLwbZRBVWTPHfA May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 42c0be30e5494716a16b458fe631f6ee May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersTestMultiNic-764646204 May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/42c0be30e5494716a16b458fe631f6ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/42c0be30e5494716a16b458fe631f6ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/42c0be30e5494716a16b458fe631f6ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_42c0be30e5494716a16b458fe631f6ee", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersTestMultiNic-764646204 May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 42c0be30e5494716a16b458fe631f6ee May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersTestMultiNic-764646204 May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersTestMultiNic-764646204-project May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 1ae937c9ae1a44029ec336114f22df83 May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersTestMultiNic-764646204-project May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 could not be found. May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '4d717563-18ef-4ab7-82ca-4db0ddecc056'} May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 could not be found. May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 could not be found. May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:58.028067 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:58.033337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:58.033337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:58.033337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:58.033337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:16:58.033337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:16:58.033337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 could not be found. May 27 15:16:58.033337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:58.033337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-85c15e46-10b6-46a0-8818-7576b5bb4557 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Returning 404 to user: Instance 4d717563-18ef-4ab7-82ca-4db0ddecc056 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:16:58.034751 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-85c15e46-10b6-46a0-8818-7576b5bb4557 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056" status: 404 len: 111 microversion: 2.1 time: 0.113333 May 27 15:16:58.035773 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2229/4443] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:57 2022] GET /compute/v2.1/servers/4d717563-18ef-4ab7-82ca-4db0ddecc056 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:16:58.043954 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bbe5f29b-419c-4665-88f7-ef7079fdb5d2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:58.046277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bbe5f29b-419c-4665-88f7-ef7079fdb5d2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:58.058111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bbe5f29b-419c-4665-88f7-ef7079fdb5d2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.062019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bbe5f29b-419c-4665-88f7-ef7079fdb5d2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.062965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bbe5f29b-419c-4665-88f7-ef7079fdb5d2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.064094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bbe5f29b-419c-4665-88f7-ef7079fdb5d2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.099556 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-bbe5f29b-419c-4665-88f7-ef7079fdb5d2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] HTTP exception thrown: Instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 could not be found. May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bbe5f29b-419c-4665-88f7-ef7079fdb5d2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Request method failure captured: May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 HTTP/1.1 May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOsUdBMh5v-ULiWL1KqcPs684D08fihdMblmDCUjtgxsHJ-eomFfJ17KNeIUKxQRQEdzdUVKgFJSQRi06Cl_aSMXu1Cv6oUFC5FssiRVYu1aJurFjj0OQxtgWRiIx86sH0xWJLewdpYqHDHIDLA0KSp_PlLgM9TRdHLwbZRBVWTPHfA May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 42c0be30e5494716a16b458fe631f6ee May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersTestMultiNic-764646204 May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/42c0be30e5494716a16b458fe631f6ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/42c0be30e5494716a16b458fe631f6ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/42c0be30e5494716a16b458fe631f6ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_42c0be30e5494716a16b458fe631f6ee", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersTestMultiNic-764646204 May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 42c0be30e5494716a16b458fe631f6ee May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersTestMultiNic-764646204 May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersTestMultiNic-764646204-project May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 1ae937c9ae1a44029ec336114f22df83 May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersTestMultiNic-764646204-project May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 could not be found. May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44'} May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 could not be found. May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:16:58.101454 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 could not be found. May 27 15:16:58.107768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:58.107768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:58.107768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:58.107768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:58.107768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:58.107768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:58.107768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:16:58.107768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:16:58.107768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 could not be found. May 27 15:16:58.107768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:58.121777 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bbe5f29b-419c-4665-88f7-ef7079fdb5d2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Returning 404 to user: Instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:16:58.124619 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bbe5f29b-419c-4665-88f7-ef7079fdb5d2 tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "DELETE /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 404 len: 111 microversion: 2.1 time: 0.084679 May 27 15:16:58.128900 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2230/4444] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:16:58 2022] DELETE /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:16:58.138836 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5a64b799-d981-4559-9c5a-66c577bba719 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:58.141242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5a64b799-d981-4559-9c5a-66c577bba719 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:58.149233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d2157370-dbdf-4e5c-b042-8d26cf3f4943 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:58.155298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5a64b799-d981-4559-9c5a-66c577bba719 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.156073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5a64b799-d981-4559-9c5a-66c577bba719 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.157672 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5a64b799-d981-4559-9c5a-66c577bba719 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.158575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5a64b799-d981-4559-9c5a-66c577bba719 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.170097 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d2157370-dbdf-4e5c-b042-8d26cf3f4943 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da" status: 200 len: 1322 microversion: 2.1 time: 0.551936 May 27 15:16:58.170714 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2215/4445] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:57 2022] GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da => generated 1322 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:58.180081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-340cbe92-5824-4445-bfde-f61413f1768c tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:58.183469 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-340cbe92-5824-4445-bfde-f61413f1768c tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] [instance: 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:58.198139 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-5a64b799-d981-4559-9c5a-66c577bba719 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] HTTP exception thrown: Cannot 'reboot' instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e while it is in vm_state rescued May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5a64b799-d981-4559-9c5a-66c577bba719 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Request method failure captured: May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e/action HTTP/1.1 May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 28 May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOnNcWUaU6oQTw40A1oZOI-6OFKZaukve4P5LqW1FpCc9yhaxuLnjuKFUwlZoi0CeEpz5akQjaT-fGwv01A8fNadXXg4nlnoB_yvoYpc3lVED0AfYG3-niNxm_AITH-UuchLUVsnXh3asdpL1aml75HbLXXqw5pajtYuIua7x_Sa4qg May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1f6efd5b16e5450d9eb9b454d05a775a May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1f6efd5b16e5450d9eb9b454d05a775a", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1f6efd5b16e5450d9eb9b454d05a775a May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerRescueNegativeTestJSON-1538927199-project May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 645379b3a21548d8a4f4d6425b61319f May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1538927199-project May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: {"reboot": {"type": "HARD"}} May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: exception: Cannot 'reboot' instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e while it is in vm_state rescued May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '3bc393fb-711a-436a-8a25-c84ee30e8f3e', 'body': {'reboot': {'type': 'HARD'}}} May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e in vm_state rescued. Cannot _hard_reboot while the instance is in this state. May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 15:16:58.199967 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 15:16:58.204540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e while it is in vm_state rescued May 27 15:16:58.204540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:58.204540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:58.204540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:58.204540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:58.204540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:58.204540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:58.204540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:16:58.204540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:16:58.204540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e while it is in vm_state rescued May 27 15:16:58.204540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:16:58.204540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5a64b799-d981-4559-9c5a-66c577bba719 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Returning 409 to user: Cannot 'reboot' instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e while it is in vm_state rescued {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:16:58.204540 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5a64b799-d981-4559-9c5a-66c577bba719 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "POST /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e/action" status: 409 len: 145 microversion: 2.1 time: 0.071712 May 27 15:16:58.204540 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2231/4446] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:16:58 2022] POST /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e/action => generated 145 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:16:58.210142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-76b0aa9c-3066-4c55-a99f-19089154d679 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:58.211653 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-76b0aa9c-3066-4c55-a99f-19089154d679 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:58.213975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-340cbe92-5824-4445-bfde-f61413f1768c tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.218478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-340cbe92-5824-4445-bfde-f61413f1768c tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.219042 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76b0aa9c-3066-4c55-a99f-19089154d679 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.220153 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76b0aa9c-3066-4c55-a99f-19089154d679 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.221236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-340cbe92-5824-4445-bfde-f61413f1768c tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.221918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76b0aa9c-3066-4c55-a99f-19089154d679 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.222429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76b0aa9c-3066-4c55-a99f-19089154d679 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.224290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-340cbe92-5824-4445-bfde-f61413f1768c tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.267759 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-340cbe92-5824-4445-bfde-f61413f1768c tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] HTTP exception thrown: Instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 could not be found. May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-340cbe92-5824-4445-bfde-f61413f1768c tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Request method failure captured: May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 HTTP/1.1 May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOsUdBMh5v-ULiWL1KqcPs684D08fihdMblmDCUjtgxsHJ-eomFfJ17KNeIUKxQRQEdzdUVKgFJSQRi06Cl_aSMXu1Cv6oUFC5FssiRVYu1aJurFjj0OQxtgWRiIx86sH0xWJLewdpYqHDHIDLA0KSp_PlLgM9TRdHLwbZRBVWTPHfA May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 42c0be30e5494716a16b458fe631f6ee May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersTestMultiNic-764646204 May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/42c0be30e5494716a16b458fe631f6ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/42c0be30e5494716a16b458fe631f6ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/42c0be30e5494716a16b458fe631f6ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_42c0be30e5494716a16b458fe631f6ee", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersTestMultiNic-764646204 May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 42c0be30e5494716a16b458fe631f6ee May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersTestMultiNic-764646204 May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersTestMultiNic-764646204-project May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 1ae937c9ae1a44029ec336114f22df83 May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersTestMultiNic-764646204-project May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 could not be found. May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44'} May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 could not be found. May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 could not be found. May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:58.273055 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:58.277816 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:58.277816 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:58.277816 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:58.277816 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:16:58.277816 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:16:58.277816 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 could not be found. May 27 15:16:58.277816 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:58.277816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-340cbe92-5824-4445-bfde-f61413f1768c tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] Returning 404 to user: Instance 117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:16:58.277816 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-340cbe92-5824-4445-bfde-f61413f1768c tempest-ServersTestMultiNic-764646204 tempest-ServersTestMultiNic-764646204-project] 10.222.0.13 "GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44" status: 404 len: 111 microversion: 2.1 time: 0.105677 May 27 15:16:58.278436 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2216/4447] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:58 2022] GET /compute/v2.1/servers/117f30d2-d7e7-4d3e-b6e7-cebc96ac4e44 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:16:58.294244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dec3b424-bd80-490c-a3cf-4c1fd8f1dc5c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "346e776e-8931-417f-87da-575810efb12b"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:58.297508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dec3b424-bd80-490c-a3cf-4c1fd8f1dc5c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:58.317325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dec3b424-bd80-490c-a3cf-4c1fd8f1dc5c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.318763 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dec3b424-bd80-490c-a3cf-4c1fd8f1dc5c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.319683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dec3b424-bd80-490c-a3cf-4c1fd8f1dc5c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.320509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dec3b424-bd80-490c-a3cf-4c1fd8f1dc5c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.361655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-76b0aa9c-3066-4c55-a99f-19089154d679 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:58.378789 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-76b0aa9c-3066-4c55-a99f-19089154d679 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 200 len: 1300 microversion: 2.1 time: 0.174779 May 27 15:16:58.393386 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-dec3b424-bd80-490c-a3cf-4c1fd8f1dc5c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] HTTP exception thrown: Cannot 'rebuild' instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e while it is in vm_state rescued May 27 15:16:58.394813 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2232/4448] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:58 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 1300 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dec3b424-bd80-490c-a3cf-4c1fd8f1dc5c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Request method failure captured: May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e/action HTTP/1.1 May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 65 May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOnNcWUaU6oQTw40A1oZOI-6OFKZaukve4P5LqW1FpCc9yhaxuLnjuKFUwlZoi0CeEpz5akQjaT-fGwv01A8fNadXXg4nlnoB_yvoYpc3lVED0AfYG3-niNxm_AITH-UuchLUVsnXh3asdpL1aml75HbLXXqw5pajtYuIua7x_Sa4qg May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 1f6efd5b16e5450d9eb9b454d05a775a May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1f6efd5b16e5450d9eb9b454d05a775a", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 1f6efd5b16e5450d9eb9b454d05a775a May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerRescueNegativeTestJSON-1538927199-project May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 645379b3a21548d8a4f4d6425b61319f May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1538927199-project May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: {"rebuild": {"imageRef": "346e776e-8931-417f-87da-575810efb12b"}} May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: exception: Cannot 'rebuild' instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e while it is in vm_state rescued May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '3bc393fb-711a-436a-8a25-c84ee30e8f3e', 'body': {'rebuild': {'imageRef': '346e776e-8931-417f-87da-575810efb12b'}}} May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e in vm_state rescued. Cannot rebuild while the instance is in this state. May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:16:58.397338 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:16:58.403536 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:16:58.403536 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 27 15:16:58.403536 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild May 27 15:16:58.403536 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 15:16:58.403536 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 15:16:58.403536 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 15:16:58.403536 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e while it is in vm_state rescued May 27 15:16:58.403536 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:58.403536 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:58.403536 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:58.403536 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:58.403536 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:58.403536 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:58.403536 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:16:58.403536 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:16:58.403536 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e while it is in vm_state rescued May 27 15:16:58.403536 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:16:58.403536 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dec3b424-bd80-490c-a3cf-4c1fd8f1dc5c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Returning 409 to user: Cannot 'rebuild' instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e while it is in vm_state rescued {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:16:58.403536 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dec3b424-bd80-490c-a3cf-4c1fd8f1dc5c tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "POST /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e/action" status: 409 len: 146 microversion: 2.1 time: 0.115904 May 27 15:16:58.408727 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2217/4449] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:16:58 2022] POST /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e/action => generated 146 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:16:58.416535 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-41ae3f95-5440-4540-ba7a-51c7d9cc0013 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:58.417428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-41ae3f95-5440-4540-ba7a-51c7d9cc0013 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:58.424842 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-41ae3f95-5440-4540-ba7a-51c7d9cc0013 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.425671 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-41ae3f95-5440-4540-ba7a-51c7d9cc0013 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.427489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-41ae3f95-5440-4540-ba7a-51c7d9cc0013 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.428217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-41ae3f95-5440-4540-ba7a-51c7d9cc0013 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.492026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-41ae3f95-5440-4540-ba7a-51c7d9cc0013 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:16:58.680328 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-41ae3f95-5440-4540-ba7a-51c7d9cc0013 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 204 len: 0 microversion: 2.1 time: 0.266496 May 27 15:16:58.683096 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2233/4450] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:16:58 2022] DELETE /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:16:58.692351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-19cb2ab9-6a54-413c-900e-d5e6fbfc6508 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:58.694326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-19cb2ab9-6a54-413c-900e-d5e6fbfc6508 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:58.727605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19cb2ab9-6a54-413c-900e-d5e6fbfc6508 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.731499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19cb2ab9-6a54-413c-900e-d5e6fbfc6508 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.733360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19cb2ab9-6a54-413c-900e-d5e6fbfc6508 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.737077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19cb2ab9-6a54-413c-900e-d5e6fbfc6508 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:59.155024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-19cb2ab9-6a54-413c-900e-d5e6fbfc6508 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:59.156306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-c8b2d1a8-f65f-4dd5-b8e1-377ed296df8d req-58050574-8b4a-4a93-8ce3-c14fc56420d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf51b0d-7630-4588-bae9-e50accb2d1da", "name": "network-vif-plugged", "status": "completed", "tag": "cfe4b2b8-979e-4e68-aae5-ec9bc705186d"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:59.165677 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-19cb2ab9-6a54-413c-900e-d5e6fbfc6508 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1690 microversion: 2.1 time: 0.478204 May 27 15:16:59.166405 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2218/4451] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:58 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1690 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:59.182352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-c8b2d1a8-f65f-4dd5-b8e1-377ed296df8d req-58050574-8b4a-4a93-8ce3-c14fc56420d4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:59.188957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-037b23a6-9fd8-4610-a886-07da0c9ec0f1 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:59.189910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-037b23a6-9fd8-4610-a886-07da0c9ec0f1 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:59.190543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-c8b2d1a8-f65f-4dd5-b8e1-377ed296df8d req-58050574-8b4a-4a93-8ce3-c14fc56420d4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:59.203741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-037b23a6-9fd8-4610-a886-07da0c9ec0f1 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:59.205018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-037b23a6-9fd8-4610-a886-07da0c9ec0f1 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:59.206106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-037b23a6-9fd8-4610-a886-07da0c9ec0f1 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:59.208637 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-037b23a6-9fd8-4610-a886-07da0c9ec0f1 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:59.216704 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-c8b2d1a8-f65f-4dd5-b8e1-377ed296df8d req-58050574-8b4a-4a93-8ce3-c14fc56420d4 service nova] Creating event network-vif-plugged:cfe4b2b8-979e-4e68-aae5-ec9bc705186d for instance bdf51b0d-7630-4588-bae9-e50accb2d1da on n-h2-843621-1 May 27 15:16:59.226712 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-c8b2d1a8-f65f-4dd5-b8e1-377ed296df8d req-58050574-8b4a-4a93-8ce3-c14fc56420d4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075340 May 27 15:16:59.240080 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2234/4452] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:59.402651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-89cd6098-3742-47ae-abf6-b80a6267e0f1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:59.403718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-89cd6098-3742-47ae-abf6-b80a6267e0f1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:59.419370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89cd6098-3742-47ae-abf6-b80a6267e0f1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:59.422311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89cd6098-3742-47ae-abf6-b80a6267e0f1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:59.423929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89cd6098-3742-47ae-abf6-b80a6267e0f1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:59.424551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89cd6098-3742-47ae-abf6-b80a6267e0f1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:59.522379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-037b23a6-9fd8-4610-a886-07da0c9ec0f1 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:59.535578 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-037b23a6-9fd8-4610-a886-07da0c9ec0f1 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da" status: 200 len: 1322 microversion: 2.1 time: 0.351659 May 27 15:16:59.537772 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2219/4453] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:59 2022] GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:59.742465 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-89cd6098-3742-47ae-abf6-b80a6267e0f1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:59.752134 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-89cd6098-3742-47ae-abf6-b80a6267e0f1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 200 len: 1367 microversion: 2.1 time: 0.354061 May 27 15:16:59.757592 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2235/4454] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:16:59 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:00.183630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d40318cf-7571-4999-9576-aa753efe3cd5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:00.184249 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d40318cf-7571-4999-9576-aa753efe3cd5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:00.200369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d40318cf-7571-4999-9576-aa753efe3cd5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:00.201007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d40318cf-7571-4999-9576-aa753efe3cd5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:00.201810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d40318cf-7571-4999-9576-aa753efe3cd5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:00.202268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d40318cf-7571-4999-9576-aa753efe3cd5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:00.229951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:00.388239 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d40318cf-7571-4999-9576-aa753efe3cd5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:00.400604 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d40318cf-7571-4999-9576-aa753efe3cd5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1690 microversion: 2.1 time: 0.218504 May 27 15:17:00.402626 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2220/4455] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:00 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1690 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:00.555425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-11c64fa9-89ff-4688-9783-38736cb3ea66 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:00.556045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-11c64fa9-89ff-4688-9783-38736cb3ea66 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:00.571006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11c64fa9-89ff-4688-9783-38736cb3ea66 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:00.573260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11c64fa9-89ff-4688-9783-38736cb3ea66 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:00.574266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11c64fa9-89ff-4688-9783-38736cb3ea66 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:00.579536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11c64fa9-89ff-4688-9783-38736cb3ea66 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:00.774943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2f20ef56-b556-4d44-8782-4eb8005ce7cf tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:00.775723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2f20ef56-b556-4d44-8782-4eb8005ce7cf tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:00.789797 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2f20ef56-b556-4d44-8782-4eb8005ce7cf tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:00.790681 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2f20ef56-b556-4d44-8782-4eb8005ce7cf tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:00.795378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2f20ef56-b556-4d44-8782-4eb8005ce7cf tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:00.796101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2f20ef56-b556-4d44-8782-4eb8005ce7cf tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:00.978766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-11c64fa9-89ff-4688-9783-38736cb3ea66 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:00.988254 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-11c64fa9-89ff-4688-9783-38736cb3ea66 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da" status: 200 len: 1322 microversion: 2.1 time: 0.436683 May 27 15:17:00.990230 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2236/4456] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:00 2022] GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da => generated 1322 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:01.054835 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2f20ef56-b556-4d44-8782-4eb8005ce7cf tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:01.064230 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2f20ef56-b556-4d44-8782-4eb8005ce7cf tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 200 len: 1367 microversion: 2.1 time: 0.293324 May 27 15:17:01.074519 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2221/4457] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:00 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:01.417846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-602da3eb-e16a-40d5-be21-170290449cb1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:01.418737 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-602da3eb-e16a-40d5-be21-170290449cb1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:01.426773 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-602da3eb-e16a-40d5-be21-170290449cb1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:01.434543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-602da3eb-e16a-40d5-be21-170290449cb1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:01.435908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-602da3eb-e16a-40d5-be21-170290449cb1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:01.436619 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-602da3eb-e16a-40d5-be21-170290449cb1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:01.745318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-602da3eb-e16a-40d5-be21-170290449cb1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:01.757168 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-602da3eb-e16a-40d5-be21-170290449cb1 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1690 microversion: 2.1 time: 0.342405 May 27 15:17:01.758361 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2237/4458] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:01 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1690 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:02.006633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b1549b56-1e9f-4dfa-9498-3323ff027bb6 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:02.007866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b1549b56-1e9f-4dfa-9498-3323ff027bb6 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:02.023815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b1549b56-1e9f-4dfa-9498-3323ff027bb6 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:02.024656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-c9c97b6b-f234-4753-9bc8-5e1b356df3ff req-38c05652-785b-4c66-ac40-4410ecd7e298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a07558-123a-448c-ad41-1da4feffb611", "tag": "d8c8343a-a199-480a-bb57-b0ac1047f111"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:02.030452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b1549b56-1e9f-4dfa-9498-3323ff027bb6 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:02.035517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b1549b56-1e9f-4dfa-9498-3323ff027bb6 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:02.038719 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b1549b56-1e9f-4dfa-9498-3323ff027bb6 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:02.058661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-c9c97b6b-f234-4753-9bc8-5e1b356df3ff req-38c05652-785b-4c66-ac40-4410ecd7e298 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:02.063980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-c9c97b6b-f234-4753-9bc8-5e1b356df3ff req-38c05652-785b-4c66-ac40-4410ecd7e298 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:02.114828 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-c9c97b6b-f234-4753-9bc8-5e1b356df3ff req-38c05652-785b-4c66-ac40-4410ecd7e298 service nova] Creating event network-changed:d8c8343a-a199-480a-bb57-b0ac1047f111 for instance 04a07558-123a-448c-ad41-1da4feffb611 on n-h2-843621-1 May 27 15:17:02.132604 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-c9c97b6b-f234-4753-9bc8-5e1b356df3ff req-38c05652-785b-4c66-ac40-4410ecd7e298 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112075 May 27 15:17:02.135446 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2238/4459] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:02.159691 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6423de0e-3828-4fa9-8fc8-b7446c6bdfbb tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:02.165910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6423de0e-3828-4fa9-8fc8-b7446c6bdfbb tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:02.208109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6423de0e-3828-4fa9-8fc8-b7446c6bdfbb tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:02.209888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6423de0e-3828-4fa9-8fc8-b7446c6bdfbb tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:02.211146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6423de0e-3828-4fa9-8fc8-b7446c6bdfbb tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:02.213716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6423de0e-3828-4fa9-8fc8-b7446c6bdfbb tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:02.338795 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b1549b56-1e9f-4dfa-9498-3323ff027bb6 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:02.353692 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b1549b56-1e9f-4dfa-9498-3323ff027bb6 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da" status: 200 len: 1471 microversion: 2.1 time: 0.346756 May 27 15:17:02.372946 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2222/4460] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:02 2022] GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da => generated 1471 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:02.382606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e08e0b61-8505-4d9b-8b9c-9b2c94d69d8d tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:02.389030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e08e0b61-8505-4d9b-8b9c-9b2c94d69d8d tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:02.407563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e08e0b61-8505-4d9b-8b9c-9b2c94d69d8d tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:02.408148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e08e0b61-8505-4d9b-8b9c-9b2c94d69d8d tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:02.409090 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e08e0b61-8505-4d9b-8b9c-9b2c94d69d8d tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:02.416839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e08e0b61-8505-4d9b-8b9c-9b2c94d69d8d tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:02.460764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-e08e0b61-8505-4d9b-8b9c-9b2c94d69d8d tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Lazy-loading 'flavor' on Instance uuid bdf51b0d-7630-4588-bae9-e50accb2d1da {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:17:02.590874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6423de0e-3828-4fa9-8fc8-b7446c6bdfbb tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:02.602402 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6423de0e-3828-4fa9-8fc8-b7446c6bdfbb tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 200 len: 1367 microversion: 2.1 time: 0.461273 May 27 15:17:02.616417 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2239/4461] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:02 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 1367 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:02.621762 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e08e0b61-8505-4d9b-8b9c-9b2c94d69d8d tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da/action" status: 202 len: 0 microversion: 2.1 time: 0.246876 May 27 15:17:02.627043 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2223/4462] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:17:02 2022] POST /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:17:02.631220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-43a0f309-a3eb-45d3-bdca-a7db0f43a499 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:02.631841 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-43a0f309-a3eb-45d3-bdca-a7db0f43a499 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:02.639712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43a0f309-a3eb-45d3-bdca-a7db0f43a499 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:02.640478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43a0f309-a3eb-45d3-bdca-a7db0f43a499 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:02.641539 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43a0f309-a3eb-45d3-bdca-a7db0f43a499 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:02.642151 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43a0f309-a3eb-45d3-bdca-a7db0f43a499 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:02.780211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:02.781224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=10 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:02.791589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3469933f-d0b2-4e5f-9706-a949d168c071 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:02.793901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3469933f-d0b2-4e5f-9706-a949d168c071 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:02.835964 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3469933f-d0b2-4e5f-9706-a949d168c071 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:02.837791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3469933f-d0b2-4e5f-9706-a949d168c071 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:02.845990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3469933f-d0b2-4e5f-9706-a949d168c071 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:02.847351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3469933f-d0b2-4e5f-9706-a949d168c071 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:03.087657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3469933f-d0b2-4e5f-9706-a949d168c071 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:03.102660 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3469933f-d0b2-4e5f-9706-a949d168c071 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1690 microversion: 2.1 time: 0.330837 May 27 15:17:03.106582 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2224/4463] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:02 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1690 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:03.173569 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-43a0f309-a3eb-45d3-bdca-a7db0f43a499 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da" status: 200 len: 1630 microversion: 2.1 time: 0.545930 May 27 15:17:03.191028 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2240/4464] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:02 2022] GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da => generated 1630 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:03.621246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cca7d84c-9b8b-4143-b817-a34782f3640c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:03.621805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cca7d84c-9b8b-4143-b817-a34782f3640c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:03.636499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cca7d84c-9b8b-4143-b817-a34782f3640c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:03.637131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cca7d84c-9b8b-4143-b817-a34782f3640c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:03.643085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cca7d84c-9b8b-4143-b817-a34782f3640c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:03.643673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cca7d84c-9b8b-4143-b817-a34782f3640c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:04.126051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-119bec5b-0da2-422a-ad41-b235adcf99eb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:04.126622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-119bec5b-0da2-422a-ad41-b235adcf99eb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:04.162080 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-119bec5b-0da2-422a-ad41-b235adcf99eb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:04.162557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-119bec5b-0da2-422a-ad41-b235adcf99eb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:04.163357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-119bec5b-0da2-422a-ad41-b235adcf99eb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:04.163807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-119bec5b-0da2-422a-ad41-b235adcf99eb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:04.329893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=12 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:04.362566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cca7d84c-9b8b-4143-b817-a34782f3640c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:04.383587 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cca7d84c-9b8b-4143-b817-a34782f3640c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 200 len: 1367 microversion: 2.1 time: 0.764492 May 27 15:17:04.397350 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2225/4465] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:03 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 1367 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:04.409850 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-522e0020-a9e4-481c-aa30-6fc948603bfc tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:04.412548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-522e0020-a9e4-481c-aa30-6fc948603bfc tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:04.428641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-522e0020-a9e4-481c-aa30-6fc948603bfc tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:04.432578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-522e0020-a9e4-481c-aa30-6fc948603bfc tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:04.434133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-522e0020-a9e4-481c-aa30-6fc948603bfc tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:04.435368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-522e0020-a9e4-481c-aa30-6fc948603bfc tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:04.715060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-119bec5b-0da2-422a-ad41-b235adcf99eb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:04.733445 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-119bec5b-0da2-422a-ad41-b235adcf99eb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1690 microversion: 2.1 time: 0.610476 May 27 15:17:04.752777 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2241/4466] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:04 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1690 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:04.780311 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-522e0020-a9e4-481c-aa30-6fc948603bfc tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da" status: 200 len: 1613 microversion: 2.1 time: 0.378508 May 27 15:17:04.783421 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2226/4467] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:04 2022] GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da => generated 1613 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:04.799824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6af0a579-3131-4947-80bf-e2e7b056d4e9 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:04.800415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6af0a579-3131-4947-80bf-e2e7b056d4e9 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:04.811642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6af0a579-3131-4947-80bf-e2e7b056d4e9 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:04.813682 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6af0a579-3131-4947-80bf-e2e7b056d4e9 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:04.817555 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6af0a579-3131-4947-80bf-e2e7b056d4e9 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:04.818024 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6af0a579-3131-4947-80bf-e2e7b056d4e9 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:04.831572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:04.866206 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-6af0a579-3131-4947-80bf-e2e7b056d4e9 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] HTTP exception thrown: Cannot 'migrate' instance bdf51b0d-7630-4588-bae9-e50accb2d1da while it is in vm_state suspended May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6af0a579-3131-4947-80bf-e2e7b056d4e9 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Request method failure captured: May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da/action HTTP/1.1 May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 15 May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOtKXyBzn1qTQDzhhjbYVLSxE4he1OA31l7iTl6ykztqC3Iqk5DRiClRarektfll_wYKWRyxwdJMHkGwQr3OC2ePe3wY_TDp4M9zR881WqaLrkqtz5QNNcWP6jmcETZsgjthCkPvajxT9gKn-Fo_UPZjvVVZzILsM_qN5XgtNIG-4Jw May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 9625a34fc3e04cfbbcce69d0959a81ab May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1546060325 May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,admin,member May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,admin,member May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9625a34fc3e04cfbbcce69d0959a81ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9625a34fc3e04cfbbcce69d0959a81ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9625a34fc3e04cfbbcce69d0959a81ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9625a34fc3e04cfbbcce69d0959a81ab", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1546060325 May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 9625a34fc3e04cfbbcce69d0959a81ab May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1546060325 May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersAdminNegativeTestJSON-1546060325-project-admin May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: d708c33209ca452d834a7093d7814971 May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1546060325-project-admin May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: {"migrate": {}} May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: exception: Cannot 'migrate' instance bdf51b0d-7630-4588-bae9-e50accb2d1da while it is in vm_state suspended May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'bdf51b0d-7630-4588-bae9-e50accb2d1da', 'body': {'migrate': {}}} May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bdf51b0d-7630-4588-bae9-e50accb2d1da in vm_state suspended. Cannot resize while the instance is in this state. May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:04.873779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:17:04.883066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:17:04.883066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate May 27 15:17:04.883066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 15:17:04.883066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 15:17:04.883066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 15:17:04.883066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance bdf51b0d-7630-4588-bae9-e50accb2d1da while it is in vm_state suspended May 27 15:17:04.883066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:04.883066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:04.883066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:04.883066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:04.883066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:04.883066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:04.883066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:17:04.883066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:17:04.883066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance bdf51b0d-7630-4588-bae9-e50accb2d1da while it is in vm_state suspended May 27 15:17:04.883066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:04.883066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6af0a579-3131-4947-80bf-e2e7b056d4e9 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Returning 409 to user: Cannot 'migrate' instance bdf51b0d-7630-4588-bae9-e50accb2d1da while it is in vm_state suspended {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:04.883066 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6af0a579-3131-4947-80bf-e2e7b056d4e9 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da/action" status: 409 len: 148 microversion: 2.1 time: 0.080773 May 27 15:17:04.883066 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2242/4468] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:17:04 2022] POST /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da/action => generated 148 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:17:04.887064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c1e90c76-b087-4cbb-abc5-3f395943d8f9 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c1e90c76-b087-4cbb-abc5-3f395943d8f9 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Request method failure captured: May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca/action HTTP/1.1 May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 39 May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOtKXyBzn1qTQDzhhjbYVLSxE4he1OA31l7iTl6ykztqC3Iqk5DRiClRarektfll_wYKWRyxwdJMHkGwQr3OC2ePe3wY_TDp4M9zR881WqaLrkqtz5QNNcWP6jmcETZsgjthCkPvajxT9gKn-Fo_UPZjvVVZzILsM_qN5XgtNIG-4Jw May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 9625a34fc3e04cfbbcce69d0959a81ab May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1546060325 May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9625a34fc3e04cfbbcce69d0959a81ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9625a34fc3e04cfbbcce69d0959a81ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9625a34fc3e04cfbbcce69d0959a81ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9625a34fc3e04cfbbcce69d0959a81ab", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1546060325 May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 9625a34fc3e04cfbbcce69d0959a81ab May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1546060325 May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersAdminNegativeTestJSON-1546060325-project-admin May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: d708c33209ca452d834a7093d7814971 May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1546060325-project-admin May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: {"os-resetState": {"state": "invalid"}} May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '0e3ab31c-07b1-4bb7-9999-47ada1e50bca', 'body': {'os-resetState': {'state': 'invalid'}}} May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'invalid' May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:17:04.889645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:17:04.895846 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 27 15:17:04.895846 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:04.895846 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:04.895846 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:04.895846 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:04.895846 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:04.895846 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:04.895846 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:17:04.895846 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:17:04.895846 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 27 15:17:04.895846 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:04.895846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c1e90c76-b087-4cbb-abc5-3f395943d8f9 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:04.895846 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c1e90c76-b087-4cbb-abc5-3f395943d8f9 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca/action" status: 400 len: 144 microversion: 2.1 time: 0.007923 May 27 15:17:04.901112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-996f7b6d-2ff8-4a69-b974-8e5532ddfe79 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:04.902270 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2227/4469] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:17:04 2022] POST /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca/action => generated 144 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-996f7b6d-2ff8-4a69-b974-8e5532ddfe79 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Request method failure captured: May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca/action HTTP/1.1 May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 31 May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOtKXyBzn1qTQDzhhjbYVLSxE4he1OA31l7iTl6ykztqC3Iqk5DRiClRarektfll_wYKWRyxwdJMHkGwQr3OC2ePe3wY_TDp4M9zR881WqaLrkqtz5QNNcWP6jmcETZsgjthCkPvajxT9gKn-Fo_UPZjvVVZzILsM_qN5XgtNIG-4Jw May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 9625a34fc3e04cfbbcce69d0959a81ab May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1546060325 May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,admin,member May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,admin,member May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9625a34fc3e04cfbbcce69d0959a81ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9625a34fc3e04cfbbcce69d0959a81ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9625a34fc3e04cfbbcce69d0959a81ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9625a34fc3e04cfbbcce69d0959a81ab", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1546060325 May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 9625a34fc3e04cfbbcce69d0959a81ab May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1546060325 May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersAdminNegativeTestJSON-1546060325-project-admin May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: d708c33209ca452d834a7093d7814971 May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1546060325-project-admin May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: {"os-resetState": {"state": 1}} May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '0e3ab31c-07b1-4bb7-9999-47ada1e50bca', 'body': {'os-resetState': {'state': 1}}} May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise error May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 1 May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 27 15:17:04.904540 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:04.912928 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:04.912928 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:04.912928 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:04.912928 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:04.912928 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:04.912928 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:17:04.912928 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:17:04.912928 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 27 15:17:04.912928 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:04.912928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-996f7b6d-2ff8-4a69-b974-8e5532ddfe79 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:04.912928 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-996f7b6d-2ff8-4a69-b974-8e5532ddfe79 tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca/action" status: 400 len: 120 microversion: 2.1 time: 0.009059 May 27 15:17:04.912928 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2243/4470] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:17:04 2022] POST /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca/action => generated 120 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:17:04.916179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7401f498-1b99-4d68-927b-dc29d21cb8cb tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:04.917234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7401f498-1b99-4d68-927b-dc29d21cb8cb tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Failed to fetch instance by id 999 {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2926}} May 27 15:17:04.918930 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-7401f498-1b99-4d68-927b-dc29d21cb8cb tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] HTTP exception thrown: Instance 999 could not be found. May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7401f498-1b99-4d68-927b-dc29d21cb8cb tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Request method failure captured: May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 37 May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOtKXyBzn1qTQDzhhjbYVLSxE4he1OA31l7iTl6ykztqC3Iqk5DRiClRarektfll_wYKWRyxwdJMHkGwQr3OC2ePe3wY_TDp4M9zR881WqaLrkqtz5QNNcWP6jmcETZsgjthCkPvajxT9gKn-Fo_UPZjvVVZzILsM_qN5XgtNIG-4Jw May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 9625a34fc3e04cfbbcce69d0959a81ab May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1546060325 May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9625a34fc3e04cfbbcce69d0959a81ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9625a34fc3e04cfbbcce69d0959a81ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9625a34fc3e04cfbbcce69d0959a81ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9625a34fc3e04cfbbcce69d0959a81ab", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1546060325 May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 9625a34fc3e04cfbbcce69d0959a81ab May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1546060325 May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersAdminNegativeTestJSON-1546060325-project-admin May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: d708c33209ca452d834a7093d7814971 May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1546060325-project-admin May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: {"os-resetState": {"state": "error"}} May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 999 could not be found. May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:04.930176 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:17:04.935570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:17:04.935570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. May 27 15:17:04.935570 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:04.935570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7401f498-1b99-4d68-927b-dc29d21cb8cb tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:04.935570 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7401f498-1b99-4d68-927b-dc29d21cb8cb tempest-ServersAdminNegativeTestJSON-1546060325 tempest-ServersAdminNegativeTestJSON-1546060325-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.019595 May 27 15:17:04.935570 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2228/4471] 10.222.0.13 () {60 vars in 1178 bytes} [Fri May 27 15:17:04 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 27 15:17:04.942983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3815733f-a258-4d47-bd68-3b3bc8e808fd tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:04.955070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3815733f-a258-4d47-bd68-3b3bc8e808fd tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:04.972936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3815733f-a258-4d47-bd68-3b3bc8e808fd tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:04.973671 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3815733f-a258-4d47-bd68-3b3bc8e808fd tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:04.974624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3815733f-a258-4d47-bd68-3b3bc8e808fd tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:04.975186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3815733f-a258-4d47-bd68-3b3bc8e808fd tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:05.028495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3815733f-a258-4d47-bd68-3b3bc8e808fd tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:17:05.133727 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3815733f-a258-4d47-bd68-3b3bc8e808fd tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da" status: 204 len: 0 microversion: 2.1 time: 0.195467 May 27 15:17:05.137875 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2244/4472] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:17:04 2022] DELETE /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:17:05.146752 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-55031f4c-de8c-4195-81dd-91d357de70cc tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:05.147635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-55031f4c-de8c-4195-81dd-91d357de70cc tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:05.164543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55031f4c-de8c-4195-81dd-91d357de70cc tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:05.165351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55031f4c-de8c-4195-81dd-91d357de70cc tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:05.166354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55031f4c-de8c-4195-81dd-91d357de70cc tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:05.167273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55031f4c-de8c-4195-81dd-91d357de70cc tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:05.405995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-6ef7fbb7-b0f6-4a3d-81bb-ae9c9619dff6 req-9e126e94-33b2-4cd9-8878-1fde1afc0f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae7e4fc8-75b6-4e3f-9fca-7e5920957283", "name": "network-vif-deleted", "tag": "89fb6ad5-bc61-4f1c-b96b-4295cadf203e"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:05.435972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:05.443025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6ef7fbb7-b0f6-4a3d-81bb-ae9c9619dff6 req-9e126e94-33b2-4cd9-8878-1fde1afc0f21 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:05.444541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6ef7fbb7-b0f6-4a3d-81bb-ae9c9619dff6 req-9e126e94-33b2-4cd9-8878-1fde1afc0f21 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:05.476965 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-6ef7fbb7-b0f6-4a3d-81bb-ae9c9619dff6 req-9e126e94-33b2-4cd9-8878-1fde1afc0f21 service nova] Creating event network-vif-deleted:89fb6ad5-bc61-4f1c-b96b-4295cadf203e for instance ae7e4fc8-75b6-4e3f-9fca-7e5920957283 on n-h1-843621-1 May 27 15:17:05.491292 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-6ef7fbb7-b0f6-4a3d-81bb-ae9c9619dff6 req-9e126e94-33b2-4cd9-8878-1fde1afc0f21 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089670 May 27 15:17:05.492043 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2245/4473] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:05.505238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5d68c05d-8602-49dc-a209-9ba4bd29b77a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:05.508527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5d68c05d-8602-49dc-a209-9ba4bd29b77a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:05.522882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d68c05d-8602-49dc-a209-9ba4bd29b77a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:05.525452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d68c05d-8602-49dc-a209-9ba4bd29b77a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:05.528573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d68c05d-8602-49dc-a209-9ba4bd29b77a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:05.529372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d68c05d-8602-49dc-a209-9ba4bd29b77a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:05.704968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-55031f4c-de8c-4195-81dd-91d357de70cc tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:05.715929 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-55031f4c-de8c-4195-81dd-91d357de70cc tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da" status: 200 len: 1468 microversion: 2.1 time: 0.576711 May 27 15:17:05.716874 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2229/4474] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:05 2022] GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da => generated 1468 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:05.752350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6b4ed3b8-dbf1-4456-a3c4-5d6a70f0e78a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:05.753017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6b4ed3b8-dbf1-4456-a3c4-5d6a70f0e78a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:05.770837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b4ed3b8-dbf1-4456-a3c4-5d6a70f0e78a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:05.771313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b4ed3b8-dbf1-4456-a3c4-5d6a70f0e78a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:05.772123 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b4ed3b8-dbf1-4456-a3c4-5d6a70f0e78a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:05.772560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b4ed3b8-dbf1-4456-a3c4-5d6a70f0e78a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:05.885520 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b4ed3b8-dbf1-4456-a3c4-5d6a70f0e78a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:05.885987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b4ed3b8-dbf1-4456-a3c4-5d6a70f0e78a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:05.886455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-6b4ed3b8-dbf1-4456-a3c4-5d6a70f0e78a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lazy-loading 'fault' on Instance uuid ae7e4fc8-75b6-4e3f-9fca-7e5920957283 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:17:05.903286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5d68c05d-8602-49dc-a209-9ba4bd29b77a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:05.921247 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5d68c05d-8602-49dc-a209-9ba4bd29b77a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 200 len: 1367 microversion: 2.1 time: 0.425206 May 27 15:17:05.924654 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2246/4475] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:05 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 1367 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:06.018950 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6b4ed3b8-dbf1-4456-a3c4-5d6a70f0e78a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:06.033290 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6b4ed3b8-dbf1-4456-a3c4-5d6a70f0e78a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 200 len: 1335 microversion: 2.1 time: 0.281132 May 27 15:17:06.034329 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2230/4476] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:05 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 1335 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:06.733733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e93c13ee-3991-4865-8e95-a4201e50cc3f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:06.735615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e93c13ee-3991-4865-8e95-a4201e50cc3f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:06.748633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e93c13ee-3991-4865-8e95-a4201e50cc3f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:06.752639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e93c13ee-3991-4865-8e95-a4201e50cc3f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:06.753751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e93c13ee-3991-4865-8e95-a4201e50cc3f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:06.755871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e93c13ee-3991-4865-8e95-a4201e50cc3f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:06.945291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-962d3790-12f3-48e2-8c7e-f37a813ca88d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:06.948762 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-962d3790-12f3-48e2-8c7e-f37a813ca88d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:06.989734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-962d3790-12f3-48e2-8c7e-f37a813ca88d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:06.990387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-962d3790-12f3-48e2-8c7e-f37a813ca88d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:06.992270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-962d3790-12f3-48e2-8c7e-f37a813ca88d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:06.992974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-962d3790-12f3-48e2-8c7e-f37a813ca88d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:07.103496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e93c13ee-3991-4865-8e95-a4201e50cc3f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:07.115046 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e93c13ee-3991-4865-8e95-a4201e50cc3f tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da" status: 200 len: 1468 microversion: 2.1 time: 0.384293 May 27 15:17:07.117006 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2247/4477] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:06 2022] GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da => generated 1468 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:07.121908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ff1ed118-8bdf-4ab2-9ddc-f27c04e90d63 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:07.122834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ff1ed118-8bdf-4ab2-9ddc-f27c04e90d63 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: ae7e4fc8-75b6-4e3f-9fca-7e5920957283] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:07.143921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff1ed118-8bdf-4ab2-9ddc-f27c04e90d63 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:07.144377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff1ed118-8bdf-4ab2-9ddc-f27c04e90d63 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:07.145187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff1ed118-8bdf-4ab2-9ddc-f27c04e90d63 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:07.145632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff1ed118-8bdf-4ab2-9ddc-f27c04e90d63 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:07.203306 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-ff1ed118-8bdf-4ab2-9ddc-f27c04e90d63 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] HTTP exception thrown: Instance ae7e4fc8-75b6-4e3f-9fca-7e5920957283 could not be found. May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ff1ed118-8bdf-4ab2-9ddc-f27c04e90d63 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Request method failure captured: May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 HTTP/1.1 May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOnNcWUaU6oQTw40A1oZOI-6OFKZaukve4P5LqW1FpCc9yhaxuLnjuKFUwlZoi0CeEpz5akQjaT-fGwv01A8fNadXXg4nlnoB_yvoYpc3lVED0AfYG3-niNxm_AITH-UuchLUVsnXh3asdpL1aml75HbLXXqw5pajtYuIua7x_Sa4qg May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1f6efd5b16e5450d9eb9b454d05a775a May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1f6efd5b16e5450d9eb9b454d05a775a", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1f6efd5b16e5450d9eb9b454d05a775a May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerRescueNegativeTestJSON-1538927199-project May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 645379b3a21548d8a4f4d6425b61319f May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1538927199-project May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance ae7e4fc8-75b6-4e3f-9fca-7e5920957283 could not be found. May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'ae7e4fc8-75b6-4e3f-9fca-7e5920957283'} May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae7e4fc8-75b6-4e3f-9fca-7e5920957283 could not be found. May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae7e4fc8-75b6-4e3f-9fca-7e5920957283 could not be found. May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:07.205570 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:07.212759 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:07.212759 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:07.212759 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:07.212759 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:07.212759 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:17:07.212759 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:17:07.212759 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae7e4fc8-75b6-4e3f-9fca-7e5920957283 could not be found. May 27 15:17:07.212759 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:07.220425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ff1ed118-8bdf-4ab2-9ddc-f27c04e90d63 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Returning 404 to user: Instance ae7e4fc8-75b6-4e3f-9fca-7e5920957283 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:07.222110 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ff1ed118-8bdf-4ab2-9ddc-f27c04e90d63 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283" status: 404 len: 111 microversion: 2.1 time: 0.103687 May 27 15:17:07.223989 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2248/4478] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:07 2022] GET /compute/v2.1/servers/ae7e4fc8-75b6-4e3f-9fca-7e5920957283 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:17:07.243860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b531da4e-5f94-4a75-95ba-6f201acaded5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '.version_select at 0x7fc775c13ca0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:07.295787 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b531da4e-5f94-4a75-95ba-6f201acaded5 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1014226516" status: 202 len: 0 microversion: 2.1 time: 0.060402 May 27 15:17:07.301901 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2249/4479] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 27 15:17:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1014226516 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:17:07.616217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-962d3790-12f3-48e2-8c7e-f37a813ca88d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:07.630297 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-962d3790-12f3-48e2-8c7e-f37a813ca88d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 200 len: 1367 microversion: 2.1 time: 0.693718 May 27 15:17:07.632656 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2231/4480] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:06 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 1367 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:08.135529 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1efad12a-cc1a-4ecf-bce4-9500f14ce79a tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:08.137680 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1efad12a-cc1a-4ecf-bce4-9500f14ce79a tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:08.157268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1efad12a-cc1a-4ecf-bce4-9500f14ce79a tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:08.161115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1efad12a-cc1a-4ecf-bce4-9500f14ce79a tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:08.162242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1efad12a-cc1a-4ecf-bce4-9500f14ce79a tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:08.162915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1efad12a-cc1a-4ecf-bce4-9500f14ce79a tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:08.230947 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-9303eea0-ba44-4edd-bc28-9b947928e6d6 req-213e6bdb-fe71-41f8-a547-52ab152bf231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf51b0d-7630-4588-bae9-e50accb2d1da", "name": "network-vif-deleted", "tag": "cfe4b2b8-979e-4e68-aae5-ec9bc705186d"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:08.257672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9303eea0-ba44-4edd-bc28-9b947928e6d6 req-213e6bdb-fe71-41f8-a547-52ab152bf231 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:08.258140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9303eea0-ba44-4edd-bc28-9b947928e6d6 req-213e6bdb-fe71-41f8-a547-52ab152bf231 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:08.298400 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-9303eea0-ba44-4edd-bc28-9b947928e6d6 req-213e6bdb-fe71-41f8-a547-52ab152bf231 service nova] Creating event network-vif-deleted:cfe4b2b8-979e-4e68-aae5-ec9bc705186d for instance bdf51b0d-7630-4588-bae9-e50accb2d1da on n-h2-843621-1 May 27 15:17:08.322308 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-9303eea0-ba44-4edd-bc28-9b947928e6d6 req-213e6bdb-fe71-41f8-a547-52ab152bf231 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095443 May 27 15:17:08.327999 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2232/4481] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:08.366020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1efad12a-cc1a-4ecf-bce4-9500f14ce79a tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:08.389644 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1efad12a-cc1a-4ecf-bce4-9500f14ce79a tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da" status: 200 len: 1426 microversion: 2.1 time: 0.261227 May 27 15:17:08.399073 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2250/4482] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:08 2022] GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da => generated 1426 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:08.655491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5da28c04-1259-498c-90dd-dc8485e6c04a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:08.656295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5da28c04-1259-498c-90dd-dc8485e6c04a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:08.673904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5da28c04-1259-498c-90dd-dc8485e6c04a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:08.674445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5da28c04-1259-498c-90dd-dc8485e6c04a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:08.675290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5da28c04-1259-498c-90dd-dc8485e6c04a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:08.675745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5da28c04-1259-498c-90dd-dc8485e6c04a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.052490 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5da28c04-1259-498c-90dd-dc8485e6c04a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:09.066947 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5da28c04-1259-498c-90dd-dc8485e6c04a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 200 len: 1367 microversion: 2.1 time: 0.416195 May 27 15:17:09.087873 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2233/4483] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:08 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:09.230621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-45b9d13d-1751-491b-837f-37870949832a req-b435c964-36c8-4f18-bb1d-6df3a01c462f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a07558-123a-448c-ad41-1da4feffb611", "name": "network-vif-plugged", "status": "completed", "tag": "d8c8343a-a199-480a-bb57-b0ac1047f111"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:09.265594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-45b9d13d-1751-491b-837f-37870949832a req-b435c964-36c8-4f18-bb1d-6df3a01c462f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.266602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-45b9d13d-1751-491b-837f-37870949832a req-b435c964-36c8-4f18-bb1d-6df3a01c462f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.311038 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-45b9d13d-1751-491b-837f-37870949832a req-b435c964-36c8-4f18-bb1d-6df3a01c462f service nova] Creating event network-vif-plugged:d8c8343a-a199-480a-bb57-b0ac1047f111 for instance 04a07558-123a-448c-ad41-1da4feffb611 on n-h2-843621-1 May 27 15:17:09.325461 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-45b9d13d-1751-491b-837f-37870949832a req-b435c964-36c8-4f18-bb1d-6df3a01c462f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111150 May 27 15:17:09.327479 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2251/4484] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:09.422069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-464c48ab-fd88-4cd8-a326-ae715f819766 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:09.424196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-464c48ab-fd88-4cd8-a326-ae715f819766 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: bdf51b0d-7630-4588-bae9-e50accb2d1da] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:09.447539 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-464c48ab-fd88-4cd8-a326-ae715f819766 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.450566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-464c48ab-fd88-4cd8-a326-ae715f819766 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.452798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-464c48ab-fd88-4cd8-a326-ae715f819766 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.456580 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-464c48ab-fd88-4cd8-a326-ae715f819766 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.503598 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-464c48ab-fd88-4cd8-a326-ae715f819766 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] HTTP exception thrown: Instance bdf51b0d-7630-4588-bae9-e50accb2d1da could not be found. May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-464c48ab-fd88-4cd8-a326-ae715f819766 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Request method failure captured: May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da HTTP/1.1 May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOtJ3NP0Tziq_Ysyvk7-AwJlH_8J9fhwk9P6IBRkZVHGVyENkVjrNEO_7fZwXoYaglAZEai5HFknIPWYafZLGO08hiSre8YqdP2vbzY8B4b6enge7rAdgvY-hYFhh75eRXitPp3-mFkiFLfCpjot9bisHbcwMHAi4iZM3PtWCMZLw4g May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 6ee6b3dae0924634a0d0d319ac0be692 May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-270049799 May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6ee6b3dae0924634a0d0d319ac0be692"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6ee6b3dae0924634a0d0d319ac0be692"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6ee6b3dae0924634a0d0d319ac0be692"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6ee6b3dae0924634a0d0d319ac0be692", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersAdminNegativeTestJSON-270049799 May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 6ee6b3dae0924634a0d0d319ac0be692 May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-270049799 May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersAdminNegativeTestJSON-270049799-project May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 693e50b119084e849e6a701c0d1f8037 May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersAdminNegativeTestJSON-270049799-project May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance bdf51b0d-7630-4588-bae9-e50accb2d1da could not be found. May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'bdf51b0d-7630-4588-bae9-e50accb2d1da'} May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf51b0d-7630-4588-bae9-e50accb2d1da could not be found. May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf51b0d-7630-4588-bae9-e50accb2d1da could not be found. May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:09.515521 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:09.522836 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:09.522836 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:09.522836 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:09.522836 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:17:09.522836 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:17:09.522836 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf51b0d-7630-4588-bae9-e50accb2d1da could not be found. May 27 15:17:09.522836 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:09.522836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-464c48ab-fd88-4cd8-a326-ae715f819766 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Returning 404 to user: Instance bdf51b0d-7630-4588-bae9-e50accb2d1da could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:09.529742 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-464c48ab-fd88-4cd8-a326-ae715f819766 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da" status: 404 len: 111 microversion: 2.1 time: 0.111945 May 27 15:17:09.530479 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2234/4485] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:09 2022] GET /compute/v2.1/servers/bdf51b0d-7630-4588-bae9-e50accb2d1da => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:17:09.539942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0b96ca06-8d88-4958-a2cd-1c0685a2c1ea tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:09.541316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0b96ca06-8d88-4958-a2cd-1c0685a2c1ea tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:09.549041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b96ca06-8d88-4958-a2cd-1c0685a2c1ea tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.549934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b96ca06-8d88-4958-a2cd-1c0685a2c1ea tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.551276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b96ca06-8d88-4958-a2cd-1c0685a2c1ea tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.552098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b96ca06-8d88-4958-a2cd-1c0685a2c1ea tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.584894 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0b96ca06-8d88-4958-a2cd-1c0685a2c1ea tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:17:09.677255 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0b96ca06-8d88-4958-a2cd-1c0685a2c1ea tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca" status: 204 len: 0 microversion: 2.1 time: 0.141913 May 27 15:17:09.687179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1a93409d-7333-4315-866a-9f8dfdf569d5 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:09.688940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1a93409d-7333-4315-866a-9f8dfdf569d5 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:09.692870 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2252/4486] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:17:09 2022] DELETE /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:17:09.697470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a93409d-7333-4315-866a-9f8dfdf569d5 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.698208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a93409d-7333-4315-866a-9f8dfdf569d5 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.699487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a93409d-7333-4315-866a-9f8dfdf569d5 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.700157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a93409d-7333-4315-866a-9f8dfdf569d5 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.918842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1a93409d-7333-4315-866a-9f8dfdf569d5 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:09.931463 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1a93409d-7333-4315-866a-9f8dfdf569d5 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca" status: 200 len: 1477 microversion: 2.1 time: 0.248428 May 27 15:17:09.943857 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2235/4487] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:09 2022] GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca => generated 1477 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:10.095951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f84e03b3-59ca-4df7-9a0a-54efb8d9b54c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:10.100417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f84e03b3-59ca-4df7-9a0a-54efb8d9b54c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:10.114168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f84e03b3-59ca-4df7-9a0a-54efb8d9b54c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.117623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f84e03b3-59ca-4df7-9a0a-54efb8d9b54c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:10.118645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f84e03b3-59ca-4df7-9a0a-54efb8d9b54c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.119114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f84e03b3-59ca-4df7-9a0a-54efb8d9b54c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:10.291984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f84e03b3-59ca-4df7-9a0a-54efb8d9b54c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:10.301282 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f84e03b3-59ca-4df7-9a0a-54efb8d9b54c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 200 len: 1367 microversion: 2.1 time: 0.212118 May 27 15:17:10.303783 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2253/4488] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:10 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:10.949385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5cd56edc-1154-48f5-811a-096f47f925c3 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:10.950005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5cd56edc-1154-48f5-811a-096f47f925c3 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:10.966363 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5cd56edc-1154-48f5-811a-096f47f925c3 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.966831 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5cd56edc-1154-48f5-811a-096f47f925c3 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:10.971767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5cd56edc-1154-48f5-811a-096f47f925c3 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.972326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5cd56edc-1154-48f5-811a-096f47f925c3 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:11.320532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b173e164-2b03-468e-9454-4be8682fcaff tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:11.321391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b173e164-2b03-468e-9454-4be8682fcaff tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:11.335831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b173e164-2b03-468e-9454-4be8682fcaff tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:11.336315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b173e164-2b03-468e-9454-4be8682fcaff tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:11.337172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b173e164-2b03-468e-9454-4be8682fcaff tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:11.337622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b173e164-2b03-468e-9454-4be8682fcaff tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:11.447115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5cd56edc-1154-48f5-811a-096f47f925c3 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:11.462569 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5cd56edc-1154-48f5-811a-096f47f925c3 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca" status: 200 len: 1477 microversion: 2.1 time: 0.515670 May 27 15:17:11.464948 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2236/4489] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:10 2022] GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca => generated 1477 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:11.633304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b173e164-2b03-468e-9454-4be8682fcaff tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:11.642651 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b173e164-2b03-468e-9454-4be8682fcaff tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 200 len: 1556 microversion: 2.1 time: 0.326374 May 27 15:17:11.653552 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2254/4490] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:11 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 1556 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:11.667099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4e40a5c3-a4db-4bcc-801c-ae13d1f5b299 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:11.668025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4e40a5c3-a4db-4bcc-801c-ae13d1f5b299 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:11.679505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e40a5c3-a4db-4bcc-801c-ae13d1f5b299 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:11.681389 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e40a5c3-a4db-4bcc-801c-ae13d1f5b299 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:11.684091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e40a5c3-a4db-4bcc-801c-ae13d1f5b299 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:11.684946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e40a5c3-a4db-4bcc-801c-ae13d1f5b299 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:11.806940 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4e40a5c3-a4db-4bcc-801c-ae13d1f5b299 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.145699 May 27 15:17:11.807547 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2237/4491] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 15:17:11 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:12.253505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d6172ff3-8c5f-4c16-a1bd-4582359226f0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-862344176", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "602684c4-1c25-42cc-82f2-08e23e922db6"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:12.322796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-d6172ff3-8c5f-4c16-a1bd-4582359226f0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] validate_networks() for [('602684c4-1c25-42cc-82f2-08e23e922db6', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:17:12.488277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4c2c43df-1dd4-4fd1-8395-083cba787e66 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:12.489214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4c2c43df-1dd4-4fd1-8395-083cba787e66 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:12.507002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c2c43df-1dd4-4fd1-8395-083cba787e66 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:12.507629 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c2c43df-1dd4-4fd1-8395-083cba787e66 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:12.517663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c2c43df-1dd4-4fd1-8395-083cba787e66 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:12.519107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c2c43df-1dd4-4fd1-8395-083cba787e66 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:13.192362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4c2c43df-1dd4-4fd1-8395-083cba787e66 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '693e50b119084e849e6a701c0d1f8037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee6b3dae0924634a0d0d319ac0be692', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:13.198963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:13.209411 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4c2c43df-1dd4-4fd1-8395-083cba787e66 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca" status: 200 len: 1435 microversion: 2.1 time: 0.726325 May 27 15:17:13.221779 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2238/4492] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:12 2022] GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca => generated 1435 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:13.221779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-1227bf48-d657-495f-b467-b97006799a4a req-ab226fbd-aa97-41b6-aa46-46b14ee09eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e3ab31c-07b1-4bb7-9999-47ada1e50bca", "name": "network-vif-deleted", "tag": "a84b7bca-8c79-4ff2-a56b-b21b6e7fb298"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:13.239625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-1227bf48-d657-495f-b467-b97006799a4a req-ab226fbd-aa97-41b6-aa46-46b14ee09eee service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:13.248702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-1227bf48-d657-495f-b467-b97006799a4a req-ab226fbd-aa97-41b6-aa46-46b14ee09eee service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:13.284627 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-1227bf48-d657-495f-b467-b97006799a4a req-ab226fbd-aa97-41b6-aa46-46b14ee09eee service nova] Creating event network-vif-deleted:a84b7bca-8c79-4ff2-a56b-b21b6e7fb298 for instance 0e3ab31c-07b1-4bb7-9999-47ada1e50bca on n-h1-843621-1 May 27 15:17:13.294265 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-1227bf48-d657-495f-b467-b97006799a4a req-ab226fbd-aa97-41b6-aa46-46b14ee09eee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082452 May 27 15:17:13.305308 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2239/4493] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:14.231056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3cc6fa69-63e4-414e-a768-6ab596dbbc47 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:14.231709 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3cc6fa69-63e4-414e-a768-6ab596dbbc47 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] [instance: 0e3ab31c-07b1-4bb7-9999-47ada1e50bca] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:14.252833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3cc6fa69-63e4-414e-a768-6ab596dbbc47 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:14.253692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3cc6fa69-63e4-414e-a768-6ab596dbbc47 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:14.255418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3cc6fa69-63e4-414e-a768-6ab596dbbc47 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:14.258653 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3cc6fa69-63e4-414e-a768-6ab596dbbc47 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:14.326369 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-3cc6fa69-63e4-414e-a768-6ab596dbbc47 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] HTTP exception thrown: Instance 0e3ab31c-07b1-4bb7-9999-47ada1e50bca could not be found. May 27 15:17:14.337352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-d6172ff3-8c5f-4c16-a1bd-4582359226f0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:17:14.338749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-d6172ff3-8c5f-4c16-a1bd-4582359226f0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3cc6fa69-63e4-414e-a768-6ab596dbbc47 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Request method failure captured: May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca HTTP/1.1 May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOtJ3NP0Tziq_Ysyvk7-AwJlH_8J9fhwk9P6IBRkZVHGVyENkVjrNEO_7fZwXoYaglAZEai5HFknIPWYafZLGO08hiSre8YqdP2vbzY8B4b6enge7rAdgvY-hYFhh75eRXitPp3-mFkiFLfCpjot9bisHbcwMHAi4iZM3PtWCMZLw4g May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 6ee6b3dae0924634a0d0d319ac0be692 May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-270049799 May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6ee6b3dae0924634a0d0d319ac0be692"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6ee6b3dae0924634a0d0d319ac0be692"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6ee6b3dae0924634a0d0d319ac0be692"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6ee6b3dae0924634a0d0d319ac0be692", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersAdminNegativeTestJSON-270049799 May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 6ee6b3dae0924634a0d0d319ac0be692 May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-270049799 May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersAdminNegativeTestJSON-270049799-project May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 693e50b119084e849e6a701c0d1f8037 May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersAdminNegativeTestJSON-270049799-project May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 0e3ab31c-07b1-4bb7-9999-47ada1e50bca could not be found. May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '0e3ab31c-07b1-4bb7-9999-47ada1e50bca'} May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e3ab31c-07b1-4bb7-9999-47ada1e50bca could not be found. May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e3ab31c-07b1-4bb7-9999-47ada1e50bca could not be found. May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:14.338962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:14.344564 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:14.344564 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:14.344564 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:14.344564 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:17:14.344564 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:17:14.344564 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e3ab31c-07b1-4bb7-9999-47ada1e50bca could not be found. May 27 15:17:14.344564 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:14.344564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3cc6fa69-63e4-414e-a768-6ab596dbbc47 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] Returning 404 to user: Instance 0e3ab31c-07b1-4bb7-9999-47ada1e50bca could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:14.344564 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3cc6fa69-63e4-414e-a768-6ab596dbbc47 tempest-ServersAdminNegativeTestJSON-270049799 tempest-ServersAdminNegativeTestJSON-270049799-project] 10.222.0.13 "GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca" status: 404 len: 111 microversion: 2.1 time: 0.116701 May 27 15:17:14.346136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-d6172ff3-8c5f-4c16-a1bd-4582359226f0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:17:14.353311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-d6172ff3-8c5f-4c16-a1bd-4582359226f0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:17:14.354757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-d6172ff3-8c5f-4c16-a1bd-4582359226f0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:17:14.356073 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2240/4494] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:14 2022] GET /compute/v2.1/servers/0e3ab31c-07b1-4bb7-9999-47ada1e50bca => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:17:14.407796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6172ff3-8c5f-4c16-a1bd-4582359226f0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:14.408254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6172ff3-8c5f-4c16-a1bd-4582359226f0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:14.423883 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6172ff3-8c5f-4c16-a1bd-4582359226f0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:14.424380 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6172ff3-8c5f-4c16-a1bd-4582359226f0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:14.481556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-d6172ff3-8c5f-4c16-a1bd-4582359226f0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Getting quotas for project a7353d23e19b45a5b5297d04f7ef71cb. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:17:14.496718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-d6172ff3-8c5f-4c16-a1bd-4582359226f0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Getting quotas for user 572426dd79d94a91bba9cd86d6542042 and project a7353d23e19b45a5b5297d04f7ef71cb. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:17:14.533291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d6172ff3-8c5f-4c16-a1bd-4582359226f0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Going to run 2 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:17:14.541438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d6172ff3-8c5f-4c16-a1bd-4582359226f0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 1ad6dd32-9427-4232-bd27-70a65f1ee2f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:17:14.637057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d6172ff3-8c5f-4c16-a1bd-4582359226f0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 36148c88-bef9-49fc-baf8-f7980cf1848d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=1ad6dd32-9427-4232-bd27-70a65f1ee2f4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:17:14.778448 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d6172ff3-8c5f-4c16-a1bd-4582359226f0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.780673 May 27 15:17:14.786259 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2255/4495] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:17:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:17:14.791556 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ba86afce-cd5f-47a3-a38a-4b0075655945 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:14.797155 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ba86afce-cd5f-47a3-a38a-4b0075655945 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:14.801746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ba86afce-cd5f-47a3-a38a-4b0075655945 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Searching by: {'deleted': False, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:17:14.886084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba86afce-cd5f-47a3-a38a-4b0075655945 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:14.886548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba86afce-cd5f-47a3-a38a-4b0075655945 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:14.887364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba86afce-cd5f-47a3-a38a-4b0075655945 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:14.887806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba86afce-cd5f-47a3-a38a-4b0075655945 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:14.942673 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ba86afce-cd5f-47a3-a38a-4b0075655945 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.154973 May 27 15:17:14.948605 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2241/4496] 10.222.0.13 () {58 vars in 1124 bytes} [Fri May 27 15:17:14 2022] GET /compute/v2.1/servers => generated 675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:17:14.954239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d5f5a386-c293-4c45-93cf-9bd4c030aba4 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:14.955306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d5f5a386-c293-4c45-93cf-9bd4c030aba4 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 36148c88-bef9-49fc-baf8-f7980cf1848d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:15.245940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d5f5a386-c293-4c45-93cf-9bd4c030aba4 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:15.256129 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d5f5a386-c293-4c45-93cf-9bd4c030aba4 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d" status: 200 len: 1219 microversion: 2.1 time: 0.306097 May 27 15:17:15.283177 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2256/4497] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:14 2022] GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d => generated 1219 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:15.321538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-32a5a295-019d-4992-a609-2e65098785fa req-c25a1f0d-6d42-4570-ac37-3c017a9d912c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a07558-123a-448c-ad41-1da4feffb611", "tag": "d8c8343a-a199-480a-bb57-b0ac1047f111"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:15.340177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-32a5a295-019d-4992-a609-2e65098785fa req-c25a1f0d-6d42-4570-ac37-3c017a9d912c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:15.340631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-32a5a295-019d-4992-a609-2e65098785fa req-c25a1f0d-6d42-4570-ac37-3c017a9d912c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:15.399123 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-32a5a295-019d-4992-a609-2e65098785fa req-c25a1f0d-6d42-4570-ac37-3c017a9d912c service nova] Creating event network-changed:d8c8343a-a199-480a-bb57-b0ac1047f111 for instance 04a07558-123a-448c-ad41-1da4feffb611 on n-h2-843621-1 May 27 15:17:15.423391 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-32a5a295-019d-4992-a609-2e65098785fa req-c25a1f0d-6d42-4570-ac37-3c017a9d912c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105442 May 27 15:17:15.436446 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2242/4498] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:16.274324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8a35a1f5-ca24-4e08-9053-fc09e1c4d368 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:16.277715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8a35a1f5-ca24-4e08-9053-fc09e1c4d368 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 36148c88-bef9-49fc-baf8-f7980cf1848d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:16.468897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8a35a1f5-ca24-4e08-9053-fc09e1c4d368 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:16.478739 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8a35a1f5-ca24-4e08-9053-fc09e1c4d368 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d" status: 200 len: 1219 microversion: 2.1 time: 0.208343 May 27 15:17:16.480772 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2257/4499] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:16 2022] GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d => generated 1219 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:17.500419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c3e571fa-23f4-42a1-9229-f9449befe5b7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:17.502296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c3e571fa-23f4-42a1-9229-f9449befe5b7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 36148c88-bef9-49fc-baf8-f7980cf1848d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:17.507406 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:17.530268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3e571fa-23f4-42a1-9229-f9449befe5b7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:17.536470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3e571fa-23f4-42a1-9229-f9449befe5b7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:17.539243 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3e571fa-23f4-42a1-9229-f9449befe5b7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:17.543779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3e571fa-23f4-42a1-9229-f9449befe5b7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:17.848335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c3e571fa-23f4-42a1-9229-f9449befe5b7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:17.865506 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c3e571fa-23f4-42a1-9229-f9449befe5b7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d" status: 200 len: 1271 microversion: 2.1 time: 0.369547 May 27 15:17:17.882517 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2243/4500] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:17 2022] GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d => generated 1271 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:18.887453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2eb47e1d-9141-4d8a-b775-a3a0a460fffb tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:18.890363 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2eb47e1d-9141-4d8a-b775-a3a0a460fffb tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 36148c88-bef9-49fc-baf8-f7980cf1848d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:18.899512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2eb47e1d-9141-4d8a-b775-a3a0a460fffb tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:18.907124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2eb47e1d-9141-4d8a-b775-a3a0a460fffb tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:18.910487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2eb47e1d-9141-4d8a-b775-a3a0a460fffb tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:18.912620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2eb47e1d-9141-4d8a-b775-a3a0a460fffb tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:19.027525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2eb47e1d-9141-4d8a-b775-a3a0a460fffb tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:19.041120 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2eb47e1d-9141-4d8a-b775-a3a0a460fffb tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d" status: 200 len: 1277 microversion: 2.1 time: 0.157309 May 27 15:17:19.047075 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2258/4501] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:18 2022] GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:20.066915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-958ccc1c-db64-4321-bb63-950f8684ef2e tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:20.067784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-958ccc1c-db64-4321-bb63-950f8684ef2e tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 36148c88-bef9-49fc-baf8-f7980cf1848d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:20.083382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-958ccc1c-db64-4321-bb63-950f8684ef2e tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:20.085017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-958ccc1c-db64-4321-bb63-950f8684ef2e tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:20.086952 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-958ccc1c-db64-4321-bb63-950f8684ef2e tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:20.088398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-958ccc1c-db64-4321-bb63-950f8684ef2e tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:20.743196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-958ccc1c-db64-4321-bb63-950f8684ef2e tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:20.761185 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-958ccc1c-db64-4321-bb63-950f8684ef2e tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d" status: 200 len: 1319 microversion: 2.1 time: 0.699209 May 27 15:17:20.772209 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2244/4502] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:20 2022] GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d => generated 1319 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:21.778432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3b8e2dff-c07b-444d-924b-ae94bc3d49f7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:21.779915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3b8e2dff-c07b-444d-924b-ae94bc3d49f7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 36148c88-bef9-49fc-baf8-f7980cf1848d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:21.793077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b8e2dff-c07b-444d-924b-ae94bc3d49f7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:21.795589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b8e2dff-c07b-444d-924b-ae94bc3d49f7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:21.796421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b8e2dff-c07b-444d-924b-ae94bc3d49f7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:21.797813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b8e2dff-c07b-444d-924b-ae94bc3d49f7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:22.514895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3b8e2dff-c07b-444d-924b-ae94bc3d49f7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:22.533803 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3b8e2dff-c07b-444d-924b-ae94bc3d49f7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d" status: 200 len: 1319 microversion: 2.1 time: 0.759317 May 27 15:17:22.535579 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2259/4503] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:21 2022] GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d => generated 1319 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:22.642183 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-16e4b12d-4bca-40c6-97df-6408d670daab req-50e3a971-9690-4505-8c2f-b83ac915d6fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ad6dd32-9427-4232-bd27-70a65f1ee2f4", "tag": "2bdba81d-cf41-417e-8765-98c7e2ef0f33"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:22.688500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-16e4b12d-4bca-40c6-97df-6408d670daab req-50e3a971-9690-4505-8c2f-b83ac915d6fa service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:22.693435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-16e4b12d-4bca-40c6-97df-6408d670daab req-50e3a971-9690-4505-8c2f-b83ac915d6fa service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:22.731951 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-16e4b12d-4bca-40c6-97df-6408d670daab req-50e3a971-9690-4505-8c2f-b83ac915d6fa service nova] Creating event network-changed:2bdba81d-cf41-417e-8765-98c7e2ef0f33 for instance 1ad6dd32-9427-4232-bd27-70a65f1ee2f4 on n-h2-843621-1 May 27 15:17:22.757996 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-16e4b12d-4bca-40c6-97df-6408d670daab req-50e3a971-9690-4505-8c2f-b83ac915d6fa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121398 May 27 15:17:22.761910 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2245/4504] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:23.553137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1c999ca9-18d1-4396-973e-4651cff788d1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:23.555095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1c999ca9-18d1-4396-973e-4651cff788d1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 36148c88-bef9-49fc-baf8-f7980cf1848d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:23.585650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c999ca9-18d1-4396-973e-4651cff788d1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:23.588502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c999ca9-18d1-4396-973e-4651cff788d1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:23.593339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c999ca9-18d1-4396-973e-4651cff788d1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:23.597248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c999ca9-18d1-4396-973e-4651cff788d1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:24.163956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1c999ca9-18d1-4396-973e-4651cff788d1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:24.204371 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1c999ca9-18d1-4396-973e-4651cff788d1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d" status: 200 len: 1319 microversion: 2.1 time: 0.647603 May 27 15:17:24.205068 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2260/4505] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:23 2022] GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d => generated 1319 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:24.920280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-48c16be8-2a74-424f-ba5b-45f11844b71f req-73751e6b-3b8f-41cf-8514-8021578c0b70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36148c88-bef9-49fc-baf8-f7980cf1848d", "tag": "4f3fc4d7-2998-46f1-9adc-43ea1a8f7d2a"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:24.946571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:24.992401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-48c16be8-2a74-424f-ba5b-45f11844b71f req-73751e6b-3b8f-41cf-8514-8021578c0b70 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:24.994351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-48c16be8-2a74-424f-ba5b-45f11844b71f req-73751e6b-3b8f-41cf-8514-8021578c0b70 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:25.043785 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-48c16be8-2a74-424f-ba5b-45f11844b71f req-73751e6b-3b8f-41cf-8514-8021578c0b70 service nova] Creating event network-changed:4f3fc4d7-2998-46f1-9adc-43ea1a8f7d2a for instance 36148c88-bef9-49fc-baf8-f7980cf1848d on n-h1-843621-1 May 27 15:17:25.057399 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-48c16be8-2a74-424f-ba5b-45f11844b71f req-73751e6b-3b8f-41cf-8514-8021578c0b70 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142266 May 27 15:17:25.068827 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2246/4506] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:25.218526 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:25.240053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-456c45e8-3286-40cd-a82a-5083501a4ea0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:25.242231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-456c45e8-3286-40cd-a82a-5083501a4ea0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 36148c88-bef9-49fc-baf8-f7980cf1848d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:25.264966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-456c45e8-3286-40cd-a82a-5083501a4ea0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:25.269275 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-456c45e8-3286-40cd-a82a-5083501a4ea0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:25.270651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-456c45e8-3286-40cd-a82a-5083501a4ea0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:25.272905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-456c45e8-3286-40cd-a82a-5083501a4ea0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:25.629761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-34da0ce5-bfdf-4326-b597-9a62f4837a78 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:25.631055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-34da0ce5-bfdf-4326-b597-9a62f4837a78 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:25.659090 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34da0ce5-bfdf-4326-b597-9a62f4837a78 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:25.659899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34da0ce5-bfdf-4326-b597-9a62f4837a78 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:25.660917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34da0ce5-bfdf-4326-b597-9a62f4837a78 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:25.663503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34da0ce5-bfdf-4326-b597-9a62f4837a78 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:25.883854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-34da0ce5-bfdf-4326-b597-9a62f4837a78 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lazy-loading 'services' on Instance uuid 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:17:26.102330 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-34da0ce5-bfdf-4326-b597-9a62f4837a78 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "DELETE /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376/os-volume_attachments/6346e75d-e250-4125-8b2d-be6b8c9b8b0f" status: 202 len: 0 microversion: 2.1 time: 0.479081 May 27 15:17:26.106353 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2247/4507] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 15:17:25 2022] DELETE /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376/os-volume_attachments/6346e75d-e250-4125-8b2d-be6b8c9b8b0f => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:17:26.385724 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-456c45e8-3286-40cd-a82a-5083501a4ea0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:26.399807 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-456c45e8-3286-40cd-a82a-5083501a4ea0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d" status: 200 len: 1319 microversion: 2.1 time: 1.181856 May 27 15:17:26.410366 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2261/4508] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:25 2022] GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d => generated 1319 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:27.420037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-23259fdc-9f69-444a-b6e1-89d0d837408d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:27.421396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-23259fdc-9f69-444a-b6e1-89d0d837408d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 36148c88-bef9-49fc-baf8-f7980cf1848d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:27.438585 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23259fdc-9f69-444a-b6e1-89d0d837408d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:27.439050 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23259fdc-9f69-444a-b6e1-89d0d837408d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:27.440043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23259fdc-9f69-444a-b6e1-89d0d837408d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:27.440577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23259fdc-9f69-444a-b6e1-89d0d837408d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:28.303491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-23259fdc-9f69-444a-b6e1-89d0d837408d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:28.313181 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-23259fdc-9f69-444a-b6e1-89d0d837408d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d" status: 200 len: 1319 microversion: 2.1 time: 0.897492 May 27 15:17:28.322936 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2248/4509] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:27 2022] GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d => generated 1319 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:29.205380 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-aa25716d-7b51-4624-b185-e3e040ff7c89 req-874e5b95-c041-4828-9edb-37b03da4e76e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad6dd32-9427-4232-bd27-70a65f1ee2f4", "name": "network-vif-plugged", "status": "completed", "tag": "2bdba81d-cf41-417e-8765-98c7e2ef0f33"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:29.209980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=10 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:29.225307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-aa25716d-7b51-4624-b185-e3e040ff7c89 req-874e5b95-c041-4828-9edb-37b03da4e76e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:29.228250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-aa25716d-7b51-4624-b185-e3e040ff7c89 req-874e5b95-c041-4828-9edb-37b03da4e76e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:29.279357 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-aa25716d-7b51-4624-b185-e3e040ff7c89 req-874e5b95-c041-4828-9edb-37b03da4e76e service nova] Creating event network-vif-plugged:2bdba81d-cf41-417e-8765-98c7e2ef0f33 for instance 1ad6dd32-9427-4232-bd27-70a65f1ee2f4 on n-h2-843621-1 May 27 15:17:29.301160 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-aa25716d-7b51-4624-b185-e3e040ff7c89 req-874e5b95-c041-4828-9edb-37b03da4e76e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096020 May 27 15:17:29.311479 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2262/4510] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:29.330836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b4b21799-e51a-4756-bf93-3fdc5464ea3f tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:29.332067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b4b21799-e51a-4756-bf93-3fdc5464ea3f tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 36148c88-bef9-49fc-baf8-f7980cf1848d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:29.350578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4b21799-e51a-4756-bf93-3fdc5464ea3f tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:29.355271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4b21799-e51a-4756-bf93-3fdc5464ea3f tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:29.357705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4b21799-e51a-4756-bf93-3fdc5464ea3f tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:29.368095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4b21799-e51a-4756-bf93-3fdc5464ea3f tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:29.717442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b4b21799-e51a-4756-bf93-3fdc5464ea3f tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:29.727610 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b4b21799-e51a-4756-bf93-3fdc5464ea3f tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d" status: 200 len: 1319 microversion: 2.1 time: 0.401176 May 27 15:17:29.733246 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2249/4511] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:29 2022] GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d => generated 1319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:30.751208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ae6abb8c-6eaf-4abe-9940-c86a80d84613 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:30.752582 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ae6abb8c-6eaf-4abe-9940-c86a80d84613 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 36148c88-bef9-49fc-baf8-f7980cf1848d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:30.776474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae6abb8c-6eaf-4abe-9940-c86a80d84613 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:30.776962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae6abb8c-6eaf-4abe-9940-c86a80d84613 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:30.792233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae6abb8c-6eaf-4abe-9940-c86a80d84613 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:30.792806 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae6abb8c-6eaf-4abe-9940-c86a80d84613 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:30.805772 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:31.185926 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ae6abb8c-6eaf-4abe-9940-c86a80d84613 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:31.197297 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ae6abb8c-6eaf-4abe-9940-c86a80d84613 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d" status: 200 len: 1319 microversion: 2.1 time: 0.451293 May 27 15:17:31.211008 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2263/4512] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:30 2022] GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:32.215809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-732abfbe-1a41-4aeb-b1cb-eecf7476b02b tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:32.216615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-732abfbe-1a41-4aeb-b1cb-eecf7476b02b tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 36148c88-bef9-49fc-baf8-f7980cf1848d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:32.230058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-732abfbe-1a41-4aeb-b1cb-eecf7476b02b tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:32.230602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-732abfbe-1a41-4aeb-b1cb-eecf7476b02b tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:32.231677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-732abfbe-1a41-4aeb-b1cb-eecf7476b02b tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:32.232479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-732abfbe-1a41-4aeb-b1cb-eecf7476b02b tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:32.616914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-732abfbe-1a41-4aeb-b1cb-eecf7476b02b tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:32.628292 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-732abfbe-1a41-4aeb-b1cb-eecf7476b02b tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d" status: 200 len: 1319 microversion: 2.1 time: 0.416263 May 27 15:17:32.635525 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2250/4513] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:32 2022] GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d => generated 1319 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:32.766367 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-5ae30b0e-dc17-4265-8895-aec9add4da8f req-e8aee20e-f552-40f0-830b-d204fbb9c12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36148c88-bef9-49fc-baf8-f7980cf1848d", "name": "network-vif-plugged", "status": "completed", "tag": "4f3fc4d7-2998-46f1-9adc-43ea1a8f7d2a"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:32.793786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-5ae30b0e-dc17-4265-8895-aec9add4da8f req-e8aee20e-f552-40f0-830b-d204fbb9c12b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:32.803833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-5ae30b0e-dc17-4265-8895-aec9add4da8f req-e8aee20e-f552-40f0-830b-d204fbb9c12b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:32.854598 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-5ae30b0e-dc17-4265-8895-aec9add4da8f req-e8aee20e-f552-40f0-830b-d204fbb9c12b service nova] Creating event network-vif-plugged:4f3fc4d7-2998-46f1-9adc-43ea1a8f7d2a for instance 36148c88-bef9-49fc-baf8-f7980cf1848d on n-h1-843621-1 May 27 15:17:32.926046 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-5ae30b0e-dc17-4265-8895-aec9add4da8f req-e8aee20e-f552-40f0-830b-d204fbb9c12b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163746 May 27 15:17:32.933477 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2264/4514] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:33.651560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-94f4f2ac-5e91-4632-a3a1-629a0e764a8a tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:33.652170 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-94f4f2ac-5e91-4632-a3a1-629a0e764a8a tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 36148c88-bef9-49fc-baf8-f7980cf1848d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:33.668880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94f4f2ac-5e91-4632-a3a1-629a0e764a8a tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:33.669398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94f4f2ac-5e91-4632-a3a1-629a0e764a8a tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:33.671533 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94f4f2ac-5e91-4632-a3a1-629a0e764a8a tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:33.673125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94f4f2ac-5e91-4632-a3a1-629a0e764a8a tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:33.976720 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-94f4f2ac-5e91-4632-a3a1-629a0e764a8a tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:33.990382 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-94f4f2ac-5e91-4632-a3a1-629a0e764a8a tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d" status: 200 len: 1319 microversion: 2.1 time: 0.343700 May 27 15:17:33.991412 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2251/4515] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:33 2022] GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:35.010838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1a136845-f37b-40dc-9c80-0026077e5fa2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:35.011641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1a136845-f37b-40dc-9c80-0026077e5fa2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 36148c88-bef9-49fc-baf8-f7980cf1848d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:35.038852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a136845-f37b-40dc-9c80-0026077e5fa2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:35.041479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a136845-f37b-40dc-9c80-0026077e5fa2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:35.056356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a136845-f37b-40dc-9c80-0026077e5fa2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:35.057323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a136845-f37b-40dc-9c80-0026077e5fa2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:35.748503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-427a7f96-84a1-4fe0-8e3a-7beb754678ce tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:35.749100 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-427a7f96-84a1-4fe0-8e3a-7beb754678ce tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:35.768779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-427a7f96-84a1-4fe0-8e3a-7beb754678ce tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:35.769552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-427a7f96-84a1-4fe0-8e3a-7beb754678ce tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:35.770523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-427a7f96-84a1-4fe0-8e3a-7beb754678ce tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:35.772961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-427a7f96-84a1-4fe0-8e3a-7beb754678ce tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:35.838142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-427a7f96-84a1-4fe0-8e3a-7beb754678ce tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:17:36.089430 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-427a7f96-84a1-4fe0-8e3a-7beb754678ce tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 204 len: 0 microversion: 2.1 time: 0.345590 May 27 15:17:36.090679 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2252/4516] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:17:35 2022] DELETE /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:17:36.101443 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1a136845-f37b-40dc-9c80-0026077e5fa2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:36.117566 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1a136845-f37b-40dc-9c80-0026077e5fa2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d" status: 200 len: 1319 microversion: 2.1 time: 1.113510 May 27 15:17:36.143258 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2265/4517] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:35 2022] GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d => generated 1319 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:36.157461 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d99bc26f-163a-4d8f-a85d-e918b32f658a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:36.159783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d99bc26f-163a-4d8f-a85d-e918b32f658a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:36.180436 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:36.192130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d99bc26f-163a-4d8f-a85d-e918b32f658a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:36.193046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d99bc26f-163a-4d8f-a85d-e918b32f658a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:36.197521 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d99bc26f-163a-4d8f-a85d-e918b32f658a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:36.200606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d99bc26f-163a-4d8f-a85d-e918b32f658a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:36.400023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-21e6e3cd-1623-4661-b4b1-a1b467c7734a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1847674428", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "f36d2574-5d53-4b40-8e21-3477336c8d77"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:36.486662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-21e6e3cd-1623-4661-b4b1-a1b467c7734a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] validate_networks() for [('f36d2574-5d53-4b40-8e21-3477336c8d77', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:17:36.566086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d99bc26f-163a-4d8f-a85d-e918b32f658a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:36.583383 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d99bc26f-163a-4d8f-a85d-e918b32f658a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1507 microversion: 2.1 time: 0.435173 May 27 15:17:36.589492 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2266/4518] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:36 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1507 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:37.154042 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3e6a4b33-2071-4d9b-a063-b693b2dc17d9 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:37.155422 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3e6a4b33-2071-4d9b-a063-b693b2dc17d9 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 36148c88-bef9-49fc-baf8-f7980cf1848d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:37.176866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e6a4b33-2071-4d9b-a063-b693b2dc17d9 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:37.183324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e6a4b33-2071-4d9b-a063-b693b2dc17d9 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:37.186860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e6a4b33-2071-4d9b-a063-b693b2dc17d9 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:37.191179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e6a4b33-2071-4d9b-a063-b693b2dc17d9 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:37.720923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-21e6e3cd-1623-4661-b4b1-a1b467c7734a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:17:37.722562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-21e6e3cd-1623-4661-b4b1-a1b467c7734a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:17:37.723668 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-21e6e3cd-1623-4661-b4b1-a1b467c7734a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:17:37.724402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-21e6e3cd-1623-4661-b4b1-a1b467c7734a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:17:37.725124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-21e6e3cd-1623-4661-b4b1-a1b467c7734a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:17:37.749934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21e6e3cd-1623-4661-b4b1-a1b467c7734a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:37.754199 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21e6e3cd-1623-4661-b4b1-a1b467c7734a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:37.755772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21e6e3cd-1623-4661-b4b1-a1b467c7734a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:37.758955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21e6e3cd-1623-4661-b4b1-a1b467c7734a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:37.837806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-21e6e3cd-1623-4661-b4b1-a1b467c7734a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Getting quotas for project 47bcab40996f4487bfb203eaac11325f. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:17:37.868118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-21e6e3cd-1623-4661-b4b1-a1b467c7734a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Getting quotas for user 15641271e7024b7bacb94612dae67d96 and project 47bcab40996f4487bfb203eaac11325f. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:17:37.902058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3e6a4b33-2071-4d9b-a063-b693b2dc17d9 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:37.914511 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-21e6e3cd-1623-4661-b4b1-a1b467c7734a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:17:37.914743 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3e6a4b33-2071-4d9b-a063-b693b2dc17d9 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d" status: 200 len: 1507 microversion: 2.1 time: 0.765198 May 27 15:17:37.922963 n-d-843621-1 devstack@n-api.service[119248]: WARNING nova.utils [None req-21e6e3cd-1623-4661-b4b1-a1b467c7734a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1847674428 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-184767442 May 27 15:17:37.924254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-21e6e3cd-1623-4661-b4b1-a1b467c7734a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:17:37.935048 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2267/4519] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:37 2022] GET /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d => generated 1507 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:37.943228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f121f501-c4ee-4148-bd3d-df146983febb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:37.944146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f121f501-c4ee-4148-bd3d-df146983febb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:37.957899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f121f501-c4ee-4148-bd3d-df146983febb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:37.958583 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f121f501-c4ee-4148-bd3d-df146983febb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:37.960026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f121f501-c4ee-4148-bd3d-df146983febb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:37.961147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f121f501-c4ee-4148-bd3d-df146983febb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:38.041371 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-21e6e3cd-1623-4661-b4b1-a1b467c7734a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.947402 May 27 15:17:38.043126 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2253/4520] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:17:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:17:38.055018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b444eaf1-da41-4d9a-a9aa-a733049b9805 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:38.055704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b444eaf1-da41-4d9a-a9aa-a733049b9805 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 1ad6dd32-9427-4232-bd27-70a65f1ee2f4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:38.071522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b444eaf1-da41-4d9a-a9aa-a733049b9805 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:38.076076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b444eaf1-da41-4d9a-a9aa-a733049b9805 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:38.077484 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b444eaf1-da41-4d9a-a9aa-a733049b9805 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:38.080042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b444eaf1-da41-4d9a-a9aa-a733049b9805 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:38.222876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f121f501-c4ee-4148-bd3d-df146983febb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:38.236746 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f121f501-c4ee-4148-bd3d-df146983febb tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1507 microversion: 2.1 time: 0.299245 May 27 15:17:38.242913 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2268/4521] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:37 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1507 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:38.266413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1e5228ee-5cea-4ad5-992e-7cc89f0b3223 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:38.268554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1e5228ee-5cea-4ad5-992e-7cc89f0b3223 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:38.564157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1e5228ee-5cea-4ad5-992e-7cc89f0b3223 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:38.572489 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1e5228ee-5cea-4ad5-992e-7cc89f0b3223 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1232 microversion: 2.1 time: 0.324996 May 27 15:17:38.591775 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2269/4522] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:38 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1232 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:38.750058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b444eaf1-da41-4d9a-a9aa-a733049b9805 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:38.765401 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b444eaf1-da41-4d9a-a9aa-a733049b9805 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/1ad6dd32-9427-4232-bd27-70a65f1ee2f4" status: 200 len: 1506 microversion: 2.1 time: 0.717560 May 27 15:17:38.774414 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2254/4523] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:38 2022] GET /compute/v2.1/servers/1ad6dd32-9427-4232-bd27-70a65f1ee2f4 => generated 1506 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:38.791151 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a97d2768-fd5e-498d-b36c-b9388c0f33e3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:38.793643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a97d2768-fd5e-498d-b36c-b9388c0f33e3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 1ad6dd32-9427-4232-bd27-70a65f1ee2f4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:38.823814 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a97d2768-fd5e-498d-b36c-b9388c0f33e3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:38.824554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a97d2768-fd5e-498d-b36c-b9388c0f33e3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:38.825541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a97d2768-fd5e-498d-b36c-b9388c0f33e3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:38.826269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a97d2768-fd5e-498d-b36c-b9388c0f33e3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:38.902566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a97d2768-fd5e-498d-b36c-b9388c0f33e3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 1ad6dd32-9427-4232-bd27-70a65f1ee2f4] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:17:39.247959 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a97d2768-fd5e-498d-b36c-b9388c0f33e3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1ad6dd32-9427-4232-bd27-70a65f1ee2f4" status: 204 len: 0 microversion: 2.1 time: 0.469455 May 27 15:17:39.254330 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2270/4524] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:17:38 2022] DELETE /compute/v2.1/servers/1ad6dd32-9427-4232-bd27-70a65f1ee2f4 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:17:39.257981 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fdf78346-588f-4fcc-9f07-acd4266d38e9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:39.258955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fdf78346-588f-4fcc-9f07-acd4266d38e9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:39.268782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fdf78346-588f-4fcc-9f07-acd4266d38e9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:39.272288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fdf78346-588f-4fcc-9f07-acd4266d38e9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:39.277248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fdf78346-588f-4fcc-9f07-acd4266d38e9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:39.277857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fdf78346-588f-4fcc-9f07-acd4266d38e9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:39.279991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f1cae386-43fa-4e28-8b57-2526a193e0e1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:39.280605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f1cae386-43fa-4e28-8b57-2526a193e0e1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 36148c88-bef9-49fc-baf8-f7980cf1848d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:39.302802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1cae386-43fa-4e28-8b57-2526a193e0e1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:39.308249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1cae386-43fa-4e28-8b57-2526a193e0e1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:39.309431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1cae386-43fa-4e28-8b57-2526a193e0e1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:39.316273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1cae386-43fa-4e28-8b57-2526a193e0e1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:39.464520 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fdf78346-588f-4fcc-9f07-acd4266d38e9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:39.471905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f1cae386-43fa-4e28-8b57-2526a193e0e1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 36148c88-bef9-49fc-baf8-f7980cf1848d] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:17:39.489556 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fdf78346-588f-4fcc-9f07-acd4266d38e9 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1465 microversion: 2.1 time: 0.235964 May 27 15:17:39.496177 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2255/4525] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:39 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1465 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:39.514808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-bbabce25-2df6-445b-94fc-e7fbc9e199b2 req-7e4957e1-c15b-4ea8-9347-c0563c67da36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc393fb-711a-436a-8a25-c84ee30e8f3e", "name": "network-vif-deleted", "tag": "98d574eb-93db-43b7-be0c-c41276934647"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:39.551580 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-bbabce25-2df6-445b-94fc-e7fbc9e199b2 req-7e4957e1-c15b-4ea8-9347-c0563c67da36 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:39.553137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-bbabce25-2df6-445b-94fc-e7fbc9e199b2 req-7e4957e1-c15b-4ea8-9347-c0563c67da36 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:39.597724 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-bbabce25-2df6-445b-94fc-e7fbc9e199b2 req-7e4957e1-c15b-4ea8-9347-c0563c67da36 service nova] Creating event network-vif-deleted:98d574eb-93db-43b7-be0c-c41276934647 for instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e on n-h1-843621-1 May 27 15:17:39.635031 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-bbabce25-2df6-445b-94fc-e7fbc9e199b2 req-7e4957e1-c15b-4ea8-9347-c0563c67da36 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119372 May 27 15:17:39.636104 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2256/4526] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 27 15:17:39.653850 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-57833b66-d24e-40df-b5bd-eba18afc13eb tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:39.661521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-57833b66-d24e-40df-b5bd-eba18afc13eb tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:39.693247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57833b66-d24e-40df-b5bd-eba18afc13eb tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:39.696803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57833b66-d24e-40df-b5bd-eba18afc13eb tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:39.697801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57833b66-d24e-40df-b5bd-eba18afc13eb tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:39.700050 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57833b66-d24e-40df-b5bd-eba18afc13eb tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:39.748316 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f1cae386-43fa-4e28-8b57-2526a193e0e1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "DELETE /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d" status: 204 len: 0 microversion: 2.1 time: 0.483210 May 27 15:17:39.750763 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2271/4527] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:17:39 2022] DELETE /compute/v2.1/servers/36148c88-bef9-49fc-baf8-f7980cf1848d => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:17:39.860214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-57833b66-d24e-40df-b5bd-eba18afc13eb tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:39.870302 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-57833b66-d24e-40df-b5bd-eba18afc13eb tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1236 microversion: 2.1 time: 0.231717 May 27 15:17:39.871800 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2257/4528] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:39 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1236 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:40.013604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ef96b0f0-56a0-45bc-a406-25e07852a1a1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1361955884", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "602684c4-1c25-42cc-82f2-08e23e922db6"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:40.118323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-ef96b0f0-56a0-45bc-a406-25e07852a1a1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] validate_networks() for [('602684c4-1c25-42cc-82f2-08e23e922db6', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:17:40.515434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cbdcf6c1-bf8d-4467-8579-18ff12e0c674 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:40.516361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cbdcf6c1-bf8d-4467-8579-18ff12e0c674 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:40.535630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cbdcf6c1-bf8d-4467-8579-18ff12e0c674 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:40.539065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cbdcf6c1-bf8d-4467-8579-18ff12e0c674 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:40.540147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cbdcf6c1-bf8d-4467-8579-18ff12e0c674 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:40.542967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cbdcf6c1-bf8d-4467-8579-18ff12e0c674 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:40.581511 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:40.665467 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cbdcf6c1-bf8d-4467-8579-18ff12e0c674 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:40.668617 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cbdcf6c1-bf8d-4467-8579-18ff12e0c674 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:40.669449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-cbdcf6c1-bf8d-4467-8579-18ff12e0c674 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lazy-loading 'fault' on Instance uuid 3bc393fb-711a-436a-8a25-c84ee30e8f3e {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:17:40.887550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cbdcf6c1-bf8d-4467-8579-18ff12e0c674 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:40.908491 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cbdcf6c1-bf8d-4467-8579-18ff12e0c674 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 200 len: 1311 microversion: 2.1 time: 0.397945 May 27 15:17:40.928941 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2258/4529] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:40 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 1311 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:40.952993 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ffa19c0f-3f0d-41ee-8cc5-7aa02682b464 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:40.955462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ffa19c0f-3f0d-41ee-8cc5-7aa02682b464 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:41.002854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ffa19c0f-3f0d-41ee-8cc5-7aa02682b464 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:41.006236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ffa19c0f-3f0d-41ee-8cc5-7aa02682b464 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:41.008483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ffa19c0f-3f0d-41ee-8cc5-7aa02682b464 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:41.009958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ffa19c0f-3f0d-41ee-8cc5-7aa02682b464 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:41.503613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ffa19c0f-3f0d-41ee-8cc5-7aa02682b464 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:41.550435 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ffa19c0f-3f0d-41ee-8cc5-7aa02682b464 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1284 microversion: 2.1 time: 0.615919 May 27 15:17:41.558616 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2259/4530] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:40 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1284 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:41.643133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ef96b0f0-56a0-45bc-a406-25e07852a1a1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:17:41.643670 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ef96b0f0-56a0-45bc-a406-25e07852a1a1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:17:41.644025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ef96b0f0-56a0-45bc-a406-25e07852a1a1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:17:41.644448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ef96b0f0-56a0-45bc-a406-25e07852a1a1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:17:41.644997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ef96b0f0-56a0-45bc-a406-25e07852a1a1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:17:41.673199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef96b0f0-56a0-45bc-a406-25e07852a1a1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:41.675474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef96b0f0-56a0-45bc-a406-25e07852a1a1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:41.680775 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef96b0f0-56a0-45bc-a406-25e07852a1a1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:41.681691 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef96b0f0-56a0-45bc-a406-25e07852a1a1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:41.771626 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-ef96b0f0-56a0-45bc-a406-25e07852a1a1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Getting quotas for project a7353d23e19b45a5b5297d04f7ef71cb. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:17:41.785057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-ef96b0f0-56a0-45bc-a406-25e07852a1a1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Getting quotas for user 572426dd79d94a91bba9cd86d6542042 and project a7353d23e19b45a5b5297d04f7ef71cb. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:17:41.820973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ef96b0f0-56a0-45bc-a406-25e07852a1a1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Going to run 2 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:17:41.826720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ef96b0f0-56a0-45bc-a406-25e07852a1a1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 580d21d0-dc33-49d4-b15c-24ffdba7ad7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:17:41.916351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ef96b0f0-56a0-45bc-a406-25e07852a1a1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 16f0ab29-0848-4e22-99ab-f8b98d99df6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=580d21d0-dc33-49d4-b15c-24ffdba7ad7d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:17:41.933626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-197340b0-5f27-4fda-8f5a-1d7df7173d83 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:41.935420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-197340b0-5f27-4fda-8f5a-1d7df7173d83 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 3bc393fb-711a-436a-8a25-c84ee30e8f3e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:41.951250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-197340b0-5f27-4fda-8f5a-1d7df7173d83 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:41.952962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-197340b0-5f27-4fda-8f5a-1d7df7173d83 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:41.955059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-197340b0-5f27-4fda-8f5a-1d7df7173d83 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:41.956623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-197340b0-5f27-4fda-8f5a-1d7df7173d83 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:42.001784 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-197340b0-5f27-4fda-8f5a-1d7df7173d83 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] HTTP exception thrown: Instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e could not be found. May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-197340b0-5f27-4fda-8f5a-1d7df7173d83 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Request method failure captured: May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e HTTP/1.1 May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOnNcWUaU6oQTw40A1oZOI-6OFKZaukve4P5LqW1FpCc9yhaxuLnjuKFUwlZoi0CeEpz5akQjaT-fGwv01A8fNadXXg4nlnoB_yvoYpc3lVED0AfYG3-niNxm_AITH-UuchLUVsnXh3asdpL1aml75HbLXXqw5pajtYuIua7x_Sa4qg May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 1f6efd5b16e5450d9eb9b454d05a775a May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1f6efd5b16e5450d9eb9b454d05a775a", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 1f6efd5b16e5450d9eb9b454d05a775a May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerRescueNegativeTestJSON-1538927199-project May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 645379b3a21548d8a4f4d6425b61319f May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1538927199-project May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e could not be found. May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '3bc393fb-711a-436a-8a25-c84ee30e8f3e'} May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e could not be found. May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e could not be found. May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:42.008336 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:42.014121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:42.014121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:42.014121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:42.014121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:42.014121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:17:42.014121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:17:42.014121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e could not be found. May 27 15:17:42.014121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:42.020232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-197340b0-5f27-4fda-8f5a-1d7df7173d83 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Returning 404 to user: Instance 3bc393fb-711a-436a-8a25-c84ee30e8f3e could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:42.032902 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-197340b0-5f27-4fda-8f5a-1d7df7173d83 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e" status: 404 len: 111 microversion: 2.1 time: 0.102855 May 27 15:17:42.036784 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2260/4531] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:41 2022] GET /compute/v2.1/servers/3bc393fb-711a-436a-8a25-c84ee30e8f3e => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:17:42.052640 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ef96b0f0-56a0-45bc-a406-25e07852a1a1 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.043238 May 27 15:17:42.059691 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2272/4532] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:17:40 2022] POST /compute/v2.1/servers => generated 32 bytes in 2049 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 27 15:17:42.066800 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6c6e797e-80a6-4b2f-ae5b-d1c891693896 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:42.067948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6c6e797e-80a6-4b2f-ae5b-d1c891693896 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:42.072874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a7fea5f1-9765-454d-ae38-35470049ec6d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:42.081178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a7fea5f1-9765-454d-ae38-35470049ec6d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:42.081994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a7fea5f1-9765-454d-ae38-35470049ec6d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Searching by: {'deleted': False, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb'} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:17:42.092611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c6e797e-80a6-4b2f-ae5b-d1c891693896 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:42.097603 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c6e797e-80a6-4b2f-ae5b-d1c891693896 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:42.099826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c6e797e-80a6-4b2f-ae5b-d1c891693896 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:42.101450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c6e797e-80a6-4b2f-ae5b-d1c891693896 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:42.131229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a7fea5f1-9765-454d-ae38-35470049ec6d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:42.131561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a7fea5f1-9765-454d-ae38-35470049ec6d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:42.134882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a7fea5f1-9765-454d-ae38-35470049ec6d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:42.135361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a7fea5f1-9765-454d-ae38-35470049ec6d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:42.193743 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6c6e797e-80a6-4b2f-ae5b-d1c891693896 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:17:42.238326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.multi_cell_list [None req-a7fea5f1-9765-454d-ae38-35470049ec6d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=119249) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:17:42.377325 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a7fea5f1-9765-454d-ae38-35470049ec6d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.304366 May 27 15:17:42.378293 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2273/4533] 10.222.0.13 () {58 vars in 1124 bytes} [Fri May 27 15:17:42 2022] GET /compute/v2.1/servers => generated 1335 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:42.389201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ce1cdb6f-c6a5-4453-82cf-a883b3f36c03 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:42.390230 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ce1cdb6f-c6a5-4453-82cf-a883b3f36c03 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 16f0ab29-0848-4e22-99ab-f8b98d99df6e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:42.513138 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6c6e797e-80a6-4b2f-ae5b-d1c891693896 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "DELETE /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 204 len: 0 microversion: 2.1 time: 0.473687 May 27 15:17:42.516380 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2261/4534] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:17:42 2022] DELETE /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:17:42.539296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f75d1758-ba8e-4250-a88a-d666964fa928 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:42.540059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f75d1758-ba8e-4250-a88a-d666964fa928 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:42.548606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ce1cdb6f-c6a5-4453-82cf-a883b3f36c03 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:42.552356 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f75d1758-ba8e-4250-a88a-d666964fa928 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:42.553617 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f75d1758-ba8e-4250-a88a-d666964fa928 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:42.555286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f75d1758-ba8e-4250-a88a-d666964fa928 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:42.555910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f75d1758-ba8e-4250-a88a-d666964fa928 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:42.558379 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ce1cdb6f-c6a5-4453-82cf-a883b3f36c03 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e" status: 200 len: 1218 microversion: 2.1 time: 0.172897 May 27 15:17:42.563369 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2274/4535] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:42 2022] GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e => generated 1218 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:42.578098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a1908d41-88cb-4a9c-8040-3f129c21c30e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:42.583292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a1908d41-88cb-4a9c-8040-3f129c21c30e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:42.600843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1908d41-88cb-4a9c-8040-3f129c21c30e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:42.611810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1908d41-88cb-4a9c-8040-3f129c21c30e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:42.614327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1908d41-88cb-4a9c-8040-3f129c21c30e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:42.618223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1908d41-88cb-4a9c-8040-3f129c21c30e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:42.868902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a1908d41-88cb-4a9c-8040-3f129c21c30e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:42.884600 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a1908d41-88cb-4a9c-8040-3f129c21c30e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1290 microversion: 2.1 time: 0.311367 May 27 15:17:42.889136 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2275/4536] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:42 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1290 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:43.080967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f75d1758-ba8e-4250-a88a-d666964fa928 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:43.101720 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f75d1758-ba8e-4250-a88a-d666964fa928 tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1522 microversion: 2.1 time: 0.579413 May 27 15:17:43.117630 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2262/4537] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:42 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1522 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:43.579395 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0984ba4d-7791-4041-a490-7901c77ab794 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:43.580599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0984ba4d-7791-4041-a490-7901c77ab794 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 16f0ab29-0848-4e22-99ab-f8b98d99df6e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:43.718336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0984ba4d-7791-4041-a490-7901c77ab794 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:43.731856 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0984ba4d-7791-4041-a490-7901c77ab794 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e" status: 200 len: 1218 microversion: 2.1 time: 0.157061 May 27 15:17:43.749365 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2276/4538] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:43 2022] GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e => generated 1218 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:43.907293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0c8383e5-5a58-4920-b55d-7a3064d1d400 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:43.908372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0c8383e5-5a58-4920-b55d-7a3064d1d400 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:43.919570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c8383e5-5a58-4920-b55d-7a3064d1d400 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:43.920712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c8383e5-5a58-4920-b55d-7a3064d1d400 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:43.922602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c8383e5-5a58-4920-b55d-7a3064d1d400 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:43.931199 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c8383e5-5a58-4920-b55d-7a3064d1d400 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:44.108110 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0c8383e5-5a58-4920-b55d-7a3064d1d400 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:44.123860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c77a66e0-d512-438b-8b96-7c4ed2b5094e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:44.124621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c77a66e0-d512-438b-8b96-7c4ed2b5094e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:44.139632 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0c8383e5-5a58-4920-b55d-7a3064d1d400 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1290 microversion: 2.1 time: 0.237459 May 27 15:17:44.143439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c77a66e0-d512-438b-8b96-7c4ed2b5094e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:44.144755 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2263/4539] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:43 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1290 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:44.149525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c77a66e0-d512-438b-8b96-7c4ed2b5094e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:44.151234 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c77a66e0-d512-438b-8b96-7c4ed2b5094e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:44.152725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c77a66e0-d512-438b-8b96-7c4ed2b5094e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:44.437082 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c77a66e0-d512-438b-8b96-7c4ed2b5094e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:44.446490 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c77a66e0-d512-438b-8b96-7c4ed2b5094e tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1522 microversion: 2.1 time: 0.327709 May 27 15:17:44.450788 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2277/4540] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:44 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:44.756945 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5adcb913-619b-4bde-860f-b6d0149057bf tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:44.757848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5adcb913-619b-4bde-860f-b6d0149057bf tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 16f0ab29-0848-4e22-99ab-f8b98d99df6e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:44.770683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5adcb913-619b-4bde-860f-b6d0149057bf tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:44.771533 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5adcb913-619b-4bde-860f-b6d0149057bf tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:44.772580 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5adcb913-619b-4bde-860f-b6d0149057bf tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:44.773290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5adcb913-619b-4bde-860f-b6d0149057bf tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:44.913054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5adcb913-619b-4bde-860f-b6d0149057bf tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:44.931608 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5adcb913-619b-4bde-860f-b6d0149057bf tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e" status: 200 len: 1270 microversion: 2.1 time: 0.178426 May 27 15:17:44.932566 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2264/4541] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:44 2022] GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e => generated 1270 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:45.161739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-26dcf659-0ae5-4a8c-abcd-a33fe9969440 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:45.163799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-26dcf659-0ae5-4a8c-abcd-a33fe9969440 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:45.182005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26dcf659-0ae5-4a8c-abcd-a33fe9969440 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:45.182843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26dcf659-0ae5-4a8c-abcd-a33fe9969440 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:45.184888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26dcf659-0ae5-4a8c-abcd-a33fe9969440 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:45.187958 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26dcf659-0ae5-4a8c-abcd-a33fe9969440 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:45.346743 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-26dcf659-0ae5-4a8c-abcd-a33fe9969440 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:45.370799 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-26dcf659-0ae5-4a8c-abcd-a33fe9969440 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1290 microversion: 2.1 time: 0.213530 May 27 15:17:45.381360 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2278/4542] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:45 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1290 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:45.469306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1947b297-3eb6-489c-b546-934966e2fa0d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:45.469938 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1947b297-3eb6-489c-b546-934966e2fa0d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:45.480446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1947b297-3eb6-489c-b546-934966e2fa0d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:45.489384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1947b297-3eb6-489c-b546-934966e2fa0d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:45.490334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1947b297-3eb6-489c-b546-934966e2fa0d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:45.490798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1947b297-3eb6-489c-b546-934966e2fa0d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:45.914464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1947b297-3eb6-489c-b546-934966e2fa0d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:45.923522 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1947b297-3eb6-489c-b546-934966e2fa0d tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1522 microversion: 2.1 time: 0.459953 May 27 15:17:45.924093 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2265/4543] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:45 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1522 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:45.950687 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3f99299c-4167-4fd8-9ac7-c8036f1599ac tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:45.952306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3f99299c-4167-4fd8-9ac7-c8036f1599ac tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 16f0ab29-0848-4e22-99ab-f8b98d99df6e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:45.970052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f99299c-4167-4fd8-9ac7-c8036f1599ac tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:45.972973 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f99299c-4167-4fd8-9ac7-c8036f1599ac tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:45.973934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f99299c-4167-4fd8-9ac7-c8036f1599ac tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:45.974502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f99299c-4167-4fd8-9ac7-c8036f1599ac tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:46.211259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-7ff00add-f712-4e68-b56d-3586f307c95f req-8c930af5-3028-4060-855f-875a4dcc7c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad6dd32-9427-4232-bd27-70a65f1ee2f4", "name": "network-vif-deleted", "tag": "2bdba81d-cf41-417e-8765-98c7e2ef0f33"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:46.226202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-7ff00add-f712-4e68-b56d-3586f307c95f req-8c930af5-3028-4060-855f-875a4dcc7c12 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:46.227014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-7ff00add-f712-4e68-b56d-3586f307c95f req-8c930af5-3028-4060-855f-875a4dcc7c12 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:46.255157 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-7ff00add-f712-4e68-b56d-3586f307c95f req-8c930af5-3028-4060-855f-875a4dcc7c12 service nova] Creating event network-vif-deleted:2bdba81d-cf41-417e-8765-98c7e2ef0f33 for instance 1ad6dd32-9427-4232-bd27-70a65f1ee2f4 on n-h2-843621-1 May 27 15:17:46.265357 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-7ff00add-f712-4e68-b56d-3586f307c95f req-8c930af5-3028-4060-855f-875a4dcc7c12 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.584376 May 27 15:17:46.266641 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2279/4544] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:17:46.389469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2df74287-b65d-47eb-9f00-a46f928c159d tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:46.390438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2df74287-b65d-47eb-9f00-a46f928c159d tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:46.401645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2df74287-b65d-47eb-9f00-a46f928c159d tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:46.404914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2df74287-b65d-47eb-9f00-a46f928c159d tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:46.407022 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2df74287-b65d-47eb-9f00-a46f928c159d tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:46.414989 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2df74287-b65d-47eb-9f00-a46f928c159d tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:46.626753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2df74287-b65d-47eb-9f00-a46f928c159d tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:46.642883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3f99299c-4167-4fd8-9ac7-c8036f1599ac tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:46.653680 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2df74287-b65d-47eb-9f00-a46f928c159d tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1290 microversion: 2.1 time: 0.268867 May 27 15:17:46.658037 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2280/4545] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:46 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1290 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:46.658612 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3f99299c-4167-4fd8-9ac7-c8036f1599ac tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e" status: 200 len: 1276 microversion: 2.1 time: 0.705801 May 27 15:17:46.669154 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2266/4546] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:45 2022] GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e => generated 1276 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:46.889634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-ffb670e1-13be-49c3-a266-d968e63e2ebe req-0b98b2e0-3ece-434c-8152-493071a3761f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "445b2880-4df5-45f6-bba3-3af281cea45c", "name": "network-vif-unplugged", "status": "completed", "tag": "c3906eca-7038-456e-89aa-ed8bbe73dafd"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:46.909752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ffb670e1-13be-49c3-a266-d968e63e2ebe req-0b98b2e0-3ece-434c-8152-493071a3761f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:46.914398 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ffb670e1-13be-49c3-a266-d968e63e2ebe req-0b98b2e0-3ece-434c-8152-493071a3761f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:46.928693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:46.940130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ec805e3d-58e2-4c65-ba09-c3f6c91ed19a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:46.941132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ec805e3d-58e2-4c65-ba09-c3f6c91ed19a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:46.956372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec805e3d-58e2-4c65-ba09-c3f6c91ed19a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:46.962047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec805e3d-58e2-4c65-ba09-c3f6c91ed19a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:46.964637 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec805e3d-58e2-4c65-ba09-c3f6c91ed19a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:46.972612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec805e3d-58e2-4c65-ba09-c3f6c91ed19a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:46.988290 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-ffb670e1-13be-49c3-a266-d968e63e2ebe req-0b98b2e0-3ece-434c-8152-493071a3761f service nova] Creating event network-vif-unplugged:c3906eca-7038-456e-89aa-ed8bbe73dafd for instance 445b2880-4df5-45f6-bba3-3af281cea45c on n-h1-843621-1 May 27 15:17:47.017583 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-ffb670e1-13be-49c3-a266-d968e63e2ebe req-0b98b2e0-3ece-434c-8152-493071a3761f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130662 May 27 15:17:47.023916 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2281/4547] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:47.394170 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ec805e3d-58e2-4c65-ba09-c3f6c91ed19a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645379b3a21548d8a4f4d6425b61319f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f6efd5b16e5450d9eb9b454d05a775a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:47.405398 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ec805e3d-58e2-4c65-ba09-c3f6c91ed19a tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 200 len: 1522 microversion: 2.1 time: 0.469805 May 27 15:17:47.407076 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2267/4548] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:46 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:47.678159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7b45404a-83e8-4a23-a8a0-dd8d6c619539 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:47.678867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7b45404a-83e8-4a23-a8a0-dd8d6c619539 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:47.688421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6e5ec416-4de8-4c4e-80e1-a74bc19121fe tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:47.689784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6e5ec416-4de8-4c4e-80e1-a74bc19121fe tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 16f0ab29-0848-4e22-99ab-f8b98d99df6e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:47.693753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:47.711426 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6e5ec416-4de8-4c4e-80e1-a74bc19121fe tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:47.713859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6e5ec416-4de8-4c4e-80e1-a74bc19121fe tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:47.718866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6e5ec416-4de8-4c4e-80e1-a74bc19121fe tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:47.720655 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6e5ec416-4de8-4c4e-80e1-a74bc19121fe tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:47.725698 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b45404a-83e8-4a23-a8a0-dd8d6c619539 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:47.726300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b45404a-83e8-4a23-a8a0-dd8d6c619539 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:47.728318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b45404a-83e8-4a23-a8a0-dd8d6c619539 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:47.731218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b45404a-83e8-4a23-a8a0-dd8d6c619539 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:47.792375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:47.895660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:48.880063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6e5ec416-4de8-4c4e-80e1-a74bc19121fe tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:48.900400 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6e5ec416-4de8-4c4e-80e1-a74bc19121fe tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e" status: 200 len: 1318 microversion: 2.1 time: 1.211331 May 27 15:17:48.901771 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2268/4549] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:47 2022] GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e => generated 1318 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:48.924544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ced1d8fe-332d-4abd-bd62-63a096cd936c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:48.935472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7b45404a-83e8-4a23-a8a0-dd8d6c619539 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:48.936776 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ced1d8fe-332d-4abd-bd62-63a096cd936c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:48.945750 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7b45404a-83e8-4a23-a8a0-dd8d6c619539 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1332 microversion: 2.1 time: 1.274599 May 27 15:17:48.951266 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ced1d8fe-332d-4abd-bd62-63a096cd936c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:48.951734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ced1d8fe-332d-4abd-bd62-63a096cd936c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:48.957439 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2282/4550] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:47 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1332 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:48.958879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ced1d8fe-332d-4abd-bd62-63a096cd936c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:48.962820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ced1d8fe-332d-4abd-bd62-63a096cd936c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:48.966048 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b7c6a7c5-5855-44cd-be24-1604219ab1ed tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:48.978324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b7c6a7c5-5855-44cd-be24-1604219ab1ed tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] [instance: 445b2880-4df5-45f6-bba3-3af281cea45c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:48.999023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7c6a7c5-5855-44cd-be24-1604219ab1ed tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:49.003005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7c6a7c5-5855-44cd-be24-1604219ab1ed tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:49.004105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7c6a7c5-5855-44cd-be24-1604219ab1ed tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:49.008483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7c6a7c5-5855-44cd-be24-1604219ab1ed tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:49.053219 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-b7c6a7c5-5855-44cd-be24-1604219ab1ed tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] HTTP exception thrown: Instance 445b2880-4df5-45f6-bba3-3af281cea45c could not be found. May 27 15:17:49.062353 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ced1d8fe-332d-4abd-bd62-63a096cd936c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611/ips" status: 200 len: 149 microversion: 2.1 time: 0.155848 May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b7c6a7c5-5855-44cd-be24-1604219ab1ed tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Request method failure captured: May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c HTTP/1.1 May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOnNcWUaU6oQTw40A1oZOI-6OFKZaukve4P5LqW1FpCc9yhaxuLnjuKFUwlZoi0CeEpz5akQjaT-fGwv01A8fNadXXg4nlnoB_yvoYpc3lVED0AfYG3-niNxm_AITH-UuchLUVsnXh3asdpL1aml75HbLXXqw5pajtYuIua7x_Sa4qg May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1f6efd5b16e5450d9eb9b454d05a775a May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1f6efd5b16e5450d9eb9b454d05a775a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1f6efd5b16e5450d9eb9b454d05a775a", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1f6efd5b16e5450d9eb9b454d05a775a May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1538927199 May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerRescueNegativeTestJSON-1538927199-project May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 645379b3a21548d8a4f4d6425b61319f May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1538927199-project May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 445b2880-4df5-45f6-bba3-3af281cea45c could not be found. May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '445b2880-4df5-45f6-bba3-3af281cea45c'} May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 445b2880-4df5-45f6-bba3-3af281cea45c could not be found. May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 445b2880-4df5-45f6-bba3-3af281cea45c could not be found. May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:49.063422 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:49.068950 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:49.068950 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:49.068950 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:49.068950 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:49.068950 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:17:49.068950 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:17:49.068950 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 445b2880-4df5-45f6-bba3-3af281cea45c could not be found. May 27 15:17:49.068950 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:49.068950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b7c6a7c5-5855-44cd-be24-1604219ab1ed tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] Returning 404 to user: Instance 445b2880-4df5-45f6-bba3-3af281cea45c could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:49.070737 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b7c6a7c5-5855-44cd-be24-1604219ab1ed tempest-ServerRescueNegativeTestJSON-1538927199 tempest-ServerRescueNegativeTestJSON-1538927199-project] 10.222.0.13 "GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c" status: 404 len: 111 microversion: 2.1 time: 0.111598 May 27 15:17:49.071086 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2269/4551] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 15:17:48 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611/ips => generated 149 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:49.074393 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2283/4552] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:48 2022] GET /compute/v2.1/servers/445b2880-4df5-45f6-bba3-3af281cea45c => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:17:49.078715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-8eb18644-1ba3-4bed-a4c9-d335985640ad req-7e804022-4d13-4090-b1cd-43b7e10a058b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36148c88-bef9-49fc-baf8-f7980cf1848d", "name": "network-vif-deleted", "tag": "4f3fc4d7-2998-46f1-9adc-43ea1a8f7d2a"}, {"server_uuid": "445b2880-4df5-45f6-bba3-3af281cea45c", "name": "network-vif-deleted", "tag": "c3906eca-7038-456e-89aa-ed8bbe73dafd"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:49.092324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9f2d97df-ab15-451e-9573-c7d102a951cf tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd3b47c5-a0fb-4399-a109-adf81bc08492"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:49.098717 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9f2d97df-ab15-451e-9573-c7d102a951cf tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:49.104563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-8eb18644-1ba3-4bed-a4c9-d335985640ad req-7e804022-4d13-4090-b1cd-43b7e10a058b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:49.107344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-8eb18644-1ba3-4bed-a4c9-d335985640ad req-7e804022-4d13-4090-b1cd-43b7e10a058b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:49.122890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f2d97df-ab15-451e-9573-c7d102a951cf tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:49.123465 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f2d97df-ab15-451e-9573-c7d102a951cf tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:49.129542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f2d97df-ab15-451e-9573-c7d102a951cf tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:49.130128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f2d97df-ab15-451e-9573-c7d102a951cf tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:49.136861 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-8eb18644-1ba3-4bed-a4c9-d335985640ad req-7e804022-4d13-4090-b1cd-43b7e10a058b service nova] Creating event network-vif-deleted:4f3fc4d7-2998-46f1-9adc-43ea1a8f7d2a for instance 36148c88-bef9-49fc-baf8-f7980cf1848d on n-h1-843621-1 May 27 15:17:49.141710 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-8eb18644-1ba3-4bed-a4c9-d335985640ad req-7e804022-4d13-4090-b1cd-43b7e10a058b service nova] Creating event network-vif-deleted:c3906eca-7038-456e-89aa-ed8bbe73dafd for instance 445b2880-4df5-45f6-bba3-3af281cea45c on n-h1-843621-1 May 27 15:17:49.164798 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-8eb18644-1ba3-4bed-a4c9-d335985640ad req-7e804022-4d13-4090-b1cd-43b7e10a058b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091882 May 27 15:17:49.165464 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2270/4553] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:49.498728 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-9f2d97df-ab15-451e-9573-c7d102a951cf tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] HTTP exception thrown: Invalid volume: volume bd3b47c5-a0fb-4399-a109-adf81bc08492 is already attached to instances: 37f90068-386b-4593-a1b7-a5e2232395b2 May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9f2d97df-ab15-451e-9573-c7d102a951cf tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Request method failure captured: May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611/os-volume_attachments HTTP/1.1 May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 74 May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOrMyApwEozUDyrEIfAo_5Y4g_1HkChw1SWcTHKZFCS59hbDZ-tG27fBruZ89SDVYIwJf1049Wu3YE4lY2cORLx6FEdOR4uGmA8kqdyyKM11lovRtNDp2ouZkjSiDmO17gaqasURXD2cDNTsBoZha7a41XrY22c7gADFUiZI3zmSCNg May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a9a825b1ade46e3a702ae19c7c53f6b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 59f88a11fc4b4bf6b4a807ccffee1fab May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: {"volumeAttachment": {"volumeId": "bd3b47c5-a0fb-4399-a109-adf81bc08492"}} May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid volume: volume bd3b47c5-a0fb-4399-a109-adf81bc08492 is already attached to instances: 37f90068-386b-4593-a1b7-a5e2232395b2 May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'server_id': '04a07558-123a-448c-ad41-1da4feffb611', 'body': {'volumeAttachment': {'volumeId': 'bd3b47c5-a0fb-4399-a109-adf81bc08492'}}} May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bd3b47c5-a0fb-4399-a109-adf81bc08492 is already attached to instances: 37f90068-386b-4593-a1b7-a5e2232395b2 May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:17:49.501711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:17:49.506817 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:17:49.506817 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:17:49.506817 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 27 15:17:49.506817 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 15:17:49.506817 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bd3b47c5-a0fb-4399-a109-adf81bc08492 is already attached to instances: 37f90068-386b-4593-a1b7-a5e2232395b2 May 27 15:17:49.506817 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:49.506817 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:49.506817 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:49.506817 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:49.506817 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:49.506817 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:49.506817 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:17:49.506817 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:17:49.506817 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bd3b47c5-a0fb-4399-a109-adf81bc08492 is already attached to instances: 37f90068-386b-4593-a1b7-a5e2232395b2 May 27 15:17:49.506817 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:17:49.506817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9f2d97df-ab15-451e-9573-c7d102a951cf tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Returning 400 to user: Invalid volume: volume bd3b47c5-a0fb-4399-a109-adf81bc08492 is already attached to instances: 37f90068-386b-4593-a1b7-a5e2232395b2 {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:49.506817 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9f2d97df-ab15-451e-9573-c7d102a951cf tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "POST /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.429062 May 27 15:17:49.511824 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2284/4554] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 15:17:49 2022] POST /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611/os-volume_attachments => generated 174 bytes in 435 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:17:49.516300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-de95a81f-fa9f-41af-8f7c-667da1b76752 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:49.517136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-de95a81f-fa9f-41af-8f7c-667da1b76752 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:49.529899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de95a81f-fa9f-41af-8f7c-667da1b76752 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:49.530625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de95a81f-fa9f-41af-8f7c-667da1b76752 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:49.531731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de95a81f-fa9f-41af-8f7c-667da1b76752 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:49.538471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de95a81f-fa9f-41af-8f7c-667da1b76752 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:49.664190 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-de95a81f-fa9f-41af-8f7c-667da1b76752 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:17:49.917861 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-de95a81f-fa9f-41af-8f7c-667da1b76752 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "DELETE /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 204 len: 0 microversion: 2.1 time: 0.405570 May 27 15:17:49.919183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bcbc1ae2-5f5d-40e6-a50c-2d15e8c505e3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:49.919812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bcbc1ae2-5f5d-40e6-a50c-2d15e8c505e3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 16f0ab29-0848-4e22-99ab-f8b98d99df6e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:49.920860 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2271/4555] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:17:49 2022] DELETE /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:17:49.934875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-14e74bd1-f2fb-4ded-aaa6-8b6a356ab95c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:49.939524 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-14e74bd1-f2fb-4ded-aaa6-8b6a356ab95c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:49.952153 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-14e74bd1-f2fb-4ded-aaa6-8b6a356ab95c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:49.956484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bcbc1ae2-5f5d-40e6-a50c-2d15e8c505e3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:49.957000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bcbc1ae2-5f5d-40e6-a50c-2d15e8c505e3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:49.957822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bcbc1ae2-5f5d-40e6-a50c-2d15e8c505e3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:49.958246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bcbc1ae2-5f5d-40e6-a50c-2d15e8c505e3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:49.958594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-14e74bd1-f2fb-4ded-aaa6-8b6a356ab95c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:49.961598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-14e74bd1-f2fb-4ded-aaa6-8b6a356ab95c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:49.962180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-14e74bd1-f2fb-4ded-aaa6-8b6a356ab95c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:51.395199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bcbc1ae2-5f5d-40e6-a50c-2d15e8c505e3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:51.411735 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bcbc1ae2-5f5d-40e6-a50c-2d15e8c505e3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e" status: 200 len: 1318 microversion: 2.1 time: 1.497134 May 27 15:17:51.412611 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2285/4556] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:49 2022] GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e => generated 1318 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:51.427294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ca662498-03f2-4981-8408-21fc6349f607 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:51.429836 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ca662498-03f2-4981-8408-21fc6349f607 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:51.450110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ca662498-03f2-4981-8408-21fc6349f607 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:51.450862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ca662498-03f2-4981-8408-21fc6349f607 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:51.454268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ca662498-03f2-4981-8408-21fc6349f607 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:51.462748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ca662498-03f2-4981-8408-21fc6349f607 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:51.948044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-14e74bd1-f2fb-4ded-aaa6-8b6a356ab95c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:51.958615 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-14e74bd1-f2fb-4ded-aaa6-8b6a356ab95c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 200 len: 1681 microversion: 2.1 time: 2.030836 May 27 15:17:51.963637 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2272/4557] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:49 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 1681 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:51.973852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-e007cf94-2a91-44fc-9a06-668d69675481 req-8784d6c7-e40d-4069-ad0c-2557a605ae9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f0ab29-0848-4e22-99ab-f8b98d99df6e", "tag": "f0e758ee-2238-4ff6-95dd-a561b476d1c4"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:51.995216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e007cf94-2a91-44fc-9a06-668d69675481 req-8784d6c7-e40d-4069-ad0c-2557a605ae9d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:51.995668 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e007cf94-2a91-44fc-9a06-668d69675481 req-8784d6c7-e40d-4069-ad0c-2557a605ae9d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:51.999007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:52.028664 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-e007cf94-2a91-44fc-9a06-668d69675481 req-8784d6c7-e40d-4069-ad0c-2557a605ae9d service nova] Creating event network-changed:f0e758ee-2238-4ff6-95dd-a561b476d1c4 for instance 16f0ab29-0848-4e22-99ab-f8b98d99df6e on n-h2-843621-1 May 27 15:17:52.034523 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-e007cf94-2a91-44fc-9a06-668d69675481 req-8784d6c7-e40d-4069-ad0c-2557a605ae9d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069637 May 27 15:17:52.035143 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2273/4558] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:52.051497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-a335af98-f101-44b1-8685-82495808e456 req-64623eba-c523-4bbd-8d15-497e0aa2d960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6821f22b-21ec-4a40-9b7e-0d887b8e2fba", "tag": "16540a03-4c24-436b-959d-06095aca3ccd"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:52.071265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-a335af98-f101-44b1-8685-82495808e456 req-64623eba-c523-4bbd-8d15-497e0aa2d960 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:52.075245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-a335af98-f101-44b1-8685-82495808e456 req-64623eba-c523-4bbd-8d15-497e0aa2d960 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:52.101242 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-a335af98-f101-44b1-8685-82495808e456 req-64623eba-c523-4bbd-8d15-497e0aa2d960 service nova] Creating event network-changed:16540a03-4c24-436b-959d-06095aca3ccd for instance 6821f22b-21ec-4a40-9b7e-0d887b8e2fba on n-h2-843621-1 May 27 15:17:52.110564 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-a335af98-f101-44b1-8685-82495808e456 req-64623eba-c523-4bbd-8d15-497e0aa2d960 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074018 May 27 15:17:52.115125 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2274/4559] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:52.185659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:52.331858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6e92236e-0308-499a-bb61-3f42dd698c23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:52.344220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6e92236e-0308-499a-bb61-3f42dd698c23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:52.344724 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6e92236e-0308-499a-bb61-3f42dd698c23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:52.391998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6e92236e-0308-499a-bb61-3f42dd698c23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Going to try to stop instance {{(pid=119248) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 15:17:52.460833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ca662498-03f2-4981-8408-21fc6349f607 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:52.473746 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ca662498-03f2-4981-8408-21fc6349f607 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1332 microversion: 2.1 time: 1.057897 May 27 15:17:52.475987 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2286/4560] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:51 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1332 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:52.483522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9abe27d3-6fad-4ae3-b739-29e2b39ccd0d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:52.490542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9abe27d3-6fad-4ae3-b739-29e2b39ccd0d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 16f0ab29-0848-4e22-99ab-f8b98d99df6e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:52.505581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9abe27d3-6fad-4ae3-b739-29e2b39ccd0d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:52.506474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9abe27d3-6fad-4ae3-b739-29e2b39ccd0d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:52.507591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9abe27d3-6fad-4ae3-b739-29e2b39ccd0d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:52.507740 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6e92236e-0308-499a-bb61-3f42dd698c23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "POST /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376/action" status: 202 len: 0 microversion: 2.1 time: 0.181239 May 27 15:17:52.508721 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2275/4561] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:17:52 2022] POST /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:17:52.509500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9abe27d3-6fad-4ae3-b739-29e2b39ccd0d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:52.517584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4743be43-fe8f-4607-ae87-769a14645542 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:52.518288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4743be43-fe8f-4607-ae87-769a14645542 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:52.534111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4743be43-fe8f-4607-ae87-769a14645542 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:52.534672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4743be43-fe8f-4607-ae87-769a14645542 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:52.538445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4743be43-fe8f-4607-ae87-769a14645542 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:52.538920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4743be43-fe8f-4607-ae87-769a14645542 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:53.386827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4743be43-fe8f-4607-ae87-769a14645542 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:53.405874 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4743be43-fe8f-4607-ae87-769a14645542 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1678 microversion: 2.1 time: 0.892956 May 27 15:17:53.408328 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2276/4562] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:52 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1678 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:53.417003 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ac3d5081-db59-423a-bcc8-0c19c08a4ab0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:53.420149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ac3d5081-db59-423a-bcc8-0c19c08a4ab0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:53.430620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac3d5081-db59-423a-bcc8-0c19c08a4ab0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:53.431450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac3d5081-db59-423a-bcc8-0c19c08a4ab0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:53.432502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac3d5081-db59-423a-bcc8-0c19c08a4ab0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:53.433209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac3d5081-db59-423a-bcc8-0c19c08a4ab0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:53.617145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9abe27d3-6fad-4ae3-b739-29e2b39ccd0d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:53.629742 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9abe27d3-6fad-4ae3-b739-29e2b39ccd0d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e" status: 200 len: 1318 microversion: 2.1 time: 1.152156 May 27 15:17:53.631286 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2287/4563] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:52 2022] GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e => generated 1318 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:53.648641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fc3ab304-7a03-4245-a781-d5d85cd69c69 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:53.651258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fc3ab304-7a03-4245-a781-d5d85cd69c69 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:53.669131 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc3ab304-7a03-4245-a781-d5d85cd69c69 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:53.670765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc3ab304-7a03-4245-a781-d5d85cd69c69 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:53.673586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc3ab304-7a03-4245-a781-d5d85cd69c69 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:53.675344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fc3ab304-7a03-4245-a781-d5d85cd69c69 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:53.723847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=12 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:53.793122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ac3d5081-db59-423a-bcc8-0c19c08a4ab0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:53.806032 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ac3d5081-db59-423a-bcc8-0c19c08a4ab0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 200 len: 1681 microversion: 2.1 time: 0.395751 May 27 15:17:53.817194 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2277/4564] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:53 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 1681 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:54.108579 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fc3ab304-7a03-4245-a781-d5d85cd69c69 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:54.120779 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fc3ab304-7a03-4245-a781-d5d85cd69c69 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1332 microversion: 2.1 time: 0.488066 May 27 15:17:54.121738 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2288/4565] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:53 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1332 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:54.427404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-888047b4-b62c-47c6-8651-89d9ad36253a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:54.433784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-888047b4-b62c-47c6-8651-89d9ad36253a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:54.469855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-888047b4-b62c-47c6-8651-89d9ad36253a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:54.470563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-888047b4-b62c-47c6-8651-89d9ad36253a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:54.471543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-888047b4-b62c-47c6-8651-89d9ad36253a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:54.472153 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-888047b4-b62c-47c6-8651-89d9ad36253a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:54.631115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-df5c186a-5b8e-45c5-b9bb-fa124a76e02e req-7b24840d-e9c7-487b-bdd4-161a5a7712af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "580d21d0-dc33-49d4-b15c-24ffdba7ad7d", "tag": "d0093499-f5a6-4da3-8d0b-7805c65fcfd8"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:54.646852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-df5c186a-5b8e-45c5-b9bb-fa124a76e02e req-7b24840d-e9c7-487b-bdd4-161a5a7712af service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:54.647590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-df5c186a-5b8e-45c5-b9bb-fa124a76e02e req-7b24840d-e9c7-487b-bdd4-161a5a7712af service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:54.676547 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-df5c186a-5b8e-45c5-b9bb-fa124a76e02e req-7b24840d-e9c7-487b-bdd4-161a5a7712af service nova] Creating event network-changed:d0093499-f5a6-4da3-8d0b-7805c65fcfd8 for instance 580d21d0-dc33-49d4-b15c-24ffdba7ad7d on n-h1-843621-1 May 27 15:17:54.696479 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-df5c186a-5b8e-45c5-b9bb-fa124a76e02e req-7b24840d-e9c7-487b-bdd4-161a5a7712af service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078906 May 27 15:17:54.699908 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2289/4566] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:54.709407 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2f400b55-0971-49be-929c-cf963919b71c tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:54.716389 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2f400b55-0971-49be-929c-cf963919b71c tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 16f0ab29-0848-4e22-99ab-f8b98d99df6e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:54.733419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2f400b55-0971-49be-929c-cf963919b71c tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:54.734420 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2f400b55-0971-49be-929c-cf963919b71c tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:54.743700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2f400b55-0971-49be-929c-cf963919b71c tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:54.744185 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2f400b55-0971-49be-929c-cf963919b71c tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:55.197989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-888047b4-b62c-47c6-8651-89d9ad36253a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:55.220020 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-888047b4-b62c-47c6-8651-89d9ad36253a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1678 microversion: 2.1 time: 0.799166 May 27 15:17:55.221222 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2278/4567] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:54 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1678 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:55.226084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cadb7a37-6a13-48fb-aef4-9842889d68f9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:55.227806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cadb7a37-6a13-48fb-aef4-9842889d68f9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:55.244333 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cadb7a37-6a13-48fb-aef4-9842889d68f9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:55.245029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cadb7a37-6a13-48fb-aef4-9842889d68f9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:55.245952 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cadb7a37-6a13-48fb-aef4-9842889d68f9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:55.254278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cadb7a37-6a13-48fb-aef4-9842889d68f9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:55.291108 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2f400b55-0971-49be-929c-cf963919b71c tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:55.304303 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2f400b55-0971-49be-929c-cf963919b71c tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e" status: 200 len: 1318 microversion: 2.1 time: 0.601761 May 27 15:17:55.305182 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2290/4568] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:54 2022] GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e => generated 1318 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:55.312790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fab1c427-6de3-44fa-b379-6c0b3242a42a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:55.314500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fab1c427-6de3-44fa-b379-6c0b3242a42a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:55.324560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fab1c427-6de3-44fa-b379-6c0b3242a42a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:55.328735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fab1c427-6de3-44fa-b379-6c0b3242a42a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:55.330049 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fab1c427-6de3-44fa-b379-6c0b3242a42a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:55.330905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fab1c427-6de3-44fa-b379-6c0b3242a42a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:55.361255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cadb7a37-6a13-48fb-aef4-9842889d68f9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:55.366228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cadb7a37-6a13-48fb-aef4-9842889d68f9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:55.367015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-cadb7a37-6a13-48fb-aef4-9842889d68f9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lazy-loading 'fault' on Instance uuid 04a07558-123a-448c-ad41-1da4feffb611 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:17:56.334862 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cadb7a37-6a13-48fb-aef4-9842889d68f9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:56.355640 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cadb7a37-6a13-48fb-aef4-9842889d68f9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 200 len: 1332 microversion: 2.1 time: 1.133219 May 27 15:17:56.357474 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2279/4569] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:55 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 1332 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:56.369799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f35553ff-3346-4050-b4fd-d077a2dc0a54 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:56.371587 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f35553ff-3346-4050-b4fd-d077a2dc0a54 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:56.395066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f35553ff-3346-4050-b4fd-d077a2dc0a54 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:56.395812 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f35553ff-3346-4050-b4fd-d077a2dc0a54 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:56.396894 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f35553ff-3346-4050-b4fd-d077a2dc0a54 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:56.401408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f35553ff-3346-4050-b4fd-d077a2dc0a54 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:56.683482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fab1c427-6de3-44fa-b379-6c0b3242a42a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:56.704379 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fab1c427-6de3-44fa-b379-6c0b3242a42a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1332 microversion: 2.1 time: 1.397930 May 27 15:17:56.714012 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2291/4570] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:55 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1332 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:56.721897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d8c7e2f8-fd65-4ef4-8f53-d96173a3db8d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:56.727186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d8c7e2f8-fd65-4ef4-8f53-d96173a3db8d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 16f0ab29-0848-4e22-99ab-f8b98d99df6e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:56.748883 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8c7e2f8-fd65-4ef4-8f53-d96173a3db8d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:56.750986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8c7e2f8-fd65-4ef4-8f53-d96173a3db8d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:56.753498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8c7e2f8-fd65-4ef4-8f53-d96173a3db8d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:56.754262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8c7e2f8-fd65-4ef4-8f53-d96173a3db8d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:56.906814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f35553ff-3346-4050-b4fd-d077a2dc0a54 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:56.921841 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f35553ff-3346-4050-b4fd-d077a2dc0a54 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1678 microversion: 2.1 time: 0.562221 May 27 15:17:56.933388 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2280/4571] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:56 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1678 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:56.950206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-3088fb9a-ea88-4222-a8af-b4e206128a2c req-883c81bd-91dd-40af-aa66-7af2cb1d957f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a07558-123a-448c-ad41-1da4feffb611", "name": "network-vif-deleted", "tag": "d8c8343a-a199-480a-bb57-b0ac1047f111"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:56.989026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3088fb9a-ea88-4222-a8af-b4e206128a2c req-883c81bd-91dd-40af-aa66-7af2cb1d957f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:56.990906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3088fb9a-ea88-4222-a8af-b4e206128a2c req-883c81bd-91dd-40af-aa66-7af2cb1d957f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:57.020818 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-3088fb9a-ea88-4222-a8af-b4e206128a2c req-883c81bd-91dd-40af-aa66-7af2cb1d957f service nova] Creating event network-vif-deleted:d8c8343a-a199-480a-bb57-b0ac1047f111 for instance 04a07558-123a-448c-ad41-1da4feffb611 on n-h2-843621-1 May 27 15:17:57.044774 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-3088fb9a-ea88-4222-a8af-b4e206128a2c req-883c81bd-91dd-40af-aa66-7af2cb1d957f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112786 May 27 15:17:57.048010 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2281/4572] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:57.379253 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4750b10d-27c6-4b8f-91ff-02e3b17d47fa tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:57.379983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4750b10d-27c6-4b8f-91ff-02e3b17d47fa tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:57.412404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4750b10d-27c6-4b8f-91ff-02e3b17d47fa tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:57.413281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4750b10d-27c6-4b8f-91ff-02e3b17d47fa tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:57.420616 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4750b10d-27c6-4b8f-91ff-02e3b17d47fa tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:57.429515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4750b10d-27c6-4b8f-91ff-02e3b17d47fa tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:57.502944 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-4750b10d-27c6-4b8f-91ff-02e3b17d47fa tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] HTTP exception thrown: Instance 04a07558-123a-448c-ad41-1da4feffb611 could not be found. May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4750b10d-27c6-4b8f-91ff-02e3b17d47fa tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Request method failure captured: May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 HTTP/1.1 May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOrMyApwEozUDyrEIfAo_5Y4g_1HkChw1SWcTHKZFCS59hbDZ-tG27fBruZ89SDVYIwJf1049Wu3YE4lY2cORLx6FEdOR4uGmA8kqdyyKM11lovRtNDp2ouZkjSiDmO17gaqasURXD2cDNTsBoZha7a41XrY22c7gADFUiZI3zmSCNg May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a9a825b1ade46e3a702ae19c7c53f6b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 59f88a11fc4b4bf6b4a807ccffee1fab May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 04a07558-123a-448c-ad41-1da4feffb611 could not be found. May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '04a07558-123a-448c-ad41-1da4feffb611'} May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04a07558-123a-448c-ad41-1da4feffb611 could not be found. May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04a07558-123a-448c-ad41-1da4feffb611 could not be found. May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:57.505534 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:57.511121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:57.511121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:57.511121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:57.511121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:17:57.511121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:17:57.511121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04a07558-123a-448c-ad41-1da4feffb611 could not be found. May 27 15:17:57.511121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:17:57.511121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4750b10d-27c6-4b8f-91ff-02e3b17d47fa tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Returning 404 to user: Instance 04a07558-123a-448c-ad41-1da4feffb611 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:57.512391 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4750b10d-27c6-4b8f-91ff-02e3b17d47fa tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 404 len: 111 microversion: 2.1 time: 0.141203 May 27 15:17:57.516075 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2282/4573] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:57 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:17:57.523210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d1d87d2a-04ff-4648-80a7-aed48baa6fcc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '.version_select at 0x7fc7756f74c0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:57.599507 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d1d87d2a-04ff-4648-80a7-aed48baa6fcc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1706732672" status: 202 len: 0 microversion: 2.1 time: 0.079619 May 27 15:17:57.601438 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2283/4574] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 27 15:17:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1706732672 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:17:57.673163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d8c7e2f8-fd65-4ef4-8f53-d96173a3db8d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:57.687790 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d8c7e2f8-fd65-4ef4-8f53-d96173a3db8d tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e" status: 200 len: 1318 microversion: 2.1 time: 0.976325 May 27 15:17:57.700444 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2292/4575] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:56 2022] GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e => generated 1318 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:57.722235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-257e8de1-143a-42ae-ac90-fa1d359671f5 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:57.722863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-257e8de1-143a-42ae-ac90-fa1d359671f5 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:57.738261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-257e8de1-143a-42ae-ac90-fa1d359671f5 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:57.738723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-257e8de1-143a-42ae-ac90-fa1d359671f5 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:57.750718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-257e8de1-143a-42ae-ac90-fa1d359671f5 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:57.751305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-257e8de1-143a-42ae-ac90-fa1d359671f5 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:57.951508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ce1c49fb-84c1-4f4e-a349-2a9c3a1491be tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:57.953023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ce1c49fb-84c1-4f4e-a349-2a9c3a1491be tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:57.968541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ce1c49fb-84c1-4f4e-a349-2a9c3a1491be tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:57.970083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ce1c49fb-84c1-4f4e-a349-2a9c3a1491be tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:57.990411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ce1c49fb-84c1-4f4e-a349-2a9c3a1491be tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:57.991309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ce1c49fb-84c1-4f4e-a349-2a9c3a1491be tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:58.520125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-257e8de1-143a-42ae-ac90-fa1d359671f5 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:58.538388 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-257e8de1-143a-42ae-ac90-fa1d359671f5 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1332 microversion: 2.1 time: 0.815418 May 27 15:17:58.541236 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2284/4576] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:57 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1332 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:58.705382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-34ae9895-ffdd-44d3-8cec-589c50394f20 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:58.706426 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-34ae9895-ffdd-44d3-8cec-589c50394f20 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 16f0ab29-0848-4e22-99ab-f8b98d99df6e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:58.718642 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34ae9895-ffdd-44d3-8cec-589c50394f20 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:58.719029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ce1c49fb-84c1-4f4e-a349-2a9c3a1491be tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:58.722519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34ae9895-ffdd-44d3-8cec-589c50394f20 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:58.724764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34ae9895-ffdd-44d3-8cec-589c50394f20 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:58.726497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34ae9895-ffdd-44d3-8cec-589c50394f20 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:58.730578 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ce1c49fb-84c1-4f4e-a349-2a9c3a1491be tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1678 microversion: 2.1 time: 0.794446 May 27 15:17:58.736663 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2293/4577] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:57 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1678 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:59.525455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-34ae9895-ffdd-44d3-8cec-589c50394f20 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:59.535806 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-34ae9895-ffdd-44d3-8cec-589c50394f20 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e" status: 200 len: 1318 microversion: 2.1 time: 0.834566 May 27 15:17:59.537432 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2285/4578] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:58 2022] GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e => generated 1318 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:59.558582 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1e6cea5e-3138-400c-b697-b036d2c9e56c tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:59.559200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1e6cea5e-3138-400c-b697-b036d2c9e56c tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:59.572602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1e6cea5e-3138-400c-b697-b036d2c9e56c tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:59.573542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1e6cea5e-3138-400c-b697-b036d2c9e56c tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:59.574607 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1e6cea5e-3138-400c-b697-b036d2c9e56c tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:59.578568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1e6cea5e-3138-400c-b697-b036d2c9e56c tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:59.751650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c7b85e45-d5b0-431f-8d17-f2ae6ed6540a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:59.752335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c7b85e45-d5b0-431f-8d17-f2ae6ed6540a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:59.774597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c7b85e45-d5b0-431f-8d17-f2ae6ed6540a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:59.774597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c7b85e45-d5b0-431f-8d17-f2ae6ed6540a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:59.774597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c7b85e45-d5b0-431f-8d17-f2ae6ed6540a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:59.774597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c7b85e45-d5b0-431f-8d17-f2ae6ed6540a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:00.081954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c7b85e45-d5b0-431f-8d17-f2ae6ed6540a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:00.097971 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c7b85e45-d5b0-431f-8d17-f2ae6ed6540a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1678 microversion: 2.1 time: 0.345696 May 27 15:18:00.098634 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2286/4579] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:59 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1678 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:00.162427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1e6cea5e-3138-400c-b697-b036d2c9e56c tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:00.172858 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1e6cea5e-3138-400c-b697-b036d2c9e56c tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1332 microversion: 2.1 time: 0.616282 May 27 15:18:00.202822 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2294/4580] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:17:59 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1332 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:00.555531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-27eafd9b-6d90-40c5-9c9f-a40d932f58d2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:00.556425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-27eafd9b-6d90-40c5-9c9f-a40d932f58d2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 16f0ab29-0848-4e22-99ab-f8b98d99df6e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:00.578463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27eafd9b-6d90-40c5-9c9f-a40d932f58d2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:00.581742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27eafd9b-6d90-40c5-9c9f-a40d932f58d2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:00.586426 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27eafd9b-6d90-40c5-9c9f-a40d932f58d2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:00.589702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27eafd9b-6d90-40c5-9c9f-a40d932f58d2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:01.117679 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-85cf33db-3582-49d0-87b6-655137192668 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:01.118819 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-85cf33db-3582-49d0-87b6-655137192668 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:01.134986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85cf33db-3582-49d0-87b6-655137192668 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:01.136147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85cf33db-3582-49d0-87b6-655137192668 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:01.139837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85cf33db-3582-49d0-87b6-655137192668 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:01.140614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85cf33db-3582-49d0-87b6-655137192668 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:01.618900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-27eafd9b-6d90-40c5-9c9f-a40d932f58d2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:01.654764 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-27eafd9b-6d90-40c5-9c9f-a40d932f58d2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e" status: 200 len: 1318 microversion: 2.1 time: 1.097484 May 27 15:18:01.671676 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2287/4581] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:00 2022] GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e => generated 1318 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:01.690541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-85cf33db-3582-49d0-87b6-655137192668 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:01.703324 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-85cf33db-3582-49d0-87b6-655137192668 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1678 microversion: 2.1 time: 0.591049 May 27 15:18:01.703920 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2295/4582] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:01 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1678 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:01.710074 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c46f21c5-c7da-4006-8aab-c6721ee5a316 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:01.710711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c46f21c5-c7da-4006-8aab-c6721ee5a316 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:01.716721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7ac1a870-bda6-4b08-9f0c-734e076c181b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:01.717237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7ac1a870-bda6-4b08-9f0c-734e076c181b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:01.730809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c46f21c5-c7da-4006-8aab-c6721ee5a316 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:01.731278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c46f21c5-c7da-4006-8aab-c6721ee5a316 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:01.732084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c46f21c5-c7da-4006-8aab-c6721ee5a316 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:01.732532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c46f21c5-c7da-4006-8aab-c6721ee5a316 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:01.758531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ac1a870-bda6-4b08-9f0c-734e076c181b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:01.758991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ac1a870-bda6-4b08-9f0c-734e076c181b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:01.759803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ac1a870-bda6-4b08-9f0c-734e076c181b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:01.760255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ac1a870-bda6-4b08-9f0c-734e076c181b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:01.919839 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-7ac1a870-bda6-4b08-9f0c-734e076c181b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lazy-loading 'services' on Instance uuid 37f90068-386b-4593-a1b7-a5e2232395b2 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:18:02.069798 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7ac1a870-bda6-4b08-9f0c-734e076c181b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "DELETE /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments/bd3b47c5-a0fb-4399-a109-adf81bc08492" status: 202 len: 0 microversion: 2.1 time: 0.364591 May 27 15:18:02.070439 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2296/4583] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 15:18:01 2022] DELETE /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments/bd3b47c5-a0fb-4399-a109-adf81bc08492 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:18:02.081737 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8e30e427-b4fe-4cdd-b661-eb31ff67110f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:02.082845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8e30e427-b4fe-4cdd-b661-eb31ff67110f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:02.101753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e30e427-b4fe-4cdd-b661-eb31ff67110f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:02.102479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e30e427-b4fe-4cdd-b661-eb31ff67110f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:02.103661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e30e427-b4fe-4cdd-b661-eb31ff67110f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:02.108963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e30e427-b4fe-4cdd-b661-eb31ff67110f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:02.203844 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8e30e427-b4fe-4cdd-b661-eb31ff67110f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128813 May 27 15:18:02.214935 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2297/4584] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:18:02 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:02.346677 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-d7c862af-93cf-4d53-9c43-0fd0e3bbe021 req-c177fd87-8214-436f-9ae9-eee04fa171c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f0ab29-0848-4e22-99ab-f8b98d99df6e", "name": "network-vif-plugged", "status": "completed", "tag": "f0e758ee-2238-4ff6-95dd-a561b476d1c4"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:02.390869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:02.393524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d7c862af-93cf-4d53-9c43-0fd0e3bbe021 req-c177fd87-8214-436f-9ae9-eee04fa171c4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:02.398071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d7c862af-93cf-4d53-9c43-0fd0e3bbe021 req-c177fd87-8214-436f-9ae9-eee04fa171c4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:02.447619 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-d7c862af-93cf-4d53-9c43-0fd0e3bbe021 req-c177fd87-8214-436f-9ae9-eee04fa171c4 service nova] Creating event network-vif-plugged:f0e758ee-2238-4ff6-95dd-a561b476d1c4 for instance 16f0ab29-0848-4e22-99ab-f8b98d99df6e on n-h2-843621-1 May 27 15:18:02.460052 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-d7c862af-93cf-4d53-9c43-0fd0e3bbe021 req-c177fd87-8214-436f-9ae9-eee04fa171c4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117182 May 27 15:18:02.466582 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2298/4585] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:02.541032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c46f21c5-c7da-4006-8aab-c6721ee5a316 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:02.556845 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c46f21c5-c7da-4006-8aab-c6721ee5a316 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1332 microversion: 2.1 time: 0.883828 May 27 15:18:02.563259 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2288/4586] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:01 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1332 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:02.675692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-82daf777-e339-4b1a-a6d8-fcde1404d7b5 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:02.676409 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-82daf777-e339-4b1a-a6d8-fcde1404d7b5 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 16f0ab29-0848-4e22-99ab-f8b98d99df6e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:02.698531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82daf777-e339-4b1a-a6d8-fcde1404d7b5 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:02.699201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82daf777-e339-4b1a-a6d8-fcde1404d7b5 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:02.699960 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82daf777-e339-4b1a-a6d8-fcde1404d7b5 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:02.700455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82daf777-e339-4b1a-a6d8-fcde1404d7b5 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:02.720614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-081c68ce-019b-4fb2-8b8d-bce74aaea172 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:02.721913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-081c68ce-019b-4fb2-8b8d-bce74aaea172 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:02.732697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-081c68ce-019b-4fb2-8b8d-bce74aaea172 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:02.736814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-081c68ce-019b-4fb2-8b8d-bce74aaea172 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:02.740123 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-081c68ce-019b-4fb2-8b8d-bce74aaea172 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:02.747286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-081c68ce-019b-4fb2-8b8d-bce74aaea172 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:03.090666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-82daf777-e339-4b1a-a6d8-fcde1404d7b5 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:03.097984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:03.103446 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-82daf777-e339-4b1a-a6d8-fcde1404d7b5 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e" status: 200 len: 1318 microversion: 2.1 time: 0.432430 May 27 15:18:03.112110 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2299/4587] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:02 2022] GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e => generated 1318 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:03.182930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-081c68ce-019b-4fb2-8b8d-bce74aaea172 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:03.196642 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-081c68ce-019b-4fb2-8b8d-bce74aaea172 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1678 microversion: 2.1 time: 0.480238 May 27 15:18:03.199366 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2289/4588] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:02 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1678 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:03.227856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b3ebfdb4-4299-4dfd-b871-303024ad12c7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:03.229433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b3ebfdb4-4299-4dfd-b871-303024ad12c7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:03.245378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3ebfdb4-4299-4dfd-b871-303024ad12c7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:03.255452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3ebfdb4-4299-4dfd-b871-303024ad12c7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:03.256763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3ebfdb4-4299-4dfd-b871-303024ad12c7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:03.257342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3ebfdb4-4299-4dfd-b871-303024ad12c7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:03.325495 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b3ebfdb4-4299-4dfd-b871-303024ad12c7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108047 May 27 15:18:03.330164 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2300/4589] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:18:03 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:03.584096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-546ce9cf-4ffa-43ee-8d78-5a5bca32522d tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:03.585056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-546ce9cf-4ffa-43ee-8d78-5a5bca32522d tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:03.615220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-546ce9cf-4ffa-43ee-8d78-5a5bca32522d tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:03.615744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-546ce9cf-4ffa-43ee-8d78-5a5bca32522d tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:03.617199 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-546ce9cf-4ffa-43ee-8d78-5a5bca32522d tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:03.618173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-546ce9cf-4ffa-43ee-8d78-5a5bca32522d tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:04.134722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7386b1e8-cb20-4c8c-858d-bf3d56a867bf tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:04.134722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7386b1e8-cb20-4c8c-858d-bf3d56a867bf tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 16f0ab29-0848-4e22-99ab-f8b98d99df6e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:04.165531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7386b1e8-cb20-4c8c-858d-bf3d56a867bf tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:04.166540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7386b1e8-cb20-4c8c-858d-bf3d56a867bf tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:04.167398 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7386b1e8-cb20-4c8c-858d-bf3d56a867bf tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:04.167862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7386b1e8-cb20-4c8c-858d-bf3d56a867bf tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:04.446693 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-546ce9cf-4ffa-43ee-8d78-5a5bca32522d tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:04.463867 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-546ce9cf-4ffa-43ee-8d78-5a5bca32522d tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1332 microversion: 2.1 time: 0.888220 May 27 15:18:04.476662 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2290/4590] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:03 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1332 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:04.496398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e00e015d-8cbe-4d2b-9114-833670a305ad tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:04.506928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e00e015d-8cbe-4d2b-9114-833670a305ad tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:04.544539 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e00e015d-8cbe-4d2b-9114-833670a305ad tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:04.546545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e00e015d-8cbe-4d2b-9114-833670a305ad tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:04.548792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e00e015d-8cbe-4d2b-9114-833670a305ad tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:04.551522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e00e015d-8cbe-4d2b-9114-833670a305ad tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:04.596771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7386b1e8-cb20-4c8c-858d-bf3d56a867bf tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:04.607586 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7386b1e8-cb20-4c8c-858d-bf3d56a867bf tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e" status: 200 len: 1505 microversion: 2.1 time: 0.482277 May 27 15:18:04.608168 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2301/4591] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:04 2022] GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e => generated 1505 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:04.640945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b1c51a93-fca9-4ebb-9587-080eb02a88a0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:04.643747 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b1c51a93-fca9-4ebb-9587-080eb02a88a0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:04.670314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b1c51a93-fca9-4ebb-9587-080eb02a88a0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:04.670937 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b1c51a93-fca9-4ebb-9587-080eb02a88a0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:04.671735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b1c51a93-fca9-4ebb-9587-080eb02a88a0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:04.672246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b1c51a93-fca9-4ebb-9587-080eb02a88a0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:04.741306 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b1c51a93-fca9-4ebb-9587-080eb02a88a0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113871 May 27 15:18:04.753059 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2302/4592] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:18:04 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:04.758037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-f2027b26-d850-453e-afd3-3af0449059ad req-c88745dc-1477-4922-b088-9cbe6e6cdfcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6821f22b-21ec-4a40-9b7e-0d887b8e2fba", "name": "network-vif-plugged", "status": "completed", "tag": "16540a03-4c24-436b-959d-06095aca3ccd"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:04.779457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f2027b26-d850-453e-afd3-3af0449059ad req-c88745dc-1477-4922-b088-9cbe6e6cdfcd service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:04.779927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f2027b26-d850-453e-afd3-3af0449059ad req-c88745dc-1477-4922-b088-9cbe6e6cdfcd service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:04.800018 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-f2027b26-d850-453e-afd3-3af0449059ad req-c88745dc-1477-4922-b088-9cbe6e6cdfcd service nova] Creating event network-vif-plugged:16540a03-4c24-436b-959d-06095aca3ccd for instance 6821f22b-21ec-4a40-9b7e-0d887b8e2fba on n-h2-843621-1 May 27 15:18:04.822505 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-f2027b26-d850-453e-afd3-3af0449059ad req-c88745dc-1477-4922-b088-9cbe6e6cdfcd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068126 May 27 15:18:04.823410 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2303/4593] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:04.829750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9586cd39-ccd0-4bc7-98c4-054782bf63f2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:04.833075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9586cd39-ccd0-4bc7-98c4-054782bf63f2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 580d21d0-dc33-49d4-b15c-24ffdba7ad7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:04.862867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9586cd39-ccd0-4bc7-98c4-054782bf63f2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:04.863228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9586cd39-ccd0-4bc7-98c4-054782bf63f2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:04.864086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9586cd39-ccd0-4bc7-98c4-054782bf63f2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:04.864541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9586cd39-ccd0-4bc7-98c4-054782bf63f2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:05.954544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e00e015d-8cbe-4d2b-9114-833670a305ad tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:05.970015 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e00e015d-8cbe-4d2b-9114-833670a305ad tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1655 microversion: 2.1 time: 1.489942 May 27 15:18:05.980848 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2291/4594] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:04 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1655 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:05.980848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e530bbc8-1c41-4c87-b2b6-eb6e9e996aa1 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:05.981912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e530bbc8-1c41-4c87-b2b6-eb6e9e996aa1 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:05.994262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e530bbc8-1c41-4c87-b2b6-eb6e9e996aa1 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:05.994639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e530bbc8-1c41-4c87-b2b6-eb6e9e996aa1 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:06.000489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e530bbc8-1c41-4c87-b2b6-eb6e9e996aa1 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:06.009557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e530bbc8-1c41-4c87-b2b6-eb6e9e996aa1 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:06.054002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:06.162508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9586cd39-ccd0-4bc7-98c4-054782bf63f2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:06.171826 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9586cd39-ccd0-4bc7-98c4-054782bf63f2 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/580d21d0-dc33-49d4-b15c-24ffdba7ad7d" status: 200 len: 1318 microversion: 2.1 time: 1.347207 May 27 15:18:06.175125 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2304/4595] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:04 2022] GET /compute/v2.1/servers/580d21d0-dc33-49d4-b15c-24ffdba7ad7d => generated 1318 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:06.199257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3abb81ce-05d4-440b-9097-9312e4a81253 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:06.200366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3abb81ce-05d4-440b-9097-9312e4a81253 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:06.213998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3abb81ce-05d4-440b-9097-9312e4a81253 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:06.216603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3abb81ce-05d4-440b-9097-9312e4a81253 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:06.217536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3abb81ce-05d4-440b-9097-9312e4a81253 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:06.223399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3abb81ce-05d4-440b-9097-9312e4a81253 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:06.288559 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3abb81ce-05d4-440b-9097-9312e4a81253 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101576 May 27 15:18:06.292310 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2305/4596] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:18:06 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:06.304864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f6acde62-2e29-4c13-8c09-182990c862b0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:06.319786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6acde62-2e29-4c13-8c09-182990c862b0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:06.320502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6acde62-2e29-4c13-8c09-182990c862b0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:06.374561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f6acde62-2e29-4c13-8c09-182990c862b0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Going to try to start instance {{(pid=119249) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 15:18:06.471075 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f6acde62-2e29-4c13-8c09-182990c862b0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "POST /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376/action" status: 202 len: 0 microversion: 2.1 time: 0.176676 May 27 15:18:06.477126 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2306/4597] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:18:06 2022] POST /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:18:06.489573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-943eca4b-2002-41da-bc3b-90b3e3277a70 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:06.493822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-943eca4b-2002-41da-bc3b-90b3e3277a70 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:06.508497 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-943eca4b-2002-41da-bc3b-90b3e3277a70 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:06.510330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-943eca4b-2002-41da-bc3b-90b3e3277a70 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:06.512552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-943eca4b-2002-41da-bc3b-90b3e3277a70 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:06.513300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-943eca4b-2002-41da-bc3b-90b3e3277a70 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:06.844907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e530bbc8-1c41-4c87-b2b6-eb6e9e996aa1 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:06.873045 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e530bbc8-1c41-4c87-b2b6-eb6e9e996aa1 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1332 microversion: 2.1 time: 0.891377 May 27 15:18:06.875916 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2292/4598] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:05 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1332 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:06.889238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-f273568a-7361-4328-b9a9-33dcb0d948ce req-e6a65103-2dbf-4a6b-841c-5869c198fbeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "580d21d0-dc33-49d4-b15c-24ffdba7ad7d", "name": "network-vif-plugged", "status": "completed", "tag": "d0093499-f5a6-4da3-8d0b-7805c65fcfd8"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:06.896868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-943eca4b-2002-41da-bc3b-90b3e3277a70 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:06.906131 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-943eca4b-2002-41da-bc3b-90b3e3277a70 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1664 microversion: 2.1 time: 0.426811 May 27 15:18:06.912182 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2307/4599] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:06 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1664 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:06.938710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-f273568a-7361-4328-b9a9-33dcb0d948ce req-e6a65103-2dbf-4a6b-841c-5869c198fbeb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:06.939825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-f273568a-7361-4328-b9a9-33dcb0d948ce req-e6a65103-2dbf-4a6b-841c-5869c198fbeb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:07.010550 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-f273568a-7361-4328-b9a9-33dcb0d948ce req-e6a65103-2dbf-4a6b-841c-5869c198fbeb service nova] Creating event network-vif-plugged:d0093499-f5a6-4da3-8d0b-7805c65fcfd8 for instance 580d21d0-dc33-49d4-b15c-24ffdba7ad7d on n-h1-843621-1 May 27 15:18:07.029029 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-f273568a-7361-4328-b9a9-33dcb0d948ce req-e6a65103-2dbf-4a6b-841c-5869c198fbeb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147382 May 27 15:18:07.029867 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2293/4600] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:07.193701 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-17184889-89f8-4c9b-8b12-c203aa949ce0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:07.194425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-17184889-89f8-4c9b-8b12-c203aa949ce0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 580d21d0-dc33-49d4-b15c-24ffdba7ad7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:07.203746 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17184889-89f8-4c9b-8b12-c203aa949ce0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:07.204202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17184889-89f8-4c9b-8b12-c203aa949ce0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:07.205093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17184889-89f8-4c9b-8b12-c203aa949ce0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:07.205458 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17184889-89f8-4c9b-8b12-c203aa949ce0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:07.306420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-43b5ae30-e6c8-45eb-996f-ceb9610f11e8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:07.308834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-43b5ae30-e6c8-45eb-996f-ceb9610f11e8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:07.328194 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-43b5ae30-e6c8-45eb-996f-ceb9610f11e8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:07.329108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-43b5ae30-e6c8-45eb-996f-ceb9610f11e8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:07.333018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-43b5ae30-e6c8-45eb-996f-ceb9610f11e8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:07.334727 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-43b5ae30-e6c8-45eb-996f-ceb9610f11e8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:07.527624 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-43b5ae30-e6c8-45eb-996f-ceb9610f11e8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.228041 May 27 15:18:07.542311 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2294/4601] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:18:07 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments => generated 197 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:18:07.625256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-17184889-89f8-4c9b-8b12-c203aa949ce0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:07.638911 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-17184889-89f8-4c9b-8b12-c203aa949ce0 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/580d21d0-dc33-49d4-b15c-24ffdba7ad7d" status: 200 len: 1318 microversion: 2.1 time: 0.449210 May 27 15:18:07.645135 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2308/4602] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:07 2022] GET /compute/v2.1/servers/580d21d0-dc33-49d4-b15c-24ffdba7ad7d => generated 1318 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:07.834269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3fbdab26-9a8d-4660-8cc3-86bc91e500e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-869793403", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "679b759f-4940-4405-a687-165c11fb616b"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:07.891327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9354aa09-90c1-4119-a9d6-969eb32f3b80 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:07.892031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9354aa09-90c1-4119-a9d6-969eb32f3b80 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:07.900045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9354aa09-90c1-4119-a9d6-969eb32f3b80 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:07.900480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9354aa09-90c1-4119-a9d6-969eb32f3b80 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:07.912862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9354aa09-90c1-4119-a9d6-969eb32f3b80 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:07.913407 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9354aa09-90c1-4119-a9d6-969eb32f3b80 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:07.925090 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-3fbdab26-9a8d-4660-8cc3-86bc91e500e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] validate_networks() for [('679b759f-4940-4405-a687-165c11fb616b', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:18:08.369841 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9354aa09-90c1-4119-a9d6-969eb32f3b80 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:08.390760 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9354aa09-90c1-4119-a9d6-969eb32f3b80 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1535 microversion: 2.1 time: 0.502616 May 27 15:18:08.393768 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2309/4603] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:07 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1535 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:08.400949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a0e114cc-ee81-48a1-9f39-7e7573acfa4d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:08.402763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a0e114cc-ee81-48a1-9f39-7e7573acfa4d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:08.448292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a0e114cc-ee81-48a1-9f39-7e7573acfa4d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:08.449895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a0e114cc-ee81-48a1-9f39-7e7573acfa4d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:08.453968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a0e114cc-ee81-48a1-9f39-7e7573acfa4d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:08.454774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a0e114cc-ee81-48a1-9f39-7e7573acfa4d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:08.849688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a0e114cc-ee81-48a1-9f39-7e7573acfa4d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:08.880021 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a0e114cc-ee81-48a1-9f39-7e7573acfa4d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1664 microversion: 2.1 time: 0.484962 May 27 15:18:08.880544 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2310/4604] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:08 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1664 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:08.903935 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3a59fdd2-2245-44b0-803f-2d5d5cc023e7 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Action: 'create', calling method: .version_select at 0x7fc775b4fe50>, body: {"pool": "40c8a0ba-5936-492c-a22b-60fbf77c5793"} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:09.336450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3fbdab26-9a8d-4660-8cc3-86bc91e500e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:18:09.337485 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3fbdab26-9a8d-4660-8cc3-86bc91e500e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:18:09.338126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3fbdab26-9a8d-4660-8cc3-86bc91e500e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:18:09.338704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3fbdab26-9a8d-4660-8cc3-86bc91e500e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:18:09.340119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3fbdab26-9a8d-4660-8cc3-86bc91e500e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:18:09.366159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3fbdab26-9a8d-4660-8cc3-86bc91e500e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:09.368838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3fbdab26-9a8d-4660-8cc3-86bc91e500e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:09.371663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3fbdab26-9a8d-4660-8cc3-86bc91e500e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:09.373506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3fbdab26-9a8d-4660-8cc3-86bc91e500e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:09.418185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-3fbdab26-9a8d-4660-8cc3-86bc91e500e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Getting quotas for project db397cde9e67464182a7ba045f1779be. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:09.432072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-3fbdab26-9a8d-4660-8cc3-86bc91e500e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Getting quotas for user 2f0525081cf441998d2c320fa0087cff and project db397cde9e67464182a7ba045f1779be. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:09.461829 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3fbdab26-9a8d-4660-8cc3-86bc91e500e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:18:09.464166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3fbdab26-9a8d-4660-8cc3-86bc91e500e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 9986bdac-9b6e-4175-ae4e-afb0adc396cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:18:09.582564 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3fbdab26-9a8d-4660-8cc3-86bc91e500e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.039569 May 27 15:18:09.603452 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2295/4605] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:18:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:18:09.616016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e2773b12-4624-4d5b-9780-fa8f2bd387e8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:09.622286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e2773b12-4624-4d5b-9780-fa8f2bd387e8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:09.634299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2773b12-4624-4d5b-9780-fa8f2bd387e8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:09.636387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2773b12-4624-4d5b-9780-fa8f2bd387e8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:09.637493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2773b12-4624-4d5b-9780-fa8f2bd387e8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:09.641549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2773b12-4624-4d5b-9780-fa8f2bd387e8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:09.716814 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e2773b12-4624-4d5b-9780-fa8f2bd387e8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111849 May 27 15:18:09.724790 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2296/4606] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:18:09 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:09.734200 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-704f7319-9150-4194-a7a3-4cc4f15521b7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:09.736798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-704f7319-9150-4194-a7a3-4cc4f15521b7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 580d21d0-dc33-49d4-b15c-24ffdba7ad7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:09.754100 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-704f7319-9150-4194-a7a3-4cc4f15521b7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:09.757520 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-704f7319-9150-4194-a7a3-4cc4f15521b7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:09.758749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-704f7319-9150-4194-a7a3-4cc4f15521b7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:09.759401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-704f7319-9150-4194-a7a3-4cc4f15521b7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:10.485500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-704f7319-9150-4194-a7a3-4cc4f15521b7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:10.503017 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-704f7319-9150-4194-a7a3-4cc4f15521b7 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/580d21d0-dc33-49d4-b15c-24ffdba7ad7d" status: 200 len: 1505 microversion: 2.1 time: 0.776418 May 27 15:18:10.520852 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2297/4607] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:09 2022] GET /compute/v2.1/servers/580d21d0-dc33-49d4-b15c-24ffdba7ad7d => generated 1505 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:10.531641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-315b488e-b3f8-4546-a69e-038c53892889 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:10.537034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-315b488e-b3f8-4546-a69e-038c53892889 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 9986bdac-9b6e-4175-ae4e-afb0adc396cc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:10.553084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-315b488e-b3f8-4546-a69e-038c53892889 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:10.554020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-315b488e-b3f8-4546-a69e-038c53892889 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:10.556900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-315b488e-b3f8-4546-a69e-038c53892889 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:10.557713 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-315b488e-b3f8-4546-a69e-038c53892889 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:10.807979 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-315b488e-b3f8-4546-a69e-038c53892889 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:10.820192 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-315b488e-b3f8-4546-a69e-038c53892889 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc" status: 200 len: 1196 microversion: 2.1 time: 0.291833 May 27 15:18:10.822166 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2298/4608] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:10 2022] GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc => generated 1196 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:10.831661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-809ad2c9-24a1-472c-a789-ea9ae14c842e tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:10.834091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-809ad2c9-24a1-472c-a789-ea9ae14c842e tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:10.849488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-809ad2c9-24a1-472c-a789-ea9ae14c842e tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:10.850592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-809ad2c9-24a1-472c-a789-ea9ae14c842e tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:10.851819 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-809ad2c9-24a1-472c-a789-ea9ae14c842e tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:10.853149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-809ad2c9-24a1-472c-a789-ea9ae14c842e tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:11.109922 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-809ad2c9-24a1-472c-a789-ea9ae14c842e tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:11.117904 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-809ad2c9-24a1-472c-a789-ea9ae14c842e tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1668 microversion: 2.1 time: 0.293861 May 27 15:18:11.121345 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2299/4609] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:10 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1668 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:11.136240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-885a8f4c-5ab6-498e-a0a5-2ada0cfa6e83 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:11.137072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-885a8f4c-5ab6-498e-a0a5-2ada0cfa6e83 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 580d21d0-dc33-49d4-b15c-24ffdba7ad7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:11.147609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-885a8f4c-5ab6-498e-a0a5-2ada0cfa6e83 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:11.150955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-885a8f4c-5ab6-498e-a0a5-2ada0cfa6e83 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:11.151959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-885a8f4c-5ab6-498e-a0a5-2ada0cfa6e83 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:11.153716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-885a8f4c-5ab6-498e-a0a5-2ada0cfa6e83 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:11.219137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-885a8f4c-5ab6-498e-a0a5-2ada0cfa6e83 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 580d21d0-dc33-49d4-b15c-24ffdba7ad7d] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:18:11.377107 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-885a8f4c-5ab6-498e-a0a5-2ada0cfa6e83 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "DELETE /compute/v2.1/servers/580d21d0-dc33-49d4-b15c-24ffdba7ad7d" status: 204 len: 0 microversion: 2.1 time: 0.253303 May 27 15:18:11.378031 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2300/4610] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:18:11 2022] DELETE /compute/v2.1/servers/580d21d0-dc33-49d4-b15c-24ffdba7ad7d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:18:11.397764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9a86daa4-dec4-4a67-9d8e-ef1cb04c997e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:11.402697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9a86daa4-dec4-4a67-9d8e-ef1cb04c997e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:11.421743 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a86daa4-dec4-4a67-9d8e-ef1cb04c997e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:11.423205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a86daa4-dec4-4a67-9d8e-ef1cb04c997e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:11.427529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a86daa4-dec4-4a67-9d8e-ef1cb04c997e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:11.428981 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a86daa4-dec4-4a67-9d8e-ef1cb04c997e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:11.494422 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9a86daa4-dec4-4a67-9d8e-ef1cb04c997e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111926 May 27 15:18:11.495152 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2301/4611] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:18:11 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:11.504148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b58bbc44-3259-4989-9548-41e00364f18c tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:11.504662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b58bbc44-3259-4989-9548-41e00364f18c tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 16f0ab29-0848-4e22-99ab-f8b98d99df6e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:11.511326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b58bbc44-3259-4989-9548-41e00364f18c tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:11.511782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b58bbc44-3259-4989-9548-41e00364f18c tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:11.512560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b58bbc44-3259-4989-9548-41e00364f18c tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:11.513018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b58bbc44-3259-4989-9548-41e00364f18c tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:11.540461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b58bbc44-3259-4989-9548-41e00364f18c tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 16f0ab29-0848-4e22-99ab-f8b98d99df6e] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:18:11.612095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:11.635330 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b58bbc44-3259-4989-9548-41e00364f18c tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "DELETE /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e" status: 204 len: 0 microversion: 2.1 time: 0.135072 May 27 15:18:11.636441 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2302/4612] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:18:11 2022] DELETE /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:18:11.647648 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-30735b48-d5d2-406a-8e7f-25ab52c5230a tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:11.648418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-30735b48-d5d2-406a-8e7f-25ab52c5230a tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 580d21d0-dc33-49d4-b15c-24ffdba7ad7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:11.659028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30735b48-d5d2-406a-8e7f-25ab52c5230a tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:11.659486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30735b48-d5d2-406a-8e7f-25ab52c5230a tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:11.660645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30735b48-d5d2-406a-8e7f-25ab52c5230a tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:11.661299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30735b48-d5d2-406a-8e7f-25ab52c5230a tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:11.836178 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3a59fdd2-2245-44b0-803f-2d5d5cc023e7 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.954124 May 27 15:18:11.843187 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2311/4613] 10.222.0.13 () {60 vars in 1169 bytes} [Fri May 27 15:18:08 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:11.847026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3bbe2674-5c1f-4647-9899-4fcd2a9795bc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:11.848165 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3bbe2674-5c1f-4647-9899-4fcd2a9795bc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 9986bdac-9b6e-4175-ae4e-afb0adc396cc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:11.860070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3bbe2674-5c1f-4647-9899-4fcd2a9795bc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:11.860538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3bbe2674-5c1f-4647-9899-4fcd2a9795bc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:11.861360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3bbe2674-5c1f-4647-9899-4fcd2a9795bc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:11.861911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3bbe2674-5c1f-4647-9899-4fcd2a9795bc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:12.019534 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3bbe2674-5c1f-4647-9899-4fcd2a9795bc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:12.040065 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3bbe2674-5c1f-4647-9899-4fcd2a9795bc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc" status: 200 len: 1252 microversion: 2.1 time: 0.200586 May 27 15:18:12.041686 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2312/4614] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:11 2022] GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc => generated 1252 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:12.055428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-98d1e647-4a2f-41dc-8fa0-edfa3b5eeb2c tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Action: 'action', calling method: .version_select at 0x7fc77d74e4c0>, body: {"addFloatingIp": {"address": "172.25.2.128"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:12.057198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-98d1e647-4a2f-41dc-8fa0-edfa3b5eeb2c tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:12.075117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98d1e647-4a2f-41dc-8fa0-edfa3b5eeb2c tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:12.076622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98d1e647-4a2f-41dc-8fa0-edfa3b5eeb2c tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:12.078665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98d1e647-4a2f-41dc-8fa0-edfa3b5eeb2c tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:12.080940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98d1e647-4a2f-41dc-8fa0-edfa3b5eeb2c tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:12.111141 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-30735b48-d5d2-406a-8e7f-25ab52c5230a tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:12.137596 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-30735b48-d5d2-406a-8e7f-25ab52c5230a tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/580d21d0-dc33-49d4-b15c-24ffdba7ad7d" status: 200 len: 1511 microversion: 2.1 time: 0.495212 May 27 15:18:12.138496 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2303/4615] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:11 2022] GET /compute/v2.1/servers/580d21d0-dc33-49d4-b15c-24ffdba7ad7d => generated 1511 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:12.140960 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98d1e647-4a2f-41dc-8fa0-edfa3b5eeb2c tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Acquired lock "refresh_cache-6821f22b-21ec-4a40-9b7e-0d887b8e2fba" {{(pid=119249) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 15:18:12.506602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e26d59ff-8a93-45b8-941a-df884d268ca8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:12.508564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e26d59ff-8a93-45b8-941a-df884d268ca8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:12.525482 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e26d59ff-8a93-45b8-941a-df884d268ca8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:12.525482 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e26d59ff-8a93-45b8-941a-df884d268ca8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:12.526102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e26d59ff-8a93-45b8-941a-df884d268ca8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:12.534535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e26d59ff-8a93-45b8-941a-df884d268ca8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:12.651464 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e26d59ff-8a93-45b8-941a-df884d268ca8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148678 May 27 15:18:12.654585 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2304/4616] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:18:12 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:13.058770 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7042a367-73b4-4d3f-b79e-39de43a349dd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:13.059763 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7042a367-73b4-4d3f-b79e-39de43a349dd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 9986bdac-9b6e-4175-ae4e-afb0adc396cc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:13.074550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7042a367-73b4-4d3f-b79e-39de43a349dd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:13.075352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7042a367-73b4-4d3f-b79e-39de43a349dd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:13.076382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7042a367-73b4-4d3f-b79e-39de43a349dd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:13.077155 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7042a367-73b4-4d3f-b79e-39de43a349dd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:13.290289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7042a367-73b4-4d3f-b79e-39de43a349dd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:13.302929 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7042a367-73b4-4d3f-b79e-39de43a349dd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc" status: 200 len: 1250 microversion: 2.1 time: 0.247104 May 27 15:18:13.306163 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2305/4617] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:13 2022] GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc => generated 1250 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:13.315079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-27129921-223f-4e78-8b06-7ece6bbf33af tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:13.319043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-27129921-223f-4e78-8b06-7ece6bbf33af tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 580d21d0-dc33-49d4-b15c-24ffdba7ad7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:13.332276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27129921-223f-4e78-8b06-7ece6bbf33af tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:13.332809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27129921-223f-4e78-8b06-7ece6bbf33af tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:13.333604 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27129921-223f-4e78-8b06-7ece6bbf33af tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:13.338341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27129921-223f-4e78-8b06-7ece6bbf33af tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:13.835127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-27129921-223f-4e78-8b06-7ece6bbf33af tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:13.837459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:13.846715 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-27129921-223f-4e78-8b06-7ece6bbf33af tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/580d21d0-dc33-49d4-b15c-24ffdba7ad7d" status: 200 len: 1511 microversion: 2.1 time: 0.537566 May 27 15:18:13.847428 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2306/4618] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:13 2022] GET /compute/v2.1/servers/580d21d0-dc33-49d4-b15c-24ffdba7ad7d => generated 1511 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:13.873902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-51b23647-10f9-499d-9cbd-fbd5aa42f90f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:13.874852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-51b23647-10f9-499d-9cbd-fbd5aa42f90f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:13.899439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51b23647-10f9-499d-9cbd-fbd5aa42f90f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:13.900133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51b23647-10f9-499d-9cbd-fbd5aa42f90f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:13.913927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51b23647-10f9-499d-9cbd-fbd5aa42f90f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:13.914561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51b23647-10f9-499d-9cbd-fbd5aa42f90f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:14.028253 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-51b23647-10f9-499d-9cbd-fbd5aa42f90f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162121 May 27 15:18:14.032312 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2307/4619] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:18:13 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:14.321716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1181ff86-606f-4ecb-a798-5df70f14c764 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:14.322487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1181ff86-606f-4ecb-a798-5df70f14c764 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 9986bdac-9b6e-4175-ae4e-afb0adc396cc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:14.343891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1181ff86-606f-4ecb-a798-5df70f14c764 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:14.344360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1181ff86-606f-4ecb-a798-5df70f14c764 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:14.348299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1181ff86-606f-4ecb-a798-5df70f14c764 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:14.348815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1181ff86-606f-4ecb-a798-5df70f14c764 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:15.106783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1181ff86-606f-4ecb-a798-5df70f14c764 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:15.118864 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1181ff86-606f-4ecb-a798-5df70f14c764 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc" status: 200 len: 1292 microversion: 2.1 time: 0.800933 May 27 15:18:15.120237 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2308/4620] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:14 2022] GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc => generated 1292 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:15.133406 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-04dab033-c797-49ea-91d2-fe6f83e7b50b tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:15.134054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-04dab033-c797-49ea-91d2-fe6f83e7b50b tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 580d21d0-dc33-49d4-b15c-24ffdba7ad7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:15.169012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04dab033-c797-49ea-91d2-fe6f83e7b50b tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:15.169504 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04dab033-c797-49ea-91d2-fe6f83e7b50b tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:15.170318 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04dab033-c797-49ea-91d2-fe6f83e7b50b tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:15.170817 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04dab033-c797-49ea-91d2-fe6f83e7b50b tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:15.452923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-04dab033-c797-49ea-91d2-fe6f83e7b50b tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:15.463931 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-04dab033-c797-49ea-91d2-fe6f83e7b50b tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/580d21d0-dc33-49d4-b15c-24ffdba7ad7d" status: 200 len: 1469 microversion: 2.1 time: 0.337530 May 27 15:18:15.466177 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2309/4621] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:15 2022] GET /compute/v2.1/servers/580d21d0-dc33-49d4-b15c-24ffdba7ad7d => generated 1469 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:15.475037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-87a866e4-0313-41a0-9e2a-9bda6a78f21f req-3159fda6-6ba3-4ed5-9eae-f516c59e6e0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f0ab29-0848-4e22-99ab-f8b98d99df6e", "name": "network-vif-deleted", "tag": "f0e758ee-2238-4ff6-95dd-a561b476d1c4"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:15.542069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-87a866e4-0313-41a0-9e2a-9bda6a78f21f req-3159fda6-6ba3-4ed5-9eae-f516c59e6e0b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:15.544278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-87a866e4-0313-41a0-9e2a-9bda6a78f21f req-3159fda6-6ba3-4ed5-9eae-f516c59e6e0b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:15.580275 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-87a866e4-0313-41a0-9e2a-9bda6a78f21f req-3159fda6-6ba3-4ed5-9eae-f516c59e6e0b service nova] Creating event network-vif-deleted:f0e758ee-2238-4ff6-95dd-a561b476d1c4 for instance 16f0ab29-0848-4e22-99ab-f8b98d99df6e on n-h2-843621-1 May 27 15:18:15.591689 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-87a866e4-0313-41a0-9e2a-9bda6a78f21f req-3159fda6-6ba3-4ed5-9eae-f516c59e6e0b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123993 May 27 15:18:15.595072 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2310/4622] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:15.627718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-35d34195-f8c1-4204-807a-5685268082a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:15.632351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-35d34195-f8c1-4204-807a-5685268082a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:15.659693 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-35d34195-f8c1-4204-807a-5685268082a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:15.665941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-35d34195-f8c1-4204-807a-5685268082a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:15.668566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-35d34195-f8c1-4204-807a-5685268082a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:15.670458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-35d34195-f8c1-4204-807a-5685268082a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:15.790002 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-35d34195-f8c1-4204-807a-5685268082a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193350 May 27 15:18:15.790620 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2311/4623] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:18:15 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:16.139083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2fe8bd9d-c2bd-4a1b-b325-debbd38673d0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:16.140374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2fe8bd9d-c2bd-4a1b-b325-debbd38673d0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 9986bdac-9b6e-4175-ae4e-afb0adc396cc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:16.153372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2fe8bd9d-c2bd-4a1b-b325-debbd38673d0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:16.153910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2fe8bd9d-c2bd-4a1b-b325-debbd38673d0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:16.154710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2fe8bd9d-c2bd-4a1b-b325-debbd38673d0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:16.155700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2fe8bd9d-c2bd-4a1b-b325-debbd38673d0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:16.920846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2fe8bd9d-c2bd-4a1b-b325-debbd38673d0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:16.943868 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2fe8bd9d-c2bd-4a1b-b325-debbd38673d0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc" status: 200 len: 1292 microversion: 2.1 time: 0.808596 May 27 15:18:16.944469 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2312/4624] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:16 2022] GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc => generated 1292 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:16.979991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-05219c28-5771-45fc-8b15-991e88e4e4c3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:16.980708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-05219c28-5771-45fc-8b15-991e88e4e4c3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 580d21d0-dc33-49d4-b15c-24ffdba7ad7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:17.012413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05219c28-5771-45fc-8b15-991e88e4e4c3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:17.014965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05219c28-5771-45fc-8b15-991e88e4e4c3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:17.017885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05219c28-5771-45fc-8b15-991e88e4e4c3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:17.019452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05219c28-5771-45fc-8b15-991e88e4e4c3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:17.168852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05219c28-5771-45fc-8b15-991e88e4e4c3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:17.170525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05219c28-5771-45fc-8b15-991e88e4e4c3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:17.171975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-05219c28-5771-45fc-8b15-991e88e4e4c3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lazy-loading 'fault' on Instance uuid 580d21d0-dc33-49d4-b15c-24ffdba7ad7d {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:18:17.578912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-98d1e647-4a2f-41dc-8fa0-edfa3b5eeb2c tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Building network info cache for instance {{(pid=119249) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 27 15:18:17.669359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-05219c28-5771-45fc-8b15-991e88e4e4c3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572426dd79d94a91bba9cd86d6542042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7353d23e19b45a5b5297d04f7ef71cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:17.679762 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-05219c28-5771-45fc-8b15-991e88e4e4c3 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/580d21d0-dc33-49d4-b15c-24ffdba7ad7d" status: 200 len: 1308 microversion: 2.1 time: 0.731057 May 27 15:18:17.691959 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2313/4625] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:16 2022] GET /compute/v2.1/servers/580d21d0-dc33-49d4-b15c-24ffdba7ad7d => generated 1308 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:17.701955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-b493941d-7e7d-41f2-83b0-97a9e619b6e3 req-c61006fc-3932-4708-ab55-ef551f8b6d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "580d21d0-dc33-49d4-b15c-24ffdba7ad7d", "name": "network-vif-deleted", "tag": "d0093499-f5a6-4da3-8d0b-7805c65fcfd8"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:17.724865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-b493941d-7e7d-41f2-83b0-97a9e619b6e3 req-c61006fc-3932-4708-ab55-ef551f8b6d54 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:17.725416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-b493941d-7e7d-41f2-83b0-97a9e619b6e3 req-c61006fc-3932-4708-ab55-ef551f8b6d54 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:17.757247 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-b493941d-7e7d-41f2-83b0-97a9e619b6e3 req-c61006fc-3932-4708-ab55-ef551f8b6d54 service nova] Creating event network-vif-deleted:d0093499-f5a6-4da3-8d0b-7805c65fcfd8 for instance 580d21d0-dc33-49d4-b15c-24ffdba7ad7d on n-h1-843621-1 May 27 15:18:17.768829 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-b493941d-7e7d-41f2-83b0-97a9e619b6e3 req-c61006fc-3932-4708-ab55-ef551f8b6d54 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074693 May 27 15:18:17.770646 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2314/4626] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:17.784489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-140f46f0-c212-45bc-bb2a-06b26a688c5d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:17.789437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-140f46f0-c212-45bc-bb2a-06b26a688c5d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:17.803163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-140f46f0-c212-45bc-bb2a-06b26a688c5d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:17.807229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-140f46f0-c212-45bc-bb2a-06b26a688c5d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:17.808135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-140f46f0-c212-45bc-bb2a-06b26a688c5d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:17.808596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-140f46f0-c212-45bc-bb2a-06b26a688c5d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:17.893512 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-140f46f0-c212-45bc-bb2a-06b26a688c5d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118927 May 27 15:18:17.894321 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2315/4627] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:18:17 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:17.906245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-4686be5b-9dc0-4171-b9ea-82f23aedc470 req-a7f4b3b4-5641-4896-a414-817426ba7234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6821f22b-21ec-4a40-9b7e-0d887b8e2fba", "tag": "16540a03-4c24-436b-959d-06095aca3ccd"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:17.926758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-4686be5b-9dc0-4171-b9ea-82f23aedc470 req-a7f4b3b4-5641-4896-a414-817426ba7234 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:17.927308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-4686be5b-9dc0-4171-b9ea-82f23aedc470 req-a7f4b3b4-5641-4896-a414-817426ba7234 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:17.992153 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-4686be5b-9dc0-4171-b9ea-82f23aedc470 req-a7f4b3b4-5641-4896-a414-817426ba7234 service nova] Creating event network-changed:16540a03-4c24-436b-959d-06095aca3ccd for instance 6821f22b-21ec-4a40-9b7e-0d887b8e2fba on n-h2-843621-1 May 27 15:18:17.999777 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-4686be5b-9dc0-4171-b9ea-82f23aedc470 req-a7f4b3b4-5641-4896-a414-817426ba7234 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103384 May 27 15:18:18.002208 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2316/4628] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:18.019089 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-53945572-8033-4e0a-8862-ad64f0c15532 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:18.021573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-53945572-8033-4e0a-8862-ad64f0c15532 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 9986bdac-9b6e-4175-ae4e-afb0adc396cc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:18.037253 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53945572-8033-4e0a-8862-ad64f0c15532 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:18.037712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53945572-8033-4e0a-8862-ad64f0c15532 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:18.043617 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53945572-8033-4e0a-8862-ad64f0c15532 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:18.044101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53945572-8033-4e0a-8862-ad64f0c15532 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:18.703828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-53945572-8033-4e0a-8862-ad64f0c15532 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:18.720782 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-53945572-8033-4e0a-8862-ad64f0c15532 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc" status: 200 len: 1292 microversion: 2.1 time: 0.712873 May 27 15:18:18.721503 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2317/4629] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:18 2022] GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc => generated 1292 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:18.736124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b4393622-7a92-4ff0-bb20-45a9fcfc7fbd tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:18.736867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b4393622-7a92-4ff0-bb20-45a9fcfc7fbd tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 580d21d0-dc33-49d4-b15c-24ffdba7ad7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:18.747079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4393622-7a92-4ff0-bb20-45a9fcfc7fbd tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:18.747817 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4393622-7a92-4ff0-bb20-45a9fcfc7fbd tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:18.751857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4393622-7a92-4ff0-bb20-45a9fcfc7fbd tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:18.753150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4393622-7a92-4ff0-bb20-45a9fcfc7fbd tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:18.788030 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-b4393622-7a92-4ff0-bb20-45a9fcfc7fbd tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] HTTP exception thrown: Instance 580d21d0-dc33-49d4-b15c-24ffdba7ad7d could not be found. May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b4393622-7a92-4ff0-bb20-45a9fcfc7fbd tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Request method failure captured: May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/580d21d0-dc33-49d4-b15c-24ffdba7ad7d HTTP/1.1 May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOt3X_w7dlL9XUXddDE2waR_kr6Z45l64RsdcQEKIjgyvtHCUEJXQEi8Xb1Vm5qPbrV5NApa6N-4-p7oAerSIuQ8mjW_fvWyiP99kDSaQlEBGnUH2kXYC77Zal8LMSQtOBP6qmsnDGJ8UAd0S-ZWMciBNi8R1rzgNSZr5OObqeWoGjo May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: a7353d23e19b45a5b5297d04f7ef71cb May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-MultipleCreateTestJSON-675013457 May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a7353d23e19b45a5b5297d04f7ef71cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a7353d23e19b45a5b5297d04f7ef71cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a7353d23e19b45a5b5297d04f7ef71cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a7353d23e19b45a5b5297d04f7ef71cb", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-MultipleCreateTestJSON-675013457 May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: a7353d23e19b45a5b5297d04f7ef71cb May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-MultipleCreateTestJSON-675013457 May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-MultipleCreateTestJSON-675013457-project May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 572426dd79d94a91bba9cd86d6542042 May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-MultipleCreateTestJSON-675013457-project May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 580d21d0-dc33-49d4-b15c-24ffdba7ad7d could not be found. May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '580d21d0-dc33-49d4-b15c-24ffdba7ad7d'} May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 580d21d0-dc33-49d4-b15c-24ffdba7ad7d could not be found. May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 580d21d0-dc33-49d4-b15c-24ffdba7ad7d could not be found. May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:18.794655 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:18.797724 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:18.797724 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:18.797724 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:18.797724 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:18.797724 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:18.797724 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 580d21d0-dc33-49d4-b15c-24ffdba7ad7d could not be found. May 27 15:18:18.797724 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:18.797724 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b4393622-7a92-4ff0-bb20-45a9fcfc7fbd tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Returning 404 to user: Instance 580d21d0-dc33-49d4-b15c-24ffdba7ad7d could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:18.797724 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b4393622-7a92-4ff0-bb20-45a9fcfc7fbd tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/580d21d0-dc33-49d4-b15c-24ffdba7ad7d" status: 404 len: 111 microversion: 2.1 time: 0.064118 May 27 15:18:18.800962 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2318/4630] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:18 2022] GET /compute/v2.1/servers/580d21d0-dc33-49d4-b15c-24ffdba7ad7d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:18.806373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-efae84c5-c88e-42a5-9952-ab5644b674a5 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:18.807049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-efae84c5-c88e-42a5-9952-ab5644b674a5 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] [instance: 16f0ab29-0848-4e22-99ab-f8b98d99df6e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:18.832874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-efae84c5-c88e-42a5-9952-ab5644b674a5 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:18.835424 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-efae84c5-c88e-42a5-9952-ab5644b674a5 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:18.837088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-efae84c5-c88e-42a5-9952-ab5644b674a5 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:18.837555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-efae84c5-c88e-42a5-9952-ab5644b674a5 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:18.883617 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-efae84c5-c88e-42a5-9952-ab5644b674a5 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] HTTP exception thrown: Instance 16f0ab29-0848-4e22-99ab-f8b98d99df6e could not be found. May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-efae84c5-c88e-42a5-9952-ab5644b674a5 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Request method failure captured: May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e HTTP/1.1 May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOt3X_w7dlL9XUXddDE2waR_kr6Z45l64RsdcQEKIjgyvtHCUEJXQEi8Xb1Vm5qPbrV5NApa6N-4-p7oAerSIuQ8mjW_fvWyiP99kDSaQlEBGnUH2kXYC77Zal8LMSQtOBP6qmsnDGJ8UAd0S-ZWMciBNi8R1rzgNSZr5OObqeWoGjo May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: a7353d23e19b45a5b5297d04f7ef71cb May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-MultipleCreateTestJSON-675013457 May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a7353d23e19b45a5b5297d04f7ef71cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a7353d23e19b45a5b5297d04f7ef71cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a7353d23e19b45a5b5297d04f7ef71cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a7353d23e19b45a5b5297d04f7ef71cb", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-MultipleCreateTestJSON-675013457 May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: a7353d23e19b45a5b5297d04f7ef71cb May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-MultipleCreateTestJSON-675013457 May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-MultipleCreateTestJSON-675013457-project May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 572426dd79d94a91bba9cd86d6542042 May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-MultipleCreateTestJSON-675013457-project May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 16f0ab29-0848-4e22-99ab-f8b98d99df6e could not be found. May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '16f0ab29-0848-4e22-99ab-f8b98d99df6e'} May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16f0ab29-0848-4e22-99ab-f8b98d99df6e could not be found. May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16f0ab29-0848-4e22-99ab-f8b98d99df6e could not be found. May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:18.887317 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:18.891262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:18.891262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:18.891262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:18.891262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:18.891262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:18.891262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16f0ab29-0848-4e22-99ab-f8b98d99df6e could not be found. May 27 15:18:18.891262 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:18.891262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-efae84c5-c88e-42a5-9952-ab5644b674a5 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] Returning 404 to user: Instance 16f0ab29-0848-4e22-99ab-f8b98d99df6e could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:18.891262 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-efae84c5-c88e-42a5-9952-ab5644b674a5 tempest-MultipleCreateTestJSON-675013457 tempest-MultipleCreateTestJSON-675013457-project] 10.222.0.13 "GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e" status: 404 len: 111 microversion: 2.1 time: 0.087126 May 27 15:18:18.894813 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2319/4631] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:18 2022] GET /compute/v2.1/servers/16f0ab29-0848-4e22-99ab-f8b98d99df6e => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:18.914220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5a10e720-60c2-416a-b1d6-afe3a0cfd142 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:18.915996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5a10e720-60c2-416a-b1d6-afe3a0cfd142 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:18.929960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a10e720-60c2-416a-b1d6-afe3a0cfd142 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:18.930430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a10e720-60c2-416a-b1d6-afe3a0cfd142 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:18.935860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a10e720-60c2-416a-b1d6-afe3a0cfd142 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:18.936500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a10e720-60c2-416a-b1d6-afe3a0cfd142 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:19.017499 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5a10e720-60c2-416a-b1d6-afe3a0cfd142 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112398 May 27 15:18:19.021844 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2320/4632] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:18:18 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:19.398016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-69dba14a-591c-4e32-9d56-3083e908a1e7 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1990768689", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "bbd5de2d-3f85-46bc-adf7-c57c36db0eb4"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:19.423857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:19.460296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:19.497885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-69dba14a-591c-4e32-9d56-3083e908a1e7 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] validate_networks() for [('bbd5de2d-3f85-46bc-adf7-c57c36db0eb4', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:18:20.663086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-98d1e647-4a2f-41dc-8fa0-edfa3b5eeb2c tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Updating instance_info_cache with network_info: [{"id": "16540a03-4c24-436b-959d-06095aca3ccd", "address": "fa:16:3e:bb:2b:73", "network": {"id": "f36d2574-5d53-4b40-8e21-3477336c8d77", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-39260674-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "47bcab40996f4487bfb203eaac11325f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap16540a03-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119249) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 27 15:18:20.682030 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98d1e647-4a2f-41dc-8fa0-edfa3b5eeb2c tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Releasing lock "refresh_cache-6821f22b-21ec-4a40-9b7e-0d887b8e2fba" {{(pid=119249) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 15:18:20.683147 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-98d1e647-4a2f-41dc-8fa0-edfa3b5eeb2c tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "POST /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba/action" status: 202 len: 0 microversion: 2.1 time: 8.640287 May 27 15:18:20.684263 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2313/4633] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:18:12 2022] POST /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba/action => generated 0 bytes in 8642 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 27 15:18:20.689250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5ea11ac4-ef32-452e-a8fc-591fbf1af499 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:20.697758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5ea11ac4-ef32-452e-a8fc-591fbf1af499 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 9986bdac-9b6e-4175-ae4e-afb0adc396cc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:20.710171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5ea11ac4-ef32-452e-a8fc-591fbf1af499 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:20.715601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5ea11ac4-ef32-452e-a8fc-591fbf1af499 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:20.716902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5ea11ac4-ef32-452e-a8fc-591fbf1af499 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:20.719246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5ea11ac4-ef32-452e-a8fc-591fbf1af499 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:20.968572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-69dba14a-591c-4e32-9d56-3083e908a1e7 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:18:20.969014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-69dba14a-591c-4e32-9d56-3083e908a1e7 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:18:20.970044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-69dba14a-591c-4e32-9d56-3083e908a1e7 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:18:20.971845 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-69dba14a-591c-4e32-9d56-3083e908a1e7 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:18:20.972359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-69dba14a-591c-4e32-9d56-3083e908a1e7 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:18:20.995021 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-69dba14a-591c-4e32-9d56-3083e908a1e7 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:20.995550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-69dba14a-591c-4e32-9d56-3083e908a1e7 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:20.996632 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-69dba14a-591c-4e32-9d56-3083e908a1e7 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:20.997137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-69dba14a-591c-4e32-9d56-3083e908a1e7 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.006776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5ea11ac4-ef32-452e-a8fc-591fbf1af499 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:21.015358 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5ea11ac4-ef32-452e-a8fc-591fbf1af499 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc" status: 200 len: 1292 microversion: 2.1 time: 0.329730 May 27 15:18:21.026536 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2314/4634] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:20 2022] GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc => generated 1292 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:21.026767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-69dba14a-591c-4e32-9d56-3083e908a1e7 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Getting quotas for project 1f687fdd15ef44408d880ba442eef96e. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:21.026860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-c76dfe0d-21ee-45ee-9ad3-f61d1baf0317 req-ec503fb0-84b3-4757-bda3-1c7aa133652a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9986bdac-9b6e-4175-ae4e-afb0adc396cc", "tag": "124b08a5-0194-45ca-a50a-b077be06b20d"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:21.033590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-69dba14a-591c-4e32-9d56-3083e908a1e7 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Getting quotas for user b135ff735afd48929e72164aafffa3e4 and project 1f687fdd15ef44408d880ba442eef96e. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:21.044171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-c76dfe0d-21ee-45ee-9ad3-f61d1baf0317 req-ec503fb0-84b3-4757-bda3-1c7aa133652a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.046167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-c76dfe0d-21ee-45ee-9ad3-f61d1baf0317 req-ec503fb0-84b3-4757-bda3-1c7aa133652a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.054663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-69dba14a-591c-4e32-9d56-3083e908a1e7 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:18:21.057736 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-69dba14a-591c-4e32-9d56-3083e908a1e7 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:18:21.075173 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-c76dfe0d-21ee-45ee-9ad3-f61d1baf0317 req-ec503fb0-84b3-4757-bda3-1c7aa133652a service nova] Creating event network-changed:124b08a5-0194-45ca-a50a-b077be06b20d for instance 9986bdac-9b6e-4175-ae4e-afb0adc396cc on n-h1-843621-1 May 27 15:18:21.085609 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-c76dfe0d-21ee-45ee-9ad3-f61d1baf0317 req-ec503fb0-84b3-4757-bda3-1c7aa133652a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066435 May 27 15:18:21.086235 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2315/4635] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:21.100907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e0452c55-72d8-40f2-a9bb-4b5ec0fe197f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:21.101943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e0452c55-72d8-40f2-a9bb-4b5ec0fe197f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:21.120404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0452c55-72d8-40f2-a9bb-4b5ec0fe197f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.120901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0452c55-72d8-40f2-a9bb-4b5ec0fe197f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.121808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0452c55-72d8-40f2-a9bb-4b5ec0fe197f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.122344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0452c55-72d8-40f2-a9bb-4b5ec0fe197f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.146748 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-69dba14a-591c-4e32-9d56-3083e908a1e7 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.122342 May 27 15:18:21.149421 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2321/4636] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:18:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:18:21.162504 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-928a3953-27d8-4df1-9c94-70ce0c5d248a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Action: 'create', calling method: .version_select at 0x7fc7756eef70>, body: {"pool": "40c8a0ba-5936-492c-a22b-60fbf77c5793"} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:21.202451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:21.206876 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e0452c55-72d8-40f2-a9bb-4b5ec0fe197f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110294 May 27 15:18:21.208085 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2316/4637] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:18:21 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:18:21.216742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0d97f8cf-a6ce-4a61-a01f-42b56988a43c tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:21.217666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0d97f8cf-a6ce-4a61-a01f-42b56988a43c tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:21.309879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0d97f8cf-a6ce-4a61-a01f-42b56988a43c tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b135ff735afd48929e72164aafffa3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f687fdd15ef44408d880ba442eef96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:21.323824 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0d97f8cf-a6ce-4a61-a01f-42b56988a43c tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c" status: 200 len: 1217 microversion: 2.1 time: 0.114248 May 27 15:18:21.324404 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2317/4638] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:21 2022] GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c => generated 1217 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:21.336268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-837126d7-c9e2-4837-b29f-d5869e88ac53 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:21.337047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-837126d7-c9e2-4837-b29f-d5869e88ac53 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:21.356986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-837126d7-c9e2-4837-b29f-d5869e88ac53 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.357569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-837126d7-c9e2-4837-b29f-d5869e88ac53 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.358985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-837126d7-c9e2-4837-b29f-d5869e88ac53 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.359643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-837126d7-c9e2-4837-b29f-d5869e88ac53 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.417195 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-837126d7-c9e2-4837-b29f-d5869e88ac53 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:18:21.619642 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-837126d7-c9e2-4837-b29f-d5869e88ac53 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "DELETE /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2" status: 204 len: 0 microversion: 2.1 time: 0.293294 May 27 15:18:21.620986 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2318/4639] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:18:21 2022] DELETE /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:18:21.650391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-57be7da9-d047-4aca-a661-4b89fa93c300 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:21.651369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-57be7da9-d047-4aca-a661-4b89fa93c300 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:21.660909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57be7da9-d047-4aca-a661-4b89fa93c300 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.661611 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57be7da9-d047-4aca-a661-4b89fa93c300 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.662686 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57be7da9-d047-4aca-a661-4b89fa93c300 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.663779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57be7da9-d047-4aca-a661-4b89fa93c300 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:22.252401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-57be7da9-d047-4aca-a661-4b89fa93c300 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:22.262356 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-57be7da9-d047-4aca-a661-4b89fa93c300 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2" status: 200 len: 1681 microversion: 2.1 time: 0.627391 May 27 15:18:22.266257 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2319/4640] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:21 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 => generated 1681 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:22.277823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-96a6aac2-5e05-4c06-b636-36dc30b4e1da tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:22.278637 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-96a6aac2-5e05-4c06-b636-36dc30b4e1da tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 9986bdac-9b6e-4175-ae4e-afb0adc396cc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:22.289998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96a6aac2-5e05-4c06-b636-36dc30b4e1da tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:22.291643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96a6aac2-5e05-4c06-b636-36dc30b4e1da tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:22.293085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96a6aac2-5e05-4c06-b636-36dc30b4e1da tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:22.293864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96a6aac2-5e05-4c06-b636-36dc30b4e1da tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:22.778900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-96a6aac2-5e05-4c06-b636-36dc30b4e1da tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:22.798926 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-96a6aac2-5e05-4c06-b636-36dc30b4e1da tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc" status: 200 len: 1292 microversion: 2.1 time: 0.531433 May 27 15:18:22.800581 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2320/4641] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:22 2022] GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc => generated 1292 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:22.807364 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9c7bb9a8-6c60-47e1-9cf6-198cb11deaba tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:22.809045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9c7bb9a8-6c60-47e1-9cf6-198cb11deaba tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:22.818528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9c7bb9a8-6c60-47e1-9cf6-198cb11deaba tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:22.820235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9c7bb9a8-6c60-47e1-9cf6-198cb11deaba tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:22.821501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9c7bb9a8-6c60-47e1-9cf6-198cb11deaba tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:22.823034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9c7bb9a8-6c60-47e1-9cf6-198cb11deaba tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:23.152498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9c7bb9a8-6c60-47e1-9cf6-198cb11deaba tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b135ff735afd48929e72164aafffa3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f687fdd15ef44408d880ba442eef96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:23.162355 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9c7bb9a8-6c60-47e1-9cf6-198cb11deaba tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c" status: 200 len: 1269 microversion: 2.1 time: 0.359403 May 27 15:18:23.166973 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2321/4642] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:22 2022] GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c => generated 1269 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:23.295425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-822da4e7-3c01-4064-aa0c-7962a96c5fe7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:23.296609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-822da4e7-3c01-4064-aa0c-7962a96c5fe7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:23.305440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-822da4e7-3c01-4064-aa0c-7962a96c5fe7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:23.309308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-822da4e7-3c01-4064-aa0c-7962a96c5fe7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:23.315006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-822da4e7-3c01-4064-aa0c-7962a96c5fe7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:23.315683 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-822da4e7-3c01-4064-aa0c-7962a96c5fe7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:23.902538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-822da4e7-3c01-4064-aa0c-7962a96c5fe7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:23.936845 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-822da4e7-3c01-4064-aa0c-7962a96c5fe7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2" status: 200 len: 1681 microversion: 2.1 time: 0.641162 May 27 15:18:23.939529 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2322/4643] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:23 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 => generated 1681 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:23.953563 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0daf2d84-307a-42c2-b259-704c63246851 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:23.956133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0daf2d84-307a-42c2-b259-704c63246851 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 9986bdac-9b6e-4175-ae4e-afb0adc396cc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:23.976783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0daf2d84-307a-42c2-b259-704c63246851 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:23.979536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0daf2d84-307a-42c2-b259-704c63246851 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:23.980984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0daf2d84-307a-42c2-b259-704c63246851 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:23.983821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0daf2d84-307a-42c2-b259-704c63246851 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:24.612018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0daf2d84-307a-42c2-b259-704c63246851 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:24.633680 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0daf2d84-307a-42c2-b259-704c63246851 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc" status: 200 len: 1292 microversion: 2.1 time: 0.691565 May 27 15:18:24.644007 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2323/4644] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:23 2022] GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc => generated 1292 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:24.644007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b9255020-a735-4a6b-a834-cb86f51d0099 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:24.645063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b9255020-a735-4a6b-a834-cb86f51d0099 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:24.662338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9255020-a735-4a6b-a834-cb86f51d0099 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:24.664100 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9255020-a735-4a6b-a834-cb86f51d0099 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:24.665411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9255020-a735-4a6b-a834-cb86f51d0099 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:24.666111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9255020-a735-4a6b-a834-cb86f51d0099 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:25.058113 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b9255020-a735-4a6b-a834-cb86f51d0099 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b135ff735afd48929e72164aafffa3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f687fdd15ef44408d880ba442eef96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:25.068986 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b9255020-a735-4a6b-a834-cb86f51d0099 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c" status: 200 len: 1317 microversion: 2.1 time: 0.433050 May 27 15:18:25.069586 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2324/4645] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:24 2022] GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c => generated 1317 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:25.075489 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-928a3953-27d8-4df1-9c94-70ce0c5d248a tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.923592 May 27 15:18:25.077635 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2322/4646] 10.222.0.13 () {60 vars in 1169 bytes} [Fri May 27 15:18:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:25.085293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3f6b7368-4360-48a1-9be8-e4df11b65c95 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:25.090301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3f6b7368-4360-48a1-9be8-e4df11b65c95 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:25.091945 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6be39782-e72c-4c76-a722-3269ba63aa56 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.178"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:25.093339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6be39782-e72c-4c76-a722-3269ba63aa56 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:25.097318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f6b7368-4360-48a1-9be8-e4df11b65c95 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:25.097983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f6b7368-4360-48a1-9be8-e4df11b65c95 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:25.098948 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f6b7368-4360-48a1-9be8-e4df11b65c95 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:25.099639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f6b7368-4360-48a1-9be8-e4df11b65c95 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:25.111661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6be39782-e72c-4c76-a722-3269ba63aa56 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:25.112407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6be39782-e72c-4c76-a722-3269ba63aa56 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:25.113589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6be39782-e72c-4c76-a722-3269ba63aa56 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:25.114296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6be39782-e72c-4c76-a722-3269ba63aa56 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:25.167664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6be39782-e72c-4c76-a722-3269ba63aa56 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Acquired lock "refresh_cache-6821f22b-21ec-4a40-9b7e-0d887b8e2fba" {{(pid=119248) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 15:18:25.578515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3f6b7368-4360-48a1-9be8-e4df11b65c95 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:25.594559 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3f6b7368-4360-48a1-9be8-e4df11b65c95 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2" status: 200 len: 1681 microversion: 2.1 time: 0.523392 May 27 15:18:25.594748 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2325/4647] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:25 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 => generated 1681 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:25.651582 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d1413681-4d4b-45b7-be5a-bf42825f00bf tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:25.652284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d1413681-4d4b-45b7-be5a-bf42825f00bf tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 9986bdac-9b6e-4175-ae4e-afb0adc396cc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:25.662998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1413681-4d4b-45b7-be5a-bf42825f00bf tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:25.663463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1413681-4d4b-45b7-be5a-bf42825f00bf tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:25.664253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1413681-4d4b-45b7-be5a-bf42825f00bf tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:25.664714 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1413681-4d4b-45b7-be5a-bf42825f00bf tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:26.144756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d1413681-4d4b-45b7-be5a-bf42825f00bf tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:26.153109 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d1413681-4d4b-45b7-be5a-bf42825f00bf tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc" status: 200 len: 1292 microversion: 2.1 time: 0.505290 May 27 15:18:26.163047 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2326/4648] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:25 2022] GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc => generated 1292 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:26.168251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0dffc191-b39b-4bfe-818a-48a2401a27b8 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:26.169525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0dffc191-b39b-4bfe-818a-48a2401a27b8 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:26.176949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0dffc191-b39b-4bfe-818a-48a2401a27b8 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:26.177586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0dffc191-b39b-4bfe-818a-48a2401a27b8 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:26.179456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0dffc191-b39b-4bfe-818a-48a2401a27b8 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:26.180061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0dffc191-b39b-4bfe-818a-48a2401a27b8 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:26.210298 n-d-843621-1 devstack@n-api.service[119248]: DEBUG neutronclient.v2_0.client [None req-6be39782-e72c-4c76-a722-3269ba63aa56 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.178 (2e3493e0-5861-4c4d-bbfc-9d9a2af69d9d) with port 16540a03-4c24-436b-959d-06095aca3ccd using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 40c8a0ba-5936-492c-a22b-60fbf77c5793.", "detail": ""}} {{(pid=119248) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 27 15:18:26.212064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6be39782-e72c-4c76-a722-3269ba63aa56 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Releasing lock "refresh_cache-6821f22b-21ec-4a40-9b7e-0d887b8e2fba" {{(pid=119248) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 15:18:26.212947 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-6be39782-e72c-4c76-a722-3269ba63aa56 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.178 (2e3493e0-5861-4c4d-bbfc-9d9a2af69d9d) with port 16540a03-4c24-436b-959d-06095aca3ccd using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 40c8a0ba-5936-492c-a22b-60fbf77c5793. May 27 15:18:26.212947 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-9f1c631b-6e93-4332-bf99-dea0be05ae3b'] May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6be39782-e72c-4c76-a722-3269ba63aa56 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Request method failure captured: May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba/action HTTP/1.1 May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 46 May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOuPOUWobEVIrqDfAz-NFCnm8fmxDs_WzonQ16wjqgzDBzn8mBkgOiKwTvGPytqKm12jDQT1LsJGDR6eq6lopz4aUeVvH7dyCUxrZlc4O8o3RNmoDXwg8q8LTX19Y40Tkgnq3dgjRWIjRD3CRQz5t50QhUsR0qzXvD8GcrdZvlqn250 May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 47bcab40996f4487bfb203eaac11325f May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/47bcab40996f4487bfb203eaac11325f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/47bcab40996f4487bfb203eaac11325f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/47bcab40996f4487bfb203eaac11325f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_47bcab40996f4487bfb203eaac11325f", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 47bcab40996f4487bfb203eaac11325f May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 15641271e7024b7bacb94612dae67d96 May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: {"addFloatingIp": {"address": "172.25.2.178"}} May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: exception: Cannot associate floating IP 172.25.2.178 (2e3493e0-5861-4c4d-bbfc-9d9a2af69d9d) with port 16540a03-4c24-436b-959d-06095aca3ccd using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 40c8a0ba-5936-492c-a22b-60fbf77c5793. May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-9f1c631b-6e93-4332-bf99-dea0be05ae3b'] May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '6821f22b-21ec-4a40-9b7e-0d887b8e2fba', 'body': {'addFloatingIp': {'address': '172.25.2.178'}}} May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2689, in associate_floating_ip May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 27 15:18:26.216162 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.178 (2e3493e0-5861-4c4d-bbfc-9d9a2af69d9d) with port 16540a03-4c24-436b-959d-06095aca3ccd using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 40c8a0ba-5936-492c-a22b-60fbf77c5793. May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f1c631b-6e93-4332-bf99-dea0be05ae3b'] May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2691, in associate_floating_ip May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.178 (2e3493e0-5861-4c4d-bbfc-9d9a2af69d9d) with port 16540a03-4c24-436b-959d-06095aca3ccd using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 40c8a0ba-5936-492c-a22b-60fbf77c5793. May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f1c631b-6e93-4332-bf99-dea0be05ae3b'] May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.178 (2e3493e0-5861-4c4d-bbfc-9d9a2af69d9d) with port 16540a03-4c24-436b-959d-06095aca3ccd using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 40c8a0ba-5936-492c-a22b-60fbf77c5793. May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f1c631b-6e93-4332-bf99-dea0be05ae3b'] May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.178 (2e3493e0-5861-4c4d-bbfc-9d9a2af69d9d) with port 16540a03-4c24-436b-959d-06095aca3ccd using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 40c8a0ba-5936-492c-a22b-60fbf77c5793. May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f1c631b-6e93-4332-bf99-dea0be05ae3b'] May 27 15:18:26.219376 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:26.229702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6be39782-e72c-4c76-a722-3269ba63aa56 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Returning 400 to user: Cannot associate floating IP 172.25.2.178 (2e3493e0-5861-4c4d-bbfc-9d9a2af69d9d) with port 16540a03-4c24-436b-959d-06095aca3ccd using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 40c8a0ba-5936-492c-a22b-60fbf77c5793. May 27 15:18:26.229702 n-d-843621-1 devstack@n-api.service[119248]: Neutron server returns request_ids: ['req-9f1c631b-6e93-4332-bf99-dea0be05ae3b'] {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:26.231108 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6be39782-e72c-4c76-a722-3269ba63aa56 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "POST /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba/action" status: 400 len: 382 microversion: 2.1 time: 1.142879 May 27 15:18:26.236109 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2323/4649] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:18:25 2022] POST /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba/action => generated 382 bytes in 1149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 27 15:18:26.242685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ff188cd8-1356-4353-bd31-5d8d5a8326cd tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '.version_select at 0x7fc7756eeca0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:26.633327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0dffc191-b39b-4bfe-818a-48a2401a27b8 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b135ff735afd48929e72164aafffa3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f687fdd15ef44408d880ba442eef96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:26.649559 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0dffc191-b39b-4bfe-818a-48a2401a27b8 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c" status: 200 len: 1317 microversion: 2.1 time: 0.479755 May 27 15:18:26.656466 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2327/4650] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:26 2022] GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c => generated 1317 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:26.676952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7df916bb-bbab-4700-b858-746820ee0a94 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:26.685266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7df916bb-bbab-4700-b858-746820ee0a94 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:26.712925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7df916bb-bbab-4700-b858-746820ee0a94 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:26.713392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7df916bb-bbab-4700-b858-746820ee0a94 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:26.714196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7df916bb-bbab-4700-b858-746820ee0a94 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:26.714641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7df916bb-bbab-4700-b858-746820ee0a94 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:27.045718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7df916bb-bbab-4700-b858-746820ee0a94 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:27.056150 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7df916bb-bbab-4700-b858-746820ee0a94 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2" status: 200 len: 1613 microversion: 2.1 time: 0.394850 May 27 15:18:27.068065 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2328/4651] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:26 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 => generated 1613 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:27.144570 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-4eeb490e-6b1f-4ace-9c74-f5df8bd9143a req-79f8dd07-e866-49a3-9ef6-b01f50649ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b815748c-e8c7-40e9-ada5-ef4b109b167c", "tag": "23e3058e-6d23-4f71-8251-80af2c48faa4"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:27.166262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4eeb490e-6b1f-4ace-9c74-f5df8bd9143a req-79f8dd07-e866-49a3-9ef6-b01f50649ad0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:27.168968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4eeb490e-6b1f-4ace-9c74-f5df8bd9143a req-79f8dd07-e866-49a3-9ef6-b01f50649ad0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:27.198269 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-4eeb490e-6b1f-4ace-9c74-f5df8bd9143a req-79f8dd07-e866-49a3-9ef6-b01f50649ad0 service nova] Creating event network-changed:23e3058e-6d23-4f71-8251-80af2c48faa4 for instance b815748c-e8c7-40e9-ada5-ef4b109b167c on n-h2-843621-1 May 27 15:18:27.210718 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-4eeb490e-6b1f-4ace-9c74-f5df8bd9143a req-79f8dd07-e866-49a3-9ef6-b01f50649ad0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071284 May 27 15:18:27.213025 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2329/4652] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:18:27.232750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dece5dcc-1443-431c-8a96-fe19773a9f8e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:27.233585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dece5dcc-1443-431c-8a96-fe19773a9f8e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 9986bdac-9b6e-4175-ae4e-afb0adc396cc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:27.249056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dece5dcc-1443-431c-8a96-fe19773a9f8e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:27.249527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dece5dcc-1443-431c-8a96-fe19773a9f8e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:27.251862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dece5dcc-1443-431c-8a96-fe19773a9f8e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:27.253178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dece5dcc-1443-431c-8a96-fe19773a9f8e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:27.550682 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dece5dcc-1443-431c-8a96-fe19773a9f8e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:27.562516 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dece5dcc-1443-431c-8a96-fe19773a9f8e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc" status: 200 len: 1292 microversion: 2.1 time: 0.345197 May 27 15:18:27.573006 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2330/4653] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:27 2022] GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc => generated 1292 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:28.081249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-78576d05-d582-4895-9320-1a3e7bbf693d tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2068480499", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "10aa0e2f-5e9d-4f02-901d-ebaacc318725"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:28.169434 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ff188cd8-1356-4353-bd31-5d8d5a8326cd tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/2e3493e0-5861-4c4d-bbfc-9d9a2af69d9d" status: 202 len: 0 microversion: 2.1 time: 1.931963 May 27 15:18:28.170019 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2324/4654] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 15:18:26 2022] DELETE /compute/v2.1/os-floating-ips/2e3493e0-5861-4c4d-bbfc-9d9a2af69d9d => generated 0 bytes in 1933 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:18:28.179353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-4e459917-e493-4731-8f44-ea0d961c54fa req-dd3ccadc-44c9-4bd2-9eb0-d4a1f8c282f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9986bdac-9b6e-4175-ae4e-afb0adc396cc", "name": "network-vif-plugged", "status": "completed", "tag": "124b08a5-0194-45ca-a50a-b077be06b20d"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:28.198175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-4e459917-e493-4731-8f44-ea0d961c54fa req-dd3ccadc-44c9-4bd2-9eb0-d4a1f8c282f4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:28.198634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-4e459917-e493-4731-8f44-ea0d961c54fa req-dd3ccadc-44c9-4bd2-9eb0-d4a1f8c282f4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:28.206926 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-78576d05-d582-4895-9320-1a3e7bbf693d tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] validate_networks() for [('10aa0e2f-5e9d-4f02-901d-ebaacc318725', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:18:28.221955 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-4e459917-e493-4731-8f44-ea0d961c54fa req-dd3ccadc-44c9-4bd2-9eb0-d4a1f8c282f4 service nova] Creating event network-vif-plugged:124b08a5-0194-45ca-a50a-b077be06b20d for instance 9986bdac-9b6e-4175-ae4e-afb0adc396cc on n-h1-843621-1 May 27 15:18:28.228245 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-4e459917-e493-4731-8f44-ea0d961c54fa req-dd3ccadc-44c9-4bd2-9eb0-d4a1f8c282f4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052886 May 27 15:18:28.229778 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2325/4655] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:28.239489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-85168596-de1f-45f3-ab3d-68520a4d0a14 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:28.240452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-85168596-de1f-45f3-ab3d-68520a4d0a14 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:28.264886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85168596-de1f-45f3-ab3d-68520a4d0a14 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:28.266550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85168596-de1f-45f3-ab3d-68520a4d0a14 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:28.268458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85168596-de1f-45f3-ab3d-68520a4d0a14 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:28.269803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85168596-de1f-45f3-ab3d-68520a4d0a14 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:28.514621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-85168596-de1f-45f3-ab3d-68520a4d0a14 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b135ff735afd48929e72164aafffa3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f687fdd15ef44408d880ba442eef96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:28.525250 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-85168596-de1f-45f3-ab3d-68520a4d0a14 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c" status: 200 len: 1317 microversion: 2.1 time: 0.293870 May 27 15:18:28.525998 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2326/4656] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:28 2022] GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:28.531456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fd8d39fc-5ebb-436d-ab41-085d76fc9b8e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:28.532351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fd8d39fc-5ebb-436d-ab41-085d76fc9b8e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:28.538786 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd8d39fc-5ebb-436d-ab41-085d76fc9b8e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:28.539809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd8d39fc-5ebb-436d-ab41-085d76fc9b8e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:28.540849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd8d39fc-5ebb-436d-ab41-085d76fc9b8e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:28.541509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd8d39fc-5ebb-436d-ab41-085d76fc9b8e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:28.557607 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-fd8d39fc-5ebb-436d-ab41-085d76fc9b8e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] HTTP exception thrown: Instance 37f90068-386b-4593-a1b7-a5e2232395b2 could not be found. May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fd8d39fc-5ebb-436d-ab41-085d76fc9b8e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Request method failure captured: May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 HTTP/1.1 May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOrMyApwEozUDyrEIfAo_5Y4g_1HkChw1SWcTHKZFCS59hbDZ-tG27fBruZ89SDVYIwJf1049Wu3YE4lY2cORLx6FEdOR4uGmA8kqdyyKM11lovRtNDp2ouZkjSiDmO17gaqasURXD2cDNTsBoZha7a41XrY22c7gADFUiZI3zmSCNg May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a9a825b1ade46e3a702ae19c7c53f6b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 59f88a11fc4b4bf6b4a807ccffee1fab May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 37f90068-386b-4593-a1b7-a5e2232395b2 could not be found. May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '37f90068-386b-4593-a1b7-a5e2232395b2'} May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37f90068-386b-4593-a1b7-a5e2232395b2 could not be found. May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37f90068-386b-4593-a1b7-a5e2232395b2 could not be found. May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:28.559500 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:28.562551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:28.562551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:28.562551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:28.562551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:28.562551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:28.562551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37f90068-386b-4593-a1b7-a5e2232395b2 could not be found. May 27 15:18:28.562551 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:28.565963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fd8d39fc-5ebb-436d-ab41-085d76fc9b8e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Returning 404 to user: Instance 37f90068-386b-4593-a1b7-a5e2232395b2 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:28.567029 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fd8d39fc-5ebb-436d-ab41-085d76fc9b8e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2" status: 404 len: 111 microversion: 2.1 time: 0.039880 May 27 15:18:28.568172 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2327/4657] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:28 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:28.572960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0c7a0fff-94c2-47f3-9c1a-cde9e10a9d6e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.128"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:28.831180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0c7a0fff-94c2-47f3-9c1a-cde9e10a9d6e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:28.841940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c7a0fff-94c2-47f3-9c1a-cde9e10a9d6e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:28.842646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c7a0fff-94c2-47f3-9c1a-cde9e10a9d6e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:28.843525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c7a0fff-94c2-47f3-9c1a-cde9e10a9d6e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:28.846628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c7a0fff-94c2-47f3-9c1a-cde9e10a9d6e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:28.946131 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-78576d05-d582-4895-9320-1a3e7bbf693d tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:18:28.947189 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-78576d05-d582-4895-9320-1a3e7bbf693d tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:18:28.948244 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-78576d05-d582-4895-9320-1a3e7bbf693d tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:18:28.949356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-78576d05-d582-4895-9320-1a3e7bbf693d tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:18:28.951385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-78576d05-d582-4895-9320-1a3e7bbf693d tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:18:28.985287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-78576d05-d582-4895-9320-1a3e7bbf693d tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:28.986018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-78576d05-d582-4895-9320-1a3e7bbf693d tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:28.987393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-78576d05-d582-4895-9320-1a3e7bbf693d tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:28.988035 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-78576d05-d582-4895-9320-1a3e7bbf693d tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:29.020468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-78576d05-d582-4895-9320-1a3e7bbf693d tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Getting quotas for project 6e715a025f1942409d8e46917422f7a7. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:29.043960 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-78576d05-d582-4895-9320-1a3e7bbf693d tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Getting quotas for user 1db092c8eaed4d57be59c00ea0b9a4be and project 6e715a025f1942409d8e46917422f7a7. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:29.070856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-78576d05-d582-4895-9320-1a3e7bbf693d tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:18:29.076193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-78576d05-d582-4895-9320-1a3e7bbf693d tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] [instance: c7a08ed3-2568-488b-b15d-6f6971fb5ef3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:18:29.187776 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-78576d05-d582-4895-9320-1a3e7bbf693d tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.614008 May 27 15:18:29.188436 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2331/4658] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:18:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:18:29.199090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e2ff2525-49e8-437b-a2b6-5d3bba58d102 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '.version_select at 0x7fc775b80af0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:29.240631 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e2ff2525-49e8-437b-a2b6-5d3bba58d102 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883981137" status: 202 len: 0 microversion: 2.1 time: 0.045924 May 27 15:18:29.242972 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2332/4659] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 27 15:18:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883981137 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:18:29.250875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e3c9c5f1-0c62-4aee-bd73-78cb4b1c5d42 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:29.253747 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e3c9c5f1-0c62-4aee-bd73-78cb4b1c5d42 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 9986bdac-9b6e-4175-ae4e-afb0adc396cc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:29.266558 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3c9c5f1-0c62-4aee-bd73-78cb4b1c5d42 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:29.267934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3c9c5f1-0c62-4aee-bd73-78cb4b1c5d42 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:29.268913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3c9c5f1-0c62-4aee-bd73-78cb4b1c5d42 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:29.269497 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3c9c5f1-0c62-4aee-bd73-78cb4b1c5d42 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:29.289131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c7a0fff-94c2-47f3-9c1a-cde9e10a9d6e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Acquired lock "refresh_cache-6821f22b-21ec-4a40-9b7e-0d887b8e2fba" {{(pid=119248) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 15:18:30.407733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e3c9c5f1-0c62-4aee-bd73-78cb4b1c5d42 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:30.416080 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e3c9c5f1-0c62-4aee-bd73-78cb4b1c5d42 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc" status: 200 len: 1292 microversion: 2.1 time: 1.171738 May 27 15:18:30.421794 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2333/4660] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:29 2022] GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc => generated 1292 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:30.427193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-db10f857-604a-4f41-a095-d3542a07785a tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:30.431668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-db10f857-604a-4f41-a095-d3542a07785a tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] [instance: c7a08ed3-2568-488b-b15d-6f6971fb5ef3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:30.446567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db10f857-604a-4f41-a095-d3542a07785a tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:30.450099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db10f857-604a-4f41-a095-d3542a07785a tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:30.450966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db10f857-604a-4f41-a095-d3542a07785a tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:30.451788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db10f857-604a-4f41-a095-d3542a07785a tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:30.580195 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-db10f857-604a-4f41-a095-d3542a07785a tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db092c8eaed4d57be59c00ea0b9a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e715a025f1942409d8e46917422f7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:30.590520 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-db10f857-604a-4f41-a095-d3542a07785a tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3" status: 200 len: 1277 microversion: 2.1 time: 0.167541 May 27 15:18:30.591456 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2334/4661] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:30 2022] GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:30.604423 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-e4542572-fb2b-4544-9842-563f10860f45 req-8f053207-f06a-443c-9a9c-0dc3b09c955e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37f90068-386b-4593-a1b7-a5e2232395b2", "name": "network-vif-deleted", "tag": "d7a1cbf6-dfcf-4666-9602-d832d9cba47b"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:30.618716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-e4542572-fb2b-4544-9842-563f10860f45 req-8f053207-f06a-443c-9a9c-0dc3b09c955e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:30.620277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-e4542572-fb2b-4544-9842-563f10860f45 req-8f053207-f06a-443c-9a9c-0dc3b09c955e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:30.626557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:30.643317 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-e4542572-fb2b-4544-9842-563f10860f45 req-8f053207-f06a-443c-9a9c-0dc3b09c955e service nova] Creating event network-vif-deleted:d7a1cbf6-dfcf-4666-9602-d832d9cba47b for instance 37f90068-386b-4593-a1b7-a5e2232395b2 on n-h1-843621-1 May 27 15:18:30.649974 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-e4542572-fb2b-4544-9842-563f10860f45 req-8f053207-f06a-443c-9a9c-0dc3b09c955e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052298 May 27 15:18:30.651696 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2335/4662] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:30.658346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4748d889-5061-449c-8ae4-1945eaf72c02 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:30.664450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4748d889-5061-449c-8ae4-1945eaf72c02 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:30.672655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4748d889-5061-449c-8ae4-1945eaf72c02 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:30.673611 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4748d889-5061-449c-8ae4-1945eaf72c02 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:30.674617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4748d889-5061-449c-8ae4-1945eaf72c02 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:30.675470 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4748d889-5061-449c-8ae4-1945eaf72c02 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.010260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:31.046383 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:31.066788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4748d889-5061-449c-8ae4-1945eaf72c02 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b135ff735afd48929e72164aafffa3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f687fdd15ef44408d880ba442eef96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:31.075318 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4748d889-5061-449c-8ae4-1945eaf72c02 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c" status: 200 len: 1317 microversion: 2.1 time: 0.422149 May 27 15:18:31.078140 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2336/4663] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:30 2022] GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c => generated 1317 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:31.253365 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-0c7a0fff-94c2-47f3-9c1a-cde9e10a9d6e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Building network info cache for instance {{(pid=119248) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 27 15:18:31.262378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-57c52479-db73-4b5e-9574-7effddbfc0f1 req-a3c5cd64-bc6a-432c-909b-38488587ec65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6821f22b-21ec-4a40-9b7e-0d887b8e2fba", "tag": "16540a03-4c24-436b-959d-06095aca3ccd"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:31.307848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:31.315590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-57c52479-db73-4b5e-9574-7effddbfc0f1 req-a3c5cd64-bc6a-432c-909b-38488587ec65 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.316049 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-57c52479-db73-4b5e-9574-7effddbfc0f1 req-a3c5cd64-bc6a-432c-909b-38488587ec65 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.361166 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-57c52479-db73-4b5e-9574-7effddbfc0f1 req-a3c5cd64-bc6a-432c-909b-38488587ec65 service nova] Creating event network-changed:16540a03-4c24-436b-959d-06095aca3ccd for instance 6821f22b-21ec-4a40-9b7e-0d887b8e2fba on n-h2-843621-1 May 27 15:18:31.396093 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-57c52479-db73-4b5e-9574-7effddbfc0f1 req-a3c5cd64-bc6a-432c-909b-38488587ec65 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137404 May 27 15:18:31.400929 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2337/4664] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:18:31.440508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2bebaa1a-6bcd-4b49-aaeb-214c2db253e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:31.441261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2bebaa1a-6bcd-4b49-aaeb-214c2db253e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 9986bdac-9b6e-4175-ae4e-afb0adc396cc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:31.471980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2bebaa1a-6bcd-4b49-aaeb-214c2db253e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.471980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2bebaa1a-6bcd-4b49-aaeb-214c2db253e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.471980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2bebaa1a-6bcd-4b49-aaeb-214c2db253e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.480966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2bebaa1a-6bcd-4b49-aaeb-214c2db253e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:32.302307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2bebaa1a-6bcd-4b49-aaeb-214c2db253e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:32.312131 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2bebaa1a-6bcd-4b49-aaeb-214c2db253e7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc" status: 200 len: 1474 microversion: 2.1 time: 0.877730 May 27 15:18:32.318346 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2338/4665] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:31 2022] GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc => generated 1474 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:32.337087 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e3f0d4de-6ad6-4bbc-be2f-884071713b8a tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:32.338499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e3f0d4de-6ad6-4bbc-be2f-884071713b8a tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] [instance: c7a08ed3-2568-488b-b15d-6f6971fb5ef3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:32.350823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3f0d4de-6ad6-4bbc-be2f-884071713b8a tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:32.351546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3f0d4de-6ad6-4bbc-be2f-884071713b8a tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:32.352537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3f0d4de-6ad6-4bbc-be2f-884071713b8a tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:32.356015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3f0d4de-6ad6-4bbc-be2f-884071713b8a tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:33.153220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e3f0d4de-6ad6-4bbc-be2f-884071713b8a tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db092c8eaed4d57be59c00ea0b9a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e715a025f1942409d8e46917422f7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:33.171373 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e3f0d4de-6ad6-4bbc-be2f-884071713b8a tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3" status: 200 len: 1325 microversion: 2.1 time: 0.851417 May 27 15:18:33.172343 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2339/4666] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:32 2022] GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3 => generated 1325 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:33.177861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b061d906-281d-487c-91f7-25249b24dcac tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:33.182021 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b061d906-281d-487c-91f7-25249b24dcac tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:33.197457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b061d906-281d-487c-91f7-25249b24dcac tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:33.199283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b061d906-281d-487c-91f7-25249b24dcac tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:33.200800 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b061d906-281d-487c-91f7-25249b24dcac tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:33.206010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b061d906-281d-487c-91f7-25249b24dcac tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:33.479619 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-0c7a0fff-94c2-47f3-9c1a-cde9e10a9d6e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Updating instance_info_cache with network_info: [{"id": "16540a03-4c24-436b-959d-06095aca3ccd", "address": "fa:16:3e:bb:2b:73", "network": {"id": "f36d2574-5d53-4b40-8e21-3477336c8d77", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-39260674-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "47bcab40996f4487bfb203eaac11325f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap16540a03-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119248) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 27 15:18:33.502024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c7a0fff-94c2-47f3-9c1a-cde9e10a9d6e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Releasing lock "refresh_cache-6821f22b-21ec-4a40-9b7e-0d887b8e2fba" {{(pid=119248) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 15:18:33.503192 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0c7a0fff-94c2-47f3-9c1a-cde9e10a9d6e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "POST /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba/action" status: 202 len: 0 microversion: 2.1 time: 4.933866 May 27 15:18:33.503977 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2328/4667] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:18:28 2022] POST /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba/action => generated 0 bytes in 4935 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 27 15:18:33.509466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee649970-0a49-403d-9dc7-36fa0fb362df tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-994215072", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:33.602543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-ee649970-0a49-403d-9dc7-36fa0fb362df tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] validate_networks() for [('679b759f-4940-4405-a687-165c11fb616b', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:18:34.146722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b061d906-281d-487c-91f7-25249b24dcac tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b135ff735afd48929e72164aafffa3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f687fdd15ef44408d880ba442eef96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:34.160893 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b061d906-281d-487c-91f7-25249b24dcac tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c" status: 200 len: 1317 microversion: 2.1 time: 0.986915 May 27 15:18:34.164108 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2340/4668] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:33 2022] GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c => generated 1317 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:34.190136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bdc72329-50a1-4f14-8166-0c366b96592a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Action: 'create', calling method: .version_select at 0x7fc775b1e310>, body: {"keypair": {"name": "tempest-keypair-1405315259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlFoQDs2cTx3neTQTh++zDn2FaTeqOVjT7Bg8N8aENMXSN9CD66ei/B8BoYV40dBIfyK5w59yCq/6l1BU4D76LUVZvMUVKBtltHQFLBf9AM3uIHC66jQwd2A9S3YYQTug=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:34.229638 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-bdc72329-50a1-4f14-8166-0c366b96592a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Getting quotas for project 5a9a825b1ade46e3a702ae19c7c53f6b. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:34.245201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-bdc72329-50a1-4f14-8166-0c366b96592a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Getting quotas for user 59f88a11fc4b4bf6b4a807ccffee1fab and project 5a9a825b1ade46e3a702ae19c7c53f6b. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:34.294087 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bdc72329-50a1-4f14-8166-0c366b96592a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.128503 May 27 15:18:34.313127 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2341/4669] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:18:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:34.318187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-2eea394d-043b-44d5-9d19-c7350b288960 req-e1e365ae-fd56-4186-8f7c-877fb53d790d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7a08ed3-2568-488b-b15d-6f6971fb5ef3", "tag": "530b7268-4572-43ad-892e-5395cf0257a4"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:34.327931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2eea394d-043b-44d5-9d19-c7350b288960 req-e1e365ae-fd56-4186-8f7c-877fb53d790d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:34.335878 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2eea394d-043b-44d5-9d19-c7350b288960 req-e1e365ae-fd56-4186-8f7c-877fb53d790d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:34.357503 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-2eea394d-043b-44d5-9d19-c7350b288960 req-e1e365ae-fd56-4186-8f7c-877fb53d790d service nova] Creating event network-changed:530b7268-4572-43ad-892e-5395cf0257a4 for instance c7a08ed3-2568-488b-b15d-6f6971fb5ef3 on n-h2-843621-1 May 27 15:18:34.373529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ee649970-0a49-403d-9dc7-36fa0fb362df tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:18:34.373907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ee649970-0a49-403d-9dc7-36fa0fb362df tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:18:34.374396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ee649970-0a49-403d-9dc7-36fa0fb362df tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:18:34.374656 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-2eea394d-043b-44d5-9d19-c7350b288960 req-e1e365ae-fd56-4186-8f7c-877fb53d790d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055968 May 27 15:18:34.374809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ee649970-0a49-403d-9dc7-36fa0fb362df tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:18:34.375666 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2342/4670] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:34.376249 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ee649970-0a49-403d-9dc7-36fa0fb362df tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:18:34.384638 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-431950b2-b478-497b-9f1e-55c97107add2 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '.version_select at 0x7fc776dfc820>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:34.388204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee649970-0a49-403d-9dc7-36fa0fb362df tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:34.388509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee649970-0a49-403d-9dc7-36fa0fb362df tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:34.390105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee649970-0a49-403d-9dc7-36fa0fb362df tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:34.390764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee649970-0a49-403d-9dc7-36fa0fb362df tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:34.419446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-ee649970-0a49-403d-9dc7-36fa0fb362df tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Getting quotas for project db397cde9e67464182a7ba045f1779be. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:34.436114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-ee649970-0a49-403d-9dc7-36fa0fb362df tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Getting quotas for user 2f0525081cf441998d2c320fa0087cff and project db397cde9e67464182a7ba045f1779be. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:34.466446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ee649970-0a49-403d-9dc7-36fa0fb362df tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:18:34.470542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ee649970-0a49-403d-9dc7-36fa0fb362df tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 31c1ef4d-5a39-4b35-818f-71fbfee047a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:18:34.538381 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ee649970-0a49-403d-9dc7-36fa0fb362df tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.032450 May 27 15:18:34.541259 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2329/4671] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:18:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:18:34.551366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c0a76bd0-f974-4795-85ef-049e0b6d46cf tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:34.553501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c0a76bd0-f974-4795-85ef-049e0b6d46cf tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] [instance: c7a08ed3-2568-488b-b15d-6f6971fb5ef3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:34.565096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0a76bd0-f974-4795-85ef-049e0b6d46cf tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:34.570248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0a76bd0-f974-4795-85ef-049e0b6d46cf tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:34.571282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0a76bd0-f974-4795-85ef-049e0b6d46cf tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:34.571848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0a76bd0-f974-4795-85ef-049e0b6d46cf tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:34.626133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:35.043762 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c0a76bd0-f974-4795-85ef-049e0b6d46cf tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db092c8eaed4d57be59c00ea0b9a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e715a025f1942409d8e46917422f7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:35.063877 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c0a76bd0-f974-4795-85ef-049e0b6d46cf tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3" status: 200 len: 1325 microversion: 2.1 time: 0.520865 May 27 15:18:35.067203 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2330/4672] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:34 2022] GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3 => generated 1325 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:35.080006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-68190eb5-d3ca-44b0-81dc-be7a36d69432 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:35.080634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-68190eb5-d3ca-44b0-81dc-be7a36d69432 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 31c1ef4d-5a39-4b35-818f-71fbfee047a3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:35.117380 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-68190eb5-d3ca-44b0-81dc-be7a36d69432 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 31c1ef4d-5a39-4b35-818f-71fbfee047a3] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:18:35.829739 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.scheduler.client.report [None req-68190eb5-d3ca-44b0-81dc-be7a36d69432 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Deleted allocations for instance 31c1ef4d-5a39-4b35-818f-71fbfee047a3 May 27 15:18:35.837846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:35.887217 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-68190eb5-d3ca-44b0-81dc-be7a36d69432 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "DELETE /compute/v2.1/servers/31c1ef4d-5a39-4b35-818f-71fbfee047a3" status: 204 len: 0 microversion: 2.1 time: 0.817845 May 27 15:18:35.888046 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2331/4673] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:18:35 2022] DELETE /compute/v2.1/servers/31c1ef4d-5a39-4b35-818f-71fbfee047a3 => generated 0 bytes in 820 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:18:35.897624 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a7af8d1a-ed56-4c9e-87c3-d81481a17d60 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:35.898379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a7af8d1a-ed56-4c9e-87c3-d81481a17d60 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:35.911827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a7af8d1a-ed56-4c9e-87c3-d81481a17d60 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:35.915225 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a7af8d1a-ed56-4c9e-87c3-d81481a17d60 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:35.917650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a7af8d1a-ed56-4c9e-87c3-d81481a17d60 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:35.927411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a7af8d1a-ed56-4c9e-87c3-d81481a17d60 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:36.277475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a7af8d1a-ed56-4c9e-87c3-d81481a17d60 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b135ff735afd48929e72164aafffa3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f687fdd15ef44408d880ba442eef96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:36.290411 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a7af8d1a-ed56-4c9e-87c3-d81481a17d60 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c" status: 200 len: 1317 microversion: 2.1 time: 0.396557 May 27 15:18:36.314724 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-431950b2-b478-497b-9f1e-55c97107add2 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "DELETE /compute/v2.1/os-floating-ips/2e8cff5b-4a5b-4e1c-9ffd-00ee99210374" status: 202 len: 0 microversion: 2.1 time: 1.937341 May 27 15:18:36.320321 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2343/4675] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 15:18:34 2022] DELETE /compute/v2.1/os-floating-ips/2e8cff5b-4a5b-4e1c-9ffd-00ee99210374 => generated 0 bytes in 1944 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:18:36.328228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-2cd62f5d-c0ec-4031-afe7-54dfeb1c8ce5 req-7308503a-d022-4fc9-ab52-0bbec528689a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b815748c-e8c7-40e9-ada5-ef4b109b167c", "name": "network-vif-plugged", "status": "completed", "tag": "23e3058e-6d23-4f71-8251-80af2c48faa4"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:36.332415 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2332/4675] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:35 2022] GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:36.349550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-62e2e99c-ef14-4df1-b9f5-c2fef119bc5e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:36.351539 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-62e2e99c-ef14-4df1-b9f5-c2fef119bc5e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 31c1ef4d-5a39-4b35-818f-71fbfee047a3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:36.358076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2cd62f5d-c0ec-4031-afe7-54dfeb1c8ce5 req-7308503a-d022-4fc9-ab52-0bbec528689a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:36.359516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2cd62f5d-c0ec-4031-afe7-54dfeb1c8ce5 req-7308503a-d022-4fc9-ab52-0bbec528689a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:36.368123 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62e2e99c-ef14-4df1-b9f5-c2fef119bc5e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:36.368877 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62e2e99c-ef14-4df1-b9f5-c2fef119bc5e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:36.370834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62e2e99c-ef14-4df1-b9f5-c2fef119bc5e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:36.374506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62e2e99c-ef14-4df1-b9f5-c2fef119bc5e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:36.390804 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-2cd62f5d-c0ec-4031-afe7-54dfeb1c8ce5 req-7308503a-d022-4fc9-ab52-0bbec528689a service nova] Creating event network-vif-plugged:23e3058e-6d23-4f71-8251-80af2c48faa4 for instance b815748c-e8c7-40e9-ada5-ef4b109b167c on n-h2-843621-1 May 27 15:18:36.407109 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-2cd62f5d-c0ec-4031-afe7-54dfeb1c8ce5 req-7308503a-d022-4fc9-ab52-0bbec528689a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084442 May 27 15:18:36.413593 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-62e2e99c-ef14-4df1-b9f5-c2fef119bc5e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance 31c1ef4d-5a39-4b35-818f-71fbfee047a3 could not be found. May 27 15:18:36.415664 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2344/4676] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-62e2e99c-ef14-4df1-b9f5-c2fef119bc5e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/31c1ef4d-5a39-4b35-818f-71fbfee047a3 HTTP/1.1 May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 31c1ef4d-5a39-4b35-818f-71fbfee047a3 could not be found. May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '31c1ef4d-5a39-4b35-818f-71fbfee047a3'} May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c1ef4d-5a39-4b35-818f-71fbfee047a3 could not be found. May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c1ef4d-5a39-4b35-818f-71fbfee047a3 could not be found. May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:36.417327 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:36.420975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:36.420975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:36.420975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:36.420975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:36.420975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c1ef4d-5a39-4b35-818f-71fbfee047a3 could not be found. May 27 15:18:36.420975 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:36.424726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-62e2e99c-ef14-4df1-b9f5-c2fef119bc5e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance 31c1ef4d-5a39-4b35-818f-71fbfee047a3 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:36.427395 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-62e2e99c-ef14-4df1-b9f5-c2fef119bc5e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/31c1ef4d-5a39-4b35-818f-71fbfee047a3" status: 404 len: 111 microversion: 2.1 time: 0.091958 May 27 15:18:36.429043 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2333/4677] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:36 2022] GET /compute/v2.1/servers/31c1ef4d-5a39-4b35-818f-71fbfee047a3 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:36.434628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3f0432fd-4b47-4ee1-bbad-5bdd73291c07 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:36.435552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3f0432fd-4b47-4ee1-bbad-5bdd73291c07 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] [instance: c7a08ed3-2568-488b-b15d-6f6971fb5ef3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:36.446352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fdaa191c-d94e-404b-8e33-5b0ed401331e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:36.455047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f0432fd-4b47-4ee1-bbad-5bdd73291c07 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:36.456291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f0432fd-4b47-4ee1-bbad-5bdd73291c07 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fdaa191c-d94e-404b-8e33-5b0ed401331e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Request method failure captured: May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba/action HTTP/1.1 May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 34 May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOuPOUWobEVIrqDfAz-NFCnm8fmxDs_WzonQ16wjqgzDBzn8mBkgOiKwTvGPytqKm12jDQT1LsJGDR6eq6lopz4aUeVvH7dyCUxrZlc4O8o3RNmoDXwg8q8LTX19Y40Tkgnq3dgjRWIjRD3CRQz5t50QhUsR0qzXvD8GcrdZvlqn250 May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 47bcab40996f4487bfb203eaac11325f May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/47bcab40996f4487bfb203eaac11325f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/47bcab40996f4487bfb203eaac11325f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/47bcab40996f4487bfb203eaac11325f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_47bcab40996f4487bfb203eaac11325f", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 47bcab40996f4487bfb203eaac11325f May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 15641271e7024b7bacb94612dae67d96 May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: {"addFloatingIp": {"address": ""}} May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '6821f22b-21ec-4a40-9b7e-0d887b8e2fba', 'body': {'addFloatingIp': {'address': ''}}} May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi '' May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:18:36.459767 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:18:36.463011 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:18:36.463011 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 27 15:18:36.463011 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:36.463011 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:36.463011 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:36.463011 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:36.463011 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:36.463011 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:36.463011 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:18:36.463011 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:18:36.463011 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 27 15:18:36.463011 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:36.464988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fdaa191c-d94e-404b-8e33-5b0ed401331e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:36.466180 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fdaa191c-d94e-404b-8e33-5b0ed401331e tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "POST /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba/action" status: 400 len: 142 microversion: 2.1 time: 0.035058 May 27 15:18:36.468627 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2334/4678] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:18:36 2022] POST /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba/action => generated 142 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:18:36.472397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f0432fd-4b47-4ee1-bbad-5bdd73291c07 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:36.472397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f0432fd-4b47-4ee1-bbad-5bdd73291c07 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:36.500618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9be35c33-0cbd-4eea-b3fb-4ce7a53d955b tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:36.506546 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9be35c33-0cbd-4eea-b3fb-4ce7a53d955b tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:36.527867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9be35c33-0cbd-4eea-b3fb-4ce7a53d955b tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:36.528659 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9be35c33-0cbd-4eea-b3fb-4ce7a53d955b tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:36.529666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9be35c33-0cbd-4eea-b3fb-4ce7a53d955b tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:36.530265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9be35c33-0cbd-4eea-b3fb-4ce7a53d955b tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:36.583450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9be35c33-0cbd-4eea-b3fb-4ce7a53d955b tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Acquired lock "refresh_cache-6821f22b-21ec-4a40-9b7e-0d887b8e2fba" {{(pid=119248) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 15:18:36.758072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9be35c33-0cbd-4eea-b3fb-4ce7a53d955b tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Releasing lock "refresh_cache-6821f22b-21ec-4a40-9b7e-0d887b8e2fba" {{(pid=119248) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 15:18:36.759074 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-9be35c33-0cbd-4eea-b3fb-4ce7a53d955b tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] HTTP exception thrown: floating IP not found May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9be35c33-0cbd-4eea-b3fb-4ce7a53d955b tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Request method failure captured: May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba/action HTTP/1.1 May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 41 May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOuPOUWobEVIrqDfAz-NFCnm8fmxDs_WzonQ16wjqgzDBzn8mBkgOiKwTvGPytqKm12jDQT1LsJGDR6eq6lopz4aUeVvH7dyCUxrZlc4O8o3RNmoDXwg8q8LTX19Y40Tkgnq3dgjRWIjRD3CRQz5t50QhUsR0qzXvD8GcrdZvlqn250 May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 47bcab40996f4487bfb203eaac11325f May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/47bcab40996f4487bfb203eaac11325f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/47bcab40996f4487bfb203eaac11325f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/47bcab40996f4487bfb203eaac11325f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_47bcab40996f4487bfb203eaac11325f", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 47bcab40996f4487bfb203eaac11325f May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 15641271e7024b7bacb94612dae67d96 May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: {"addFloatingIp": {"address": "0.0.0.0"}} May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: exception: floating IP not found May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '6821f22b-21ec-4a40-9b7e-0d887b8e2fba', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2685, in associate_floating_ip May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2997, in _get_floating_ip_by_address May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found May 27 15:18:36.760942 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:36.764359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:36.764359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:36.764359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:36.764359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:36.764359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:36.764359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:36.764359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:36.764359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found May 27 15:18:36.764359 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:36.766402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9be35c33-0cbd-4eea-b3fb-4ce7a53d955b tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Returning 404 to user: floating IP not found {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:36.767474 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9be35c33-0cbd-4eea-b3fb-4ce7a53d955b tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "POST /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba/action" status: 404 len: 67 microversion: 2.1 time: 0.293176 May 27 15:18:36.768574 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2335/4679] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:18:36 2022] POST /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba/action => generated 67 bytes in 295 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 27 15:18:36.777918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2d841f42-7108-4925-a179-4ab15b7080e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-445842087", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "679b759f-4940-4405-a687-165c11fb616b"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:36.863545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-2d841f42-7108-4925-a179-4ab15b7080e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] validate_networks() for [('679b759f-4940-4405-a687-165c11fb616b', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:18:36.894690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3f0432fd-4b47-4ee1-bbad-5bdd73291c07 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db092c8eaed4d57be59c00ea0b9a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e715a025f1942409d8e46917422f7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:36.902959 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3f0432fd-4b47-4ee1-bbad-5bdd73291c07 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3" status: 200 len: 1325 microversion: 2.1 time: 0.485949 May 27 15:18:36.913035 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2345/4680] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:36 2022] GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3 => generated 1325 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:36.923728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-281105dc-fbea-4762-9b9d-10fe19f9dd98 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:36.984865 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-281105dc-fbea-4762-9b9d-10fe19f9dd98 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-281105dc-fbea-4762-9b9d-10fe19f9dd98 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Request method failure captured: May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba/action HTTP/1.1 May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 44 May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOuPOUWobEVIrqDfAz-NFCnm8fmxDs_WzonQ16wjqgzDBzn8mBkgOiKwTvGPytqKm12jDQT1LsJGDR6eq6lopz4aUeVvH7dyCUxrZlc4O8o3RNmoDXwg8q8LTX19Y40Tkgnq3dgjRWIjRD3CRQz5t50QhUsR0qzXvD8GcrdZvlqn250 May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 47bcab40996f4487bfb203eaac11325f May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/47bcab40996f4487bfb203eaac11325f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/47bcab40996f4487bfb203eaac11325f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/47bcab40996f4487bfb203eaac11325f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_47bcab40996f4487bfb203eaac11325f", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 47bcab40996f4487bfb203eaac11325f May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 15641271e7024b7bacb94612dae67d96 May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: {"removeFloatingIp": {"address": "0.0.0.0"}} May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: exception: Floating IP not found for address 0.0.0.0. May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '6821f22b-21ec-4a40-9b7e-0d887b8e2fba', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2913, in get_instance_id_by_floating_address May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2997, in _get_floating_ip_by_address May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr May 27 15:18:36.986626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) May 27 15:18:36.989928 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. May 27 15:18:36.989928 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:18:36.989928 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:36.989928 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:18:36.989928 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:36.989928 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:36.989928 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:36.989928 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:36.989928 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:36.989928 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. May 27 15:18:36.989928 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:18:36.989928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-281105dc-fbea-4762-9b9d-10fe19f9dd98 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:36.989928 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-281105dc-fbea-4762-9b9d-10fe19f9dd98 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "POST /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba/action" status: 404 len: 88 microversion: 2.1 time: 0.074069 May 27 15:18:36.989928 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2346/4681] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:18:36 2022] POST /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba/action => generated 88 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:18:36.999350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-52be9e1e-31f4-47ac-947a-bc022fe8fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:36.999856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-52be9e1e-31f4-47ac-947a-bc022fe8fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:37.013176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52be9e1e-31f4-47ac-947a-bc022fe8fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:37.013632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52be9e1e-31f4-47ac-947a-bc022fe8fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:37.014655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52be9e1e-31f4-47ac-947a-bc022fe8fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:37.024052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52be9e1e-31f4-47ac-947a-bc022fe8fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:37.068642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-52be9e1e-31f4-47ac-947a-bc022fe8fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:18:37.218601 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-52be9e1e-31f4-47ac-947a-bc022fe8fbc1 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 204 len: 0 microversion: 2.1 time: 0.223792 May 27 15:18:37.222184 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2347/4682] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:18:36 2022] DELETE /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:18:37.234264 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7ea7c03b-273d-4eda-aa40-a185d8734295 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:37.237396 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7ea7c03b-273d-4eda-aa40-a185d8734295 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:37.251909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ea7c03b-273d-4eda-aa40-a185d8734295 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:37.257564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ea7c03b-273d-4eda-aa40-a185d8734295 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:37.258710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ea7c03b-273d-4eda-aa40-a185d8734295 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:37.259848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ea7c03b-273d-4eda-aa40-a185d8734295 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:37.612587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7ea7c03b-273d-4eda-aa40-a185d8734295 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:37.623725 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7ea7c03b-273d-4eda-aa40-a185d8734295 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1541 microversion: 2.1 time: 0.394297 May 27 15:18:37.626069 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2348/4683] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:37 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1541 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:37.643304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-15181f22-02d7-4f22-bf9a-a1967490585b tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:37.645118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-15181f22-02d7-4f22-bf9a-a1967490585b tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:37.663643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15181f22-02d7-4f22-bf9a-a1967490585b tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:37.664483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15181f22-02d7-4f22-bf9a-a1967490585b tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:37.666571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15181f22-02d7-4f22-bf9a-a1967490585b tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:37.667372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15181f22-02d7-4f22-bf9a-a1967490585b tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:37.677538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-2d841f42-7108-4925-a179-4ab15b7080e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:18:37.678377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-2d841f42-7108-4925-a179-4ab15b7080e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:18:37.679023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-2d841f42-7108-4925-a179-4ab15b7080e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:18:37.679680 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-2d841f42-7108-4925-a179-4ab15b7080e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:18:37.680896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-2d841f42-7108-4925-a179-4ab15b7080e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:18:37.705527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2d841f42-7108-4925-a179-4ab15b7080e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:37.706318 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2d841f42-7108-4925-a179-4ab15b7080e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:37.707419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2d841f42-7108-4925-a179-4ab15b7080e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:37.710128 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2d841f42-7108-4925-a179-4ab15b7080e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:37.757136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-2d841f42-7108-4925-a179-4ab15b7080e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Getting quotas for project db397cde9e67464182a7ba045f1779be. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:37.781547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-2d841f42-7108-4925-a179-4ab15b7080e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Getting quotas for user 2f0525081cf441998d2c320fa0087cff and project db397cde9e67464182a7ba045f1779be. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:37.812310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2d841f42-7108-4925-a179-4ab15b7080e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:18:37.815480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2d841f42-7108-4925-a179-4ab15b7080e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:18:37.941947 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2d841f42-7108-4925-a179-4ab15b7080e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.171805 May 27 15:18:37.948248 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2336/4684] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:18:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:18:37.955775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8c294644-ac6b-479d-ad3e-9b8dbf7a03e6 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:37.963072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8c294644-ac6b-479d-ad3e-9b8dbf7a03e6 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] [instance: c7a08ed3-2568-488b-b15d-6f6971fb5ef3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:37.969035 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-15181f22-02d7-4f22-bf9a-a1967490585b tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b135ff735afd48929e72164aafffa3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f687fdd15ef44408d880ba442eef96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:37.994138 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-15181f22-02d7-4f22-bf9a-a1967490585b tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c" status: 200 len: 1317 microversion: 2.1 time: 0.366775 May 27 15:18:38.000533 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2349/4685] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:37 2022] GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:38.039912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8c294644-ac6b-479d-ad3e-9b8dbf7a03e6 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:38.040791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8c294644-ac6b-479d-ad3e-9b8dbf7a03e6 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:38.041336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-91263f78-d8cc-40b6-9bf2-0ddb024ceace tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:38.043220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-91263f78-d8cc-40b6-9bf2-0ddb024ceace tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:38.043954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8c294644-ac6b-479d-ad3e-9b8dbf7a03e6 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:38.044581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8c294644-ac6b-479d-ad3e-9b8dbf7a03e6 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:38.209000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-91263f78-d8cc-40b6-9bf2-0ddb024ceace tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:38.228481 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-91263f78-d8cc-40b6-9bf2-0ddb024ceace tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 200 len: 1220 microversion: 2.1 time: 0.226130 May 27 15:18:38.231719 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2350/4686] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:38 2022] GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 1220 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:38.387747 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cc397e49-fb71-4754-be27-4f41685eddc1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-536799497", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5506dc4-66e1-4bd2-af40-7ec96debefd9"}], "security_groups": [{"name": "tempest-securitygroup--390535510"}], "key_name": "tempest-keypair-1405315259", "user_data": "}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:38.406377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8c294644-ac6b-479d-ad3e-9b8dbf7a03e6 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db092c8eaed4d57be59c00ea0b9a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e715a025f1942409d8e46917422f7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:38.433232 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8c294644-ac6b-479d-ad3e-9b8dbf7a03e6 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3" status: 200 len: 1325 microversion: 2.1 time: 0.481822 May 27 15:18:38.437147 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2337/4687] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:37 2022] GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3 => generated 1325 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:38.616390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-cc397e49-fb71-4754-be27-4f41685eddc1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] validate_networks() for [('b5506dc4-66e1-4bd2-af40-7ec96debefd9', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:18:38.645515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-be3a2aad-6252-40d6-a9ee-b091cee79257 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:38.648345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-be3a2aad-6252-40d6-a9ee-b091cee79257 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:38.657964 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be3a2aad-6252-40d6-a9ee-b091cee79257 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:38.659118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be3a2aad-6252-40d6-a9ee-b091cee79257 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:38.660877 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be3a2aad-6252-40d6-a9ee-b091cee79257 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:38.661595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be3a2aad-6252-40d6-a9ee-b091cee79257 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:39.002680 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:39.061734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-be3a2aad-6252-40d6-a9ee-b091cee79257 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:39.074338 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-be3a2aad-6252-40d6-a9ee-b091cee79257 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1541 microversion: 2.1 time: 0.435495 May 27 15:18:39.075786 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2338/4688] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:38 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1541 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:39.083531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-03274be9-53b6-4041-88ee-9247d724d714 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:39.084447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-03274be9-53b6-4041-88ee-9247d724d714 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:39.115157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03274be9-53b6-4041-88ee-9247d724d714 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:39.116969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03274be9-53b6-4041-88ee-9247d724d714 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:39.117960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03274be9-53b6-4041-88ee-9247d724d714 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:39.118502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03274be9-53b6-4041-88ee-9247d724d714 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:39.641030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-03274be9-53b6-4041-88ee-9247d724d714 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b135ff735afd48929e72164aafffa3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f687fdd15ef44408d880ba442eef96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:39.663284 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-03274be9-53b6-4041-88ee-9247d724d714 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c" status: 200 len: 1506 microversion: 2.1 time: 0.585404 May 27 15:18:39.664140 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2339/4689] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:39 2022] GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c => generated 1506 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:39.673347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c948952a-9661-49d1-9a9c-c197edcc23ae tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:39.673980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c948952a-9661-49d1-9a9c-c197edcc23ae tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:39.697696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c948952a-9661-49d1-9a9c-c197edcc23ae tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:39.698201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c948952a-9661-49d1-9a9c-c197edcc23ae tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:39.699024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c948952a-9661-49d1-9a9c-c197edcc23ae tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:39.699471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c948952a-9661-49d1-9a9c-c197edcc23ae tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:39.746775 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-cc397e49-fb71-4754-be27-4f41685eddc1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:18:39.748180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-cc397e49-fb71-4754-be27-4f41685eddc1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:18:39.749381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-cc397e49-fb71-4754-be27-4f41685eddc1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:18:39.749951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-cc397e49-fb71-4754-be27-4f41685eddc1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:18:39.750512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-cc397e49-fb71-4754-be27-4f41685eddc1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:18:39.763260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc397e49-fb71-4754-be27-4f41685eddc1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:39.765562 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc397e49-fb71-4754-be27-4f41685eddc1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:39.768120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc397e49-fb71-4754-be27-4f41685eddc1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:39.773334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cc397e49-fb71-4754-be27-4f41685eddc1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:39.816002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-cc397e49-fb71-4754-be27-4f41685eddc1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Getting quotas for project 5a9a825b1ade46e3a702ae19c7c53f6b. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:39.834539 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-cc397e49-fb71-4754-be27-4f41685eddc1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Getting quotas for user 59f88a11fc4b4bf6b4a807ccffee1fab and project 5a9a825b1ade46e3a702ae19c7c53f6b. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:39.859018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cc397e49-fb71-4754-be27-4f41685eddc1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:18:39.861738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cc397e49-fb71-4754-be27-4f41685eddc1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:18:39.908855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c948952a-9661-49d1-9a9c-c197edcc23ae tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:39.929519 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c948952a-9661-49d1-9a9c-c197edcc23ae tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 200 len: 1280 microversion: 2.1 time: 0.252339 May 27 15:18:39.929519 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2340/4690] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:39 2022] GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 1280 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:39.950410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d335961a-7b08-4d9b-90cb-00b8f7e7374b tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:39.951041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d335961a-7b08-4d9b-90cb-00b8f7e7374b tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] [instance: c7a08ed3-2568-488b-b15d-6f6971fb5ef3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:39.957391 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d335961a-7b08-4d9b-90cb-00b8f7e7374b tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:39.958081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d335961a-7b08-4d9b-90cb-00b8f7e7374b tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:39.959347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d335961a-7b08-4d9b-90cb-00b8f7e7374b tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:39.960057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d335961a-7b08-4d9b-90cb-00b8f7e7374b tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:40.003206 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cc397e49-fb71-4754-be27-4f41685eddc1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.619827 May 27 15:18:40.014287 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2351/4691] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:18:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 15:18:40.024157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c6159d01-01d2-48db-989b-e5cec0506500 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:40.025750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c6159d01-01d2-48db-989b-e5cec0506500 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:40.046307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c6159d01-01d2-48db-989b-e5cec0506500 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:40.047001 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c6159d01-01d2-48db-989b-e5cec0506500 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:40.048974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c6159d01-01d2-48db-989b-e5cec0506500 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:40.052901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c6159d01-01d2-48db-989b-e5cec0506500 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:40.091352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c6159d01-01d2-48db-989b-e5cec0506500 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'b135ff735afd48929e72164aafffa3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f687fdd15ef44408d880ba442eef96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:40.093836 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c6159d01-01d2-48db-989b-e5cec0506500 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c/os-instance-actions/req-69dba14a-591c-4e32-9d56-3083e908a1e7" status: 200 len: 313 microversion: 2.1 time: 0.078306 May 27 15:18:40.094636 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2352/4692] 10.222.0.13 () {58 vars in 1418 bytes} [Fri May 27 15:18:40 2022] GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c/os-instance-actions/req-69dba14a-591c-4e32-9d56-3083e908a1e7 => generated 313 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:40.099868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-b47e6dd1-0d32-43dc-b03e-c3c53625aeb3 req-41570985-8485-418f-a655-1a6cb6638ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a08ed3-2568-488b-b15d-6f6971fb5ef3", "name": "network-vif-plugged", "status": "completed", "tag": "530b7268-4572-43ad-892e-5395cf0257a4"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:40.120902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b47e6dd1-0d32-43dc-b03e-c3c53625aeb3 req-41570985-8485-418f-a655-1a6cb6638ea9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:40.121358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b47e6dd1-0d32-43dc-b03e-c3c53625aeb3 req-41570985-8485-418f-a655-1a6cb6638ea9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:40.166186 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-b47e6dd1-0d32-43dc-b03e-c3c53625aeb3 req-41570985-8485-418f-a655-1a6cb6638ea9 service nova] Creating event network-vif-plugged:530b7268-4572-43ad-892e-5395cf0257a4 for instance c7a08ed3-2568-488b-b15d-6f6971fb5ef3 on n-h2-843621-1 May 27 15:18:40.185594 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-b47e6dd1-0d32-43dc-b03e-c3c53625aeb3 req-41570985-8485-418f-a655-1a6cb6638ea9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087988 May 27 15:18:40.188000 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2353/4693] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:40.205720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2e1341e4-aaab-48c9-a883-6aff52847432 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:40.209074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2e1341e4-aaab-48c9-a883-6aff52847432 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:40.864289 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2e1341e4-aaab-48c9-a883-6aff52847432 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:40.880452 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2e1341e4-aaab-48c9-a883-6aff52847432 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 200 len: 1241 microversion: 2.1 time: 0.688344 May 27 15:18:40.881065 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2354/4694] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:40 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 1241 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:40.895837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9606eabb-6e7c-4c80-b02d-688988fef7f8 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:40.896475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9606eabb-6e7c-4c80-b02d-688988fef7f8 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:40.913506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9606eabb-6e7c-4c80-b02d-688988fef7f8 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:40.914041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9606eabb-6e7c-4c80-b02d-688988fef7f8 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:40.915058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9606eabb-6e7c-4c80-b02d-688988fef7f8 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:40.915525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9606eabb-6e7c-4c80-b02d-688988fef7f8 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:41.078873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9606eabb-6e7c-4c80-b02d-688988fef7f8 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:41.089258 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9606eabb-6e7c-4c80-b02d-688988fef7f8 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1499 microversion: 2.1 time: 0.197225 May 27 15:18:41.089842 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2355/4695] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:40 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1499 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:41.102257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4aced0fb-cb1a-41fa-85a4-10197d4d2eef tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:41.103252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4aced0fb-cb1a-41fa-85a4-10197d4d2eef tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:41.108587 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d335961a-7b08-4d9b-90cb-00b8f7e7374b tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db092c8eaed4d57be59c00ea0b9a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e715a025f1942409d8e46917422f7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:41.118861 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d335961a-7b08-4d9b-90cb-00b8f7e7374b tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3" status: 200 len: 1325 microversion: 2.1 time: 1.199914 May 27 15:18:41.119461 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2341/4696] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:39 2022] GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3 => generated 1325 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:41.132093 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ab3dab5a-2666-4042-8abc-6f2d3c5d766e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:41.132747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ab3dab5a-2666-4042-8abc-6f2d3c5d766e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:41.137451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4aced0fb-cb1a-41fa-85a4-10197d4d2eef tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:41.137930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4aced0fb-cb1a-41fa-85a4-10197d4d2eef tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:41.143395 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4aced0fb-cb1a-41fa-85a4-10197d4d2eef tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:41.143871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4aced0fb-cb1a-41fa-85a4-10197d4d2eef tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:41.160586 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab3dab5a-2666-4042-8abc-6f2d3c5d766e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:41.168422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab3dab5a-2666-4042-8abc-6f2d3c5d766e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:41.169465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab3dab5a-2666-4042-8abc-6f2d3c5d766e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:41.169948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab3dab5a-2666-4042-8abc-6f2d3c5d766e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:41.310648 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4aced0fb-cb1a-41fa-85a4-10197d4d2eef tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "POST /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c/action" status: 202 len: 0 microversion: 2.1 time: 0.216631 May 27 15:18:41.317889 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2356/4697] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:18:41 2022] POST /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:18:41.343407 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-ab1e2cf8-db40-47a9-affc-6a90da210f73 req-52f88cfb-99e2-4f07-a9f0-f4cc0922c9dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6821f22b-21ec-4a40-9b7e-0d887b8e2fba", "name": "network-vif-deleted", "tag": "16540a03-4c24-436b-959d-06095aca3ccd"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:41.357373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ab1e2cf8-db40-47a9-affc-6a90da210f73 req-52f88cfb-99e2-4f07-a9f0-f4cc0922c9dc service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:41.358647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ab1e2cf8-db40-47a9-affc-6a90da210f73 req-52f88cfb-99e2-4f07-a9f0-f4cc0922c9dc service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:41.386265 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-ab1e2cf8-db40-47a9-affc-6a90da210f73 req-52f88cfb-99e2-4f07-a9f0-f4cc0922c9dc service nova] Creating event network-vif-deleted:16540a03-4c24-436b-959d-06095aca3ccd for instance 6821f22b-21ec-4a40-9b7e-0d887b8e2fba on n-h2-843621-1 May 27 15:18:41.392265 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-ab1e2cf8-db40-47a9-affc-6a90da210f73 req-52f88cfb-99e2-4f07-a9f0-f4cc0922c9dc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071619 May 27 15:18:41.397775 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2357/4698] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:41.404286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7a3b027f-e8d4-49f8-956a-533152f44d56 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:41.407767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7a3b027f-e8d4-49f8-956a-533152f44d56 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:41.422586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a3b027f-e8d4-49f8-956a-533152f44d56 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:41.423761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a3b027f-e8d4-49f8-956a-533152f44d56 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:41.424161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a3b027f-e8d4-49f8-956a-533152f44d56 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:41.424864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a3b027f-e8d4-49f8-956a-533152f44d56 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:41.528965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ab3dab5a-2666-4042-8abc-6f2d3c5d766e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:41.546242 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ab3dab5a-2666-4042-8abc-6f2d3c5d766e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 200 len: 1320 microversion: 2.1 time: 0.425664 May 27 15:18:41.546848 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2342/4699] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:41 2022] GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 1320 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:41.718938 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7a3b027f-e8d4-49f8-956a-533152f44d56 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b135ff735afd48929e72164aafffa3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f687fdd15ef44408d880ba442eef96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:41.724431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:41.736387 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7a3b027f-e8d4-49f8-956a-533152f44d56 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c" status: 200 len: 1508 microversion: 2.1 time: 0.336330 May 27 15:18:41.738289 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2358/4700] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:41 2022] GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c => generated 1508 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:41.897722 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fdd773d7-9c42-4249-998d-e9297091e987 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:41.898430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fdd773d7-9c42-4249-998d-e9297091e987 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:41.905018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fdd773d7-9c42-4249-998d-e9297091e987 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:41.909282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fdd773d7-9c42-4249-998d-e9297091e987 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:41.918473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fdd773d7-9c42-4249-998d-e9297091e987 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:41.919065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fdd773d7-9c42-4249-998d-e9297091e987 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:42.036455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fdd773d7-9c42-4249-998d-e9297091e987 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:42.049547 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fdd773d7-9c42-4249-998d-e9297091e987 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 200 len: 1293 microversion: 2.1 time: 0.154001 May 27 15:18:42.060066 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2343/4701] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:41 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 1293 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:42.106864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ef8c3e8f-9515-4abe-90da-2fa2804e16b9 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:42.108241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ef8c3e8f-9515-4abe-90da-2fa2804e16b9 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:42.125251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef8c3e8f-9515-4abe-90da-2fa2804e16b9 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:42.132954 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef8c3e8f-9515-4abe-90da-2fa2804e16b9 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:42.135148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef8c3e8f-9515-4abe-90da-2fa2804e16b9 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:42.137530 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef8c3e8f-9515-4abe-90da-2fa2804e16b9 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:42.138280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eccdb2b0-a5eb-4174-a90e-3d50ee8a0cc0 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:42.139825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-eccdb2b0-a5eb-4174-a90e-3d50ee8a0cc0 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] [instance: c7a08ed3-2568-488b-b15d-6f6971fb5ef3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:42.153444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eccdb2b0-a5eb-4174-a90e-3d50ee8a0cc0 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:42.155638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eccdb2b0-a5eb-4174-a90e-3d50ee8a0cc0 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:42.156859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eccdb2b0-a5eb-4174-a90e-3d50ee8a0cc0 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:42.161103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eccdb2b0-a5eb-4174-a90e-3d50ee8a0cc0 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:42.266401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef8c3e8f-9515-4abe-90da-2fa2804e16b9 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:42.267773 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef8c3e8f-9515-4abe-90da-2fa2804e16b9 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:42.268269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-ef8c3e8f-9515-4abe-90da-2fa2804e16b9 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lazy-loading 'fault' on Instance uuid 6821f22b-21ec-4a40-9b7e-0d887b8e2fba {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:18:42.712194 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ef8c3e8f-9515-4abe-90da-2fa2804e16b9 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15641271e7024b7bacb94612dae67d96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47bcab40996f4487bfb203eaac11325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:42.739835 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ef8c3e8f-9515-4abe-90da-2fa2804e16b9 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 200 len: 1322 microversion: 2.1 time: 0.636243 May 27 15:18:42.741878 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2359/4702] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:42 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 1322 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:42.757507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5e65ad41-b6b1-460d-a60f-46e3c299554b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:42.758559 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5e65ad41-b6b1-460d-a60f-46e3c299554b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:42.775962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e65ad41-b6b1-460d-a60f-46e3c299554b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:42.776807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e65ad41-b6b1-460d-a60f-46e3c299554b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:42.778134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e65ad41-b6b1-460d-a60f-46e3c299554b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:42.779064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e65ad41-b6b1-460d-a60f-46e3c299554b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:43.022612 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5e65ad41-b6b1-460d-a60f-46e3c299554b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:43.031267 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5e65ad41-b6b1-460d-a60f-46e3c299554b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 200 len: 1320 microversion: 2.1 time: 0.287408 May 27 15:18:43.031995 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2360/4703] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:42 2022] GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 1320 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:43.042058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eccdb2b0-a5eb-4174-a90e-3d50ee8a0cc0 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db092c8eaed4d57be59c00ea0b9a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e715a025f1942409d8e46917422f7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:43.055063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-374be08d-fe61-432a-924a-e6fb986cfe73 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:43.056447 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-eccdb2b0-a5eb-4174-a90e-3d50ee8a0cc0 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3" status: 200 len: 1521 microversion: 2.1 time: 0.924066 May 27 15:18:43.070031 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2344/4704] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:42 2022] GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3 => generated 1521 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:43.077908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-374be08d-fe61-432a-924a-e6fb986cfe73 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:43.082656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-22206120-9470-45bd-a53f-1a335c474407 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:43.086592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-374be08d-fe61-432a-924a-e6fb986cfe73 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:43.087595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-22206120-9470-45bd-a53f-1a335c474407 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:43.091467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-374be08d-fe61-432a-924a-e6fb986cfe73 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:43.092613 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-374be08d-fe61-432a-924a-e6fb986cfe73 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:43.095266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-374be08d-fe61-432a-924a-e6fb986cfe73 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:43.100296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22206120-9470-45bd-a53f-1a335c474407 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:43.101130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22206120-9470-45bd-a53f-1a335c474407 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:43.105411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22206120-9470-45bd-a53f-1a335c474407 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:43.106174 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22206120-9470-45bd-a53f-1a335c474407 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:43.296341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-22206120-9470-45bd-a53f-1a335c474407 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:43.306747 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-22206120-9470-45bd-a53f-1a335c474407 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 200 len: 1299 microversion: 2.1 time: 0.235121 May 27 15:18:43.308189 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2345/4705] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:43 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 1299 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:43.322764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7bc59ea9-e546-4a0d-aa47-75de0228518c tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:43.323625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7bc59ea9-e546-4a0d-aa47-75de0228518c tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] [instance: c7a08ed3-2568-488b-b15d-6f6971fb5ef3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:43.339782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7bc59ea9-e546-4a0d-aa47-75de0228518c tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:43.340811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7bc59ea9-e546-4a0d-aa47-75de0228518c tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:43.343727 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7bc59ea9-e546-4a0d-aa47-75de0228518c tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:43.345144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7bc59ea9-e546-4a0d-aa47-75de0228518c tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:43.423867 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-7bc59ea9-e546-4a0d-aa47-75de0228518c tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] HTTP exception thrown: Instance is not a member of specified network May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7bc59ea9-e546-4a0d-aa47-75de0228518c tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Request method failure captured: May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3/ips/invalid HTTP/1.1 May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOvCKYMjvheh6YmB6NF6HmHrylooIjKVlntQDalxrGBmhOF09fGVumx8z-Jw6BJU5KcL6s3Pp8VHC0XdQM6BD8xUlY4k3H4CNzD3GSwIZ-XNKRnTfDJk2xAuTSNPguriBwKUv0VleBOCLbV1itWNcwDDPGWP3dy2VCyCShtSmSY_eCw May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 6e715a025f1942409d8e46917422f7a7 May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1375964276 May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6e715a025f1942409d8e46917422f7a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6e715a025f1942409d8e46917422f7a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6e715a025f1942409d8e46917422f7a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6e715a025f1942409d8e46917422f7a7", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1375964276 May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 6e715a025f1942409d8e46917422f7a7 May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1375964276 May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerAddressesNegativeTestJSON-1375964276-project May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 1db092c8eaed4d57be59c00ea0b9a4be May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1375964276-project May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance is not a member of specified network May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'server_id': 'c7a08ed3-2568-488b-b15d-6f6971fb5ef3', 'id': 'invalid'} May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network May 27 15:18:43.437390 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:43.440855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7bc59ea9-e546-4a0d-aa47-75de0228518c tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:43.440855 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7bc59ea9-e546-4a0d-aa47-75de0228518c tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.125685 May 27 15:18:43.444656 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2346/4706] 10.222.0.13 () {58 vars in 1271 bytes} [Fri May 27 15:18:43 2022] GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3/ips/invalid => generated 91 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:18:43.461638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7a0e3871-0736-4b39-977c-dee0637c3353 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:43.462138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7a0e3871-0736-4b39-977c-dee0637c3353 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Failed to fetch instance by id 999 {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2926}} May 27 15:18:43.462652 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-7a0e3871-0736-4b39-977c-dee0637c3353 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] HTTP exception thrown: Instance 999 could not be found. May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7a0e3871-0736-4b39-977c-dee0637c3353 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Request method failure captured: May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOvCKYMjvheh6YmB6NF6HmHrylooIjKVlntQDalxrGBmhOF09fGVumx8z-Jw6BJU5KcL6s3Pp8VHC0XdQM6BD8xUlY4k3H4CNzD3GSwIZ-XNKRnTfDJk2xAuTSNPguriBwKUv0VleBOCLbV1itWNcwDDPGWP3dy2VCyCShtSmSY_eCw May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 6e715a025f1942409d8e46917422f7a7 May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1375964276 May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6e715a025f1942409d8e46917422f7a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6e715a025f1942409d8e46917422f7a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6e715a025f1942409d8e46917422f7a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6e715a025f1942409d8e46917422f7a7", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1375964276 May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 6e715a025f1942409d8e46917422f7a7 May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1375964276 May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerAddressesNegativeTestJSON-1375964276-project May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 1db092c8eaed4d57be59c00ea0b9a4be May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1375964276-project May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 999 could not be found. May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'server_id': '999'} May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. May 27 15:18:43.467360 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:43.471000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7a0e3871-0736-4b39-977c-dee0637c3353 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:43.471000 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7a0e3871-0736-4b39-977c-dee0637c3353 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] 10.222.0.13 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.024094 May 27 15:18:43.475679 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2347/4707] 10.222.0.13 () {58 vars in 1148 bytes} [Fri May 27 15:18:43 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:18:43.483242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8a811894-4606-4ad1-a49c-87d6263ecde4 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:43.486545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8a811894-4606-4ad1-a49c-87d6263ecde4 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] [instance: c7a08ed3-2568-488b-b15d-6f6971fb5ef3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:43.494659 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a811894-4606-4ad1-a49c-87d6263ecde4 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:43.495307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a811894-4606-4ad1-a49c-87d6263ecde4 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:43.496351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a811894-4606-4ad1-a49c-87d6263ecde4 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:43.496975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a811894-4606-4ad1-a49c-87d6263ecde4 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:43.526755 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8a811894-4606-4ad1-a49c-87d6263ecde4 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] [instance: c7a08ed3-2568-488b-b15d-6f6971fb5ef3] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:18:43.569529 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-374be08d-fe61-432a-924a-e6fb986cfe73 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b135ff735afd48929e72164aafffa3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f687fdd15ef44408d880ba442eef96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:43.583631 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-374be08d-fe61-432a-924a-e6fb986cfe73 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c" status: 200 len: 1508 microversion: 2.1 time: 0.545941 May 27 15:18:43.586278 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2361/4708] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:43 2022] GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c => generated 1508 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:43.688862 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8a811894-4606-4ad1-a49c-87d6263ecde4 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3" status: 204 len: 0 microversion: 2.1 time: 0.211374 May 27 15:18:43.689856 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2348/4709] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:18:43 2022] DELETE /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:18:43.698063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b93f298c-27dd-4725-9fee-ef69fe11e9bf tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:43.699175 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b93f298c-27dd-4725-9fee-ef69fe11e9bf tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] [instance: c7a08ed3-2568-488b-b15d-6f6971fb5ef3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:43.710963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b93f298c-27dd-4725-9fee-ef69fe11e9bf tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:43.712003 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b93f298c-27dd-4725-9fee-ef69fe11e9bf tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:43.713016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b93f298c-27dd-4725-9fee-ef69fe11e9bf tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:43.713951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b93f298c-27dd-4725-9fee-ef69fe11e9bf tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:43.760430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-223e3b6a-a5bc-4400-8aff-8c77ca0f525f tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:43.761574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-223e3b6a-a5bc-4400-8aff-8c77ca0f525f tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] [instance: 6821f22b-21ec-4a40-9b7e-0d887b8e2fba] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:43.778201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-223e3b6a-a5bc-4400-8aff-8c77ca0f525f tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:43.778665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-223e3b6a-a5bc-4400-8aff-8c77ca0f525f tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:43.783630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-223e3b6a-a5bc-4400-8aff-8c77ca0f525f tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:43.784306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-223e3b6a-a5bc-4400-8aff-8c77ca0f525f tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:43.820235 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-223e3b6a-a5bc-4400-8aff-8c77ca0f525f tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] HTTP exception thrown: Instance 6821f22b-21ec-4a40-9b7e-0d887b8e2fba could not be found. May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-223e3b6a-a5bc-4400-8aff-8c77ca0f525f tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Request method failure captured: May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba HTTP/1.1 May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOuPOUWobEVIrqDfAz-NFCnm8fmxDs_WzonQ16wjqgzDBzn8mBkgOiKwTvGPytqKm12jDQT1LsJGDR6eq6lopz4aUeVvH7dyCUxrZlc4O8o3RNmoDXwg8q8LTX19Y40Tkgnq3dgjRWIjRD3CRQz5t50QhUsR0qzXvD8GcrdZvlqn250 May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 47bcab40996f4487bfb203eaac11325f May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/47bcab40996f4487bfb203eaac11325f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/47bcab40996f4487bfb203eaac11325f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/47bcab40996f4487bfb203eaac11325f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_47bcab40996f4487bfb203eaac11325f", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 47bcab40996f4487bfb203eaac11325f May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 15641271e7024b7bacb94612dae67d96 May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 6821f22b-21ec-4a40-9b7e-0d887b8e2fba could not be found. May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '6821f22b-21ec-4a40-9b7e-0d887b8e2fba'} May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6821f22b-21ec-4a40-9b7e-0d887b8e2fba could not be found. May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6821f22b-21ec-4a40-9b7e-0d887b8e2fba could not be found. May 27 15:18:43.845515 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:43.848747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:43.848747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:43.848747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:43.848747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:43.848747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:43.848747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:43.848747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:43.848747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6821f22b-21ec-4a40-9b7e-0d887b8e2fba could not be found. May 27 15:18:43.848747 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:43.848747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-223e3b6a-a5bc-4400-8aff-8c77ca0f525f tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] Returning 404 to user: Instance 6821f22b-21ec-4a40-9b7e-0d887b8e2fba could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:43.850192 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-223e3b6a-a5bc-4400-8aff-8c77ca0f525f tempest-FloatingIPsAssociationNegativeTestJSON-1447478166 tempest-FloatingIPsAssociationNegativeTestJSON-1447478166-project] 10.222.0.13 "GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba" status: 404 len: 111 microversion: 2.1 time: 0.093274 May 27 15:18:43.851812 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2349/4710] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:43 2022] GET /compute/v2.1/servers/6821f22b-21ec-4a40-9b7e-0d887b8e2fba => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:18:43.864550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-49ad4def-4e87-456b-a278-5df01736b908 req-d5019fae-65a5-499f-b015-d4c8766bd407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6863a0f9-a1ac-4dd5-93f7-1089256bd265", "tag": "456bdf86-20a6-4d02-bcf3-cb8866dd6114"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:43.888167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-49ad4def-4e87-456b-a278-5df01736b908 req-d5019fae-65a5-499f-b015-d4c8766bd407 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:43.890308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-49ad4def-4e87-456b-a278-5df01736b908 req-d5019fae-65a5-499f-b015-d4c8766bd407 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:43.925300 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-49ad4def-4e87-456b-a278-5df01736b908 req-d5019fae-65a5-499f-b015-d4c8766bd407 service nova] Creating event network-changed:456bdf86-20a6-4d02-bcf3-cb8866dd6114 for instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 on n-h1-843621-1 May 27 15:18:43.939657 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-49ad4def-4e87-456b-a278-5df01736b908 req-d5019fae-65a5-499f-b015-d4c8766bd407 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086303 May 27 15:18:43.944428 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2350/4711] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:44.021393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b93f298c-27dd-4725-9fee-ef69fe11e9bf tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db092c8eaed4d57be59c00ea0b9a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e715a025f1942409d8e46917422f7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:44.031457 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b93f298c-27dd-4725-9fee-ef69fe11e9bf tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3" status: 200 len: 1527 microversion: 2.1 time: 0.337390 May 27 15:18:44.032051 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2362/4712] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:43 2022] GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3 => generated 1527 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:44.052146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-881c167c-2e93-466e-a8d9-f7c0925a4598 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:44.053610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-881c167c-2e93-466e-a8d9-f7c0925a4598 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:44.062837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-881c167c-2e93-466e-a8d9-f7c0925a4598 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:44.063662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-881c167c-2e93-466e-a8d9-f7c0925a4598 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:44.064853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-881c167c-2e93-466e-a8d9-f7c0925a4598 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:44.066207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-881c167c-2e93-466e-a8d9-f7c0925a4598 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:44.291197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-881c167c-2e93-466e-a8d9-f7c0925a4598 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:44.296113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:44.305285 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-881c167c-2e93-466e-a8d9-f7c0925a4598 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 200 len: 1320 microversion: 2.1 time: 0.259071 May 27 15:18:44.305889 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2351/4713] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:44 2022] GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 1320 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:44.326103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-88119441-5f5a-457d-8fba-2c7281c4b6e2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:44.327614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-88119441-5f5a-457d-8fba-2c7281c4b6e2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:44.334609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-88119441-5f5a-457d-8fba-2c7281c4b6e2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:44.335257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-88119441-5f5a-457d-8fba-2c7281c4b6e2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:44.336408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-88119441-5f5a-457d-8fba-2c7281c4b6e2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:44.337650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-88119441-5f5a-457d-8fba-2c7281c4b6e2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:44.524929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-88119441-5f5a-457d-8fba-2c7281c4b6e2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:44.535192 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-88119441-5f5a-457d-8fba-2c7281c4b6e2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 200 len: 1366 microversion: 2.1 time: 0.211400 May 27 15:18:44.547596 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2363/4714] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:44 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:44.603347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3397e022-a3a3-4c76-aa0c-29b4290005af tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:44.604538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3397e022-a3a3-4c76-aa0c-29b4290005af tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:44.626789 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3397e022-a3a3-4c76-aa0c-29b4290005af tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:44.628017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3397e022-a3a3-4c76-aa0c-29b4290005af tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:44.629647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3397e022-a3a3-4c76-aa0c-29b4290005af tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:44.640584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3397e022-a3a3-4c76-aa0c-29b4290005af tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:44.957336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3397e022-a3a3-4c76-aa0c-29b4290005af tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b135ff735afd48929e72164aafffa3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f687fdd15ef44408d880ba442eef96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:44.965491 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3397e022-a3a3-4c76-aa0c-29b4290005af tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c" status: 200 len: 1513 microversion: 2.1 time: 0.367918 May 27 15:18:44.978997 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2352/4715] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:44 2022] GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c => generated 1513 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:45.049432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b0b338a8-c57f-4abf-ac6a-c665f3b27465 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:45.051720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b0b338a8-c57f-4abf-ac6a-c665f3b27465 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] [instance: c7a08ed3-2568-488b-b15d-6f6971fb5ef3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:45.069657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b0b338a8-c57f-4abf-ac6a-c665f3b27465 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:45.070742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b0b338a8-c57f-4abf-ac6a-c665f3b27465 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:45.074015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b0b338a8-c57f-4abf-ac6a-c665f3b27465 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:45.075038 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b0b338a8-c57f-4abf-ac6a-c665f3b27465 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:45.323859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-87b5be05-95ea-4c4e-974a-56b2d7072067 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:45.325039 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-87b5be05-95ea-4c4e-974a-56b2d7072067 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:45.337765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87b5be05-95ea-4c4e-974a-56b2d7072067 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:45.338855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87b5be05-95ea-4c4e-974a-56b2d7072067 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:45.340091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87b5be05-95ea-4c4e-974a-56b2d7072067 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:45.340720 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87b5be05-95ea-4c4e-974a-56b2d7072067 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:45.462528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b0b338a8-c57f-4abf-ac6a-c665f3b27465 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db092c8eaed4d57be59c00ea0b9a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e715a025f1942409d8e46917422f7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:45.473893 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b0b338a8-c57f-4abf-ac6a-c665f3b27465 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3" status: 200 len: 1527 microversion: 2.1 time: 0.429143 May 27 15:18:45.475145 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2364/4716] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:45 2022] GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3 => generated 1527 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:45.555418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a2d90b70-3d7c-4b7e-b773-5ce1f97124a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:45.556644 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a2d90b70-3d7c-4b7e-b773-5ce1f97124a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:45.569931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a2d90b70-3d7c-4b7e-b773-5ce1f97124a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:45.572301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a2d90b70-3d7c-4b7e-b773-5ce1f97124a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:45.577046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a2d90b70-3d7c-4b7e-b773-5ce1f97124a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:45.577846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a2d90b70-3d7c-4b7e-b773-5ce1f97124a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:45.804789 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-87b5be05-95ea-4c4e-974a-56b2d7072067 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:45.814747 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-87b5be05-95ea-4c4e-974a-56b2d7072067 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 200 len: 1320 microversion: 2.1 time: 0.495175 May 27 15:18:45.818778 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2353/4717] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:45 2022] GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 1320 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:45.837206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a2d90b70-3d7c-4b7e-b773-5ce1f97124a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:45.846728 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a2d90b70-3d7c-4b7e-b773-5ce1f97124a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 200 len: 1366 microversion: 2.1 time: 0.294968 May 27 15:18:45.847340 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2365/4718] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:45 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:45.995346 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d8ec8c76-085e-4128-b29e-da0bae0d5923 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:45.995975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d8ec8c76-085e-4128-b29e-da0bae0d5923 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:46.011468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8ec8c76-085e-4128-b29e-da0bae0d5923 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.011931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8ec8c76-085e-4128-b29e-da0bae0d5923 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.012741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8ec8c76-085e-4128-b29e-da0bae0d5923 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.013192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8ec8c76-085e-4128-b29e-da0bae0d5923 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.490650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-51429bb1-b2fb-49dd-83b9-44c76a93bba7 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:46.491267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-51429bb1-b2fb-49dd-83b9-44c76a93bba7 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] [instance: c7a08ed3-2568-488b-b15d-6f6971fb5ef3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:46.499144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d8ec8c76-085e-4128-b29e-da0bae0d5923 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b135ff735afd48929e72164aafffa3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f687fdd15ef44408d880ba442eef96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:46.507044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51429bb1-b2fb-49dd-83b9-44c76a93bba7 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.510025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51429bb1-b2fb-49dd-83b9-44c76a93bba7 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.510814 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51429bb1-b2fb-49dd-83b9-44c76a93bba7 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.511307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51429bb1-b2fb-49dd-83b9-44c76a93bba7 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.512056 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d8ec8c76-085e-4128-b29e-da0bae0d5923 tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c" status: 200 len: 1506 microversion: 2.1 time: 0.518381 May 27 15:18:46.513127 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2354/4719] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:45 2022] GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c => generated 1506 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:46.527065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-84aadfdd-cc2d-4fe5-b0dc-c694cb233e9a req-5dd100fe-0b09-45c1-ac63-569894ae4efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a08ed3-2568-488b-b15d-6f6971fb5ef3", "name": "network-vif-deleted", "tag": "530b7268-4572-43ad-892e-5395cf0257a4"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:46.556865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-84aadfdd-cc2d-4fe5-b0dc-c694cb233e9a req-5dd100fe-0b09-45c1-ac63-569894ae4efe service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.561156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-84aadfdd-cc2d-4fe5-b0dc-c694cb233e9a req-5dd100fe-0b09-45c1-ac63-569894ae4efe service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.591154 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-84aadfdd-cc2d-4fe5-b0dc-c694cb233e9a req-5dd100fe-0b09-45c1-ac63-569894ae4efe service nova] Creating event network-vif-deleted:530b7268-4572-43ad-892e-5395cf0257a4 for instance c7a08ed3-2568-488b-b15d-6f6971fb5ef3 on n-h2-843621-1 May 27 15:18:46.597357 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-84aadfdd-cc2d-4fe5-b0dc-c694cb233e9a req-5dd100fe-0b09-45c1-ac63-569894ae4efe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078971 May 27 15:18:46.598462 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2355/4720] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:46.606947 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0679ef9d-9bd5-48f2-b5ec-40290318743a tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '.version_select at 0x7fc77560dca0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:46.606947 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0679ef9d-9bd5-48f2-b5ec-40290318743a tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:46.611783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0679ef9d-9bd5-48f2-b5ec-40290318743a tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.612239 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0679ef9d-9bd5-48f2-b5ec-40290318743a tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.613278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0679ef9d-9bd5-48f2-b5ec-40290318743a tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.613726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0679ef9d-9bd5-48f2-b5ec-40290318743a tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.649748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-51429bb1-b2fb-49dd-83b9-44c76a93bba7 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db092c8eaed4d57be59c00ea0b9a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e715a025f1942409d8e46917422f7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:46.650791 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0679ef9d-9bd5-48f2-b5ec-40290318743a tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.051070 May 27 15:18:46.651713 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2356/4721] 10.222.0.13 () {58 vars in 1295 bytes} [Fri May 27 15:18:46 2022] GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c/os-instance-actions => generated 611 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:46.661189 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-51429bb1-b2fb-49dd-83b9-44c76a93bba7 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3" status: 200 len: 1310 microversion: 2.1 time: 0.174408 May 27 15:18:46.662201 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2366/4722] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:46 2022] GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3 => generated 1310 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:46.665613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f8f5b127-bf8c-487a-bea7-0f6acd0e541e tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:46.666129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f8f5b127-bf8c-487a-bea7-0f6acd0e541e tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:46.672222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8f5b127-bf8c-487a-bea7-0f6acd0e541e tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.672699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8f5b127-bf8c-487a-bea7-0f6acd0e541e tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.673460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8f5b127-bf8c-487a-bea7-0f6acd0e541e tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.673908 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8f5b127-bf8c-487a-bea7-0f6acd0e541e tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.700168 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f8f5b127-bf8c-487a-bea7-0f6acd0e541e tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:18:46.799081 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f8f5b127-bf8c-487a-bea7-0f6acd0e541e tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c" status: 204 len: 0 microversion: 2.1 time: 0.138317 May 27 15:18:46.799910 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2357/4723] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:18:46 2022] DELETE /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:18:46.807811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ceb01fe4-b251-4ab6-9782-04c5f589a19e tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:46.808619 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ceb01fe4-b251-4ab6-9782-04c5f589a19e tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:46.817328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ceb01fe4-b251-4ab6-9782-04c5f589a19e tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.817876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ceb01fe4-b251-4ab6-9782-04c5f589a19e tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.818757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ceb01fe4-b251-4ab6-9782-04c5f589a19e tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.819278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ceb01fe4-b251-4ab6-9782-04c5f589a19e tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.832872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f569037e-6842-4645-bfdb-c0b666125cc9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:46.833684 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f569037e-6842-4645-bfdb-c0b666125cc9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:46.841073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f569037e-6842-4645-bfdb-c0b666125cc9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.841073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f569037e-6842-4645-bfdb-c0b666125cc9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.841461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f569037e-6842-4645-bfdb-c0b666125cc9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.841940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f569037e-6842-4645-bfdb-c0b666125cc9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:47.143261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ceb01fe4-b251-4ab6-9782-04c5f589a19e tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b135ff735afd48929e72164aafffa3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f687fdd15ef44408d880ba442eef96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:47.153358 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ceb01fe4-b251-4ab6-9782-04c5f589a19e tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c" status: 200 len: 1512 microversion: 2.1 time: 0.349365 May 27 15:18:47.154555 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2367/4724] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:46 2022] GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c => generated 1512 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:47.168710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c87c05d9-2a27-40c1-a621-759d68ee3b43 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:47.169510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c87c05d9-2a27-40c1-a621-759d68ee3b43 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:47.178307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c87c05d9-2a27-40c1-a621-759d68ee3b43 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:47.178799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c87c05d9-2a27-40c1-a621-759d68ee3b43 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:47.179580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c87c05d9-2a27-40c1-a621-759d68ee3b43 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:47.180079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c87c05d9-2a27-40c1-a621-759d68ee3b43 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:47.207120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f569037e-6842-4645-bfdb-c0b666125cc9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:47.221123 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f569037e-6842-4645-bfdb-c0b666125cc9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 200 len: 1320 microversion: 2.1 time: 0.391534 May 27 15:18:47.231954 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2358/4725] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:46 2022] GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 1320 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:47.520119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c87c05d9-2a27-40c1-a621-759d68ee3b43 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:47.537322 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c87c05d9-2a27-40c1-a621-759d68ee3b43 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 200 len: 1366 microversion: 2.1 time: 0.381461 May 27 15:18:47.537911 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2368/4726] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:47 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:47.680555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a91e7330-1c3c-471c-b6d4-872ec07148f3 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:47.681583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a91e7330-1c3c-471c-b6d4-872ec07148f3 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] [instance: c7a08ed3-2568-488b-b15d-6f6971fb5ef3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:47.691588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a91e7330-1c3c-471c-b6d4-872ec07148f3 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:47.692114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a91e7330-1c3c-471c-b6d4-872ec07148f3 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:47.693337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a91e7330-1c3c-471c-b6d4-872ec07148f3 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:47.693939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a91e7330-1c3c-471c-b6d4-872ec07148f3 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:47.738230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:47.742893 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a91e7330-1c3c-471c-b6d4-872ec07148f3 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:47.743497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a91e7330-1c3c-471c-b6d4-872ec07148f3 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:47.744222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-a91e7330-1c3c-471c-b6d4-872ec07148f3 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lazy-loading 'fault' on Instance uuid c7a08ed3-2568-488b-b15d-6f6971fb5ef3 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:18:47.794094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=14 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:47.822244 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-d7451fab-da7a-4b57-975a-8ef1efd9e428 req-d18eb95d-bdd7-48c3-bcb1-f0240404943a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b014831-b34a-4451-9bf7-f9a5d3dbb17f", "tag": "41df9384-4288-4063-947f-534a792f3faa"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:47.824904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a91e7330-1c3c-471c-b6d4-872ec07148f3 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db092c8eaed4d57be59c00ea0b9a4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e715a025f1942409d8e46917422f7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:47.833987 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a91e7330-1c3c-471c-b6d4-872ec07148f3 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3" status: 200 len: 1315 microversion: 2.1 time: 0.159887 May 27 15:18:47.834949 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2359/4727] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:47 2022] GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:47.838350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d7451fab-da7a-4b57-975a-8ef1efd9e428 req-d18eb95d-bdd7-48c3-bcb1-f0240404943a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:47.843942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d7451fab-da7a-4b57-975a-8ef1efd9e428 req-d18eb95d-bdd7-48c3-bcb1-f0240404943a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:47.869885 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-d7451fab-da7a-4b57-975a-8ef1efd9e428 req-d18eb95d-bdd7-48c3-bcb1-f0240404943a service nova] Creating event network-changed:41df9384-4288-4063-947f-534a792f3faa for instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f on n-h2-843621-1 May 27 15:18:47.881840 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-d7451fab-da7a-4b57-975a-8ef1efd9e428 req-d18eb95d-bdd7-48c3-bcb1-f0240404943a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063694 May 27 15:18:47.885257 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2369/4728] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:18:48.171490 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4e3e1d8d-a2e8-47e7-8b98-2d69c0522beb tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:48.172092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4e3e1d8d-a2e8-47e7-8b98-2d69c0522beb tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:48.188302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e3e1d8d-a2e8-47e7-8b98-2d69c0522beb tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:48.188630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e3e1d8d-a2e8-47e7-8b98-2d69c0522beb tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:48.189456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e3e1d8d-a2e8-47e7-8b98-2d69c0522beb tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:48.189906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e3e1d8d-a2e8-47e7-8b98-2d69c0522beb tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:48.240525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ede2df34-7004-4e12-a1d9-93763228cef6 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:48.241562 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ede2df34-7004-4e12-a1d9-93763228cef6 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:48.243833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:48.254364 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ede2df34-7004-4e12-a1d9-93763228cef6 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:48.262457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ede2df34-7004-4e12-a1d9-93763228cef6 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:48.266169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ede2df34-7004-4e12-a1d9-93763228cef6 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:48.267000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ede2df34-7004-4e12-a1d9-93763228cef6 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:48.770718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4e3e1d8d-a2e8-47e7-8b98-2d69c0522beb tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b135ff735afd48929e72164aafffa3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f687fdd15ef44408d880ba442eef96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:48.787160 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4e3e1d8d-a2e8-47e7-8b98-2d69c0522beb tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c" status: 200 len: 1512 microversion: 2.1 time: 0.619595 May 27 15:18:48.799028 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2360/4729] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:48 2022] GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c => generated 1512 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:48.799028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-36bc85ff-cf8a-422f-9eb4-adbd6b1dc681 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:48.799028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-36bc85ff-cf8a-422f-9eb4-adbd6b1dc681 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:48.812640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-36bc85ff-cf8a-422f-9eb4-adbd6b1dc681 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:48.821639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-36bc85ff-cf8a-422f-9eb4-adbd6b1dc681 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:48.822574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-36bc85ff-cf8a-422f-9eb4-adbd6b1dc681 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:48.823107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-36bc85ff-cf8a-422f-9eb4-adbd6b1dc681 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:48.898989 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ede2df34-7004-4e12-a1d9-93763228cef6 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:48.909189 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ede2df34-7004-4e12-a1d9-93763228cef6 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 200 len: 1320 microversion: 2.1 time: 0.674267 May 27 15:18:48.909786 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2370/4730] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:48 2022] GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 1320 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:48.925722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-25126e05-4606-468d-aa96-19b012da4ee4 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:48.926308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-25126e05-4606-468d-aa96-19b012da4ee4 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] [instance: c7a08ed3-2568-488b-b15d-6f6971fb5ef3] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:48.941806 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-25126e05-4606-468d-aa96-19b012da4ee4 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:48.942270 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-25126e05-4606-468d-aa96-19b012da4ee4 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:48.943066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-25126e05-4606-468d-aa96-19b012da4ee4 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:48.943520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-25126e05-4606-468d-aa96-19b012da4ee4 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:48.970665 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-25126e05-4606-468d-aa96-19b012da4ee4 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] HTTP exception thrown: Instance c7a08ed3-2568-488b-b15d-6f6971fb5ef3 could not be found. May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-25126e05-4606-468d-aa96-19b012da4ee4 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Request method failure captured: May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3 HTTP/1.1 May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOvCKYMjvheh6YmB6NF6HmHrylooIjKVlntQDalxrGBmhOF09fGVumx8z-Jw6BJU5KcL6s3Pp8VHC0XdQM6BD8xUlY4k3H4CNzD3GSwIZ-XNKRnTfDJk2xAuTSNPguriBwKUv0VleBOCLbV1itWNcwDDPGWP3dy2VCyCShtSmSY_eCw May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 6e715a025f1942409d8e46917422f7a7 May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1375964276 May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6e715a025f1942409d8e46917422f7a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6e715a025f1942409d8e46917422f7a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6e715a025f1942409d8e46917422f7a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6e715a025f1942409d8e46917422f7a7", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1375964276 May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 6e715a025f1942409d8e46917422f7a7 May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1375964276 May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerAddressesNegativeTestJSON-1375964276-project May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 1db092c8eaed4d57be59c00ea0b9a4be May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1375964276-project May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance c7a08ed3-2568-488b-b15d-6f6971fb5ef3 could not be found. May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'c7a08ed3-2568-488b-b15d-6f6971fb5ef3'} May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7a08ed3-2568-488b-b15d-6f6971fb5ef3 could not be found. May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7a08ed3-2568-488b-b15d-6f6971fb5ef3 could not be found. May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:18:48.972770 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:48.976361 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:18:48.976361 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:48.976361 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:48.976361 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:48.976361 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:48.976361 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:48.976361 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7a08ed3-2568-488b-b15d-6f6971fb5ef3 could not be found. May 27 15:18:48.976361 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:18:48.978222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-25126e05-4606-468d-aa96-19b012da4ee4 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] Returning 404 to user: Instance c7a08ed3-2568-488b-b15d-6f6971fb5ef3 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:48.979307 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-25126e05-4606-468d-aa96-19b012da4ee4 tempest-ServerAddressesNegativeTestJSON-1375964276 tempest-ServerAddressesNegativeTestJSON-1375964276-project] 10.222.0.13 "GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3" status: 404 len: 111 microversion: 2.1 time: 0.057574 May 27 15:18:48.983984 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2371/4731] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:48 2022] GET /compute/v2.1/servers/c7a08ed3-2568-488b-b15d-6f6971fb5ef3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:49.095394 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-36bc85ff-cf8a-422f-9eb4-adbd6b1dc681 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:49.103556 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-36bc85ff-cf8a-422f-9eb4-adbd6b1dc681 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 200 len: 1366 microversion: 2.1 time: 0.314363 May 27 15:18:49.104357 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2361/4732] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:48 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:49.499086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-f6415316-83e6-455c-b54d-201a984673e2 req-52137d38-3825-4471-81e7-1be78c383283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b815748c-e8c7-40e9-ada5-ef4b109b167c", "name": "network-vif-deleted", "tag": "23e3058e-6d23-4f71-8251-80af2c48faa4"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:49.526428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f6415316-83e6-455c-b54d-201a984673e2 req-52137d38-3825-4471-81e7-1be78c383283 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:49.532203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f6415316-83e6-455c-b54d-201a984673e2 req-52137d38-3825-4471-81e7-1be78c383283 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:49.551306 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-f6415316-83e6-455c-b54d-201a984673e2 req-52137d38-3825-4471-81e7-1be78c383283 service nova] Creating event network-vif-deleted:23e3058e-6d23-4f71-8251-80af2c48faa4 for instance b815748c-e8c7-40e9-ada5-ef4b109b167c on n-h2-843621-1 May 27 15:18:49.569433 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-f6415316-83e6-455c-b54d-201a984673e2 req-52137d38-3825-4471-81e7-1be78c383283 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082998 May 27 15:18:49.570286 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2372/4733] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:49.815825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5c7777e9-e0ee-4a69-89f6-76bc3b5eccdc tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:49.817219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5c7777e9-e0ee-4a69-89f6-76bc3b5eccdc tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:49.842918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c7777e9-e0ee-4a69-89f6-76bc3b5eccdc tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:49.845059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c7777e9-e0ee-4a69-89f6-76bc3b5eccdc tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:49.851151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c7777e9-e0ee-4a69-89f6-76bc3b5eccdc tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:49.851151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c7777e9-e0ee-4a69-89f6-76bc3b5eccdc tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:49.923506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:49.928811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cfe0b53c-98ec-4436-a703-a3fa0d90760f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:49.929854 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cfe0b53c-98ec-4436-a703-a3fa0d90760f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:49.946415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfe0b53c-98ec-4436-a703-a3fa0d90760f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:49.958921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfe0b53c-98ec-4436-a703-a3fa0d90760f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:49.961357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfe0b53c-98ec-4436-a703-a3fa0d90760f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:49.962919 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfe0b53c-98ec-4436-a703-a3fa0d90760f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:49.970561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c7777e9-e0ee-4a69-89f6-76bc3b5eccdc tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:49.971733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5c7777e9-e0ee-4a69-89f6-76bc3b5eccdc tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:49.975920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-5c7777e9-e0ee-4a69-89f6-76bc3b5eccdc tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lazy-loading 'fault' on Instance uuid b815748c-e8c7-40e9-ada5-ef4b109b167c {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:18:50.172975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5c7777e9-e0ee-4a69-89f6-76bc3b5eccdc tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b135ff735afd48929e72164aafffa3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f687fdd15ef44408d880ba442eef96e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:50.187738 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5c7777e9-e0ee-4a69-89f6-76bc3b5eccdc tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c" status: 200 len: 1307 microversion: 2.1 time: 0.377578 May 27 15:18:50.188364 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2362/4734] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:49 2022] GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c => generated 1307 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:50.197308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-121a5c4d-0220-43e8-8377-0d8789acbbe3 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:50.203805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-121a5c4d-0220-43e8-8377-0d8789acbbe3 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:50.244986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-121a5c4d-0220-43e8-8377-0d8789acbbe3 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:50.247459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-121a5c4d-0220-43e8-8377-0d8789acbbe3 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:50.250214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-121a5c4d-0220-43e8-8377-0d8789acbbe3 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:50.254743 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-121a5c4d-0220-43e8-8377-0d8789acbbe3 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:50.706661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cfe0b53c-98ec-4436-a703-a3fa0d90760f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:50.719816 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cfe0b53c-98ec-4436-a703-a3fa0d90760f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 200 len: 1320 microversion: 2.1 time: 0.797275 May 27 15:18:50.720797 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2373/4735] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:49 2022] GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 1320 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:51.075022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-121a5c4d-0220-43e8-8377-0d8789acbbe3 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:51.091258 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-121a5c4d-0220-43e8-8377-0d8789acbbe3 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 200 len: 1366 microversion: 2.1 time: 0.897608 May 27 15:18:51.098298 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2363/4736] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:50 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 1366 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:51.224252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-136d37b5-48c8-4626-8a2a-f6fcbb85165b tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:51.225875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-136d37b5-48c8-4626-8a2a-f6fcbb85165b tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] [instance: b815748c-e8c7-40e9-ada5-ef4b109b167c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:51.232147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=22 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:51.271888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-136d37b5-48c8-4626-8a2a-f6fcbb85165b tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:51.275429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-136d37b5-48c8-4626-8a2a-f6fcbb85165b tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:51.276318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-136d37b5-48c8-4626-8a2a-f6fcbb85165b tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:51.277092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-136d37b5-48c8-4626-8a2a-f6fcbb85165b tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:51.364236 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-136d37b5-48c8-4626-8a2a-f6fcbb85165b tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] HTTP exception thrown: Instance b815748c-e8c7-40e9-ada5-ef4b109b167c could not be found. May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-136d37b5-48c8-4626-8a2a-f6fcbb85165b tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Request method failure captured: May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c HTTP/1.1 May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOu6v5scmwnOEk22iM9Evktq7QdeRVyj4-USPTBGhv-hZHZL_Kwv-85LIgAeQVSfhkeCXb-WSW7FbTTx3RuppNgA7Wx0khQ4O-uZvY8QskdY4E4i7UJnKNuMBrOr688XfGfPaMu2rAez47jLoFKYj3-gAaBcruYvaAQFzMw9KXrc_kM May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1f687fdd15ef44408d880ba442eef96e May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-InstanceActionsTestJSON-1569210366 May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f687fdd15ef44408d880ba442eef96e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f687fdd15ef44408d880ba442eef96e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1f687fdd15ef44408d880ba442eef96e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1f687fdd15ef44408d880ba442eef96e", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-InstanceActionsTestJSON-1569210366 May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1f687fdd15ef44408d880ba442eef96e May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1569210366 May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-InstanceActionsTestJSON-1569210366-project May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b135ff735afd48929e72164aafffa3e4 May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-InstanceActionsTestJSON-1569210366-project May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance b815748c-e8c7-40e9-ada5-ef4b109b167c could not be found. May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'b815748c-e8c7-40e9-ada5-ef4b109b167c'} May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b815748c-e8c7-40e9-ada5-ef4b109b167c could not be found. May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b815748c-e8c7-40e9-ada5-ef4b109b167c could not be found. May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:51.377298 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:18:51.395582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:51.395582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:51.395582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:51.395582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:51.395582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:51.395582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b815748c-e8c7-40e9-ada5-ef4b109b167c could not be found. May 27 15:18:51.395582 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:18:51.405601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-136d37b5-48c8-4626-8a2a-f6fcbb85165b tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] Returning 404 to user: Instance b815748c-e8c7-40e9-ada5-ef4b109b167c could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:51.415925 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-136d37b5-48c8-4626-8a2a-f6fcbb85165b tempest-InstanceActionsTestJSON-1569210366 tempest-InstanceActionsTestJSON-1569210366-project] 10.222.0.13 "GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c" status: 404 len: 111 microversion: 2.1 time: 0.196536 May 27 15:18:51.431683 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2374/4737] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:51 2022] GET /compute/v2.1/servers/b815748c-e8c7-40e9-ada5-ef4b109b167c => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:18:51.738092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6808086e-4674-4782-b2f7-f6973228f8ea tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:51.738693 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6808086e-4674-4782-b2f7-f6973228f8ea tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:51.774839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6808086e-4674-4782-b2f7-f6973228f8ea tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:51.780421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6808086e-4674-4782-b2f7-f6973228f8ea tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:51.781970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6808086e-4674-4782-b2f7-f6973228f8ea tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:51.794051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6808086e-4674-4782-b2f7-f6973228f8ea tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:52.114099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d8260533-fbf6-437e-acd2-d7810abfba0b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:52.115209 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d8260533-fbf6-437e-acd2-d7810abfba0b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:52.130498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8260533-fbf6-437e-acd2-d7810abfba0b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:52.131590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8260533-fbf6-437e-acd2-d7810abfba0b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:52.133036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8260533-fbf6-437e-acd2-d7810abfba0b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:52.137331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8260533-fbf6-437e-acd2-d7810abfba0b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:52.676065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6808086e-4674-4782-b2f7-f6973228f8ea tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:52.693409 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6808086e-4674-4782-b2f7-f6973228f8ea tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 200 len: 1320 microversion: 2.1 time: 0.959725 May 27 15:18:52.702719 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2364/4738] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:51 2022] GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 1320 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:52.753739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d8260533-fbf6-437e-acd2-d7810abfba0b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:52.772016 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d8260533-fbf6-437e-acd2-d7810abfba0b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 200 len: 1366 microversion: 2.1 time: 0.661377 May 27 15:18:52.774201 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2375/4739] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:52 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 1366 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:53.720215 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2e472e2d-cbc1-483d-86c2-f9c73f21ef98 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:53.720934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2e472e2d-cbc1-483d-86c2-f9c73f21ef98 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:53.740147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e472e2d-cbc1-483d-86c2-f9c73f21ef98 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:53.740615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e472e2d-cbc1-483d-86c2-f9c73f21ef98 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:53.741445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e472e2d-cbc1-483d-86c2-f9c73f21ef98 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:53.741898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e472e2d-cbc1-483d-86c2-f9c73f21ef98 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:53.793490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-281c10e5-9b6c-4b0e-a8e4-5ca3d82b9afc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:53.795560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-281c10e5-9b6c-4b0e-a8e4-5ca3d82b9afc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:53.804549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-281c10e5-9b6c-4b0e-a8e4-5ca3d82b9afc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:53.805433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-281c10e5-9b6c-4b0e-a8e4-5ca3d82b9afc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:53.806495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-281c10e5-9b6c-4b0e-a8e4-5ca3d82b9afc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:53.807160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-281c10e5-9b6c-4b0e-a8e4-5ca3d82b9afc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:54.436997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2e472e2d-cbc1-483d-86c2-f9c73f21ef98 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:54.452078 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2e472e2d-cbc1-483d-86c2-f9c73f21ef98 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 200 len: 1320 microversion: 2.1 time: 0.734025 May 27 15:18:54.464832 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2365/4740] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:53 2022] GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 1320 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:54.496382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-281c10e5-9b6c-4b0e-a8e4-5ca3d82b9afc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:54.512214 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-281c10e5-9b6c-4b0e-a8e4-5ca3d82b9afc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 200 len: 1366 microversion: 2.1 time: 0.724171 May 27 15:18:54.523576 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2376/4741] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:53 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 1366 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:55.089404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-0c1cca0e-c67d-41eb-97bf-53552462d2bb req-bd35c9db-42d6-41fb-8474-2c6f6d37ca85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6863a0f9-a1ac-4dd5-93f7-1089256bd265", "name": "network-vif-plugged", "status": "completed", "tag": "456bdf86-20a6-4d02-bcf3-cb8866dd6114"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:55.107067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0c1cca0e-c67d-41eb-97bf-53552462d2bb req-bd35c9db-42d6-41fb-8474-2c6f6d37ca85 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:55.108150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0c1cca0e-c67d-41eb-97bf-53552462d2bb req-bd35c9db-42d6-41fb-8474-2c6f6d37ca85 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:55.134955 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-0c1cca0e-c67d-41eb-97bf-53552462d2bb req-bd35c9db-42d6-41fb-8474-2c6f6d37ca85 service nova] Creating event network-vif-plugged:456bdf86-20a6-4d02-bcf3-cb8866dd6114 for instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 on n-h1-843621-1 May 27 15:18:55.160147 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-0c1cca0e-c67d-41eb-97bf-53552462d2bb req-bd35c9db-42d6-41fb-8474-2c6f6d37ca85 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.673957 May 27 15:18:55.165701 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2366/4742] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:55.487096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7a197478-158f-46ed-bce4-70b049562dd0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:55.488667 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7a197478-158f-46ed-bce4-70b049562dd0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:55.508017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a197478-158f-46ed-bce4-70b049562dd0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:55.514291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a197478-158f-46ed-bce4-70b049562dd0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:55.515446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a197478-158f-46ed-bce4-70b049562dd0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:55.516515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a197478-158f-46ed-bce4-70b049562dd0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:55.535902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b7085bbc-8fb8-4c19-8dfe-7af28386e090 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:55.536954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b7085bbc-8fb8-4c19-8dfe-7af28386e090 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:55.553053 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:55.559752 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b7085bbc-8fb8-4c19-8dfe-7af28386e090 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:55.561560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b7085bbc-8fb8-4c19-8dfe-7af28386e090 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:55.564030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b7085bbc-8fb8-4c19-8dfe-7af28386e090 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:55.567531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b7085bbc-8fb8-4c19-8dfe-7af28386e090 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:55.629523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:55.955874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b7085bbc-8fb8-4c19-8dfe-7af28386e090 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:55.968653 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b7085bbc-8fb8-4c19-8dfe-7af28386e090 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 200 len: 1366 microversion: 2.1 time: 0.441832 May 27 15:18:55.970848 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2367/4743] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:55 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 1366 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:55.996147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7a197478-158f-46ed-bce4-70b049562dd0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:56.007203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:56.011923 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7a197478-158f-46ed-bce4-70b049562dd0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 200 len: 1320 microversion: 2.1 time: 0.528527 May 27 15:18:56.017608 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2377/4744] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:55 2022] GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 1320 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:56.987141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3e7973f9-1759-4859-b97e-70e84abf442e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:56.987748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3e7973f9-1759-4859-b97e-70e84abf442e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:57.003877 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e7973f9-1759-4859-b97e-70e84abf442e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:57.004364 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e7973f9-1759-4859-b97e-70e84abf442e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:57.007833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e7973f9-1759-4859-b97e-70e84abf442e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:57.008311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e7973f9-1759-4859-b97e-70e84abf442e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:57.240472 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bc7f3ad3-d844-4218-bc38-cf5841d871bb tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Action: 'create', calling method: .version_select at 0x7fc7755dbee0>, body: {"keypair": {"name": "tempest-keypair-429068665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkJ9s88ADkszjO6yZZYicOpfEMI0qI1DSqzuRYMgNpOZKD2kjm3XU2TgATox8N25KS2w5+n7qkh0hmmHqQ1p+B7Ng1zjXhMOMvlwwMuTWafKpmkBcy/BStMb51oQeaoRw=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:57.274773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-bc7f3ad3-d844-4218-bc38-cf5841d871bb tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Getting quotas for project 4b2928af5e6d47cb8c7808250e57de6c. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:57.291781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-bc7f3ad3-d844-4218-bc38-cf5841d871bb tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Getting quotas for user 9070922da9654a8899685d1df6e7cfdc and project 4b2928af5e6d47cb8c7808250e57de6c. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:57.340757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3e7973f9-1759-4859-b97e-70e84abf442e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:57.342252 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bc7f3ad3-d844-4218-bc38-cf5841d871bb tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.741142 May 27 15:18:57.343354 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2368/4745] 10.222.0.13 () {62 vars in 1198 bytes} [Fri May 27 15:18:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 743 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 27 15:18:57.351676 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3e7973f9-1759-4859-b97e-70e84abf442e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 200 len: 1366 microversion: 2.1 time: 0.368745 May 27 15:18:57.360027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-db12785f-ad40-479a-8b36-c7ca75f50981 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:57.361007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-db12785f-ad40-479a-8b36-c7ca75f50981 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:57.364718 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2378/4746] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:56 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 1366 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:57.371850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-15cab6d8-f855-4030-add8-d45c697cf023 req-cd4314d3-bb29-49fe-9fbf-b39ceea97ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b014831-b34a-4451-9bf7-f9a5d3dbb17f", "name": "network-vif-plugged", "status": "completed", "tag": "41df9384-4288-4063-947f-534a792f3faa"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:57.373682 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db12785f-ad40-479a-8b36-c7ca75f50981 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:57.374378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db12785f-ad40-479a-8b36-c7ca75f50981 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:57.376441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db12785f-ad40-479a-8b36-c7ca75f50981 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:57.377138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db12785f-ad40-479a-8b36-c7ca75f50981 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:57.397381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-15cab6d8-f855-4030-add8-d45c697cf023 req-cd4314d3-bb29-49fe-9fbf-b39ceea97ada service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:57.402869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-15cab6d8-f855-4030-add8-d45c697cf023 req-cd4314d3-bb29-49fe-9fbf-b39ceea97ada service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:57.421214 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-15cab6d8-f855-4030-add8-d45c697cf023 req-cd4314d3-bb29-49fe-9fbf-b39ceea97ada service nova] Creating event network-vif-plugged:41df9384-4288-4063-947f-534a792f3faa for instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f on n-h2-843621-1 May 27 15:18:57.445506 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-15cab6d8-f855-4030-add8-d45c697cf023 req-cd4314d3-bb29-49fe-9fbf-b39ceea97ada service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079191 May 27 15:18:57.450360 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2379/4747] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:57.472220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3c700681-5b27-4a66-9684-476bf96db36d tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Calling method '.version_select at 0x7fc7763dda60>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:57.511277 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3c700681-5b27-4a66-9684-476bf96db36d tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-429068665" status: 200 len: 512 microversion: 2.2 time: 0.043464 May 27 15:18:57.515551 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2380/4748] 10.222.0.13 () {60 vars in 1254 bytes} [Fri May 27 15:18:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-429068665 => generated 512 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:57.549136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7336292b-0a63-43d0-9d91-7e1fa237458d tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Calling method '.version_select at 0x7fc77634eb80>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:57.613072 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7336292b-0a63-43d0-9d91-7e1fa237458d tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-429068665" status: 204 len: 0 microversion: 2.2 time: 0.089023 May 27 15:18:57.620923 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2381/4749] 10.222.0.13 () {60 vars in 1257 bytes} [Fri May 27 15:18:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-429068665 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:18:57.647633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-16b3f6c8-6efb-4302-9941-411fc52658be tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Action: 'create', calling method: .version_select at 0x7fc7763c69d0>, body: {"keypair": {"name": "tempest-keypair-1032383685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKA6MWnAPJ1xZfWUhOJJQ0tMyu6pOeaMVstTkGSDVty33ylECRgQjoj+Zsasq9alPeh/TcZC1/DYB7gC9fK1mW9u2CgGNSY6HLcf1QqaBcZD0d7dy9TlLpFalTkg9HzJbQ=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:57.703569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-16b3f6c8-6efb-4302-9941-411fc52658be tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Getting quotas for project 4b2928af5e6d47cb8c7808250e57de6c. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:57.717964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-16b3f6c8-6efb-4302-9941-411fc52658be tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Getting quotas for user 9070922da9654a8899685d1df6e7cfdc and project 4b2928af5e6d47cb8c7808250e57de6c. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:57.755886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-db12785f-ad40-479a-8b36-c7ca75f50981 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:57.768215 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-db12785f-ad40-479a-8b36-c7ca75f50981 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 200 len: 1501 microversion: 2.1 time: 0.423263 May 27 15:18:57.769393 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2369/4750] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:57 2022] GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 1501 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:57.776492 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-16b3f6c8-6efb-4302-9941-411fc52658be tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.151499 May 27 15:18:57.778578 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2382/4751] 10.222.0.13 () {62 vars in 1198 bytes} [Fri May 27 15:18:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 156 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 27 15:18:57.804418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4c351afc-d906-4ec9-85dc-98e6be93cd93 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:57.811124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4c351afc-d906-4ec9-85dc-98e6be93cd93 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:57.818649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-84ed6958-951e-477e-8314-42fdaef270b2 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Calling method '.version_select at 0x7fc775c21f70>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:57.834811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c351afc-d906-4ec9-85dc-98e6be93cd93 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:57.845381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c351afc-d906-4ec9-85dc-98e6be93cd93 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:57.849095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c351afc-d906-4ec9-85dc-98e6be93cd93 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:57.849703 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c351afc-d906-4ec9-85dc-98e6be93cd93 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:57.872323 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-84ed6958-951e-477e-8314-42fdaef270b2 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1032383685" status: 204 len: 0 microversion: 2.2 time: 0.084605 May 27 15:18:57.877717 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2383/4752] 10.222.0.13 () {60 vars in 1260 bytes} [Fri May 27 15:18:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1032383685 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:18:58.028779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-77de772d-5b4e-43db-8542-df6443736a1f tempest-ServerGroup264TestJSON-1904828806 tempest-ServerGroup264TestJSON-1904828806-project] Action: 'create', calling method: .version_select at 0x7fc775b1e430>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:58.086967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-77de772d-5b4e-43db-8542-df6443736a1f tempest-ServerGroup264TestJSON-1904828806 tempest-ServerGroup264TestJSON-1904828806-project] Getting quotas for project 92341db4472b40329798e870afbb87dc. Resources: {'server_groups'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:58.097552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-77de772d-5b4e-43db-8542-df6443736a1f tempest-ServerGroup264TestJSON-1904828806 tempest-ServerGroup264TestJSON-1904828806-project] Getting quotas for user fea201ecf49b485a8e27d8093a100380 and project 92341db4472b40329798e870afbb87dc. Resources: {'server_groups'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:58.118066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4c351afc-d906-4ec9-85dc-98e6be93cd93 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:58.129840 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4c351afc-d906-4ec9-85dc-98e6be93cd93 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 200 len: 1501 microversion: 2.1 time: 0.346468 May 27 15:18:58.132072 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2370/4753] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:57 2022] GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 1501 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:58.149471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d975c99b-ad42-4871-b344-cf64b2c0aa23 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Action: 'create', calling method: .version_select at 0x7fc7756e6d30>, body: {"keypair": {"name": "tempest-keypair-1784659275", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:58.185666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-d975c99b-ad42-4871-b344-cf64b2c0aa23 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Getting quotas for project 4b2928af5e6d47cb8c7808250e57de6c. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:58.194503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-77de772d-5b4e-43db-8542-df6443736a1f tempest-ServerGroup264TestJSON-1904828806 tempest-ServerGroup264TestJSON-1904828806-project] Getting quotas for project 92341db4472b40329798e870afbb87dc. Resources: {'server_groups'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:58.201912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-d975c99b-ad42-4871-b344-cf64b2c0aa23 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Getting quotas for user 9070922da9654a8899685d1df6e7cfdc and project 4b2928af5e6d47cb8c7808250e57de6c. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:58.208944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-77de772d-5b4e-43db-8542-df6443736a1f tempest-ServerGroup264TestJSON-1904828806 tempest-ServerGroup264TestJSON-1904828806-project] Getting quotas for user fea201ecf49b485a8e27d8093a100380 and project 92341db4472b40329798e870afbb87dc. Resources: {'server_groups'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:58.254831 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-77de772d-5b4e-43db-8542-df6443736a1f tempest-ServerGroup264TestJSON-1904828806 tempest-ServerGroup264TestJSON-1904828806-project] 10.222.0.13 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.372130 May 27 15:18:58.266070 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2384/4754] 10.222.0.13 () {62 vars in 1213 bytes} [Fri May 27 15:18:57 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:18:58.266265 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d975c99b-ad42-4871-b344-cf64b2c0aa23 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.131160 May 27 15:18:58.267265 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2371/4755] 10.222.0.13 () {62 vars in 1198 bytes} [Fri May 27 15:18:58 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 27 15:18:58.273726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5900b1e3-140b-4d6d-a2f2-759f42556f71 tempest-ServerGroup264TestJSON-1904828806 tempest-ServerGroup264TestJSON-1904828806-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:58.275744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-99058df6-3673-4384-8a5f-af618ae64969 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:58.282382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-99058df6-3673-4384-8a5f-af618ae64969 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:58.290510 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5900b1e3-140b-4d6d-a2f2-759f42556f71 tempest-ServerGroup264TestJSON-1904828806 tempest-ServerGroup264TestJSON-1904828806-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.021406 May 27 15:18:58.290736 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2372/4756] 10.222.0.13 () {60 vars in 1192 bytes} [Fri May 27 15:18:58 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:18:58.296838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9b7b105b-6328-4c0c-83c4-04884b75525b tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Calling method '.version_select at 0x7fc77562e550>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:58.306557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99058df6-3673-4384-8a5f-af618ae64969 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:58.308851 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99058df6-3673-4384-8a5f-af618ae64969 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:58.311409 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99058df6-3673-4384-8a5f-af618ae64969 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:58.319752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99058df6-3673-4384-8a5f-af618ae64969 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:58.333445 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9b7b105b-6328-4c0c-83c4-04884b75525b tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784659275" status: 204 len: 0 microversion: 2.2 time: 0.041567 May 27 15:18:58.334673 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2373/4757] 10.222.0.13 () {60 vars in 1260 bytes} [Fri May 27 15:18:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784659275 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:18:58.340332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e6c5beea-0a72-4314-94f0-9614322e8482 tempest-ServerGroup264TestJSON-1904828806 tempest-ServerGroup264TestJSON-1904828806-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:58.350882 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e6c5beea-0a72-4314-94f0-9614322e8482 tempest-ServerGroup264TestJSON-1904828806 tempest-ServerGroup264TestJSON-1904828806-project] 10.222.0.13 "GET /compute/v2.1/os-server-groups/c369ce8e-19ad-4e35-8864-81cfc6e6e9cd" status: 200 len: 235 microversion: 2.64 time: 0.014866 May 27 15:18:58.351669 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2374/4758] 10.222.0.13 () {60 vars in 1303 bytes} [Fri May 27 15:18:58 2022] GET /compute/v2.1/os-server-groups/c369ce8e-19ad-4e35-8864-81cfc6e6e9cd => generated 235 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:18:58.374540 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-39232d9c-9ea7-48bc-9f8f-c48bc6a9590d tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Action: 'create', calling method: .version_select at 0x7fc7755d70d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-908901165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhXz14woQ2akz+vF575uqjHiooFpOFedr35cZSVG0svM1uHkKpLp0m720mVHleGuoKZ8MqgWHW5ywqfKozBYOPb+Mreo11cSmCY3NHo5PWrq87VQx0w6C9g9l1WuVcA2g=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:58.383151 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-99058df6-3673-4384-8a5f-af618ae64969 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:18:58.398766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-39232d9c-9ea7-48bc-9f8f-c48bc6a9590d tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Getting quotas for project 4b2928af5e6d47cb8c7808250e57de6c. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:58.404602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-39232d9c-9ea7-48bc-9f8f-c48bc6a9590d tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Getting quotas for user 9070922da9654a8899685d1df6e7cfdc and project 4b2928af5e6d47cb8c7808250e57de6c. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:58.456323 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-39232d9c-9ea7-48bc-9f8f-c48bc6a9590d tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.103325 May 27 15:18:58.465374 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2375/4759] 10.222.0.13 () {62 vars in 1198 bytes} [Fri May 27 15:18:58 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 27 15:18:58.471239 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-73570581-606b-4397-8434-03416b831b90 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:58.471881 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-73570581-606b-4397-8434-03416b831b90 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:58.479160 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73570581-606b-4397-8434-03416b831b90 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:58.479626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73570581-606b-4397-8434-03416b831b90 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:58.481867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73570581-606b-4397-8434-03416b831b90 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:58.482419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73570581-606b-4397-8434-03416b831b90 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:58.565109 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-99058df6-3673-4384-8a5f-af618ae64969 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 204 len: 0 microversion: 2.1 time: 0.301813 May 27 15:18:58.566167 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2385/4760] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:18:58 2022] DELETE /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:18:58.573270 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-83911e6c-11a9-4cb4-a02d-64251bff4447 tempest-ServerGroup264TestJSON-1904828806 tempest-ServerGroup264TestJSON-1904828806-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:58.603366 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-83911e6c-11a9-4cb4-a02d-64251bff4447 tempest-ServerGroup264TestJSON-1904828806 tempest-ServerGroup264TestJSON-1904828806-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/c369ce8e-19ad-4e35-8864-81cfc6e6e9cd" status: 204 len: 0 microversion: 2.64 time: 0.034842 May 27 15:18:58.604167 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2386/4761] 10.222.0.13 () {60 vars in 1306 bytes} [Fri May 27 15:18:58 2022] DELETE /compute/v2.1/os-server-groups/c369ce8e-19ad-4e35-8864-81cfc6e6e9cd => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:18:58.613604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-002ed5dc-32eb-42e0-9596-1da37e7084c6 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Action: 'create', calling method: .version_select at 0x7fc7763c6670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1957897784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuOu0piRphPRyxeSbqm26WAXR4VyRYpMdaiG86t1bzxmzs9AwJ18BAdWb5HVD5ZqhyuAXF/Y/ntQ8PTecJ9ptaS1/APJMasDh6Yegxpl1G+P2zKhi1bNsbfjJLk9bZX5Q=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:58.629498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-002ed5dc-32eb-42e0-9596-1da37e7084c6 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Getting quotas for project 4b2928af5e6d47cb8c7808250e57de6c. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:58.635092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-002ed5dc-32eb-42e0-9596-1da37e7084c6 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Getting quotas for user 9070922da9654a8899685d1df6e7cfdc and project 4b2928af5e6d47cb8c7808250e57de6c. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:58.650582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-73570581-606b-4397-8434-03416b831b90 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:58.663111 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-002ed5dc-32eb-42e0-9596-1da37e7084c6 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.053113 May 27 15:18:58.663326 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-73570581-606b-4397-8434-03416b831b90 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 200 len: 1366 microversion: 2.1 time: 0.196588 May 27 15:18:58.663973 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2376/4762] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:58 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:58.664950 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2387/4763] 10.222.0.13 () {62 vars in 1198 bytes} [Fri May 27 15:18:58 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 27 15:18:58.670188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d030ad22-f2b2-43c0-8006-cc0535188977 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:58.670877 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d030ad22-f2b2-43c0-8006-cc0535188977 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:58.683445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d030ad22-f2b2-43c0-8006-cc0535188977 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:58.684451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d030ad22-f2b2-43c0-8006-cc0535188977 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:58.686216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d030ad22-f2b2-43c0-8006-cc0535188977 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:58.687454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d030ad22-f2b2-43c0-8006-cc0535188977 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:58.754142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6dc91388-85f5-4307-b700-7d5d9ba37401 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-51118192", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "056ed003-e36a-4d3a-bb46-a376f404d89a"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:58.834432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-6dc91388-85f5-4307-b700-7d5d9ba37401 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] validate_networks() for [('056ed003-e36a-4d3a-bb46-a376f404d89a', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:18:58.864834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d030ad22-f2b2-43c0-8006-cc0535188977 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:58.875549 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d030ad22-f2b2-43c0-8006-cc0535188977 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 200 len: 1507 microversion: 2.1 time: 0.210710 May 27 15:18:58.876524 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2377/4764] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:58 2022] GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 1507 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:58.890813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1dcdb4e0-9178-4e54-8d5f-943d2e206c4d tempest-ServerGroup264TestJSON-1904828806 tempest-ServerGroup264TestJSON-1904828806-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:58.897669 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-1dcdb4e0-9178-4e54-8d5f-943d2e206c4d tempest-ServerGroup264TestJSON-1904828806 tempest-ServerGroup264TestJSON-1904828806-project] HTTP exception thrown: Instance group c369ce8e-19ad-4e35-8864-81cfc6e6e9cd could not be found. May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1dcdb4e0-9178-4e54-8d5f-943d2e206c4d tempest-ServerGroup264TestJSON-1904828806 tempest-ServerGroup264TestJSON-1904828806-project] Request method failure captured: May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/os-server-groups/c369ce8e-19ad-4e35-8864-81cfc6e6e9cd HTTP/1.1 May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOvh7vknoz_CLnEWU5M_JvQr7eHw7sNfHd6fD4-YSlcs-vC1wj4OpPxnYd-DWJEu1A5tB4JQkzRaXIH8RO-GepJkew7vTAp_X1f24qYLB1zj1rqtpWdYUUbJhMLvzmjiFaQ4K0WAdvSuncRfqNJy8Ny2ERKqAWFnggSv221d0R5yO5s May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-Openstack-Nova-Api-Version: 2.64 May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 92341db4472b40329798e870afbb87dc May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerGroup264TestJSON-1904828806 May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/92341db4472b40329798e870afbb87dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/92341db4472b40329798e870afbb87dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/92341db4472b40329798e870afbb87dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_92341db4472b40329798e870afbb87dc", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerGroup264TestJSON-1904828806 May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 92341db4472b40329798e870afbb87dc May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1904828806 May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerGroup264TestJSON-1904828806-project May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: fea201ecf49b485a8e27d8093a100380 May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerGroup264TestJSON-1904828806-project May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance group c369ce8e-19ad-4e35-8864-81cfc6e6e9cd could not be found. May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'c369ce8e-19ad-4e35-8864-81cfc6e6e9cd'} May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c369ce8e-19ad-4e35-8864-81cfc6e6e9cd could not be found. May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c369ce8e-19ad-4e35-8864-81cfc6e6e9cd could not be found. May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:58.899461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:18:58.903011 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:18:58.903011 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:18:58.903011 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:18:58.903011 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:18:58.903011 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c369ce8e-19ad-4e35-8864-81cfc6e6e9cd could not be found. May 27 15:18:58.903011 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:18:58.903011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1dcdb4e0-9178-4e54-8d5f-943d2e206c4d tempest-ServerGroup264TestJSON-1904828806 tempest-ServerGroup264TestJSON-1904828806-project] Returning 404 to user: Instance group c369ce8e-19ad-4e35-8864-81cfc6e6e9cd could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:18:58.903011 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1dcdb4e0-9178-4e54-8d5f-943d2e206c4d tempest-ServerGroup264TestJSON-1904828806 tempest-ServerGroup264TestJSON-1904828806-project] 10.222.0.13 "DELETE /compute/v2.1/os-server-groups/c369ce8e-19ad-4e35-8864-81cfc6e6e9cd" status: 404 len: 117 microversion: 2.64 time: 0.015662 May 27 15:18:58.903011 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2378/4765] 10.222.0.13 () {60 vars in 1306 bytes} [Fri May 27 15:18:58 2022] DELETE /compute/v2.1/os-server-groups/c369ce8e-19ad-4e35-8864-81cfc6e6e9cd => generated 117 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:18:58.907022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ba683334-456e-406b-bca5-3f26881a656d tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Action: 'create', calling method: .version_select at 0x7fc7755d7700>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1154517858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKseRA9fbYIfyD5cM5nIQt6rHZYI+wDyJx+K845/QimszhUiEw2/fQdNM3JCj4NACT0GUsUxoZKgKlDT+JtnQVkA1z/Vi7bsrd/VmvtTgi5cHJGqynP89GyjLFLJgLZtvw=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:58.924997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-ba683334-456e-406b-bca5-3f26881a656d tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Getting quotas for project 4b2928af5e6d47cb8c7808250e57de6c. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:58.930607 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-ba683334-456e-406b-bca5-3f26881a656d tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Getting quotas for user 9070922da9654a8899685d1df6e7cfdc and project 4b2928af5e6d47cb8c7808250e57de6c. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:58.967158 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ba683334-456e-406b-bca5-3f26881a656d tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.062903 May 27 15:18:58.968485 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2379/4766] 10.222.0.13 () {62 vars in 1198 bytes} [Fri May 27 15:18:58 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 27 15:18:58.980003 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1af1beae-11a6-4610-9ab6-c0f899ead87b tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Calling method '.version_select at 0x7fc776e8c1f0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:58.983021 n-d-843621-1 devstack@n-api.service[119248]: WARNING oslo_db.sqlalchemy.utils [None req-1af1beae-11a6-4610-9ab6-c0f899ead87b tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Unique keys not in sort_keys. The sorting order may be unstable. May 27 15:18:58.993780 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1af1beae-11a6-4610-9ab6-c0f899ead87b tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.019952 May 27 15:18:58.994375 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2380/4767] 10.222.0.13 () {60 vars in 1176 bytes} [Fri May 27 15:18:58 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:59.006205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-81c1922a-3a55-4c5a-bcc1-3bc9ef76f32b tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Calling method '.version_select at 0x7fc7756975e0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:59.031045 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-81c1922a-3a55-4c5a-bcc1-3bc9ef76f32b tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1154517858" status: 204 len: 0 microversion: 2.2 time: 0.028523 May 27 15:18:59.031045 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2381/4768] 10.222.0.13 () {60 vars in 1320 bytes} [Fri May 27 15:18:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1154517858 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:18:59.039161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-abe0198d-5a0c-41f5-a092-9030fe13677f tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Calling method '.version_select at 0x7fc7756f7670>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:59.065365 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-abe0198d-5a0c-41f5-a092-9030fe13677f tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1957897784" status: 204 len: 0 microversion: 2.2 time: 0.030267 May 27 15:18:59.065969 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2382/4769] 10.222.0.13 () {60 vars in 1320 bytes} [Fri May 27 15:18:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1957897784 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:18:59.080440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ddd17974-f77f-4348-a50c-b48c9f443a25 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Calling method '.version_select at 0x7fc775744a60>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:59.105924 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ddd17974-f77f-4348-a50c-b48c9f443a25 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-908901165" status: 204 len: 0 microversion: 2.2 time: 0.032436 May 27 15:18:59.106722 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2383/4770] 10.222.0.13 () {60 vars in 1317 bytes} [Fri May 27 15:18:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-908901165 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:18:59.126071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-72718519-af47-4102-9be9-d9c9a0a649ed tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Action: 'create', calling method: .version_select at 0x7fc775697160>, body: {"keypair": {"name": "tempest-keypair-60993349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXfpLF8Ihd/fI2QSFwFxJU2sqgS1raNakEmyOgAt+KQ70KWkBw8YxpaXuFVsLQvz1dgdQg1yw4EmIe2hiXwIB6ysXfxDbDmicw7TSc/+6dFqXyAxGLdfFd/QRW3SHi4fA=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:59.146185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-72718519-af47-4102-9be9-d9c9a0a649ed tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Getting quotas for project 4b2928af5e6d47cb8c7808250e57de6c. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:59.156371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-72718519-af47-4102-9be9-d9c9a0a649ed tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Getting quotas for user 9070922da9654a8899685d1df6e7cfdc and project 4b2928af5e6d47cb8c7808250e57de6c. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:59.198862 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-72718519-af47-4102-9be9-d9c9a0a649ed tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.081372 May 27 15:18:59.199652 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2384/4771] 10.222.0.13 () {62 vars in 1198 bytes} [Fri May 27 15:18:59 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 27 15:18:59.209555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9402e90a-ddab-414e-ac0a-2d97ad3e65b7 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Calling method '.version_select at 0x7fc7755d7dc0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:59.218382 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9402e90a-ddab-414e-ac0a-2d97ad3e65b7 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-60993349" status: 200 len: 511 microversion: 2.2 time: 0.012671 May 27 15:18:59.224288 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2385/4772] 10.222.0.13 () {60 vars in 1251 bytes} [Fri May 27 15:18:59 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-60993349 => generated 511 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:18:59.242007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f30119a0-1689-42e1-b07f-3d1487594d21 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Calling method '.version_select at 0x7fc7755ed790>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:59.253946 n-d-843621-1 devstack@n-api.service[119248]: WARNING oslo_db.sqlalchemy.utils [None req-f30119a0-1689-42e1-b07f-3d1487594d21 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Unique keys not in sort_keys. The sorting order may be unstable. May 27 15:18:59.268805 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f30119a0-1689-42e1-b07f-3d1487594d21 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 368 microversion: 2.2 time: 0.038821 May 27 15:18:59.274153 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2386/4773] 10.222.0.13 () {60 vars in 1176 bytes} [Fri May 27 15:18:59 2022] GET /compute/v2.1/os-keypairs => generated 368 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:59.283756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1006a484-1ffc-4bac-ac32-b0b3a7bd2b3e tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Calling method '.version_select at 0x7fc7755edb80>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:59.308546 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:59.326533 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1006a484-1ffc-4bac-ac32-b0b3a7bd2b3e tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-60993349" status: 204 len: 0 microversion: 2.2 time: 0.048405 May 27 15:18:59.331480 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2387/4774] 10.222.0.13 () {60 vars in 1254 bytes} [Fri May 27 15:18:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-60993349 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:18:59.354175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-095a5dcf-33dc-426d-b447-9029e9453cf3 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Action: 'create', calling method: .version_select at 0x7fc7755d7dc0>, body: {"keypair": {"name": "tempest-keypair-971790504", "type": "x509"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:59.401056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-095a5dcf-33dc-426d-b447-9029e9453cf3 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Getting quotas for project 4b2928af5e6d47cb8c7808250e57de6c. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:59.410800 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-095a5dcf-33dc-426d-b447-9029e9453cf3 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Getting quotas for user 9070922da9654a8899685d1df6e7cfdc and project 4b2928af5e6d47cb8c7808250e57de6c. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:59.456332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.processutils [None req-095a5dcf-33dc-426d-b447-9029e9453cf3 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp58om90ng/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp58om90ng/temp.key -subj /CN=9070922da9654a8899685d1df6e7cfdc -extensions v3_req_client {{(pid=119248) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 27 15:18:59.659930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.processutils [None req-095a5dcf-33dc-426d-b447-9029e9453cf3 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp58om90ng/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp58om90ng/temp.key -subj /CN=9070922da9654a8899685d1df6e7cfdc -extensions v3_req_client" returned: 0 in 0.203s {{(pid=119248) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 27 15:18:59.662650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.processutils [None req-095a5dcf-33dc-426d-b447-9029e9453cf3 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp58om90ng/temp.key -password pass: {{(pid=119248) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 27 15:18:59.710430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.processutils [None req-095a5dcf-33dc-426d-b447-9029e9453cf3 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp58om90ng/temp.key -password pass:" returned: 0 in 0.046s {{(pid=119248) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 27 15:18:59.796743 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-6dc91388-85f5-4307-b700-7d5d9ba37401 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:18:59.798198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-6dc91388-85f5-4307-b700-7d5d9ba37401 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:18:59.798882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-6dc91388-85f5-4307-b700-7d5d9ba37401 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:18:59.799506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-6dc91388-85f5-4307-b700-7d5d9ba37401 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:18:59.800268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-6dc91388-85f5-4307-b700-7d5d9ba37401 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:18:59.803798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=5,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:59.809972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-095a5dcf-33dc-426d-b447-9029e9453cf3 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Getting quotas for project 4b2928af5e6d47cb8c7808250e57de6c. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:59.812247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6dc91388-85f5-4307-b700-7d5d9ba37401 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:59.812984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6dc91388-85f5-4307-b700-7d5d9ba37401 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:59.814580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6dc91388-85f5-4307-b700-7d5d9ba37401 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:59.815282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6dc91388-85f5-4307-b700-7d5d9ba37401 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:59.818853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-095a5dcf-33dc-426d-b447-9029e9453cf3 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Getting quotas for user 9070922da9654a8899685d1df6e7cfdc and project 4b2928af5e6d47cb8c7808250e57de6c. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:59.852943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-6dc91388-85f5-4307-b700-7d5d9ba37401 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Getting quotas for project 02c7dc0c99734781b18bf56d952bc9ad. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:59.858123 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-095a5dcf-33dc-426d-b447-9029e9453cf3 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.518107 May 27 15:18:59.859382 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2388/4775] 10.222.0.13 () {62 vars in 1197 bytes} [Fri May 27 15:18:59 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 521 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) May 27 15:18:59.874027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-6dc91388-85f5-4307-b700-7d5d9ba37401 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Getting quotas for user 44380d176a0d451d8b19e4dd90cc9478 and project 02c7dc0c99734781b18bf56d952bc9ad. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:59.876027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-62a906e3-80ab-404a-a735-d533f48ea12d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:59.876781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-62a906e3-80ab-404a-a735-d533f48ea12d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:59.885159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62a906e3-80ab-404a-a735-d533f48ea12d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:59.885630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62a906e3-80ab-404a-a735-d533f48ea12d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:59.887989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62a906e3-80ab-404a-a735-d533f48ea12d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:59.887989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62a906e3-80ab-404a-a735-d533f48ea12d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:59.909081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6dc91388-85f5-4307-b700-7d5d9ba37401 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Going to run 3 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:18:59.912071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6dc91388-85f5-4307-b700-7d5d9ba37401 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: d4f95c0e-01e4-40d3-98cb-d61147d8ca03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:18:59.959944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6dc91388-85f5-4307-b700-7d5d9ba37401 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 620dfc02-19dd-4f62-862c-8bee81ad6572] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=d4f95c0e-01e4-40d3-98cb-d61147d8ca03,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:19:00.020343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6dc91388-85f5-4307-b700-7d5d9ba37401 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=620dfc02-19dd-4f62-862c-8bee81ad6572,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:19:00.060847 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-62a906e3-80ab-404a-a735-d533f48ea12d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:00.070891 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-62a906e3-80ab-404a-a735-d533f48ea12d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 200 len: 1556 microversion: 2.1 time: 0.208801 May 27 15:19:00.072047 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2389/4776] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:18:59 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 1556 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:00.078179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d07919de-43db-431d-a28c-bd879e8c2e70 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Calling method '.version_select at 0x7fc776c94820>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:00.087859 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d07919de-43db-431d-a28c-bd879e8c2e70 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs/tempest-keypair-971790504" status: 200 len: 1533 microversion: 2.2 time: 0.014481 May 27 15:19:00.088694 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2390/4777] 10.222.0.13 () {60 vars in 1254 bytes} [Fri May 27 15:19:00 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-971790504 => generated 1533 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:00.094832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5f72584d-76e9-457f-9f00-d57edb5a915e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:00.095782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5f72584d-76e9-457f-9f00-d57edb5a915e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:00.099886 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6dc91388-85f5-4307-b700-7d5d9ba37401 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.433496 May 27 15:19:00.100539 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2388/4778] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:18:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:19:00.104436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f72584d-76e9-457f-9f00-d57edb5a915e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:00.104937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f72584d-76e9-457f-9f00-d57edb5a915e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:00.105890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f72584d-76e9-457f-9f00-d57edb5a915e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:00.106537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f72584d-76e9-457f-9f00-d57edb5a915e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:00.110015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-50f15d12-cb51-49a8-89fe-9323c41d93a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:00.110526 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-50f15d12-cb51-49a8-89fe-9323c41d93a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:00.121463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-50f15d12-cb51-49a8-89fe-9323c41d93a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:00.122163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-50f15d12-cb51-49a8-89fe-9323c41d93a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:00.123536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-50f15d12-cb51-49a8-89fe-9323c41d93a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:00.124202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-50f15d12-cb51-49a8-89fe-9323c41d93a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:00.332181 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-50f15d12-cb51-49a8-89fe-9323c41d93a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.230020 May 27 15:19:00.333234 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2389/4779] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 15:19:00 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-interface => generated 285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:00.341469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-38387dff-1441-4d63-b89a-09725e33eac8 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Calling method '.version_select at 0x7fc78067f670>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:00.379328 n-d-843621-1 devstack@n-api.service[119249]: WARNING oslo_db.sqlalchemy.utils [None req-38387dff-1441-4d63-b89a-09725e33eac8 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Unique keys not in sort_keys. The sorting order may be unstable. May 27 15:19:00.409484 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-38387dff-1441-4d63-b89a-09725e33eac8 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.074903 May 27 15:19:00.411389 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2390/4780] 10.222.0.13 () {60 vars in 1176 bytes} [Fri May 27 15:19:00 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:00.424263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3ef42253-2e64-445a-be65-7c360fb55569 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:00.434101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3ef42253-2e64-445a-be65-7c360fb55569 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:00.439120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3ef42253-2e64-445a-be65-7c360fb55569 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Searching by: {'deleted': False, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad'} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:19:00.524534 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ef42253-2e64-445a-be65-7c360fb55569 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:00.525352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ef42253-2e64-445a-be65-7c360fb55569 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:00.526830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ef42253-2e64-445a-be65-7c360fb55569 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:00.527507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ef42253-2e64-445a-be65-7c360fb55569 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:00.642400 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3ef42253-2e64-445a-be65-7c360fb55569 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.229510 May 27 15:19:00.650213 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5f72584d-76e9-457f-9f00-d57edb5a915e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:00.653233 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2391/4781] 10.222.0.13 () {58 vars in 1124 bytes} [Fri May 27 15:19:00 2022] GET /compute/v2.1/servers => generated 1012 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:00.665332 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5f72584d-76e9-457f-9f00-d57edb5a915e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 200 len: 1507 microversion: 2.1 time: 0.574671 May 27 15:19:00.665807 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2391/4782] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:00 2022] GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 1507 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:00.674245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d957e83c-53d7-4a7a-97cc-15ca43080521 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:00.679833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d957e83c-53d7-4a7a-97cc-15ca43080521 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:00.691554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4f745fae-9f4f-469c-927d-be81b9deaac7 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] Calling method '.version_select at 0x7fc78067fdc0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:00.749844 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4f745fae-9f4f-469c-927d-be81b9deaac7 tempest-KeyPairsV22TestJSON-33791219 tempest-KeyPairsV22TestJSON-33791219-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-971790504" status: 204 len: 0 microversion: 2.2 time: 0.095135 May 27 15:19:00.751361 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2392/4783] 10.222.0.13 () {60 vars in 1257 bytes} [Fri May 27 15:19:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-971790504 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:19:00.915715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d957e83c-53d7-4a7a-97cc-15ca43080521 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:00.927474 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d957e83c-53d7-4a7a-97cc-15ca43080521 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1221 microversion: 2.1 time: 0.258100 May 27 15:19:00.940656 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2392/4784] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:00 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1221 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:01.403590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-db3866db-c9f7-4391-b0bc-9b4785d6ea83 req-e5588089-adfb-4311-ab67-3b2663c282d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6863a0f9-a1ac-4dd5-93f7-1089256bd265", "name": "network-vif-deleted", "tag": "456bdf86-20a6-4d02-bcf3-cb8866dd6114"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:01.445203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-db3866db-c9f7-4391-b0bc-9b4785d6ea83 req-e5588089-adfb-4311-ab67-3b2663c282d6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:01.445669 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-db3866db-c9f7-4391-b0bc-9b4785d6ea83 req-e5588089-adfb-4311-ab67-3b2663c282d6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:01.532212 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-db3866db-c9f7-4391-b0bc-9b4785d6ea83 req-e5588089-adfb-4311-ab67-3b2663c282d6 service nova] Creating event network-vif-deleted:456bdf86-20a6-4d02-bcf3-cb8866dd6114 for instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 on n-h1-843621-1 May 27 15:19:01.549717 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-db3866db-c9f7-4391-b0bc-9b4785d6ea83 req-e5588089-adfb-4311-ab67-3b2663c282d6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152094 May 27 15:19:01.550368 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2393/4785] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:01.684350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a769c86a-6978-4a6c-badd-d41fe9dd4697 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:01.685296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a769c86a-6978-4a6c-badd-d41fe9dd4697 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:01.701720 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a769c86a-6978-4a6c-badd-d41fe9dd4697 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:01.702203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a769c86a-6978-4a6c-badd-d41fe9dd4697 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:01.704872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a769c86a-6978-4a6c-badd-d41fe9dd4697 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:01.705444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a769c86a-6978-4a6c-badd-d41fe9dd4697 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:01.849742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a769c86a-6978-4a6c-badd-d41fe9dd4697 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:01.856341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a769c86a-6978-4a6c-badd-d41fe9dd4697 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:01.857205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-a769c86a-6978-4a6c-badd-d41fe9dd4697 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lazy-loading 'fault' on Instance uuid 6863a0f9-a1ac-4dd5-93f7-1089256bd265 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:19:01.948092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-00bc7020-f991-4f9f-bd8e-59ee76809e0a tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:01.949028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-00bc7020-f991-4f9f-bd8e-59ee76809e0a tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:01.974767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a769c86a-6978-4a6c-badd-d41fe9dd4697 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:01.988334 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a769c86a-6978-4a6c-badd-d41fe9dd4697 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 200 len: 1310 microversion: 2.1 time: 0.304784 May 27 15:19:02.009655 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2393/4786] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:01 2022] GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 1310 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:02.161076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-00bc7020-f991-4f9f-bd8e-59ee76809e0a tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:02.171389 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-00bc7020-f991-4f9f-bd8e-59ee76809e0a tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1221 microversion: 2.1 time: 0.227691 May 27 15:19:02.185888 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2394/4787] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:01 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1221 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:02.800134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-362af6a4-01e6-4ca8-a1aa-93000265f095 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Action: 'create', calling method: .version_select at 0x7fc7755eddc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-480002571"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:03.016297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-867c43b6-355b-450d-ae1d-1a5b3d602596 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:03.017034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-867c43b6-355b-450d-ae1d-1a5b3d602596 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:03.026098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-867c43b6-355b-450d-ae1d-1a5b3d602596 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:03.026541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-867c43b6-355b-450d-ae1d-1a5b3d602596 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:03.041152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-867c43b6-355b-450d-ae1d-1a5b3d602596 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:03.045590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-867c43b6-355b-450d-ae1d-1a5b3d602596 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:03.098998 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-867c43b6-355b-450d-ae1d-1a5b3d602596 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 could not be found. May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-867c43b6-355b-450d-ae1d-1a5b3d602596 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 HTTP/1.1 May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 could not be found. May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '6863a0f9-a1ac-4dd5-93f7-1089256bd265'} May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 could not be found. May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 could not be found. May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:03.101044 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:03.110258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:03.110258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:03.110258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:19:03.110258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:19:03.110258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 could not be found. May 27 15:19:03.110258 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:03.110258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-867c43b6-355b-450d-ae1d-1a5b3d602596 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:03.110258 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-867c43b6-355b-450d-ae1d-1a5b3d602596 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 404 len: 111 microversion: 2.1 time: 0.090384 May 27 15:19:03.114457 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2395/4788] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:03 2022] GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:19:03.126569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-916d0440-02cb-4d54-a538-f3cc28f06a88 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Action: 'create', calling method: .version_select at 0x7fc77634e310>, body: {"keypair": {"name": "tempest-key-1944763729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJScweAaRuz/umWRVv/rEdWopxkQmuc0M42UjvBSEKmJm9BLu+lvhNa5P7JSRxAd0qOosRJmuiSZ4teT1OiWSsd1NscfCVa4vWIx+FHbCKmfbsGVDrGVpdPMRsK6RIeHkQ=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:03.168517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-916d0440-02cb-4d54-a538-f3cc28f06a88 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Getting quotas for project db397cde9e67464182a7ba045f1779be. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:19:03.180121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-916d0440-02cb-4d54-a538-f3cc28f06a88 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Getting quotas for user 2f0525081cf441998d2c320fa0087cff and project db397cde9e67464182a7ba045f1779be. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:19:03.238272 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-916d0440-02cb-4d54-a538-f3cc28f06a88 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.122583 May 27 15:19:03.243611 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2396/4789] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:19:03 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:03.256930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-89d9b88c-8b82-4bd7-ab32-b6fe3d6efc93 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:03.257811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-89d9b88c-8b82-4bd7-ab32-b6fe3d6efc93 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:03.284783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89d9b88c-8b82-4bd7-ab32-b6fe3d6efc93 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:03.285486 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89d9b88c-8b82-4bd7-ab32-b6fe3d6efc93 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:03.289120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89d9b88c-8b82-4bd7-ab32-b6fe3d6efc93 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:03.289757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89d9b88c-8b82-4bd7-ab32-b6fe3d6efc93 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:03.478845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-89d9b88c-8b82-4bd7-ab32-b6fe3d6efc93 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:03.503827 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-89d9b88c-8b82-4bd7-ab32-b6fe3d6efc93 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1273 microversion: 2.1 time: 0.257803 May 27 15:19:03.524842 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2397/4790] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:03 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1273 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:03.542913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-eeedb30a-328a-43f5-9eea-4ee406354d24 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '.version_select at 0x7fc775b4fa60>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:03.552283 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-362af6a4-01e6-4ca8-a1aa-93000265f095 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.120465 May 27 15:19:03.553412 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2394/4791] 10.222.0.13 () {60 vars in 1154 bytes} [Fri May 27 15:19:02 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1122 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 27 15:19:03.562734 n-d-843621-1 devstack@n-api.service[119249]: WARNING oslo_db.sqlalchemy.utils [None req-eeedb30a-328a-43f5-9eea-4ee406354d24 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Unique keys not in sort_keys. The sorting order may be unstable. May 27 15:19:03.581954 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-eeedb30a-328a-43f5-9eea-4ee406354d24 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.062188 May 27 15:19:03.588869 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2398/4792] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 15:19:03 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:03.618037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3f9d3136-91df-4df9-ab5f-39b159ac974c tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc7771c9310>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:03.775681 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3f9d3136-91df-4df9-ab5f-39b159ac974c tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d" status: 200 len: 344 microversion: 2.1 time: 0.184205 May 27 15:19:03.782207 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2399/4793] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:19:03 2022] GET /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d => generated 344 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:03.893320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-c94d25c7-5025-4fe8-ac15-3584b4501bc9 req-3afdb9da-ae74-44bb-91ca-b81321b019d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b014831-b34a-4451-9bf7-f9a5d3dbb17f", "tag": "41df9384-4288-4063-947f-534a792f3faa"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:03.917744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c94d25c7-5025-4fe8-ac15-3584b4501bc9 req-3afdb9da-ae74-44bb-91ca-b81321b019d2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:03.918209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c94d25c7-5025-4fe8-ac15-3584b4501bc9 req-3afdb9da-ae74-44bb-91ca-b81321b019d2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:03.974723 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-c94d25c7-5025-4fe8-ac15-3584b4501bc9 req-3afdb9da-ae74-44bb-91ca-b81321b019d2 service nova] Creating event network-changed:41df9384-4288-4063-947f-534a792f3faa for instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f on n-h2-843621-1 May 27 15:19:03.995965 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-c94d25c7-5025-4fe8-ac15-3584b4501bc9 req-3afdb9da-ae74-44bb-91ca-b81321b019d2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.441065 May 27 15:19:04.006689 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2395/4794] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:04.159745 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2830baef-ebf5-407c-9c9d-5299383bfee8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1993631115", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "key_name": "tempest-key-1944763729", "networks": [{"uuid": "679b759f-4940-4405-a687-165c11fb616b"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:04.285689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-2830baef-ebf5-407c-9c9d-5299383bfee8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] validate_networks() for [('679b759f-4940-4405-a687-165c11fb616b', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:19:04.588491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-211f7ebe-4c33-484d-80ed-452a03d47968 tempest-AbsoluteLimitsTestJSON-564142871 tempest-AbsoluteLimitsTestJSON-564142871-project] Calling method '.version_select at 0x7fc776c94af0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:04.615813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-211f7ebe-4c33-484d-80ed-452a03d47968 tempest-AbsoluteLimitsTestJSON-564142871 tempest-AbsoluteLimitsTestJSON-564142871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:04.616281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-211f7ebe-4c33-484d-80ed-452a03d47968 tempest-AbsoluteLimitsTestJSON-564142871 tempest-AbsoluteLimitsTestJSON-564142871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:04.621917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-211f7ebe-4c33-484d-80ed-452a03d47968 tempest-AbsoluteLimitsTestJSON-564142871 tempest-AbsoluteLimitsTestJSON-564142871-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:04.622374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-211f7ebe-4c33-484d-80ed-452a03d47968 tempest-AbsoluteLimitsTestJSON-564142871 tempest-AbsoluteLimitsTestJSON-564142871-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:04.673275 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-211f7ebe-4c33-484d-80ed-452a03d47968 tempest-AbsoluteLimitsTestJSON-564142871 tempest-AbsoluteLimitsTestJSON-564142871-project] 10.222.0.13 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.359643 May 27 15:19:04.678221 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2396/4795] 10.222.0.13 () {58 vars in 1121 bytes} [Fri May 27 15:19:04 2022] GET /compute/v2.1/limits => generated 511 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:04.693336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9b75eebd-1c54-40db-b8d7-de5e09bbbefc tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:04.694297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9b75eebd-1c54-40db-b8d7-de5e09bbbefc tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:04.712064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b75eebd-1c54-40db-b8d7-de5e09bbbefc tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:04.712785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b75eebd-1c54-40db-b8d7-de5e09bbbefc tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:04.714385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b75eebd-1c54-40db-b8d7-de5e09bbbefc tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:04.717478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b75eebd-1c54-40db-b8d7-de5e09bbbefc tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:05.032377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9b75eebd-1c54-40db-b8d7-de5e09bbbefc tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:05.044327 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9b75eebd-1c54-40db-b8d7-de5e09bbbefc tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1279 microversion: 2.1 time: 0.363869 May 27 15:19:05.045541 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2397/4796] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:04 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1279 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:05.058627 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e91aa484-846a-4bbc-ac32-7d0b5d29bc10 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc7756f8310>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:05.229807 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e91aa484-846a-4bbc-ac32-7d0b5d29bc10 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d" status: 200 len: 344 microversion: 2.1 time: 0.180947 May 27 15:19:05.231756 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2398/4797] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:19:05 2022] GET /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d => generated 344 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:05.516649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-2830baef-ebf5-407c-9c9d-5299383bfee8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:19:05.518026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-2830baef-ebf5-407c-9c9d-5299383bfee8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:19:05.518670 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-2830baef-ebf5-407c-9c9d-5299383bfee8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:19:05.519242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-2830baef-ebf5-407c-9c9d-5299383bfee8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:19:05.519817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-2830baef-ebf5-407c-9c9d-5299383bfee8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:19:05.548786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2830baef-ebf5-407c-9c9d-5299383bfee8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:05.549503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2830baef-ebf5-407c-9c9d-5299383bfee8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:05.553429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2830baef-ebf5-407c-9c9d-5299383bfee8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:05.556573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2830baef-ebf5-407c-9c9d-5299383bfee8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:05.643609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-2830baef-ebf5-407c-9c9d-5299383bfee8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Getting quotas for project db397cde9e67464182a7ba045f1779be. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:19:05.664256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-2830baef-ebf5-407c-9c9d-5299383bfee8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Getting quotas for user 2f0525081cf441998d2c320fa0087cff and project db397cde9e67464182a7ba045f1779be. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:19:05.745542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2830baef-ebf5-407c-9c9d-5299383bfee8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:19:05.749164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2830baef-ebf5-407c-9c9d-5299383bfee8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:19:05.866872 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2830baef-ebf5-407c-9c9d-5299383bfee8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.712632 May 27 15:19:05.879689 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6c84ac9c-d550-44a7-a00f-f657bf3fa772 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:05.880799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6c84ac9c-d550-44a7-a00f-f657bf3fa772 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:05.881671 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2400/4798] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:19:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:19:06.065586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-103f7a34-98bf-43d8-abc6-b069cfc53018 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:06.065905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-103f7a34-98bf-43d8-abc6-b069cfc53018 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:06.087073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-103f7a34-98bf-43d8-abc6-b069cfc53018 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:06.091874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-103f7a34-98bf-43d8-abc6-b069cfc53018 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:06.094781 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-103f7a34-98bf-43d8-abc6-b069cfc53018 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:06.098594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-103f7a34-98bf-43d8-abc6-b069cfc53018 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:06.778601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6c84ac9c-d550-44a7-a00f-f657bf3fa772 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:06.783541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-103f7a34-98bf-43d8-abc6-b069cfc53018 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:06.787714 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6c84ac9c-d550-44a7-a00f-f657bf3fa772 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1229 microversion: 2.1 time: 0.913493 May 27 15:19:06.792572 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2399/4799] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:05 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1229 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:06.803913 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-103f7a34-98bf-43d8-abc6-b069cfc53018 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1279 microversion: 2.1 time: 0.744231 May 27 15:19:06.804544 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2401/4800] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:06 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1279 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:06.806783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d2f42241-0a82-4976-81c4-a06c2a32d9d8 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc7756f8c10>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:06.927596 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d2f42241-0a82-4976-81c4-a06c2a32d9d8 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d" status: 200 len: 345 microversion: 2.1 time: 0.133648 May 27 15:19:06.928300 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2400/4801] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:19:06 2022] GET /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d => generated 345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:06.940990 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-baa5e72e-142e-488e-b402-dede08a70b9f tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Action: 'create', calling method: .version_select at 0x7fc77634eb80>, body: {"snapshot": {"volume_id": "86ff023a-c75f-46dc-afa1-79b45c5ade4d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1812148416"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:07.214223 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-baa5e72e-142e-488e-b402-dede08a70b9f tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.278457 May 27 15:19:07.224979 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2402/4802] 10.222.0.13 () {60 vars in 1161 bytes} [Fri May 27 15:19:06 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:07.226146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fc7174a5-51a4-4194-ab55-58ab604f6bab tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc775744a60>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:07.284715 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fc7174a5-51a4-4194-ab55-58ab604f6bab tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561" status: 200 len: 287 microversion: 2.1 time: 0.062874 May 27 15:19:07.295685 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2401/4803] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 15:19:07 2022] GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:07.296336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-12574b18-4686-4125-851a-85c3eea5b60c tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc7763bd040>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:07.346954 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-12574b18-4686-4125-851a-85c3eea5b60c tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.055202 May 27 15:19:07.347773 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2403/4804] 10.222.0.13 () {58 vars in 1139 bytes} [Fri May 27 15:19:07 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:07.363000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bda9f36d-e807-4e9f-a1cf-1ecf1d4d2597 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc775585310>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:07.410407 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bda9f36d-e807-4e9f-a1cf-1ecf1d4d2597 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561" status: 200 len: 287 microversion: 2.1 time: 0.051358 May 27 15:19:07.411290 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2402/4805] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 15:19:07 2022] GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:07.811715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bb56d590-5d49-4608-bc2d-5348337ae687 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:07.812405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bb56d590-5d49-4608-bc2d-5348337ae687 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:07.823751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-547dcbfd-f6a9-4bbf-b263-3cab6eec7a2b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:07.824909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-547dcbfd-f6a9-4bbf-b263-3cab6eec7a2b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:07.836376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb56d590-5d49-4608-bc2d-5348337ae687 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:07.839177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-547dcbfd-f6a9-4bbf-b263-3cab6eec7a2b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:07.839657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-547dcbfd-f6a9-4bbf-b263-3cab6eec7a2b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:07.840462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-547dcbfd-f6a9-4bbf-b263-3cab6eec7a2b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:07.840936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-547dcbfd-f6a9-4bbf-b263-3cab6eec7a2b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:07.847446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb56d590-5d49-4608-bc2d-5348337ae687 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:07.848353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb56d590-5d49-4608-bc2d-5348337ae687 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:07.853013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb56d590-5d49-4608-bc2d-5348337ae687 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:08.016029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-547dcbfd-f6a9-4bbf-b263-3cab6eec7a2b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:08.028076 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-547dcbfd-f6a9-4bbf-b263-3cab6eec7a2b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1279 microversion: 2.1 time: 0.208605 May 27 15:19:08.028712 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2403/4806] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:07 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1279 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:08.060953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bb56d590-5d49-4608-bc2d-5348337ae687 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:08.077064 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bb56d590-5d49-4608-bc2d-5348337ae687 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1281 microversion: 2.1 time: 0.271930 May 27 15:19:08.083258 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2404/4807] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:07 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1281 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:08.423514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-30de4a33-098d-44ed-946e-bca2ce510723 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc7755edca0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:08.495717 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-30de4a33-098d-44ed-946e-bca2ce510723 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561" status: 200 len: 287 microversion: 2.1 time: 0.077132 May 27 15:19:08.497620 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2404/4808] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 15:19:08 2022] GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:09.055920 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-12c556ba-bdbb-4643-8eb9-abf9e5498c19 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:09.056702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-12c556ba-bdbb-4643-8eb9-abf9e5498c19 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:09.068249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12c556ba-bdbb-4643-8eb9-abf9e5498c19 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:09.068737 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12c556ba-bdbb-4643-8eb9-abf9e5498c19 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:09.069538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12c556ba-bdbb-4643-8eb9-abf9e5498c19 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:09.100765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-53e2b5fb-a8b8-40b3-b1e6-e9ef536295bb tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:09.102450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-53e2b5fb-a8b8-40b3-b1e6-e9ef536295bb tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:09.107668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12c556ba-bdbb-4643-8eb9-abf9e5498c19 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:09.118155 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53e2b5fb-a8b8-40b3-b1e6-e9ef536295bb tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:09.118752 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53e2b5fb-a8b8-40b3-b1e6-e9ef536295bb tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:09.122086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53e2b5fb-a8b8-40b3-b1e6-e9ef536295bb tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:09.122706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53e2b5fb-a8b8-40b3-b1e6-e9ef536295bb tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:09.520145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-53e2b5fb-a8b8-40b3-b1e6-e9ef536295bb tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:09.528404 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-53e2b5fb-a8b8-40b3-b1e6-e9ef536295bb tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1287 microversion: 2.1 time: 0.432426 May 27 15:19:09.541163 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2405/4809] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:09 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1287 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:09.671106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-12c556ba-bdbb-4643-8eb9-abf9e5498c19 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:09.687055 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-12c556ba-bdbb-4643-8eb9-abf9e5498c19 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1321 microversion: 2.1 time: 0.642056 May 27 15:19:09.688068 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2405/4810] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:09 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1321 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:09.696401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0060230e-1a34-4623-b4a8-e3867fdbe9b5 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc780723f70>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:09.793659 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0060230e-1a34-4623-b4a8-e3867fdbe9b5 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561" status: 200 len: 287 microversion: 2.1 time: 0.103735 May 27 15:19:09.793924 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2406/4811] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 15:19:09 2022] GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561 => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:09.855003 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e2761b39-5d0f-4461-8b57-17c7d8c512ca tempest-AbsoluteLimitsNegativeTestJSON-837779865 tempest-AbsoluteLimitsNegativeTestJSON-837779865-project] Calling method '.version_select at 0x7fc775596ee0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:09.882273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2761b39-5d0f-4461-8b57-17c7d8c512ca tempest-AbsoluteLimitsNegativeTestJSON-837779865 tempest-AbsoluteLimitsNegativeTestJSON-837779865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:09.883295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2761b39-5d0f-4461-8b57-17c7d8c512ca tempest-AbsoluteLimitsNegativeTestJSON-837779865 tempest-AbsoluteLimitsNegativeTestJSON-837779865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:09.886683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2761b39-5d0f-4461-8b57-17c7d8c512ca tempest-AbsoluteLimitsNegativeTestJSON-837779865 tempest-AbsoluteLimitsNegativeTestJSON-837779865-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:09.887144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2761b39-5d0f-4461-8b57-17c7d8c512ca tempest-AbsoluteLimitsNegativeTestJSON-837779865 tempest-AbsoluteLimitsNegativeTestJSON-837779865-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:09.942381 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e2761b39-5d0f-4461-8b57-17c7d8c512ca tempest-AbsoluteLimitsNegativeTestJSON-837779865 tempest-AbsoluteLimitsNegativeTestJSON-837779865-project] 10.222.0.13 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.398455 May 27 15:19:09.942998 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2406/4812] 10.222.0.13 () {58 vars in 1121 bytes} [Fri May 27 15:19:09 2022] GET /compute/v2.1/limits => generated 511 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:10.033032 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6d3b9a6b-40fe-4ca7-bf0b-e5b7a6ac186e tempest-AbsoluteLimitsNegativeTestJSON-837779865 tempest-AbsoluteLimitsNegativeTestJSON-837779865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1009581791", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:10.135322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-6d3b9a6b-40fe-4ca7-bf0b-e5b7a6ac186e tempest-AbsoluteLimitsNegativeTestJSON-837779865 tempest-AbsoluteLimitsNegativeTestJSON-837779865-project] validate_networks() for None {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:19:10.425804 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-6d3b9a6b-40fe-4ca7-bf0b-e5b7a6ac186e tempest-AbsoluteLimitsNegativeTestJSON-837779865 tempest-AbsoluteLimitsNegativeTestJSON-837779865-project] Getting quotas for project 6e73f64bda6c45e1adaca0d93b19f3bf. Resources: dict_keys(['metadata_items']) {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:19:10.452399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-6d3b9a6b-40fe-4ca7-bf0b-e5b7a6ac186e tempest-AbsoluteLimitsNegativeTestJSON-837779865 tempest-AbsoluteLimitsNegativeTestJSON-837779865-project] Getting quotas for user d43e3e55c1814dc9adaf16b31c6d458f and project 6e73f64bda6c45e1adaca0d93b19f3bf. Resources: dict_keys(['metadata_items']) {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:19:10.525237 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-6d3b9a6b-40fe-4ca7-bf0b-e5b7a6ac186e tempest-AbsoluteLimitsNegativeTestJSON-837779865 tempest-AbsoluteLimitsNegativeTestJSON-837779865-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6d3b9a6b-40fe-4ca7-bf0b-e5b7a6ac186e tempest-AbsoluteLimitsNegativeTestJSON-837779865 tempest-AbsoluteLimitsNegativeTestJSON-837779865-project] Request method failure captured: May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 1752 May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOvtGKA3zBBRxAe5MHsp95ty_qvX1CZ7e0YAOVt1RLxSf6SwYKme2Cd7Ttic_yGffzhKv0Gm-CVZHGxpZ5IO3kIdYSRcR__-YfFOoaAIEdGgqztkr0KIQoa-xnsxxohRcRGW-_aJ0Zfj_a9YwoxwlFT4pi3jYitwujuKP94zTvCNeFQ May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 6e73f64bda6c45e1adaca0d93b19f3bf May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-837779865 May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6e73f64bda6c45e1adaca0d93b19f3bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6e73f64bda6c45e1adaca0d93b19f3bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6e73f64bda6c45e1adaca0d93b19f3bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6e73f64bda6c45e1adaca0d93b19f3bf", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-837779865 May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 6e73f64bda6c45e1adaca0d93b19f3bf May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-837779865 May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-837779865-project May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: d43e3e55c1814dc9adaf16b31c6d458f May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-837779865-project May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1009581791", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:19:10.534036 n-d-843621-1 devstack@n-api.service[119249]: exception: Maximum number of metadata items exceeds 128 May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1009581791', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._create_instance( May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:19:10.537089 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:19:10.539382 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:19:10.539382 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 27 15:19:10.539382 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 27 15:19:10.539382 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 27 15:19:10.539382 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 May 27 15:19:10.539382 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:10.539382 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:10.539382 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:10.539382 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:10.539382 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:10.539382 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:10.539382 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:19:10.539382 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:19:10.539382 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 May 27 15:19:10.539382 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:10.539382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6d3b9a6b-40fe-4ca7-bf0b-e5b7a6ac186e tempest-AbsoluteLimitsNegativeTestJSON-837779865 tempest-AbsoluteLimitsNegativeTestJSON-837779865-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:10.540325 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6d3b9a6b-40fe-4ca7-bf0b-e5b7a6ac186e tempest-AbsoluteLimitsNegativeTestJSON-837779865 tempest-AbsoluteLimitsNegativeTestJSON-837779865-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.512857 May 27 15:19:10.543158 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2407/4813] 10.222.0.13 () {60 vars in 1147 bytes} [Fri May 27 15:19:10 2022] POST /compute/v2.1/servers => generated 87 bytes in 516 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) May 27 15:19:10.558823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-aae50c2f-e5ef-411e-a480-c07a970c68b9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:10.562073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-aae50c2f-e5ef-411e-a480-c07a970c68b9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:10.579208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aae50c2f-e5ef-411e-a480-c07a970c68b9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:10.579902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aae50c2f-e5ef-411e-a480-c07a970c68b9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:10.580987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aae50c2f-e5ef-411e-a480-c07a970c68b9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:10.581644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aae50c2f-e5ef-411e-a480-c07a970c68b9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:10.704214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bac09aee-2e1d-40ac-ae65-f5d342ea149e tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:10.704875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bac09aee-2e1d-40ac-ae65-f5d342ea149e tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:10.728026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bac09aee-2e1d-40ac-ae65-f5d342ea149e tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:10.728488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bac09aee-2e1d-40ac-ae65-f5d342ea149e tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:10.738426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bac09aee-2e1d-40ac-ae65-f5d342ea149e tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:10.738892 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bac09aee-2e1d-40ac-ae65-f5d342ea149e tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:11.084307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-aae50c2f-e5ef-411e-a480-c07a970c68b9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:11.098987 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-aae50c2f-e5ef-411e-a480-c07a970c68b9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1287 microversion: 2.1 time: 0.548082 May 27 15:19:11.109933 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2407/4814] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:10 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1287 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:11.117150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0991a56d-d10e-49c1-9a99-2f656c0faf0e tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc776cc5040>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:11.268460 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0991a56d-d10e-49c1-9a99-2f656c0faf0e tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561" status: 200 len: 287 microversion: 2.1 time: 0.157091 May 27 15:19:11.269585 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2408/4815] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 15:19:11 2022] GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561 => generated 287 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:11.274646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-1f3e0c8a-ac1a-4aea-af11-f3f88caf950e req-c3fb1f6b-55d1-4633-8574-648b6aaf0cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "620dfc02-19dd-4f62-862c-8bee81ad6572", "tag": "4e71fbd8-95cd-4758-ba40-75304b82648f"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:11.289126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-1f3e0c8a-ac1a-4aea-af11-f3f88caf950e req-c3fb1f6b-55d1-4633-8574-648b6aaf0cd7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:11.289865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-1f3e0c8a-ac1a-4aea-af11-f3f88caf950e req-c3fb1f6b-55d1-4633-8574-648b6aaf0cd7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:11.317552 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-1f3e0c8a-ac1a-4aea-af11-f3f88caf950e req-c3fb1f6b-55d1-4633-8574-648b6aaf0cd7 service nova] Creating event network-changed:4e71fbd8-95cd-4758-ba40-75304b82648f for instance 620dfc02-19dd-4f62-862c-8bee81ad6572 on n-h2-843621-1 May 27 15:19:11.335323 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-1f3e0c8a-ac1a-4aea-af11-f3f88caf950e req-c3fb1f6b-55d1-4633-8574-648b6aaf0cd7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062799 May 27 15:19:11.340446 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2409/4816] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:11.454271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-d4765f36-f869-4b18-93f5-8de5f28f6873 req-c156664e-3f2b-4198-866f-3b2b6d29b56b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f95c0e-01e4-40d3-98cb-d61147d8ca03", "tag": "2af24b23-ac86-4a9f-a777-f5e4b651b84e"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:11.479007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d4765f36-f869-4b18-93f5-8de5f28f6873 req-c156664e-3f2b-4198-866f-3b2b6d29b56b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:11.484480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d4765f36-f869-4b18-93f5-8de5f28f6873 req-c156664e-3f2b-4198-866f-3b2b6d29b56b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:11.519838 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-d4765f36-f869-4b18-93f5-8de5f28f6873 req-c156664e-3f2b-4198-866f-3b2b6d29b56b service nova] Creating event network-changed:2af24b23-ac86-4a9f-a777-f5e4b651b84e for instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 on n-h2-843621-1 May 27 15:19:11.541242 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-d4765f36-f869-4b18-93f5-8de5f28f6873 req-c156664e-3f2b-4198-866f-3b2b6d29b56b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092948 May 27 15:19:11.547435 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2410/4817] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:19:11.771869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bac09aee-2e1d-40ac-ae65-f5d342ea149e tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:11.780911 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bac09aee-2e1d-40ac-ae65-f5d342ea149e tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1321 microversion: 2.1 time: 1.080895 May 27 15:19:11.785633 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2408/4818] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:10 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1321 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:12.119047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2238d953-0784-49a5-bbc0-bf9bc62d65c1 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:12.120293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2238d953-0784-49a5-bbc0-bf9bc62d65c1 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:12.133404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2238d953-0784-49a5-bbc0-bf9bc62d65c1 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:12.135515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2238d953-0784-49a5-bbc0-bf9bc62d65c1 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:12.137606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2238d953-0784-49a5-bbc0-bf9bc62d65c1 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:12.139947 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2238d953-0784-49a5-bbc0-bf9bc62d65c1 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:12.284088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-61ad73d4-beb7-4233-96d7-f9d71b91abf0 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc775b80670>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:12.428077 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-61ad73d4-beb7-4233-96d7-f9d71b91abf0 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561" status: 200 len: 287 microversion: 2.1 time: 0.148124 May 27 15:19:12.429276 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2409/4819] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 15:19:12 2022] GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561 => generated 287 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:12.802004 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ea21fb7b-4df6-4471-a4e9-c91796584acb tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:12.802620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ea21fb7b-4df6-4471-a4e9-c91796584acb tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:12.814376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea21fb7b-4df6-4471-a4e9-c91796584acb tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:12.814837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea21fb7b-4df6-4471-a4e9-c91796584acb tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:12.819848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea21fb7b-4df6-4471-a4e9-c91796584acb tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:12.820805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea21fb7b-4df6-4471-a4e9-c91796584acb tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:13.507600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2238d953-0784-49a5-bbc0-bf9bc62d65c1 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:13.525366 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2238d953-0784-49a5-bbc0-bf9bc62d65c1 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1329 microversion: 2.1 time: 1.411118 May 27 15:19:13.525979 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2411/4820] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:12 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1329 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:13.541862 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e8b661ed-5dff-4add-9c3b-15bc624486a7 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc775640dc0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:13.601466 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e8b661ed-5dff-4add-9c3b-15bc624486a7 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561" status: 200 len: 288 microversion: 2.1 time: 0.064945 May 27 15:19:13.607663 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2412/4821] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 15:19:13 2022] GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561 => generated 288 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:13.613926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b69d8a65-61e0-45ba-b23b-c23bf3675822 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc7755d7040>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:13.614934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ea21fb7b-4df6-4471-a4e9-c91796584acb tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:13.632203 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ea21fb7b-4df6-4471-a4e9-c91796584acb tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1321 microversion: 2.1 time: 0.834670 May 27 15:19:13.632700 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2410/4822] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:12 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1321 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:13.655243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-2e236657-fd74-4489-8bd2-c8a08cfebafa req-3e070d01-a616-4a55-b33f-b189e40d3dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d7f9467-fde2-48d2-a2e6-26678afb0734", "tag": "c3beae81-08af-4000-9027-6f7f0f270d3d"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:13.671731 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2e236657-fd74-4489-8bd2-c8a08cfebafa req-3e070d01-a616-4a55-b33f-b189e40d3dc1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:13.672233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2e236657-fd74-4489-8bd2-c8a08cfebafa req-3e070d01-a616-4a55-b33f-b189e40d3dc1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:13.744408 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-2e236657-fd74-4489-8bd2-c8a08cfebafa req-3e070d01-a616-4a55-b33f-b189e40d3dc1 service nova] Creating event network-changed:c3beae81-08af-4000-9027-6f7f0f270d3d for instance 8d7f9467-fde2-48d2-a2e6-26678afb0734 on n-h1-843621-1 May 27 15:19:13.744540 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b69d8a65-61e0-45ba-b23b-c23bf3675822 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561" status: 202 len: 0 microversion: 2.1 time: 0.134784 May 27 15:19:13.745344 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2413/4823] 10.222.0.13 () {58 vars in 1253 bytes} [Fri May 27 15:19:13 2022] DELETE /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:19:13.754305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2bb4b675-59a2-46dd-b497-13c8bd341ed1 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc77562e550>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:13.756078 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-2e236657-fd74-4489-8bd2-c8a08cfebafa req-3e070d01-a616-4a55-b33f-b189e40d3dc1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105648 May 27 15:19:13.759720 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2411/4824] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:13.820684 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2bb4b675-59a2-46dd-b497-13c8bd341ed1 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561" status: 200 len: 287 microversion: 2.1 time: 0.070163 May 27 15:19:13.821282 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2414/4825] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 15:19:13 2022] GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:19:14.543122 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b313ec40-981e-4320-825e-456867241913 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:14.544245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b313ec40-981e-4320-825e-456867241913 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:14.556272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b313ec40-981e-4320-825e-456867241913 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:14.556821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b313ec40-981e-4320-825e-456867241913 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:14.557713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b313ec40-981e-4320-825e-456867241913 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:14.558182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b313ec40-981e-4320-825e-456867241913 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:14.657726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b9bbbb91-1e45-410f-b3c2-35076d05cdba tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:14.660322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b9bbbb91-1e45-410f-b3c2-35076d05cdba tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:14.690937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9bbbb91-1e45-410f-b3c2-35076d05cdba tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:14.697401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9bbbb91-1e45-410f-b3c2-35076d05cdba tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:14.703450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9bbbb91-1e45-410f-b3c2-35076d05cdba tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:14.715203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9bbbb91-1e45-410f-b3c2-35076d05cdba tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:14.840534 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b313ec40-981e-4320-825e-456867241913 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:14.855326 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b313ec40-981e-4320-825e-456867241913 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1329 microversion: 2.1 time: 0.315346 May 27 15:19:14.856340 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2412/4826] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:14 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1329 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:14.869945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7fd9f8d9-57d2-467d-8cbf-02edd8b294f0 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc7763bd9d0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:14.947311 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7fd9f8d9-57d2-467d-8cbf-02edd8b294f0 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561" status: 200 len: 287 microversion: 2.1 time: 0.088064 May 27 15:19:14.948541 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2413/4827] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 15:19:14 2022] GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:15.029864 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b9bbbb91-1e45-410f-b3c2-35076d05cdba tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:15.039908 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b9bbbb91-1e45-410f-b3c2-35076d05cdba tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1321 microversion: 2.1 time: 0.392275 May 27 15:19:15.040933 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2415/4828] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:14 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1321 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:15.795709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-f8f24367-430f-43af-8822-74b85c42b1d9 req-56f4b171-6088-4520-a40a-5ecc1044d7ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fc136c6-a73e-495c-b72d-e8f6ecbc26ff", "tag": "203c9d14-ed58-4284-982e-42b85c6016e4"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:15.812034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:15.821309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f8f24367-430f-43af-8822-74b85c42b1d9 req-56f4b171-6088-4520-a40a-5ecc1044d7ab service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:15.823571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f8f24367-430f-43af-8822-74b85c42b1d9 req-56f4b171-6088-4520-a40a-5ecc1044d7ab service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:15.858774 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-f8f24367-430f-43af-8822-74b85c42b1d9 req-56f4b171-6088-4520-a40a-5ecc1044d7ab service nova] Creating event network-changed:203c9d14-ed58-4284-982e-42b85c6016e4 for instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff on n-h1-843621-1 May 27 15:19:15.875354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-67b3570a-8775-40a5-a76c-f14543ac485b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:15.875978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-67b3570a-8775-40a5-a76c-f14543ac485b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:15.884799 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-f8f24367-430f-43af-8822-74b85c42b1d9 req-56f4b171-6088-4520-a40a-5ecc1044d7ab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094485 May 27 15:19:15.889004 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2414/4829] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:15.890752 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67b3570a-8775-40a5-a76c-f14543ac485b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:15.891418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67b3570a-8775-40a5-a76c-f14543ac485b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:15.894773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67b3570a-8775-40a5-a76c-f14543ac485b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:15.895396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67b3570a-8775-40a5-a76c-f14543ac485b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:15.960136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-767856a5-96cb-4e8d-9c5f-4aaa13652333 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc7771c9310>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:16.054713 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-767856a5-96cb-4e8d-9c5f-4aaa13652333 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561" status: 200 len: 287 microversion: 2.1 time: 0.098873 May 27 15:19:16.055314 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2415/4830] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 15:19:15 2022] GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561 => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:19:16.063381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4689ed61-fd8e-4276-ab18-30932cb9f35b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:16.064152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4689ed61-fd8e-4276-ab18-30932cb9f35b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:16.067284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=13,nova_api:DELETE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:16.072512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4689ed61-fd8e-4276-ab18-30932cb9f35b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:16.073049 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4689ed61-fd8e-4276-ab18-30932cb9f35b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:16.074167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4689ed61-fd8e-4276-ab18-30932cb9f35b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:16.074857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4689ed61-fd8e-4276-ab18-30932cb9f35b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:16.721235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-67b3570a-8775-40a5-a76c-f14543ac485b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:16.729855 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-67b3570a-8775-40a5-a76c-f14543ac485b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1329 microversion: 2.1 time: 0.860943 May 27 15:19:16.735254 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2416/4831] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:15 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1329 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:16.797640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4689ed61-fd8e-4276-ab18-30932cb9f35b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:16.811724 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4689ed61-fd8e-4276-ab18-30932cb9f35b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1321 microversion: 2.1 time: 0.755258 May 27 15:19:16.812394 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2416/4832] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:16 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1321 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:17.069136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c24ff49e-3a0e-4c34-aada-725d2d57db8d tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc77560d700>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:17.147800 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c24ff49e-3a0e-4c34-aada-725d2d57db8d tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561" status: 200 len: 287 microversion: 2.1 time: 0.084014 May 27 15:19:17.149435 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2417/4833] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 15:19:17 2022] GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:17.754775 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-baa0d75f-b6c4-4245-a838-d2f0cbcd75c8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:17.755387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-baa0d75f-b6c4-4245-a838-d2f0cbcd75c8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:17.777373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-baa0d75f-b6c4-4245-a838-d2f0cbcd75c8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:17.777879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-baa0d75f-b6c4-4245-a838-d2f0cbcd75c8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:17.778753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-baa0d75f-b6c4-4245-a838-d2f0cbcd75c8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:17.779202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-baa0d75f-b6c4-4245-a838-d2f0cbcd75c8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:17.833173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b98230fd-0c8c-4b23-a764-15b89f3625ea tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:17.833837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b98230fd-0c8c-4b23-a764-15b89f3625ea tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:17.858796 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b98230fd-0c8c-4b23-a764-15b89f3625ea tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:17.859260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b98230fd-0c8c-4b23-a764-15b89f3625ea tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:17.860051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b98230fd-0c8c-4b23-a764-15b89f3625ea tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:17.860498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b98230fd-0c8c-4b23-a764-15b89f3625ea tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:17.882072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:18.291434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b98230fd-0c8c-4b23-a764-15b89f3625ea tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:18.305735 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b98230fd-0c8c-4b23-a764-15b89f3625ea tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1321 microversion: 2.1 time: 0.476625 May 27 15:19:18.306673 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2418/4834] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:17 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1321 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:18.315296 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-baa0d75f-b6c4-4245-a838-d2f0cbcd75c8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:18.327909 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-baa0d75f-b6c4-4245-a838-d2f0cbcd75c8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1329 microversion: 2.1 time: 0.580365 May 27 15:19:18.330816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7f26ddb3-43ef-4189-954e-76d04c7821ee tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc7755851f0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:18.331539 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2417/4835] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:17 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1329 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:18.429498 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-7f26ddb3-43ef-4189-954e-76d04c7821ee tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] HTTP exception thrown: Snapshot d3d50274-7073-47c1-9a45-a8c533014561 could not be found. May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7f26ddb3-43ef-4189-954e-76d04c7821ee tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Request method failure captured: May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561 HTTP/1.1 May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOvmY1ZlBoO4P5sXCBssR3VPrM93JXmjQt85eWaeHUjBFMH1VQ_AMab6VkCXlcvs8seIcecHykBvMPvfVjISGDBMMFWiBRBskgluybydNhyhpemTYRZNzLd9GZE2RH3nhVio8RCHOyPA8gJ89IghN2LH-QHAMme1lImxs9GgOZY1FgI May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 1861673023cf4c8092f631db12fcde7e May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1798389546 May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1861673023cf4c8092f631db12fcde7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1861673023cf4c8092f631db12fcde7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1861673023cf4c8092f631db12fcde7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1861673023cf4c8092f631db12fcde7e", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1798389546 May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 1861673023cf4c8092f631db12fcde7e May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1798389546 May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-VolumesSnapshotsTestJSON-1798389546-project May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 0a541103578b4c0c86feb7239022832d May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1798389546-project May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: exception: Snapshot d3d50274-7073-47c1-9a45-a8c533014561 could not be found. May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'd3d50274-7073-47c1-9a45-a8c533014561'} May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d3d50274-7073-47c1-9a45-a8c533014561 could not be found. (HTTP 404) (Request-ID: req-55e12f40-c239-454e-90f0-7b3bd885b5df) May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:19:18.442820 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d3d50274-7073-47c1-9a45-a8c533014561 could not be found. May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d3d50274-7073-47c1-9a45-a8c533014561 could not be found. May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d3d50274-7073-47c1-9a45-a8c533014561 could not be found. May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:18.447072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7f26ddb3-43ef-4189-954e-76d04c7821ee tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Returning 404 to user: Snapshot d3d50274-7073-47c1-9a45-a8c533014561 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:18.451837 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7f26ddb3-43ef-4189-954e-76d04c7821ee tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561" status: 404 len: 111 microversion: 2.1 time: 0.143390 May 27 15:19:18.462329 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-461e853a-90db-4d04-84f6-74481053e33e tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc78067fa60>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:18.464302 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2419/4836] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 15:19:18 2022] GET /compute/v2.1/os-snapshots/d3d50274-7073-47c1-9a45-a8c533014561 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:19:18.581361 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-461e853a-90db-4d04-84f6-74481053e33e tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d" status: 202 len: 0 microversion: 2.1 time: 0.124311 May 27 15:19:18.591500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-37e9577f-9f3b-405b-ad85-2c7cbda9e5a9 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc77561c5e0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:18.593099 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2418/4837] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 15:19:18 2022] DELETE /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:19:18.695478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c76f3816-7596-48bd-a177-2e2002ca186c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:18.696695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c76f3816-7596-48bd-a177-2e2002ca186c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:18.715765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c76f3816-7596-48bd-a177-2e2002ca186c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:18.716884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c76f3816-7596-48bd-a177-2e2002ca186c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:18.717874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c76f3816-7596-48bd-a177-2e2002ca186c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:18.724562 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c76f3816-7596-48bd-a177-2e2002ca186c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:18.811611 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:18.822204 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-37e9577f-9f3b-405b-ad85-2c7cbda9e5a9 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d" status: 200 len: 344 microversion: 2.1 time: 0.234687 May 27 15:19:18.824032 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2420/4838] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:19:18 2022] GET /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d => generated 344 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:18.840946 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c76f3816-7596-48bd-a177-2e2002ca186c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.149293 May 27 15:19:18.852777 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2419/4839] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:19:18 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376/os-volume_attachments => generated 25 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:19:18.975179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-58bdc17f-0d64-4186-b450-d4f39d1dee0d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:18.977265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-58bdc17f-0d64-4186-b450-d4f39d1dee0d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:18.999029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-58bdc17f-0d64-4186-b450-d4f39d1dee0d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:19.000099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-58bdc17f-0d64-4186-b450-d4f39d1dee0d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:19.002056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-58bdc17f-0d64-4186-b450-d4f39d1dee0d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:19.005236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-58bdc17f-0d64-4186-b450-d4f39d1dee0d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:19.141460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-58bdc17f-0d64-4186-b450-d4f39d1dee0d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:19:19.326911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4f3dfbcf-8dcb-49b3-825f-5731cc75bf86 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:19.327554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4f3dfbcf-8dcb-49b3-825f-5731cc75bf86 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:19.374623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f3dfbcf-8dcb-49b3-825f-5731cc75bf86 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:19.375222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f3dfbcf-8dcb-49b3-825f-5731cc75bf86 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:19.376073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f3dfbcf-8dcb-49b3-825f-5731cc75bf86 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:19.376528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f3dfbcf-8dcb-49b3-825f-5731cc75bf86 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:19.461601 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-58bdc17f-0d64-4186-b450-d4f39d1dee0d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "DELETE /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 204 len: 0 microversion: 2.1 time: 0.490032 May 27 15:19:19.463160 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2421/4840] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:19:18 2022] DELETE /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:19:19.475021 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-30bddd22-ba05-4676-8b71-6b68278402c8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:19.478721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-30bddd22-ba05-4676-8b71-6b68278402c8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:19.494983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30bddd22-ba05-4676-8b71-6b68278402c8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:19.495781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30bddd22-ba05-4676-8b71-6b68278402c8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:19.496838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30bddd22-ba05-4676-8b71-6b68278402c8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:19.500380 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30bddd22-ba05-4676-8b71-6b68278402c8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:19.882114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=36 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:19.912955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:19.968367 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-30bddd22-ba05-4676-8b71-6b68278402c8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:19.981199 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-30bddd22-ba05-4676-8b71-6b68278402c8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1329 microversion: 2.1 time: 0.515067 May 27 15:19:19.986330 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2422/4841] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:19 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1329 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:20.004418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-02001b64-ead6-458d-b5db-5208a03ce039 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:20.005386 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-02001b64-ead6-458d-b5db-5208a03ce039 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:20.016923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4f3dfbcf-8dcb-49b3-825f-5731cc75bf86 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:20.021707 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02001b64-ead6-458d-b5db-5208a03ce039 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:20.022595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02001b64-ead6-458d-b5db-5208a03ce039 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:20.025870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02001b64-ead6-458d-b5db-5208a03ce039 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:20.026783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02001b64-ead6-458d-b5db-5208a03ce039 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:20.035235 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4f3dfbcf-8dcb-49b3-825f-5731cc75bf86 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1321 microversion: 2.1 time: 0.715133 May 27 15:19:20.048271 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2420/4842] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:19 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1321 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:20.073621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5795951f-49e0-4d43-a07f-8ceb22df2f33 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc776cbe9d0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:20.191966 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5795951f-49e0-4d43-a07f-8ceb22df2f33 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d" status: 200 len: 344 microversion: 2.1 time: 0.141021 May 27 15:19:20.195904 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2421/4843] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:19:20 2022] GET /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d => generated 344 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:20.699455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-02001b64-ead6-458d-b5db-5208a03ce039 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:20.712127 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-02001b64-ead6-458d-b5db-5208a03ce039 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1674 microversion: 2.1 time: 0.715632 May 27 15:19:20.722375 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2423/4844] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:19 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1674 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:21.001817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=38 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:21.008329 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-58fdb224-3b83-4a52-8802-9d00b803cf2e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:21.009393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-58fdb224-3b83-4a52-8802-9d00b803cf2e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:21.038039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58fdb224-3b83-4a52-8802-9d00b803cf2e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:21.038666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58fdb224-3b83-4a52-8802-9d00b803cf2e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:21.039712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58fdb224-3b83-4a52-8802-9d00b803cf2e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:21.040368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58fdb224-3b83-4a52-8802-9d00b803cf2e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:21.062404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-74210ea6-d4b4-4a2c-9cf8-220fedd261a7 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:21.063052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-74210ea6-d4b4-4a2c-9cf8-220fedd261a7 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:21.078444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74210ea6-d4b4-4a2c-9cf8-220fedd261a7 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:21.081638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74210ea6-d4b4-4a2c-9cf8-220fedd261a7 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:21.087708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74210ea6-d4b4-4a2c-9cf8-220fedd261a7 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:21.088228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74210ea6-d4b4-4a2c-9cf8-220fedd261a7 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:21.643271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-74210ea6-d4b4-4a2c-9cf8-220fedd261a7 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:21.655141 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-74210ea6-d4b4-4a2c-9cf8-220fedd261a7 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1321 microversion: 2.1 time: 0.603924 May 27 15:19:21.655744 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2424/4845] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:21 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1321 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:21.671410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-58fdb224-3b83-4a52-8802-9d00b803cf2e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:21.683343 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-58fdb224-3b83-4a52-8802-9d00b803cf2e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1329 microversion: 2.1 time: 0.682393 May 27 15:19:21.693816 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2422/4846] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:20 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1329 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:21.694623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c2a9d204-c273-4be7-8a20-9b2c9aa91346 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc775541d30>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:21.729925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-979ee109-535b-4e34-b757-b37438154613 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:21.730780 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-979ee109-535b-4e34-b757-b37438154613 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:21.746764 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-979ee109-535b-4e34-b757-b37438154613 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:21.747515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-979ee109-535b-4e34-b757-b37438154613 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:21.748776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-979ee109-535b-4e34-b757-b37438154613 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:21.749373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-979ee109-535b-4e34-b757-b37438154613 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:21.811477 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c2a9d204-c273-4be7-8a20-9b2c9aa91346 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d" status: 200 len: 344 microversion: 2.1 time: 0.133167 May 27 15:19:21.812301 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2425/4847] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:19:21 2022] GET /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d => generated 344 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:22.175374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-a9c62c82-4647-48ae-9bd7-4a5dba9f632e req-3dfecbb9-a14e-48c3-aeea-a72a9dd339b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f95c0e-01e4-40d3-98cb-d61147d8ca03", "name": "network-vif-plugged", "status": "completed", "tag": "2af24b23-ac86-4a9f-a777-f5e4b651b84e"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:22.203527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-a9c62c82-4647-48ae-9bd7-4a5dba9f632e req-3dfecbb9-a14e-48c3-aeea-a72a9dd339b2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:22.205951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-a9c62c82-4647-48ae-9bd7-4a5dba9f632e req-3dfecbb9-a14e-48c3-aeea-a72a9dd339b2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:22.248347 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-a9c62c82-4647-48ae-9bd7-4a5dba9f632e req-3dfecbb9-a14e-48c3-aeea-a72a9dd339b2 service nova] Creating event network-vif-plugged:2af24b23-ac86-4a9f-a777-f5e4b651b84e for instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 on n-h2-843621-1 May 27 15:19:22.260169 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-a9c62c82-4647-48ae-9bd7-4a5dba9f632e req-3dfecbb9-a14e-48c3-aeea-a72a9dd339b2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088249 May 27 15:19:22.261518 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2426/4848] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:22.288647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-979ee109-535b-4e34-b757-b37438154613 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:22.310447 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-979ee109-535b-4e34-b757-b37438154613 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1674 microversion: 2.1 time: 0.583634 May 27 15:19:22.326700 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2423/4849] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:21 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1674 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:22.673667 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-271d63b0-a6a0-43b3-8b02-36e1db0761b5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:22.675396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-271d63b0-a6a0-43b3-8b02-36e1db0761b5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:22.686851 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-271d63b0-a6a0-43b3-8b02-36e1db0761b5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:22.687997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-271d63b0-a6a0-43b3-8b02-36e1db0761b5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:22.690053 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-271d63b0-a6a0-43b3-8b02-36e1db0761b5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:22.690984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-271d63b0-a6a0-43b3-8b02-36e1db0761b5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:22.705781 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9f3b82fd-3c96-496e-bc38-be9c9e57bc10 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:22.706128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9f3b82fd-3c96-496e-bc38-be9c9e57bc10 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:22.716542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f3b82fd-3c96-496e-bc38-be9c9e57bc10 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:22.717046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f3b82fd-3c96-496e-bc38-be9c9e57bc10 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:22.717845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f3b82fd-3c96-496e-bc38-be9c9e57bc10 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:22.718292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9f3b82fd-3c96-496e-bc38-be9c9e57bc10 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:23.051547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-271d63b0-a6a0-43b3-8b02-36e1db0761b5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:23.056485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9f3b82fd-3c96-496e-bc38-be9c9e57bc10 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:23.064288 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-271d63b0-a6a0-43b3-8b02-36e1db0761b5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1321 microversion: 2.1 time: 0.395105 May 27 15:19:23.066632 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2427/4850] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:22 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:23.070982 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9f3b82fd-3c96-496e-bc38-be9c9e57bc10 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1329 microversion: 2.1 time: 0.370013 May 27 15:19:23.075025 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2424/4851] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:22 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1329 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:23.105206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b62d82a5-ddd4-4e62-a2cd-48c80f182f3d tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc7756eed30>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:23.266755 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b62d82a5-ddd4-4e62-a2cd-48c80f182f3d tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d" status: 200 len: 344 microversion: 2.1 time: 0.198650 May 27 15:19:23.267582 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2428/4852] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:19:23 2022] GET /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d => generated 344 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:23.334724 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-318a3dd1-ba20-4fc6-b60b-25b220827958 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:23.336173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-318a3dd1-ba20-4fc6-b60b-25b220827958 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:23.365542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-318a3dd1-ba20-4fc6-b60b-25b220827958 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:23.371336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-318a3dd1-ba20-4fc6-b60b-25b220827958 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:23.372237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-318a3dd1-ba20-4fc6-b60b-25b220827958 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:23.372720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-318a3dd1-ba20-4fc6-b60b-25b220827958 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:24.083379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1dcdb435-0fb2-41fe-b205-de0fb6aee141 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:24.084013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1dcdb435-0fb2-41fe-b205-de0fb6aee141 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:24.101347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1dcdb435-0fb2-41fe-b205-de0fb6aee141 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:24.103943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1dcdb435-0fb2-41fe-b205-de0fb6aee141 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:24.106363 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1dcdb435-0fb2-41fe-b205-de0fb6aee141 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:24.110668 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1dcdb435-0fb2-41fe-b205-de0fb6aee141 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:25.143488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1dcdb435-0fb2-41fe-b205-de0fb6aee141 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:25.156649 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1dcdb435-0fb2-41fe-b205-de0fb6aee141 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1321 microversion: 2.1 time: 1.079040 May 27 15:19:25.160198 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2429/4853] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:24 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1321 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:25.169974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-88f8d241-127a-4fa9-bb79-1a65474c4f66 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:25.172153 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-88f8d241-127a-4fa9-bb79-1a65474c4f66 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:25.188731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88f8d241-127a-4fa9-bb79-1a65474c4f66 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:25.189711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-318a3dd1-ba20-4fc6-b60b-25b220827958 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:25.191152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88f8d241-127a-4fa9-bb79-1a65474c4f66 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:25.192007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88f8d241-127a-4fa9-bb79-1a65474c4f66 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:25.192468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88f8d241-127a-4fa9-bb79-1a65474c4f66 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:25.202574 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-318a3dd1-ba20-4fc6-b60b-25b220827958 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1674 microversion: 2.1 time: 1.872126 May 27 15:19:25.204038 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2425/4854] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:23 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1674 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:25.221427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dfaabe12-6e10-4914-b70f-7b8da97998be tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc7771c9a60>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:25.288463 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-dfaabe12-6e10-4914-b70f-7b8da97998be tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] HTTP exception thrown: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dfaabe12-6e10-4914-b70f-7b8da97998be tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Request method failure captured: May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d HTTP/1.1 May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOvmY1ZlBoO4P5sXCBssR3VPrM93JXmjQt85eWaeHUjBFMH1VQ_AMab6VkCXlcvs8seIcecHykBvMPvfVjISGDBMMFWiBRBskgluybydNhyhpemTYRZNzLd9GZE2RH3nhVio8RCHOyPA8gJ89IghN2LH-QHAMme1lImxs9GgOZY1FgI May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1861673023cf4c8092f631db12fcde7e May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1798389546 May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1861673023cf4c8092f631db12fcde7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1861673023cf4c8092f631db12fcde7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1861673023cf4c8092f631db12fcde7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1861673023cf4c8092f631db12fcde7e", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1798389546 May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1861673023cf4c8092f631db12fcde7e May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1798389546 May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-VolumesSnapshotsTestJSON-1798389546-project May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 0a541103578b4c0c86feb7239022832d May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1798389546-project May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: exception: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '86ff023a-c75f-46dc-afa1-79b45c5ade4d'} May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. (HTTP 404) (Request-ID: req-c67285df-087f-483f-964a-74ac7a8ee6f2) May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:19:25.290629 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dfaabe12-6e10-4914-b70f-7b8da97998be tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Returning 404 to user: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dfaabe12-6e10-4914-b70f-7b8da97998be tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d" status: 404 len: 109 microversion: 2.1 time: 0.087448 May 27 15:19:25.294520 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2426/4855] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:19:25 2022] GET /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:19:25.310970 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-25f1cc81-7cfb-41aa-9765-6a0c8d8b9757 req-96c4fe3f-2a5d-4af8-929f-1cd912a4f0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "620dfc02-19dd-4f62-862c-8bee81ad6572", "name": "network-vif-plugged", "status": "completed", "tag": "4e71fbd8-95cd-4758-ba40-75304b82648f"}, {"server_uuid": "8d7f9467-fde2-48d2-a2e6-26678afb0734", "name": "network-vif-plugged", "status": "completed", "tag": "c3beae81-08af-4000-9027-6f7f0f270d3d"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:25.333535 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-25f1cc81-7cfb-41aa-9765-6a0c8d8b9757 req-96c4fe3f-2a5d-4af8-929f-1cd912a4f0e9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:25.335929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-25f1cc81-7cfb-41aa-9765-6a0c8d8b9757 req-96c4fe3f-2a5d-4af8-929f-1cd912a4f0e9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:25.386272 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-25f1cc81-7cfb-41aa-9765-6a0c8d8b9757 req-96c4fe3f-2a5d-4af8-929f-1cd912a4f0e9 service nova] Creating event network-vif-plugged:4e71fbd8-95cd-4758-ba40-75304b82648f for instance 620dfc02-19dd-4f62-862c-8bee81ad6572 on n-h2-843621-1 May 27 15:19:25.386272 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-25f1cc81-7cfb-41aa-9765-6a0c8d8b9757 req-96c4fe3f-2a5d-4af8-929f-1cd912a4f0e9 service nova] Creating event network-vif-plugged:c3beae81-08af-4000-9027-6f7f0f270d3d for instance 8d7f9467-fde2-48d2-a2e6-26678afb0734 on n-h1-843621-1 May 27 15:19:25.421203 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-25f1cc81-7cfb-41aa-9765-6a0c8d8b9757 req-96c4fe3f-2a5d-4af8-929f-1cd912a4f0e9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.126397 May 27 15:19:25.421845 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2427/4856] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:25.449241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a028cc0e-2851-4539-b6ba-b8e7e3f15b34 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc780621ee0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:25.556593 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-a028cc0e-2851-4539-b6ba-b8e7e3f15b34 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] HTTP exception thrown: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a028cc0e-2851-4539-b6ba-b8e7e3f15b34 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Request method failure captured: May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d HTTP/1.1 May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOvmY1ZlBoO4P5sXCBssR3VPrM93JXmjQt85eWaeHUjBFMH1VQ_AMab6VkCXlcvs8seIcecHykBvMPvfVjISGDBMMFWiBRBskgluybydNhyhpemTYRZNzLd9GZE2RH3nhVio8RCHOyPA8gJ89IghN2LH-QHAMme1lImxs9GgOZY1FgI May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1861673023cf4c8092f631db12fcde7e May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1798389546 May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1861673023cf4c8092f631db12fcde7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1861673023cf4c8092f631db12fcde7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1861673023cf4c8092f631db12fcde7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1861673023cf4c8092f631db12fcde7e", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1798389546 May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1861673023cf4c8092f631db12fcde7e May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1798389546 May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-VolumesSnapshotsTestJSON-1798389546-project May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 0a541103578b4c0c86feb7239022832d May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1798389546-project May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: exception: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '86ff023a-c75f-46dc-afa1-79b45c5ade4d'} May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. (HTTP 404) (Request-ID: req-dfc377e3-4544-4397-8806-532168b31582) May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:19:25.560291 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. May 27 15:19:25.564057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.568719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a028cc0e-2851-4539-b6ba-b8e7e3f15b34 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Returning 404 to user: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:25.572718 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a028cc0e-2851-4539-b6ba-b8e7e3f15b34 tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d" status: 404 len: 109 microversion: 2.1 time: 0.138347 May 27 15:19:25.574045 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2428/4857] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 15:19:25 2022] DELETE /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:19:25.588623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f1d5ecd1-251a-468d-b100-7d880264fded tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Calling method '.version_select at 0x7fc780696670>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:25.659211 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-f1d5ecd1-251a-468d-b100-7d880264fded tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] HTTP exception thrown: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f1d5ecd1-251a-468d-b100-7d880264fded tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Request method failure captured: May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d HTTP/1.1 May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOvmY1ZlBoO4P5sXCBssR3VPrM93JXmjQt85eWaeHUjBFMH1VQ_AMab6VkCXlcvs8seIcecHykBvMPvfVjISGDBMMFWiBRBskgluybydNhyhpemTYRZNzLd9GZE2RH3nhVio8RCHOyPA8gJ89IghN2LH-QHAMme1lImxs9GgOZY1FgI May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1861673023cf4c8092f631db12fcde7e May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1798389546 May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1861673023cf4c8092f631db12fcde7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1861673023cf4c8092f631db12fcde7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1861673023cf4c8092f631db12fcde7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1861673023cf4c8092f631db12fcde7e", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1798389546 May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1861673023cf4c8092f631db12fcde7e May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1798389546 May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-VolumesSnapshotsTestJSON-1798389546-project May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 0a541103578b4c0c86feb7239022832d May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1798389546-project May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: method: May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: exception: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '86ff023a-c75f-46dc-afa1-79b45c5ade4d'} May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. (HTTP 404) (Request-ID: req-dda0b4ac-d2d9-481e-8b9a-90d5df08ce0e) May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:19:25.662137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f1d5ecd1-251a-468d-b100-7d880264fded tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] Returning 404 to user: Volume 86ff023a-c75f-46dc-afa1-79b45c5ade4d could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:25.665478 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f1d5ecd1-251a-468d-b100-7d880264fded tempest-VolumesSnapshotsTestJSON-1798389546 tempest-VolumesSnapshotsTestJSON-1798389546-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d" status: 404 len: 109 microversion: 2.1 time: 0.088617 May 27 15:19:25.668067 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2429/4858] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:19:25 2022] GET /compute/v2.1/os-volumes/86ff023a-c75f-46dc-afa1-79b45c5ade4d => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:19:25.800655 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-88f8d241-127a-4fa9-bb79-1a65474c4f66 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:25.814812 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-88f8d241-127a-4fa9-bb79-1a65474c4f66 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1329 microversion: 2.1 time: 0.653028 May 27 15:19:25.828878 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2430/4859] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:25 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1329 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:26.175685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-69d71dd6-f953-48c5-8d37-5535afb3982b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:26.176595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-69d71dd6-f953-48c5-8d37-5535afb3982b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:26.190107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69d71dd6-f953-48c5-8d37-5535afb3982b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:26.192820 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69d71dd6-f953-48c5-8d37-5535afb3982b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:26.194784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69d71dd6-f953-48c5-8d37-5535afb3982b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:26.195416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69d71dd6-f953-48c5-8d37-5535afb3982b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:26.220804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-39e26450-e67f-44d3-8c23-7ca3be7ba610 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:26.221428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-39e26450-e67f-44d3-8c23-7ca3be7ba610 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:26.234034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39e26450-e67f-44d3-8c23-7ca3be7ba610 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:26.234491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39e26450-e67f-44d3-8c23-7ca3be7ba610 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:26.245977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39e26450-e67f-44d3-8c23-7ca3be7ba610 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:26.246478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39e26450-e67f-44d3-8c23-7ca3be7ba610 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:26.692117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-39e26450-e67f-44d3-8c23-7ca3be7ba610 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:26.701780 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-39e26450-e67f-44d3-8c23-7ca3be7ba610 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1606 microversion: 2.1 time: 0.486091 May 27 15:19:26.710899 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2431/4860] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:26 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1606 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:26.835460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-df492fd9-d57f-4de8-95a0-d12fb3533ae4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:26.836420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-df492fd9-d57f-4de8-95a0-d12fb3533ae4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:26.839848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:26.860894 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df492fd9-d57f-4de8-95a0-d12fb3533ae4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:26.864380 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df492fd9-d57f-4de8-95a0-d12fb3533ae4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:26.867151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df492fd9-d57f-4de8-95a0-d12fb3533ae4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:26.872645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df492fd9-d57f-4de8-95a0-d12fb3533ae4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:26.916475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-69d71dd6-f953-48c5-8d37-5535afb3982b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:26.925431 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-69d71dd6-f953-48c5-8d37-5535afb3982b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1321 microversion: 2.1 time: 0.754861 May 27 15:19:26.926019 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2430/4861] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:26 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1321 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:27.055852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-aaa3ab69-a19e-4746-9a5c-04a046d8d0df req-367172c2-5459-4b8c-9dc8-52d4e0d6a0fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d1ab07-fd5f-4c23-8ee7-fdc018c73376", "name": "network-vif-deleted", "tag": "754ea1e4-0201-4c60-83c7-b66cc166cf98"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:27.082725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-aaa3ab69-a19e-4746-9a5c-04a046d8d0df req-367172c2-5459-4b8c-9dc8-52d4e0d6a0fa service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:27.083203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-aaa3ab69-a19e-4746-9a5c-04a046d8d0df req-367172c2-5459-4b8c-9dc8-52d4e0d6a0fa service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:27.115519 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-aaa3ab69-a19e-4746-9a5c-04a046d8d0df req-367172c2-5459-4b8c-9dc8-52d4e0d6a0fa service nova] Creating event network-vif-deleted:754ea1e4-0201-4c60-83c7-b66cc166cf98 for instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 on n-h1-843621-1 May 27 15:19:27.129336 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-aaa3ab69-a19e-4746-9a5c-04a046d8d0df req-367172c2-5459-4b8c-9dc8-52d4e0d6a0fa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076952 May 27 15:19:27.130266 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2431/4862] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:27.481342 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-df492fd9-d57f-4de8-95a0-d12fb3533ae4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:27.493278 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-df492fd9-d57f-4de8-95a0-d12fb3533ae4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1329 microversion: 2.1 time: 0.661600 May 27 15:19:27.494483 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2432/4863] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:26 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1329 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:27.722577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d88ccc79-edc3-49fa-9ccc-dc6df80e8f02 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:27.723072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d88ccc79-edc3-49fa-9ccc-dc6df80e8f02 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:27.758192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d88ccc79-edc3-49fa-9ccc-dc6df80e8f02 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:27.759183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d88ccc79-edc3-49fa-9ccc-dc6df80e8f02 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:27.779607 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d88ccc79-edc3-49fa-9ccc-dc6df80e8f02 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:27.796839 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d88ccc79-edc3-49fa-9ccc-dc6df80e8f02 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:27.942903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9815c98e-4a31-4707-8599-15c261047b13 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:27.943907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9815c98e-4a31-4707-8599-15c261047b13 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:27.951066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9815c98e-4a31-4707-8599-15c261047b13 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:27.973260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d88ccc79-edc3-49fa-9ccc-dc6df80e8f02 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:27.978559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9815c98e-4a31-4707-8599-15c261047b13 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:27.979414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9815c98e-4a31-4707-8599-15c261047b13 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:27.979869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9815c98e-4a31-4707-8599-15c261047b13 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:28.006584 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d88ccc79-edc3-49fa-9ccc-dc6df80e8f02 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:28.007851 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-d88ccc79-edc3-49fa-9ccc-dc6df80e8f02 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lazy-loading 'fault' on Instance uuid 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:19:28.360886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d88ccc79-edc3-49fa-9ccc-dc6df80e8f02 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:28.371389 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d88ccc79-edc3-49fa-9ccc-dc6df80e8f02 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 200 len: 1327 microversion: 2.1 time: 0.654942 May 27 15:19:28.385554 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2432/4864] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:27 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 1327 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:28.513790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c2de9e98-dbec-4fa8-8d23-aea261be5756 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:28.514111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c2de9e98-dbec-4fa8-8d23-aea261be5756 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:28.529343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2de9e98-dbec-4fa8-8d23-aea261be5756 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:28.530094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2de9e98-dbec-4fa8-8d23-aea261be5756 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:28.535168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2de9e98-dbec-4fa8-8d23-aea261be5756 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:28.535631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2de9e98-dbec-4fa8-8d23-aea261be5756 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:28.902429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9815c98e-4a31-4707-8599-15c261047b13 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:28.935900 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9815c98e-4a31-4707-8599-15c261047b13 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1321 microversion: 2.1 time: 0.993449 May 27 15:19:28.944623 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2433/4865] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:27 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1321 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:28.971632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c2de9e98-dbec-4fa8-8d23-aea261be5756 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:28.981490 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c2de9e98-dbec-4fa8-8d23-aea261be5756 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1329 microversion: 2.1 time: 0.473916 May 27 15:19:28.988152 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2433/4866] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:28 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1329 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:29.407290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9bcf6610-395a-4412-b7bc-0897065e68ee tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:29.407636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9bcf6610-395a-4412-b7bc-0897065e68ee tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:29.433432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9bcf6610-395a-4412-b7bc-0897065e68ee tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:29.433650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9bcf6610-395a-4412-b7bc-0897065e68ee tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:29.438005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9bcf6610-395a-4412-b7bc-0897065e68ee tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:29.439929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9bcf6610-395a-4412-b7bc-0897065e68ee tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:29.486227 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-9bcf6610-395a-4412-b7bc-0897065e68ee tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] HTTP exception thrown: Instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 could not be found. May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9bcf6610-395a-4412-b7bc-0897065e68ee tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Request method failure captured: May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 HTTP/1.1 May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOqO8KVR7bzq1xoLjXzLKv0jGOqOkF04cM8b_FyeHOV8wjUdo7LcGuyLc27U8rtMZ4Tx8DJ2dvOnNu1SxerG7uKkQJnKsTqpVjsMvJMqiMgOzvJ1G7GmmMLPDp1c3TCtYtsBkLf2gEtULm562ZhCKsQs-h_bvBej5OHYc34thW1M5ug May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 73054e8eb659476bb30aa574d7251758 May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AttachVolumeTestJSON-528269557 May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/73054e8eb659476bb30aa574d7251758"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/73054e8eb659476bb30aa574d7251758"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/73054e8eb659476bb30aa574d7251758"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_73054e8eb659476bb30aa574d7251758", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AttachVolumeTestJSON-528269557 May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 73054e8eb659476bb30aa574d7251758 May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AttachVolumeTestJSON-528269557 May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AttachVolumeTestJSON-528269557-project May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 6fdf02b03cac44cb89d2cf3b373fb9e1 May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AttachVolumeTestJSON-528269557-project May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 could not be found. May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '00d1ab07-fd5f-4c23-8ee7-fdc018c73376'} May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 could not be found. May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 could not be found. May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:29.493203 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:29.500325 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:29.500325 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:29.500325 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:29.500325 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:19:29.500325 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:19:29.500325 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 could not be found. May 27 15:19:29.500325 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:29.503244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9bcf6610-395a-4412-b7bc-0897065e68ee tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Returning 404 to user: Instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:29.510564 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9bcf6610-395a-4412-b7bc-0897065e68ee tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 404 len: 111 microversion: 2.1 time: 0.105269 May 27 15:19:29.516441 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2434/4867] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:29 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:19:29.521488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ec90f4b8-bc9d-40b2-8b5b-5089fb3e6f20 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '.version_select at 0x7fc776366ca0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:29.597943 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ec90f4b8-bc9d-40b2-8b5b-5089fb3e6f20 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1202279322" status: 202 len: 0 microversion: 2.1 time: 0.078323 May 27 15:19:29.600227 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2434/4868] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 27 15:19:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1202279322 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:19:29.956879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6e0fb5b8-3b66-4838-b286-b805b57a6d55 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:29.957674 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6e0fb5b8-3b66-4838-b286-b805b57a6d55 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:29.975037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6e0fb5b8-3b66-4838-b286-b805b57a6d55 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:29.975440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6e0fb5b8-3b66-4838-b286-b805b57a6d55 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:29.984368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6e0fb5b8-3b66-4838-b286-b805b57a6d55 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:29.987158 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6e0fb5b8-3b66-4838-b286-b805b57a6d55 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:29.999307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0c2058ba-563d-499f-8a1a-342e42cddaf7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:30.002251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0c2058ba-563d-499f-8a1a-342e42cddaf7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:30.041027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c2058ba-563d-499f-8a1a-342e42cddaf7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:30.041564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c2058ba-563d-499f-8a1a-342e42cddaf7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:30.047414 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c2058ba-563d-499f-8a1a-342e42cddaf7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:30.047898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c2058ba-563d-499f-8a1a-342e42cddaf7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:31.102511 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6e0fb5b8-3b66-4838-b286-b805b57a6d55 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:31.118330 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6e0fb5b8-3b66-4838-b286-b805b57a6d55 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1514 microversion: 2.1 time: 1.161413 May 27 15:19:31.127569 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2435/4869] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:29 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1514 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:31.148294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-6ecfb636-e567-4c07-829a-c5f4a8871c8d req-cbec0989-b79f-478e-a8d0-b68b03a3bc9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc136c6-a73e-495c-b72d-e8f6ecbc26ff", "name": "network-vif-plugged", "status": "completed", "tag": "203c9d14-ed58-4284-982e-42b85c6016e4"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:31.172483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-6ecfb636-e567-4c07-829a-c5f4a8871c8d req-cbec0989-b79f-478e-a8d0-b68b03a3bc9f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:31.182031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-6ecfb636-e567-4c07-829a-c5f4a8871c8d req-cbec0989-b79f-478e-a8d0-b68b03a3bc9f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:31.209929 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-6ecfb636-e567-4c07-829a-c5f4a8871c8d req-cbec0989-b79f-478e-a8d0-b68b03a3bc9f service nova] Creating event network-vif-plugged:203c9d14-ed58-4284-982e-42b85c6016e4 for instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff on n-h1-843621-1 May 27 15:19:31.227638 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-6ecfb636-e567-4c07-829a-c5f4a8871c8d req-cbec0989-b79f-478e-a8d0-b68b03a3bc9f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098730 May 27 15:19:31.233828 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2436/4870] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:31.243052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-47a5c036-0ca8-40e3-93bb-9747c1f7577d tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:31.250233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-47a5c036-0ca8-40e3-93bb-9747c1f7577d tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 620dfc02-19dd-4f62-862c-8bee81ad6572] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:31.268616 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47a5c036-0ca8-40e3-93bb-9747c1f7577d tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:31.271171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47a5c036-0ca8-40e3-93bb-9747c1f7577d tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:31.272876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47a5c036-0ca8-40e3-93bb-9747c1f7577d tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:31.274626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47a5c036-0ca8-40e3-93bb-9747c1f7577d tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:31.717846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0c2058ba-563d-499f-8a1a-342e42cddaf7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:31.729492 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0c2058ba-563d-499f-8a1a-342e42cddaf7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1329 microversion: 2.1 time: 1.733157 May 27 15:19:31.742046 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2435/4871] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:29 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1329 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:31.898587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3e5962dc-082f-43f5-9eda-8640cf2d73f0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Action: 'create', calling method: .version_select at 0x7fc776366310>, body: {"keypair": {"name": "tempest-keypair-1316052880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3SZ4OwS1W+NKwZnu7IJwG/XgwClKbi4o5zyW4ldw29btmn86b0gt2VgvofmmCpo2Xxi+nqOCvLe4YziV1inQZMQCAqQk3EB5iL88/yFwy3YYgYpEcfg8Nl3Cr25ftY5w=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:31.914869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-47a5c036-0ca8-40e3-93bb-9747c1f7577d tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:31.930910 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-47a5c036-0ca8-40e3-93bb-9747c1f7577d tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/620dfc02-19dd-4f62-862c-8bee81ad6572" status: 200 len: 1513 microversion: 2.1 time: 0.693232 May 27 15:19:31.931885 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2437/4872] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:31 2022] GET /compute/v2.1/servers/620dfc02-19dd-4f62-862c-8bee81ad6572 => generated 1513 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:31.935416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-3e5962dc-082f-43f5-9eda-8640cf2d73f0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Getting quotas for project 73054e8eb659476bb30aa574d7251758. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:19:31.946959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-3e5962dc-082f-43f5-9eda-8640cf2d73f0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Getting quotas for user 6fdf02b03cac44cb89d2cf3b373fb9e1 and project 73054e8eb659476bb30aa574d7251758. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:19:31.963320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-46636569-da57-43b8-91b9-415a0d6978d9 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:31.964358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-46636569-da57-43b8-91b9-415a0d6978d9 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: d4f95c0e-01e4-40d3-98cb-d61147d8ca03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:31.986244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-46636569-da57-43b8-91b9-415a0d6978d9 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:32.005054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-46636569-da57-43b8-91b9-415a0d6978d9 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:32.006312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-46636569-da57-43b8-91b9-415a0d6978d9 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:32.006883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-46636569-da57-43b8-91b9-415a0d6978d9 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:32.020088 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3e5962dc-082f-43f5-9eda-8640cf2d73f0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126035 May 27 15:19:32.024147 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2436/4873] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:19:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:32.303340 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-46636569-da57-43b8-91b9-415a0d6978d9 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:32.318482 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-46636569-da57-43b8-91b9-415a0d6978d9 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/d4f95c0e-01e4-40d3-98cb-d61147d8ca03" status: 200 len: 1514 microversion: 2.1 time: 0.368147 May 27 15:19:32.333332 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2438/4874] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:31 2022] GET /compute/v2.1/servers/d4f95c0e-01e4-40d3-98cb-d61147d8ca03 => generated 1514 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:32.338929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9495ec63-1edf-4585-b781-a91970e9b0e9 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:32.339439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9495ec63-1edf-4585-b781-a91970e9b0e9 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: d4f95c0e-01e4-40d3-98cb-d61147d8ca03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:32.370778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9495ec63-1edf-4585-b781-a91970e9b0e9 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:32.371340 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9495ec63-1edf-4585-b781-a91970e9b0e9 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:32.372431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9495ec63-1edf-4585-b781-a91970e9b0e9 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:32.372589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9495ec63-1edf-4585-b781-a91970e9b0e9 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:32.388519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:32.426321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0ea2827c-f9f5-406d-b0e1-98ad32a0f374 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'create', calling method: .version_select at 0x7fc776ab25e0>, body: {"keypair": {"name": "tempest-keypair-1881861425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8+T+DT9mlbYulzYq3nzdH1/maF74R4c3o/rnTisMtOv9zT+WRZp4bYB5YtyepLrr7KlgxY5n0Vcom8+XEdVfRY+zX7R88V6gGxsq6W2AeZkerQdhVG9VsSpK3vI4V5dQ=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:32.465030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9495ec63-1edf-4585-b781-a91970e9b0e9 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: d4f95c0e-01e4-40d3-98cb-d61147d8ca03] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:19:32.475760 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-0ea2827c-f9f5-406d-b0e1-98ad32a0f374 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Getting quotas for project e72c782a808345e093093ea95ce04ae4. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:19:32.491152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-0ea2827c-f9f5-406d-b0e1-98ad32a0f374 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Getting quotas for user f750b3f70eed4477a15c3529371a8af3 and project e72c782a808345e093093ea95ce04ae4. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:19:32.555195 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0ea2827c-f9f5-406d-b0e1-98ad32a0f374 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.495024 May 27 15:19:32.557609 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2437/4875] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:19:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:19:32.687910 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9495ec63-1edf-4585-b781-a91970e9b0e9 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d4f95c0e-01e4-40d3-98cb-d61147d8ca03" status: 204 len: 0 microversion: 2.1 time: 0.352688 May 27 15:19:32.698059 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2439/4876] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:19:32 2022] DELETE /compute/v2.1/servers/d4f95c0e-01e4-40d3-98cb-d61147d8ca03 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:19:32.710553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-48dfe466-f60a-4acc-bcf6-205bdb6a477b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:32.711115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-48dfe466-f60a-4acc-bcf6-205bdb6a477b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: d4f95c0e-01e4-40d3-98cb-d61147d8ca03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:32.726437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-48dfe466-f60a-4acc-bcf6-205bdb6a477b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:32.727103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-48dfe466-f60a-4acc-bcf6-205bdb6a477b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:32.730143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-48dfe466-f60a-4acc-bcf6-205bdb6a477b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:32.733124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-48dfe466-f60a-4acc-bcf6-205bdb6a477b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:32.754056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-202a2217-a4cc-48af-9096-0f27c7782689 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:32.755297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-202a2217-a4cc-48af-9096-0f27c7782689 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:32.772336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-202a2217-a4cc-48af-9096-0f27c7782689 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:32.774733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-202a2217-a4cc-48af-9096-0f27c7782689 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:32.778126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-202a2217-a4cc-48af-9096-0f27c7782689 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:32.779467 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-202a2217-a4cc-48af-9096-0f27c7782689 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:33.478236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-202a2217-a4cc-48af-9096-0f27c7782689 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:33.490221 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-202a2217-a4cc-48af-9096-0f27c7782689 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1329 microversion: 2.1 time: 0.745897 May 27 15:19:33.512779 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2440/4877] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:32 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1329 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:33.534079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-48dfe466-f60a-4acc-bcf6-205bdb6a477b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:33.540595 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-48dfe466-f60a-4acc-bcf6-205bdb6a477b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/d4f95c0e-01e4-40d3-98cb-d61147d8ca03" status: 200 len: 1520 microversion: 2.1 time: 0.836828 May 27 15:19:33.541222 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2438/4878] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:32 2022] GET /compute/v2.1/servers/d4f95c0e-01e4-40d3-98cb-d61147d8ca03 => generated 1520 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:34.507992 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6c2a0c57-1354-4722-8b2f-8a481526ed31 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:34.508618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6c2a0c57-1354-4722-8b2f-8a481526ed31 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:34.530320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c2a0c57-1354-4722-8b2f-8a481526ed31 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:34.531007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c2a0c57-1354-4722-8b2f-8a481526ed31 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:34.531968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c2a0c57-1354-4722-8b2f-8a481526ed31 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:34.532432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c2a0c57-1354-4722-8b2f-8a481526ed31 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:34.558115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2b93dc7e-c6e4-466e-a954-862acac9be77 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:34.558736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2b93dc7e-c6e4-466e-a954-862acac9be77 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: d4f95c0e-01e4-40d3-98cb-d61147d8ca03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:34.581263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2b93dc7e-c6e4-466e-a954-862acac9be77 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:34.581726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2b93dc7e-c6e4-466e-a954-862acac9be77 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:34.588008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2b93dc7e-c6e4-466e-a954-862acac9be77 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:34.588465 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2b93dc7e-c6e4-466e-a954-862acac9be77 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:35.496468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6c2a0c57-1354-4722-8b2f-8a481526ed31 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:35.509918 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6c2a0c57-1354-4722-8b2f-8a481526ed31 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1511 microversion: 2.1 time: 1.004987 May 27 15:19:35.524279 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2441/4879] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:34 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1511 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:35.538209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c792cd18-b444-4311-bf64-497f626a2452 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:35.542138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c792cd18-b444-4311-bf64-497f626a2452 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:35.560629 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c792cd18-b444-4311-bf64-497f626a2452 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:35.562227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c792cd18-b444-4311-bf64-497f626a2452 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:35.564367 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c792cd18-b444-4311-bf64-497f626a2452 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:35.566933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c792cd18-b444-4311-bf64-497f626a2452 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:36.456462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2b93dc7e-c6e4-466e-a954-862acac9be77 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:36.468402 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2b93dc7e-c6e4-466e-a954-862acac9be77 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/d4f95c0e-01e4-40d3-98cb-d61147d8ca03" status: 200 len: 1520 microversion: 2.1 time: 1.913985 May 27 15:19:36.476299 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2439/4880] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:34 2022] GET /compute/v2.1/servers/d4f95c0e-01e4-40d3-98cb-d61147d8ca03 => generated 1520 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:36.533117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c792cd18-b444-4311-bf64-497f626a2452 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:36.548901 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c792cd18-b444-4311-bf64-497f626a2452 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1511 microversion: 2.1 time: 1.020727 May 27 15:19:36.565264 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2442/4881] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:35 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1511 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:36.580177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-db563e41-c7ec-45fe-bdfa-2258fd9c1649 req-878dd4bb-e739-4fcd-9656-962ea7a9629c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f95c0e-01e4-40d3-98cb-d61147d8ca03", "name": "network-vif-deleted", "tag": "2af24b23-ac86-4a9f-a777-f5e4b651b84e"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:36.611371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-db563e41-c7ec-45fe-bdfa-2258fd9c1649 req-878dd4bb-e739-4fcd-9656-962ea7a9629c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:36.612157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-db563e41-c7ec-45fe-bdfa-2258fd9c1649 req-878dd4bb-e739-4fcd-9656-962ea7a9629c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:36.644641 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-db563e41-c7ec-45fe-bdfa-2258fd9c1649 req-878dd4bb-e739-4fcd-9656-962ea7a9629c service nova] Creating event network-vif-deleted:2af24b23-ac86-4a9f-a777-f5e4b651b84e for instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 on n-h2-843621-1 May 27 15:19:36.666669 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-db563e41-c7ec-45fe-bdfa-2258fd9c1649 req-878dd4bb-e739-4fcd-9656-962ea7a9629c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095122 May 27 15:19:36.679490 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2443/4882] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:36.697526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-48110bbd-a14a-4a33-85c1-a36c47a08ed9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:36.705852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-48110bbd-a14a-4a33-85c1-a36c47a08ed9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:36.730297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48110bbd-a14a-4a33-85c1-a36c47a08ed9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:36.730764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48110bbd-a14a-4a33-85c1-a36c47a08ed9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:36.732445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48110bbd-a14a-4a33-85c1-a36c47a08ed9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:36.732938 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48110bbd-a14a-4a33-85c1-a36c47a08ed9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:36.785485 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-48110bbd-a14a-4a33-85c1-a36c47a08ed9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:19:36.945421 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-48110bbd-a14a-4a33-85c1-a36c47a08ed9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 204 len: 0 microversion: 2.1 time: 0.264260 May 27 15:19:36.947907 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2444/4883] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:19:36 2022] DELETE /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:19:36.960806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-848cc8e8-2983-425f-ba58-e4e2e963b30c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-631930818", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd9b0c1e-1337-41c4-ad51-76af42807fc2"}], "security_groups": [{"name": "tempest-securitygroup--2036872350"}], "key_name": "tempest-keypair-1316052880", "user_data": "}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:37.286232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8a606c9f-fdac-4b9c-a1ad-705b7584d1d3 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:37.286952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8a606c9f-fdac-4b9c-a1ad-705b7584d1d3 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:37.295455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a606c9f-fdac-4b9c-a1ad-705b7584d1d3 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:37.295909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a606c9f-fdac-4b9c-a1ad-705b7584d1d3 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:37.296710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a606c9f-fdac-4b9c-a1ad-705b7584d1d3 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:37.300223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a606c9f-fdac-4b9c-a1ad-705b7584d1d3 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:37.362264 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8a606c9f-fdac-4b9c-a1ad-705b7584d1d3 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/ips" status: 200 len: 150 microversion: 2.1 time: 0.884378 May 27 15:19:37.362861 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2440/4884] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 15:19:36 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/ips => generated 150 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:37.380690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2da78ef7-10d0-45cb-b97e-c8de79666856 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:37.381333 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2da78ef7-10d0-45cb-b97e-c8de79666856 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:37.409833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2da78ef7-10d0-45cb-b97e-c8de79666856 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:37.410292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2da78ef7-10d0-45cb-b97e-c8de79666856 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:37.411071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2da78ef7-10d0-45cb-b97e-c8de79666856 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:37.411513 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2da78ef7-10d0-45cb-b97e-c8de79666856 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:37.443345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-848cc8e8-2983-425f-ba58-e4e2e963b30c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] validate_networks() for [('bd9b0c1e-1337-41c4-ad51-76af42807fc2', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:19:37.893237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2da78ef7-10d0-45cb-b97e-c8de79666856 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:37.906192 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2da78ef7-10d0-45cb-b97e-c8de79666856 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1517 microversion: 2.1 time: 0.539205 May 27 15:19:37.919156 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2441/4885] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:37 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1517 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:37.937387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-74d5caec-7835-47e6-b8f0-7df4128311dc tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:37.941182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-74d5caec-7835-47e6-b8f0-7df4128311dc tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: d4f95c0e-01e4-40d3-98cb-d61147d8ca03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:37.959088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-74d5caec-7835-47e6-b8f0-7df4128311dc tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:37.959554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-74d5caec-7835-47e6-b8f0-7df4128311dc tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:37.961932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-74d5caec-7835-47e6-b8f0-7df4128311dc tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:37.962396 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-74d5caec-7835-47e6-b8f0-7df4128311dc tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:38.004061 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-74d5caec-7835-47e6-b8f0-7df4128311dc tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] HTTP exception thrown: Instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 could not be found. May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-74d5caec-7835-47e6-b8f0-7df4128311dc tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Request method failure captured: May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/d4f95c0e-01e4-40d3-98cb-d61147d8ca03 HTTP/1.1 May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOvieKw5CHK5Q8bvjKQk5MIl9jOe7hq8quA382rQaFUPA0-KqTvhcKhOHqch2a_BvA9rlrG4McYiMcF0nX_C38e9cJP0SHEiV-NX55OdOAeFGJaQ3fKnlllwasVjwMR9M3SyjkW2aqFBNKkkzcxFiPCm1CL9ZdVxOxccc5G_MN3IzgY May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 02c7dc0c99734781b18bf56d952bc9ad May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02c7dc0c99734781b18bf56d952bc9ad", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 02c7dc0c99734781b18bf56d952bc9ad May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ListServersNegativeTestJSON-696810623-project May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 44380d176a0d451d8b19e4dd90cc9478 May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ListServersNegativeTestJSON-696810623-project May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 could not be found. May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'd4f95c0e-01e4-40d3-98cb-d61147d8ca03'} May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 could not be found. May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 could not be found. May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:38.009337 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:38.013484 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:38.013484 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:38.013484 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:38.013484 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:19:38.013484 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:19:38.013484 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 could not be found. May 27 15:19:38.013484 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:38.013484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-74d5caec-7835-47e6-b8f0-7df4128311dc tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Returning 404 to user: Instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:38.014006 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-74d5caec-7835-47e6-b8f0-7df4128311dc tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/d4f95c0e-01e4-40d3-98cb-d61147d8ca03" status: 404 len: 111 microversion: 2.1 time: 0.093450 May 27 15:19:38.014257 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2442/4886] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:37 2022] GET /compute/v2.1/servers/d4f95c0e-01e4-40d3-98cb-d61147d8ca03 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:19:38.028895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b00d9292-f8c0-4417-9745-b3139d7d2d0b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:38.054970 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b00d9292-f8c0-4417-9745-b3139d7d2d0b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:38.056742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b00d9292-f8c0-4417-9745-b3139d7d2d0b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '02c7dc0c99734781b18bf56d952bc9ad'} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:19:38.065132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b00d9292-f8c0-4417-9745-b3139d7d2d0b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:38.065675 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b00d9292-f8c0-4417-9745-b3139d7d2d0b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:38.066570 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b00d9292-f8c0-4417-9745-b3139d7d2d0b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:38.067079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b00d9292-f8c0-4417-9745-b3139d7d2d0b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:38.234963 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b00d9292-f8c0-4417-9745-b3139d7d2d0b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.213916 May 27 15:19:38.235552 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2443/4887] 10.222.0.13 () {58 vars in 1229 bytes} [Fri May 27 15:19:38 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:19:38.257211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ad9160d1-559f-4934-a8ee-790943d8c0c8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-856950824", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2accc000-a1ee-4371-bdb5-4490822eb578"}], "security_groups": [{"name": "tempest-securitygroup--349771873"}], "key_name": "tempest-keypair-1881861425", "user_data": "}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:38.518554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-ad9160d1-559f-4934-a8ee-790943d8c0c8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] validate_networks() for [('2accc000-a1ee-4371-bdb5-4490822eb578', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:19:38.583031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-848cc8e8-2983-425f-ba58-e4e2e963b30c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:19:38.583531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-848cc8e8-2983-425f-ba58-e4e2e963b30c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:19:38.583930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-848cc8e8-2983-425f-ba58-e4e2e963b30c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:19:38.584352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-848cc8e8-2983-425f-ba58-e4e2e963b30c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:19:38.584809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-848cc8e8-2983-425f-ba58-e4e2e963b30c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:19:38.607186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-848cc8e8-2983-425f-ba58-e4e2e963b30c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:38.607718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-848cc8e8-2983-425f-ba58-e4e2e963b30c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:38.611275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-848cc8e8-2983-425f-ba58-e4e2e963b30c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:38.612922 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-848cc8e8-2983-425f-ba58-e4e2e963b30c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:38.642830 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-848cc8e8-2983-425f-ba58-e4e2e963b30c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Getting quotas for project 73054e8eb659476bb30aa574d7251758. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:19:38.656434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-848cc8e8-2983-425f-ba58-e4e2e963b30c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Getting quotas for user 6fdf02b03cac44cb89d2cf3b373fb9e1 and project 73054e8eb659476bb30aa574d7251758. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:19:38.689438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-848cc8e8-2983-425f-ba58-e4e2e963b30c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:19:38.694971 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-848cc8e8-2983-425f-ba58-e4e2e963b30c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:19:38.808352 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-848cc8e8-2983-425f-ba58-e4e2e963b30c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.856412 May 27 15:19:38.814007 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2445/4888] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:19:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 1864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:19:38.826162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ecf07f59-1c82-480f-894b-da62d40f0d10 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ecf07f59-1c82-480f-894b-da62d40f0d10 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Request method failure captured: May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOvieKw5CHK5Q8bvjKQk5MIl9jOe7hq8quA382rQaFUPA0-KqTvhcKhOHqch2a_BvA9rlrG4McYiMcF0nX_C38e9cJP0SHEiV-NX55OdOAeFGJaQ3fKnlllwasVjwMR9M3SyjkW2aqFBNKkkzcxFiPCm1CL9ZdVxOxccc5G_MN3IzgY May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 02c7dc0c99734781b18bf56d952bc9ad May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02c7dc0c99734781b18bf56d952bc9ad", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 02c7dc0c99734781b18bf56d952bc9ad May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ListServersNegativeTestJSON-696810623-project May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 44380d176a0d451d8b19e4dd90cc9478 May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ListServersNegativeTestJSON-696810623-project May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: action_args: {} May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance[0]: May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi '2011/01/01' May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 27 15:19:38.866122 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:19:38.869871 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:19:38.869871 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:19:38.869871 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:19:38.869871 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 27 15:19:38.869871 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:38.869871 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:38.869871 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:38.869871 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:38.869871 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:38.869871 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:38.869871 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:19:38.869871 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:19:38.869871 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 27 15:19:38.869871 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:38.876644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ecf07f59-1c82-480f-894b-da62d40f0d10 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:38.881304 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ecf07f59-1c82-480f-894b-da62d40f0d10 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.064144 May 27 15:19:38.883902 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2446/4889] 10.222.0.13 () {58 vars in 1181 bytes} [Fri May 27 15:19:38 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:19:38.889998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1599523d-916c-475f-ae78-f2c7b3546476 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:38.891205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1599523d-916c-475f-ae78-f2c7b3546476 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:39.029607 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1599523d-916c-475f-ae78-f2c7b3546476 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:39.041565 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1599523d-916c-475f-ae78-f2c7b3546476 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 200 len: 1237 microversion: 2.1 time: 0.155508 May 27 15:19:39.042744 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2447/4890] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:38 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 1237 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:39.062292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-46290c48-6868-434d-bb9d-6d05b42519f8 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:39.077729 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-46290c48-6868-434d-bb9d-6d05b42519f8 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:39.079297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-46290c48-6868-434d-bb9d-6d05b42519f8 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Searching by: {'deleted': False, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:19:39.096066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-46290c48-6868-434d-bb9d-6d05b42519f8 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:39.098187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-46290c48-6868-434d-bb9d-6d05b42519f8 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:39.100619 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-46290c48-6868-434d-bb9d-6d05b42519f8 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:39.102650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-46290c48-6868-434d-bb9d-6d05b42519f8 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:39.205105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-46290c48-6868-434d-bb9d-6d05b42519f8 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:19:39.285457 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-46290c48-6868-434d-bb9d-6d05b42519f8 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 679 microversion: 2.1 time: 0.241271 May 27 15:19:39.288072 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2448/4891] 10.222.0.13 () {58 vars in 1124 bytes} [Fri May 27 15:19:39 2022] GET /compute/v2.1/servers => generated 679 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:39.302184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c5937029-bd05-49a2-b2ef-19932e7a5dd3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:39.304649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c5937029-bd05-49a2-b2ef-19932e7a5dd3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:39.328027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c5937029-bd05-49a2-b2ef-19932e7a5dd3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:39.332989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c5937029-bd05-49a2-b2ef-19932e7a5dd3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:39.338516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c5937029-bd05-49a2-b2ef-19932e7a5dd3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:39.339627 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c5937029-bd05-49a2-b2ef-19932e7a5dd3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:39.795731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c5937029-bd05-49a2-b2ef-19932e7a5dd3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:39.807592 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c5937029-bd05-49a2-b2ef-19932e7a5dd3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1517 microversion: 2.1 time: 0.517581 May 27 15:19:39.814159 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2449/4892] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:39 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1517 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:39.837039 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c58fdc88-ecc1-4d85-9737-7c792f9ef2de tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:39.840767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c58fdc88-ecc1-4d85-9737-7c792f9ef2de tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:39.841237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.compute.servers [None req-c58fdc88-ecc1-4d85-9737-7c792f9ef2de tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Removing options 'limit' from query {{(pid=119248) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 27 15:19:39.841920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c58fdc88-ecc1-4d85-9737-7c792f9ef2de tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Searching by: {'deleted': False, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:19:39.873280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c58fdc88-ecc1-4d85-9737-7c792f9ef2de tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:39.873280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c58fdc88-ecc1-4d85-9737-7c792f9ef2de tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:39.873859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c58fdc88-ecc1-4d85-9737-7c792f9ef2de tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:39.874372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c58fdc88-ecc1-4d85-9737-7c792f9ef2de tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:39.952319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.multi_cell_list [None req-c58fdc88-ecc1-4d85-9737-7c792f9ef2de tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119248) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:19:40.039405 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c58fdc88-ecc1-4d85-9737-7c792f9ef2de tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=102" status: 200 len: 679 microversion: 2.1 time: 0.221739 May 27 15:19:40.041512 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2450/4893] 10.222.0.13 () {58 vars in 1143 bytes} [Fri May 27 15:19:39 2022] GET /compute/v2.1/servers?limit=102 => generated 679 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:40.081423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2c1f6879-bd21-4133-b9fb-ab11f9f17b1d tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2c1f6879-bd21-4133-b9fb-ab11f9f17b1d tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Request method failure captured: May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOvieKw5CHK5Q8bvjKQk5MIl9jOe7hq8quA382rQaFUPA0-KqTvhcKhOHqch2a_BvA9rlrG4McYiMcF0nX_C38e9cJP0SHEiV-NX55OdOAeFGJaQ3fKnlllwasVjwMR9M3SyjkW2aqFBNKkkzcxFiPCm1CL9ZdVxOxccc5G_MN3IzgY May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 02c7dc0c99734781b18bf56d952bc9ad May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02c7dc0c99734781b18bf56d952bc9ad", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 02c7dc0c99734781b18bf56d952bc9ad May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ListServersNegativeTestJSON-696810623-project May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 44380d176a0d451d8b19e4dd90cc9478 May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ListServersNegativeTestJSON-696810623-project May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: action_args: {} May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'minimum': 0, May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance[0]: May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi '-1' May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 27 15:19:40.090214 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 27 15:19:40.095399 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:19:40.095399 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:19:40.095399 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:19:40.095399 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:19:40.095399 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 27 15:19:40.095399 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:40.095399 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:40.095399 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:40.095399 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:40.095399 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:40.095399 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:40.095399 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:19:40.095399 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:19:40.095399 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 27 15:19:40.095399 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:40.095399 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2c1f6879-bd21-4133-b9fb-ab11f9f17b1d tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:40.102581 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2c1f6879-bd21-4133-b9fb-ab11f9f17b1d tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.037545 May 27 15:19:40.102581 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2451/4894] 10.222.0.13 () {58 vars in 1141 bytes} [Fri May 27 15:19:40 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:19:40.113958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e6cc7659-c64d-488b-91c4-fe0520c13b23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:40.120311 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e6cc7659-c64d-488b-91c4-fe0520c13b23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:40.145133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e6cc7659-c64d-488b-91c4-fe0520c13b23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:40.148450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e6cc7659-c64d-488b-91c4-fe0520c13b23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:40.153864 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e6cc7659-c64d-488b-91c4-fe0520c13b23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:40.156130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e6cc7659-c64d-488b-91c4-fe0520c13b23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:40.407888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e6cc7659-c64d-488b-91c4-fe0520c13b23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:40.425606 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e6cc7659-c64d-488b-91c4-fe0520c13b23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 200 len: 1289 microversion: 2.1 time: 0.322423 May 27 15:19:40.440115 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2452/4895] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:40 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 1289 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:40.461825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ad9160d1-559f-4934-a8ee-790943d8c0c8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:19:40.462316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-84ef9ad6-1e32-49fb-8bfb-abcaf15daf5b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:40.462431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ad9160d1-559f-4934-a8ee-790943d8c0c8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:19:40.462738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ad9160d1-559f-4934-a8ee-790943d8c0c8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:19:40.463163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ad9160d1-559f-4934-a8ee-790943d8c0c8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:19:40.463591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ad9160d1-559f-4934-a8ee-790943d8c0c8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-84ef9ad6-1e32-49fb-8bfb-abcaf15daf5b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Request method failure captured: May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOvieKw5CHK5Q8bvjKQk5MIl9jOe7hq8quA382rQaFUPA0-KqTvhcKhOHqch2a_BvA9rlrG4McYiMcF0nX_C38e9cJP0SHEiV-NX55OdOAeFGJaQ3fKnlllwasVjwMR9M3SyjkW2aqFBNKkkzcxFiPCm1CL9ZdVxOxccc5G_MN3IzgY May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 02c7dc0c99734781b18bf56d952bc9ad May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02c7dc0c99734781b18bf56d952bc9ad", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 02c7dc0c99734781b18bf56d952bc9ad May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ListServersNegativeTestJSON-696810623-project May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 44380d176a0d451d8b19e4dd90cc9478 May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ListServersNegativeTestJSON-696810623-project May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: action_args: {} May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'minimum': 0, May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance[0]: May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'testing' May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 27 15:19:40.464906 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 27 15:19:40.471810 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:19:40.471810 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:19:40.471810 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:19:40.471810 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:19:40.471810 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 27 15:19:40.471810 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:40.471810 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:40.471810 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:40.471810 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:40.471810 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:40.471810 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:40.471810 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:19:40.471810 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:19:40.471810 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 27 15:19:40.471810 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:40.471810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-84ef9ad6-1e32-49fb-8bfb-abcaf15daf5b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:40.471810 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-84ef9ad6-1e32-49fb-8bfb-abcaf15daf5b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.024560 May 27 15:19:40.472954 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2453/4896] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 15:19:40 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:19:40.477267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-48377089-b77e-4b8d-9116-7c059e3abc00 req-11677dbd-5603-454e-8cd6-d5aa0fe73f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc136c6-a73e-495c-b72d-e8f6ecbc26ff", "name": "network-vif-deleted", "tag": "203c9d14-ed58-4284-982e-42b85c6016e4"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:40.484480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad9160d1-559f-4934-a8ee-790943d8c0c8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:40.484976 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad9160d1-559f-4934-a8ee-790943d8c0c8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:40.485811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad9160d1-559f-4934-a8ee-790943d8c0c8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:40.486386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad9160d1-559f-4934-a8ee-790943d8c0c8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:40.488533 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-48377089-b77e-4b8d-9116-7c059e3abc00 req-11677dbd-5603-454e-8cd6-d5aa0fe73f3a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:40.489096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-48377089-b77e-4b8d-9116-7c059e3abc00 req-11677dbd-5603-454e-8cd6-d5aa0fe73f3a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:40.524545 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-48377089-b77e-4b8d-9116-7c059e3abc00 req-11677dbd-5603-454e-8cd6-d5aa0fe73f3a service nova] Creating event network-vif-deleted:203c9d14-ed58-4284-982e-42b85c6016e4 for instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff on n-h1-843621-1 May 27 15:19:40.532561 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-48377089-b77e-4b8d-9116-7c059e3abc00 req-11677dbd-5603-454e-8cd6-d5aa0fe73f3a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058807 May 27 15:19:40.536227 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2454/4897] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:40.545594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3d48f965-6b2b-4be3-a7d5-e7f6272b3cc5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:40.563657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3d48f965-6b2b-4be3-a7d5-e7f6272b3cc5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:40.568619 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-ad9160d1-559f-4934-a8ee-790943d8c0c8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Getting quotas for project e72c782a808345e093093ea95ce04ae4. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:19:40.569710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3d48f965-6b2b-4be3-a7d5-e7f6272b3cc5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:19:40.582829 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-ad9160d1-559f-4934-a8ee-790943d8c0c8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Getting quotas for user f750b3f70eed4477a15c3529371a8af3 and project e72c782a808345e093093ea95ce04ae4. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:19:40.584213 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.compute.servers [None req-3d48f965-6b2b-4be3-a7d5-e7f6272b3cc5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Flavor 'non_existing_flavor' could not be found {{(pid=119248) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} May 27 15:19:40.585671 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3d48f965-6b2b-4be3-a7d5-e7f6272b3cc5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.047022 May 27 15:19:40.586759 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2455/4898] 10.222.0.13 () {58 vars in 1177 bytes} [Fri May 27 15:19:40 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:19:40.600776 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f363ac2d-2785-4dff-bf87-f6e7ca002cf1 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:40.605686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f363ac2d-2785-4dff-bf87-f6e7ca002cf1 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:40.607169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f363ac2d-2785-4dff-bf87-f6e7ca002cf1 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:19:40.618285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f363ac2d-2785-4dff-bf87-f6e7ca002cf1 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:40.620711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f363ac2d-2785-4dff-bf87-f6e7ca002cf1 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:40.622759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f363ac2d-2785-4dff-bf87-f6e7ca002cf1 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:40.631523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f363ac2d-2785-4dff-bf87-f6e7ca002cf1 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:40.640143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ad9160d1-559f-4934-a8ee-790943d8c0c8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:19:40.642640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ad9160d1-559f-4934-a8ee-790943d8c0c8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:19:40.891075 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ad9160d1-559f-4934-a8ee-790943d8c0c8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.649343 May 27 15:19:40.894899 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2444/4899] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:19:38 2022] POST /compute/v2.1/servers => generated 408 bytes in 2657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:19:40.905843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fa3e7200-ba5e-4c1d-abec-43f25194e1a8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:40.910387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fa3e7200-ba5e-4c1d-abec-43f25194e1a8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:40.943843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa3e7200-ba5e-4c1d-abec-43f25194e1a8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:40.947758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa3e7200-ba5e-4c1d-abec-43f25194e1a8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:40.956298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa3e7200-ba5e-4c1d-abec-43f25194e1a8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:40.957135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa3e7200-ba5e-4c1d-abec-43f25194e1a8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:41.076730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa3e7200-ba5e-4c1d-abec-43f25194e1a8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:41.084123 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa3e7200-ba5e-4c1d-abec-43f25194e1a8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:41.088815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-fa3e7200-ba5e-4c1d-abec-43f25194e1a8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lazy-loading 'fault' on Instance uuid 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:19:41.272782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fa3e7200-ba5e-4c1d-abec-43f25194e1a8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:41.287014 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fa3e7200-ba5e-4c1d-abec-43f25194e1a8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 200 len: 1319 microversion: 2.1 time: 0.390795 May 27 15:19:41.297125 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2445/4900] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:40 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 1319 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:41.301209 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-745696fc-f1f1-4f9c-8f3a-1de36bb6ba99 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:41.301848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-745696fc-f1f1-4f9c-8f3a-1de36bb6ba99 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:41.472912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-745696fc-f1f1-4f9c-8f3a-1de36bb6ba99 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:41.480068 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-745696fc-f1f1-4f9c-8f3a-1de36bb6ba99 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1238 microversion: 2.1 time: 0.191392 May 27 15:19:41.489741 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2446/4901] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:41 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1238 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:41.504947 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-09fac401-ab2f-47ca-ad56-b8bbdc85e5b0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:41.507040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-09fac401-ab2f-47ca-ad56-b8bbdc85e5b0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:41.538093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09fac401-ab2f-47ca-ad56-b8bbdc85e5b0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:41.543115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09fac401-ab2f-47ca-ad56-b8bbdc85e5b0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:41.547344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09fac401-ab2f-47ca-ad56-b8bbdc85e5b0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:41.549143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09fac401-ab2f-47ca-ad56-b8bbdc85e5b0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:41.620126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:41.670709 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f363ac2d-2785-4dff-bf87-f6e7ca002cf1 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 1.073570 May 27 15:19:41.680783 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2456/4902] 10.222.0.13 () {58 vars in 1173 bytes} [Fri May 27 15:19:40 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 15:19:41.697022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3bb11cca-4686-4572-bb60-5edb57c446af tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:41.700938 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-09fac401-ab2f-47ca-ad56-b8bbdc85e5b0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:41.707948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3bb11cca-4686-4572-bb60-5edb57c446af tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:41.709707 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3bb11cca-4686-4572-bb60-5edb57c446af tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad'} {{(pid=119248) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:19:41.716463 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-09fac401-ab2f-47ca-ad56-b8bbdc85e5b0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 200 len: 1295 microversion: 2.1 time: 0.224932 May 27 15:19:41.719367 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2447/4903] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:41 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 1295 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:41.742229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3bb11cca-4686-4572-bb60-5edb57c446af tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:41.743397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3bb11cca-4686-4572-bb60-5edb57c446af tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:41.744457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3bb11cca-4686-4572-bb60-5edb57c446af tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:41.745535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3bb11cca-4686-4572-bb60-5edb57c446af tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:41.986689 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3bb11cca-4686-4572-bb60-5edb57c446af tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.298828 May 27 15:19:41.995725 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2457/4904] 10.222.0.13 () {58 vars in 1183 bytes} [Fri May 27 15:19:41 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:19:42.001002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f933630a-2be5-40ef-b6d5-0724e12889e5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:42.004565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f933630a-2be5-40ef-b6d5-0724e12889e5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:42.006149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f933630a-2be5-40ef-b6d5-0724e12889e5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Searching by: {'deleted': False, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad'} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:19:42.020426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f933630a-2be5-40ef-b6d5-0724e12889e5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.020916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f933630a-2be5-40ef-b6d5-0724e12889e5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.021902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f933630a-2be5-40ef-b6d5-0724e12889e5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.022347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f933630a-2be5-40ef-b6d5-0724e12889e5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.100009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.multi_cell_list [None req-f933630a-2be5-40ef-b6d5-0724e12889e5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119249) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:19:42.180041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f933630a-2be5-40ef-b6d5-0724e12889e5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:42.183067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:42.195510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f933630a-2be5-40ef-b6d5-0724e12889e5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.196180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f933630a-2be5-40ef-b6d5-0724e12889e5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.305377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8ab2c31f-e306-4857-abac-5183442b8fc9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:42.306379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8ab2c31f-e306-4857-abac-5183442b8fc9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:42.319573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ab2c31f-e306-4857-abac-5183442b8fc9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.320309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ab2c31f-e306-4857-abac-5183442b8fc9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.321381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ab2c31f-e306-4857-abac-5183442b8fc9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.323735 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ab2c31f-e306-4857-abac-5183442b8fc9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.372750 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-8ab2c31f-e306-4857-abac-5183442b8fc9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff could not be found. May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8ab2c31f-e306-4857-abac-5183442b8fc9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff HTTP/1.1 May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff could not be found. May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '2fc136c6-a73e-495c-b72d-e8f6ecbc26ff'} May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff could not be found. May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff could not be found. May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:42.374791 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:42.378879 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:42.378879 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:42.378879 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:19:42.378879 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:19:42.378879 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff could not be found. May 27 15:19:42.378879 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:19:42.378879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8ab2c31f-e306-4857-abac-5183442b8fc9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:42.382706 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8ab2c31f-e306-4857-abac-5183442b8fc9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 404 len: 111 microversion: 2.1 time: 0.081628 May 27 15:19:42.386498 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2458/4905] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:42 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:19:42.405255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4b8b693a-a46b-4e26-8a6d-aa8c8f33ecb3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '.version_select at 0x7fc775585040>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:42.455974 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4b8b693a-a46b-4e26-8a6d-aa8c8f33ecb3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-key-1944763729" status: 202 len: 0 microversion: 2.1 time: 0.068253 May 27 15:19:42.457653 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2459/4906] 10.222.0.13 () {58 vars in 1208 bytes} [Fri May 27 15:19:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1944763729 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:19:42.473784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-29066c5f-6bee-402f-9d02-63b0af6e4655 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b69a2877-bc02-4900-b2bc-3a01370a615f"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:42.475133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-29066c5f-6bee-402f-9d02-63b0af6e4655 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:42.493052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29066c5f-6bee-402f-9d02-63b0af6e4655 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.495549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29066c5f-6bee-402f-9d02-63b0af6e4655 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.497216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29066c5f-6bee-402f-9d02-63b0af6e4655 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.498245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29066c5f-6bee-402f-9d02-63b0af6e4655 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.523021 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f933630a-2be5-40ef-b6d5-0724e12889e5 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/detail" status: 200 len: 3020 microversion: 2.1 time: 0.527215 May 27 15:19:42.524047 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2448/4907] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 15:19:41 2022] GET /compute/v2.1/servers/detail => generated 3020 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:42.529505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-46b06e5d-8134-4109-9271-a701a510bb5a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:42.531076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-46b06e5d-8134-4109-9271-a701a510bb5a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:42.558679 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-46b06e5d-8134-4109-9271-a701a510bb5a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.561032 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-46b06e5d-8134-4109-9271-a701a510bb5a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.565697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-46b06e5d-8134-4109-9271-a701a510bb5a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.568031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-46b06e5d-8134-4109-9271-a701a510bb5a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.757287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-46b06e5d-8134-4109-9271-a701a510bb5a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:42.788738 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-46b06e5d-8134-4109-9271-a701a510bb5a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1234 microversion: 2.1 time: 0.263231 May 27 15:19:42.793281 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2449/4908] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:42 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1234 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:42.821259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dd36f919-8fbd-4132-a1b1-ab6a4355b49c tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:42.846697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dd36f919-8fbd-4132-a1b1-ab6a4355b49c tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:42.854154 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dd36f919-8fbd-4132-a1b1-ab6a4355b49c tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.054303 May 27 15:19:42.878286 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2450/4909] 10.222.0.13 () {58 vars in 1177 bytes} [Fri May 27 15:19:42 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:19:42.904411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-43014bf5-ec4a-46e2-a3ef-351d4ade6f0f tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:42.905251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-43014bf5-ec4a-46e2-a3ef-351d4ade6f0f tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:42.933179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43014bf5-ec4a-46e2-a3ef-351d4ade6f0f tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.933668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43014bf5-ec4a-46e2-a3ef-351d4ade6f0f tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.934543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43014bf5-ec4a-46e2-a3ef-351d4ade6f0f tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.934975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43014bf5-ec4a-46e2-a3ef-351d4ade6f0f tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:43.119797 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:43.184150 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-29066c5f-6bee-402f-9d02-63b0af6e4655 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "POST /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.724404 May 27 15:19:43.186488 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2460/4910] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 15:19:42 2022] POST /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 194 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:43.199840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f124d212-05cb-4898-a0cd-eaedf89b4127 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-463418635", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "679b759f-4940-4405-a687-165c11fb616b"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:43.402025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-f124d212-05cb-4898-a0cd-eaedf89b4127 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] validate_networks() for [('679b759f-4940-4405-a687-165c11fb616b', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:19:43.439068 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-43014bf5-ec4a-46e2-a3ef-351d4ade6f0f tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:43.459410 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-43014bf5-ec4a-46e2-a3ef-351d4ade6f0f tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 200 len: 1363 microversion: 2.1 time: 0.568001 May 27 15:19:43.462439 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2451/4911] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:42 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 1363 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:43.490945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-59af5cd6-fd88-4b8b-a6d6-8225dd40db94 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:43.496055 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-59af5cd6-fd88-4b8b-a6d6-8225dd40db94 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:43.509454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-59af5cd6-fd88-4b8b-a6d6-8225dd40db94 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Searching by: {'deleted': False, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad'} {{(pid=119249) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:19:43.523669 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-59af5cd6-fd88-4b8b-a6d6-8225dd40db94 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:43.524310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-59af5cd6-fd88-4b8b-a6d6-8225dd40db94 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:43.524966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-59af5cd6-fd88-4b8b-a6d6-8225dd40db94 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:43.525417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-59af5cd6-fd88-4b8b-a6d6-8225dd40db94 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:43.593079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.multi_cell_list [None req-59af5cd6-fd88-4b8b-a6d6-8225dd40db94 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119249) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:19:43.664693 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-59af5cd6-fd88-4b8b-a6d6-8225dd40db94 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 679 microversion: 2.1 time: 0.200911 May 27 15:19:43.670579 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2452/4912] 10.222.0.13 () {58 vars in 1124 bytes} [Fri May 27 15:19:43 2022] GET /compute/v2.1/servers => generated 679 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:43.681385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4255b007-31a3-4940-882f-4a8b86b816f8 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:43.682945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4255b007-31a3-4940-882f-4a8b86b816f8 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: d4f95c0e-01e4-40d3-98cb-d61147d8ca03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:43.702294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4255b007-31a3-4940-882f-4a8b86b816f8 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:43.702793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4255b007-31a3-4940-882f-4a8b86b816f8 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:43.703620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4255b007-31a3-4940-882f-4a8b86b816f8 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:43.704063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4255b007-31a3-4940-882f-4a8b86b816f8 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:43.744002 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-4255b007-31a3-4940-882f-4a8b86b816f8 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] HTTP exception thrown: Instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 could not be found. May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4255b007-31a3-4940-882f-4a8b86b816f8 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Request method failure captured: May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/d4f95c0e-01e4-40d3-98cb-d61147d8ca03 HTTP/1.1 May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOvieKw5CHK5Q8bvjKQk5MIl9jOe7hq8quA382rQaFUPA0-KqTvhcKhOHqch2a_BvA9rlrG4McYiMcF0nX_C38e9cJP0SHEiV-NX55OdOAeFGJaQ3fKnlllwasVjwMR9M3SyjkW2aqFBNKkkzcxFiPCm1CL9ZdVxOxccc5G_MN3IzgY May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 02c7dc0c99734781b18bf56d952bc9ad May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02c7dc0c99734781b18bf56d952bc9ad", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 02c7dc0c99734781b18bf56d952bc9ad May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ListServersNegativeTestJSON-696810623-project May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 44380d176a0d451d8b19e4dd90cc9478 May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ListServersNegativeTestJSON-696810623-project May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 could not be found. May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'd4f95c0e-01e4-40d3-98cb-d61147d8ca03'} May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 could not be found. May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:19:43.745919 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:19:43.749959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 could not be found. May 27 15:19:43.749959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:43.749959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:43.749959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:43.749959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:43.749959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:43.749959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:43.749959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:19:43.749959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:19:43.749959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 could not be found. May 27 15:19:43.749959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:43.752228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4255b007-31a3-4940-882f-4a8b86b816f8 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Returning 404 to user: Instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:43.753489 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4255b007-31a3-4940-882f-4a8b86b816f8 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d4f95c0e-01e4-40d3-98cb-d61147d8ca03" status: 404 len: 111 microversion: 2.1 time: 0.076213 May 27 15:19:43.754712 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2453/4913] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:19:43 2022] DELETE /compute/v2.1/servers/d4f95c0e-01e4-40d3-98cb-d61147d8ca03 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:19:43.766158 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-019ae70b-dd74-4e39-bdba-849c07ecdeec tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:43.767794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-019ae70b-dd74-4e39-bdba-849c07ecdeec tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 620dfc02-19dd-4f62-862c-8bee81ad6572] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:43.776215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-019ae70b-dd74-4e39-bdba-849c07ecdeec tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:43.777025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-019ae70b-dd74-4e39-bdba-849c07ecdeec tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:43.778946 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-019ae70b-dd74-4e39-bdba-849c07ecdeec tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:43.779774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-019ae70b-dd74-4e39-bdba-849c07ecdeec tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:43.836123 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-019ae70b-dd74-4e39-bdba-849c07ecdeec tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 620dfc02-19dd-4f62-862c-8bee81ad6572] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:19:44.009082 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-019ae70b-dd74-4e39-bdba-849c07ecdeec tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "DELETE /compute/v2.1/servers/620dfc02-19dd-4f62-862c-8bee81ad6572" status: 204 len: 0 microversion: 2.1 time: 0.248905 May 27 15:19:44.013847 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2454/4914] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:19:43 2022] DELETE /compute/v2.1/servers/620dfc02-19dd-4f62-862c-8bee81ad6572 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:19:44.021177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-14ee01cf-c278-408e-a821-ffce384f0bb6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:44.022186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-14ee01cf-c278-408e-a821-ffce384f0bb6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:44.030471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14ee01cf-c278-408e-a821-ffce384f0bb6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:44.031185 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14ee01cf-c278-408e-a821-ffce384f0bb6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.032132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14ee01cf-c278-408e-a821-ffce384f0bb6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:44.032778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14ee01cf-c278-408e-a821-ffce384f0bb6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.176233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-14ee01cf-c278-408e-a821-ffce384f0bb6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:44.187766 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-14ee01cf-c278-408e-a821-ffce384f0bb6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1296 microversion: 2.1 time: 0.172318 May 27 15:19:44.190255 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2455/4915] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:44 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1296 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:44.197528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e1a22b5a-2873-4c15-83e0-59525054e24e tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:44.203586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e1a22b5a-2873-4c15-83e0-59525054e24e tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:44.219595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1a22b5a-2873-4c15-83e0-59525054e24e tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:44.220066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1a22b5a-2873-4c15-83e0-59525054e24e tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.220915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1a22b5a-2873-4c15-83e0-59525054e24e tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:44.226273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1a22b5a-2873-4c15-83e0-59525054e24e tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.245976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f124d212-05cb-4898-a0cd-eaedf89b4127 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:19:44.247571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f124d212-05cb-4898-a0cd-eaedf89b4127 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:19:44.248562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f124d212-05cb-4898-a0cd-eaedf89b4127 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:19:44.249312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f124d212-05cb-4898-a0cd-eaedf89b4127 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:19:44.250129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f124d212-05cb-4898-a0cd-eaedf89b4127 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:19:44.267411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f124d212-05cb-4898-a0cd-eaedf89b4127 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:44.267784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f124d212-05cb-4898-a0cd-eaedf89b4127 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.268891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f124d212-05cb-4898-a0cd-eaedf89b4127 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:44.269527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f124d212-05cb-4898-a0cd-eaedf89b4127 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.283642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e1a22b5a-2873-4c15-83e0-59525054e24e tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:19:44.292964 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-f124d212-05cb-4898-a0cd-eaedf89b4127 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Getting quotas for project db397cde9e67464182a7ba045f1779be. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:19:44.303392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-f124d212-05cb-4898-a0cd-eaedf89b4127 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Getting quotas for user 2f0525081cf441998d2c320fa0087cff and project db397cde9e67464182a7ba045f1779be. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:19:44.335667 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f124d212-05cb-4898-a0cd-eaedf89b4127 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:19:44.339987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f124d212-05cb-4898-a0cd-eaedf89b4127 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:19:44.477771 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f124d212-05cb-4898-a0cd-eaedf89b4127 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.288318 May 27 15:19:44.479336 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2461/4916] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:19:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:19:44.485671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-325811e2-ea0f-40d1-b7b4-4a134a4149ac tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:44.511429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-325811e2-ea0f-40d1-b7b4-4a134a4149ac tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:44.518301 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e1a22b5a-2873-4c15-83e0-59525054e24e tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 204 len: 0 microversion: 2.1 time: 0.324348 May 27 15:19:44.519271 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2456/4917] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:19:44 2022] DELETE /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:19:44.527301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:44.537230 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1b998113-c388-49f5-87f4-4f91e897afbd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:44.538048 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1b998113-c388-49f5-87f4-4f91e897afbd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:44.575668 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-325811e2-ea0f-40d1-b7b4-4a134a4149ac tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:44.580028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-325811e2-ea0f-40d1-b7b4-4a134a4149ac tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.586959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-325811e2-ea0f-40d1-b7b4-4a134a4149ac tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:44.589039 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-325811e2-ea0f-40d1-b7b4-4a134a4149ac tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.710145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1b998113-c388-49f5-87f4-4f91e897afbd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:44.732299 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1b998113-c388-49f5-87f4-4f91e897afbd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 200 len: 1208 microversion: 2.1 time: 0.206485 May 27 15:19:44.744019 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2457/4918] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:44 2022] GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 1208 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:44.759196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a81d934b-a853-4f44-97de-3c11852d664b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:44.765368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a81d934b-a853-4f44-97de-3c11852d664b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: d4f95c0e-01e4-40d3-98cb-d61147d8ca03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:44.777481 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a81d934b-a853-4f44-97de-3c11852d664b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:44.780202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a81d934b-a853-4f44-97de-3c11852d664b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.783194 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a81d934b-a853-4f44-97de-3c11852d664b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:44.784242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a81d934b-a853-4f44-97de-3c11852d664b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.828612 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-a81d934b-a853-4f44-97de-3c11852d664b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] HTTP exception thrown: Instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 could not be found. May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a81d934b-a853-4f44-97de-3c11852d664b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Request method failure captured: May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/d4f95c0e-01e4-40d3-98cb-d61147d8ca03 HTTP/1.1 May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOvieKw5CHK5Q8bvjKQk5MIl9jOe7hq8quA382rQaFUPA0-KqTvhcKhOHqch2a_BvA9rlrG4McYiMcF0nX_C38e9cJP0SHEiV-NX55OdOAeFGJaQ3fKnlllwasVjwMR9M3SyjkW2aqFBNKkkzcxFiPCm1CL9ZdVxOxccc5G_MN3IzgY May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 02c7dc0c99734781b18bf56d952bc9ad May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02c7dc0c99734781b18bf56d952bc9ad", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 02c7dc0c99734781b18bf56d952bc9ad May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ListServersNegativeTestJSON-696810623-project May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 44380d176a0d451d8b19e4dd90cc9478 May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ListServersNegativeTestJSON-696810623-project May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 could not be found. May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'd4f95c0e-01e4-40d3-98cb-d61147d8ca03'} May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 could not be found. May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 could not be found. May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:44.830489 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:44.834718 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:44.834718 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:44.834718 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:44.834718 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:19:44.834718 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:19:44.834718 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 could not be found. May 27 15:19:44.834718 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:44.834718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a81d934b-a853-4f44-97de-3c11852d664b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Returning 404 to user: Instance d4f95c0e-01e4-40d3-98cb-d61147d8ca03 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:44.834718 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a81d934b-a853-4f44-97de-3c11852d664b tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/d4f95c0e-01e4-40d3-98cb-d61147d8ca03" status: 404 len: 111 microversion: 2.1 time: 0.082855 May 27 15:19:44.834718 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2458/4919] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:44 2022] GET /compute/v2.1/servers/d4f95c0e-01e4-40d3-98cb-d61147d8ca03 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:19:44.869077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d7b6ef2a-3325-4123-80c9-56c416abdddf tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:44.872719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d7b6ef2a-3325-4123-80c9-56c416abdddf tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 620dfc02-19dd-4f62-862c-8bee81ad6572] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:44.891601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d7b6ef2a-3325-4123-80c9-56c416abdddf tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:44.892416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d7b6ef2a-3325-4123-80c9-56c416abdddf tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.893161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d7b6ef2a-3325-4123-80c9-56c416abdddf tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:44.893610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d7b6ef2a-3325-4123-80c9-56c416abdddf tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:45.124157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-325811e2-ea0f-40d1-b7b4-4a134a4149ac tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:45.138526 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-325811e2-ea0f-40d1-b7b4-4a134a4149ac tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 200 len: 1363 microversion: 2.1 time: 0.657787 May 27 15:19:45.142010 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2462/4920] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:44 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 1363 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:45.179830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d7b6ef2a-3325-4123-80c9-56c416abdddf tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:45.190172 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d7b6ef2a-3325-4123-80c9-56c416abdddf tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/620dfc02-19dd-4f62-862c-8bee81ad6572" status: 200 len: 1519 microversion: 2.1 time: 0.341557 May 27 15:19:45.206334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1e3211e1-ef61-4137-9882-9b4fdd818b39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:45.206813 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2459/4921] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:44 2022] GET /compute/v2.1/servers/620dfc02-19dd-4f62-862c-8bee81ad6572 => generated 1519 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:45.207337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1e3211e1-ef61-4137-9882-9b4fdd818b39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:45.218797 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e3211e1-ef61-4137-9882-9b4fdd818b39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:45.224592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e3211e1-ef61-4137-9882-9b4fdd818b39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:45.226353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e3211e1-ef61-4137-9882-9b4fdd818b39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:45.229911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e3211e1-ef61-4137-9882-9b4fdd818b39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:45.375967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1e3211e1-ef61-4137-9882-9b4fdd818b39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:45.391496 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1e3211e1-ef61-4137-9882-9b4fdd818b39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1296 microversion: 2.1 time: 0.187944 May 27 15:19:45.396050 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2463/4922] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:45 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1296 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:45.753989 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-62391d23-ab05-4691-ab72-7d8c68917202 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:45.755658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-62391d23-ab05-4691-ab72-7d8c68917202 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:45.783415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-62391d23-ab05-4691-ab72-7d8c68917202 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:45.785639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-62391d23-ab05-4691-ab72-7d8c68917202 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:45.788015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-62391d23-ab05-4691-ab72-7d8c68917202 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:45.790499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-62391d23-ab05-4691-ab72-7d8c68917202 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:46.075275 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-62391d23-ab05-4691-ab72-7d8c68917202 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:46.088968 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-62391d23-ab05-4691-ab72-7d8c68917202 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 200 len: 1204 microversion: 2.1 time: 0.341642 May 27 15:19:46.090211 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2460/4923] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:45 2022] GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 1204 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:46.166509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9a2b6575-7905-4a9e-8479-430938b03be4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:46.167138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9a2b6575-7905-4a9e-8479-430938b03be4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:46.206578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a2b6575-7905-4a9e-8479-430938b03be4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:46.207228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a2b6575-7905-4a9e-8479-430938b03be4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:46.209954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a2b6575-7905-4a9e-8479-430938b03be4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:46.210213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5c13aa47-5ece-4494-9619-89400f8aa435 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:46.211218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5c13aa47-5ece-4494-9619-89400f8aa435 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 620dfc02-19dd-4f62-862c-8bee81ad6572] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:46.216987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a2b6575-7905-4a9e-8479-430938b03be4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:46.222907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c13aa47-5ece-4494-9619-89400f8aa435 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:46.228313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c13aa47-5ece-4494-9619-89400f8aa435 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:46.229563 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c13aa47-5ece-4494-9619-89400f8aa435 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:46.230402 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c13aa47-5ece-4494-9619-89400f8aa435 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:46.568244 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5c13aa47-5ece-4494-9619-89400f8aa435 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:46.578354 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5c13aa47-5ece-4494-9619-89400f8aa435 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/620dfc02-19dd-4f62-862c-8bee81ad6572" status: 200 len: 1477 microversion: 2.1 time: 0.374676 May 27 15:19:46.585545 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2461/4924] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:46 2022] GET /compute/v2.1/servers/620dfc02-19dd-4f62-862c-8bee81ad6572 => generated 1477 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:46.596028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c3b01ec3-7449-48e2-a159-1400ecf2001a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:46.603298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c3b01ec3-7449-48e2-a159-1400ecf2001a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:46.615381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3b01ec3-7449-48e2-a159-1400ecf2001a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:46.620449 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3b01ec3-7449-48e2-a159-1400ecf2001a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:46.621506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3b01ec3-7449-48e2-a159-1400ecf2001a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:46.625425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3b01ec3-7449-48e2-a159-1400ecf2001a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:46.821537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c3b01ec3-7449-48e2-a159-1400ecf2001a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:46.826095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:46.848938 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c3b01ec3-7449-48e2-a159-1400ecf2001a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1296 microversion: 2.1 time: 0.261228 May 27 15:19:46.860962 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2462/4925] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:46 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1296 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:46.878232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-9641d389-9e0a-4e44-b24c-4170a3145a9d req-306ec3a9-c0e8-4938-9627-7550c2347a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "620dfc02-19dd-4f62-862c-8bee81ad6572", "name": "network-vif-deleted", "tag": "4e71fbd8-95cd-4758-ba40-75304b82648f"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:46.928004 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-9641d389-9e0a-4e44-b24c-4170a3145a9d req-306ec3a9-c0e8-4938-9627-7550c2347a76 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:46.933175 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-9641d389-9e0a-4e44-b24c-4170a3145a9d req-306ec3a9-c0e8-4938-9627-7550c2347a76 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:46.988245 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-9641d389-9e0a-4e44-b24c-4170a3145a9d req-306ec3a9-c0e8-4938-9627-7550c2347a76 service nova] Creating event network-vif-deleted:4e71fbd8-95cd-4758-ba40-75304b82648f for instance 620dfc02-19dd-4f62-862c-8bee81ad6572 on n-h2-843621-1 May 27 15:19:46.997260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9a2b6575-7905-4a9e-8479-430938b03be4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:47.005799 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9a2b6575-7905-4a9e-8479-430938b03be4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 200 len: 1363 microversion: 2.1 time: 0.850972 May 27 15:19:47.025811 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2464/4926] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:46 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 1363 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:47.026399 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-9641d389-9e0a-4e44-b24c-4170a3145a9d req-306ec3a9-c0e8-4938-9627-7550c2347a76 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160724 May 27 15:19:47.035196 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2463/4927] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:47.108573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-275235ca-1d3a-435a-b0c3-06ada95e9d80 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:47.109237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-275235ca-1d3a-435a-b0c3-06ada95e9d80 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:47.134743 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-275235ca-1d3a-435a-b0c3-06ada95e9d80 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:47.135229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-275235ca-1d3a-435a-b0c3-06ada95e9d80 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:47.136159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-275235ca-1d3a-435a-b0c3-06ada95e9d80 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:47.136613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-275235ca-1d3a-435a-b0c3-06ada95e9d80 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:47.253806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-275235ca-1d3a-435a-b0c3-06ada95e9d80 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:47.265163 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-275235ca-1d3a-435a-b0c3-06ada95e9d80 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 200 len: 1266 microversion: 2.1 time: 0.161950 May 27 15:19:47.266632 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2465/4928] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:47 2022] GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:47.603341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cf146415-650d-44be-bf05-649ea48f87f0 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:47.604162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cf146415-650d-44be-bf05-649ea48f87f0 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 620dfc02-19dd-4f62-862c-8bee81ad6572] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:47.615965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cf146415-650d-44be-bf05-649ea48f87f0 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:47.616826 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cf146415-650d-44be-bf05-649ea48f87f0 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:47.617831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cf146415-650d-44be-bf05-649ea48f87f0 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:47.621236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cf146415-650d-44be-bf05-649ea48f87f0 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:47.658896 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-cf146415-650d-44be-bf05-649ea48f87f0 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] HTTP exception thrown: Instance 620dfc02-19dd-4f62-862c-8bee81ad6572 could not be found. May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cf146415-650d-44be-bf05-649ea48f87f0 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Request method failure captured: May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/620dfc02-19dd-4f62-862c-8bee81ad6572 HTTP/1.1 May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOvieKw5CHK5Q8bvjKQk5MIl9jOe7hq8quA382rQaFUPA0-KqTvhcKhOHqch2a_BvA9rlrG4McYiMcF0nX_C38e9cJP0SHEiV-NX55OdOAeFGJaQ3fKnlllwasVjwMR9M3SyjkW2aqFBNKkkzcxFiPCm1CL9ZdVxOxccc5G_MN3IzgY May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 02c7dc0c99734781b18bf56d952bc9ad May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02c7dc0c99734781b18bf56d952bc9ad", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 02c7dc0c99734781b18bf56d952bc9ad May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ListServersNegativeTestJSON-696810623-project May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 44380d176a0d451d8b19e4dd90cc9478 May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ListServersNegativeTestJSON-696810623-project May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 620dfc02-19dd-4f62-862c-8bee81ad6572 could not be found. May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '620dfc02-19dd-4f62-862c-8bee81ad6572'} May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 620dfc02-19dd-4f62-862c-8bee81ad6572 could not be found. May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 620dfc02-19dd-4f62-862c-8bee81ad6572 could not be found. May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:47.661013 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:47.664818 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:47.664818 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:47.664818 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:47.664818 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:19:47.664818 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:19:47.664818 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 620dfc02-19dd-4f62-862c-8bee81ad6572 could not be found. May 27 15:19:47.664818 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:47.668318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cf146415-650d-44be-bf05-649ea48f87f0 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Returning 404 to user: Instance 620dfc02-19dd-4f62-862c-8bee81ad6572 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:47.671654 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cf146415-650d-44be-bf05-649ea48f87f0 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/620dfc02-19dd-4f62-862c-8bee81ad6572" status: 404 len: 111 microversion: 2.1 time: 0.072556 May 27 15:19:47.672481 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2464/4929] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:47 2022] GET /compute/v2.1/servers/620dfc02-19dd-4f62-862c-8bee81ad6572 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:19:47.680463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d73e8828-e50d-4efd-bb97-a4fe5f3771a4 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:47.681451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d73e8828-e50d-4efd-bb97-a4fe5f3771a4 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:47.700956 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d73e8828-e50d-4efd-bb97-a4fe5f3771a4 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:47.701777 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d73e8828-e50d-4efd-bb97-a4fe5f3771a4 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:47.702804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d73e8828-e50d-4efd-bb97-a4fe5f3771a4 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:47.703470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d73e8828-e50d-4efd-bb97-a4fe5f3771a4 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:47.868433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e926705f-fa06-4935-bb55-2c988652223d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:47.869732 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e926705f-fa06-4935-bb55-2c988652223d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:47.882506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e926705f-fa06-4935-bb55-2c988652223d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:47.889281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e926705f-fa06-4935-bb55-2c988652223d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:47.896893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e926705f-fa06-4935-bb55-2c988652223d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:47.897684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e926705f-fa06-4935-bb55-2c988652223d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:47.981783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d73e8828-e50d-4efd-bb97-a4fe5f3771a4 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:47.989863 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d73e8828-e50d-4efd-bb97-a4fe5f3771a4 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1520 microversion: 2.1 time: 0.313165 May 27 15:19:48.000174 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2466/4930] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:47 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1520 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:48.014697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e926705f-fa06-4935-bb55-2c988652223d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:48.024621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9c625ee8-8d5f-415c-916b-65624c5f3274 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:48.027538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9c625ee8-8d5f-415c-916b-65624c5f3274 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:48.037075 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e926705f-fa06-4935-bb55-2c988652223d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1296 microversion: 2.1 time: 0.166642 May 27 15:19:48.038155 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2465/4931] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:47 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1296 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:48.051076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c625ee8-8d5f-415c-916b-65624c5f3274 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.051725 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c625ee8-8d5f-415c-916b-65624c5f3274 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.052804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c625ee8-8d5f-415c-916b-65624c5f3274 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.053470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c625ee8-8d5f-415c-916b-65624c5f3274 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.284338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dd0931e0-6a5c-4f2d-b9b5-5b24aa3357b7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:48.285477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dd0931e0-6a5c-4f2d-b9b5-5b24aa3357b7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:48.297051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd0931e0-6a5c-4f2d-b9b5-5b24aa3357b7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.298166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd0931e0-6a5c-4f2d-b9b5-5b24aa3357b7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.300730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd0931e0-6a5c-4f2d-b9b5-5b24aa3357b7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.302318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd0931e0-6a5c-4f2d-b9b5-5b24aa3357b7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.353586 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9c625ee8-8d5f-415c-916b-65624c5f3274 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:48.365053 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9c625ee8-8d5f-415c-916b-65624c5f3274 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 200 len: 1363 microversion: 2.1 time: 0.342954 May 27 15:19:48.368558 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2467/4932] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:48 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:48.473094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dd0931e0-6a5c-4f2d-b9b5-5b24aa3357b7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:48.494777 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dd0931e0-6a5c-4f2d-b9b5-5b24aa3357b7 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 200 len: 1266 microversion: 2.1 time: 0.208748 May 27 15:19:48.496467 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2466/4933] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:48 2022] GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:48.884251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-27228e46-5bd5-43f3-8973-7e7ab26131e5 req-3c37f8d4-eb8e-4cb0-a80d-c945b7ea1a54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cc72e17-205e-4e7f-aefe-17a244443295", "tag": "f9ce40a9-a844-4d2e-af96-330750459ac3"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:48.905408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-27228e46-5bd5-43f3-8973-7e7ab26131e5 req-3c37f8d4-eb8e-4cb0-a80d-c945b7ea1a54 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.906368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-27228e46-5bd5-43f3-8973-7e7ab26131e5 req-3c37f8d4-eb8e-4cb0-a80d-c945b7ea1a54 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.936398 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-27228e46-5bd5-43f3-8973-7e7ab26131e5 req-3c37f8d4-eb8e-4cb0-a80d-c945b7ea1a54 service nova] Creating event network-changed:f9ce40a9-a844-4d2e-af96-330750459ac3 for instance 9cc72e17-205e-4e7f-aefe-17a244443295 on n-h2-843621-1 May 27 15:19:48.969440 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-27228e46-5bd5-43f3-8973-7e7ab26131e5 req-3c37f8d4-eb8e-4cb0-a80d-c945b7ea1a54 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090193 May 27 15:19:48.970869 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2468/4934] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:49.008985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4573ba21-dd60-4788-aac5-d5c6e17932e6 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:49.010225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4573ba21-dd60-4788-aac5-d5c6e17932e6 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:49.022560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4573ba21-dd60-4788-aac5-d5c6e17932e6 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:49.029404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4573ba21-dd60-4788-aac5-d5c6e17932e6 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:49.030569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4573ba21-dd60-4788-aac5-d5c6e17932e6 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:49.035813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4573ba21-dd60-4788-aac5-d5c6e17932e6 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:49.055043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7a1ba33b-5117-4fba-be66-b826b94852aa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:49.056654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7a1ba33b-5117-4fba-be66-b826b94852aa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:49.096398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a1ba33b-5117-4fba-be66-b826b94852aa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:49.097541 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a1ba33b-5117-4fba-be66-b826b94852aa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:49.101931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a1ba33b-5117-4fba-be66-b826b94852aa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:49.138017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a1ba33b-5117-4fba-be66-b826b94852aa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:49.293031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4573ba21-dd60-4788-aac5-d5c6e17932e6 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44380d176a0d451d8b19e4dd90cc9478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02c7dc0c99734781b18bf56d952bc9ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:49.311369 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4573ba21-dd60-4788-aac5-d5c6e17932e6 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 200 len: 1478 microversion: 2.1 time: 0.307716 May 27 15:19:49.312176 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2467/4935] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:49 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 1478 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:49.370355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7a1ba33b-5117-4fba-be66-b826b94852aa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:49.382509 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7a1ba33b-5117-4fba-be66-b826b94852aa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1296 microversion: 2.1 time: 0.331792 May 27 15:19:49.384349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-23e46af4-53b2-4552-936f-b414a3eb4cc9 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:49.385175 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-23e46af4-53b2-4552-936f-b414a3eb4cc9 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:49.387293 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2469/4936] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:49 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1296 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:49.396475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-23e46af4-53b2-4552-936f-b414a3eb4cc9 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:49.397558 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-23e46af4-53b2-4552-936f-b414a3eb4cc9 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:49.398855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-23e46af4-53b2-4552-936f-b414a3eb4cc9 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:49.399453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-23e46af4-53b2-4552-936f-b414a3eb4cc9 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:49.514548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b6107483-d5c7-4828-aa95-417e83726a17 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:49.515188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b6107483-d5c7-4828-aa95-417e83726a17 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:49.526699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b6107483-d5c7-4828-aa95-417e83726a17 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:49.527356 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b6107483-d5c7-4828-aa95-417e83726a17 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:49.528759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b6107483-d5c7-4828-aa95-417e83726a17 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:49.529233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b6107483-d5c7-4828-aa95-417e83726a17 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:49.775211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-23e46af4-53b2-4552-936f-b414a3eb4cc9 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:49.786186 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-23e46af4-53b2-4552-936f-b414a3eb4cc9 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 200 len: 1363 microversion: 2.1 time: 0.404931 May 27 15:19:49.787258 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2468/4937] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:49 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 1363 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:49.841554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b6107483-d5c7-4828-aa95-417e83726a17 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:49.873400 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b6107483-d5c7-4828-aa95-417e83726a17 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 200 len: 1308 microversion: 2.1 time: 0.347620 May 27 15:19:49.874457 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2470/4938] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:49 2022] GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 1308 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:50.330796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6980682d-633d-4920-b091-03b3f26f3c00 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:50.331598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6980682d-633d-4920-b091-03b3f26f3c00 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] [instance: 8d7f9467-fde2-48d2-a2e6-26678afb0734] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:50.362183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6980682d-633d-4920-b091-03b3f26f3c00 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:50.363512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6980682d-633d-4920-b091-03b3f26f3c00 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:50.369368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6980682d-633d-4920-b091-03b3f26f3c00 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:50.374087 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6980682d-633d-4920-b091-03b3f26f3c00 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:50.399104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4fe940c5-16d2-42ec-854f-191034f7c380 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:50.399752 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4fe940c5-16d2-42ec-854f-191034f7c380 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:50.401351 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-6980682d-633d-4920-b091-03b3f26f3c00 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] HTTP exception thrown: Instance 8d7f9467-fde2-48d2-a2e6-26678afb0734 could not be found. May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6980682d-633d-4920-b091-03b3f26f3c00 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Request method failure captured: May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 HTTP/1.1 May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOvieKw5CHK5Q8bvjKQk5MIl9jOe7hq8quA382rQaFUPA0-KqTvhcKhOHqch2a_BvA9rlrG4McYiMcF0nX_C38e9cJP0SHEiV-NX55OdOAeFGJaQ3fKnlllwasVjwMR9M3SyjkW2aqFBNKkkzcxFiPCm1CL9ZdVxOxccc5G_MN3IzgY May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 02c7dc0c99734781b18bf56d952bc9ad May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02c7dc0c99734781b18bf56d952bc9ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02c7dc0c99734781b18bf56d952bc9ad", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 02c7dc0c99734781b18bf56d952bc9ad May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-696810623 May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ListServersNegativeTestJSON-696810623-project May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 44380d176a0d451d8b19e4dd90cc9478 May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ListServersNegativeTestJSON-696810623-project May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 8d7f9467-fde2-48d2-a2e6-26678afb0734 could not be found. May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '8d7f9467-fde2-48d2-a2e6-26678afb0734'} May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d7f9467-fde2-48d2-a2e6-26678afb0734 could not be found. May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d7f9467-fde2-48d2-a2e6-26678afb0734 could not be found. May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:50.404591 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:50.408779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:50.408779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:50.408779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:50.408779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:19:50.408779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:19:50.408779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d7f9467-fde2-48d2-a2e6-26678afb0734 could not be found. May 27 15:19:50.408779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:19:50.411441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6980682d-633d-4920-b091-03b3f26f3c00 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] Returning 404 to user: Instance 8d7f9467-fde2-48d2-a2e6-26678afb0734 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:50.414432 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6980682d-633d-4920-b091-03b3f26f3c00 tempest-ListServersNegativeTestJSON-696810623 tempest-ListServersNegativeTestJSON-696810623-project] 10.222.0.13 "GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734" status: 404 len: 111 microversion: 2.1 time: 0.090621 May 27 15:19:50.415528 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2469/4939] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:50 2022] GET /compute/v2.1/servers/8d7f9467-fde2-48d2-a2e6-26678afb0734 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:19:50.421570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4fe940c5-16d2-42ec-854f-191034f7c380 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:50.422027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4fe940c5-16d2-42ec-854f-191034f7c380 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:50.423105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4fe940c5-16d2-42ec-854f-191034f7c380 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:50.423712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4fe940c5-16d2-42ec-854f-191034f7c380 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:50.774378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4fe940c5-16d2-42ec-854f-191034f7c380 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:50.787465 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4fe940c5-16d2-42ec-854f-191034f7c380 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1363 microversion: 2.1 time: 0.392048 May 27 15:19:50.789103 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2471/4940] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:50 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1363 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:50.806391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ae11e17b-26b4-4112-9781-f5159dd5ea1b tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:50.807239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ae11e17b-26b4-4112-9781-f5159dd5ea1b tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:50.817147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae11e17b-26b4-4112-9781-f5159dd5ea1b tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:50.820445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae11e17b-26b4-4112-9781-f5159dd5ea1b tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:50.821469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae11e17b-26b4-4112-9781-f5159dd5ea1b tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:50.823168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae11e17b-26b4-4112-9781-f5159dd5ea1b tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:50.895633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-22297e46-5b42-41bc-aef5-177fe5eb2ad8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:50.900540 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-22297e46-5b42-41bc-aef5-177fe5eb2ad8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:50.914847 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22297e46-5b42-41bc-aef5-177fe5eb2ad8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:50.920918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22297e46-5b42-41bc-aef5-177fe5eb2ad8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:50.922869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22297e46-5b42-41bc-aef5-177fe5eb2ad8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:50.924138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22297e46-5b42-41bc-aef5-177fe5eb2ad8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:51.195796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ae11e17b-26b4-4112-9781-f5159dd5ea1b tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:51.206590 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ae11e17b-26b4-4112-9781-f5159dd5ea1b tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 200 len: 1363 microversion: 2.1 time: 0.406858 May 27 15:19:51.208118 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2470/4941] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:50 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 1363 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:51.215109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-1bf27910-7334-4827-89c6-c8cea4e61f6d req-815ef3a5-5d11-4dc3-80b1-ea670af1a13f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d7f9467-fde2-48d2-a2e6-26678afb0734", "name": "network-vif-deleted", "tag": "c3beae81-08af-4000-9027-6f7f0f270d3d"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:51.246426 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-22297e46-5b42-41bc-aef5-177fe5eb2ad8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:51.255834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-1bf27910-7334-4827-89c6-c8cea4e61f6d req-815ef3a5-5d11-4dc3-80b1-ea670af1a13f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:51.258712 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-22297e46-5b42-41bc-aef5-177fe5eb2ad8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 200 len: 1308 microversion: 2.1 time: 0.371716 May 27 15:19:51.259450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-1bf27910-7334-4827-89c6-c8cea4e61f6d req-815ef3a5-5d11-4dc3-80b1-ea670af1a13f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:51.260564 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2472/4942] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:50 2022] GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 1308 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:51.288522 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-1bf27910-7334-4827-89c6-c8cea4e61f6d req-815ef3a5-5d11-4dc3-80b1-ea670af1a13f service nova] Creating event network-vif-deleted:c3beae81-08af-4000-9027-6f7f0f270d3d for instance 8d7f9467-fde2-48d2-a2e6-26678afb0734 on n-h1-843621-1 May 27 15:19:51.301133 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-1bf27910-7334-4827-89c6-c8cea4e61f6d req-815ef3a5-5d11-4dc3-80b1-ea670af1a13f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089606 May 27 15:19:51.301863 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2471/4943] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:51.805402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-468a07ec-38a5-4016-93fc-1228ef7aa3ad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:51.806377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-468a07ec-38a5-4016-93fc-1228ef7aa3ad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:51.818940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-468a07ec-38a5-4016-93fc-1228ef7aa3ad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:51.821848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-468a07ec-38a5-4016-93fc-1228ef7aa3ad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:51.822989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-468a07ec-38a5-4016-93fc-1228ef7aa3ad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:51.825718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-468a07ec-38a5-4016-93fc-1228ef7aa3ad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:52.077911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-468a07ec-38a5-4016-93fc-1228ef7aa3ad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:52.086672 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-468a07ec-38a5-4016-93fc-1228ef7aa3ad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1363 microversion: 2.1 time: 0.285852 May 27 15:19:52.087688 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2473/4944] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:51 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:52.232161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-875567ea-115a-494d-b529-b2278238d55e tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:52.233147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-875567ea-115a-494d-b529-b2278238d55e tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:52.250116 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-875567ea-115a-494d-b529-b2278238d55e tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:52.252222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-875567ea-115a-494d-b529-b2278238d55e tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:52.253336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-875567ea-115a-494d-b529-b2278238d55e tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:52.254221 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-875567ea-115a-494d-b529-b2278238d55e tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:52.278671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-83ffadc4-db8a-425b-a496-081150d0131e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:52.279296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-83ffadc4-db8a-425b-a496-081150d0131e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:52.290034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-83ffadc4-db8a-425b-a496-081150d0131e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:52.293988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-83ffadc4-db8a-425b-a496-081150d0131e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:52.294871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-83ffadc4-db8a-425b-a496-081150d0131e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:52.295352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-83ffadc4-db8a-425b-a496-081150d0131e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:52.662539 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-875567ea-115a-494d-b529-b2278238d55e tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:52.673698 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-875567ea-115a-494d-b529-b2278238d55e tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 200 len: 1363 microversion: 2.1 time: 0.449667 May 27 15:19:52.687193 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2472/4945] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:52 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 1363 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:52.703475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-83ffadc4-db8a-425b-a496-081150d0131e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:52.711903 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-83ffadc4-db8a-425b-a496-081150d0131e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 200 len: 1308 microversion: 2.1 time: 0.437297 May 27 15:19:52.717099 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2474/4946] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:52 2022] GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 1308 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:53.105898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-63400285-3340-4cba-9052-dacd4b5b84c2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:53.107609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-63400285-3340-4cba-9052-dacd4b5b84c2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:53.136365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63400285-3340-4cba-9052-dacd4b5b84c2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.136365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63400285-3340-4cba-9052-dacd4b5b84c2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:53.136516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63400285-3340-4cba-9052-dacd4b5b84c2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.136873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-63400285-3340-4cba-9052-dacd4b5b84c2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:53.342707 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-8843c9b3-6bcd-4cc1-9ba1-1f0d699e3e11 req-ba4d79af-d082-48d4-9a50-788f9e5bb9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36a5db54-c75b-4a95-9b2f-3f4ac68d345e", "tag": "b369df5e-fca2-45e6-b32d-d97fbc0d5fad"}, {"name": "network-changed", "server_uuid": "812d42c0-07f1-4f7c-83b8-848b18cf0186", "tag": "0d9da5e7-a50c-4ddd-aca9-02eae7d0476c"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:53.373048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-8843c9b3-6bcd-4cc1-9ba1-1f0d699e3e11 req-ba4d79af-d082-48d4-9a50-788f9e5bb9e7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.375346 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-8843c9b3-6bcd-4cc1-9ba1-1f0d699e3e11 req-ba4d79af-d082-48d4-9a50-788f9e5bb9e7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:53.412346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-63400285-3340-4cba-9052-dacd4b5b84c2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:53.421806 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-63400285-3340-4cba-9052-dacd4b5b84c2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1363 microversion: 2.1 time: 0.321027 May 27 15:19:53.423116 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2473/4947] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:53 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:53.446259 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-8843c9b3-6bcd-4cc1-9ba1-1f0d699e3e11 req-ba4d79af-d082-48d4-9a50-788f9e5bb9e7 service nova] Creating event network-changed:b369df5e-fca2-45e6-b32d-d97fbc0d5fad for instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e on n-h2-843621-1 May 27 15:19:53.447012 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-8843c9b3-6bcd-4cc1-9ba1-1f0d699e3e11 req-ba4d79af-d082-48d4-9a50-788f9e5bb9e7 service nova] Creating event network-changed:0d9da5e7-a50c-4ddd-aca9-02eae7d0476c for instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 on n-h1-843621-1 May 27 15:19:53.459104 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-8843c9b3-6bcd-4cc1-9ba1-1f0d699e3e11 req-ba4d79af-d082-48d4-9a50-788f9e5bb9e7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.120573 May 27 15:19:53.464440 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2475/4948] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:53.694440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-02699eee-98a8-46ab-956a-17f6b727880d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:53.695335 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-02699eee-98a8-46ab-956a-17f6b727880d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:53.698087 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=8 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:53.707412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-02699eee-98a8-46ab-956a-17f6b727880d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.708273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-02699eee-98a8-46ab-956a-17f6b727880d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:53.709109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-02699eee-98a8-46ab-956a-17f6b727880d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.711583 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-02699eee-98a8-46ab-956a-17f6b727880d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:53.736472 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dcdda561-2b84-44e2-8e5d-bb25ecfd01e3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:53.738068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dcdda561-2b84-44e2-8e5d-bb25ecfd01e3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:53.774572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dcdda561-2b84-44e2-8e5d-bb25ecfd01e3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.777182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dcdda561-2b84-44e2-8e5d-bb25ecfd01e3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:53.785848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dcdda561-2b84-44e2-8e5d-bb25ecfd01e3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.790347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dcdda561-2b84-44e2-8e5d-bb25ecfd01e3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:54.282086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=12 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:54.319528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=14 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:54.357371 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-02699eee-98a8-46ab-956a-17f6b727880d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:54.375498 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-02699eee-98a8-46ab-956a-17f6b727880d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 200 len: 1363 microversion: 2.1 time: 0.685261 May 27 15:19:54.387870 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2474/4949] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:53 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 1363 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:54.448883 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b96d254c-9eaa-4c90-be04-1967215b3b1b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:54.450337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b96d254c-9eaa-4c90-be04-1967215b3b1b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:54.466733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b96d254c-9eaa-4c90-be04-1967215b3b1b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:54.467741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b96d254c-9eaa-4c90-be04-1967215b3b1b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:54.471556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b96d254c-9eaa-4c90-be04-1967215b3b1b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:54.472242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b96d254c-9eaa-4c90-be04-1967215b3b1b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:54.532867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dcdda561-2b84-44e2-8e5d-bb25ecfd01e3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:54.560012 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dcdda561-2b84-44e2-8e5d-bb25ecfd01e3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 200 len: 1308 microversion: 2.1 time: 0.813686 May 27 15:19:54.561101 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2476/4950] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:53 2022] GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 1308 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:54.692596 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b96d254c-9eaa-4c90-be04-1967215b3b1b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:54.701895 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b96d254c-9eaa-4c90-be04-1967215b3b1b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1363 microversion: 2.1 time: 0.260387 May 27 15:19:54.710369 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2475/4951] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:54 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:55.394813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5966fa3f-bbc6-4d08-8482-68c8278e0f49 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:55.396425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5966fa3f-bbc6-4d08-8482-68c8278e0f49 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:55.400781 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=20 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:55.409062 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5966fa3f-bbc6-4d08-8482-68c8278e0f49 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:55.409894 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5966fa3f-bbc6-4d08-8482-68c8278e0f49 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:55.410944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5966fa3f-bbc6-4d08-8482-68c8278e0f49 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:55.411856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5966fa3f-bbc6-4d08-8482-68c8278e0f49 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:55.456703 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bd3c9ac6-5218-4125-8b4d-59b69bbe5fa9 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1007190803", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": "none"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:55.550707 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-bd3c9ac6-5218-4125-8b4d-59b69bbe5fa9 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:19:55.551319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-bd3c9ac6-5218-4125-8b4d-59b69bbe5fa9 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:19:55.551841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-bd3c9ac6-5218-4125-8b4d-59b69bbe5fa9 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:19:55.552366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-bd3c9ac6-5218-4125-8b4d-59b69bbe5fa9 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:19:55.553028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-bd3c9ac6-5218-4125-8b4d-59b69bbe5fa9 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:19:55.577393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd3c9ac6-5218-4125-8b4d-59b69bbe5fa9 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:55.579794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd3c9ac6-5218-4125-8b4d-59b69bbe5fa9 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:55.581439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd3c9ac6-5218-4125-8b4d-59b69bbe5fa9 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:55.584305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd3c9ac6-5218-4125-8b4d-59b69bbe5fa9 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:55.628475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-bd3c9ac6-5218-4125-8b4d-59b69bbe5fa9 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Getting quotas for project 7b4bfe339fba4ed4890a2a07c997e18e. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:19:55.635554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-bd3c9ac6-5218-4125-8b4d-59b69bbe5fa9 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Getting quotas for user eabc3d4c177d482a9c776a47c7819bf0 and project 7b4bfe339fba4ed4890a2a07c997e18e. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:19:55.646598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5966fa3f-bbc6-4d08-8482-68c8278e0f49 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:55.655204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bd3c9ac6-5218-4125-8b4d-59b69bbe5fa9 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:19:55.656018 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5966fa3f-bbc6-4d08-8482-68c8278e0f49 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 200 len: 1363 microversion: 2.1 time: 0.266588 May 27 15:19:55.657274 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2476/4952] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:55 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:55.658630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bd3c9ac6-5218-4125-8b4d-59b69bbe5fa9 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] [instance: 8fb4c523-1db8-41fb-991b-1b78a8eda95d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:19:55.662077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2744ea2b-db56-4c33-8b0b-a3e11d7064a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:55.663009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2744ea2b-db56-4c33-8b0b-a3e11d7064a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:55.670626 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2744ea2b-db56-4c33-8b0b-a3e11d7064a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:55.671099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2744ea2b-db56-4c33-8b0b-a3e11d7064a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:55.671999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2744ea2b-db56-4c33-8b0b-a3e11d7064a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:55.672620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2744ea2b-db56-4c33-8b0b-a3e11d7064a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:55.761256 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bd3c9ac6-5218-4125-8b4d-59b69bbe5fa9 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.551651 May 27 15:19:55.764006 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2477/4953] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 27 15:19:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 15:19:55.773182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b2b3484e-ff76-43b2-b2f7-30fe8b5ad7a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:55.774252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b2b3484e-ff76-43b2-b2f7-30fe8b5ad7a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:55.792983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2b3484e-ff76-43b2-b2f7-30fe8b5ad7a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:55.794020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2b3484e-ff76-43b2-b2f7-30fe8b5ad7a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:55.795998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2b3484e-ff76-43b2-b2f7-30fe8b5ad7a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:55.796621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2b3484e-ff76-43b2-b2f7-30fe8b5ad7a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:55.942149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2744ea2b-db56-4c33-8b0b-a3e11d7064a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:55.951276 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2744ea2b-db56-4c33-8b0b-a3e11d7064a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 200 len: 1308 microversion: 2.1 time: 0.292804 May 27 15:19:55.965023 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2477/4954] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:55 2022] GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 1308 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:55.975273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9f232d56-294b-4f83-bf0e-2d5c89172d06 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:55.977399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9f232d56-294b-4f83-bf0e-2d5c89172d06 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] [instance: 8fb4c523-1db8-41fb-991b-1b78a8eda95d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:56.082195 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9f232d56-294b-4f83-bf0e-2d5c89172d06 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:56.094039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9f232d56-294b-4f83-bf0e-2d5c89172d06 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:56.098505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9f232d56-294b-4f83-bf0e-2d5c89172d06 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:56.099811 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9f232d56-294b-4f83-bf0e-2d5c89172d06 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] 10.222.0.13 "GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d" status: 200 len: 1281 microversion: 2.47 time: 0.132632 May 27 15:19:56.113441 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2478/4955] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:19:55 2022] GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d => generated 1281 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:56.146818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b2b3484e-ff76-43b2-b2f7-30fe8b5ad7a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:56.151362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-4785a805-12fd-4030-94eb-3a807796a903 req-b8fe02b3-8695-4abb-9d4b-b229207237ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cc72e17-205e-4e7f-aefe-17a244443295", "name": "network-vif-plugged", "status": "completed", "tag": "f9ce40a9-a844-4d2e-af96-330750459ac3"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:56.166478 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b2b3484e-ff76-43b2-b2f7-30fe8b5ad7a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1363 microversion: 2.1 time: 0.400656 May 27 15:19:56.168935 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2478/4956] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:55 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1363 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:56.172770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4785a805-12fd-4030-94eb-3a807796a903 req-b8fe02b3-8695-4abb-9d4b-b229207237ca service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:56.173362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4785a805-12fd-4030-94eb-3a807796a903 req-b8fe02b3-8695-4abb-9d4b-b229207237ca service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:56.187354 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-4785a805-12fd-4030-94eb-3a807796a903 req-b8fe02b3-8695-4abb-9d4b-b229207237ca service nova] Creating event network-vif-plugged:f9ce40a9-a844-4d2e-af96-330750459ac3 for instance 9cc72e17-205e-4e7f-aefe-17a244443295 on n-h2-843621-1 May 27 15:19:56.193266 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-4785a805-12fd-4030-94eb-3a807796a903 req-b8fe02b3-8695-4abb-9d4b-b229207237ca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049792 May 27 15:19:56.195584 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2479/4957] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:56.674545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4560994b-3ba7-4571-a7f1-3e417fc54cfe tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:56.675762 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4560994b-3ba7-4571-a7f1-3e417fc54cfe tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:56.695615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4560994b-3ba7-4571-a7f1-3e417fc54cfe tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:56.697295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4560994b-3ba7-4571-a7f1-3e417fc54cfe tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:56.699452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4560994b-3ba7-4571-a7f1-3e417fc54cfe tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:56.700003 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4560994b-3ba7-4571-a7f1-3e417fc54cfe tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:56.951131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4560994b-3ba7-4571-a7f1-3e417fc54cfe tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:56.956191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:56.964169 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4560994b-3ba7-4571-a7f1-3e417fc54cfe tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 200 len: 1363 microversion: 2.1 time: 0.294127 May 27 15:19:56.968162 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2479/4958] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:56 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 1363 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:56.977324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a1d103d1-7661-420d-91f3-7323660f340f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:56.978606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a1d103d1-7661-420d-91f3-7323660f340f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:56.988897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1d103d1-7661-420d-91f3-7323660f340f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:56.989361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1d103d1-7661-420d-91f3-7323660f340f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:56.990143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1d103d1-7661-420d-91f3-7323660f340f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:56.990584 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a1d103d1-7661-420d-91f3-7323660f340f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:57.133009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-305db13c-a0f7-4c42-a494-65e210a00121 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:57.133840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-305db13c-a0f7-4c42-a494-65e210a00121 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] [instance: 8fb4c523-1db8-41fb-991b-1b78a8eda95d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:57.145468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-305db13c-a0f7-4c42-a494-65e210a00121 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:57.145954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-305db13c-a0f7-4c42-a494-65e210a00121 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:57.146767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-305db13c-a0f7-4c42-a494-65e210a00121 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:57.147312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-305db13c-a0f7-4c42-a494-65e210a00121 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:57.271608 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a1d103d1-7661-420d-91f3-7323660f340f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:57.315521 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a1d103d1-7661-420d-91f3-7323660f340f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 200 len: 1308 microversion: 2.1 time: 0.342152 May 27 15:19:57.317816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-305db13c-a0f7-4c42-a494-65e210a00121 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:57.327493 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2480/4959] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:56 2022] GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 1308 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:57.337475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-164a7b51-725f-41a0-a635-62997d29e19c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:57.341489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-164a7b51-725f-41a0-a635-62997d29e19c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:57.349519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-305db13c-a0f7-4c42-a494-65e210a00121 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:57.355396 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-164a7b51-725f-41a0-a635-62997d29e19c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:57.357380 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-164a7b51-725f-41a0-a635-62997d29e19c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:57.363170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-164a7b51-725f-41a0-a635-62997d29e19c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:57.363734 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-164a7b51-725f-41a0-a635-62997d29e19c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:57.367147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-305db13c-a0f7-4c42-a494-65e210a00121 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:57.372806 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-305db13c-a0f7-4c42-a494-65e210a00121 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] 10.222.0.13 "GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d" status: 200 len: 1285 microversion: 2.47 time: 0.256920 May 27 15:19:57.374188 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2480/4960] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:19:57 2022] GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d => generated 1285 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:57.647681 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-164a7b51-725f-41a0-a635-62997d29e19c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:57.661481 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-164a7b51-725f-41a0-a635-62997d29e19c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1363 microversion: 2.1 time: 0.332381 May 27 15:19:57.662098 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2481/4961] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:57 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:57.984071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b78759cf-7c3d-48d8-a67b-a57a0485371a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:57.984992 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b78759cf-7c3d-48d8-a67b-a57a0485371a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:57.998512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b78759cf-7c3d-48d8-a67b-a57a0485371a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:58.000493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b78759cf-7c3d-48d8-a67b-a57a0485371a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:58.003442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b78759cf-7c3d-48d8-a67b-a57a0485371a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:58.004203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b78759cf-7c3d-48d8-a67b-a57a0485371a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:58.192030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b78759cf-7c3d-48d8-a67b-a57a0485371a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:58.201306 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b78759cf-7c3d-48d8-a67b-a57a0485371a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 200 len: 1549 microversion: 2.1 time: 0.221615 May 27 15:19:58.204004 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2481/4962] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:57 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 1549 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:58.222036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a5c1ce39-1f90-4c40-ba73-c67c20f9f0f1 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:58.223279 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a5c1ce39-1f90-4c40-ba73-c67c20f9f0f1 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:58.232370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a5c1ce39-1f90-4c40-ba73-c67c20f9f0f1 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:58.233107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a5c1ce39-1f90-4c40-ba73-c67c20f9f0f1 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:58.234099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a5c1ce39-1f90-4c40-ba73-c67c20f9f0f1 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:58.234690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a5c1ce39-1f90-4c40-ba73-c67c20f9f0f1 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:58.335150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b2cc5ce3-50f5-4204-a2f4-a5a0a5b407c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:58.336190 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b2cc5ce3-50f5-4204-a2f4-a5a0a5b407c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:58.343547 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a5c1ce39-1f90-4c40-ba73-c67c20f9f0f1 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125763 May 27 15:19:58.351655 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2482/4963] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 15:19:58 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:58.355292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2cc5ce3-50f5-4204-a2f4-a5a0a5b407c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:58.356517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2cc5ce3-50f5-4204-a2f4-a5a0a5b407c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:58.357566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2cc5ce3-50f5-4204-a2f4-a5a0a5b407c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:58.358306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2cc5ce3-50f5-4204-a2f4-a5a0a5b407c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:58.393485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d2304515-4066-4405-a3c0-6ea0e06bf167 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:58.394905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d2304515-4066-4405-a3c0-6ea0e06bf167 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] [instance: 8fb4c523-1db8-41fb-991b-1b78a8eda95d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:58.408146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d2304515-4066-4405-a3c0-6ea0e06bf167 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:58.408923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d2304515-4066-4405-a3c0-6ea0e06bf167 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:58.411826 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d2304515-4066-4405-a3c0-6ea0e06bf167 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:58.415214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d2304515-4066-4405-a3c0-6ea0e06bf167 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:58.632553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d2304515-4066-4405-a3c0-6ea0e06bf167 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:58.656314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d2304515-4066-4405-a3c0-6ea0e06bf167 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:58.658169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d2304515-4066-4405-a3c0-6ea0e06bf167 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:58.659382 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d2304515-4066-4405-a3c0-6ea0e06bf167 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] 10.222.0.13 "GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d" status: 200 len: 1351 microversion: 2.47 time: 0.271739 May 27 15:19:58.674767 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2483/4964] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:19:58 2022] GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d => generated 1351 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:58.684556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-596f44d8-4d7d-48ed-9bd7-45c4ed0225de tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:58.685409 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-596f44d8-4d7d-48ed-9bd7-45c4ed0225de tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:58.704903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-596f44d8-4d7d-48ed-9bd7-45c4ed0225de tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:58.706223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-596f44d8-4d7d-48ed-9bd7-45c4ed0225de tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:58.708359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-596f44d8-4d7d-48ed-9bd7-45c4ed0225de tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:58.709536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-596f44d8-4d7d-48ed-9bd7-45c4ed0225de tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:58.721287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:58.805775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b2cc5ce3-50f5-4204-a2f4-a5a0a5b407c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:58.815583 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b2cc5ce3-50f5-4204-a2f4-a5a0a5b407c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 200 len: 1308 microversion: 2.1 time: 0.484697 May 27 15:19:58.832161 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2482/4965] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:58 2022] GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 1308 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:58.967103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-596f44d8-4d7d-48ed-9bd7-45c4ed0225de tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:58.979304 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-596f44d8-4d7d-48ed-9bd7-45c4ed0225de tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1363 microversion: 2.1 time: 0.301384 May 27 15:19:58.989171 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2484/4966] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:58 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:59.678216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e3977f6d-0f32-43b8-91b6-f63568ceb4c6 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:59.678865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e3977f6d-0f32-43b8-91b6-f63568ceb4c6 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] [instance: 8fb4c523-1db8-41fb-991b-1b78a8eda95d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:59.700335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3977f6d-0f32-43b8-91b6-f63568ceb4c6 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:59.700983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3977f6d-0f32-43b8-91b6-f63568ceb4c6 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:59.701879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3977f6d-0f32-43b8-91b6-f63568ceb4c6 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:59.702438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3977f6d-0f32-43b8-91b6-f63568ceb4c6 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:59.842198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-57e3401e-32d8-4fda-a927-5de1a1935215 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:59.843226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-57e3401e-32d8-4fda-a927-5de1a1935215 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:59.860741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57e3401e-32d8-4fda-a927-5de1a1935215 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:59.861215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57e3401e-32d8-4fda-a927-5de1a1935215 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:59.868378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57e3401e-32d8-4fda-a927-5de1a1935215 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:59.868896 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57e3401e-32d8-4fda-a927-5de1a1935215 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:59.889927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e3977f6d-0f32-43b8-91b6-f63568ceb4c6 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:59.900428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e3977f6d-0f32-43b8-91b6-f63568ceb4c6 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:59.908723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e3977f6d-0f32-43b8-91b6-f63568ceb4c6 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:59.912624 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e3977f6d-0f32-43b8-91b6-f63568ceb4c6 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] 10.222.0.13 "GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d" status: 200 len: 1339 microversion: 2.47 time: 0.238329 May 27 15:19:59.922770 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2483/4967] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:19:59 2022] GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d => generated 1339 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:00.000271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d7e82fb3-be8b-4094-952e-23cc224f9f21 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:00.001051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d7e82fb3-be8b-4094-952e-23cc224f9f21 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:00.013124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7e82fb3-be8b-4094-952e-23cc224f9f21 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.021758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7e82fb3-be8b-4094-952e-23cc224f9f21 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.022824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7e82fb3-be8b-4094-952e-23cc224f9f21 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.025586 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7e82fb3-be8b-4094-952e-23cc224f9f21 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.333387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-57e3401e-32d8-4fda-a927-5de1a1935215 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:00.345372 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-57e3401e-32d8-4fda-a927-5de1a1935215 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 200 len: 1308 microversion: 2.1 time: 0.509770 May 27 15:20:00.346322 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2485/4968] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:59 2022] GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 1308 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:00.355332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-37e3a443-a163-4b75-89d3-06f7f9b255cd req-fcd6f9f7-8408-4ac8-88ee-9536aa28b511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36a5db54-c75b-4a95-9b2f-3f4ac68d345e", "name": "network-vif-plugged", "status": "completed", "tag": "b369df5e-fca2-45e6-b32d-d97fbc0d5fad"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:00.379032 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-37e3a443-a163-4b75-89d3-06f7f9b255cd req-fcd6f9f7-8408-4ac8-88ee-9536aa28b511 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.379534 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-37e3a443-a163-4b75-89d3-06f7f9b255cd req-fcd6f9f7-8408-4ac8-88ee-9536aa28b511 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.400638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d7e82fb3-be8b-4094-952e-23cc224f9f21 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:00.412228 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d7e82fb3-be8b-4094-952e-23cc224f9f21 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1363 microversion: 2.1 time: 0.413703 May 27 15:20:00.412940 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-37e3a443-a163-4b75-89d3-06f7f9b255cd req-fcd6f9f7-8408-4ac8-88ee-9536aa28b511 service nova] Creating event network-vif-plugged:b369df5e-fca2-45e6-b32d-d97fbc0d5fad for instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e on n-h2-843621-1 May 27 15:20:00.414267 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2484/4969] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:19:59 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1363 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:00.421452 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-37e3a443-a163-4b75-89d3-06f7f9b255cd req-fcd6f9f7-8408-4ac8-88ee-9536aa28b511 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073390 May 27 15:20:00.422493 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2486/4970] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:00.892653 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-7d6cc10d-b69a-430c-95c6-0d4b68ad5b3e req-679d64c1-6cdc-4886-802d-9534ae26aa0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cc72e17-205e-4e7f-aefe-17a244443295", "tag": "f9ce40a9-a844-4d2e-af96-330750459ac3"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:00.911405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-7d6cc10d-b69a-430c-95c6-0d4b68ad5b3e req-679d64c1-6cdc-4886-802d-9534ae26aa0d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.913113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-7d6cc10d-b69a-430c-95c6-0d4b68ad5b3e req-679d64c1-6cdc-4886-802d-9534ae26aa0d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.934921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-69675286-9376-438f-a7b1-9807909bd2d8 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:00.936223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-69675286-9376-438f-a7b1-9807909bd2d8 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] [instance: 8fb4c523-1db8-41fb-991b-1b78a8eda95d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:00.943484 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-7d6cc10d-b69a-430c-95c6-0d4b68ad5b3e req-679d64c1-6cdc-4886-802d-9534ae26aa0d service nova] Creating event network-changed:f9ce40a9-a844-4d2e-af96-330750459ac3 for instance 9cc72e17-205e-4e7f-aefe-17a244443295 on n-h2-843621-1 May 27 15:20:00.946044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69675286-9376-438f-a7b1-9807909bd2d8 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.947161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69675286-9376-438f-a7b1-9807909bd2d8 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.948300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69675286-9376-438f-a7b1-9807909bd2d8 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.949067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-69675286-9376-438f-a7b1-9807909bd2d8 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.959576 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-7d6cc10d-b69a-430c-95c6-0d4b68ad5b3e req-679d64c1-6cdc-4886-802d-9534ae26aa0d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070970 May 27 15:20:00.963390 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2485/4971] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:01.075656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-69675286-9376-438f-a7b1-9807909bd2d8 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:01.095572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-69675286-9376-438f-a7b1-9807909bd2d8 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:01.097292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-69675286-9376-438f-a7b1-9807909bd2d8 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:01.098711 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-69675286-9376-438f-a7b1-9807909bd2d8 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] 10.222.0.13 "GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d" status: 200 len: 1339 microversion: 2.47 time: 0.170120 May 27 15:20:01.099282 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2487/4972] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:00 2022] GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d => generated 1339 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:20:01.364420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4573362d-fc83-49b5-b70b-c4f2d3a3b91c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:01.365400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4573362d-fc83-49b5-b70b-c4f2d3a3b91c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:01.381811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4573362d-fc83-49b5-b70b-c4f2d3a3b91c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:01.400310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4573362d-fc83-49b5-b70b-c4f2d3a3b91c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:01.405709 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4573362d-fc83-49b5-b70b-c4f2d3a3b91c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:01.407849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4573362d-fc83-49b5-b70b-c4f2d3a3b91c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:01.430623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-950ab3f4-79fa-46e8-a6d5-a453a12d52df tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:01.431257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-950ab3f4-79fa-46e8-a6d5-a453a12d52df tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:01.438946 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-950ab3f4-79fa-46e8-a6d5-a453a12d52df tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:01.439415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-950ab3f4-79fa-46e8-a6d5-a453a12d52df tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:01.440262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-950ab3f4-79fa-46e8-a6d5-a453a12d52df tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:01.440936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-950ab3f4-79fa-46e8-a6d5-a453a12d52df tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:01.819598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4573362d-fc83-49b5-b70b-c4f2d3a3b91c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:01.841404 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4573362d-fc83-49b5-b70b-c4f2d3a3b91c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 200 len: 1308 microversion: 2.1 time: 0.477315 May 27 15:20:01.842682 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2486/4973] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:01 2022] GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 1308 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:01.854558 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-950ab3f4-79fa-46e8-a6d5-a453a12d52df tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:01.865654 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-950ab3f4-79fa-46e8-a6d5-a453a12d52df tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1363 microversion: 2.1 time: 0.439134 May 27 15:20:01.883598 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2488/4974] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:01 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1363 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:02.119998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8a8a740f-a328-4a86-a1be-0188bf23dffd tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:02.121547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8a8a740f-a328-4a86-a1be-0188bf23dffd tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] [instance: 8fb4c523-1db8-41fb-991b-1b78a8eda95d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:02.150642 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a8a740f-a328-4a86-a1be-0188bf23dffd tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:02.156228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a8a740f-a328-4a86-a1be-0188bf23dffd tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:02.158019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a8a740f-a328-4a86-a1be-0188bf23dffd tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:02.159248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a8a740f-a328-4a86-a1be-0188bf23dffd tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:02.275884 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8a8a740f-a328-4a86-a1be-0188bf23dffd tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:02.298415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8a8a740f-a328-4a86-a1be-0188bf23dffd tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:02.300114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8a8a740f-a328-4a86-a1be-0188bf23dffd tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:02.307274 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8a8a740f-a328-4a86-a1be-0188bf23dffd tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] 10.222.0.13 "GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d" status: 200 len: 1339 microversion: 2.47 time: 0.191411 May 27 15:20:02.307896 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2487/4975] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:02 2022] GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d => generated 1339 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:02.464184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-6e611521-9897-4c5e-ae75-855cfd0f696d req-4957b2a9-cc8a-47a7-b979-b98743e9ee5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812d42c0-07f1-4f7c-83b8-848b18cf0186", "name": "network-vif-plugged", "status": "completed", "tag": "0d9da5e7-a50c-4ddd-aca9-02eae7d0476c"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:02.485274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6e611521-9897-4c5e-ae75-855cfd0f696d req-4957b2a9-cc8a-47a7-b979-b98743e9ee5b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:02.486955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6e611521-9897-4c5e-ae75-855cfd0f696d req-4957b2a9-cc8a-47a7-b979-b98743e9ee5b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:02.508322 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-6e611521-9897-4c5e-ae75-855cfd0f696d req-4957b2a9-cc8a-47a7-b979-b98743e9ee5b service nova] Creating event network-vif-plugged:0d9da5e7-a50c-4ddd-aca9-02eae7d0476c for instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 on n-h1-843621-1 May 27 15:20:02.520921 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-6e611521-9897-4c5e-ae75-855cfd0f696d req-4957b2a9-cc8a-47a7-b979-b98743e9ee5b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067155 May 27 15:20:02.523353 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2489/4976] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:02.859241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-12a55bdb-2f79-431a-9db0-f99347ba373b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:02.859871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-12a55bdb-2f79-431a-9db0-f99347ba373b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:02.867652 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12a55bdb-2f79-431a-9db0-f99347ba373b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:02.868121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12a55bdb-2f79-431a-9db0-f99347ba373b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:02.879423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12a55bdb-2f79-431a-9db0-f99347ba373b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:02.886302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12a55bdb-2f79-431a-9db0-f99347ba373b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:02.886523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f08c1e81-bfe3-44bb-be6a-2eef8fb055e1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:02.889100 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f08c1e81-bfe3-44bb-be6a-2eef8fb055e1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:02.924988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f08c1e81-bfe3-44bb-be6a-2eef8fb055e1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:02.926057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f08c1e81-bfe3-44bb-be6a-2eef8fb055e1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:02.939096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f08c1e81-bfe3-44bb-be6a-2eef8fb055e1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:02.940052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f08c1e81-bfe3-44bb-be6a-2eef8fb055e1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:03.193965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-12a55bdb-2f79-431a-9db0-f99347ba373b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:03.202467 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-12a55bdb-2f79-431a-9db0-f99347ba373b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 200 len: 1489 microversion: 2.1 time: 0.347096 May 27 15:20:03.203061 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2488/4977] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:02 2022] GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 1489 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:03.237211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f08c1e81-bfe3-44bb-be6a-2eef8fb055e1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:03.251076 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f08c1e81-bfe3-44bb-be6a-2eef8fb055e1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1363 microversion: 2.1 time: 0.370255 May 27 15:20:03.252718 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2490/4978] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:02 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1363 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:03.326748 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e24dab34-9c4a-48cc-a426-d92893ddcd7a tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:03.327386 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e24dab34-9c4a-48cc-a426-d92893ddcd7a tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] [instance: 8fb4c523-1db8-41fb-991b-1b78a8eda95d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:03.337270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e24dab34-9c4a-48cc-a426-d92893ddcd7a tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:03.338729 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e24dab34-9c4a-48cc-a426-d92893ddcd7a tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:03.341984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e24dab34-9c4a-48cc-a426-d92893ddcd7a tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:03.342617 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e24dab34-9c4a-48cc-a426-d92893ddcd7a tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:03.400571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-71183f55-7739-4c08-84bf-e23b78f19529 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-463418635", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "679b759f-4940-4405-a687-165c11fb616b"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:03.417525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:03.451310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e24dab34-9c4a-48cc-a426-d92893ddcd7a tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:03.472287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e24dab34-9c4a-48cc-a426-d92893ddcd7a tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:03.476010 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e24dab34-9c4a-48cc-a426-d92893ddcd7a tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:03.479510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-71183f55-7739-4c08-84bf-e23b78f19529 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] validate_networks() for [('679b759f-4940-4405-a687-165c11fb616b', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:20:03.482934 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e24dab34-9c4a-48cc-a426-d92893ddcd7a tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] 10.222.0.13 "GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d" status: 200 len: 1360 microversion: 2.47 time: 0.158079 May 27 15:20:03.486273 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2489/4979] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:03 2022] GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:03.506746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-271871a8-c539-48b5-a424-18b8841cc059 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-698650501"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:03.508397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-271871a8-c539-48b5-a424-18b8841cc059 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] [instance: 8fb4c523-1db8-41fb-991b-1b78a8eda95d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:03.516516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-271871a8-c539-48b5-a424-18b8841cc059 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:03.517287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-271871a8-c539-48b5-a424-18b8841cc059 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:03.518750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-271871a8-c539-48b5-a424-18b8841cc059 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:03.519633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-271871a8-c539-48b5-a424-18b8841cc059 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:03.966408 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-271871a8-c539-48b5-a424-18b8841cc059 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] 10.222.0.13 "POST /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d/action" status: 202 len: 52 microversion: 2.47 time: 0.456623 May 27 15:20:03.972997 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2490/4980] 10.222.0.13 () {62 vars in 1318 bytes} [Fri May 27 15:20:03 2022] POST /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d/action => generated 52 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) May 27 15:20:03.983804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0101ae8c-8f8a-4003-a425-902da7022514 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:03.984404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0101ae8c-8f8a-4003-a425-902da7022514 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] [instance: 8fb4c523-1db8-41fb-991b-1b78a8eda95d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:04.001054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0101ae8c-8f8a-4003-a425-902da7022514 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:04.001931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0101ae8c-8f8a-4003-a425-902da7022514 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:04.002931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0101ae8c-8f8a-4003-a425-902da7022514 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:04.004401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0101ae8c-8f8a-4003-a425-902da7022514 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:04.046599 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0101ae8c-8f8a-4003-a425-902da7022514 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] [instance: 8fb4c523-1db8-41fb-991b-1b78a8eda95d] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:20:04.185098 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0101ae8c-8f8a-4003-a425-902da7022514 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d" status: 204 len: 0 microversion: 2.47 time: 0.207766 May 27 15:20:04.188058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-71183f55-7739-4c08-84bf-e23b78f19529 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:20:04.188783 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2491/4981] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:20:03 2022] DELETE /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:20:04.189115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-71183f55-7739-4c08-84bf-e23b78f19529 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:20:04.190385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-71183f55-7739-4c08-84bf-e23b78f19529 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:20:04.191218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-71183f55-7739-4c08-84bf-e23b78f19529 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:20:04.192268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-71183f55-7739-4c08-84bf-e23b78f19529 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:20:04.198890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-28291ba3-d123-491f-b1a8-d23e08af961b tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:04.203391 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-28291ba3-d123-491f-b1a8-d23e08af961b tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] [instance: 8fb4c523-1db8-41fb-991b-1b78a8eda95d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:04.215247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71183f55-7739-4c08-84bf-e23b78f19529 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:04.216304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71183f55-7739-4c08-84bf-e23b78f19529 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:04.217561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71183f55-7739-4c08-84bf-e23b78f19529 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:04.218192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-71183f55-7739-4c08-84bf-e23b78f19529 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:04.221113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-28291ba3-d123-491f-b1a8-d23e08af961b tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:04.221695 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-28291ba3-d123-491f-b1a8-d23e08af961b tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:04.222847 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-28291ba3-d123-491f-b1a8-d23e08af961b tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:04.223449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-28291ba3-d123-491f-b1a8-d23e08af961b tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:04.254979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-71183f55-7739-4c08-84bf-e23b78f19529 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Getting quotas for project db397cde9e67464182a7ba045f1779be. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:20:04.270026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-71183f55-7739-4c08-84bf-e23b78f19529 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Getting quotas for user 2f0525081cf441998d2c320fa0087cff and project db397cde9e67464182a7ba045f1779be. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:20:04.296880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-71183f55-7739-4c08-84bf-e23b78f19529 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:20:04.304852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-71183f55-7739-4c08-84bf-e23b78f19529 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:20:04.349044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-28291ba3-d123-491f-b1a8-d23e08af961b tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:04.368014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-28291ba3-d123-491f-b1a8-d23e08af961b tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:04.369378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-28291ba3-d123-491f-b1a8-d23e08af961b tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:04.370790 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-28291ba3-d123-491f-b1a8-d23e08af961b tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] 10.222.0.13 "GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d" status: 200 len: 1366 microversion: 2.47 time: 0.177457 May 27 15:20:04.376789 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2492/4982] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:04 2022] GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:04.380748 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-82a075f5-1fcd-4636-b49b-371aa55c7dfb tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:04.381436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-82a075f5-1fcd-4636-b49b-371aa55c7dfb tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:04.388151 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-71183f55-7739-4c08-84bf-e23b78f19529 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991332 May 27 15:20:04.389670 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2491/4983] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:20:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:20:04.391781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82a075f5-1fcd-4636-b49b-371aa55c7dfb tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:04.392473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82a075f5-1fcd-4636-b49b-371aa55c7dfb tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:04.393585 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82a075f5-1fcd-4636-b49b-371aa55c7dfb tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:04.394256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82a075f5-1fcd-4636-b49b-371aa55c7dfb tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:04.399634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e88cf9dc-4ca5-4d53-8208-007e0d047e76 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:04.400367 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e88cf9dc-4ca5-4d53-8208-007e0d047e76 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:04.523119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e88cf9dc-4ca5-4d53-8208-007e0d047e76 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:04.539059 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e88cf9dc-4ca5-4d53-8208-007e0d047e76 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 200 len: 1208 microversion: 2.1 time: 0.143284 May 27 15:20:04.540867 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2492/4984] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:04 2022] GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 1208 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:04.781409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-82a075f5-1fcd-4636-b49b-371aa55c7dfb tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:04.808528 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-82a075f5-1fcd-4636-b49b-371aa55c7dfb tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1363 microversion: 2.1 time: 0.432430 May 27 15:20:04.811502 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2493/4985] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:04 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1363 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:05.392384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5ee64e76-5aca-4d25-8768-2900d0da8e8d tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:05.393838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5ee64e76-5aca-4d25-8768-2900d0da8e8d tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] [instance: 8fb4c523-1db8-41fb-991b-1b78a8eda95d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:05.402750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5ee64e76-5aca-4d25-8768-2900d0da8e8d tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:05.406301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5ee64e76-5aca-4d25-8768-2900d0da8e8d tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:05.408449 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5ee64e76-5aca-4d25-8768-2900d0da8e8d tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:05.411391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5ee64e76-5aca-4d25-8768-2900d0da8e8d tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:05.536866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5ee64e76-5aca-4d25-8768-2900d0da8e8d tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:05.545471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5ee64e76-5aca-4d25-8768-2900d0da8e8d tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:05.548941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5ee64e76-5aca-4d25-8768-2900d0da8e8d tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:05.548941 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5ee64e76-5aca-4d25-8768-2900d0da8e8d tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] 10.222.0.13 "GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d" status: 200 len: 1366 microversion: 2.47 time: 0.160621 May 27 15:20:05.549238 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2493/4986] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:05 2022] GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:05.566418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-58c5f50f-b6d7-4595-96a3-7a0d9a233ebd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:05.567577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-58c5f50f-b6d7-4595-96a3-7a0d9a233ebd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:05.577567 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-58c5f50f-b6d7-4595-96a3-7a0d9a233ebd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:05.578138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-58c5f50f-b6d7-4595-96a3-7a0d9a233ebd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:05.579108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-58c5f50f-b6d7-4595-96a3-7a0d9a233ebd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:05.579862 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-58c5f50f-b6d7-4595-96a3-7a0d9a233ebd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:05.602852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:05.608824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:05.647521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:05.671048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-58c5f50f-b6d7-4595-96a3-7a0d9a233ebd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:05.679844 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-58c5f50f-b6d7-4595-96a3-7a0d9a233ebd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 200 len: 1260 microversion: 2.1 time: 0.122209 May 27 15:20:05.691327 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2494/4987] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:05 2022] GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 1260 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:05.837962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0e6a779f-e935-4f43-8078-7c2048acd735 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:05.838589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0e6a779f-e935-4f43-8078-7c2048acd735 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:05.861744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0e6a779f-e935-4f43-8078-7c2048acd735 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:05.864222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0e6a779f-e935-4f43-8078-7c2048acd735 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:05.866676 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0e6a779f-e935-4f43-8078-7c2048acd735 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:05.869267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0e6a779f-e935-4f43-8078-7c2048acd735 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:06.110152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0e6a779f-e935-4f43-8078-7c2048acd735 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:06.128467 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0e6a779f-e935-4f43-8078-7c2048acd735 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1550 microversion: 2.1 time: 0.290133 May 27 15:20:06.130813 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2494/4988] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:05 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1550 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:06.148443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-66cd958d-2d83-41eb-82b6-0ecdc68a8b87 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:06.149234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-66cd958d-2d83-41eb-82b6-0ecdc68a8b87 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:06.156949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66cd958d-2d83-41eb-82b6-0ecdc68a8b87 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:06.157548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66cd958d-2d83-41eb-82b6-0ecdc68a8b87 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:06.158506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66cd958d-2d83-41eb-82b6-0ecdc68a8b87 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:06.159115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66cd958d-2d83-41eb-82b6-0ecdc68a8b87 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:06.255818 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-66cd958d-2d83-41eb-82b6-0ecdc68a8b87 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111205 May 27 15:20:06.256834 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2495/4989] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 15:20:06 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:20:06.573263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b7e0f32b-0a54-4194-9d50-b9d7eecbddcc tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:06.578655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b7e0f32b-0a54-4194-9d50-b9d7eecbddcc tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] [instance: 8fb4c523-1db8-41fb-991b-1b78a8eda95d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:06.612439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7e0f32b-0a54-4194-9d50-b9d7eecbddcc tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:06.620127 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7e0f32b-0a54-4194-9d50-b9d7eecbddcc tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:06.622824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7e0f32b-0a54-4194-9d50-b9d7eecbddcc tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:06.624373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7e0f32b-0a54-4194-9d50-b9d7eecbddcc tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:06.700261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3d2b8905-46d5-4c37-91cb-4a96537d9534 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:06.701503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3d2b8905-46d5-4c37-91cb-4a96537d9534 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:06.722648 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d2b8905-46d5-4c37-91cb-4a96537d9534 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:06.723366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d2b8905-46d5-4c37-91cb-4a96537d9534 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:06.724335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d2b8905-46d5-4c37-91cb-4a96537d9534 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:06.724986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d2b8905-46d5-4c37-91cb-4a96537d9534 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:06.991983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b7e0f32b-0a54-4194-9d50-b9d7eecbddcc tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:07.022462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3d2b8905-46d5-4c37-91cb-4a96537d9534 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:07.031352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b7e0f32b-0a54-4194-9d50-b9d7eecbddcc tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:07.033049 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b7e0f32b-0a54-4194-9d50-b9d7eecbddcc tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:07.035984 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3d2b8905-46d5-4c37-91cb-4a96537d9534 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 200 len: 1266 microversion: 2.1 time: 0.341629 May 27 15:20:07.054602 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b7e0f32b-0a54-4194-9d50-b9d7eecbddcc tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] 10.222.0.13 "GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d" status: 200 len: 1366 microversion: 2.47 time: 0.490340 May 27 15:20:07.055355 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2496/4990] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:06 2022] GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 1266 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:07.056578 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2495/4991] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:06 2022] GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d => generated 1366 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:08.061303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7cc48338-d69c-44db-b22a-f2a81cafe760 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:08.061934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7cc48338-d69c-44db-b22a-f2a81cafe760 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:08.077075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-36363211-97f2-47cb-a5be-91089504ce43 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:08.077705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-36363211-97f2-47cb-a5be-91089504ce43 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] [instance: 8fb4c523-1db8-41fb-991b-1b78a8eda95d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:08.086310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7cc48338-d69c-44db-b22a-f2a81cafe760 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:08.088211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36363211-97f2-47cb-a5be-91089504ce43 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:08.088699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36363211-97f2-47cb-a5be-91089504ce43 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:08.089486 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36363211-97f2-47cb-a5be-91089504ce43 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:08.090492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36363211-97f2-47cb-a5be-91089504ce43 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:08.098600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7cc48338-d69c-44db-b22a-f2a81cafe760 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:08.099000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7cc48338-d69c-44db-b22a-f2a81cafe760 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:08.099466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7cc48338-d69c-44db-b22a-f2a81cafe760 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:08.259182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-36363211-97f2-47cb-a5be-91089504ce43 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:08.276191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-36363211-97f2-47cb-a5be-91089504ce43 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:08.281538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-36363211-97f2-47cb-a5be-91089504ce43 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:08.285971 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-36363211-97f2-47cb-a5be-91089504ce43 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] 10.222.0.13 "GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d" status: 200 len: 1366 microversion: 2.47 time: 0.212851 May 27 15:20:08.287709 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2496/4992] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:08 2022] GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:08.444470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7cc48338-d69c-44db-b22a-f2a81cafe760 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:08.454023 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7cc48338-d69c-44db-b22a-f2a81cafe760 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 200 len: 1308 microversion: 2.1 time: 0.396530 May 27 15:20:08.454696 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2497/4993] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:08 2022] GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 1308 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:08.776426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-6c5ad882-6e7d-4558-871d-144a716e747b req-45b20500-7393-4563-84ed-5f561c1a786c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43dd287d-127e-46be-97bd-7051aaccc3b5", "tag": "c6f28894-ce87-4b3d-9214-2362b03f3c1e"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:08.792430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6c5ad882-6e7d-4558-871d-144a716e747b req-45b20500-7393-4563-84ed-5f561c1a786c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:08.793135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6c5ad882-6e7d-4558-871d-144a716e747b req-45b20500-7393-4563-84ed-5f561c1a786c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:08.819462 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-6c5ad882-6e7d-4558-871d-144a716e747b req-45b20500-7393-4563-84ed-5f561c1a786c service nova] Creating event network-changed:c6f28894-ce87-4b3d-9214-2362b03f3c1e for instance 43dd287d-127e-46be-97bd-7051aaccc3b5 on n-h2-843621-1 May 27 15:20:08.826625 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-6c5ad882-6e7d-4558-871d-144a716e747b req-45b20500-7393-4563-84ed-5f561c1a786c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053972 May 27 15:20:08.835994 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2497/4994] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:08.998079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-569b056a-68cf-479a-95c5-388ae76f4d40 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:08.999222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-569b056a-68cf-479a-95c5-388ae76f4d40 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:09.011115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-e3c122ff-2e32-4246-8e42-b311a0638ef4 req-de79823a-9422-4804-9a79-bd967724d38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "812d42c0-07f1-4f7c-83b8-848b18cf0186", "tag": "0d9da5e7-a50c-4ddd-aca9-02eae7d0476c"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:09.037174 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-569b056a-68cf-479a-95c5-388ae76f4d40 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:09.038901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-569b056a-68cf-479a-95c5-388ae76f4d40 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:09.044227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-569b056a-68cf-479a-95c5-388ae76f4d40 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:09.046410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-569b056a-68cf-479a-95c5-388ae76f4d40 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:09.063229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-e3c122ff-2e32-4246-8e42-b311a0638ef4 req-de79823a-9422-4804-9a79-bd967724d38b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:09.063811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-e3c122ff-2e32-4246-8e42-b311a0638ef4 req-de79823a-9422-4804-9a79-bd967724d38b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:09.122971 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-e3c122ff-2e32-4246-8e42-b311a0638ef4 req-de79823a-9422-4804-9a79-bd967724d38b service nova] Creating event network-changed:0d9da5e7-a50c-4ddd-aca9-02eae7d0476c for instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 on n-h1-843621-1 May 27 15:20:09.138923 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-e3c122ff-2e32-4246-8e42-b311a0638ef4 req-de79823a-9422-4804-9a79-bd967724d38b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132441 May 27 15:20:09.158316 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2498/4995] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:09.306486 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3ebce41d-3605-407b-9627-3472b85b2f2a tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:09.307590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3ebce41d-3605-407b-9627-3472b85b2f2a tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] [instance: 8fb4c523-1db8-41fb-991b-1b78a8eda95d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:09.315833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ebce41d-3605-407b-9627-3472b85b2f2a tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:09.316706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ebce41d-3605-407b-9627-3472b85b2f2a tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:09.317736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ebce41d-3605-407b-9627-3472b85b2f2a tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:09.318411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ebce41d-3605-407b-9627-3472b85b2f2a tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:09.458551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-569b056a-68cf-479a-95c5-388ae76f4d40 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:09.471520 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-569b056a-68cf-479a-95c5-388ae76f4d40 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1550 microversion: 2.1 time: 0.478522 May 27 15:20:09.475275 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2498/4996] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:08 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1550 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:09.490861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ad8d8f77-2de7-440b-b5f5-999ed32ce662 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:09.491864 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ad8d8f77-2de7-440b-b5f5-999ed32ce662 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:09.510321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad8d8f77-2de7-440b-b5f5-999ed32ce662 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:09.512666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad8d8f77-2de7-440b-b5f5-999ed32ce662 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:09.513651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3ebce41d-3605-407b-9627-3472b85b2f2a tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:09.515693 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad8d8f77-2de7-440b-b5f5-999ed32ce662 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:09.516612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad8d8f77-2de7-440b-b5f5-999ed32ce662 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:09.532790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3ebce41d-3605-407b-9627-3472b85b2f2a tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:09.534597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3ebce41d-3605-407b-9627-3472b85b2f2a tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eabc3d4c177d482a9c776a47c7819bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4bfe339fba4ed4890a2a07c997e18e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:09.548029 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3ebce41d-3605-407b-9627-3472b85b2f2a tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] 10.222.0.13 "GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d" status: 200 len: 1366 microversion: 2.47 time: 0.245807 May 27 15:20:09.548648 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2499/4997] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:09 2022] GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:09.570735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-57bbb06c-c9fd-45df-8739-4904965ab1db tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:09.576368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-57bbb06c-c9fd-45df-8739-4904965ab1db tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:09.612630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57bbb06c-c9fd-45df-8739-4904965ab1db tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:09.613134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57bbb06c-c9fd-45df-8739-4904965ab1db tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:09.613959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57bbb06c-c9fd-45df-8739-4904965ab1db tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:09.614412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57bbb06c-c9fd-45df-8739-4904965ab1db tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:09.991350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ad8d8f77-2de7-440b-b5f5-999ed32ce662 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:10.000875 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ad8d8f77-2de7-440b-b5f5-999ed32ce662 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 200 len: 1308 microversion: 2.1 time: 0.524066 May 27 15:20:10.005738 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2499/4998] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:09 2022] GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 1308 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:10.213501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-57bbb06c-c9fd-45df-8739-4904965ab1db tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:10.228108 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-57bbb06c-c9fd-45df-8739-4904965ab1db tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1550 microversion: 2.1 time: 0.671634 May 27 15:20:10.228737 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2500/4999] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:09 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1550 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:10.567159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-44eb53cd-5740-4e5d-ad7f-86f70323ef09 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:10.567891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-44eb53cd-5740-4e5d-ad7f-86f70323ef09 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] [instance: 8fb4c523-1db8-41fb-991b-1b78a8eda95d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:10.591473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44eb53cd-5740-4e5d-ad7f-86f70323ef09 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:10.592157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44eb53cd-5740-4e5d-ad7f-86f70323ef09 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:10.592690 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44eb53cd-5740-4e5d-ad7f-86f70323ef09 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:10.593143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44eb53cd-5740-4e5d-ad7f-86f70323ef09 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:10.629027 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-44eb53cd-5740-4e5d-ad7f-86f70323ef09 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] HTTP exception thrown: Instance 8fb4c523-1db8-41fb-991b-1b78a8eda95d could not be found. May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-44eb53cd-5740-4e5d-ad7f-86f70323ef09 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Request method failure captured: May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d HTTP/1.1 May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOwaZafCQ96pvfZHDPUDn-hoxLT3clEeFbl2lMd8lI5h6-ScJNURyIcHaKSyeeflQQfMI5roNW91WC33_sPnscR7eBZGMaHTVwzHl5Xrj6Upo3Xwyd6S3ww7GcRn9SyQLQoQmm7anxEvGDVOxIbni5XL6LR_RNlN7IO1qX5aWYoCI_U May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-Openstack-Nova-Api-Version: 2.47 May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 7b4bfe339fba4ed4890a2a07c997e18e May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersAaction247Test-739109200 May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7b4bfe339fba4ed4890a2a07c997e18e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7b4bfe339fba4ed4890a2a07c997e18e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7b4bfe339fba4ed4890a2a07c997e18e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7b4bfe339fba4ed4890a2a07c997e18e", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersAaction247Test-739109200 May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 7b4bfe339fba4ed4890a2a07c997e18e May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersAaction247Test-739109200 May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersAaction247Test-739109200-project May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: eabc3d4c177d482a9c776a47c7819bf0 May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersAaction247Test-739109200-project May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 8fb4c523-1db8-41fb-991b-1b78a8eda95d could not be found. May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '8fb4c523-1db8-41fb-991b-1b78a8eda95d'} May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fb4c523-1db8-41fb-991b-1b78a8eda95d could not be found. May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fb4c523-1db8-41fb-991b-1b78a8eda95d could not be found. May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:10.646193 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:20:10.650535 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:10.650535 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:10.650535 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:10.650535 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:20:10.650535 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:20:10.650535 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fb4c523-1db8-41fb-991b-1b78a8eda95d could not be found. May 27 15:20:10.650535 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:20:10.651965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-44eb53cd-5740-4e5d-ad7f-86f70323ef09 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] Returning 404 to user: Instance 8fb4c523-1db8-41fb-991b-1b78a8eda95d could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:20:10.653707 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-44eb53cd-5740-4e5d-ad7f-86f70323ef09 tempest-ServersAaction247Test-739109200 tempest-ServersAaction247Test-739109200-project] 10.222.0.13 "GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d" status: 404 len: 111 microversion: 2.47 time: 0.090703 May 27 15:20:10.654777 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2500/5000] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:10 2022] GET /compute/v2.1/servers/8fb4c523-1db8-41fb-991b-1b78a8eda95d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:20:11.023867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8ce94a4d-7872-49d7-9b93-03958f6ea603 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:11.024531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8ce94a4d-7872-49d7-9b93-03958f6ea603 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:11.039362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ce94a4d-7872-49d7-9b93-03958f6ea603 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:11.042087 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ce94a4d-7872-49d7-9b93-03958f6ea603 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:11.043038 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ce94a4d-7872-49d7-9b93-03958f6ea603 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:11.044895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ce94a4d-7872-49d7-9b93-03958f6ea603 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:11.245334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-45cddb70-8b4d-4318-b6ba-51cbc57da829 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:11.246019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-45cddb70-8b4d-4318-b6ba-51cbc57da829 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:11.263034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45cddb70-8b4d-4318-b6ba-51cbc57da829 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:11.263508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45cddb70-8b4d-4318-b6ba-51cbc57da829 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:11.264331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45cddb70-8b4d-4318-b6ba-51cbc57da829 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:11.264814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45cddb70-8b4d-4318-b6ba-51cbc57da829 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:11.571235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8ce94a4d-7872-49d7-9b93-03958f6ea603 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:11.586335 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8ce94a4d-7872-49d7-9b93-03958f6ea603 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 200 len: 1308 microversion: 2.1 time: 0.568384 May 27 15:20:11.602532 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2501/5001] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:11 2022] GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 1308 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:11.690761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-45cddb70-8b4d-4318-b6ba-51cbc57da829 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:11.698557 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-45cddb70-8b4d-4318-b6ba-51cbc57da829 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.457111 May 27 15:20:11.699179 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2501/5002] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:11 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:11.727466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9b069ec3-c5f5-4305-9d3f-dee6d1648732 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:11.728662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9b069ec3-c5f5-4305-9d3f-dee6d1648732 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:11.750494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b069ec3-c5f5-4305-9d3f-dee6d1648732 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:11.750956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b069ec3-c5f5-4305-9d3f-dee6d1648732 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:11.751751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b069ec3-c5f5-4305-9d3f-dee6d1648732 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:11.752197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b069ec3-c5f5-4305-9d3f-dee6d1648732 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:12.247853 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9b069ec3-c5f5-4305-9d3f-dee6d1648732 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:12.261179 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9b069ec3-c5f5-4305-9d3f-dee6d1648732 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.549305 May 27 15:20:12.277001 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2502/5003] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:11 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:12.288241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e7f8a803-9ab5-4727-8f52-ced35b20f578 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1563958259"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:12.296237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e7f8a803-9ab5-4727-8f52-ced35b20f578 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:12.304105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:12.320056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7f8a803-9ab5-4727-8f52-ced35b20f578 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:12.320534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7f8a803-9ab5-4727-8f52-ced35b20f578 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:12.322556 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7f8a803-9ab5-4727-8f52-ced35b20f578 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:12.323017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7f8a803-9ab5-4727-8f52-ced35b20f578 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:12.610503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d1e1e131-a90a-4580-8057-0e165b8040d6 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:12.611431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d1e1e131-a90a-4580-8057-0e165b8040d6 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:12.625300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1e1e131-a90a-4580-8057-0e165b8040d6 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:12.626054 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1e1e131-a90a-4580-8057-0e165b8040d6 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:12.627795 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1e1e131-a90a-4580-8057-0e165b8040d6 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:12.628291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1e1e131-a90a-4580-8057-0e165b8040d6 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:12.797973 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e7f8a803-9ab5-4727-8f52-ced35b20f578 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action" status: 202 len: 0 microversion: 2.1 time: 0.518250 May 27 15:20:12.801183 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2502/5004] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:20:12 2022] POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 27 15:20:13.139406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d1e1e131-a90a-4580-8057-0e165b8040d6 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:13.149742 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d1e1e131-a90a-4580-8057-0e165b8040d6 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 200 len: 1308 microversion: 2.1 time: 0.543339 May 27 15:20:13.157462 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2503/5005] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:12 2022] GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 1308 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:14.182117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b38e261b-5fc4-42f8-b560-f7f7a1461d6f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:14.183483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b38e261b-5fc4-42f8-b560-f7f7a1461d6f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:14.211962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b38e261b-5fc4-42f8-b560-f7f7a1461d6f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:14.212767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b38e261b-5fc4-42f8-b560-f7f7a1461d6f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:14.221124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b38e261b-5fc4-42f8-b560-f7f7a1461d6f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:14.221925 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b38e261b-5fc4-42f8-b560-f7f7a1461d6f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:14.438423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b38e261b-5fc4-42f8-b560-f7f7a1461d6f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:14.446661 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b38e261b-5fc4-42f8-b560-f7f7a1461d6f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 200 len: 1308 microversion: 2.1 time: 0.275037 May 27 15:20:14.449758 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2503/5006] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:14 2022] GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 1308 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:15.465966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7653ff0f-f34c-4402-9e68-43ee987f246a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:15.467347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7653ff0f-f34c-4402-9e68-43ee987f246a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:15.475084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:15.477441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=10 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:15.481420 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7653ff0f-f34c-4402-9e68-43ee987f246a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:15.482422 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7653ff0f-f34c-4402-9e68-43ee987f246a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:15.483906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7653ff0f-f34c-4402-9e68-43ee987f246a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:15.484599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7653ff0f-f34c-4402-9e68-43ee987f246a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:15.695779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7653ff0f-f34c-4402-9e68-43ee987f246a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:15.707177 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7653ff0f-f34c-4402-9e68-43ee987f246a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 200 len: 1308 microversion: 2.1 time: 0.246616 May 27 15:20:15.708405 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2504/5007] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:15 2022] GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 1308 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:16.469688 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-d2364ba8-edf5-489b-b82a-9a14f29e0d79 req-6acf965e-2f1c-489e-99e4-facc1fbd49ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43dd287d-127e-46be-97bd-7051aaccc3b5", "name": "network-vif-plugged", "status": "completed", "tag": "c6f28894-ce87-4b3d-9214-2362b03f3c1e"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:16.491726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d2364ba8-edf5-489b-b82a-9a14f29e0d79 req-6acf965e-2f1c-489e-99e4-facc1fbd49ad service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:16.492384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-d2364ba8-edf5-489b-b82a-9a14f29e0d79 req-6acf965e-2f1c-489e-99e4-facc1fbd49ad service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:16.522874 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-d2364ba8-edf5-489b-b82a-9a14f29e0d79 req-6acf965e-2f1c-489e-99e4-facc1fbd49ad service nova] Creating event network-vif-plugged:c6f28894-ce87-4b3d-9214-2362b03f3c1e for instance 43dd287d-127e-46be-97bd-7051aaccc3b5 on n-h2-843621-1 May 27 15:20:16.537342 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-d2364ba8-edf5-489b-b82a-9a14f29e0d79 req-6acf965e-2f1c-489e-99e4-facc1fbd49ad service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072817 May 27 15:20:16.538243 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2504/5008] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:16.730139 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b4c892a5-8e73-47f3-86a4-00dfc7955336 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:16.734570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b4c892a5-8e73-47f3-86a4-00dfc7955336 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:16.748621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4c892a5-8e73-47f3-86a4-00dfc7955336 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:16.752324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4c892a5-8e73-47f3-86a4-00dfc7955336 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:16.753880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4c892a5-8e73-47f3-86a4-00dfc7955336 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:16.756525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4c892a5-8e73-47f3-86a4-00dfc7955336 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:16.975888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b4c892a5-8e73-47f3-86a4-00dfc7955336 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:16.986687 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b4c892a5-8e73-47f3-86a4-00dfc7955336 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 200 len: 1308 microversion: 2.1 time: 0.264623 May 27 15:20:16.987757 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2505/5009] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:16 2022] GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 1308 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:17.165317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-73617eab-fc91-4d93-becf-108d43e80b52 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1372871589", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "a9e794a7-dbde-4216-ab7c-2edadb38bfd6"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:17.268457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-73617eab-fc91-4d93-becf-108d43e80b52 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] validate_networks() for [('a9e794a7-dbde-4216-ab7c-2edadb38bfd6', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:20:17.801546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-73617eab-fc91-4d93-becf-108d43e80b52 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:20:17.802355 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-73617eab-fc91-4d93-becf-108d43e80b52 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:20:17.804088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-73617eab-fc91-4d93-becf-108d43e80b52 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:20:17.804914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-73617eab-fc91-4d93-becf-108d43e80b52 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:20:17.806017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-73617eab-fc91-4d93-becf-108d43e80b52 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:20:17.820525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73617eab-fc91-4d93-becf-108d43e80b52 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:17.821720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73617eab-fc91-4d93-becf-108d43e80b52 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:17.823106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73617eab-fc91-4d93-becf-108d43e80b52 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:17.823782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73617eab-fc91-4d93-becf-108d43e80b52 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:17.840523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:17.855362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-73617eab-fc91-4d93-becf-108d43e80b52 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Getting quotas for project 09cf56d7b12b445aadc583eef99ea026. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:20:17.862917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-73617eab-fc91-4d93-becf-108d43e80b52 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Getting quotas for user c48e5dce95834fbe9e696865ed21ae0a and project 09cf56d7b12b445aadc583eef99ea026. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:20:17.890804 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-73617eab-fc91-4d93-becf-108d43e80b52 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:20:17.893466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-73617eab-fc91-4d93-becf-108d43e80b52 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:20:17.958779 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-73617eab-fc91-4d93-becf-108d43e80b52 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.329037 May 27 15:20:17.960383 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2505/5010] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 27 15:20:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1331 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 15:20:17.975220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4abed4c9-531a-4374-8abc-6d7c3b634e0d tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:17.976171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4abed4c9-531a-4374-8abc-6d7c3b634e0d tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:18.006438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b9cdddc5-f013-4062-b2ac-b263b7d82239 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:18.007423 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b9cdddc5-f013-4062-b2ac-b263b7d82239 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:18.023863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9cdddc5-f013-4062-b2ac-b263b7d82239 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:18.027469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9cdddc5-f013-4062-b2ac-b263b7d82239 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:18.030206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9cdddc5-f013-4062-b2ac-b263b7d82239 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:18.030917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9cdddc5-f013-4062-b2ac-b263b7d82239 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:18.106756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4abed4c9-531a-4374-8abc-6d7c3b634e0d tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:18.118523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4abed4c9-531a-4374-8abc-6d7c3b634e0d tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:18.124081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4abed4c9-531a-4374-8abc-6d7c3b634e0d tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:18.132701 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4abed4c9-531a-4374-8abc-6d7c3b634e0d tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183" status: 200 len: 1262 microversion: 2.26 time: 0.164850 May 27 15:20:18.141741 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2506/5011] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:17 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183 => generated 1262 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:18.264697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b9cdddc5-f013-4062-b2ac-b263b7d82239 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:18.274739 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b9cdddc5-f013-4062-b2ac-b263b7d82239 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 200 len: 1308 microversion: 2.1 time: 0.273152 May 27 15:20:18.275859 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2506/5012] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:17 2022] GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 1308 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:18.847138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2eb94c72-a96e-4f38-8b1a-4b0a0ac44a97 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b69a2877-bc02-4900-b2bc-3a01370a615f"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:18.849080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2eb94c72-a96e-4f38-8b1a-4b0a0ac44a97 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:18.861306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2eb94c72-a96e-4f38-8b1a-4b0a0ac44a97 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:18.864495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2eb94c72-a96e-4f38-8b1a-4b0a0ac44a97 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:18.865614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2eb94c72-a96e-4f38-8b1a-4b0a0ac44a97 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:18.866422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2eb94c72-a96e-4f38-8b1a-4b0a0ac44a97 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:19.022341 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-2eb94c72-a96e-4f38-8b1a-4b0a0ac44a97 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] HTTP exception thrown: Invalid volume: volume b69a2877-bc02-4900-b2bc-3a01370a615f is already attached to instances: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2eb94c72-a96e-4f38-8b1a-4b0a0ac44a97 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Request method failure captured: May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments HTTP/1.1 May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 74 May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOrMyApwEozUDyrEIfAo_5Y4g_1HkChw1SWcTHKZFCS59hbDZ-tG27fBruZ89SDVYIwJf1049Wu3YE4lY2cORLx6FEdOR4uGmA8kqdyyKM11lovRtNDp2ouZkjSiDmO17gaqasURXD2cDNTsBoZha7a41XrY22c7gADFUiZI3zmSCNg May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a9a825b1ade46e3a702ae19c7c53f6b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 59f88a11fc4b4bf6b4a807ccffee1fab May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: {"volumeAttachment": {"volumeId": "b69a2877-bc02-4900-b2bc-3a01370a615f"}} May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid volume: volume b69a2877-bc02-4900-b2bc-3a01370a615f is already attached to instances: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'server_id': '9b014831-b34a-4451-9bf7-f9a5d3dbb17f', 'body': {'volumeAttachment': {'volumeId': 'b69a2877-bc02-4900-b2bc-3a01370a615f'}}} May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b69a2877-bc02-4900-b2bc-3a01370a615f is already attached to instances: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:20:19.024929 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:20:19.031171 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:20:19.031171 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:20:19.031171 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 27 15:20:19.031171 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 15:20:19.031171 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b69a2877-bc02-4900-b2bc-3a01370a615f is already attached to instances: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f May 27 15:20:19.031171 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:20:19.031171 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:19.031171 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:20:19.031171 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:19.031171 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:19.031171 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:19.031171 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:20:19.031171 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:20:19.031171 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b69a2877-bc02-4900-b2bc-3a01370a615f is already attached to instances: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f May 27 15:20:19.031171 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:20:19.031171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2eb94c72-a96e-4f38-8b1a-4b0a0ac44a97 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Returning 400 to user: Invalid volume: volume b69a2877-bc02-4900-b2bc-3a01370a615f is already attached to instances: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:20:19.031171 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2eb94c72-a96e-4f38-8b1a-4b0a0ac44a97 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "POST /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.184375 May 27 15:20:19.037093 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2507/5013] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 15:20:18 2022] POST /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 174 bytes in 195 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:20:19.154130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e663a889-13bc-400b-8b00-cfeeb431b8bb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:19.154818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e663a889-13bc-400b-8b00-cfeeb431b8bb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:19.155227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-da61dc08-5ee3-453b-a0fc-0e5ccc77f50f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:19.155864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-da61dc08-5ee3-453b-a0fc-0e5ccc77f50f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:19.165830 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e663a889-13bc-400b-8b00-cfeeb431b8bb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:19.166487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da61dc08-5ee3-453b-a0fc-0e5ccc77f50f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:19.167411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da61dc08-5ee3-453b-a0fc-0e5ccc77f50f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:19.169475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da61dc08-5ee3-453b-a0fc-0e5ccc77f50f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:19.170055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e663a889-13bc-400b-8b00-cfeeb431b8bb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:19.170232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da61dc08-5ee3-453b-a0fc-0e5ccc77f50f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:19.170889 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e663a889-13bc-400b-8b00-cfeeb431b8bb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:19.173409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e663a889-13bc-400b-8b00-cfeeb431b8bb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:19.335799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e663a889-13bc-400b-8b00-cfeeb431b8bb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:19.346470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e663a889-13bc-400b-8b00-cfeeb431b8bb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:19.351941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e663a889-13bc-400b-8b00-cfeeb431b8bb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:19.356074 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e663a889-13bc-400b-8b00-cfeeb431b8bb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183" status: 200 len: 1258 microversion: 2.26 time: 0.207210 May 27 15:20:19.360067 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2508/5014] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:19 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183 => generated 1258 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:19.372837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-da61dc08-5ee3-453b-a0fc-0e5ccc77f50f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lazy-loading 'services' on Instance uuid 9b014831-b34a-4451-9bf7-f9a5d3dbb17f {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:19.378913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-10483505-f36b-4ea4-96ed-994cf777a79d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:19.380399 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-10483505-f36b-4ea4-96ed-994cf777a79d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:19.393458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10483505-f36b-4ea4-96ed-994cf777a79d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:19.394174 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10483505-f36b-4ea4-96ed-994cf777a79d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:19.396722 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10483505-f36b-4ea4-96ed-994cf777a79d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:19.397348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10483505-f36b-4ea4-96ed-994cf777a79d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:19.587014 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-da61dc08-5ee3-453b-a0fc-0e5ccc77f50f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments/b69a2877-bc02-4900-b2bc-3a01370a615f" status: 202 len: 0 microversion: 2.1 time: 0.444533 May 27 15:20:19.587791 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2507/5015] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 15:20:19 2022] DELETE /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments/b69a2877-bc02-4900-b2bc-3a01370a615f => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:20:19.600742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3f6e44cf-40cc-40bc-8860-4bdb499e809a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:19.610311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3f6e44cf-40cc-40bc-8860-4bdb499e809a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:19.624193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f6e44cf-40cc-40bc-8860-4bdb499e809a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:19.625152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f6e44cf-40cc-40bc-8860-4bdb499e809a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:19.629077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f6e44cf-40cc-40bc-8860-4bdb499e809a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:19.629873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f6e44cf-40cc-40bc-8860-4bdb499e809a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:19.709544 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3f6e44cf-40cc-40bc-8860-4bdb499e809a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115226 May 27 15:20:19.716217 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2508/5016] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:19 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:19.777758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-10483505-f36b-4ea4-96ed-994cf777a79d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:19.786451 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-10483505-f36b-4ea4-96ed-994cf777a79d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 200 len: 1489 microversion: 2.1 time: 0.425007 May 27 15:20:19.787038 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2509/5017] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:19 2022] GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 1489 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:19.804602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c3d41889-19bf-4350-8d66-ed7ea7d3ed21 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:19.805520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c3d41889-19bf-4350-8d66-ed7ea7d3ed21 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:19.815065 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3d41889-19bf-4350-8d66-ed7ea7d3ed21 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:19.815794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3d41889-19bf-4350-8d66-ed7ea7d3ed21 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:19.817692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3d41889-19bf-4350-8d66-ed7ea7d3ed21 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:19.818872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3d41889-19bf-4350-8d66-ed7ea7d3ed21 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:20.016912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-ed0eae79-dd3f-4fbc-92a7-48ac1d9e3a02 req-77f5b525-af8e-48cd-9d3c-c961d05ecca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812d42c0-07f1-4f7c-83b8-848b18cf0186", "name": "network-vif-plugged", "status": "completed", "tag": "0d9da5e7-a50c-4ddd-aca9-02eae7d0476c"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:20.040531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-ed0eae79-dd3f-4fbc-92a7-48ac1d9e3a02 req-77f5b525-af8e-48cd-9d3c-c961d05ecca4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:20.041158 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-ed0eae79-dd3f-4fbc-92a7-48ac1d9e3a02 req-77f5b525-af8e-48cd-9d3c-c961d05ecca4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:20.057535 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c3d41889-19bf-4350-8d66-ed7ea7d3ed21 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:20.068769 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-ed0eae79-dd3f-4fbc-92a7-48ac1d9e3a02 req-77f5b525-af8e-48cd-9d3c-c961d05ecca4 service nova] Creating event network-vif-plugged:0d9da5e7-a50c-4ddd-aca9-02eae7d0476c for instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 on n-h1-843621-1 May 27 15:20:20.072535 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c3d41889-19bf-4350-8d66-ed7ea7d3ed21 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 200 len: 1489 microversion: 2.1 time: 0.266883 May 27 15:20:20.083709 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2509/5018] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:19 2022] GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 1489 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:20.083929 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-ed0eae79-dd3f-4fbc-92a7-48ac1d9e3a02 req-77f5b525-af8e-48cd-9d3c-c961d05ecca4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062593 May 27 15:20:20.083929 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2510/5019] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:20.093618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-377c5456-bfea-4766-b8aa-33e2711e5291 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:20.094273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-377c5456-bfea-4766-b8aa-33e2711e5291 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:20.103317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-377c5456-bfea-4766-b8aa-33e2711e5291 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:20.103999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-377c5456-bfea-4766-b8aa-33e2711e5291 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:20.104985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-377c5456-bfea-4766-b8aa-33e2711e5291 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:20.106005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-377c5456-bfea-4766-b8aa-33e2711e5291 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:20.348583 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-377c5456-bfea-4766-b8aa-33e2711e5291 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:20.378639 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-377c5456-bfea-4766-b8aa-33e2711e5291 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 200 len: 1489 microversion: 2.1 time: 0.292751 May 27 15:20:20.381581 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2510/5020] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:20 2022] GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 1489 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:20.385677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fd81d146-6791-45db-a202-1e1d533cf9bc tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:20.388598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fd81d146-6791-45db-a202-1e1d533cf9bc tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:20.401160 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd81d146-6791-45db-a202-1e1d533cf9bc tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:20.402223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd81d146-6791-45db-a202-1e1d533cf9bc tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:20.405089 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd81d146-6791-45db-a202-1e1d533cf9bc tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:20.405875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd81d146-6791-45db-a202-1e1d533cf9bc tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:20.406704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0a1b28ed-66cd-4a54-b505-690ef89179ea tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:20.407427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0a1b28ed-66cd-4a54-b505-690ef89179ea tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:20.427282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a1b28ed-66cd-4a54-b505-690ef89179ea tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:20.429094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a1b28ed-66cd-4a54-b505-690ef89179ea tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:20.431957 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a1b28ed-66cd-4a54-b505-690ef89179ea tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:20.433927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a1b28ed-66cd-4a54-b505-690ef89179ea tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:20.477610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0a1b28ed-66cd-4a54-b505-690ef89179ea tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:20:20.638716 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0a1b28ed-66cd-4a54-b505-690ef89179ea tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "DELETE /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 204 len: 0 microversion: 2.1 time: 0.243857 May 27 15:20:20.639619 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2511/5021] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:20:20 2022] DELETE /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:20:20.658790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fd81d146-6791-45db-a202-1e1d533cf9bc tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:20.669689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7aeead10-ade0-45c2-9ae5-a4e84777b35e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:20.670563 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7aeead10-ade0-45c2-9ae5-a4e84777b35e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:20.675307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fd81d146-6791-45db-a202-1e1d533cf9bc tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:20.678531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fd81d146-6791-45db-a202-1e1d533cf9bc tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:20.679848 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fd81d146-6791-45db-a202-1e1d533cf9bc tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183" status: 200 len: 1322 microversion: 2.26 time: 0.305310 May 27 15:20:20.683079 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2511/5022] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:20 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:20.685219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7aeead10-ade0-45c2-9ae5-a4e84777b35e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:20.685681 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7aeead10-ade0-45c2-9ae5-a4e84777b35e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:20.686467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7aeead10-ade0-45c2-9ae5-a4e84777b35e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:20.686911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7aeead10-ade0-45c2-9ae5-a4e84777b35e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:20.723513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2cae8d54-dd7c-4860-9bb3-baca082007e1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:20.724909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2cae8d54-dd7c-4860-9bb3-baca082007e1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:20.736106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2cae8d54-dd7c-4860-9bb3-baca082007e1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:20.738161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2cae8d54-dd7c-4860-9bb3-baca082007e1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:20.741157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2cae8d54-dd7c-4860-9bb3-baca082007e1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:20.741883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2cae8d54-dd7c-4860-9bb3-baca082007e1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:20.799422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:20.809640 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2cae8d54-dd7c-4860-9bb3-baca082007e1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090809 May 27 15:20:20.810246 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2512/5023] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:20 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:20:21.016224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7aeead10-ade0-45c2-9ae5-a4e84777b35e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:21.028095 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7aeead10-ade0-45c2-9ae5-a4e84777b35e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 200 len: 1495 microversion: 2.1 time: 0.383368 May 27 15:20:21.029602 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2512/5024] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:20 2022] GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 1495 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:21.700329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dc546680-09a3-4966-bdd7-75796069f7d9 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:21.701005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dc546680-09a3-4966-bdd7-75796069f7d9 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:21.714160 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dc546680-09a3-4966-bdd7-75796069f7d9 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:21.715195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dc546680-09a3-4966-bdd7-75796069f7d9 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:21.716085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dc546680-09a3-4966-bdd7-75796069f7d9 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:21.716531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dc546680-09a3-4966-bdd7-75796069f7d9 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:21.822366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-abd8be66-0d71-4750-b8f3-12da01013fc0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:21.825415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-abd8be66-0d71-4750-b8f3-12da01013fc0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:21.848167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-abd8be66-0d71-4750-b8f3-12da01013fc0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:21.864033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-abd8be66-0d71-4750-b8f3-12da01013fc0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:21.865315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-abd8be66-0d71-4750-b8f3-12da01013fc0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:21.865981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-abd8be66-0d71-4750-b8f3-12da01013fc0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:21.950875 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-abd8be66-0d71-4750-b8f3-12da01013fc0 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133267 May 27 15:20:21.963258 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2513/5025] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:21 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:21.972452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dc546680-09a3-4966-bdd7-75796069f7d9 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:21.982645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dc546680-09a3-4966-bdd7-75796069f7d9 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:21.987313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dc546680-09a3-4966-bdd7-75796069f7d9 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:22.005107 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dc546680-09a3-4966-bdd7-75796069f7d9 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183" status: 200 len: 1320 microversion: 2.26 time: 0.301773 May 27 15:20:22.017947 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2513/5026] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:21 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183 => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:22.050340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5fd77827-a953-4d06-a258-7a34b8678b14 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:22.051176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5fd77827-a953-4d06-a258-7a34b8678b14 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:22.073545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fd77827-a953-4d06-a258-7a34b8678b14 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:22.079181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fd77827-a953-4d06-a258-7a34b8678b14 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:22.081377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fd77827-a953-4d06-a258-7a34b8678b14 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:22.086314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fd77827-a953-4d06-a258-7a34b8678b14 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:22.462137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5fd77827-a953-4d06-a258-7a34b8678b14 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:22.475796 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5fd77827-a953-4d06-a258-7a34b8678b14 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 200 len: 1495 microversion: 2.1 time: 0.431430 May 27 15:20:22.477297 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2514/5027] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:22 2022] GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 1495 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:22.973491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b9a94042-09c6-40d1-9d7b-f0b341b6432a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:22.974522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b9a94042-09c6-40d1-9d7b-f0b341b6432a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:22.988419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9a94042-09c6-40d1-9d7b-f0b341b6432a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:23.001917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9a94042-09c6-40d1-9d7b-f0b341b6432a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:23.011265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9a94042-09c6-40d1-9d7b-f0b341b6432a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:23.012600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9a94042-09c6-40d1-9d7b-f0b341b6432a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:23.025079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-638b1549-d485-473f-9b82-96fc34999117 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:23.025879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-638b1549-d485-473f-9b82-96fc34999117 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:23.052446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-638b1549-d485-473f-9b82-96fc34999117 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:23.054886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-638b1549-d485-473f-9b82-96fc34999117 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:23.058992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-638b1549-d485-473f-9b82-96fc34999117 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:23.059802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-638b1549-d485-473f-9b82-96fc34999117 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:23.128737 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b9a94042-09c6-40d1-9d7b-f0b341b6432a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145807 May 27 15:20:23.131505 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2514/5028] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:22 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:23.447813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-638b1549-d485-473f-9b82-96fc34999117 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:23.459036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-638b1549-d485-473f-9b82-96fc34999117 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:23.461360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-638b1549-d485-473f-9b82-96fc34999117 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:23.463425 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-638b1549-d485-473f-9b82-96fc34999117 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183" status: 200 len: 1362 microversion: 2.26 time: 0.442280 May 27 15:20:23.464319 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2515/5029] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:23 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183 => generated 1362 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:20:23.496138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4df2b49d-9eb4-495c-aebe-779c0474c636 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:23.496710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4df2b49d-9eb4-495c-aebe-779c0474c636 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:23.506775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4df2b49d-9eb4-495c-aebe-779c0474c636 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:23.508246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4df2b49d-9eb4-495c-aebe-779c0474c636 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:23.512259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4df2b49d-9eb4-495c-aebe-779c0474c636 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:23.515282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4df2b49d-9eb4-495c-aebe-779c0474c636 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:23.989772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4df2b49d-9eb4-495c-aebe-779c0474c636 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:24.017748 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4df2b49d-9eb4-495c-aebe-779c0474c636 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 200 len: 1495 microversion: 2.1 time: 0.525945 May 27 15:20:24.024090 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2515/5030] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:23 2022] GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 1495 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:24.142552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5362a41e-2565-4d0f-8ef3-0306116d84a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:24.144564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5362a41e-2565-4d0f-8ef3-0306116d84a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:24.165488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5362a41e-2565-4d0f-8ef3-0306116d84a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:24.169417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5362a41e-2565-4d0f-8ef3-0306116d84a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:24.170843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5362a41e-2565-4d0f-8ef3-0306116d84a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:24.173888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5362a41e-2565-4d0f-8ef3-0306116d84a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:24.257323 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5362a41e-2565-4d0f-8ef3-0306116d84a6 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120236 May 27 15:20:24.275108 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2516/5031] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:24 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:24.413401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-31729793-ac9f-4c7d-8af5-3b358e1e4472 req-2cadce48-21a6-4f0d-9d58-f2fcf8bbd84c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43dd287d-127e-46be-97bd-7051aaccc3b5", "name": "network-vif-deleted", "tag": "c6f28894-ce87-4b3d-9214-2362b03f3c1e"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:24.473222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-31729793-ac9f-4c7d-8af5-3b358e1e4472 req-2cadce48-21a6-4f0d-9d58-f2fcf8bbd84c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:24.479327 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-31729793-ac9f-4c7d-8af5-3b358e1e4472 req-2cadce48-21a6-4f0d-9d58-f2fcf8bbd84c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:24.484800 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-89a317b6-0b3b-42e5-9b5e-918fbd74204a tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:24.485467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-89a317b6-0b3b-42e5-9b5e-918fbd74204a tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:24.500943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89a317b6-0b3b-42e5-9b5e-918fbd74204a tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:24.501497 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89a317b6-0b3b-42e5-9b5e-918fbd74204a tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:24.505324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89a317b6-0b3b-42e5-9b5e-918fbd74204a tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:24.506495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89a317b6-0b3b-42e5-9b5e-918fbd74204a tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:24.547232 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-31729793-ac9f-4c7d-8af5-3b358e1e4472 req-2cadce48-21a6-4f0d-9d58-f2fcf8bbd84c service nova] Creating event network-vif-deleted:c6f28894-ce87-4b3d-9214-2362b03f3c1e for instance 43dd287d-127e-46be-97bd-7051aaccc3b5 on n-h2-843621-1 May 27 15:20:24.560501 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-31729793-ac9f-4c7d-8af5-3b358e1e4472 req-2cadce48-21a6-4f0d-9d58-f2fcf8bbd84c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152964 May 27 15:20:24.562424 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2516/5032] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:24.927911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-89a317b6-0b3b-42e5-9b5e-918fbd74204a tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:24.937044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-89a317b6-0b3b-42e5-9b5e-918fbd74204a tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:24.940916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-89a317b6-0b3b-42e5-9b5e-918fbd74204a tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:24.942546 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-89a317b6-0b3b-42e5-9b5e-918fbd74204a tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183" status: 200 len: 1362 microversion: 2.26 time: 0.463274 May 27 15:20:24.943275 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2517/5033] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:24 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183 => generated 1362 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:25.041304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2ee47680-9c53-4105-a96b-6068c14a5e8b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:25.042023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2ee47680-9c53-4105-a96b-6068c14a5e8b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:25.049873 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ee47680-9c53-4105-a96b-6068c14a5e8b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:25.057345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ee47680-9c53-4105-a96b-6068c14a5e8b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:25.059147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ee47680-9c53-4105-a96b-6068c14a5e8b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:25.060035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ee47680-9c53-4105-a96b-6068c14a5e8b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:25.184783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ee47680-9c53-4105-a96b-6068c14a5e8b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:25.186369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ee47680-9c53-4105-a96b-6068c14a5e8b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:25.188048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-2ee47680-9c53-4105-a96b-6068c14a5e8b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lazy-loading 'fault' on Instance uuid 43dd287d-127e-46be-97bd-7051aaccc3b5 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:25.273682 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-78cef427-2e1d-43c3-84b5-c818586e4850 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:25.276497 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-78cef427-2e1d-43c3-84b5-c818586e4850 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:25.301516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2ee47680-9c53-4105-a96b-6068c14a5e8b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:25.301858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-78cef427-2e1d-43c3-84b5-c818586e4850 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:25.310256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-78cef427-2e1d-43c3-84b5-c818586e4850 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:25.311222 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2ee47680-9c53-4105-a96b-6068c14a5e8b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 200 len: 1298 microversion: 2.1 time: 0.275349 May 27 15:20:25.313022 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-78cef427-2e1d-43c3-84b5-c818586e4850 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:25.314606 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2517/5034] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:25 2022] GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 1298 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:25.317420 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-78cef427-2e1d-43c3-84b5-c818586e4850 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:25.415145 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-78cef427-2e1d-43c3-84b5-c818586e4850 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148805 May 27 15:20:25.416519 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2518/5035] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:25 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:20:25.962554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-21337385-2de1-492b-9da9-c1369b8ef662 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:25.964262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-21337385-2de1-492b-9da9-c1369b8ef662 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:25.979513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21337385-2de1-492b-9da9-c1369b8ef662 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:25.993076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21337385-2de1-492b-9da9-c1369b8ef662 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:25.996051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21337385-2de1-492b-9da9-c1369b8ef662 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:25.998569 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21337385-2de1-492b-9da9-c1369b8ef662 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.314230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-21337385-2de1-492b-9da9-c1369b8ef662 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:26.325901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-21337385-2de1-492b-9da9-c1369b8ef662 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:26.328264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-21337385-2de1-492b-9da9-c1369b8ef662 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:26.329952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f6b4e22c-1ac5-49f6-9041-240cd701ebfc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:26.330824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f6b4e22c-1ac5-49f6-9041-240cd701ebfc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:26.331663 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-21337385-2de1-492b-9da9-c1369b8ef662 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183" status: 200 len: 1362 microversion: 2.26 time: 0.373701 May 27 15:20:26.332833 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2518/5036] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:25 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183 => generated 1362 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:26.391598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6b4e22c-1ac5-49f6-9041-240cd701ebfc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.392252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6b4e22c-1ac5-49f6-9041-240cd701ebfc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.401856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6b4e22c-1ac5-49f6-9041-240cd701ebfc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.403070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6b4e22c-1ac5-49f6-9041-240cd701ebfc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.429382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-181e4eca-b1a3-4185-99ca-59f55cdb5c51 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:26.430455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-181e4eca-b1a3-4185-99ca-59f55cdb5c51 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:26.442195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-181e4eca-b1a3-4185-99ca-59f55cdb5c51 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.444972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-181e4eca-b1a3-4185-99ca-59f55cdb5c51 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.445979 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-181e4eca-b1a3-4185-99ca-59f55cdb5c51 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.455084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-181e4eca-b1a3-4185-99ca-59f55cdb5c51 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.472710 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-f6b4e22c-1ac5-49f6-9041-240cd701ebfc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance 43dd287d-127e-46be-97bd-7051aaccc3b5 could not be found. May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f6b4e22c-1ac5-49f6-9041-240cd701ebfc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 HTTP/1.1 May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 43dd287d-127e-46be-97bd-7051aaccc3b5 could not be found. May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '43dd287d-127e-46be-97bd-7051aaccc3b5'} May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43dd287d-127e-46be-97bd-7051aaccc3b5 could not be found. May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43dd287d-127e-46be-97bd-7051aaccc3b5 could not be found. May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:20:26.474701 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:26.479395 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:26.479395 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:26.479395 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:20:26.479395 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:20:26.479395 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43dd287d-127e-46be-97bd-7051aaccc3b5 could not be found. May 27 15:20:26.479395 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:20:26.481313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f6b4e22c-1ac5-49f6-9041-240cd701ebfc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance 43dd287d-127e-46be-97bd-7051aaccc3b5 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:20:26.482993 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f6b4e22c-1ac5-49f6-9041-240cd701ebfc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 404 len: 111 microversion: 2.1 time: 0.157285 May 27 15:20:26.485156 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2519/5037] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:26 2022] GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:20:26.497424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7f083614-b74d-4381-856a-ee3fd41e7089 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:26.498202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7f083614-b74d-4381-856a-ee3fd41e7089 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:26.505706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f083614-b74d-4381-856a-ee3fd41e7089 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.506403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f083614-b74d-4381-856a-ee3fd41e7089 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.507359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f083614-b74d-4381-856a-ee3fd41e7089 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.507958 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f083614-b74d-4381-856a-ee3fd41e7089 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.593503 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-181e4eca-b1a3-4185-99ca-59f55cdb5c51 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169720 May 27 15:20:26.597443 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2519/5038] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:26 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:20:26.599534 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7f083614-b74d-4381-856a-ee3fd41e7089 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:20:26.604078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:26.630584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-e8d759d9-d3dd-410f-9b29-fe6baa395692 req-f832494a-1738-44d5-a52a-d27c7f34f177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37acc336-598b-4d82-8f06-0f405cc51183", "tag": "9e6c7f64-97a6-4a2c-9ee7-1d1f21f01048"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:26.647312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e8d759d9-d3dd-410f-9b29-fe6baa395692 req-f832494a-1738-44d5-a52a-d27c7f34f177 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.648031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e8d759d9-d3dd-410f-9b29-fe6baa395692 req-f832494a-1738-44d5-a52a-d27c7f34f177 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.675635 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-e8d759d9-d3dd-410f-9b29-fe6baa395692 req-f832494a-1738-44d5-a52a-d27c7f34f177 service nova] Creating event network-changed:9e6c7f64-97a6-4a2c-9ee7-1d1f21f01048 for instance 37acc336-598b-4d82-8f06-0f405cc51183 on n-h1-843621-1 May 27 15:20:26.684501 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-e8d759d9-d3dd-410f-9b29-fe6baa395692 req-f832494a-1738-44d5-a52a-d27c7f34f177 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056566 May 27 15:20:26.685446 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2520/5039] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:20:26.764484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:26.773138 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7f083614-b74d-4381-856a-ee3fd41e7089 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "DELETE /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 204 len: 0 microversion: 2.1 time: 0.281429 May 27 15:20:26.778171 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2520/5040] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:20:26 2022] DELETE /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:20:26.783722 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-792c02a9-938f-41a7-a2ee-983871e278b8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:26.784653 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-792c02a9-938f-41a7-a2ee-983871e278b8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:26.798545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-792c02a9-938f-41a7-a2ee-983871e278b8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.799249 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-792c02a9-938f-41a7-a2ee-983871e278b8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.807867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-792c02a9-938f-41a7-a2ee-983871e278b8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.809296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-792c02a9-938f-41a7-a2ee-983871e278b8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:27.152840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-792c02a9-938f-41a7-a2ee-983871e278b8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:27.163113 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-792c02a9-938f-41a7-a2ee-983871e278b8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 200 len: 1495 microversion: 2.1 time: 0.383652 May 27 15:20:27.170933 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2521/5041] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:26 2022] GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 1495 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:27.350936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6b061773-336b-406b-9d56-790f7857baec tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:27.351638 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6b061773-336b-406b-9d56-790f7857baec tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:27.379555 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b061773-336b-406b-9d56-790f7857baec tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:27.380016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b061773-336b-406b-9d56-790f7857baec tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:27.380834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b061773-336b-406b-9d56-790f7857baec tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:27.381280 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b061773-336b-406b-9d56-790f7857baec tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:27.615511 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e53b2e02-713e-4cfd-b7d7-684ce4994bcc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:27.616542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e53b2e02-713e-4cfd-b7d7-684ce4994bcc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:27.630506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e53b2e02-713e-4cfd-b7d7-684ce4994bcc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:27.630771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e53b2e02-713e-4cfd-b7d7-684ce4994bcc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:27.631586 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e53b2e02-713e-4cfd-b7d7-684ce4994bcc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:27.638300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e53b2e02-713e-4cfd-b7d7-684ce4994bcc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:27.723947 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e53b2e02-713e-4cfd-b7d7-684ce4994bcc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113294 May 27 15:20:27.732238 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2522/5042] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:27 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:20:27.767852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6b061773-336b-406b-9d56-790f7857baec tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:27.784020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6b061773-336b-406b-9d56-790f7857baec tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:27.791069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6b061773-336b-406b-9d56-790f7857baec tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:27.797922 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6b061773-336b-406b-9d56-790f7857baec tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183" status: 200 len: 1362 microversion: 2.26 time: 0.451378 May 27 15:20:27.798808 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2521/5043] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:27 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183 => generated 1362 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:28.188449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4a7a331f-a663-42b4-a164-26644c2f8f77 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:28.189474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4a7a331f-a663-42b4-a164-26644c2f8f77 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:28.198329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:28.205535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a7a331f-a663-42b4-a164-26644c2f8f77 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:28.207292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a7a331f-a663-42b4-a164-26644c2f8f77 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:28.209614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a7a331f-a663-42b4-a164-26644c2f8f77 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:28.211264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a7a331f-a663-42b4-a164-26644c2f8f77 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:28.736311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9807471e-aa2e-4f23-9771-8929219f4189 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:28.738510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9807471e-aa2e-4f23-9771-8929219f4189 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:28.753832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:28.755588 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:28.761035 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9807471e-aa2e-4f23-9771-8929219f4189 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:28.772992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9807471e-aa2e-4f23-9771-8929219f4189 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:28.774261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9807471e-aa2e-4f23-9771-8929219f4189 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:28.774930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9807471e-aa2e-4f23-9771-8929219f4189 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:28.924327 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9807471e-aa2e-4f23-9771-8929219f4189 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192080 May 27 15:20:28.926543 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2522/5044] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:28 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:20:28.948404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5d23fc05-1660-4226-a242-43bbdbb4f7dd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:28.951326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5d23fc05-1660-4226-a242-43bbdbb4f7dd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:28.969118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d23fc05-1660-4226-a242-43bbdbb4f7dd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:28.970902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d23fc05-1660-4226-a242-43bbdbb4f7dd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:28.971857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d23fc05-1660-4226-a242-43bbdbb4f7dd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:28.972328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d23fc05-1660-4226-a242-43bbdbb4f7dd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:29.023880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4a7a331f-a663-42b4-a164-26644c2f8f77 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:29.044763 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4a7a331f-a663-42b4-a164-26644c2f8f77 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 200 len: 1495 microversion: 2.1 time: 0.859594 May 27 15:20:29.046977 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2523/5045] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:28 2022] GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 1495 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:29.414374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5d23fc05-1660-4226-a242-43bbdbb4f7dd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:29.425757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5d23fc05-1660-4226-a242-43bbdbb4f7dd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:29.429551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5d23fc05-1660-4226-a242-43bbdbb4f7dd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:29.430756 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5d23fc05-1660-4226-a242-43bbdbb4f7dd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183" status: 200 len: 1362 microversion: 2.26 time: 0.496582 May 27 15:20:29.443984 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2523/5046] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:28 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183 => generated 1362 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:29.938667 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-88780b74-1b5d-4449-9cc3-65acac3a46ed tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:29.940041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-88780b74-1b5d-4449-9cc3-65acac3a46ed tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:29.967103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88780b74-1b5d-4449-9cc3-65acac3a46ed tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:29.969237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88780b74-1b5d-4449-9cc3-65acac3a46ed tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:29.970545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88780b74-1b5d-4449-9cc3-65acac3a46ed tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:29.971156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88780b74-1b5d-4449-9cc3-65acac3a46ed tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:30.080940 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-88780b74-1b5d-4449-9cc3-65acac3a46ed tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147796 May 27 15:20:30.084169 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2524/5047] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:29 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:30.101755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2c954dfa-5e70-4751-b327-fe6a4f1b3647 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:30.102379 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2c954dfa-5e70-4751-b327-fe6a4f1b3647 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:30.132339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c954dfa-5e70-4751-b327-fe6a4f1b3647 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:30.132940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c954dfa-5e70-4751-b327-fe6a4f1b3647 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:30.133629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c954dfa-5e70-4751-b327-fe6a4f1b3647 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:30.136872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c954dfa-5e70-4751-b327-fe6a4f1b3647 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:30.451366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c61362da-2cf6-4cdf-ab6d-13e5dba4a943 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:30.452653 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c61362da-2cf6-4cdf-ab6d-13e5dba4a943 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:30.462005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c61362da-2cf6-4cdf-ab6d-13e5dba4a943 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:30.462718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c61362da-2cf6-4cdf-ab6d-13e5dba4a943 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:30.465287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c61362da-2cf6-4cdf-ab6d-13e5dba4a943 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:30.466048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c61362da-2cf6-4cdf-ab6d-13e5dba4a943 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:30.848760 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2c954dfa-5e70-4751-b327-fe6a4f1b3647 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:30.858487 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2c954dfa-5e70-4751-b327-fe6a4f1b3647 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 200 len: 1495 microversion: 2.1 time: 0.798322 May 27 15:20:30.861323 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2524/5048] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:30 2022] GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 1495 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:30.886041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-05dd1792-1ddc-4c09-a20a-0d3cf4f16060 req-0db30e87-6db6-429a-9a65-5b85364c2292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36a5db54-c75b-4a95-9b2f-3f4ac68d345e", "name": "network-vif-deleted", "tag": "b369df5e-fca2-45e6-b32d-d97fbc0d5fad"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:30.906426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-05dd1792-1ddc-4c09-a20a-0d3cf4f16060 req-0db30e87-6db6-429a-9a65-5b85364c2292 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:30.906988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-05dd1792-1ddc-4c09-a20a-0d3cf4f16060 req-0db30e87-6db6-429a-9a65-5b85364c2292 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:30.934482 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-05dd1792-1ddc-4c09-a20a-0d3cf4f16060 req-0db30e87-6db6-429a-9a65-5b85364c2292 service nova] Creating event network-vif-deleted:b369df5e-fca2-45e6-b32d-d97fbc0d5fad for instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e on n-h2-843621-1 May 27 15:20:30.945648 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-05dd1792-1ddc-4c09-a20a-0d3cf4f16060 req-0db30e87-6db6-429a-9a65-5b85364c2292 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069286 May 27 15:20:30.947097 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2525/5049] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:31.071677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c61362da-2cf6-4cdf-ab6d-13e5dba4a943 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:31.082647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c61362da-2cf6-4cdf-ab6d-13e5dba4a943 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:31.084822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c61362da-2cf6-4cdf-ab6d-13e5dba4a943 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:31.086213 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c61362da-2cf6-4cdf-ab6d-13e5dba4a943 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183" status: 200 len: 1362 microversion: 2.26 time: 0.641874 May 27 15:20:31.099169 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2525/5050] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:30 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183 => generated 1362 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:31.101338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-20fa0282-eae1-4bc8-847f-ba95f5316059 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:31.102377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-20fa0282-eae1-4bc8-847f-ba95f5316059 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:31.119104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20fa0282-eae1-4bc8-847f-ba95f5316059 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:31.119559 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20fa0282-eae1-4bc8-847f-ba95f5316059 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:31.120353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20fa0282-eae1-4bc8-847f-ba95f5316059 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:31.122178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20fa0282-eae1-4bc8-847f-ba95f5316059 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:31.315696 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-20fa0282-eae1-4bc8-847f-ba95f5316059 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221987 May 27 15:20:31.321970 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2526/5051] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:31 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 197 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:20:31.879243 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-85772798-9eb9-4b4f-b4a6-2000ee249d07 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:31.880030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-85772798-9eb9-4b4f-b4a6-2000ee249d07 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:31.892456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85772798-9eb9-4b4f-b4a6-2000ee249d07 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:31.894618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85772798-9eb9-4b4f-b4a6-2000ee249d07 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:31.898470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85772798-9eb9-4b4f-b4a6-2000ee249d07 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:31.899131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85772798-9eb9-4b4f-b4a6-2000ee249d07 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:31.942315 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-85772798-9eb9-4b4f-b4a6-2000ee249d07 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e could not be found. May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-85772798-9eb9-4b4f-b4a6-2000ee249d07 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e HTTP/1.1 May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e could not be found. May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '36a5db54-c75b-4a95-9b2f-3f4ac68d345e'} May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e could not be found. May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e could not be found. May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:20:31.956641 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:31.960629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:31.960629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:31.960629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:20:31.960629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:20:31.960629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e could not be found. May 27 15:20:31.960629 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:20:31.964253 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-85772798-9eb9-4b4f-b4a6-2000ee249d07 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:20:31.968103 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-85772798-9eb9-4b4f-b4a6-2000ee249d07 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 404 len: 111 microversion: 2.1 time: 0.093431 May 27 15:20:31.973991 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2526/5052] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:31 2022] GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:20:32.107775 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4b454ae7-15c9-4e94-8e7b-e7bd9b2f68fb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:32.109258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4b454ae7-15c9-4e94-8e7b-e7bd9b2f68fb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:32.131911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7a471af4-4ef4-4f21-8e84-c6b8f3b49e33 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-648283472", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "679b759f-4940-4405-a687-165c11fb616b"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:32.132716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b454ae7-15c9-4e94-8e7b-e7bd9b2f68fb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:32.133676 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b454ae7-15c9-4e94-8e7b-e7bd9b2f68fb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:32.135051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b454ae7-15c9-4e94-8e7b-e7bd9b2f68fb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:32.137161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b454ae7-15c9-4e94-8e7b-e7bd9b2f68fb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:32.251238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-7a471af4-4ef4-4f21-8e84-c6b8f3b49e33 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] validate_networks() for [('679b759f-4940-4405-a687-165c11fb616b', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:20:32.568337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4b454ae7-15c9-4e94-8e7b-e7bd9b2f68fb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:32.582053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4b454ae7-15c9-4e94-8e7b-e7bd9b2f68fb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:32.587234 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4b454ae7-15c9-4e94-8e7b-e7bd9b2f68fb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:32.588927 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4b454ae7-15c9-4e94-8e7b-e7bd9b2f68fb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183" status: 200 len: 1362 microversion: 2.26 time: 0.486185 May 27 15:20:32.604775 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2527/5053] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:32 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183 => generated 1362 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:32.617930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-06229e35-6fb6-4a94-a9fe-5c60d32b99bc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:32.624374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-06229e35-6fb6-4a94-a9fe-5c60d32b99bc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:32.644815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-06229e35-6fb6-4a94-a9fe-5c60d32b99bc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:32.653199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-06229e35-6fb6-4a94-a9fe-5c60d32b99bc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:32.654720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-06229e35-6fb6-4a94-a9fe-5c60d32b99bc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:32.655430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-06229e35-6fb6-4a94-a9fe-5c60d32b99bc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:32.728205 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-06229e35-6fb6-4a94-a9fe-5c60d32b99bc tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117060 May 27 15:20:32.733355 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2528/5054] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:32 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:32.744801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-a946a851-d341-426c-bfd4-d266f83bbb15 req-aec5305a-651f-4ec9-97ba-b429b274860c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37acc336-598b-4d82-8f06-0f405cc51183", "name": "network-vif-plugged", "status": "completed", "tag": "9e6c7f64-97a6-4a2c-9ee7-1d1f21f01048"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:32.769476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-a946a851-d341-426c-bfd4-d266f83bbb15 req-aec5305a-651f-4ec9-97ba-b429b274860c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:32.771385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-a946a851-d341-426c-bfd4-d266f83bbb15 req-aec5305a-651f-4ec9-97ba-b429b274860c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:32.800035 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-a946a851-d341-426c-bfd4-d266f83bbb15 req-aec5305a-651f-4ec9-97ba-b429b274860c service nova] Creating event network-vif-plugged:9e6c7f64-97a6-4a2c-9ee7-1d1f21f01048 for instance 37acc336-598b-4d82-8f06-0f405cc51183 on n-h1-843621-1 May 27 15:20:32.806838 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-a946a851-d341-426c-bfd4-d266f83bbb15 req-aec5305a-651f-4ec9-97ba-b429b274860c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071912 May 27 15:20:32.808040 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2529/5055] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:33.462879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-7a471af4-4ef4-4f21-8e84-c6b8f3b49e33 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:20:33.464823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-7a471af4-4ef4-4f21-8e84-c6b8f3b49e33 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:20:33.465838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-7a471af4-4ef4-4f21-8e84-c6b8f3b49e33 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:20:33.466584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-7a471af4-4ef4-4f21-8e84-c6b8f3b49e33 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:20:33.467243 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-7a471af4-4ef4-4f21-8e84-c6b8f3b49e33 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:20:33.490273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a471af4-4ef4-4f21-8e84-c6b8f3b49e33 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:33.491136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a471af4-4ef4-4f21-8e84-c6b8f3b49e33 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:33.492225 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a471af4-4ef4-4f21-8e84-c6b8f3b49e33 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:33.493903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a471af4-4ef4-4f21-8e84-c6b8f3b49e33 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:33.539779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-7a471af4-4ef4-4f21-8e84-c6b8f3b49e33 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Getting quotas for project db397cde9e67464182a7ba045f1779be. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:20:33.554846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-7a471af4-4ef4-4f21-8e84-c6b8f3b49e33 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Getting quotas for user 2f0525081cf441998d2c320fa0087cff and project db397cde9e67464182a7ba045f1779be. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:20:33.582944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7a471af4-4ef4-4f21-8e84-c6b8f3b49e33 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:20:33.593489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7a471af4-4ef4-4f21-8e84-c6b8f3b49e33 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:20:33.609528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-87cb3e7c-f8ce-404f-9268-4fe2d84d3bba tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:33.610816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-87cb3e7c-f8ce-404f-9268-4fe2d84d3bba tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:33.628098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87cb3e7c-f8ce-404f-9268-4fe2d84d3bba tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:33.628610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87cb3e7c-f8ce-404f-9268-4fe2d84d3bba tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:33.629474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87cb3e7c-f8ce-404f-9268-4fe2d84d3bba tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:33.634880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87cb3e7c-f8ce-404f-9268-4fe2d84d3bba tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:33.717011 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7a471af4-4ef4-4f21-8e84-c6b8f3b49e33 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.591152 May 27 15:20:33.720004 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2527/5056] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:20:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:20:33.732022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-867e09cd-f9ba-4669-8471-383ed86b21be tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:33.734532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-867e09cd-f9ba-4669-8471-383ed86b21be tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:34.073656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-867e09cd-f9ba-4669-8471-383ed86b21be tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:34.089741 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-867e09cd-f9ba-4669-8471-383ed86b21be tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 200 len: 1208 microversion: 2.1 time: 0.359434 May 27 15:20:34.089741 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2528/5057] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:33 2022] GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 1208 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:34.116182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c16d31c9-bbf6-4b3d-9d93-4b0bb7cf249f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:34.116182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c16d31c9-bbf6-4b3d-9d93-4b0bb7cf249f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:34.131702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c16d31c9-bbf6-4b3d-9d93-4b0bb7cf249f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:34.132170 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c16d31c9-bbf6-4b3d-9d93-4b0bb7cf249f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:34.145076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c16d31c9-bbf6-4b3d-9d93-4b0bb7cf249f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:34.145627 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c16d31c9-bbf6-4b3d-9d93-4b0bb7cf249f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:34.224660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-87cb3e7c-f8ce-404f-9268-4fe2d84d3bba tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:34.236817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-87cb3e7c-f8ce-404f-9268-4fe2d84d3bba tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:34.239684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-87cb3e7c-f8ce-404f-9268-4fe2d84d3bba tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:34.241269 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-87cb3e7c-f8ce-404f-9268-4fe2d84d3bba tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183" status: 200 len: 1362 microversion: 2.26 time: 0.637341 May 27 15:20:34.242906 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2530/5058] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:33 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183 => generated 1362 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:34.254441 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c16d31c9-bbf6-4b3d-9d93-4b0bb7cf249f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168290 May 27 15:20:34.260183 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2529/5059] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:34 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:35.102391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dfcda836-caa9-4730-999f-d33a3d44a026 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:35.103466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dfcda836-caa9-4730-999f-d33a3d44a026 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:35.122906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dfcda836-caa9-4730-999f-d33a3d44a026 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:35.126907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dfcda836-caa9-4730-999f-d33a3d44a026 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:35.136120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dfcda836-caa9-4730-999f-d33a3d44a026 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:35.142441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dfcda836-caa9-4730-999f-d33a3d44a026 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:35.239250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dfcda836-caa9-4730-999f-d33a3d44a026 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:35.252629 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dfcda836-caa9-4730-999f-d33a3d44a026 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 200 len: 1204 microversion: 2.1 time: 0.154282 May 27 15:20:35.253695 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2531/5060] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:35 2022] GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 1204 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:35.265409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d3d0e7a3-32e7-4e04-bb9d-eaf9a53d29f6 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:35.266755 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d3d0e7a3-32e7-4e04-bb9d-eaf9a53d29f6 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:35.274295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-33b2b0f6-139f-424e-b42f-48e557ddb6fd tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:35.275356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-33b2b0f6-139f-424e-b42f-48e557ddb6fd tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:35.296630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d3d0e7a3-32e7-4e04-bb9d-eaf9a53d29f6 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:35.297465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d3d0e7a3-32e7-4e04-bb9d-eaf9a53d29f6 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:35.298525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d3d0e7a3-32e7-4e04-bb9d-eaf9a53d29f6 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:35.299078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d3d0e7a3-32e7-4e04-bb9d-eaf9a53d29f6 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:35.315863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-33b2b0f6-139f-424e-b42f-48e557ddb6fd tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:35.320203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-33b2b0f6-139f-424e-b42f-48e557ddb6fd tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:35.324048 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-33b2b0f6-139f-424e-b42f-48e557ddb6fd tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:35.325360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-33b2b0f6-139f-424e-b42f-48e557ddb6fd tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:35.453835 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-33b2b0f6-139f-424e-b42f-48e557ddb6fd tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.186231 May 27 15:20:35.454796 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2532/5061] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:35 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:35.466409 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-224e4e11-40d4-408b-98ab-f5cc441bdbd0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:35.468666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-224e4e11-40d4-408b-98ab-f5cc441bdbd0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:35.486818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-224e4e11-40d4-408b-98ab-f5cc441bdbd0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:35.487307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-224e4e11-40d4-408b-98ab-f5cc441bdbd0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:35.489282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-224e4e11-40d4-408b-98ab-f5cc441bdbd0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:35.489741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-224e4e11-40d4-408b-98ab-f5cc441bdbd0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:35.587095 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-224e4e11-40d4-408b-98ab-f5cc441bdbd0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/ips" status: 200 len: 146 microversion: 2.1 time: 0.131007 May 27 15:20:35.587812 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2533/5062] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 15:20:35 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/ips => generated 146 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:35.713629 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d3d0e7a3-32e7-4e04-bb9d-eaf9a53d29f6 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:35.735458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d3d0e7a3-32e7-4e04-bb9d-eaf9a53d29f6 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:35.777348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d3d0e7a3-32e7-4e04-bb9d-eaf9a53d29f6 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:35.784428 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d3d0e7a3-32e7-4e04-bb9d-eaf9a53d29f6 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183" status: 200 len: 1546 microversion: 2.26 time: 0.524741 May 27 15:20:35.794446 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2530/5063] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:35 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183 => generated 1546 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:35.812566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-029e7aa6-d643-4687-84ed-492b98f334fd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '.version_select at 0x7fc776d54280>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:35.822175 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-029e7aa6-d643-4687-84ed-492b98f334fd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:35.825822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-029e7aa6-d643-4687-84ed-492b98f334fd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:35.828496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-029e7aa6-d643-4687-84ed-492b98f334fd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:35.845152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-029e7aa6-d643-4687-84ed-492b98f334fd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:35.846358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-029e7aa6-d643-4687-84ed-492b98f334fd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:35.851597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-029e7aa6-d643-4687-84ed-492b98f334fd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:35.852226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-029e7aa6-d643-4687-84ed-492b98f334fd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:35.950840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-029e7aa6-d643-4687-84ed-492b98f334fd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:35.951682 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-029e7aa6-d643-4687-84ed-492b98f334fd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.021327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-029e7aa6-d643-4687-84ed-492b98f334fd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.022762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-029e7aa6-d643-4687-84ed-492b98f334fd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.095134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-029e7aa6-d643-4687-84ed-492b98f334fd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lazy-loading 'flavor' on Instance uuid 37acc336-598b-4d82-8f06-0f405cc51183 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:36.139474 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-029e7aa6-d643-4687-84ed-492b98f334fd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "PUT /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags/tempest-tag-2107430571" status: 201 len: 0 microversion: 2.26 time: 0.330643 May 27 15:20:36.142371 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2534/5064] 10.222.0.13 () {62 vars in 1379 bytes} [Fri May 27 15:20:35 2022] PUT /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags/tempest-tag-2107430571 => generated 0 bytes in 334 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 27 15:20:36.160942 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1123efdf-dcce-434e-9984-828387ba2e62 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '.version_select at 0x7fc7756f8310>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:36.182802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1123efdf-dcce-434e-9984-828387ba2e62 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.183318 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1123efdf-dcce-434e-9984-828387ba2e62 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.232869 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1123efdf-dcce-434e-9984-828387ba2e62 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags/tempest-tag-2107430571" status: 204 len: 0 microversion: 2.26 time: 0.086281 May 27 15:20:36.258060 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2531/5065] 10.222.0.13 () {60 vars in 1360 bytes} [Fri May 27 15:20:36 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags/tempest-tag-2107430571 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:20:36.287201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-50475065-f779-4b22-9049-b55d4a27a227 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '.version_select at 0x7fc776cd48b0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:36.305434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-50475065-f779-4b22-9049-b55d4a27a227 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.305899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-50475065-f779-4b22-9049-b55d4a27a227 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.311926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ce949761-a081-4bb7-892a-346bb31e6ebf tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:36.313406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-50475065-f779-4b22-9049-b55d4a27a227 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:36.319196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ce949761-a081-4bb7-892a-346bb31e6ebf tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:36.332205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-50475065-f779-4b22-9049-b55d4a27a227 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.332205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-50475065-f779-4b22-9049-b55d4a27a227 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.332551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-50475065-f779-4b22-9049-b55d4a27a227 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.333103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-50475065-f779-4b22-9049-b55d4a27a227 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.340729 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ce949761-a081-4bb7-892a-346bb31e6ebf tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.341790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ce949761-a081-4bb7-892a-346bb31e6ebf tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.343754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ce949761-a081-4bb7-892a-346bb31e6ebf tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.345072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ce949761-a081-4bb7-892a-346bb31e6ebf tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.411908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-50475065-f779-4b22-9049-b55d4a27a227 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.415358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-50475065-f779-4b22-9049-b55d4a27a227 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.422971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:36.464649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-50475065-f779-4b22-9049-b55d4a27a227 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lazy-loading 'flavor' on Instance uuid 37acc336-598b-4d82-8f06-0f405cc51183 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:36.488642 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ce949761-a081-4bb7-892a-346bb31e6ebf tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:36.499190 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-50475065-f779-4b22-9049-b55d4a27a227 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "DELETE /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags" status: 204 len: 0 microversion: 2.26 time: 0.218423 May 27 15:20:36.501364 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ce949761-a081-4bb7-892a-346bb31e6ebf tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 200 len: 1266 microversion: 2.1 time: 0.206551 May 27 15:20:36.503307 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2535/5066] 10.222.0.13 () {60 vars in 1294 bytes} [Fri May 27 15:20:36 2022] DELETE /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:20:36.515498 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2532/5067] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:36 2022] GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:36.517132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d9bff536-928f-454d-b4c8-4fa277dc0400 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:36.518111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d9bff536-928f-454d-b4c8-4fa277dc0400 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:36.525767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ba2c25fd-ac4e-4fe9-8d6f-64f67db6a61b tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '.version_select at 0x7fc775772ee0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:36.530533 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9bff536-928f-454d-b4c8-4fa277dc0400 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.530991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9bff536-928f-454d-b4c8-4fa277dc0400 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.531995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9bff536-928f-454d-b4c8-4fa277dc0400 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.534359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9bff536-928f-454d-b4c8-4fa277dc0400 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.538344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba2c25fd-ac4e-4fe9-8d6f-64f67db6a61b tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.540368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba2c25fd-ac4e-4fe9-8d6f-64f67db6a61b tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.553160 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:36.556820 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ba2c25fd-ac4e-4fe9-8d6f-64f67db6a61b tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags" status: 200 len: 12 microversion: 2.26 time: 0.037522 May 27 15:20:36.557831 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2533/5068] 10.222.0.13 () {60 vars in 1291 bytes} [Fri May 27 15:20:36 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags => generated 12 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:36.570900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4a411996-86c7-4002-b5e1-c1857e246c63 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '.version_select at 0x7fc775772dc0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:36.584384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a411996-86c7-4002-b5e1-c1857e246c63 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.585605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a411996-86c7-4002-b5e1-c1857e246c63 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.586531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4a411996-86c7-4002-b5e1-c1857e246c63 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:36.597136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a411996-86c7-4002-b5e1-c1857e246c63 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.598639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a411996-86c7-4002-b5e1-c1857e246c63 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.600119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a411996-86c7-4002-b5e1-c1857e246c63 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.600933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a411996-86c7-4002-b5e1-c1857e246c63 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.632452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a411996-86c7-4002-b5e1-c1857e246c63 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.633242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a411996-86c7-4002-b5e1-c1857e246c63 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.650193 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a411996-86c7-4002-b5e1-c1857e246c63 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.651406 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a411996-86c7-4002-b5e1-c1857e246c63 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.680579 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d9bff536-928f-454d-b4c8-4fa277dc0400 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174663 May 27 15:20:36.686447 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2536/5069] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:36 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:36.724663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-4a411996-86c7-4002-b5e1-c1857e246c63 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lazy-loading 'flavor' on Instance uuid 37acc336-598b-4d82-8f06-0f405cc51183 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:36.767262 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4a411996-86c7-4002-b5e1-c1857e246c63 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "PUT /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags/tempest-tag-1403696678" status: 201 len: 0 microversion: 2.26 time: 0.202018 May 27 15:20:36.770401 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2534/5070] 10.222.0.13 () {62 vars in 1379 bytes} [Fri May 27 15:20:36 2022] PUT /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags/tempest-tag-1403696678 => generated 0 bytes in 206 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 27 15:20:36.780542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0a5a0db5-e15a-41c6-8ad6-f4b4c1ab3819 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '.version_select at 0x7fc780621040>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:36.795960 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a5a0db5-e15a-41c6-8ad6-f4b4c1ab3819 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.796770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0a5a0db5-e15a-41c6-8ad6-f4b4c1ab3819 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.815823 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0a5a0db5-e15a-41c6-8ad6-f4b4c1ab3819 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags" status: 200 len: 36 microversion: 2.26 time: 0.040694 May 27 15:20:36.826675 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2537/5071] 10.222.0.13 () {60 vars in 1291 bytes} [Fri May 27 15:20:36 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags => generated 36 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:36.837176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-897423a8-d480-48eb-822d-86e5622b5cf2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '.version_select at 0x7fc7756f7040>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:36.866171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-897423a8-d480-48eb-822d-86e5622b5cf2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.866754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-897423a8-d480-48eb-822d-86e5622b5cf2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.873677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-897423a8-d480-48eb-822d-86e5622b5cf2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:36.888956 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-897423a8-d480-48eb-822d-86e5622b5cf2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.889952 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-897423a8-d480-48eb-822d-86e5622b5cf2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.892014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-897423a8-d480-48eb-822d-86e5622b5cf2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.893171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-897423a8-d480-48eb-822d-86e5622b5cf2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.966533 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-897423a8-d480-48eb-822d-86e5622b5cf2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.967272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-897423a8-d480-48eb-822d-86e5622b5cf2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.029883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-897423a8-d480-48eb-822d-86e5622b5cf2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lazy-loading 'flavor' on Instance uuid 37acc336-598b-4d82-8f06-0f405cc51183 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:37.087278 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-897423a8-d480-48eb-822d-86e5622b5cf2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "DELETE /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags/tempest-tag-1403696678" status: 204 len: 0 microversion: 2.26 time: 0.255260 May 27 15:20:37.090547 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2535/5072] 10.222.0.13 () {60 vars in 1363 bytes} [Fri May 27 15:20:36 2022] DELETE /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags/tempest-tag-1403696678 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:20:37.108422 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-75824789-5c94-47b9-8f29-f8401afcc6d4 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '.version_select at 0x7fc7763c6160>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:37.169470 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-75824789-5c94-47b9-8f29-f8401afcc6d4 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.172028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-75824789-5c94-47b9-8f29-f8401afcc6d4 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.223399 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-75824789-5c94-47b9-8f29-f8401afcc6d4 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags" status: 200 len: 12 microversion: 2.26 time: 0.127185 May 27 15:20:37.225727 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2538/5073] 10.222.0.13 () {60 vars in 1291 bytes} [Fri May 27 15:20:37 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags => generated 12 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:37.236890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bf0d1091-744d-4a03-8200-df48d21e0426 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '.version_select at 0x7fc775fed4c0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:37.262583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf0d1091-744d-4a03-8200-df48d21e0426 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.264171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf0d1091-744d-4a03-8200-df48d21e0426 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.265189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bf0d1091-744d-4a03-8200-df48d21e0426 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:37.278959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf0d1091-744d-4a03-8200-df48d21e0426 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.280270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf0d1091-744d-4a03-8200-df48d21e0426 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.282302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf0d1091-744d-4a03-8200-df48d21e0426 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.284156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf0d1091-744d-4a03-8200-df48d21e0426 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.348604 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf0d1091-744d-4a03-8200-df48d21e0426 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.351772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf0d1091-744d-4a03-8200-df48d21e0426 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.383750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-bf0d1091-744d-4a03-8200-df48d21e0426 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lazy-loading 'flavor' on Instance uuid 37acc336-598b-4d82-8f06-0f405cc51183 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:37.407955 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bf0d1091-744d-4a03-8200-df48d21e0426 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "DELETE /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags" status: 204 len: 0 microversion: 2.26 time: 0.174794 May 27 15:20:37.409393 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2536/5074] 10.222.0.13 () {60 vars in 1294 bytes} [Fri May 27 15:20:37 2022] DELETE /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:20:37.422823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3694be96-58e5-49af-97b6-900d6a0f53cd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '.version_select at 0x7fc776ca5670>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:37.449242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3694be96-58e5-49af-97b6-900d6a0f53cd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.450785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3694be96-58e5-49af-97b6-900d6a0f53cd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.454104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3694be96-58e5-49af-97b6-900d6a0f53cd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:37.479519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3694be96-58e5-49af-97b6-900d6a0f53cd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.482649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3694be96-58e5-49af-97b6-900d6a0f53cd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.489725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3694be96-58e5-49af-97b6-900d6a0f53cd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.493372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3694be96-58e5-49af-97b6-900d6a0f53cd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.520235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-db3adcbf-79b7-419a-9068-1b729c459bab tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:37.521643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-db3adcbf-79b7-419a-9068-1b729c459bab tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:37.543463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db3adcbf-79b7-419a-9068-1b729c459bab tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.548602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db3adcbf-79b7-419a-9068-1b729c459bab tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.550227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db3adcbf-79b7-419a-9068-1b729c459bab tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.557398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db3adcbf-79b7-419a-9068-1b729c459bab tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.625975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3694be96-58e5-49af-97b6-900d6a0f53cd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.629927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3694be96-58e5-49af-97b6-900d6a0f53cd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.654302 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3694be96-58e5-49af-97b6-900d6a0f53cd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.655185 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3694be96-58e5-49af-97b6-900d6a0f53cd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.725195 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-3694be96-58e5-49af-97b6-900d6a0f53cd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lazy-loading 'flavor' on Instance uuid 37acc336-598b-4d82-8f06-0f405cc51183 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:37.747204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-db3adcbf-79b7-419a-9068-1b729c459bab tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:37.783226 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-db3adcbf-79b7-419a-9068-1b729c459bab tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 200 len: 1266 microversion: 2.1 time: 0.265440 May 27 15:20:37.786701 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2537/5075] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:37 2022] GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:37.803016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f4e65447-ed30-436f-a298-6c3d5f9305da tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:37.804390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f4e65447-ed30-436f-a298-6c3d5f9305da tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:37.805282 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3694be96-58e5-49af-97b6-900d6a0f53cd tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "PUT /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags/tempest-tag-86335700" status: 201 len: 0 microversion: 2.26 time: 0.387044 May 27 15:20:37.808543 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2539/5076] 10.222.0.13 () {62 vars in 1373 bytes} [Fri May 27 15:20:37 2022] PUT /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags/tempest-tag-86335700 => generated 0 bytes in 393 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) May 27 15:20:37.822914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d483c43b-0f6f-4824-8777-d753bf0530ac tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '.version_select at 0x7fc776c9daf0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:37.826988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4e65447-ed30-436f-a298-6c3d5f9305da tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.829390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4e65447-ed30-436f-a298-6c3d5f9305da tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.830451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4e65447-ed30-436f-a298-6c3d5f9305da tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.831943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4e65447-ed30-436f-a298-6c3d5f9305da tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.854794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d483c43b-0f6f-4824-8777-d753bf0530ac tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.857644 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d483c43b-0f6f-4824-8777-d753bf0530ac tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.858692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d483c43b-0f6f-4824-8777-d753bf0530ac tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:37.897009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d483c43b-0f6f-4824-8777-d753bf0530ac tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.898708 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d483c43b-0f6f-4824-8777-d753bf0530ac tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.900339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d483c43b-0f6f-4824-8777-d753bf0530ac tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.901277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d483c43b-0f6f-4824-8777-d753bf0530ac tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.947884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d483c43b-0f6f-4824-8777-d753bf0530ac tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.950673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d483c43b-0f6f-4824-8777-d753bf0530ac tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.955533 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f4e65447-ed30-436f-a298-6c3d5f9305da tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166492 May 27 15:20:37.956464 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2538/5077] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:37 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:37.982026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d483c43b-0f6f-4824-8777-d753bf0530ac tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.983016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d483c43b-0f6f-4824-8777-d753bf0530ac tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.061293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-d483c43b-0f6f-4824-8777-d753bf0530ac tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lazy-loading 'flavor' on Instance uuid 37acc336-598b-4d82-8f06-0f405cc51183 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:38.104231 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d483c43b-0f6f-4824-8777-d753bf0530ac tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "PUT /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags/tempest-tag-13637669" status: 201 len: 0 microversion: 2.26 time: 0.287167 May 27 15:20:38.110864 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2540/5078] 10.222.0.13 () {62 vars in 1373 bytes} [Fri May 27 15:20:37 2022] PUT /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags/tempest-tag-13637669 => generated 0 bytes in 294 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) May 27 15:20:38.116252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-31c19b27-9d3a-4439-8a40-6c05fe20b09b tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '.version_select at 0x7fc775730700>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:38.118292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:38.146206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-31c19b27-9d3a-4439-8a40-6c05fe20b09b tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.146680 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-31c19b27-9d3a-4439-8a40-6c05fe20b09b tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.147190 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-31c19b27-9d3a-4439-8a40-6c05fe20b09b tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:38.196276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-31c19b27-9d3a-4439-8a40-6c05fe20b09b tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.196798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-31c19b27-9d3a-4439-8a40-6c05fe20b09b tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.197638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-31c19b27-9d3a-4439-8a40-6c05fe20b09b tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.198094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-31c19b27-9d3a-4439-8a40-6c05fe20b09b tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.294312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-31c19b27-9d3a-4439-8a40-6c05fe20b09b tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.294975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-31c19b27-9d3a-4439-8a40-6c05fe20b09b tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.318196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-31c19b27-9d3a-4439-8a40-6c05fe20b09b tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lazy-loading 'flavor' on Instance uuid 37acc336-598b-4d82-8f06-0f405cc51183 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:38.352218 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-31c19b27-9d3a-4439-8a40-6c05fe20b09b tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "DELETE /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags" status: 204 len: 0 microversion: 2.26 time: 0.238463 May 27 15:20:38.355899 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2539/5079] 10.222.0.13 () {60 vars in 1294 bytes} [Fri May 27 15:20:38 2022] DELETE /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:20:38.367423 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e0ba4bd1-df18-4b35-851e-c1ebeaac32eb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '.version_select at 0x7fc776ca5430>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:38.419984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0ba4bd1-df18-4b35-851e-c1ebeaac32eb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.429280 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0ba4bd1-df18-4b35-851e-c1ebeaac32eb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.463408 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e0ba4bd1-df18-4b35-851e-c1ebeaac32eb tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags" status: 200 len: 12 microversion: 2.26 time: 0.102510 May 27 15:20:38.473686 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2541/5080] 10.222.0.13 () {60 vars in 1291 bytes} [Fri May 27 15:20:38 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags => generated 12 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:38.486129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-225726d5-99c3-47d8-a102-c2cb66e225fa tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '.version_select at 0x7fc775730d30>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:38.501674 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-225726d5-99c3-47d8-a102-c2cb66e225fa tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.504605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-225726d5-99c3-47d8-a102-c2cb66e225fa tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.505335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-225726d5-99c3-47d8-a102-c2cb66e225fa tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:38.520170 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-225726d5-99c3-47d8-a102-c2cb66e225fa tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.520938 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-225726d5-99c3-47d8-a102-c2cb66e225fa tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.522164 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-225726d5-99c3-47d8-a102-c2cb66e225fa tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.522826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-225726d5-99c3-47d8-a102-c2cb66e225fa tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.548839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-225726d5-99c3-47d8-a102-c2cb66e225fa tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.549589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-225726d5-99c3-47d8-a102-c2cb66e225fa tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.569779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-225726d5-99c3-47d8-a102-c2cb66e225fa tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lazy-loading 'flavor' on Instance uuid 37acc336-598b-4d82-8f06-0f405cc51183 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:38.605801 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-225726d5-99c3-47d8-a102-c2cb66e225fa tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "DELETE /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags" status: 204 len: 0 microversion: 2.26 time: 0.125549 May 27 15:20:38.610592 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2540/5081] 10.222.0.13 () {60 vars in 1294 bytes} [Fri May 27 15:20:38 2022] DELETE /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:20:38.618500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f755ab75-2586-4b46-9878-2f3d12b6b99e tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '.version_select at 0x7fc776ca5550>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:38.645705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f755ab75-2586-4b46-9878-2f3d12b6b99e tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.646172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f755ab75-2586-4b46-9878-2f3d12b6b99e tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.646671 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f755ab75-2586-4b46-9878-2f3d12b6b99e tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:38.691640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f755ab75-2586-4b46-9878-2f3d12b6b99e tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.692350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f755ab75-2586-4b46-9878-2f3d12b6b99e tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.695443 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f755ab75-2586-4b46-9878-2f3d12b6b99e tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.698170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f755ab75-2586-4b46-9878-2f3d12b6b99e tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.769591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f755ab75-2586-4b46-9878-2f3d12b6b99e tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.770160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f755ab75-2586-4b46-9878-2f3d12b6b99e tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.801582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f550985d-b07d-470b-80c6-91a8fcd1fed1 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:38.802614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f550985d-b07d-470b-80c6-91a8fcd1fed1 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:38.803975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f755ab75-2586-4b46-9878-2f3d12b6b99e tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.812796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f755ab75-2586-4b46-9878-2f3d12b6b99e tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.817110 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f550985d-b07d-470b-80c6-91a8fcd1fed1 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.817786 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f550985d-b07d-470b-80c6-91a8fcd1fed1 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.819983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f550985d-b07d-470b-80c6-91a8fcd1fed1 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.829049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f550985d-b07d-470b-80c6-91a8fcd1fed1 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.889735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-f755ab75-2586-4b46-9878-2f3d12b6b99e tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lazy-loading 'flavor' on Instance uuid 37acc336-598b-4d82-8f06-0f405cc51183 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:38.954930 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f755ab75-2586-4b46-9878-2f3d12b6b99e tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "PUT /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags/tempest-tag-395731089" status: 201 len: 0 microversion: 2.26 time: 0.342315 May 27 15:20:38.962945 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2542/5082] 10.222.0.13 () {62 vars in 1376 bytes} [Fri May 27 15:20:38 2022] PUT /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags/tempest-tag-395731089 => generated 0 bytes in 351 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) May 27 15:20:38.990547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6f75e6cf-966b-4368-965f-e10fef23d411 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:38.993193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6f75e6cf-966b-4368-965f-e10fef23d411 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:39.022859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f75e6cf-966b-4368-965f-e10fef23d411 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.024540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f75e6cf-966b-4368-965f-e10fef23d411 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:39.025419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f75e6cf-966b-4368-965f-e10fef23d411 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.025891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f75e6cf-966b-4368-965f-e10fef23d411 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:39.130131 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6f75e6cf-966b-4368-965f-e10fef23d411 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165845 May 27 15:20:39.131007 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2543/5083] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:38 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:39.146781 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-51e1251c-f990-45af-8bd7-126e0c51ffce tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '.version_select at 0x7fc776c37550>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:39.187869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51e1251c-f990-45af-8bd7-126e0c51ffce tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.188660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51e1251c-f990-45af-8bd7-126e0c51ffce tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:39.189405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-51e1251c-f990-45af-8bd7-126e0c51ffce tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:39.252891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51e1251c-f990-45af-8bd7-126e0c51ffce tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.257452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51e1251c-f990-45af-8bd7-126e0c51ffce tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:39.258856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51e1251c-f990-45af-8bd7-126e0c51ffce tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.268769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51e1251c-f990-45af-8bd7-126e0c51ffce tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:39.313988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f550985d-b07d-470b-80c6-91a8fcd1fed1 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:39.351352 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f550985d-b07d-470b-80c6-91a8fcd1fed1 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 200 len: 1308 microversion: 2.1 time: 0.549726 May 27 15:20:39.352330 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2541/5084] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:38 2022] GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 1308 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:39.394776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51e1251c-f990-45af-8bd7-126e0c51ffce tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.396414 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51e1251c-f990-45af-8bd7-126e0c51ffce tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:39.426232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51e1251c-f990-45af-8bd7-126e0c51ffce tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.428063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51e1251c-f990-45af-8bd7-126e0c51ffce tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:39.497069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-51e1251c-f990-45af-8bd7-126e0c51ffce tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lazy-loading 'flavor' on Instance uuid 37acc336-598b-4d82-8f06-0f405cc51183 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:39.555454 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-51e1251c-f990-45af-8bd7-126e0c51ffce tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "PUT /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags/tempest-tag-228279971" status: 201 len: 0 microversion: 2.26 time: 0.421526 May 27 15:20:39.559525 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2544/5085] 10.222.0.13 () {62 vars in 1376 bytes} [Fri May 27 15:20:39 2022] PUT /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags/tempest-tag-228279971 => generated 0 bytes in 428 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) May 27 15:20:39.578195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b328c2ae-53d7-40f7-adb3-01e4461036f3 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Action: 'update_all', calling method: .version_select at 0x7fc775f36790>, body: {"tags": ["tempest-tag-1370654086", "tempest-tag-1304184221"]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:39.598051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b328c2ae-53d7-40f7-adb3-01e4461036f3 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.601313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b328c2ae-53d7-40f7-adb3-01e4461036f3 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:39.602787 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b328c2ae-53d7-40f7-adb3-01e4461036f3 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:39.629574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b328c2ae-53d7-40f7-adb3-01e4461036f3 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.633212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b328c2ae-53d7-40f7-adb3-01e4461036f3 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:39.634976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b328c2ae-53d7-40f7-adb3-01e4461036f3 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.640651 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b328c2ae-53d7-40f7-adb3-01e4461036f3 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:39.714348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b328c2ae-53d7-40f7-adb3-01e4461036f3 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.716324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b328c2ae-53d7-40f7-adb3-01e4461036f3 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:39.774181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-b328c2ae-53d7-40f7-adb3-01e4461036f3 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lazy-loading 'flavor' on Instance uuid 37acc336-598b-4d82-8f06-0f405cc51183 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:39.835678 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b328c2ae-53d7-40f7-adb3-01e4461036f3 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "PUT /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags" status: 200 len: 62 microversion: 2.26 time: 0.270985 May 27 15:20:39.837028 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2542/5086] 10.222.0.13 () {62 vars in 1311 bytes} [Fri May 27 15:20:39 2022] PUT /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags => generated 62 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:39.848799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-81bbc87b-4e77-4f02-9d14-dab3c5fc85e1 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '.version_select at 0x7fc776b89dc0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:39.865716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81bbc87b-4e77-4f02-9d14-dab3c5fc85e1 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.866187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81bbc87b-4e77-4f02-9d14-dab3c5fc85e1 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:39.903323 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-81bbc87b-4e77-4f02-9d14-dab3c5fc85e1 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags" status: 200 len: 62 microversion: 2.26 time: 0.057686 May 27 15:20:39.914563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0fa4e951-4c73-4877-8ba8-8ba42baca502 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '.version_select at 0x7fc775640b80>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:39.924366 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2545/5087] 10.222.0.13 () {60 vars in 1291 bytes} [Fri May 27 15:20:39 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags => generated 62 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:39.935554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0fa4e951-4c73-4877-8ba8-8ba42baca502 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.935874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0fa4e951-4c73-4877-8ba8-8ba42baca502 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:39.939286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0fa4e951-4c73-4877-8ba8-8ba42baca502 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:39.957473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0fa4e951-4c73-4877-8ba8-8ba42baca502 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.958307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0fa4e951-4c73-4877-8ba8-8ba42baca502 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:39.960692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0fa4e951-4c73-4877-8ba8-8ba42baca502 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.961299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0fa4e951-4c73-4877-8ba8-8ba42baca502 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:39.998214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0fa4e951-4c73-4877-8ba8-8ba42baca502 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.999269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0fa4e951-4c73-4877-8ba8-8ba42baca502 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:40.022943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-0fa4e951-4c73-4877-8ba8-8ba42baca502 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lazy-loading 'flavor' on Instance uuid 37acc336-598b-4d82-8f06-0f405cc51183 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:40.090157 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0fa4e951-4c73-4877-8ba8-8ba42baca502 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "DELETE /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags" status: 204 len: 0 microversion: 2.26 time: 0.178591 May 27 15:20:40.109972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-26e305d9-31d0-4b88-b091-9e817a913d71 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:40.111111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-26e305d9-31d0-4b88-b091-9e817a913d71 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:40.114913 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2543/5088] 10.222.0.13 () {60 vars in 1294 bytes} [Fri May 27 15:20:39 2022] DELETE /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183/tags => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:20:40.130960 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26e305d9-31d0-4b88-b091-9e817a913d71 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:40.132415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26e305d9-31d0-4b88-b091-9e817a913d71 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:40.133472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26e305d9-31d0-4b88-b091-9e817a913d71 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:40.134073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26e305d9-31d0-4b88-b091-9e817a913d71 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:40.145405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ba4a1d5c-9603-4eb0-9524-11316d70e45e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:40.146866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ba4a1d5c-9603-4eb0-9524-11316d70e45e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:40.169398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba4a1d5c-9603-4eb0-9524-11316d70e45e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:40.171427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba4a1d5c-9603-4eb0-9524-11316d70e45e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:40.178286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba4a1d5c-9603-4eb0-9524-11316d70e45e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:40.182027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba4a1d5c-9603-4eb0-9524-11316d70e45e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:40.236561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=87,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=4,nova_cell1:INSERT=4,nova_cell1:RELEASE=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:40.263584 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-26e305d9-31d0-4b88-b091-9e817a913d71 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:20:40.287574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:40.296165 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ba4a1d5c-9603-4eb0-9524-11316d70e45e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155676 May 27 15:20:40.300490 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2544/5089] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:40 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:40.373225 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f257c036-4c8c-44dc-add8-b6d2bc79c4ac tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:40.375064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f257c036-4c8c-44dc-add8-b6d2bc79c4ac tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:40.459833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f257c036-4c8c-44dc-add8-b6d2bc79c4ac tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:40.461624 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f257c036-4c8c-44dc-add8-b6d2bc79c4ac tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:40.469236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f257c036-4c8c-44dc-add8-b6d2bc79c4ac tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:40.473618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f257c036-4c8c-44dc-add8-b6d2bc79c4ac tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:40.679687 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-26e305d9-31d0-4b88-b091-9e817a913d71 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "DELETE /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183" status: 204 len: 0 microversion: 2.26 time: 0.577282 May 27 15:20:40.680772 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2546/5090] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:20:40 2022] DELETE /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:20:40.691583 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f5f29431-d920-4e81-a971-26559c0774e4 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:40.692881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f5f29431-d920-4e81-a971-26559c0774e4 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:40.706552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f5f29431-d920-4e81-a971-26559c0774e4 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:40.706552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f5f29431-d920-4e81-a971-26559c0774e4 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:40.707227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f5f29431-d920-4e81-a971-26559c0774e4 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:40.707867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f5f29431-d920-4e81-a971-26559c0774e4 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:41.119513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f257c036-4c8c-44dc-add8-b6d2bc79c4ac tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:41.132902 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f257c036-4c8c-44dc-add8-b6d2bc79c4ac tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 200 len: 1308 microversion: 2.1 time: 0.766943 May 27 15:20:41.136994 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2545/5091] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:40 2022] GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 1308 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:41.147948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-dcc73725-1f98-4ed1-ae81-35a3b462efed req-20bf4311-8ba5-40bb-a4e8-149054f41201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f417695-eff6-4c81-89e9-9f8301495dd8", "tag": "8461ebad-e71c-4278-a68b-1bf2ae90fb4e"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:41.166559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-dcc73725-1f98-4ed1-ae81-35a3b462efed req-20bf4311-8ba5-40bb-a4e8-149054f41201 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:41.169530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-dcc73725-1f98-4ed1-ae81-35a3b462efed req-20bf4311-8ba5-40bb-a4e8-149054f41201 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:41.201752 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-dcc73725-1f98-4ed1-ae81-35a3b462efed req-20bf4311-8ba5-40bb-a4e8-149054f41201 service nova] Creating event network-changed:8461ebad-e71c-4278-a68b-1bf2ae90fb4e for instance 5f417695-eff6-4c81-89e9-9f8301495dd8 on n-h2-843621-1 May 27 15:20:41.215697 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-dcc73725-1f98-4ed1-ae81-35a3b462efed req-20bf4311-8ba5-40bb-a4e8-149054f41201 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075171 May 27 15:20:41.217949 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2546/5092] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:41.271244 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f5f29431-d920-4e81-a971-26559c0774e4 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:41.279731 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f5f29431-d920-4e81-a971-26559c0774e4 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:41.285607 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f5f29431-d920-4e81-a971-26559c0774e4 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:41.288970 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f5f29431-d920-4e81-a971-26559c0774e4 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183" status: 200 len: 1552 microversion: 2.26 time: 0.603545 May 27 15:20:41.306420 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2547/5093] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:40 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183 => generated 1552 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:41.309070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bc40158b-a1f7-4c86-b830-f966ddc69b91 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:41.310122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bc40158b-a1f7-4c86-b830-f966ddc69b91 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:41.323873 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc40158b-a1f7-4c86-b830-f966ddc69b91 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:41.324393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc40158b-a1f7-4c86-b830-f966ddc69b91 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:41.325255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc40158b-a1f7-4c86-b830-f966ddc69b91 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:41.325738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc40158b-a1f7-4c86-b830-f966ddc69b91 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:41.411639 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bc40158b-a1f7-4c86-b830-f966ddc69b91 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107835 May 27 15:20:41.412330 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2547/5094] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:41 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:41.800443 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8a569945-fa84-4fa9-9ffd-b99e174245f5 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ff93d62-b236-4d3d-9595-d575625ed4d0"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:41.804009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8a569945-fa84-4fa9-9ffd-b99e174245f5 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:41.832070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a569945-fa84-4fa9-9ffd-b99e174245f5 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:41.833467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a569945-fa84-4fa9-9ffd-b99e174245f5 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:41.834551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a569945-fa84-4fa9-9ffd-b99e174245f5 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:41.835708 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a569945-fa84-4fa9-9ffd-b99e174245f5 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:42.152716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-99cd34bc-9817-4ecd-b28b-092e591d7240 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:42.153656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-99cd34bc-9817-4ecd-b28b-092e591d7240 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:42.215594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99cd34bc-9817-4ecd-b28b-092e591d7240 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:42.224530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99cd34bc-9817-4ecd-b28b-092e591d7240 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:42.229815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99cd34bc-9817-4ecd-b28b-092e591d7240 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:42.232299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99cd34bc-9817-4ecd-b28b-092e591d7240 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:42.639850 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8a569945-fa84-4fa9-9ffd-b99e174245f5 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "POST /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.840052 May 27 15:20:42.654375 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2548/5095] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 15:20:41 2022] POST /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments => generated 194 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:42.675282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9ccb99a2-3b18-437f-a87f-4749e7a340f0 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:42.676036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9ccb99a2-3b18-437f-a87f-4749e7a340f0 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:42.710080 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ccb99a2-3b18-437f-a87f-4749e7a340f0 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:42.710539 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ccb99a2-3b18-437f-a87f-4749e7a340f0 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:42.711365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ccb99a2-3b18-437f-a87f-4749e7a340f0 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:42.722338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ccb99a2-3b18-437f-a87f-4749e7a340f0 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:42.797676 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-99cd34bc-9817-4ecd-b28b-092e591d7240 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:42.810267 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-99cd34bc-9817-4ecd-b28b-092e591d7240 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 200 len: 1308 microversion: 2.1 time: 0.663562 May 27 15:20:42.813025 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2548/5096] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:42 2022] GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 1308 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:42.838897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2ee688fc-7924-4f5a-af65-5da8bb9d9e1b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:42.843069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2ee688fc-7924-4f5a-af65-5da8bb9d9e1b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:42.878810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ee688fc-7924-4f5a-af65-5da8bb9d9e1b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:42.882389 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ee688fc-7924-4f5a-af65-5da8bb9d9e1b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:42.889343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ee688fc-7924-4f5a-af65-5da8bb9d9e1b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:42.889808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ee688fc-7924-4f5a-af65-5da8bb9d9e1b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:43.038396 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2ee688fc-7924-4f5a-af65-5da8bb9d9e1b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.224046 May 27 15:20:43.045201 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2549/5097] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:42 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 197 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:43.110108 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9ccb99a2-3b18-437f-a87f-4749e7a340f0 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:43.131527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9ccb99a2-3b18-437f-a87f-4749e7a340f0 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:43.138282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9ccb99a2-3b18-437f-a87f-4749e7a340f0 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:43.139965 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9ccb99a2-3b18-437f-a87f-4749e7a340f0 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183" status: 200 len: 1552 microversion: 2.26 time: 0.484369 May 27 15:20:43.141854 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2549/5098] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:42 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183 => generated 1552 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:43.827769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0d96e8ee-3fd5-4e03-9bb5-d438ea813eff tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:43.828547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0d96e8ee-3fd5-4e03-9bb5-d438ea813eff tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:43.843887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:43.850667 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0d96e8ee-3fd5-4e03-9bb5-d438ea813eff tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:43.851132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0d96e8ee-3fd5-4e03-9bb5-d438ea813eff tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:43.851927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0d96e8ee-3fd5-4e03-9bb5-d438ea813eff tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:43.859588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0d96e8ee-3fd5-4e03-9bb5-d438ea813eff tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:44.083702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=8 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:44.424170 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0d96e8ee-3fd5-4e03-9bb5-d438ea813eff tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:44.434764 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0d96e8ee-3fd5-4e03-9bb5-d438ea813eff tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 200 len: 1308 microversion: 2.1 time: 0.610325 May 27 15:20:44.447448 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2550/5099] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:43 2022] GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 1308 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:44.459313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6b992949-9546-463b-ab8e-36908653c890 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:44.464067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6b992949-9546-463b-ab8e-36908653c890 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:44.482498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b992949-9546-463b-ab8e-36908653c890 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:44.483335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b992949-9546-463b-ab8e-36908653c890 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:44.484530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b992949-9546-463b-ab8e-36908653c890 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:44.488091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b992949-9546-463b-ab8e-36908653c890 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:44.598120 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6b992949-9546-463b-ab8e-36908653c890 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.146738 May 27 15:20:44.612151 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2551/5100] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:20:44 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f/os-volume_attachments => generated 25 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:20:44.618069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-790801c3-5af9-48db-9dd7-b47182ec3fd2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:44.619581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-790801c3-5af9-48db-9dd7-b47182ec3fd2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:44.627256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-790801c3-5af9-48db-9dd7-b47182ec3fd2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:44.628094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-790801c3-5af9-48db-9dd7-b47182ec3fd2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:44.629166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-790801c3-5af9-48db-9dd7-b47182ec3fd2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:44.629842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-790801c3-5af9-48db-9dd7-b47182ec3fd2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:44.690908 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-790801c3-5af9-48db-9dd7-b47182ec3fd2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:44.691850 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-790801c3-5af9-48db-9dd7-b47182ec3fd2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:44.692609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-790801c3-5af9-48db-9dd7-b47182ec3fd2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lazy-loading 'fault' on Instance uuid 37acc336-598b-4d82-8f06-0f405cc51183 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:44.808978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-790801c3-5af9-48db-9dd7-b47182ec3fd2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:44.821838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-790801c3-5af9-48db-9dd7-b47182ec3fd2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:44.826917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-790801c3-5af9-48db-9dd7-b47182ec3fd2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c48e5dce95834fbe9e696865ed21ae0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09cf56d7b12b445aadc583eef99ea026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:44.828564 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-790801c3-5af9-48db-9dd7-b47182ec3fd2 tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183" status: 200 len: 1352 microversion: 2.26 time: 0.214570 May 27 15:20:44.830194 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2552/5101] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:44 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183 => generated 1352 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:44.849507 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-50830b6f-f0db-4023-859a-840876228732 req-385701e8-c42d-4ba7-baf5-07ec38e18854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37acc336-598b-4d82-8f06-0f405cc51183", "name": "network-vif-deleted", "tag": "9e6c7f64-97a6-4a2c-9ee7-1d1f21f01048"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:44.857325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-16712053-92d8-430f-9f87-742f7a748c90 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-778149046", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "083651f1-696b-4594-b2f6-515310400bd7"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:44.933331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-50830b6f-f0db-4023-859a-840876228732 req-385701e8-c42d-4ba7-baf5-07ec38e18854 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:44.933891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-50830b6f-f0db-4023-859a-840876228732 req-385701e8-c42d-4ba7-baf5-07ec38e18854 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:44.970188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-16712053-92d8-430f-9f87-742f7a748c90 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] validate_networks() for [('083651f1-696b-4594-b2f6-515310400bd7', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:20:44.990188 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-50830b6f-f0db-4023-859a-840876228732 req-385701e8-c42d-4ba7-baf5-07ec38e18854 service nova] Creating event network-vif-deleted:9e6c7f64-97a6-4a2c-9ee7-1d1f21f01048 for instance 37acc336-598b-4d82-8f06-0f405cc51183 on n-h1-843621-1 May 27 15:20:45.032920 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-50830b6f-f0db-4023-859a-840876228732 req-385701e8-c42d-4ba7-baf5-07ec38e18854 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201115 May 27 15:20:45.043455 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2553/5102] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:45.066516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9cd37790-ab65-4128-80d5-fb9a9d497e9b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:45.067498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9cd37790-ab65-4128-80d5-fb9a9d497e9b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:45.080386 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cd37790-ab65-4128-80d5-fb9a9d497e9b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:45.095759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cd37790-ab65-4128-80d5-fb9a9d497e9b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:45.099578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cd37790-ab65-4128-80d5-fb9a9d497e9b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:45.102289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cd37790-ab65-4128-80d5-fb9a9d497e9b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:45.192451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9cd37790-ab65-4128-80d5-fb9a9d497e9b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:20:45.537494 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9cd37790-ab65-4128-80d5-fb9a9d497e9b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 204 len: 0 microversion: 2.1 time: 0.491759 May 27 15:20:45.542701 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2554/5103] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:20:45 2022] DELETE /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:20:45.553109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1948317e-87c9-4adc-b0f2-14b9b37d1d3f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:45.553899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1948317e-87c9-4adc-b0f2-14b9b37d1d3f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:45.575722 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1948317e-87c9-4adc-b0f2-14b9b37d1d3f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:45.576081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1948317e-87c9-4adc-b0f2-14b9b37d1d3f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:45.576918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1948317e-87c9-4adc-b0f2-14b9b37d1d3f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:45.581897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1948317e-87c9-4adc-b0f2-14b9b37d1d3f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:45.949016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-16712053-92d8-430f-9f87-742f7a748c90 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:20:45.949648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-16712053-92d8-430f-9f87-742f7a748c90 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:20:45.949920 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-16712053-92d8-430f-9f87-742f7a748c90 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:20:45.950664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-16712053-92d8-430f-9f87-742f7a748c90 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:20:45.951253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-16712053-92d8-430f-9f87-742f7a748c90 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:20:45.970725 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1948317e-87c9-4adc-b0f2-14b9b37d1d3f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:45.981302 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1948317e-87c9-4adc-b0f2-14b9b37d1d3f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 200 len: 1308 microversion: 2.1 time: 0.440239 May 27 15:20:45.982228 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2555/5104] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:45 2022] GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 1308 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:45.984165 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16712053-92d8-430f-9f87-742f7a748c90 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:45.989140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-19b979c4-1225-4e2e-bc19-248cf528fe87 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:45.989875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16712053-92d8-430f-9f87-742f7a748c90 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:45.990912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16712053-92d8-430f-9f87-742f7a748c90 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:45.991519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-16712053-92d8-430f-9f87-742f7a748c90 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:45.995416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-19b979c4-1225-4e2e-bc19-248cf528fe87 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:46.009493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19b979c4-1225-4e2e-bc19-248cf528fe87 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:46.014189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19b979c4-1225-4e2e-bc19-248cf528fe87 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:46.019436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19b979c4-1225-4e2e-bc19-248cf528fe87 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:46.020109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19b979c4-1225-4e2e-bc19-248cf528fe87 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:46.035265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-16712053-92d8-430f-9f87-742f7a748c90 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Getting quotas for project 39f52dd2be4344c0b8efce1f70eb2112. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:20:46.055301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-16712053-92d8-430f-9f87-742f7a748c90 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Getting quotas for user b9c940f8d67d4eb7828647bbe0869fc5 and project 39f52dd2be4344c0b8efce1f70eb2112. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:20:46.086631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-16712053-92d8-430f-9f87-742f7a748c90 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:20:46.107110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-16712053-92d8-430f-9f87-742f7a748c90 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:20:46.214266 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-16712053-92d8-430f-9f87-742f7a748c90 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.324513 May 27 15:20:46.217919 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2550/5105] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:20:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:20:46.223629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5699304c-730d-42b9-9199-acb61fa1c83a tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:46.230166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5699304c-730d-42b9-9199-acb61fa1c83a tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] [instance: 37acc336-598b-4d82-8f06-0f405cc51183] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:46.247269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5699304c-730d-42b9-9199-acb61fa1c83a tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:46.253459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5699304c-730d-42b9-9199-acb61fa1c83a tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:46.254560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5699304c-730d-42b9-9199-acb61fa1c83a tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:46.255182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5699304c-730d-42b9-9199-acb61fa1c83a tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:46.276343 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-5699304c-730d-42b9-9199-acb61fa1c83a tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] HTTP exception thrown: Instance 37acc336-598b-4d82-8f06-0f405cc51183 could not be found. May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5699304c-730d-42b9-9199-acb61fa1c83a tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Request method failure captured: May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183 HTTP/1.1 May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOwweY2oAC1C7APt8MIGyCCl-5yFzq24nwwlB3Q51hwvLe212ADpEvFJA4y68jYmcz-U2sMb9UNa7EUFYQzdAjF1gfUCR4Yfz8puvXLeFK3mSXBTcUIfNk1w4GTzAnU6fktqLRcVGBSoxF97ngNppF9twzPWtV18oG0eUdPZqhYiI8A May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-Openstack-Nova-Api-Version: 2.26 May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 09cf56d7b12b445aadc583eef99ea026 May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerTagsTestJSON-1148304424 May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09cf56d7b12b445aadc583eef99ea026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/09cf56d7b12b445aadc583eef99ea026"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/09cf56d7b12b445aadc583eef99ea026"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_09cf56d7b12b445aadc583eef99ea026", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerTagsTestJSON-1148304424 May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 09cf56d7b12b445aadc583eef99ea026 May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerTagsTestJSON-1148304424 May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerTagsTestJSON-1148304424-project May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: c48e5dce95834fbe9e696865ed21ae0a May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerTagsTestJSON-1148304424-project May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 37acc336-598b-4d82-8f06-0f405cc51183 could not be found. May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '37acc336-598b-4d82-8f06-0f405cc51183'} May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37acc336-598b-4d82-8f06-0f405cc51183 could not be found. May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37acc336-598b-4d82-8f06-0f405cc51183 could not be found. May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:46.278417 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:20:46.283459 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:46.283459 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:46.283459 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:46.283459 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:20:46.283459 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:20:46.283459 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37acc336-598b-4d82-8f06-0f405cc51183 could not be found. May 27 15:20:46.283459 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:20:46.285279 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5699304c-730d-42b9-9199-acb61fa1c83a tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] Returning 404 to user: Instance 37acc336-598b-4d82-8f06-0f405cc51183 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:20:46.287416 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5699304c-730d-42b9-9199-acb61fa1c83a tempest-ServerTagsTestJSON-1148304424 tempest-ServerTagsTestJSON-1148304424-project] 10.222.0.13 "GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183" status: 404 len: 111 microversion: 2.26 time: 0.068065 May 27 15:20:46.290060 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2551/5106] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:20:46 2022] GET /compute/v2.1/servers/37acc336-598b-4d82-8f06-0f405cc51183 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:20:46.304579 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c508b071-8aa5-47c8-942d-b262dead0a3f tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:46.305455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c508b071-8aa5-47c8-942d-b262dead0a3f tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:47.476148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c508b071-8aa5-47c8-942d-b262dead0a3f tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:47.509014 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c508b071-8aa5-47c8-942d-b262dead0a3f tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1214 microversion: 2.1 time: 1.217259 May 27 15:20:47.510099 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2552/5107] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:46 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1214 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:47.544964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-db996c1d-fb55-44f0-b63d-b3b01b3e0851 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:47.545608 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-db996c1d-fb55-44f0-b63d-b3b01b3e0851 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:47.579350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:47.587339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-19b979c4-1225-4e2e-bc19-248cf528fe87 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:47.601341 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-19b979c4-1225-4e2e-bc19-248cf528fe87 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 200 len: 1681 microversion: 2.1 time: 1.615827 May 27 15:20:47.601942 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2556/5108] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:45 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 1681 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:47.603331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db996c1d-fb55-44f0-b63d-b3b01b3e0851 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:47.603979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db996c1d-fb55-44f0-b63d-b3b01b3e0851 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:47.610590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db996c1d-fb55-44f0-b63d-b3b01b3e0851 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:47.611323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db996c1d-fb55-44f0-b63d-b3b01b3e0851 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:48.138016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-db996c1d-fb55-44f0-b63d-b3b01b3e0851 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:48.147664 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-db996c1d-fb55-44f0-b63d-b3b01b3e0851 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 200 len: 1308 microversion: 2.1 time: 0.635516 May 27 15:20:48.162258 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2553/5109] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:47 2022] GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 1308 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:48.532498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e64756f0-0398-4587-982e-29e93d8e4dfd tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:48.533169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e64756f0-0398-4587-982e-29e93d8e4dfd tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:48.560879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e64756f0-0398-4587-982e-29e93d8e4dfd tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:48.561340 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e64756f0-0398-4587-982e-29e93d8e4dfd tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:48.569084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e64756f0-0398-4587-982e-29e93d8e4dfd tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:48.577470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e64756f0-0398-4587-982e-29e93d8e4dfd tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:48.615327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-472ddbf2-4b74-4622-ad55-ab32b2d5e47a req-85a9fda3-fe68-483c-8f06-d9ea8229678d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f417695-eff6-4c81-89e9-9f8301495dd8", "name": "network-vif-plugged", "status": "completed", "tag": "8461ebad-e71c-4278-a68b-1bf2ae90fb4e"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:48.639148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-472ddbf2-4b74-4622-ad55-ab32b2d5e47a req-85a9fda3-fe68-483c-8f06-d9ea8229678d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:48.641591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-472ddbf2-4b74-4622-ad55-ab32b2d5e47a req-85a9fda3-fe68-483c-8f06-d9ea8229678d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:48.685127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e64756f0-0398-4587-982e-29e93d8e4dfd tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:48.690615 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-472ddbf2-4b74-4622-ad55-ab32b2d5e47a req-85a9fda3-fe68-483c-8f06-d9ea8229678d service nova] Creating event network-vif-plugged:8461ebad-e71c-4278-a68b-1bf2ae90fb4e for instance 5f417695-eff6-4c81-89e9-9f8301495dd8 on n-h2-843621-1 May 27 15:20:48.696244 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e64756f0-0398-4587-982e-29e93d8e4dfd tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1274 microversion: 2.1 time: 0.170841 May 27 15:20:48.706742 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2557/5110] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:48 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1274 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:48.706936 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-472ddbf2-4b74-4622-ad55-ab32b2d5e47a req-85a9fda3-fe68-483c-8f06-d9ea8229678d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093217 May 27 15:20:48.706936 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2554/5111] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:20:48.713252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9c21f939-2b89-441b-a9f9-4b05371907da tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:48.714517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9c21f939-2b89-441b-a9f9-4b05371907da tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:48.747273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c21f939-2b89-441b-a9f9-4b05371907da tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:48.749991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c21f939-2b89-441b-a9f9-4b05371907da tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:48.751641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c21f939-2b89-441b-a9f9-4b05371907da tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:48.753275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c21f939-2b89-441b-a9f9-4b05371907da tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:49.151118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9c21f939-2b89-441b-a9f9-4b05371907da tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:49.160309 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9c21f939-2b89-441b-a9f9-4b05371907da tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 200 len: 1681 microversion: 2.1 time: 0.457658 May 27 15:20:49.160974 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2558/5112] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:48 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 1681 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:49.184181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-26e133f3-e41a-46c8-81b1-dbb3f5e4826a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:49.184992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-26e133f3-e41a-46c8-81b1-dbb3f5e4826a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:49.198929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26e133f3-e41a-46c8-81b1-dbb3f5e4826a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:49.199395 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26e133f3-e41a-46c8-81b1-dbb3f5e4826a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:49.200220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26e133f3-e41a-46c8-81b1-dbb3f5e4826a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:49.200664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26e133f3-e41a-46c8-81b1-dbb3f5e4826a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:49.563530 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-26e133f3-e41a-46c8-81b1-dbb3f5e4826a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:49.596268 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-26e133f3-e41a-46c8-81b1-dbb3f5e4826a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 200 len: 1308 microversion: 2.1 time: 0.409323 May 27 15:20:49.613352 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2555/5113] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:49 2022] GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 1308 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:49.729274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b1b0c335-9008-4835-962b-c7bf3ac14c8a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:49.730040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b1b0c335-9008-4835-962b-c7bf3ac14c8a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:49.743667 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b1b0c335-9008-4835-962b-c7bf3ac14c8a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:49.744215 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b1b0c335-9008-4835-962b-c7bf3ac14c8a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:49.750097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b1b0c335-9008-4835-962b-c7bf3ac14c8a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:49.750622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b1b0c335-9008-4835-962b-c7bf3ac14c8a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:49.873658 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b1b0c335-9008-4835-962b-c7bf3ac14c8a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:49.890514 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b1b0c335-9008-4835-962b-c7bf3ac14c8a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1272 microversion: 2.1 time: 0.168146 May 27 15:20:49.891127 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2559/5114] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:49 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1272 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:50.181862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a876aa03-6575-4d36-94b4-9bc461561ce4 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:50.182586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a876aa03-6575-4d36-94b4-9bc461561ce4 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:50.212912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a876aa03-6575-4d36-94b4-9bc461561ce4 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:50.212912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a876aa03-6575-4d36-94b4-9bc461561ce4 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:50.216307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a876aa03-6575-4d36-94b4-9bc461561ce4 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:50.226293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a876aa03-6575-4d36-94b4-9bc461561ce4 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:50.422886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a876aa03-6575-4d36-94b4-9bc461561ce4 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:50.450850 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a876aa03-6575-4d36-94b4-9bc461561ce4 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 200 len: 1614 microversion: 2.1 time: 0.273408 May 27 15:20:50.454615 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2556/5115] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:50 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 1614 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:50.618131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-55118ccc-4747-4d41-81c3-627b2115d379 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:50.619424 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-55118ccc-4747-4d41-81c3-627b2115d379 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:50.630501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55118ccc-4747-4d41-81c3-627b2115d379 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:50.630961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55118ccc-4747-4d41-81c3-627b2115d379 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:50.631872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55118ccc-4747-4d41-81c3-627b2115d379 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:50.632364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55118ccc-4747-4d41-81c3-627b2115d379 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:50.913787 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8a46e2df-d818-4142-8740-4e9a16ad9e74 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:50.914543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8a46e2df-d818-4142-8740-4e9a16ad9e74 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:50.925093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a46e2df-d818-4142-8740-4e9a16ad9e74 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:50.925757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a46e2df-d818-4142-8740-4e9a16ad9e74 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:50.927193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a46e2df-d818-4142-8740-4e9a16ad9e74 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:50.927804 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a46e2df-d818-4142-8740-4e9a16ad9e74 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:51.070627 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8a46e2df-d818-4142-8740-4e9a16ad9e74 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:51.077981 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-55118ccc-4747-4d41-81c3-627b2115d379 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:51.081050 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:51.092593 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8a46e2df-d818-4142-8740-4e9a16ad9e74 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1272 microversion: 2.1 time: 0.186977 May 27 15:20:51.093171 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-55118ccc-4747-4d41-81c3-627b2115d379 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 200 len: 1490 microversion: 2.1 time: 0.478865 May 27 15:20:51.095089 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2560/5116] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:50 2022] GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 1490 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:51.099430 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2557/5117] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:50 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:51.120953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a6015274-38af-4fbf-b261-48712c9cfdbb tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:51.126539 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a6015274-38af-4fbf-b261-48712c9cfdbb tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:51.142062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a6015274-38af-4fbf-b261-48712c9cfdbb tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:51.146357 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a6015274-38af-4fbf-b261-48712c9cfdbb tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:51.151892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a6015274-38af-4fbf-b261-48712c9cfdbb tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:51.152386 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a6015274-38af-4fbf-b261-48712c9cfdbb tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:51.295952 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a6015274-38af-4fbf-b261-48712c9cfdbb tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "PUT /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 200 len: 1085 microversion: 2.1 time: 0.187404 May 27 15:20:51.296755 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2561/5118] 10.222.0.13 () {60 vars in 1255 bytes} [Fri May 27 15:20:51 2022] PUT /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 1085 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:51.311218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-736f6811-6bda-43bb-85a9-4f71f99f9f54 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:51.311936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-736f6811-6bda-43bb-85a9-4f71f99f9f54 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:51.323516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-736f6811-6bda-43bb-85a9-4f71f99f9f54 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:51.325669 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-736f6811-6bda-43bb-85a9-4f71f99f9f54 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:51.327853 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-736f6811-6bda-43bb-85a9-4f71f99f9f54 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:51.329860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-736f6811-6bda-43bb-85a9-4f71f99f9f54 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:51.469290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-4a0803d6-594f-4113-9383-34786aeec2f0 req-5443f1da-81d1-4354-97c8-799d86d2d3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b014831-b34a-4451-9bf7-f9a5d3dbb17f", "name": "network-vif-deleted", "tag": "41df9384-4288-4063-947f-534a792f3faa"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:51.484446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-4a0803d6-594f-4113-9383-34786aeec2f0 req-5443f1da-81d1-4354-97c8-799d86d2d3ca service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:51.484934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-4a0803d6-594f-4113-9383-34786aeec2f0 req-5443f1da-81d1-4354-97c8-799d86d2d3ca service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:51.518837 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-4a0803d6-594f-4113-9383-34786aeec2f0 req-5443f1da-81d1-4354-97c8-799d86d2d3ca service nova] Creating event network-vif-deleted:41df9384-4288-4063-947f-534a792f3faa for instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f on n-h2-843621-1 May 27 15:20:51.532852 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-4a0803d6-594f-4113-9383-34786aeec2f0 req-5443f1da-81d1-4354-97c8-799d86d2d3ca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067448 May 27 15:20:51.535196 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2562/5119] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:20:51.565225 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d65548a5-484f-406d-8689-7f4aab36782a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:51.567288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d65548a5-484f-406d-8689-7f4aab36782a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:51.624419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d65548a5-484f-406d-8689-7f4aab36782a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:51.633340 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d65548a5-484f-406d-8689-7f4aab36782a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:51.640368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d65548a5-484f-406d-8689-7f4aab36782a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:51.646869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d65548a5-484f-406d-8689-7f4aab36782a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:51.660890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-736f6811-6bda-43bb-85a9-4f71f99f9f54 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:51.671241 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-736f6811-6bda-43bb-85a9-4f71f99f9f54 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 200 len: 1511 microversion: 2.1 time: 0.364515 May 27 15:20:51.672584 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2558/5120] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:51 2022] GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 1511 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:51.696158 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d214531c-ee02-4539-a5bb-438760807a19 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:51.701485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d214531c-ee02-4539-a5bb-438760807a19 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:51.710961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d214531c-ee02-4539-a5bb-438760807a19 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:51.713038 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d214531c-ee02-4539-a5bb-438760807a19 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:51.717404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d214531c-ee02-4539-a5bb-438760807a19 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:51.718049 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d214531c-ee02-4539-a5bb-438760807a19 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:51.806290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d65548a5-484f-406d-8689-7f4aab36782a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:51.806700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d65548a5-484f-406d-8689-7f4aab36782a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:51.813313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-d65548a5-484f-406d-8689-7f4aab36782a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lazy-loading 'fault' on Instance uuid 9b014831-b34a-4451-9bf7-f9a5d3dbb17f {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:51.981886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d65548a5-484f-406d-8689-7f4aab36782a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:52.008417 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d65548a5-484f-406d-8689-7f4aab36782a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 200 len: 1331 microversion: 2.1 time: 0.466396 May 27 15:20:52.010195 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2563/5121] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:51 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 1331 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:52.038982 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8659b973-ac18-41b0-95a5-8101ffdc3bad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:52.042671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8659b973-ac18-41b0-95a5-8101ffdc3bad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:52.068358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8659b973-ac18-41b0-95a5-8101ffdc3bad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:52.069268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8659b973-ac18-41b0-95a5-8101ffdc3bad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:52.070086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8659b973-ac18-41b0-95a5-8101ffdc3bad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:52.070536 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8659b973-ac18-41b0-95a5-8101ffdc3bad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:52.514930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d214531c-ee02-4539-a5bb-438760807a19 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:52.529498 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d214531c-ee02-4539-a5bb-438760807a19 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 200 len: 1511 microversion: 2.1 time: 0.840905 May 27 15:20:52.541147 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2559/5122] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:51 2022] GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 1511 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:52.549907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0b74dd19-bbf0-40db-933e-c335ea241402 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:52.550832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0b74dd19-bbf0-40db-933e-c335ea241402 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:52.567798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b74dd19-bbf0-40db-933e-c335ea241402 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:52.568561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b74dd19-bbf0-40db-933e-c335ea241402 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:52.569977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b74dd19-bbf0-40db-933e-c335ea241402 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:52.570578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b74dd19-bbf0-40db-933e-c335ea241402 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:52.659696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8659b973-ac18-41b0-95a5-8101ffdc3bad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:52.676953 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8659b973-ac18-41b0-95a5-8101ffdc3bad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.658323 May 27 15:20:52.680748 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2564/5123] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:52 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:52.696306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3100adef-0d78-429d-a709-0add9ff335c4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:52.697307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3100adef-0d78-429d-a709-0add9ff335c4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:52.713492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3100adef-0d78-429d-a709-0add9ff335c4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:52.714921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3100adef-0d78-429d-a709-0add9ff335c4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:52.715903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3100adef-0d78-429d-a709-0add9ff335c4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:52.716630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3100adef-0d78-429d-a709-0add9ff335c4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:52.782112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3100adef-0d78-429d-a709-0add9ff335c4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:20:52.945946 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0b74dd19-bbf0-40db-933e-c335ea241402 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:52.962798 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3100adef-0d78-429d-a709-0add9ff335c4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 204 len: 0 microversion: 2.1 time: 0.280682 May 27 15:20:52.964306 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2565/5124] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:20:52 2022] DELETE /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:20:52.973012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c35cdbc9-813e-41c9-9c51-321dd7206974 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1026529699"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:52.973761 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0b74dd19-bbf0-40db-933e-c335ea241402 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1314 microversion: 2.1 time: 0.414233 May 27 15:20:52.976818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c35cdbc9-813e-41c9-9c51-321dd7206974 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:52.977095 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2560/5125] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:52 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:52.993686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c35cdbc9-813e-41c9-9c51-321dd7206974 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:52.994151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c35cdbc9-813e-41c9-9c51-321dd7206974 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:52.995585 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c35cdbc9-813e-41c9-9c51-321dd7206974 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:52.995943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c35cdbc9-813e-41c9-9c51-321dd7206974 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:53.005094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3f98b1c0-5b23-49a3-8caa-4a06e766965e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:53.005902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3f98b1c0-5b23-49a3-8caa-4a06e766965e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:53.040934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f98b1c0-5b23-49a3-8caa-4a06e766965e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:53.042259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f98b1c0-5b23-49a3-8caa-4a06e766965e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:53.043387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f98b1c0-5b23-49a3-8caa-4a06e766965e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:53.059430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3f98b1c0-5b23-49a3-8caa-4a06e766965e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:53.479242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3f98b1c0-5b23-49a3-8caa-4a06e766965e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:53.488855 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3f98b1c0-5b23-49a3-8caa-4a06e766965e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 200 len: 1517 microversion: 2.1 time: 0.509167 May 27 15:20:53.509602 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2561/5126] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:52 2022] GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 1517 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:53.525092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-225b1bd4-ca12-425e-bb66-751647f1ad17 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:53.526708 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-225b1bd4-ca12-425e-bb66-751647f1ad17 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:53.545541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-225b1bd4-ca12-425e-bb66-751647f1ad17 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:53.547448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-225b1bd4-ca12-425e-bb66-751647f1ad17 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:53.549219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-225b1bd4-ca12-425e-bb66-751647f1ad17 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:53.549703 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-225b1bd4-ca12-425e-bb66-751647f1ad17 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:53.618063 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-225b1bd4-ca12-425e-bb66-751647f1ad17 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] HTTP exception thrown: Instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f could not be found. May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-225b1bd4-ca12-425e-bb66-751647f1ad17 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Request method failure captured: May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f HTTP/1.1 May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOrMyApwEozUDyrEIfAo_5Y4g_1HkChw1SWcTHKZFCS59hbDZ-tG27fBruZ89SDVYIwJf1049Wu3YE4lY2cORLx6FEdOR4uGmA8kqdyyKM11lovRtNDp2ouZkjSiDmO17gaqasURXD2cDNTsBoZha7a41XrY22c7gADFUiZI3zmSCNg May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a9a825b1ade46e3a702ae19c7c53f6b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 59f88a11fc4b4bf6b4a807ccffee1fab May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f could not be found. May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '9b014831-b34a-4451-9bf7-f9a5d3dbb17f'} May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f could not be found. May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f could not be found. May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:53.620212 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:20:53.625838 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:53.625838 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:53.625838 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:53.625838 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:20:53.625838 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:20:53.625838 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f could not be found. May 27 15:20:53.625838 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:20:53.625838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-225b1bd4-ca12-425e-bb66-751647f1ad17 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Returning 404 to user: Instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:20:53.634881 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-225b1bd4-ca12-425e-bb66-751647f1ad17 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 404 len: 111 microversion: 2.1 time: 0.120315 May 27 15:20:53.639164 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2562/5127] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:53 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:20:53.644350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-59f5d3d7-95d9-4048-8aeb-a697f1b1ed67 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '.version_select at 0x7fc776f24f70>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:53.677348 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-59f5d3d7-95d9-4048-8aeb-a697f1b1ed67 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1405315259" status: 202 len: 0 microversion: 2.1 time: 0.036966 May 27 15:20:53.678747 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2563/5128] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 27 15:20:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1405315259 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:20:53.760884 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c35cdbc9-813e-41c9-9c51-321dd7206974 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action" status: 202 len: 0 microversion: 2.1 time: 0.794632 May 27 15:20:53.770404 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2566/5129] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:20:52 2022] POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action => generated 0 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 27 15:20:53.945546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-f984ad3a-ecdc-4cd7-8a1c-9927f8b1148a req-0529fdbd-69ff-47f5-83c3-adf25ebb07a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa44ac2-38d8-4f8e-bc99-4c9487756708", "tag": "bee9fccf-9fc4-45b4-a702-3601ea47be74"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:53.994451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-737dd646-2d4a-4441-8b25-2b08171b48b5 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:53.995195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-737dd646-2d4a-4441-8b25-2b08171b48b5 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:54.004302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-737dd646-2d4a-4441-8b25-2b08171b48b5 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:54.004647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f984ad3a-ecdc-4cd7-8a1c-9927f8b1148a req-0529fdbd-69ff-47f5-83c3-adf25ebb07a3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:54.006306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f984ad3a-ecdc-4cd7-8a1c-9927f8b1148a req-0529fdbd-69ff-47f5-83c3-adf25ebb07a3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:54.017453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-737dd646-2d4a-4441-8b25-2b08171b48b5 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:54.028071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-737dd646-2d4a-4441-8b25-2b08171b48b5 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:54.032360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-737dd646-2d4a-4441-8b25-2b08171b48b5 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:54.040045 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-f984ad3a-ecdc-4cd7-8a1c-9927f8b1148a req-0529fdbd-69ff-47f5-83c3-adf25ebb07a3 service nova] Creating event network-changed:bee9fccf-9fc4-45b4-a702-3601ea47be74 for instance 3aa44ac2-38d8-4f8e-bc99-4c9487756708 on n-h1-843621-1 May 27 15:20:54.074553 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-f984ad3a-ecdc-4cd7-8a1c-9927f8b1148a req-0529fdbd-69ff-47f5-83c3-adf25ebb07a3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133946 May 27 15:20:54.078655 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2564/5130] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:54.478795 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-737dd646-2d4a-4441-8b25-2b08171b48b5 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:54.489435 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-737dd646-2d4a-4441-8b25-2b08171b48b5 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1314 microversion: 2.1 time: 0.499804 May 27 15:20:54.491722 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2567/5131] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:53 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:54.509484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0c6bb5e5-af05-44d5-8f2b-ce82d1571c1e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:54.510085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0c6bb5e5-af05-44d5-8f2b-ce82d1571c1e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:54.537383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c6bb5e5-af05-44d5-8f2b-ce82d1571c1e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:54.538978 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c6bb5e5-af05-44d5-8f2b-ce82d1571c1e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:54.542417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c6bb5e5-af05-44d5-8f2b-ce82d1571c1e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:54.543418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c6bb5e5-af05-44d5-8f2b-ce82d1571c1e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:54.615718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:55.115780 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0c6bb5e5-af05-44d5-8f2b-ce82d1571c1e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:55.152610 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0c6bb5e5-af05-44d5-8f2b-ce82d1571c1e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 200 len: 1517 microversion: 2.1 time: 0.645440 May 27 15:20:55.154401 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2565/5132] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:54 2022] GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 1517 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:55.284082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-513058ad-760b-4e99-9301-24e27c5cfc08 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Action: 'create', calling method: .version_select at 0x7fc775f383a0>, body: {"keypair": {"name": "tempest-keypair-1370725543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8+Vq0N8RvQxwwRWWBPQRCsecAJVUu6CkXAEl7sUTgZ26/+i2qP0e+i5ArfNopjb6lfOaZb46WKIii8OqLLnNPSbmioy5T9uk9VQNiwRm0888uhtDYaipUkUVR+BPcuMA=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:55.348959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-513058ad-760b-4e99-9301-24e27c5cfc08 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Getting quotas for project 5a9a825b1ade46e3a702ae19c7c53f6b. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:20:55.361317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-513058ad-760b-4e99-9301-24e27c5cfc08 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Getting quotas for user 59f88a11fc4b4bf6b4a807ccffee1fab and project 5a9a825b1ade46e3a702ae19c7c53f6b. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:20:55.419941 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-513058ad-760b-4e99-9301-24e27c5cfc08 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.142404 May 27 15:20:55.421160 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2568/5133] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:20:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:55.510032 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2c2a104e-23da-491f-aaa6-75bc2328d403 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:55.510852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2c2a104e-23da-491f-aaa6-75bc2328d403 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:55.531461 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c2a104e-23da-491f-aaa6-75bc2328d403 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:55.531941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c2a104e-23da-491f-aaa6-75bc2328d403 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:55.532765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c2a104e-23da-491f-aaa6-75bc2328d403 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:55.533215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c2a104e-23da-491f-aaa6-75bc2328d403 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:55.964490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2c2a104e-23da-491f-aaa6-75bc2328d403 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:55.984346 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2c2a104e-23da-491f-aaa6-75bc2328d403 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1314 microversion: 2.1 time: 0.480183 May 27 15:20:55.986819 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2566/5134] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:55 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:56.172872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-41703c34-5d26-4e16-9cf2-1f6ae647ac76 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:56.173706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-41703c34-5d26-4e16-9cf2-1f6ae647ac76 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:56.194057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41703c34-5d26-4e16-9cf2-1f6ae647ac76 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:56.217100 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-add71bfa-ea3d-422b-983f-500ee72965f5 req-6100eebe-db3f-4593-9dc3-8a96fc4682ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f417695-eff6-4c81-89e9-9f8301495dd8", "name": "network-vif-deleted", "tag": "8461ebad-e71c-4278-a68b-1bf2ae90fb4e"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:56.228608 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:56.229036 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41703c34-5d26-4e16-9cf2-1f6ae647ac76 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:56.230291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41703c34-5d26-4e16-9cf2-1f6ae647ac76 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:56.249694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41703c34-5d26-4e16-9cf2-1f6ae647ac76 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:56.263336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-add71bfa-ea3d-422b-983f-500ee72965f5 req-6100eebe-db3f-4593-9dc3-8a96fc4682ef service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:56.264066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-add71bfa-ea3d-422b-983f-500ee72965f5 req-6100eebe-db3f-4593-9dc3-8a96fc4682ef service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:56.281770 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-add71bfa-ea3d-422b-983f-500ee72965f5 req-6100eebe-db3f-4593-9dc3-8a96fc4682ef service nova] Creating event network-vif-deleted:8461ebad-e71c-4278-a68b-1bf2ae90fb4e for instance 5f417695-eff6-4c81-89e9-9f8301495dd8 on n-h2-843621-1 May 27 15:20:56.288985 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-add71bfa-ea3d-422b-983f-500ee72965f5 req-6100eebe-db3f-4593-9dc3-8a96fc4682ef service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079181 May 27 15:20:56.291038 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2567/5135] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:20:56.346285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41703c34-5d26-4e16-9cf2-1f6ae647ac76 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:56.346872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-41703c34-5d26-4e16-9cf2-1f6ae647ac76 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:56.347453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-41703c34-5d26-4e16-9cf2-1f6ae647ac76 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lazy-loading 'fault' on Instance uuid 5f417695-eff6-4c81-89e9-9f8301495dd8 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:56.451178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-41703c34-5d26-4e16-9cf2-1f6ae647ac76 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:56.470517 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-41703c34-5d26-4e16-9cf2-1f6ae647ac76 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 200 len: 1319 microversion: 2.1 time: 0.303335 May 27 15:20:56.472753 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2569/5136] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:56 2022] GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:56.568203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-db26e123-a2f6-48d8-b069-560633af6923 req-4602868b-ad7c-4fd0-aa7b-41729f69be84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812d42c0-07f1-4f7c-83b8-848b18cf0186", "name": "network-vif-unplugged", "status": "completed", "tag": "0d9da5e7-a50c-4ddd-aca9-02eae7d0476c"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:56.578430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-db26e123-a2f6-48d8-b069-560633af6923 req-4602868b-ad7c-4fd0-aa7b-41729f69be84 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:56.581669 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-db26e123-a2f6-48d8-b069-560633af6923 req-4602868b-ad7c-4fd0-aa7b-41729f69be84 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:56.613637 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-db26e123-a2f6-48d8-b069-560633af6923 req-4602868b-ad7c-4fd0-aa7b-41729f69be84 service nova] Creating event network-vif-unplugged:0d9da5e7-a50c-4ddd-aca9-02eae7d0476c for instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 on n-h1-843621-1 May 27 15:20:56.624874 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-db26e123-a2f6-48d8-b069-560633af6923 req-4602868b-ad7c-4fd0-aa7b-41729f69be84 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062519 May 27 15:20:56.627715 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2568/5137] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:57.004372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1ea10d58-7d5e-4a9a-96e5-b2f6cb462358 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:57.005511 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1ea10d58-7d5e-4a9a-96e5-b2f6cb462358 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:57.017928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1ea10d58-7d5e-4a9a-96e5-b2f6cb462358 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:57.018470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1ea10d58-7d5e-4a9a-96e5-b2f6cb462358 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:57.027414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1ea10d58-7d5e-4a9a-96e5-b2f6cb462358 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:57.027937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1ea10d58-7d5e-4a9a-96e5-b2f6cb462358 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:57.266675 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1ea10d58-7d5e-4a9a-96e5-b2f6cb462358 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:57.278575 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1ea10d58-7d5e-4a9a-96e5-b2f6cb462358 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1314 microversion: 2.1 time: 0.280278 May 27 15:20:57.280725 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2570/5138] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:56 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:57.492705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-49e5c2ba-7991-47fd-bfe9-2c00e5efbec5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:57.493565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-49e5c2ba-7991-47fd-bfe9-2c00e5efbec5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:57.510121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-49e5c2ba-7991-47fd-bfe9-2c00e5efbec5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:57.511266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-49e5c2ba-7991-47fd-bfe9-2c00e5efbec5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:57.514350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-49e5c2ba-7991-47fd-bfe9-2c00e5efbec5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:57.514350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-49e5c2ba-7991-47fd-bfe9-2c00e5efbec5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:57.514350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=8 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:57.539425 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-49e5c2ba-7991-47fd-bfe9-2c00e5efbec5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance 5f417695-eff6-4c81-89e9-9f8301495dd8 could not be found. May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-49e5c2ba-7991-47fd-bfe9-2c00e5efbec5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 HTTP/1.1 May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 5f417695-eff6-4c81-89e9-9f8301495dd8 could not be found. May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '5f417695-eff6-4c81-89e9-9f8301495dd8'} May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f417695-eff6-4c81-89e9-9f8301495dd8 could not be found. May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f417695-eff6-4c81-89e9-9f8301495dd8 could not be found. May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:20:57.542227 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:57.568263 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:57.568263 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:57.568263 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:20:57.568263 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:20:57.568263 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f417695-eff6-4c81-89e9-9f8301495dd8 could not be found. May 27 15:20:57.568263 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:20:57.568263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-49e5c2ba-7991-47fd-bfe9-2c00e5efbec5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance 5f417695-eff6-4c81-89e9-9f8301495dd8 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:20:57.568263 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-49e5c2ba-7991-47fd-bfe9-2c00e5efbec5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 404 len: 111 microversion: 2.1 time: 0.058319 May 27 15:20:57.568263 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2569/5139] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:57 2022] GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:20:57.723167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b90734bd-02b4-4a41-b413-0cd13d1bf4a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-939833491", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "679b759f-4940-4405-a687-165c11fb616b"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:57.734460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:57.828647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-b90734bd-02b4-4a41-b413-0cd13d1bf4a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] validate_networks() for [('679b759f-4940-4405-a687-165c11fb616b', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:20:58.297837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-44a71fb4-2b6b-4a52-8b73-64189bc32fa5 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:58.298580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-44a71fb4-2b6b-4a52-8b73-64189bc32fa5 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:58.307105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44a71fb4-2b6b-4a52-8b73-64189bc32fa5 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:58.312648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44a71fb4-2b6b-4a52-8b73-64189bc32fa5 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:58.313847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44a71fb4-2b6b-4a52-8b73-64189bc32fa5 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:58.315132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44a71fb4-2b6b-4a52-8b73-64189bc32fa5 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:59.184143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-44a71fb4-2b6b-4a52-8b73-64189bc32fa5 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:59.204599 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-44a71fb4-2b6b-4a52-8b73-64189bc32fa5 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1314 microversion: 2.1 time: 0.911404 May 27 15:20:59.205859 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2570/5140] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:58 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1314 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:59.323657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b90734bd-02b4-4a41-b413-0cd13d1bf4a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:20:59.324396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b90734bd-02b4-4a41-b413-0cd13d1bf4a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:20:59.325118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b90734bd-02b4-4a41-b413-0cd13d1bf4a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:20:59.325118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b90734bd-02b4-4a41-b413-0cd13d1bf4a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:20:59.325503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-b90734bd-02b4-4a41-b413-0cd13d1bf4a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:20:59.348852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b90734bd-02b4-4a41-b413-0cd13d1bf4a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:59.353383 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b90734bd-02b4-4a41-b413-0cd13d1bf4a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:59.354503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b90734bd-02b4-4a41-b413-0cd13d1bf4a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:59.355468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b90734bd-02b4-4a41-b413-0cd13d1bf4a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:59.386838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7e6192d0-08e5-4c57-9e9d-c67422a31a10 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1628138793", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5506dc4-66e1-4bd2-af40-7ec96debefd9"}], "security_groups": [{"name": "tempest-securitygroup--964040227"}], "key_name": "tempest-keypair-1370725543", "user_data": "}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:59.404921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-b90734bd-02b4-4a41-b413-0cd13d1bf4a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Getting quotas for project db397cde9e67464182a7ba045f1779be. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:20:59.416640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-b90734bd-02b4-4a41-b413-0cd13d1bf4a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Getting quotas for user 2f0525081cf441998d2c320fa0087cff and project db397cde9e67464182a7ba045f1779be. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:20:59.449305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b90734bd-02b4-4a41-b413-0cd13d1bf4a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:20:59.456415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b90734bd-02b4-4a41-b413-0cd13d1bf4a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:20:59.553034 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b90734bd-02b4-4a41-b413-0cd13d1bf4a0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.834208 May 27 15:20:59.554537 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2571/5141] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:20:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:20:59.565226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8bfd3453-d456-41b5-be3f-da8ae803e314 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:59.566168 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8bfd3453-d456-41b5-be3f-da8ae803e314 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:59.601548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-7e6192d0-08e5-4c57-9e9d-c67422a31a10 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] validate_networks() for [('b5506dc4-66e1-4bd2-af40-7ec96debefd9', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:20:59.665000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8bfd3453-d456-41b5-be3f-da8ae803e314 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:59.684638 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8bfd3453-d456-41b5-be3f-da8ae803e314 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1208 microversion: 2.1 time: 0.123266 May 27 15:20:59.686659 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2572/5142] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:20:59 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1208 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:00.239111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f22831c8-629d-4419-bd59-36033c2271fb tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:00.239738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f22831c8-629d-4419-bd59-36033c2271fb tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:00.255184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f22831c8-629d-4419-bd59-36033c2271fb tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:00.255900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f22831c8-629d-4419-bd59-36033c2271fb tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:00.256992 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f22831c8-629d-4419-bd59-36033c2271fb tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:00.257647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f22831c8-629d-4419-bd59-36033c2271fb tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:00.535383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-7e6192d0-08e5-4c57-9e9d-c67422a31a10 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:21:00.536839 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-7e6192d0-08e5-4c57-9e9d-c67422a31a10 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:21:00.537730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-7e6192d0-08e5-4c57-9e9d-c67422a31a10 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:21:00.538342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-7e6192d0-08e5-4c57-9e9d-c67422a31a10 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:21:00.538971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-7e6192d0-08e5-4c57-9e9d-c67422a31a10 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:21:00.575129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e6192d0-08e5-4c57-9e9d-c67422a31a10 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:00.586527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e6192d0-08e5-4c57-9e9d-c67422a31a10 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:00.588787 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e6192d0-08e5-4c57-9e9d-c67422a31a10 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:00.593009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e6192d0-08e5-4c57-9e9d-c67422a31a10 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:00.690372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-7e6192d0-08e5-4c57-9e9d-c67422a31a10 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Getting quotas for project 5a9a825b1ade46e3a702ae19c7c53f6b. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:21:00.694409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f22831c8-629d-4419-bd59-36033c2271fb tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:00.703505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-7e6192d0-08e5-4c57-9e9d-c67422a31a10 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Getting quotas for user 59f88a11fc4b4bf6b4a807ccffee1fab and project 5a9a825b1ade46e3a702ae19c7c53f6b. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:21:00.704972 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f22831c8-629d-4419-bd59-36033c2271fb tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1314 microversion: 2.1 time: 0.482904 May 27 15:21:00.710019 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2573/5143] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:00 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:00.721375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5a9aec41-97bb-4e9e-b382-fcc32c88008b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:00.724222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5a9aec41-97bb-4e9e-b382-fcc32c88008b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:00.737859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7e6192d0-08e5-4c57-9e9d-c67422a31a10 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:21:00.740632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7e6192d0-08e5-4c57-9e9d-c67422a31a10 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:21:00.755743 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a9aec41-97bb-4e9e-b382-fcc32c88008b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:00.758841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a9aec41-97bb-4e9e-b382-fcc32c88008b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:00.761769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a9aec41-97bb-4e9e-b382-fcc32c88008b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:00.763691 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a9aec41-97bb-4e9e-b382-fcc32c88008b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:00.900582 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7e6192d0-08e5-4c57-9e9d-c67422a31a10 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.520330 May 27 15:21:00.903533 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2571/5144] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:20:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 1524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 15:21:00.915167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d297cd88-034c-42e1-984b-d2557e6c8ddb tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:00.930778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d297cd88-034c-42e1-984b-d2557e6c8ddb tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:00.980324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5a9aec41-97bb-4e9e-b382-fcc32c88008b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:00.988949 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5a9aec41-97bb-4e9e-b382-fcc32c88008b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1204 microversion: 2.1 time: 0.277520 May 27 15:21:00.990658 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2574/5145] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:00 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1204 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:01.099555 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d297cd88-034c-42e1-984b-d2557e6c8ddb tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:01.111362 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d297cd88-034c-42e1-984b-d2557e6c8ddb tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 200 len: 1242 microversion: 2.1 time: 0.200600 May 27 15:21:01.130796 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2572/5146] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:00 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 1242 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:01.246401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-cc903213-9c54-41aa-8dad-8794a3c6a088 req-bc360ebe-50f7-4436-a491-736a79913c03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812d42c0-07f1-4f7c-83b8-848b18cf0186", "name": "network-vif-plugged", "status": "completed", "tag": "0d9da5e7-a50c-4ddd-aca9-02eae7d0476c"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:01.258417 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-cc903213-9c54-41aa-8dad-8794a3c6a088 req-bc360ebe-50f7-4436-a491-736a79913c03 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:01.259113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-cc903213-9c54-41aa-8dad-8794a3c6a088 req-bc360ebe-50f7-4436-a491-736a79913c03 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:01.273786 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-cc903213-9c54-41aa-8dad-8794a3c6a088 req-bc360ebe-50f7-4436-a491-736a79913c03 service nova] Creating event network-vif-plugged:0d9da5e7-a50c-4ddd-aca9-02eae7d0476c for instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 on n-h1-843621-1 May 27 15:21:01.280344 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-cc903213-9c54-41aa-8dad-8794a3c6a088 req-bc360ebe-50f7-4436-a491-736a79913c03 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040408 May 27 15:21:01.281762 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2575/5147] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:01.738428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-97ab0666-8d08-460b-a7e4-f41c6e83046d tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:01.739095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-97ab0666-8d08-460b-a7e4-f41c6e83046d tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:01.764727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-97ab0666-8d08-460b-a7e4-f41c6e83046d tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:01.765326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-97ab0666-8d08-460b-a7e4-f41c6e83046d tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:01.768442 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-97ab0666-8d08-460b-a7e4-f41c6e83046d tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:01.769401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-97ab0666-8d08-460b-a7e4-f41c6e83046d tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:02.009840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a487b30d-637a-4943-b204-a08fe9668fc0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:02.011792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a487b30d-637a-4943-b204-a08fe9668fc0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:02.030702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a487b30d-637a-4943-b204-a08fe9668fc0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:02.035480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a487b30d-637a-4943-b204-a08fe9668fc0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:02.039526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a487b30d-637a-4943-b204-a08fe9668fc0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:02.043130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a487b30d-637a-4943-b204-a08fe9668fc0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:02.103574 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-97ab0666-8d08-460b-a7e4-f41c6e83046d tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:02.114187 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-97ab0666-8d08-460b-a7e4-f41c6e83046d tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1314 microversion: 2.1 time: 0.390393 May 27 15:21:02.129764 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2573/5148] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:01 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:02.148955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6825c769-ccf0-411b-a64c-5809de13ed9a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:02.149763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6825c769-ccf0-411b-a64c-5809de13ed9a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:02.183817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6825c769-ccf0-411b-a64c-5809de13ed9a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:02.184288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6825c769-ccf0-411b-a64c-5809de13ed9a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:02.185125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6825c769-ccf0-411b-a64c-5809de13ed9a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:02.185587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6825c769-ccf0-411b-a64c-5809de13ed9a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:02.186481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a487b30d-637a-4943-b204-a08fe9668fc0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:02.197801 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a487b30d-637a-4943-b204-a08fe9668fc0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1266 microversion: 2.1 time: 0.193524 May 27 15:21:02.201792 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2576/5149] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:02 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:02.403628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6825c769-ccf0-411b-a64c-5809de13ed9a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:02.414182 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6825c769-ccf0-411b-a64c-5809de13ed9a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 200 len: 1238 microversion: 2.1 time: 0.283198 May 27 15:21:02.418716 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2574/5150] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:02 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 1238 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:03.166024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4c5c301e-215f-4528-b35f-68ba4dfa8cc2 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:03.167022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4c5c301e-215f-4528-b35f-68ba4dfa8cc2 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:03.184337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c5c301e-215f-4528-b35f-68ba4dfa8cc2 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:03.185078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c5c301e-215f-4528-b35f-68ba4dfa8cc2 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:03.187772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c5c301e-215f-4528-b35f-68ba4dfa8cc2 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:03.188970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c5c301e-215f-4528-b35f-68ba4dfa8cc2 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:03.219855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8e4db96e-7389-4ad8-82d2-10ce93136fac tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:03.220633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8e4db96e-7389-4ad8-82d2-10ce93136fac tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:03.241751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e4db96e-7389-4ad8-82d2-10ce93136fac tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:03.242362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e4db96e-7389-4ad8-82d2-10ce93136fac tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:03.247704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e4db96e-7389-4ad8-82d2-10ce93136fac tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:03.248295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e4db96e-7389-4ad8-82d2-10ce93136fac tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:03.254387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:03.493818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8e4db96e-7389-4ad8-82d2-10ce93136fac tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:03.507703 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8e4db96e-7389-4ad8-82d2-10ce93136fac tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1266 microversion: 2.1 time: 0.291641 May 27 15:21:03.508299 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2575/5151] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:03 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:03.521456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5ae58e16-954b-4e35-ba3f-bc107e3109ad tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:03.522085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5ae58e16-954b-4e35-ba3f-bc107e3109ad tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:03.538351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5ae58e16-954b-4e35-ba3f-bc107e3109ad tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:03.539099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5ae58e16-954b-4e35-ba3f-bc107e3109ad tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:03.542248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5ae58e16-954b-4e35-ba3f-bc107e3109ad tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:03.543682 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5ae58e16-954b-4e35-ba3f-bc107e3109ad tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:03.603023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4c5c301e-215f-4528-b35f-68ba4dfa8cc2 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:03.635077 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4c5c301e-215f-4528-b35f-68ba4dfa8cc2 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1314 microversion: 2.1 time: 0.469031 May 27 15:21:03.639042 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2577/5152] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:03 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:03.724517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5ae58e16-954b-4e35-ba3f-bc107e3109ad tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:03.733759 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5ae58e16-954b-4e35-ba3f-bc107e3109ad tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 200 len: 1300 microversion: 2.1 time: 0.224339 May 27 15:21:03.741122 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2576/5153] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:03 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 1300 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:04.529717 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7f599f79-bcfe-48d1-912b-c43afaffa335 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:04.530444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7f599f79-bcfe-48d1-912b-c43afaffa335 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:04.553781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f599f79-bcfe-48d1-912b-c43afaffa335 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:04.554250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f599f79-bcfe-48d1-912b-c43afaffa335 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:04.555051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f599f79-bcfe-48d1-912b-c43afaffa335 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:04.574102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f599f79-bcfe-48d1-912b-c43afaffa335 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:04.657985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-38a010f2-94dd-48f2-a73c-0ebfb451bd0f tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:04.658790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-38a010f2-94dd-48f2-a73c-0ebfb451bd0f tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:04.686322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38a010f2-94dd-48f2-a73c-0ebfb451bd0f tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:04.686712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38a010f2-94dd-48f2-a73c-0ebfb451bd0f tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:04.693702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38a010f2-94dd-48f2-a73c-0ebfb451bd0f tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:04.694174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38a010f2-94dd-48f2-a73c-0ebfb451bd0f tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:04.973753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7f599f79-bcfe-48d1-912b-c43afaffa335 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:04.991390 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7f599f79-bcfe-48d1-912b-c43afaffa335 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1308 microversion: 2.1 time: 0.463174 May 27 15:21:04.992592 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2578/5154] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:04 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1308 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:05.008837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-62aee299-9b43-4feb-a09b-2acb90ec5f98 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:05.011901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-62aee299-9b43-4feb-a09b-2acb90ec5f98 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:05.031373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62aee299-9b43-4feb-a09b-2acb90ec5f98 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:05.032877 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62aee299-9b43-4feb-a09b-2acb90ec5f98 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:05.033729 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62aee299-9b43-4feb-a09b-2acb90ec5f98 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:05.034190 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62aee299-9b43-4feb-a09b-2acb90ec5f98 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:05.067459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-38a010f2-94dd-48f2-a73c-0ebfb451bd0f tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:05.080043 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-38a010f2-94dd-48f2-a73c-0ebfb451bd0f tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1314 microversion: 2.1 time: 0.423877 May 27 15:21:05.095895 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2577/5155] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:04 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:05.095895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-ae4fe423-a64d-4d8c-b68d-c2786fb556d2 req-f31ea7f2-6b4b-4246-9601-6f2232406837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa44ac2-38d8-4f8e-bc99-4c9487756708", "name": "network-vif-plugged", "status": "completed", "tag": "bee9fccf-9fc4-45b4-a702-3601ea47be74"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:05.128431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ae4fe423-a64d-4d8c-b68d-c2786fb556d2 req-f31ea7f2-6b4b-4246-9601-6f2232406837 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:05.129134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ae4fe423-a64d-4d8c-b68d-c2786fb556d2 req-f31ea7f2-6b4b-4246-9601-6f2232406837 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:05.173966 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-ae4fe423-a64d-4d8c-b68d-c2786fb556d2 req-f31ea7f2-6b4b-4246-9601-6f2232406837 service nova] Creating event network-vif-plugged:bee9fccf-9fc4-45b4-a702-3601ea47be74 for instance 3aa44ac2-38d8-4f8e-bc99-4c9487756708 on n-h1-843621-1 May 27 15:21:05.190864 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-ae4fe423-a64d-4d8c-b68d-c2786fb556d2 req-f31ea7f2-6b4b-4246-9601-6f2232406837 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108168 May 27 15:21:05.194590 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2578/5156] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:05.220056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-62aee299-9b43-4feb-a09b-2acb90ec5f98 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:05.229913 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-62aee299-9b43-4feb-a09b-2acb90ec5f98 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 200 len: 1300 microversion: 2.1 time: 0.232122 May 27 15:21:05.231249 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2579/5157] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:04 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 1300 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:06.012524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fe78950d-1575-4125-b309-ab6ec39b724b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:06.013657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fe78950d-1575-4125-b309-ab6ec39b724b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:06.030628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe78950d-1575-4125-b309-ab6ec39b724b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:06.031098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe78950d-1575-4125-b309-ab6ec39b724b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:06.031912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe78950d-1575-4125-b309-ab6ec39b724b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:06.038330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe78950d-1575-4125-b309-ab6ec39b724b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:06.102581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-228aaa0a-afd0-4e4a-a323-c0471e2ed0c0 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:06.103991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-228aaa0a-afd0-4e4a-a323-c0471e2ed0c0 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:06.112595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-228aaa0a-afd0-4e4a-a323-c0471e2ed0c0 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:06.117066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-228aaa0a-afd0-4e4a-a323-c0471e2ed0c0 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:06.118288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-228aaa0a-afd0-4e4a-a323-c0471e2ed0c0 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:06.118971 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-228aaa0a-afd0-4e4a-a323-c0471e2ed0c0 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:06.314352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fe78950d-1575-4125-b309-ab6ec39b724b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:06.323588 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fe78950d-1575-4125-b309-ab6ec39b724b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1308 microversion: 2.1 time: 0.317113 May 27 15:21:06.325979 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2579/5158] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:06 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1308 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:06.340581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5eb38b9c-da25-4913-a4ec-b816073ab223 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:06.341373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5eb38b9c-da25-4913-a4ec-b816073ab223 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:06.376387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5eb38b9c-da25-4913-a4ec-b816073ab223 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:06.380933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5eb38b9c-da25-4913-a4ec-b816073ab223 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:06.382282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5eb38b9c-da25-4913-a4ec-b816073ab223 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:06.385314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5eb38b9c-da25-4913-a4ec-b816073ab223 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:06.555746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-228aaa0a-afd0-4e4a-a323-c0471e2ed0c0 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:06.565899 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-228aaa0a-afd0-4e4a-a323-c0471e2ed0c0 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1314 microversion: 2.1 time: 0.467070 May 27 15:21:06.581497 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2580/5159] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:06 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:06.837225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5eb38b9c-da25-4913-a4ec-b816073ab223 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:06.846018 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5eb38b9c-da25-4913-a4ec-b816073ab223 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 200 len: 1367 microversion: 2.1 time: 0.518148 May 27 15:21:06.848313 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2580/5160] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:06 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 1367 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:07.345091 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e394e2cc-71bf-4cb5-8c5c-f55a7caa8992 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:07.345831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e394e2cc-71bf-4cb5-8c5c-f55a7caa8992 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:07.347780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-4aca60e3-8984-4ce4-b97b-f93294e5f062 req-0f56770b-fcf9-4507-88bd-353bd4e499e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d701db87-6f62-435a-b972-a7ac8733604c", "tag": "70cd2511-8ebe-424e-8768-049a8d83ec47"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:07.392628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e394e2cc-71bf-4cb5-8c5c-f55a7caa8992 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:07.394323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e394e2cc-71bf-4cb5-8c5c-f55a7caa8992 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:07.395350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-4aca60e3-8984-4ce4-b97b-f93294e5f062 req-0f56770b-fcf9-4507-88bd-353bd4e499e7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:07.396238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-4aca60e3-8984-4ce4-b97b-f93294e5f062 req-0f56770b-fcf9-4507-88bd-353bd4e499e7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:07.397231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e394e2cc-71bf-4cb5-8c5c-f55a7caa8992 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:07.399524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e394e2cc-71bf-4cb5-8c5c-f55a7caa8992 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:07.433762 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-4aca60e3-8984-4ce4-b97b-f93294e5f062 req-0f56770b-fcf9-4507-88bd-353bd4e499e7 service nova] Creating event network-changed:70cd2511-8ebe-424e-8768-049a8d83ec47 for instance d701db87-6f62-435a-b972-a7ac8733604c on n-h2-843621-1 May 27 15:21:07.452776 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-4aca60e3-8984-4ce4-b97b-f93294e5f062 req-0f56770b-fcf9-4507-88bd-353bd4e499e7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118273 May 27 15:21:07.455581 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2581/5161] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:07.600340 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-50bab0a7-86c6-458f-b549-e0fda6a63525 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:07.604506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-50bab0a7-86c6-458f-b549-e0fda6a63525 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:07.631533 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-50bab0a7-86c6-458f-b549-e0fda6a63525 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:07.631929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-50bab0a7-86c6-458f-b549-e0fda6a63525 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:07.632746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-50bab0a7-86c6-458f-b549-e0fda6a63525 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:07.633199 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-50bab0a7-86c6-458f-b549-e0fda6a63525 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:07.666052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e394e2cc-71bf-4cb5-8c5c-f55a7caa8992 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:07.684310 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e394e2cc-71bf-4cb5-8c5c-f55a7caa8992 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1308 microversion: 2.1 time: 0.345694 May 27 15:21:07.685498 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2581/5162] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:07 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1308 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:07.868864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d0175a22-27a1-4146-8008-3a142f384371 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:07.869811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d0175a22-27a1-4146-8008-3a142f384371 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:07.888337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d0175a22-27a1-4146-8008-3a142f384371 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:07.893440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d0175a22-27a1-4146-8008-3a142f384371 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:07.894642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d0175a22-27a1-4146-8008-3a142f384371 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:07.895108 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d0175a22-27a1-4146-8008-3a142f384371 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:08.102024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-50bab0a7-86c6-458f-b549-e0fda6a63525 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:08.115092 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-50bab0a7-86c6-458f-b549-e0fda6a63525 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1501 microversion: 2.1 time: 0.519795 May 27 15:21:08.124708 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2582/5163] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:07 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1501 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:08.136029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5d4fec48-21d1-45ea-b655-bc22b6a5b9d7 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:08.136713 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5d4fec48-21d1-45ea-b655-bc22b6a5b9d7 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:08.147781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5d4fec48-21d1-45ea-b655-bc22b6a5b9d7 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:08.148248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5d4fec48-21d1-45ea-b655-bc22b6a5b9d7 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:08.153649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5d4fec48-21d1-45ea-b655-bc22b6a5b9d7 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:08.153839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5d4fec48-21d1-45ea-b655-bc22b6a5b9d7 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:08.353692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d0175a22-27a1-4146-8008-3a142f384371 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:08.363547 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d0175a22-27a1-4146-8008-3a142f384371 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 200 len: 1367 microversion: 2.1 time: 0.498364 May 27 15:21:08.363547 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2582/5164] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:07 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 1367 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:08.511217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5d4fec48-21d1-45ea-b655-bc22b6a5b9d7 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:08.532347 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5d4fec48-21d1-45ea-b655-bc22b6a5b9d7 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1501 microversion: 2.1 time: 0.401954 May 27 15:21:08.534027 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2583/5165] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:08 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1501 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:08.559966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-66be1c16-5b98-4d68-b00b-ea818d657932 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:08.560641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-66be1c16-5b98-4d68-b00b-ea818d657932 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:08.581555 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66be1c16-5b98-4d68-b00b-ea818d657932 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:08.582984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66be1c16-5b98-4d68-b00b-ea818d657932 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:08.583959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66be1c16-5b98-4d68-b00b-ea818d657932 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:08.588219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66be1c16-5b98-4d68-b00b-ea818d657932 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:08.681598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-66be1c16-5b98-4d68-b00b-ea818d657932 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lazy-loading 'flavor' on Instance uuid 3aa44ac2-38d8-4f8e-bc99-4c9487756708 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:21:08.702969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a907d72c-7fbd-4178-844f-e4866838053a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:08.704013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a907d72c-7fbd-4178-844f-e4866838053a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:08.731438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a907d72c-7fbd-4178-844f-e4866838053a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:08.738659 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a907d72c-7fbd-4178-844f-e4866838053a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:08.746032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a907d72c-7fbd-4178-844f-e4866838053a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:08.751512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a907d72c-7fbd-4178-844f-e4866838053a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:08.934041 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-66be1c16-5b98-4d68-b00b-ea818d657932 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "POST /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708/action" status: 202 len: 0 microversion: 2.1 time: 0.380158 May 27 15:21:08.941017 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2583/5166] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:21:08 2022] POST /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:21:08.970886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7d65fe2f-8a1c-4c8e-8214-59271a4c1d08 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:08.977729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7d65fe2f-8a1c-4c8e-8214-59271a4c1d08 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:09.007318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d65fe2f-8a1c-4c8e-8214-59271a4c1d08 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:09.009323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d65fe2f-8a1c-4c8e-8214-59271a4c1d08 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:09.014582 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d65fe2f-8a1c-4c8e-8214-59271a4c1d08 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:09.019535 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d65fe2f-8a1c-4c8e-8214-59271a4c1d08 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:09.372497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:09.569211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a907d72c-7fbd-4178-844f-e4866838053a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:09.590920 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a907d72c-7fbd-4178-844f-e4866838053a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1308 microversion: 2.1 time: 0.892154 May 27 15:21:09.594855 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2584/5167] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:08 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1308 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:09.601774 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7fd5241f-715c-4e69-9bd4-e4ba1a37c30b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:09.602720 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7fd5241f-715c-4e69-9bd4-e4ba1a37c30b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:09.623877 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7fd5241f-715c-4e69-9bd4-e4ba1a37c30b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:09.624372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7fd5241f-715c-4e69-9bd4-e4ba1a37c30b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:09.625237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7fd5241f-715c-4e69-9bd4-e4ba1a37c30b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:09.627894 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7fd5241f-715c-4e69-9bd4-e4ba1a37c30b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:09.633229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7d65fe2f-8a1c-4c8e-8214-59271a4c1d08 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:09.638887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:09.652386 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7d65fe2f-8a1c-4c8e-8214-59271a4c1d08 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1509 microversion: 2.1 time: 0.702669 May 27 15:21:09.655105 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2584/5168] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:08 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1509 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:09.670585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-361ef23a-f9c3-4872-af88-81060ab13c2e req-8df7cbb3-e008-4139-9ba8-056584198fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb9b7c54-a210-490f-bf50-f6c1ece7ae55", "tag": "9043ff94-df32-4f3e-95d5-a543c47eccad"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:09.683507 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=12 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:09.696294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-361ef23a-f9c3-4872-af88-81060ab13c2e req-8df7cbb3-e008-4139-9ba8-056584198fd1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:09.698981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-361ef23a-f9c3-4872-af88-81060ab13c2e req-8df7cbb3-e008-4139-9ba8-056584198fd1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:09.725301 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-361ef23a-f9c3-4872-af88-81060ab13c2e req-8df7cbb3-e008-4139-9ba8-056584198fd1 service nova] Creating event network-changed:9043ff94-df32-4f3e-95d5-a543c47eccad for instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 on n-h2-843621-1 May 27 15:21:09.752834 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-361ef23a-f9c3-4872-af88-81060ab13c2e req-8df7cbb3-e008-4139-9ba8-056584198fd1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093901 May 27 15:21:09.755117 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2585/5169] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:09.880264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7fd5241f-715c-4e69-9bd4-e4ba1a37c30b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:09.889530 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7fd5241f-715c-4e69-9bd4-e4ba1a37c30b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 200 len: 1367 microversion: 2.1 time: 0.293485 May 27 15:21:09.891519 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2585/5170] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:09 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:10.612439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-83c08804-d226-48eb-9194-7f851209fb61 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:10.613915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-83c08804-d226-48eb-9194-7f851209fb61 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:10.637725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-83c08804-d226-48eb-9194-7f851209fb61 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:10.640113 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-83c08804-d226-48eb-9194-7f851209fb61 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:10.642546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-83c08804-d226-48eb-9194-7f851209fb61 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:10.644659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-83c08804-d226-48eb-9194-7f851209fb61 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:10.681127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7f5bf931-c459-4b34-b94d-2c782e02a4cf tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:10.681970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7f5bf931-c459-4b34-b94d-2c782e02a4cf tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:10.705233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f5bf931-c459-4b34-b94d-2c782e02a4cf tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:10.713115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f5bf931-c459-4b34-b94d-2c782e02a4cf tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:10.716288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f5bf931-c459-4b34-b94d-2c782e02a4cf tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:10.716863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f5bf931-c459-4b34-b94d-2c782e02a4cf tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:10.740949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:11.111668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=8 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:11.164654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7f5bf931-c459-4b34-b94d-2c782e02a4cf tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:11.173659 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7f5bf931-c459-4b34-b94d-2c782e02a4cf tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1492 microversion: 2.1 time: 0.504244 May 27 15:21:11.174258 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2586/5171] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:10 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1492 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:11.192162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fda89f90-2698-4f3c-b21b-7a6aa0b5b5d9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:11.192162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fda89f90-2698-4f3c-b21b-7a6aa0b5b5d9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:11.204065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fda89f90-2698-4f3c-b21b-7a6aa0b5b5d9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:11.204529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fda89f90-2698-4f3c-b21b-7a6aa0b5b5d9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:11.205373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fda89f90-2698-4f3c-b21b-7a6aa0b5b5d9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:11.218035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fda89f90-2698-4f3c-b21b-7a6aa0b5b5d9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:11.480068 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-83c08804-d226-48eb-9194-7f851209fb61 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:11.496461 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-83c08804-d226-48eb-9194-7f851209fb61 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1308 microversion: 2.1 time: 0.887028 May 27 15:21:11.514736 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2586/5172] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:10 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1308 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:11.536346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e2de38e3-5a2b-44f6-bf47-3e9b2c911977 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:11.537772 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e2de38e3-5a2b-44f6-bf47-3e9b2c911977 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:11.560712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fda89f90-2698-4f3c-b21b-7a6aa0b5b5d9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:11.583196 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fda89f90-2698-4f3c-b21b-7a6aa0b5b5d9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 200 len: 1367 microversion: 2.1 time: 0.400933 May 27 15:21:11.587695 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2587/5173] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:11 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 1367 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:11.591416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e2de38e3-5a2b-44f6-bf47-3e9b2c911977 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:11.593030 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e2de38e3-5a2b-44f6-bf47-3e9b2c911977 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:11.594693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e2de38e3-5a2b-44f6-bf47-3e9b2c911977 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:11.595425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e2de38e3-5a2b-44f6-bf47-3e9b2c911977 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:11.819234 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e2de38e3-5a2b-44f6-bf47-3e9b2c911977 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "POST /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708/action" status: 202 len: 0 microversion: 2.1 time: 0.300805 May 27 15:21:11.832179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d4cc225a-dec6-484b-86a1-a0b57ec99f6b tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:11.834487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d4cc225a-dec6-484b-86a1-a0b57ec99f6b tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:11.840830 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2587/5174] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:21:11 2022] POST /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:21:11.862168 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4cc225a-dec6-484b-86a1-a0b57ec99f6b tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:11.864230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4cc225a-dec6-484b-86a1-a0b57ec99f6b tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:11.867263 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4cc225a-dec6-484b-86a1-a0b57ec99f6b tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:11.868933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4cc225a-dec6-484b-86a1-a0b57ec99f6b tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:12.531300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2ceac1bc-6af8-405a-8ebc-6d9ee96c0461 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:12.531720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2ceac1bc-6af8-405a-8ebc-6d9ee96c0461 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:12.554910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2ceac1bc-6af8-405a-8ebc-6d9ee96c0461 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:12.555717 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2ceac1bc-6af8-405a-8ebc-6d9ee96c0461 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:12.558708 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2ceac1bc-6af8-405a-8ebc-6d9ee96c0461 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:12.575302 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2ceac1bc-6af8-405a-8ebc-6d9ee96c0461 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:13.206444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d4cc225a-dec6-484b-86a1-a0b57ec99f6b tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:13.219795 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d4cc225a-dec6-484b-86a1-a0b57ec99f6b tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1498 microversion: 2.1 time: 1.391264 May 27 15:21:13.231934 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2588/5175] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:11 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1498 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:13.241952 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c1c0678b-95fc-4be4-adcf-60ef9b29bea9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:13.242841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c1c0678b-95fc-4be4-adcf-60ef9b29bea9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:13.267128 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c1c0678b-95fc-4be4-adcf-60ef9b29bea9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:13.272212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c1c0678b-95fc-4be4-adcf-60ef9b29bea9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:13.274691 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c1c0678b-95fc-4be4-adcf-60ef9b29bea9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:13.277423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c1c0678b-95fc-4be4-adcf-60ef9b29bea9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:13.290555 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2ceac1bc-6af8-405a-8ebc-6d9ee96c0461 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:13.303208 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2ceac1bc-6af8-405a-8ebc-6d9ee96c0461 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1308 microversion: 2.1 time: 0.777311 May 27 15:21:13.304945 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2588/5176] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:12 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1308 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:13.311207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c05a606c-8139-47b9-ae4f-467c014658da tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:13.313853 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c05a606c-8139-47b9-ae4f-467c014658da tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:13.320790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c05a606c-8139-47b9-ae4f-467c014658da tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:13.334159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c05a606c-8139-47b9-ae4f-467c014658da tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:13.337245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c05a606c-8139-47b9-ae4f-467c014658da tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:13.339233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c05a606c-8139-47b9-ae4f-467c014658da tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:13.461541 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c05a606c-8139-47b9-ae4f-467c014658da tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154670 May 27 15:21:13.465024 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2589/5177] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:21:13 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:13.478519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-80c2e191-56fc-488a-9829-05ec20ed8e3a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:13.481019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-80c2e191-56fc-488a-9829-05ec20ed8e3a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:13.499189 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-80c2e191-56fc-488a-9829-05ec20ed8e3a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:13.499995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-80c2e191-56fc-488a-9829-05ec20ed8e3a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:13.504858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-80c2e191-56fc-488a-9829-05ec20ed8e3a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:13.505494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-80c2e191-56fc-488a-9829-05ec20ed8e3a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:13.595111 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-80c2e191-56fc-488a-9829-05ec20ed8e3a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments/9ff93d62-b236-4d3d-9595-d575625ed4d0" status: 200 len: 194 microversion: 2.1 time: 0.124225 May 27 15:21:13.599863 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2590/5178] 10.222.0.13 () {58 vars in 1412 bytes} [Fri May 27 15:21:13 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments/9ff93d62-b236-4d3d-9595-d575625ed4d0 => generated 194 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:13.614769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c1c0678b-95fc-4be4-adcf-60ef9b29bea9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:13.634152 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c1c0678b-95fc-4be4-adcf-60ef9b29bea9 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 200 len: 1367 microversion: 2.1 time: 0.400720 May 27 15:21:13.646511 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2589/5179] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:13 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 1367 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:14.248029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4966375e-f106-48f9-8d18-6412dfb36e68 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:14.250129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4966375e-f106-48f9-8d18-6412dfb36e68 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:14.267311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4966375e-f106-48f9-8d18-6412dfb36e68 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:14.268378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4966375e-f106-48f9-8d18-6412dfb36e68 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:14.272086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4966375e-f106-48f9-8d18-6412dfb36e68 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:14.273153 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4966375e-f106-48f9-8d18-6412dfb36e68 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:14.323054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6d35ef97-d60d-46f3-8f33-83551109d4a4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:14.324651 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6d35ef97-d60d-46f3-8f33-83551109d4a4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:14.345385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d35ef97-d60d-46f3-8f33-83551109d4a4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:14.346152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d35ef97-d60d-46f3-8f33-83551109d4a4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:14.348479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d35ef97-d60d-46f3-8f33-83551109d4a4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:14.349378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d35ef97-d60d-46f3-8f33-83551109d4a4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:15.017750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6d35ef97-d60d-46f3-8f33-83551109d4a4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:15.027262 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6d35ef97-d60d-46f3-8f33-83551109d4a4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1308 microversion: 2.1 time: 0.709701 May 27 15:21:15.038935 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2590/5180] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:14 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1308 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:15.054138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-22486852-8abf-49ae-bab6-bc8c791c5058 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:15.057467 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-22486852-8abf-49ae-bab6-bc8c791c5058 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:15.066287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4966375e-f106-48f9-8d18-6412dfb36e68 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:15.077993 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4966375e-f106-48f9-8d18-6412dfb36e68 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1498 microversion: 2.1 time: 0.835508 May 27 15:21:15.083062 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2591/5181] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:14 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1498 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:15.086217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22486852-8abf-49ae-bab6-bc8c791c5058 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:15.093349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22486852-8abf-49ae-bab6-bc8c791c5058 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:15.097103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22486852-8abf-49ae-bab6-bc8c791c5058 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:15.097860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22486852-8abf-49ae-bab6-bc8c791c5058 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:15.143725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-78ead7a2-f79e-4eb8-860b-c323815641c4 req-3db0808d-07ba-4c35-8719-79489758405c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d701db87-6f62-435a-b972-a7ac8733604c", "name": "network-vif-plugged", "status": "completed", "tag": "70cd2511-8ebe-424e-8768-049a8d83ec47"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:15.166930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-78ead7a2-f79e-4eb8-860b-c323815641c4 req-3db0808d-07ba-4c35-8719-79489758405c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:15.191195 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-78ead7a2-f79e-4eb8-860b-c323815641c4 req-3db0808d-07ba-4c35-8719-79489758405c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:15.258332 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-78ead7a2-f79e-4eb8-860b-c323815641c4 req-3db0808d-07ba-4c35-8719-79489758405c service nova] Creating event network-vif-plugged:70cd2511-8ebe-424e-8768-049a8d83ec47 for instance d701db87-6f62-435a-b972-a7ac8733604c on n-h2-843621-1 May 27 15:21:15.267303 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-78ead7a2-f79e-4eb8-860b-c323815641c4 req-3db0808d-07ba-4c35-8719-79489758405c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127460 May 27 15:21:15.290966 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2592/5182] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:15.829405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-22486852-8abf-49ae-bab6-bc8c791c5058 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:15.846353 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-22486852-8abf-49ae-bab6-bc8c791c5058 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 200 len: 1367 microversion: 2.1 time: 0.805881 May 27 15:21:15.861123 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2591/5183] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:15 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 1367 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:16.062019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3876c655-1609-4639-b4e8-3f203378d0c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:16.063138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3876c655-1609-4639-b4e8-3f203378d0c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:16.066573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:16.084299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3876c655-1609-4639-b4e8-3f203378d0c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:16.089760 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3876c655-1609-4639-b4e8-3f203378d0c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:16.092176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3876c655-1609-4639-b4e8-3f203378d0c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:16.093141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3876c655-1609-4639-b4e8-3f203378d0c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:16.110485 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a0cb8ca4-ea7e-436a-a253-8138031cc42b tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:16.111597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a0cb8ca4-ea7e-436a-a253-8138031cc42b tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:16.129346 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a0cb8ca4-ea7e-436a-a253-8138031cc42b tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:16.143706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a0cb8ca4-ea7e-436a-a253-8138031cc42b tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:16.149336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a0cb8ca4-ea7e-436a-a253-8138031cc42b tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:16.156769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a0cb8ca4-ea7e-436a-a253-8138031cc42b tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:16.832134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a0cb8ca4-ea7e-436a-a253-8138031cc42b tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:16.841712 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a0cb8ca4-ea7e-436a-a253-8138031cc42b tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1501 microversion: 2.1 time: 0.739813 May 27 15:21:16.842223 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2592/5184] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:16 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1501 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:16.879855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-28d59930-6e86-4291-a642-698c9887028a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:16.880432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-28d59930-6e86-4291-a642-698c9887028a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:16.902405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-28d59930-6e86-4291-a642-698c9887028a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:16.903025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3876c655-1609-4639-b4e8-3f203378d0c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:16.904353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-28d59930-6e86-4291-a642-698c9887028a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:16.907066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-28d59930-6e86-4291-a642-698c9887028a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:16.909399 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-28d59930-6e86-4291-a642-698c9887028a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:16.932914 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3876c655-1609-4639-b4e8-3f203378d0c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1308 microversion: 2.1 time: 0.879470 May 27 15:21:16.942739 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2593/5185] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:16 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1308 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:16.951999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-28d59930-6e86-4291-a642-698c9887028a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lazy-loading 'flavor' on Instance uuid 3aa44ac2-38d8-4f8e-bc99-4c9487756708 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:21:16.960418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f4932cf7-310a-4120-af87-8e96cf7ca6b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:16.968937 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f4932cf7-310a-4120-af87-8e96cf7ca6b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:16.978476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4932cf7-310a-4120-af87-8e96cf7ca6b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:16.979943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4932cf7-310a-4120-af87-8e96cf7ca6b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:16.981271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4932cf7-310a-4120-af87-8e96cf7ca6b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:16.981977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4932cf7-310a-4120-af87-8e96cf7ca6b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:17.039981 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:17.250682 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-28d59930-6e86-4291-a642-698c9887028a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "POST /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708/action" status: 202 len: 0 microversion: 2.1 time: 0.390794 May 27 15:21:17.251798 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2593/5186] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:21:16 2022] POST /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:21:17.262883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e7753a0c-9383-4430-9d83-4acda9093884 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:17.263988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e7753a0c-9383-4430-9d83-4acda9093884 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:17.272873 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7753a0c-9383-4430-9d83-4acda9093884 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:17.273421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7753a0c-9383-4430-9d83-4acda9093884 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:17.274343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7753a0c-9383-4430-9d83-4acda9093884 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:17.274909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7753a0c-9383-4430-9d83-4acda9093884 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:17.864912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f4932cf7-310a-4120-af87-8e96cf7ca6b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:17.884638 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f4932cf7-310a-4120-af87-8e96cf7ca6b8 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 200 len: 1367 microversion: 2.1 time: 0.930289 May 27 15:21:17.886315 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2594/5187] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:16 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 1367 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:17.899917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e7753a0c-9383-4430-9d83-4acda9093884 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:17.910488 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e7753a0c-9383-4430-9d83-4acda9093884 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1509 microversion: 2.1 time: 0.654360 May 27 15:21:17.923407 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2594/5188] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:17 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1509 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:17.951493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9e7f3cd5-6adb-4e73-9878-e4a730690cf0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:17.952349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9e7f3cd5-6adb-4e73-9878-e4a730690cf0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:17.968311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e7f3cd5-6adb-4e73-9878-e4a730690cf0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:17.969207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e7f3cd5-6adb-4e73-9878-e4a730690cf0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:17.970613 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e7f3cd5-6adb-4e73-9878-e4a730690cf0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:17.972029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e7f3cd5-6adb-4e73-9878-e4a730690cf0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:18.505981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9e7f3cd5-6adb-4e73-9878-e4a730690cf0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:18.515846 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9e7f3cd5-6adb-4e73-9878-e4a730690cf0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1489 microversion: 2.1 time: 0.569316 May 27 15:21:18.516560 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2595/5189] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:17 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1489 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:18.533587 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-af1f70d4-582a-46ba-bc5b-0041523f1067 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2097321006"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:18.535490 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-af1f70d4-582a-46ba-bc5b-0041523f1067 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:18.555298 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af1f70d4-582a-46ba-bc5b-0041523f1067 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:18.562315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af1f70d4-582a-46ba-bc5b-0041523f1067 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:18.563618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af1f70d4-582a-46ba-bc5b-0041523f1067 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:18.566661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af1f70d4-582a-46ba-bc5b-0041523f1067 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:18.685776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-c535b40f-f414-4215-99c2-f493e41bb069 req-f1e21658-93d6-4128-a494-973627eb2fbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb9b7c54-a210-490f-bf50-f6c1ece7ae55", "name": "network-vif-plugged", "status": "completed", "tag": "9043ff94-df32-4f3e-95d5-a543c47eccad"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:18.715580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-c535b40f-f414-4215-99c2-f493e41bb069 req-f1e21658-93d6-4128-a494-973627eb2fbb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:18.721040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-c535b40f-f414-4215-99c2-f493e41bb069 req-f1e21658-93d6-4128-a494-973627eb2fbb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:18.738208 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-af1f70d4-582a-46ba-bc5b-0041523f1067 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "PUT /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1075 microversion: 2.1 time: 0.208551 May 27 15:21:18.738869 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2595/5190] 10.222.0.13 () {60 vars in 1255 bytes} [Fri May 27 15:21:18 2022] PUT /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1075 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:18.752500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4a83abaa-9c82-467d-941a-0c1adf9d6cde tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14c1bec1-df30-4ad4-a15c-07f620cf9ce4"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:18.753998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4a83abaa-9c82-467d-941a-0c1adf9d6cde tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:18.760638 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-c535b40f-f414-4215-99c2-f493e41bb069 req-f1e21658-93d6-4128-a494-973627eb2fbb service nova] Creating event network-vif-plugged:9043ff94-df32-4f3e-95d5-a543c47eccad for instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 on n-h2-843621-1 May 27 15:21:18.762696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a83abaa-9c82-467d-941a-0c1adf9d6cde tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:18.766379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a83abaa-9c82-467d-941a-0c1adf9d6cde tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:18.767529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a83abaa-9c82-467d-941a-0c1adf9d6cde tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:18.772388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a83abaa-9c82-467d-941a-0c1adf9d6cde tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:18.805119 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-c535b40f-f414-4215-99c2-f493e41bb069 req-f1e21658-93d6-4128-a494-973627eb2fbb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124909 May 27 15:21:18.806136 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2596/5191] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:21:18.812193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d97b38a8-784f-4b60-bbd0-54aa030ba9e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:18.813307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d97b38a8-784f-4b60-bbd0-54aa030ba9e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:18.823005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d97b38a8-784f-4b60-bbd0-54aa030ba9e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:18.824646 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d97b38a8-784f-4b60-bbd0-54aa030ba9e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:18.826249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d97b38a8-784f-4b60-bbd0-54aa030ba9e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:18.826913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d97b38a8-784f-4b60-bbd0-54aa030ba9e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:19.353922 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4a83abaa-9c82-467d-941a-0c1adf9d6cde tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "POST /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.584743 May 27 15:21:19.359490 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2596/5192] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 15:21:18 2022] POST /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments => generated 194 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:19.414438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f8d2a244-8c57-4837-8e79-1203f3efff0c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:19.419765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f8d2a244-8c57-4837-8e79-1203f3efff0c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:19.462516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8d2a244-8c57-4837-8e79-1203f3efff0c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:19.469253 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8d2a244-8c57-4837-8e79-1203f3efff0c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:19.476420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8d2a244-8c57-4837-8e79-1203f3efff0c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:19.479398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8d2a244-8c57-4837-8e79-1203f3efff0c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:19.611816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d97b38a8-784f-4b60-bbd0-54aa030ba9e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:19.628479 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d97b38a8-784f-4b60-bbd0-54aa030ba9e4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1501 microversion: 2.1 time: 0.820801 May 27 15:21:19.640832 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2597/5193] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:18 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1501 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:19.659987 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e4e5690e-81b6-4b9f-b621-a4a1bfc4ee5a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:19.671416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e4e5690e-81b6-4b9f-b621-a4a1bfc4ee5a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:19.682155 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e4e5690e-81b6-4b9f-b621-a4a1bfc4ee5a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:19.682623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e4e5690e-81b6-4b9f-b621-a4a1bfc4ee5a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:19.683639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e4e5690e-81b6-4b9f-b621-a4a1bfc4ee5a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:19.686934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e4e5690e-81b6-4b9f-b621-a4a1bfc4ee5a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:20.027647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f8d2a244-8c57-4837-8e79-1203f3efff0c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:20.052372 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f8d2a244-8c57-4837-8e79-1203f3efff0c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 200 len: 1367 microversion: 2.1 time: 0.664064 May 27 15:21:20.053020 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2597/5194] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:19 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 1367 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:20.069613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b48ef4c5-b761-445c-9c8d-81579d3e8657 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:20.070351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b48ef4c5-b761-445c-9c8d-81579d3e8657 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:20.078522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b48ef4c5-b761-445c-9c8d-81579d3e8657 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:20.079622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b48ef4c5-b761-445c-9c8d-81579d3e8657 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:20.080732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b48ef4c5-b761-445c-9c8d-81579d3e8657 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:20.081394 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b48ef4c5-b761-445c-9c8d-81579d3e8657 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:20.344437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e4e5690e-81b6-4b9f-b621-a4a1bfc4ee5a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:20.375990 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e4e5690e-81b6-4b9f-b621-a4a1bfc4ee5a tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1492 microversion: 2.1 time: 0.733613 May 27 15:21:20.389729 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2598/5195] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:19 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1492 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:20.409877 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-572f8ddd-441c-473b-b32e-47c15cc21937 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:20.410754 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-572f8ddd-441c-473b-b32e-47c15cc21937 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:20.419376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-572f8ddd-441c-473b-b32e-47c15cc21937 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:20.435985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-572f8ddd-441c-473b-b32e-47c15cc21937 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:20.437834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-572f8ddd-441c-473b-b32e-47c15cc21937 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:20.438491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-572f8ddd-441c-473b-b32e-47c15cc21937 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:20.643712 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-572f8ddd-441c-473b-b32e-47c15cc21937 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "POST /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708/action" status: 202 len: 0 microversion: 2.1 time: 0.237472 May 27 15:21:20.652547 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2599/5196] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:21:20 2022] POST /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:21:20.663382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f1702f82-7848-4e92-83ac-30ce88c925f7 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:20.669070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f1702f82-7848-4e92-83ac-30ce88c925f7 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:20.687617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1702f82-7848-4e92-83ac-30ce88c925f7 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:20.688729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1702f82-7848-4e92-83ac-30ce88c925f7 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:20.690064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1702f82-7848-4e92-83ac-30ce88c925f7 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:20.690713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1702f82-7848-4e92-83ac-30ce88c925f7 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:20.741704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b48ef4c5-b761-445c-9c8d-81579d3e8657 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:20.759094 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b48ef4c5-b761-445c-9c8d-81579d3e8657 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1501 microversion: 2.1 time: 0.699400 May 27 15:21:20.761289 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2598/5197] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:20 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1501 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:20.803125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-06637913-b10e-4ae8-b60e-2e7cd890fc6e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:20.826463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06637913-b10e-4ae8-b60e-2e7cd890fc6e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:20.827412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06637913-b10e-4ae8-b60e-2e7cd890fc6e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:20.933480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-06637913-b10e-4ae8-b60e-2e7cd890fc6e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Going to try to stop instance {{(pid=119248) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 15:21:21.050855 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-06637913-b10e-4ae8-b60e-2e7cd890fc6e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "POST /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c/action" status: 202 len: 0 microversion: 2.1 time: 0.275018 May 27 15:21:21.051792 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2599/5198] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:21:20 2022] POST /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:21:21.080787 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b4f6bb70-fd22-4f84-ada2-3621b848d94a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:21.081764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b4f6bb70-fd22-4f84-ada2-3621b848d94a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:21.106298 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4f6bb70-fd22-4f84-ada2-3621b848d94a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:21.107137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4f6bb70-fd22-4f84-ada2-3621b848d94a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:21.109689 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4f6bb70-fd22-4f84-ada2-3621b848d94a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:21.110919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4f6bb70-fd22-4f84-ada2-3621b848d94a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:21.640314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f1702f82-7848-4e92-83ac-30ce88c925f7 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:21.648199 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f1702f82-7848-4e92-83ac-30ce88c925f7 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1498 microversion: 2.1 time: 0.993745 May 27 15:21:21.649215 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2600/5199] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:20 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1498 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:21.671534 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6dde34b9-5cd1-4ea3-88f8-5b830f918eba tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:21.672162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6dde34b9-5cd1-4ea3-88f8-5b830f918eba tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:21.681337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6dde34b9-5cd1-4ea3-88f8-5b830f918eba tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:21.685783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6dde34b9-5cd1-4ea3-88f8-5b830f918eba tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:21.686755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6dde34b9-5cd1-4ea3-88f8-5b830f918eba tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:21.687360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6dde34b9-5cd1-4ea3-88f8-5b830f918eba tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:21.742354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:21.803904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b4f6bb70-fd22-4f84-ada2-3621b848d94a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:21.833256 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b4f6bb70-fd22-4f84-ada2-3621b848d94a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1511 microversion: 2.1 time: 0.767401 May 27 15:21:21.834617 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2600/5200] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:21 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1511 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:22.008828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6dde34b9-5cd1-4ea3-88f8-5b830f918eba tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:22.019180 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6dde34b9-5cd1-4ea3-88f8-5b830f918eba tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 200 len: 1557 microversion: 2.1 time: 0.359681 May 27 15:21:22.022570 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2601/5201] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:21 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 1557 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:22.045202 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6e849a4f-3bec-46c2-a159-1e01849059c2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:22.045899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6e849a4f-3bec-46c2-a159-1e01849059c2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:22.057836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6e849a4f-3bec-46c2-a159-1e01849059c2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:22.061953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6e849a4f-3bec-46c2-a159-1e01849059c2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:22.062836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6e849a4f-3bec-46c2-a159-1e01849059c2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:22.063312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6e849a4f-3bec-46c2-a159-1e01849059c2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:22.232608 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6e849a4f-3bec-46c2-a159-1e01849059c2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.192146 May 27 15:21:22.233665 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2601/5202] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 15:21:22 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-interface => generated 285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:22.666417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5dcbed98-ea4f-40e1-a862-e8034e6fd5df tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:22.667093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5dcbed98-ea4f-40e1-a862-e8034e6fd5df tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:22.680836 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5dcbed98-ea4f-40e1-a862-e8034e6fd5df tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:22.681305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5dcbed98-ea4f-40e1-a862-e8034e6fd5df tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:22.682134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5dcbed98-ea4f-40e1-a862-e8034e6fd5df tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:22.690012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5dcbed98-ea4f-40e1-a862-e8034e6fd5df tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:22.858791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-49a29649-729e-40b0-82d2-3558df9a0d06 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:22.859425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-49a29649-729e-40b0-82d2-3558df9a0d06 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:22.874698 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-49a29649-729e-40b0-82d2-3558df9a0d06 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:22.875499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-49a29649-729e-40b0-82d2-3558df9a0d06 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:22.880444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-49a29649-729e-40b0-82d2-3558df9a0d06 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:22.881000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-49a29649-729e-40b0-82d2-3558df9a0d06 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:23.157953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5dcbed98-ea4f-40e1-a862-e8034e6fd5df tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:23.171457 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5dcbed98-ea4f-40e1-a862-e8034e6fd5df tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1498 microversion: 2.1 time: 0.508946 May 27 15:21:23.172057 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2602/5203] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:22 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1498 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:23.224892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-49a29649-729e-40b0-82d2-3558df9a0d06 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:23.234316 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-49a29649-729e-40b0-82d2-3558df9a0d06 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1511 microversion: 2.1 time: 0.385443 May 27 15:21:23.241129 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2602/5204] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:22 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1511 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:24.189129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6b2a0f02-0602-4d0b-a4df-bf74f3f5d4fc tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:24.190098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6b2a0f02-0602-4d0b-a4df-bf74f3f5d4fc tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:24.206402 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b2a0f02-0602-4d0b-a4df-bf74f3f5d4fc tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:24.207150 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b2a0f02-0602-4d0b-a4df-bf74f3f5d4fc tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:24.208178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b2a0f02-0602-4d0b-a4df-bf74f3f5d4fc tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:24.208886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b2a0f02-0602-4d0b-a4df-bf74f3f5d4fc tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:24.259212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-516d7ca5-ca06-467e-94ab-ccc93a234954 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:24.261128 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-516d7ca5-ca06-467e-94ab-ccc93a234954 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:24.275530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-516d7ca5-ca06-467e-94ab-ccc93a234954 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:24.278301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-516d7ca5-ca06-467e-94ab-ccc93a234954 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:24.284560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-516d7ca5-ca06-467e-94ab-ccc93a234954 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:24.285385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-516d7ca5-ca06-467e-94ab-ccc93a234954 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:25.575755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6b2a0f02-0602-4d0b-a4df-bf74f3f5d4fc tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:25.586525 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6b2a0f02-0602-4d0b-a4df-bf74f3f5d4fc tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1501 microversion: 2.1 time: 1.401325 May 27 15:21:25.593657 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2603/5205] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:24 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1501 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:25.613908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-bc47419f-c2bd-4604-a1c4-be67516ade1a req-6b3a2d20-82a4-4bcf-934a-95d32915fbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb9b7c54-a210-490f-bf50-f6c1ece7ae55", "tag": "9043ff94-df32-4f3e-95d5-a543c47eccad"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:25.630802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-516d7ca5-ca06-467e-94ab-ccc93a234954 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:25.654015 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-516d7ca5-ca06-467e-94ab-ccc93a234954 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1511 microversion: 2.1 time: 1.393555 May 27 15:21:25.658496 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2603/5206] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:24 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1511 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:25.682857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-bc47419f-c2bd-4604-a1c4-be67516ade1a req-6b3a2d20-82a4-4bcf-934a-95d32915fbd7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:25.685272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-bc47419f-c2bd-4604-a1c4-be67516ade1a req-6b3a2d20-82a4-4bcf-934a-95d32915fbd7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:25.691211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a6a4d275-3382-4db3-9947-8c722014665c tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:25.692030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a6a4d275-3382-4db3-9947-8c722014665c tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:25.711577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a6a4d275-3382-4db3-9947-8c722014665c tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:25.715467 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a6a4d275-3382-4db3-9947-8c722014665c tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:25.716728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a6a4d275-3382-4db3-9947-8c722014665c tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:25.717759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a6a4d275-3382-4db3-9947-8c722014665c tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:25.720022 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-bc47419f-c2bd-4604-a1c4-be67516ade1a req-6b3a2d20-82a4-4bcf-934a-95d32915fbd7 service nova] Creating event network-changed:9043ff94-df32-4f3e-95d5-a543c47eccad for instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 on n-h2-843621-1 May 27 15:21:25.737021 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-bc47419f-c2bd-4604-a1c4-be67516ade1a req-6b3a2d20-82a4-4bcf-934a-95d32915fbd7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128142 May 27 15:21:25.741417 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2604/5207] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:25.760470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a6a4d275-3382-4db3-9947-8c722014665c tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:21:25.941847 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a6a4d275-3382-4db3-9947-8c722014665c tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 204 len: 0 microversion: 2.1 time: 0.277125 May 27 15:21:25.942762 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2604/5208] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:21:25 2022] DELETE /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:21:25.952700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7881157f-bef7-4ebc-ae3a-39bcbc4d3daa tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:25.953517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7881157f-bef7-4ebc-ae3a-39bcbc4d3daa tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:25.967690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7881157f-bef7-4ebc-ae3a-39bcbc4d3daa tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:25.969508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7881157f-bef7-4ebc-ae3a-39bcbc4d3daa tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:25.973197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7881157f-bef7-4ebc-ae3a-39bcbc4d3daa tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:25.979855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7881157f-bef7-4ebc-ae3a-39bcbc4d3daa tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:26.386249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7881157f-bef7-4ebc-ae3a-39bcbc4d3daa tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:26.404063 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7881157f-bef7-4ebc-ae3a-39bcbc4d3daa tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1507 microversion: 2.1 time: 0.456522 May 27 15:21:26.405210 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2605/5209] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:25 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1507 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:26.674845 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7f9553b7-8930-4746-bf1f-5cc8fe435bad tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:26.675740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7f9553b7-8930-4746-bf1f-5cc8fe435bad tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:26.686466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f9553b7-8930-4746-bf1f-5cc8fe435bad tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:26.687342 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f9553b7-8930-4746-bf1f-5cc8fe435bad tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:26.688371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f9553b7-8930-4746-bf1f-5cc8fe435bad tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:26.689073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f9553b7-8930-4746-bf1f-5cc8fe435bad tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:26.695272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:27.081501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7f9553b7-8930-4746-bf1f-5cc8fe435bad tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:27.115118 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7f9553b7-8930-4746-bf1f-5cc8fe435bad tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1511 microversion: 2.1 time: 0.443656 May 27 15:21:27.117317 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2605/5210] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:26 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1511 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:27.424269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-70467fae-5454-4d42-aed3-f17cd5c62f2e tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:27.425200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-70467fae-5454-4d42-aed3-f17cd5c62f2e tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:27.440298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70467fae-5454-4d42-aed3-f17cd5c62f2e tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:27.450693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70467fae-5454-4d42-aed3-f17cd5c62f2e tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:27.451610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70467fae-5454-4d42-aed3-f17cd5c62f2e tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:27.452118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70467fae-5454-4d42-aed3-f17cd5c62f2e tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:28.138176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-479a19b5-6075-4b62-9c81-c5d6687363cd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:28.139910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-479a19b5-6075-4b62-9c81-c5d6687363cd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:28.147310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:28.161333 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-479a19b5-6075-4b62-9c81-c5d6687363cd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:28.162483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-479a19b5-6075-4b62-9c81-c5d6687363cd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:28.165925 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-479a19b5-6075-4b62-9c81-c5d6687363cd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:28.172050 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-479a19b5-6075-4b62-9c81-c5d6687363cd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:28.240483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-70467fae-5454-4d42-aed3-f17cd5c62f2e tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:28.252701 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-70467fae-5454-4d42-aed3-f17cd5c62f2e tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1507 microversion: 2.1 time: 0.832589 May 27 15:21:28.256499 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2606/5211] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:27 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1507 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:28.590863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-479a19b5-6075-4b62-9c81-c5d6687363cd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:28.601089 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-479a19b5-6075-4b62-9c81-c5d6687363cd tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1511 microversion: 2.1 time: 0.471013 May 27 15:21:28.609066 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2606/5212] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:28 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1511 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:29.272661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-67115e65-ad18-40ce-992e-e18124b89ff0 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:29.273310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-67115e65-ad18-40ce-992e-e18124b89ff0 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:29.296798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67115e65-ad18-40ce-992e-e18124b89ff0 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:29.299867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67115e65-ad18-40ce-992e-e18124b89ff0 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:29.302869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67115e65-ad18-40ce-992e-e18124b89ff0 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:29.304244 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67115e65-ad18-40ce-992e-e18124b89ff0 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:29.620391 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1b6459d1-a854-4a62-a899-87f7376ce391 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:29.621783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1b6459d1-a854-4a62-a899-87f7376ce391 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:29.642409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b6459d1-a854-4a62-a899-87f7376ce391 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:29.645644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b6459d1-a854-4a62-a899-87f7376ce391 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:29.646804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b6459d1-a854-4a62-a899-87f7376ce391 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:29.650107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1b6459d1-a854-4a62-a899-87f7376ce391 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:29.757918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-67115e65-ad18-40ce-992e-e18124b89ff0 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9c940f8d67d4eb7828647bbe0869fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f52dd2be4344c0b8efce1f70eb2112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:29.791619 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-67115e65-ad18-40ce-992e-e18124b89ff0 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 200 len: 1465 microversion: 2.1 time: 0.522239 May 27 15:21:29.792226 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2607/5213] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:29 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 1465 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:29.803082 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-78bf176b-265f-4e9f-b391-c2dc2b634d09 req-0bd6b99b-8416-4dfa-8759-357e06bbc5ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa44ac2-38d8-4f8e-bc99-4c9487756708", "name": "network-vif-deleted", "tag": "bee9fccf-9fc4-45b4-a702-3601ea47be74"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:29.838952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-78bf176b-265f-4e9f-b391-c2dc2b634d09 req-0bd6b99b-8416-4dfa-8759-357e06bbc5ec service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:29.839675 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-78bf176b-265f-4e9f-b391-c2dc2b634d09 req-0bd6b99b-8416-4dfa-8759-357e06bbc5ec service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:29.881537 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-78bf176b-265f-4e9f-b391-c2dc2b634d09 req-0bd6b99b-8416-4dfa-8759-357e06bbc5ec service nova] Creating event network-vif-deleted:bee9fccf-9fc4-45b4-a702-3601ea47be74 for instance 3aa44ac2-38d8-4f8e-bc99-4c9487756708 on n-h1-843621-1 May 27 15:21:29.889394 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-78bf176b-265f-4e9f-b391-c2dc2b634d09 req-0bd6b99b-8416-4dfa-8759-357e06bbc5ec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090561 May 27 15:21:29.890775 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2608/5214] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:30.394069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1b6459d1-a854-4a62-a899-87f7376ce391 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:30.409748 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1b6459d1-a854-4a62-a899-87f7376ce391 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1511 microversion: 2.1 time: 0.790281 May 27 15:21:30.411154 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2607/5215] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:29 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1511 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:30.811502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-527f47f9-8ce3-4511-817f-6ddb88333fb2 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:30.812408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-527f47f9-8ce3-4511-817f-6ddb88333fb2 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] [instance: 3aa44ac2-38d8-4f8e-bc99-4c9487756708] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:30.832624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-527f47f9-8ce3-4511-817f-6ddb88333fb2 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:30.833370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-527f47f9-8ce3-4511-817f-6ddb88333fb2 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:30.834191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-527f47f9-8ce3-4511-817f-6ddb88333fb2 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:30.834652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-527f47f9-8ce3-4511-817f-6ddb88333fb2 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:30.867494 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-527f47f9-8ce3-4511-817f-6ddb88333fb2 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] HTTP exception thrown: Instance 3aa44ac2-38d8-4f8e-bc99-4c9487756708 could not be found. May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-527f47f9-8ce3-4511-817f-6ddb88333fb2 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Request method failure captured: May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 HTTP/1.1 May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOxHfx4Eyk8Lo8djGQy261yM9MGNIc27NWUmbKcM5p2kN3y-QKXMSgosThN-G7SlpZpzrztPqjfjZ0VcmsgL3JJAMeZIQOzeC_w6INaA3roJNnKKu3QA1f7FtPDseoQ0Win3ghi9gT69s9l2DRJ2xVZKHeMI00ZEm27ZTrF9zM8j9fA May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 39f52dd2be4344c0b8efce1f70eb2112 May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TestServerAdvancedOps-270662516 May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/39f52dd2be4344c0b8efce1f70eb2112"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/39f52dd2be4344c0b8efce1f70eb2112"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/39f52dd2be4344c0b8efce1f70eb2112"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_39f52dd2be4344c0b8efce1f70eb2112", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TestServerAdvancedOps-270662516 May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 39f52dd2be4344c0b8efce1f70eb2112 May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TestServerAdvancedOps-270662516 May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TestServerAdvancedOps-270662516-project May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b9c940f8d67d4eb7828647bbe0869fc5 May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TestServerAdvancedOps-270662516-project May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 3aa44ac2-38d8-4f8e-bc99-4c9487756708 could not be found. May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '3aa44ac2-38d8-4f8e-bc99-4c9487756708'} May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa44ac2-38d8-4f8e-bc99-4c9487756708 could not be found. May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa44ac2-38d8-4f8e-bc99-4c9487756708 could not be found. May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:30.875343 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:30.880954 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:30.880954 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:30.880954 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:30.880954 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:21:30.880954 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:21:30.880954 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa44ac2-38d8-4f8e-bc99-4c9487756708 could not be found. May 27 15:21:30.880954 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:30.882771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-527f47f9-8ce3-4511-817f-6ddb88333fb2 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] Returning 404 to user: Instance 3aa44ac2-38d8-4f8e-bc99-4c9487756708 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:21:30.883861 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-527f47f9-8ce3-4511-817f-6ddb88333fb2 tempest-TestServerAdvancedOps-270662516 tempest-TestServerAdvancedOps-270662516-project] 10.222.0.13 "GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708" status: 404 len: 111 microversion: 2.1 time: 0.077260 May 27 15:21:30.885128 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2609/5216] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:30 2022] GET /compute/v2.1/servers/3aa44ac2-38d8-4f8e-bc99-4c9487756708 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:21:31.429262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e82cdcfd-9ed8-4f79-92ab-ffbc32e9d10d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:31.436131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e82cdcfd-9ed8-4f79-92ab-ffbc32e9d10d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:31.465861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e82cdcfd-9ed8-4f79-92ab-ffbc32e9d10d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:31.466721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e82cdcfd-9ed8-4f79-92ab-ffbc32e9d10d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:31.467768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e82cdcfd-9ed8-4f79-92ab-ffbc32e9d10d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:31.468551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e82cdcfd-9ed8-4f79-92ab-ffbc32e9d10d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:31.757964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d2890bbc-ac24-4c80-a3d2-ed9ca94a22ff tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:31.758597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d2890bbc-ac24-4c80-a3d2-ed9ca94a22ff tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:31.777256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d2890bbc-ac24-4c80-a3d2-ed9ca94a22ff tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:31.777727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d2890bbc-ac24-4c80-a3d2-ed9ca94a22ff tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:31.778530 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d2890bbc-ac24-4c80-a3d2-ed9ca94a22ff tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:31.779172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d2890bbc-ac24-4c80-a3d2-ed9ca94a22ff tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:31.939037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e82cdcfd-9ed8-4f79-92ab-ffbc32e9d10d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:31.953908 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e82cdcfd-9ed8-4f79-92ab-ffbc32e9d10d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1511 microversion: 2.1 time: 0.529982 May 27 15:21:31.958723 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2608/5217] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:31 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1511 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:32.112545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d2890bbc-ac24-4c80-a3d2-ed9ca94a22ff tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:32.124979 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d2890bbc-ac24-4c80-a3d2-ed9ca94a22ff tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.370775 May 27 15:21:32.125894 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2610/5218] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:31 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:32.142978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0ce2592c-49e6-4e44-93a8-c5f33b697dca tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1903371552"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:32.144226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0ce2592c-49e6-4e44-93a8-c5f33b697dca tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:32.156230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ce2592c-49e6-4e44-93a8-c5f33b697dca tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:32.156997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ce2592c-49e6-4e44-93a8-c5f33b697dca tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:32.159911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ce2592c-49e6-4e44-93a8-c5f33b697dca tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:32.161969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ce2592c-49e6-4e44-93a8-c5f33b697dca tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:32.688133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-75bc055d-720a-491c-b018-2d1c6f07422e req-9ac055e4-4027-4553-8603-9e80e5368aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812d42c0-07f1-4f7c-83b8-848b18cf0186", "name": "network-vif-unplugged", "status": "completed", "tag": "0d9da5e7-a50c-4ddd-aca9-02eae7d0476c"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:32.690033 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0ce2592c-49e6-4e44-93a8-c5f33b697dca tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action" status: 202 len: 0 microversion: 2.1 time: 0.550820 May 27 15:21:32.693578 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2609/5219] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:21:32 2022] POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 27 15:21:32.706092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-75bc055d-720a-491c-b018-2d1c6f07422e req-9ac055e4-4027-4553-8603-9e80e5368aa8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:32.706910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-75bc055d-720a-491c-b018-2d1c6f07422e req-9ac055e4-4027-4553-8603-9e80e5368aa8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:32.712005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-28b117b2-49a5-4b1f-b86c-2fa3c92fc946 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:32.716246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-28b117b2-49a5-4b1f-b86c-2fa3c92fc946 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:32.738168 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-28b117b2-49a5-4b1f-b86c-2fa3c92fc946 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:32.740576 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-75bc055d-720a-491c-b018-2d1c6f07422e req-9ac055e4-4027-4553-8603-9e80e5368aa8 service nova] Creating event network-vif-unplugged:0d9da5e7-a50c-4ddd-aca9-02eae7d0476c for instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 on n-h1-843621-1 May 27 15:21:32.741076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-28b117b2-49a5-4b1f-b86c-2fa3c92fc946 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:32.741970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-28b117b2-49a5-4b1f-b86c-2fa3c92fc946 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:32.742409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-28b117b2-49a5-4b1f-b86c-2fa3c92fc946 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:32.764220 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-75bc055d-720a-491c-b018-2d1c6f07422e req-9ac055e4-4027-4553-8603-9e80e5368aa8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080991 May 27 15:21:32.767004 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2611/5220] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:21:32.974999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9d1a2bf0-87d8-4838-a564-9225b593992c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:32.975790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9d1a2bf0-87d8-4838-a564-9225b593992c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:32.986439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d1a2bf0-87d8-4838-a564-9225b593992c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:32.987278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d1a2bf0-87d8-4838-a564-9225b593992c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:32.988575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d1a2bf0-87d8-4838-a564-9225b593992c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:32.989389 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d1a2bf0-87d8-4838-a564-9225b593992c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:33.703368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-28b117b2-49a5-4b1f-b86c-2fa3c92fc946 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:33.717991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9d1a2bf0-87d8-4838-a564-9225b593992c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:33.733127 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9d1a2bf0-87d8-4838-a564-9225b593992c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1511 microversion: 2.1 time: 0.763041 May 27 15:21:33.733881 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-28b117b2-49a5-4b1f-b86c-2fa3c92fc946 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1679 microversion: 2.1 time: 1.028831 May 27 15:21:33.735903 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2610/5222] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:32 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1679 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:33.736096 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2612/5222] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:32 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1511 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:34.751586 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ece1af37-3460-4c84-aa36-03ca337aa18d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:34.756993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2cfa9bfe-dcb8-46bf-97f2-56fde4139fb2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:34.757616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2cfa9bfe-dcb8-46bf-97f2-56fde4139fb2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:34.764206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ece1af37-3460-4c84-aa36-03ca337aa18d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:34.779567 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ece1af37-3460-4c84-aa36-03ca337aa18d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:34.780042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ece1af37-3460-4c84-aa36-03ca337aa18d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:34.780872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ece1af37-3460-4c84-aa36-03ca337aa18d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:34.781321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ece1af37-3460-4c84-aa36-03ca337aa18d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:34.785632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2cfa9bfe-dcb8-46bf-97f2-56fde4139fb2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:34.786097 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2cfa9bfe-dcb8-46bf-97f2-56fde4139fb2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:34.786905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2cfa9bfe-dcb8-46bf-97f2-56fde4139fb2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:34.787354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2cfa9bfe-dcb8-46bf-97f2-56fde4139fb2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:35.176737 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2cfa9bfe-dcb8-46bf-97f2-56fde4139fb2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:35.191269 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2cfa9bfe-dcb8-46bf-97f2-56fde4139fb2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1679 microversion: 2.1 time: 0.433480 May 27 15:21:35.192528 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2613/5223] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:34 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1679 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:35.251709 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ece1af37-3460-4c84-aa36-03ca337aa18d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:35.263903 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ece1af37-3460-4c84-aa36-03ca337aa18d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1511 microversion: 2.1 time: 0.516295 May 27 15:21:35.276836 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2611/5224] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:34 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1511 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:36.211539 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a9389ff7-9b02-4b42-9812-3d4e2bdc9f38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:36.213712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a9389ff7-9b02-4b42-9812-3d4e2bdc9f38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:36.221644 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a9389ff7-9b02-4b42-9812-3d4e2bdc9f38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:36.222352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a9389ff7-9b02-4b42-9812-3d4e2bdc9f38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:36.223636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a9389ff7-9b02-4b42-9812-3d4e2bdc9f38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:36.225722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a9389ff7-9b02-4b42-9812-3d4e2bdc9f38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:36.287265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a229d6a6-52bd-42b2-aba0-d0c80742f754 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:36.287891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a229d6a6-52bd-42b2-aba0-d0c80742f754 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:36.297280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a229d6a6-52bd-42b2-aba0-d0c80742f754 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:36.298646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a229d6a6-52bd-42b2-aba0-d0c80742f754 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:36.300235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a229d6a6-52bd-42b2-aba0-d0c80742f754 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:36.301058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a229d6a6-52bd-42b2-aba0-d0c80742f754 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:36.566175 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a9389ff7-9b02-4b42-9812-3d4e2bdc9f38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:36.584217 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a9389ff7-9b02-4b42-9812-3d4e2bdc9f38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1679 microversion: 2.1 time: 0.377190 May 27 15:21:36.597173 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2614/5225] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:36 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1679 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:36.659187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a229d6a6-52bd-42b2-aba0-d0c80742f754 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:36.674707 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a229d6a6-52bd-42b2-aba0-d0c80742f754 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1511 microversion: 2.1 time: 0.391773 May 27 15:21:36.677258 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2612/5226] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:36 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1511 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:37.602483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8582f3c5-a3cf-4e59-9ac4-55834fb06aec tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:37.603097 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8582f3c5-a3cf-4e59-9ac4-55834fb06aec tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:37.610186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8582f3c5-a3cf-4e59-9ac4-55834fb06aec tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:37.610642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8582f3c5-a3cf-4e59-9ac4-55834fb06aec tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:37.611412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8582f3c5-a3cf-4e59-9ac4-55834fb06aec tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:37.611857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8582f3c5-a3cf-4e59-9ac4-55834fb06aec tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:37.694467 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-58d8ce88-069c-47ea-bb3e-6bde94b870c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:37.695771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-58d8ce88-069c-47ea-bb3e-6bde94b870c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:37.710066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-58d8ce88-069c-47ea-bb3e-6bde94b870c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:37.710921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-58d8ce88-069c-47ea-bb3e-6bde94b870c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:37.711930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-58d8ce88-069c-47ea-bb3e-6bde94b870c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:37.713811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-58d8ce88-069c-47ea-bb3e-6bde94b870c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:37.815312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8582f3c5-a3cf-4e59-9ac4-55834fb06aec tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:37.828011 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8582f3c5-a3cf-4e59-9ac4-55834fb06aec tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1687 microversion: 2.1 time: 0.228530 May 27 15:21:37.836517 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2615/5227] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:37 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1687 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:37.892447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-58d8ce88-069c-47ea-bb3e-6bde94b870c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:37.901764 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-58d8ce88-069c-47ea-bb3e-6bde94b870c5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1511 microversion: 2.1 time: 0.211191 May 27 15:21:37.903482 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2613/5228] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:37 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1511 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:38.854118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6fd9f216-b60c-4286-8233-9cb6837ee2a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:38.855454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6fd9f216-b60c-4286-8233-9cb6837ee2a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:38.868741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6fd9f216-b60c-4286-8233-9cb6837ee2a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:38.869491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6fd9f216-b60c-4286-8233-9cb6837ee2a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:38.875760 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6fd9f216-b60c-4286-8233-9cb6837ee2a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:38.876727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6fd9f216-b60c-4286-8233-9cb6837ee2a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:38.923873 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5080e892-e5dc-44c6-aac7-246bf4f03640 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:38.924656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5080e892-e5dc-44c6-aac7-246bf4f03640 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:38.938180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5080e892-e5dc-44c6-aac7-246bf4f03640 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:38.941555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5080e892-e5dc-44c6-aac7-246bf4f03640 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:38.942489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5080e892-e5dc-44c6-aac7-246bf4f03640 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:38.943047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5080e892-e5dc-44c6-aac7-246bf4f03640 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:39.188830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6fd9f216-b60c-4286-8233-9cb6837ee2a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:39.194838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5080e892-e5dc-44c6-aac7-246bf4f03640 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:39.199881 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6fd9f216-b60c-4286-8233-9cb6837ee2a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1687 microversion: 2.1 time: 0.350847 May 27 15:21:39.200688 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2616/5229] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:38 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1687 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:39.212167 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5080e892-e5dc-44c6-aac7-246bf4f03640 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1511 microversion: 2.1 time: 0.296715 May 27 15:21:39.213114 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2614/5230] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:38 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1511 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:40.218338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0293e6b7-df45-4f09-831a-4b970c5a8319 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:40.220104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0293e6b7-df45-4f09-831a-4b970c5a8319 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:40.231600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-07058586-8eeb-458f-a619-d0da3c8a6b18 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:40.233142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-07058586-8eeb-458f-a619-d0da3c8a6b18 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:40.248553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-07058586-8eeb-458f-a619-d0da3c8a6b18 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:40.251749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-07058586-8eeb-458f-a619-d0da3c8a6b18 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:40.251992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0293e6b7-df45-4f09-831a-4b970c5a8319 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:40.253379 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0293e6b7-df45-4f09-831a-4b970c5a8319 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:40.254397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0293e6b7-df45-4f09-831a-4b970c5a8319 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:40.254891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-07058586-8eeb-458f-a619-d0da3c8a6b18 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:40.255657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-07058586-8eeb-458f-a619-d0da3c8a6b18 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:40.256255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0293e6b7-df45-4f09-831a-4b970c5a8319 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:41.252336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0293e6b7-df45-4f09-831a-4b970c5a8319 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:41.267255 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0293e6b7-df45-4f09-831a-4b970c5a8319 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1687 microversion: 2.1 time: 1.053702 May 27 15:21:41.268286 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2617/5231] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:40 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1687 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:41.282034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-4e8fda5b-4b8d-4345-8168-9593dfd357ac req-fe21f509-9371-4071-90e7-3a042bb8443f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812d42c0-07f1-4f7c-83b8-848b18cf0186", "name": "network-vif-plugged", "status": "completed", "tag": "0d9da5e7-a50c-4ddd-aca9-02eae7d0476c"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:41.292731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-07058586-8eeb-458f-a619-d0da3c8a6b18 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:41.302931 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-07058586-8eeb-458f-a619-d0da3c8a6b18 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1511 microversion: 2.1 time: 1.075855 May 27 15:21:41.306931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4e8fda5b-4b8d-4345-8168-9593dfd357ac req-fe21f509-9371-4071-90e7-3a042bb8443f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:41.307745 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2615/5232] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:40 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1511 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:41.308359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4e8fda5b-4b8d-4345-8168-9593dfd357ac req-fe21f509-9371-4071-90e7-3a042bb8443f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:41.371776 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-4e8fda5b-4b8d-4345-8168-9593dfd357ac req-fe21f509-9371-4071-90e7-3a042bb8443f service nova] Creating event network-vif-plugged:0d9da5e7-a50c-4ddd-aca9-02eae7d0476c for instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 on n-h1-843621-1 May 27 15:21:41.398218 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-4e8fda5b-4b8d-4345-8168-9593dfd357ac req-fe21f509-9371-4071-90e7-3a042bb8443f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114643 May 27 15:21:41.404936 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2618/5233] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:42.284201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7b3ea7dc-5b35-4851-8af5-d8426f975c87 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:42.285024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7b3ea7dc-5b35-4851-8af5-d8426f975c87 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:42.296520 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7b3ea7dc-5b35-4851-8af5-d8426f975c87 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:42.297716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7b3ea7dc-5b35-4851-8af5-d8426f975c87 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:42.298456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7b3ea7dc-5b35-4851-8af5-d8426f975c87 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:42.298931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7b3ea7dc-5b35-4851-8af5-d8426f975c87 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:42.337937 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a4b2db41-3b5c-4e09-8506-802e5c9cc793 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:42.338647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a4b2db41-3b5c-4e09-8506-802e5c9cc793 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:42.357374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4b2db41-3b5c-4e09-8506-802e5c9cc793 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:42.359471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4b2db41-3b5c-4e09-8506-802e5c9cc793 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:42.364821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4b2db41-3b5c-4e09-8506-802e5c9cc793 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:42.365659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4b2db41-3b5c-4e09-8506-802e5c9cc793 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:42.705482 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7b3ea7dc-5b35-4851-8af5-d8426f975c87 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:42.709429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a4b2db41-3b5c-4e09-8506-802e5c9cc793 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:42.717123 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7b3ea7dc-5b35-4851-8af5-d8426f975c87 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1687 microversion: 2.1 time: 0.436715 May 27 15:21:42.719749 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a4b2db41-3b5c-4e09-8506-802e5c9cc793 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1511 microversion: 2.1 time: 0.391919 May 27 15:21:42.720228 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2616/5234] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:42 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1687 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:42.732752 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2619/5235] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:42 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1511 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:43.738680 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1003b37c-a360-496f-bb15-d6a28577889e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:43.740018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1003b37c-a360-496f-bb15-d6a28577889e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:43.749305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f45cc7bd-5c52-4c94-8adb-1ce8da861919 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:43.749873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f45cc7bd-5c52-4c94-8adb-1ce8da861919 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:43.752620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1003b37c-a360-496f-bb15-d6a28577889e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:43.757184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1003b37c-a360-496f-bb15-d6a28577889e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:43.758283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1003b37c-a360-496f-bb15-d6a28577889e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:43.760128 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1003b37c-a360-496f-bb15-d6a28577889e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:43.762948 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f45cc7bd-5c52-4c94-8adb-1ce8da861919 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:43.763418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f45cc7bd-5c52-4c94-8adb-1ce8da861919 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:43.774602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f45cc7bd-5c52-4c94-8adb-1ce8da861919 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:43.775650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f45cc7bd-5c52-4c94-8adb-1ce8da861919 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:44.338046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1003b37c-a360-496f-bb15-d6a28577889e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:44.381720 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1003b37c-a360-496f-bb15-d6a28577889e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1682 microversion: 2.1 time: 0.643450 May 27 15:21:44.384502 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2617/5236] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:43 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1682 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:44.596459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f45cc7bd-5c52-4c94-8adb-1ce8da861919 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:44.605250 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f45cc7bd-5c52-4c94-8adb-1ce8da861919 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1511 microversion: 2.1 time: 0.860430 May 27 15:21:44.614989 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2620/5237] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:43 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1511 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:45.402453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a6e1dc83-8d2d-4029-a8c2-8bc4a5f5587e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:45.403109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a6e1dc83-8d2d-4029-a8c2-8bc4a5f5587e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:45.411607 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a6e1dc83-8d2d-4029-a8c2-8bc4a5f5587e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:45.412353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a6e1dc83-8d2d-4029-a8c2-8bc4a5f5587e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:45.413355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a6e1dc83-8d2d-4029-a8c2-8bc4a5f5587e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:45.413964 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a6e1dc83-8d2d-4029-a8c2-8bc4a5f5587e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:45.626647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-35873f22-7bc1-40de-9783-4d4496e22c4b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:45.627682 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-35873f22-7bc1-40de-9783-4d4496e22c4b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:45.649757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35873f22-7bc1-40de-9783-4d4496e22c4b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:45.650636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35873f22-7bc1-40de-9783-4d4496e22c4b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:45.651718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35873f22-7bc1-40de-9783-4d4496e22c4b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:45.652625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35873f22-7bc1-40de-9783-4d4496e22c4b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:45.679995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:45.972692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a6e1dc83-8d2d-4029-a8c2-8bc4a5f5587e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:45.989744 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a6e1dc83-8d2d-4029-a8c2-8bc4a5f5587e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1682 microversion: 2.1 time: 0.593028 May 27 15:21:45.990680 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2618/5238] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:45 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1682 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:46.021517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-35873f22-7bc1-40de-9783-4d4496e22c4b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:46.032441 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-35873f22-7bc1-40de-9783-4d4496e22c4b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1511 microversion: 2.1 time: 0.413713 May 27 15:21:46.042624 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2621/5239] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:45 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1511 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:47.008177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-10b66304-5162-4fdb-8ff1-e088e5c01ca4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:47.008880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-10b66304-5162-4fdb-8ff1-e088e5c01ca4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:47.022359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10b66304-5162-4fdb-8ff1-e088e5c01ca4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:47.022827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10b66304-5162-4fdb-8ff1-e088e5c01ca4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:47.023631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10b66304-5162-4fdb-8ff1-e088e5c01ca4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:47.024081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10b66304-5162-4fdb-8ff1-e088e5c01ca4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:47.061632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d32e2da2-4b64-48b5-a70a-dd4b62a2d533 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:47.062905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d32e2da2-4b64-48b5-a70a-dd4b62a2d533 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:47.075916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=57 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:47.082092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d32e2da2-4b64-48b5-a70a-dd4b62a2d533 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:47.082975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d32e2da2-4b64-48b5-a70a-dd4b62a2d533 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:47.086112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d32e2da2-4b64-48b5-a70a-dd4b62a2d533 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:47.086834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d32e2da2-4b64-48b5-a70a-dd4b62a2d533 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:47.577870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d32e2da2-4b64-48b5-a70a-dd4b62a2d533 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:47.590586 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d32e2da2-4b64-48b5-a70a-dd4b62a2d533 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1511 microversion: 2.1 time: 0.534629 May 27 15:21:47.595741 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2622/5240] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:47 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1511 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:47.600605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-234b58c4-5def-4c19-9bc8-5f9a51c53070 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:47.605740 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-234b58c4-5def-4c19-9bc8-5f9a51c53070 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:47.623399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-234b58c4-5def-4c19-9bc8-5f9a51c53070 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:47.624061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-234b58c4-5def-4c19-9bc8-5f9a51c53070 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:47.624963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-234b58c4-5def-4c19-9bc8-5f9a51c53070 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:47.626288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-234b58c4-5def-4c19-9bc8-5f9a51c53070 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:47.689537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-10b66304-5162-4fdb-8ff1-e088e5c01ca4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:47.716452 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-234b58c4-5def-4c19-9bc8-5f9a51c53070 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.119578 May 27 15:21:47.717748 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-10b66304-5162-4fdb-8ff1-e088e5c01ca4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1682 microversion: 2.1 time: 0.709235 May 27 15:21:47.718336 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2619/5241] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:47 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1682 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:47.718604 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2623/5242] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:21:47 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:47.864966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-55e5a110-fb70-4203-935a-58577c8038cc tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:47.865817 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-55e5a110-fb70-4203-935a-58577c8038cc tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:47.880287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55e5a110-fb70-4203-935a-58577c8038cc tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:47.883638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55e5a110-fb70-4203-935a-58577c8038cc tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:47.884957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55e5a110-fb70-4203-935a-58577c8038cc tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:47.885708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55e5a110-fb70-4203-935a-58577c8038cc tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:47.942148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:47.971713 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-55e5a110-fb70-4203-935a-58577c8038cc tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments/9ff93d62-b236-4d3d-9595-d575625ed4d0" status: 200 len: 194 microversion: 2.1 time: 0.110933 May 27 15:21:47.972642 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2620/5243] 10.222.0.13 () {58 vars in 1412 bytes} [Fri May 27 15:21:47 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments/9ff93d62-b236-4d3d-9595-d575625ed4d0 => generated 194 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:47.983517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f920658e-fd37-43b8-811f-783f82fa79ad tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:47.984362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f920658e-fd37-43b8-811f-783f82fa79ad tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:47.996341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f920658e-fd37-43b8-811f-783f82fa79ad tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:47.997045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f920658e-fd37-43b8-811f-783f82fa79ad tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:48.001084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f920658e-fd37-43b8-811f-783f82fa79ad tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:48.001751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f920658e-fd37-43b8-811f-783f82fa79ad tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:48.142229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-f920658e-fd37-43b8-811f-783f82fa79ad tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lazy-loading 'services' on Instance uuid 9cc72e17-205e-4e7f-aefe-17a244443295 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:21:48.287772 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f920658e-fd37-43b8-811f-783f82fa79ad tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments/9ff93d62-b236-4d3d-9595-d575625ed4d0" status: 202 len: 0 microversion: 2.1 time: 0.308540 May 27 15:21:48.288580 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2624/5244] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 15:21:47 2022] DELETE /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments/9ff93d62-b236-4d3d-9595-d575625ed4d0 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:21:48.621067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-da526f65-1a73-44d9-aa4d-2a9082455ec5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:48.622831 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-da526f65-1a73-44d9-aa4d-2a9082455ec5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:48.640530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da526f65-1a73-44d9-aa4d-2a9082455ec5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:48.648213 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da526f65-1a73-44d9-aa4d-2a9082455ec5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:48.650259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da526f65-1a73-44d9-aa4d-2a9082455ec5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:48.653567 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da526f65-1a73-44d9-aa4d-2a9082455ec5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:48.737061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d9570895-dea8-4f08-b4f6-14b1ea5246bd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:48.738117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d9570895-dea8-4f08-b4f6-14b1ea5246bd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:48.751595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9570895-dea8-4f08-b4f6-14b1ea5246bd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:48.753299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9570895-dea8-4f08-b4f6-14b1ea5246bd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:48.757473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9570895-dea8-4f08-b4f6-14b1ea5246bd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:48.758225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9570895-dea8-4f08-b4f6-14b1ea5246bd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:48.966713 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-da526f65-1a73-44d9-aa4d-2a9082455ec5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:48.979725 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-da526f65-1a73-44d9-aa4d-2a9082455ec5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1511 microversion: 2.1 time: 0.361737 May 27 15:21:48.980746 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2621/5245] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:48 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1511 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:48.986839 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d9570895-dea8-4f08-b4f6-14b1ea5246bd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:48.995618 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d9570895-dea8-4f08-b4f6-14b1ea5246bd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1682 microversion: 2.1 time: 0.263423 May 27 15:21:48.996403 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2625/5246] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:48 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1682 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:50.003729 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-054882e0-8585-4699-bf67-4f6ae3c933a3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:50.004370 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-054882e0-8585-4699-bf67-4f6ae3c933a3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:50.016635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-38849c04-ae13-4015-9b0b-23d486b0e6c3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:50.018112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-38849c04-ae13-4015-9b0b-23d486b0e6c3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:50.020139 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-054882e0-8585-4699-bf67-4f6ae3c933a3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:50.028320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-054882e0-8585-4699-bf67-4f6ae3c933a3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:50.030515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-054882e0-8585-4699-bf67-4f6ae3c933a3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:50.032199 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-054882e0-8585-4699-bf67-4f6ae3c933a3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:50.037029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38849c04-ae13-4015-9b0b-23d486b0e6c3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:50.037836 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38849c04-ae13-4015-9b0b-23d486b0e6c3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:50.040807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38849c04-ae13-4015-9b0b-23d486b0e6c3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:50.041581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38849c04-ae13-4015-9b0b-23d486b0e6c3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:50.757245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-38849c04-ae13-4015-9b0b-23d486b0e6c3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:50.776894 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-38849c04-ae13-4015-9b0b-23d486b0e6c3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1682 microversion: 2.1 time: 0.757137 May 27 15:21:50.778171 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2626/5247] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:50 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1682 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:50.873059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-054882e0-8585-4699-bf67-4f6ae3c933a3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:50.881507 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-054882e0-8585-4699-bf67-4f6ae3c933a3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1511 microversion: 2.1 time: 0.883625 May 27 15:21:50.886358 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2622/5248] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:49 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1511 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:51.811872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1b3eb1fc-b101-4fb8-803c-e4646e2c3d9d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:51.818061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1b3eb1fc-b101-4fb8-803c-e4646e2c3d9d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:51.839217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b3eb1fc-b101-4fb8-803c-e4646e2c3d9d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:51.839733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b3eb1fc-b101-4fb8-803c-e4646e2c3d9d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:51.840988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b3eb1fc-b101-4fb8-803c-e4646e2c3d9d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:51.841775 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b3eb1fc-b101-4fb8-803c-e4646e2c3d9d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:51.909910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3feb311a-8bdf-431a-b808-86ab5449a1b9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:51.910976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3feb311a-8bdf-431a-b808-86ab5449a1b9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:51.939555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3feb311a-8bdf-431a-b808-86ab5449a1b9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:51.941465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3feb311a-8bdf-431a-b808-86ab5449a1b9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:51.943459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3feb311a-8bdf-431a-b808-86ab5449a1b9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:51.944602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3feb311a-8bdf-431a-b808-86ab5449a1b9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:52.749695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1b3eb1fc-b101-4fb8-803c-e4646e2c3d9d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:52.765405 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1b3eb1fc-b101-4fb8-803c-e4646e2c3d9d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1682 microversion: 2.1 time: 0.972848 May 27 15:21:52.766008 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2627/5249] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:51 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1682 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:52.815563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3feb311a-8bdf-431a-b808-86ab5449a1b9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:52.832281 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3feb311a-8bdf-431a-b808-86ab5449a1b9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1488 microversion: 2.1 time: 0.927071 May 27 15:21:52.837596 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2623/5250] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:51 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1488 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:52.860105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-65ececb1-9217-414e-9bdb-a32812ac4423 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1021451173"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:52.863115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-65ececb1-9217-414e-9bdb-a32812ac4423 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:52.905277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65ececb1-9217-414e-9bdb-a32812ac4423 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:52.905766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65ececb1-9217-414e-9bdb-a32812ac4423 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:52.906634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65ececb1-9217-414e-9bdb-a32812ac4423 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:52.907008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65ececb1-9217-414e-9bdb-a32812ac4423 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:53.088872 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-65ececb1-9217-414e-9bdb-a32812ac4423 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "PUT /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1061 microversion: 2.1 time: 0.236025 May 27 15:21:53.099927 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2628/5251] 10.222.0.13 () {60 vars in 1255 bytes} [Fri May 27 15:21:52 2022] PUT /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1061 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:53.104278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f34f59df-7164-4eae-bc2b-5ece62ffd4dc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:53.105558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f34f59df-7164-4eae-bc2b-5ece62ffd4dc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:53.126278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f34f59df-7164-4eae-bc2b-5ece62ffd4dc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:53.126742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f34f59df-7164-4eae-bc2b-5ece62ffd4dc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:53.127538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f34f59df-7164-4eae-bc2b-5ece62ffd4dc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:53.128065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f34f59df-7164-4eae-bc2b-5ece62ffd4dc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:53.151383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-662554f0-e946-4306-9486-60b907e7275e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:53.152294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-662554f0-e946-4306-9486-60b907e7275e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:53.161132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-662554f0-e946-4306-9486-60b907e7275e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:53.162005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-662554f0-e946-4306-9486-60b907e7275e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:53.163030 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-662554f0-e946-4306-9486-60b907e7275e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:53.163726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-662554f0-e946-4306-9486-60b907e7275e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:53.201392 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-662554f0-e946-4306-9486-60b907e7275e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/ips" status: 200 len: 150 microversion: 2.1 time: 0.059535 May 27 15:21:53.208342 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2629/5252] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 15:21:53 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/ips => generated 150 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:53.446498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f34f59df-7164-4eae-bc2b-5ece62ffd4dc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:53.462010 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f34f59df-7164-4eae-bc2b-5ece62ffd4dc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1488 microversion: 2.1 time: 0.360047 May 27 15:21:53.467691 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2624/5253] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:53 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1488 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:53.481612 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fab565ea-2ded-45e6-ab3e-5aae11af13b0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:53.482253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fab565ea-2ded-45e6-ab3e-5aae11af13b0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:53.501597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fab565ea-2ded-45e6-ab3e-5aae11af13b0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:53.502962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fab565ea-2ded-45e6-ab3e-5aae11af13b0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:53.504256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fab565ea-2ded-45e6-ab3e-5aae11af13b0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:53.504908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fab565ea-2ded-45e6-ab3e-5aae11af13b0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:53.783372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-26841cd0-a349-4b4e-bab7-7c34596f1f0e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:53.784277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-26841cd0-a349-4b4e-bab7-7c34596f1f0e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:53.802986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26841cd0-a349-4b4e-bab7-7c34596f1f0e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:53.803758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26841cd0-a349-4b4e-bab7-7c34596f1f0e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:53.804787 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26841cd0-a349-4b4e-bab7-7c34596f1f0e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:53.805450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26841cd0-a349-4b4e-bab7-7c34596f1f0e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:53.860250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fab565ea-2ded-45e6-ab3e-5aae11af13b0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:53.870943 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fab565ea-2ded-45e6-ab3e-5aae11af13b0 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1488 microversion: 2.1 time: 0.394275 May 27 15:21:53.872001 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2630/5254] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:53 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1488 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:53.896889 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3ea9da67-a499-403a-9715-d96e5cd6f57e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:53.897875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3ea9da67-a499-403a-9715-d96e5cd6f57e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:53.919687 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ea9da67-a499-403a-9715-d96e5cd6f57e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:53.922861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ea9da67-a499-403a-9715-d96e5cd6f57e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:53.923932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ea9da67-a499-403a-9715-d96e5cd6f57e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:53.927933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ea9da67-a499-403a-9715-d96e5cd6f57e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:54.029624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3ea9da67-a499-403a-9715-d96e5cd6f57e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:21:54.193839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-26841cd0-a349-4b4e-bab7-7c34596f1f0e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:54.211803 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-26841cd0-a349-4b4e-bab7-7c34596f1f0e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1682 microversion: 2.1 time: 0.430289 May 27 15:21:54.216436 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2625/5255] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:53 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1682 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:54.273406 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3ea9da67-a499-403a-9715-d96e5cd6f57e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 204 len: 0 microversion: 2.1 time: 0.388411 May 27 15:21:54.274460 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2631/5256] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:21:53 2022] DELETE /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:21:54.287242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-92c5336c-401d-48e4-9923-139a2d27ce6b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:54.287883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-92c5336c-401d-48e4-9923-139a2d27ce6b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:54.300075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-92c5336c-401d-48e4-9923-139a2d27ce6b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:54.300543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-92c5336c-401d-48e4-9923-139a2d27ce6b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:54.302552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-92c5336c-401d-48e4-9923-139a2d27ce6b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:54.303005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-92c5336c-401d-48e4-9923-139a2d27ce6b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:54.776559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-92c5336c-401d-48e4-9923-139a2d27ce6b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:54.785008 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-92c5336c-401d-48e4-9923-139a2d27ce6b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1494 microversion: 2.1 time: 0.502570 May 27 15:21:54.796473 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2626/5257] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:54 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1494 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:55.241831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7712c551-0722-4381-a6db-a4469ceb6c30 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:55.242589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7712c551-0722-4381-a6db-a4469ceb6c30 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:55.250990 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7712c551-0722-4381-a6db-a4469ceb6c30 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:55.251460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7712c551-0722-4381-a6db-a4469ceb6c30 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:55.252319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7712c551-0722-4381-a6db-a4469ceb6c30 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:55.252880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7712c551-0722-4381-a6db-a4469ceb6c30 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:55.722825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7712c551-0722-4381-a6db-a4469ceb6c30 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:55.741243 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7712c551-0722-4381-a6db-a4469ceb6c30 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1682 microversion: 2.1 time: 0.510722 May 27 15:21:55.744523 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2632/5258] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:55 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1682 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:55.803449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bb097cad-e40c-4a27-99c0-cbb3c200216e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:55.804884 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bb097cad-e40c-4a27-99c0-cbb3c200216e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:55.829294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb097cad-e40c-4a27-99c0-cbb3c200216e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:55.830262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb097cad-e40c-4a27-99c0-cbb3c200216e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:55.831745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb097cad-e40c-4a27-99c0-cbb3c200216e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:55.832439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb097cad-e40c-4a27-99c0-cbb3c200216e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:56.111886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bb097cad-e40c-4a27-99c0-cbb3c200216e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:56.123315 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bb097cad-e40c-4a27-99c0-cbb3c200216e tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1494 microversion: 2.1 time: 0.324210 May 27 15:21:56.128352 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2627/5259] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:55 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1494 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:56.760859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-855a1f86-4a52-48a5-86e4-25e88752cdd6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:56.762240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-855a1f86-4a52-48a5-86e4-25e88752cdd6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:56.773330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-855a1f86-4a52-48a5-86e4-25e88752cdd6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:56.775743 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-855a1f86-4a52-48a5-86e4-25e88752cdd6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:56.776802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-855a1f86-4a52-48a5-86e4-25e88752cdd6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:56.779846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-855a1f86-4a52-48a5-86e4-25e88752cdd6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:57.063794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3be42c97-5124-4138-b410-aa829a83f8ca tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cc6102f-b517-49dd-aeca-6084cceb803a"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:57.065065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3be42c97-5124-4138-b410-aa829a83f8ca tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:57.083684 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3be42c97-5124-4138-b410-aa829a83f8ca tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:57.084160 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3be42c97-5124-4138-b410-aa829a83f8ca tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:57.088416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3be42c97-5124-4138-b410-aa829a83f8ca tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:57.088945 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3be42c97-5124-4138-b410-aa829a83f8ca tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:57.594804 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3be42c97-5124-4138-b410-aa829a83f8ca tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "POST /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.536670 May 27 15:21:57.595463 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2628/5260] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 15:21:57 2022] POST /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments => generated 194 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:57.623496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-30328f94-b3e6-4d73-a039-58d551d1f425 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:57.632712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-30328f94-b3e6-4d73-a039-58d551d1f425 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:57.653382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30328f94-b3e6-4d73-a039-58d551d1f425 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:57.653758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30328f94-b3e6-4d73-a039-58d551d1f425 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:57.654562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30328f94-b3e6-4d73-a039-58d551d1f425 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:57.666805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30328f94-b3e6-4d73-a039-58d551d1f425 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:57.809734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30328f94-b3e6-4d73-a039-58d551d1f425 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:57.811556 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30328f94-b3e6-4d73-a039-58d551d1f425 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:57.814161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-30328f94-b3e6-4d73-a039-58d551d1f425 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lazy-loading 'fault' on Instance uuid d701db87-6f62-435a-b972-a7ac8733604c {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:21:57.834950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-855a1f86-4a52-48a5-86e4-25e88752cdd6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:57.866698 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-855a1f86-4a52-48a5-86e4-25e88752cdd6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1682 microversion: 2.1 time: 1.109934 May 27 15:21:57.879166 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2633/5261] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:56 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1682 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:57.888301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-8ba13fc7-6a31-45cf-ada0-25f785da132c req-ca5a9c94-a813-4a50-ab22-e9215f17daf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d701db87-6f62-435a-b972-a7ac8733604c", "name": "network-vif-deleted", "tag": "70cd2511-8ebe-424e-8768-049a8d83ec47"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:57.913694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-8ba13fc7-6a31-45cf-ada0-25f785da132c req-ca5a9c94-a813-4a50-ab22-e9215f17daf5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:57.928030 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-8ba13fc7-6a31-45cf-ada0-25f785da132c req-ca5a9c94-a813-4a50-ab22-e9215f17daf5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:57.960091 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-8ba13fc7-6a31-45cf-ada0-25f785da132c req-ca5a9c94-a813-4a50-ab22-e9215f17daf5 service nova] Creating event network-vif-deleted:70cd2511-8ebe-424e-8768-049a8d83ec47 for instance d701db87-6f62-435a-b972-a7ac8733604c on n-h2-843621-1 May 27 15:21:57.982923 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-8ba13fc7-6a31-45cf-ada0-25f785da132c req-ca5a9c94-a813-4a50-ab22-e9215f17daf5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101586 May 27 15:21:57.990820 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2634/5262] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:58.223888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-30328f94-b3e6-4d73-a039-58d551d1f425 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:58.233137 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-30328f94-b3e6-4d73-a039-58d551d1f425 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 200 len: 1310 microversion: 2.1 time: 0.621262 May 27 15:21:58.250415 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2629/5263] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:57 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 1310 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:58.889280 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dae7053b-4201-4f0d-865c-f2ba233d3b6b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:58.890662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dae7053b-4201-4f0d-865c-f2ba233d3b6b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:58.905994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dae7053b-4201-4f0d-865c-f2ba233d3b6b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:58.910739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dae7053b-4201-4f0d-865c-f2ba233d3b6b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:58.911792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dae7053b-4201-4f0d-865c-f2ba233d3b6b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:58.912415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dae7053b-4201-4f0d-865c-f2ba233d3b6b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.162986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dae7053b-4201-4f0d-865c-f2ba233d3b6b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:59.175544 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dae7053b-4201-4f0d-865c-f2ba233d3b6b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1682 microversion: 2.1 time: 0.292966 May 27 15:21:59.179250 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2635/5264] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:58 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1682 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:59.254553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-76b27861-d9d0-45cc-a7ba-68e13d64b2e9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:59.255098 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-76b27861-d9d0-45cc-a7ba-68e13d64b2e9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:59.264028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=50 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:59.269371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-76b27861-d9d0-45cc-a7ba-68e13d64b2e9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.270302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-76b27861-d9d0-45cc-a7ba-68e13d64b2e9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.273520 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-76b27861-d9d0-45cc-a7ba-68e13d64b2e9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.274227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-76b27861-d9d0-45cc-a7ba-68e13d64b2e9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.315005 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-76b27861-d9d0-45cc-a7ba-68e13d64b2e9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance d701db87-6f62-435a-b972-a7ac8733604c could not be found. May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-76b27861-d9d0-45cc-a7ba-68e13d64b2e9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c HTTP/1.1 May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance d701db87-6f62-435a-b972-a7ac8733604c could not be found. May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'd701db87-6f62-435a-b972-a7ac8733604c'} May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d701db87-6f62-435a-b972-a7ac8733604c could not be found. May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d701db87-6f62-435a-b972-a7ac8733604c could not be found. May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.320101 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.325191 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:59.325191 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:59.325191 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:21:59.325191 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:21:59.325191 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d701db87-6f62-435a-b972-a7ac8733604c could not be found. May 27 15:21:59.325191 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.328593 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-76b27861-d9d0-45cc-a7ba-68e13d64b2e9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance d701db87-6f62-435a-b972-a7ac8733604c could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:21:59.331942 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-76b27861-d9d0-45cc-a7ba-68e13d64b2e9 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 404 len: 111 microversion: 2.1 time: 0.085112 May 27 15:21:59.335489 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2630/5265] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:59 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:21:59.375633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f1e60add-1b18-41c2-a0df-64462b243d9b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:59.376156 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f1e60add-1b18-41c2-a0df-64462b243d9b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:59.384426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1e60add-1b18-41c2-a0df-64462b243d9b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.385144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1e60add-1b18-41c2-a0df-64462b243d9b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.386101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1e60add-1b18-41c2-a0df-64462b243d9b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.386698 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1e60add-1b18-41c2-a0df-64462b243d9b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.392016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:59.404896 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-f1e60add-1b18-41c2-a0df-64462b243d9b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance d701db87-6f62-435a-b972-a7ac8733604c could not be found. May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f1e60add-1b18-41c2-a0df-64462b243d9b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c HTTP/1.1 May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance d701db87-6f62-435a-b972-a7ac8733604c could not be found. May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'd701db87-6f62-435a-b972-a7ac8733604c'} May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d701db87-6f62-435a-b972-a7ac8733604c could not be found. May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:21:59.407163 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d701db87-6f62-435a-b972-a7ac8733604c could not be found. May 27 15:21:59.411595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:59.411595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:59.411595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:59.411595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.411595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:59.411595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:59.411595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:21:59.411595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:21:59.411595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d701db87-6f62-435a-b972-a7ac8733604c could not be found. May 27 15:21:59.411595 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:59.413289 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f1e60add-1b18-41c2-a0df-64462b243d9b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance d701db87-6f62-435a-b972-a7ac8733604c could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:21:59.414478 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f1e60add-1b18-41c2-a0df-64462b243d9b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 404 len: 111 microversion: 2.1 time: 0.067416 May 27 15:21:59.416206 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2636/5266] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:21:59 2022] DELETE /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:21:59.427727 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-125539bb-848b-4ea5-9fc2-88ce8310e823 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:59.428984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-125539bb-848b-4ea5-9fc2-88ce8310e823 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: d701db87-6f62-435a-b972-a7ac8733604c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:59.445463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-125539bb-848b-4ea5-9fc2-88ce8310e823 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.445941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-125539bb-848b-4ea5-9fc2-88ce8310e823 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.446844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-125539bb-848b-4ea5-9fc2-88ce8310e823 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.447291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-125539bb-848b-4ea5-9fc2-88ce8310e823 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.484141 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-125539bb-848b-4ea5-9fc2-88ce8310e823 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance d701db87-6f62-435a-b972-a7ac8733604c could not be found. May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-125539bb-848b-4ea5-9fc2-88ce8310e823 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c HTTP/1.1 May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance d701db87-6f62-435a-b972-a7ac8733604c could not be found. May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'd701db87-6f62-435a-b972-a7ac8733604c'} May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d701db87-6f62-435a-b972-a7ac8733604c could not be found. May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d701db87-6f62-435a-b972-a7ac8733604c could not be found. May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.487090 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.491555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:59.491555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:59.491555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:21:59.491555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:21:59.491555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d701db87-6f62-435a-b972-a7ac8733604c could not be found. May 27 15:21:59.491555 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.496379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-125539bb-848b-4ea5-9fc2-88ce8310e823 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance d701db87-6f62-435a-b972-a7ac8733604c could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:21:59.497506 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-125539bb-848b-4ea5-9fc2-88ce8310e823 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c" status: 404 len: 111 microversion: 2.1 time: 0.077503 May 27 15:21:59.500199 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2631/5267] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:59 2022] GET /compute/v2.1/servers/d701db87-6f62-435a-b972-a7ac8733604c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:21:59.507071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b4b9354f-cccd-4396-a92a-f25370f89bfe tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:59.507864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b4b9354f-cccd-4396-a92a-f25370f89bfe tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:59.518220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4b9354f-cccd-4396-a92a-f25370f89bfe tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.520080 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4b9354f-cccd-4396-a92a-f25370f89bfe tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.521091 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4b9354f-cccd-4396-a92a-f25370f89bfe tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.522943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4b9354f-cccd-4396-a92a-f25370f89bfe tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.541134 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-b4b9354f-cccd-4396-a92a-f25370f89bfe tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance 5f417695-eff6-4c81-89e9-9f8301495dd8 could not be found. May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b4b9354f-cccd-4396-a92a-f25370f89bfe tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 HTTP/1.1 May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 5f417695-eff6-4c81-89e9-9f8301495dd8 could not be found. May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '5f417695-eff6-4c81-89e9-9f8301495dd8'} May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f417695-eff6-4c81-89e9-9f8301495dd8 could not be found. May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:21:59.543043 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f417695-eff6-4c81-89e9-9f8301495dd8 could not be found. May 27 15:21:59.547978 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:59.547978 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:59.547978 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:59.547978 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.547978 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:59.547978 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:59.547978 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:21:59.547978 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:21:59.547978 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f417695-eff6-4c81-89e9-9f8301495dd8 could not be found. May 27 15:21:59.547978 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:59.547978 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b4b9354f-cccd-4396-a92a-f25370f89bfe tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance 5f417695-eff6-4c81-89e9-9f8301495dd8 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:21:59.548822 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b4b9354f-cccd-4396-a92a-f25370f89bfe tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 404 len: 111 microversion: 2.1 time: 0.045723 May 27 15:21:59.557429 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2637/5268] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:21:59 2022] DELETE /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:21:59.557993 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d4de9528-96bb-402f-b4ac-81a5b90b663a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:59.558789 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d4de9528-96bb-402f-b4ac-81a5b90b663a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 5f417695-eff6-4c81-89e9-9f8301495dd8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:59.571840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4de9528-96bb-402f-b4ac-81a5b90b663a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.573625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4de9528-96bb-402f-b4ac-81a5b90b663a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.574676 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4de9528-96bb-402f-b4ac-81a5b90b663a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.575299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4de9528-96bb-402f-b4ac-81a5b90b663a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.598539 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-d4de9528-96bb-402f-b4ac-81a5b90b663a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance 5f417695-eff6-4c81-89e9-9f8301495dd8 could not be found. May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d4de9528-96bb-402f-b4ac-81a5b90b663a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 HTTP/1.1 May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 5f417695-eff6-4c81-89e9-9f8301495dd8 could not be found. May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '5f417695-eff6-4c81-89e9-9f8301495dd8'} May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f417695-eff6-4c81-89e9-9f8301495dd8 could not be found. May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f417695-eff6-4c81-89e9-9f8301495dd8 could not be found. May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.600851 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.607604 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:59.607604 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:59.607604 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:21:59.607604 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:21:59.607604 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f417695-eff6-4c81-89e9-9f8301495dd8 could not be found. May 27 15:21:59.607604 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.609152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d4de9528-96bb-402f-b4ac-81a5b90b663a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance 5f417695-eff6-4c81-89e9-9f8301495dd8 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:21:59.611222 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d4de9528-96bb-402f-b4ac-81a5b90b663a tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8" status: 404 len: 111 microversion: 2.1 time: 0.057616 May 27 15:21:59.612523 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2632/5269] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:59 2022] GET /compute/v2.1/servers/5f417695-eff6-4c81-89e9-9f8301495dd8 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:21:59.622549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9b1383e8-d53e-4537-8a37-732209bcc0c4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:59.623069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9b1383e8-d53e-4537-8a37-732209bcc0c4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:59.633063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b1383e8-d53e-4537-8a37-732209bcc0c4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.633532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b1383e8-d53e-4537-8a37-732209bcc0c4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.634394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b1383e8-d53e-4537-8a37-732209bcc0c4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.634847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b1383e8-d53e-4537-8a37-732209bcc0c4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.683481 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-9b1383e8-d53e-4537-8a37-732209bcc0c4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance 43dd287d-127e-46be-97bd-7051aaccc3b5 could not be found. May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9b1383e8-d53e-4537-8a37-732209bcc0c4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 HTTP/1.1 May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 43dd287d-127e-46be-97bd-7051aaccc3b5 could not be found. May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '43dd287d-127e-46be-97bd-7051aaccc3b5'} May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43dd287d-127e-46be-97bd-7051aaccc3b5 could not be found. May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:21:59.687466 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43dd287d-127e-46be-97bd-7051aaccc3b5 could not be found. May 27 15:21:59.692049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:59.692049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:59.692049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:59.692049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.692049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:59.692049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:59.692049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:21:59.692049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:21:59.692049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43dd287d-127e-46be-97bd-7051aaccc3b5 could not be found. May 27 15:21:59.692049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:59.692049 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9b1383e8-d53e-4537-8a37-732209bcc0c4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance 43dd287d-127e-46be-97bd-7051aaccc3b5 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:21:59.692049 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9b1383e8-d53e-4537-8a37-732209bcc0c4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "DELETE /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 404 len: 111 microversion: 2.1 time: 0.074011 May 27 15:21:59.695609 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2638/5270] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:21:59 2022] DELETE /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:21:59.703905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-67c62571-f1ea-4f4f-8a6e-3f9749be695c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:59.704535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-67c62571-f1ea-4f4f-8a6e-3f9749be695c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 43dd287d-127e-46be-97bd-7051aaccc3b5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:59.713984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67c62571-f1ea-4f4f-8a6e-3f9749be695c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.715839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67c62571-f1ea-4f4f-8a6e-3f9749be695c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.716730 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67c62571-f1ea-4f4f-8a6e-3f9749be695c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.721148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67c62571-f1ea-4f4f-8a6e-3f9749be695c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.759131 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-67c62571-f1ea-4f4f-8a6e-3f9749be695c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance 43dd287d-127e-46be-97bd-7051aaccc3b5 could not be found. May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-67c62571-f1ea-4f4f-8a6e-3f9749be695c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 HTTP/1.1 May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 43dd287d-127e-46be-97bd-7051aaccc3b5 could not be found. May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '43dd287d-127e-46be-97bd-7051aaccc3b5'} May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43dd287d-127e-46be-97bd-7051aaccc3b5 could not be found. May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43dd287d-127e-46be-97bd-7051aaccc3b5 could not be found. May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.760817 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.765593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:59.765593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:59.765593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:21:59.765593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:21:59.765593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43dd287d-127e-46be-97bd-7051aaccc3b5 could not be found. May 27 15:21:59.765593 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.765593 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-67c62571-f1ea-4f4f-8a6e-3f9749be695c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance 43dd287d-127e-46be-97bd-7051aaccc3b5 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:21:59.765593 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-67c62571-f1ea-4f4f-8a6e-3f9749be695c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5" status: 404 len: 111 microversion: 2.1 time: 0.062354 May 27 15:21:59.770921 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2633/5271] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:59 2022] GET /compute/v2.1/servers/43dd287d-127e-46be-97bd-7051aaccc3b5 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:21:59.777543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-20a263e6-dc35-4a30-a1ec-e2d947ee65e5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:59.778208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-20a263e6-dc35-4a30-a1ec-e2d947ee65e5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:59.784426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20a263e6-dc35-4a30-a1ec-e2d947ee65e5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.784920 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20a263e6-dc35-4a30-a1ec-e2d947ee65e5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.797368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20a263e6-dc35-4a30-a1ec-e2d947ee65e5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.797995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20a263e6-dc35-4a30-a1ec-e2d947ee65e5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.826595 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-20a263e6-dc35-4a30-a1ec-e2d947ee65e5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e could not be found. May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-20a263e6-dc35-4a30-a1ec-e2d947ee65e5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e HTTP/1.1 May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e could not be found. May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '36a5db54-c75b-4a95-9b2f-3f4ac68d345e'} May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e could not be found. May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:21:59.832257 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e could not be found. May 27 15:21:59.839202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:59.839202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:59.839202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:59.839202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.839202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:59.839202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:59.839202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:21:59.839202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:21:59.839202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e could not be found. May 27 15:21:59.839202 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:21:59.842114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-20a263e6-dc35-4a30-a1ec-e2d947ee65e5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:21:59.844467 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-20a263e6-dc35-4a30-a1ec-e2d947ee65e5 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "DELETE /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 404 len: 111 microversion: 2.1 time: 0.072158 May 27 15:21:59.850188 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2639/5272] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:21:59 2022] DELETE /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:21:59.859102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-81e585a5-042e-401c-a851-3a03f8784b3f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:59.859730 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-81e585a5-042e-401c-a851-3a03f8784b3f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 36a5db54-c75b-4a95-9b2f-3f4ac68d345e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:59.880270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-81e585a5-042e-401c-a851-3a03f8784b3f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.880851 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-81e585a5-042e-401c-a851-3a03f8784b3f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.881659 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-81e585a5-042e-401c-a851-3a03f8784b3f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.882106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-81e585a5-042e-401c-a851-3a03f8784b3f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.914941 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-81e585a5-042e-401c-a851-3a03f8784b3f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e could not be found. May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-81e585a5-042e-401c-a851-3a03f8784b3f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e HTTP/1.1 May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e could not be found. May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '36a5db54-c75b-4a95-9b2f-3f4ac68d345e'} May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e could not be found. May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e could not be found. May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.922642 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:59.927369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:59.927369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:59.927369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:21:59.927369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:21:59.927369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e could not be found. May 27 15:21:59.927369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:21:59.931324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-81e585a5-042e-401c-a851-3a03f8784b3f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance 36a5db54-c75b-4a95-9b2f-3f4ac68d345e could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:21:59.935091 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-81e585a5-042e-401c-a851-3a03f8784b3f tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e" status: 404 len: 111 microversion: 2.1 time: 0.081460 May 27 15:21:59.936272 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2634/5273] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:21:59 2022] GET /compute/v2.1/servers/36a5db54-c75b-4a95-9b2f-3f4ac68d345e => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:21:59.945516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-afb6f10a-bdfe-4d86-b5ee-559712cb74c3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:59.946057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-afb6f10a-bdfe-4d86-b5ee-559712cb74c3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:59.973935 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afb6f10a-bdfe-4d86-b5ee-559712cb74c3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.976395 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afb6f10a-bdfe-4d86-b5ee-559712cb74c3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.979285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afb6f10a-bdfe-4d86-b5ee-559712cb74c3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.979752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-afb6f10a-bdfe-4d86-b5ee-559712cb74c3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.018147 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-afb6f10a-bdfe-4d86-b5ee-559712cb74c3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff could not be found. May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-afb6f10a-bdfe-4d86-b5ee-559712cb74c3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff HTTP/1.1 May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff could not be found. May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '2fc136c6-a73e-495c-b72d-e8f6ecbc26ff'} May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff could not be found. May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:22:00.021488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff could not be found. May 27 15:22:00.026742 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:00.026742 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:00.026742 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:00.026742 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:00.026742 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:00.026742 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:00.026742 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:22:00.026742 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:22:00.026742 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff could not be found. May 27 15:22:00.026742 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:00.026742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-afb6f10a-bdfe-4d86-b5ee-559712cb74c3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:22:00.027493 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-afb6f10a-bdfe-4d86-b5ee-559712cb74c3 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 404 len: 111 microversion: 2.1 time: 0.085445 May 27 15:22:00.032144 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2640/5274] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:21:59 2022] DELETE /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:22:00.039270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e56bddb7-076c-49bf-9046-5737e3eaff05 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:00.040126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e56bddb7-076c-49bf-9046-5737e3eaff05 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:00.058302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e56bddb7-076c-49bf-9046-5737e3eaff05 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:00.059209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e56bddb7-076c-49bf-9046-5737e3eaff05 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.062517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e56bddb7-076c-49bf-9046-5737e3eaff05 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:00.063202 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e56bddb7-076c-49bf-9046-5737e3eaff05 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.098840 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-e56bddb7-076c-49bf-9046-5737e3eaff05 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff could not be found. May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e56bddb7-076c-49bf-9046-5737e3eaff05 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff HTTP/1.1 May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff could not be found. May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '2fc136c6-a73e-495c-b72d-e8f6ecbc26ff'} May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff could not be found. May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff could not be found. May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:22:00.103099 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:00.107669 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:00.107669 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:00.107669 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:22:00.107669 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:22:00.107669 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff could not be found. May 27 15:22:00.107669 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:22:00.112711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e56bddb7-076c-49bf-9046-5737e3eaff05 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance 2fc136c6-a73e-495c-b72d-e8f6ecbc26ff could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:22:00.113862 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e56bddb7-076c-49bf-9046-5737e3eaff05 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff" status: 404 len: 111 microversion: 2.1 time: 0.081641 May 27 15:22:00.114614 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2635/5275] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:00 2022] GET /compute/v2.1/servers/2fc136c6-a73e-495c-b72d-e8f6ecbc26ff => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:22:00.123435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a44023b9-2c02-4576-b0be-aa62ade4275d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:00.124220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a44023b9-2c02-4576-b0be-aa62ade4275d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:00.134512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a44023b9-2c02-4576-b0be-aa62ade4275d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:00.135137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a44023b9-2c02-4576-b0be-aa62ade4275d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.138529 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a44023b9-2c02-4576-b0be-aa62ade4275d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:00.142902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a44023b9-2c02-4576-b0be-aa62ade4275d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.175108 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-a44023b9-2c02-4576-b0be-aa62ade4275d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 could not be found. May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a44023b9-2c02-4576-b0be-aa62ade4275d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 HTTP/1.1 May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 could not be found. May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '6863a0f9-a1ac-4dd5-93f7-1089256bd265'} May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 could not be found. May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:22:00.180660 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 could not be found. May 27 15:22:00.185188 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:00.185188 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:00.185188 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:00.185188 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:00.185188 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:00.185188 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:00.185188 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:22:00.185188 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:22:00.185188 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 could not be found. May 27 15:22:00.185188 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:00.185188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a44023b9-2c02-4576-b0be-aa62ade4275d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:22:00.185188 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a44023b9-2c02-4576-b0be-aa62ade4275d tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 404 len: 111 microversion: 2.1 time: 0.065329 May 27 15:22:00.187686 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2641/5276] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:22:00 2022] DELETE /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:22:00.194384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e1aefbb5-151b-4302-b9bc-31492fc50a92 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:00.195026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e1aefbb5-151b-4302-b9bc-31492fc50a92 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 6863a0f9-a1ac-4dd5-93f7-1089256bd265] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:00.216820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e1aefbb5-151b-4302-b9bc-31492fc50a92 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:00.217879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-40fded5b-f7ca-4efa-97e1-a266baf93cb4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:00.218624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-40fded5b-f7ca-4efa-97e1-a266baf93cb4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:00.221259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e1aefbb5-151b-4302-b9bc-31492fc50a92 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.222196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e1aefbb5-151b-4302-b9bc-31492fc50a92 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:00.222660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e1aefbb5-151b-4302-b9bc-31492fc50a92 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.243436 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40fded5b-f7ca-4efa-97e1-a266baf93cb4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:00.243909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40fded5b-f7ca-4efa-97e1-a266baf93cb4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.249482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40fded5b-f7ca-4efa-97e1-a266baf93cb4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:00.249964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40fded5b-f7ca-4efa-97e1-a266baf93cb4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.264551 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-e1aefbb5-151b-4302-b9bc-31492fc50a92 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 could not be found. May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e1aefbb5-151b-4302-b9bc-31492fc50a92 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 HTTP/1.1 May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 could not be found. May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '6863a0f9-a1ac-4dd5-93f7-1089256bd265'} May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 could not be found. May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 could not be found. May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:22:00.275657 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:00.283911 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:00.283911 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:00.283911 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:22:00.283911 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:22:00.283911 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 could not be found. May 27 15:22:00.283911 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:22:00.283911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e1aefbb5-151b-4302-b9bc-31492fc50a92 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance 6863a0f9-a1ac-4dd5-93f7-1089256bd265 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:22:00.283911 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e1aefbb5-151b-4302-b9bc-31492fc50a92 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265" status: 404 len: 111 microversion: 2.1 time: 0.087092 May 27 15:22:00.283911 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2636/5277] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:00 2022] GET /compute/v2.1/servers/6863a0f9-a1ac-4dd5-93f7-1089256bd265 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:22:00.286472 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee2ec1d2-e0f6-44da-a7f4-f0543f07cb63 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:00.286993 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ee2ec1d2-e0f6-44da-a7f4-f0543f07cb63 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 31c1ef4d-5a39-4b35-818f-71fbfee047a3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:00.312693 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee2ec1d2-e0f6-44da-a7f4-f0543f07cb63 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:00.313173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee2ec1d2-e0f6-44da-a7f4-f0543f07cb63 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.313997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee2ec1d2-e0f6-44da-a7f4-f0543f07cb63 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:00.314831 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee2ec1d2-e0f6-44da-a7f4-f0543f07cb63 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.377598 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-ee2ec1d2-e0f6-44da-a7f4-f0543f07cb63 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance 31c1ef4d-5a39-4b35-818f-71fbfee047a3 could not be found. May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee2ec1d2-e0f6-44da-a7f4-f0543f07cb63 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/31c1ef4d-5a39-4b35-818f-71fbfee047a3 HTTP/1.1 May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 31c1ef4d-5a39-4b35-818f-71fbfee047a3 could not be found. May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '31c1ef4d-5a39-4b35-818f-71fbfee047a3'} May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c1ef4d-5a39-4b35-818f-71fbfee047a3 could not be found. May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:22:00.385941 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c1ef4d-5a39-4b35-818f-71fbfee047a3 could not be found. May 27 15:22:00.390504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:22:00.390504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:00.390504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:22:00.390504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:00.390504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:00.390504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:00.390504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:22:00.390504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:22:00.390504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c1ef4d-5a39-4b35-818f-71fbfee047a3 could not be found. May 27 15:22:00.390504 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:22:00.390504 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee2ec1d2-e0f6-44da-a7f4-f0543f07cb63 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance 31c1ef4d-5a39-4b35-818f-71fbfee047a3 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:22:00.390504 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ee2ec1d2-e0f6-44da-a7f4-f0543f07cb63 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "DELETE /compute/v2.1/servers/31c1ef4d-5a39-4b35-818f-71fbfee047a3" status: 404 len: 111 microversion: 2.1 time: 0.104831 May 27 15:22:00.400223 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2637/5278] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:22:00 2022] DELETE /compute/v2.1/servers/31c1ef4d-5a39-4b35-818f-71fbfee047a3 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:22:00.415241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5d7e96a5-928a-4a8a-a8b7-651810eb26d8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:00.419553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5d7e96a5-928a-4a8a-a8b7-651810eb26d8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 31c1ef4d-5a39-4b35-818f-71fbfee047a3] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:00.446146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5d7e96a5-928a-4a8a-a8b7-651810eb26d8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:00.447269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5d7e96a5-928a-4a8a-a8b7-651810eb26d8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.454183 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5d7e96a5-928a-4a8a-a8b7-651810eb26d8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:00.454983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5d7e96a5-928a-4a8a-a8b7-651810eb26d8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.518054 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-5d7e96a5-928a-4a8a-a8b7-651810eb26d8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance 31c1ef4d-5a39-4b35-818f-71fbfee047a3 could not be found. May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5d7e96a5-928a-4a8a-a8b7-651810eb26d8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/31c1ef4d-5a39-4b35-818f-71fbfee047a3 HTTP/1.1 May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 31c1ef4d-5a39-4b35-818f-71fbfee047a3 could not be found. May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '31c1ef4d-5a39-4b35-818f-71fbfee047a3'} May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c1ef4d-5a39-4b35-818f-71fbfee047a3 could not be found. May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c1ef4d-5a39-4b35-818f-71fbfee047a3 could not be found. May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:22:00.527823 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:00.532556 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:00.532556 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:00.532556 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:22:00.532556 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:22:00.532556 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c1ef4d-5a39-4b35-818f-71fbfee047a3 could not be found. May 27 15:22:00.532556 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:22:00.534920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5d7e96a5-928a-4a8a-a8b7-651810eb26d8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance 31c1ef4d-5a39-4b35-818f-71fbfee047a3 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:22:00.537176 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5d7e96a5-928a-4a8a-a8b7-651810eb26d8 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/31c1ef4d-5a39-4b35-818f-71fbfee047a3" status: 404 len: 111 microversion: 2.1 time: 0.135324 May 27 15:22:00.537943 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2638/5279] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:00 2022] GET /compute/v2.1/servers/31c1ef4d-5a39-4b35-818f-71fbfee047a3 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:22:00.547487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3b5c3dda-ed61-42b2-bb28-3bada3018a1c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:00.548397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3b5c3dda-ed61-42b2-bb28-3bada3018a1c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 9986bdac-9b6e-4175-ae4e-afb0adc396cc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:00.561954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b5c3dda-ed61-42b2-bb28-3bada3018a1c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:00.562703 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b5c3dda-ed61-42b2-bb28-3bada3018a1c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.564376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b5c3dda-ed61-42b2-bb28-3bada3018a1c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:00.565388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b5c3dda-ed61-42b2-bb28-3bada3018a1c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.612826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3b5c3dda-ed61-42b2-bb28-3bada3018a1c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 9986bdac-9b6e-4175-ae4e-afb0adc396cc] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:22:00.700802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:00.786508 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3b5c3dda-ed61-42b2-bb28-3bada3018a1c tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc" status: 204 len: 0 microversion: 2.1 time: 0.241120 May 27 15:22:00.790774 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2639/5280] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:22:00 2022] DELETE /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:22:00.806083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dafb1e35-fe64-48a2-bd6b-79e2826380f4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:00.810508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dafb1e35-fe64-48a2-bd6b-79e2826380f4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 9986bdac-9b6e-4175-ae4e-afb0adc396cc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:00.828631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dafb1e35-fe64-48a2-bd6b-79e2826380f4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:00.830485 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dafb1e35-fe64-48a2-bd6b-79e2826380f4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.832584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dafb1e35-fe64-48a2-bd6b-79e2826380f4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:00.840655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-40fded5b-f7ca-4efa-97e1-a266baf93cb4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:00.849747 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-40fded5b-f7ca-4efa-97e1-a266baf93cb4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1682 microversion: 2.1 time: 0.649863 May 27 15:22:00.850366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dafb1e35-fe64-48a2-bd6b-79e2826380f4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.853957 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2642/5281] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:00 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1682 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:00.998074 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dafb1e35-fe64-48a2-bd6b-79e2826380f4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:01.006773 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dafb1e35-fe64-48a2-bd6b-79e2826380f4 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc" status: 200 len: 1480 microversion: 2.1 time: 0.214586 May 27 15:22:01.008780 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2640/5282] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:00 2022] GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc => generated 1480 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:01.883410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1ad97f8f-0fff-45a1-bb75-c610ff92c22e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:01.884044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1ad97f8f-0fff-45a1-bb75-c610ff92c22e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:01.892432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ad97f8f-0fff-45a1-bb75-c610ff92c22e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:01.893284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ad97f8f-0fff-45a1-bb75-c610ff92c22e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:01.894404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ad97f8f-0fff-45a1-bb75-c610ff92c22e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:01.895389 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ad97f8f-0fff-45a1-bb75-c610ff92c22e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:02.026473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dffdf2bc-dc8d-4c10-88d1-381e81c22c09 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:02.028127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dffdf2bc-dc8d-4c10-88d1-381e81c22c09 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 9986bdac-9b6e-4175-ae4e-afb0adc396cc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:02.041845 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dffdf2bc-dc8d-4c10-88d1-381e81c22c09 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:02.044841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dffdf2bc-dc8d-4c10-88d1-381e81c22c09 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:02.047102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dffdf2bc-dc8d-4c10-88d1-381e81c22c09 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:02.049800 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dffdf2bc-dc8d-4c10-88d1-381e81c22c09 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:02.091256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1ad97f8f-0fff-45a1-bb75-c610ff92c22e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:02.103872 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1ad97f8f-0fff-45a1-bb75-c610ff92c22e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1682 microversion: 2.1 time: 0.225199 May 27 15:22:02.106899 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2643/5283] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:01 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:02.274793 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dffdf2bc-dc8d-4c10-88d1-381e81c22c09 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:02.286043 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dffdf2bc-dc8d-4c10-88d1-381e81c22c09 tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc" status: 200 len: 1480 microversion: 2.1 time: 0.262858 May 27 15:22:02.299534 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2641/5284] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:02 2022] GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc => generated 1480 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:22:03.123295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dce029f8-3309-4abd-a1a4-4208266c1ef5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:03.124201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dce029f8-3309-4abd-a1a4-4208266c1ef5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:03.131782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dce029f8-3309-4abd-a1a4-4208266c1ef5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:03.132490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dce029f8-3309-4abd-a1a4-4208266c1ef5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:03.133472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dce029f8-3309-4abd-a1a4-4208266c1ef5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:03.134615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dce029f8-3309-4abd-a1a4-4208266c1ef5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:03.309903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6c05101d-5cc5-49cc-93ff-cc4c2f647c5b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:03.311296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6c05101d-5cc5-49cc-93ff-cc4c2f647c5b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 9986bdac-9b6e-4175-ae4e-afb0adc396cc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:03.333248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c05101d-5cc5-49cc-93ff-cc4c2f647c5b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:03.334378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c05101d-5cc5-49cc-93ff-cc4c2f647c5b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:03.335764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c05101d-5cc5-49cc-93ff-cc4c2f647c5b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:03.336387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6c05101d-5cc5-49cc-93ff-cc4c2f647c5b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:03.499170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dce029f8-3309-4abd-a1a4-4208266c1ef5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:03.511459 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dce029f8-3309-4abd-a1a4-4208266c1ef5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1682 microversion: 2.1 time: 0.391120 May 27 15:22:03.513200 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2644/5285] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:03 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1682 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:03.649642 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6c05101d-5cc5-49cc-93ff-cc4c2f647c5b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f0525081cf441998d2c320fa0087cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db397cde9e67464182a7ba045f1779be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:03.662159 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6c05101d-5cc5-49cc-93ff-cc4c2f647c5b tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc" status: 200 len: 1480 microversion: 2.1 time: 0.359916 May 27 15:22:03.664361 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2642/5286] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:03 2022] GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc => generated 1480 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:03.718125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-375f5d42-0a60-4b74-8ef4-b48299010518 req-7f99c491-b217-4d3e-88a8-0e6dc82fef9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9986bdac-9b6e-4175-ae4e-afb0adc396cc", "name": "network-vif-deleted", "tag": "124b08a5-0194-45ca-a50a-b077be06b20d"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:03.732858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-375f5d42-0a60-4b74-8ef4-b48299010518 req-7f99c491-b217-4d3e-88a8-0e6dc82fef9f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:03.735056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-375f5d42-0a60-4b74-8ef4-b48299010518 req-7f99c491-b217-4d3e-88a8-0e6dc82fef9f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:03.755685 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-375f5d42-0a60-4b74-8ef4-b48299010518 req-7f99c491-b217-4d3e-88a8-0e6dc82fef9f service nova] Creating event network-vif-deleted:124b08a5-0194-45ca-a50a-b077be06b20d for instance 9986bdac-9b6e-4175-ae4e-afb0adc396cc on n-h1-843621-1 May 27 15:22:03.761941 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-375f5d42-0a60-4b74-8ef4-b48299010518 req-7f99c491-b217-4d3e-88a8-0e6dc82fef9f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047648 May 27 15:22:03.771749 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2645/5287] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:04.530726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4c50d295-f73c-4638-a819-5c4e2a0efc77 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:04.531403 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4c50d295-f73c-4638-a819-5c4e2a0efc77 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:04.552056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c50d295-f73c-4638-a819-5c4e2a0efc77 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:04.558413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c50d295-f73c-4638-a819-5c4e2a0efc77 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:04.560964 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c50d295-f73c-4638-a819-5c4e2a0efc77 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:04.561446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4c50d295-f73c-4638-a819-5c4e2a0efc77 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:04.686085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f50821a1-367e-4267-9875-48f4dc54cffc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:04.688006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f50821a1-367e-4267-9875-48f4dc54cffc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] [instance: 9986bdac-9b6e-4175-ae4e-afb0adc396cc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:04.703428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f50821a1-367e-4267-9875-48f4dc54cffc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:04.709173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f50821a1-367e-4267-9875-48f4dc54cffc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:04.711301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f50821a1-367e-4267-9875-48f4dc54cffc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:04.712740 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f50821a1-367e-4267-9875-48f4dc54cffc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:04.734299 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-f50821a1-367e-4267-9875-48f4dc54cffc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] HTTP exception thrown: Instance 9986bdac-9b6e-4175-ae4e-afb0adc396cc could not be found. May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f50821a1-367e-4267-9875-48f4dc54cffc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Request method failure captured: May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc HTTP/1.1 May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOuvyXkDdoiqqqi-3rcGZs_w6rU8U4UhBGrpHCxpZAoWNTHqMZ-lyr3dmQ8SaMBSrJXL5KhkX3pwHQ8w4_4noYlaZN5o28u03Ghewtu4WDG0tobCy_DrgsCbtLYjLKo4Y1Nsc1rQHJ36eeokODwfAWzowVKiTiCWt0ltD0HSWNFzo1Q May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: db397cde9e67464182a7ba045f1779be May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersTestJSON-41376916 May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/db397cde9e67464182a7ba045f1779be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/db397cde9e67464182a7ba045f1779be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_db397cde9e67464182a7ba045f1779be", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersTestJSON-41376916 May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: db397cde9e67464182a7ba045f1779be May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersTestJSON-41376916 May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersTestJSON-41376916-project May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 2f0525081cf441998d2c320fa0087cff May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersTestJSON-41376916-project May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 9986bdac-9b6e-4175-ae4e-afb0adc396cc could not be found. May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '9986bdac-9b6e-4175-ae4e-afb0adc396cc'} May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9986bdac-9b6e-4175-ae4e-afb0adc396cc could not be found. May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9986bdac-9b6e-4175-ae4e-afb0adc396cc could not be found. May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:04.736614 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:04.740622 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:04.740622 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:04.740622 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:22:04.740622 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:22:04.740622 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9986bdac-9b6e-4175-ae4e-afb0adc396cc could not be found. May 27 15:22:04.740622 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:04.744170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f50821a1-367e-4267-9875-48f4dc54cffc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] Returning 404 to user: Instance 9986bdac-9b6e-4175-ae4e-afb0adc396cc could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:22:04.746444 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f50821a1-367e-4267-9875-48f4dc54cffc tempest-ServersTestJSON-41376916 tempest-ServersTestJSON-41376916-project] 10.222.0.13 "GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc" status: 404 len: 111 microversion: 2.1 time: 0.067949 May 27 15:22:04.747217 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2646/5288] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:04 2022] GET /compute/v2.1/servers/9986bdac-9b6e-4175-ae4e-afb0adc396cc => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:22:04.866146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4c50d295-f73c-4638-a819-5c4e2a0efc77 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:04.885979 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4c50d295-f73c-4638-a819-5c4e2a0efc77 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.359414 May 27 15:22:04.886846 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2643/5289] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:04 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:05.001644 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d6d3576f-a7b1-4ac7-a384-da927dbb656d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:05.002463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d6d3576f-a7b1-4ac7-a384-da927dbb656d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:05.010550 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6d3576f-a7b1-4ac7-a384-da927dbb656d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:05.011584 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6d3576f-a7b1-4ac7-a384-da927dbb656d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:05.012630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6d3576f-a7b1-4ac7-a384-da927dbb656d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:05.013362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6d3576f-a7b1-4ac7-a384-da927dbb656d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:05.324537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d6d3576f-a7b1-4ac7-a384-da927dbb656d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:05.336500 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d6d3576f-a7b1-4ac7-a384-da927dbb656d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.338710 May 27 15:22:05.338213 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2647/5290] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:04 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:05.389429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7635a718-5b40-465d-aa22-72c3ce968765 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:05.393552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7635a718-5b40-465d-aa22-72c3ce968765 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:05.413818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7635a718-5b40-465d-aa22-72c3ce968765 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:05.414301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7635a718-5b40-465d-aa22-72c3ce968765 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:05.418632 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7635a718-5b40-465d-aa22-72c3ce968765 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:05.420931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7635a718-5b40-465d-aa22-72c3ce968765 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:05.570402 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7635a718-5b40-465d-aa22-72c3ce968765 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments/14c1bec1-df30-4ad4-a15c-07f620cf9ce4" status: 200 len: 194 microversion: 2.1 time: 0.191668 May 27 15:22:05.580345 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2644/5291] 10.222.0.13 () {58 vars in 1412 bytes} [Fri May 27 15:22:05 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments/14c1bec1-df30-4ad4-a15c-07f620cf9ce4 => generated 194 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:05.599245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8219ac75-469b-46cb-8ed9-da832d79256a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:05.605160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8219ac75-469b-46cb-8ed9-da832d79256a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:05.621028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8219ac75-469b-46cb-8ed9-da832d79256a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:05.621499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8219ac75-469b-46cb-8ed9-da832d79256a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:05.623832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8219ac75-469b-46cb-8ed9-da832d79256a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:05.625932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8219ac75-469b-46cb-8ed9-da832d79256a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:05.896171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-8219ac75-469b-46cb-8ed9-da832d79256a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lazy-loading 'services' on Instance uuid 9cc72e17-205e-4e7f-aefe-17a244443295 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:22:06.167347 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8219ac75-469b-46cb-8ed9-da832d79256a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments/14c1bec1-df30-4ad4-a15c-07f620cf9ce4" status: 202 len: 0 microversion: 2.1 time: 0.585641 May 27 15:22:06.169339 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2648/5292] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 15:22:05 2022] DELETE /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments/14c1bec1-df30-4ad4-a15c-07f620cf9ce4 => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:22:06.869464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-441274fc-e343-47a7-954a-0a77250e2210 req-9e053fbc-80ac-4fbc-86f8-105a2707ea06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812d42c0-07f1-4f7c-83b8-848b18cf0186", "name": "network-vif-unplugged", "status": "completed", "tag": "0d9da5e7-a50c-4ddd-aca9-02eae7d0476c"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:06.893189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-441274fc-e343-47a7-954a-0a77250e2210 req-9e053fbc-80ac-4fbc-86f8-105a2707ea06 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:06.893660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-441274fc-e343-47a7-954a-0a77250e2210 req-9e053fbc-80ac-4fbc-86f8-105a2707ea06 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:06.954763 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-441274fc-e343-47a7-954a-0a77250e2210 req-9e053fbc-80ac-4fbc-86f8-105a2707ea06 service nova] Creating event network-vif-unplugged:0d9da5e7-a50c-4ddd-aca9-02eae7d0476c for instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 on n-h1-843621-1 May 27 15:22:06.986525 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-441274fc-e343-47a7-954a-0a77250e2210 req-9e053fbc-80ac-4fbc-86f8-105a2707ea06 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121386 May 27 15:22:06.986783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e9f5f199-3868-4b10-8394-72552d3e4a0f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:06.987246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e9f5f199-3868-4b10-8394-72552d3e4a0f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:06.989410 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2645/5293] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:07.007188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9f5f199-3868-4b10-8394-72552d3e4a0f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:07.014311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9f5f199-3868-4b10-8394-72552d3e4a0f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:07.015789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9f5f199-3868-4b10-8394-72552d3e4a0f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:07.016256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e9f5f199-3868-4b10-8394-72552d3e4a0f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:07.373589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e9f5f199-3868-4b10-8394-72552d3e4a0f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:07.386113 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e9f5f199-3868-4b10-8394-72552d3e4a0f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.403562 May 27 15:22:07.386974 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2649/5294] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:06 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:22:07.409753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3f4c5ff6-a31a-4d68-aead-3f7570dc7a19 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:07.410469 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3f4c5ff6-a31a-4d68-aead-3f7570dc7a19 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:07.417573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f4c5ff6-a31a-4d68-aead-3f7570dc7a19 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:07.418044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f4c5ff6-a31a-4d68-aead-3f7570dc7a19 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:07.418821 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f4c5ff6-a31a-4d68-aead-3f7570dc7a19 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:07.419497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f4c5ff6-a31a-4d68-aead-3f7570dc7a19 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:07.712977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3f4c5ff6-a31a-4d68-aead-3f7570dc7a19 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:07.725685 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3f4c5ff6-a31a-4d68-aead-3f7570dc7a19 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.324039 May 27 15:22:07.728755 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2646/5295] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:07 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:07.746217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c0113ecb-f20b-47c5-a292-ece2183da035 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:07.746854 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c0113ecb-f20b-47c5-a292-ece2183da035 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:07.764806 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c0113ecb-f20b-47c5-a292-ece2183da035 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:07.767871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c0113ecb-f20b-47c5-a292-ece2183da035 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:07.768920 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c0113ecb-f20b-47c5-a292-ece2183da035 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:07.769785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c0113ecb-f20b-47c5-a292-ece2183da035 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:08.187159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c0113ecb-f20b-47c5-a292-ece2183da035 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:08.199564 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c0113ecb-f20b-47c5-a292-ece2183da035 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.456865 May 27 15:22:08.209070 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2650/5296] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:07 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:08.217641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2e286248-cdd1-4a2e-8c7b-a8897529bdef tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:08.218976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2e286248-cdd1-4a2e-8c7b-a8897529bdef tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:08.231730 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e286248-cdd1-4a2e-8c7b-a8897529bdef tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:08.232176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e286248-cdd1-4a2e-8c7b-a8897529bdef tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:08.233054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e286248-cdd1-4a2e-8c7b-a8897529bdef tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:08.233495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e286248-cdd1-4a2e-8c7b-a8897529bdef tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:08.402891 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2e286248-cdd1-4a2e-8c7b-a8897529bdef tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action" status: 202 len: 0 microversion: 2.1 time: 0.188455 May 27 15:22:08.405026 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2647/5297] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:22:08 2022] POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:22:08.415234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b31ca152-7e22-4841-9598-38e4f7c5c1b4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:08.416598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b31ca152-7e22-4841-9598-38e4f7c5c1b4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:08.429645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b31ca152-7e22-4841-9598-38e4f7c5c1b4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:08.432686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b31ca152-7e22-4841-9598-38e4f7c5c1b4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:08.434563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b31ca152-7e22-4841-9598-38e4f7c5c1b4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:08.435521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b31ca152-7e22-4841-9598-38e4f7c5c1b4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:08.847016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f375510a-3924-4be3-9799-f11a96fe8b38 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-61348931", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": "none"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:08.917543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f375510a-3924-4be3-9799-f11a96fe8b38 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:22:08.918437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f375510a-3924-4be3-9799-f11a96fe8b38 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:22:08.918604 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b31ca152-7e22-4841-9598-38e4f7c5c1b4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:08.919220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f375510a-3924-4be3-9799-f11a96fe8b38 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:22:08.920226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f375510a-3924-4be3-9799-f11a96fe8b38 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:22:08.920918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f375510a-3924-4be3-9799-f11a96fe8b38 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:22:08.930126 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b31ca152-7e22-4841-9598-38e4f7c5c1b4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1671 microversion: 2.1 time: 0.521085 May 27 15:22:08.931267 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2648/5298] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:08 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1671 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:08.944189 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f375510a-3924-4be3-9799-f11a96fe8b38 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:08.944706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f375510a-3924-4be3-9799-f11a96fe8b38 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:08.945654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f375510a-3924-4be3-9799-f11a96fe8b38 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:08.949386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f375510a-3924-4be3-9799-f11a96fe8b38 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:08.973271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-f375510a-3924-4be3-9799-f11a96fe8b38 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Getting quotas for project e40d8431a56f4f979e2a598b32a6821a. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:22:08.981120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-f375510a-3924-4be3-9799-f11a96fe8b38 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Getting quotas for user 442c425528fc4b8fbffa7b044ffa3069 and project e40d8431a56f4f979e2a598b32a6821a. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:22:08.996971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f375510a-3924-4be3-9799-f11a96fe8b38 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:22:09.003079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f375510a-3924-4be3-9799-f11a96fe8b38 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:22:09.092822 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f375510a-3924-4be3-9799-f11a96fe8b38 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.723495 May 27 15:22:09.095597 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2651/5299] 10.222.0.13 () {62 vars in 1187 bytes} [Fri May 27 15:22:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 27 15:22:09.105966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6d5ec01e-863f-4f4d-966c-671de27bcfb4 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:09.106072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6d5ec01e-863f-4f4d-966c-671de27bcfb4 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:09.226646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6d5ec01e-863f-4f4d-966c-671de27bcfb4 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:09.240439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6d5ec01e-863f-4f4d-966c-671de27bcfb4 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:09.242473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6d5ec01e-863f-4f4d-966c-671de27bcfb4 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:09.248395 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6d5ec01e-863f-4f4d-966c-671de27bcfb4 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1276 microversion: 2.57 time: 0.145801 May 27 15:22:09.263334 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2649/5300] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:09 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1276 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:09.948159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4d42bc41-07f0-4f70-bc55-5eedda6e1cf2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:09.949565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4d42bc41-07f0-4f70-bc55-5eedda6e1cf2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:09.966293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4d42bc41-07f0-4f70-bc55-5eedda6e1cf2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:09.967178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4d42bc41-07f0-4f70-bc55-5eedda6e1cf2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:09.968165 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4d42bc41-07f0-4f70-bc55-5eedda6e1cf2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:09.968931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4d42bc41-07f0-4f70-bc55-5eedda6e1cf2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:10.268231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4d42bc41-07f0-4f70-bc55-5eedda6e1cf2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:10.270622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1fc091cd-8409-421a-a690-c165b29a4030 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:10.277543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1fc091cd-8409-421a-a690-c165b29a4030 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:10.335934 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4d42bc41-07f0-4f70-bc55-5eedda6e1cf2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1671 microversion: 2.1 time: 0.392100 May 27 15:22:10.345375 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2652/5301] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:09 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1671 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:10.349149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1fc091cd-8409-421a-a690-c165b29a4030 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:10.349719 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1fc091cd-8409-421a-a690-c165b29a4030 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:10.350604 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1fc091cd-8409-421a-a690-c165b29a4030 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:10.351298 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1fc091cd-8409-421a-a690-c165b29a4030 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:10.480532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1fc091cd-8409-421a-a690-c165b29a4030 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:10.502875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1fc091cd-8409-421a-a690-c165b29a4030 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:10.504741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1fc091cd-8409-421a-a690-c165b29a4030 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:10.505907 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1fc091cd-8409-421a-a690-c165b29a4030 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1328 microversion: 2.57 time: 0.242480 May 27 15:22:10.506471 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2650/5302] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:10 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1328 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:11.364355 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1471ed1e-b506-40b8-a848-dd55641f3d5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:11.365625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1471ed1e-b506-40b8-a848-dd55641f3d5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:11.376635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1471ed1e-b506-40b8-a848-dd55641f3d5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:11.377556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1471ed1e-b506-40b8-a848-dd55641f3d5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:11.378602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1471ed1e-b506-40b8-a848-dd55641f3d5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:11.381492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1471ed1e-b506-40b8-a848-dd55641f3d5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:11.529766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b5883f81-2ab6-41ac-a496-04ad7d42b44d tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:11.531164 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b5883f81-2ab6-41ac-a496-04ad7d42b44d tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:11.541624 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5883f81-2ab6-41ac-a496-04ad7d42b44d tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:11.542761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5883f81-2ab6-41ac-a496-04ad7d42b44d tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:11.544482 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5883f81-2ab6-41ac-a496-04ad7d42b44d tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:11.545835 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5883f81-2ab6-41ac-a496-04ad7d42b44d tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:11.604657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1471ed1e-b506-40b8-a848-dd55641f3d5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:11.614787 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1471ed1e-b506-40b8-a848-dd55641f3d5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.256345 May 27 15:22:11.622162 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2653/5303] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:11 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:11.633186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e20cbd24-da82-42e7-a097-e5ce85e76dfc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:11.634666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e20cbd24-da82-42e7-a097-e5ce85e76dfc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:11.643117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e20cbd24-da82-42e7-a097-e5ce85e76dfc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:11.643885 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e20cbd24-da82-42e7-a097-e5ce85e76dfc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:11.645010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e20cbd24-da82-42e7-a097-e5ce85e76dfc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:11.645619 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e20cbd24-da82-42e7-a097-e5ce85e76dfc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:11.697262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b5883f81-2ab6-41ac-a496-04ad7d42b44d tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:11.706411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b5883f81-2ab6-41ac-a496-04ad7d42b44d tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:11.708255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b5883f81-2ab6-41ac-a496-04ad7d42b44d tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:11.709494 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b5883f81-2ab6-41ac-a496-04ad7d42b44d tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1334 microversion: 2.57 time: 0.186704 May 27 15:22:11.710876 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2651/5304] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:11 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1334 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:12.730654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2a2acdd5-1e6b-4c0b-b030-b929754fc2d8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:12.731585 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2a2acdd5-1e6b-4c0b-b030-b929754fc2d8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:12.738833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a2acdd5-1e6b-4c0b-b030-b929754fc2d8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:12.739534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a2acdd5-1e6b-4c0b-b030-b929754fc2d8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:12.740711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a2acdd5-1e6b-4c0b-b030-b929754fc2d8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:12.741617 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a2acdd5-1e6b-4c0b-b030-b929754fc2d8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:12.870920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2a2acdd5-1e6b-4c0b-b030-b929754fc2d8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:12.886373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2a2acdd5-1e6b-4c0b-b030-b929754fc2d8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:12.890520 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2a2acdd5-1e6b-4c0b-b030-b929754fc2d8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:12.895336 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2a2acdd5-1e6b-4c0b-b030-b929754fc2d8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1334 microversion: 2.57 time: 0.166431 May 27 15:22:12.897520 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2652/5305] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:12 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1334 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:22:13.456689 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e20cbd24-da82-42e7-a097-e5ce85e76dfc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action" status: 200 len: 143 microversion: 2.1 time: 1.827825 May 27 15:22:13.459976 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2654/5306] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:22:11 2022] POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action => generated 143 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:13.473344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4b90e332-e747-49e5-8b80-5ce924ef6d0d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:13.474314 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4b90e332-e747-49e5-8b80-5ce924ef6d0d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:13.485042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b90e332-e747-49e5-8b80-5ce924ef6d0d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:13.485853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b90e332-e747-49e5-8b80-5ce924ef6d0d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:13.503715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b90e332-e747-49e5-8b80-5ce924ef6d0d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:13.505031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b90e332-e747-49e5-8b80-5ce924ef6d0d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:13.747296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4b90e332-e747-49e5-8b80-5ce924ef6d0d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:13.766279 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4b90e332-e747-49e5-8b80-5ce924ef6d0d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.299915 May 27 15:22:13.767721 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2653/5307] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:13 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:13.787298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4f407475-3ce7-417d-bf6f-63f1c73ac4ba tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:13.788408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4f407475-3ce7-417d-bf6f-63f1c73ac4ba tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:13.795783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f407475-3ce7-417d-bf6f-63f1c73ac4ba tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:13.796583 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f407475-3ce7-417d-bf6f-63f1c73ac4ba tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:13.797657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f407475-3ce7-417d-bf6f-63f1c73ac4ba tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:13.798333 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f407475-3ce7-417d-bf6f-63f1c73ac4ba tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:13.919234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ef9e6073-2eb0-4006-9cf5-cb7d400e2775 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:13.920928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ef9e6073-2eb0-4006-9cf5-cb7d400e2775 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:13.928274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef9e6073-2eb0-4006-9cf5-cb7d400e2775 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:13.929082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef9e6073-2eb0-4006-9cf5-cb7d400e2775 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:13.930095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef9e6073-2eb0-4006-9cf5-cb7d400e2775 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:13.931289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef9e6073-2eb0-4006-9cf5-cb7d400e2775 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:14.013184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4f407475-3ce7-417d-bf6f-63f1c73ac4ba tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:14.023961 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4f407475-3ce7-417d-bf6f-63f1c73ac4ba tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.240369 May 27 15:22:14.033440 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2655/5308] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:13 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:14.042359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4bb718c6-1721-4c16-bee9-e676dbe7ea4b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:14.043616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4bb718c6-1721-4c16-bee9-e676dbe7ea4b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:14.046304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ef9e6073-2eb0-4006-9cf5-cb7d400e2775 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:14.052362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4bb718c6-1721-4c16-bee9-e676dbe7ea4b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:14.053097 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4bb718c6-1721-4c16-bee9-e676dbe7ea4b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:14.054579 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4bb718c6-1721-4c16-bee9-e676dbe7ea4b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:14.056263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4bb718c6-1721-4c16-bee9-e676dbe7ea4b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:14.058802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ef9e6073-2eb0-4006-9cf5-cb7d400e2775 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:14.060636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ef9e6073-2eb0-4006-9cf5-cb7d400e2775 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:14.062034 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ef9e6073-2eb0-4006-9cf5-cb7d400e2775 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1334 microversion: 2.57 time: 0.148556 May 27 15:22:14.063072 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2654/5309] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:13 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1334 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:14.210446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4bb718c6-1721-4c16-bee9-e676dbe7ea4b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:14.219293 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4bb718c6-1721-4c16-bee9-e676dbe7ea4b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.181138 May 27 15:22:14.220510 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2656/5310] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:14 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:14.236004 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1c5f21cb-2250-4919-b2d5-7ca7a6abcbae tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:14.237150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1c5f21cb-2250-4919-b2d5-7ca7a6abcbae tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:14.245303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1c5f21cb-2250-4919-b2d5-7ca7a6abcbae tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:14.246048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1c5f21cb-2250-4919-b2d5-7ca7a6abcbae tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:14.247055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1c5f21cb-2250-4919-b2d5-7ca7a6abcbae tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:14.247764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1c5f21cb-2250-4919-b2d5-7ca7a6abcbae tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:14.410930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1c5f21cb-2250-4919-b2d5-7ca7a6abcbae tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:14.421021 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1c5f21cb-2250-4919-b2d5-7ca7a6abcbae tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.188847 May 27 15:22:14.437647 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2655/5311] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:14 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:14.567666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b7190df0-e3a0-496d-88b1-761c70023d89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1156259728", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "2accc000-a1ee-4371-bdb5-4490822eb578"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:14.630403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-b7190df0-e3a0-496d-88b1-761c70023d89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] validate_networks() for [('2accc000-a1ee-4371-bdb5-4490822eb578', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:22:15.084837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-347e5479-948b-4310-a970-fe9b2f67c2d3 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:15.086335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-347e5479-948b-4310-a970-fe9b2f67c2d3 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:15.099634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-347e5479-948b-4310-a970-fe9b2f67c2d3 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:15.101863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-347e5479-948b-4310-a970-fe9b2f67c2d3 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:15.103687 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-347e5479-948b-4310-a970-fe9b2f67c2d3 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:15.104503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-347e5479-948b-4310-a970-fe9b2f67c2d3 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:15.221376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-347e5479-948b-4310-a970-fe9b2f67c2d3 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:15.231980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-347e5479-948b-4310-a970-fe9b2f67c2d3 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:15.238847 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-347e5479-948b-4310-a970-fe9b2f67c2d3 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:15.240152 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-347e5479-948b-4310-a970-fe9b2f67c2d3 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1355 microversion: 2.57 time: 0.161502 May 27 15:22:15.245811 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2656/5312] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:15 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1355 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:15.260000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d231e9ea-2776-46ba-b507-bcab6f59efe9 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "346e776e-8931-417f-87da-575810efb12b"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:15.264857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d231e9ea-2776-46ba-b507-bcab6f59efe9 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:15.280925 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d231e9ea-2776-46ba-b507-bcab6f59efe9 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:15.282428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d231e9ea-2776-46ba-b507-bcab6f59efe9 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:15.284220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d231e9ea-2776-46ba-b507-bcab6f59efe9 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:15.293300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d231e9ea-2776-46ba-b507-bcab6f59efe9 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:15.309766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:15.464814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-d231e9ea-2776-46ba-b507-bcab6f59efe9 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:22:15.470575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-b7190df0-e3a0-496d-88b1-761c70023d89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:22:15.471173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-d231e9ea-2776-46ba-b507-bcab6f59efe9 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:22:15.471917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-b7190df0-e3a0-496d-88b1-761c70023d89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:22:15.472089 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-d231e9ea-2776-46ba-b507-bcab6f59efe9 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:22:15.472860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-b7190df0-e3a0-496d-88b1-761c70023d89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:22:15.473578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-b7190df0-e3a0-496d-88b1-761c70023d89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:22:15.474215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-b7190df0-e3a0-496d-88b1-761c70023d89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:22:15.474347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-d231e9ea-2776-46ba-b507-bcab6f59efe9 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:22:15.476230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-d231e9ea-2776-46ba-b507-bcab6f59efe9 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:22:15.487568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7190df0-e3a0-496d-88b1-761c70023d89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:15.488769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7190df0-e3a0-496d-88b1-761c70023d89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:15.489840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7190df0-e3a0-496d-88b1-761c70023d89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:15.490483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7190df0-e3a0-496d-88b1-761c70023d89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:15.515755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-b7190df0-e3a0-496d-88b1-761c70023d89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Getting quotas for project e72c782a808345e093093ea95ce04ae4. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:22:15.522907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-b7190df0-e3a0-496d-88b1-761c70023d89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Getting quotas for user f750b3f70eed4477a15c3529371a8af3 and project e72c782a808345e093093ea95ce04ae4. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:22:15.537847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:15.540281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b7190df0-e3a0-496d-88b1-761c70023d89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:22:15.543193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b7190df0-e3a0-496d-88b1-761c70023d89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:22:15.617460 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b7190df0-e3a0-496d-88b1-761c70023d89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.053200 May 27 15:22:15.628229 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2657/5313] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:22:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:22:15.632133 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d231e9ea-2776-46ba-b507-bcab6f59efe9 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:15.642734 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e1508ce6-0ab1-4ae0-b28e-314dfc0df5dd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:15.644282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e1508ce6-0ab1-4ae0-b28e-314dfc0df5dd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:15.647153 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d231e9ea-2776-46ba-b507-bcab6f59efe9 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:15.647710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d231e9ea-2776-46ba-b507-bcab6f59efe9 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:15.649450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d231e9ea-2776-46ba-b507-bcab6f59efe9 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:15.649951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d231e9ea-2776-46ba-b507-bcab6f59efe9 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:15.756809 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e1508ce6-0ab1-4ae0-b28e-314dfc0df5dd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:15.765449 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d231e9ea-2776-46ba-b507-bcab6f59efe9 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "POST /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff/action" status: 202 len: 1136 microversion: 2.57 time: 0.509918 May 27 15:22:15.767821 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e1508ce6-0ab1-4ae0-b28e-314dfc0df5dd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1215 microversion: 2.1 time: 0.137627 May 27 15:22:15.769651 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2657/5314] 10.222.0.13 () {62 vars in 1319 bytes} [Fri May 27 15:22:15 2022] POST /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff/action => generated 1136 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) May 27 15:22:15.771336 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2658/5315] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:15 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1215 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:15.807425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8bc51371-b10d-4adf-a13a-b051a718657b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:15.808085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8bc51371-b10d-4adf-a13a-b051a718657b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:15.825437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8bc51371-b10d-4adf-a13a-b051a718657b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:15.825905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8bc51371-b10d-4adf-a13a-b051a718657b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:15.829141 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8bc51371-b10d-4adf-a13a-b051a718657b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:15.830017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8bc51371-b10d-4adf-a13a-b051a718657b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:15.952785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8bc51371-b10d-4adf-a13a-b051a718657b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:15.969773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8bc51371-b10d-4adf-a13a-b051a718657b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:15.972352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8bc51371-b10d-4adf-a13a-b051a718657b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:15.973870 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8bc51371-b10d-4adf-a13a-b051a718657b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.188043 May 27 15:22:15.988454 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2658/5316] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:15 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:16.788276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3d2c13e4-8971-4496-a431-16ce631e2951 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:16.788939 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3d2c13e4-8971-4496-a431-16ce631e2951 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:16.802639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d2c13e4-8971-4496-a431-16ce631e2951 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:16.803099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d2c13e4-8971-4496-a431-16ce631e2951 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:16.803887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d2c13e4-8971-4496-a431-16ce631e2951 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:16.808405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d2c13e4-8971-4496-a431-16ce631e2951 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:16.884006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3d2c13e4-8971-4496-a431-16ce631e2951 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:16.894303 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3d2c13e4-8971-4496-a431-16ce631e2951 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1267 microversion: 2.1 time: 0.110546 May 27 15:22:16.896545 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2659/5317] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:16 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1267 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:16.995624 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-730d60e2-fa86-4fe0-aad7-a12021d3c949 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:16.996262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-730d60e2-fa86-4fe0-aad7-a12021d3c949 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:17.012155 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-730d60e2-fa86-4fe0-aad7-a12021d3c949 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:17.012555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-730d60e2-fa86-4fe0-aad7-a12021d3c949 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:17.013391 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-730d60e2-fa86-4fe0-aad7-a12021d3c949 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:17.013844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-730d60e2-fa86-4fe0-aad7-a12021d3c949 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:17.136387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-730d60e2-fa86-4fe0-aad7-a12021d3c949 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:17.146180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-730d60e2-fa86-4fe0-aad7-a12021d3c949 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:17.150478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-730d60e2-fa86-4fe0-aad7-a12021d3c949 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:17.152023 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-730d60e2-fa86-4fe0-aad7-a12021d3c949 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.160517 May 27 15:22:17.162537 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2659/5318] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:16 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:17.913178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8bc09ceb-53d6-426f-b625-99f807cd9ea9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:17.913807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8bc09ceb-53d6-426f-b625-99f807cd9ea9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:17.938468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8bc09ceb-53d6-426f-b625-99f807cd9ea9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:17.938933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8bc09ceb-53d6-426f-b625-99f807cd9ea9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:17.939740 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8bc09ceb-53d6-426f-b625-99f807cd9ea9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:17.940188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8bc09ceb-53d6-426f-b625-99f807cd9ea9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:17.953089 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:18.093055 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8bc09ceb-53d6-426f-b625-99f807cd9ea9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:18.104602 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8bc09ceb-53d6-426f-b625-99f807cd9ea9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1273 microversion: 2.1 time: 0.195202 May 27 15:22:18.105237 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2660/5319] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:17 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1273 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:18.172808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-277e4f99-65ae-45c3-86cd-0dd835f4cba8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:18.173445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-277e4f99-65ae-45c3-86cd-0dd835f4cba8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:18.187412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-277e4f99-65ae-45c3-86cd-0dd835f4cba8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:18.195412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-277e4f99-65ae-45c3-86cd-0dd835f4cba8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:18.197368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-277e4f99-65ae-45c3-86cd-0dd835f4cba8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:18.197841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-277e4f99-65ae-45c3-86cd-0dd835f4cba8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:18.331370 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-277e4f99-65ae-45c3-86cd-0dd835f4cba8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:18.342277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-277e4f99-65ae-45c3-86cd-0dd835f4cba8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:18.346931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-277e4f99-65ae-45c3-86cd-0dd835f4cba8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:18.352598 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-277e4f99-65ae-45c3-86cd-0dd835f4cba8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.185250 May 27 15:22:18.353780 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2660/5320] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:18 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:19.123006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a3f2882b-7eaa-41ca-9d36-c912caaeb3ac tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:19.133776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a3f2882b-7eaa-41ca-9d36-c912caaeb3ac tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:19.151073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3f2882b-7eaa-41ca-9d36-c912caaeb3ac tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:19.151664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3f2882b-7eaa-41ca-9d36-c912caaeb3ac tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:19.152910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3f2882b-7eaa-41ca-9d36-c912caaeb3ac tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:19.153483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3f2882b-7eaa-41ca-9d36-c912caaeb3ac tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:19.378086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6cb9ad27-155d-4acf-ab38-2f9ab6bbef5b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:19.378734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6cb9ad27-155d-4acf-ab38-2f9ab6bbef5b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:19.392544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:19.410862 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6cb9ad27-155d-4acf-ab38-2f9ab6bbef5b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:19.411731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6cb9ad27-155d-4acf-ab38-2f9ab6bbef5b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:19.418012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6cb9ad27-155d-4acf-ab38-2f9ab6bbef5b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:19.420289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6cb9ad27-155d-4acf-ab38-2f9ab6bbef5b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:19.608434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6cb9ad27-155d-4acf-ab38-2f9ab6bbef5b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:19.624356 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6cb9ad27-155d-4acf-ab38-2f9ab6bbef5b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:19.626034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6cb9ad27-155d-4acf-ab38-2f9ab6bbef5b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:19.627292 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6cb9ad27-155d-4acf-ab38-2f9ab6bbef5b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.258992 May 27 15:22:19.633248 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2661/5321] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:19 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:19.669146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a3f2882b-7eaa-41ca-9d36-c912caaeb3ac tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:19.677361 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a3f2882b-7eaa-41ca-9d36-c912caaeb3ac tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1315 microversion: 2.1 time: 0.559576 May 27 15:22:19.678733 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2661/5322] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:19 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:20.652996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eee63768-903c-42f9-87df-f5a8c152848b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:20.653791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-eee63768-903c-42f9-87df-f5a8c152848b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:20.674410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eee63768-903c-42f9-87df-f5a8c152848b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:20.674881 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eee63768-903c-42f9-87df-f5a8c152848b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:20.681494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eee63768-903c-42f9-87df-f5a8c152848b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:20.681995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eee63768-903c-42f9-87df-f5a8c152848b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:20.695495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3a8d5982-4862-485e-9252-e2b71afbd63b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:20.697012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3a8d5982-4862-485e-9252-e2b71afbd63b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:20.716017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a8d5982-4862-485e-9252-e2b71afbd63b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:20.717369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a8d5982-4862-485e-9252-e2b71afbd63b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:20.721012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a8d5982-4862-485e-9252-e2b71afbd63b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:20.726302 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a8d5982-4862-485e-9252-e2b71afbd63b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:21.180082 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3a8d5982-4862-485e-9252-e2b71afbd63b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:21.223068 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3a8d5982-4862-485e-9252-e2b71afbd63b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1315 microversion: 2.1 time: 0.532010 May 27 15:22:21.223888 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2662/5323] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:20 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:21.259984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eee63768-903c-42f9-87df-f5a8c152848b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:21.271647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eee63768-903c-42f9-87df-f5a8c152848b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:21.279607 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eee63768-903c-42f9-87df-f5a8c152848b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:21.281048 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-eee63768-903c-42f9-87df-f5a8c152848b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.632905 May 27 15:22:21.287734 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2662/5324] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:20 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:21.774640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-99bb5c82-dde9-46bd-aac2-facf28266acd req-e9b83b38-3c0e-4f3f-89b6-c2164ed08ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d91e4fed-5552-40e8-842c-20a685a81620", "tag": "6148066f-0357-4dd8-a86a-82427e608d1a"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:21.820433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-99bb5c82-dde9-46bd-aac2-facf28266acd req-e9b83b38-3c0e-4f3f-89b6-c2164ed08ce3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:21.828418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-99bb5c82-dde9-46bd-aac2-facf28266acd req-e9b83b38-3c0e-4f3f-89b6-c2164ed08ce3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:21.869616 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-99bb5c82-dde9-46bd-aac2-facf28266acd req-e9b83b38-3c0e-4f3f-89b6-c2164ed08ce3 service nova] Creating event network-changed:6148066f-0357-4dd8-a86a-82427e608d1a for instance d91e4fed-5552-40e8-842c-20a685a81620 on n-h2-843621-1 May 27 15:22:21.897754 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-99bb5c82-dde9-46bd-aac2-facf28266acd req-e9b83b38-3c0e-4f3f-89b6-c2164ed08ce3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131089 May 27 15:22:21.898557 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2663/5325] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:22.240918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-11635853-5876-4e3a-96f6-65370601289e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:22.241552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-11635853-5876-4e3a-96f6-65370601289e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:22.251848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-11635853-5876-4e3a-96f6-65370601289e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:22.252318 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-11635853-5876-4e3a-96f6-65370601289e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:22.253154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-11635853-5876-4e3a-96f6-65370601289e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:22.253610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-11635853-5876-4e3a-96f6-65370601289e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:22.306879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0677361d-78cf-4fb7-8fb3-e7909739cd73 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:22.307596 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0677361d-78cf-4fb7-8fb3-e7909739cd73 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:22.331006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0677361d-78cf-4fb7-8fb3-e7909739cd73 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:22.331474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0677361d-78cf-4fb7-8fb3-e7909739cd73 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:22.332275 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0677361d-78cf-4fb7-8fb3-e7909739cd73 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:22.332748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0677361d-78cf-4fb7-8fb3-e7909739cd73 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:22.556200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0677361d-78cf-4fb7-8fb3-e7909739cd73 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:22.573605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0677361d-78cf-4fb7-8fb3-e7909739cd73 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:22.575183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0677361d-78cf-4fb7-8fb3-e7909739cd73 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:22.576437 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0677361d-78cf-4fb7-8fb3-e7909739cd73 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.273883 May 27 15:22:22.589066 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2664/5326] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:22 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:22:22.695625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-11635853-5876-4e3a-96f6-65370601289e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:22.705709 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-11635853-5876-4e3a-96f6-65370601289e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1315 microversion: 2.1 time: 0.468643 May 27 15:22:22.706300 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2663/5327] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:22 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:23.595629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5c70b988-eefb-45ea-a9dd-c8502dd7c74a tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:23.596252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5c70b988-eefb-45ea-a9dd-c8502dd7c74a tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:23.603789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c70b988-eefb-45ea-a9dd-c8502dd7c74a tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:23.604480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c70b988-eefb-45ea-a9dd-c8502dd7c74a tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:23.605464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c70b988-eefb-45ea-a9dd-c8502dd7c74a tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:23.606074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c70b988-eefb-45ea-a9dd-c8502dd7c74a tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:23.694796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5c70b988-eefb-45ea-a9dd-c8502dd7c74a tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:23.710896 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5c70b988-eefb-45ea-a9dd-c8502dd7c74a tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:23.713320 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5c70b988-eefb-45ea-a9dd-c8502dd7c74a tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:23.723898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c710a8a3-9abd-47fc-85cd-9cc0d12606fa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:23.730437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c710a8a3-9abd-47fc-85cd-9cc0d12606fa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:23.739321 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5c70b988-eefb-45ea-a9dd-c8502dd7c74a tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.147420 May 27 15:22:23.743408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c710a8a3-9abd-47fc-85cd-9cc0d12606fa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:23.744374 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2665/5328] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:23 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:23.745124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c710a8a3-9abd-47fc-85cd-9cc0d12606fa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:23.746150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c710a8a3-9abd-47fc-85cd-9cc0d12606fa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:23.746810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c710a8a3-9abd-47fc-85cd-9cc0d12606fa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:24.010264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c710a8a3-9abd-47fc-85cd-9cc0d12606fa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:24.021701 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c710a8a3-9abd-47fc-85cd-9cc0d12606fa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1315 microversion: 2.1 time: 0.302428 May 27 15:22:24.023664 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2664/5329] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:23 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:24.765626 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dcbde5a7-9e18-4a35-8e40-c4e394d85e50 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:24.767340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dcbde5a7-9e18-4a35-8e40-c4e394d85e50 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:24.782068 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dcbde5a7-9e18-4a35-8e40-c4e394d85e50 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:24.782539 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dcbde5a7-9e18-4a35-8e40-c4e394d85e50 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:24.783331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dcbde5a7-9e18-4a35-8e40-c4e394d85e50 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:24.786350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dcbde5a7-9e18-4a35-8e40-c4e394d85e50 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:24.913109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dcbde5a7-9e18-4a35-8e40-c4e394d85e50 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:24.925958 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dcbde5a7-9e18-4a35-8e40-c4e394d85e50 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:24.925958 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dcbde5a7-9e18-4a35-8e40-c4e394d85e50 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:24.926611 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dcbde5a7-9e18-4a35-8e40-c4e394d85e50 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.164836 May 27 15:22:24.927733 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2666/5330] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:24 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:25.040508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-befa37c1-a15b-43e5-8db7-6e2b1862bbb9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:25.042176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-befa37c1-a15b-43e5-8db7-6e2b1862bbb9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:25.052660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-befa37c1-a15b-43e5-8db7-6e2b1862bbb9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:25.053538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-befa37c1-a15b-43e5-8db7-6e2b1862bbb9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:25.054932 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-befa37c1-a15b-43e5-8db7-6e2b1862bbb9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:25.056137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-befa37c1-a15b-43e5-8db7-6e2b1862bbb9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:25.330883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-befa37c1-a15b-43e5-8db7-6e2b1862bbb9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:25.344429 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-befa37c1-a15b-43e5-8db7-6e2b1862bbb9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1315 microversion: 2.1 time: 0.308765 May 27 15:22:25.346101 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2665/5331] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:25 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:25.946657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ffd74a0f-a253-4e31-8a96-59588dc16bdf tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:25.947295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ffd74a0f-a253-4e31-8a96-59588dc16bdf tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:25.952355 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:25.953683 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=14 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:25.957040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ffd74a0f-a253-4e31-8a96-59588dc16bdf tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:25.957696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ffd74a0f-a253-4e31-8a96-59588dc16bdf tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:25.959599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ffd74a0f-a253-4e31-8a96-59588dc16bdf tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:25.960296 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ffd74a0f-a253-4e31-8a96-59588dc16bdf tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:26.072981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ffd74a0f-a253-4e31-8a96-59588dc16bdf tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:26.088055 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ffd74a0f-a253-4e31-8a96-59588dc16bdf tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:26.090461 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ffd74a0f-a253-4e31-8a96-59588dc16bdf tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:26.092092 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ffd74a0f-a253-4e31-8a96-59588dc16bdf tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.149755 May 27 15:22:26.093588 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2667/5332] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:25 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:26.361650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-55c6064e-a957-4937-a07f-f96225fd0bab tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:26.362267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-55c6064e-a957-4937-a07f-f96225fd0bab tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:26.375297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55c6064e-a957-4937-a07f-f96225fd0bab tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:26.375759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55c6064e-a957-4937-a07f-f96225fd0bab tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:26.376782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55c6064e-a957-4937-a07f-f96225fd0bab tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:26.377389 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55c6064e-a957-4937-a07f-f96225fd0bab tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:26.600523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-55c6064e-a957-4937-a07f-f96225fd0bab tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:26.609880 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-55c6064e-a957-4937-a07f-f96225fd0bab tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1315 microversion: 2.1 time: 0.252077 May 27 15:22:26.610485 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2666/5333] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:26 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:27.063555 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-20efd6ea-baac-4513-a3fb-b9accb18dea0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:27.065349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-20efd6ea-baac-4513-a3fb-b9accb18dea0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:27.084242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20efd6ea-baac-4513-a3fb-b9accb18dea0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:27.087554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20efd6ea-baac-4513-a3fb-b9accb18dea0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:27.089518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20efd6ea-baac-4513-a3fb-b9accb18dea0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:27.091495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-20efd6ea-baac-4513-a3fb-b9accb18dea0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:27.112745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fcf5800c-4d25-44e5-9583-640f13d96113 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:27.113773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fcf5800c-4d25-44e5-9583-640f13d96113 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:27.120457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fcf5800c-4d25-44e5-9583-640f13d96113 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:27.128998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fcf5800c-4d25-44e5-9583-640f13d96113 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:27.132036 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fcf5800c-4d25-44e5-9583-640f13d96113 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:27.135377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fcf5800c-4d25-44e5-9583-640f13d96113 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:27.204259 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-20efd6ea-baac-4513-a3fb-b9accb18dea0 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.145069 May 27 15:22:27.210255 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2668/5334] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:22:27 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments => generated 25 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:22:27.296858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fcf5800c-4d25-44e5-9583-640f13d96113 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:27.318707 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fcf5800c-4d25-44e5-9583-640f13d96113 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:27.327726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fcf5800c-4d25-44e5-9583-640f13d96113 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:27.330814 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fcf5800c-4d25-44e5-9583-640f13d96113 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.221958 May 27 15:22:27.335205 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2667/5335] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:27 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:27.404417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cd1a4408-9281-4375-a1ef-2b91b52745af tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:27.405895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cd1a4408-9281-4375-a1ef-2b91b52745af tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:27.416207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cd1a4408-9281-4375-a1ef-2b91b52745af tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:27.436055 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cd1a4408-9281-4375-a1ef-2b91b52745af tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:27.437323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cd1a4408-9281-4375-a1ef-2b91b52745af tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:27.439154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cd1a4408-9281-4375-a1ef-2b91b52745af tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:27.529048 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cd1a4408-9281-4375-a1ef-2b91b52745af tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.128520 May 27 15:22:27.537536 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2669/5336] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:22:27 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295/os-volume_attachments => generated 25 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:22:27.628131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e2aeba1e-5e39-4352-9421-ac3f9a32c6a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:27.628751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e2aeba1e-5e39-4352-9421-ac3f9a32c6a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:27.645486 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f92227ba-5c11-4493-9632-be3d5c6986ea tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:27.645961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f92227ba-5c11-4493-9632-be3d5c6986ea tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:27.647132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2aeba1e-5e39-4352-9421-ac3f9a32c6a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:27.647510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2aeba1e-5e39-4352-9421-ac3f9a32c6a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:27.648322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2aeba1e-5e39-4352-9421-ac3f9a32c6a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:27.648814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2aeba1e-5e39-4352-9421-ac3f9a32c6a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:27.654311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f92227ba-5c11-4493-9632-be3d5c6986ea tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:27.655055 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f92227ba-5c11-4493-9632-be3d5c6986ea tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:27.656091 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f92227ba-5c11-4493-9632-be3d5c6986ea tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:27.656788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f92227ba-5c11-4493-9632-be3d5c6986ea tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:27.686046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f92227ba-5c11-4493-9632-be3d5c6986ea tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:22:27.809465 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f92227ba-5c11-4493-9632-be3d5c6986ea tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 204 len: 0 microversion: 2.1 time: 0.168726 May 27 15:22:27.815543 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2670/5337] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:22:27 2022] DELETE /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:22:27.822494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4f5ec08f-9657-4b56-8ed5-3bb5efbdc64c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:27.823956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4f5ec08f-9657-4b56-8ed5-3bb5efbdc64c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:27.833921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f5ec08f-9657-4b56-8ed5-3bb5efbdc64c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:27.834750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f5ec08f-9657-4b56-8ed5-3bb5efbdc64c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:27.837809 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f5ec08f-9657-4b56-8ed5-3bb5efbdc64c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:27.839378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f5ec08f-9657-4b56-8ed5-3bb5efbdc64c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:28.140234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e2aeba1e-5e39-4352-9421-ac3f9a32c6a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:28.149137 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e2aeba1e-5e39-4352-9421-ac3f9a32c6a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1315 microversion: 2.1 time: 0.525392 May 27 15:22:28.150357 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2668/5338] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:27 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1315 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:22:28.350028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-45045fa0-b895-402d-8df1-c43747d7b039 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:28.350660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-45045fa0-b895-402d-8df1-c43747d7b039 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:28.361309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45045fa0-b895-402d-8df1-c43747d7b039 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:28.362316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45045fa0-b895-402d-8df1-c43747d7b039 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:28.363343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45045fa0-b895-402d-8df1-c43747d7b039 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:28.364022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45045fa0-b895-402d-8df1-c43747d7b039 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:28.502517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-45045fa0-b895-402d-8df1-c43747d7b039 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:28.512066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-45045fa0-b895-402d-8df1-c43747d7b039 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:28.514041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-45045fa0-b895-402d-8df1-c43747d7b039 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:28.515535 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-45045fa0-b895-402d-8df1-c43747d7b039 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.169649 May 27 15:22:28.516700 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2669/5339] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:28 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:22:28.569326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4f5ec08f-9657-4b56-8ed5-3bb5efbdc64c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:28.582262 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4f5ec08f-9657-4b56-8ed5-3bb5efbdc64c tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 200 len: 1674 microversion: 2.1 time: 0.764399 May 27 15:22:28.584108 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2671/5340] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:27 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 1674 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:28.650499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-af6dfb25-029c-4837-b192-252f79193cbc req-85fa13b5-ca1d-47c2-bee8-cd57515f6109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91e4fed-5552-40e8-842c-20a685a81620", "name": "network-vif-plugged", "status": "completed", "tag": "6148066f-0357-4dd8-a86a-82427e608d1a"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:28.663726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-af6dfb25-029c-4837-b192-252f79193cbc req-85fa13b5-ca1d-47c2-bee8-cd57515f6109 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:28.664247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-af6dfb25-029c-4837-b192-252f79193cbc req-85fa13b5-ca1d-47c2-bee8-cd57515f6109 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:28.680184 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-af6dfb25-029c-4837-b192-252f79193cbc req-85fa13b5-ca1d-47c2-bee8-cd57515f6109 service nova] Creating event network-vif-plugged:6148066f-0357-4dd8-a86a-82427e608d1a for instance d91e4fed-5552-40e8-842c-20a685a81620 on n-h2-843621-1 May 27 15:22:28.697208 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-af6dfb25-029c-4837-b192-252f79193cbc req-85fa13b5-ca1d-47c2-bee8-cd57515f6109 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053223 May 27 15:22:28.699011 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2670/5341] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:29.170644 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-57e94b4a-49be-4c12-a58a-f3c7ad419bb6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:29.171535 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-57e94b4a-49be-4c12-a58a-f3c7ad419bb6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:29.199684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57e94b4a-49be-4c12-a58a-f3c7ad419bb6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:29.202155 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57e94b4a-49be-4c12-a58a-f3c7ad419bb6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:29.203593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57e94b4a-49be-4c12-a58a-f3c7ad419bb6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:29.204217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57e94b4a-49be-4c12-a58a-f3c7ad419bb6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:29.536604 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4844cc6a-fe5b-4dc4-9118-5b0d98c73b25 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:29.537357 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4844cc6a-fe5b-4dc4-9118-5b0d98c73b25 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:29.556149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:29.558241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4844cc6a-fe5b-4dc4-9118-5b0d98c73b25 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:29.558880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4844cc6a-fe5b-4dc4-9118-5b0d98c73b25 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:29.562073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4844cc6a-fe5b-4dc4-9118-5b0d98c73b25 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:29.562692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4844cc6a-fe5b-4dc4-9118-5b0d98c73b25 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:29.759688 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4844cc6a-fe5b-4dc4-9118-5b0d98c73b25 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:29.774726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4844cc6a-fe5b-4dc4-9118-5b0d98c73b25 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:29.782139 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-57e94b4a-49be-4c12-a58a-f3c7ad419bb6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:29.792760 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-57e94b4a-49be-4c12-a58a-f3c7ad419bb6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1315 microversion: 2.1 time: 0.630455 May 27 15:22:29.793348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4844cc6a-fe5b-4dc4-9118-5b0d98c73b25 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:29.796746 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4844cc6a-fe5b-4dc4-9118-5b0d98c73b25 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.264585 May 27 15:22:29.799505 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2672/5342] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:29 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:29.801691 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2671/5343] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:29 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:29.819955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c1176ec9-1676-4640-8bac-101eddad781a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:29.822792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c1176ec9-1676-4640-8bac-101eddad781a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:29.834002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1176ec9-1676-4640-8bac-101eddad781a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:29.834465 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1176ec9-1676-4640-8bac-101eddad781a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:29.837980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1176ec9-1676-4640-8bac-101eddad781a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:29.839569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1176ec9-1676-4640-8bac-101eddad781a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:30.597465 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c1176ec9-1676-4640-8bac-101eddad781a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:30.632953 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c1176ec9-1676-4640-8bac-101eddad781a tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 200 len: 1674 microversion: 2.1 time: 0.832123 May 27 15:22:30.635470 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2673/5344] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:29 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 1674 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:30.815346 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4ceccab6-e2b5-4068-9c1a-2b569dc8bcaa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:30.831264 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e3a6f41b-e9fb-4969-b724-3017e1b9d11c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:30.833107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e3a6f41b-e9fb-4969-b724-3017e1b9d11c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:30.833803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4ceccab6-e2b5-4068-9c1a-2b569dc8bcaa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:30.846853 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3a6f41b-e9fb-4969-b724-3017e1b9d11c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:30.851391 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ceccab6-e2b5-4068-9c1a-2b569dc8bcaa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:30.853357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3a6f41b-e9fb-4969-b724-3017e1b9d11c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:30.855009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3a6f41b-e9fb-4969-b724-3017e1b9d11c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:30.858522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ceccab6-e2b5-4068-9c1a-2b569dc8bcaa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:30.865350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3a6f41b-e9fb-4969-b724-3017e1b9d11c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:30.866553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ceccab6-e2b5-4068-9c1a-2b569dc8bcaa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:30.869271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ceccab6-e2b5-4068-9c1a-2b569dc8bcaa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:30.968822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:31.184040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e3a6f41b-e9fb-4969-b724-3017e1b9d11c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:31.223514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e3a6f41b-e9fb-4969-b724-3017e1b9d11c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:31.226571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e3a6f41b-e9fb-4969-b724-3017e1b9d11c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:31.229062 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e3a6f41b-e9fb-4969-b724-3017e1b9d11c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.409012 May 27 15:22:31.234174 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2674/5345] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:30 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:22:31.486735 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4ceccab6-e2b5-4068-9c1a-2b569dc8bcaa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:31.498415 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4ceccab6-e2b5-4068-9c1a-2b569dc8bcaa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1503 microversion: 2.1 time: 0.690389 May 27 15:22:31.503847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-d927f63c-2b54-49ec-a4db-5f7376f33bd6 req-417b0ad0-2fc5-4e24-9b1f-d5f3a4ee7838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cc72e17-205e-4e7f-aefe-17a244443295", "name": "network-vif-deleted", "tag": "f9ce40a9-a844-4d2e-af96-330750459ac3"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:31.505946 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2672/5346] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:30 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1503 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:31.522618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e3a06c31-f7b3-470b-b508-975e4c4646a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:31.522974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d927f63c-2b54-49ec-a4db-5f7376f33bd6 req-417b0ad0-2fc5-4e24-9b1f-d5f3a4ee7838 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:31.523547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d927f63c-2b54-49ec-a4db-5f7376f33bd6 req-417b0ad0-2fc5-4e24-9b1f-d5f3a4ee7838 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:31.547696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3a06c31-f7b3-470b-b508-975e4c4646a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:31.550919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3a06c31-f7b3-470b-b508-975e4c4646a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:31.553061 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-d927f63c-2b54-49ec-a4db-5f7376f33bd6 req-417b0ad0-2fc5-4e24-9b1f-d5f3a4ee7838 service nova] Creating event network-vif-deleted:f9ce40a9-a844-4d2e-af96-330750459ac3 for instance 9cc72e17-205e-4e7f-aefe-17a244443295 on n-h2-843621-1 May 27 15:22:31.565805 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-d927f63c-2b54-49ec-a4db-5f7376f33bd6 req-417b0ad0-2fc5-4e24-9b1f-d5f3a4ee7838 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063058 May 27 15:22:31.567749 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2675/5347] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:22:31.644472 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e3a06c31-f7b3-470b-b508-975e4c4646a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Going to try to stop instance {{(pid=119248) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 15:22:31.653458 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e90e25e5-cd58-46c8-b043-e60b4ff78d6d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:31.654164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e90e25e5-cd58-46c8-b043-e60b4ff78d6d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:31.671362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e90e25e5-cd58-46c8-b043-e60b4ff78d6d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:31.671935 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e90e25e5-cd58-46c8-b043-e60b4ff78d6d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:31.673985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e90e25e5-cd58-46c8-b043-e60b4ff78d6d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:31.676373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e90e25e5-cd58-46c8-b043-e60b4ff78d6d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:31.715133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:31.738203 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e3a06c31-f7b3-470b-b508-975e4c4646a0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620/action" status: 202 len: 0 microversion: 2.1 time: 0.219316 May 27 15:22:31.739476 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2673/5348] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:22:31 2022] POST /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:22:31.750446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f72d25d3-c964-4b70-8408-2731cc807520 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:31.752171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f72d25d3-c964-4b70-8408-2731cc807520 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:31.760112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f72d25d3-c964-4b70-8408-2731cc807520 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:31.761496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f72d25d3-c964-4b70-8408-2731cc807520 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:31.765485 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f72d25d3-c964-4b70-8408-2731cc807520 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:31.766346 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f72d25d3-c964-4b70-8408-2731cc807520 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:31.868844 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e90e25e5-cd58-46c8-b043-e60b4ff78d6d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fdf02b03cac44cb89d2cf3b373fb9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73054e8eb659476bb30aa574d7251758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:31.883208 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e90e25e5-cd58-46c8-b043-e60b4ff78d6d tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 200 len: 1322 microversion: 2.1 time: 0.233992 May 27 15:22:31.884902 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2676/5349] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:31 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:32.253225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3e64cf96-9eed-4c90-8581-2ab9250bbf28 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:32.253921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3e64cf96-9eed-4c90-8581-2ab9250bbf28 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:32.273157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e64cf96-9eed-4c90-8581-2ab9250bbf28 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:32.273625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e64cf96-9eed-4c90-8581-2ab9250bbf28 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:32.275016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e64cf96-9eed-4c90-8581-2ab9250bbf28 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:32.275473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e64cf96-9eed-4c90-8581-2ab9250bbf28 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:32.457363 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3e64cf96-9eed-4c90-8581-2ab9250bbf28 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:32.473773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f72d25d3-c964-4b70-8408-2731cc807520 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:32.475838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3e64cf96-9eed-4c90-8581-2ab9250bbf28 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:32.480287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3e64cf96-9eed-4c90-8581-2ab9250bbf28 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:32.483261 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3e64cf96-9eed-4c90-8581-2ab9250bbf28 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.234461 May 27 15:22:32.484859 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2677/5350] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:32 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:22:32.491256 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f72d25d3-c964-4b70-8408-2731cc807520 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1513 microversion: 2.1 time: 0.746710 May 27 15:22:32.492492 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2674/5351] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:31 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1513 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:32.903733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ee43696c-22f6-4179-8525-76308b62a973 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:32.905897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ee43696c-22f6-4179-8525-76308b62a973 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:32.916094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ee43696c-22f6-4179-8525-76308b62a973 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:32.917233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ee43696c-22f6-4179-8525-76308b62a973 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:32.918444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ee43696c-22f6-4179-8525-76308b62a973 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:32.919397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ee43696c-22f6-4179-8525-76308b62a973 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:32.944513 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-ee43696c-22f6-4179-8525-76308b62a973 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] HTTP exception thrown: Instance 9cc72e17-205e-4e7f-aefe-17a244443295 could not be found. May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ee43696c-22f6-4179-8525-76308b62a973 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Request method failure captured: May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 HTTP/1.1 May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOqO8KVR7bzq1xoLjXzLKv0jGOqOkF04cM8b_FyeHOV8wjUdo7LcGuyLc27U8rtMZ4Tx8DJ2dvOnNu1SxerG7uKkQJnKsTqpVjsMvJMqiMgOzvJ1G7GmmMLPDp1c3TCtYtsBkLf2gEtULm562ZhCKsQs-h_bvBej5OHYc34thW1M5ug May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 73054e8eb659476bb30aa574d7251758 May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-AttachVolumeTestJSON-528269557 May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/73054e8eb659476bb30aa574d7251758"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/73054e8eb659476bb30aa574d7251758"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/73054e8eb659476bb30aa574d7251758"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_73054e8eb659476bb30aa574d7251758", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-AttachVolumeTestJSON-528269557 May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 73054e8eb659476bb30aa574d7251758 May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-AttachVolumeTestJSON-528269557 May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-AttachVolumeTestJSON-528269557-project May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 6fdf02b03cac44cb89d2cf3b373fb9e1 May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-AttachVolumeTestJSON-528269557-project May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 9cc72e17-205e-4e7f-aefe-17a244443295 could not be found. May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '9cc72e17-205e-4e7f-aefe-17a244443295'} May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cc72e17-205e-4e7f-aefe-17a244443295 could not be found. May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cc72e17-205e-4e7f-aefe-17a244443295 could not be found. May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:32.947533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:32.953308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:32.953308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:32.953308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:32.953308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:22:32.953308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:22:32.953308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cc72e17-205e-4e7f-aefe-17a244443295 could not be found. May 27 15:22:32.953308 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:32.956125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ee43696c-22f6-4179-8525-76308b62a973 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Returning 404 to user: Instance 9cc72e17-205e-4e7f-aefe-17a244443295 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:22:32.957857 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ee43696c-22f6-4179-8525-76308b62a973 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 404 len: 111 microversion: 2.1 time: 0.059844 May 27 15:22:32.959243 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2678/5352] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:32 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:22:32.973337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4a647792-454f-4760-9020-b7d3d4cbadd4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '.version_select at 0x7fc7765d3e50>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:33.011104 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4a647792-454f-4760-9020-b7d3d4cbadd4 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1316052880" status: 202 len: 0 microversion: 2.1 time: 0.046681 May 27 15:22:33.014169 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2675/5353] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 27 15:22:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1316052880 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:22:33.504215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-05496801-7e30-427f-a71d-628fcb9cb51e tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:33.505130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-05496801-7e30-427f-a71d-628fcb9cb51e tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:33.510407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8e09ade7-7155-4529-a4f8-dab862f2a182 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:33.512643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8e09ade7-7155-4529-a4f8-dab862f2a182 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:33.518567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05496801-7e30-427f-a71d-628fcb9cb51e tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:33.519038 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05496801-7e30-427f-a71d-628fcb9cb51e tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:33.519834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05496801-7e30-427f-a71d-628fcb9cb51e tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:33.525998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05496801-7e30-427f-a71d-628fcb9cb51e tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:33.533597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e09ade7-7155-4529-a4f8-dab862f2a182 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:33.537196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e09ade7-7155-4529-a4f8-dab862f2a182 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:33.538388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e09ade7-7155-4529-a4f8-dab862f2a182 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:33.539672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e09ade7-7155-4529-a4f8-dab862f2a182 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:33.675791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-05496801-7e30-427f-a71d-628fcb9cb51e tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:33.690074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-05496801-7e30-427f-a71d-628fcb9cb51e tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:33.693388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-05496801-7e30-427f-a71d-628fcb9cb51e tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:33.694621 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-05496801-7e30-427f-a71d-628fcb9cb51e tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.195773 May 27 15:22:33.699317 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2679/5354] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:33 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:34.034564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8e09ade7-7155-4529-a4f8-dab862f2a182 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:34.053226 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8e09ade7-7155-4529-a4f8-dab862f2a182 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1513 microversion: 2.1 time: 0.546972 May 27 15:22:34.055667 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2676/5355] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:33 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1513 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:34.719630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2e5030b8-29f2-4f1c-9e4a-083301e9d3f7 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:34.720901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2e5030b8-29f2-4f1c-9e4a-083301e9d3f7 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:34.736543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e5030b8-29f2-4f1c-9e4a-083301e9d3f7 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:34.737605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e5030b8-29f2-4f1c-9e4a-083301e9d3f7 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:34.739448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e5030b8-29f2-4f1c-9e4a-083301e9d3f7 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:34.740794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e5030b8-29f2-4f1c-9e4a-083301e9d3f7 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:34.904774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2e5030b8-29f2-4f1c-9e4a-083301e9d3f7 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:34.914256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2e5030b8-29f2-4f1c-9e4a-083301e9d3f7 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:34.916229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2e5030b8-29f2-4f1c-9e4a-083301e9d3f7 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:34.917781 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2e5030b8-29f2-4f1c-9e4a-083301e9d3f7 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.205002 May 27 15:22:34.918602 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2680/5356] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:34 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:35.076711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ca7c41a0-f78d-4575-80d4-cb3edf606a6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:35.077896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ca7c41a0-f78d-4575-80d4-cb3edf606a6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:35.110999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca7c41a0-f78d-4575-80d4-cb3edf606a6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:35.111475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca7c41a0-f78d-4575-80d4-cb3edf606a6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:35.112311 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca7c41a0-f78d-4575-80d4-cb3edf606a6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:35.112799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca7c41a0-f78d-4575-80d4-cb3edf606a6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:35.545772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ca7c41a0-f78d-4575-80d4-cb3edf606a6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:35.559117 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ca7c41a0-f78d-4575-80d4-cb3edf606a6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1513 microversion: 2.1 time: 0.490028 May 27 15:22:35.588915 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2677/5357] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:35 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1513 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:35.943429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-31d98eac-350f-40b4-9e24-b89cfc4dfed8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:35.944206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-31d98eac-350f-40b4-9e24-b89cfc4dfed8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:35.962728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-31d98eac-350f-40b4-9e24-b89cfc4dfed8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:35.963557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-31d98eac-350f-40b4-9e24-b89cfc4dfed8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:35.964622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-31d98eac-350f-40b4-9e24-b89cfc4dfed8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:35.965883 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-31d98eac-350f-40b4-9e24-b89cfc4dfed8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:36.546820 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-31d98eac-350f-40b4-9e24-b89cfc4dfed8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:36.567818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-31d98eac-350f-40b4-9e24-b89cfc4dfed8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:36.570022 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-31d98eac-350f-40b4-9e24-b89cfc4dfed8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:36.576790 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-31d98eac-350f-40b4-9e24-b89cfc4dfed8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.637419 May 27 15:22:36.578220 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2681/5358] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:35 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:36.589610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f809e2d1-3ed5-45a6-91d0-dd7ad9eb5a0f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:36.591906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f809e2d1-3ed5-45a6-91d0-dd7ad9eb5a0f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:36.612711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f809e2d1-3ed5-45a6-91d0-dd7ad9eb5a0f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:36.614143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f809e2d1-3ed5-45a6-91d0-dd7ad9eb5a0f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:36.616282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f809e2d1-3ed5-45a6-91d0-dd7ad9eb5a0f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:36.618209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f809e2d1-3ed5-45a6-91d0-dd7ad9eb5a0f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:37.162330 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f809e2d1-3ed5-45a6-91d0-dd7ad9eb5a0f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:37.179194 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f809e2d1-3ed5-45a6-91d0-dd7ad9eb5a0f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1513 microversion: 2.1 time: 0.593361 May 27 15:22:37.190587 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2678/5359] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:36 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1513 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:37.597642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a04d39dd-2018-4b47-8601-54c74de40270 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:37.599927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a04d39dd-2018-4b47-8601-54c74de40270 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:37.628295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a04d39dd-2018-4b47-8601-54c74de40270 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:37.630416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a04d39dd-2018-4b47-8601-54c74de40270 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:37.634549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a04d39dd-2018-4b47-8601-54c74de40270 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:37.638595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a04d39dd-2018-4b47-8601-54c74de40270 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:38.157624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a04d39dd-2018-4b47-8601-54c74de40270 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:38.175976 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a04d39dd-2018-4b47-8601-54c74de40270 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:38.181647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a04d39dd-2018-4b47-8601-54c74de40270 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:38.183194 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a04d39dd-2018-4b47-8601-54c74de40270 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.591244 May 27 15:22:38.184581 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2682/5360] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:37 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:38.207009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-06a1e9e8-fcc8-4694-ace1-669c54d376c3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:38.208493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-06a1e9e8-fcc8-4694-ace1-669c54d376c3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:38.228984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06a1e9e8-fcc8-4694-ace1-669c54d376c3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:38.231745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06a1e9e8-fcc8-4694-ace1-669c54d376c3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:38.239070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06a1e9e8-fcc8-4694-ace1-669c54d376c3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:38.240064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-06a1e9e8-fcc8-4694-ace1-669c54d376c3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:38.386965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9be0aea0-468a-458f-b39c-227072039326 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:38.387480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9be0aea0-468a-458f-b39c-227072039326 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:38.395422 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9be0aea0-468a-458f-b39c-227072039326 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:38.395821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9be0aea0-468a-458f-b39c-227072039326 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:38.397168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9be0aea0-468a-458f-b39c-227072039326 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:38.397827 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9be0aea0-468a-458f-b39c-227072039326 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:38.586897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-9be0aea0-468a-458f-b39c-227072039326 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lazy-loading 'services' on Instance uuid eb9b7c54-a210-490f-bf50-f6c1ece7ae55 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:22:38.826101 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9be0aea0-468a-458f-b39c-227072039326 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "DELETE /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments/7cc6102f-b517-49dd-aeca-6084cceb803a" status: 202 len: 0 microversion: 2.1 time: 0.424637 May 27 15:22:38.831328 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2683/5361] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 15:22:38 2022] DELETE /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments/7cc6102f-b517-49dd-aeca-6084cceb803a => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:22:38.861322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1a701bdd-398f-43fd-82ba-9c61089e4585 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:38.871526 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1a701bdd-398f-43fd-82ba-9c61089e4585 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:38.905733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a701bdd-398f-43fd-82ba-9c61089e4585 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:38.906205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a701bdd-398f-43fd-82ba-9c61089e4585 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:38.910161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a701bdd-398f-43fd-82ba-9c61089e4585 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:38.910702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a701bdd-398f-43fd-82ba-9c61089e4585 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:39.033965 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1a701bdd-398f-43fd-82ba-9c61089e4585 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188105 May 27 15:22:39.041189 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2684/5362] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:22:38 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:39.202160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fe4aae4c-4c5e-4836-8dc8-230aa88df4f6 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:39.204234 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fe4aae4c-4c5e-4836-8dc8-230aa88df4f6 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:39.228840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe4aae4c-4c5e-4836-8dc8-230aa88df4f6 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:39.229767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe4aae4c-4c5e-4836-8dc8-230aa88df4f6 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:39.235072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe4aae4c-4c5e-4836-8dc8-230aa88df4f6 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:39.237935 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe4aae4c-4c5e-4836-8dc8-230aa88df4f6 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:39.499837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fe4aae4c-4c5e-4836-8dc8-230aa88df4f6 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:39.515178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fe4aae4c-4c5e-4836-8dc8-230aa88df4f6 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:39.517292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fe4aae4c-4c5e-4836-8dc8-230aa88df4f6 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:39.522291 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fe4aae4c-4c5e-4836-8dc8-230aa88df4f6 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.323933 May 27 15:22:39.526607 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2685/5363] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:39 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:39.549160 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-06a1e9e8-fcc8-4694-ace1-669c54d376c3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:39.562835 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-06a1e9e8-fcc8-4694-ace1-669c54d376c3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1513 microversion: 2.1 time: 1.360123 May 27 15:22:39.567448 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2679/5364] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:38 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1513 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:40.048931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f87b11f5-9674-423a-a2bb-4f8ce8c4c0a7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:40.051362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f87b11f5-9674-423a-a2bb-4f8ce8c4c0a7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:40.068643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f87b11f5-9674-423a-a2bb-4f8ce8c4c0a7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:40.072085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f87b11f5-9674-423a-a2bb-4f8ce8c4c0a7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:40.078963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f87b11f5-9674-423a-a2bb-4f8ce8c4c0a7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:40.079879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f87b11f5-9674-423a-a2bb-4f8ce8c4c0a7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:40.160665 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f87b11f5-9674-423a-a2bb-4f8ce8c4c0a7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117525 May 27 15:22:40.170122 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2686/5365] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:22:40 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:40.546615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0bb8ba10-fa6c-4c7b-83a7-12cf8da6c478 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:40.548072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0bb8ba10-fa6c-4c7b-83a7-12cf8da6c478 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:40.564010 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bb8ba10-fa6c-4c7b-83a7-12cf8da6c478 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:40.564940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bb8ba10-fa6c-4c7b-83a7-12cf8da6c478 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:40.567377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bb8ba10-fa6c-4c7b-83a7-12cf8da6c478 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:40.569041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bb8ba10-fa6c-4c7b-83a7-12cf8da6c478 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:40.581683 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-64db8563-08a5-421b-8897-6a0feb27c7cc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:40.582963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-64db8563-08a5-421b-8897-6a0feb27c7cc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:40.594036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64db8563-08a5-421b-8897-6a0feb27c7cc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:40.595790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64db8563-08a5-421b-8897-6a0feb27c7cc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:40.599073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64db8563-08a5-421b-8897-6a0feb27c7cc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:40.599914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64db8563-08a5-421b-8897-6a0feb27c7cc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:40.790664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0bb8ba10-fa6c-4c7b-83a7-12cf8da6c478 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:40.806650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0bb8ba10-fa6c-4c7b-83a7-12cf8da6c478 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:40.808523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0bb8ba10-fa6c-4c7b-83a7-12cf8da6c478 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:40.811617 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0bb8ba10-fa6c-4c7b-83a7-12cf8da6c478 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.269320 May 27 15:22:40.815605 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2680/5366] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:40 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:40.986743 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-64db8563-08a5-421b-8897-6a0feb27c7cc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:41.000206 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-64db8563-08a5-421b-8897-6a0feb27c7cc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1513 microversion: 2.1 time: 0.422749 May 27 15:22:41.012522 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2687/5367] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:40 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1513 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:41.174894 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-02c8cdfd-3433-460e-b217-fca7bce7821e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:41.176135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-02c8cdfd-3433-460e-b217-fca7bce7821e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:41.191154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02c8cdfd-3433-460e-b217-fca7bce7821e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:41.192172 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02c8cdfd-3433-460e-b217-fca7bce7821e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:41.193355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02c8cdfd-3433-460e-b217-fca7bce7821e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:41.194117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02c8cdfd-3433-460e-b217-fca7bce7821e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:41.259199 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-02c8cdfd-3433-460e-b217-fca7bce7821e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087730 May 27 15:22:41.264571 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2681/5368] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:22:41 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:41.838441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-45b74b96-03f8-4d34-b677-cf0b007b0fbb tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:41.839180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-45b74b96-03f8-4d34-b677-cf0b007b0fbb tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:41.863287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45b74b96-03f8-4d34-b677-cf0b007b0fbb tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:41.863860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45b74b96-03f8-4d34-b677-cf0b007b0fbb tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:41.864777 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45b74b96-03f8-4d34-b677-cf0b007b0fbb tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:41.865302 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45b74b96-03f8-4d34-b677-cf0b007b0fbb tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:42.021508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c91a9767-c615-4c3a-ad92-be9c04738ec5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:42.022137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c91a9767-c615-4c3a-ad92-be9c04738ec5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:42.036590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c91a9767-c615-4c3a-ad92-be9c04738ec5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:42.043528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c91a9767-c615-4c3a-ad92-be9c04738ec5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:42.044375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c91a9767-c615-4c3a-ad92-be9c04738ec5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:42.048796 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c91a9767-c615-4c3a-ad92-be9c04738ec5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:42.158893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-45b74b96-03f8-4d34-b677-cf0b007b0fbb tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:42.180794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-45b74b96-03f8-4d34-b677-cf0b007b0fbb tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:42.190639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-45b74b96-03f8-4d34-b677-cf0b007b0fbb tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:42.202299 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-45b74b96-03f8-4d34-b677-cf0b007b0fbb tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.366871 May 27 15:22:42.203376 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2688/5369] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:41 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:22:42.271585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7e601d9d-0546-4320-a04f-2bf3a01d510f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:42.272962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7e601d9d-0546-4320-a04f-2bf3a01d510f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:42.285580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e601d9d-0546-4320-a04f-2bf3a01d510f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:42.288297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e601d9d-0546-4320-a04f-2bf3a01d510f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:42.289424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e601d9d-0546-4320-a04f-2bf3a01d510f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:42.292480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e601d9d-0546-4320-a04f-2bf3a01d510f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:42.396526 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7e601d9d-0546-4320-a04f-2bf3a01d510f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128835 May 27 15:22:42.400034 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2689/5370] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:22:42 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:22:42.600356 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c91a9767-c615-4c3a-ad92-be9c04738ec5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:42.612714 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c91a9767-c615-4c3a-ad92-be9c04738ec5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1513 microversion: 2.1 time: 0.595979 May 27 15:22:42.617022 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2682/5371] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:42 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1513 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:22:43.225183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-14ac5f29-823f-4177-a56e-a67d089fc660 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:43.229590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-14ac5f29-823f-4177-a56e-a67d089fc660 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:43.252581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14ac5f29-823f-4177-a56e-a67d089fc660 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:43.254980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14ac5f29-823f-4177-a56e-a67d089fc660 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:43.256092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14ac5f29-823f-4177-a56e-a67d089fc660 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:43.257677 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-14ac5f29-823f-4177-a56e-a67d089fc660 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:43.411909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d5dff89c-0d54-4c51-aa3f-a3057449b88e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:43.413019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d5dff89c-0d54-4c51-aa3f-a3057449b88e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:43.434937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5dff89c-0d54-4c51-aa3f-a3057449b88e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:43.435897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5dff89c-0d54-4c51-aa3f-a3057449b88e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:43.438022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5dff89c-0d54-4c51-aa3f-a3057449b88e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:43.442394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-14ac5f29-823f-4177-a56e-a67d089fc660 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:43.442801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5dff89c-0d54-4c51-aa3f-a3057449b88e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:43.464917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-14ac5f29-823f-4177-a56e-a67d089fc660 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:43.466863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-14ac5f29-823f-4177-a56e-a67d089fc660 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:43.475845 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-14ac5f29-823f-4177-a56e-a67d089fc660 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.255040 May 27 15:22:43.479724 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2690/5372] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:43 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:22:43.574147 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d5dff89c-0d54-4c51-aa3f-a3057449b88e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168245 May 27 15:22:43.578455 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2683/5373] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:22:43 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:43.634259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a9bd2118-9c43-49ee-9bdd-1c18dad3de6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:43.635049 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a9bd2118-9c43-49ee-9bdd-1c18dad3de6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:43.647881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a9bd2118-9c43-49ee-9bdd-1c18dad3de6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:43.648509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a9bd2118-9c43-49ee-9bdd-1c18dad3de6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:43.650159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a9bd2118-9c43-49ee-9bdd-1c18dad3de6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:43.650839 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a9bd2118-9c43-49ee-9bdd-1c18dad3de6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:44.088915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a9bd2118-9c43-49ee-9bdd-1c18dad3de6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:44.099008 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a9bd2118-9c43-49ee-9bdd-1c18dad3de6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1513 microversion: 2.1 time: 0.469252 May 27 15:22:44.102885 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2691/5374] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:43 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1513 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:44.510340 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cd7a2a78-bbe8-4cfd-8fb6-23ff97cb779c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:44.510973 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cd7a2a78-bbe8-4cfd-8fb6-23ff97cb779c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:44.542544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cd7a2a78-bbe8-4cfd-8fb6-23ff97cb779c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:44.543331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cd7a2a78-bbe8-4cfd-8fb6-23ff97cb779c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:44.544297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cd7a2a78-bbe8-4cfd-8fb6-23ff97cb779c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:44.551274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cd7a2a78-bbe8-4cfd-8fb6-23ff97cb779c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:44.592891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ee813d0f-61a9-4493-9e25-1a5c7ae43b6f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:44.594760 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ee813d0f-61a9-4493-9e25-1a5c7ae43b6f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:44.618014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ee813d0f-61a9-4493-9e25-1a5c7ae43b6f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:44.620199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ee813d0f-61a9-4493-9e25-1a5c7ae43b6f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:44.628808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ee813d0f-61a9-4493-9e25-1a5c7ae43b6f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:44.630722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ee813d0f-61a9-4493-9e25-1a5c7ae43b6f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:44.755772 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ee813d0f-61a9-4493-9e25-1a5c7ae43b6f tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170279 May 27 15:22:44.756728 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2692/5375] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:22:44 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:22:45.119733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-60adfe78-abe8-4bb9-ae39-bec04bb7f38a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:45.120666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-60adfe78-abe8-4bb9-ae39-bec04bb7f38a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:45.149733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-60adfe78-abe8-4bb9-ae39-bec04bb7f38a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:45.161511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-60adfe78-abe8-4bb9-ae39-bec04bb7f38a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:45.162749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-60adfe78-abe8-4bb9-ae39-bec04bb7f38a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:45.163469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-60adfe78-abe8-4bb9-ae39-bec04bb7f38a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:45.168561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:45.266037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cd7a2a78-bbe8-4cfd-8fb6-23ff97cb779c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:45.286325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cd7a2a78-bbe8-4cfd-8fb6-23ff97cb779c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:45.288895 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cd7a2a78-bbe8-4cfd-8fb6-23ff97cb779c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:45.289726 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cd7a2a78-bbe8-4cfd-8fb6-23ff97cb779c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.793947 May 27 15:22:45.290657 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2684/5376] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:44 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:45.604480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-60adfe78-abe8-4bb9-ae39-bec04bb7f38a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:45.618961 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-60adfe78-abe8-4bb9-ae39-bec04bb7f38a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1513 microversion: 2.1 time: 0.503543 May 27 15:22:45.622690 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2693/5377] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:45 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1513 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:22:45.766742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c85627a0-e457-450c-95e5-24a440528e8b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:45.769000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c85627a0-e457-450c-95e5-24a440528e8b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:45.783027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c85627a0-e457-450c-95e5-24a440528e8b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:45.785495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c85627a0-e457-450c-95e5-24a440528e8b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:45.786492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c85627a0-e457-450c-95e5-24a440528e8b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:45.787143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c85627a0-e457-450c-95e5-24a440528e8b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:45.825280 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c85627a0-e457-450c-95e5-24a440528e8b tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062174 May 27 15:22:45.826475 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2685/5378] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:22:45 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:46.308983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-905ac653-3ddf-4b4a-95f1-aaa704f56ec5 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:46.309651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-905ac653-3ddf-4b4a-95f1-aaa704f56ec5 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:46.314913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:46.323498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-905ac653-3ddf-4b4a-95f1-aaa704f56ec5 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:46.323974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-905ac653-3ddf-4b4a-95f1-aaa704f56ec5 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:46.329084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-905ac653-3ddf-4b4a-95f1-aaa704f56ec5 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:46.329909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-905ac653-3ddf-4b4a-95f1-aaa704f56ec5 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:46.522234 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-905ac653-3ddf-4b4a-95f1-aaa704f56ec5 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:46.541889 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-905ac653-3ddf-4b4a-95f1-aaa704f56ec5 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:46.547540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-905ac653-3ddf-4b4a-95f1-aaa704f56ec5 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:46.552707 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-905ac653-3ddf-4b4a-95f1-aaa704f56ec5 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1364 microversion: 2.57 time: 0.246632 May 27 15:22:46.556048 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2694/5379] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:46 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:46.642217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-aced92b3-d208-43b0-a2df-53af027ed590 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:46.642850 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-aced92b3-d208-43b0-a2df-53af027ed590 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:46.662570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aced92b3-d208-43b0-a2df-53af027ed590 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:46.663037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aced92b3-d208-43b0-a2df-53af027ed590 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:46.663946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aced92b3-d208-43b0-a2df-53af027ed590 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:46.664467 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aced92b3-d208-43b0-a2df-53af027ed590 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:46.837788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-77f96e90-61c0-4198-b7b3-45f139f2d7fb tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:46.838755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-77f96e90-61c0-4198-b7b3-45f139f2d7fb tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:46.854403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-77f96e90-61c0-4198-b7b3-45f139f2d7fb tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:46.855305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-77f96e90-61c0-4198-b7b3-45f139f2d7fb tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:46.859157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-77f96e90-61c0-4198-b7b3-45f139f2d7fb tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:46.860934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-77f96e90-61c0-4198-b7b3-45f139f2d7fb tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:46.965353 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-77f96e90-61c0-4198-b7b3-45f139f2d7fb tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131273 May 27 15:22:46.972077 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2695/5380] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:22:46 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:22:47.008582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-aced92b3-d208-43b0-a2df-53af027ed590 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:47.021889 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-aced92b3-d208-43b0-a2df-53af027ed590 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1513 microversion: 2.1 time: 0.383396 May 27 15:22:47.024423 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2686/5381] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:46 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1513 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:47.576918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dc2e7630-9d54-482d-accf-9d33e2802891 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:47.577762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dc2e7630-9d54-482d-accf-9d33e2802891 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:47.587412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc2e7630-9d54-482d-accf-9d33e2802891 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:47.588255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc2e7630-9d54-482d-accf-9d33e2802891 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:47.589572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc2e7630-9d54-482d-accf-9d33e2802891 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:47.590492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc2e7630-9d54-482d-accf-9d33e2802891 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:47.916577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dc2e7630-9d54-482d-accf-9d33e2802891 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:47.948805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dc2e7630-9d54-482d-accf-9d33e2802891 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:47.950742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dc2e7630-9d54-482d-accf-9d33e2802891 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:47.952385 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dc2e7630-9d54-482d-accf-9d33e2802891 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1382 microversion: 2.57 time: 0.381813 May 27 15:22:47.954267 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2696/5382] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:47 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1382 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:47.982101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-01d3cb83-61df-4912-b48a-e7627668f6ed tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:47.983525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-01d3cb83-61df-4912-b48a-e7627668f6ed tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:47.998130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-01d3cb83-61df-4912-b48a-e7627668f6ed tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:47.999705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-01d3cb83-61df-4912-b48a-e7627668f6ed tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:48.000608 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-01d3cb83-61df-4912-b48a-e7627668f6ed tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:48.004027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-01d3cb83-61df-4912-b48a-e7627668f6ed tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:48.072277 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-01d3cb83-61df-4912-b48a-e7627668f6ed tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095708 May 27 15:22:48.074321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-327a78ed-60ec-44d8-83a2-b49169e84a3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:48.076413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-327a78ed-60ec-44d8-83a2-b49169e84a3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:48.077342 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2687/5383] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:22:47 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:48.099345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-327a78ed-60ec-44d8-83a2-b49169e84a3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:48.106063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-327a78ed-60ec-44d8-83a2-b49169e84a3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:48.106932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-327a78ed-60ec-44d8-83a2-b49169e84a3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:48.107392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-327a78ed-60ec-44d8-83a2-b49169e84a3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:48.557011 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-327a78ed-60ec-44d8-83a2-b49169e84a3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:48.569094 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-327a78ed-60ec-44d8-83a2-b49169e84a3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1513 microversion: 2.1 time: 0.524616 May 27 15:22:48.573946 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2697/5384] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:48 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1513 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:22:48.973364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-26b5c71e-8e66-40ba-84dc-d5f48861ca7c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:48.974088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-26b5c71e-8e66-40ba-84dc-d5f48861ca7c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:48.987122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26b5c71e-8e66-40ba-84dc-d5f48861ca7c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:48.988876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26b5c71e-8e66-40ba-84dc-d5f48861ca7c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:48.989778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26b5c71e-8e66-40ba-84dc-d5f48861ca7c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:48.993406 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26b5c71e-8e66-40ba-84dc-d5f48861ca7c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:49.089481 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-12fe0075-5db1-4dcb-a82e-382df11536c7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:49.091164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-12fe0075-5db1-4dcb-a82e-382df11536c7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:49.110629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12fe0075-5db1-4dcb-a82e-382df11536c7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:49.112342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12fe0075-5db1-4dcb-a82e-382df11536c7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:49.113267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12fe0075-5db1-4dcb-a82e-382df11536c7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:49.126218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12fe0075-5db1-4dcb-a82e-382df11536c7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:49.148579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-26b5c71e-8e66-40ba-84dc-d5f48861ca7c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:49.194553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-26b5c71e-8e66-40ba-84dc-d5f48861ca7c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:49.202149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-26b5c71e-8e66-40ba-84dc-d5f48861ca7c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:49.211656 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-26b5c71e-8e66-40ba-84dc-d5f48861ca7c tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1370 microversion: 2.57 time: 0.242448 May 27 15:22:49.214921 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2688/5385] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:48 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1370 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:49.217794 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-12fe0075-5db1-4dcb-a82e-382df11536c7 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132581 May 27 15:22:49.218865 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2698/5386] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:22:49 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:49.590978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-89d2eac5-b793-463e-aa14-50bf99e14bca tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:49.591894 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-89d2eac5-b793-463e-aa14-50bf99e14bca tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:49.606244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89d2eac5-b793-463e-aa14-50bf99e14bca tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:49.606967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89d2eac5-b793-463e-aa14-50bf99e14bca tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:49.607941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89d2eac5-b793-463e-aa14-50bf99e14bca tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:49.608560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89d2eac5-b793-463e-aa14-50bf99e14bca tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:49.652115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:49.858239 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-89d2eac5-b793-463e-aa14-50bf99e14bca tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:49.868865 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-89d2eac5-b793-463e-aa14-50bf99e14bca tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1513 microversion: 2.1 time: 0.279356 May 27 15:22:49.875092 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2689/5387] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:49 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1513 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:50.232827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9897f25d-ae82-4556-a30e-e97689b5ace0 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:50.237301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-818afcd5-703c-4657-bfb2-46d93db072c2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:50.238604 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9897f25d-ae82-4556-a30e-e97689b5ace0 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:50.239752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-818afcd5-703c-4657-bfb2-46d93db072c2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:50.262723 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-818afcd5-703c-4657-bfb2-46d93db072c2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:50.263440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9897f25d-ae82-4556-a30e-e97689b5ace0 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:50.264103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9897f25d-ae82-4556-a30e-e97689b5ace0 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:50.265574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9897f25d-ae82-4556-a30e-e97689b5ace0 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:50.265820 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-818afcd5-703c-4657-bfb2-46d93db072c2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:50.266816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-818afcd5-703c-4657-bfb2-46d93db072c2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:50.267454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9897f25d-ae82-4556-a30e-e97689b5ace0 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:50.277112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-818afcd5-703c-4657-bfb2-46d93db072c2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:50.358506 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-818afcd5-703c-4657-bfb2-46d93db072c2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130646 May 27 15:22:50.360185 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2699/5388] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:22:50 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:50.577904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9897f25d-ae82-4556-a30e-e97689b5ace0 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:50.587481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9897f25d-ae82-4556-a30e-e97689b5ace0 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:50.589048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9897f25d-ae82-4556-a30e-e97689b5ace0 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:50.590314 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9897f25d-ae82-4556-a30e-e97689b5ace0 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1370 microversion: 2.57 time: 0.361311 May 27 15:22:50.590883 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2690/5389] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:50 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1370 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:50.888908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b96f117e-ee2f-4b0a-a921-2b74289400d0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:50.889911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b96f117e-ee2f-4b0a-a921-2b74289400d0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:50.897589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b96f117e-ee2f-4b0a-a921-2b74289400d0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:50.898378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b96f117e-ee2f-4b0a-a921-2b74289400d0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:50.899515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b96f117e-ee2f-4b0a-a921-2b74289400d0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:50.900156 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b96f117e-ee2f-4b0a-a921-2b74289400d0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:51.240454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b96f117e-ee2f-4b0a-a921-2b74289400d0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:51.254258 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b96f117e-ee2f-4b0a-a921-2b74289400d0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1513 microversion: 2.1 time: 0.371684 May 27 15:22:51.254853 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2700/5390] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:50 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1513 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:51.372104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8cf285d1-3fd9-4c2a-9ce4-b419e59c552a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:51.373104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8cf285d1-3fd9-4c2a-9ce4-b419e59c552a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:51.385257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8cf285d1-3fd9-4c2a-9ce4-b419e59c552a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:51.385731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8cf285d1-3fd9-4c2a-9ce4-b419e59c552a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:51.386532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8cf285d1-3fd9-4c2a-9ce4-b419e59c552a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:51.386987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8cf285d1-3fd9-4c2a-9ce4-b419e59c552a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:51.472991 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8cf285d1-3fd9-4c2a-9ce4-b419e59c552a tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106159 May 27 15:22:51.480824 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2691/5391] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:22:51 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:51.618216 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4abcacd1-65a9-4348-bcf2-3f0a3b6e2d22 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:51.620732 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4abcacd1-65a9-4348-bcf2-3f0a3b6e2d22 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:51.635110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4abcacd1-65a9-4348-bcf2-3f0a3b6e2d22 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:51.636080 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4abcacd1-65a9-4348-bcf2-3f0a3b6e2d22 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:51.637382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4abcacd1-65a9-4348-bcf2-3f0a3b6e2d22 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:51.638160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4abcacd1-65a9-4348-bcf2-3f0a3b6e2d22 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:51.770023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4abcacd1-65a9-4348-bcf2-3f0a3b6e2d22 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:51.783942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4abcacd1-65a9-4348-bcf2-3f0a3b6e2d22 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:51.788404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4abcacd1-65a9-4348-bcf2-3f0a3b6e2d22 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:51.791715 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4abcacd1-65a9-4348-bcf2-3f0a3b6e2d22 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1370 microversion: 2.57 time: 0.183085 May 27 15:22:51.807577 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2701/5392] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:51 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:52.272179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-26dc1866-762d-46c7-ae99-7c1942bd7d85 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:52.273020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-26dc1866-762d-46c7-ae99-7c1942bd7d85 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:52.286740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26dc1866-762d-46c7-ae99-7c1942bd7d85 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:52.287372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26dc1866-762d-46c7-ae99-7c1942bd7d85 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:52.288425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26dc1866-762d-46c7-ae99-7c1942bd7d85 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:52.289195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26dc1866-762d-46c7-ae99-7c1942bd7d85 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:52.487076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4f008dbb-596a-4316-8575-1b8d553f7dec tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:52.488104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4f008dbb-596a-4316-8575-1b8d553f7dec tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:52.505478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f008dbb-596a-4316-8575-1b8d553f7dec tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:52.510697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f008dbb-596a-4316-8575-1b8d553f7dec tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:52.513512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f008dbb-596a-4316-8575-1b8d553f7dec tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:52.513990 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f008dbb-596a-4316-8575-1b8d553f7dec tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:52.595327 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4f008dbb-596a-4316-8575-1b8d553f7dec tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114084 May 27 15:22:52.599095 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2702/5393] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:22:52 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:52.788136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-26dc1866-762d-46c7-ae99-7c1942bd7d85 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:52.802259 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-26dc1866-762d-46c7-ae99-7c1942bd7d85 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1513 microversion: 2.1 time: 0.534150 May 27 15:22:52.802878 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2692/5394] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:52 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1513 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:52.825999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bb2fabe4-c3c2-4581-a150-c78670c415a1 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:52.826748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bb2fabe4-c3c2-4581-a150-c78670c415a1 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:52.840810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb2fabe4-c3c2-4581-a150-c78670c415a1 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:52.843211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb2fabe4-c3c2-4581-a150-c78670c415a1 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:52.844321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb2fabe4-c3c2-4581-a150-c78670c415a1 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:52.844811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb2fabe4-c3c2-4581-a150-c78670c415a1 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:53.060991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bb2fabe4-c3c2-4581-a150-c78670c415a1 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:53.102813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bb2fabe4-c3c2-4581-a150-c78670c415a1 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:53.116488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bb2fabe4-c3c2-4581-a150-c78670c415a1 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:53.122557 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bb2fabe4-c3c2-4581-a150-c78670c415a1 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1355 microversion: 2.57 time: 0.313144 May 27 15:22:53.157418 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2703/5395] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:52 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1355 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:53.163254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c3f0ba27-f17f-4e56-8ab6-c9cf718e7f6e tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:53.164578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c3f0ba27-f17f-4e56-8ab6-c9cf718e7f6e tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:53.180281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3f0ba27-f17f-4e56-8ab6-c9cf718e7f6e tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:53.181044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3f0ba27-f17f-4e56-8ab6-c9cf718e7f6e tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:53.182038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3f0ba27-f17f-4e56-8ab6-c9cf718e7f6e tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:53.182650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3f0ba27-f17f-4e56-8ab6-c9cf718e7f6e tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:53.246897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c3f0ba27-f17f-4e56-8ab6-c9cf718e7f6e tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:22:53.420355 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c3f0ba27-f17f-4e56-8ab6-c9cf718e7f6e tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "DELETE /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 204 len: 0 microversion: 2.57 time: 0.260869 May 27 15:22:53.423981 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2693/5396] 10.222.0.13 () {60 vars in 1279 bytes} [Fri May 27 15:22:53 2022] DELETE /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:22:53.429314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e6bf676a-2fa5-48c6-aa15-fc239ef11cd8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:53.430541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e6bf676a-2fa5-48c6-aa15-fc239ef11cd8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:53.440529 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e6bf676a-2fa5-48c6-aa15-fc239ef11cd8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:53.441017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e6bf676a-2fa5-48c6-aa15-fc239ef11cd8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:53.441820 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e6bf676a-2fa5-48c6-aa15-fc239ef11cd8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:53.442375 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e6bf676a-2fa5-48c6-aa15-fc239ef11cd8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:53.612632 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c0afed2c-85b9-4c60-99a1-fc699130b223 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:53.613897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c0afed2c-85b9-4c60-99a1-fc699130b223 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:53.631534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0afed2c-85b9-4c60-99a1-fc699130b223 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:53.633301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0afed2c-85b9-4c60-99a1-fc699130b223 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:53.636164 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0afed2c-85b9-4c60-99a1-fc699130b223 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:53.639742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0afed2c-85b9-4c60-99a1-fc699130b223 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:53.736972 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c0afed2c-85b9-4c60-99a1-fc699130b223 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129371 May 27 15:22:53.743621 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2694/5397] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:22:53 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:53.780368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e6bf676a-2fa5-48c6-aa15-fc239ef11cd8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:53.808392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e6bf676a-2fa5-48c6-aa15-fc239ef11cd8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:53.811900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e6bf676a-2fa5-48c6-aa15-fc239ef11cd8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:53.819139 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e6bf676a-2fa5-48c6-aa15-fc239ef11cd8 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1361 microversion: 2.57 time: 0.392370 May 27 15:22:53.822299 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2704/5398] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:53 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1361 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:53.826580 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e877cfda-0abc-4375-9412-d00825b72e54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:53.827355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e877cfda-0abc-4375-9412-d00825b72e54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:53.835643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e877cfda-0abc-4375-9412-d00825b72e54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:53.845624 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e877cfda-0abc-4375-9412-d00825b72e54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:53.846740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e877cfda-0abc-4375-9412-d00825b72e54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:53.847361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e877cfda-0abc-4375-9412-d00825b72e54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:54.336155 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e877cfda-0abc-4375-9412-d00825b72e54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:54.346606 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e877cfda-0abc-4375-9412-d00825b72e54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1513 microversion: 2.1 time: 0.523647 May 27 15:22:54.348337 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2695/5399] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:53 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1513 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:54.755655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b201a79d-2197-4898-bf00-d8003bc520ef tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:54.758159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b201a79d-2197-4898-bf00-d8003bc520ef tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:54.781671 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b201a79d-2197-4898-bf00-d8003bc520ef tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:54.782353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b201a79d-2197-4898-bf00-d8003bc520ef tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:54.783637 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b201a79d-2197-4898-bf00-d8003bc520ef tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:54.784206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b201a79d-2197-4898-bf00-d8003bc520ef tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:54.850376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d3129988-2978-4333-8cf9-b53d9a4bc5b4 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:54.854348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d3129988-2978-4333-8cf9-b53d9a4bc5b4 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:54.872183 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b201a79d-2197-4898-bf00-d8003bc520ef tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121691 May 27 15:22:54.873037 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2705/5400] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:22:54 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:54.892190 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d3129988-2978-4333-8cf9-b53d9a4bc5b4 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:54.892690 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d3129988-2978-4333-8cf9-b53d9a4bc5b4 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:54.895276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d3129988-2978-4333-8cf9-b53d9a4bc5b4 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:54.897278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d3129988-2978-4333-8cf9-b53d9a4bc5b4 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:55.067960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d3129988-2978-4333-8cf9-b53d9a4bc5b4 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:55.084985 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d3129988-2978-4333-8cf9-b53d9a4bc5b4 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:55.087214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d3129988-2978-4333-8cf9-b53d9a4bc5b4 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:55.089063 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d3129988-2978-4333-8cf9-b53d9a4bc5b4 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1361 microversion: 2.57 time: 0.243133 May 27 15:22:55.090391 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2696/5401] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:54 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:22:55.377657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-56429137-2be3-4609-992a-27c39cc26125 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:55.378783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-56429137-2be3-4609-992a-27c39cc26125 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:55.401333 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56429137-2be3-4609-992a-27c39cc26125 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:55.402230 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56429137-2be3-4609-992a-27c39cc26125 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:55.403987 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56429137-2be3-4609-992a-27c39cc26125 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:55.404656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56429137-2be3-4609-992a-27c39cc26125 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:55.680504 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-56429137-2be3-4609-992a-27c39cc26125 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:55.688583 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-56429137-2be3-4609-992a-27c39cc26125 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1513 microversion: 2.1 time: 0.324656 May 27 15:22:55.689717 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2706/5402] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:55 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1513 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:55.884011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fd78d04d-3d0e-4741-9910-ea2d7c23b5b2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:55.886121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fd78d04d-3d0e-4741-9910-ea2d7c23b5b2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:55.896967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd78d04d-3d0e-4741-9910-ea2d7c23b5b2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:55.901913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd78d04d-3d0e-4741-9910-ea2d7c23b5b2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:55.903079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd78d04d-3d0e-4741-9910-ea2d7c23b5b2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:55.903764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fd78d04d-3d0e-4741-9910-ea2d7c23b5b2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:55.964599 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fd78d04d-3d0e-4741-9910-ea2d7c23b5b2 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084220 May 27 15:22:55.966689 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2697/5403] 10.222.0.13 () {58 vars in 1301 bytes} [Fri May 27 15:22:55 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:22:56.111391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-38cb0d61-12f2-45b3-b904-af778246566b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:56.120876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7a0c153f-4bb4-4d36-952a-cbd1db591943 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:56.121826 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-38cb0d61-12f2-45b3-b904-af778246566b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:56.122960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7a0c153f-4bb4-4d36-952a-cbd1db591943 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:56.142257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38cb0d61-12f2-45b3-b904-af778246566b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:56.146025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38cb0d61-12f2-45b3-b904-af778246566b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:56.146730 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a0c153f-4bb4-4d36-952a-cbd1db591943 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:56.148734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a0c153f-4bb4-4d36-952a-cbd1db591943 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:56.150077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a0c153f-4bb4-4d36-952a-cbd1db591943 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:56.150318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38cb0d61-12f2-45b3-b904-af778246566b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:56.151471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38cb0d61-12f2-45b3-b904-af778246566b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:56.154158 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a0c153f-4bb4-4d36-952a-cbd1db591943 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:56.243176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7a0c153f-4bb4-4d36-952a-cbd1db591943 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:22:56.270507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38cb0d61-12f2-45b3-b904-af778246566b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:56.271577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38cb0d61-12f2-45b3-b904-af778246566b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:56.272384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-38cb0d61-12f2-45b3-b904-af778246566b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lazy-loading 'fault' on Instance uuid 80598f78-f85d-4758-bb39-8c7d6cfc67ff {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:22:56.373507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-38cb0d61-12f2-45b3-b904-af778246566b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:56.388534 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-38cb0d61-12f2-45b3-b904-af778246566b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:56.390825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-38cb0d61-12f2-45b3-b904-af778246566b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '442c425528fc4b8fbffa7b044ffa3069', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40d8431a56f4f979e2a598b32a6821a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:56.392447 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-38cb0d61-12f2-45b3-b904-af778246566b tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 200 len: 1366 microversion: 2.57 time: 0.286957 May 27 15:22:56.394143 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2707/5404] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:56 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:22:56.418292 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7a0c153f-4bb4-4d36-952a-cbd1db591943 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "DELETE /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 204 len: 0 microversion: 2.1 time: 0.304231 May 27 15:22:56.421131 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2698/5405] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:22:56 2022] DELETE /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:22:56.431406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2da0c53d-715f-4bee-b6d6-abbc2209e6a5 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:56.432357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2da0c53d-715f-4bee-b6d6-abbc2209e6a5 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:56.448512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2da0c53d-715f-4bee-b6d6-abbc2209e6a5 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:56.449339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2da0c53d-715f-4bee-b6d6-abbc2209e6a5 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:56.451554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2da0c53d-715f-4bee-b6d6-abbc2209e6a5 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:56.452101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2da0c53d-715f-4bee-b6d6-abbc2209e6a5 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:56.708458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-63f2d285-4301-4e01-a190-7f8d76d4956a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:56.710105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-63f2d285-4301-4e01-a190-7f8d76d4956a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:56.723268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63f2d285-4301-4e01-a190-7f8d76d4956a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:56.723268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63f2d285-4301-4e01-a190-7f8d76d4956a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:56.725912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63f2d285-4301-4e01-a190-7f8d76d4956a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:56.726972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63f2d285-4301-4e01-a190-7f8d76d4956a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:57.011684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2da0c53d-715f-4bee-b6d6-abbc2209e6a5 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:57.041832 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2da0c53d-715f-4bee-b6d6-abbc2209e6a5 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 200 len: 1682 microversion: 2.1 time: 0.614494 May 27 15:22:57.046160 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2708/5406] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:56 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 1682 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:57.351686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-63f2d285-4301-4e01-a190-7f8d76d4956a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:57.365104 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-63f2d285-4301-4e01-a190-7f8d76d4956a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1513 microversion: 2.1 time: 0.662424 May 27 15:22:57.375529 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2699/5407] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:56 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1513 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:57.416732 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b1a9af40-3a08-4f4d-960c-08e9c140b7e3 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:57.417355 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b1a9af40-3a08-4f4d-960c-08e9c140b7e3 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] [instance: 80598f78-f85d-4758-bb39-8c7d6cfc67ff] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:57.424658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b1a9af40-3a08-4f4d-960c-08e9c140b7e3 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:57.425436 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b1a9af40-3a08-4f4d-960c-08e9c140b7e3 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:57.426390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b1a9af40-3a08-4f4d-960c-08e9c140b7e3 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:57.427623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b1a9af40-3a08-4f4d-960c-08e9c140b7e3 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:57.465101 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-b1a9af40-3a08-4f4d-960c-08e9c140b7e3 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] HTTP exception thrown: Instance 80598f78-f85d-4758-bb39-8c7d6cfc67ff could not be found. May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b1a9af40-3a08-4f4d-960c-08e9c140b7e3 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Request method failure captured: May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff HTTP/1.1 May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOygTECJMmkNTqRNceXZsQw-CIgts9dzMh8d4yXem1okohpVvIfC-1Yhti7ftdXcVXRCKuusC3-fHnReLZV4lrdtm2PJr3ATQ0R5KIgnbeXquwO3aD4H4KXFhRacQTZH8nypJ5zLlYrJvySHroFWNLQBBFXm60qyep_77e57LezU6ww May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-Openstack-Nova-Api-Version: 2.57 May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: e40d8431a56f4f979e2a598b32a6821a May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerShowV257Test-2048369027 May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e40d8431a56f4f979e2a598b32a6821a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e40d8431a56f4f979e2a598b32a6821a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e40d8431a56f4f979e2a598b32a6821a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e40d8431a56f4f979e2a598b32a6821a", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerShowV257Test-2048369027 May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: e40d8431a56f4f979e2a598b32a6821a May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerShowV257Test-2048369027 May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerShowV257Test-2048369027-project May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 442c425528fc4b8fbffa7b044ffa3069 May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerShowV257Test-2048369027-project May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 80598f78-f85d-4758-bb39-8c7d6cfc67ff could not be found. May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '80598f78-f85d-4758-bb39-8c7d6cfc67ff'} May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80598f78-f85d-4758-bb39-8c7d6cfc67ff could not be found. May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80598f78-f85d-4758-bb39-8c7d6cfc67ff could not be found. May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:57.472103 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:57.495508 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:57.495508 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:57.495508 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:57.495508 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:22:57.495508 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:22:57.495508 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80598f78-f85d-4758-bb39-8c7d6cfc67ff could not be found. May 27 15:22:57.495508 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:22:57.495508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b1a9af40-3a08-4f4d-960c-08e9c140b7e3 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] Returning 404 to user: Instance 80598f78-f85d-4758-bb39-8c7d6cfc67ff could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:22:57.495508 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b1a9af40-3a08-4f4d-960c-08e9c140b7e3 tempest-ServerShowV257Test-2048369027 tempest-ServerShowV257Test-2048369027-project] 10.222.0.13 "GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff" status: 404 len: 111 microversion: 2.57 time: 0.078430 May 27 15:22:57.509222 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2709/5408] 10.222.0.13 () {60 vars in 1276 bytes} [Fri May 27 15:22:57 2022] GET /compute/v2.1/servers/80598f78-f85d-4758-bb39-8c7d6cfc67ff => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:22:58.065663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-22dfc90c-7a9d-4444-bec8-61f23f51a31e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:58.066285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-22dfc90c-7a9d-4444-bec8-61f23f51a31e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:58.082119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22dfc90c-7a9d-4444-bec8-61f23f51a31e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:58.082787 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22dfc90c-7a9d-4444-bec8-61f23f51a31e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:58.084834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22dfc90c-7a9d-4444-bec8-61f23f51a31e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:58.086323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22dfc90c-7a9d-4444-bec8-61f23f51a31e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:58.412245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-eed24624-12b9-48e6-b14c-eaea430c0d39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:58.413811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-eed24624-12b9-48e6-b14c-eaea430c0d39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:58.414712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-22dfc90c-7a9d-4444-bec8-61f23f51a31e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:58.423932 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-22dfc90c-7a9d-4444-bec8-61f23f51a31e tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 200 len: 1682 microversion: 2.1 time: 0.364577 May 27 15:22:58.424521 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2700/5409] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:58 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 1682 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:58.439901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eed24624-12b9-48e6-b14c-eaea430c0d39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:58.441019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eed24624-12b9-48e6-b14c-eaea430c0d39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:58.441981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eed24624-12b9-48e6-b14c-eaea430c0d39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:58.442590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eed24624-12b9-48e6-b14c-eaea430c0d39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:58.469249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:58.720118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-eed24624-12b9-48e6-b14c-eaea430c0d39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:58.728575 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-eed24624-12b9-48e6-b14c-eaea430c0d39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1490 microversion: 2.1 time: 0.337442 May 27 15:22:58.751704 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2710/5410] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:58 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1490 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:58.761544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2c78d5e3-efb0-493c-9ef6-63c3f0545736 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:58.763066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2c78d5e3-efb0-493c-9ef6-63c3f0545736 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:58.780002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2c78d5e3-efb0-493c-9ef6-63c3f0545736 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:58.781228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2c78d5e3-efb0-493c-9ef6-63c3f0545736 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:58.782536 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2c78d5e3-efb0-493c-9ef6-63c3f0545736 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:58.785653 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2c78d5e3-efb0-493c-9ef6-63c3f0545736 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:58.880250 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2c78d5e3-efb0-493c-9ef6-63c3f0545736 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action" status: 200 len: 180 microversion: 2.1 time: 0.125659 May 27 15:22:58.881487 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2701/5411] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:22:58 2022] POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action => generated 180 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:58.891538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-011462ec-c1c4-4182-807c-9b45c21acd8c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:58.892180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-011462ec-c1c4-4182-807c-9b45c21acd8c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:58.908934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-011462ec-c1c4-4182-807c-9b45c21acd8c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:58.909610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-011462ec-c1c4-4182-807c-9b45c21acd8c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:58.910599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-011462ec-c1c4-4182-807c-9b45c21acd8c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:58.911221 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-011462ec-c1c4-4182-807c-9b45c21acd8c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:59.241963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-011462ec-c1c4-4182-807c-9b45c21acd8c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:59.258458 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-011462ec-c1c4-4182-807c-9b45c21acd8c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.368482 May 27 15:22:59.259529 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2711/5412] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:58 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:59.315807 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bfd955cd-ff4a-48d7-8ef0-af706fcf0308 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:59.316859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bfd955cd-ff4a-48d7-8ef0-af706fcf0308 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:59.367094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bfd955cd-ff4a-48d7-8ef0-af706fcf0308 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:59.375256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bfd955cd-ff4a-48d7-8ef0-af706fcf0308 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:59.376411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bfd955cd-ff4a-48d7-8ef0-af706fcf0308 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:59.381940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bfd955cd-ff4a-48d7-8ef0-af706fcf0308 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:59.443077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b18d216e-461f-4f16-a045-0815c4bea24d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:59.452951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b18d216e-461f-4f16-a045-0815c4bea24d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:59.471485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b18d216e-461f-4f16-a045-0815c4bea24d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:59.473065 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b18d216e-461f-4f16-a045-0815c4bea24d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:59.478073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b18d216e-461f-4f16-a045-0815c4bea24d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:59.478553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b18d216e-461f-4f16-a045-0815c4bea24d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:59.744575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bfd955cd-ff4a-48d7-8ef0-af706fcf0308 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:59.750041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:59.779833 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bfd955cd-ff4a-48d7-8ef0-af706fcf0308 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.461560 May 27 15:22:59.796835 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2702/5413] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:59 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:59.804074 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-90dfc858-cc83-465c-b237-37ecba41e5e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:59.805262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-90dfc858-cc83-465c-b237-37ecba41e5e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:59.814436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:59.816398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-90dfc858-cc83-465c-b237-37ecba41e5e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:59.817045 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-90dfc858-cc83-465c-b237-37ecba41e5e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:59.817836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-90dfc858-cc83-465c-b237-37ecba41e5e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:59.818407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-90dfc858-cc83-465c-b237-37ecba41e5e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:59.824163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b18d216e-461f-4f16-a045-0815c4bea24d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:59.833182 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b18d216e-461f-4f16-a045-0815c4bea24d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 200 len: 1682 microversion: 2.1 time: 0.393857 May 27 15:22:59.837559 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2712/5414] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:59 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 1682 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:00.178268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-90dfc858-cc83-465c-b237-37ecba41e5e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:00.191612 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-90dfc858-cc83-465c-b237-37ecba41e5e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.388100 May 27 15:23:00.191612 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2703/5415] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:22:59 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:00.205775 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2a3120f7-ca28-480f-aa5b-8bbd6b40bf1c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:00.206565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2a3120f7-ca28-480f-aa5b-8bbd6b40bf1c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:00.221490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a3120f7-ca28-480f-aa5b-8bbd6b40bf1c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:00.221976 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a3120f7-ca28-480f-aa5b-8bbd6b40bf1c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:00.227000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a3120f7-ca28-480f-aa5b-8bbd6b40bf1c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:00.232568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a3120f7-ca28-480f-aa5b-8bbd6b40bf1c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:00.576241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2a3120f7-ca28-480f-aa5b-8bbd6b40bf1c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:00.589335 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2a3120f7-ca28-480f-aa5b-8bbd6b40bf1c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.386889 May 27 15:23:00.590483 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2713/5416] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:00 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:00.860248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a7a275f7-dc7c-4db3-9cd0-f4057ffb5874 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:00.861792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a7a275f7-dc7c-4db3-9cd0-f4057ffb5874 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:00.894771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a7a275f7-dc7c-4db3-9cd0-f4057ffb5874 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:00.895272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a7a275f7-dc7c-4db3-9cd0-f4057ffb5874 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:00.896233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a7a275f7-dc7c-4db3-9cd0-f4057ffb5874 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:00.901803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a7a275f7-dc7c-4db3-9cd0-f4057ffb5874 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:00.970712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4e299c72-7e12-433d-9393-729995b52773 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-94352826", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "2accc000-a1ee-4371-bdb5-4490822eb578"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:01.076709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-4e299c72-7e12-433d-9393-729995b52773 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] validate_networks() for [('2accc000-a1ee-4371-bdb5-4490822eb578', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:23:01.203389 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a7a275f7-dc7c-4db3-9cd0-f4057ffb5874 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f88a11fc4b4bf6b4a807ccffee1fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9a825b1ade46e3a702ae19c7c53f6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:01.212812 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a7a275f7-dc7c-4db3-9cd0-f4057ffb5874 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 200 len: 1615 microversion: 2.1 time: 0.358293 May 27 15:23:01.241548 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2704/5417] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:00 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 1615 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:23:02.067615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-6b44b37c-fc9d-4a54-a4c7-048d39ebcb80 req-f4f0100d-8b71-4e99-bf8c-9dbf4b0e7dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb9b7c54-a210-490f-bf50-f6c1ece7ae55", "name": "network-vif-deleted", "tag": "9043ff94-df32-4f3e-95d5-a543c47eccad"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:02.095415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-6b44b37c-fc9d-4a54-a4c7-048d39ebcb80 req-f4f0100d-8b71-4e99-bf8c-9dbf4b0e7dbb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:02.099935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-6b44b37c-fc9d-4a54-a4c7-048d39ebcb80 req-f4f0100d-8b71-4e99-bf8c-9dbf4b0e7dbb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:02.166765 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-6b44b37c-fc9d-4a54-a4c7-048d39ebcb80 req-f4f0100d-8b71-4e99-bf8c-9dbf4b0e7dbb service nova] Creating event network-vif-deleted:9043ff94-df32-4f3e-95d5-a543c47eccad for instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 on n-h2-843621-1 May 27 15:23:02.194442 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-6b44b37c-fc9d-4a54-a4c7-048d39ebcb80 req-f4f0100d-8b71-4e99-bf8c-9dbf4b0e7dbb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.496194 May 27 15:23:02.197019 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2705/5418] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:23:02.251466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-03232c76-0843-48d2-afe8-99093051636c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:02.255221 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-03232c76-0843-48d2-afe8-99093051636c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:02.276424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-4e299c72-7e12-433d-9393-729995b52773 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:23:02.277352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-4e299c72-7e12-433d-9393-729995b52773 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:23:02.278138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-4e299c72-7e12-433d-9393-729995b52773 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:23:02.279309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-4e299c72-7e12-433d-9393-729995b52773 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:23:02.279848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-4e299c72-7e12-433d-9393-729995b52773 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:23:02.297387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03232c76-0843-48d2-afe8-99093051636c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:02.300080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03232c76-0843-48d2-afe8-99093051636c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:02.304360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03232c76-0843-48d2-afe8-99093051636c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:02.309140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03232c76-0843-48d2-afe8-99093051636c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:02.322636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e299c72-7e12-433d-9393-729995b52773 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:02.323346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e299c72-7e12-433d-9393-729995b52773 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:02.337440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e299c72-7e12-433d-9393-729995b52773 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:02.338213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e299c72-7e12-433d-9393-729995b52773 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:02.400039 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-03232c76-0843-48d2-afe8-99093051636c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] HTTP exception thrown: Instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 could not be found. May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-03232c76-0843-48d2-afe8-99093051636c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Request method failure captured: May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 HTTP/1.1 May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOrMyApwEozUDyrEIfAo_5Y4g_1HkChw1SWcTHKZFCS59hbDZ-tG27fBruZ89SDVYIwJf1049Wu3YE4lY2cORLx6FEdOR4uGmA8kqdyyKM11lovRtNDp2ouZkjSiDmO17gaqasURXD2cDNTsBoZha7a41XrY22c7gADFUiZI3zmSCNg May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a9a825b1ade46e3a702ae19c7c53f6b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 59f88a11fc4b4bf6b4a807ccffee1fab May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 could not be found. May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'eb9b7c54-a210-490f-bf50-f6c1ece7ae55'} May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 could not be found. May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 could not be found. May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:02.416540 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:02.420761 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:02.420761 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:02.420761 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:02.420761 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:02.420761 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:02.420761 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 could not be found. May 27 15:23:02.420761 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:02.420761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-03232c76-0843-48d2-afe8-99093051636c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Returning 404 to user: Instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:02.421280 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-03232c76-0843-48d2-afe8-99093051636c tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 404 len: 111 microversion: 2.1 time: 0.174976 May 27 15:23:02.436272 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2706/5419] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:02 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:23:02.461837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3aca9ca5-3fdb-48ad-bf69-1be9f693aa81 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '.version_select at 0x7fc7806e4700>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:02.483771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-4e299c72-7e12-433d-9393-729995b52773 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Getting quotas for project e72c782a808345e093093ea95ce04ae4. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:23:02.510816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-4e299c72-7e12-433d-9393-729995b52773 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Getting quotas for user f750b3f70eed4477a15c3529371a8af3 and project e72c782a808345e093093ea95ce04ae4. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:23:02.531061 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3aca9ca5-3fdb-48ad-bf69-1be9f693aa81 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1370725543" status: 202 len: 0 microversion: 2.1 time: 0.091825 May 27 15:23:02.543585 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2707/5420] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 27 15:23:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1370725543 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:23:02.551256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4e299c72-7e12-433d-9393-729995b52773 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:23:02.553644 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4e299c72-7e12-433d-9393-729995b52773 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:23:02.710594 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4e299c72-7e12-433d-9393-729995b52773 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.743717 May 27 15:23:02.722398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c60e4139-bf68-44ac-b907-4f24cb232797 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:02.723039 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c60e4139-bf68-44ac-b907-4f24cb232797 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:02.732191 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2714/5421] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:23:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:23:03.582685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c60e4139-bf68-44ac-b907-4f24cb232797 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:03.606794 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c60e4139-bf68-44ac-b907-4f24cb232797 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073" status: 200 len: 1213 microversion: 2.1 time: 0.888336 May 27 15:23:03.609270 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2708/5422] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:02 2022] GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073 => generated 1213 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:04.636306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-37740835-f3eb-4b69-8425-5c0a0d515823 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:04.639866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-37740835-f3eb-4b69-8425-5c0a0d515823 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:04.657479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-37740835-f3eb-4b69-8425-5c0a0d515823 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:04.658283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-37740835-f3eb-4b69-8425-5c0a0d515823 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:04.659522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-37740835-f3eb-4b69-8425-5c0a0d515823 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:04.661523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-37740835-f3eb-4b69-8425-5c0a0d515823 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:04.771757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-37740835-f3eb-4b69-8425-5c0a0d515823 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:04.787962 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-37740835-f3eb-4b69-8425-5c0a0d515823 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073" status: 200 len: 1271 microversion: 2.1 time: 0.157770 May 27 15:23:04.788716 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2715/5423] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:04 2022] GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073 => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:05.022554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-481a89a7-798f-463c-a027-c37e9ef53591 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:05.023728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-481a89a7-798f-463c-a027-c37e9ef53591 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:05.041637 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-481a89a7-798f-463c-a027-c37e9ef53591 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:05.043862 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-481a89a7-798f-463c-a027-c37e9ef53591 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:05.046330 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-481a89a7-798f-463c-a027-c37e9ef53591 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:05.047806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-481a89a7-798f-463c-a027-c37e9ef53591 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:05.106149 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-481a89a7-798f-463c-a027-c37e9ef53591 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] HTTP exception thrown: Instance 9cc72e17-205e-4e7f-aefe-17a244443295 could not be found. May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-481a89a7-798f-463c-a027-c37e9ef53591 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Request method failure captured: May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 HTTP/1.1 May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOqO8KVR7bzq1xoLjXzLKv0jGOqOkF04cM8b_FyeHOV8wjUdo7LcGuyLc27U8rtMZ4Tx8DJ2dvOnNu1SxerG7uKkQJnKsTqpVjsMvJMqiMgOzvJ1G7GmmMLPDp1c3TCtYtsBkLf2gEtULm562ZhCKsQs-h_bvBej5OHYc34thW1M5ug May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 73054e8eb659476bb30aa574d7251758 May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AttachVolumeTestJSON-528269557 May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/73054e8eb659476bb30aa574d7251758"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/73054e8eb659476bb30aa574d7251758"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/73054e8eb659476bb30aa574d7251758"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_73054e8eb659476bb30aa574d7251758", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AttachVolumeTestJSON-528269557 May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 73054e8eb659476bb30aa574d7251758 May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AttachVolumeTestJSON-528269557 May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AttachVolumeTestJSON-528269557-project May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 6fdf02b03cac44cb89d2cf3b373fb9e1 May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AttachVolumeTestJSON-528269557-project May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 9cc72e17-205e-4e7f-aefe-17a244443295 could not be found. May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '9cc72e17-205e-4e7f-aefe-17a244443295'} May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cc72e17-205e-4e7f-aefe-17a244443295 could not be found. May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:23:05.144856 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:23:05.149700 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cc72e17-205e-4e7f-aefe-17a244443295 could not be found. May 27 15:23:05.149700 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:05.149700 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:05.149700 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:05.149700 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:05.149700 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:05.149700 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:05.149700 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:05.149700 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:05.149700 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cc72e17-205e-4e7f-aefe-17a244443295 could not be found. May 27 15:23:05.149700 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:05.153854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-481a89a7-798f-463c-a027-c37e9ef53591 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Returning 404 to user: Instance 9cc72e17-205e-4e7f-aefe-17a244443295 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:05.155167 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-481a89a7-798f-463c-a027-c37e9ef53591 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 404 len: 111 microversion: 2.1 time: 0.138788 May 27 15:23:05.156406 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2709/5424] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:23:05 2022] DELETE /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:23:05.165956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d64d6033-c8e7-4956-a1de-e43d56aecd09 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:05.167504 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d64d6033-c8e7-4956-a1de-e43d56aecd09 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 9cc72e17-205e-4e7f-aefe-17a244443295] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:05.181327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d64d6033-c8e7-4956-a1de-e43d56aecd09 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:05.182281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d64d6033-c8e7-4956-a1de-e43d56aecd09 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:05.184451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d64d6033-c8e7-4956-a1de-e43d56aecd09 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:05.185179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d64d6033-c8e7-4956-a1de-e43d56aecd09 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:05.215012 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-d64d6033-c8e7-4956-a1de-e43d56aecd09 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] HTTP exception thrown: Instance 9cc72e17-205e-4e7f-aefe-17a244443295 could not be found. May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d64d6033-c8e7-4956-a1de-e43d56aecd09 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Request method failure captured: May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 HTTP/1.1 May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOqO8KVR7bzq1xoLjXzLKv0jGOqOkF04cM8b_FyeHOV8wjUdo7LcGuyLc27U8rtMZ4Tx8DJ2dvOnNu1SxerG7uKkQJnKsTqpVjsMvJMqiMgOzvJ1G7GmmMLPDp1c3TCtYtsBkLf2gEtULm562ZhCKsQs-h_bvBej5OHYc34thW1M5ug May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 73054e8eb659476bb30aa574d7251758 May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-AttachVolumeTestJSON-528269557 May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/73054e8eb659476bb30aa574d7251758"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/73054e8eb659476bb30aa574d7251758"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/73054e8eb659476bb30aa574d7251758"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_73054e8eb659476bb30aa574d7251758", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-AttachVolumeTestJSON-528269557 May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 73054e8eb659476bb30aa574d7251758 May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-AttachVolumeTestJSON-528269557 May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-AttachVolumeTestJSON-528269557-project May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 6fdf02b03cac44cb89d2cf3b373fb9e1 May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-AttachVolumeTestJSON-528269557-project May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 9cc72e17-205e-4e7f-aefe-17a244443295 could not be found. May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '9cc72e17-205e-4e7f-aefe-17a244443295'} May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cc72e17-205e-4e7f-aefe-17a244443295 could not be found. May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cc72e17-205e-4e7f-aefe-17a244443295 could not be found. May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:05.224158 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:05.236110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:05.236110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:05.236110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:05.236110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:05.236110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:05.236110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cc72e17-205e-4e7f-aefe-17a244443295 could not be found. May 27 15:23:05.236110 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:05.259571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d64d6033-c8e7-4956-a1de-e43d56aecd09 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Returning 404 to user: Instance 9cc72e17-205e-4e7f-aefe-17a244443295 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:05.263128 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d64d6033-c8e7-4956-a1de-e43d56aecd09 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295" status: 404 len: 111 microversion: 2.1 time: 0.101624 May 27 15:23:05.265416 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2716/5425] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:05 2022] GET /compute/v2.1/servers/9cc72e17-205e-4e7f-aefe-17a244443295 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:23:05.607301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6ef0462a-1adc-4c6d-91bb-bfc231b31bdb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1410278601", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:05.779312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-6ef0462a-1adc-4c6d-91bb-bfc231b31bdb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] validate_networks() for [('640304d1-fbbc-473c-9acb-60ed77473841', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:23:05.827703 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7ad70ca2-1385-4154-9fdc-88d99a54e3dd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:05.829008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7ad70ca2-1385-4154-9fdc-88d99a54e3dd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:05.869886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ad70ca2-1385-4154-9fdc-88d99a54e3dd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:05.871914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ad70ca2-1385-4154-9fdc-88d99a54e3dd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:05.874957 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ad70ca2-1385-4154-9fdc-88d99a54e3dd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:05.885399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ad70ca2-1385-4154-9fdc-88d99a54e3dd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:06.223014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7ad70ca2-1385-4154-9fdc-88d99a54e3dd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:06.236489 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7ad70ca2-1385-4154-9fdc-88d99a54e3dd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073" status: 200 len: 1271 microversion: 2.1 time: 0.423802 May 27 15:23:06.239746 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2717/5426] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:05 2022] GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073 => generated 1271 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:23:06.699321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-6ef0462a-1adc-4c6d-91bb-bfc231b31bdb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:23:06.700652 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-6ef0462a-1adc-4c6d-91bb-bfc231b31bdb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:23:06.701542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-6ef0462a-1adc-4c6d-91bb-bfc231b31bdb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:23:06.702197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-6ef0462a-1adc-4c6d-91bb-bfc231b31bdb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:23:06.703768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-6ef0462a-1adc-4c6d-91bb-bfc231b31bdb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:23:06.728358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ef0462a-1adc-4c6d-91bb-bfc231b31bdb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:06.729410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ef0462a-1adc-4c6d-91bb-bfc231b31bdb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:06.732917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ef0462a-1adc-4c6d-91bb-bfc231b31bdb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:06.733689 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ef0462a-1adc-4c6d-91bb-bfc231b31bdb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:06.802466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-6ef0462a-1adc-4c6d-91bb-bfc231b31bdb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Getting quotas for project 63b23f93ab7240e2bbfb8afe006da460. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:23:06.810388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-6ef0462a-1adc-4c6d-91bb-bfc231b31bdb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Getting quotas for user b4ce6d024ba549d494a7156a4a0ae974 and project 63b23f93ab7240e2bbfb8afe006da460. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:23:06.863183 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6ef0462a-1adc-4c6d-91bb-bfc231b31bdb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:23:06.866058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6ef0462a-1adc-4c6d-91bb-bfc231b31bdb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:23:06.947561 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6ef0462a-1adc-4c6d-91bb-bfc231b31bdb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.711458 May 27 15:23:06.948540 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2710/5427] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:23:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:23:06.960273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3501e159-079d-467e-8871-d1eae9b9423d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:06.963254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3501e159-079d-467e-8871-d1eae9b9423d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:07.093066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3501e159-079d-467e-8871-d1eae9b9423d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:07.107537 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3501e159-079d-467e-8871-d1eae9b9423d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1217 microversion: 2.1 time: 0.152731 May 27 15:23:07.119277 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2718/5428] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:06 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1217 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:07.257081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1d25d33f-04f6-4316-b9f1-da6344c58752 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:07.258431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1d25d33f-04f6-4316-b9f1-da6344c58752 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:07.279329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d25d33f-04f6-4316-b9f1-da6344c58752 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:07.280118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d25d33f-04f6-4316-b9f1-da6344c58752 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:07.281438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d25d33f-04f6-4316-b9f1-da6344c58752 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:07.282142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d25d33f-04f6-4316-b9f1-da6344c58752 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:07.638040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1d25d33f-04f6-4316-b9f1-da6344c58752 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:07.653753 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1d25d33f-04f6-4316-b9f1-da6344c58752 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073" status: 200 len: 1313 microversion: 2.1 time: 0.401893 May 27 15:23:07.664438 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2711/5429] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:07 2022] GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:08.129754 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e1cd4fcf-2dc0-49f5-85ef-3395b8cddbbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:08.130393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e1cd4fcf-2dc0-49f5-85ef-3395b8cddbbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:08.151466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1cd4fcf-2dc0-49f5-85ef-3395b8cddbbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:08.155413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1cd4fcf-2dc0-49f5-85ef-3395b8cddbbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:08.157624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1cd4fcf-2dc0-49f5-85ef-3395b8cddbbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:08.159354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1cd4fcf-2dc0-49f5-85ef-3395b8cddbbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:08.292283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e1cd4fcf-2dc0-49f5-85ef-3395b8cddbbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:08.313988 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e1cd4fcf-2dc0-49f5-85ef-3395b8cddbbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1221 microversion: 2.1 time: 0.190597 May 27 15:23:08.329350 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2719/5430] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:08 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1221 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:08.672811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-180c5a6c-c5eb-4f8d-a812-fec6c34afe47 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:08.674296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-180c5a6c-c5eb-4f8d-a812-fec6c34afe47 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:08.684394 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-180c5a6c-c5eb-4f8d-a812-fec6c34afe47 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:08.685734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-180c5a6c-c5eb-4f8d-a812-fec6c34afe47 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:08.687272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-180c5a6c-c5eb-4f8d-a812-fec6c34afe47 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:08.688013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-180c5a6c-c5eb-4f8d-a812-fec6c34afe47 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:09.205037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-180c5a6c-c5eb-4f8d-a812-fec6c34afe47 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:09.236260 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-180c5a6c-c5eb-4f8d-a812-fec6c34afe47 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073" status: 200 len: 1313 microversion: 2.1 time: 0.565807 May 27 15:23:09.239802 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2712/5431] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:08 2022] GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073 => generated 1313 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:09.335280 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e7a316db-aa47-4a3f-83ff-e1f4d25c716e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:09.340341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e7a316db-aa47-4a3f-83ff-e1f4d25c716e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:09.349061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e7a316db-aa47-4a3f-83ff-e1f4d25c716e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:09.349750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e7a316db-aa47-4a3f-83ff-e1f4d25c716e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:09.353734 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e7a316db-aa47-4a3f-83ff-e1f4d25c716e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:09.354519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e7a316db-aa47-4a3f-83ff-e1f4d25c716e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:09.588235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e7a316db-aa47-4a3f-83ff-e1f4d25c716e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:09.617275 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e7a316db-aa47-4a3f-83ff-e1f4d25c716e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1275 microversion: 2.1 time: 0.288195 May 27 15:23:09.618581 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2720/5432] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:09 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1275 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:10.058513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-b6e30192-746a-4e9d-a784-81e5fc2c2b69 req-b4391f18-d0bf-45ab-aa68-80983a0bb914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d12645a-f630-4ffd-9a89-cfac16f7b073", "tag": "faab2934-303a-4822-bbe9-ddeb58a28dea"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:10.088046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-b6e30192-746a-4e9d-a784-81e5fc2c2b69 req-b4391f18-d0bf-45ab-aa68-80983a0bb914 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:10.094863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-b6e30192-746a-4e9d-a784-81e5fc2c2b69 req-b4391f18-d0bf-45ab-aa68-80983a0bb914 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:10.149273 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-b6e30192-746a-4e9d-a784-81e5fc2c2b69 req-b4391f18-d0bf-45ab-aa68-80983a0bb914 service nova] Creating event network-changed:faab2934-303a-4822-bbe9-ddeb58a28dea for instance 2d12645a-f630-4ffd-9a89-cfac16f7b073 on n-h1-843621-1 May 27 15:23:10.166096 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-b6e30192-746a-4e9d-a784-81e5fc2c2b69 req-b4391f18-d0bf-45ab-aa68-80983a0bb914 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117014 May 27 15:23:10.168549 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2713/5433] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:23:10.256117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ff7e6402-698f-42d1-b0dd-0c080086b4e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:10.257154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ff7e6402-698f-42d1-b0dd-0c080086b4e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:10.269500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff7e6402-698f-42d1-b0dd-0c080086b4e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:10.269965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff7e6402-698f-42d1-b0dd-0c080086b4e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:10.270761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff7e6402-698f-42d1-b0dd-0c080086b4e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:10.271203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff7e6402-698f-42d1-b0dd-0c080086b4e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:10.638498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d4443696-b8b3-47ee-896e-39418bd8f0e5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:10.640269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d4443696-b8b3-47ee-896e-39418bd8f0e5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:10.681388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4443696-b8b3-47ee-896e-39418bd8f0e5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:10.681861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4443696-b8b3-47ee-896e-39418bd8f0e5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:10.683293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4443696-b8b3-47ee-896e-39418bd8f0e5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:10.683850 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4443696-b8b3-47ee-896e-39418bd8f0e5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:10.738311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ff7e6402-698f-42d1-b0dd-0c080086b4e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:10.749817 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ff7e6402-698f-42d1-b0dd-0c080086b4e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073" status: 200 len: 1313 microversion: 2.1 time: 0.497463 May 27 15:23:10.755017 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2721/5434] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:10 2022] GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073 => generated 1313 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:10.965058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d4443696-b8b3-47ee-896e-39418bd8f0e5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:10.997766 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d4443696-b8b3-47ee-896e-39418bd8f0e5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1275 microversion: 2.1 time: 0.365511 May 27 15:23:10.999081 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2714/5435] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:10 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1275 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:23:11.767921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9cdba9d8-b4e5-4e9e-b50b-757b898fd3a3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:11.768578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9cdba9d8-b4e5-4e9e-b50b-757b898fd3a3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:11.784163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9cdba9d8-b4e5-4e9e-b50b-757b898fd3a3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:11.788385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9cdba9d8-b4e5-4e9e-b50b-757b898fd3a3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:11.790069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9cdba9d8-b4e5-4e9e-b50b-757b898fd3a3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:11.792197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9cdba9d8-b4e5-4e9e-b50b-757b898fd3a3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:12.030273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-397c1299-c097-41e9-a0ce-00264352200d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:12.030985 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-397c1299-c097-41e9-a0ce-00264352200d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:12.047823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-397c1299-c097-41e9-a0ce-00264352200d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:12.061459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-397c1299-c097-41e9-a0ce-00264352200d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:12.062713 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-397c1299-c097-41e9-a0ce-00264352200d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:12.063354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-397c1299-c097-41e9-a0ce-00264352200d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:12.412029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:12.937827 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9cdba9d8-b4e5-4e9e-b50b-757b898fd3a3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:12.950049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-397c1299-c097-41e9-a0ce-00264352200d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:12.960377 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9cdba9d8-b4e5-4e9e-b50b-757b898fd3a3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073" status: 200 len: 1313 microversion: 2.1 time: 1.196993 May 27 15:23:12.961375 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-397c1299-c097-41e9-a0ce-00264352200d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1317 microversion: 2.1 time: 0.934549 May 27 15:23:12.962050 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2715/5436] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:12 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1317 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:12.971043 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2722/5437] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:11 2022] GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073 => generated 1313 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:13.768998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-e4926e43-eafa-4a36-93ca-88187cd01ff4 req-a1872f59-451d-4152-a77b-febe16fb9c90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3833c6b2-abd7-4b5a-8268-7582e7ee9554", "tag": "1de1e73d-e773-469f-b8b2-df33a48f8687"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:13.791798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e4926e43-eafa-4a36-93ca-88187cd01ff4 req-a1872f59-451d-4152-a77b-febe16fb9c90 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:13.792247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e4926e43-eafa-4a36-93ca-88187cd01ff4 req-a1872f59-451d-4152-a77b-febe16fb9c90 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:13.842809 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-e4926e43-eafa-4a36-93ca-88187cd01ff4 req-a1872f59-451d-4152-a77b-febe16fb9c90 service nova] Creating event network-changed:1de1e73d-e773-469f-b8b2-df33a48f8687 for instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 on n-h2-843621-1 May 27 15:23:13.857734 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-e4926e43-eafa-4a36-93ca-88187cd01ff4 req-a1872f59-451d-4152-a77b-febe16fb9c90 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089078 May 27 15:23:13.859313 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2716/5438] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:23:13.981723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0218a10a-e6ef-47c9-8471-975621e555d8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:13.982472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8c13deaf-eb0d-459b-983e-cd1f14ff5ccb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:13.982934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0218a10a-e6ef-47c9-8471-975621e555d8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:13.983712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8c13deaf-eb0d-459b-983e-cd1f14ff5ccb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:14.012574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0218a10a-e6ef-47c9-8471-975621e555d8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:14.012990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0218a10a-e6ef-47c9-8471-975621e555d8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:14.013794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0218a10a-e6ef-47c9-8471-975621e555d8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:14.014248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0218a10a-e6ef-47c9-8471-975621e555d8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:14.028600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c13deaf-eb0d-459b-983e-cd1f14ff5ccb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:14.029101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c13deaf-eb0d-459b-983e-cd1f14ff5ccb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:14.031479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c13deaf-eb0d-459b-983e-cd1f14ff5ccb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:14.032033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c13deaf-eb0d-459b-983e-cd1f14ff5ccb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:14.423023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0218a10a-e6ef-47c9-8471-975621e555d8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:14.443120 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0218a10a-e6ef-47c9-8471-975621e555d8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073" status: 200 len: 1313 microversion: 2.1 time: 0.467111 May 27 15:23:14.445292 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2717/5439] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:13 2022] GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073 => generated 1313 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:23:14.477540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8c13deaf-eb0d-459b-983e-cd1f14ff5ccb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:14.492484 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8c13deaf-eb0d-459b-983e-cd1f14ff5ccb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1317 microversion: 2.1 time: 0.517399 May 27 15:23:14.507832 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2723/5440] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:13 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1317 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:15.468096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-48b79d55-2dd9-480b-bb72-f5ad11d873ad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:15.468973 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-48b79d55-2dd9-480b-bb72-f5ad11d873ad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:15.494029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48b79d55-2dd9-480b-bb72-f5ad11d873ad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:15.494650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48b79d55-2dd9-480b-bb72-f5ad11d873ad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:15.497276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48b79d55-2dd9-480b-bb72-f5ad11d873ad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:15.498336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48b79d55-2dd9-480b-bb72-f5ad11d873ad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:15.517625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-78e8c9c2-9e7f-49ac-a778-ae96d71e7358 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:15.518517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-78e8c9c2-9e7f-49ac-a778-ae96d71e7358 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:15.553780 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-78e8c9c2-9e7f-49ac-a778-ae96d71e7358 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:15.561321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-78e8c9c2-9e7f-49ac-a778-ae96d71e7358 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:15.563048 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-78e8c9c2-9e7f-49ac-a778-ae96d71e7358 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:15.563661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-78e8c9c2-9e7f-49ac-a778-ae96d71e7358 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:15.889772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-48b79d55-2dd9-480b-bb72-f5ad11d873ad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:15.904333 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-48b79d55-2dd9-480b-bb72-f5ad11d873ad tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073" status: 200 len: 1313 microversion: 2.1 time: 0.440533 May 27 15:23:15.906052 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2718/5441] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:15 2022] GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073 => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:16.048098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-78e8c9c2-9e7f-49ac-a778-ae96d71e7358 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:16.062705 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-78e8c9c2-9e7f-49ac-a778-ae96d71e7358 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1317 microversion: 2.1 time: 0.550727 May 27 15:23:16.075800 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2724/5442] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:15 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:16.913313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4e0049c8-57e4-462d-ae6d-9e956cf19e23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:16.916320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4e0049c8-57e4-462d-ae6d-9e956cf19e23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:16.927510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d9068b12-4825-4086-afa7-8bf7e9967a02 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:16.928858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d9068b12-4825-4086-afa7-8bf7e9967a02 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:16.936989 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:16.948355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:16.953763 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=8 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:16.978330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9068b12-4825-4086-afa7-8bf7e9967a02 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:16.983259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9068b12-4825-4086-afa7-8bf7e9967a02 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:16.988733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e0049c8-57e4-462d-ae6d-9e956cf19e23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:16.991143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9068b12-4825-4086-afa7-8bf7e9967a02 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:16.994534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e0049c8-57e4-462d-ae6d-9e956cf19e23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:16.995314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9068b12-4825-4086-afa7-8bf7e9967a02 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:16.998115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e0049c8-57e4-462d-ae6d-9e956cf19e23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:17.006640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e0049c8-57e4-462d-ae6d-9e956cf19e23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:17.057387 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-4e0049c8-57e4-462d-ae6d-9e956cf19e23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] HTTP exception thrown: Instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 could not be found. May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4e0049c8-57e4-462d-ae6d-9e956cf19e23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Request method failure captured: May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 HTTP/1.1 May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOqO8KVR7bzq1xoLjXzLKv0jGOqOkF04cM8b_FyeHOV8wjUdo7LcGuyLc27U8rtMZ4Tx8DJ2dvOnNu1SxerG7uKkQJnKsTqpVjsMvJMqiMgOzvJ1G7GmmMLPDp1c3TCtYtsBkLf2gEtULm562ZhCKsQs-h_bvBej5OHYc34thW1M5ug May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 73054e8eb659476bb30aa574d7251758 May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AttachVolumeTestJSON-528269557 May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/73054e8eb659476bb30aa574d7251758"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/73054e8eb659476bb30aa574d7251758"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/73054e8eb659476bb30aa574d7251758"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_73054e8eb659476bb30aa574d7251758", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AttachVolumeTestJSON-528269557 May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 73054e8eb659476bb30aa574d7251758 May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AttachVolumeTestJSON-528269557 May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AttachVolumeTestJSON-528269557-project May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 6fdf02b03cac44cb89d2cf3b373fb9e1 May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AttachVolumeTestJSON-528269557-project May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 could not be found. May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '00d1ab07-fd5f-4c23-8ee7-fdc018c73376'} May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 could not be found. May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:23:17.078128 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:23:17.086519 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 could not be found. May 27 15:23:17.086519 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:17.086519 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:17.086519 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:17.086519 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:17.086519 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:17.086519 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:17.086519 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:17.086519 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:17.086519 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 could not be found. May 27 15:23:17.086519 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:17.092519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4e0049c8-57e4-462d-ae6d-9e956cf19e23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Returning 404 to user: Instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:17.099194 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4e0049c8-57e4-462d-ae6d-9e956cf19e23 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "DELETE /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 404 len: 111 microversion: 2.1 time: 0.191517 May 27 15:23:17.103307 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2719/5443] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:23:16 2022] DELETE /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:23:17.109431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dd291858-d9cf-4efa-995d-9b3f5126c73c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:17.119998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=8 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:17.121658 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dd291858-d9cf-4efa-995d-9b3f5126c73c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:17.155220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd291858-d9cf-4efa-995d-9b3f5126c73c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:17.158102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd291858-d9cf-4efa-995d-9b3f5126c73c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:17.160587 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd291858-d9cf-4efa-995d-9b3f5126c73c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:17.167051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dd291858-d9cf-4efa-995d-9b3f5126c73c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:18.295291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d9068b12-4825-4086-afa7-8bf7e9967a02 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:18.311191 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d9068b12-4825-4086-afa7-8bf7e9967a02 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073" status: 200 len: 1313 microversion: 2.1 time: 1.385807 May 27 15:23:18.314032 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2725/5444] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:16 2022] GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073 => generated 1313 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:18.324644 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6238b72f-a5f2-4d30-a837-a994a2a88198 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:18.327332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6238b72f-a5f2-4d30-a837-a994a2a88198 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] [instance: 00d1ab07-fd5f-4c23-8ee7-fdc018c73376] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:18.348483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6238b72f-a5f2-4d30-a837-a994a2a88198 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:18.349866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6238b72f-a5f2-4d30-a837-a994a2a88198 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:18.352045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6238b72f-a5f2-4d30-a837-a994a2a88198 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:18.352779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6238b72f-a5f2-4d30-a837-a994a2a88198 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:18.387070 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-6238b72f-a5f2-4d30-a837-a994a2a88198 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] HTTP exception thrown: Instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 could not be found. May 27 15:23:18.389226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dd291858-d9cf-4efa-995d-9b3f5126c73c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6238b72f-a5f2-4d30-a837-a994a2a88198 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Request method failure captured: May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 HTTP/1.1 May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOqO8KVR7bzq1xoLjXzLKv0jGOqOkF04cM8b_FyeHOV8wjUdo7LcGuyLc27U8rtMZ4Tx8DJ2dvOnNu1SxerG7uKkQJnKsTqpVjsMvJMqiMgOzvJ1G7GmmMLPDp1c3TCtYtsBkLf2gEtULm562ZhCKsQs-h_bvBej5OHYc34thW1M5ug May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 73054e8eb659476bb30aa574d7251758 May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-AttachVolumeTestJSON-528269557 May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/73054e8eb659476bb30aa574d7251758"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/73054e8eb659476bb30aa574d7251758"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/73054e8eb659476bb30aa574d7251758"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_73054e8eb659476bb30aa574d7251758", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-AttachVolumeTestJSON-528269557 May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 73054e8eb659476bb30aa574d7251758 May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-AttachVolumeTestJSON-528269557 May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-AttachVolumeTestJSON-528269557-project May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 6fdf02b03cac44cb89d2cf3b373fb9e1 May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-AttachVolumeTestJSON-528269557-project May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 could not be found. May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '00d1ab07-fd5f-4c23-8ee7-fdc018c73376'} May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 could not be found. May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 could not be found. May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:18.392825 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:18.399157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:18.399157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:18.399157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:18.399157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:18.399157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:18.399157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 could not be found. May 27 15:23:18.399157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:18.404160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6238b72f-a5f2-4d30-a837-a994a2a88198 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] Returning 404 to user: Instance 00d1ab07-fd5f-4c23-8ee7-fdc018c73376 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:18.405666 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6238b72f-a5f2-4d30-a837-a994a2a88198 tempest-AttachVolumeTestJSON-528269557 tempest-AttachVolumeTestJSON-528269557-project] 10.222.0.13 "GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376" status: 404 len: 111 microversion: 2.1 time: 0.088558 May 27 15:23:18.409106 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2726/5445] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:18 2022] GET /compute/v2.1/servers/00d1ab07-fd5f-4c23-8ee7-fdc018c73376 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:23:18.420894 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dd291858-d9cf-4efa-995d-9b3f5126c73c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1317 microversion: 2.1 time: 1.315979 May 27 15:23:18.424922 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-3a1ceefd-2cb2-45f3-93bf-5f4b8a710de1 req-77513f86-9a82-4a4a-b8b8-32162709c896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d12645a-f630-4ffd-9a89-cfac16f7b073", "name": "network-vif-plugged", "status": "completed", "tag": "faab2934-303a-4822-bbe9-ddeb58a28dea"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:18.425902 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2720/5446] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:17 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1317 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:18.457233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3a1ceefd-2cb2-45f3-93bf-5f4b8a710de1 req-77513f86-9a82-4a4a-b8b8-32162709c896 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:18.458742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3a1ceefd-2cb2-45f3-93bf-5f4b8a710de1 req-77513f86-9a82-4a4a-b8b8-32162709c896 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:18.488495 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-3a1ceefd-2cb2-45f3-93bf-5f4b8a710de1 req-77513f86-9a82-4a4a-b8b8-32162709c896 service nova] Creating event network-vif-plugged:faab2934-303a-4822-bbe9-ddeb58a28dea for instance 2d12645a-f630-4ffd-9a89-cfac16f7b073 on n-h1-843621-1 May 27 15:23:18.515132 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-3a1ceefd-2cb2-45f3-93bf-5f4b8a710de1 req-77513f86-9a82-4a4a-b8b8-32162709c896 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104521 May 27 15:23:18.533394 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2727/5447] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:23:19.334916 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6174fd96-2920-4e1c-8093-bb22e49dbfbf tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:19.335598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6174fd96-2920-4e1c-8093-bb22e49dbfbf tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:19.360220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6174fd96-2920-4e1c-8093-bb22e49dbfbf tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:19.360847 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6174fd96-2920-4e1c-8093-bb22e49dbfbf tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:19.367986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6174fd96-2920-4e1c-8093-bb22e49dbfbf tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:19.368466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6174fd96-2920-4e1c-8093-bb22e49dbfbf tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:19.448881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-48ca99c9-55e0-4427-a44d-f29dfa510de2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:19.450306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-48ca99c9-55e0-4427-a44d-f29dfa510de2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:19.472071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-48ca99c9-55e0-4427-a44d-f29dfa510de2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:19.472688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-48ca99c9-55e0-4427-a44d-f29dfa510de2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:19.479819 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-48ca99c9-55e0-4427-a44d-f29dfa510de2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:19.483618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-48ca99c9-55e0-4427-a44d-f29dfa510de2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:20.029223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6174fd96-2920-4e1c-8093-bb22e49dbfbf tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:20.037358 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6174fd96-2920-4e1c-8093-bb22e49dbfbf tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073" status: 200 len: 1313 microversion: 2.1 time: 0.707136 May 27 15:23:20.045089 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2721/5448] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:19 2022] GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073 => generated 1313 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:20.129321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-48ca99c9-55e0-4427-a44d-f29dfa510de2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:20.138755 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-48ca99c9-55e0-4427-a44d-f29dfa510de2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1317 microversion: 2.1 time: 0.698337 May 27 15:23:20.154224 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2728/5449] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:19 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1317 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:20.899826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-82583710-81d3-4525-ada5-7414b7e49b77 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:20.900645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-82583710-81d3-4525-ada5-7414b7e49b77 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:20.915410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82583710-81d3-4525-ada5-7414b7e49b77 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:20.917971 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82583710-81d3-4525-ada5-7414b7e49b77 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:20.919460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82583710-81d3-4525-ada5-7414b7e49b77 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:20.920914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82583710-81d3-4525-ada5-7414b7e49b77 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:20.951313 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-82583710-81d3-4525-ada5-7414b7e49b77 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] HTTP exception thrown: Instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 could not be found. May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-82583710-81d3-4525-ada5-7414b7e49b77 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Request method failure captured: May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 HTTP/1.1 May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOrMyApwEozUDyrEIfAo_5Y4g_1HkChw1SWcTHKZFCS59hbDZ-tG27fBruZ89SDVYIwJf1049Wu3YE4lY2cORLx6FEdOR4uGmA8kqdyyKM11lovRtNDp2ouZkjSiDmO17gaqasURXD2cDNTsBoZha7a41XrY22c7gADFUiZI3zmSCNg May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a9a825b1ade46e3a702ae19c7c53f6b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 59f88a11fc4b4bf6b4a807ccffee1fab May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 could not be found. May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'eb9b7c54-a210-490f-bf50-f6c1ece7ae55'} May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 could not be found. May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:23:20.955458 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:23:20.962035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 could not be found. May 27 15:23:20.962035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:20.962035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:20.962035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:20.962035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:20.962035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:20.962035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:20.962035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:20.962035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:20.962035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 could not be found. May 27 15:23:20.962035 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:20.966414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-82583710-81d3-4525-ada5-7414b7e49b77 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Returning 404 to user: Instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:20.968987 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-82583710-81d3-4525-ada5-7414b7e49b77 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "DELETE /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 404 len: 111 microversion: 2.1 time: 0.073027 May 27 15:23:20.969854 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2722/5450] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:23:20 2022] DELETE /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:23:20.982591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-501803d2-7478-4959-8441-4c410c277589 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:20.983808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-501803d2-7478-4959-8441-4c410c277589 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: eb9b7c54-a210-490f-bf50-f6c1ece7ae55] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:21.009008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-501803d2-7478-4959-8441-4c410c277589 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:21.009641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-501803d2-7478-4959-8441-4c410c277589 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:21.012290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-501803d2-7478-4959-8441-4c410c277589 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:21.027620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-501803d2-7478-4959-8441-4c410c277589 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:21.055867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d3b15db4-281e-4132-b3a5-28f8097aa53f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:21.056613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d3b15db4-281e-4132-b3a5-28f8097aa53f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:21.064567 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d3b15db4-281e-4132-b3a5-28f8097aa53f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:21.065154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d3b15db4-281e-4132-b3a5-28f8097aa53f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:21.071449 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-501803d2-7478-4959-8441-4c410c277589 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] HTTP exception thrown: Instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 could not be found. May 27 15:23:21.077122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d3b15db4-281e-4132-b3a5-28f8097aa53f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:21.077898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d3b15db4-281e-4132-b3a5-28f8097aa53f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-501803d2-7478-4959-8441-4c410c277589 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Request method failure captured: May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 HTTP/1.1 May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOrMyApwEozUDyrEIfAo_5Y4g_1HkChw1SWcTHKZFCS59hbDZ-tG27fBruZ89SDVYIwJf1049Wu3YE4lY2cORLx6FEdOR4uGmA8kqdyyKM11lovRtNDp2ouZkjSiDmO17gaqasURXD2cDNTsBoZha7a41XrY22c7gADFUiZI3zmSCNg May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a9a825b1ade46e3a702ae19c7c53f6b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 59f88a11fc4b4bf6b4a807ccffee1fab May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 could not be found. May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'eb9b7c54-a210-490f-bf50-f6c1ece7ae55'} May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 could not be found. May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 could not be found. May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:21.083482 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:21.094978 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:21.094978 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:21.094978 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:21.094978 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:21.094978 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:21.094978 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 could not be found. May 27 15:23:21.094978 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:21.098973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-501803d2-7478-4959-8441-4c410c277589 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Returning 404 to user: Instance eb9b7c54-a210-490f-bf50-f6c1ece7ae55 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:21.099858 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-501803d2-7478-4959-8441-4c410c277589 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55" status: 404 len: 111 microversion: 2.1 time: 0.124752 May 27 15:23:21.108099 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2729/5451] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:20 2022] GET /compute/v2.1/servers/eb9b7c54-a210-490f-bf50-f6c1ece7ae55 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:23:21.131101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-a81f38db-4050-4c78-a316-a3f72341206b req-c440072c-6b9f-4422-9ca0-a049e4828682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3833c6b2-abd7-4b5a-8268-7582e7ee9554", "name": "network-vif-plugged", "status": "completed", "tag": "1de1e73d-e773-469f-b8b2-df33a48f8687"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:21.160421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-a81f38db-4050-4c78-a316-a3f72341206b req-c440072c-6b9f-4422-9ca0-a049e4828682 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:21.160916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-a81f38db-4050-4c78-a316-a3f72341206b req-c440072c-6b9f-4422-9ca0-a049e4828682 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:21.201025 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-a81f38db-4050-4c78-a316-a3f72341206b req-c440072c-6b9f-4422-9ca0-a049e4828682 service nova] Creating event network-vif-plugged:1de1e73d-e773-469f-b8b2-df33a48f8687 for instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 on n-h2-843621-1 May 27 15:23:21.214572 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-a81f38db-4050-4c78-a316-a3f72341206b req-c440072c-6b9f-4422-9ca0-a049e4828682 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102365 May 27 15:23:21.215439 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2730/5452] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:23:21.257515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fe92be10-b825-40a4-813e-d11044634e09 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:21.258983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fe92be10-b825-40a4-813e-d11044634e09 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:21.299866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe92be10-b825-40a4-813e-d11044634e09 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:21.303795 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe92be10-b825-40a4-813e-d11044634e09 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:21.307396 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe92be10-b825-40a4-813e-d11044634e09 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:21.308378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe92be10-b825-40a4-813e-d11044634e09 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:22.591658 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d3b15db4-281e-4132-b3a5-28f8097aa53f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:22.599873 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d3b15db4-281e-4132-b3a5-28f8097aa53f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073" status: 200 len: 1500 microversion: 2.1 time: 1.547855 May 27 15:23:22.606390 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2723/5453] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:21 2022] GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073 => generated 1500 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:23:22.634029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a50099f9-3f59-47a5-83e1-61fb1250ba38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:22.635010 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a50099f9-3f59-47a5-83e1-61fb1250ba38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:22.648545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a50099f9-3f59-47a5-83e1-61fb1250ba38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:22.651361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a50099f9-3f59-47a5-83e1-61fb1250ba38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:22.652267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a50099f9-3f59-47a5-83e1-61fb1250ba38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:22.652750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a50099f9-3f59-47a5-83e1-61fb1250ba38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:22.678055 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fe92be10-b825-40a4-813e-d11044634e09 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:22.689637 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:22.705710 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fe92be10-b825-40a4-813e-d11044634e09 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1317 microversion: 2.1 time: 1.476270 May 27 15:23:22.707438 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2731/5454] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:21 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1317 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:22.729062 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a50099f9-3f59-47a5-83e1-61fb1250ba38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action" status: 200 len: 14 microversion: 2.1 time: 0.099565 May 27 15:23:22.730624 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2724/5455] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:23:22 2022] POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 15:23:23.728246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f3265cb3-a95b-4b03-b696-775c48cc24d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:23.729103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f3265cb3-a95b-4b03-b696-775c48cc24d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:23.740326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3265cb3-a95b-4b03-b696-775c48cc24d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:23.740738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3265cb3-a95b-4b03-b696-775c48cc24d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:23.743308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-436e3c0e-9e09-4bff-bf7f-cc81ecdf79f7 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:23.744538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-436e3c0e-9e09-4bff-bf7f-cc81ecdf79f7 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:23.745822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3265cb3-a95b-4b03-b696-775c48cc24d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:23.746357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3265cb3-a95b-4b03-b696-775c48cc24d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:23.768753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-436e3c0e-9e09-4bff-bf7f-cc81ecdf79f7 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:23.769621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-436e3c0e-9e09-4bff-bf7f-cc81ecdf79f7 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:23.772252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-436e3c0e-9e09-4bff-bf7f-cc81ecdf79f7 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:23.775295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-436e3c0e-9e09-4bff-bf7f-cc81ecdf79f7 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:23.902017 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-436e3c0e-9e09-4bff-bf7f-cc81ecdf79f7 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action" status: 200 len: 14 microversion: 2.1 time: 0.164118 May 27 15:23:23.903316 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2725/5456] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:23:23 2022] POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:23:24.235737 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f3265cb3-a95b-4b03-b696-775c48cc24d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:24.251774 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f3265cb3-a95b-4b03-b696-775c48cc24d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.520730 May 27 15:23:24.268703 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2732/5457] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:23 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:24.524907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4b4f4d53-b9b0-4b03-8143-372772b03727 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1350512229", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:24.661115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-4b4f4d53-b9b0-4b03-8143-372772b03727 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] validate_networks() for [('640304d1-fbbc-473c-9acb-60ed77473841', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:23:24.914153 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-33013270-01cc-4811-8a7b-c7b6aceba0a8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:24.916172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-33013270-01cc-4811-8a7b-c7b6aceba0a8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:24.931923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-33013270-01cc-4811-8a7b-c7b6aceba0a8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:24.933517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-33013270-01cc-4811-8a7b-c7b6aceba0a8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:24.936256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-33013270-01cc-4811-8a7b-c7b6aceba0a8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:24.939353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-33013270-01cc-4811-8a7b-c7b6aceba0a8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:25.039464 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-33013270-01cc-4811-8a7b-c7b6aceba0a8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action" status: 200 len: 14 microversion: 2.1 time: 0.129986 May 27 15:23:25.048086 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2733/5458] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:23:24 2022] POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 15:23:26.070994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a8407112-b126-4848-bc77-5464662ab51d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:26.076388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a8407112-b126-4848-bc77-5464662ab51d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:26.089914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a8407112-b126-4848-bc77-5464662ab51d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:26.091036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a8407112-b126-4848-bc77-5464662ab51d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:26.092339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a8407112-b126-4848-bc77-5464662ab51d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:26.093040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a8407112-b126-4848-bc77-5464662ab51d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:26.182342 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a8407112-b126-4848-bc77-5464662ab51d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action" status: 200 len: 14 microversion: 2.1 time: 0.123950 May 27 15:23:26.183939 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2734/5459] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:23:26 2022] POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:23:26.488881 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-4b4f4d53-b9b0-4b03-8143-372772b03727 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:23:26.489644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-4b4f4d53-b9b0-4b03-8143-372772b03727 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:23:26.490076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-4b4f4d53-b9b0-4b03-8143-372772b03727 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:23:26.490552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-4b4f4d53-b9b0-4b03-8143-372772b03727 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:23:26.491008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-4b4f4d53-b9b0-4b03-8143-372772b03727 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:23:26.510900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b4f4d53-b9b0-4b03-8143-372772b03727 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:26.511382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b4f4d53-b9b0-4b03-8143-372772b03727 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:26.512205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b4f4d53-b9b0-4b03-8143-372772b03727 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:26.512654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4b4f4d53-b9b0-4b03-8143-372772b03727 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:26.553891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-4b4f4d53-b9b0-4b03-8143-372772b03727 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Getting quotas for project 63b23f93ab7240e2bbfb8afe006da460. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:23:26.561873 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-4b4f4d53-b9b0-4b03-8143-372772b03727 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Getting quotas for user b4ce6d024ba549d494a7156a4a0ae974 and project 63b23f93ab7240e2bbfb8afe006da460. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:23:26.585939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4b4f4d53-b9b0-4b03-8143-372772b03727 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:23:26.591127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4b4f4d53-b9b0-4b03-8143-372772b03727 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:23:26.692119 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4b4f4d53-b9b0-4b03-8143-372772b03727 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.175219 May 27 15:23:26.693813 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2726/5460] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:23:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:23:26.715128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-39b2a29a-d255-48e9-b1e2-1960e77a445c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:26.716036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-39b2a29a-d255-48e9-b1e2-1960e77a445c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:27.125026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-39b2a29a-d255-48e9-b1e2-1960e77a445c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:27.134414 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-39b2a29a-d255-48e9-b1e2-1960e77a445c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09" status: 200 len: 1217 microversion: 2.1 time: 0.427978 May 27 15:23:27.140167 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2735/5461] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:26 2022] GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09 => generated 1217 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:27.198420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3034da2c-23c8-4565-8832-92352ec0eb5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:27.199591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3034da2c-23c8-4565-8832-92352ec0eb5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:27.214755 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3034da2c-23c8-4565-8832-92352ec0eb5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:27.215216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3034da2c-23c8-4565-8832-92352ec0eb5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:27.218497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3034da2c-23c8-4565-8832-92352ec0eb5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:27.220712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3034da2c-23c8-4565-8832-92352ec0eb5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:27.389444 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3034da2c-23c8-4565-8832-92352ec0eb5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action" status: 200 len: 14 microversion: 2.1 time: 0.197303 May 27 15:23:27.393085 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2727/5462] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:23:27 2022] POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action => generated 14 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:23:28.157247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b904e2d5-7ea3-4cdf-8793-829b6badce2e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:28.158232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b904e2d5-7ea3-4cdf-8793-829b6badce2e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:28.176666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b904e2d5-7ea3-4cdf-8793-829b6badce2e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:28.177159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b904e2d5-7ea3-4cdf-8793-829b6badce2e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:28.178063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b904e2d5-7ea3-4cdf-8793-829b6badce2e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:28.178514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b904e2d5-7ea3-4cdf-8793-829b6badce2e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:28.407982 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6cbb6f77-a530-47d7-8129-89366f280846 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:28.409375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6cbb6f77-a530-47d7-8129-89366f280846 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:28.450959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6cbb6f77-a530-47d7-8129-89366f280846 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:28.452301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6cbb6f77-a530-47d7-8129-89366f280846 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:28.456484 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6cbb6f77-a530-47d7-8129-89366f280846 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:28.457440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6cbb6f77-a530-47d7-8129-89366f280846 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:28.515039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b904e2d5-7ea3-4cdf-8793-829b6badce2e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:28.541096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:28.544644 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b904e2d5-7ea3-4cdf-8793-829b6badce2e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09" status: 200 len: 1221 microversion: 2.1 time: 0.389642 May 27 15:23:28.554295 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2736/5463] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:28 2022] GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09 => generated 1221 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:28.579712 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6cbb6f77-a530-47d7-8129-89366f280846 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action" status: 200 len: 14 microversion: 2.1 time: 0.180470 May 27 15:23:28.587170 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2728/5464] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:23:28 2022] POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action => generated 14 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:23:29.569056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-38d1fef0-af1b-40a7-ab1d-1692b5ead5fc tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:29.571353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-38d1fef0-af1b-40a7-ab1d-1692b5ead5fc tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:29.593075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-68639bc7-9ede-4d37-a828-41527d4a0bea tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:29.594360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38d1fef0-af1b-40a7-ab1d-1692b5ead5fc tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:29.594924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-68639bc7-9ede-4d37-a828-41527d4a0bea tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:29.595140 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38d1fef0-af1b-40a7-ab1d-1692b5ead5fc tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:29.601318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38d1fef0-af1b-40a7-ab1d-1692b5ead5fc tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:29.604373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38d1fef0-af1b-40a7-ab1d-1692b5ead5fc tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:29.617485 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68639bc7-9ede-4d37-a828-41527d4a0bea tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:29.617982 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68639bc7-9ede-4d37-a828-41527d4a0bea tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:29.618786 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68639bc7-9ede-4d37-a828-41527d4a0bea tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:29.619426 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68639bc7-9ede-4d37-a828-41527d4a0bea tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:29.688933 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-68639bc7-9ede-4d37-a828-41527d4a0bea tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action" status: 200 len: 14 microversion: 2.1 time: 0.099844 May 27 15:23:29.690254 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2729/5465] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:23:29 2022] POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 15:23:29.735814 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-38d1fef0-af1b-40a7-ab1d-1692b5ead5fc tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:29.744819 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-38d1fef0-af1b-40a7-ab1d-1692b5ead5fc tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09" status: 200 len: 1275 microversion: 2.1 time: 0.181082 May 27 15:23:29.745610 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2737/5466] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:29 2022] GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09 => generated 1275 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:30.703671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cc976bf7-30c5-49b5-896d-eda9041cd657 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:30.704654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cc976bf7-30c5-49b5-896d-eda9041cd657 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:30.707675 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:30.745477 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cc976bf7-30c5-49b5-896d-eda9041cd657 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:30.746388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cc976bf7-30c5-49b5-896d-eda9041cd657 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:30.748320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cc976bf7-30c5-49b5-896d-eda9041cd657 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:30.749201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cc976bf7-30c5-49b5-896d-eda9041cd657 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:30.763985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0412c063-0a34-4e0f-8b25-1a0b74f60394 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:30.764629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0412c063-0a34-4e0f-8b25-1a0b74f60394 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:30.775987 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0412c063-0a34-4e0f-8b25-1a0b74f60394 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:30.781425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0412c063-0a34-4e0f-8b25-1a0b74f60394 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:30.782571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0412c063-0a34-4e0f-8b25-1a0b74f60394 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:30.784620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0412c063-0a34-4e0f-8b25-1a0b74f60394 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:30.839820 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cc976bf7-30c5-49b5-896d-eda9041cd657 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action" status: 200 len: 14 microversion: 2.1 time: 0.141519 May 27 15:23:30.846284 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2730/5467] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:23:30 2022] POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:23:31.561149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0412c063-0a34-4e0f-8b25-1a0b74f60394 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:31.572487 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0412c063-0a34-4e0f-8b25-1a0b74f60394 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09" status: 200 len: 1317 microversion: 2.1 time: 0.812557 May 27 15:23:31.573281 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2738/5468] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:30 2022] GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09 => generated 1317 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:31.854819 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1bf5ba39-659c-400c-afdc-af7ddedf5027 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:31.855927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1bf5ba39-659c-400c-afdc-af7ddedf5027 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:31.878664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1bf5ba39-659c-400c-afdc-af7ddedf5027 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:31.879125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1bf5ba39-659c-400c-afdc-af7ddedf5027 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:31.879916 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1bf5ba39-659c-400c-afdc-af7ddedf5027 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:31.880368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1bf5ba39-659c-400c-afdc-af7ddedf5027 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:31.972869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-1796f7e4-41eb-48ea-817c-c04cb918e873 req-d6daf783-861e-4088-bcbd-b641598c1bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "900d6720-34fc-4af9-bee0-76fabedb8b09", "tag": "3514e3f5-47fd-4171-89b8-9c7464f2997b"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:32.002692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-1796f7e4-41eb-48ea-817c-c04cb918e873 req-d6daf783-861e-4088-bcbd-b641598c1bd7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:32.003063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-1796f7e4-41eb-48ea-817c-c04cb918e873 req-d6daf783-861e-4088-bcbd-b641598c1bd7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:32.030508 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1bf5ba39-659c-400c-afdc-af7ddedf5027 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action" status: 200 len: 14 microversion: 2.1 time: 0.180486 May 27 15:23:32.034967 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2731/5469] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:23:31 2022] POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:23:32.049692 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-1796f7e4-41eb-48ea-817c-c04cb918e873 req-d6daf783-861e-4088-bcbd-b641598c1bd7 service nova] Creating event network-changed:3514e3f5-47fd-4171-89b8-9c7464f2997b for instance 900d6720-34fc-4af9-bee0-76fabedb8b09 on n-h2-843621-1 May 27 15:23:32.061843 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-1796f7e4-41eb-48ea-817c-c04cb918e873 req-d6daf783-861e-4088-bcbd-b641598c1bd7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093090 May 27 15:23:32.063461 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2739/5470] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:23:32.590304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a8209b33-ca21-4350-8bb7-02418a6e6fbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:32.591027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a8209b33-ca21-4350-8bb7-02418a6e6fbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:32.611915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a8209b33-ca21-4350-8bb7-02418a6e6fbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:32.612395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a8209b33-ca21-4350-8bb7-02418a6e6fbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:32.613244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a8209b33-ca21-4350-8bb7-02418a6e6fbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:32.613692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a8209b33-ca21-4350-8bb7-02418a6e6fbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:32.726143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-025f69d3-05b9-42cf-828e-1d9d589725a1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:32.726969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-025f69d3-05b9-42cf-828e-1d9d589725a1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:32.738280 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-025f69d3-05b9-42cf-828e-1d9d589725a1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:32.750464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-025f69d3-05b9-42cf-828e-1d9d589725a1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:32.752548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-025f69d3-05b9-42cf-828e-1d9d589725a1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:32.753235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-025f69d3-05b9-42cf-828e-1d9d589725a1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:32.802379 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-025f69d3-05b9-42cf-828e-1d9d589725a1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] HTTP exception thrown: Instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f could not be found. May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-025f69d3-05b9-42cf-828e-1d9d589725a1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Request method failure captured: May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f HTTP/1.1 May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOrMyApwEozUDyrEIfAo_5Y4g_1HkChw1SWcTHKZFCS59hbDZ-tG27fBruZ89SDVYIwJf1049Wu3YE4lY2cORLx6FEdOR4uGmA8kqdyyKM11lovRtNDp2ouZkjSiDmO17gaqasURXD2cDNTsBoZha7a41XrY22c7gADFUiZI3zmSCNg May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a9a825b1ade46e3a702ae19c7c53f6b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 59f88a11fc4b4bf6b4a807ccffee1fab May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f could not be found. May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '9b014831-b34a-4451-9bf7-f9a5d3dbb17f'} May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f could not be found. May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:23:32.804565 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:23:32.809279 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f could not be found. May 27 15:23:32.809279 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:32.809279 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:32.809279 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:32.809279 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:32.809279 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:32.809279 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:32.809279 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:32.809279 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:32.809279 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f could not be found. May 27 15:23:32.809279 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:32.814564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-025f69d3-05b9-42cf-828e-1d9d589725a1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Returning 404 to user: Instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:32.814937 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-025f69d3-05b9-42cf-828e-1d9d589725a1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 404 len: 111 microversion: 2.1 time: 0.093758 May 27 15:23:32.815699 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2740/5471] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:23:32 2022] DELETE /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:23:32.828206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-22fc4ace-73f4-4e92-9cf7-df4db79d4511 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:32.831065 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-22fc4ace-73f4-4e92-9cf7-df4db79d4511 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 9b014831-b34a-4451-9bf7-f9a5d3dbb17f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:32.850071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-22fc4ace-73f4-4e92-9cf7-df4db79d4511 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:32.850071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-22fc4ace-73f4-4e92-9cf7-df4db79d4511 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:32.864614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-22fc4ace-73f4-4e92-9cf7-df4db79d4511 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:32.870827 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-22fc4ace-73f4-4e92-9cf7-df4db79d4511 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:32.938272 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-22fc4ace-73f4-4e92-9cf7-df4db79d4511 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] HTTP exception thrown: Instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f could not be found. May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-22fc4ace-73f4-4e92-9cf7-df4db79d4511 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Request method failure captured: May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f HTTP/1.1 May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOrMyApwEozUDyrEIfAo_5Y4g_1HkChw1SWcTHKZFCS59hbDZ-tG27fBruZ89SDVYIwJf1049Wu3YE4lY2cORLx6FEdOR4uGmA8kqdyyKM11lovRtNDp2ouZkjSiDmO17gaqasURXD2cDNTsBoZha7a41XrY22c7gADFUiZI3zmSCNg May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a9a825b1ade46e3a702ae19c7c53f6b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 59f88a11fc4b4bf6b4a807ccffee1fab May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f could not be found. May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '9b014831-b34a-4451-9bf7-f9a5d3dbb17f'} May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f could not be found. May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f could not be found. May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:32.940029 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:32.945606 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:32.945606 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:32.945606 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:32.945606 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:32.945606 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:32.945606 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f could not be found. May 27 15:23:32.945606 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:32.945606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-22fc4ace-73f4-4e92-9cf7-df4db79d4511 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Returning 404 to user: Instance 9b014831-b34a-4451-9bf7-f9a5d3dbb17f could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:32.945606 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-22fc4ace-73f4-4e92-9cf7-df4db79d4511 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f" status: 404 len: 111 microversion: 2.1 time: 0.119640 May 27 15:23:32.949639 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2741/5472] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:32 2022] GET /compute/v2.1/servers/9b014831-b34a-4451-9bf7-f9a5d3dbb17f => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:23:32.955933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b2bcd08f-43d5-47fc-a6f8-be3a7ecb6362 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:32.956439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b2bcd08f-43d5-47fc-a6f8-be3a7ecb6362 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:32.972644 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b2bcd08f-43d5-47fc-a6f8-be3a7ecb6362 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:32.975096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b2bcd08f-43d5-47fc-a6f8-be3a7ecb6362 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:32.977005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b2bcd08f-43d5-47fc-a6f8-be3a7ecb6362 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:32.977688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b2bcd08f-43d5-47fc-a6f8-be3a7ecb6362 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:32.995518 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-b2bcd08f-43d5-47fc-a6f8-be3a7ecb6362 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] HTTP exception thrown: Instance 04a07558-123a-448c-ad41-1da4feffb611 could not be found. May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b2bcd08f-43d5-47fc-a6f8-be3a7ecb6362 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Request method failure captured: May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 HTTP/1.1 May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOrMyApwEozUDyrEIfAo_5Y4g_1HkChw1SWcTHKZFCS59hbDZ-tG27fBruZ89SDVYIwJf1049Wu3YE4lY2cORLx6FEdOR4uGmA8kqdyyKM11lovRtNDp2ouZkjSiDmO17gaqasURXD2cDNTsBoZha7a41XrY22c7gADFUiZI3zmSCNg May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a9a825b1ade46e3a702ae19c7c53f6b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 59f88a11fc4b4bf6b4a807ccffee1fab May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 04a07558-123a-448c-ad41-1da4feffb611 could not be found. May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '04a07558-123a-448c-ad41-1da4feffb611'} May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04a07558-123a-448c-ad41-1da4feffb611 could not be found. May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:23:32.997520 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:23:33.001691 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04a07558-123a-448c-ad41-1da4feffb611 could not be found. May 27 15:23:33.001691 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:33.001691 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:33.001691 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:33.001691 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:33.001691 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:33.001691 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:33.001691 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:33.001691 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:33.001691 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04a07558-123a-448c-ad41-1da4feffb611 could not be found. May 27 15:23:33.001691 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:33.004868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b2bcd08f-43d5-47fc-a6f8-be3a7ecb6362 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Returning 404 to user: Instance 04a07558-123a-448c-ad41-1da4feffb611 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:33.006468 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b2bcd08f-43d5-47fc-a6f8-be3a7ecb6362 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "DELETE /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 404 len: 111 microversion: 2.1 time: 0.055780 May 27 15:23:33.007799 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2742/5473] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:23:32 2022] DELETE /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:23:33.019000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2ff5e3bb-7bf5-45ab-92dc-feb8dc9507c1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:33.019561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2ff5e3bb-7bf5-45ab-92dc-feb8dc9507c1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 04a07558-123a-448c-ad41-1da4feffb611] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:33.029131 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2ff5e3bb-7bf5-45ab-92dc-feb8dc9507c1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:33.029629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2ff5e3bb-7bf5-45ab-92dc-feb8dc9507c1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:33.030975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2ff5e3bb-7bf5-45ab-92dc-feb8dc9507c1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:33.031449 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2ff5e3bb-7bf5-45ab-92dc-feb8dc9507c1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:33.054102 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-2ff5e3bb-7bf5-45ab-92dc-feb8dc9507c1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] HTTP exception thrown: Instance 04a07558-123a-448c-ad41-1da4feffb611 could not be found. May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2ff5e3bb-7bf5-45ab-92dc-feb8dc9507c1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Request method failure captured: May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 HTTP/1.1 May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOrMyApwEozUDyrEIfAo_5Y4g_1HkChw1SWcTHKZFCS59hbDZ-tG27fBruZ89SDVYIwJf1049Wu3YE4lY2cORLx6FEdOR4uGmA8kqdyyKM11lovRtNDp2ouZkjSiDmO17gaqasURXD2cDNTsBoZha7a41XrY22c7gADFUiZI3zmSCNg May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a9a825b1ade46e3a702ae19c7c53f6b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 59f88a11fc4b4bf6b4a807ccffee1fab May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 04a07558-123a-448c-ad41-1da4feffb611 could not be found. May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '04a07558-123a-448c-ad41-1da4feffb611'} May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04a07558-123a-448c-ad41-1da4feffb611 could not be found. May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04a07558-123a-448c-ad41-1da4feffb611 could not be found. May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:33.056511 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:33.060473 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:33.060473 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:33.060473 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:33.060473 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:33.060473 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:33.060473 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04a07558-123a-448c-ad41-1da4feffb611 could not be found. May 27 15:23:33.060473 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:33.060473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2ff5e3bb-7bf5-45ab-92dc-feb8dc9507c1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Returning 404 to user: Instance 04a07558-123a-448c-ad41-1da4feffb611 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:33.060473 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2ff5e3bb-7bf5-45ab-92dc-feb8dc9507c1 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611" status: 404 len: 111 microversion: 2.1 time: 0.044178 May 27 15:23:33.073258 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2743/5474] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:33 2022] GET /compute/v2.1/servers/04a07558-123a-448c-ad41-1da4feffb611 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:23:33.087928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bf1e8ffd-aed0-4140-8998-ac8e1dc697bd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:33.089066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bf1e8ffd-aed0-4140-8998-ac8e1dc697bd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:33.104884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf1e8ffd-aed0-4140-8998-ac8e1dc697bd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:33.108564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf1e8ffd-aed0-4140-8998-ac8e1dc697bd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:33.109736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf1e8ffd-aed0-4140-8998-ac8e1dc697bd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:33.111389 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf1e8ffd-aed0-4140-8998-ac8e1dc697bd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:33.138698 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a8209b33-ca21-4350-8bb7-02418a6e6fbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:33.151326 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a8209b33-ca21-4350-8bb7-02418a6e6fbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09" status: 200 len: 1317 microversion: 2.1 time: 0.565004 May 27 15:23:33.155425 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2732/5475] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:32 2022] GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09 => generated 1317 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:23:33.231381 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bf1e8ffd-aed0-4140-8998-ac8e1dc697bd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action" status: 200 len: 14 microversion: 2.1 time: 0.154323 May 27 15:23:33.236477 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2744/5476] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:23:33 2022] POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:23:34.171980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e6bdfda-548b-4d93-ab5e-d5e64de7c163 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:34.172586 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e6bdfda-548b-4d93-ab5e-d5e64de7c163 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:34.202099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e6bdfda-548b-4d93-ab5e-d5e64de7c163 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:34.207955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e6bdfda-548b-4d93-ab5e-d5e64de7c163 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:34.221909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e6bdfda-548b-4d93-ab5e-d5e64de7c163 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:34.222371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e6bdfda-548b-4d93-ab5e-d5e64de7c163 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:34.249014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-38873c17-08d8-451d-b986-f40a2f4662dd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:34.252109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-38873c17-08d8-451d-b986-f40a2f4662dd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:34.279498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38873c17-08d8-451d-b986-f40a2f4662dd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:34.280184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38873c17-08d8-451d-b986-f40a2f4662dd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:34.281695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38873c17-08d8-451d-b986-f40a2f4662dd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:34.284638 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-38873c17-08d8-451d-b986-f40a2f4662dd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:34.416036 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-38873c17-08d8-451d-b986-f40a2f4662dd tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action" status: 200 len: 8206 microversion: 2.1 time: 0.175459 May 27 15:23:34.417754 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2745/5477] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:23:34 2022] POST /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073/action => generated 8206 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:34.427855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5fd60b0d-87fe-4382-a900-3c3743b90ead tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:34.430270 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5fd60b0d-87fe-4382-a900-3c3743b90ead tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:34.450192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fd60b0d-87fe-4382-a900-3c3743b90ead tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:34.454085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fd60b0d-87fe-4382-a900-3c3743b90ead tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:34.455211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fd60b0d-87fe-4382-a900-3c3743b90ead tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:34.455825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fd60b0d-87fe-4382-a900-3c3743b90ead tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:35.283706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e6bdfda-548b-4d93-ab5e-d5e64de7c163 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:35.298923 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e6bdfda-548b-4d93-ab5e-d5e64de7c163 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09" status: 200 len: 1317 microversion: 2.1 time: 1.126451 May 27 15:23:35.299976 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2733/5478] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:34 2022] GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09 => generated 1317 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:35.464497 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5fd60b0d-87fe-4382-a900-3c3743b90ead tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:35.479842 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5fd60b0d-87fe-4382-a900-3c3743b90ead tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 1.056815 May 27 15:23:35.482623 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2746/5479] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:34 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:23:35.509450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ccdd1e94-9acd-4fcc-8001-24e364059f69 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:35.510401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ccdd1e94-9acd-4fcc-8001-24e364059f69 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:35.524763 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccdd1e94-9acd-4fcc-8001-24e364059f69 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:35.532936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccdd1e94-9acd-4fcc-8001-24e364059f69 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:35.537543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccdd1e94-9acd-4fcc-8001-24e364059f69 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:35.540434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccdd1e94-9acd-4fcc-8001-24e364059f69 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:36.219087 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ccdd1e94-9acd-4fcc-8001-24e364059f69 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:36.229799 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ccdd1e94-9acd-4fcc-8001-24e364059f69 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.728733 May 27 15:23:36.254208 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2734/5480] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:35 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:36.270130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-253fd7d9-de66-4465-89b1-fc3e50c2204c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:36.272880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-253fd7d9-de66-4465-89b1-fc3e50c2204c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:36.292739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-253fd7d9-de66-4465-89b1-fc3e50c2204c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:36.293384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-253fd7d9-de66-4465-89b1-fc3e50c2204c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:36.299236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-253fd7d9-de66-4465-89b1-fc3e50c2204c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:36.299717 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-253fd7d9-de66-4465-89b1-fc3e50c2204c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:36.317055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-39799356-614c-4452-b08f-6aaf49756266 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:36.317725 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-39799356-614c-4452-b08f-6aaf49756266 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:36.328223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39799356-614c-4452-b08f-6aaf49756266 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:36.328708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39799356-614c-4452-b08f-6aaf49756266 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:36.344214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39799356-614c-4452-b08f-6aaf49756266 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:36.345402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39799356-614c-4452-b08f-6aaf49756266 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:36.533732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:36.576369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:37.129759 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:37.207516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-253fd7d9-de66-4465-89b1-fc3e50c2204c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:37.232986 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-253fd7d9-de66-4465-89b1-fc3e50c2204c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.965906 May 27 15:23:37.235511 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2747/5481] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:36 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:37.252926 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1e95389c-be86-40b7-a1de-f5d10b54263e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:37.254956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1e95389c-be86-40b7-a1de-f5d10b54263e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:37.274547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1e95389c-be86-40b7-a1de-f5d10b54263e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:37.277087 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1e95389c-be86-40b7-a1de-f5d10b54263e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:37.279800 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-39799356-614c-4452-b08f-6aaf49756266 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:37.281366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1e95389c-be86-40b7-a1de-f5d10b54263e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:37.282307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1e95389c-be86-40b7-a1de-f5d10b54263e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:37.288818 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-39799356-614c-4452-b08f-6aaf49756266 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09" status: 200 len: 1317 microversion: 2.1 time: 0.975125 May 27 15:23:37.301106 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2735/5482] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:36 2022] GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09 => generated 1317 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:37.780125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1e95389c-be86-40b7-a1de-f5d10b54263e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:37.789632 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1e95389c-be86-40b7-a1de-f5d10b54263e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.543577 May 27 15:23:37.793389 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2748/5483] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:37 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:23:37.810758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d7a154d9-febe-4c9b-bb2e-d3638f146e50 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:37.811545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d7a154d9-febe-4c9b-bb2e-d3638f146e50 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:37.827818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7a154d9-febe-4c9b-bb2e-d3638f146e50 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:37.830903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7a154d9-febe-4c9b-bb2e-d3638f146e50 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:37.834520 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7a154d9-febe-4c9b-bb2e-d3638f146e50 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:37.836039 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d7a154d9-febe-4c9b-bb2e-d3638f146e50 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:37.853729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-bcbf9deb-34c9-42d2-8eea-a8210bff98fe req-da30172e-3549-4668-a63a-e1dca1165290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900d6720-34fc-4af9-bee0-76fabedb8b09", "name": "network-vif-plugged", "status": "completed", "tag": "3514e3f5-47fd-4171-89b8-9c7464f2997b"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:37.893726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-bcbf9deb-34c9-42d2-8eea-a8210bff98fe req-da30172e-3549-4668-a63a-e1dca1165290 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:37.894359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-bcbf9deb-34c9-42d2-8eea-a8210bff98fe req-da30172e-3549-4668-a63a-e1dca1165290 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:37.969114 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-bcbf9deb-34c9-42d2-8eea-a8210bff98fe req-da30172e-3549-4668-a63a-e1dca1165290 service nova] Creating event network-vif-plugged:3514e3f5-47fd-4171-89b8-9c7464f2997b for instance 900d6720-34fc-4af9-bee0-76fabedb8b09 on n-h2-843621-1 May 27 15:23:37.998432 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-bcbf9deb-34c9-42d2-8eea-a8210bff98fe req-da30172e-3549-4668-a63a-e1dca1165290 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144492 May 27 15:23:38.001270 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2749/5484] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:23:38.026498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d7a154d9-febe-4c9b-bb2e-d3638f146e50 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Locking {{(pid=119248) lock /opt/stack/nova/nova/compute/api.py:4700}} May 27 15:23:38.215024 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d7a154d9-febe-4c9b-bb2e-d3638f146e50 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action" status: 202 len: 0 microversion: 2.1 time: 0.409447 May 27 15:23:38.216574 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2736/5485] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:23:37 2022] POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:23:38.228191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ecc0e240-e130-4531-823c-627e048de90f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:38.229648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ecc0e240-e130-4531-823c-627e048de90f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:38.250196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecc0e240-e130-4531-823c-627e048de90f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:38.252137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecc0e240-e130-4531-823c-627e048de90f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:38.256261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecc0e240-e130-4531-823c-627e048de90f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:38.257542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecc0e240-e130-4531-823c-627e048de90f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:38.318441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3f1b259d-e000-47ff-b582-e05c30805c82 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:38.319783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3f1b259d-e000-47ff-b582-e05c30805c82 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:38.329108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f1b259d-e000-47ff-b582-e05c30805c82 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:38.333742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f1b259d-e000-47ff-b582-e05c30805c82 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:38.335493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f1b259d-e000-47ff-b582-e05c30805c82 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:38.336223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f1b259d-e000-47ff-b582-e05c30805c82 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:38.749913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ecc0e240-e130-4531-823c-627e048de90f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:38.765896 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ecc0e240-e130-4531-823c-627e048de90f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.545450 May 27 15:23:38.779287 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2750/5486] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:38 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:38.800660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-99c233a5-6be6-45be-a069-e56d4865e5b9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:38.817475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99c233a5-6be6-45be-a069-e56d4865e5b9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:38.817940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-99c233a5-6be6-45be-a069-e56d4865e5b9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:38.883101 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-99c233a5-6be6-45be-a069-e56d4865e5b9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] HTTP exception thrown: Instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 is locked May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-99c233a5-6be6-45be-a069-e56d4865e5b9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Request method failure captured: May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action HTTP/1.1 May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 15 May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOwDliVCqTPMRyWTz5VCa0lJbDfMaiA5Q8VkkcxCOAy1xPsZUsWj5pPLtvKr9t-3Mp_2sGNauOrE6ab_oHFj_8BDEOrlb-yDaF-p_CCTZtMT8gxTV_PBncYxYUEN_u4cCR_nROmEBbSl3SF3qPihCPQBj05K88_94KDmUBFQNqLTUVE May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: e72c782a808345e093093ea95ce04ae4 May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerActionsTestJSON-1655989499 May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e72c782a808345e093093ea95ce04ae4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e72c782a808345e093093ea95ce04ae4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e72c782a808345e093093ea95ce04ae4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e72c782a808345e093093ea95ce04ae4", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerActionsTestJSON-1655989499 May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: e72c782a808345e093093ea95ce04ae4 May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerActionsTestJSON-1655989499 May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerActionsTestJSON-1655989499-project May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: f750b3f70eed4477a15c3529371a8af3 May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerActionsTestJSON-1655989499-project May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: {"os-stop": {}} May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 is locked May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '812d42c0-07f1-4f7c-83b8-848b18cf0186', 'body': {'os-stop': {}}} May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 is locked May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 is locked May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 is locked May 27 15:23:38.885706 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:38.890776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-99c233a5-6be6-45be-a069-e56d4865e5b9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Returning 409 to user: Instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 is locked {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:38.890776 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-99c233a5-6be6-45be-a069-e56d4865e5b9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action" status: 409 len: 107 microversion: 2.1 time: 0.106183 May 27 15:23:38.890776 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2751/5487] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:23:38 2022] POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action => generated 107 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:23:38.900298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-84404fff-9c06-4ce6-bcc6-319d5c406b08 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:38.901057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-84404fff-9c06-4ce6-bcc6-319d5c406b08 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:38.910484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84404fff-9c06-4ce6-bcc6-319d5c406b08 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:38.911426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84404fff-9c06-4ce6-bcc6-319d5c406b08 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:38.912352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84404fff-9c06-4ce6-bcc6-319d5c406b08 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:38.914056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84404fff-9c06-4ce6-bcc6-319d5c406b08 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:38.956431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3f1b259d-e000-47ff-b582-e05c30805c82 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:38.973573 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3f1b259d-e000-47ff-b582-e05c30805c82 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09" status: 200 len: 1317 microversion: 2.1 time: 0.659224 May 27 15:23:38.978810 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2737/5488] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:38 2022] GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09 => generated 1317 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:38.993562 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-84404fff-9c06-4ce6-bcc6-319d5c406b08 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Unlocking {{(pid=119249) unlock /opt/stack/nova/nova/compute/api.py:4729}} May 27 15:23:39.093553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:39.117742 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-84404fff-9c06-4ce6-bcc6-319d5c406b08 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action" status: 202 len: 0 microversion: 2.1 time: 0.221367 May 27 15:23:39.121946 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2752/5489] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:23:38 2022] POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:23:39.182293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c4e8ef08-ed05-44a7-8e31-ece992f1ed0b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:39.195295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c4e8ef08-ed05-44a7-8e31-ece992f1ed0b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:39.195852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c4e8ef08-ed05-44a7-8e31-ece992f1ed0b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:39.274773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c4e8ef08-ed05-44a7-8e31-ece992f1ed0b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Going to try to stop instance {{(pid=119248) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 15:23:39.376291 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c4e8ef08-ed05-44a7-8e31-ece992f1ed0b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action" status: 202 len: 0 microversion: 2.1 time: 0.253296 May 27 15:23:39.380842 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2738/5490] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:23:39 2022] POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:23:39.390087 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cf6e1730-d89e-4f51-a9f4-3c3ef3bf9b16 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:39.392251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cf6e1730-d89e-4f51-a9f4-3c3ef3bf9b16 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:39.416410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cf6e1730-d89e-4f51-a9f4-3c3ef3bf9b16 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:39.419296 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cf6e1730-d89e-4f51-a9f4-3c3ef3bf9b16 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:39.426170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cf6e1730-d89e-4f51-a9f4-3c3ef3bf9b16 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:39.426170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cf6e1730-d89e-4f51-a9f4-3c3ef3bf9b16 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:39.721635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cf6e1730-d89e-4f51-a9f4-3c3ef3bf9b16 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:39.731612 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cf6e1730-d89e-4f51-a9f4-3c3ef3bf9b16 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1679 microversion: 2.1 time: 0.348521 May 27 15:23:39.735543 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2753/5491] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:39 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1679 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:39.995027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3348e7bf-bd75-4bd0-afc1-dd62b4a0f036 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:39.996577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3348e7bf-bd75-4bd0-afc1-dd62b4a0f036 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:40.048365 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3348e7bf-bd75-4bd0-afc1-dd62b4a0f036 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:40.049130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3348e7bf-bd75-4bd0-afc1-dd62b4a0f036 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:40.052189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3348e7bf-bd75-4bd0-afc1-dd62b4a0f036 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:40.053264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3348e7bf-bd75-4bd0-afc1-dd62b4a0f036 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:40.465379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3348e7bf-bd75-4bd0-afc1-dd62b4a0f036 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:40.474646 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3348e7bf-bd75-4bd0-afc1-dd62b4a0f036 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09" status: 200 len: 1317 microversion: 2.1 time: 0.484861 May 27 15:23:40.484905 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2739/5492] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:39 2022] GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09 => generated 1317 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:40.752900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e3e9dbc1-bccf-42ee-90be-69faec296af6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:40.754126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e3e9dbc1-bccf-42ee-90be-69faec296af6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:40.762864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3e9dbc1-bccf-42ee-90be-69faec296af6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:40.763669 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3e9dbc1-bccf-42ee-90be-69faec296af6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:40.765051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3e9dbc1-bccf-42ee-90be-69faec296af6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:40.765850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3e9dbc1-bccf-42ee-90be-69faec296af6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:41.504281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ccfb04a8-03fd-4927-a9ed-8a13e74d415e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:41.505047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ccfb04a8-03fd-4927-a9ed-8a13e74d415e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:41.527854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccfb04a8-03fd-4927-a9ed-8a13e74d415e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:41.528718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccfb04a8-03fd-4927-a9ed-8a13e74d415e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:41.533785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccfb04a8-03fd-4927-a9ed-8a13e74d415e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:41.534653 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccfb04a8-03fd-4927-a9ed-8a13e74d415e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:41.871572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e3e9dbc1-bccf-42ee-90be-69faec296af6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:41.884411 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e3e9dbc1-bccf-42ee-90be-69faec296af6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1679 microversion: 2.1 time: 1.135997 May 27 15:23:41.893880 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2754/5493] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:40 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1679 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:42.007641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ccfb04a8-03fd-4927-a9ed-8a13e74d415e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:42.019445 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ccfb04a8-03fd-4927-a9ed-8a13e74d415e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09" status: 200 len: 1505 microversion: 2.1 time: 0.519768 May 27 15:23:42.022989 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2740/5494] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:41 2022] GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09 => generated 1505 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:42.037294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9a4a904c-c1a0-4bbc-aed0-39cba0b4fb36 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:42.038382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9a4a904c-c1a0-4bbc-aed0-39cba0b4fb36 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:42.046584 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a4a904c-c1a0-4bbc-aed0-39cba0b4fb36 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:42.049027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a4a904c-c1a0-4bbc-aed0-39cba0b4fb36 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:42.053627 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a4a904c-c1a0-4bbc-aed0-39cba0b4fb36 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:42.054377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a4a904c-c1a0-4bbc-aed0-39cba0b4fb36 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:42.115607 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9a4a904c-c1a0-4bbc-aed0-39cba0b4fb36 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:23:42.248401 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9a4a904c-c1a0-4bbc-aed0-39cba0b4fb36 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "DELETE /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09" status: 204 len: 0 microversion: 2.1 time: 0.207595 May 27 15:23:42.248401 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2755/5495] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:23:42 2022] DELETE /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:23:42.255502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b6714083-cafc-43c2-9855-e70ce1b3898c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:42.256188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b6714083-cafc-43c2-9855-e70ce1b3898c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:42.265786 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b6714083-cafc-43c2-9855-e70ce1b3898c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:42.266296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b6714083-cafc-43c2-9855-e70ce1b3898c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:42.267560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b6714083-cafc-43c2-9855-e70ce1b3898c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:42.268093 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b6714083-cafc-43c2-9855-e70ce1b3898c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:42.710721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b6714083-cafc-43c2-9855-e70ce1b3898c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:42.725793 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b6714083-cafc-43c2-9855-e70ce1b3898c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09" status: 200 len: 1511 microversion: 2.1 time: 0.469980 May 27 15:23:42.731349 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2741/5496] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:42 2022] GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09 => generated 1511 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:42.913129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-755de514-5561-4c12-bca2-cd8d21ee6bd5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:42.914098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-755de514-5561-4c12-bca2-cd8d21ee6bd5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:42.935712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-755de514-5561-4c12-bca2-cd8d21ee6bd5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:42.937893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-755de514-5561-4c12-bca2-cd8d21ee6bd5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:42.939158 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-755de514-5561-4c12-bca2-cd8d21ee6bd5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:42.942766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-755de514-5561-4c12-bca2-cd8d21ee6bd5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:43.374035 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-755de514-5561-4c12-bca2-cd8d21ee6bd5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:43.385634 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-755de514-5561-4c12-bca2-cd8d21ee6bd5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1679 microversion: 2.1 time: 0.477626 May 27 15:23:43.386551 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2756/5497] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:42 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1679 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:43.747748 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3d3d933f-ea35-4976-90bb-671fb14207d5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:43.748902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3d3d933f-ea35-4976-90bb-671fb14207d5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:43.849037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d3d933f-ea35-4976-90bb-671fb14207d5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:43.851277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d3d933f-ea35-4976-90bb-671fb14207d5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:43.852361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d3d933f-ea35-4976-90bb-671fb14207d5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:43.853216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d3d933f-ea35-4976-90bb-671fb14207d5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:44.411693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-367ed170-52c9-4cb3-bc9a-bbf04f6a5544 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:44.412941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-367ed170-52c9-4cb3-bc9a-bbf04f6a5544 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:44.510875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-367ed170-52c9-4cb3-bc9a-bbf04f6a5544 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:44.523705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-367ed170-52c9-4cb3-bc9a-bbf04f6a5544 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:44.532422 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-367ed170-52c9-4cb3-bc9a-bbf04f6a5544 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:44.536790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-367ed170-52c9-4cb3-bc9a-bbf04f6a5544 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:44.711757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3d3d933f-ea35-4976-90bb-671fb14207d5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:44.722126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:44.770457 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3d3d933f-ea35-4976-90bb-671fb14207d5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09" status: 200 len: 1511 microversion: 2.1 time: 1.026626 May 27 15:23:44.772258 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2742/5498] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:43 2022] GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09 => generated 1511 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:45.071562 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-367ed170-52c9-4cb3-bc9a-bbf04f6a5544 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:45.091578 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-367ed170-52c9-4cb3-bc9a-bbf04f6a5544 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1679 microversion: 2.1 time: 0.690299 May 27 15:23:45.094948 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2757/5499] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:44 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1679 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:45.708341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8b3b97e4-876a-4c7d-85e0-0da6bf828a1d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:45.708928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8b3b97e4-876a-4c7d-85e0-0da6bf828a1d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:45.734065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b3b97e4-876a-4c7d-85e0-0da6bf828a1d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:45.737370 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b3b97e4-876a-4c7d-85e0-0da6bf828a1d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:45.745935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b3b97e4-876a-4c7d-85e0-0da6bf828a1d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:45.746275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b3b97e4-876a-4c7d-85e0-0da6bf828a1d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:45.790562 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ae668850-b9eb-43d0-8f8b-4e51a78e37c9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:45.791182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ae668850-b9eb-43d0-8f8b-4e51a78e37c9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:45.812596 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-8b3b97e4-876a-4c7d-85e0-0da6bf828a1d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] HTTP exception thrown: Instance 37f90068-386b-4593-a1b7-a5e2232395b2 could not be found. May 27 15:23:45.816106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae668850-b9eb-43d0-8f8b-4e51a78e37c9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:45.817072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae668850-b9eb-43d0-8f8b-4e51a78e37c9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:45.826735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae668850-b9eb-43d0-8f8b-4e51a78e37c9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:45.827992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ae668850-b9eb-43d0-8f8b-4e51a78e37c9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8b3b97e4-876a-4c7d-85e0-0da6bf828a1d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Request method failure captured: May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 HTTP/1.1 May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOrMyApwEozUDyrEIfAo_5Y4g_1HkChw1SWcTHKZFCS59hbDZ-tG27fBruZ89SDVYIwJf1049Wu3YE4lY2cORLx6FEdOR4uGmA8kqdyyKM11lovRtNDp2ouZkjSiDmO17gaqasURXD2cDNTsBoZha7a41XrY22c7gADFUiZI3zmSCNg May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a9a825b1ade46e3a702ae19c7c53f6b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 59f88a11fc4b4bf6b4a807ccffee1fab May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 37f90068-386b-4593-a1b7-a5e2232395b2 could not be found. May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '37f90068-386b-4593-a1b7-a5e2232395b2'} May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37f90068-386b-4593-a1b7-a5e2232395b2 could not be found. May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:23:45.833321 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:23:45.837974 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37f90068-386b-4593-a1b7-a5e2232395b2 could not be found. May 27 15:23:45.837974 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:45.837974 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:45.837974 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:45.837974 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:45.837974 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:45.837974 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:45.837974 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:45.837974 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:45.837974 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37f90068-386b-4593-a1b7-a5e2232395b2 could not be found. May 27 15:23:45.837974 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:45.841685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8b3b97e4-876a-4c7d-85e0-0da6bf828a1d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Returning 404 to user: Instance 37f90068-386b-4593-a1b7-a5e2232395b2 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:45.843158 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8b3b97e4-876a-4c7d-85e0-0da6bf828a1d tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "DELETE /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2" status: 404 len: 111 microversion: 2.1 time: 0.146412 May 27 15:23:45.847176 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2743/5500] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:23:45 2022] DELETE /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:23:45.864174 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a644c6ea-7aa4-4544-8b45-0b3d921f6924 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:45.866783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a644c6ea-7aa4-4544-8b45-0b3d921f6924 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] [instance: 37f90068-386b-4593-a1b7-a5e2232395b2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:45.883245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a644c6ea-7aa4-4544-8b45-0b3d921f6924 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:45.888659 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a644c6ea-7aa4-4544-8b45-0b3d921f6924 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:45.898684 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a644c6ea-7aa4-4544-8b45-0b3d921f6924 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:45.903032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a644c6ea-7aa4-4544-8b45-0b3d921f6924 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:45.960225 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-a644c6ea-7aa4-4544-8b45-0b3d921f6924 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] HTTP exception thrown: Instance 37f90068-386b-4593-a1b7-a5e2232395b2 could not be found. May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a644c6ea-7aa4-4544-8b45-0b3d921f6924 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Request method failure captured: May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 HTTP/1.1 May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOrMyApwEozUDyrEIfAo_5Y4g_1HkChw1SWcTHKZFCS59hbDZ-tG27fBruZ89SDVYIwJf1049Wu3YE4lY2cORLx6FEdOR4uGmA8kqdyyKM11lovRtNDp2ouZkjSiDmO17gaqasURXD2cDNTsBoZha7a41XrY22c7gADFUiZI3zmSCNg May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a9a825b1ade46e3a702ae19c7c53f6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a9a825b1ade46e3a702ae19c7c53f6b", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 5a9a825b1ade46e3a702ae19c7c53f6b May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033741878 May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 59f88a11fc4b4bf6b4a807ccffee1fab May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-AttachVolumeNegativeTest-1033741878-project May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 37f90068-386b-4593-a1b7-a5e2232395b2 could not be found. May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '37f90068-386b-4593-a1b7-a5e2232395b2'} May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37f90068-386b-4593-a1b7-a5e2232395b2 could not be found. May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37f90068-386b-4593-a1b7-a5e2232395b2 could not be found. May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:45.974172 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:45.979537 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:45.979537 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:45.979537 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:45.979537 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:45.979537 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:45.979537 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37f90068-386b-4593-a1b7-a5e2232395b2 could not be found. May 27 15:23:45.979537 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:45.979537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a644c6ea-7aa4-4544-8b45-0b3d921f6924 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] Returning 404 to user: Instance 37f90068-386b-4593-a1b7-a5e2232395b2 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:45.985704 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a644c6ea-7aa4-4544-8b45-0b3d921f6924 tempest-AttachVolumeNegativeTest-1033741878 tempest-AttachVolumeNegativeTest-1033741878-project] 10.222.0.13 "GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2" status: 404 len: 111 microversion: 2.1 time: 0.124476 May 27 15:23:45.992314 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2744/5501] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:45 2022] GET /compute/v2.1/servers/37f90068-386b-4593-a1b7-a5e2232395b2 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:23:46.038685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ae668850-b9eb-43d0-8f8b-4e51a78e37c9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:46.059520 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ae668850-b9eb-43d0-8f8b-4e51a78e37c9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09" status: 200 len: 1469 microversion: 2.1 time: 0.274682 May 27 15:23:46.071669 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2758/5502] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:45 2022] GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09 => generated 1469 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:46.112088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f5a8e4d0-918b-492a-b506-2110b6af16ec tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:46.117059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f5a8e4d0-918b-492a-b506-2110b6af16ec tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:46.134390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-8898874a-19f6-4ce7-902e-333241666313 req-2668a6d5-6457-4dd1-9742-8c0e2cb20b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900d6720-34fc-4af9-bee0-76fabedb8b09", "name": "network-vif-deleted", "tag": "3514e3f5-47fd-4171-89b8-9c7464f2997b"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:46.137122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f5a8e4d0-918b-492a-b506-2110b6af16ec tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:46.156274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f5a8e4d0-918b-492a-b506-2110b6af16ec tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:46.157240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f5a8e4d0-918b-492a-b506-2110b6af16ec tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:46.157700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f5a8e4d0-918b-492a-b506-2110b6af16ec tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:46.158767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-8898874a-19f6-4ce7-902e-333241666313 req-2668a6d5-6457-4dd1-9742-8c0e2cb20b67 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:46.159508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-8898874a-19f6-4ce7-902e-333241666313 req-2668a6d5-6457-4dd1-9742-8c0e2cb20b67 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:46.192499 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-8898874a-19f6-4ce7-902e-333241666313 req-2668a6d5-6457-4dd1-9742-8c0e2cb20b67 service nova] Creating event network-vif-deleted:3514e3f5-47fd-4171-89b8-9c7464f2997b for instance 900d6720-34fc-4af9-bee0-76fabedb8b09 on n-h2-843621-1 May 27 15:23:46.206730 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-8898874a-19f6-4ce7-902e-333241666313 req-2668a6d5-6457-4dd1-9742-8c0e2cb20b67 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079817 May 27 15:23:46.211852 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2759/5503] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:23:46.599222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f5a8e4d0-918b-492a-b506-2110b6af16ec tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:46.614125 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f5a8e4d0-918b-492a-b506-2110b6af16ec tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1679 microversion: 2.1 time: 0.505810 May 27 15:23:46.619896 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2745/5504] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:46 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1679 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:47.097434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-42e73613-a67c-4af0-a68d-868a2cb60ee8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:47.101162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-42e73613-a67c-4af0-a68d-868a2cb60ee8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:47.110712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:47.129584 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42e73613-a67c-4af0-a68d-868a2cb60ee8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:47.132043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42e73613-a67c-4af0-a68d-868a2cb60ee8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:47.134166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42e73613-a67c-4af0-a68d-868a2cb60ee8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:47.135880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42e73613-a67c-4af0-a68d-868a2cb60ee8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:47.177178 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-42e73613-a67c-4af0-a68d-868a2cb60ee8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-42e73613-a67c-4af0-a68d-868a2cb60ee8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09 HTTP/1.1 May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '900d6720-34fc-4af9-bee0-76fabedb8b09'} May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:47.182162 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:47.187098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:47.187098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:47.187098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:47.187098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:47.187098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:47.187098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:23:47.187098 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:47.187098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-42e73613-a67c-4af0-a68d-868a2cb60ee8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:47.189705 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-42e73613-a67c-4af0-a68d-868a2cb60ee8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09" status: 404 len: 111 microversion: 2.1 time: 0.109560 May 27 15:23:47.191634 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2760/5505] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:47 2022] GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:23:47.201928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9c8da6a5-976f-46d0-8add-29c8ffa2c3d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:47.203166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9c8da6a5-976f-46d0-8add-29c8ffa2c3d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:47.214671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c8da6a5-976f-46d0-8add-29c8ffa2c3d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:47.220725 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c8da6a5-976f-46d0-8add-29c8ffa2c3d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:47.221883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c8da6a5-976f-46d0-8add-29c8ffa2c3d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:47.223962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c8da6a5-976f-46d0-8add-29c8ffa2c3d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:47.442552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9c8da6a5-976f-46d0-8add-29c8ffa2c3d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:47.460938 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9c8da6a5-976f-46d0-8add-29c8ffa2c3d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.261600 May 27 15:23:47.468578 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2746/5506] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:47 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:47.639704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9d2e5a5d-c4cb-4002-b148-c1e8612e20b0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:47.639704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9d2e5a5d-c4cb-4002-b148-c1e8612e20b0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:47.650059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d2e5a5d-c4cb-4002-b148-c1e8612e20b0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:47.650525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d2e5a5d-c4cb-4002-b148-c1e8612e20b0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:47.652286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d2e5a5d-c4cb-4002-b148-c1e8612e20b0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:47.652833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d2e5a5d-c4cb-4002-b148-c1e8612e20b0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:47.771339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2119d4b0-c9a2-4623-bb22-cc496b3b7fc1 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2119d4b0-c9a2-4623-bb22-cc496b3b7fc1 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 163 May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: {"server": {"name": 12345, "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'networks': [{'uuid': '640304d1-fbbc-473c-9acb-60ed77473841'}]}}} May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance['server']: May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 12345 May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:23:47.778021 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:23:47.782298 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:23:47.782298 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 27 15:23:47.782298 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:47.782298 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:47.782298 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:47.782298 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:47.782298 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:47.782298 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:47.782298 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:23:47.782298 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:23:47.782298 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 27 15:23:47.782298 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:47.782298 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2119d4b0-c9a2-4623-bb22-cc496b3b7fc1 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:47.782298 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2119d4b0-c9a2-4623-bb22-cc496b3b7fc1 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.014813 May 27 15:23:47.782298 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2747/5507] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:23:47 2022] POST /compute/v2.1/servers => generated 127 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:23:47.797051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7d01694c-a7f6-46d2-9897-16b9ae3ad3bb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:47.797726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7d01694c-a7f6-46d2-9897-16b9ae3ad3bb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:47.811533 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d01694c-a7f6-46d2-9897-16b9ae3ad3bb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:47.811997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d01694c-a7f6-46d2-9897-16b9ae3ad3bb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:47.812831 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d01694c-a7f6-46d2-9897-16b9ae3ad3bb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:47.813277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d01694c-a7f6-46d2-9897-16b9ae3ad3bb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:48.475220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9d2e5a5d-c4cb-4002-b148-c1e8612e20b0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:48.510548 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9d2e5a5d-c4cb-4002-b148-c1e8612e20b0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1679 microversion: 2.1 time: 0.870471 May 27 15:23:48.511553 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2761/5508] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:47 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1679 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:48.683147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7d01694c-a7f6-46d2-9897-16b9ae3ad3bb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:48.691888 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7d01694c-a7f6-46d2-9897-16b9ae3ad3bb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.906369 May 27 15:23:48.698250 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2748/5509] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:47 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:48.723041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9c7974ae-be04-46c9-8131-d190b3a500c2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:48.723678 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9c7974ae-be04-46c9-8131-d190b3a500c2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:48.754665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9c7974ae-be04-46c9-8131-d190b3a500c2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:48.757384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9c7974ae-be04-46c9-8131-d190b3a500c2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:48.758570 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9c7974ae-be04-46c9-8131-d190b3a500c2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:48.761446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9c7974ae-be04-46c9-8131-d190b3a500c2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:49.245455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9c7974ae-be04-46c9-8131-d190b3a500c2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:49.263131 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9c7974ae-be04-46c9-8131-d190b3a500c2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.544741 May 27 15:23:49.263725 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2762/5510] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:48 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:49.530581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f99127fc-7bdb-4945-93a7-f059fca1b538 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:49.531465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f99127fc-7bdb-4945-93a7-f059fca1b538 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:49.547556 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f99127fc-7bdb-4945-93a7-f059fca1b538 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:49.548465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f99127fc-7bdb-4945-93a7-f059fca1b538 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:49.550607 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f99127fc-7bdb-4945-93a7-f059fca1b538 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:49.553020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f99127fc-7bdb-4945-93a7-f059fca1b538 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:50.563271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f99127fc-7bdb-4945-93a7-f059fca1b538 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:50.571956 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f99127fc-7bdb-4945-93a7-f059fca1b538 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1679 microversion: 2.1 time: 1.047773 May 27 15:23:50.574965 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2749/5511] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:49 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1679 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:51.596201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5c18f45f-401c-4f5d-b3f9-bfaeb3f64df4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:51.601251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5c18f45f-401c-4f5d-b3f9-bfaeb3f64df4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:51.633655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c18f45f-401c-4f5d-b3f9-bfaeb3f64df4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:51.635462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c18f45f-401c-4f5d-b3f9-bfaeb3f64df4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:51.637050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c18f45f-401c-4f5d-b3f9-bfaeb3f64df4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:51.646545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5c18f45f-401c-4f5d-b3f9-bfaeb3f64df4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:52.163079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5c18f45f-401c-4f5d-b3f9-bfaeb3f64df4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:52.189174 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5c18f45f-401c-4f5d-b3f9-bfaeb3f64df4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1679 microversion: 2.1 time: 0.598101 May 27 15:23:52.191988 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2763/5512] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:51 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1679 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:53.206509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0f9f07ac-94be-4546-8a0e-4784f430cae9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:53.207833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0f9f07ac-94be-4546-8a0e-4784f430cae9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:53.219791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f9f07ac-94be-4546-8a0e-4784f430cae9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:53.220450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f9f07ac-94be-4546-8a0e-4784f430cae9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:53.224124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f9f07ac-94be-4546-8a0e-4784f430cae9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:53.224590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f9f07ac-94be-4546-8a0e-4784f430cae9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:53.591590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0ec6c19e-51d9-4f20-ba22-e6ec894be15b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-290064684", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "cd762e6d-f862-4095-bd2e-447f22410a9b", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:53.722934 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-0ec6c19e-51d9-4f20-ba22-e6ec894be15b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Block Device cd762e6d-f862-4095-bd2e-447f22410a9b is not bootable. May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0ec6c19e-51d9-4f20-ba22-e6ec894be15b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 357 May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-290064684", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "cd762e6d-f862-4095-bd2e-447f22410a9b", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: exception: Block Device cd762e6d-f862-4095-bd2e-447f22410a9b is not bootable. May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-290064684', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'cd762e6d-f862-4095-bd2e-447f22410a9b'}], 'networks': [{'uuid': '640304d1-fbbc-473c-9acb-60ed77473841'}]}}} May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._create_instance( May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device cd762e6d-f862-4095-bd2e-447f22410a9b is not bootable. May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:23:53.741633 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:23:53.749270 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:23:53.749270 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:23:53.749270 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:23:53.749270 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 27 15:23:53.749270 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 27 15:23:53.749270 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 27 15:23:53.749270 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device cd762e6d-f862-4095-bd2e-447f22410a9b is not bootable. May 27 15:23:53.749270 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:53.749270 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:53.749270 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:53.749270 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:53.749270 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:53.749270 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:53.749270 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:53.749270 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:53.749270 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device cd762e6d-f862-4095-bd2e-447f22410a9b is not bootable. May 27 15:23:53.749270 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:23:53.749270 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0ec6c19e-51d9-4f20-ba22-e6ec894be15b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 400 to user: Block Device cd762e6d-f862-4095-bd2e-447f22410a9b is not bootable. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:53.749270 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0ec6c19e-51d9-4f20-ba22-e6ec894be15b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.156323 May 27 15:23:53.749270 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2764/5513] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:23:53 2022] POST /compute/v2.1/servers => generated 110 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:23:53.753339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1068a3ca-c78d-40a0-ad03-025b75500f88 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:53.753933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1068a3ca-c78d-40a0-ad03-025b75500f88 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:53.767056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1068a3ca-c78d-40a0-ad03-025b75500f88 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:53.767516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1068a3ca-c78d-40a0-ad03-025b75500f88 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:53.768311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1068a3ca-c78d-40a0-ad03-025b75500f88 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:53.768787 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1068a3ca-c78d-40a0-ad03-025b75500f88 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:53.901191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0f9f07ac-94be-4546-8a0e-4784f430cae9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:53.917562 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0f9f07ac-94be-4546-8a0e-4784f430cae9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1679 microversion: 2.1 time: 0.713953 May 27 15:23:53.919440 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2750/5514] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:53 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1679 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:54.140596 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1068a3ca-c78d-40a0-ad03-025b75500f88 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:54.157466 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1068a3ca-c78d-40a0-ad03-025b75500f88 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.409100 May 27 15:23:54.170738 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2765/5515] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:53 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:54.175575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4d296de2-3876-4791-9501-946d42098325 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:54.176199 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4d296de2-3876-4791-9501-946d42098325 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:54.186791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d296de2-3876-4791-9501-946d42098325 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:54.187254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d296de2-3876-4791-9501-946d42098325 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:54.188047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d296de2-3876-4791-9501-946d42098325 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:54.188492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d296de2-3876-4791-9501-946d42098325 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:54.707454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4d296de2-3876-4791-9501-946d42098325 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:54.730184 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4d296de2-3876-4791-9501-946d42098325 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.558410 May 27 15:23:54.736598 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2751/5516] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:54 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:54.941139 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e7c04692-8ef5-4115-bb14-1c6ae608314d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:54.941770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e7c04692-8ef5-4115-bb14-1c6ae608314d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:54.956272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e7c04692-8ef5-4115-bb14-1c6ae608314d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:54.961125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e7c04692-8ef5-4115-bb14-1c6ae608314d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:54.963011 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e7c04692-8ef5-4115-bb14-1c6ae608314d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:54.964298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e7c04692-8ef5-4115-bb14-1c6ae608314d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:56.043536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e7c04692-8ef5-4115-bb14-1c6ae608314d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:56.059796 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e7c04692-8ef5-4115-bb14-1c6ae608314d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1656 microversion: 2.1 time: 1.123716 May 27 15:23:56.063188 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2766/5517] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:54 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1656 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:56.083898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-10812ba4-e463-4341-a02f-34529984d819 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:56.111523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10812ba4-e463-4341-a02f-34529984d819 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:56.112162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10812ba4-e463-4341-a02f-34529984d819 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:56.215594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-10812ba4-e463-4341-a02f-34529984d819 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Going to try to start instance {{(pid=119248) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 15:23:56.357132 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-10812ba4-e463-4341-a02f-34529984d819 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action" status: 202 len: 0 microversion: 2.1 time: 0.278537 May 27 15:23:56.358085 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2752/5518] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:23:56 2022] POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:23:56.371514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-81e73a7a-c55c-4e63-97d2-c463f61a7d0d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:56.372064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-81e73a7a-c55c-4e63-97d2-c463f61a7d0d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:56.394630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81e73a7a-c55c-4e63-97d2-c463f61a7d0d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:56.396840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81e73a7a-c55c-4e63-97d2-c463f61a7d0d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:56.399551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81e73a7a-c55c-4e63-97d2-c463f61a7d0d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:56.404178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81e73a7a-c55c-4e63-97d2-c463f61a7d0d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:56.947528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-81e73a7a-c55c-4e63-97d2-c463f61a7d0d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:56.960124 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-81e73a7a-c55c-4e63-97d2-c463f61a7d0d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1665 microversion: 2.1 time: 0.595700 May 27 15:23:56.963202 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2767/5519] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:56 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1665 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:57.985351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-296f95c4-f437-4118-b6ae-3e4e2012a7df tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:57.986067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-296f95c4-f437-4118-b6ae-3e4e2012a7df tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:58.016261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-296f95c4-f437-4118-b6ae-3e4e2012a7df tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:58.018020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-296f95c4-f437-4118-b6ae-3e4e2012a7df tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:58.020381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-296f95c4-f437-4118-b6ae-3e4e2012a7df tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:58.022669 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-296f95c4-f437-4118-b6ae-3e4e2012a7df tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:58.719956 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-296f95c4-f437-4118-b6ae-3e4e2012a7df tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:58.734116 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-296f95c4-f437-4118-b6ae-3e4e2012a7df tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1665 microversion: 2.1 time: 0.758213 May 27 15:23:58.745428 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2753/5520] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:57 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1665 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:58.954708 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-04ed18eb-024b-4c68-973b-98c277a11ce4 tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] Action: 'create', calling method: .version_select at 0x7fc775ce3310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-229002811", "metadata": {"Type": "work"}}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:59.128256 n-d-843621-1 devstack@n-api.service[119249]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:23:59.128537 n-d-843621-1 devstack@n-api.service[119249]: Fri May 27 15:23:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes (ip 10.222.0.13) !!! May 27 15:23:59.263080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-01fdac8e-9bc1-4b2b-aa2f-cb718b1e0096 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-572801354", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "346e776e-8931-417f-87da-575810efb12b", "destination_type": "local"}, {"source_type": "volume", "uuid": "c756b20c-9f5f-41b6-978e-60dc2a79ef47", "destination_type": "invalid"}], "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-01fdac8e-9bc1-4b2b-aa2f-cb718b1e0096 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 494 May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-572801354", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "346e776e-8931-417f-87da-575810efb12b", "destination_type": "local"}, {"source_type": "volume", "uuid": "c756b20c-9f5f-41b6-978e-60dc2a79ef47", "destination_type": "invalid"}], "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-572801354', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '346e776e-8931-417f-87da-575810efb12b', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'c756b20c-9f5f-41b6-978e-60dc2a79ef47', 'destination_type': 'invalid'}], 'networks': [{'uuid': '640304d1-fbbc-473c-9acb-60ed77473841'}]}}} May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'invalid' May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:59.267887 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:59.272269 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:23:59.272269 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:23:59.272269 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:23:59.272269 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:23:59.272269 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:23:59.272269 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:23:59.272269 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:23:59.272269 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:23:59.272269 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 27 15:23:59.272269 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:59.272269 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:59.272269 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:59.272269 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:59.272269 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:59.272269 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:59.272269 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:23:59.272269 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:23:59.272269 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 27 15:23:59.272269 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:23:59.276865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-01fdac8e-9bc1-4b2b-aa2f-cb718b1e0096 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:59.278580 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-01fdac8e-9bc1-4b2b-aa2f-cb718b1e0096 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.020465 May 27 15:23:59.297416 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2754/5521] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:23:59 2022] POST /compute/v2.1/servers => generated 155 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:23:59.311501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-51e46271-f29b-4de4-8268-f392d3db4ff0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:59.312483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-51e46271-f29b-4de4-8268-f392d3db4ff0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:59.326401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51e46271-f29b-4de4-8268-f392d3db4ff0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:59.327237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51e46271-f29b-4de4-8268-f392d3db4ff0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:59.328616 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51e46271-f29b-4de4-8268-f392d3db4ff0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:59.330499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51e46271-f29b-4de4-8268-f392d3db4ff0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:59.612158 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-51e46271-f29b-4de4-8268-f392d3db4ff0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:59.625850 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-51e46271-f29b-4de4-8268-f392d3db4ff0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.325682 May 27 15:23:59.626434 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2755/5522] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:59 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:59.650216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-90e6c777-a047-4dbe-82fc-15385443f05b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:59.650855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-90e6c777-a047-4dbe-82fc-15385443f05b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:59.678338 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-90e6c777-a047-4dbe-82fc-15385443f05b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:59.679146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-90e6c777-a047-4dbe-82fc-15385443f05b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:59.679969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-90e6c777-a047-4dbe-82fc-15385443f05b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:59.680497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-90e6c777-a047-4dbe-82fc-15385443f05b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:59.690418 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-04ed18eb-024b-4c68-973b-98c277a11ce4 tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.972339 May 27 15:23:59.691589 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2768/5523] 10.222.0.13 () {60 vars in 1155 bytes} [Fri May 27 15:23:58 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 975 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 27 15:23:59.703239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e0d0d4eb-0490-459a-b36b-cc50c05ecdf7 tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] Calling method '.version_select at 0x7fc775cdeaf0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:59.803348 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e0d0d4eb-0490-459a-b36b-cc50c05ecdf7 tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2" status: 200 len: 352 microversion: 2.1 time: 0.104286 May 27 15:23:59.808374 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2769/5524] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:23:59 2022] GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:23:59.809460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-42a930a7-0c93-470b-9965-58a6ba7f9470 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:59.810095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-42a930a7-0c93-470b-9965-58a6ba7f9470 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:59.835320 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42a930a7-0c93-470b-9965-58a6ba7f9470 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:59.835783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42a930a7-0c93-470b-9965-58a6ba7f9470 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:59.836587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42a930a7-0c93-470b-9965-58a6ba7f9470 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:59.837059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42a930a7-0c93-470b-9965-58a6ba7f9470 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:00.257971 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-90e6c777-a047-4dbe-82fc-15385443f05b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:00.262081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-42a930a7-0c93-470b-9965-58a6ba7f9470 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:00.272579 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-42a930a7-0c93-470b-9965-58a6ba7f9470 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.466508 May 27 15:24:00.274847 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-90e6c777-a047-4dbe-82fc-15385443f05b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.629732 May 27 15:24:00.275449 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2756/5525] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:59 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:00.289868 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2770/5526] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:23:59 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:00.309293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7a24c1d9-bcb5-4b56-bd11-ae47d4e28b3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:00.310145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7a24c1d9-bcb5-4b56-bd11-ae47d4e28b3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:00.321898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a24c1d9-bcb5-4b56-bd11-ae47d4e28b3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:00.327361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a24c1d9-bcb5-4b56-bd11-ae47d4e28b3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:00.328962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a24c1d9-bcb5-4b56-bd11-ae47d4e28b3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:00.329696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a24c1d9-bcb5-4b56-bd11-ae47d4e28b3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:00.476008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b3c1444d-49e0-4345-9574-0b4dc7ac6345 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1232829192", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b3c1444d-49e0-4345-9574-0b4dc7ac6345 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 492 May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1232829192", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1232829192', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '640304d1-fbbc-473c-9acb-60ed77473841'}]}}} May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise error May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: May 27 15:24:00.479959 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b3c1444d-49e0-4345-9574-0b4dc7ac6345 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:00.483766 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b3c1444d-49e0-4345-9574-0b4dc7ac6345 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.010870 May 27 15:24:00.486937 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2771/5527] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:24:00 2022] POST /compute/v2.1/servers => generated 624 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 27 15:24:00.492796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fbc2f6ac-59d4-4e67-9c92-17ddfa836f60 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:00.493706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fbc2f6ac-59d4-4e67-9c92-17ddfa836f60 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:00.526646 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fbc2f6ac-59d4-4e67-9c92-17ddfa836f60 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:00.527112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fbc2f6ac-59d4-4e67-9c92-17ddfa836f60 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:00.527909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fbc2f6ac-59d4-4e67-9c92-17ddfa836f60 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:00.528353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fbc2f6ac-59d4-4e67-9c92-17ddfa836f60 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:00.851395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7a24c1d9-bcb5-4b56-bd11-ae47d4e28b3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:00.859917 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7a24c1d9-bcb5-4b56-bd11-ae47d4e28b3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.554906 May 27 15:24:00.862685 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2757/5528] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:00 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:00.874744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-86825fd7-37b2-452b-8006-093eef02f254 tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] Calling method '.version_select at 0x7fc7756a0940>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:00.966835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fbc2f6ac-59d4-4e67-9c92-17ddfa836f60 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:00.971693 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-86825fd7-37b2-452b-8006-093eef02f254 tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2" status: 200 len: 352 microversion: 2.1 time: 0.107410 May 27 15:24:00.976557 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fbc2f6ac-59d4-4e67-9c92-17ddfa836f60 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.488348 May 27 15:24:00.977221 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2758/5529] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:24:00 2022] GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2 => generated 352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:00.978371 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2772/5530] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:00 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:00.986813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b2f7c063-57fb-4ab9-a9d4-747d0a219de4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:00.990284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b2f7c063-57fb-4ab9-a9d4-747d0a219de4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:01.001011 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-285e574f-5a75-406f-b973-3f90c2e854fd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:01.002018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-285e574f-5a75-406f-b973-3f90c2e854fd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:01.003872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=52 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:01.008278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2f7c063-57fb-4ab9-a9d4-747d0a219de4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:01.008780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2f7c063-57fb-4ab9-a9d4-747d0a219de4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:01.009811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2f7c063-57fb-4ab9-a9d4-747d0a219de4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:01.013378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2f7c063-57fb-4ab9-a9d4-747d0a219de4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:01.015315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-285e574f-5a75-406f-b973-3f90c2e854fd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:01.016107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-285e574f-5a75-406f-b973-3f90c2e854fd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:01.017241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-285e574f-5a75-406f-b973-3f90c2e854fd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:01.017859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-285e574f-5a75-406f-b973-3f90c2e854fd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:01.023473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:01.086882 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b2f7c063-57fb-4ab9-a9d4-747d0a219de4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Unlocking {{(pid=119248) unlock /opt/stack/nova/nova/compute/api.py:4729}} May 27 15:24:01.218230 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b2f7c063-57fb-4ab9-a9d4-747d0a219de4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action" status: 202 len: 0 microversion: 2.1 time: 0.239108 May 27 15:24:01.219574 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2759/5531] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:24:00 2022] POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:24:01.234285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-04ee96f0-cc89-41a0-a43d-ac5b6cb58eed tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:01.234937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-04ee96f0-cc89-41a0-a43d-ac5b6cb58eed tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:01.248017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04ee96f0-cc89-41a0-a43d-ac5b6cb58eed tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:01.248640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04ee96f0-cc89-41a0-a43d-ac5b6cb58eed tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:01.253384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04ee96f0-cc89-41a0-a43d-ac5b6cb58eed tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:01.254046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04ee96f0-cc89-41a0-a43d-ac5b6cb58eed tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:01.292194 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:01.350816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-285e574f-5a75-406f-b973-3f90c2e854fd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:01.382130 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-285e574f-5a75-406f-b973-3f90c2e854fd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.386226 May 27 15:24:01.384296 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2773/5532] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:00 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:01.522466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b129608d-5f6b-49df-8231-15b0fb3bd9c9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b129608d-5f6b-49df-8231-15b0fb3bd9c9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 416 May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'networks': [{'uuid': '640304d1-fbbc-473c-9acb-60ed77473841'}]}}} May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise error May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi On instance['server']: May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:01.526736 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 27 15:24:01.530626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:01.535699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b129608d-5f6b-49df-8231-15b0fb3bd9c9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:01.546473 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b129608d-5f6b-49df-8231-15b0fb3bd9c9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.028399 May 27 15:24:01.548595 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2774/5533] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:24:01 2022] POST /compute/v2.1/servers => generated 619 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:24:01.559515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a0233233-cb43-4279-9ac7-b3aa589f2f46 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:01.565257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a0233233-cb43-4279-9ac7-b3aa589f2f46 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:01.580418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a0233233-cb43-4279-9ac7-b3aa589f2f46 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:01.586881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a0233233-cb43-4279-9ac7-b3aa589f2f46 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:01.588216 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a0233233-cb43-4279-9ac7-b3aa589f2f46 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:01.589689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a0233233-cb43-4279-9ac7-b3aa589f2f46 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:02.062704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a0233233-cb43-4279-9ac7-b3aa589f2f46 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:02.075860 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a0233233-cb43-4279-9ac7-b3aa589f2f46 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.522866 May 27 15:24:02.080596 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2775/5534] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:01 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:02.110384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-04ee96f0-cc89-41a0-a43d-ac5b6cb58eed tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:02.125850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-df347f97-4309-4e8c-be97-31d39353b2fc tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] Calling method '.version_select at 0x7fc775b91700>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:02.130099 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-04ee96f0-cc89-41a0-a43d-ac5b6cb58eed tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.901736 May 27 15:24:02.134225 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2760/5535] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:01 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:02.142825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-205d681c-13f5-42bb-8b84-e5e778984ab6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:02.149348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-205d681c-13f5-42bb-8b84-e5e778984ab6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:02.174125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-205d681c-13f5-42bb-8b84-e5e778984ab6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:02.177097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-205d681c-13f5-42bb-8b84-e5e778984ab6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:02.178791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-205d681c-13f5-42bb-8b84-e5e778984ab6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:02.180923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-205d681c-13f5-42bb-8b84-e5e778984ab6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:02.249430 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-df347f97-4309-4e8c-be97-31d39353b2fc tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2" status: 200 len: 352 microversion: 2.1 time: 0.150154 May 27 15:24:02.251625 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2776/5536] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:24:02 2022] GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2 => generated 352 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:02.259466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2657c3f4-ce0e-4f4d-9e33-d4343c348085 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:02.263556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2657c3f4-ce0e-4f4d-9e33-d4343c348085 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:02.293267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2657c3f4-ce0e-4f4d-9e33-d4343c348085 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:02.294193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2657c3f4-ce0e-4f4d-9e33-d4343c348085 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:02.299696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2657c3f4-ce0e-4f4d-9e33-d4343c348085 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:02.302275 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2657c3f4-ce0e-4f4d-9e33-d4343c348085 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:02.587570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-205d681c-13f5-42bb-8b84-e5e778984ab6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:02.612401 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-205d681c-13f5-42bb-8b84-e5e778984ab6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.469542 May 27 15:24:02.614711 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2761/5537] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:02 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:02.721930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2657c3f4-ce0e-4f4d-9e33-d4343c348085 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:02.732111 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2657c3f4-ce0e-4f4d-9e33-d4343c348085 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.479100 May 27 15:24:02.735858 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2777/5538] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:02 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:02.751196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e6c738db-6420-4116-987e-ef0080acb8f9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:02.757208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e6c738db-6420-4116-987e-ef0080acb8f9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:02.772181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e6c738db-6420-4116-987e-ef0080acb8f9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:02.779994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e6c738db-6420-4116-987e-ef0080acb8f9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:02.785965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e6c738db-6420-4116-987e-ef0080acb8f9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:02.785965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e6c738db-6420-4116-987e-ef0080acb8f9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:02.792157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bc5797af-55f1-4001-b8b0-2138fdaefd0d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-368632214", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": -1, "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:02.823699 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-bc5797af-55f1-4001-b8b0-2138fdaefd0d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Flavor -1 could not be found. May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bc5797af-55f1-4001-b8b0-2138fdaefd0d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 205 May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-368632214", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": -1, "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: exception: Flavor -1 could not be found. May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-368632214', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': -1, 'networks': [{'uuid': '640304d1-fbbc-473c-9acb-60ed77473841'}]}}} May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:02.844057 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:02.848925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:02.848925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:02.848925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:02.848925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:02.848925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 27 15:24:02.848925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 27 15:24:02.848925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 27 15:24:02.848925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. May 27 15:24:02.848925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:02.848925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:02.848925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:02.848925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:02.848925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:02.848925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:02.848925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:02.848925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:02.848925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. May 27 15:24:02.848925 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:02.850833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bc5797af-55f1-4001-b8b0-2138fdaefd0d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:02.851401 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bc5797af-55f1-4001-b8b0-2138fdaefd0d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.064281 May 27 15:24:02.855217 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2778/5539] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:24:02 2022] POST /compute/v2.1/servers => generated 73 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 27 15:24:02.867217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ababa5a0-879d-4cb2-9d9a-fcbfef2a3980 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:02.873724 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ababa5a0-879d-4cb2-9d9a-fcbfef2a3980 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:02.889287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ababa5a0-879d-4cb2-9d9a-fcbfef2a3980 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:02.889504 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ababa5a0-879d-4cb2-9d9a-fcbfef2a3980 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:02.890219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ababa5a0-879d-4cb2-9d9a-fcbfef2a3980 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:02.890669 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ababa5a0-879d-4cb2-9d9a-fcbfef2a3980 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:03.309852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e6c738db-6420-4116-987e-ef0080acb8f9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:03.320268 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e6c738db-6420-4116-987e-ef0080acb8f9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.573952 May 27 15:24:03.324071 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2762/5540] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:02 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:03.331589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-53a2443a-6641-437d-ab69-cb11482eeeed tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] Calling method '.version_select at 0x7fc780670c10>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:03.339041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ababa5a0-879d-4cb2-9d9a-fcbfef2a3980 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:03.353561 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ababa5a0-879d-4cb2-9d9a-fcbfef2a3980 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.496300 May 27 15:24:03.354176 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2779/5541] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:02 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:24:03.398532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-40c19a82-32ee-435c-9622-7e3f501b5fe3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:03.400560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-40c19a82-32ee-435c-9622-7e3f501b5fe3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:03.423401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40c19a82-32ee-435c-9622-7e3f501b5fe3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:03.423879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40c19a82-32ee-435c-9622-7e3f501b5fe3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:03.424735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40c19a82-32ee-435c-9622-7e3f501b5fe3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:03.429681 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-40c19a82-32ee-435c-9622-7e3f501b5fe3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:03.450074 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-53a2443a-6641-437d-ab69-cb11482eeeed tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2" status: 200 len: 353 microversion: 2.1 time: 0.121241 May 27 15:24:03.456723 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2763/5542] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:24:03 2022] GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2 => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:03.462956 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-00d1b34e-d57a-415b-a35b-c2b9cb57a5c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:03.463590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-00d1b34e-d57a-415b-a35b-c2b9cb57a5c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:03.493038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-00d1b34e-d57a-415b-a35b-c2b9cb57a5c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:03.493546 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-00d1b34e-d57a-415b-a35b-c2b9cb57a5c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:03.496746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-00d1b34e-d57a-415b-a35b-c2b9cb57a5c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:03.497224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-00d1b34e-d57a-415b-a35b-c2b9cb57a5c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:03.701981 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-40c19a82-32ee-435c-9622-7e3f501b5fe3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action" status: 202 len: 0 microversion: 2.1 time: 0.331879 May 27 15:24:03.702951 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2780/5543] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:24:03 2022] POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:24:03.718335 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2002d489-f0c6-4e0b-8c44-b8f545163ae5 tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] Calling method '.version_select at 0x7fc775c913a0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:03.874169 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2002d489-f0c6-4e0b-8c44-b8f545163ae5 tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2" status: 200 len: 353 microversion: 2.1 time: 0.169945 May 27 15:24:03.875105 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2781/5544] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:24:03 2022] GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2 => generated 353 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:03.889248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-909366ea-c5b9-4516-9709-4b9b82ec2faa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:03.890296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-00d1b34e-d57a-415b-a35b-c2b9cb57a5c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:03.890746 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-909366ea-c5b9-4516-9709-4b9b82ec2faa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:03.909970 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-909366ea-c5b9-4516-9709-4b9b82ec2faa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:03.911340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-909366ea-c5b9-4516-9709-4b9b82ec2faa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:03.914674 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-909366ea-c5b9-4516-9709-4b9b82ec2faa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:03.916934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-909366ea-c5b9-4516-9709-4b9b82ec2faa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:03.920057 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-00d1b34e-d57a-415b-a35b-c2b9cb57a5c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.462127 May 27 15:24:03.938840 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2764/5545] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:03 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:03.963399 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-786dd6d7-45ab-41c0-817d-3b168c0fd848 tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] Calling method '.version_select at 0x7fc780670c10>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:04.126371 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-786dd6d7-45ab-41c0-817d-3b168c0fd848 tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2" status: 202 len: 0 microversion: 2.1 time: 0.172481 May 27 15:24:04.127169 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2765/5546] 10.222.0.13 () {58 vars in 1247 bytes} [Fri May 27 15:24:03 2022] DELETE /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:24:04.136431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0f5f2819-4f82-412e-b0b0-868e5a55c17f tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] Calling method '.version_select at 0x7fc78064c940>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:04.279202 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0f5f2819-4f82-412e-b0b0-868e5a55c17f tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2" status: 200 len: 352 microversion: 2.1 time: 0.147373 May 27 15:24:04.279788 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2766/5547] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:24:04 2022] GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2 => generated 352 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:04.284832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1fbf6b4b-983e-442b-8f29-691ab34a4fcb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-972148157", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1fbf6b4b-983e-442b-8f29-691ab34a4fcb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 172 May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-972148157", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-972148157', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '640304d1-fbbc-473c-9acb-60ed77473841'}]}}} May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance['server']: May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi -1 May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:24:04.288461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:24:04.294023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:24:04.294023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:24:04.294023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 27 15:24:04.294023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:04.294023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:04.294023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:04.294023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:04.294023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:04.294023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:04.294023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:24:04.294023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:24:04.294023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 27 15:24:04.294023 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:04.294023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1fbf6b4b-983e-442b-8f29-691ab34a4fcb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:04.294023 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1fbf6b4b-983e-442b-8f29-691ab34a4fcb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.009198 May 27 15:24:04.297244 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2767/5548] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:24:04 2022] POST /compute/v2.1/servers => generated 145 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:24:04.310820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7e780e60-73f4-4c15-8b44-855c5c56adbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:04.311457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7e780e60-73f4-4c15-8b44-855c5c56adbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:04.328275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e780e60-73f4-4c15-8b44-855c5c56adbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:04.328666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e780e60-73f4-4c15-8b44-855c5c56adbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:04.329732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e780e60-73f4-4c15-8b44-855c5c56adbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:04.330194 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e780e60-73f4-4c15-8b44-855c5c56adbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:04.534955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-909366ea-c5b9-4516-9709-4b9b82ec2faa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:04.544156 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-909366ea-c5b9-4516-9709-4b9b82ec2faa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1674 microversion: 2.1 time: 0.667466 May 27 15:24:04.551439 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2782/5549] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:03 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1674 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:04.788892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7e780e60-73f4-4c15-8b44-855c5c56adbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:04.797545 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7e780e60-73f4-4c15-8b44-855c5c56adbf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.499249 May 27 15:24:04.799840 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2768/5550] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:04 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:04.821595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-90f8f67d-d98d-49f5-b8c1-28e5b340e131 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:04.822229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-90f8f67d-d98d-49f5-b8c1-28e5b340e131 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:04.840564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90f8f67d-d98d-49f5-b8c1-28e5b340e131 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:04.841256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90f8f67d-d98d-49f5-b8c1-28e5b340e131 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:04.843006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90f8f67d-d98d-49f5-b8c1-28e5b340e131 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:04.845046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90f8f67d-d98d-49f5-b8c1-28e5b340e131 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:05.292120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-378c8eeb-68ef-427d-84ce-31fc39ab20de tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] Calling method '.version_select at 0x7fc7807fff70>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:05.367099 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-378c8eeb-68ef-427d-84ce-31fc39ab20de tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2" status: 200 len: 352 microversion: 2.1 time: 0.076959 May 27 15:24:05.368029 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2769/5551] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:24:05 2022] GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2 => generated 352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:24:05.502749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-90f8f67d-d98d-49f5-b8c1-28e5b340e131 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:05.535236 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-90f8f67d-d98d-49f5-b8c1-28e5b340e131 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.720054 May 27 15:24:05.538906 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2783/5552] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:04 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:05.567548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-25db7af8-fa8b-46d2-8955-2d20702bef70 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:05.568357 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-25db7af8-fa8b-46d2-8955-2d20702bef70 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:05.594901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-25db7af8-fa8b-46d2-8955-2d20702bef70 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:05.595379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-25db7af8-fa8b-46d2-8955-2d20702bef70 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:05.602084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-25db7af8-fa8b-46d2-8955-2d20702bef70 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:05.602508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-25db7af8-fa8b-46d2-8955-2d20702bef70 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:05.891825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-25db7af8-fa8b-46d2-8955-2d20702bef70 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:05.905934 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-25db7af8-fa8b-46d2-8955-2d20702bef70 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1654 microversion: 2.1 time: 0.342322 May 27 15:24:05.909074 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2770/5553] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:05 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1654 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:05.927967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-da040424-ab71-4416-b4c6-c550369f554d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:05.928519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-da040424-ab71-4416-b4c6-c550369f554d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:05.940482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da040424-ab71-4416-b4c6-c550369f554d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:05.940965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da040424-ab71-4416-b4c6-c550369f554d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:05.941758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da040424-ab71-4416-b4c6-c550369f554d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:05.942203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da040424-ab71-4416-b4c6-c550369f554d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:05.965273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-67f853a9-e2bd-4132-aa14-0ac32d0d9346 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1697442439", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:05.969636 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-67f853a9-e2bd-4132-aa14-0ac32d0d9346 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-67f853a9-e2bd-4132-aa14-0ac32d0d9346 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 216 May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1697442439", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1697442439', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._validate_network_id( May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:05.974830 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:05.980052 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:05.980052 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:05.980052 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:05.980052 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:05.980052 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:05.980052 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 27 15:24:05.980052 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:05.982125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-67f853a9-e2bd-4132-aa14-0ac32d0d9346 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:05.989048 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-67f853a9-e2bd-4132-aa14-0ac32d0d9346 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.027993 May 27 15:24:05.992216 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2771/5554] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:24:05 2022] POST /compute/v2.1/servers => generated 123 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:24:06.002611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-83b5b639-b9de-4a76-b64e-2351a69b58e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:06.005248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-83b5b639-b9de-4a76-b64e-2351a69b58e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:06.045880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-83b5b639-b9de-4a76-b64e-2351a69b58e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:06.047987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-83b5b639-b9de-4a76-b64e-2351a69b58e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:06.051329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-83b5b639-b9de-4a76-b64e-2351a69b58e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:06.051870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-83b5b639-b9de-4a76-b64e-2351a69b58e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:06.171515 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-da040424-ab71-4416-b4c6-c550369f554d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action" status: 202 len: 0 microversion: 2.1 time: 0.246689 May 27 15:24:06.187130 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2784/5555] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:24:05 2022] POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:24:06.210107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fd6a26ff-b463-4935-abdf-2cffd368a8ef tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:06.223804 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fd6a26ff-b463-4935-abdf-2cffd368a8ef tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:06.241831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd6a26ff-b463-4935-abdf-2cffd368a8ef tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:06.243981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd6a26ff-b463-4935-abdf-2cffd368a8ef tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:06.248141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd6a26ff-b463-4935-abdf-2cffd368a8ef tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:06.249071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd6a26ff-b463-4935-abdf-2cffd368a8ef tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:06.665604 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-83b5b639-b9de-4a76-b64e-2351a69b58e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:06.675061 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-83b5b639-b9de-4a76-b64e-2351a69b58e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.679308 May 27 15:24:06.680372 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2772/5556] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:05 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:06.690179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e5d3a929-a555-49a5-a3d6-b3b7c1b3659c tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] Calling method '.version_select at 0x7fc77594d040>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:06.798984 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e5d3a929-a555-49a5-a3d6-b3b7c1b3659c tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2" status: 200 len: 352 microversion: 2.1 time: 0.117167 May 27 15:24:06.800866 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2773/5557] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:24:06 2022] GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2 => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:06.806383 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5f13bcbc-cc66-4795-8aff-961b526fce98 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:06.807278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5f13bcbc-cc66-4795-8aff-961b526fce98 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:06.825013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f13bcbc-cc66-4795-8aff-961b526fce98 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:06.825790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f13bcbc-cc66-4795-8aff-961b526fce98 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:06.830535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f13bcbc-cc66-4795-8aff-961b526fce98 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:06.830535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f13bcbc-cc66-4795-8aff-961b526fce98 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:06.932542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fd6a26ff-b463-4935-abdf-2cffd368a8ef tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:06.962648 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fd6a26ff-b463-4935-abdf-2cffd368a8ef tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1661 microversion: 2.1 time: 0.769823 May 27 15:24:06.963363 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2785/5558] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:06 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1661 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:07.239701 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5f13bcbc-cc66-4795-8aff-961b526fce98 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:07.248329 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5f13bcbc-cc66-4795-8aff-961b526fce98 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.446141 May 27 15:24:07.252244 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2774/5559] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:06 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:07.414392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2e09173f-f934-485e-80cc-510a7356042d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2133955647", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "key_name": "tempest-key-727775127", "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:07.510689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-2e09173f-f934-485e-80cc-510a7356042d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] validate_networks() for [('640304d1-fbbc-473c-9acb-60ed77473841', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:24:07.815939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d8ca0683-f6d7-4013-ba22-abc26401d453 tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] Calling method '.version_select at 0x7fc77594d4c0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:07.945957 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d8ca0683-f6d7-4013-ba22-abc26401d453 tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2" status: 200 len: 352 microversion: 2.1 time: 0.136468 May 27 15:24:07.951379 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2775/5560] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:24:07 2022] GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2 => generated 352 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:07.981540 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-73e314ab-c16a-4173-95c3-2cd88438eace tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:07.982181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-73e314ab-c16a-4173-95c3-2cd88438eace tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:07.990264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73e314ab-c16a-4173-95c3-2cd88438eace tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:07.990735 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73e314ab-c16a-4173-95c3-2cd88438eace tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:07.991526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73e314ab-c16a-4173-95c3-2cd88438eace tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:07.992229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73e314ab-c16a-4173-95c3-2cd88438eace tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:08.009693 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-2e09173f-f934-485e-80cc-510a7356042d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Invalid key_name provided. May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2e09173f-f934-485e-80cc-510a7356042d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 246 May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2133955647", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "key_name": "tempest-key-727775127", "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid key_name provided. May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2133955647', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'key_name': 'tempest-key-727775127', 'networks': [{'uuid': '640304d1-fbbc-473c-9acb-60ed77473841'}]}}} May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._create_instance( May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-727775127 not found for user b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:08.016322 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2e09173f-f934-485e-80cc-510a7356042d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 400 to user: Invalid key_name provided. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:08.020636 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2e09173f-f934-485e-80cc-510a7356042d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.618634 May 27 15:24:08.026448 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2786/5561] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:24:07 2022] POST /compute/v2.1/servers => generated 70 bytes in 624 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 27 15:24:08.034974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fb84c153-e21d-4310-b2ec-0b875de181f0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:08.038656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fb84c153-e21d-4310-b2ec-0b875de181f0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:08.052306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb84c153-e21d-4310-b2ec-0b875de181f0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:08.054010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb84c153-e21d-4310-b2ec-0b875de181f0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:08.054855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb84c153-e21d-4310-b2ec-0b875de181f0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:08.055306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb84c153-e21d-4310-b2ec-0b875de181f0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:08.508371 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fb84c153-e21d-4310-b2ec-0b875de181f0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:08.520191 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fb84c153-e21d-4310-b2ec-0b875de181f0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.493351 May 27 15:24:08.523161 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2787/5562] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:08 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:08.542327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9fc737a1-9d61-422c-aa6d-ba3338952918 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:08.544419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9fc737a1-9d61-422c-aa6d-ba3338952918 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:08.554241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9fc737a1-9d61-422c-aa6d-ba3338952918 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:08.555018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9fc737a1-9d61-422c-aa6d-ba3338952918 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:08.556119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9fc737a1-9d61-422c-aa6d-ba3338952918 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:08.556854 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9fc737a1-9d61-422c-aa6d-ba3338952918 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:08.559534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-73e314ab-c16a-4173-95c3-2cd88438eace tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:08.575165 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-73e314ab-c16a-4173-95c3-2cd88438eace tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.598369 May 27 15:24:08.578589 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2776/5563] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:07 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:08.596256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-10f1bdc5-8afc-45b4-8cff-37a696aecbc6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:08.597412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-10f1bdc5-8afc-45b4-8cff-37a696aecbc6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:08.617343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10f1bdc5-8afc-45b4-8cff-37a696aecbc6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:08.617869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10f1bdc5-8afc-45b4-8cff-37a696aecbc6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:08.618695 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10f1bdc5-8afc-45b4-8cff-37a696aecbc6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:08.619595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10f1bdc5-8afc-45b4-8cff-37a696aecbc6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:09.323203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9fc737a1-9d61-422c-aa6d-ba3338952918 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:09.340659 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9fc737a1-9d61-422c-aa6d-ba3338952918 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.796478 May 27 15:24:09.341416 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2788/5564] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:08 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:24:09.348365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-86962431-4172-4c43-aa6d-bade2f00d93b tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] Calling method '.version_select at 0x7fc775b75550>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:09.514368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-10f1bdc5-8afc-45b4-8cff-37a696aecbc6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:09.518039 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-86962431-4172-4c43-aa6d-bade2f00d93b tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2" status: 200 len: 352 microversion: 2.1 time: 0.174244 May 27 15:24:09.520091 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2789/5565] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:24:09 2022] GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2 => generated 352 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:09.548608 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-10f1bdc5-8afc-45b4-8cff-37a696aecbc6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.958216 May 27 15:24:09.549276 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2777/5566] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:08 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:24:09.571247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dc50166a-8485-4b16-83ef-50b62e119f22 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:09.572175 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dc50166a-8485-4b16-83ef-50b62e119f22 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:09.580684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc50166a-8485-4b16-83ef-50b62e119f22 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:09.581384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc50166a-8485-4b16-83ef-50b62e119f22 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:09.582830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc50166a-8485-4b16-83ef-50b62e119f22 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:09.583445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc50166a-8485-4b16-83ef-50b62e119f22 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:09.670527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e7c235e9-f5b2-440a-b41a-2d937a8f9a61 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-941105392", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:10.077470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.security_group_api [None req-e7c235e9-f5b2-440a-b41a-2d937a8f9a61 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Neutron security group does_not_exist not found {{(pid=119248) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} May 27 15:24:10.078093 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-e7c235e9-f5b2-440a-b41a-2d937a8f9a61 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e7c235e9-f5b2-440a-b41a-2d937a8f9a61 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 257 May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-941105392", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: exception: Unable to find security_group with name or id 'does_not_exist' May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-941105392', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '640304d1-fbbc-473c-9acb-60ed77473841'}]}}} May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name May 27 15:24:10.097121 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._create_instance( May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' May 27 15:24:10.102645 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:10.108818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e7c235e9-f5b2-440a-b41a-2d937a8f9a61 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:10.109150 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e7c235e9-f5b2-440a-b41a-2d937a8f9a61 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.443454 May 27 15:24:10.109935 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2778/5567] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:24:09 2022] POST /compute/v2.1/servers => generated 106 bytes in 445 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:24:10.118644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-362036ac-4154-43de-979c-5e82f38f76dd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:10.119600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-362036ac-4154-43de-979c-5e82f38f76dd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:10.142212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-362036ac-4154-43de-979c-5e82f38f76dd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:10.143724 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-362036ac-4154-43de-979c-5e82f38f76dd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:10.145705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-362036ac-4154-43de-979c-5e82f38f76dd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:10.146171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-362036ac-4154-43de-979c-5e82f38f76dd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:10.284369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dc50166a-8485-4b16-83ef-50b62e119f22 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:10.296313 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dc50166a-8485-4b16-83ef-50b62e119f22 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.731631 May 27 15:24:10.306710 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2790/5568] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:09 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:10.316054 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-84edc7ed-84b0-40b0-aa3a-4dc2622237cc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:10.316753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-84edc7ed-84b0-40b0-aa3a-4dc2622237cc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:10.326762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84edc7ed-84b0-40b0-aa3a-4dc2622237cc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:10.327368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84edc7ed-84b0-40b0-aa3a-4dc2622237cc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:10.328069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84edc7ed-84b0-40b0-aa3a-4dc2622237cc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:10.328577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-84edc7ed-84b0-40b0-aa3a-4dc2622237cc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:10.596482 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-362036ac-4154-43de-979c-5e82f38f76dd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:10.610921 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-362036ac-4154-43de-979c-5e82f38f76dd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.496266 May 27 15:24:10.621021 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2779/5569] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:10 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:10.641010 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c30947e0-dc5c-4553-a4d3-e3835afb0609 tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] Calling method '.version_select at 0x7fc77588b430>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:10.681300 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-c30947e0-dc5c-4553-a4d3-e3835afb0609 tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] HTTP exception thrown: Volume 966b0a52-7077-4291-b58a-f8c6bd1a39f2 could not be found. May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c30947e0-dc5c-4553-a4d3-e3835afb0609 tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] Request method failure captured: May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2 HTTP/1.1 May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikO0OwInbp-_rmqL3EPLIwHY7sYMCckOo0L4AO_3CM8bo4UlK025u7i3VFz603axOz9FZ4s8bo1g5Dekz-QRa3_KtiIXxdRsSpI1i3wNb_kMcPhF3zgGOuDB4RhoaiKti597VVCHGTMN3O5tOpVLcabv3-WSgP8_bSiaa0o5X1t8VBF4 May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 74f7c0e4cab94885ab4ea6603bbe23a3 May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-VolumesGetTestJSON-1573262244 May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/74f7c0e4cab94885ab4ea6603bbe23a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/74f7c0e4cab94885ab4ea6603bbe23a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/74f7c0e4cab94885ab4ea6603bbe23a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_74f7c0e4cab94885ab4ea6603bbe23a3", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-VolumesGetTestJSON-1573262244 May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 74f7c0e4cab94885ab4ea6603bbe23a3 May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-VolumesGetTestJSON-1573262244 May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-VolumesGetTestJSON-1573262244-project May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 1fce9b6decb544d69f8a55df75e35256 May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-VolumesGetTestJSON-1573262244-project May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: method: May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: exception: Volume 966b0a52-7077-4291-b58a-f8c6bd1a39f2 could not be found. May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '966b0a52-7077-4291-b58a-f8c6bd1a39f2'} May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 966b0a52-7077-4291-b58a-f8c6bd1a39f2 could not be found. (HTTP 404) (Request-ID: req-b9485fb1-68af-4db3-91cb-aac61c0a3708) May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:24:10.683319 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 966b0a52-7077-4291-b58a-f8c6bd1a39f2 could not be found. May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 966b0a52-7077-4291-b58a-f8c6bd1a39f2 could not be found. May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 966b0a52-7077-4291-b58a-f8c6bd1a39f2 could not be found. May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c30947e0-dc5c-4553-a4d3-e3835afb0609 tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] Returning 404 to user: Volume 966b0a52-7077-4291-b58a-f8c6bd1a39f2 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c30947e0-dc5c-4553-a4d3-e3835afb0609 tempest-VolumesGetTestJSON-1573262244 tempest-VolumesGetTestJSON-1573262244-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2" status: 404 len: 109 microversion: 2.1 time: 0.062490 May 27 15:24:10.688461 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2780/5570] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:24:10 2022] GET /compute/v2.1/os-volumes/966b0a52-7077-4291-b58a-f8c6bd1a39f2 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:24:10.695492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ccacad09-6127-4060-bb51-d08818b349e6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:10.695492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ccacad09-6127-4060-bb51-d08818b349e6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:10.717662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-84edc7ed-84b0-40b0-aa3a-4dc2622237cc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:10.738452 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-84edc7ed-84b0-40b0-aa3a-4dc2622237cc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.428941 May 27 15:24:10.751134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccacad09-6127-4060-bb51-d08818b349e6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:10.751605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccacad09-6127-4060-bb51-d08818b349e6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:10.752414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccacad09-6127-4060-bb51-d08818b349e6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:10.761091 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2791/5571] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:10 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:24:10.767228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4b43d699-564d-4674-8626-028dbabe3c20 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:10.767228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4b43d699-564d-4674-8626-028dbabe3c20 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:10.768379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ccacad09-6127-4060-bb51-d08818b349e6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:10.800308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b43d699-564d-4674-8626-028dbabe3c20 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:10.800712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b43d699-564d-4674-8626-028dbabe3c20 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:10.801500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b43d699-564d-4674-8626-028dbabe3c20 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:10.813359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b43d699-564d-4674-8626-028dbabe3c20 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:11.334393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ccacad09-6127-4060-bb51-d08818b349e6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:11.348529 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ccacad09-6127-4060-bb51-d08818b349e6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.662107 May 27 15:24:11.365915 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2781/5572] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:10 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:11.372013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8495f9f6-1fd7-4a31-9c87-30f3d134f6d9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:11.378960 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4b43d699-564d-4674-8626-028dbabe3c20 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:11.381838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8495f9f6-1fd7-4a31-9c87-30f3d134f6d9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 69f056fd-1dcf-4444-87fd-a99a812e8530] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:11.396131 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4b43d699-564d-4674-8626-028dbabe3c20 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.629727 May 27 15:24:11.397272 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2792/5573] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:10 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:11.402373 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-8495f9f6-1fd7-4a31-9c87-30f3d134f6d9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance 69f056fd-1dcf-4444-87fd-a99a812e8530 could not be found. May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8495f9f6-1fd7-4a31-9c87-30f3d134f6d9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/69f056fd-1dcf-4444-87fd-a99a812e8530 HTTP/1.1 May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 69f056fd-1dcf-4444-87fd-a99a812e8530 could not be found. May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '69f056fd-1dcf-4444-87fd-a99a812e8530'} May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f056fd-1dcf-4444-87fd-a99a812e8530 could not be found. May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f056fd-1dcf-4444-87fd-a99a812e8530 could not be found. May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:11.407930 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:11.413427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:11.413427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:11.413427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:11.413427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:11.413427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:11.413427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f056fd-1dcf-4444-87fd-a99a812e8530 could not be found. May 27 15:24:11.413427 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:11.415908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7e35244a-b3a4-4135-8c2f-f32ff7643f1f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:11.416570 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7e35244a-b3a4-4135-8c2f-f32ff7643f1f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:11.417410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8495f9f6-1fd7-4a31-9c87-30f3d134f6d9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance 69f056fd-1dcf-4444-87fd-a99a812e8530 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:11.420587 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8495f9f6-1fd7-4a31-9c87-30f3d134f6d9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "DELETE /compute/v2.1/servers/69f056fd-1dcf-4444-87fd-a99a812e8530" status: 404 len: 111 microversion: 2.1 time: 0.053377 May 27 15:24:11.425928 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2782/5574] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:24:11 2022] DELETE /compute/v2.1/servers/69f056fd-1dcf-4444-87fd-a99a812e8530 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:24:11.434688 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ad21b096-6847-4a8e-9139-5a7363fc5959 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:11.435702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ad21b096-6847-4a8e-9139-5a7363fc5959 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:11.443607 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad21b096-6847-4a8e-9139-5a7363fc5959 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:11.444542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad21b096-6847-4a8e-9139-5a7363fc5959 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:11.446104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad21b096-6847-4a8e-9139-5a7363fc5959 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:11.447151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad21b096-6847-4a8e-9139-5a7363fc5959 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:11.456284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e35244a-b3a4-4135-8c2f-f32ff7643f1f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:11.456770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e35244a-b3a4-4135-8c2f-f32ff7643f1f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:11.480003 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e35244a-b3a4-4135-8c2f-f32ff7643f1f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:11.483160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e35244a-b3a4-4135-8c2f-f32ff7643f1f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:12.103187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ad21b096-6847-4a8e-9139-5a7363fc5959 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:12.112775 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ad21b096-6847-4a8e-9139-5a7363fc5959 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.685405 May 27 15:24:12.127053 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2783/5575] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:11 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:12.133872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-08242f30-e339-45d1-b67d-953a83a77331 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:12.135645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-08242f30-e339-45d1-b67d-953a83a77331 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:12.143790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08242f30-e339-45d1-b67d-953a83a77331 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:12.144479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08242f30-e339-45d1-b67d-953a83a77331 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:12.145705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08242f30-e339-45d1-b67d-953a83a77331 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:12.146356 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-08242f30-e339-45d1-b67d-953a83a77331 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:12.204187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7e35244a-b3a4-4135-8c2f-f32ff7643f1f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:12.207346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:12.228103 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7e35244a-b3a4-4135-8c2f-f32ff7643f1f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.814843 May 27 15:24:12.229247 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2793/5576] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:11 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:24:12.589107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-08242f30-e339-45d1-b67d-953a83a77331 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:12.604023 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-08242f30-e339-45d1-b67d-953a83a77331 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.475139 May 27 15:24:12.610917 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2784/5577] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:12 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:12.633297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-62d45cff-a88b-495c-8ca9-3b7de9b2ffd9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:12.634093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-62d45cff-a88b-495c-8ca9-3b7de9b2ffd9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2926}} May 27 15:24:12.634332 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-62d45cff-a88b-495c-8ca9-3b7de9b2ffd9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-62d45cff-a88b-495c-8ca9-3b7de9b2ffd9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 9223372036854775808 could not be found. May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '9223372036854775808'} May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:12.637596 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:12.643523 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:12.643523 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:12.643523 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:12.643523 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. May 27 15:24:12.643523 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:12.653562 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-62d45cff-a88b-495c-8ca9-3b7de9b2ffd9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:12.654865 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-62d45cff-a88b-495c-8ca9-3b7de9b2ffd9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.027925 May 27 15:24:12.658109 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2794/5578] 10.222.0.13 () {58 vars in 1187 bytes} [Fri May 27 15:24:12 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:24:12.672126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8e5bd20a-0a31-4d94-991a-a99036e1edb6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:12.679352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8e5bd20a-0a31-4d94-991a-a99036e1edb6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:12.735392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e5bd20a-0a31-4d94-991a-a99036e1edb6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:12.735972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e5bd20a-0a31-4d94-991a-a99036e1edb6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:12.736868 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e5bd20a-0a31-4d94-991a-a99036e1edb6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:12.737317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e5bd20a-0a31-4d94-991a-a99036e1edb6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:13.149876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8e5bd20a-0a31-4d94-991a-a99036e1edb6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:13.159456 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8e5bd20a-0a31-4d94-991a-a99036e1edb6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.494538 May 27 15:24:13.164471 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2785/5579] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:12 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:13.193776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3a3e34d6-0f3c-4214-a845-c9ecd35f8d3c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:13.194725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3a3e34d6-0f3c-4214-a845-c9ecd35f8d3c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:13.233181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a3e34d6-0f3c-4214-a845-c9ecd35f8d3c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:13.236606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a3e34d6-0f3c-4214-a845-c9ecd35f8d3c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:13.241661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a3e34d6-0f3c-4214-a845-c9ecd35f8d3c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:13.242738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a3e34d6-0f3c-4214-a845-c9ecd35f8d3c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:13.603601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3a3e34d6-0f3c-4214-a845-c9ecd35f8d3c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:13.616107 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3a3e34d6-0f3c-4214-a845-c9ecd35f8d3c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.430473 May 27 15:24:13.617339 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2795/5580] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:13 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:13.639770 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-45659b6d-58d5-4698-8511-b11230a2e428 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:13.640267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-45659b6d-58d5-4698-8511-b11230a2e428 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Failed to fetch instance by id -1 {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2926}} May 27 15:24:13.640954 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-45659b6d-58d5-4698-8511-b11230a2e428 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance -1 could not be found. May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-45659b6d-58d5-4698-8511-b11230a2e428 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance -1 could not be found. May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '-1'} May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:13.642626 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:13.647933 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:13.647933 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:13.647933 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. May 27 15:24:13.647933 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:13.649224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-45659b6d-58d5-4698-8511-b11230a2e428 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:13.650257 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-45659b6d-58d5-4698-8511-b11230a2e428 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.014394 May 27 15:24:13.654743 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2786/5581] 10.222.0.13 () {58 vars in 1136 bytes} [Fri May 27 15:24:13 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 15:24:13.666444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f4879c1e-6279-4aa4-bf41-36890447cabe tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:13.675015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f4879c1e-6279-4aa4-bf41-36890447cabe tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:13.694562 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4879c1e-6279-4aa4-bf41-36890447cabe tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:13.695688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4879c1e-6279-4aa4-bf41-36890447cabe tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:13.696969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4879c1e-6279-4aa4-bf41-36890447cabe tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:13.702205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4879c1e-6279-4aa4-bf41-36890447cabe tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:14.308469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f4879c1e-6279-4aa4-bf41-36890447cabe tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:14.321728 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f4879c1e-6279-4aa4-bf41-36890447cabe tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.658728 May 27 15:24:14.323822 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2796/5582] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:13 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:14.346823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9706107a-28e0-49f0-b8e0-d3b53e8a6477 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:14.347462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9706107a-28e0-49f0-b8e0-d3b53e8a6477 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:14.378503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9706107a-28e0-49f0-b8e0-d3b53e8a6477 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:14.380548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9706107a-28e0-49f0-b8e0-d3b53e8a6477 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:14.382271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9706107a-28e0-49f0-b8e0-d3b53e8a6477 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:14.382718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9706107a-28e0-49f0-b8e0-d3b53e8a6477 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:15.291537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9706107a-28e0-49f0-b8e0-d3b53e8a6477 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:15.306591 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9706107a-28e0-49f0-b8e0-d3b53e8a6477 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.964658 May 27 15:24:15.308607 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2787/5583] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:14 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:15.326332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2d968797-c924-4093-98dc-f07c094933c5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:15.327325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2d968797-c924-4093-98dc-f07c094933c5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 97af9aab-383b-40db-99f4-6f6b433e814c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:15.342935 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-2d968797-c924-4093-98dc-f07c094933c5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance 97af9aab-383b-40db-99f4-6f6b433e814c could not be found. May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2d968797-c924-4093-98dc-f07c094933c5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/97af9aab-383b-40db-99f4-6f6b433e814c/action HTTP/1.1 May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 19 May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: {"forceDelete": {}} May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 97af9aab-383b-40db-99f4-6f6b433e814c could not be found. May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '97af9aab-383b-40db-99f4-6f6b433e814c', 'body': {'forceDelete': {}}} May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97af9aab-383b-40db-99f4-6f6b433e814c could not be found. May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97af9aab-383b-40db-99f4-6f6b433e814c could not be found. May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:15.348007 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:15.357855 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:15.357855 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:15.357855 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97af9aab-383b-40db-99f4-6f6b433e814c could not be found. May 27 15:24:15.357855 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:15.357855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2d968797-c924-4093-98dc-f07c094933c5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance 97af9aab-383b-40db-99f4-6f6b433e814c could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:15.357855 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2d968797-c924-4093-98dc-f07c094933c5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/97af9aab-383b-40db-99f4-6f6b433e814c/action" status: 404 len: 111 microversion: 2.1 time: 0.027262 May 27 15:24:15.357855 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2797/5584] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:24:15 2022] POST /compute/v2.1/servers/97af9aab-383b-40db-99f4-6f6b433e814c/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:24:15.358689 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0bcfea50-cd85-4896-bd7b-2849e3ef5119 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:15.360126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0bcfea50-cd85-4896-bd7b-2849e3ef5119 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:15.385226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bcfea50-cd85-4896-bd7b-2849e3ef5119 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:15.385882 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bcfea50-cd85-4896-bd7b-2849e3ef5119 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:15.386850 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bcfea50-cd85-4896-bd7b-2849e3ef5119 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:15.387456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bcfea50-cd85-4896-bd7b-2849e3ef5119 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:15.702738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0bcfea50-cd85-4896-bd7b-2849e3ef5119 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:15.727067 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0bcfea50-cd85-4896-bd7b-2849e3ef5119 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.372085 May 27 15:24:15.728898 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2788/5585] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:15 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:15.751642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7d7b0251-c808-479b-ba4c-7655c2f02db6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:15.753507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7d7b0251-c808-479b-ba4c-7655c2f02db6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:15.773788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d7b0251-c808-479b-ba4c-7655c2f02db6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:15.774600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d7b0251-c808-479b-ba4c-7655c2f02db6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:15.775620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d7b0251-c808-479b-ba4c-7655c2f02db6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:15.776373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d7b0251-c808-479b-ba4c-7655c2f02db6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:16.136104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7d7b0251-c808-479b-ba4c-7655c2f02db6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:16.144829 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7d7b0251-c808-479b-ba4c-7655c2f02db6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.401122 May 27 15:24:16.145417 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2798/5586] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:15 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:16.166412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b6a4c72c-7c7d-4790-b05a-6a6557f0c616 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:16.167417 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b6a4c72c-7c7d-4790-b05a-6a6557f0c616 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: e97ccf16-ce3c-4a6c-94ce-7c200ce76eec] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:16.177494 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-b6a4c72c-7c7d-4790-b05a-6a6557f0c616 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance e97ccf16-ce3c-4a6c-94ce-7c200ce76eec could not be found. May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b6a4c72c-7c7d-4790-b05a-6a6557f0c616 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/e97ccf16-ce3c-4a6c-94ce-7c200ce76eec/action HTTP/1.1 May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 39 May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: {"os-getConsoleOutput": {"length": 10}} May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance e97ccf16-ce3c-4a6c-94ce-7c200ce76eec could not be found. May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'e97ccf16-ce3c-4a6c-94ce-7c200ce76eec', 'body': {'os-getConsoleOutput': {'length': 10}}} May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97ccf16-ce3c-4a6c-94ce-7c200ce76eec could not be found. May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97ccf16-ce3c-4a6c-94ce-7c200ce76eec could not be found. May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:16.186619 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:16.193191 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:16.193191 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:16.193191 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:16.193191 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:16.193191 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97ccf16-ce3c-4a6c-94ce-7c200ce76eec could not be found. May 27 15:24:16.193191 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:16.193191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b6a4c72c-7c7d-4790-b05a-6a6557f0c616 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance e97ccf16-ce3c-4a6c-94ce-7c200ce76eec could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:16.193191 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b6a4c72c-7c7d-4790-b05a-6a6557f0c616 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/e97ccf16-ce3c-4a6c-94ce-7c200ce76eec/action" status: 404 len: 111 microversion: 2.1 time: 0.028030 May 27 15:24:16.193191 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2789/5587] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:24:16 2022] POST /compute/v2.1/servers/e97ccf16-ce3c-4a6c-94ce-7c200ce76eec/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:24:16.200093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ef82418d-56f8-4509-9c4a-7f840ae95bba tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:16.201061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ef82418d-56f8-4509-9c4a-7f840ae95bba tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:16.211862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef82418d-56f8-4509-9c4a-7f840ae95bba tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:16.213784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef82418d-56f8-4509-9c4a-7f840ae95bba tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:16.218056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef82418d-56f8-4509-9c4a-7f840ae95bba tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:16.218785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef82418d-56f8-4509-9c4a-7f840ae95bba tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:16.628487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ef82418d-56f8-4509-9c4a-7f840ae95bba tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:16.640991 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ef82418d-56f8-4509-9c4a-7f840ae95bba tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.441889 May 27 15:24:16.642398 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2799/5588] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:16 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:16.664968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ea3b891f-5acd-42e2-85e9-76648316ebd8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:16.665599 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ea3b891f-5acd-42e2-85e9-76648316ebd8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:16.675652 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea3b891f-5acd-42e2-85e9-76648316ebd8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:16.677290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea3b891f-5acd-42e2-85e9-76648316ebd8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:16.678695 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea3b891f-5acd-42e2-85e9-76648316ebd8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:16.679380 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea3b891f-5acd-42e2-85e9-76648316ebd8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:16.691063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:16.936326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ea3b891f-5acd-42e2-85e9-76648316ebd8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:16.947553 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ea3b891f-5acd-42e2-85e9-76648316ebd8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.287277 May 27 15:24:16.948870 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2790/5589] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:16 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:16.965251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9a7c3cce-6ff2-40dc-b7b0-438c17ebe31b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:16.966242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9a7c3cce-6ff2-40dc-b7b0-438c17ebe31b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 0405a118-9063-4627-a676-d9103d7decb0] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:16.972440 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-9a7c3cce-6ff2-40dc-b7b0-438c17ebe31b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance 0405a118-9063-4627-a676-d9103d7decb0 could not be found. May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9a7c3cce-6ff2-40dc-b7b0-438c17ebe31b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/0405a118-9063-4627-a676-d9103d7decb0 HTTP/1.1 May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 0405a118-9063-4627-a676-d9103d7decb0 could not be found. May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '0405a118-9063-4627-a676-d9103d7decb0'} May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0405a118-9063-4627-a676-d9103d7decb0 could not be found. May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0405a118-9063-4627-a676-d9103d7decb0 could not be found. May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:16.975017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:16.979253 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:16.979253 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:16.979253 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:16.979253 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0405a118-9063-4627-a676-d9103d7decb0 could not be found. May 27 15:24:16.979253 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:16.979253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9a7c3cce-6ff2-40dc-b7b0-438c17ebe31b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance 0405a118-9063-4627-a676-d9103d7decb0 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:16.979253 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9a7c3cce-6ff2-40dc-b7b0-438c17ebe31b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/0405a118-9063-4627-a676-d9103d7decb0" status: 404 len: 111 microversion: 2.1 time: 0.015352 May 27 15:24:16.979253 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2800/5590] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:16 2022] GET /compute/v2.1/servers/0405a118-9063-4627-a676-d9103d7decb0 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:24:16.988765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6ca90adb-ac44-4670-aeb3-c1168bc675f5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:16.989455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6ca90adb-ac44-4670-aeb3-c1168bc675f5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:16.997077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ca90adb-ac44-4670-aeb3-c1168bc675f5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:16.997534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ca90adb-ac44-4670-aeb3-c1168bc675f5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:16.998679 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ca90adb-ac44-4670-aeb3-c1168bc675f5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:16.999432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6ca90adb-ac44-4670-aeb3-c1168bc675f5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:17.198509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6ca90adb-ac44-4670-aeb3-c1168bc675f5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:17.228584 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6ca90adb-ac44-4670-aeb3-c1168bc675f5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.243654 May 27 15:24:17.251730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cca9cc2b-68fa-4f47-91f9-d50278d7b7a9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:17.252956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cca9cc2b-68fa-4f47-91f9-d50278d7b7a9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:17.259922 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2791/5591] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:16 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:17.275635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cca9cc2b-68fa-4f47-91f9-d50278d7b7a9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:17.276824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cca9cc2b-68fa-4f47-91f9-d50278d7b7a9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:17.277564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cca9cc2b-68fa-4f47-91f9-d50278d7b7a9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:17.278014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cca9cc2b-68fa-4f47-91f9-d50278d7b7a9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:17.609271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cca9cc2b-68fa-4f47-91f9-d50278d7b7a9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:17.620707 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cca9cc2b-68fa-4f47-91f9-d50278d7b7a9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.377323 May 27 15:24:17.637353 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2801/5592] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:17 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:24:17.899156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a84ba0e5-785c-4b7e-8bd0-37f323f8b50f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1442255003", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a84ba0e5-785c-4b7e-8bd0-37f323f8b50f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 238 May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1442255003", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1442255003', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '640304d1-fbbc-473c-9acb-60ed77473841'}]}}} May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance['server']: May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:24:17.911180 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:24:17.915946 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:24:17.915946 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:24:17.915946 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 27 15:24:17.915946 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:17.915946 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:17.915946 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:17.915946 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:17.915946 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:17.915946 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:17.915946 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:24:17.915946 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:24:17.915946 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 27 15:24:17.915946 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:17.915946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a84ba0e5-785c-4b7e-8bd0-37f323f8b50f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:17.923969 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a84ba0e5-785c-4b7e-8bd0-37f323f8b50f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.032620 May 27 15:24:17.934335 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e07537f5-8c62-4ce8-b394-ea1083231dea tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:17.935287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e07537f5-8c62-4ce8-b394-ea1083231dea tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:17.937271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=70 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:17.938956 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2792/5593] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:24:17 2022] POST /compute/v2.1/servers => generated 139 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:24:17.950619 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e07537f5-8c62-4ce8-b394-ea1083231dea tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:17.951727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e07537f5-8c62-4ce8-b394-ea1083231dea tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:17.955038 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e07537f5-8c62-4ce8-b394-ea1083231dea tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:17.956145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e07537f5-8c62-4ce8-b394-ea1083231dea tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:18.254081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e07537f5-8c62-4ce8-b394-ea1083231dea tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:18.263127 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e07537f5-8c62-4ce8-b394-ea1083231dea tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.333179 May 27 15:24:18.283056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ca6ae647-0a7f-47d6-ac19-67a998a2b39c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:18.283685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ca6ae647-0a7f-47d6-ac19-67a998a2b39c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:18.285406 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2802/5594] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:17 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:18.293261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca6ae647-0a7f-47d6-ac19-67a998a2b39c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:18.293943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca6ae647-0a7f-47d6-ac19-67a998a2b39c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:18.294900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca6ae647-0a7f-47d6-ac19-67a998a2b39c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:18.295717 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca6ae647-0a7f-47d6-ac19-67a998a2b39c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:18.674898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ca6ae647-0a7f-47d6-ac19-67a998a2b39c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:18.683988 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ca6ae647-0a7f-47d6-ac19-67a998a2b39c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.407208 May 27 15:24:18.690642 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2793/5595] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:18 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:18.886634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9d0e4ce1-eb3d-40d5-abb4-de0df0bfd5c0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-655779016", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9d0e4ce1-eb3d-40d5-abb4-de0df0bfd5c0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 234 May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-655779016", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-655779016', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '640304d1-fbbc-473c-9acb-60ed77473841'}]}}} May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = func(instance) May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise error May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi On instance['server']: May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi 'notvalid' May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:18.892883 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9d0e4ce1-eb3d-40d5-abb4-de0df0bfd5c0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9d0e4ce1-eb3d-40d5-abb4-de0df0bfd5c0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.011929 May 27 15:24:18.902683 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2803/5596] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:24:18 2022] POST /compute/v2.1/servers => generated 133 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:24:18.907402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-009301fb-357a-480d-9a3f-8a6d24b953e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:18.909238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-009301fb-357a-480d-9a3f-8a6d24b953e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:18.933849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-009301fb-357a-480d-9a3f-8a6d24b953e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:18.935673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-009301fb-357a-480d-9a3f-8a6d24b953e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:18.936568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-009301fb-357a-480d-9a3f-8a6d24b953e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:18.941044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-009301fb-357a-480d-9a3f-8a6d24b953e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:19.504988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-009301fb-357a-480d-9a3f-8a6d24b953e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:19.522061 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-009301fb-357a-480d-9a3f-8a6d24b953e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.621309 May 27 15:24:19.523838 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2794/5597] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:18 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:19.555703 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-42b9b43e-131c-4162-acc2-ffb22b9089b0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:19.556346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-42b9b43e-131c-4162-acc2-ffb22b9089b0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:19.583890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42b9b43e-131c-4162-acc2-ffb22b9089b0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:19.586756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42b9b43e-131c-4162-acc2-ffb22b9089b0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:19.590042 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42b9b43e-131c-4162-acc2-ffb22b9089b0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:19.590525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42b9b43e-131c-4162-acc2-ffb22b9089b0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:20.066867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-42b9b43e-131c-4162-acc2-ffb22b9089b0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:20.079768 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-42b9b43e-131c-4162-acc2-ffb22b9089b0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.537357 May 27 15:24:20.084893 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2804/5598] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:19 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:20.097846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-17b058a4-6200-412d-9218-5a2e41bd505b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:20.100588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-17b058a4-6200-412d-9218-5a2e41bd505b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 7c2f98d8-cc1f-4189-a17c-80005290ede1] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:20.107683 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-17b058a4-6200-412d-9218-5a2e41bd505b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance 7c2f98d8-cc1f-4189-a17c-80005290ede1 could not be found. May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-17b058a4-6200-412d-9218-5a2e41bd505b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/7c2f98d8-cc1f-4189-a17c-80005290ede1/action HTTP/1.1 May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 13 May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: {"pause": {}} May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 7c2f98d8-cc1f-4189-a17c-80005290ede1 could not be found. May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '7c2f98d8-cc1f-4189-a17c-80005290ede1', 'body': {'pause': {}}} May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2f98d8-cc1f-4189-a17c-80005290ede1 could not be found. May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2f98d8-cc1f-4189-a17c-80005290ede1 could not be found. May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:20.123745 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:20.129137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:20.129137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:20.129137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2f98d8-cc1f-4189-a17c-80005290ede1 could not be found. May 27 15:24:20.129137 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:20.133230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-17b058a4-6200-412d-9218-5a2e41bd505b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance 7c2f98d8-cc1f-4189-a17c-80005290ede1 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:20.134138 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-17b058a4-6200-412d-9218-5a2e41bd505b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/7c2f98d8-cc1f-4189-a17c-80005290ede1/action" status: 404 len: 111 microversion: 2.1 time: 0.041261 May 27 15:24:20.135766 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2795/5599] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:24:20 2022] POST /compute/v2.1/servers/7c2f98d8-cc1f-4189-a17c-80005290ede1/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:24:20.144982 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9a3c05eb-3bf6-483f-b908-27094d6c3c8b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:20.147033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9a3c05eb-3bf6-483f-b908-27094d6c3c8b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:20.155729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a3c05eb-3bf6-483f-b908-27094d6c3c8b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:20.156457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a3c05eb-3bf6-483f-b908-27094d6c3c8b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:20.157406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a3c05eb-3bf6-483f-b908-27094d6c3c8b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:20.158083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a3c05eb-3bf6-483f-b908-27094d6c3c8b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:20.648484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9a3c05eb-3bf6-483f-b908-27094d6c3c8b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:20.670263 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9a3c05eb-3bf6-483f-b908-27094d6c3c8b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.523748 May 27 15:24:20.671323 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2805/5600] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:20 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:20.689726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4f5368da-679b-472f-ab2d-22a64750cb7d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:20.690358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4f5368da-679b-472f-ab2d-22a64750cb7d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:20.736292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4f5368da-679b-472f-ab2d-22a64750cb7d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:20.736961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4f5368da-679b-472f-ab2d-22a64750cb7d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:20.750096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4f5368da-679b-472f-ab2d-22a64750cb7d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:20.750555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4f5368da-679b-472f-ab2d-22a64750cb7d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:21.218425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4f5368da-679b-472f-ab2d-22a64750cb7d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:21.234330 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4f5368da-679b-472f-ab2d-22a64750cb7d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.550272 May 27 15:24:21.237137 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2796/5601] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:20 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:21.254961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-04288ec0-3b8b-4b9f-a258-3b247fb4db84 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:21.255961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-04288ec0-3b8b-4b9f-a258-3b247fb4db84 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:21.275796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04288ec0-3b8b-4b9f-a258-3b247fb4db84 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:21.281313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04288ec0-3b8b-4b9f-a258-3b247fb4db84 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:21.282400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04288ec0-3b8b-4b9f-a258-3b247fb4db84 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:21.283097 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04288ec0-3b8b-4b9f-a258-3b247fb4db84 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:21.582682 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-04288ec0-3b8b-4b9f-a258-3b247fb4db84 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action" status: 202 len: 0 microversion: 2.1 time: 0.331909 May 27 15:24:21.596279 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2806/5602] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:24:21 2022] POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:24:21.600912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d6c06035-3089-4d70-8548-5188d5464b07 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:21.602844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d6c06035-3089-4d70-8548-5188d5464b07 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:21.632997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d6c06035-3089-4d70-8548-5188d5464b07 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:21.635161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d6c06035-3089-4d70-8548-5188d5464b07 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:21.639487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d6c06035-3089-4d70-8548-5188d5464b07 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:21.640212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d6c06035-3089-4d70-8548-5188d5464b07 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:22.257742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d6c06035-3089-4d70-8548-5188d5464b07 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:22.269413 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d6c06035-3089-4d70-8548-5188d5464b07 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1511 microversion: 2.1 time: 0.676496 May 27 15:24:22.275365 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2797/5603] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:21 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1511 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:24:23.292345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ab490489-41bc-4af1-ace1-39c3bab22822 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:23.293410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ab490489-41bc-4af1-ace1-39c3bab22822 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:23.307195 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab490489-41bc-4af1-ace1-39c3bab22822 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:23.307878 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab490489-41bc-4af1-ace1-39c3bab22822 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:23.314650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab490489-41bc-4af1-ace1-39c3bab22822 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:23.314650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab490489-41bc-4af1-ace1-39c3bab22822 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:23.649639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ab490489-41bc-4af1-ace1-39c3bab22822 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:23.658618 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ab490489-41bc-4af1-ace1-39c3bab22822 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1491 microversion: 2.1 time: 0.370355 May 27 15:24:23.662742 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2807/5604] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:23 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1491 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:23.680498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-07b2b7f8-43eb-4577-a982-027961348a99 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:23.681834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-07b2b7f8-43eb-4577-a982-027961348a99 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:23.689823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-07b2b7f8-43eb-4577-a982-027961348a99 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:23.690962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-07b2b7f8-43eb-4577-a982-027961348a99 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:23.693446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-07b2b7f8-43eb-4577-a982-027961348a99 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:23.701694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-07b2b7f8-43eb-4577-a982-027961348a99 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:23.736064 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-07b2b7f8-43eb-4577-a982-027961348a99 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Cannot 'pause' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state paused May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-07b2b7f8-43eb-4577-a982-027961348a99 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action HTTP/1.1 May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 13 May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: {"pause": {}} May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: exception: Cannot 'pause' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state paused May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '3833c6b2-abd7-4b5a-8268-7582e7ee9554', 'body': {'pause': {}}} May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 in vm_state paused. Cannot pause while the instance is in this state. May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state paused May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:23.738369 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:23.743283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:23.743283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:23.743283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:23.743283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state paused May 27 15:24:23.743283 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:23.745213 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-07b2b7f8-43eb-4577-a982-027961348a99 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 409 to user: Cannot 'pause' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state paused {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:23.746512 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-07b2b7f8-43eb-4577-a982-027961348a99 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action" status: 409 len: 143 microversion: 2.1 time: 0.070496 May 27 15:24:23.750991 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2798/5605] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:24:23 2022] POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action => generated 143 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:24:23.757597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ab34d0c9-06e9-4ce9-9002-03ab14abc3d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:23.758151 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ab34d0c9-06e9-4ce9-9002-03ab14abc3d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:23.768226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab34d0c9-06e9-4ce9-9002-03ab14abc3d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:23.768740 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab34d0c9-06e9-4ce9-9002-03ab14abc3d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:23.770514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab34d0c9-06e9-4ce9-9002-03ab14abc3d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:23.771903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab34d0c9-06e9-4ce9-9002-03ab14abc3d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:23.919486 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ab34d0c9-06e9-4ce9-9002-03ab14abc3d8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action" status: 202 len: 0 microversion: 2.1 time: 0.166710 May 27 15:24:23.928609 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2808/5606] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:24:23 2022] POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:24:23.939284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e004ab68-2547-41c8-a487-9519696228c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:23.940129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e004ab68-2547-41c8-a487-9519696228c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:23.972490 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e004ab68-2547-41c8-a487-9519696228c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:23.975953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e004ab68-2547-41c8-a487-9519696228c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:23.982582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e004ab68-2547-41c8-a487-9519696228c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:23.983258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e004ab68-2547-41c8-a487-9519696228c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:24.546883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e004ab68-2547-41c8-a487-9519696228c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:24.554837 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e004ab68-2547-41c8-a487-9519696228c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1498 microversion: 2.1 time: 0.621338 May 27 15:24:24.555471 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2799/5607] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:23 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1498 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:25.575853 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cdf245ac-cf77-41ae-bd0e-147792b8c85d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:25.577241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cdf245ac-cf77-41ae-bd0e-147792b8c85d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:25.597011 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cdf245ac-cf77-41ae-bd0e-147792b8c85d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:25.598043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cdf245ac-cf77-41ae-bd0e-147792b8c85d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:25.599129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cdf245ac-cf77-41ae-bd0e-147792b8c85d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:25.602262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cdf245ac-cf77-41ae-bd0e-147792b8c85d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:25.920344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cdf245ac-cf77-41ae-bd0e-147792b8c85d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:25.945358 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cdf245ac-cf77-41ae-bd0e-147792b8c85d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.375830 May 27 15:24:25.951174 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2809/5608] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:25 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:25.981608 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9db22cd1-df1e-400f-8bf9-e10ec8e0f295 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:25.982846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9db22cd1-df1e-400f-8bf9-e10ec8e0f295 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:26.045850 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9db22cd1-df1e-400f-8bf9-e10ec8e0f295 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:26.046319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9db22cd1-df1e-400f-8bf9-e10ec8e0f295 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:26.047145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9db22cd1-df1e-400f-8bf9-e10ec8e0f295 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:26.047582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9db22cd1-df1e-400f-8bf9-e10ec8e0f295 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:26.314847 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9db22cd1-df1e-400f-8bf9-e10ec8e0f295 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:26.328429 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9db22cd1-df1e-400f-8bf9-e10ec8e0f295 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.357125 May 27 15:24:26.330405 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2800/5609] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:25 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:26.351359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7b6c82b4-5165-4832-949f-3f52803ab95f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:26.353660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7b6c82b4-5165-4832-949f-3f52803ab95f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:26.362853 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b6c82b4-5165-4832-949f-3f52803ab95f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:26.364339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b6c82b4-5165-4832-949f-3f52803ab95f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:26.366550 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b6c82b4-5165-4832-949f-3f52803ab95f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:26.367452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b6c82b4-5165-4832-949f-3f52803ab95f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:26.386720 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-7b6c82b4-5165-4832-949f-3f52803ab95f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7b6c82b4-5165-4832-949f-3f52803ab95f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09/action HTTP/1.1 May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 28 May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: {"reboot": {"type": "SOFT"}} May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '900d6720-34fc-4af9-bee0-76fabedb8b09', 'body': {'reboot': {'type': 'SOFT'}}} May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:24:26.388995 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:24:26.393250 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:24:26.393250 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:26.393250 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:26.393250 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:26.393250 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:26.393250 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:26.393250 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:26.393250 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:26.393250 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:26.393250 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:24:26.393250 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:26.397192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7b6c82b4-5165-4832-949f-3f52803ab95f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:26.398847 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7b6c82b4-5165-4832-949f-3f52803ab95f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09/action" status: 404 len: 111 microversion: 2.1 time: 0.052922 May 27 15:24:26.400083 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2810/5610] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:24:26 2022] POST /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:24:26.410584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c8c96789-0037-489e-a801-058e2303b508 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:26.412222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c8c96789-0037-489e-a801-058e2303b508 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:26.420046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8c96789-0037-489e-a801-058e2303b508 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:26.420791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8c96789-0037-489e-a801-058e2303b508 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:26.421751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8c96789-0037-489e-a801-058e2303b508 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:26.422309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8c96789-0037-489e-a801-058e2303b508 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:27.235727 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c8c96789-0037-489e-a801-058e2303b508 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:27.249399 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c8c96789-0037-489e-a801-058e2303b508 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.844272 May 27 15:24:27.263461 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2801/5611] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:26 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:24:27.269725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1d87f0bf-85cf-426a-8e22-ddd9a10bc239 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:27.271950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1d87f0bf-85cf-426a-8e22-ddd9a10bc239 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:27.300824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d87f0bf-85cf-426a-8e22-ddd9a10bc239 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:27.301306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d87f0bf-85cf-426a-8e22-ddd9a10bc239 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:27.303263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d87f0bf-85cf-426a-8e22-ddd9a10bc239 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:27.303776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d87f0bf-85cf-426a-8e22-ddd9a10bc239 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:27.877694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1d87f0bf-85cf-426a-8e22-ddd9a10bc239 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:27.890681 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1d87f0bf-85cf-426a-8e22-ddd9a10bc239 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.625860 May 27 15:24:27.908812 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2811/5612] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:27 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:27.916165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dc236d4d-9cb6-450f-8f76-12d2a7daa741 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:27.917905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dc236d4d-9cb6-450f-8f76-12d2a7daa741 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: ebc53b2e-8f97-40f2-a385-8b3e9bd4f281] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:27.948424 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-dc236d4d-9cb6-450f-8f76-12d2a7daa741 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance ebc53b2e-8f97-40f2-a385-8b3e9bd4f281 could not be found. May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dc236d4d-9cb6-450f-8f76-12d2a7daa741 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/ebc53b2e-8f97-40f2-a385-8b3e9bd4f281/action HTTP/1.1 May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 28 May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: {"reboot": {"type": "SOFT"}} May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance ebc53b2e-8f97-40f2-a385-8b3e9bd4f281 could not be found. May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'ebc53b2e-8f97-40f2-a385-8b3e9bd4f281', 'body': {'reboot': {'type': 'SOFT'}}} May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebc53b2e-8f97-40f2-a385-8b3e9bd4f281 could not be found. May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebc53b2e-8f97-40f2-a385-8b3e9bd4f281 could not be found. May 27 15:24:27.961452 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:27.969549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:27.969549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:27.969549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:27.969549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:27.969549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:27.969549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:27.969549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:27.969549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebc53b2e-8f97-40f2-a385-8b3e9bd4f281 could not be found. May 27 15:24:27.969549 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:27.969549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dc236d4d-9cb6-450f-8f76-12d2a7daa741 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance ebc53b2e-8f97-40f2-a385-8b3e9bd4f281 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:27.969549 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dc236d4d-9cb6-450f-8f76-12d2a7daa741 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/ebc53b2e-8f97-40f2-a385-8b3e9bd4f281/action" status: 404 len: 111 microversion: 2.1 time: 0.057335 May 27 15:24:27.969549 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2802/5613] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:24:27 2022] POST /compute/v2.1/servers/ebc53b2e-8f97-40f2-a385-8b3e9bd4f281/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:24:27.976587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2b36b03c-4313-4ec6-b384-807a1fedd280 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:27.977735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2b36b03c-4313-4ec6-b384-807a1fedd280 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:27.993865 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2b36b03c-4313-4ec6-b384-807a1fedd280 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:27.995919 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2b36b03c-4313-4ec6-b384-807a1fedd280 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:27.997264 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2b36b03c-4313-4ec6-b384-807a1fedd280 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:28.002073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2b36b03c-4313-4ec6-b384-807a1fedd280 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:28.426694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2b36b03c-4313-4ec6-b384-807a1fedd280 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:28.443894 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2b36b03c-4313-4ec6-b384-807a1fedd280 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.470379 May 27 15:24:28.444500 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2812/5614] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:27 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:28.467485 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2cb90267-6ebf-4742-b097-a0aa429e19a3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:28.468298 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2cb90267-6ebf-4742-b097-a0aa429e19a3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:28.494506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2cb90267-6ebf-4742-b097-a0aa429e19a3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:28.494964 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2cb90267-6ebf-4742-b097-a0aa429e19a3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:28.495763 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2cb90267-6ebf-4742-b097-a0aa429e19a3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:28.496210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2cb90267-6ebf-4742-b097-a0aa429e19a3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:29.036530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2cb90267-6ebf-4742-b097-a0aa429e19a3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:29.069702 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2cb90267-6ebf-4742-b097-a0aa429e19a3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.606727 May 27 15:24:29.082723 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2803/5615] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:28 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:29.099128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1c4ad31c-39ca-4b88-93f1-2d58108279da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "346e776e-8931-417f-87da-575810efb12b"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:29.101110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1c4ad31c-39ca-4b88-93f1-2d58108279da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:29.116890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c4ad31c-39ca-4b88-93f1-2d58108279da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:29.118811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c4ad31c-39ca-4b88-93f1-2d58108279da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:29.120639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c4ad31c-39ca-4b88-93f1-2d58108279da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:29.121513 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c4ad31c-39ca-4b88-93f1-2d58108279da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:29.128906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:29.166587 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-1c4ad31c-39ca-4b88-93f1-2d58108279da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1c4ad31c-39ca-4b88-93f1-2d58108279da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09/action HTTP/1.1 May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 65 May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: {"rebuild": {"imageRef": "346e776e-8931-417f-87da-575810efb12b"}} May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '900d6720-34fc-4af9-bee0-76fabedb8b09', 'body': {'rebuild': {'imageRef': '346e776e-8931-417f-87da-575810efb12b'}}} May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 27 15:24:29.171868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild May 27 15:24:29.176965 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 27 15:24:29.176965 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:24:29.176965 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:24:29.176965 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:24:29.176965 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:24:29.176965 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:24:29.176965 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:29.176965 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:29.176965 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:29.176965 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:29.176965 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:29.176965 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:29.176965 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:29.176965 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:29.176965 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:24:29.176965 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:29.180392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1c4ad31c-39ca-4b88-93f1-2d58108279da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:29.181750 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1c4ad31c-39ca-4b88-93f1-2d58108279da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09/action" status: 404 len: 111 microversion: 2.1 time: 0.087176 May 27 15:24:29.192495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9ecb6b92-cdd3-42a5-bfc9-e7cbc981e6fd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:29.193522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9ecb6b92-cdd3-42a5-bfc9-e7cbc981e6fd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:29.201480 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2813/5616] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:24:29 2022] POST /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09/action => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:24:29.206498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ecb6b92-cdd3-42a5-bfc9-e7cbc981e6fd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:29.208464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ecb6b92-cdd3-42a5-bfc9-e7cbc981e6fd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:29.210504 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ecb6b92-cdd3-42a5-bfc9-e7cbc981e6fd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:29.212213 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ecb6b92-cdd3-42a5-bfc9-e7cbc981e6fd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:29.589054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9ecb6b92-cdd3-42a5-bfc9-e7cbc981e6fd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:29.612985 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9ecb6b92-cdd3-42a5-bfc9-e7cbc981e6fd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.412681 May 27 15:24:29.618172 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2804/5617] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:29 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:24:29.638313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fd519bb1-faf5-4b8c-9a01-fff155bed396 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:29.639047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fd519bb1-faf5-4b8c-9a01-fff155bed396 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:29.664062 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd519bb1-faf5-4b8c-9a01-fff155bed396 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:29.664690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd519bb1-faf5-4b8c-9a01-fff155bed396 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:29.665567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd519bb1-faf5-4b8c-9a01-fff155bed396 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:29.666020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fd519bb1-faf5-4b8c-9a01-fff155bed396 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:30.699774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fd519bb1-faf5-4b8c-9a01-fff155bed396 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:30.738942 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fd519bb1-faf5-4b8c-9a01-fff155bed396 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 1.105757 May 27 15:24:30.756851 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2814/5618] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:29 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:30.764965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-63f3cc41-7f09-4e24-97fc-43bd1d7225c7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "346e776e-8931-417f-87da-575810efb12b"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:30.779473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-63f3cc41-7f09-4e24-97fc-43bd1d7225c7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: a073f433-7774-4f56-8661-0d3863539df8] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:30.806639 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-63f3cc41-7f09-4e24-97fc-43bd1d7225c7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance a073f433-7774-4f56-8661-0d3863539df8 could not be found. May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-63f3cc41-7f09-4e24-97fc-43bd1d7225c7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/a073f433-7774-4f56-8661-0d3863539df8/action HTTP/1.1 May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 65 May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: {"rebuild": {"imageRef": "346e776e-8931-417f-87da-575810efb12b"}} May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance a073f433-7774-4f56-8661-0d3863539df8 could not be found. May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'a073f433-7774-4f56-8661-0d3863539df8', 'body': {'rebuild': {'imageRef': '346e776e-8931-417f-87da-575810efb12b'}}} May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a073f433-7774-4f56-8661-0d3863539df8 could not be found. May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 27 15:24:30.816443 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:24:30.820712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:24:30.820712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:24:30.820712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:24:30.820712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a073f433-7774-4f56-8661-0d3863539df8 could not be found. May 27 15:24:30.820712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:30.820712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:30.820712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:30.820712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:30.820712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:30.820712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:30.820712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:30.820712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:30.820712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a073f433-7774-4f56-8661-0d3863539df8 could not be found. May 27 15:24:30.820712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:30.833653 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-63f3cc41-7f09-4e24-97fc-43bd1d7225c7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance a073f433-7774-4f56-8661-0d3863539df8 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:30.834924 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-63f3cc41-7f09-4e24-97fc-43bd1d7225c7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/a073f433-7774-4f56-8661-0d3863539df8/action" status: 404 len: 111 microversion: 2.1 time: 0.074459 May 27 15:24:30.835743 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2805/5619] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:24:30 2022] POST /compute/v2.1/servers/a073f433-7774-4f56-8661-0d3863539df8/action => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:24:30.848524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0fdbe728-b227-422c-9a77-0d74ba5f6726 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:30.849983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0fdbe728-b227-422c-9a77-0d74ba5f6726 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:30.866801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0fdbe728-b227-422c-9a77-0d74ba5f6726 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:30.870812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0fdbe728-b227-422c-9a77-0d74ba5f6726 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:30.871911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0fdbe728-b227-422c-9a77-0d74ba5f6726 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:30.872599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0fdbe728-b227-422c-9a77-0d74ba5f6726 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:31.255303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0fdbe728-b227-422c-9a77-0d74ba5f6726 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:31.268449 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0fdbe728-b227-422c-9a77-0d74ba5f6726 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.428299 May 27 15:24:31.269747 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2815/5620] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:30 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:31.296767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-84246b44-fbb9-47c7-b5b1-9f759f49e203 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:31.297943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-84246b44-fbb9-47c7-b5b1-9f759f49e203 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:31.300135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=72 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:31.330859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84246b44-fbb9-47c7-b5b1-9f759f49e203 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:31.335285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84246b44-fbb9-47c7-b5b1-9f759f49e203 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:31.340348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84246b44-fbb9-47c7-b5b1-9f759f49e203 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:31.341674 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84246b44-fbb9-47c7-b5b1-9f759f49e203 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:32.127948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-84246b44-fbb9-47c7-b5b1-9f759f49e203 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:32.143061 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-84246b44-fbb9-47c7-b5b1-9f759f49e203 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.854133 May 27 15:24:32.167395 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2806/5621] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:31 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:32.180714 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-474cfbf0-ed97-48b4-82e9-e9f5f9c11a39 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:32.181581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-474cfbf0-ed97-48b4-82e9-e9f5f9c11a39 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: a6ebf14a-aca8-4846-a491-25dc1cf3ac85] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:32.198950 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-474cfbf0-ed97-48b4-82e9-e9f5f9c11a39 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance a6ebf14a-aca8-4846-a491-25dc1cf3ac85 could not be found. May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-474cfbf0-ed97-48b4-82e9-e9f5f9c11a39 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/a6ebf14a-aca8-4846-a491-25dc1cf3ac85/action HTTP/1.1 May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 15 May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: {"restore": {}} May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance a6ebf14a-aca8-4846-a491-25dc1cf3ac85 could not be found. May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'a6ebf14a-aca8-4846-a491-25dc1cf3ac85', 'body': {'restore': {}}} May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6ebf14a-aca8-4846-a491-25dc1cf3ac85 could not be found. May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6ebf14a-aca8-4846-a491-25dc1cf3ac85 could not be found. May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:32.207107 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:32.212810 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:32.212810 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:32.212810 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6ebf14a-aca8-4846-a491-25dc1cf3ac85 could not be found. May 27 15:24:32.212810 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:32.215610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-474cfbf0-ed97-48b4-82e9-e9f5f9c11a39 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance a6ebf14a-aca8-4846-a491-25dc1cf3ac85 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:32.223738 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-474cfbf0-ed97-48b4-82e9-e9f5f9c11a39 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/a6ebf14a-aca8-4846-a491-25dc1cf3ac85/action" status: 404 len: 111 microversion: 2.1 time: 0.040977 May 27 15:24:32.228400 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2816/5622] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:24:32 2022] POST /compute/v2.1/servers/a6ebf14a-aca8-4846-a491-25dc1cf3ac85/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:24:32.239432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d84ba180-1ed7-479c-a3d2-d5a75c426cd6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:32.241262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d84ba180-1ed7-479c-a3d2-d5a75c426cd6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:32.263503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d84ba180-1ed7-479c-a3d2-d5a75c426cd6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:32.265435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d84ba180-1ed7-479c-a3d2-d5a75c426cd6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:32.267393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d84ba180-1ed7-479c-a3d2-d5a75c426cd6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:32.269097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d84ba180-1ed7-479c-a3d2-d5a75c426cd6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:32.911266 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d84ba180-1ed7-479c-a3d2-d5a75c426cd6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:32.925664 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d84ba180-1ed7-479c-a3d2-d5a75c426cd6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.692859 May 27 15:24:32.931385 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2807/5623] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:32 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:32.952029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0c8b85f9-2d3f-43fc-a690-6e96dfe7516e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:32.952887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0c8b85f9-2d3f-43fc-a690-6e96dfe7516e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:32.977964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c8b85f9-2d3f-43fc-a690-6e96dfe7516e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:32.978804 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c8b85f9-2d3f-43fc-a690-6e96dfe7516e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:32.979948 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c8b85f9-2d3f-43fc-a690-6e96dfe7516e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:32.980580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c8b85f9-2d3f-43fc-a690-6e96dfe7516e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:33.635884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0c8b85f9-2d3f-43fc-a690-6e96dfe7516e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:33.645400 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0c8b85f9-2d3f-43fc-a690-6e96dfe7516e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.698830 May 27 15:24:33.648512 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2817/5624] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:32 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:33.665037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3c24b0e7-ae3e-4460-a510-d063a7ec11ed tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:33.665618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3c24b0e7-ae3e-4460-a510-d063a7ec11ed tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:33.685568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c24b0e7-ae3e-4460-a510-d063a7ec11ed tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:33.686030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c24b0e7-ae3e-4460-a510-d063a7ec11ed tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:33.686822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c24b0e7-ae3e-4460-a510-d063a7ec11ed tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:33.687260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c24b0e7-ae3e-4460-a510-d063a7ec11ed tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:33.761203 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-3c24b0e7-ae3e-4460-a510-d063a7ec11ed tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Cannot 'restore' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state active May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3c24b0e7-ae3e-4460-a510-d063a7ec11ed tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action HTTP/1.1 May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 15 May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: {"restore": {}} May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: exception: Cannot 'restore' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state active May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '3833c6b2-abd7-4b5a-8268-7582e7ee9554', 'body': {'restore': {}}} May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 in vm_state active. Cannot restore while the instance is in this state. May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state active May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:33.783988 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:33.788219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:33.788219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:33.788219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:33.788219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state active May 27 15:24:33.788219 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:33.788219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3c24b0e7-ae3e-4460-a510-d063a7ec11ed tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 409 to user: Cannot 'restore' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state active {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:33.788219 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3c24b0e7-ae3e-4460-a510-d063a7ec11ed tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action" status: 409 len: 145 microversion: 2.1 time: 0.126160 May 27 15:24:33.792400 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2808/5625] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:24:33 2022] POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action => generated 145 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:24:33.797092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9ac61250-53ef-4732-b865-db1f613749a0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:33.797726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9ac61250-53ef-4732-b865-db1f613749a0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:33.810730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ac61250-53ef-4732-b865-db1f613749a0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:33.811203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ac61250-53ef-4732-b865-db1f613749a0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:33.812002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ac61250-53ef-4732-b865-db1f613749a0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:33.812450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9ac61250-53ef-4732-b865-db1f613749a0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:34.331822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9ac61250-53ef-4732-b865-db1f613749a0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:34.348014 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9ac61250-53ef-4732-b865-db1f613749a0 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.554992 May 27 15:24:34.357374 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2818/5626] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:33 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:34.375247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e1a83494-d13f-4f84-9431-803eeb760f82 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:34.376991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e1a83494-d13f-4f84-9431-803eeb760f82 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:34.387847 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e1a83494-d13f-4f84-9431-803eeb760f82 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:34.389306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e1a83494-d13f-4f84-9431-803eeb760f82 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:34.390774 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e1a83494-d13f-4f84-9431-803eeb760f82 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:34.392186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e1a83494-d13f-4f84-9431-803eeb760f82 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:34.943832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e1a83494-d13f-4f84-9431-803eeb760f82 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:34.956124 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e1a83494-d13f-4f84-9431-803eeb760f82 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.584063 May 27 15:24:34.959013 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2809/5627] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:34 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:34.974807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ccbe6a8d-e497-4655-98ff-a6c79baeb009 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:34.975934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ccbe6a8d-e497-4655-98ff-a6c79baeb009 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: cd739d94-55c4-4382-b805-c3935b3ea451] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:34.985669 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-ccbe6a8d-e497-4655-98ff-a6c79baeb009 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance cd739d94-55c4-4382-b805-c3935b3ea451 could not be found. May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ccbe6a8d-e497-4655-98ff-a6c79baeb009 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/cd739d94-55c4-4382-b805-c3935b3ea451/action HTTP/1.1 May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 14 May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: {"resume": {}} May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance cd739d94-55c4-4382-b805-c3935b3ea451 could not be found. May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'cd739d94-55c4-4382-b805-c3935b3ea451', 'body': {'resume': {}}} May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd739d94-55c4-4382-b805-c3935b3ea451 could not be found. May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd739d94-55c4-4382-b805-c3935b3ea451 could not be found. May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:34.998649 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:35.003665 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:35.003665 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:35.003665 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd739d94-55c4-4382-b805-c3935b3ea451 could not be found. May 27 15:24:35.003665 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:35.003665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ccbe6a8d-e497-4655-98ff-a6c79baeb009 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance cd739d94-55c4-4382-b805-c3935b3ea451 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:35.003665 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ccbe6a8d-e497-4655-98ff-a6c79baeb009 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/cd739d94-55c4-4382-b805-c3935b3ea451/action" status: 404 len: 111 microversion: 2.1 time: 0.031129 May 27 15:24:35.003665 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2819/5628] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:24:34 2022] POST /compute/v2.1/servers/cd739d94-55c4-4382-b805-c3935b3ea451/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:24:35.011886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-29fe2e11-2fcd-4933-b1f9-357905050e9a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:35.013214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-29fe2e11-2fcd-4933-b1f9-357905050e9a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:35.024981 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29fe2e11-2fcd-4933-b1f9-357905050e9a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:35.025802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29fe2e11-2fcd-4933-b1f9-357905050e9a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:35.026771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29fe2e11-2fcd-4933-b1f9-357905050e9a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:35.027636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29fe2e11-2fcd-4933-b1f9-357905050e9a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:35.356240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-29fe2e11-2fcd-4933-b1f9-357905050e9a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:35.377973 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-29fe2e11-2fcd-4933-b1f9-357905050e9a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.370533 May 27 15:24:35.380994 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2810/5629] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:35 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:35.396902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3667cf8e-d64f-406a-8539-2dddef05d5ff tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:35.397531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3667cf8e-d64f-406a-8539-2dddef05d5ff tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:35.424232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3667cf8e-d64f-406a-8539-2dddef05d5ff tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:35.424702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3667cf8e-d64f-406a-8539-2dddef05d5ff tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:35.428719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3667cf8e-d64f-406a-8539-2dddef05d5ff tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:35.429232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3667cf8e-d64f-406a-8539-2dddef05d5ff tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:35.726246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3667cf8e-d64f-406a-8539-2dddef05d5ff tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:35.739982 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3667cf8e-d64f-406a-8539-2dddef05d5ff tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.345978 May 27 15:24:35.742173 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2820/5630] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:35 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:35.757842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e06fca60-9e66-4778-adf9-5f5f48912ce6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:35.758885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e06fca60-9e66-4778-adf9-5f5f48912ce6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:35.779137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e06fca60-9e66-4778-adf9-5f5f48912ce6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:35.782159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e06fca60-9e66-4778-adf9-5f5f48912ce6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:35.784297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e06fca60-9e66-4778-adf9-5f5f48912ce6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:35.790415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e06fca60-9e66-4778-adf9-5f5f48912ce6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:35.848239 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:35.887308 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-e06fca60-9e66-4778-adf9-5f5f48912ce6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Cannot 'resume' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state active May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e06fca60-9e66-4778-adf9-5f5f48912ce6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action HTTP/1.1 May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 14 May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: {"resume": {}} May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: exception: Cannot 'resume' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state active May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '3833c6b2-abd7-4b5a-8268-7582e7ee9554', 'body': {'resume': {}}} May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 in vm_state active. Cannot resume while the instance is in this state. May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state active May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:35.889064 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:35.896102 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:35.896102 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:35.896102 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:35.896102 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state active May 27 15:24:35.896102 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:35.917747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e06fca60-9e66-4778-adf9-5f5f48912ce6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 409 to user: Cannot 'resume' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state active {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:35.919384 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e06fca60-9e66-4778-adf9-5f5f48912ce6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action" status: 409 len: 144 microversion: 2.1 time: 0.166562 May 27 15:24:35.922491 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2811/5631] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:24:35 2022] POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action => generated 144 bytes in 170 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:24:35.931586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3c615a90-6db3-4aa9-ba86-e63e0524f7d7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:35.932491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3c615a90-6db3-4aa9-ba86-e63e0524f7d7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:35.942634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3c615a90-6db3-4aa9-ba86-e63e0524f7d7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:35.943764 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3c615a90-6db3-4aa9-ba86-e63e0524f7d7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:35.946919 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3c615a90-6db3-4aa9-ba86-e63e0524f7d7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:35.949362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3c615a90-6db3-4aa9-ba86-e63e0524f7d7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:36.432892 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3c615a90-6db3-4aa9-ba86-e63e0524f7d7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:36.448054 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3c615a90-6db3-4aa9-ba86-e63e0524f7d7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.520979 May 27 15:24:36.453023 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2821/5632] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:35 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:36.472083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-614b545d-5742-4385-8cbe-f1b808d7e981 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:36.472739 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-614b545d-5742-4385-8cbe-f1b808d7e981 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:36.487903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-614b545d-5742-4385-8cbe-f1b808d7e981 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:36.497991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-614b545d-5742-4385-8cbe-f1b808d7e981 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:36.502810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-614b545d-5742-4385-8cbe-f1b808d7e981 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:36.503227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-614b545d-5742-4385-8cbe-f1b808d7e981 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:36.917138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-614b545d-5742-4385-8cbe-f1b808d7e981 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:36.926497 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-614b545d-5742-4385-8cbe-f1b808d7e981 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.460949 May 27 15:24:36.929353 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2812/5633] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:36 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:37.297495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-745d50dc-f5ed-4c08-a777-294942d14d78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-745d50dc-f5ed-4c08-a777-294942d14d78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers HTTP/1.1 May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 160 May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: {"server": {"name": "", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "640304d1-fbbc-473c-9acb-60ed77473841"}]}} May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: exception: Invalid input for field/attribute name. Value: . '' is too short May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'body': {'server': {'name': '', 'imageRef': '346e776e-8931-417f-87da-575810efb12b', 'flavorRef': '452', 'networks': [{'uuid': '640304d1-fbbc-473c-9acb-60ed77473841'}]}}} May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise error May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi On instance['server']: May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi '' May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:24:37.299868 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:24:37.306147 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:24:37.306147 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 27 15:24:37.306147 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:37.306147 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:37.306147 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:37.306147 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:37.306147 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:37.306147 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:37.306147 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:24:37.306147 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:24:37.306147 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 27 15:24:37.306147 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:24:37.306147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-745d50dc-f5ed-4c08-a777-294942d14d78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:37.306147 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-745d50dc-f5ed-4c08-a777-294942d14d78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.007934 May 27 15:24:37.310148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-befcba55-cfe8-42b7-a9bf-f644cd6b4d83 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:37.310960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-befcba55-cfe8-42b7-a9bf-f644cd6b4d83 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:37.316873 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2822/5634] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:24:37 2022] POST /compute/v2.1/servers => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:24:37.318612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-befcba55-cfe8-42b7-a9bf-f644cd6b4d83 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:37.319081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-befcba55-cfe8-42b7-a9bf-f644cd6b4d83 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:37.319865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-befcba55-cfe8-42b7-a9bf-f644cd6b4d83 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:37.332817 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-befcba55-cfe8-42b7-a9bf-f644cd6b4d83 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:37.744445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-befcba55-cfe8-42b7-a9bf-f644cd6b4d83 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:37.753237 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-befcba55-cfe8-42b7-a9bf-f644cd6b4d83 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.446737 May 27 15:24:37.763764 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2813/5635] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:37 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:24:37.783864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d1d8281f-38a7-43c4-9129-d8ef8c421994 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:37.784645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d1d8281f-38a7-43c4-9129-d8ef8c421994 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:37.837967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1d8281f-38a7-43c4-9129-d8ef8c421994 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:37.838806 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1d8281f-38a7-43c4-9129-d8ef8c421994 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:37.842761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1d8281f-38a7-43c4-9129-d8ef8c421994 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:37.852069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d1d8281f-38a7-43c4-9129-d8ef8c421994 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:38.211114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d1d8281f-38a7-43c4-9129-d8ef8c421994 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:38.235760 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d1d8281f-38a7-43c4-9129-d8ef8c421994 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.458073 May 27 15:24:38.236290 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2823/5636] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:37 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:38.253410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2472e1c8-99f2-4670-8280-1ccff8c2b0da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:38.254068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2472e1c8-99f2-4670-8280-1ccff8c2b0da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 15883adc-c9bb-4308-8a70-802ad3408cc5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:38.264123 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-2472e1c8-99f2-4670-8280-1ccff8c2b0da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance 15883adc-c9bb-4308-8a70-802ad3408cc5 could not be found. May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2472e1c8-99f2-4670-8280-1ccff8c2b0da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/15883adc-c9bb-4308-8a70-802ad3408cc5/action HTTP/1.1 May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 14 May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: {"shelve": {}} May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 15883adc-c9bb-4308-8a70-802ad3408cc5 could not be found. May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '15883adc-c9bb-4308-8a70-802ad3408cc5', 'body': {'shelve': {}}} May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15883adc-c9bb-4308-8a70-802ad3408cc5 could not be found. May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15883adc-c9bb-4308-8a70-802ad3408cc5 could not be found. May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:38.277799 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:38.282615 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:38.282615 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:38.282615 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15883adc-c9bb-4308-8a70-802ad3408cc5 could not be found. May 27 15:24:38.282615 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:24:38.283784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2472e1c8-99f2-4670-8280-1ccff8c2b0da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance 15883adc-c9bb-4308-8a70-802ad3408cc5 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:38.284863 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2472e1c8-99f2-4670-8280-1ccff8c2b0da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/15883adc-c9bb-4308-8a70-802ad3408cc5/action" status: 404 len: 111 microversion: 2.1 time: 0.035831 May 27 15:24:38.289537 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2814/5637] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:24:38 2022] POST /compute/v2.1/servers/15883adc-c9bb-4308-8a70-802ad3408cc5/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:24:38.297279 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bb48d310-7191-4016-a49e-848c9195f213 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:38.297956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bb48d310-7191-4016-a49e-848c9195f213 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:38.318592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb48d310-7191-4016-a49e-848c9195f213 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:38.319064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb48d310-7191-4016-a49e-848c9195f213 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:38.319887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb48d310-7191-4016-a49e-848c9195f213 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:38.320344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb48d310-7191-4016-a49e-848c9195f213 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:39.601655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bb48d310-7191-4016-a49e-848c9195f213 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:39.615962 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bb48d310-7191-4016-a49e-848c9195f213 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 1.323817 May 27 15:24:39.624597 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2824/5638] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:38 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:39.642694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ff25a20a-f153-4200-a540-69c54e41049a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:39.643325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ff25a20a-f153-4200-a540-69c54e41049a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:39.660237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff25a20a-f153-4200-a540-69c54e41049a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:39.660731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff25a20a-f153-4200-a540-69c54e41049a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:39.665289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff25a20a-f153-4200-a540-69c54e41049a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:39.666042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ff25a20a-f153-4200-a540-69c54e41049a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:40.408295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ff25a20a-f153-4200-a540-69c54e41049a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:40.427869 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ff25a20a-f153-4200-a540-69c54e41049a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.787145 May 27 15:24:40.434486 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2815/5639] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:39 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:40.445093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1f4fc176-2038-4fb3-9817-bcf6bfed56f5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:40.445652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1f4fc176-2038-4fb3-9817-bcf6bfed56f5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:40.480852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f4fc176-2038-4fb3-9817-bcf6bfed56f5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:40.481622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f4fc176-2038-4fb3-9817-bcf6bfed56f5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:40.482479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f4fc176-2038-4fb3-9817-bcf6bfed56f5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:40.485293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1f4fc176-2038-4fb3-9817-bcf6bfed56f5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:40.606960 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-1f4fc176-2038-4fb3-9817-bcf6bfed56f5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lazy-loading 'flavor' on Instance uuid 3833c6b2-abd7-4b5a-8268-7582e7ee9554 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:24:41.291252 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1f4fc176-2038-4fb3-9817-bcf6bfed56f5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action" status: 202 len: 0 microversion: 2.1 time: 0.845812 May 27 15:24:41.299550 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2825/5640] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:24:40 2022] POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action => generated 0 bytes in 856 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:24:41.305283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b2fd948a-0f8a-4ebd-bf8b-877df188c135 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:41.305912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b2fd948a-0f8a-4ebd-bf8b-877df188c135 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:41.336587 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2fd948a-0f8a-4ebd-bf8b-877df188c135 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:41.337094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2fd948a-0f8a-4ebd-bf8b-877df188c135 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:41.339377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2fd948a-0f8a-4ebd-bf8b-877df188c135 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:41.339837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2fd948a-0f8a-4ebd-bf8b-877df188c135 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:41.761064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b2fd948a-0f8a-4ebd-bf8b-877df188c135 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:41.773226 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b2fd948a-0f8a-4ebd-bf8b-877df188c135 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1512 microversion: 2.1 time: 0.473149 May 27 15:24:41.778740 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2816/5641] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:41 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1512 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:42.797568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-06184468-a8a1-4a84-9ac0-1642d8a6244e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:42.798378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-06184468-a8a1-4a84-9ac0-1642d8a6244e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:42.817510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-06184468-a8a1-4a84-9ac0-1642d8a6244e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:42.817981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-06184468-a8a1-4a84-9ac0-1642d8a6244e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:42.818791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-06184468-a8a1-4a84-9ac0-1642d8a6244e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:42.819323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-06184468-a8a1-4a84-9ac0-1642d8a6244e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:43.276392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-06184468-a8a1-4a84-9ac0-1642d8a6244e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:43.295452 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-06184468-a8a1-4a84-9ac0-1642d8a6244e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1512 microversion: 2.1 time: 0.501945 May 27 15:24:43.305933 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2826/5642] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:42 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1512 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:44.313590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2cab2c30-b90c-4e1c-bcd9-18eb9a3f48fa tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:44.314229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2cab2c30-b90c-4e1c-bcd9-18eb9a3f48fa tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:44.332026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2cab2c30-b90c-4e1c-bcd9-18eb9a3f48fa tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:44.338425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2cab2c30-b90c-4e1c-bcd9-18eb9a3f48fa tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:44.345860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2cab2c30-b90c-4e1c-bcd9-18eb9a3f48fa tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:44.347427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2cab2c30-b90c-4e1c-bcd9-18eb9a3f48fa tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:44.788929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2cab2c30-b90c-4e1c-bcd9-18eb9a3f48fa tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:44.800411 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2cab2c30-b90c-4e1c-bcd9-18eb9a3f48fa tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1512 microversion: 2.1 time: 0.489932 May 27 15:24:44.803940 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2817/5643] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:44 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1512 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:45.819273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b1214ac1-2c87-43da-bbf4-412410fbb90e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:45.819904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b1214ac1-2c87-43da-bbf4-412410fbb90e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:45.835592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b1214ac1-2c87-43da-bbf4-412410fbb90e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:45.836304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b1214ac1-2c87-43da-bbf4-412410fbb90e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:45.837201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b1214ac1-2c87-43da-bbf4-412410fbb90e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:45.837659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b1214ac1-2c87-43da-bbf4-412410fbb90e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:46.175994 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b1214ac1-2c87-43da-bbf4-412410fbb90e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:46.198111 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b1214ac1-2c87-43da-bbf4-412410fbb90e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1512 microversion: 2.1 time: 0.377394 May 27 15:24:46.213441 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2827/5644] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:45 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1512 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:47.223358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f8ef220a-aa97-4722-b8cb-ec8a65f3a804 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:47.224029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f8ef220a-aa97-4722-b8cb-ec8a65f3a804 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:47.240376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8ef220a-aa97-4722-b8cb-ec8a65f3a804 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:47.240778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8ef220a-aa97-4722-b8cb-ec8a65f3a804 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:47.241580 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8ef220a-aa97-4722-b8cb-ec8a65f3a804 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:47.254123 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8ef220a-aa97-4722-b8cb-ec8a65f3a804 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:47.649498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f8ef220a-aa97-4722-b8cb-ec8a65f3a804 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:47.658132 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f8ef220a-aa97-4722-b8cb-ec8a65f3a804 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1512 microversion: 2.1 time: 0.442599 May 27 15:24:47.663224 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2818/5645] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:47 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1512 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:48.680710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-122d813d-2a8f-4bc5-975d-482628a8803f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:48.681468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-122d813d-2a8f-4bc5-975d-482628a8803f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:48.684555 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=48 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:48.701713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-122d813d-2a8f-4bc5-975d-482628a8803f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:48.702547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-122d813d-2a8f-4bc5-975d-482628a8803f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:48.703587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-122d813d-2a8f-4bc5-975d-482628a8803f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:48.704273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-122d813d-2a8f-4bc5-975d-482628a8803f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:48.982619 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-122d813d-2a8f-4bc5-975d-482628a8803f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:48.992032 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-122d813d-2a8f-4bc5-975d-482628a8803f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1512 microversion: 2.1 time: 0.316562 May 27 15:24:48.999185 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2828/5646] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:48 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1512 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:50.016572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-16801028-05d5-4ed6-9a6a-1c3f8114161a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:50.017219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-16801028-05d5-4ed6-9a6a-1c3f8114161a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:50.035704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16801028-05d5-4ed6-9a6a-1c3f8114161a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:50.036202 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16801028-05d5-4ed6-9a6a-1c3f8114161a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:50.037033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16801028-05d5-4ed6-9a6a-1c3f8114161a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:50.037482 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16801028-05d5-4ed6-9a6a-1c3f8114161a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:51.017436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-16801028-05d5-4ed6-9a6a-1c3f8114161a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:51.027721 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-16801028-05d5-4ed6-9a6a-1c3f8114161a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1512 microversion: 2.1 time: 1.013999 May 27 15:24:51.037065 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2819/5647] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:50 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1512 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:52.047425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1e9ed718-a0e6-40f6-9590-2e9b5cabc189 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:52.048055 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1e9ed718-a0e6-40f6-9590-2e9b5cabc189 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:52.072572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1e9ed718-a0e6-40f6-9590-2e9b5cabc189 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:52.072969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1e9ed718-a0e6-40f6-9590-2e9b5cabc189 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:52.073775 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1e9ed718-a0e6-40f6-9590-2e9b5cabc189 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:52.074232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1e9ed718-a0e6-40f6-9590-2e9b5cabc189 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:52.342744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1e9ed718-a0e6-40f6-9590-2e9b5cabc189 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:52.388966 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1e9ed718-a0e6-40f6-9590-2e9b5cabc189 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1512 microversion: 2.1 time: 0.345284 May 27 15:24:52.405455 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2829/5648] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:52 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1512 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:53.410669 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c2ff0603-9d5f-4fc8-b63d-618f889d1b6c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:53.411421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c2ff0603-9d5f-4fc8-b63d-618f889d1b6c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:53.425752 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2ff0603-9d5f-4fc8-b63d-618f889d1b6c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:53.426221 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2ff0603-9d5f-4fc8-b63d-618f889d1b6c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:53.427051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2ff0603-9d5f-4fc8-b63d-618f889d1b6c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:53.427505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2ff0603-9d5f-4fc8-b63d-618f889d1b6c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:53.797845 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c2ff0603-9d5f-4fc8-b63d-618f889d1b6c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:53.812124 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c2ff0603-9d5f-4fc8-b63d-618f889d1b6c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1512 microversion: 2.1 time: 0.405815 May 27 15:24:53.815154 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2820/5649] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:53 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1512 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:54.831963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b7e30658-2b31-4e11-b045-19c687f9c4cc tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:54.832954 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b7e30658-2b31-4e11-b045-19c687f9c4cc tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:54.844997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7e30658-2b31-4e11-b045-19c687f9c4cc tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:54.846469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7e30658-2b31-4e11-b045-19c687f9c4cc tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:54.847951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7e30658-2b31-4e11-b045-19c687f9c4cc tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:54.849929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7e30658-2b31-4e11-b045-19c687f9c4cc tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:55.161677 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b7e30658-2b31-4e11-b045-19c687f9c4cc tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:55.185651 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b7e30658-2b31-4e11-b045-19c687f9c4cc tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1512 microversion: 2.1 time: 0.356951 May 27 15:24:55.189743 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2830/5650] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:54 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1512 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:56.205082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-915d6545-9115-4cb6-ae53-1180a038dbb3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:56.205705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-915d6545-9115-4cb6-ae53-1180a038dbb3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:56.230118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-915d6545-9115-4cb6-ae53-1180a038dbb3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:56.232497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-915d6545-9115-4cb6-ae53-1180a038dbb3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:56.239293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-915d6545-9115-4cb6-ae53-1180a038dbb3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:56.242119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-915d6545-9115-4cb6-ae53-1180a038dbb3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:56.974012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-915d6545-9115-4cb6-ae53-1180a038dbb3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:57.031218 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-915d6545-9115-4cb6-ae53-1180a038dbb3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1512 microversion: 2.1 time: 0.822665 May 27 15:24:57.032741 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2821/5651] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:56 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1512 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:58.057768 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-802d6776-b2ee-487c-8311-67668e53e15b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:58.059078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-802d6776-b2ee-487c-8311-67668e53e15b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:58.079104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-802d6776-b2ee-487c-8311-67668e53e15b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:58.080040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-802d6776-b2ee-487c-8311-67668e53e15b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:58.081668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-802d6776-b2ee-487c-8311-67668e53e15b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:58.084416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-802d6776-b2ee-487c-8311-67668e53e15b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:58.120293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:58.540300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-802d6776-b2ee-487c-8311-67668e53e15b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:58.557986 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-802d6776-b2ee-487c-8311-67668e53e15b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1533 microversion: 2.1 time: 0.504880 May 27 15:24:58.568555 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2831/5652] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:58 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1533 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:59.615183 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cff0bdf8-825a-4f7d-b82c-53adc783ea2f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:59.617429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cff0bdf8-825a-4f7d-b82c-53adc783ea2f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:59.633067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cff0bdf8-825a-4f7d-b82c-53adc783ea2f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:59.635046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cff0bdf8-825a-4f7d-b82c-53adc783ea2f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:59.636404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cff0bdf8-825a-4f7d-b82c-53adc783ea2f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:59.637083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cff0bdf8-825a-4f7d-b82c-53adc783ea2f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:00.076732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cff0bdf8-825a-4f7d-b82c-53adc783ea2f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:00.086296 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cff0bdf8-825a-4f7d-b82c-53adc783ea2f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1528 microversion: 2.1 time: 0.511758 May 27 15:25:00.105695 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2822/5653] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:24:59 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1528 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:01.105915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a351d978-bc50-4d33-a1b3-6bd10a305e7a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:01.107318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a351d978-bc50-4d33-a1b3-6bd10a305e7a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:01.124476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a351d978-bc50-4d33-a1b3-6bd10a305e7a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:01.125661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a351d978-bc50-4d33-a1b3-6bd10a305e7a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:01.126735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a351d978-bc50-4d33-a1b3-6bd10a305e7a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:01.127445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a351d978-bc50-4d33-a1b3-6bd10a305e7a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:01.671906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a351d978-bc50-4d33-a1b3-6bd10a305e7a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:01.684416 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a351d978-bc50-4d33-a1b3-6bd10a305e7a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1528 microversion: 2.1 time: 0.584613 May 27 15:25:01.686758 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2832/5654] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:01 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1528 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:02.711865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-861cff36-ab4d-4b0a-9b2e-408878e4c70b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:02.713260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-861cff36-ab4d-4b0a-9b2e-408878e4c70b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:02.726666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=34 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:02.733289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-861cff36-ab4d-4b0a-9b2e-408878e4c70b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:02.740486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-861cff36-ab4d-4b0a-9b2e-408878e4c70b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:02.742581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-861cff36-ab4d-4b0a-9b2e-408878e4c70b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:02.744710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-861cff36-ab4d-4b0a-9b2e-408878e4c70b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:03.263284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-861cff36-ab4d-4b0a-9b2e-408878e4c70b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:03.282589 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-861cff36-ab4d-4b0a-9b2e-408878e4c70b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1528 microversion: 2.1 time: 0.570394 May 27 15:25:03.285192 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2823/5655] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:02 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1528 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:04.299885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2e35a490-2cd6-4835-80eb-872a9546f62d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:04.302178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2e35a490-2cd6-4835-80eb-872a9546f62d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:04.314181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e35a490-2cd6-4835-80eb-872a9546f62d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:04.314654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e35a490-2cd6-4835-80eb-872a9546f62d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:04.318043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e35a490-2cd6-4835-80eb-872a9546f62d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:04.318545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e35a490-2cd6-4835-80eb-872a9546f62d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:04.629056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-35d8cd30-c768-4fab-9dce-87bc6ac38ab1 req-8fe08c1e-fe9a-46fc-bb17-3a87e96aa14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3833c6b2-abd7-4b5a-8268-7582e7ee9554", "name": "network-vif-plugged", "status": "completed", "tag": "1de1e73d-e773-469f-b8b2-df33a48f8687"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:25:04.655400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-35d8cd30-c768-4fab-9dce-87bc6ac38ab1 req-8fe08c1e-fe9a-46fc-bb17-3a87e96aa14e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:04.656219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-35d8cd30-c768-4fab-9dce-87bc6ac38ab1 req-8fe08c1e-fe9a-46fc-bb17-3a87e96aa14e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:04.683316 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-35d8cd30-c768-4fab-9dce-87bc6ac38ab1 req-8fe08c1e-fe9a-46fc-bb17-3a87e96aa14e service nova] Creating event network-vif-plugged:1de1e73d-e773-469f-b8b2-df33a48f8687 for instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 on n-h2-843621-1 May 27 15:25:04.699447 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-35d8cd30-c768-4fab-9dce-87bc6ac38ab1 req-8fe08c1e-fe9a-46fc-bb17-3a87e96aa14e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.621339 May 27 15:25:04.707375 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2833/5656] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:25:05.046213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ac1be1ea-5ff8-4d1e-b105-ded4b7b103f5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:25:05.047312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ac1be1ea-5ff8-4d1e-b105-ded4b7b103f5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:05.105456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac1be1ea-5ff8-4d1e-b105-ded4b7b103f5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:05.106276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac1be1ea-5ff8-4d1e-b105-ded4b7b103f5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:05.107273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac1be1ea-5ff8-4d1e-b105-ded4b7b103f5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:05.107977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac1be1ea-5ff8-4d1e-b105-ded4b7b103f5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:05.238177 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ac1be1ea-5ff8-4d1e-b105-ded4b7b103f5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action" status: 202 len: 0 microversion: 2.1 time: 0.528615 May 27 15:25:05.240859 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2834/5657] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:25:04 2022] POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:25:05.269235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f3c8ed7b-9067-4504-9cb0-6054e928265b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:05.272589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f3c8ed7b-9067-4504-9cb0-6054e928265b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:05.284435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3c8ed7b-9067-4504-9cb0-6054e928265b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:05.286349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3c8ed7b-9067-4504-9cb0-6054e928265b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:05.288066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3c8ed7b-9067-4504-9cb0-6054e928265b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:05.309089 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3c8ed7b-9067-4504-9cb0-6054e928265b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:05.475429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2e35a490-2cd6-4835-80eb-872a9546f62d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:05.490156 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2e35a490-2cd6-4835-80eb-872a9546f62d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1528 microversion: 2.1 time: 1.194170 May 27 15:25:05.508268 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2824/5658] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:04 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1528 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:05.864297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f3c8ed7b-9067-4504-9cb0-6054e928265b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:05.873378 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f3c8ed7b-9067-4504-9cb0-6054e928265b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1671 microversion: 2.1 time: 0.619141 May 27 15:25:05.879056 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2835/5659] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:05 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1671 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:06.526622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-10fdbddc-f1ff-4358-a06a-2d5a8c4cce60 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:06.528189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-10fdbddc-f1ff-4358-a06a-2d5a8c4cce60 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:06.541771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10fdbddc-f1ff-4358-a06a-2d5a8c4cce60 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:06.545380 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10fdbddc-f1ff-4358-a06a-2d5a8c4cce60 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:06.546597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10fdbddc-f1ff-4358-a06a-2d5a8c4cce60 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:06.551913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10fdbddc-f1ff-4358-a06a-2d5a8c4cce60 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:06.612565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=74 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:06.894763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-af98c22b-27c4-4f1a-9ff3-ab4d42f88ab2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:06.896899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-af98c22b-27c4-4f1a-9ff3-ab4d42f88ab2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:06.923119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af98c22b-27c4-4f1a-9ff3-ab4d42f88ab2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:06.927366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af98c22b-27c4-4f1a-9ff3-ab4d42f88ab2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:06.934141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af98c22b-27c4-4f1a-9ff3-ab4d42f88ab2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:06.937039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af98c22b-27c4-4f1a-9ff3-ab4d42f88ab2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:07.479864 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-10fdbddc-f1ff-4358-a06a-2d5a8c4cce60 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:07.493550 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-10fdbddc-f1ff-4358-a06a-2d5a8c4cce60 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1528 microversion: 2.1 time: 0.969545 May 27 15:25:07.507209 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2825/5660] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:06 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1528 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:07.913099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-af98c22b-27c4-4f1a-9ff3-ab4d42f88ab2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:07.927887 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-af98c22b-27c4-4f1a-9ff3-ab4d42f88ab2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1671 microversion: 2.1 time: 1.039981 May 27 15:25:07.935399 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2836/5661] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:06 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1671 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:08.515579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9c5a25fc-0ef1-4f1b-8403-8c9950575b12 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:08.521950 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9c5a25fc-0ef1-4f1b-8403-8c9950575b12 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:08.568217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c5a25fc-0ef1-4f1b-8403-8c9950575b12 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:08.571621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c5a25fc-0ef1-4f1b-8403-8c9950575b12 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:08.575572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c5a25fc-0ef1-4f1b-8403-8c9950575b12 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:08.578756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c5a25fc-0ef1-4f1b-8403-8c9950575b12 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:08.954674 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f83bf1b6-e5bd-4f33-8303-7f102d316d5c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:08.955394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f83bf1b6-e5bd-4f33-8303-7f102d316d5c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:08.971574 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f83bf1b6-e5bd-4f33-8303-7f102d316d5c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:08.973297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f83bf1b6-e5bd-4f33-8303-7f102d316d5c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:08.976314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f83bf1b6-e5bd-4f33-8303-7f102d316d5c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:08.976840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f83bf1b6-e5bd-4f33-8303-7f102d316d5c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:08.982117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9c5a25fc-0ef1-4f1b-8403-8c9950575b12 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:08.994685 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9c5a25fc-0ef1-4f1b-8403-8c9950575b12 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1528 microversion: 2.1 time: 0.482590 May 27 15:25:08.998062 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2826/5662] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:08 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1528 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:09.268914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f83bf1b6-e5bd-4f33-8303-7f102d316d5c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:09.279233 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f83bf1b6-e5bd-4f33-8303-7f102d316d5c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.331980 May 27 15:25:09.280432 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2837/5663] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:08 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:10.017711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8928b90f-d24d-48f8-af41-7a89b26c667e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:10.019428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8928b90f-d24d-48f8-af41-7a89b26c667e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:10.032510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8928b90f-d24d-48f8-af41-7a89b26c667e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:10.034905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8928b90f-d24d-48f8-af41-7a89b26c667e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:10.038008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8928b90f-d24d-48f8-af41-7a89b26c667e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:10.039374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8928b90f-d24d-48f8-af41-7a89b26c667e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:10.515387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8928b90f-d24d-48f8-af41-7a89b26c667e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:10.535315 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8928b90f-d24d-48f8-af41-7a89b26c667e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1528 microversion: 2.1 time: 0.517116 May 27 15:25:10.537218 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2827/5664] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:10 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1528 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:11.555517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-be5df687-3569-4d81-9379-71a2223aa26d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:11.556785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-be5df687-3569-4d81-9379-71a2223aa26d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:11.570274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be5df687-3569-4d81-9379-71a2223aa26d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:11.574537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be5df687-3569-4d81-9379-71a2223aa26d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:11.575810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be5df687-3569-4d81-9379-71a2223aa26d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:11.576490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be5df687-3569-4d81-9379-71a2223aa26d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:11.980060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-be5df687-3569-4d81-9379-71a2223aa26d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:11.989911 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-be5df687-3569-4d81-9379-71a2223aa26d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1528 microversion: 2.1 time: 0.439947 May 27 15:25:11.993871 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2838/5665] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:11 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1528 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:13.009491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2fed5302-856a-4ab9-90de-6d2b50bdd369 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:13.010134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2fed5302-856a-4ab9-90de-6d2b50bdd369 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:13.038173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2fed5302-856a-4ab9-90de-6d2b50bdd369 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:13.038670 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2fed5302-856a-4ab9-90de-6d2b50bdd369 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:13.044281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2fed5302-856a-4ab9-90de-6d2b50bdd369 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:13.044826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2fed5302-856a-4ab9-90de-6d2b50bdd369 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:13.518478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2fed5302-856a-4ab9-90de-6d2b50bdd369 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:13.533489 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2fed5302-856a-4ab9-90de-6d2b50bdd369 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1528 microversion: 2.1 time: 0.522861 May 27 15:25:13.536395 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2828/5666] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:13 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1528 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:14.554727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-03bf2eac-07e4-4197-aa4b-612e2858b091 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:14.555408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-03bf2eac-07e4-4197-aa4b-612e2858b091 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:14.581611 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03bf2eac-07e4-4197-aa4b-612e2858b091 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:14.583273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03bf2eac-07e4-4197-aa4b-612e2858b091 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:14.589029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03bf2eac-07e4-4197-aa4b-612e2858b091 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:14.594708 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03bf2eac-07e4-4197-aa4b-612e2858b091 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:15.316616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-03bf2eac-07e4-4197-aa4b-612e2858b091 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:15.326763 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-03bf2eac-07e4-4197-aa4b-612e2858b091 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1528 microversion: 2.1 time: 0.777662 May 27 15:25:15.337804 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2839/5667] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:14 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1528 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:16.355984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d6106906-71ef-4ec9-8acd-5ee400d7eb4a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:16.356742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d6106906-71ef-4ec9-8acd-5ee400d7eb4a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:16.393387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d6106906-71ef-4ec9-8acd-5ee400d7eb4a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:16.394162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d6106906-71ef-4ec9-8acd-5ee400d7eb4a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:16.395245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d6106906-71ef-4ec9-8acd-5ee400d7eb4a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:16.397167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d6106906-71ef-4ec9-8acd-5ee400d7eb4a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:16.760377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d6106906-71ef-4ec9-8acd-5ee400d7eb4a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:16.807947 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d6106906-71ef-4ec9-8acd-5ee400d7eb4a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1528 microversion: 2.1 time: 0.456596 May 27 15:25:16.811052 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2829/5668] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:16 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1528 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:17.826262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2efb87ef-b5e0-4366-b231-668f786aa835 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:17.826889 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2efb87ef-b5e0-4366-b231-668f786aa835 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:17.868944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2efb87ef-b5e0-4366-b231-668f786aa835 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:17.875693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2efb87ef-b5e0-4366-b231-668f786aa835 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:17.880858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2efb87ef-b5e0-4366-b231-668f786aa835 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:17.887812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2efb87ef-b5e0-4366-b231-668f786aa835 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:18.604784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2efb87ef-b5e0-4366-b231-668f786aa835 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:18.636958 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2efb87ef-b5e0-4366-b231-668f786aa835 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1528 microversion: 2.1 time: 0.815143 May 27 15:25:18.638253 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2840/5669] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:17 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1528 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:19.661248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-52f5f80b-fd2e-48d7-97b5-a0e69c8b05d9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:19.664203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-52f5f80b-fd2e-48d7-97b5-a0e69c8b05d9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:19.706878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-52f5f80b-fd2e-48d7-97b5-a0e69c8b05d9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:19.710032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-52f5f80b-fd2e-48d7-97b5-a0e69c8b05d9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:19.711744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-52f5f80b-fd2e-48d7-97b5-a0e69c8b05d9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:19.725473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-52f5f80b-fd2e-48d7-97b5-a0e69c8b05d9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:20.284801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-52f5f80b-fd2e-48d7-97b5-a0e69c8b05d9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:20.294899 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-52f5f80b-fd2e-48d7-97b5-a0e69c8b05d9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1528 microversion: 2.1 time: 0.644072 May 27 15:25:20.312065 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2830/5670] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:19 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1528 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:25:21.319455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bf68dd47-76cb-44a1-aca5-fdaaa3def306 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:21.320870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bf68dd47-76cb-44a1-aca5-fdaaa3def306 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:21.338285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=26 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:21.354506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf68dd47-76cb-44a1-aca5-fdaaa3def306 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:21.354979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf68dd47-76cb-44a1-aca5-fdaaa3def306 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:21.355868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf68dd47-76cb-44a1-aca5-fdaaa3def306 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:21.356314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf68dd47-76cb-44a1-aca5-fdaaa3def306 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:21.986316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bf68dd47-76cb-44a1-aca5-fdaaa3def306 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:21.998468 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bf68dd47-76cb-44a1-aca5-fdaaa3def306 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1528 microversion: 2.1 time: 0.683272 May 27 15:25:22.000733 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2841/5671] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:21 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1528 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:23.017969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-24fa00e4-7834-4471-8ad6-6db0b4723e1b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:23.018607 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-24fa00e4-7834-4471-8ad6-6db0b4723e1b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:23.042198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24fa00e4-7834-4471-8ad6-6db0b4723e1b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:23.043638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24fa00e4-7834-4471-8ad6-6db0b4723e1b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:23.048104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24fa00e4-7834-4471-8ad6-6db0b4723e1b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:23.059086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24fa00e4-7834-4471-8ad6-6db0b4723e1b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:23.453332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-24fa00e4-7834-4471-8ad6-6db0b4723e1b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:23.484850 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-24fa00e4-7834-4471-8ad6-6db0b4723e1b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1528 microversion: 2.1 time: 0.466193 May 27 15:25:23.491440 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2831/5672] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:23 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1528 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:24.505649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-af626d31-2c50-42b1-b70d-b8efbbc6e2df tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:24.506898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-af626d31-2c50-42b1-b70d-b8efbbc6e2df tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:24.521527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af626d31-2c50-42b1-b70d-b8efbbc6e2df tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:24.521999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af626d31-2c50-42b1-b70d-b8efbbc6e2df tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:24.539996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af626d31-2c50-42b1-b70d-b8efbbc6e2df tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:24.542083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af626d31-2c50-42b1-b70d-b8efbbc6e2df tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:24.860640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-af626d31-2c50-42b1-b70d-b8efbbc6e2df tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:24.906619 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-af626d31-2c50-42b1-b70d-b8efbbc6e2df tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1528 microversion: 2.1 time: 0.404796 May 27 15:25:24.915477 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2842/5673] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:24 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1528 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:25.940722 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2e94a218-f46c-436a-b8cc-777ef6f57a3b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:25.945499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2e94a218-f46c-436a-b8cc-777ef6f57a3b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:25.982673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e94a218-f46c-436a-b8cc-777ef6f57a3b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:25.992664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e94a218-f46c-436a-b8cc-777ef6f57a3b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:25.999419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e94a218-f46c-436a-b8cc-777ef6f57a3b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:26.000401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e94a218-f46c-436a-b8cc-777ef6f57a3b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:26.360939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2e94a218-f46c-436a-b8cc-777ef6f57a3b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:26.374130 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2e94a218-f46c-436a-b8cc-777ef6f57a3b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1528 microversion: 2.1 time: 0.452725 May 27 15:25:26.375780 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2832/5674] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:25 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1528 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:27.393875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9e9d9e5e-4f4e-44e7-b19c-a7277afe0390 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:27.395888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9e9d9e5e-4f4e-44e7-b19c-a7277afe0390 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:27.417630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e9d9e5e-4f4e-44e7-b19c-a7277afe0390 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:27.420377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e9d9e5e-4f4e-44e7-b19c-a7277afe0390 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:27.421468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e9d9e5e-4f4e-44e7-b19c-a7277afe0390 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:27.422159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e9d9e5e-4f4e-44e7-b19c-a7277afe0390 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:28.444844 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9e9d9e5e-4f4e-44e7-b19c-a7277afe0390 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:28.478520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:28.484177 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9e9d9e5e-4f4e-44e7-b19c-a7277afe0390 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1528 microversion: 2.1 time: 1.094194 May 27 15:25:28.496058 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2843/5675] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:27 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1528 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:29.514762 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ba05ad30-7e7d-4725-9dcb-860e79c6ec9f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:29.516157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ba05ad30-7e7d-4725-9dcb-860e79c6ec9f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:29.530476 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba05ad30-7e7d-4725-9dcb-860e79c6ec9f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:29.538785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba05ad30-7e7d-4725-9dcb-860e79c6ec9f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:29.545962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba05ad30-7e7d-4725-9dcb-860e79c6ec9f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:29.547974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba05ad30-7e7d-4725-9dcb-860e79c6ec9f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:30.040357 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ba05ad30-7e7d-4725-9dcb-860e79c6ec9f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:30.052598 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ba05ad30-7e7d-4725-9dcb-860e79c6ec9f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1528 microversion: 2.1 time: 0.540523 May 27 15:25:30.064801 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2833/5676] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:29 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1528 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:31.074825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4f917cbb-7056-441a-b162-34075704db07 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:31.077041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4f917cbb-7056-441a-b162-34075704db07 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:31.095555 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f917cbb-7056-441a-b162-34075704db07 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:31.099845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f917cbb-7056-441a-b162-34075704db07 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:31.101151 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f917cbb-7056-441a-b162-34075704db07 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:31.101705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4f917cbb-7056-441a-b162-34075704db07 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:31.967959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4f917cbb-7056-441a-b162-34075704db07 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:31.978156 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4f917cbb-7056-441a-b162-34075704db07 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1510 microversion: 2.1 time: 0.910514 May 27 15:25:31.981717 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2844/5677] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:31 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1510 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:33.001023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eafdcfeb-175f-4082-b60c-6b7f8d3f6c92 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:33.001651 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-eafdcfeb-175f-4082-b60c-6b7f8d3f6c92 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:33.019063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=22 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:33.025314 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eafdcfeb-175f-4082-b60c-6b7f8d3f6c92 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:33.025774 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eafdcfeb-175f-4082-b60c-6b7f8d3f6c92 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:33.028278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eafdcfeb-175f-4082-b60c-6b7f8d3f6c92 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:33.029810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eafdcfeb-175f-4082-b60c-6b7f8d3f6c92 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:33.385172 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eafdcfeb-175f-4082-b60c-6b7f8d3f6c92 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:33.398306 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-eafdcfeb-175f-4082-b60c-6b7f8d3f6c92 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1510 microversion: 2.1 time: 0.402650 May 27 15:25:33.411789 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2834/5678] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:32 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1510 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:34.333117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-421a574f-f8f6-40eb-a521-ad10b78153d7 req-3ed3b4d3-bc99-430b-b958-e51c83b28b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3833c6b2-abd7-4b5a-8268-7582e7ee9554", "name": "network-vif-unplugged", "status": "completed", "tag": "1de1e73d-e773-469f-b8b2-df33a48f8687"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:25:34.354006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-421a574f-f8f6-40eb-a521-ad10b78153d7 req-3ed3b4d3-bc99-430b-b958-e51c83b28b43 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:34.357224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-421a574f-f8f6-40eb-a521-ad10b78153d7 req-3ed3b4d3-bc99-430b-b958-e51c83b28b43 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:34.401650 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-421a574f-f8f6-40eb-a521-ad10b78153d7 req-3ed3b4d3-bc99-430b-b958-e51c83b28b43 service nova] Creating event network-vif-unplugged:1de1e73d-e773-469f-b8b2-df33a48f8687 for instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 on n-h2-843621-1 May 27 15:25:34.414160 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-421a574f-f8f6-40eb-a521-ad10b78153d7 req-3ed3b4d3-bc99-430b-b958-e51c83b28b43 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085665 May 27 15:25:34.417093 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-63d22af0-1698-4ea2-b44f-e1696a8eaa14 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:34.418581 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2845/5679] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:25:34.419204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-63d22af0-1698-4ea2-b44f-e1696a8eaa14 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:34.461980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63d22af0-1698-4ea2-b44f-e1696a8eaa14 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:34.471385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63d22af0-1698-4ea2-b44f-e1696a8eaa14 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:34.474839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63d22af0-1698-4ea2-b44f-e1696a8eaa14 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:34.481317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63d22af0-1698-4ea2-b44f-e1696a8eaa14 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:34.934226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-63d22af0-1698-4ea2-b44f-e1696a8eaa14 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:34.955457 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-63d22af0-1698-4ea2-b44f-e1696a8eaa14 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1510 microversion: 2.1 time: 0.543316 May 27 15:25:34.958217 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2835/5680] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:34 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1510 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:35.977322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-361fae03-8ba0-4f02-bc7d-edfaa2d0c291 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:35.978698 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-361fae03-8ba0-4f02-bc7d-edfaa2d0c291 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:35.998883 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-361fae03-8ba0-4f02-bc7d-edfaa2d0c291 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:35.999351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-361fae03-8ba0-4f02-bc7d-edfaa2d0c291 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:36.000435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-361fae03-8ba0-4f02-bc7d-edfaa2d0c291 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:36.000916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-361fae03-8ba0-4f02-bc7d-edfaa2d0c291 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:36.341664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-361fae03-8ba0-4f02-bc7d-edfaa2d0c291 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:36.363544 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-361fae03-8ba0-4f02-bc7d-edfaa2d0c291 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1453 microversion: 2.1 time: 0.385446 May 27 15:25:36.364260 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2846/5681] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:35 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1453 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:25:36.387836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-426d1136-ea46-4f5c-808b-ff2b330893eb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:36.389879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-426d1136-ea46-4f5c-808b-ff2b330893eb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:36.405462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-426d1136-ea46-4f5c-808b-ff2b330893eb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:36.406299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-426d1136-ea46-4f5c-808b-ff2b330893eb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:36.407407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-426d1136-ea46-4f5c-808b-ff2b330893eb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:36.408089 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-426d1136-ea46-4f5c-808b-ff2b330893eb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:37.114145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-426d1136-ea46-4f5c-808b-ff2b330893eb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:37.116417 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=70 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:37.125427 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-426d1136-ea46-4f5c-808b-ff2b330893eb tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1453 microversion: 2.1 time: 0.746479 May 27 15:25:37.129439 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2836/5682] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:36 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1453 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:37.187282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-64b35bac-8fad-4dfb-939c-28da58ff8bcd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:25:37.188691 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-64b35bac-8fad-4dfb-939c-28da58ff8bcd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:37.201590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64b35bac-8fad-4dfb-939c-28da58ff8bcd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:37.202077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64b35bac-8fad-4dfb-939c-28da58ff8bcd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:37.203270 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64b35bac-8fad-4dfb-939c-28da58ff8bcd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:37.203726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64b35bac-8fad-4dfb-939c-28da58ff8bcd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:37.267748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-64b35bac-8fad-4dfb-939c-28da58ff8bcd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lazy-loading 'flavor' on Instance uuid 3833c6b2-abd7-4b5a-8268-7582e7ee9554 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:25:37.323877 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-64b35bac-8fad-4dfb-939c-28da58ff8bcd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Cannot 'shelve' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state shelved_offloaded May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-64b35bac-8fad-4dfb-939c-28da58ff8bcd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action HTTP/1.1 May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 14 May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: {"shelve": {}} May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: exception: Cannot 'shelve' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state shelved_offloaded May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '3833c6b2-abd7-4b5a-8268-7582e7ee9554', 'body': {'shelve': {}}} May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve May 27 15:25:37.326413 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 15:25:37.332450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 15:25:37.332450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 15:25:37.332450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state shelved_offloaded May 27 15:25:37.332450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:25:37.332450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:25:37.332450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:25:37.332450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:25:37.332450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:25:37.332450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:25:37.332450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:25:37.332450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:25:37.332450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state shelved_offloaded May 27 15:25:37.332450 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:25:37.336655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-64b35bac-8fad-4dfb-939c-28da58ff8bcd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 409 to user: Cannot 'shelve' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state shelved_offloaded {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:25:37.338094 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-64b35bac-8fad-4dfb-939c-28da58ff8bcd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action" status: 409 len: 155 microversion: 2.1 time: 0.154605 May 27 15:25:37.342826 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2847/5683] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:25:37 2022] POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action => generated 155 bytes in 160 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:25:37.348258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-05bd66ad-ccab-4091-b5c8-436491c6b98b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:25:37.349255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-05bd66ad-ccab-4091-b5c8-436491c6b98b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:37.364988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05bd66ad-ccab-4091-b5c8-436491c6b98b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:37.365458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05bd66ad-ccab-4091-b5c8-436491c6b98b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:37.366261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05bd66ad-ccab-4091-b5c8-436491c6b98b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:37.366712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05bd66ad-ccab-4091-b5c8-436491c6b98b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:38.059061 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-05bd66ad-ccab-4091-b5c8-436491c6b98b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action" status: 202 len: 0 microversion: 2.1 time: 0.714989 May 27 15:25:38.061528 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2837/5684] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:25:37 2022] POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action => generated 0 bytes in 718 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:25:38.071963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-112c8542-3676-43ca-8264-5a7f5664e232 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:38.072514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-112c8542-3676-43ca-8264-5a7f5664e232 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:38.084317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-112c8542-3676-43ca-8264-5a7f5664e232 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:38.086038 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-112c8542-3676-43ca-8264-5a7f5664e232 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:38.094107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-112c8542-3676-43ca-8264-5a7f5664e232 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:38.096213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-112c8542-3676-43ca-8264-5a7f5664e232 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:38.521971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-112c8542-3676-43ca-8264-5a7f5664e232 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:38.537485 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-112c8542-3676-43ca-8264-5a7f5664e232 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1461 microversion: 2.1 time: 0.471251 May 27 15:25:38.556776 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2848/5685] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:38 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1461 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:39.189173 n-d-843621-1 devstack@n-api.service[119249]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:25:39.189506 n-d-843621-1 devstack@n-api.service[119249]: Fri May 27 15:25:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:25:39.563837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-58c31435-6875-4237-b5cc-fbc0c9dff5da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:39.564889 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-58c31435-6875-4237-b5cc-fbc0c9dff5da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:39.583721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-58c31435-6875-4237-b5cc-fbc0c9dff5da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:39.584192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-58c31435-6875-4237-b5cc-fbc0c9dff5da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:39.591887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-58c31435-6875-4237-b5cc-fbc0c9dff5da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:39.592412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-58c31435-6875-4237-b5cc-fbc0c9dff5da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:39.948955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-58c31435-6875-4237-b5cc-fbc0c9dff5da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:39.970984 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-58c31435-6875-4237-b5cc-fbc0c9dff5da tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1461 microversion: 2.1 time: 0.414070 May 27 15:25:39.974545 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2838/5686] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:39 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1461 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:40.992003 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-879fcf66-59bb-49b0-81cc-1c597351fdbd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:40.992622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-879fcf66-59bb-49b0-81cc-1c597351fdbd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:41.005130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-879fcf66-59bb-49b0-81cc-1c597351fdbd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:41.008927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-879fcf66-59bb-49b0-81cc-1c597351fdbd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:41.010051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-879fcf66-59bb-49b0-81cc-1c597351fdbd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:41.012940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-879fcf66-59bb-49b0-81cc-1c597351fdbd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:41.293990 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-879fcf66-59bb-49b0-81cc-1c597351fdbd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:41.303487 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-879fcf66-59bb-49b0-81cc-1c597351fdbd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1461 microversion: 2.1 time: 0.315783 May 27 15:25:41.310032 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2849/5687] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:40 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1461 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:42.327562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2e5119bb-0f31-4146-a893-d77c3f23a1c6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:42.328912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2e5119bb-0f31-4146-a893-d77c3f23a1c6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:42.341516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e5119bb-0f31-4146-a893-d77c3f23a1c6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:42.345666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e5119bb-0f31-4146-a893-d77c3f23a1c6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:42.346723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e5119bb-0f31-4146-a893-d77c3f23a1c6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:42.347942 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e5119bb-0f31-4146-a893-d77c3f23a1c6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:43.047344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2e5119bb-0f31-4146-a893-d77c3f23a1c6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:43.065784 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2e5119bb-0f31-4146-a893-d77c3f23a1c6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1461 microversion: 2.1 time: 0.742084 May 27 15:25:43.073086 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2839/5688] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:42 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1461 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:44.088823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e86e285c-80a6-4f25-bd11-255e28a3dacd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:44.089522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e86e285c-80a6-4f25-bd11-255e28a3dacd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:44.121908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e86e285c-80a6-4f25-bd11-255e28a3dacd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:44.126560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e86e285c-80a6-4f25-bd11-255e28a3dacd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:44.129728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e86e285c-80a6-4f25-bd11-255e28a3dacd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:44.138576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e86e285c-80a6-4f25-bd11-255e28a3dacd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:44.755886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e86e285c-80a6-4f25-bd11-255e28a3dacd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:44.769196 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e86e285c-80a6-4f25-bd11-255e28a3dacd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1519 microversion: 2.1 time: 0.680848 May 27 15:25:44.772985 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2850/5689] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:44 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1519 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:45.793318 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5d1db2a9-4e9c-470c-aa4b-f79dff434e11 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:45.794806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5d1db2a9-4e9c-470c-aa4b-f79dff434e11 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:45.806228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5d1db2a9-4e9c-470c-aa4b-f79dff434e11 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:45.808998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5d1db2a9-4e9c-470c-aa4b-f79dff434e11 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:45.811032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5d1db2a9-4e9c-470c-aa4b-f79dff434e11 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:45.813313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5d1db2a9-4e9c-470c-aa4b-f79dff434e11 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:46.827948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5d1db2a9-4e9c-470c-aa4b-f79dff434e11 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:46.838951 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5d1db2a9-4e9c-470c-aa4b-f79dff434e11 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1519 microversion: 2.1 time: 1.055241 May 27 15:25:46.848988 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2840/5690] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:45 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1519 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:47.862071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-26cec07f-adf5-41fb-a253-57ae039dd69f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:47.870797 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-26cec07f-adf5-41fb-a253-57ae039dd69f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:47.899411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26cec07f-adf5-41fb-a253-57ae039dd69f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:47.900311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26cec07f-adf5-41fb-a253-57ae039dd69f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:47.901640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26cec07f-adf5-41fb-a253-57ae039dd69f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:47.902448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26cec07f-adf5-41fb-a253-57ae039dd69f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:49.370437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-26cec07f-adf5-41fb-a253-57ae039dd69f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:49.382126 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-26cec07f-adf5-41fb-a253-57ae039dd69f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1519 microversion: 2.1 time: 1.524555 May 27 15:25:49.398862 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2851/5691] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:47 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1519 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:50.403617 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0a362aae-3511-460f-94d3-f75b62083b78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:50.405050 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0a362aae-3511-460f-94d3-f75b62083b78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:50.418816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a362aae-3511-460f-94d3-f75b62083b78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:50.425054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a362aae-3511-460f-94d3-f75b62083b78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:50.430472 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a362aae-3511-460f-94d3-f75b62083b78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:50.431209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a362aae-3511-460f-94d3-f75b62083b78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:51.110762 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0a362aae-3511-460f-94d3-f75b62083b78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:51.121734 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0a362aae-3511-460f-94d3-f75b62083b78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1519 microversion: 2.1 time: 0.722360 May 27 15:25:51.130634 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2841/5692] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:50 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1519 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:52.151735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-52169333-8638-46d7-8147-4e89983917d5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:52.153275 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-52169333-8638-46d7-8147-4e89983917d5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:52.181018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=22 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:52.185308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52169333-8638-46d7-8147-4e89983917d5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:52.188019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52169333-8638-46d7-8147-4e89983917d5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:52.192119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52169333-8638-46d7-8147-4e89983917d5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:52.195348 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52169333-8638-46d7-8147-4e89983917d5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:52.705058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-52169333-8638-46d7-8147-4e89983917d5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:52.735665 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-52169333-8638-46d7-8147-4e89983917d5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1519 microversion: 2.1 time: 0.589363 May 27 15:25:52.746459 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2852/5693] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:52 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1519 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:53.765686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1ed5e266-9dcd-4af1-bff6-d04fe3de3f53 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:53.766361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1ed5e266-9dcd-4af1-bff6-d04fe3de3f53 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:53.791718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1ed5e266-9dcd-4af1-bff6-d04fe3de3f53 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:53.792197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1ed5e266-9dcd-4af1-bff6-d04fe3de3f53 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:53.793138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1ed5e266-9dcd-4af1-bff6-d04fe3de3f53 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:53.793593 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1ed5e266-9dcd-4af1-bff6-d04fe3de3f53 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:56.457854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1ed5e266-9dcd-4af1-bff6-d04fe3de3f53 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:56.481402 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1ed5e266-9dcd-4af1-bff6-d04fe3de3f53 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1519 microversion: 2.1 time: 2.721367 May 27 15:25:56.482980 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2842/5694] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:53 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1519 bytes in 2724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:57.517791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e771ef12-57c6-40b8-bbbf-50082c808ce8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:57.528127 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e771ef12-57c6-40b8-bbbf-50082c808ce8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:57.587918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e771ef12-57c6-40b8-bbbf-50082c808ce8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:57.594388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e771ef12-57c6-40b8-bbbf-50082c808ce8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:57.605975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e771ef12-57c6-40b8-bbbf-50082c808ce8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:57.606953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e771ef12-57c6-40b8-bbbf-50082c808ce8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:58.372934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e771ef12-57c6-40b8-bbbf-50082c808ce8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:58.388041 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e771ef12-57c6-40b8-bbbf-50082c808ce8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1519 microversion: 2.1 time: 0.887425 May 27 15:25:58.389474 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2853/5695] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:57 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1519 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:59.415491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c17004b6-f0da-4ecc-b1be-2488d33b7eaf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:59.420895 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c17004b6-f0da-4ecc-b1be-2488d33b7eaf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:59.470308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c17004b6-f0da-4ecc-b1be-2488d33b7eaf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:59.473117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c17004b6-f0da-4ecc-b1be-2488d33b7eaf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:59.476109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c17004b6-f0da-4ecc-b1be-2488d33b7eaf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:59.477432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c17004b6-f0da-4ecc-b1be-2488d33b7eaf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:00.252269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c17004b6-f0da-4ecc-b1be-2488d33b7eaf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:00.288179 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c17004b6-f0da-4ecc-b1be-2488d33b7eaf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1519 microversion: 2.1 time: 0.877309 May 27 15:26:00.305616 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2843/5696] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:25:59 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1519 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:01.307454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ac5f173c-626a-4019-a5b4-58d443add233 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:01.309170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ac5f173c-626a-4019-a5b4-58d443add233 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:01.320417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac5f173c-626a-4019-a5b4-58d443add233 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:01.321569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac5f173c-626a-4019-a5b4-58d443add233 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:01.323179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac5f173c-626a-4019-a5b4-58d443add233 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:01.324117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac5f173c-626a-4019-a5b4-58d443add233 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:01.332036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=58 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:01.901194 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ac5f173c-626a-4019-a5b4-58d443add233 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:01.919071 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ac5f173c-626a-4019-a5b4-58d443add233 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1519 microversion: 2.1 time: 0.616205 May 27 15:26:01.938774 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2854/5697] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:01 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1519 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:02.949854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2bd05e8b-ccf2-4770-b936-f84d59331033 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:02.952478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2bd05e8b-ccf2-4770-b936-f84d59331033 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:02.969644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bd05e8b-ccf2-4770-b936-f84d59331033 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:02.975151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bd05e8b-ccf2-4770-b936-f84d59331033 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:02.977350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bd05e8b-ccf2-4770-b936-f84d59331033 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:02.983227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bd05e8b-ccf2-4770-b936-f84d59331033 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:03.617378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2bd05e8b-ccf2-4770-b936-f84d59331033 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:03.626732 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2bd05e8b-ccf2-4770-b936-f84d59331033 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1519 microversion: 2.1 time: 0.684448 May 27 15:26:03.627343 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2844/5698] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:02 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1519 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:04.646347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-44c10c0e-ba2a-4222-b76b-02b336e05f98 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:04.647381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-44c10c0e-ba2a-4222-b76b-02b336e05f98 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:04.656859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44c10c0e-ba2a-4222-b76b-02b336e05f98 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:04.665888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44c10c0e-ba2a-4222-b76b-02b336e05f98 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:04.669849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44c10c0e-ba2a-4222-b76b-02b336e05f98 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:04.670555 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44c10c0e-ba2a-4222-b76b-02b336e05f98 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:05.398641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-44c10c0e-ba2a-4222-b76b-02b336e05f98 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:05.424592 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-44c10c0e-ba2a-4222-b76b-02b336e05f98 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1519 microversion: 2.1 time: 0.784026 May 27 15:26:05.430598 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2855/5699] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:04 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1519 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:06.450068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4791f32a-5776-48e3-9626-61bbe52b2f5b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:06.450749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4791f32a-5776-48e3-9626-61bbe52b2f5b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:06.457181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=24 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:06.480081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4791f32a-5776-48e3-9626-61bbe52b2f5b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:06.481823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4791f32a-5776-48e3-9626-61bbe52b2f5b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:06.483510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4791f32a-5776-48e3-9626-61bbe52b2f5b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:06.487125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4791f32a-5776-48e3-9626-61bbe52b2f5b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:06.891303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4791f32a-5776-48e3-9626-61bbe52b2f5b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:06.922947 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4791f32a-5776-48e3-9626-61bbe52b2f5b tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1519 microversion: 2.1 time: 0.476028 May 27 15:26:06.923736 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2845/5700] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:06 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1519 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:07.942617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6af036e6-ebc8-4c1e-8367-568b88988356 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:07.943977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6af036e6-ebc8-4c1e-8367-568b88988356 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:07.966147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6af036e6-ebc8-4c1e-8367-568b88988356 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:07.966790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6af036e6-ebc8-4c1e-8367-568b88988356 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:07.967611 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6af036e6-ebc8-4c1e-8367-568b88988356 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:07.968067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6af036e6-ebc8-4c1e-8367-568b88988356 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:08.402309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6af036e6-ebc8-4c1e-8367-568b88988356 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:08.418511 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6af036e6-ebc8-4c1e-8367-568b88988356 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1519 microversion: 2.1 time: 0.480728 May 27 15:26:08.419601 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2856/5701] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:07 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1519 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:09.437880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fa822f8c-725f-477c-b1c6-bc024372a4bf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:09.438517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fa822f8c-725f-477c-b1c6-bc024372a4bf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:09.459198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa822f8c-725f-477c-b1c6-bc024372a4bf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:09.465083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa822f8c-725f-477c-b1c6-bc024372a4bf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:09.466171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa822f8c-725f-477c-b1c6-bc024372a4bf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:09.467578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa822f8c-725f-477c-b1c6-bc024372a4bf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:09.536588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:09.923166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fa822f8c-725f-477c-b1c6-bc024372a4bf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:09.931865 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fa822f8c-725f-477c-b1c6-bc024372a4bf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1519 microversion: 2.1 time: 0.498953 May 27 15:26:09.949069 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2846/5702] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:09 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1519 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:10.520474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-d415777a-24b2-4108-ab90-ded5591c2685 req-ef2a7776-4706-4039-838a-180e345bd2b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3833c6b2-abd7-4b5a-8268-7582e7ee9554", "name": "network-vif-plugged", "status": "completed", "tag": "1de1e73d-e773-469f-b8b2-df33a48f8687"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:10.536558 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d415777a-24b2-4108-ab90-ded5591c2685 req-ef2a7776-4706-4039-838a-180e345bd2b5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:10.537059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d415777a-24b2-4108-ab90-ded5591c2685 req-ef2a7776-4706-4039-838a-180e345bd2b5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:10.578988 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-d415777a-24b2-4108-ab90-ded5591c2685 req-ef2a7776-4706-4039-838a-180e345bd2b5 service nova] Creating event network-vif-plugged:1de1e73d-e773-469f-b8b2-df33a48f8687 for instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 on n-h2-843621-1 May 27 15:26:10.589380 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-d415777a-24b2-4108-ab90-ded5591c2685 req-ef2a7776-4706-4039-838a-180e345bd2b5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071180 May 27 15:26:10.590034 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2857/5703] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:26:10.949294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-77658c76-e75c-403a-827c-c819f3733be8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:10.950813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-77658c76-e75c-403a-827c-c819f3733be8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:10.961450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77658c76-e75c-403a-827c-c819f3733be8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:10.975279 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77658c76-e75c-403a-827c-c819f3733be8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:10.976140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77658c76-e75c-403a-827c-c819f3733be8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:10.976598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77658c76-e75c-403a-827c-c819f3733be8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:11.538144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-77658c76-e75c-403a-827c-c819f3733be8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:11.551792 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-77658c76-e75c-403a-827c-c819f3733be8 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1519 microversion: 2.1 time: 0.606410 May 27 15:26:11.553059 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2847/5704] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:10 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1519 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:12.446587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d8d97b7a-05c6-4653-845c-91ba026275da tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:12.451032 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d8d97b7a-05c6-4653-845c-91ba026275da tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:12.492189 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8d97b7a-05c6-4653-845c-91ba026275da tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:12.492653 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8d97b7a-05c6-4653-845c-91ba026275da tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:12.493480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8d97b7a-05c6-4653-845c-91ba026275da tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:12.493926 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d8d97b7a-05c6-4653-845c-91ba026275da tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:12.575077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-94e03ed2-ab2c-405f-9e32-bbdb2e0b91d6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:12.577289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-94e03ed2-ab2c-405f-9e32-bbdb2e0b91d6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:12.621723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94e03ed2-ab2c-405f-9e32-bbdb2e0b91d6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:12.634600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94e03ed2-ab2c-405f-9e32-bbdb2e0b91d6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:12.639154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94e03ed2-ab2c-405f-9e32-bbdb2e0b91d6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:12.645476 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94e03ed2-ab2c-405f-9e32-bbdb2e0b91d6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:14.309014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-94e03ed2-ab2c-405f-9e32-bbdb2e0b91d6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:14.323981 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-94e03ed2-ab2c-405f-9e32-bbdb2e0b91d6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1519 microversion: 2.1 time: 1.759170 May 27 15:26:14.336855 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2848/5705] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:12 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1519 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:26:14.556095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d8d97b7a-05c6-4653-845c-91ba026275da tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:14.592259 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d8d97b7a-05c6-4653-845c-91ba026275da tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 2.162832 May 27 15:26:14.593113 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2858/5706] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:12 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 2169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:14.611900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4d10f1e3-4fcc-468c-a9e9-a6950119486c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:14.612946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4d10f1e3-4fcc-468c-a9e9-a6950119486c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:14.656494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d10f1e3-4fcc-468c-a9e9-a6950119486c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:14.662805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d10f1e3-4fcc-468c-a9e9-a6950119486c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:14.664935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d10f1e3-4fcc-468c-a9e9-a6950119486c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:14.672085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4d10f1e3-4fcc-468c-a9e9-a6950119486c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:15.184196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4d10f1e3-4fcc-468c-a9e9-a6950119486c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:15.193106 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4d10f1e3-4fcc-468c-a9e9-a6950119486c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.584942 May 27 15:26:15.204521 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2849/5707] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:14 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:15.209913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c44fb49c-a048-425e-a613-ba20430307a2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:15.210879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c44fb49c-a048-425e-a613-ba20430307a2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:15.230991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c44fb49c-a048-425e-a613-ba20430307a2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:15.231845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c44fb49c-a048-425e-a613-ba20430307a2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:15.232900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c44fb49c-a048-425e-a613-ba20430307a2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:15.233585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c44fb49c-a048-425e-a613-ba20430307a2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:15.361619 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e2318f29-4ef9-4fe9-9f0c-5d2efa3436c9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:15.363663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e2318f29-4ef9-4fe9-9f0c-5d2efa3436c9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:15.379528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2318f29-4ef9-4fe9-9f0c-5d2efa3436c9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:15.380566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2318f29-4ef9-4fe9-9f0c-5d2efa3436c9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:15.383950 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2318f29-4ef9-4fe9-9f0c-5d2efa3436c9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:15.384657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2318f29-4ef9-4fe9-9f0c-5d2efa3436c9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:15.859939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e2318f29-4ef9-4fe9-9f0c-5d2efa3436c9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:15.868002 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e2318f29-4ef9-4fe9-9f0c-5d2efa3436c9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.526608 May 27 15:26:15.873412 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2850/5708] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:15 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:15.895124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-42d3d035-9b97-4f31-93a4-a543e6175a0c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:15.896047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-42d3d035-9b97-4f31-93a4-a543e6175a0c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:15.909071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-42d3d035-9b97-4f31-93a4-a543e6175a0c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:15.912074 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-42d3d035-9b97-4f31-93a4-a543e6175a0c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:15.913404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-42d3d035-9b97-4f31-93a4-a543e6175a0c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:15.915361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-42d3d035-9b97-4f31-93a4-a543e6175a0c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:15.965990 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c44fb49c-a048-425e-a613-ba20430307a2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:15.983548 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c44fb49c-a048-425e-a613-ba20430307a2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.777653 May 27 15:26:15.990753 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2859/5709] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:15 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:16.030721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-36979f00-37ca-4100-a8c3-af2b563bd82f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:16.032026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-36979f00-37ca-4100-a8c3-af2b563bd82f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:16.056006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36979f00-37ca-4100-a8c3-af2b563bd82f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:16.063618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36979f00-37ca-4100-a8c3-af2b563bd82f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:16.069642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36979f00-37ca-4100-a8c3-af2b563bd82f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:16.074718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36979f00-37ca-4100-a8c3-af2b563bd82f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:16.440183 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-42d3d035-9b97-4f31-93a4-a543e6175a0c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:16.449578 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-42d3d035-9b97-4f31-93a4-a543e6175a0c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.559798 May 27 15:26:16.453980 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2851/5710] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:15 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:16.490255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c8b8b067-7165-4923-8179-30837908c2a5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:16.491305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c8b8b067-7165-4923-8179-30837908c2a5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:16.498286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8b8b067-7165-4923-8179-30837908c2a5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:16.503983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8b8b067-7165-4923-8179-30837908c2a5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:16.511611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8b8b067-7165-4923-8179-30837908c2a5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:16.513195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8b8b067-7165-4923-8179-30837908c2a5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:16.513597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-36979f00-37ca-4100-a8c3-af2b563bd82f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:16.523216 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-36979f00-37ca-4100-a8c3-af2b563bd82f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.515862 May 27 15:26:16.524105 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2860/5711] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:16 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:16.849661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0c5c84bf-43fa-43be-a8d8-c5b0b2ebeae0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1615448139", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "2accc000-a1ee-4371-bdb5-4490822eb578"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:16.960448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-0c5c84bf-43fa-43be-a8d8-c5b0b2ebeae0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] validate_networks() for [('2accc000-a1ee-4371-bdb5-4490822eb578', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:26:17.507300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c8b8b067-7165-4923-8179-30837908c2a5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:17.517548 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c8b8b067-7165-4923-8179-30837908c2a5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 1.033984 May 27 15:26:17.519611 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2852/5712] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:16 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:17.554353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c6c1835d-5661-45a2-8284-73c6c84eac05 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:17.585371 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-c6c1835d-5661-45a2-8284-73c6c84eac05 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance 08803329-7967-4543-a5ee-b084a2f8c72b has no mapping to a cell. May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c6c1835d-5661-45a2-8284-73c6c84eac05 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/08803329-7967-4543-a5ee-b084a2f8c72b/action HTTP/1.1 May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 15 May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: {"os-stop": {}} May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 08803329-7967-4543-a5ee-b084a2f8c72b has no mapping to a cell. May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '08803329-7967-4543-a5ee-b084a2f8c72b', 'body': {'os-stop': {}}} May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 08803329-7967-4543-a5ee-b084a2f8c72b has no mapping to a cell. May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:26:17.618484 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08803329-7967-4543-a5ee-b084a2f8c72b has no mapping to a cell. May 27 15:26:17.624297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:17.624297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:17.624297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:17.624297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:17.624297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:17.624297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:17.624297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:26:17.624297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:26:17.624297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08803329-7967-4543-a5ee-b084a2f8c72b has no mapping to a cell. May 27 15:26:17.624297 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:17.635123 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c6c1835d-5661-45a2-8284-73c6c84eac05 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance 08803329-7967-4543-a5ee-b084a2f8c72b has no mapping to a cell. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:26:17.637935 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c6c1835d-5661-45a2-8284-73c6c84eac05 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/08803329-7967-4543-a5ee-b084a2f8c72b/action" status: 404 len: 117 microversion: 2.1 time: 0.106638 May 27 15:26:17.642476 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2853/5713] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:26:17 2022] POST /compute/v2.1/servers/08803329-7967-4543-a5ee-b084a2f8c72b/action => generated 117 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:26:17.657954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3909e9fd-106d-4b10-a717-96ec0313f02e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:17.658921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3909e9fd-106d-4b10-a717-96ec0313f02e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:17.699282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3909e9fd-106d-4b10-a717-96ec0313f02e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:17.700130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3909e9fd-106d-4b10-a717-96ec0313f02e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:17.701184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3909e9fd-106d-4b10-a717-96ec0313f02e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:17.703556 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3909e9fd-106d-4b10-a717-96ec0313f02e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:18.375108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3909e9fd-106d-4b10-a717-96ec0313f02e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:18.404004 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3909e9fd-106d-4b10-a717-96ec0313f02e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.758170 May 27 15:26:18.416184 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2854/5714] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:17 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:18.437636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-27e7512f-23ec-4cad-b8f3-71e2eb4a81b7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:18.438793 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-27e7512f-23ec-4cad-b8f3-71e2eb4a81b7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:18.449705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27e7512f-23ec-4cad-b8f3-71e2eb4a81b7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:18.450421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27e7512f-23ec-4cad-b8f3-71e2eb4a81b7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:18.453760 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27e7512f-23ec-4cad-b8f3-71e2eb4a81b7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:18.455622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27e7512f-23ec-4cad-b8f3-71e2eb4a81b7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:18.864369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-0c5c84bf-43fa-43be-a8d8-c5b0b2ebeae0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:26:18.865386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-0c5c84bf-43fa-43be-a8d8-c5b0b2ebeae0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:26:18.866171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-0c5c84bf-43fa-43be-a8d8-c5b0b2ebeae0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:26:18.866606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-0c5c84bf-43fa-43be-a8d8-c5b0b2ebeae0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:26:18.867030 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-0c5c84bf-43fa-43be-a8d8-c5b0b2ebeae0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:26:18.894135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c5c84bf-43fa-43be-a8d8-c5b0b2ebeae0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:18.894611 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c5c84bf-43fa-43be-a8d8-c5b0b2ebeae0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:18.895543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c5c84bf-43fa-43be-a8d8-c5b0b2ebeae0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:18.896349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c5c84bf-43fa-43be-a8d8-c5b0b2ebeae0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:18.960537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-0c5c84bf-43fa-43be-a8d8-c5b0b2ebeae0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Getting quotas for project e72c782a808345e093093ea95ce04ae4. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:26:18.971400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-0c5c84bf-43fa-43be-a8d8-c5b0b2ebeae0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Getting quotas for user f750b3f70eed4477a15c3529371a8af3 and project e72c782a808345e093093ea95ce04ae4. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:26:18.999007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0c5c84bf-43fa-43be-a8d8-c5b0b2ebeae0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:26:19.002097 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0c5c84bf-43fa-43be-a8d8-c5b0b2ebeae0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:26:19.066688 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0c5c84bf-43fa-43be-a8d8-c5b0b2ebeae0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.221304 May 27 15:26:19.068523 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2861/5715] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:26:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:26:19.085476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-46e810e7-4098-4b0f-8d28-99b3b0b0b0e5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:19.086812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-46e810e7-4098-4b0f-8d28-99b3b0b0b0e5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:19.230192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-46e810e7-4098-4b0f-8d28-99b3b0b0b0e5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:19.264028 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-46e810e7-4098-4b0f-8d28-99b3b0b0b0e5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318" status: 200 len: 1215 microversion: 2.1 time: 0.188770 May 27 15:26:19.275357 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2862/5716] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:19 2022] GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318 => generated 1215 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:19.339069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-27e7512f-23ec-4cad-b8f3-71e2eb4a81b7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:19.359674 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-27e7512f-23ec-4cad-b8f3-71e2eb4a81b7 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.926610 May 27 15:26:19.361768 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2855/5717] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:18 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:19.396072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d68b9bfe-7bd2-4105-b7c1-1dd0dc39d75e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:19.398792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d68b9bfe-7bd2-4105-b7c1-1dd0dc39d75e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: b1bd40ad-5a86-467b-89d9-d0fe00cf71ab] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:19.423955 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-d68b9bfe-7bd2-4105-b7c1-1dd0dc39d75e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance b1bd40ad-5a86-467b-89d9-d0fe00cf71ab could not be found. May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d68b9bfe-7bd2-4105-b7c1-1dd0dc39d75e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/b1bd40ad-5a86-467b-89d9-d0fe00cf71ab/action HTTP/1.1 May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 15 May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: {"suspend": {}} May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance b1bd40ad-5a86-467b-89d9-d0fe00cf71ab could not be found. May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'b1bd40ad-5a86-467b-89d9-d0fe00cf71ab', 'body': {'suspend': {}}} May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1bd40ad-5a86-467b-89d9-d0fe00cf71ab could not be found. May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1bd40ad-5a86-467b-89d9-d0fe00cf71ab could not be found. May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:19.431017 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:19.438348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:26:19.438348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:26:19.438348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1bd40ad-5a86-467b-89d9-d0fe00cf71ab could not be found. May 27 15:26:19.438348 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:19.438348 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d68b9bfe-7bd2-4105-b7c1-1dd0dc39d75e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance b1bd40ad-5a86-467b-89d9-d0fe00cf71ab could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:26:19.438348 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d68b9bfe-7bd2-4105-b7c1-1dd0dc39d75e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/b1bd40ad-5a86-467b-89d9-d0fe00cf71ab/action" status: 404 len: 111 microversion: 2.1 time: 0.044079 May 27 15:26:19.445172 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2863/5718] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:26:19 2022] POST /compute/v2.1/servers/b1bd40ad-5a86-467b-89d9-d0fe00cf71ab/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:26:19.448543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9114a46a-e29c-4b4a-87bc-7488f7267596 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:19.453405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9114a46a-e29c-4b4a-87bc-7488f7267596 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:19.486551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9114a46a-e29c-4b4a-87bc-7488f7267596 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:19.489834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9114a46a-e29c-4b4a-87bc-7488f7267596 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:19.498590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9114a46a-e29c-4b4a-87bc-7488f7267596 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:19.499184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9114a46a-e29c-4b4a-87bc-7488f7267596 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:20.001125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9114a46a-e29c-4b4a-87bc-7488f7267596 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:20.015028 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9114a46a-e29c-4b4a-87bc-7488f7267596 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.572944 May 27 15:26:20.015788 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2856/5719] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:19 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:20.036898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2335c5d1-9f49-463d-9cab-7d5599a53ebf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:20.037715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2335c5d1-9f49-463d-9cab-7d5599a53ebf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:20.051732 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2335c5d1-9f49-463d-9cab-7d5599a53ebf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:20.053047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2335c5d1-9f49-463d-9cab-7d5599a53ebf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:20.055146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2335c5d1-9f49-463d-9cab-7d5599a53ebf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:20.056809 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2335c5d1-9f49-463d-9cab-7d5599a53ebf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:20.283918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-510dcd3e-365b-4597-9449-af6fe087557e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:20.284970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-510dcd3e-365b-4597-9449-af6fe087557e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:20.295631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-510dcd3e-365b-4597-9449-af6fe087557e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:20.296469 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-510dcd3e-365b-4597-9449-af6fe087557e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:20.298514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-510dcd3e-365b-4597-9449-af6fe087557e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:20.301162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-510dcd3e-365b-4597-9449-af6fe087557e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:20.470888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-510dcd3e-365b-4597-9449-af6fe087557e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:20.481205 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-510dcd3e-365b-4597-9449-af6fe087557e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318" status: 200 len: 1211 microversion: 2.1 time: 0.202100 May 27 15:26:20.482436 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2857/5720] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:20 2022] GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318 => generated 1211 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:20.529489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2335c5d1-9f49-463d-9cab-7d5599a53ebf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:20.541555 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2335c5d1-9f49-463d-9cab-7d5599a53ebf tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.510539 May 27 15:26:20.542167 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2864/5721] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:20 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:20.566048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e69190f7-2275-483e-9092-6f9a1944e5c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:20.566854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e69190f7-2275-483e-9092-6f9a1944e5c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:20.576759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e69190f7-2275-483e-9092-6f9a1944e5c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:20.578053 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e69190f7-2275-483e-9092-6f9a1944e5c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:20.579722 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e69190f7-2275-483e-9092-6f9a1944e5c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:20.580397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e69190f7-2275-483e-9092-6f9a1944e5c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:20.614984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-e69190f7-2275-483e-9092-6f9a1944e5c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lazy-loading 'flavor' on Instance uuid 3833c6b2-abd7-4b5a-8268-7582e7ee9554 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:26:20.900129 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e69190f7-2275-483e-9092-6f9a1944e5c3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action" status: 202 len: 0 microversion: 2.1 time: 0.337492 May 27 15:26:20.903965 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2858/5722] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:26:20 2022] POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:26:20.910199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a762de94-1e7e-43d4-b084-d39b81567c51 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:20.910898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a762de94-1e7e-43d4-b084-d39b81567c51 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:20.920171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a762de94-1e7e-43d4-b084-d39b81567c51 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:20.923218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a762de94-1e7e-43d4-b084-d39b81567c51 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:20.924407 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a762de94-1e7e-43d4-b084-d39b81567c51 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:20.927449 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a762de94-1e7e-43d4-b084-d39b81567c51 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:21.243182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a762de94-1e7e-43d4-b084-d39b81567c51 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:21.257552 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a762de94-1e7e-43d4-b084-d39b81567c51 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1514 microversion: 2.1 time: 0.351824 May 27 15:26:21.258153 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2865/5723] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:20 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1514 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:21.501309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4861fa6a-4fcb-464f-b621-80d2b7a42e54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:21.503202 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4861fa6a-4fcb-464f-b621-80d2b7a42e54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:21.521251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4861fa6a-4fcb-464f-b621-80d2b7a42e54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:21.521979 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4861fa6a-4fcb-464f-b621-80d2b7a42e54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:21.522958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4861fa6a-4fcb-464f-b621-80d2b7a42e54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:21.523676 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4861fa6a-4fcb-464f-b621-80d2b7a42e54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:21.679640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4861fa6a-4fcb-464f-b621-80d2b7a42e54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:21.708574 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4861fa6a-4fcb-464f-b621-80d2b7a42e54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318" status: 200 len: 1273 microversion: 2.1 time: 0.212343 May 27 15:26:21.713580 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2859/5724] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:21 2022] GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318 => generated 1273 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:22.276226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-10648345-1f28-471d-809e-062b35a614e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:22.276909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-10648345-1f28-471d-809e-062b35a614e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:22.279769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:22.292852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10648345-1f28-471d-809e-062b35a614e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:22.293326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10648345-1f28-471d-809e-062b35a614e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:22.294136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10648345-1f28-471d-809e-062b35a614e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:22.294589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10648345-1f28-471d-809e-062b35a614e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:22.732541 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5244f3cf-a852-4535-9468-fa519ab076b9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:22.733230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5244f3cf-a852-4535-9468-fa519ab076b9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:22.749815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5244f3cf-a852-4535-9468-fa519ab076b9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:22.751086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5244f3cf-a852-4535-9468-fa519ab076b9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:22.752210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5244f3cf-a852-4535-9468-fa519ab076b9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:22.753002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5244f3cf-a852-4535-9468-fa519ab076b9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:22.948729 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5244f3cf-a852-4535-9468-fa519ab076b9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:22.953409 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-10648345-1f28-471d-809e-062b35a614e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:22.963298 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5244f3cf-a852-4535-9468-fa519ab076b9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318" status: 200 len: 1273 microversion: 2.1 time: 0.232599 May 27 15:26:22.967086 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2860/5725] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:22 2022] GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318 => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:26:22.968149 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-10648345-1f28-471d-809e-062b35a614e2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1497 microversion: 2.1 time: 0.695621 May 27 15:26:22.969017 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2866/5726] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:22 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1497 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:22.994592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-34acee0f-88ef-4bfa-b303-e6a72805932d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:22.995210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-34acee0f-88ef-4bfa-b303-e6a72805932d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:23.007488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34acee0f-88ef-4bfa-b303-e6a72805932d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:23.008040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34acee0f-88ef-4bfa-b303-e6a72805932d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:23.009409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34acee0f-88ef-4bfa-b303-e6a72805932d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:23.013833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34acee0f-88ef-4bfa-b303-e6a72805932d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:23.058714 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-34acee0f-88ef-4bfa-b303-e6a72805932d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lazy-loading 'flavor' on Instance uuid 3833c6b2-abd7-4b5a-8268-7582e7ee9554 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:26:23.091611 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-34acee0f-88ef-4bfa-b303-e6a72805932d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Cannot 'suspend' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state suspended May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-34acee0f-88ef-4bfa-b303-e6a72805932d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action HTTP/1.1 May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 15 May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: {"suspend": {}} May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: exception: Cannot 'suspend' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state suspended May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '3833c6b2-abd7-4b5a-8268-7582e7ee9554', 'body': {'suspend': {}}} May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 in vm_state suspended. Cannot suspend while the instance is in this state. May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend May 27 15:26:23.093463 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 15:26:23.099204 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 15:26:23.099204 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 15:26:23.099204 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state suspended May 27 15:26:23.099204 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:23.099204 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:23.099204 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:23.099204 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:23.099204 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:23.099204 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:23.099204 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:26:23.099204 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:26:23.099204 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state suspended May 27 15:26:23.099204 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:23.099204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-34acee0f-88ef-4bfa-b303-e6a72805932d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 409 to user: Cannot 'suspend' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state suspended {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:26:23.099204 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-34acee0f-88ef-4bfa-b303-e6a72805932d tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action" status: 409 len: 148 microversion: 2.1 time: 0.107462 May 27 15:26:23.099204 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2861/5727] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:26:22 2022] POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action => generated 148 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:26:23.106787 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b8d2bb68-9a1a-405a-a2ef-98259e63d37c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:23.107677 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b8d2bb68-9a1a-405a-a2ef-98259e63d37c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:23.120850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8d2bb68-9a1a-405a-a2ef-98259e63d37c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:23.121323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8d2bb68-9a1a-405a-a2ef-98259e63d37c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:23.122124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8d2bb68-9a1a-405a-a2ef-98259e63d37c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:23.122579 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8d2bb68-9a1a-405a-a2ef-98259e63d37c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:23.269797 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b8d2bb68-9a1a-405a-a2ef-98259e63d37c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action" status: 202 len: 0 microversion: 2.1 time: 0.166762 May 27 15:26:23.275187 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2867/5728] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:26:23 2022] POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:26:23.281840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-87243e07-14fd-4822-bb2d-c0e9767b0f0a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:23.282744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-87243e07-14fd-4822-bb2d-c0e9767b0f0a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:23.294955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87243e07-14fd-4822-bb2d-c0e9767b0f0a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:23.295786 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87243e07-14fd-4822-bb2d-c0e9767b0f0a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:23.296828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87243e07-14fd-4822-bb2d-c0e9767b0f0a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:23.299640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87243e07-14fd-4822-bb2d-c0e9767b0f0a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:23.308547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:23.988939 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-17060eb9-fc5f-4b05-b151-27298eda80d8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:23.989673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-17060eb9-fc5f-4b05-b151-27298eda80d8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:24.000818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17060eb9-fc5f-4b05-b151-27298eda80d8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:24.006463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17060eb9-fc5f-4b05-b151-27298eda80d8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:24.012556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17060eb9-fc5f-4b05-b151-27298eda80d8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:24.013325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-17060eb9-fc5f-4b05-b151-27298eda80d8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:24.380329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-87243e07-14fd-4822-bb2d-c0e9767b0f0a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:24.395134 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-87243e07-14fd-4822-bb2d-c0e9767b0f0a tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1503 microversion: 2.1 time: 1.111139 May 27 15:26:24.396307 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2862/5729] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:23 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1503 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:24.604511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-17060eb9-fc5f-4b05-b151-27298eda80d8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:24.615265 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-17060eb9-fc5f-4b05-b151-27298eda80d8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318" status: 200 len: 1315 microversion: 2.1 time: 0.631218 May 27 15:26:24.616383 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2868/5730] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:23 2022] GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318 => generated 1315 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:26:25.413578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c39474e5-0d40-47b7-80fa-d53c560af2de tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:25.414177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c39474e5-0d40-47b7-80fa-d53c560af2de tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:25.431545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c39474e5-0d40-47b7-80fa-d53c560af2de tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:25.432021 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c39474e5-0d40-47b7-80fa-d53c560af2de tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:25.432849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c39474e5-0d40-47b7-80fa-d53c560af2de tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:25.433493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c39474e5-0d40-47b7-80fa-d53c560af2de tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:25.632120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bbeff85c-3e4b-400d-a82b-712f58a46d6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:25.633363 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bbeff85c-3e4b-400d-a82b-712f58a46d6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:25.652071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bbeff85c-3e4b-400d-a82b-712f58a46d6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:25.652891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bbeff85c-3e4b-400d-a82b-712f58a46d6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:25.653933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bbeff85c-3e4b-400d-a82b-712f58a46d6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:25.654618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bbeff85c-3e4b-400d-a82b-712f58a46d6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:26.419720 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c39474e5-0d40-47b7-80fa-d53c560af2de tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:26.443016 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c39474e5-0d40-47b7-80fa-d53c560af2de tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1503 microversion: 2.1 time: 1.033269 May 27 15:26:26.456800 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2863/5731] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:25 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1503 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:26.469562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-01b01eab-ae50-4867-ac66-54a9174dc249 req-85ce6b4b-a4bc-4c63-b31d-044588907ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98fb50be-7fb6-438a-b017-724a1acde318", "tag": "bc120629-208e-4b26-a2ad-82b5729fd42f"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:26.475309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bbeff85c-3e4b-400d-a82b-712f58a46d6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:26.489998 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bbeff85c-3e4b-400d-a82b-712f58a46d6a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318" status: 200 len: 1315 microversion: 2.1 time: 0.862107 May 27 15:26:26.491237 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2869/5732] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:25 2022] GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318 => generated 1315 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:26.509405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-01b01eab-ae50-4867-ac66-54a9174dc249 req-85ce6b4b-a4bc-4c63-b31d-044588907ef3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:26.510185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-01b01eab-ae50-4867-ac66-54a9174dc249 req-85ce6b4b-a4bc-4c63-b31d-044588907ef3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:26.540169 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-01b01eab-ae50-4867-ac66-54a9174dc249 req-85ce6b4b-a4bc-4c63-b31d-044588907ef3 service nova] Creating event network-changed:bc120629-208e-4b26-a2ad-82b5729fd42f for instance 98fb50be-7fb6-438a-b017-724a1acde318 on n-h2-843621-1 May 27 15:26:26.552472 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-01b01eab-ae50-4867-ac66-54a9174dc249 req-85ce6b4b-a4bc-4c63-b31d-044588907ef3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094187 May 27 15:26:26.559216 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2864/5733] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:26:27.497354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-43709c34-c41d-4876-8cf1-24ef0d280000 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:27.497354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-43709c34-c41d-4876-8cf1-24ef0d280000 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:27.509510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-96b91fbe-a2a9-43e1-9125-03555ee37a9e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:27.511417 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-96b91fbe-a2a9-43e1-9125-03555ee37a9e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:27.514006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43709c34-c41d-4876-8cf1-24ef0d280000 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:27.514822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43709c34-c41d-4876-8cf1-24ef0d280000 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:27.526098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43709c34-c41d-4876-8cf1-24ef0d280000 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:27.527627 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-96b91fbe-a2a9-43e1-9125-03555ee37a9e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:27.528296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-96b91fbe-a2a9-43e1-9125-03555ee37a9e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:27.529954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-96b91fbe-a2a9-43e1-9125-03555ee37a9e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:27.530876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43709c34-c41d-4876-8cf1-24ef0d280000 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:27.531545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-96b91fbe-a2a9-43e1-9125-03555ee37a9e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:28.195870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-43709c34-c41d-4876-8cf1-24ef0d280000 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:28.203611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-96b91fbe-a2a9-43e1-9125-03555ee37a9e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:28.204001 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-43709c34-c41d-4876-8cf1-24ef0d280000 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1503 microversion: 2.1 time: 0.746521 May 27 15:26:28.213184 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2870/5734] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:27 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1503 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:26:28.233944 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-96b91fbe-a2a9-43e1-9125-03555ee37a9e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318" status: 200 len: 1315 microversion: 2.1 time: 0.727563 May 27 15:26:28.234980 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2865/5735] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:27 2022] GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318 => generated 1315 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:29.222524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-25581f68-5e0c-4d7c-8363-8938727bb44c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:29.223235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-25581f68-5e0c-4d7c-8363-8938727bb44c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:29.226484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:29.239914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-25581f68-5e0c-4d7c-8363-8938727bb44c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:29.242464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-25581f68-5e0c-4d7c-8363-8938727bb44c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:29.243543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-25581f68-5e0c-4d7c-8363-8938727bb44c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:29.244593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-25581f68-5e0c-4d7c-8363-8938727bb44c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:29.253225 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e8a96e04-3ad7-4f39-94d5-f35735caa5ee tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:29.253986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e8a96e04-3ad7-4f39-94d5-f35735caa5ee tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:29.269464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e8a96e04-3ad7-4f39-94d5-f35735caa5ee tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:29.270206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e8a96e04-3ad7-4f39-94d5-f35735caa5ee tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:29.271245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e8a96e04-3ad7-4f39-94d5-f35735caa5ee tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:29.272129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e8a96e04-3ad7-4f39-94d5-f35735caa5ee tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:29.323056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=8 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:29.748177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e8a96e04-3ad7-4f39-94d5-f35735caa5ee tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:29.763636 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e8a96e04-3ad7-4f39-94d5-f35735caa5ee tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318" status: 200 len: 1315 microversion: 2.1 time: 0.513898 May 27 15:26:29.769462 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2866/5736] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:29 2022] GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318 => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:29.825585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-25581f68-5e0c-4d7c-8363-8938727bb44c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:29.837598 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-25581f68-5e0c-4d7c-8363-8938727bb44c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.619719 May 27 15:26:29.841342 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2871/5737] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:29 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:29.864270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-02dfa385-8d2c-46a5-a720-455d60a990f2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:29.864927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-02dfa385-8d2c-46a5-a720-455d60a990f2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:29.876633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02dfa385-8d2c-46a5-a720-455d60a990f2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:29.878367 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02dfa385-8d2c-46a5-a720-455d60a990f2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:29.879389 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02dfa385-8d2c-46a5-a720-455d60a990f2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:29.880780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02dfa385-8d2c-46a5-a720-455d60a990f2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:30.362376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-02dfa385-8d2c-46a5-a720-455d60a990f2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:30.384579 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-02dfa385-8d2c-46a5-a720-455d60a990f2 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.523941 May 27 15:26:30.387533 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2867/5738] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:29 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:30.407293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-88f5aa85-5aac-4f86-8c11-0efdafa96829 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:30.407891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-88f5aa85-5aac-4f86-8c11-0efdafa96829 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 1f72e475-c87f-40b7-8273-8c80a60c7c86] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:30.426396 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-88f5aa85-5aac-4f86-8c11-0efdafa96829 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance 1f72e475-c87f-40b7-8273-8c80a60c7c86 could not be found. May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-88f5aa85-5aac-4f86-8c11-0efdafa96829 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/1f72e475-c87f-40b7-8273-8c80a60c7c86/action HTTP/1.1 May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 15 May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: {"unpause": {}} May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 1f72e475-c87f-40b7-8273-8c80a60c7c86 could not be found. May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '1f72e475-c87f-40b7-8273-8c80a60c7c86', 'body': {'unpause': {}}} May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f72e475-c87f-40b7-8273-8c80a60c7c86 could not be found. May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f72e475-c87f-40b7-8273-8c80a60c7c86 could not be found. May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:30.429002 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:30.435049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:26:30.435049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:26:30.435049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f72e475-c87f-40b7-8273-8c80a60c7c86 could not be found. May 27 15:26:30.435049 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:30.436501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-88f5aa85-5aac-4f86-8c11-0efdafa96829 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance 1f72e475-c87f-40b7-8273-8c80a60c7c86 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:26:30.437866 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-88f5aa85-5aac-4f86-8c11-0efdafa96829 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/1f72e475-c87f-40b7-8273-8c80a60c7c86/action" status: 404 len: 111 microversion: 2.1 time: 0.034951 May 27 15:26:30.441568 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2872/5739] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:26:30 2022] POST /compute/v2.1/servers/1f72e475-c87f-40b7-8273-8c80a60c7c86/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:26:30.450097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-93214dd4-056e-4d20-89bb-66e146ad5127 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:30.451102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-93214dd4-056e-4d20-89bb-66e146ad5127 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:30.464172 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-93214dd4-056e-4d20-89bb-66e146ad5127 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:30.465238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-93214dd4-056e-4d20-89bb-66e146ad5127 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:30.466105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-93214dd4-056e-4d20-89bb-66e146ad5127 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:30.466558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-93214dd4-056e-4d20-89bb-66e146ad5127 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:30.782262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9d6cb9d2-0a20-4203-bedf-1fb55510e26f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:30.782807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9d6cb9d2-0a20-4203-bedf-1fb55510e26f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:30.818266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d6cb9d2-0a20-4203-bedf-1fb55510e26f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:30.818738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d6cb9d2-0a20-4203-bedf-1fb55510e26f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:30.819545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d6cb9d2-0a20-4203-bedf-1fb55510e26f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:30.820004 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d6cb9d2-0a20-4203-bedf-1fb55510e26f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:31.138776 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-93214dd4-056e-4d20-89bb-66e146ad5127 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:31.155571 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-93214dd4-056e-4d20-89bb-66e146ad5127 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.711406 May 27 15:26:31.156207 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2868/5740] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:30 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:26:31.189041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8cf8fe3c-be72-4186-872c-84a860dfd666 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:31.196827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8cf8fe3c-be72-4186-872c-84a860dfd666 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:31.215564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8cf8fe3c-be72-4186-872c-84a860dfd666 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:31.216033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8cf8fe3c-be72-4186-872c-84a860dfd666 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:31.216869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8cf8fe3c-be72-4186-872c-84a860dfd666 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:31.222556 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8cf8fe3c-be72-4186-872c-84a860dfd666 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:31.395769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9d6cb9d2-0a20-4203-bedf-1fb55510e26f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:31.398384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:31.423150 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9d6cb9d2-0a20-4203-bedf-1fb55510e26f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318" status: 200 len: 1315 microversion: 2.1 time: 0.640038 May 27 15:26:31.433707 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2873/5741] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:30 2022] GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318 => generated 1315 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:26:31.526726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8cf8fe3c-be72-4186-872c-84a860dfd666 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:31.541317 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8cf8fe3c-be72-4186-872c-84a860dfd666 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.366288 May 27 15:26:31.554850 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2869/5742] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:31 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:31.560427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8c14da2a-cb49-463a-99ac-0d5e9cf38a0e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:31.561146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8c14da2a-cb49-463a-99ac-0d5e9cf38a0e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:31.582448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c14da2a-cb49-463a-99ac-0d5e9cf38a0e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:31.585697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c14da2a-cb49-463a-99ac-0d5e9cf38a0e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:31.598098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c14da2a-cb49-463a-99ac-0d5e9cf38a0e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:31.598938 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8c14da2a-cb49-463a-99ac-0d5e9cf38a0e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:31.653853 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-8c14da2a-cb49-463a-99ac-0d5e9cf38a0e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Cannot 'unpause' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state active May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8c14da2a-cb49-463a-99ac-0d5e9cf38a0e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action HTTP/1.1 May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 15 May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: {"unpause": {}} May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: exception: Cannot 'unpause' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state active May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '3833c6b2-abd7-4b5a-8268-7582e7ee9554', 'body': {'unpause': {}}} May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 in vm_state active. Cannot unpause while the instance is in this state. May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state active May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:31.655888 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:31.660557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:31.660557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:26:31.660557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:26:31.660557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state active May 27 15:26:31.660557 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:31.668372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8c14da2a-cb49-463a-99ac-0d5e9cf38a0e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 409 to user: Cannot 'unpause' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state active {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:26:31.674409 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8c14da2a-cb49-463a-99ac-0d5e9cf38a0e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action" status: 409 len: 145 microversion: 2.1 time: 0.119675 May 27 15:26:31.675658 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2874/5743] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:26:31 2022] POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action => generated 145 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:26:31.684240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-67a2537a-cb6c-4503-be41-98da5b20f6c6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:31.684928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-67a2537a-cb6c-4503-be41-98da5b20f6c6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:31.701403 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67a2537a-cb6c-4503-be41-98da5b20f6c6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:31.701866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67a2537a-cb6c-4503-be41-98da5b20f6c6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:31.702663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67a2537a-cb6c-4503-be41-98da5b20f6c6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:31.703110 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67a2537a-cb6c-4503-be41-98da5b20f6c6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:32.332936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-62df28ef-80a5-4e93-a4a5-8896c63be75c req-d9fded98-9558-42f8-8570-ef1483cb2f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98fb50be-7fb6-438a-b017-724a1acde318", "name": "network-vif-plugged", "status": "completed", "tag": "bc120629-208e-4b26-a2ad-82b5729fd42f"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:32.351202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-62df28ef-80a5-4e93-a4a5-8896c63be75c req-d9fded98-9558-42f8-8570-ef1483cb2f51 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:32.354528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-62df28ef-80a5-4e93-a4a5-8896c63be75c req-d9fded98-9558-42f8-8570-ef1483cb2f51 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:32.405859 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-62df28ef-80a5-4e93-a4a5-8896c63be75c req-d9fded98-9558-42f8-8570-ef1483cb2f51 service nova] Creating event network-vif-plugged:bc120629-208e-4b26-a2ad-82b5729fd42f for instance 98fb50be-7fb6-438a-b017-724a1acde318 on n-h2-843621-1 May 27 15:26:32.424912 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-62df28ef-80a5-4e93-a4a5-8896c63be75c req-d9fded98-9558-42f8-8570-ef1483cb2f51 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096141 May 27 15:26:32.428389 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2875/5744] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:26:32.454811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bd5145b4-9272-4505-9b8f-08fe26502b7a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:32.456652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bd5145b4-9272-4505-9b8f-08fe26502b7a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:32.473089 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd5145b4-9272-4505-9b8f-08fe26502b7a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:32.474988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd5145b4-9272-4505-9b8f-08fe26502b7a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:32.475995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd5145b4-9272-4505-9b8f-08fe26502b7a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:32.477489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd5145b4-9272-4505-9b8f-08fe26502b7a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:32.681015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-67a2537a-cb6c-4503-be41-98da5b20f6c6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:32.696634 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-67a2537a-cb6c-4503-be41-98da5b20f6c6 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 1.011594 May 27 15:26:32.697384 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2870/5745] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:31 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:32.719957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d32ed5ab-2d39-4d2a-b95d-d646c2d9fe95 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:32.723107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d32ed5ab-2d39-4d2a-b95d-d646c2d9fe95 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:32.738518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d32ed5ab-2d39-4d2a-b95d-d646c2d9fe95 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:32.741428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d32ed5ab-2d39-4d2a-b95d-d646c2d9fe95 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:32.742629 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d32ed5ab-2d39-4d2a-b95d-d646c2d9fe95 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:32.743400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d32ed5ab-2d39-4d2a-b95d-d646c2d9fe95 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:33.784732 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bd5145b4-9272-4505-9b8f-08fe26502b7a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:33.797461 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bd5145b4-9272-4505-9b8f-08fe26502b7a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318" status: 200 len: 1315 microversion: 2.1 time: 1.349241 May 27 15:26:33.801337 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2876/5746] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:32 2022] GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318 => generated 1315 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:26:33.810423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d32ed5ab-2d39-4d2a-b95d-d646c2d9fe95 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:33.824036 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d32ed5ab-2d39-4d2a-b95d-d646c2d9fe95 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 1.110291 May 27 15:26:33.826005 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2871/5747] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:32 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:26:33.847171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-92a153c6-664b-4634-ac82-4c39532f8a66 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:33.847840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-92a153c6-664b-4634-ac82-4c39532f8a66 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 7f59d75b-b06c-4e73-85ee-7b39a27b625e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:33.860057 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-92a153c6-664b-4634-ac82-4c39532f8a66 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance 7f59d75b-b06c-4e73-85ee-7b39a27b625e could not be found. May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-92a153c6-664b-4634-ac82-4c39532f8a66 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/7f59d75b-b06c-4e73-85ee-7b39a27b625e/action HTTP/1.1 May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 18 May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: {"unshelve": null} May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 7f59d75b-b06c-4e73-85ee-7b39a27b625e could not be found. May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '7f59d75b-b06c-4e73-85ee-7b39a27b625e', 'body': {'unshelve': None}} May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f59d75b-b06c-4e73-85ee-7b39a27b625e could not be found. May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f59d75b-b06c-4e73-85ee-7b39a27b625e could not be found. May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:33.864275 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:33.882119 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:33.882119 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:26:33.882119 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:26:33.882119 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f59d75b-b06c-4e73-85ee-7b39a27b625e could not be found. May 27 15:26:33.882119 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:33.882119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-92a153c6-664b-4634-ac82-4c39532f8a66 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance 7f59d75b-b06c-4e73-85ee-7b39a27b625e could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:26:33.882119 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-92a153c6-664b-4634-ac82-4c39532f8a66 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/7f59d75b-b06c-4e73-85ee-7b39a27b625e/action" status: 404 len: 111 microversion: 2.1 time: 0.025563 May 27 15:26:33.884852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a8e3069f-e07e-483b-978b-9109e1b99900 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:33.884852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a8e3069f-e07e-483b-978b-9109e1b99900 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:33.886544 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2877/5748] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:26:33 2022] POST /compute/v2.1/servers/7f59d75b-b06c-4e73-85ee-7b39a27b625e/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:26:33.912978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a8e3069f-e07e-483b-978b-9109e1b99900 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:33.914664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a8e3069f-e07e-483b-978b-9109e1b99900 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:33.917433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a8e3069f-e07e-483b-978b-9109e1b99900 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:33.918568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a8e3069f-e07e-483b-978b-9109e1b99900 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:34.226450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a8e3069f-e07e-483b-978b-9109e1b99900 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:34.239165 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a8e3069f-e07e-483b-978b-9109e1b99900 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.360711 May 27 15:26:34.240716 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2872/5749] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:33 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:34.266212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-58a70233-4e81-4bb6-b1a2-784574753cfd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:34.267848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-58a70233-4e81-4bb6-b1a2-784574753cfd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:34.281855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58a70233-4e81-4bb6-b1a2-784574753cfd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:34.283175 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58a70233-4e81-4bb6-b1a2-784574753cfd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:34.286250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58a70233-4e81-4bb6-b1a2-784574753cfd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:34.287223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58a70233-4e81-4bb6-b1a2-784574753cfd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:34.637870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-58a70233-4e81-4bb6-b1a2-784574753cfd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:34.649579 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-58a70233-4e81-4bb6-b1a2-784574753cfd tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.393499 May 27 15:26:34.654790 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2878/5750] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:34 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:34.668555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2f256423-b9c0-449f-b342-00fc3d041a24 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:34.669568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2f256423-b9c0-449f-b342-00fc3d041a24 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:34.688393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2f256423-b9c0-449f-b342-00fc3d041a24 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:34.689268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2f256423-b9c0-449f-b342-00fc3d041a24 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:34.690430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2f256423-b9c0-449f-b342-00fc3d041a24 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:34.691138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2f256423-b9c0-449f-b342-00fc3d041a24 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:34.740858 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-2f256423-b9c0-449f-b342-00fc3d041a24 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Cannot 'unshelve' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state active May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2f256423-b9c0-449f-b342-00fc3d041a24 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action HTTP/1.1 May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 18 May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: {"unshelve": null} May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: exception: Cannot 'unshelve' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state active May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '3833c6b2-abd7-4b5a-8268-7582e7ee9554', 'body': {'unshelve': None}} May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 in vm_state active. Cannot unshelve while the instance is in this state. May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state active May 27 15:26:34.742962 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:34.747659 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:34.747659 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:34.747659 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:34.747659 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:34.747659 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:34.747659 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:26:34.747659 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:26:34.747659 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state active May 27 15:26:34.747659 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:34.750066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2f256423-b9c0-449f-b342-00fc3d041a24 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 409 to user: Cannot 'unshelve' instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 while it is in vm_state active {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:26:34.751880 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2f256423-b9c0-449f-b342-00fc3d041a24 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action" status: 409 len: 146 microversion: 2.1 time: 0.087686 May 27 15:26:34.753124 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2873/5751] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:26:34 2022] POST /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554/action => generated 146 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:26:34.761771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7e161c65-3d3f-4600-a067-993913aebf75 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:34.762849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7e161c65-3d3f-4600-a067-993913aebf75 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:34.771956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e161c65-3d3f-4600-a067-993913aebf75 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:34.790274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e161c65-3d3f-4600-a067-993913aebf75 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:34.795282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e161c65-3d3f-4600-a067-993913aebf75 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:34.800033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e161c65-3d3f-4600-a067-993913aebf75 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:34.817573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-24520b73-7354-4cd5-aa25-982333c21334 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:34.821237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-24520b73-7354-4cd5-aa25-982333c21334 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:34.832415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24520b73-7354-4cd5-aa25-982333c21334 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:34.833917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24520b73-7354-4cd5-aa25-982333c21334 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:34.835559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24520b73-7354-4cd5-aa25-982333c21334 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:34.837351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24520b73-7354-4cd5-aa25-982333c21334 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:35.690495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7e161c65-3d3f-4600-a067-993913aebf75 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:35.706764 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7e161c65-3d3f-4600-a067-993913aebf75 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.949065 May 27 15:26:35.721952 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2879/5752] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:34 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:35.727081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-120ef8ad-feb4-4313-bb12-65cc30d90af4 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:35.727772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-24520b73-7354-4cd5-aa25-982333c21334 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:35.732261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-120ef8ad-feb4-4313-bb12-65cc30d90af4 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:35.739959 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-24520b73-7354-4cd5-aa25-982333c21334 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318" status: 200 len: 1315 microversion: 2.1 time: 0.926089 May 27 15:26:35.741334 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2874/5753] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:34 2022] GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318 => generated 1315 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:35.747159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-120ef8ad-feb4-4313-bb12-65cc30d90af4 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:35.749401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-120ef8ad-feb4-4313-bb12-65cc30d90af4 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:35.753295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-120ef8ad-feb4-4313-bb12-65cc30d90af4 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:35.754021 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-120ef8ad-feb4-4313-bb12-65cc30d90af4 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:36.083211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-120ef8ad-feb4-4313-bb12-65cc30d90af4 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:36.098044 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-120ef8ad-feb4-4313-bb12-65cc30d90af4 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.372780 May 27 15:26:36.113466 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2880/5754] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:35 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:36.119416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1f0ad610-8495-4bd2-ba95-b3c4674fa079 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1599326683_updated"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:36.120947 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1f0ad610-8495-4bd2-ba95-b3c4674fa079 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: b400ce05-20b9-4784-830e-39de8fc9d493] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:36.140158 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-1f0ad610-8495-4bd2-ba95-b3c4674fa079 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance b400ce05-20b9-4784-830e-39de8fc9d493 could not be found. May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1f0ad610-8495-4bd2-ba95-b3c4674fa079 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: request: PUT /compute/v2.1/servers/b400ce05-20b9-4784-830e-39de8fc9d493 HTTP/1.1 May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 81 May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1599326683_updated"}} May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance b400ce05-20b9-4784-830e-39de8fc9d493 could not be found. May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'b400ce05-20b9-4784-830e-39de8fc9d493', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1599326683_updated'}}} May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b400ce05-20b9-4784-830e-39de8fc9d493 could not be found. May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) May 27 15:26:36.145270 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:26:36.150373 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:26:36.150373 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:26:36.150373 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:26:36.150373 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b400ce05-20b9-4784-830e-39de8fc9d493 could not be found. May 27 15:26:36.150373 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:36.150373 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:36.150373 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:36.150373 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:36.150373 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:36.150373 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:36.150373 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:26:36.150373 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:26:36.150373 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b400ce05-20b9-4784-830e-39de8fc9d493 could not be found. May 27 15:26:36.150373 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:36.150373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1f0ad610-8495-4bd2-ba95-b3c4674fa079 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance b400ce05-20b9-4784-830e-39de8fc9d493 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:26:36.151635 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1f0ad610-8495-4bd2-ba95-b3c4674fa079 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "PUT /compute/v2.1/servers/b400ce05-20b9-4784-830e-39de8fc9d493" status: 404 len: 111 microversion: 2.1 time: 0.036389 May 27 15:26:36.155299 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2875/5755] 10.222.0.13 () {60 vars in 1255 bytes} [Fri May 27 15:26:36 2022] PUT /compute/v2.1/servers/b400ce05-20b9-4784-830e-39de8fc9d493 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:26:36.165392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-120a4266-d328-46c4-a684-05b047ec8bd9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:36.166294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-120a4266-d328-46c4-a684-05b047ec8bd9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:36.175715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-120a4266-d328-46c4-a684-05b047ec8bd9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:36.176343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-120a4266-d328-46c4-a684-05b047ec8bd9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:36.177326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-120a4266-d328-46c4-a684-05b047ec8bd9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:36.178766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-120a4266-d328-46c4-a684-05b047ec8bd9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:36.685580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-120a4266-d328-46c4-a684-05b047ec8bd9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:36.698301 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-120a4266-d328-46c4-a684-05b047ec8bd9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.537893 May 27 15:26:36.699086 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2881/5756] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:36 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:36.720870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8a2d5ae2-9935-48ce-a186-813d7aad1442 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:36.727422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8a2d5ae2-9935-48ce-a186-813d7aad1442 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:36.746664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=62 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:36.750274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a2d5ae2-9935-48ce-a186-813d7aad1442 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:36.751640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a2d5ae2-9935-48ce-a186-813d7aad1442 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:36.759010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1458b73e-8dfe-40a2-87e2-50e114a0880f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:36.759778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1458b73e-8dfe-40a2-87e2-50e114a0880f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:36.763296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a2d5ae2-9935-48ce-a186-813d7aad1442 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:36.766356 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a2d5ae2-9935-48ce-a186-813d7aad1442 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:36.772925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1458b73e-8dfe-40a2-87e2-50e114a0880f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:36.773683 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1458b73e-8dfe-40a2-87e2-50e114a0880f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:36.778072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1458b73e-8dfe-40a2-87e2-50e114a0880f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:36.779146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1458b73e-8dfe-40a2-87e2-50e114a0880f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:37.179047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8a2d5ae2-9935-48ce-a186-813d7aad1442 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:37.188807 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8a2d5ae2-9935-48ce-a186-813d7aad1442 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.471183 May 27 15:26:37.192581 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2876/5757] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:36 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:26:37.212686 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1458b73e-8dfe-40a2-87e2-50e114a0880f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:37.215320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-03e7e99a-7587-497c-9327-f1dad26883e3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-03e7e99a-7587-497c-9327-f1dad26883e3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: request: PUT /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 HTTP/1.1 May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 280 May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '3833c6b2-abd7-4b5a-8268-7582e7ee9554', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance['server']: May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:37.219413 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 27 15:26:37.224877 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:37.232224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-03e7e99a-7587-497c-9327-f1dad26883e3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:26:37.233366 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-03e7e99a-7587-497c-9327-f1dad26883e3 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "PUT /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 400 len: 619 microversion: 2.1 time: 0.025908 May 27 15:26:37.237428 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2877/5758] 10.222.0.13 () {60 vars in 1256 bytes} [Fri May 27 15:26:37 2022] PUT /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:26:37.239548 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1458b73e-8dfe-40a2-87e2-50e114a0880f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318" status: 200 len: 1503 microversion: 2.1 time: 0.484651 May 27 15:26:37.246117 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2882/5759] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:36 2022] GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318 => generated 1503 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:37.249037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dcdaf060-58a8-4c46-8b56-4204d7aa0e78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:37.249911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dcdaf060-58a8-4c46-8b56-4204d7aa0e78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:37.264473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1d2a093e-3bda-4368-b600-39d89b044d60 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:37.266701 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1d2a093e-3bda-4368-b600-39d89b044d60 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:37.272527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dcdaf060-58a8-4c46-8b56-4204d7aa0e78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:37.275987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dcdaf060-58a8-4c46-8b56-4204d7aa0e78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:37.277693 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dcdaf060-58a8-4c46-8b56-4204d7aa0e78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:37.279545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dcdaf060-58a8-4c46-8b56-4204d7aa0e78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:37.306409 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d2a093e-3bda-4368-b600-39d89b044d60 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:37.311216 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d2a093e-3bda-4368-b600-39d89b044d60 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:37.312064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d2a093e-3bda-4368-b600-39d89b044d60 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:37.312532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1d2a093e-3bda-4368-b600-39d89b044d60 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:37.846653 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dcdaf060-58a8-4c46-8b56-4204d7aa0e78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:37.855534 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dcdaf060-58a8-4c46-8b56-4204d7aa0e78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.612880 May 27 15:26:37.858923 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2878/5760] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:37 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:37.876126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-30934638-3e15-43de-a949-be8e31d8000f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:37.876910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-30934638-3e15-43de-a949-be8e31d8000f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:37.888849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30934638-3e15-43de-a949-be8e31d8000f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:37.889596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30934638-3e15-43de-a949-be8e31d8000f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:37.890711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30934638-3e15-43de-a949-be8e31d8000f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:37.892300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-30934638-3e15-43de-a949-be8e31d8000f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:37.901934 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.network.security_group_api [None req-1d2a093e-3bda-4368-b600-39d89b044d60 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Removing security group 9e02b549-6df1-43ce-9cd6-c198ff3c744f from port bc120629-208e-4b26-a2ad-82b5729fd42f May 27 15:26:38.273737 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-30934638-3e15-43de-a949-be8e31d8000f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:38.283697 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-30934638-3e15-43de-a949-be8e31d8000f tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.411546 May 27 15:26:38.302008 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2879/5761] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:37 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:38.313337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d1b4a90c-e912-4c98-908d-637104d12258 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d1b4a90c-e912-4c98-908d-637104d12258 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: request: PUT /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 HTTP/1.1 May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 24 May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: {"server": {"name": ""}} May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: exception: Invalid input for field/attribute name. Value: . '' is too short May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '3833c6b2-abd7-4b5a-8268-7582e7ee9554', 'body': {'server': {'name': ''}}} May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise error May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi On instance['server']: May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi '' May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:26:38.316407 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 27 15:26:38.327043 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:38.327043 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:38.327043 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:38.327043 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:38.327043 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:38.327043 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:38.327043 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:26:38.327043 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:26:38.327043 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 27 15:26:38.327043 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:38.327043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d1b4a90c-e912-4c98-908d-637104d12258 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:26:38.327043 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d1b4a90c-e912-4c98-908d-637104d12258 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "PUT /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 400 len: 108 microversion: 2.1 time: 0.019721 May 27 15:26:38.332243 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2880/5762] 10.222.0.13 () {60 vars in 1255 bytes} [Fri May 27 15:26:38 2022] PUT /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 108 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:26:38.341306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-685a50a9-9ffd-4a57-bda1-ad06b7b26e78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:38.342257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-685a50a9-9ffd-4a57-bda1-ad06b7b26e78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:38.363007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-685a50a9-9ffd-4a57-bda1-ad06b7b26e78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:38.363879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-685a50a9-9ffd-4a57-bda1-ad06b7b26e78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:38.364973 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-685a50a9-9ffd-4a57-bda1-ad06b7b26e78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:38.365656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-685a50a9-9ffd-4a57-bda1-ad06b7b26e78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:38.893257 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1d2a093e-3bda-4368-b600-39d89b044d60 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318/action" status: 202 len: 0 microversion: 2.1 time: 1.634362 May 27 15:26:38.895181 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2883/5763] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:26:37 2022] POST /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318/action => generated 0 bytes in 1637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:26:38.902924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9594731c-c1de-4aac-a616-524553591e2d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:38.903777 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9594731c-c1de-4aac-a616-524553591e2d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:38.918273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9594731c-c1de-4aac-a616-524553591e2d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:38.922707 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9594731c-c1de-4aac-a616-524553591e2d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:38.923728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9594731c-c1de-4aac-a616-524553591e2d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:38.925058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9594731c-c1de-4aac-a616-524553591e2d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:39.059186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-685a50a9-9ffd-4a57-bda1-ad06b7b26e78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:39.070561 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-685a50a9-9ffd-4a57-bda1-ad06b7b26e78 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1506 microversion: 2.1 time: 0.733431 May 27 15:26:39.075588 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2881/5764] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:38 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1506 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:26:39.236254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9594731c-c1de-4aac-a616-524553591e2d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:39.255466 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9594731c-c1de-4aac-a616-524553591e2d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318" status: 200 len: 1461 microversion: 2.1 time: 0.356276 May 27 15:26:39.267299 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2884/5765] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:38 2022] GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318 => generated 1461 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:26:39.292416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-72795239-cd2d-4562-97bf-bbffc734e4c9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:39.297788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-72795239-cd2d-4562-97bf-bbffc734e4c9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:39.335012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-72795239-cd2d-4562-97bf-bbffc734e4c9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:39.335508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-72795239-cd2d-4562-97bf-bbffc734e4c9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:39.344988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-72795239-cd2d-4562-97bf-bbffc734e4c9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:39.345842 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-72795239-cd2d-4562-97bf-bbffc734e4c9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:39.686342 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-c9d8a65d-d105-4b34-b162-b551de2ec0cd req-30109895-0ce1-4aa3-ac5b-7d7524618497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98fb50be-7fb6-438a-b017-724a1acde318", "tag": "bc120629-208e-4b26-a2ad-82b5729fd42f"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:39.707157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c9d8a65d-d105-4b34-b162-b551de2ec0cd req-30109895-0ce1-4aa3-ac5b-7d7524618497 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:39.707618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c9d8a65d-d105-4b34-b162-b551de2ec0cd req-30109895-0ce1-4aa3-ac5b-7d7524618497 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:39.773249 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-c9d8a65d-d105-4b34-b162-b551de2ec0cd req-30109895-0ce1-4aa3-ac5b-7d7524618497 service nova] Creating event network-changed:bc120629-208e-4b26-a2ad-82b5729fd42f for instance 98fb50be-7fb6-438a-b017-724a1acde318 on n-h2-843621-1 May 27 15:26:39.778863 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-c9d8a65d-d105-4b34-b162-b551de2ec0cd req-30109895-0ce1-4aa3-ac5b-7d7524618497 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.701822 May 27 15:26:39.785446 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2882/5766] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:26:40.092819 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-72795239-cd2d-4562-97bf-bbffc734e4c9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:40.112737 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-72795239-cd2d-4562-97bf-bbffc734e4c9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.837051 May 27 15:26:40.116066 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2885/5767] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:39 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:40.154632 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-72d5ae82-3438-45dd-8a23-6153e403f4fa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:40.155444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-72d5ae82-3438-45dd-8a23-6153e403f4fa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:40.193198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72d5ae82-3438-45dd-8a23-6153e403f4fa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:40.194071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72d5ae82-3438-45dd-8a23-6153e403f4fa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:40.197900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72d5ae82-3438-45dd-8a23-6153e403f4fa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:40.197900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72d5ae82-3438-45dd-8a23-6153e403f4fa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:40.239601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:40.498192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-72d5ae82-3438-45dd-8a23-6153e403f4fa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:40.514316 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-72d5ae82-3438-45dd-8a23-6153e403f4fa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.378342 May 27 15:26:40.515579 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2883/5768] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:40 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:40.533547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3b9fac4f-a73c-4800-864d-b287da1bd342 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:40.534900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3b9fac4f-a73c-4800-864d-b287da1bd342 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:40.547206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b9fac4f-a73c-4800-864d-b287da1bd342 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:40.551273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b9fac4f-a73c-4800-864d-b287da1bd342 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:40.556855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b9fac4f-a73c-4800-864d-b287da1bd342 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:40.557752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b9fac4f-a73c-4800-864d-b287da1bd342 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:41.107475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3b9fac4f-a73c-4800-864d-b287da1bd342 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:41.133222 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3b9fac4f-a73c-4800-864d-b287da1bd342 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.596190 May 27 15:26:41.134594 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2886/5769] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:40 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:41.154872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-53a6cf5c-7993-42a8-8503-7061dc41e9e4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:41.156256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-53a6cf5c-7993-42a8-8503-7061dc41e9e4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:41.186248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53a6cf5c-7993-42a8-8503-7061dc41e9e4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:41.186902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53a6cf5c-7993-42a8-8503-7061dc41e9e4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:41.187815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53a6cf5c-7993-42a8-8503-7061dc41e9e4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:41.188591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53a6cf5c-7993-42a8-8503-7061dc41e9e4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:41.788013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-53a6cf5c-7993-42a8-8503-7061dc41e9e4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:41.801910 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-53a6cf5c-7993-42a8-8503-7061dc41e9e4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.656317 May 27 15:26:41.804089 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2884/5770] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:41 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:42.224916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-862d9666-5448-4ea2-bff0-ac580316aa54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1925888215", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "2accc000-a1ee-4371-bdb5-4490822eb578"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:42.389019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-862d9666-5448-4ea2-bff0-ac580316aa54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] validate_networks() for [('2accc000-a1ee-4371-bdb5-4490822eb578', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:26:44.741535 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-862d9666-5448-4ea2-bff0-ac580316aa54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:26:44.742127 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-862d9666-5448-4ea2-bff0-ac580316aa54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:26:44.742598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-862d9666-5448-4ea2-bff0-ac580316aa54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:26:44.743022 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-862d9666-5448-4ea2-bff0-ac580316aa54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:26:44.743446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-862d9666-5448-4ea2-bff0-ac580316aa54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:26:44.756700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-862d9666-5448-4ea2-bff0-ac580316aa54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:44.761096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-862d9666-5448-4ea2-bff0-ac580316aa54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:44.766276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-862d9666-5448-4ea2-bff0-ac580316aa54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:44.767964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-862d9666-5448-4ea2-bff0-ac580316aa54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:44.837107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-862d9666-5448-4ea2-bff0-ac580316aa54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Getting quotas for project e72c782a808345e093093ea95ce04ae4. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:26:44.850465 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-862d9666-5448-4ea2-bff0-ac580316aa54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Getting quotas for user f750b3f70eed4477a15c3529371a8af3 and project e72c782a808345e093093ea95ce04ae4. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:26:44.900358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-862d9666-5448-4ea2-bff0-ac580316aa54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:26:44.909863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-862d9666-5448-4ea2-bff0-ac580316aa54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:26:45.098127 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-862d9666-5448-4ea2-bff0-ac580316aa54 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.878007 May 27 15:26:45.103635 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2887/5771] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:26:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:26:45.116041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d894460c-7825-493e-b6f1-ccab18984b2a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:45.116839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d894460c-7825-493e-b6f1-ccab18984b2a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:45.303054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d894460c-7825-493e-b6f1-ccab18984b2a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:45.325949 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d894460c-7825-493e-b6f1-ccab18984b2a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1215 microversion: 2.1 time: 0.218733 May 27 15:26:45.331404 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2885/5772] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:45 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1215 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:46.351835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5923390b-6b3f-4cce-8792-d3375c9dc1f2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:46.352628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5923390b-6b3f-4cce-8792-d3375c9dc1f2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:46.397135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5923390b-6b3f-4cce-8792-d3375c9dc1f2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:46.398457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5923390b-6b3f-4cce-8792-d3375c9dc1f2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:46.404183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5923390b-6b3f-4cce-8792-d3375c9dc1f2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:46.412941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5923390b-6b3f-4cce-8792-d3375c9dc1f2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:46.658792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5923390b-6b3f-4cce-8792-d3375c9dc1f2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:46.668612 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5923390b-6b3f-4cce-8792-d3375c9dc1f2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1219 microversion: 2.1 time: 0.324476 May 27 15:26:46.676951 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2888/5773] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:46 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1219 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:47.706189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c81d53f2-97f5-4137-ac24-4ce79b613108 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:47.710676 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c81d53f2-97f5-4137-ac24-4ce79b613108 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:47.748766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c81d53f2-97f5-4137-ac24-4ce79b613108 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:47.750204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c81d53f2-97f5-4137-ac24-4ce79b613108 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:47.753230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c81d53f2-97f5-4137-ac24-4ce79b613108 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:47.753714 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c81d53f2-97f5-4137-ac24-4ce79b613108 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:47.887182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c81d53f2-97f5-4137-ac24-4ce79b613108 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:47.902935 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c81d53f2-97f5-4137-ac24-4ce79b613108 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1273 microversion: 2.1 time: 0.210802 May 27 15:26:47.903570 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2886/5774] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:47 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1273 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:48.923392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3babe8c0-56cf-42ba-a2d4-b38bfdaaa914 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:48.925411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3babe8c0-56cf-42ba-a2d4-b38bfdaaa914 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:48.950704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3babe8c0-56cf-42ba-a2d4-b38bfdaaa914 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:48.954305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3babe8c0-56cf-42ba-a2d4-b38bfdaaa914 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:48.958673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3babe8c0-56cf-42ba-a2d4-b38bfdaaa914 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:48.972511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3babe8c0-56cf-42ba-a2d4-b38bfdaaa914 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:49.229078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3babe8c0-56cf-42ba-a2d4-b38bfdaaa914 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:49.246568 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3babe8c0-56cf-42ba-a2d4-b38bfdaaa914 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1273 microversion: 2.1 time: 0.329181 May 27 15:26:49.253578 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2889/5775] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:48 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1273 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:50.270474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-914545dd-086d-40ec-8b1a-b2dc7e367ded tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:50.271748 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-914545dd-086d-40ec-8b1a-b2dc7e367ded tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:50.289756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-914545dd-086d-40ec-8b1a-b2dc7e367ded tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:50.290497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-914545dd-086d-40ec-8b1a-b2dc7e367ded tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:50.291488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-914545dd-086d-40ec-8b1a-b2dc7e367ded tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:50.292149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-914545dd-086d-40ec-8b1a-b2dc7e367ded tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:50.764035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-914545dd-086d-40ec-8b1a-b2dc7e367ded tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:50.779033 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-914545dd-086d-40ec-8b1a-b2dc7e367ded tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1315 microversion: 2.1 time: 0.512784 May 27 15:26:50.779921 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2887/5776] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:50 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:51.796900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2e4d9285-35e7-495b-a274-ae6024991596 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:51.798174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2e4d9285-35e7-495b-a274-ae6024991596 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:51.828243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e4d9285-35e7-495b-a274-ae6024991596 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:51.828929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e4d9285-35e7-495b-a274-ae6024991596 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:51.829930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e4d9285-35e7-495b-a274-ae6024991596 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:51.832116 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e4d9285-35e7-495b-a274-ae6024991596 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:52.351254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-cd98ae1d-e630-4bce-8caf-b090c0ee7638 req-0f68b830-1189-4439-9bc0-f260a843b5fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e1ea07-7d87-45ab-81b9-fe8dc6544258", "tag": "cae8ec95-5c5e-485f-bf31-56b814395525"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:52.387114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-cd98ae1d-e630-4bce-8caf-b090c0ee7638 req-0f68b830-1189-4439-9bc0-f260a843b5fe service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:52.394043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-cd98ae1d-e630-4bce-8caf-b090c0ee7638 req-0f68b830-1189-4439-9bc0-f260a843b5fe service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:52.448856 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-cd98ae1d-e630-4bce-8caf-b090c0ee7638 req-0f68b830-1189-4439-9bc0-f260a843b5fe service nova] Creating event network-changed:cae8ec95-5c5e-485f-bf31-56b814395525 for instance d6e1ea07-7d87-45ab-81b9-fe8dc6544258 on n-h1-843621-1 May 27 15:26:52.455880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2e4d9285-35e7-495b-a274-ae6024991596 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:52.464479 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2e4d9285-35e7-495b-a274-ae6024991596 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1315 microversion: 2.1 time: 0.672153 May 27 15:26:52.475722 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-cd98ae1d-e630-4bce-8caf-b090c0ee7638 req-0f68b830-1189-4439-9bc0-f260a843b5fe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128526 May 27 15:26:52.475970 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2890/5777] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:51 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:52.480533 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2888/5778] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:26:53.493762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-06ea0ab2-d4e9-4992-838d-1d80cbbcdcf5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:53.495198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-06ea0ab2-d4e9-4992-838d-1d80cbbcdcf5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:53.505136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:53.539514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-06ea0ab2-d4e9-4992-838d-1d80cbbcdcf5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:53.545136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-06ea0ab2-d4e9-4992-838d-1d80cbbcdcf5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:53.553798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-06ea0ab2-d4e9-4992-838d-1d80cbbcdcf5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:53.555877 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-06ea0ab2-d4e9-4992-838d-1d80cbbcdcf5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:53.934141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-06ea0ab2-d4e9-4992-838d-1d80cbbcdcf5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:53.946093 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-06ea0ab2-d4e9-4992-838d-1d80cbbcdcf5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1315 microversion: 2.1 time: 0.458557 May 27 15:26:53.956330 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2891/5779] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:53 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:54.964764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9af2b9b8-8762-4980-9129-c771ff37c83c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:54.965483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9af2b9b8-8762-4980-9129-c771ff37c83c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:54.991895 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9af2b9b8-8762-4980-9129-c771ff37c83c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:54.992773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9af2b9b8-8762-4980-9129-c771ff37c83c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:54.993677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9af2b9b8-8762-4980-9129-c771ff37c83c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:54.996871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9af2b9b8-8762-4980-9129-c771ff37c83c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:55.308195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:55.330913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9af2b9b8-8762-4980-9129-c771ff37c83c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:55.343313 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9af2b9b8-8762-4980-9129-c771ff37c83c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1315 microversion: 2.1 time: 0.383602 May 27 15:26:55.344307 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2889/5780] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:54 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:56.367801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3c1d574d-e987-4b72-8e02-720dbb527341 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:56.368308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3c1d574d-e987-4b72-8e02-720dbb527341 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:56.377978 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:56.387208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:56.391199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3c1d574d-e987-4b72-8e02-720dbb527341 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:56.391669 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3c1d574d-e987-4b72-8e02-720dbb527341 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:56.392620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3c1d574d-e987-4b72-8e02-720dbb527341 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:56.402867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3c1d574d-e987-4b72-8e02-720dbb527341 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:56.968608 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3c1d574d-e987-4b72-8e02-720dbb527341 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:56.985407 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3c1d574d-e987-4b72-8e02-720dbb527341 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1315 microversion: 2.1 time: 0.620648 May 27 15:26:56.987382 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2892/5781] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:56 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1315 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:58.003504 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bcb5db88-2680-4bf3-a555-6e0954f49b83 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:58.005478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bcb5db88-2680-4bf3-a555-6e0954f49b83 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:58.018875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bcb5db88-2680-4bf3-a555-6e0954f49b83 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:58.019926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bcb5db88-2680-4bf3-a555-6e0954f49b83 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:58.021130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bcb5db88-2680-4bf3-a555-6e0954f49b83 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:58.023432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bcb5db88-2680-4bf3-a555-6e0954f49b83 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:58.381487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bcb5db88-2680-4bf3-a555-6e0954f49b83 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:58.389546 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bcb5db88-2680-4bf3-a555-6e0954f49b83 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1315 microversion: 2.1 time: 0.390632 May 27 15:26:58.403847 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2890/5782] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:57 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:58.821297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-3bbbc55c-c9be-4f0f-b963-f846b412299a req-a53c34ea-5094-458d-8b07-1ae38b48a89c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e1ea07-7d87-45ab-81b9-fe8dc6544258", "name": "network-vif-plugged", "status": "completed", "tag": "cae8ec95-5c5e-485f-bf31-56b814395525"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:58.851453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3bbbc55c-c9be-4f0f-b963-f846b412299a req-a53c34ea-5094-458d-8b07-1ae38b48a89c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:58.852311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3bbbc55c-c9be-4f0f-b963-f846b412299a req-a53c34ea-5094-458d-8b07-1ae38b48a89c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:58.882175 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-3bbbc55c-c9be-4f0f-b963-f846b412299a req-a53c34ea-5094-458d-8b07-1ae38b48a89c service nova] Creating event network-vif-plugged:cae8ec95-5c5e-485f-bf31-56b814395525 for instance d6e1ea07-7d87-45ab-81b9-fe8dc6544258 on n-h1-843621-1 May 27 15:26:58.892504 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-3bbbc55c-c9be-4f0f-b963-f846b412299a req-a53c34ea-5094-458d-8b07-1ae38b48a89c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075238 May 27 15:26:58.893275 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2893/5783] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:26:59.109244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-239f73ca-0a29-4cb0-9ca5-820a8ecba6f9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:59.109960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-239f73ca-0a29-4cb0-9ca5-820a8ecba6f9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:59.120516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-239f73ca-0a29-4cb0-9ca5-820a8ecba6f9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:59.130625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-239f73ca-0a29-4cb0-9ca5-820a8ecba6f9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:59.131870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-239f73ca-0a29-4cb0-9ca5-820a8ecba6f9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:59.132513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-239f73ca-0a29-4cb0-9ca5-820a8ecba6f9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:59.180898 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-239f73ca-0a29-4cb0-9ca5-820a8ecba6f9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-239f73ca-0a29-4cb0-9ca5-820a8ecba6f9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09 HTTP/1.1 May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '900d6720-34fc-4af9-bee0-76fabedb8b09'} May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:26:59.186715 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:26:59.195146 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:26:59.195146 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:59.195146 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:59.195146 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:59.195146 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:59.195146 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:59.195146 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:59.195146 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:26:59.195146 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:26:59.195146 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:26:59.195146 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:26:59.199904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-239f73ca-0a29-4cb0-9ca5-820a8ecba6f9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:26:59.201716 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-239f73ca-0a29-4cb0-9ca5-820a8ecba6f9 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "DELETE /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09" status: 404 len: 111 microversion: 2.1 time: 0.098175 May 27 15:26:59.212756 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2891/5784] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:26:59 2022] DELETE /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:26:59.225673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8f201d0b-2f6a-4190-94e2-aa4e42a4f179 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:59.245544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8f201d0b-2f6a-4190-94e2-aa4e42a4f179 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 900d6720-34fc-4af9-bee0-76fabedb8b09] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:59.267268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8f201d0b-2f6a-4190-94e2-aa4e42a4f179 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:59.269975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8f201d0b-2f6a-4190-94e2-aa4e42a4f179 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:59.279387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8f201d0b-2f6a-4190-94e2-aa4e42a4f179 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:59.280403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8f201d0b-2f6a-4190-94e2-aa4e42a4f179 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:59.309620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:59.373934 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-8f201d0b-2f6a-4190-94e2-aa4e42a4f179 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8f201d0b-2f6a-4190-94e2-aa4e42a4f179 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09 HTTP/1.1 May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '900d6720-34fc-4af9-bee0-76fabedb8b09'} May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:59.375862 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:59.383998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:59.383998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:59.383998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:59.383998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:26:59.383998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:26:59.383998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. May 27 15:26:59.383998 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:26:59.383998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8f201d0b-2f6a-4190-94e2-aa4e42a4f179 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance 900d6720-34fc-4af9-bee0-76fabedb8b09 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:26:59.385220 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8f201d0b-2f6a-4190-94e2-aa4e42a4f179 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09" status: 404 len: 111 microversion: 2.1 time: 0.160102 May 27 15:26:59.392727 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2894/5785] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:59 2022] GET /compute/v2.1/servers/900d6720-34fc-4af9-bee0-76fabedb8b09 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:26:59.394235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9c91cb2d-6bed-4689-8cb6-32bb22f52767 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:59.394753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9c91cb2d-6bed-4689-8cb6-32bb22f52767 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:59.405016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c91cb2d-6bed-4689-8cb6-32bb22f52767 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:59.405483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c91cb2d-6bed-4689-8cb6-32bb22f52767 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:59.406299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c91cb2d-6bed-4689-8cb6-32bb22f52767 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:59.410310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d788dde7-4cf9-417d-add6-47bb1751e9f5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:59.410964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d788dde7-4cf9-417d-add6-47bb1751e9f5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:59.411771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c91cb2d-6bed-4689-8cb6-32bb22f52767 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:59.425822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d788dde7-4cf9-417d-add6-47bb1751e9f5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:59.426290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d788dde7-4cf9-417d-add6-47bb1751e9f5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:59.427075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d788dde7-4cf9-417d-add6-47bb1751e9f5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:59.427519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d788dde7-4cf9-417d-add6-47bb1751e9f5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:59.504087 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9c91cb2d-6bed-4689-8cb6-32bb22f52767 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:26:59.721839 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9c91cb2d-6bed-4689-8cb6-32bb22f52767 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 204 len: 0 microversion: 2.1 time: 0.331742 May 27 15:26:59.726915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d788dde7-4cf9-417d-add6-47bb1751e9f5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:59.727640 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2892/5786] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:26:59 2022] DELETE /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:26:59.742912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-82f2769b-50e0-488c-9f02-48b198ee3ed5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:59.745335 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d788dde7-4cf9-417d-add6-47bb1751e9f5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1315 microversion: 2.1 time: 0.338597 May 27 15:26:59.745517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-82f2769b-50e0-488c-9f02-48b198ee3ed5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:59.753967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82f2769b-50e0-488c-9f02-48b198ee3ed5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:59.754785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82f2769b-50e0-488c-9f02-48b198ee3ed5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:59.755742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82f2769b-50e0-488c-9f02-48b198ee3ed5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:59.756990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82f2769b-50e0-488c-9f02-48b198ee3ed5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:59.758964 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2895/5787] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:59 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:26:59.984553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-82f2769b-50e0-488c-9f02-48b198ee3ed5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:59.994738 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-82f2769b-50e0-488c-9f02-48b198ee3ed5 tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1512 microversion: 2.1 time: 0.262776 May 27 15:26:59.996440 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2893/5788] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:26:59 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1512 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:00.776454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3fef9874-80ee-43f7-9fb5-09e7f02a3032 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:00.777617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3fef9874-80ee-43f7-9fb5-09e7f02a3032 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:00.786245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fef9874-80ee-43f7-9fb5-09e7f02a3032 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:00.799380 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fef9874-80ee-43f7-9fb5-09e7f02a3032 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:00.804321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fef9874-80ee-43f7-9fb5-09e7f02a3032 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:00.805172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fef9874-80ee-43f7-9fb5-09e7f02a3032 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:01.014549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-274658e1-7633-4fc9-8497-41dadae6e1ef tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:01.016949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-274658e1-7633-4fc9-8497-41dadae6e1ef tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:01.041738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-274658e1-7633-4fc9-8497-41dadae6e1ef tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:01.043195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-274658e1-7633-4fc9-8497-41dadae6e1ef tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:01.053967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-274658e1-7633-4fc9-8497-41dadae6e1ef tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:01.057069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-274658e1-7633-4fc9-8497-41dadae6e1ef tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:01.171431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3fef9874-80ee-43f7-9fb5-09e7f02a3032 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:01.189031 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3fef9874-80ee-43f7-9fb5-09e7f02a3032 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1315 microversion: 2.1 time: 0.409353 May 27 15:27:01.192373 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2896/5789] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:00 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:01.485662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-274658e1-7633-4fc9-8497-41dadae6e1ef tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:01.509850 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-274658e1-7633-4fc9-8497-41dadae6e1ef tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1512 microversion: 2.1 time: 0.495314 May 27 15:27:01.514187 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2894/5790] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:01 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1512 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:27:02.215160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-90a96da0-142f-429a-9476-e3d098e7bf2d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:02.216045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-90a96da0-142f-429a-9476-e3d098e7bf2d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:02.238762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90a96da0-142f-429a-9476-e3d098e7bf2d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:02.241866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90a96da0-142f-429a-9476-e3d098e7bf2d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:02.248705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90a96da0-142f-429a-9476-e3d098e7bf2d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:02.249305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90a96da0-142f-429a-9476-e3d098e7bf2d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:02.532033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a97d1136-357c-4a3d-85b9-5f7087d8434c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:02.534080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a97d1136-357c-4a3d-85b9-5f7087d8434c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:02.556439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a97d1136-357c-4a3d-85b9-5f7087d8434c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:02.558057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a97d1136-357c-4a3d-85b9-5f7087d8434c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:02.564181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a97d1136-357c-4a3d-85b9-5f7087d8434c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:02.566633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a97d1136-357c-4a3d-85b9-5f7087d8434c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:02.916868 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a97d1136-357c-4a3d-85b9-5f7087d8434c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4ce6d024ba549d494a7156a4a0ae974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b23f93ab7240e2bbfb8afe006da460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:02.934906 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a97d1136-357c-4a3d-85b9-5f7087d8434c tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 200 len: 1470 microversion: 2.1 time: 0.409973 May 27 15:27:02.963966 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2895/5791] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:02 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 1470 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:02.997083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-83c98fb3-003b-4627-ac98-78fff146b2d7 req-dbd0b4e9-1658-456d-b439-a787d65333ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3833c6b2-abd7-4b5a-8268-7582e7ee9554", "name": "network-vif-deleted", "tag": "1de1e73d-e773-469f-b8b2-df33a48f8687"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:27:03.022517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-90a96da0-142f-429a-9476-e3d098e7bf2d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:03.028265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-83c98fb3-003b-4627-ac98-78fff146b2d7 req-dbd0b4e9-1658-456d-b439-a787d65333ce service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:03.032199 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-83c98fb3-003b-4627-ac98-78fff146b2d7 req-dbd0b4e9-1658-456d-b439-a787d65333ce service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:03.034763 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-90a96da0-142f-429a-9476-e3d098e7bf2d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1502 microversion: 2.1 time: 0.823944 May 27 15:27:03.057051 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2897/5792] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:02 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1502 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:03.062220 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-83c98fb3-003b-4627-ac98-78fff146b2d7 req-dbd0b4e9-1658-456d-b439-a787d65333ce service nova] Creating event network-vif-deleted:1de1e73d-e773-469f-b8b2-df33a48f8687 for instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 on n-h2-843621-1 May 27 15:27:03.077482 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-83c98fb3-003b-4627-ac98-78fff146b2d7 req-dbd0b4e9-1658-456d-b439-a787d65333ce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099783 May 27 15:27:03.078514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9987ed60-44b7-4065-a348-6779b61bf780 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:27:03.083517 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2896/5793] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:27:03.085043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9987ed60-44b7-4065-a348-6779b61bf780 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:03.113372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9987ed60-44b7-4065-a348-6779b61bf780 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:03.115972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9987ed60-44b7-4065-a348-6779b61bf780 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:03.117292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9987ed60-44b7-4065-a348-6779b61bf780 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:03.118308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9987ed60-44b7-4065-a348-6779b61bf780 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:03.271273 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9987ed60-44b7-4065-a348-6779b61bf780 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258/action" status: 202 len: 0 microversion: 2.1 time: 0.212588 May 27 15:27:03.272988 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2898/5794] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:27:03 2022] POST /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:27:03.293208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-24598a5b-0f8f-4a49-bbf2-d8392e231e63 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:03.302235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-24598a5b-0f8f-4a49-bbf2-d8392e231e63 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:03.339549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24598a5b-0f8f-4a49-bbf2-d8392e231e63 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:03.340063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24598a5b-0f8f-4a49-bbf2-d8392e231e63 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:03.340984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24598a5b-0f8f-4a49-bbf2-d8392e231e63 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:03.344915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24598a5b-0f8f-4a49-bbf2-d8392e231e63 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:03.836407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-24598a5b-0f8f-4a49-bbf2-d8392e231e63 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:03.849019 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-24598a5b-0f8f-4a49-bbf2-d8392e231e63 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1507 microversion: 2.1 time: 0.570294 May 27 15:27:03.849628 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2897/5795] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:03 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1507 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:03.953965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-928cfcfb-8c36-435f-bb65-505d74efea5e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:03.954854 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-928cfcfb-8c36-435f-bb65-505d74efea5e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] [instance: 3833c6b2-abd7-4b5a-8268-7582e7ee9554] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:03.971594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-928cfcfb-8c36-435f-bb65-505d74efea5e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:03.974380 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-928cfcfb-8c36-435f-bb65-505d74efea5e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:03.978531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-928cfcfb-8c36-435f-bb65-505d74efea5e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:03.979018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-928cfcfb-8c36-435f-bb65-505d74efea5e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:04.035151 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-928cfcfb-8c36-435f-bb65-505d74efea5e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] HTTP exception thrown: Instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 could not be found. May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-928cfcfb-8c36-435f-bb65-505d74efea5e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Request method failure captured: May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 HTTP/1.1 May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOzYiczF3HaYh2DRQ6k-gXZwsKOKefUL0XBCWfrL1Z-asVnDJX8bu1oDtJEm2EGyLjoRnfL9gsWz8AfNDlCX6h85bNC27SOri4hORJBcaEUmjiGNLnUdZtWLuNiKn42q558SpUimzUfbBkqV1lCckektrnhAcED8d3DewBm76ub8Swc May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/63b23f93ab7240e2bbfb8afe006da460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_63b23f93ab7240e2bbfb8afe006da460", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestJSON-688572886 May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 63b23f93ab7240e2bbfb8afe006da460 May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestJSON-688572886 May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestJSON-688572886-project May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: b4ce6d024ba549d494a7156a4a0ae974 May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestJSON-688572886-project May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 could not be found. May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '3833c6b2-abd7-4b5a-8268-7582e7ee9554'} May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 could not be found. May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 could not be found. May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:04.041516 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:27:04.046229 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:04.046229 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:04.046229 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:04.046229 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:27:04.046229 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:27:04.046229 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 could not be found. May 27 15:27:04.046229 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:27:04.046229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-928cfcfb-8c36-435f-bb65-505d74efea5e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] Returning 404 to user: Instance 3833c6b2-abd7-4b5a-8268-7582e7ee9554 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:27:04.050510 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-928cfcfb-8c36-435f-bb65-505d74efea5e tempest-ServersNegativeTestJSON-688572886 tempest-ServersNegativeTestJSON-688572886-project] 10.222.0.13 "GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554" status: 404 len: 111 microversion: 2.1 time: 0.100582 May 27 15:27:04.051142 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2899/5796] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:03 2022] GET /compute/v2.1/servers/3833c6b2-abd7-4b5a-8268-7582e7ee9554 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:27:04.868259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fa1bd24a-5106-4567-8aa8-67e4618856e2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:04.869725 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fa1bd24a-5106-4567-8aa8-67e4618856e2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:04.885344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa1bd24a-5106-4567-8aa8-67e4618856e2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:04.887705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa1bd24a-5106-4567-8aa8-67e4618856e2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:04.889594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa1bd24a-5106-4567-8aa8-67e4618856e2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:04.891872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fa1bd24a-5106-4567-8aa8-67e4618856e2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:05.278463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fa1bd24a-5106-4567-8aa8-67e4618856e2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:05.337809 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fa1bd24a-5106-4567-8aa8-67e4618856e2 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1487 microversion: 2.1 time: 0.474485 May 27 15:27:05.347767 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2898/5797] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:04 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1487 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:05.366299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9c9ba962-c28d-41d7-af96-508163456e39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:27:05.367992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9c9ba962-c28d-41d7-af96-508163456e39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:05.408281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9c9ba962-c28d-41d7-af96-508163456e39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:05.409014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9c9ba962-c28d-41d7-af96-508163456e39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:05.411217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9c9ba962-c28d-41d7-af96-508163456e39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:05.411871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9c9ba962-c28d-41d7-af96-508163456e39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:05.471069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-9c9ba962-c28d-41d7-af96-508163456e39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lazy-loading 'flavor' on Instance uuid d6e1ea07-7d87-45ab-81b9-fe8dc6544258 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:27:06.149216 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9c9ba962-c28d-41d7-af96-508163456e39 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258/action" status: 202 len: 0 microversion: 2.1 time: 0.788291 May 27 15:27:06.155377 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2900/5798] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:27:05 2022] POST /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258/action => generated 0 bytes in 793 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:27:06.175609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f384a768-dbd4-48db-917e-fb9cf4f2c150 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:06.180624 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f384a768-dbd4-48db-917e-fb9cf4f2c150 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:06.200984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f384a768-dbd4-48db-917e-fb9cf4f2c150 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:06.202012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f384a768-dbd4-48db-917e-fb9cf4f2c150 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:06.203014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f384a768-dbd4-48db-917e-fb9cf4f2c150 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:06.205590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f384a768-dbd4-48db-917e-fb9cf4f2c150 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:06.408809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f384a768-dbd4-48db-917e-fb9cf4f2c150 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:06.446230 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f384a768-dbd4-48db-917e-fb9cf4f2c150 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1493 microversion: 2.1 time: 0.287103 May 27 15:27:06.447139 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2899/5799] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:06 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1493 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:07.470915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d3e7c3eb-b121-40f2-8d36-a0c7e0a2a929 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:07.472506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d3e7c3eb-b121-40f2-8d36-a0c7e0a2a929 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:07.492258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d3e7c3eb-b121-40f2-8d36-a0c7e0a2a929 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:07.499179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d3e7c3eb-b121-40f2-8d36-a0c7e0a2a929 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:07.505712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d3e7c3eb-b121-40f2-8d36-a0c7e0a2a929 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:07.507165 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d3e7c3eb-b121-40f2-8d36-a0c7e0a2a929 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:07.830769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d3e7c3eb-b121-40f2-8d36-a0c7e0a2a929 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:07.849001 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d3e7c3eb-b121-40f2-8d36-a0c7e0a2a929 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1493 microversion: 2.1 time: 0.386668 May 27 15:27:07.851908 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2901/5800] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:07 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1493 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:08.878728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b68ec367-c4ce-4210-8390-3e0c4e937857 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:08.879281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b68ec367-c4ce-4210-8390-3e0c4e937857 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:08.897918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:08.912424 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b68ec367-c4ce-4210-8390-3e0c4e937857 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:08.916109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b68ec367-c4ce-4210-8390-3e0c4e937857 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:08.924621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b68ec367-c4ce-4210-8390-3e0c4e937857 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:08.925501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b68ec367-c4ce-4210-8390-3e0c4e937857 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:09.296201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b68ec367-c4ce-4210-8390-3e0c4e937857 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:09.309518 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b68ec367-c4ce-4210-8390-3e0c4e937857 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1514 microversion: 2.1 time: 0.436061 May 27 15:27:09.314191 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2900/5801] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:08 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1514 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:10.334189 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-10a5bbf4-b66c-47de-9fda-8955fa78ee7d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:10.335911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-10a5bbf4-b66c-47de-9fda-8955fa78ee7d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:10.352737 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10a5bbf4-b66c-47de-9fda-8955fa78ee7d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:10.355890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10a5bbf4-b66c-47de-9fda-8955fa78ee7d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:10.364512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10a5bbf4-b66c-47de-9fda-8955fa78ee7d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:10.367200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10a5bbf4-b66c-47de-9fda-8955fa78ee7d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:10.719232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-10a5bbf4-b66c-47de-9fda-8955fa78ee7d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:10.740368 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-10a5bbf4-b66c-47de-9fda-8955fa78ee7d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1514 microversion: 2.1 time: 0.413052 May 27 15:27:10.741049 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2902/5802] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:10 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1514 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:11.126628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-2a95f7f2-b555-4e51-9463-f44eee927480 req-aa9121f6-9998-46b8-85da-c6a9595ebfdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e1ea07-7d87-45ab-81b9-fe8dc6544258", "name": "network-vif-plugged", "status": "completed", "tag": "cae8ec95-5c5e-485f-bf31-56b814395525"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:27:11.151014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2a95f7f2-b555-4e51-9463-f44eee927480 req-aa9121f6-9998-46b8-85da-c6a9595ebfdf service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:11.153242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2a95f7f2-b555-4e51-9463-f44eee927480 req-aa9121f6-9998-46b8-85da-c6a9595ebfdf service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:11.183842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:11.190478 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-2a95f7f2-b555-4e51-9463-f44eee927480 req-aa9121f6-9998-46b8-85da-c6a9595ebfdf service nova] Creating event network-vif-plugged:cae8ec95-5c5e-485f-bf31-56b814395525 for instance d6e1ea07-7d87-45ab-81b9-fe8dc6544258 on n-h1-843621-1 May 27 15:27:11.206840 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-2a95f7f2-b555-4e51-9463-f44eee927480 req-aa9121f6-9998-46b8-85da-c6a9595ebfdf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089666 May 27 15:27:11.207470 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2901/5803] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:27:11.758133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ac07c065-8d27-4f88-bdcb-4302c8445ff8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:11.758766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ac07c065-8d27-4f88-bdcb-4302c8445ff8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:11.769188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac07c065-8d27-4f88-bdcb-4302c8445ff8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:11.769580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac07c065-8d27-4f88-bdcb-4302c8445ff8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:11.770374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac07c065-8d27-4f88-bdcb-4302c8445ff8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:11.770824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac07c065-8d27-4f88-bdcb-4302c8445ff8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:12.167088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ac07c065-8d27-4f88-bdcb-4302c8445ff8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:12.184921 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ac07c065-8d27-4f88-bdcb-4302c8445ff8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1514 microversion: 2.1 time: 0.425269 May 27 15:27:12.185974 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2903/5804] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:11 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1514 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:13.204137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-77f0801b-7f11-4cd4-aab5-78b8695b6d2c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:13.206077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-77f0801b-7f11-4cd4-aab5-78b8695b6d2c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:13.244840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77f0801b-7f11-4cd4-aab5-78b8695b6d2c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:13.250892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77f0801b-7f11-4cd4-aab5-78b8695b6d2c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:13.252294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77f0801b-7f11-4cd4-aab5-78b8695b6d2c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:13.254847 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77f0801b-7f11-4cd4-aab5-78b8695b6d2c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:14.096707 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-77f0801b-7f11-4cd4-aab5-78b8695b6d2c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:14.109026 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-77f0801b-7f11-4cd4-aab5-78b8695b6d2c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1509 microversion: 2.1 time: 0.910196 May 27 15:27:14.114854 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2902/5805] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:13 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1509 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:15.136016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-99830158-388d-4332-ab4f-e73f3d42b66e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:15.137434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-99830158-388d-4332-ab4f-e73f3d42b66e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:15.166495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99830158-388d-4332-ab4f-e73f3d42b66e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:15.170760 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99830158-388d-4332-ab4f-e73f3d42b66e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:15.174888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99830158-388d-4332-ab4f-e73f3d42b66e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:15.179780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99830158-388d-4332-ab4f-e73f3d42b66e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:15.450999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ee75a0fc-85aa-4db7-96bf-8628e0fbd232 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1590255070", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "f99080c9-5ec0-42df-b142-2d2daf135ce8"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:27:15.686000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-ee75a0fc-85aa-4db7-96bf-8628e0fbd232 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] validate_networks() for [('f99080c9-5ec0-42df-b142-2d2daf135ce8', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:27:15.879047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-99830158-388d-4332-ab4f-e73f3d42b66e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:15.918022 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-99830158-388d-4332-ab4f-e73f3d42b66e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1509 microversion: 2.1 time: 0.786697 May 27 15:27:15.918626 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2903/5806] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:15 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1509 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:16.936970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6db097c4-39d6-4f5a-abfe-9f9bb7a4af62 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:16.937955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6db097c4-39d6-4f5a-abfe-9f9bb7a4af62 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:16.979280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6db097c4-39d6-4f5a-abfe-9f9bb7a4af62 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:16.979807 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6db097c4-39d6-4f5a-abfe-9f9bb7a4af62 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:16.980639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6db097c4-39d6-4f5a-abfe-9f9bb7a4af62 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:16.990096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6db097c4-39d6-4f5a-abfe-9f9bb7a4af62 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:17.608160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ee75a0fc-85aa-4db7-96bf-8628e0fbd232 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:27:17.609879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ee75a0fc-85aa-4db7-96bf-8628e0fbd232 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:27:17.610603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ee75a0fc-85aa-4db7-96bf-8628e0fbd232 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:27:17.611195 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ee75a0fc-85aa-4db7-96bf-8628e0fbd232 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:27:17.611805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ee75a0fc-85aa-4db7-96bf-8628e0fbd232 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:27:17.627658 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6db097c4-39d6-4f5a-abfe-9f9bb7a4af62 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:17.646524 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6db097c4-39d6-4f5a-abfe-9f9bb7a4af62 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1509 microversion: 2.1 time: 0.714408 May 27 15:27:17.647551 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2904/5807] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:16 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1509 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:17.654234 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ee75a0fc-85aa-4db7-96bf-8628e0fbd232 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:17.654782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ee75a0fc-85aa-4db7-96bf-8628e0fbd232 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:17.656088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ee75a0fc-85aa-4db7-96bf-8628e0fbd232 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:17.659202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ee75a0fc-85aa-4db7-96bf-8628e0fbd232 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:17.718404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-ee75a0fc-85aa-4db7-96bf-8628e0fbd232 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Getting quotas for project b081ca95cf17463a9f7f05ff9970f2e4. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:27:17.725658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-ee75a0fc-85aa-4db7-96bf-8628e0fbd232 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Getting quotas for user 347233fdfa5c4843a9b4d1d2b8b7fd66 and project b081ca95cf17463a9f7f05ff9970f2e4. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:27:17.755161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ee75a0fc-85aa-4db7-96bf-8628e0fbd232 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:27:17.758467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ee75a0fc-85aa-4db7-96bf-8628e0fbd232 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:27:17.899132 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ee75a0fc-85aa-4db7-96bf-8628e0fbd232 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.883806 May 27 15:27:17.908717 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2904/5808] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:27:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:27:17.910778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f4058e64-3af4-4093-8018-16a312a08c3c tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:17.911407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f4058e64-3af4-4093-8018-16a312a08c3c tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:18.126519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f4058e64-3af4-4093-8018-16a312a08c3c tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347233fdfa5c4843a9b4d1d2b8b7fd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081ca95cf17463a9f7f05ff9970f2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:18.138120 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f4058e64-3af4-4093-8018-16a312a08c3c tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] 10.222.0.13 "GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 200 len: 1228 microversion: 2.1 time: 0.229573 May 27 15:27:18.147753 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2905/5809] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:17 2022] GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 1228 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:18.664153 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bb81b19f-f659-4b83-bc02-49cd665965d5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:18.665527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bb81b19f-f659-4b83-bc02-49cd665965d5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:18.686815 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb81b19f-f659-4b83-bc02-49cd665965d5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:18.687606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb81b19f-f659-4b83-bc02-49cd665965d5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:18.689311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb81b19f-f659-4b83-bc02-49cd665965d5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:18.690008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb81b19f-f659-4b83-bc02-49cd665965d5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:19.092201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bb81b19f-f659-4b83-bc02-49cd665965d5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:19.113062 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bb81b19f-f659-4b83-bc02-49cd665965d5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1509 microversion: 2.1 time: 0.452855 May 27 15:27:19.129503 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2905/5810] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:18 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1509 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:19.139962 n-d-843621-1 devstack@n-api.service[119249]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:27:19.140380 n-d-843621-1 devstack@n-api.service[119249]: Fri May 27 15:27:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:27:19.155419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b7fbb986-df45-4434-a500-7d179c4a252c tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:19.156730 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b7fbb986-df45-4434-a500-7d179c4a252c tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:19.267505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b7fbb986-df45-4434-a500-7d179c4a252c tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347233fdfa5c4843a9b4d1d2b8b7fd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081ca95cf17463a9f7f05ff9970f2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:19.276015 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b7fbb986-df45-4434-a500-7d179c4a252c tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] 10.222.0.13 "GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 200 len: 1228 microversion: 2.1 time: 0.124467 May 27 15:27:19.277511 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2906/5811] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:19 2022] GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 1228 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:20.135563 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f0c28fee-a870-40f3-851b-fae4434c3b22 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:20.137017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f0c28fee-a870-40f3-851b-fae4434c3b22 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:20.165483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0c28fee-a870-40f3-851b-fae4434c3b22 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:20.165483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0c28fee-a870-40f3-851b-fae4434c3b22 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:20.165483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0c28fee-a870-40f3-851b-fae4434c3b22 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:20.165483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0c28fee-a870-40f3-851b-fae4434c3b22 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:20.300075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7f5320c7-a302-4b02-98bf-c73815a07d90 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:20.302282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7f5320c7-a302-4b02-98bf-c73815a07d90 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:20.326179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f5320c7-a302-4b02-98bf-c73815a07d90 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:20.331417 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f5320c7-a302-4b02-98bf-c73815a07d90 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:20.341302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f5320c7-a302-4b02-98bf-c73815a07d90 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:20.348742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f5320c7-a302-4b02-98bf-c73815a07d90 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:21.275808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7f5320c7-a302-4b02-98bf-c73815a07d90 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347233fdfa5c4843a9b4d1d2b8b7fd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081ca95cf17463a9f7f05ff9970f2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:21.289753 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7f5320c7-a302-4b02-98bf-c73815a07d90 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] 10.222.0.13 "GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 200 len: 1288 microversion: 2.1 time: 0.993522 May 27 15:27:21.302882 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2907/5812] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:20 2022] GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 1288 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:21.328568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f0c28fee-a870-40f3-851b-fae4434c3b22 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:21.337364 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f0c28fee-a870-40f3-851b-fae4434c3b22 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1509 microversion: 2.1 time: 1.205755 May 27 15:27:21.337803 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2906/5813] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:20 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1509 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:22.307670 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3fe691eb-5e50-4022-b968-c737553fc399 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:22.309178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3fe691eb-5e50-4022-b968-c737553fc399 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:22.321308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3fe691eb-5e50-4022-b968-c737553fc399 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:22.336805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3fe691eb-5e50-4022-b968-c737553fc399 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:22.338196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3fe691eb-5e50-4022-b968-c737553fc399 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:22.338977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3fe691eb-5e50-4022-b968-c737553fc399 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:22.354233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7da1e135-dc4b-4b45-aece-2cde19c46c9a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:22.355509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7da1e135-dc4b-4b45-aece-2cde19c46c9a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:22.373712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7da1e135-dc4b-4b45-aece-2cde19c46c9a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:22.382246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7da1e135-dc4b-4b45-aece-2cde19c46c9a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:22.385709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7da1e135-dc4b-4b45-aece-2cde19c46c9a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:22.392975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7da1e135-dc4b-4b45-aece-2cde19c46c9a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:23.297398 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7da1e135-dc4b-4b45-aece-2cde19c46c9a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:23.306824 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7da1e135-dc4b-4b45-aece-2cde19c46c9a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1509 microversion: 2.1 time: 0.957633 May 27 15:27:23.307627 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2907/5814] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:22 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1509 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:27:23.523184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3fe691eb-5e50-4022-b968-c737553fc399 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347233fdfa5c4843a9b4d1d2b8b7fd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081ca95cf17463a9f7f05ff9970f2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:23.536217 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3fe691eb-5e50-4022-b968-c737553fc399 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] 10.222.0.13 "GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 200 len: 1328 microversion: 2.1 time: 1.232252 May 27 15:27:23.537210 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2908/5815] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:22 2022] GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 1328 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:24.327717 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-57482981-2850-4e07-97ef-c36ce509b5cb tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:24.328354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-57482981-2850-4e07-97ef-c36ce509b5cb tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:24.331887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:24.358621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57482981-2850-4e07-97ef-c36ce509b5cb tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:24.377753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57482981-2850-4e07-97ef-c36ce509b5cb tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:24.378799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57482981-2850-4e07-97ef-c36ce509b5cb tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:24.379286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57482981-2850-4e07-97ef-c36ce509b5cb tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:24.557572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-642bf005-2f9c-4132-a02b-3b42ce9b2f1b tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:24.557572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-642bf005-2f9c-4132-a02b-3b42ce9b2f1b tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:24.598936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-642bf005-2f9c-4132-a02b-3b42ce9b2f1b tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:24.601663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-642bf005-2f9c-4132-a02b-3b42ce9b2f1b tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:24.604292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-642bf005-2f9c-4132-a02b-3b42ce9b2f1b tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:24.615512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-642bf005-2f9c-4132-a02b-3b42ce9b2f1b tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:25.914788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-57482981-2850-4e07-97ef-c36ce509b5cb tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:25.949899 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-57482981-2850-4e07-97ef-c36ce509b5cb tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1509 microversion: 2.1 time: 1.620794 May 27 15:27:25.952665 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2908/5816] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:24 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1509 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:26.439981 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-642bf005-2f9c-4132-a02b-3b42ce9b2f1b tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347233fdfa5c4843a9b4d1d2b8b7fd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081ca95cf17463a9f7f05ff9970f2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:26.464513 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-642bf005-2f9c-4132-a02b-3b42ce9b2f1b tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] 10.222.0.13 "GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 200 len: 1328 microversion: 2.1 time: 1.898262 May 27 15:27:26.479325 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2909/5817] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:24 2022] GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 1328 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:26.968345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3a785479-3b7c-4e2d-92c7-6c62a1b6614a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:26.969194 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3a785479-3b7c-4e2d-92c7-6c62a1b6614a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:26.984404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a785479-3b7c-4e2d-92c7-6c62a1b6614a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:26.984910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a785479-3b7c-4e2d-92c7-6c62a1b6614a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:26.985752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a785479-3b7c-4e2d-92c7-6c62a1b6614a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:26.986204 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a785479-3b7c-4e2d-92c7-6c62a1b6614a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:27.485119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-720ad303-9dd8-4bd1-8d26-414264020f0e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:27.487044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-720ad303-9dd8-4bd1-8d26-414264020f0e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:27.499343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-720ad303-9dd8-4bd1-8d26-414264020f0e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:27.504336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-720ad303-9dd8-4bd1-8d26-414264020f0e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:27.505669 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-720ad303-9dd8-4bd1-8d26-414264020f0e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:27.508663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-720ad303-9dd8-4bd1-8d26-414264020f0e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:27.564574 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3a785479-3b7c-4e2d-92c7-6c62a1b6614a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:27.566980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:27.595175 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3a785479-3b7c-4e2d-92c7-6c62a1b6614a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1509 microversion: 2.1 time: 0.630525 May 27 15:27:27.599068 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2909/5818] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:26 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1509 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:27.614460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-4532a1da-d526-45be-95ee-2fb1b6142842 req-47e7f880-6354-41cf-bcef-d9c0a05313a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00e7ba77-6e64-469a-b277-37efba73e8a4", "tag": "8caf3579-3318-43f7-9361-438c9cb06e9b"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:27:27.651174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4532a1da-d526-45be-95ee-2fb1b6142842 req-47e7f880-6354-41cf-bcef-d9c0a05313a7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:27.656214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4532a1da-d526-45be-95ee-2fb1b6142842 req-47e7f880-6354-41cf-bcef-d9c0a05313a7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:27.673709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:27.715949 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-4532a1da-d526-45be-95ee-2fb1b6142842 req-47e7f880-6354-41cf-bcef-d9c0a05313a7 service nova] Creating event network-changed:8caf3579-3318-43f7-9361-438c9cb06e9b for instance 00e7ba77-6e64-469a-b277-37efba73e8a4 on n-h2-843621-1 May 27 15:27:27.735108 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-4532a1da-d526-45be-95ee-2fb1b6142842 req-47e7f880-6354-41cf-bcef-d9c0a05313a7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127058 May 27 15:27:27.741768 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2910/5819] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:27:28.379936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-720ad303-9dd8-4bd1-8d26-414264020f0e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347233fdfa5c4843a9b4d1d2b8b7fd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081ca95cf17463a9f7f05ff9970f2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:28.406688 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-720ad303-9dd8-4bd1-8d26-414264020f0e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] 10.222.0.13 "GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 200 len: 1328 microversion: 2.1 time: 0.925881 May 27 15:27:28.418147 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2910/5820] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:27 2022] GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 1328 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:27:28.624287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b07a0241-b785-4b32-9dae-74a9ffaa4a89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:28.626768 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b07a0241-b785-4b32-9dae-74a9ffaa4a89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:28.647635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:28.657361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b07a0241-b785-4b32-9dae-74a9ffaa4a89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:28.661045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b07a0241-b785-4b32-9dae-74a9ffaa4a89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:28.663431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b07a0241-b785-4b32-9dae-74a9ffaa4a89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:28.664200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b07a0241-b785-4b32-9dae-74a9ffaa4a89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:29.370694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b07a0241-b785-4b32-9dae-74a9ffaa4a89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:29.402672 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b07a0241-b785-4b32-9dae-74a9ffaa4a89 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1509 microversion: 2.1 time: 0.791964 May 27 15:27:29.408222 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2911/5821] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:28 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1509 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:29.441215 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-85e0bee6-bb7f-40ba-abee-a117465ede65 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:29.442935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-85e0bee6-bb7f-40ba-abee-a117465ede65 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:29.455582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:29.505780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85e0bee6-bb7f-40ba-abee-a117465ede65 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:29.512179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85e0bee6-bb7f-40ba-abee-a117465ede65 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:29.517200 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85e0bee6-bb7f-40ba-abee-a117465ede65 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:29.522058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85e0bee6-bb7f-40ba-abee-a117465ede65 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:30.069150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-85e0bee6-bb7f-40ba-abee-a117465ede65 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347233fdfa5c4843a9b4d1d2b8b7fd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081ca95cf17463a9f7f05ff9970f2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:30.087422 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-85e0bee6-bb7f-40ba-abee-a117465ede65 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] 10.222.0.13 "GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 200 len: 1328 microversion: 2.1 time: 0.656692 May 27 15:27:30.100377 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2911/5822] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:29 2022] GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 1328 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:30.427022 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f167ad19-4b39-477b-bbbf-6f1c9f46526a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:30.427764 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f167ad19-4b39-477b-bbbf-6f1c9f46526a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:30.439732 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f167ad19-4b39-477b-bbbf-6f1c9f46526a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:30.449971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f167ad19-4b39-477b-bbbf-6f1c9f46526a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:30.454381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f167ad19-4b39-477b-bbbf-6f1c9f46526a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:30.455973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f167ad19-4b39-477b-bbbf-6f1c9f46526a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:31.107898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-da937852-032d-478f-8c67-3b6799a94a4f tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:31.109403 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-da937852-032d-478f-8c67-3b6799a94a4f tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:31.147623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da937852-032d-478f-8c67-3b6799a94a4f tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:31.148743 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da937852-032d-478f-8c67-3b6799a94a4f tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:31.154465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da937852-032d-478f-8c67-3b6799a94a4f tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:31.155640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-da937852-032d-478f-8c67-3b6799a94a4f tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:31.758767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f167ad19-4b39-477b-bbbf-6f1c9f46526a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:31.778256 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f167ad19-4b39-477b-bbbf-6f1c9f46526a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1509 microversion: 2.1 time: 1.358691 May 27 15:27:31.780525 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2912/5823] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:30 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1509 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:32.159799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-da937852-032d-478f-8c67-3b6799a94a4f tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347233fdfa5c4843a9b4d1d2b8b7fd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081ca95cf17463a9f7f05ff9970f2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:32.178691 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-da937852-032d-478f-8c67-3b6799a94a4f tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] 10.222.0.13 "GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 200 len: 1328 microversion: 2.1 time: 1.074847 May 27 15:27:32.188348 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2912/5824] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:31 2022] GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 1328 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:27:32.798024 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a7a9e8fd-76ca-4ffb-98f0-ad6bbf67dad1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:32.798731 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a7a9e8fd-76ca-4ffb-98f0-ad6bbf67dad1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:32.824432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a7a9e8fd-76ca-4ffb-98f0-ad6bbf67dad1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:32.829696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a7a9e8fd-76ca-4ffb-98f0-ad6bbf67dad1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:32.830587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a7a9e8fd-76ca-4ffb-98f0-ad6bbf67dad1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:32.843128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a7a9e8fd-76ca-4ffb-98f0-ad6bbf67dad1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:33.188809 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a7a9e8fd-76ca-4ffb-98f0-ad6bbf67dad1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:33.199299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b8c59103-b4a8-4617-9f08-d4040e9cad3c tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:33.203810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b8c59103-b4a8-4617-9f08-d4040e9cad3c tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:33.217601 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a7a9e8fd-76ca-4ffb-98f0-ad6bbf67dad1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1509 microversion: 2.1 time: 0.424758 May 27 15:27:33.223599 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b8c59103-b4a8-4617-9f08-d4040e9cad3c tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:33.225083 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2913/5825] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:32 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1509 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:33.229460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b8c59103-b4a8-4617-9f08-d4040e9cad3c tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:33.230568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b8c59103-b4a8-4617-9f08-d4040e9cad3c tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:33.231198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b8c59103-b4a8-4617-9f08-d4040e9cad3c tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:33.689614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b8c59103-b4a8-4617-9f08-d4040e9cad3c tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347233fdfa5c4843a9b4d1d2b8b7fd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081ca95cf17463a9f7f05ff9970f2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:33.700487 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b8c59103-b4a8-4617-9f08-d4040e9cad3c tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] 10.222.0.13 "GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 200 len: 1328 microversion: 2.1 time: 0.505221 May 27 15:27:33.701804 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2913/5826] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:33 2022] GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 1328 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:34.243353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ca00bfb4-11cf-4ec6-858b-6943c62e4053 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:34.244350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ca00bfb4-11cf-4ec6-858b-6943c62e4053 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:34.258719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ca00bfb4-11cf-4ec6-858b-6943c62e4053 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:34.259179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ca00bfb4-11cf-4ec6-858b-6943c62e4053 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:34.259968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ca00bfb4-11cf-4ec6-858b-6943c62e4053 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:34.260414 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ca00bfb4-11cf-4ec6-858b-6943c62e4053 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:34.718298 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c993b493-ad78-435a-9f9f-49d7e67d40bd tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:34.720511 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c993b493-ad78-435a-9f9f-49d7e67d40bd tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:34.736385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c993b493-ad78-435a-9f9f-49d7e67d40bd tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:34.746817 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c993b493-ad78-435a-9f9f-49d7e67d40bd tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:34.755250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c993b493-ad78-435a-9f9f-49d7e67d40bd tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:34.756079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c993b493-ad78-435a-9f9f-49d7e67d40bd tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:34.859797 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ca00bfb4-11cf-4ec6-858b-6943c62e4053 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:34.867587 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ca00bfb4-11cf-4ec6-858b-6943c62e4053 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1509 microversion: 2.1 time: 0.628958 May 27 15:27:34.868181 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2914/5827] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:34 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1509 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:34.952774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-66031e65-31cc-4a4c-93d2-a7cb17bf6644 req-9fdcf39c-9928-4fb5-a695-a668f8155f27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00e7ba77-6e64-469a-b277-37efba73e8a4", "name": "network-vif-plugged", "status": "completed", "tag": "8caf3579-3318-43f7-9361-438c9cb06e9b"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:27:34.983308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-66031e65-31cc-4a4c-93d2-a7cb17bf6644 req-9fdcf39c-9928-4fb5-a695-a668f8155f27 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:34.985203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-66031e65-31cc-4a4c-93d2-a7cb17bf6644 req-9fdcf39c-9928-4fb5-a695-a668f8155f27 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:35.022731 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-66031e65-31cc-4a4c-93d2-a7cb17bf6644 req-9fdcf39c-9928-4fb5-a695-a668f8155f27 service nova] Creating event network-vif-plugged:8caf3579-3318-43f7-9361-438c9cb06e9b for instance 00e7ba77-6e64-469a-b277-37efba73e8a4 on n-h2-843621-1 May 27 15:27:35.033876 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-66031e65-31cc-4a4c-93d2-a7cb17bf6644 req-9fdcf39c-9928-4fb5-a695-a668f8155f27 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086324 May 27 15:27:35.051936 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2915/5828] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:27:35.176517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c993b493-ad78-435a-9f9f-49d7e67d40bd tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347233fdfa5c4843a9b4d1d2b8b7fd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081ca95cf17463a9f7f05ff9970f2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:35.185858 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c993b493-ad78-435a-9f9f-49d7e67d40bd tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] 10.222.0.13 "GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 200 len: 1328 microversion: 2.1 time: 0.471684 May 27 15:27:35.194706 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2914/5829] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:34 2022] GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 1328 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:35.885360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-28ac6985-73ee-4266-a0e9-9da597fba053 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:35.886706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-28ac6985-73ee-4266-a0e9-9da597fba053 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:35.909037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-28ac6985-73ee-4266-a0e9-9da597fba053 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:35.909906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-28ac6985-73ee-4266-a0e9-9da597fba053 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:35.910936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-28ac6985-73ee-4266-a0e9-9da597fba053 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:35.911706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-28ac6985-73ee-4266-a0e9-9da597fba053 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:36.211380 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2756809b-947a-4072-99e9-a1772cf603bb tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:36.229733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2756809b-947a-4072-99e9-a1772cf603bb tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:36.246141 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2756809b-947a-4072-99e9-a1772cf603bb tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:36.250895 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2756809b-947a-4072-99e9-a1772cf603bb tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:36.254260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2756809b-947a-4072-99e9-a1772cf603bb tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:36.255972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2756809b-947a-4072-99e9-a1772cf603bb tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:36.258144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-28ac6985-73ee-4266-a0e9-9da597fba053 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:36.271517 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-28ac6985-73ee-4266-a0e9-9da597fba053 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1509 microversion: 2.1 time: 0.385406 May 27 15:27:36.279527 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2916/5830] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:35 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1509 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:36.643216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2756809b-947a-4072-99e9-a1772cf603bb tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347233fdfa5c4843a9b4d1d2b8b7fd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081ca95cf17463a9f7f05ff9970f2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:36.651408 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2756809b-947a-4072-99e9-a1772cf603bb tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] 10.222.0.13 "GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 200 len: 1328 microversion: 2.1 time: 0.444429 May 27 15:27:36.658423 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2915/5831] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:36 2022] GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 1328 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:37.297007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-add0b553-f5ea-4229-a117-f1dd95cb5cc9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:37.302923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-add0b553-f5ea-4229-a117-f1dd95cb5cc9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:37.324010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-add0b553-f5ea-4229-a117-f1dd95cb5cc9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:37.324912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-add0b553-f5ea-4229-a117-f1dd95cb5cc9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:37.328615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-add0b553-f5ea-4229-a117-f1dd95cb5cc9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:37.329391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-add0b553-f5ea-4229-a117-f1dd95cb5cc9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:37.674937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d5e39933-e707-44df-9c01-e28a40c61a4b tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:37.675560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d5e39933-e707-44df-9c01-e28a40c61a4b tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:37.688769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5e39933-e707-44df-9c01-e28a40c61a4b tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:37.689239 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5e39933-e707-44df-9c01-e28a40c61a4b tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:37.690051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5e39933-e707-44df-9c01-e28a40c61a4b tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:37.690498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d5e39933-e707-44df-9c01-e28a40c61a4b tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:38.167531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d5e39933-e707-44df-9c01-e28a40c61a4b tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347233fdfa5c4843a9b4d1d2b8b7fd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081ca95cf17463a9f7f05ff9970f2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:38.184725 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d5e39933-e707-44df-9c01-e28a40c61a4b tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] 10.222.0.13 "GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 200 len: 1528 microversion: 2.1 time: 0.514025 May 27 15:27:38.188583 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2916/5832] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:37 2022] GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 1528 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:38.208177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b5140da8-5aae-4fd8-acbe-b2f1b80d006e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:38.209345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b5140da8-5aae-4fd8-acbe-b2f1b80d006e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:38.225056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5140da8-5aae-4fd8-acbe-b2f1b80d006e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:38.225844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5140da8-5aae-4fd8-acbe-b2f1b80d006e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:38.230019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5140da8-5aae-4fd8-acbe-b2f1b80d006e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:38.230750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5140da8-5aae-4fd8-acbe-b2f1b80d006e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:38.759400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-add0b553-f5ea-4229-a117-f1dd95cb5cc9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:38.773182 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-add0b553-f5ea-4229-a117-f1dd95cb5cc9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1509 microversion: 2.1 time: 1.482177 May 27 15:27:38.782712 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2917/5833] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:37 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1509 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:39.010616 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b5140da8-5aae-4fd8-acbe-b2f1b80d006e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347233fdfa5c4843a9b4d1d2b8b7fd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081ca95cf17463a9f7f05ff9970f2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:39.022328 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b5140da8-5aae-4fd8-acbe-b2f1b80d006e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] 10.222.0.13 "GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 200 len: 1528 microversion: 2.1 time: 0.820216 May 27 15:27:39.022940 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2917/5834] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:38 2022] GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 1528 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:27:39.429002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e430f5a2-338f-4ec0-a8e2-f90c63f35426 tempest-ServersNegativeTestMultiTenantJSON-19464458 tempest-ServersNegativeTestMultiTenantJSON-19464458-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:39.429450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e430f5a2-338f-4ec0-a8e2-f90c63f35426 tempest-ServersNegativeTestMultiTenantJSON-19464458 tempest-ServersNegativeTestMultiTenantJSON-19464458-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:39.440766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e430f5a2-338f-4ec0-a8e2-f90c63f35426 tempest-ServersNegativeTestMultiTenantJSON-19464458 tempest-ServersNegativeTestMultiTenantJSON-19464458-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:39.441539 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e430f5a2-338f-4ec0-a8e2-f90c63f35426 tempest-ServersNegativeTestMultiTenantJSON-19464458 tempest-ServersNegativeTestMultiTenantJSON-19464458-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:39.442573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e430f5a2-338f-4ec0-a8e2-f90c63f35426 tempest-ServersNegativeTestMultiTenantJSON-19464458 tempest-ServersNegativeTestMultiTenantJSON-19464458-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:39.443215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e430f5a2-338f-4ec0-a8e2-f90c63f35426 tempest-ServersNegativeTestMultiTenantJSON-19464458 tempest-ServersNegativeTestMultiTenantJSON-19464458-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:39.460518 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-e430f5a2-338f-4ec0-a8e2-f90c63f35426 tempest-ServersNegativeTestMultiTenantJSON-19464458 tempest-ServersNegativeTestMultiTenantJSON-19464458-project] HTTP exception thrown: Instance 00e7ba77-6e64-469a-b277-37efba73e8a4 could not be found. May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e430f5a2-338f-4ec0-a8e2-f90c63f35426 tempest-ServersNegativeTestMultiTenantJSON-19464458 tempest-ServersNegativeTestMultiTenantJSON-19464458-project] Request method failure captured: May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 HTTP/1.1 May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikO3SiraDCmawHRG4ZTLAXvBjol1SKiKZlb7laCfgdMzBUs5tWAhCqaZ31WY4vhosI-u0v8IkJwdZhUlE6qCHqJgaCw1ObVCi-5Jp_Ld4tbHhUCsxv5B54g5jViYU6BAvxvsQndIrq4ry5S4RUfmlXt8ylFgNZJrPAJO7D6Q4dK0VFkg May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: b4dd8c7dcd5f4b349c458571c8339357 May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-19464458 May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b4dd8c7dcd5f4b349c458571c8339357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b4dd8c7dcd5f4b349c458571c8339357"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b4dd8c7dcd5f4b349c458571c8339357"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b4dd8c7dcd5f4b349c458571c8339357", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-19464458 May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: b4dd8c7dcd5f4b349c458571c8339357 May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-19464458 May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersNegativeTestMultiTenantJSON-19464458-project May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: e1eda06be4934643bcf156d114f2ce93 May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-19464458-project May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 00e7ba77-6e64-469a-b277-37efba73e8a4 could not be found. May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '00e7ba77-6e64-469a-b277-37efba73e8a4'} May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00e7ba77-6e64-469a-b277-37efba73e8a4 could not be found. May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:27:39.462608 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:27:39.467663 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00e7ba77-6e64-469a-b277-37efba73e8a4 could not be found. May 27 15:27:39.467663 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:27:39.467663 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:39.467663 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:27:39.467663 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:39.467663 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:39.467663 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:39.467663 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:27:39.467663 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:27:39.467663 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00e7ba77-6e64-469a-b277-37efba73e8a4 could not be found. May 27 15:27:39.467663 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:27:39.473364 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e430f5a2-338f-4ec0-a8e2-f90c63f35426 tempest-ServersNegativeTestMultiTenantJSON-19464458 tempest-ServersNegativeTestMultiTenantJSON-19464458-project] Returning 404 to user: Instance 00e7ba77-6e64-469a-b277-37efba73e8a4 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:27:39.474468 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e430f5a2-338f-4ec0-a8e2-f90c63f35426 tempest-ServersNegativeTestMultiTenantJSON-19464458 tempest-ServersNegativeTestMultiTenantJSON-19464458-project] 10.222.0.13 "DELETE /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 404 len: 111 microversion: 2.1 time: 0.438417 May 27 15:27:39.481547 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2918/5835] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:27:39 2022] DELETE /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 111 bytes in 446 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:27:39.486858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1f76da51-9073-4140-9720-7680dc88cfcb tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:39.488273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1f76da51-9073-4140-9720-7680dc88cfcb tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:39.490511 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=40 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:39.497769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f76da51-9073-4140-9720-7680dc88cfcb tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:39.509522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f76da51-9073-4140-9720-7680dc88cfcb tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:39.513778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f76da51-9073-4140-9720-7680dc88cfcb tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:39.513986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f76da51-9073-4140-9720-7680dc88cfcb tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:39.791413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7ff037e4-f457-4112-a0e2-496b89233b02 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:39.792173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7ff037e4-f457-4112-a0e2-496b89233b02 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:39.810162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ff037e4-f457-4112-a0e2-496b89233b02 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:39.814905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ff037e4-f457-4112-a0e2-496b89233b02 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:39.815979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ff037e4-f457-4112-a0e2-496b89233b02 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:39.816498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7ff037e4-f457-4112-a0e2-496b89233b02 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:40.009505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1f76da51-9073-4140-9720-7680dc88cfcb tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347233fdfa5c4843a9b4d1d2b8b7fd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081ca95cf17463a9f7f05ff9970f2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:40.025366 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1f76da51-9073-4140-9720-7680dc88cfcb tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] 10.222.0.13 "GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 200 len: 1528 microversion: 2.1 time: 0.542730 May 27 15:27:40.027092 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2918/5836] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:39 2022] GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 1528 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:40.058958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6d9d7656-8211-40c7-910a-ca767b85bf94 tempest-ServersNegativeTestMultiTenantJSON-19464458 tempest-ServersNegativeTestMultiTenantJSON-19464458-project] Action: 'update', calling method: >, body: {"server": {"name": "00e7ba77-6e64-469a-b277-37efba73e8a4_new"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:27:40.060920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6d9d7656-8211-40c7-910a-ca767b85bf94 tempest-ServersNegativeTestMultiTenantJSON-19464458 tempest-ServersNegativeTestMultiTenantJSON-19464458-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:40.078079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d9d7656-8211-40c7-910a-ca767b85bf94 tempest-ServersNegativeTestMultiTenantJSON-19464458 tempest-ServersNegativeTestMultiTenantJSON-19464458-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:40.081588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d9d7656-8211-40c7-910a-ca767b85bf94 tempest-ServersNegativeTestMultiTenantJSON-19464458 tempest-ServersNegativeTestMultiTenantJSON-19464458-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:40.084821 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d9d7656-8211-40c7-910a-ca767b85bf94 tempest-ServersNegativeTestMultiTenantJSON-19464458 tempest-ServersNegativeTestMultiTenantJSON-19464458-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:40.085635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d9d7656-8211-40c7-910a-ca767b85bf94 tempest-ServersNegativeTestMultiTenantJSON-19464458 tempest-ServersNegativeTestMultiTenantJSON-19464458-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:40.146744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7ff037e4-f457-4112-a0e2-496b89233b02 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:40.156175 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7ff037e4-f457-4112-a0e2-496b89233b02 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1509 microversion: 2.1 time: 0.369600 May 27 15:27:40.159444 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2919/5837] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:39 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1509 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:27:40.165074 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-6d9d7656-8211-40c7-910a-ca767b85bf94 tempest-ServersNegativeTestMultiTenantJSON-19464458 tempest-ServersNegativeTestMultiTenantJSON-19464458-project] HTTP exception thrown: Instance 00e7ba77-6e64-469a-b277-37efba73e8a4 could not be found. May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6d9d7656-8211-40c7-910a-ca767b85bf94 tempest-ServersNegativeTestMultiTenantJSON-19464458 tempest-ServersNegativeTestMultiTenantJSON-19464458-project] Request method failure captured: May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: request: PUT /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 HTTP/1.1 May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 64 May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikO3SiraDCmawHRG4ZTLAXvBjol1SKiKZlb7laCfgdMzBUs5tWAhCqaZ31WY4vhosI-u0v8IkJwdZhUlE6qCHqJgaCw1ObVCi-5Jp_Ld4tbHhUCsxv5B54g5jViYU6BAvxvsQndIrq4ry5S4RUfmlXt8ylFgNZJrPAJO7D6Q4dK0VFkg May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: b4dd8c7dcd5f4b349c458571c8339357 May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-19464458 May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b4dd8c7dcd5f4b349c458571c8339357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b4dd8c7dcd5f4b349c458571c8339357"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b4dd8c7dcd5f4b349c458571c8339357"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b4dd8c7dcd5f4b349c458571c8339357", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-19464458 May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: b4dd8c7dcd5f4b349c458571c8339357 May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-19464458 May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestMultiTenantJSON-19464458-project May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: e1eda06be4934643bcf156d114f2ce93 May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-19464458-project May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: {"server": {"name": "00e7ba77-6e64-469a-b277-37efba73e8a4_new"}} May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 00e7ba77-6e64-469a-b277-37efba73e8a4 could not be found. May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '00e7ba77-6e64-469a-b277-37efba73e8a4', 'body': {'server': {'name': '00e7ba77-6e64-469a-b277-37efba73e8a4_new'}}} May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00e7ba77-6e64-469a-b277-37efba73e8a4 could not be found. May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 27 15:27:40.177487 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update May 27 15:27:40.186110 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) May 27 15:27:40.186110 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:27:40.186110 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:27:40.186110 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:27:40.186110 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:27:40.186110 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00e7ba77-6e64-469a-b277-37efba73e8a4 could not be found. May 27 15:27:40.186110 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:27:40.186110 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:40.186110 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:27:40.186110 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:40.186110 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:40.186110 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:40.186110 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:27:40.186110 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:27:40.186110 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00e7ba77-6e64-469a-b277-37efba73e8a4 could not be found. May 27 15:27:40.186110 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:27:40.188793 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6d9d7656-8211-40c7-910a-ca767b85bf94 tempest-ServersNegativeTestMultiTenantJSON-19464458 tempest-ServersNegativeTestMultiTenantJSON-19464458-project] Returning 404 to user: Instance 00e7ba77-6e64-469a-b277-37efba73e8a4 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:27:40.190069 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6d9d7656-8211-40c7-910a-ca767b85bf94 tempest-ServersNegativeTestMultiTenantJSON-19464458 tempest-ServersNegativeTestMultiTenantJSON-19464458-project] 10.222.0.13 "PUT /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 404 len: 111 microversion: 2.1 time: 0.150913 May 27 15:27:40.197685 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2919/5838] 10.222.0.13 () {60 vars in 1255 bytes} [Fri May 27 15:27:40 2022] PUT /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:27:40.210763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-85ad9576-5fbc-4257-96e7-fdd117bae26f tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:40.219149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-85ad9576-5fbc-4257-96e7-fdd117bae26f tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:40.242641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85ad9576-5fbc-4257-96e7-fdd117bae26f tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:40.245081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85ad9576-5fbc-4257-96e7-fdd117bae26f tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:40.246165 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85ad9576-5fbc-4257-96e7-fdd117bae26f tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:40.248267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-85ad9576-5fbc-4257-96e7-fdd117bae26f tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:40.364002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-85ad9576-5fbc-4257-96e7-fdd117bae26f tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:27:40.671962 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-85ad9576-5fbc-4257-96e7-fdd117bae26f tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] 10.222.0.13 "DELETE /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 204 len: 0 microversion: 2.1 time: 0.468358 May 27 15:27:40.685731 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2920/5839] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:27:40 2022] DELETE /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:27:40.697304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c21c19ea-da46-46c1-9266-9a5e396a8249 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:40.697944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c21c19ea-da46-46c1-9266-9a5e396a8249 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:40.706005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c21c19ea-da46-46c1-9266-9a5e396a8249 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:40.706469 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c21c19ea-da46-46c1-9266-9a5e396a8249 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:40.707272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c21c19ea-da46-46c1-9266-9a5e396a8249 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:40.707726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c21c19ea-da46-46c1-9266-9a5e396a8249 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:40.883155 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c21c19ea-da46-46c1-9266-9a5e396a8249 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347233fdfa5c4843a9b4d1d2b8b7fd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081ca95cf17463a9f7f05ff9970f2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:40.901066 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c21c19ea-da46-46c1-9266-9a5e396a8249 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] 10.222.0.13 "GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 200 len: 1534 microversion: 2.1 time: 0.211118 May 27 15:27:40.904267 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2920/5840] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:40 2022] GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 1534 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:41.187485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-691359a2-474a-4f95-8824-d704c2eac221 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:41.189405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-691359a2-474a-4f95-8824-d704c2eac221 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:41.203500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-691359a2-474a-4f95-8824-d704c2eac221 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:41.204862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-691359a2-474a-4f95-8824-d704c2eac221 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:41.206026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-691359a2-474a-4f95-8824-d704c2eac221 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:41.209817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-691359a2-474a-4f95-8824-d704c2eac221 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:41.654770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-691359a2-474a-4f95-8824-d704c2eac221 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:41.673798 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-691359a2-474a-4f95-8824-d704c2eac221 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1509 microversion: 2.1 time: 0.491948 May 27 15:27:41.683284 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2921/5841] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:41 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1509 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:41.921912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bfad4608-2ce4-4e05-b548-711e4554c37e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:41.923007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bfad4608-2ce4-4e05-b548-711e4554c37e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:41.942172 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bfad4608-2ce4-4e05-b548-711e4554c37e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:41.944101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bfad4608-2ce4-4e05-b548-711e4554c37e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:41.944969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bfad4608-2ce4-4e05-b548-711e4554c37e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:41.951136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bfad4608-2ce4-4e05-b548-711e4554c37e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:42.038062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:42.510293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bfad4608-2ce4-4e05-b548-711e4554c37e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347233fdfa5c4843a9b4d1d2b8b7fd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081ca95cf17463a9f7f05ff9970f2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:42.524878 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bfad4608-2ce4-4e05-b548-711e4554c37e tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] 10.222.0.13 "GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 200 len: 1534 microversion: 2.1 time: 0.604255 May 27 15:27:42.526096 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2921/5842] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:41 2022] GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 1534 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:42.691421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b211d419-c477-462b-9557-b6ace211dc4c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:42.692040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b211d419-c477-462b-9557-b6ace211dc4c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:42.733912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b211d419-c477-462b-9557-b6ace211dc4c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:42.734640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b211d419-c477-462b-9557-b6ace211dc4c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:42.736466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b211d419-c477-462b-9557-b6ace211dc4c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:42.743272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b211d419-c477-462b-9557-b6ace211dc4c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:43.408173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b211d419-c477-462b-9557-b6ace211dc4c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:43.416999 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b211d419-c477-462b-9557-b6ace211dc4c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1509 microversion: 2.1 time: 0.730538 May 27 15:27:43.420302 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2922/5843] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:42 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1509 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:43.543345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a92a7dca-2438-4743-9833-e9ef99c8d812 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:43.544694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a92a7dca-2438-4743-9833-e9ef99c8d812 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:43.567172 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a92a7dca-2438-4743-9833-e9ef99c8d812 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:43.573347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a92a7dca-2438-4743-9833-e9ef99c8d812 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:43.581374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a92a7dca-2438-4743-9833-e9ef99c8d812 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:43.586322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a92a7dca-2438-4743-9833-e9ef99c8d812 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:43.846709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-6464998c-916e-4d39-95e9-edb9f32a9568 req-b4393699-3c73-456f-911f-09005f96ba0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00e7ba77-6e64-469a-b277-37efba73e8a4", "name": "network-vif-deleted", "tag": "8caf3579-3318-43f7-9361-438c9cb06e9b"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:27:43.879024 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6464998c-916e-4d39-95e9-edb9f32a9568 req-b4393699-3c73-456f-911f-09005f96ba0a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:43.880613 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6464998c-916e-4d39-95e9-edb9f32a9568 req-b4393699-3c73-456f-911f-09005f96ba0a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:43.905092 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-6464998c-916e-4d39-95e9-edb9f32a9568 req-b4393699-3c73-456f-911f-09005f96ba0a service nova] Creating event network-vif-deleted:8caf3579-3318-43f7-9361-438c9cb06e9b for instance 00e7ba77-6e64-469a-b277-37efba73e8a4 on n-h2-843621-1 May 27 15:27:43.926272 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-6464998c-916e-4d39-95e9-edb9f32a9568 req-b4393699-3c73-456f-911f-09005f96ba0a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085229 May 27 15:27:43.931489 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2923/5844] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:27:43.967670 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a92a7dca-2438-4743-9833-e9ef99c8d812 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '347233fdfa5c4843a9b4d1d2b8b7fd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b081ca95cf17463a9f7f05ff9970f2e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:43.986087 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a92a7dca-2438-4743-9833-e9ef99c8d812 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] 10.222.0.13 "GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 200 len: 1492 microversion: 2.1 time: 0.447580 May 27 15:27:43.987620 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2922/5845] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:43 2022] GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 1492 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:44.449489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bc0ff2f0-f293-4ec6-90c5-8f0ed1da857d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:44.451594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bc0ff2f0-f293-4ec6-90c5-8f0ed1da857d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:44.487026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc0ff2f0-f293-4ec6-90c5-8f0ed1da857d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:44.487486 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc0ff2f0-f293-4ec6-90c5-8f0ed1da857d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:44.488279 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc0ff2f0-f293-4ec6-90c5-8f0ed1da857d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:44.503665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc0ff2f0-f293-4ec6-90c5-8f0ed1da857d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:44.794868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bc0ff2f0-f293-4ec6-90c5-8f0ed1da857d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:44.810044 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bc0ff2f0-f293-4ec6-90c5-8f0ed1da857d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1509 microversion: 2.1 time: 0.371219 May 27 15:27:44.811015 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2924/5846] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:44 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1509 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:45.005366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1e4c8068-9334-4cc1-87bd-c9c9310af902 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:45.007378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1e4c8068-9334-4cc1-87bd-c9c9310af902 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] [instance: 00e7ba77-6e64-469a-b277-37efba73e8a4] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:45.022215 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e4c8068-9334-4cc1-87bd-c9c9310af902 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:45.024227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e4c8068-9334-4cc1-87bd-c9c9310af902 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:45.027515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e4c8068-9334-4cc1-87bd-c9c9310af902 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:45.028269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e4c8068-9334-4cc1-87bd-c9c9310af902 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:45.103460 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-1e4c8068-9334-4cc1-87bd-c9c9310af902 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] HTTP exception thrown: Instance 00e7ba77-6e64-469a-b277-37efba73e8a4 could not be found. May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1e4c8068-9334-4cc1-87bd-c9c9310af902 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Request method failure captured: May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 HTTP/1.1 May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikO3OQOPj65I9kurRoD3UG3h5fZQOVmMXvVJ_zjN4m8q0nSVA8dJd2BTxKY675ljzRe7IlrRKYn7Kpy99rG69jvGbmOx_dzE8YB8cVy_xrNdyenO9Lcii4LhudxKfXLrpxSr1slC7Eg1PnSwts3uqiUUJrQpeDK6dcH9nrtXe_4JaEbk May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: b081ca95cf17463a9f7f05ff9970f2e4 May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1525422915 May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b081ca95cf17463a9f7f05ff9970f2e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b081ca95cf17463a9f7f05ff9970f2e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b081ca95cf17463a9f7f05ff9970f2e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b081ca95cf17463a9f7f05ff9970f2e4", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1525422915 May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: b081ca95cf17463a9f7f05ff9970f2e4 May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1525422915 May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1525422915-project May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 347233fdfa5c4843a9b4d1d2b8b7fd66 May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1525422915-project May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 00e7ba77-6e64-469a-b277-37efba73e8a4 could not be found. May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '00e7ba77-6e64-469a-b277-37efba73e8a4'} May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00e7ba77-6e64-469a-b277-37efba73e8a4 could not be found. May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00e7ba77-6e64-469a-b277-37efba73e8a4 could not be found. May 27 15:27:45.107808 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:27:45.115712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:45.115712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:27:45.115712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:45.115712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:45.115712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:45.115712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:27:45.115712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:27:45.115712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00e7ba77-6e64-469a-b277-37efba73e8a4 could not be found. May 27 15:27:45.115712 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:27:45.139623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1e4c8068-9334-4cc1-87bd-c9c9310af902 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] Returning 404 to user: Instance 00e7ba77-6e64-469a-b277-37efba73e8a4 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:27:45.146379 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1e4c8068-9334-4cc1-87bd-c9c9310af902 tempest-ServersNegativeTestMultiTenantJSON-1525422915 tempest-ServersNegativeTestMultiTenantJSON-1525422915-project] 10.222.0.13 "GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4" status: 404 len: 111 microversion: 2.1 time: 0.146671 May 27 15:27:45.152654 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2923/5847] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:44 2022] GET /compute/v2.1/servers/00e7ba77-6e64-469a-b277-37efba73e8a4 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:27:45.831385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-034c50a3-ea9b-4617-921a-0c3f01e4e4b0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:45.832135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-034c50a3-ea9b-4617-921a-0c3f01e4e4b0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:45.890413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-034c50a3-ea9b-4617-921a-0c3f01e4e4b0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:45.893453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-034c50a3-ea9b-4617-921a-0c3f01e4e4b0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:45.899253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-034c50a3-ea9b-4617-921a-0c3f01e4e4b0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:45.907487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-034c50a3-ea9b-4617-921a-0c3f01e4e4b0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:46.559488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-034c50a3-ea9b-4617-921a-0c3f01e4e4b0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:46.574511 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-034c50a3-ea9b-4617-921a-0c3f01e4e4b0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1509 microversion: 2.1 time: 0.750447 May 27 15:27:46.575169 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2925/5848] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:45 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1509 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:47.593628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-802caa55-85b2-4890-8289-dafdc00d665d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:47.595163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-802caa55-85b2-4890-8289-dafdc00d665d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:47.604075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-802caa55-85b2-4890-8289-dafdc00d665d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:47.605008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-802caa55-85b2-4890-8289-dafdc00d665d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:47.606013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-802caa55-85b2-4890-8289-dafdc00d665d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:47.606622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-802caa55-85b2-4890-8289-dafdc00d665d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:48.144357 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-802caa55-85b2-4890-8289-dafdc00d665d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:48.155791 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-802caa55-85b2-4890-8289-dafdc00d665d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1509 microversion: 2.1 time: 0.567861 May 27 15:27:48.157843 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2924/5849] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:47 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1509 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:49.174584 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-96c3f85d-26fb-405e-8634-85bfe5a0b16c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:49.175212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-96c3f85d-26fb-405e-8634-85bfe5a0b16c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:49.185792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96c3f85d-26fb-405e-8634-85bfe5a0b16c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:49.186257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96c3f85d-26fb-405e-8634-85bfe5a0b16c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:49.191639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96c3f85d-26fb-405e-8634-85bfe5a0b16c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:49.191639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96c3f85d-26fb-405e-8634-85bfe5a0b16c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:49.558530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ad303306-ba2a-4b9e-a8b5-392deb7be402 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-330868327", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "00ab1dda-ee2a-49cc-a9a8-811fee5e71fc"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:27:49.654402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-ad303306-ba2a-4b9e-a8b5-392deb7be402 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] validate_networks() for [('00ab1dda-ee2a-49cc-a9a8-811fee5e71fc', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:27:49.699912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-96c3f85d-26fb-405e-8634-85bfe5a0b16c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:49.709205 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-96c3f85d-26fb-405e-8634-85bfe5a0b16c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1506 microversion: 2.1 time: 0.538909 May 27 15:27:49.717043 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2926/5850] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:49 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1506 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:50.304250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ad303306-ba2a-4b9e-a8b5-392deb7be402 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:27:50.305277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ad303306-ba2a-4b9e-a8b5-392deb7be402 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:27:50.305901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ad303306-ba2a-4b9e-a8b5-392deb7be402 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:27:50.307098 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ad303306-ba2a-4b9e-a8b5-392deb7be402 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:27:50.307657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ad303306-ba2a-4b9e-a8b5-392deb7be402 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:27:50.330842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad303306-ba2a-4b9e-a8b5-392deb7be402 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:50.332264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad303306-ba2a-4b9e-a8b5-392deb7be402 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:50.334711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad303306-ba2a-4b9e-a8b5-392deb7be402 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:50.336265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad303306-ba2a-4b9e-a8b5-392deb7be402 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:50.403368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-ad303306-ba2a-4b9e-a8b5-392deb7be402 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Getting quotas for project 5b503b65f93a4a9dbbc5b319d85d8adb. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:27:50.418043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-ad303306-ba2a-4b9e-a8b5-392deb7be402 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Getting quotas for user f9c77e08f31a4fab865b9b8dd1ffdc1f and project 5b503b65f93a4a9dbbc5b319d85d8adb. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:27:50.432697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ad303306-ba2a-4b9e-a8b5-392deb7be402 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:27:50.435551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ad303306-ba2a-4b9e-a8b5-392deb7be402 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] [instance: 0c305985-e4b3-4a70-8ba7-0a7558d09c34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:27:50.543760 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ad303306-ba2a-4b9e-a8b5-392deb7be402 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.171783 May 27 15:27:50.549521 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2925/5851] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:27:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 15:27:50.561374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e3dc5817-67b1-4955-ae1b-9fdef7faa0b3 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:50.564438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e3dc5817-67b1-4955-ae1b-9fdef7faa0b3 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] [instance: 0c305985-e4b3-4a70-8ba7-0a7558d09c34] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:50.663513 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e3dc5817-67b1-4955-ae1b-9fdef7faa0b3 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c77e08f31a4fab865b9b8dd1ffdc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b503b65f93a4a9dbbc5b319d85d8adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:50.698276 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e3dc5817-67b1-4955-ae1b-9fdef7faa0b3 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] 10.222.0.13 "GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34" status: 200 len: 1213 microversion: 2.1 time: 0.144961 May 27 15:27:50.698891 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2927/5852] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:50 2022] GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34 => generated 1213 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:50.729645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7e660058-2062-4024-a4ee-3aa360c80af1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:50.730423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7e660058-2062-4024-a4ee-3aa360c80af1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:50.757530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e660058-2062-4024-a4ee-3aa360c80af1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:50.758146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e660058-2062-4024-a4ee-3aa360c80af1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:50.763236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e660058-2062-4024-a4ee-3aa360c80af1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:50.764657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e660058-2062-4024-a4ee-3aa360c80af1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:50.972655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-102f4f65-ce7a-4c4b-b32d-f6829fbd11f2 req-9bf35200-a630-4dc3-b11b-1bda98495d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e1ea07-7d87-45ab-81b9-fe8dc6544258", "name": "network-vif-unplugged", "status": "completed", "tag": "cae8ec95-5c5e-485f-bf31-56b814395525"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:27:51.010801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-102f4f65-ce7a-4c4b-b32d-f6829fbd11f2 req-9bf35200-a630-4dc3-b11b-1bda98495d11 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:51.012998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-102f4f65-ce7a-4c4b-b32d-f6829fbd11f2 req-9bf35200-a630-4dc3-b11b-1bda98495d11 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:51.061079 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-102f4f65-ce7a-4c4b-b32d-f6829fbd11f2 req-9bf35200-a630-4dc3-b11b-1bda98495d11 service nova] Creating event network-vif-unplugged:cae8ec95-5c5e-485f-bf31-56b814395525 for instance d6e1ea07-7d87-45ab-81b9-fe8dc6544258 on n-h1-843621-1 May 27 15:27:51.088290 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-102f4f65-ce7a-4c4b-b32d-f6829fbd11f2 req-9bf35200-a630-4dc3-b11b-1bda98495d11 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119121 May 27 15:27:51.091994 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2928/5853] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:27:51.119132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7e660058-2062-4024-a4ee-3aa360c80af1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:51.128965 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7e660058-2062-4024-a4ee-3aa360c80af1 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1506 microversion: 2.1 time: 0.405797 May 27 15:27:51.130052 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2926/5854] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:50 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:51.734847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f937c5f3-fe32-4048-a7d5-19ac5416631b tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:51.743946 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f937c5f3-fe32-4048-a7d5-19ac5416631b tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] [instance: 0c305985-e4b3-4a70-8ba7-0a7558d09c34] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:51.773150 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f937c5f3-fe32-4048-a7d5-19ac5416631b tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:51.777463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f937c5f3-fe32-4048-a7d5-19ac5416631b tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:51.780831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f937c5f3-fe32-4048-a7d5-19ac5416631b tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:51.781356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f937c5f3-fe32-4048-a7d5-19ac5416631b tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:51.789408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:51.942925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f937c5f3-fe32-4048-a7d5-19ac5416631b tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c77e08f31a4fab865b9b8dd1ffdc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b503b65f93a4a9dbbc5b319d85d8adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:51.961731 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f937c5f3-fe32-4048-a7d5-19ac5416631b tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] 10.222.0.13 "GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34" status: 200 len: 1217 microversion: 2.1 time: 0.246311 May 27 15:27:51.965576 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2929/5855] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:51 2022] GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34 => generated 1217 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:52.147820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b385f4af-6c7a-4335-97a1-a7092118bf25 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:52.149170 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b385f4af-6c7a-4335-97a1-a7092118bf25 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:52.158210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b385f4af-6c7a-4335-97a1-a7092118bf25 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:52.158918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b385f4af-6c7a-4335-97a1-a7092118bf25 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:52.160340 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b385f4af-6c7a-4335-97a1-a7092118bf25 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:52.161268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b385f4af-6c7a-4335-97a1-a7092118bf25 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:52.360433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b385f4af-6c7a-4335-97a1-a7092118bf25 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:52.371825 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b385f4af-6c7a-4335-97a1-a7092118bf25 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 200 len: 1449 microversion: 2.1 time: 0.228235 May 27 15:27:52.386621 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2927/5856] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:52 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 1449 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:52.391934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4ddb6e05-d9ae-4189-994b-72c1186fd73b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:52.397650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4ddb6e05-d9ae-4189-994b-72c1186fd73b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:52.412286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ddb6e05-d9ae-4189-994b-72c1186fd73b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:52.413081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ddb6e05-d9ae-4189-994b-72c1186fd73b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:52.418802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ddb6e05-d9ae-4189-994b-72c1186fd73b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:52.419599 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ddb6e05-d9ae-4189-994b-72c1186fd73b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:52.555408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4cdd1118-519f-4e96-93cc-27cec1c27ecd tempest-QuotasTestJSON-474169669 tempest-QuotasTestJSON-474169669-project] Calling method '.version_select at 0x7fc7806cd5e0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:52.689989 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4cdd1118-519f-4e96-93cc-27cec1c27ecd tempest-QuotasTestJSON-474169669 tempest-QuotasTestJSON-474169669-project] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/4fb43358ced0473488177a37d262bf72/defaults" status: 200 len: 371 microversion: 2.1 time: 0.519120 May 27 15:27:52.691189 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2930/5857] 10.222.0.13 () {58 vars in 1268 bytes} [Fri May 27 15:27:52 2022] GET /compute/v2.1/os-quota-sets/4fb43358ced0473488177a37d262bf72/defaults => generated 371 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:27:52.709010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b0a2daab-23ed-4641-b30c-47552c1427f8 tempest-QuotasTestJSON-474169669 tempest-QuotasTestJSON-474169669-project] Calling method '.version_select at 0x7fc77c0ebc10>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:52.813510 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b0a2daab-23ed-4641-b30c-47552c1427f8 tempest-QuotasTestJSON-474169669 tempest-QuotasTestJSON-474169669-project] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/4fb43358ced0473488177a37d262bf72" status: 200 len: 371 microversion: 2.1 time: 0.115527 May 27 15:27:52.821365 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2931/5858] 10.222.0.13 () {58 vars in 1241 bytes} [Fri May 27 15:27:52 2022] GET /compute/v2.1/os-quota-sets/4fb43358ced0473488177a37d262bf72 => generated 371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:27:52.828206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c98e532b-437a-430f-91a9-a609f2691297 tempest-QuotasTestJSON-474169669 tempest-QuotasTestJSON-474169669-project] Calling method '.version_select at 0x7fc77716aee0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:52.861643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4ddb6e05-d9ae-4189-994b-72c1186fd73b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:52.875436 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4ddb6e05-d9ae-4189-994b-72c1186fd73b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.487246 May 27 15:27:52.876566 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2928/5859] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:52 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:52.903626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4bc58ec1-9826-4f4f-85bf-2bb1801d84a4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:52.904269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4bc58ec1-9826-4f4f-85bf-2bb1801d84a4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:52.909944 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c98e532b-437a-430f-91a9-a609f2691297 tempest-QuotasTestJSON-474169669 tempest-QuotasTestJSON-474169669-project] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/4fb43358ced0473488177a37d262bf72/defaults" status: 200 len: 371 microversion: 2.1 time: 0.086867 May 27 15:27:52.912349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4bc58ec1-9826-4f4f-85bf-2bb1801d84a4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:52.913189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4bc58ec1-9826-4f4f-85bf-2bb1801d84a4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:52.914274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4bc58ec1-9826-4f4f-85bf-2bb1801d84a4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:52.914781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4bc58ec1-9826-4f4f-85bf-2bb1801d84a4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:52.915420 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2932/5860] 10.222.0.13 () {58 vars in 1268 bytes} [Fri May 27 15:27:52 2022] GET /compute/v2.1/os-quota-sets/4fb43358ced0473488177a37d262bf72/defaults => generated 371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:27:52.934614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e3b8be6e-a9f8-43d3-8db6-8ef0973acbdb tempest-QuotasTestJSON-474169669 tempest-QuotasTestJSON-474169669-project] Calling method '.version_select at 0x7fc776b398b0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:53.071130 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e3b8be6e-a9f8-43d3-8db6-8ef0973acbdb tempest-QuotasTestJSON-474169669 tempest-QuotasTestJSON-474169669-project] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/4fb43358ced0473488177a37d262bf72" status: 200 len: 371 microversion: 2.1 time: 0.144165 May 27 15:27:53.072601 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2933/5861] 10.222.0.13 () {58 vars in 1241 bytes} [Fri May 27 15:27:52 2022] GET /compute/v2.1/os-quota-sets/4fb43358ced0473488177a37d262bf72 => generated 371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:27:53.086038 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9e43d192-8ba1-401a-879e-a054f6c170ea tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:53.087009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9e43d192-8ba1-401a-879e-a054f6c170ea tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] [instance: 0c305985-e4b3-4a70-8ba7-0a7558d09c34] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:53.095546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e43d192-8ba1-401a-879e-a054f6c170ea tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:53.096331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e43d192-8ba1-401a-879e-a054f6c170ea tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:53.097426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e43d192-8ba1-401a-879e-a054f6c170ea tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:53.099274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9e43d192-8ba1-401a-879e-a054f6c170ea tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:53.313599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9e43d192-8ba1-401a-879e-a054f6c170ea tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c77e08f31a4fab865b9b8dd1ffdc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b503b65f93a4a9dbbc5b319d85d8adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:53.341466 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9e43d192-8ba1-401a-879e-a054f6c170ea tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] 10.222.0.13 "GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34" status: 200 len: 1271 microversion: 2.1 time: 0.260515 May 27 15:27:53.342640 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2934/5862] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:53 2022] GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34 => generated 1271 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:53.350796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7895aa55-ff70-4dc0-951e-e97e7e418d06 tempest-QuotasTestJSON-474169669 tempest-QuotasTestJSON-474169669-project] Calling method '.version_select at 0x7fc78064fd30>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:53.355522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4bc58ec1-9826-4f4f-85bf-2bb1801d84a4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:53.370196 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4bc58ec1-9826-4f4f-85bf-2bb1801d84a4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.469302 May 27 15:27:53.378033 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2929/5863] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:52 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:53.410300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1419c309-3364-420a-b7ac-c3769432aebf tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:53.411332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1419c309-3364-420a-b7ac-c3769432aebf tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:53.427324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1419c309-3364-420a-b7ac-c3769432aebf tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:53.427989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1419c309-3364-420a-b7ac-c3769432aebf tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:53.428991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1419c309-3364-420a-b7ac-c3769432aebf tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:53.429933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1419c309-3364-420a-b7ac-c3769432aebf tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:53.496897 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7895aa55-ff70-4dc0-951e-e97e7e418d06 tempest-QuotasTestJSON-474169669 tempest-QuotasTestJSON-474169669-project] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/4fb43358ced0473488177a37d262bf72?user_id=174c5527364045a79f08772358a42d1a" status: 200 len: 371 microversion: 2.1 time: 0.152905 May 27 15:27:53.508798 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2935/5864] 10.222.0.13 () {58 vars in 1322 bytes} [Fri May 27 15:27:53 2022] GET /compute/v2.1/os-quota-sets/4fb43358ced0473488177a37d262bf72?user_id=174c5527364045a79f08772358a42d1a => generated 371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:27:53.789488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1419c309-3364-420a-b7ac-c3769432aebf tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:53.804600 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1419c309-3364-420a-b7ac-c3769432aebf tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.415148 May 27 15:27:53.805496 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2930/5865] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:53 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:53.821356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-296b7bf9-464d-4e03-a41c-2ba61a7f68a9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:53.822085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-296b7bf9-464d-4e03-a41c-2ba61a7f68a9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:53.834246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-296b7bf9-464d-4e03-a41c-2ba61a7f68a9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:53.835210 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-296b7bf9-464d-4e03-a41c-2ba61a7f68a9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:53.839115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-296b7bf9-464d-4e03-a41c-2ba61a7f68a9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:53.839804 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-296b7bf9-464d-4e03-a41c-2ba61a7f68a9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:54.213083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-296b7bf9-464d-4e03-a41c-2ba61a7f68a9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:54.241171 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-296b7bf9-464d-4e03-a41c-2ba61a7f68a9 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.423629 May 27 15:27:54.253214 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2936/5866] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:53 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:54.265255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8d8122a2-9114-46ab-b736-0d8c7b4552c7 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:27:54.272631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d8122a2-9114-46ab-b736-0d8c7b4552c7 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:54.273336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d8122a2-9114-46ab-b736-0d8c7b4552c7 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:54.339544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8d8122a2-9114-46ab-b736-0d8c7b4552c7 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Going to try to stop instance {{(pid=119248) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 15:27:54.362005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-928674b6-c953-49ba-85b6-de7b91b4f14c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:54.362625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-928674b6-c953-49ba-85b6-de7b91b4f14c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] [instance: 0c305985-e4b3-4a70-8ba7-0a7558d09c34] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:54.376067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-928674b6-c953-49ba-85b6-de7b91b4f14c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:54.376431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-928674b6-c953-49ba-85b6-de7b91b4f14c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:54.382805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-928674b6-c953-49ba-85b6-de7b91b4f14c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:54.384377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-928674b6-c953-49ba-85b6-de7b91b4f14c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:54.466689 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8d8122a2-9114-46ab-b736-0d8c7b4552c7 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action" status: 202 len: 0 microversion: 2.1 time: 0.204798 May 27 15:27:54.467331 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2931/5867] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:27:54 2022] POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:27:54.484625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dbd9b40c-f622-4a96-88bf-a254ee01b412 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:54.486837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dbd9b40c-f622-4a96-88bf-a254ee01b412 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:54.505171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dbd9b40c-f622-4a96-88bf-a254ee01b412 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:54.505431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dbd9b40c-f622-4a96-88bf-a254ee01b412 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:54.508487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dbd9b40c-f622-4a96-88bf-a254ee01b412 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:54.510111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dbd9b40c-f622-4a96-88bf-a254ee01b412 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:54.791521 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-928674b6-c953-49ba-85b6-de7b91b4f14c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c77e08f31a4fab865b9b8dd1ffdc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b503b65f93a4a9dbbc5b319d85d8adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:54.803328 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-928674b6-c953-49ba-85b6-de7b91b4f14c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] 10.222.0.13 "GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34" status: 200 len: 1313 microversion: 2.1 time: 0.444464 May 27 15:27:54.806475 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2937/5868] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:54 2022] GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34 => generated 1313 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:54.974320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dbd9b40c-f622-4a96-88bf-a254ee01b412 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:54.984062 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dbd9b40c-f622-4a96-88bf-a254ee01b412 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1679 microversion: 2.1 time: 0.509809 May 27 15:27:54.995586 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2932/5869] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:54 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1679 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:55.564345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-2776a786-bef8-4fa5-a6ae-bdc93decb6ab req-9b9cc4f3-1fd8-4d2d-95b6-632ee58f719f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c305985-e4b3-4a70-8ba7-0a7558d09c34", "tag": "f96b44a1-d49b-40a0-bd1e-32c1a99460e4"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:27:55.585305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:27:55.598794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2776a786-bef8-4fa5-a6ae-bdc93decb6ab req-9b9cc4f3-1fd8-4d2d-95b6-632ee58f719f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:55.599264 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2776a786-bef8-4fa5-a6ae-bdc93decb6ab req-9b9cc4f3-1fd8-4d2d-95b6-632ee58f719f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:55.653639 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-2776a786-bef8-4fa5-a6ae-bdc93decb6ab req-9b9cc4f3-1fd8-4d2d-95b6-632ee58f719f service nova] Creating event network-changed:f96b44a1-d49b-40a0-bd1e-32c1a99460e4 for instance 0c305985-e4b3-4a70-8ba7-0a7558d09c34 on n-h2-843621-1 May 27 15:27:55.665759 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-2776a786-bef8-4fa5-a6ae-bdc93decb6ab req-9b9cc4f3-1fd8-4d2d-95b6-632ee58f719f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106117 May 27 15:27:55.667084 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2938/5870] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:27:55.831699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ea724834-0317-4005-afe2-fd5933e578e3 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:55.841023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ea724834-0317-4005-afe2-fd5933e578e3 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] [instance: 0c305985-e4b3-4a70-8ba7-0a7558d09c34] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:55.869262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea724834-0317-4005-afe2-fd5933e578e3 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:55.869855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea724834-0317-4005-afe2-fd5933e578e3 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:55.870678 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea724834-0317-4005-afe2-fd5933e578e3 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:55.871135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea724834-0317-4005-afe2-fd5933e578e3 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:56.004369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e16cf772-3211-4d9e-8490-fca033cd4831 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:56.005519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e16cf772-3211-4d9e-8490-fca033cd4831 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:56.013010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e16cf772-3211-4d9e-8490-fca033cd4831 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:56.013857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e16cf772-3211-4d9e-8490-fca033cd4831 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:56.014840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e16cf772-3211-4d9e-8490-fca033cd4831 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:56.015465 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e16cf772-3211-4d9e-8490-fca033cd4831 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:56.346006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e16cf772-3211-4d9e-8490-fca033cd4831 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:56.359839 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e16cf772-3211-4d9e-8490-fca033cd4831 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1679 microversion: 2.1 time: 0.361063 May 27 15:27:56.360444 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2939/5871] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:55 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1679 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:27:56.396991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ea724834-0317-4005-afe2-fd5933e578e3 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c77e08f31a4fab865b9b8dd1ffdc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b503b65f93a4a9dbbc5b319d85d8adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:56.407614 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ea724834-0317-4005-afe2-fd5933e578e3 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] 10.222.0.13 "GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34" status: 200 len: 1313 microversion: 2.1 time: 0.587283 May 27 15:27:56.409387 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2933/5872] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:55 2022] GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34 => generated 1313 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:57.378061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1a7c7b1a-9838-4888-89e8-dd0247011e94 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:57.379043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1a7c7b1a-9838-4888-89e8-dd0247011e94 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:57.396382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a7c7b1a-9838-4888-89e8-dd0247011e94 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:57.396879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a7c7b1a-9838-4888-89e8-dd0247011e94 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:57.397676 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a7c7b1a-9838-4888-89e8-dd0247011e94 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:57.398125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a7c7b1a-9838-4888-89e8-dd0247011e94 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:57.427550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4383e377-905a-4d82-b489-ec3c7f8a8fe6 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:57.428236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4383e377-905a-4d82-b489-ec3c7f8a8fe6 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] [instance: 0c305985-e4b3-4a70-8ba7-0a7558d09c34] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:57.438934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4383e377-905a-4d82-b489-ec3c7f8a8fe6 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:57.439393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4383e377-905a-4d82-b489-ec3c7f8a8fe6 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:57.440182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4383e377-905a-4d82-b489-ec3c7f8a8fe6 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:57.440627 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4383e377-905a-4d82-b489-ec3c7f8a8fe6 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:57.853821 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4383e377-905a-4d82-b489-ec3c7f8a8fe6 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c77e08f31a4fab865b9b8dd1ffdc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b503b65f93a4a9dbbc5b319d85d8adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:57.874146 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4383e377-905a-4d82-b489-ec3c7f8a8fe6 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] 10.222.0.13 "GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34" status: 200 len: 1313 microversion: 2.1 time: 0.450386 May 27 15:27:57.875327 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2934/5873] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:57 2022] GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34 => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:57.968179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1a7c7b1a-9838-4888-89e8-dd0247011e94 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:57.985883 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1a7c7b1a-9838-4888-89e8-dd0247011e94 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1679 microversion: 2.1 time: 0.612247 May 27 15:27:57.986487 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2940/5874] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:57 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1679 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:58.906201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-468a58d3-1a15-4eb3-84c2-6ad6f2bb30e3 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:58.906881 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-468a58d3-1a15-4eb3-84c2-6ad6f2bb30e3 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] [instance: 0c305985-e4b3-4a70-8ba7-0a7558d09c34] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:58.933116 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1d3234ca-c82c-4843-b51a-0866029c9930 tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] Calling method '.version_select at 0x7fc7806bc1f0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:58.944811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-468a58d3-1a15-4eb3-84c2-6ad6f2bb30e3 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:58.946049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-468a58d3-1a15-4eb3-84c2-6ad6f2bb30e3 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:58.948407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-468a58d3-1a15-4eb3-84c2-6ad6f2bb30e3 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:58.950346 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-468a58d3-1a15-4eb3-84c2-6ad6f2bb30e3 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:59.022071 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1d3234ca-c82c-4843-b51a-0866029c9930 tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/99fe495a-0a1a-4075-aaa3-9e6119c6c3d5" status: 200 len: 351 microversion: 2.1 time: 0.092779 May 27 15:27:59.030416 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2941/5875] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:27:58 2022] GET /compute/v2.1/os-volumes/99fe495a-0a1a-4075-aaa3-9e6119c6c3d5 => generated 351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:27:59.038808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-89aa13de-888e-407d-9134-50a7aa05a7a5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:59.039728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-89aa13de-888e-407d-9134-50a7aa05a7a5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:59.052936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89aa13de-888e-407d-9134-50a7aa05a7a5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:59.054510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89aa13de-888e-407d-9134-50a7aa05a7a5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:59.055560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89aa13de-888e-407d-9134-50a7aa05a7a5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:59.056982 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-89aa13de-888e-407d-9134-50a7aa05a7a5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:59.293492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-468a58d3-1a15-4eb3-84c2-6ad6f2bb30e3 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c77e08f31a4fab865b9b8dd1ffdc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b503b65f93a4a9dbbc5b319d85d8adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:59.302870 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-468a58d3-1a15-4eb3-84c2-6ad6f2bb30e3 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] 10.222.0.13 "GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34" status: 200 len: 1313 microversion: 2.1 time: 0.414736 May 27 15:27:59.306956 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2935/5876] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:58 2022] GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34 => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:59.439052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-89aa13de-888e-407d-9134-50a7aa05a7a5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:59.450205 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-89aa13de-888e-407d-9134-50a7aa05a7a5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1679 microversion: 2.1 time: 0.418041 May 27 15:27:59.453499 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2942/5877] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:27:59 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1679 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:00.329126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9b673a3f-6971-4e7a-9124-ccac5f4079db tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:00.331450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9b673a3f-6971-4e7a-9124-ccac5f4079db tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] [instance: 0c305985-e4b3-4a70-8ba7-0a7558d09c34] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:00.345961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b673a3f-6971-4e7a-9124-ccac5f4079db tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:00.347338 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b673a3f-6971-4e7a-9124-ccac5f4079db tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:00.354777 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b673a3f-6971-4e7a-9124-ccac5f4079db tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:00.356448 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b673a3f-6971-4e7a-9124-ccac5f4079db tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:00.404695 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:00.442486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:00.473263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0878a993-0eba-41a6-9822-22da94a42a0e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:00.475018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0878a993-0eba-41a6-9822-22da94a42a0e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:00.524504 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0878a993-0eba-41a6-9822-22da94a42a0e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:00.527934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0878a993-0eba-41a6-9822-22da94a42a0e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:00.530257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0878a993-0eba-41a6-9822-22da94a42a0e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:00.534387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0878a993-0eba-41a6-9822-22da94a42a0e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:00.893026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9b673a3f-6971-4e7a-9124-ccac5f4079db tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c77e08f31a4fab865b9b8dd1ffdc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b503b65f93a4a9dbbc5b319d85d8adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:00.906344 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9b673a3f-6971-4e7a-9124-ccac5f4079db tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] 10.222.0.13 "GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34" status: 200 len: 1313 microversion: 2.1 time: 0.587718 May 27 15:28:00.917552 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2936/5878] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:00 2022] GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34 => generated 1313 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:00.983448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0878a993-0eba-41a6-9822-22da94a42a0e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:00.996075 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0878a993-0eba-41a6-9822-22da94a42a0e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1679 microversion: 2.1 time: 0.525364 May 27 15:28:00.998318 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2943/5879] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:00 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1679 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:28:01.053006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-00558b35-9f95-4e5e-9a06-12aeae11a98c req-5e83ba88-df1e-4171-a0cd-1176867f11c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c305985-e4b3-4a70-8ba7-0a7558d09c34", "name": "network-vif-plugged", "status": "completed", "tag": "f96b44a1-d49b-40a0-bd1e-32c1a99460e4"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:28:01.092887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-00558b35-9f95-4e5e-9a06-12aeae11a98c req-5e83ba88-df1e-4171-a0cd-1176867f11c8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:01.097012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-00558b35-9f95-4e5e-9a06-12aeae11a98c req-5e83ba88-df1e-4171-a0cd-1176867f11c8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:01.119106 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-00558b35-9f95-4e5e-9a06-12aeae11a98c req-5e83ba88-df1e-4171-a0cd-1176867f11c8 service nova] Creating event network-vif-plugged:f96b44a1-d49b-40a0-bd1e-32c1a99460e4 for instance 0c305985-e4b3-4a70-8ba7-0a7558d09c34 on n-h2-843621-1 May 27 15:28:01.125665 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-00558b35-9f95-4e5e-9a06-12aeae11a98c req-5e83ba88-df1e-4171-a0cd-1176867f11c8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076211 May 27 15:28:01.126999 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2937/5880] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:28:01.923859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e81925e3-0760-4284-b34e-d96ce4d9321c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:01.924506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e81925e3-0760-4284-b34e-d96ce4d9321c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] [instance: 0c305985-e4b3-4a70-8ba7-0a7558d09c34] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:01.940209 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e81925e3-0760-4284-b34e-d96ce4d9321c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:01.940714 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e81925e3-0760-4284-b34e-d96ce4d9321c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:01.941539 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e81925e3-0760-4284-b34e-d96ce4d9321c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:01.942000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e81925e3-0760-4284-b34e-d96ce4d9321c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:01.972872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5691878e-eaac-43e7-8560-48abf9bf9bf0 tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] Calling method '.version_select at 0x7fc775424160>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:02.061261 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5691878e-eaac-43e7-8560-48abf9bf9bf0 tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f9a58700-9636-4f07-8666-1944793c7214" status: 200 len: 351 microversion: 2.1 time: 0.097122 May 27 15:28:02.062000 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2938/5881] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:28:01 2022] GET /compute/v2.1/os-volumes/f9a58700-9636-4f07-8666-1944793c7214 => generated 351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:28:02.074174 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-35fd1728-ba9d-49ec-896e-9593c73393a5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:02.075078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-35fd1728-ba9d-49ec-896e-9593c73393a5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:02.095369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-35fd1728-ba9d-49ec-896e-9593c73393a5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:02.095890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-35fd1728-ba9d-49ec-896e-9593c73393a5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:02.096864 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-35fd1728-ba9d-49ec-896e-9593c73393a5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:02.097390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-35fd1728-ba9d-49ec-896e-9593c73393a5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:02.626336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e81925e3-0760-4284-b34e-d96ce4d9321c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c77e08f31a4fab865b9b8dd1ffdc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b503b65f93a4a9dbbc5b319d85d8adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:02.634424 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e81925e3-0760-4284-b34e-d96ce4d9321c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] 10.222.0.13 "GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34" status: 200 len: 1313 microversion: 2.1 time: 0.714721 May 27 15:28:02.640607 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2944/5882] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:01 2022] GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34 => generated 1313 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:02.703010 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-35fd1728-ba9d-49ec-896e-9593c73393a5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:02.706372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:02.715148 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-35fd1728-ba9d-49ec-896e-9593c73393a5 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1679 microversion: 2.1 time: 0.645275 May 27 15:28:02.715993 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2939/5883] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:02 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1679 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:03.661289 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-eb9792d7-39c6-41d3-93ad-a48aa542caa4 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:03.662500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-eb9792d7-39c6-41d3-93ad-a48aa542caa4 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] [instance: 0c305985-e4b3-4a70-8ba7-0a7558d09c34] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:03.665759 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=10 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:03.683953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb9792d7-39c6-41d3-93ad-a48aa542caa4 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:03.684571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb9792d7-39c6-41d3-93ad-a48aa542caa4 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:03.685423 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb9792d7-39c6-41d3-93ad-a48aa542caa4 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:03.685878 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb9792d7-39c6-41d3-93ad-a48aa542caa4 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:03.744910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9ab61c34-6106-4ecf-96d3-8104a65d6e5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:03.745583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9ab61c34-6106-4ecf-96d3-8104a65d6e5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:03.760750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ab61c34-6106-4ecf-96d3-8104a65d6e5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:03.761129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ab61c34-6106-4ecf-96d3-8104a65d6e5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:03.762189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ab61c34-6106-4ecf-96d3-8104a65d6e5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:03.764892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ab61c34-6106-4ecf-96d3-8104a65d6e5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:04.103670 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9ab61c34-6106-4ecf-96d3-8104a65d6e5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:04.118036 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9ab61c34-6106-4ecf-96d3-8104a65d6e5e tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1679 microversion: 2.1 time: 0.388685 May 27 15:28:04.123700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-eb9792d7-39c6-41d3-93ad-a48aa542caa4 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c77e08f31a4fab865b9b8dd1ffdc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b503b65f93a4a9dbbc5b319d85d8adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:04.128194 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2940/5884] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:03 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1679 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:28:04.133025 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-eb9792d7-39c6-41d3-93ad-a48aa542caa4 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] 10.222.0.13 "GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34" status: 200 len: 1496 microversion: 2.1 time: 0.479053 May 27 15:28:04.134495 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2945/5885] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:03 2022] GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34 => generated 1496 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:04.799270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8f40c2ee-fe81-4abe-ac6e-269cda3ef580 tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] Calling method '.version_select at 0x7fc77543fd30>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:04.914688 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8f40c2ee-fe81-4abe-ac6e-269cda3ef580 tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/9922f3a4-2d92-4d0c-8ccc-a2572007077f" status: 200 len: 351 microversion: 2.1 time: 0.119758 May 27 15:28:04.915874 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2941/5886] 10.222.0.13 () {58 vars in 1244 bytes} [Fri May 27 15:28:04 2022] GET /compute/v2.1/os-volumes/9922f3a4-2d92-4d0c-8ccc-a2572007077f => generated 351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:28:04.928927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f9009a7f-2ca6-48f7-ab63-697d56231212 tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] Calling method '.version_select at 0x7fc77c014dc0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:05.110833 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f9009a7f-2ca6-48f7-ab63-697d56231212 tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.186866 May 27 15:28:05.112032 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2946/5887] 10.222.0.13 () {58 vars in 1133 bytes} [Fri May 27 15:28:04 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:28:05.124619 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a683b7a4-6855-4c0f-b85c-cf7bb67699e3 tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] Calling method '.version_select at 0x7fc77549ed30>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:05.140087 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c4d45271-a821-4436-9554-2a3a99db964c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:05.140905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c4d45271-a821-4436-9554-2a3a99db964c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:05.152356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c4d45271-a821-4436-9554-2a3a99db964c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:05.152776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c4d45271-a821-4436-9554-2a3a99db964c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:05.153585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c4d45271-a821-4436-9554-2a3a99db964c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:05.154040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c4d45271-a821-4436-9554-2a3a99db964c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:05.295802 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a683b7a4-6855-4c0f-b85c-cf7bb67699e3 tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.173222 May 27 15:28:05.295802 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2942/5888] 10.222.0.13 () {58 vars in 1148 bytes} [Fri May 27 15:28:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:28:05.307080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d91ddf7a-a540-4882-a29e-c038d098e041 tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] Calling method '.version_select at 0x7fc775424f70>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:05.397573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c4d45271-a821-4436-9554-2a3a99db964c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:05.413645 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c4d45271-a821-4436-9554-2a3a99db964c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1656 microversion: 2.1 time: 0.277919 May 27 15:28:05.414585 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2947/5889] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:05 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1656 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:05.431670 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b2746322-3d12-4cd7-8b94-b1a62284528f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:28:05.437838 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d91ddf7a-a540-4882-a29e-c038d098e041 tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.134588 May 27 15:28:05.438661 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2943/5890] 10.222.0.13 () {58 vars in 1133 bytes} [Fri May 27 15:28:05 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:28:05.446577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b2746322-3d12-4cd7-8b94-b1a62284528f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:05.447387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b2746322-3d12-4cd7-8b94-b1a62284528f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:05.457951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-acfb3ccc-ffd7-4a9d-94a3-375efaae06aa tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] Calling method '.version_select at 0x7fc77549e9d0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:05.503254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b2746322-3d12-4cd7-8b94-b1a62284528f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Going to try to start instance {{(pid=119249) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 15:28:05.581858 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b2746322-3d12-4cd7-8b94-b1a62284528f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action" status: 202 len: 0 microversion: 2.1 time: 0.153973 May 27 15:28:05.583171 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2948/5891] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:28:05 2022] POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:28:05.609765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fbbc0c43-7587-4a01-bb76-2dd58f52b0e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:05.611330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fbbc0c43-7587-4a01-bb76-2dd58f52b0e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:05.623388 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-acfb3ccc-ffd7-4a9d-94a3-375efaae06aa tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.176951 May 27 15:28:05.624894 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fbbc0c43-7587-4a01-bb76-2dd58f52b0e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:05.625363 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fbbc0c43-7587-4a01-bb76-2dd58f52b0e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:05.626500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fbbc0c43-7587-4a01-bb76-2dd58f52b0e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:05.626955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fbbc0c43-7587-4a01-bb76-2dd58f52b0e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:05.633010 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2944/5892] 10.222.0.13 () {58 vars in 1166 bytes} [Fri May 27 15:28:05 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:28:05.638349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bd536bbc-ec0a-4b99-a438-21be718ff47f tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] Calling method '.version_select at 0x7fc7754d3af0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:05.895181 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bd536bbc-ec0a-4b99-a438-21be718ff47f tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.260936 May 27 15:28:05.896522 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2945/5893] 10.222.0.13 () {58 vars in 1169 bytes} [Fri May 27 15:28:05 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:28:05.910935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3ae5c10a-f614-4b6f-a848-811a933f52f7 tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] Calling method '.version_select at 0x7fc7754245e0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:05.942369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fbbc0c43-7587-4a01-bb76-2dd58f52b0e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:05.959979 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fbbc0c43-7587-4a01-bb76-2dd58f52b0e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1665 microversion: 2.1 time: 0.363246 May 27 15:28:05.970946 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2949/5894] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:05 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1665 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:06.211587 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3ae5c10a-f614-4b6f-a848-811a933f52f7 tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.305779 May 27 15:28:06.213118 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2946/5895] 10.222.0.13 () {58 vars in 1154 bytes} [Fri May 27 15:28:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:28:06.225174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4cd0310f-6dd8-42d0-8941-9f9b3dbb98ad tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] Calling method '.version_select at 0x7fc775bc5f70>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:06.376268 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4cd0310f-6dd8-42d0-8941-9f9b3dbb98ad tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.155113 May 27 15:28:06.376869 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2950/5896] 10.222.0.13 () {58 vars in 1187 bytes} [Fri May 27 15:28:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:28:06.388874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-af553900-7dea-47ae-98dc-c71f53ddd081 tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] Calling method '.version_select at 0x7fc77543fd30>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:06.556031 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-af553900-7dea-47ae-98dc-c71f53ddd081 tempest-VolumesTestJSON-1339097227 tempest-VolumesTestJSON-1339097227-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.170855 May 27 15:28:06.558074 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2947/5897] 10.222.0.13 () {58 vars in 1154 bytes} [Fri May 27 15:28:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:06.992440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a9dad0ed-ddd6-4282-b54e-df79431328a6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:06.994457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a9dad0ed-ddd6-4282-b54e-df79431328a6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:07.025159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a9dad0ed-ddd6-4282-b54e-df79431328a6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:07.025617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a9dad0ed-ddd6-4282-b54e-df79431328a6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:07.026421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a9dad0ed-ddd6-4282-b54e-df79431328a6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:07.026867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a9dad0ed-ddd6-4282-b54e-df79431328a6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:07.335489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a9dad0ed-ddd6-4282-b54e-df79431328a6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:07.343349 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a9dad0ed-ddd6-4282-b54e-df79431328a6 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1665 microversion: 2.1 time: 0.369170 May 27 15:28:07.364021 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2951/5898] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:06 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1665 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:08.378184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-717fdb9b-5f7e-48c3-bc81-03691c3bc416 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:08.379414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-717fdb9b-5f7e-48c3-bc81-03691c3bc416 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:08.388305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-717fdb9b-5f7e-48c3-bc81-03691c3bc416 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:08.389108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-717fdb9b-5f7e-48c3-bc81-03691c3bc416 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:08.390066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-717fdb9b-5f7e-48c3-bc81-03691c3bc416 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:08.390757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-717fdb9b-5f7e-48c3-bc81-03691c3bc416 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:08.659438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-717fdb9b-5f7e-48c3-bc81-03691c3bc416 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:08.676410 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-717fdb9b-5f7e-48c3-bc81-03691c3bc416 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.313139 May 27 15:28:08.698781 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e6a1b689-a215-45cd-9086-7ffcf3806081 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:08.699517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e6a1b689-a215-45cd-9086-7ffcf3806081 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:08.704523 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2948/5899] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:08 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:08.717596 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e6a1b689-a215-45cd-9086-7ffcf3806081 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:08.718065 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e6a1b689-a215-45cd-9086-7ffcf3806081 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:08.725270 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e6a1b689-a215-45cd-9086-7ffcf3806081 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:08.727056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e6a1b689-a215-45cd-9086-7ffcf3806081 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:09.086510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e6a1b689-a215-45cd-9086-7ffcf3806081 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:09.097632 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e6a1b689-a215-45cd-9086-7ffcf3806081 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.403755 May 27 15:28:09.098294 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2952/5900] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:08 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:09.118953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5896f0a4-8767-4f86-b102-2079c712db5a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:09.119844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5896f0a4-8767-4f86-b102-2079c712db5a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:09.133112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5896f0a4-8767-4f86-b102-2079c712db5a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:09.133631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5896f0a4-8767-4f86-b102-2079c712db5a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:09.134452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5896f0a4-8767-4f86-b102-2079c712db5a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:09.134910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5896f0a4-8767-4f86-b102-2079c712db5a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:09.418903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5896f0a4-8767-4f86-b102-2079c712db5a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:09.433764 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5896f0a4-8767-4f86-b102-2079c712db5a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.318829 May 27 15:28:09.435361 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2949/5901] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:09 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:09.469131 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cff76cb1-32ed-41c5-a2e0-70fa1ee1d9e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:09.469982 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cff76cb1-32ed-41c5-a2e0-70fa1ee1d9e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:09.482473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cff76cb1-32ed-41c5-a2e0-70fa1ee1d9e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:09.493539 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cff76cb1-32ed-41c5-a2e0-70fa1ee1d9e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:09.494699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cff76cb1-32ed-41c5-a2e0-70fa1ee1d9e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:09.497568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cff76cb1-32ed-41c5-a2e0-70fa1ee1d9e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:09.535808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:09.767757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cff76cb1-32ed-41c5-a2e0-70fa1ee1d9e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:09.777973 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cff76cb1-32ed-41c5-a2e0-70fa1ee1d9e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.323416 May 27 15:28:09.779680 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2953/5902] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:09 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:09.795534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-51a78854-b3f3-4260-9fa0-13cde4ac96c0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:09.796164 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-51a78854-b3f3-4260-9fa0-13cde4ac96c0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:09.798697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:09.818247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51a78854-b3f3-4260-9fa0-13cde4ac96c0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:09.818712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51a78854-b3f3-4260-9fa0-13cde4ac96c0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:09.827324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51a78854-b3f3-4260-9fa0-13cde4ac96c0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:09.827836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51a78854-b3f3-4260-9fa0-13cde4ac96c0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:10.156066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-51a78854-b3f3-4260-9fa0-13cde4ac96c0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:10.165175 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-51a78854-b3f3-4260-9fa0-13cde4ac96c0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.373775 May 27 15:28:10.181961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-244782ff-fca2-4670-a6b1-aa57075e1737 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:28:10.182922 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-244782ff-fca2-4670-a6b1-aa57075e1737 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:10.183213 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2950/5903] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:09 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:10.191824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-244782ff-fca2-4670-a6b1-aa57075e1737 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:10.192280 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-244782ff-fca2-4670-a6b1-aa57075e1737 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:10.193113 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-244782ff-fca2-4670-a6b1-aa57075e1737 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:10.193555 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-244782ff-fca2-4670-a6b1-aa57075e1737 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:10.234441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-244782ff-fca2-4670-a6b1-aa57075e1737 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lazy-loading 'flavor' on Instance uuid 812d42c0-07f1-4f7c-83b8-848b18cf0186 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:28:10.249852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-401de77f-8200-4520-b8d2-e12aac16644c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:10.250358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-401de77f-8200-4520-b8d2-e12aac16644c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] [instance: 0c305985-e4b3-4a70-8ba7-0a7558d09c34] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:10.261713 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-401de77f-8200-4520-b8d2-e12aac16644c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:10.262177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-401de77f-8200-4520-b8d2-e12aac16644c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:10.262964 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-401de77f-8200-4520-b8d2-e12aac16644c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:10.263407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-401de77f-8200-4520-b8d2-e12aac16644c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:10.325460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-401de77f-8200-4520-b8d2-e12aac16644c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] [instance: 0c305985-e4b3-4a70-8ba7-0a7558d09c34] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:28:10.389206 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-244782ff-fca2-4670-a6b1-aa57075e1737 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action" status: 202 len: 0 microversion: 2.1 time: 0.207600 May 27 15:28:10.391482 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2954/5904] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:28:10 2022] POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:28:10.410135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5192729f-ce06-4316-8dcb-e5c2328c7684 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:10.412638 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5192729f-ce06-4316-8dcb-e5c2328c7684 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:10.440247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5192729f-ce06-4316-8dcb-e5c2328c7684 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:10.440818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5192729f-ce06-4316-8dcb-e5c2328c7684 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:10.441672 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5192729f-ce06-4316-8dcb-e5c2328c7684 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:10.443531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5192729f-ce06-4316-8dcb-e5c2328c7684 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:10.507540 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-401de77f-8200-4520-b8d2-e12aac16644c tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34" status: 204 len: 0 microversion: 2.1 time: 0.261417 May 27 15:28:10.509542 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2951/5905] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:28:10 2022] DELETE /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:28:10.521330 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e5e9af16-7f3a-47bd-b4b5-8e69f6407202 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:10.522318 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e5e9af16-7f3a-47bd-b4b5-8e69f6407202 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] [instance: 0c305985-e4b3-4a70-8ba7-0a7558d09c34] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:10.533976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5e9af16-7f3a-47bd-b4b5-8e69f6407202 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:10.534436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5e9af16-7f3a-47bd-b4b5-8e69f6407202 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:10.535221 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5e9af16-7f3a-47bd-b4b5-8e69f6407202 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:10.535668 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5e9af16-7f3a-47bd-b4b5-8e69f6407202 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:10.724601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5192729f-ce06-4316-8dcb-e5c2328c7684 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:10.732819 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5192729f-ce06-4316-8dcb-e5c2328c7684 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1677 microversion: 2.1 time: 0.336722 May 27 15:28:10.745429 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2955/5906] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:10 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1677 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:10.901853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e5e9af16-7f3a-47bd-b4b5-8e69f6407202 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c77e08f31a4fab865b9b8dd1ffdc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b503b65f93a4a9dbbc5b319d85d8adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:10.910422 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e5e9af16-7f3a-47bd-b4b5-8e69f6407202 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] 10.222.0.13 "GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34" status: 200 len: 1502 microversion: 2.1 time: 0.394787 May 27 15:28:10.911425 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2952/5907] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:10 2022] GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34 => generated 1502 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:28:11.763945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-510da9a0-3db3-448c-b606-597b169d4d9c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:11.764764 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-510da9a0-3db3-448c-b606-597b169d4d9c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:11.775271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-510da9a0-3db3-448c-b606-597b169d4d9c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:11.775882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-510da9a0-3db3-448c-b606-597b169d4d9c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:11.777101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-510da9a0-3db3-448c-b606-597b169d4d9c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:11.777653 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-510da9a0-3db3-448c-b606-597b169d4d9c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:11.932165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a582add2-ab4b-4a09-b030-7603475b6b5d tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:11.933504 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a582add2-ab4b-4a09-b030-7603475b6b5d tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] [instance: 0c305985-e4b3-4a70-8ba7-0a7558d09c34] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:11.950802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a582add2-ab4b-4a09-b030-7603475b6b5d tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:11.956603 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a582add2-ab4b-4a09-b030-7603475b6b5d tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:11.961954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a582add2-ab4b-4a09-b030-7603475b6b5d tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:11.962638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a582add2-ab4b-4a09-b030-7603475b6b5d tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:12.276819 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-510da9a0-3db3-448c-b606-597b169d4d9c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:12.287859 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-510da9a0-3db3-448c-b606-597b169d4d9c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1660 microversion: 2.1 time: 0.530016 May 27 15:28:12.291231 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2956/5908] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:11 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1660 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:12.310089 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4c8317cb-e628-437f-a9cb-9f6cc71be9e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:28:12.310995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4c8317cb-e628-437f-a9cb-9f6cc71be9e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:12.324469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4c8317cb-e628-437f-a9cb-9f6cc71be9e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:12.325980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4c8317cb-e628-437f-a9cb-9f6cc71be9e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:12.329104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4c8317cb-e628-437f-a9cb-9f6cc71be9e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:12.334124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4c8317cb-e628-437f-a9cb-9f6cc71be9e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:12.547637 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4c8317cb-e628-437f-a9cb-9f6cc71be9e8 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action" status: 202 len: 0 microversion: 2.1 time: 0.241342 May 27 15:28:12.551920 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2957/5909] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:28:12 2022] POST /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:28:12.566129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5695d018-9205-4606-9ae5-25751cbecc3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:12.575081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5695d018-9205-4606-9ae5-25751cbecc3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:12.595407 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5695d018-9205-4606-9ae5-25751cbecc3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:12.599238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5695d018-9205-4606-9ae5-25751cbecc3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:12.600551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5695d018-9205-4606-9ae5-25751cbecc3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:12.602064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5695d018-9205-4606-9ae5-25751cbecc3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:12.977519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a582add2-ab4b-4a09-b030-7603475b6b5d tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c77e08f31a4fab865b9b8dd1ffdc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b503b65f93a4a9dbbc5b319d85d8adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:12.990945 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a582add2-ab4b-4a09-b030-7603475b6b5d tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] 10.222.0.13 "GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34" status: 200 len: 1502 microversion: 2.1 time: 1.063321 May 27 15:28:12.991609 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2953/5910] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:11 2022] GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34 => generated 1502 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:28:13.385532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5695d018-9205-4606-9ae5-25751cbecc3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:13.394398 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5695d018-9205-4606-9ae5-25751cbecc3b tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1666 microversion: 2.1 time: 0.837951 May 27 15:28:13.409415 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2958/5911] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:12 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1666 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:13.975088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-3ce8d94f-a726-4c25-8765-f4600e49f4b0 req-d46089d7-bd58-4a77-883a-bcd363854ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c305985-e4b3-4a70-8ba7-0a7558d09c34", "name": "network-vif-deleted", "tag": "f96b44a1-d49b-40a0-bd1e-32c1a99460e4"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:28:14.008377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-51afb4be-15f6-4fc4-9194-640c3c37f64d tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:14.009812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-51afb4be-15f6-4fc4-9194-640c3c37f64d tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] [instance: 0c305985-e4b3-4a70-8ba7-0a7558d09c34] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:14.027582 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51afb4be-15f6-4fc4-9194-640c3c37f64d tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:14.030732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3ce8d94f-a726-4c25-8765-f4600e49f4b0 req-d46089d7-bd58-4a77-883a-bcd363854ff9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:14.032046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-3ce8d94f-a726-4c25-8765-f4600e49f4b0 req-d46089d7-bd58-4a77-883a-bcd363854ff9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:14.035801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51afb4be-15f6-4fc4-9194-640c3c37f64d tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:14.037079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51afb4be-15f6-4fc4-9194-640c3c37f64d tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:14.040095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51afb4be-15f6-4fc4-9194-640c3c37f64d tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:14.072115 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-3ce8d94f-a726-4c25-8765-f4600e49f4b0 req-d46089d7-bd58-4a77-883a-bcd363854ff9 service nova] Creating event network-vif-deleted:f96b44a1-d49b-40a0-bd1e-32c1a99460e4 for instance 0c305985-e4b3-4a70-8ba7-0a7558d09c34 on n-h2-843621-1 May 27 15:28:14.083319 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-3ce8d94f-a726-4c25-8765-f4600e49f4b0 req-d46089d7-bd58-4a77-883a-bcd363854ff9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112688 May 27 15:28:14.090450 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2954/5912] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:28:14.275371 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-51afb4be-15f6-4fc4-9194-640c3c37f64d tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9c77e08f31a4fab865b9b8dd1ffdc1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b503b65f93a4a9dbbc5b319d85d8adb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:14.289478 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-51afb4be-15f6-4fc4-9194-640c3c37f64d tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] 10.222.0.13 "GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34" status: 200 len: 1298 microversion: 2.1 time: 0.284993 May 27 15:28:14.290213 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2959/5913] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:14 2022] GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34 => generated 1298 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:28:14.427390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9433e25a-77d4-41c4-aec4-f325b9ccc992 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:14.428293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9433e25a-77d4-41c4-aec4-f325b9ccc992 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:14.454813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9433e25a-77d4-41c4-aec4-f325b9ccc992 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:14.457908 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9433e25a-77d4-41c4-aec4-f325b9ccc992 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:14.459050 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9433e25a-77d4-41c4-aec4-f325b9ccc992 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:14.459713 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9433e25a-77d4-41c4-aec4-f325b9ccc992 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:15.138185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9433e25a-77d4-41c4-aec4-f325b9ccc992 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:15.159599 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9433e25a-77d4-41c4-aec4-f325b9ccc992 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1666 microversion: 2.1 time: 0.736565 May 27 15:28:15.169342 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2955/5914] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:14 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1666 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:15.307277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-faf810df-e8cc-4e61-a453-38994f5c4ff8 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:15.308048 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-faf810df-e8cc-4e61-a453-38994f5c4ff8 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] [instance: 0c305985-e4b3-4a70-8ba7-0a7558d09c34] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:15.327659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-faf810df-e8cc-4e61-a453-38994f5c4ff8 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:15.330512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-faf810df-e8cc-4e61-a453-38994f5c4ff8 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:15.333297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-faf810df-e8cc-4e61-a453-38994f5c4ff8 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:15.338405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-faf810df-e8cc-4e61-a453-38994f5c4ff8 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:15.393560 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-faf810df-e8cc-4e61-a453-38994f5c4ff8 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] HTTP exception thrown: Instance 0c305985-e4b3-4a70-8ba7-0a7558d09c34 could not be found. May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-faf810df-e8cc-4e61-a453-38994f5c4ff8 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Request method failure captured: May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34 HTTP/1.1 May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikO3xi_3qwheQ7ffXLSiFTez-7egVch_RsxC7fctG7Zwg1PjtXK9fP1BhFAeVpjg4Kbrawg0Z99nshno6-B9b7EbvWHWSf4VXWXisLkAamR9-IT415Jr28mrEPS03b-_AoIAeOthe8z4gmty31KmSVK-hLKjU43YwgdPkDjVYG_9iPXM May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 5b503b65f93a4a9dbbc5b319d85d8adb May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-VolumesActionsTest-913789941 May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5b503b65f93a4a9dbbc5b319d85d8adb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5b503b65f93a4a9dbbc5b319d85d8adb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5b503b65f93a4a9dbbc5b319d85d8adb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5b503b65f93a4a9dbbc5b319d85d8adb", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-VolumesActionsTest-913789941 May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 5b503b65f93a4a9dbbc5b319d85d8adb May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-VolumesActionsTest-913789941 May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-VolumesActionsTest-913789941-project May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: f9c77e08f31a4fab865b9b8dd1ffdc1f May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-VolumesActionsTest-913789941-project May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 0c305985-e4b3-4a70-8ba7-0a7558d09c34 could not be found. May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '0c305985-e4b3-4a70-8ba7-0a7558d09c34'} May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c305985-e4b3-4a70-8ba7-0a7558d09c34 could not be found. May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c305985-e4b3-4a70-8ba7-0a7558d09c34 could not be found. May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:28:15.404137 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:15.411632 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:28:15.411632 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:28:15.411632 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:28:15.411632 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:28:15.411632 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:28:15.411632 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c305985-e4b3-4a70-8ba7-0a7558d09c34 could not be found. May 27 15:28:15.411632 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:15.411632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-faf810df-e8cc-4e61-a453-38994f5c4ff8 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] Returning 404 to user: Instance 0c305985-e4b3-4a70-8ba7-0a7558d09c34 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:28:15.413052 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-faf810df-e8cc-4e61-a453-38994f5c4ff8 tempest-VolumesActionsTest-913789941 tempest-VolumesActionsTest-913789941-project] 10.222.0.13 "GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34" status: 404 len: 111 microversion: 2.1 time: 0.106531 May 27 15:28:15.423223 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2960/5915] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:15 2022] GET /compute/v2.1/servers/0c305985-e4b3-4a70-8ba7-0a7558d09c34 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:28:16.191962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-85603101-94ed-4d58-9a5b-48ddf1250b11 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:16.195381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-85603101-94ed-4d58-9a5b-48ddf1250b11 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:16.230159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85603101-94ed-4d58-9a5b-48ddf1250b11 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:16.233129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85603101-94ed-4d58-9a5b-48ddf1250b11 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:16.234540 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85603101-94ed-4d58-9a5b-48ddf1250b11 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:16.235002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-85603101-94ed-4d58-9a5b-48ddf1250b11 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:16.935595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-85603101-94ed-4d58-9a5b-48ddf1250b11 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:16.946843 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-85603101-94ed-4d58-9a5b-48ddf1250b11 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.762851 May 27 15:28:16.948823 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2956/5916] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:16 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:16.965290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b9baae71-4c93-4fca-8757-16e674055c46 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:16.966790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b9baae71-4c93-4fca-8757-16e674055c46 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:16.981111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9baae71-4c93-4fca-8757-16e674055c46 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:16.983722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9baae71-4c93-4fca-8757-16e674055c46 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:16.985510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9baae71-4c93-4fca-8757-16e674055c46 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:16.987015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9baae71-4c93-4fca-8757-16e674055c46 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:17.501099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b9baae71-4c93-4fca-8757-16e674055c46 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:17.519733 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b9baae71-4c93-4fca-8757-16e674055c46 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1669 microversion: 2.1 time: 0.557748 May 27 15:28:17.522949 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2961/5917] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:16 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1669 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:17.539359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-94679a89-93fa-42ef-b2bd-a92520af2e0a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:17.540614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-94679a89-93fa-42ef-b2bd-a92520af2e0a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:17.552977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94679a89-93fa-42ef-b2bd-a92520af2e0a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:17.557638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94679a89-93fa-42ef-b2bd-a92520af2e0a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:17.558953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94679a89-93fa-42ef-b2bd-a92520af2e0a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:17.563802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94679a89-93fa-42ef-b2bd-a92520af2e0a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:17.621892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-94679a89-93fa-42ef-b2bd-a92520af2e0a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:28:17.630012 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.compute.api [None req-94679a89-93fa-42ef-b2bd-a92520af2e0a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Working on deleting snapshot 87060520-c62b-4319-8c9c-b96c7b8651f4 from shelved instance... May 27 15:28:19.059172 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-94679a89-93fa-42ef-b2bd-a92520af2e0a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Doing local delete in cell 57e0886a-3e0a-4a65-b585-e8d63742d44b(cell1) {{(pid=119248) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 27 15:28:19.060328 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94679a89-93fa-42ef-b2bd-a92520af2e0a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:19.061254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-94679a89-93fa-42ef-b2bd-a92520af2e0a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:19.061748 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.compute.api [None req-94679a89-93fa-42ef-b2bd-a92520af2e0a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 27 15:28:19.065376 n-d-843621-1 devstack@n-api.service[119248]: ERROR oslo.messaging._drivers.impl_rabbit [None req-94679a89-93fa-42ef-b2bd-a92520af2e0a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [e0ae02f9-ab4d-4eb0-908d-57b2829c01d9] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 15:28:20.097491 n-d-843621-1 devstack@n-api.service[119248]: INFO oslo.messaging._drivers.impl_rabbit [None req-94679a89-93fa-42ef-b2bd-a92520af2e0a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [e0ae02f9-ab4d-4eb0-908d-57b2829c01d9] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48898. May 27 15:28:20.107281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-94679a89-93fa-42ef-b2bd-a92520af2e0a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] deallocate_for_instance() {{(pid=119248) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} May 27 15:28:21.475262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-94679a89-93fa-42ef-b2bd-a92520af2e0a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Updating instance_info_cache with network_info: [] {{(pid=119248) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 27 15:28:21.524052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-4a09ec9a-8bde-47c4-b83e-78191c724ad4 req-d43cc928-afc5-4fb9-8d6d-1ad45cb75f92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e1ea07-7d87-45ab-81b9-fe8dc6544258", "name": "network-vif-deleted", "tag": "cae8ec95-5c5e-485f-bf31-56b814395525"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:28:21.548585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4a09ec9a-8bde-47c4-b83e-78191c724ad4 req-d43cc928-afc5-4fb9-8d6d-1ad45cb75f92 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:21.551776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4a09ec9a-8bde-47c4-b83e-78191c724ad4 req-d43cc928-afc5-4fb9-8d6d-1ad45cb75f92 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:21.588511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.compute.server_external_events [req-4a09ec9a-8bde-47c4-b83e-78191c724ad4 req-d43cc928-afc5-4fb9-8d6d-1ad45cb75f92 service nova] Unable to find a host for instance d6e1ea07-7d87-45ab-81b9-fe8dc6544258. Dropping event network-vif-deleted {{(pid=119249) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 27 15:28:21.598649 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-4a09ec9a-8bde-47c4-b83e-78191c724ad4 req-d43cc928-afc5-4fb9-8d6d-1ad45cb75f92 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.079468 May 27 15:28:21.605377 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2962/5918] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 87 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 27 15:28:22.384772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=8,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:22.406365 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-94679a89-93fa-42ef-b2bd-a92520af2e0a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 204 len: 0 microversion: 2.1 time: 4.870654 May 27 15:28:22.407216 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2957/5919] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:28:17 2022] DELETE /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 0 bytes in 4873 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:28:22.415839 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1cb7e300-85ee-437e-bd70-cc1ffcb7c761 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:22.416717 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1cb7e300-85ee-437e-bd70-cc1ffcb7c761 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d6e1ea07-7d87-45ab-81b9-fe8dc6544258] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:22.435334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1cb7e300-85ee-437e-bd70-cc1ffcb7c761 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:22.435816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1cb7e300-85ee-437e-bd70-cc1ffcb7c761 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:22.436637 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1cb7e300-85ee-437e-bd70-cc1ffcb7c761 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:22.437661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1cb7e300-85ee-437e-bd70-cc1ffcb7c761 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:22.493942 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-1cb7e300-85ee-437e-bd70-cc1ffcb7c761 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] HTTP exception thrown: Instance d6e1ea07-7d87-45ab-81b9-fe8dc6544258 could not be found. May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1cb7e300-85ee-437e-bd70-cc1ffcb7c761 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Request method failure captured: May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 HTTP/1.1 May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOwDliVCqTPMRyWTz5VCa0lJbDfMaiA5Q8VkkcxCOAy1xPsZUsWj5pPLtvKr9t-3Mp_2sGNauOrE6ab_oHFj_8BDEOrlb-yDaF-p_CCTZtMT8gxTV_PBncYxYUEN_u4cCR_nROmEBbSl3SF3qPihCPQBj05K88_94KDmUBFQNqLTUVE May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: e72c782a808345e093093ea95ce04ae4 May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerActionsTestJSON-1655989499 May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e72c782a808345e093093ea95ce04ae4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e72c782a808345e093093ea95ce04ae4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e72c782a808345e093093ea95ce04ae4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e72c782a808345e093093ea95ce04ae4", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerActionsTestJSON-1655989499 May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: e72c782a808345e093093ea95ce04ae4 May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerActionsTestJSON-1655989499 May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerActionsTestJSON-1655989499-project May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: f750b3f70eed4477a15c3529371a8af3 May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerActionsTestJSON-1655989499-project May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance d6e1ea07-7d87-45ab-81b9-fe8dc6544258 could not be found. May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'd6e1ea07-7d87-45ab-81b9-fe8dc6544258'} May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6e1ea07-7d87-45ab-81b9-fe8dc6544258 could not be found. May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6e1ea07-7d87-45ab-81b9-fe8dc6544258 could not be found. May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:28:22.501480 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:22.505261 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:28:22.505261 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:28:22.505261 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:28:22.505261 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:28:22.505261 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:28:22.505261 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6e1ea07-7d87-45ab-81b9-fe8dc6544258 could not be found. May 27 15:28:22.505261 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:22.505261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1cb7e300-85ee-437e-bd70-cc1ffcb7c761 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Returning 404 to user: Instance d6e1ea07-7d87-45ab-81b9-fe8dc6544258 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:28:22.505261 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1cb7e300-85ee-437e-bd70-cc1ffcb7c761 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258" status: 404 len: 111 microversion: 2.1 time: 0.091765 May 27 15:28:22.506025 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2963/5920] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:22 2022] GET /compute/v2.1/servers/d6e1ea07-7d87-45ab-81b9-fe8dc6544258 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:28:22.513797 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f4eb6240-9510-4181-b55c-eee9f55bd8ee tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:22.514432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f4eb6240-9510-4181-b55c-eee9f55bd8ee tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:22.528001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4eb6240-9510-4181-b55c-eee9f55bd8ee tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:22.530463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4eb6240-9510-4181-b55c-eee9f55bd8ee tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:22.532216 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4eb6240-9510-4181-b55c-eee9f55bd8ee tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:22.534271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f4eb6240-9510-4181-b55c-eee9f55bd8ee tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:22.601070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f4eb6240-9510-4181-b55c-eee9f55bd8ee tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:28:22.758699 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f4eb6240-9510-4181-b55c-eee9f55bd8ee tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "DELETE /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318" status: 204 len: 0 microversion: 2.1 time: 0.249677 May 27 15:28:22.759907 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2958/5921] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:28:22 2022] DELETE /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:28:22.772943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-448262d5-f958-42fd-97b0-a7e1b702cdc4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:22.773579 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-448262d5-f958-42fd-97b0-a7e1b702cdc4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:22.793899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-448262d5-f958-42fd-97b0-a7e1b702cdc4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:22.794578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-448262d5-f958-42fd-97b0-a7e1b702cdc4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:22.795544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-448262d5-f958-42fd-97b0-a7e1b702cdc4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:22.796132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-448262d5-f958-42fd-97b0-a7e1b702cdc4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:23.089799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-448262d5-f958-42fd-97b0-a7e1b702cdc4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:23.104335 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-448262d5-f958-42fd-97b0-a7e1b702cdc4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318" status: 200 len: 1467 microversion: 2.1 time: 0.338882 May 27 15:28:23.114713 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2964/5922] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:22 2022] GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318 => generated 1467 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:24.122026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-99ec1c16-4e73-49b4-a0d4-7e56e2183cf3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:24.123440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-99ec1c16-4e73-49b4-a0d4-7e56e2183cf3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:24.136877 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99ec1c16-4e73-49b4-a0d4-7e56e2183cf3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:24.147815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99ec1c16-4e73-49b4-a0d4-7e56e2183cf3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:24.150551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99ec1c16-4e73-49b4-a0d4-7e56e2183cf3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:24.152417 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99ec1c16-4e73-49b4-a0d4-7e56e2183cf3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:24.378591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-99ec1c16-4e73-49b4-a0d4-7e56e2183cf3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:24.388818 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-99ec1c16-4e73-49b4-a0d4-7e56e2183cf3 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318" status: 200 len: 1467 microversion: 2.1 time: 0.270925 May 27 15:28:24.389570 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2959/5923] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:24 2022] GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318 => generated 1467 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:25.322939 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-5ec5d88a-0eb8-4fae-8f77-6d741285155a req-df2f3332-d4d3-4cd3-84aa-b6538f387a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98fb50be-7fb6-438a-b017-724a1acde318", "name": "network-vif-deleted", "tag": "bc120629-208e-4b26-a2ad-82b5729fd42f"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:28:25.408156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ea87249e-4de4-4dde-bdcf-0d5506b3fdc0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:25.410124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ea87249e-4de4-4dde-bdcf-0d5506b3fdc0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:25.415487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-5ec5d88a-0eb8-4fae-8f77-6d741285155a req-df2f3332-d4d3-4cd3-84aa-b6538f387a81 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:25.415957 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-5ec5d88a-0eb8-4fae-8f77-6d741285155a req-df2f3332-d4d3-4cd3-84aa-b6538f387a81 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:25.465847 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-5ec5d88a-0eb8-4fae-8f77-6d741285155a req-df2f3332-d4d3-4cd3-84aa-b6538f387a81 service nova] Creating event network-vif-deleted:bc120629-208e-4b26-a2ad-82b5729fd42f for instance 98fb50be-7fb6-438a-b017-724a1acde318 on n-h2-843621-1 May 27 15:28:25.471177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea87249e-4de4-4dde-bdcf-0d5506b3fdc0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:25.472574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea87249e-4de4-4dde-bdcf-0d5506b3fdc0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:25.480995 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-5ec5d88a-0eb8-4fae-8f77-6d741285155a req-df2f3332-d4d3-4cd3-84aa-b6538f387a81 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173083 May 27 15:28:25.481474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea87249e-4de4-4dde-bdcf-0d5506b3fdc0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:25.481925 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea87249e-4de4-4dde-bdcf-0d5506b3fdc0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:25.483131 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2965/5924] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:28:25.723282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ea87249e-4de4-4dde-bdcf-0d5506b3fdc0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:25.732316 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ea87249e-4de4-4dde-bdcf-0d5506b3fdc0 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318" status: 200 len: 1300 microversion: 2.1 time: 0.329471 May 27 15:28:25.748099 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2960/5925] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:25 2022] GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318 => generated 1300 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:26.768132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f31d5bcf-73de-43b5-843b-4813184dbf7a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:26.768918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f31d5bcf-73de-43b5-843b-4813184dbf7a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 98fb50be-7fb6-438a-b017-724a1acde318] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:26.783875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=50 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:26.789346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f31d5bcf-73de-43b5-843b-4813184dbf7a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:26.789821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f31d5bcf-73de-43b5-843b-4813184dbf7a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:26.798730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f31d5bcf-73de-43b5-843b-4813184dbf7a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:26.799222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f31d5bcf-73de-43b5-843b-4813184dbf7a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:26.857545 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-f31d5bcf-73de-43b5-843b-4813184dbf7a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] HTTP exception thrown: Instance 98fb50be-7fb6-438a-b017-724a1acde318 could not be found. May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f31d5bcf-73de-43b5-843b-4813184dbf7a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Request method failure captured: May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318 HTTP/1.1 May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOwDliVCqTPMRyWTz5VCa0lJbDfMaiA5Q8VkkcxCOAy1xPsZUsWj5pPLtvKr9t-3Mp_2sGNauOrE6ab_oHFj_8BDEOrlb-yDaF-p_CCTZtMT8gxTV_PBncYxYUEN_u4cCR_nROmEBbSl3SF3qPihCPQBj05K88_94KDmUBFQNqLTUVE May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: e72c782a808345e093093ea95ce04ae4 May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerActionsTestJSON-1655989499 May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e72c782a808345e093093ea95ce04ae4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e72c782a808345e093093ea95ce04ae4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e72c782a808345e093093ea95ce04ae4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e72c782a808345e093093ea95ce04ae4", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerActionsTestJSON-1655989499 May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: e72c782a808345e093093ea95ce04ae4 May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerActionsTestJSON-1655989499 May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerActionsTestJSON-1655989499-project May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: f750b3f70eed4477a15c3529371a8af3 May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerActionsTestJSON-1655989499-project May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 98fb50be-7fb6-438a-b017-724a1acde318 could not be found. May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '98fb50be-7fb6-438a-b017-724a1acde318'} May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98fb50be-7fb6-438a-b017-724a1acde318 could not be found. May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98fb50be-7fb6-438a-b017-724a1acde318 could not be found. May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:28:26.859353 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:26.862860 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:28:26.862860 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:28:26.862860 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:28:26.862860 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:28:26.862860 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:28:26.862860 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98fb50be-7fb6-438a-b017-724a1acde318 could not be found. May 27 15:28:26.862860 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:26.862860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f31d5bcf-73de-43b5-843b-4813184dbf7a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Returning 404 to user: Instance 98fb50be-7fb6-438a-b017-724a1acde318 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:28:26.867240 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f31d5bcf-73de-43b5-843b-4813184dbf7a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318" status: 404 len: 111 microversion: 2.1 time: 0.109750 May 27 15:28:26.877087 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8aa970ae-c8a4-401b-bc36-c91af1ace739 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:26.878315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8aa970ae-c8a4-401b-bc36-c91af1ace739 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:26.884973 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2966/5926] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:26 2022] GET /compute/v2.1/servers/98fb50be-7fb6-438a-b017-724a1acde318 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:28:26.888732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8aa970ae-c8a4-401b-bc36-c91af1ace739 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:26.889493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8aa970ae-c8a4-401b-bc36-c91af1ace739 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:26.891062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8aa970ae-c8a4-401b-bc36-c91af1ace739 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:26.891741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8aa970ae-c8a4-401b-bc36-c91af1ace739 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:26.983052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8aa970ae-c8a4-401b-bc36-c91af1ace739 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:28:27.181223 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8aa970ae-c8a4-401b-bc36-c91af1ace739 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073" status: 204 len: 0 microversion: 2.1 time: 0.308383 May 27 15:28:27.181823 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2961/5927] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:28:26 2022] DELETE /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:28:27.192137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-64a52d09-0aa7-4e7b-9122-67a3223f13ed tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:27.193269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-64a52d09-0aa7-4e7b-9122-67a3223f13ed tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:27.200060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64a52d09-0aa7-4e7b-9122-67a3223f13ed tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:27.200782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64a52d09-0aa7-4e7b-9122-67a3223f13ed tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:27.201743 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64a52d09-0aa7-4e7b-9122-67a3223f13ed tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:27.203292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64a52d09-0aa7-4e7b-9122-67a3223f13ed tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:27.462891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-64a52d09-0aa7-4e7b-9122-67a3223f13ed tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:27.471698 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-64a52d09-0aa7-4e7b-9122-67a3223f13ed tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073" status: 200 len: 1506 microversion: 2.1 time: 0.285677 May 27 15:28:27.472505 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2967/5928] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:27 2022] GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073 => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:28.491184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ad4cf7ba-30d2-4449-954a-b4824ad5355a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:28.491910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ad4cf7ba-30d2-4449-954a-b4824ad5355a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:28.511227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad4cf7ba-30d2-4449-954a-b4824ad5355a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:28.511702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad4cf7ba-30d2-4449-954a-b4824ad5355a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:28.517746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad4cf7ba-30d2-4449-954a-b4824ad5355a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:28.518231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ad4cf7ba-30d2-4449-954a-b4824ad5355a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:28.872379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ad4cf7ba-30d2-4449-954a-b4824ad5355a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:28.887558 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ad4cf7ba-30d2-4449-954a-b4824ad5355a tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073" status: 200 len: 1506 microversion: 2.1 time: 0.401320 May 27 15:28:28.901530 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2962/5929] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:28 2022] GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073 => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:28:29.864050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-6b9cbb07-f6e6-4ca1-91f2-03fd64048395 req-c3f527d2-2d6f-4910-a6e5-d63c3f9d60bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d12645a-f630-4ffd-9a89-cfac16f7b073", "name": "network-vif-deleted", "tag": "faab2934-303a-4822-bbe9-ddeb58a28dea"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:28:29.880323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6b9cbb07-f6e6-4ca1-91f2-03fd64048395 req-c3f527d2-2d6f-4910-a6e5-d63c3f9d60bf service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:29.896167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6b9cbb07-f6e6-4ca1-91f2-03fd64048395 req-c3f527d2-2d6f-4910-a6e5-d63c3f9d60bf service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:29.911909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8d564fca-77c1-45b5-ad6d-8b79f66f8073 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:29.916210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8d564fca-77c1-45b5-ad6d-8b79f66f8073 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:29.951958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d564fca-77c1-45b5-ad6d-8b79f66f8073 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:29.954775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d564fca-77c1-45b5-ad6d-8b79f66f8073 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:29.956528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d564fca-77c1-45b5-ad6d-8b79f66f8073 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:29.959728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d564fca-77c1-45b5-ad6d-8b79f66f8073 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:29.974029 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-6b9cbb07-f6e6-4ca1-91f2-03fd64048395 req-c3f527d2-2d6f-4910-a6e5-d63c3f9d60bf service nova] Creating event network-vif-deleted:faab2934-303a-4822-bbe9-ddeb58a28dea for instance 2d12645a-f630-4ffd-9a89-cfac16f7b073 on n-h1-843621-1 May 27 15:28:29.997161 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-6b9cbb07-f6e6-4ca1-91f2-03fd64048395 req-c3f527d2-2d6f-4910-a6e5-d63c3f9d60bf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.619591 May 27 15:28:30.000310 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2968/5930] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:28:30.061418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d564fca-77c1-45b5-ad6d-8b79f66f8073 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:30.062439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d564fca-77c1-45b5-ad6d-8b79f66f8073 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:30.062917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-8d564fca-77c1-45b5-ad6d-8b79f66f8073 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lazy-loading 'fault' on Instance uuid 2d12645a-f630-4ffd-9a89-cfac16f7b073 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:28:30.196029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8d564fca-77c1-45b5-ad6d-8b79f66f8073 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:30.216572 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8d564fca-77c1-45b5-ad6d-8b79f66f8073 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073" status: 200 len: 1303 microversion: 2.1 time: 0.308233 May 27 15:28:30.220563 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2963/5931] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:29 2022] GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073 => generated 1303 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:31.244872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8ba565de-fa72-4e63-ba16-5f1350e1f58f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:31.246135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8ba565de-fa72-4e63-ba16-5f1350e1f58f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 2d12645a-f630-4ffd-9a89-cfac16f7b073] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:31.255940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ba565de-fa72-4e63-ba16-5f1350e1f58f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:31.256488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ba565de-fa72-4e63-ba16-5f1350e1f58f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:31.257568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ba565de-fa72-4e63-ba16-5f1350e1f58f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:31.267053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ba565de-fa72-4e63-ba16-5f1350e1f58f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:31.299034 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-8ba565de-fa72-4e63-ba16-5f1350e1f58f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] HTTP exception thrown: Instance 2d12645a-f630-4ffd-9a89-cfac16f7b073 could not be found. May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8ba565de-fa72-4e63-ba16-5f1350e1f58f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Request method failure captured: May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073 HTTP/1.1 May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOwDliVCqTPMRyWTz5VCa0lJbDfMaiA5Q8VkkcxCOAy1xPsZUsWj5pPLtvKr9t-3Mp_2sGNauOrE6ab_oHFj_8BDEOrlb-yDaF-p_CCTZtMT8gxTV_PBncYxYUEN_u4cCR_nROmEBbSl3SF3qPihCPQBj05K88_94KDmUBFQNqLTUVE May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: e72c782a808345e093093ea95ce04ae4 May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerActionsTestJSON-1655989499 May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e72c782a808345e093093ea95ce04ae4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e72c782a808345e093093ea95ce04ae4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e72c782a808345e093093ea95ce04ae4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e72c782a808345e093093ea95ce04ae4", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerActionsTestJSON-1655989499 May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: e72c782a808345e093093ea95ce04ae4 May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerActionsTestJSON-1655989499 May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerActionsTestJSON-1655989499-project May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: f750b3f70eed4477a15c3529371a8af3 May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerActionsTestJSON-1655989499-project May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 2d12645a-f630-4ffd-9a89-cfac16f7b073 could not be found. May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '2d12645a-f630-4ffd-9a89-cfac16f7b073'} May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d12645a-f630-4ffd-9a89-cfac16f7b073 could not be found. May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d12645a-f630-4ffd-9a89-cfac16f7b073 could not be found. May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:28:31.306776 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:31.310927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:28:31.310927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:28:31.310927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:28:31.310927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:28:31.310927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:28:31.310927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d12645a-f630-4ffd-9a89-cfac16f7b073 could not be found. May 27 15:28:31.310927 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:31.312453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8ba565de-fa72-4e63-ba16-5f1350e1f58f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Returning 404 to user: Instance 2d12645a-f630-4ffd-9a89-cfac16f7b073 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:28:31.313577 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8ba565de-fa72-4e63-ba16-5f1350e1f58f tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073" status: 404 len: 111 microversion: 2.1 time: 0.080547 May 27 15:28:31.315703 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2969/5932] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:31 2022] GET /compute/v2.1/servers/2d12645a-f630-4ffd-9a89-cfac16f7b073 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:28:31.323720 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d2af87bb-b12a-4fd5-b142-8bdb4d1381fe tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:31.324252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d2af87bb-b12a-4fd5-b142-8bdb4d1381fe tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:31.334424 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2af87bb-b12a-4fd5-b142-8bdb4d1381fe tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:31.344240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2af87bb-b12a-4fd5-b142-8bdb4d1381fe tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:31.345269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2af87bb-b12a-4fd5-b142-8bdb4d1381fe tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:31.346820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2af87bb-b12a-4fd5-b142-8bdb4d1381fe tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:31.433805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d2af87bb-b12a-4fd5-b142-8bdb4d1381fe tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:28:31.667904 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d2af87bb-b12a-4fd5-b142-8bdb4d1381fe tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 204 len: 0 microversion: 2.1 time: 0.345441 May 27 15:28:31.669239 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2964/5933] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:28:31 2022] DELETE /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:28:31.677374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8e039694-f89f-4d45-9086-7220f5faab38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:31.678015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8e039694-f89f-4d45-9086-7220f5faab38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:31.703319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e039694-f89f-4d45-9086-7220f5faab38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:31.703836 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e039694-f89f-4d45-9086-7220f5faab38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:31.716666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e039694-f89f-4d45-9086-7220f5faab38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:31.717245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e039694-f89f-4d45-9086-7220f5faab38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:32.348912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8e039694-f89f-4d45-9086-7220f5faab38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:32.358784 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8e039694-f89f-4d45-9086-7220f5faab38 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1496 microversion: 2.1 time: 0.685233 May 27 15:28:32.368045 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2970/5934] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:31 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1496 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:33.382627 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eedad8be-fc99-419f-bac4-e0da36de8f7c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:33.383979 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-eedad8be-fc99-419f-bac4-e0da36de8f7c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:33.407753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eedad8be-fc99-419f-bac4-e0da36de8f7c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:33.407753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eedad8be-fc99-419f-bac4-e0da36de8f7c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:33.408502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eedad8be-fc99-419f-bac4-e0da36de8f7c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:33.408963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eedad8be-fc99-419f-bac4-e0da36de8f7c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:33.559780 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-8315968a-c75a-42a4-9458-25c73b9c5df7 req-2f393f12-3c3a-42e3-be24-79cd51f88e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91e4fed-5552-40e8-842c-20a685a81620", "name": "network-vif-deleted", "tag": "6148066f-0357-4dd8-a86a-82427e608d1a"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:28:33.610420 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-8315968a-c75a-42a4-9458-25c73b9c5df7 req-2f393f12-3c3a-42e3-be24-79cd51f88e67 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:33.611092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-8315968a-c75a-42a4-9458-25c73b9c5df7 req-2f393f12-3c3a-42e3-be24-79cd51f88e67 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:33.659715 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-8315968a-c75a-42a4-9458-25c73b9c5df7 req-2f393f12-3c3a-42e3-be24-79cd51f88e67 service nova] Creating event network-vif-deleted:6148066f-0357-4dd8-a86a-82427e608d1a for instance d91e4fed-5552-40e8-842c-20a685a81620 on n-h2-843621-1 May 27 15:28:33.675315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eedad8be-fc99-419f-bac4-e0da36de8f7c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:33.690372 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-eedad8be-fc99-419f-bac4-e0da36de8f7c tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 200 len: 1454 microversion: 2.1 time: 0.312293 May 27 15:28:33.700246 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2965/5935] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:33 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 1454 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:33.702062 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-8315968a-c75a-42a4-9458-25c73b9c5df7 req-2f393f12-3c3a-42e3-be24-79cd51f88e67 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163618 May 27 15:28:33.704480 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2971/5936] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 27 15:28:34.715396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cabcc182-ab03-48bd-a086-b37135de76dc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:34.717052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cabcc182-ab03-48bd-a086-b37135de76dc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: d91e4fed-5552-40e8-842c-20a685a81620] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:34.737277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cabcc182-ab03-48bd-a086-b37135de76dc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:34.739358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cabcc182-ab03-48bd-a086-b37135de76dc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:34.748857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cabcc182-ab03-48bd-a086-b37135de76dc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:34.750492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cabcc182-ab03-48bd-a086-b37135de76dc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:34.792294 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-cabcc182-ab03-48bd-a086-b37135de76dc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] HTTP exception thrown: Instance d91e4fed-5552-40e8-842c-20a685a81620 could not be found. May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cabcc182-ab03-48bd-a086-b37135de76dc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Request method failure captured: May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 HTTP/1.1 May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikOwDliVCqTPMRyWTz5VCa0lJbDfMaiA5Q8VkkcxCOAy1xPsZUsWj5pPLtvKr9t-3Mp_2sGNauOrE6ab_oHFj_8BDEOrlb-yDaF-p_CCTZtMT8gxTV_PBncYxYUEN_u4cCR_nROmEBbSl3SF3qPihCPQBj05K88_94KDmUBFQNqLTUVE May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: e72c782a808345e093093ea95ce04ae4 May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerActionsTestJSON-1655989499 May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e72c782a808345e093093ea95ce04ae4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e72c782a808345e093093ea95ce04ae4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e72c782a808345e093093ea95ce04ae4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e72c782a808345e093093ea95ce04ae4", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerActionsTestJSON-1655989499 May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: e72c782a808345e093093ea95ce04ae4 May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerActionsTestJSON-1655989499 May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerActionsTestJSON-1655989499-project May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: f750b3f70eed4477a15c3529371a8af3 May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerActionsTestJSON-1655989499-project May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance d91e4fed-5552-40e8-842c-20a685a81620 could not be found. May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'd91e4fed-5552-40e8-842c-20a685a81620'} May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d91e4fed-5552-40e8-842c-20a685a81620 could not be found. May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d91e4fed-5552-40e8-842c-20a685a81620 could not be found. May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:28:34.794371 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:28:34.798739 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:28:34.798739 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:28:34.798739 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:28:34.798739 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:28:34.798739 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:28:34.798739 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d91e4fed-5552-40e8-842c-20a685a81620 could not be found. May 27 15:28:34.798739 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:28:34.813450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cabcc182-ab03-48bd-a086-b37135de76dc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Returning 404 to user: Instance d91e4fed-5552-40e8-842c-20a685a81620 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:28:34.813450 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cabcc182-ab03-48bd-a086-b37135de76dc tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620" status: 404 len: 111 microversion: 2.1 time: 0.100281 May 27 15:28:34.824849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-70e8658a-bd3d-49fa-9f7a-5869832db86d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:34.825576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-70e8658a-bd3d-49fa-9f7a-5869832db86d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:34.829507 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2966/5937] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:34 2022] GET /compute/v2.1/servers/d91e4fed-5552-40e8-842c-20a685a81620 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:28:34.838467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70e8658a-bd3d-49fa-9f7a-5869832db86d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:34.840616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70e8658a-bd3d-49fa-9f7a-5869832db86d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:34.844902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70e8658a-bd3d-49fa-9f7a-5869832db86d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:34.845479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70e8658a-bd3d-49fa-9f7a-5869832db86d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:34.901016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-70e8658a-bd3d-49fa-9f7a-5869832db86d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:28:34.909277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:35.102978 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-70e8658a-bd3d-49fa-9f7a-5869832db86d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "DELETE /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 204 len: 0 microversion: 2.1 time: 0.285135 May 27 15:28:35.108448 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2972/5938] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:28:34 2022] DELETE /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:28:35.113131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-98729615-62e8-4bd7-807c-c88c9e8fb490 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:35.114113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-98729615-62e8-4bd7-807c-c88c9e8fb490 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:35.123211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98729615-62e8-4bd7-807c-c88c9e8fb490 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:35.123674 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98729615-62e8-4bd7-807c-c88c9e8fb490 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:35.127179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98729615-62e8-4bd7-807c-c88c9e8fb490 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:35.127648 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98729615-62e8-4bd7-807c-c88c9e8fb490 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:35.402379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-98729615-62e8-4bd7-807c-c88c9e8fb490 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:35.451790 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-98729615-62e8-4bd7-807c-c88c9e8fb490 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1675 microversion: 2.1 time: 0.341966 May 27 15:28:35.453385 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2967/5939] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:35 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1675 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:36.472281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1a016d3a-226b-479e-96fd-491af3c17476 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:36.473850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1a016d3a-226b-479e-96fd-491af3c17476 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:36.485143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a016d3a-226b-479e-96fd-491af3c17476 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:36.485817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a016d3a-226b-479e-96fd-491af3c17476 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:36.486880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a016d3a-226b-479e-96fd-491af3c17476 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:36.487716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a016d3a-226b-479e-96fd-491af3c17476 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:36.706742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1a016d3a-226b-479e-96fd-491af3c17476 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:36.717807 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1a016d3a-226b-479e-96fd-491af3c17476 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1675 microversion: 2.1 time: 0.251328 May 27 15:28:36.723969 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2973/5940] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:36 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1675 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:37.741981 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-32d16250-6f0c-49ae-b974-ffc580891c03 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:37.743219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-32d16250-6f0c-49ae-b974-ffc580891c03 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:37.764615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32d16250-6f0c-49ae-b974-ffc580891c03 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:37.767234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32d16250-6f0c-49ae-b974-ffc580891c03 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:37.769008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32d16250-6f0c-49ae-b974-ffc580891c03 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:37.773057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32d16250-6f0c-49ae-b974-ffc580891c03 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:37.781728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:UPDATE=12,nova_cell1:DELETE=2,nova_cell1:SELECT=83,nova_cell1:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:38.208503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-32d16250-6f0c-49ae-b974-ffc580891c03 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:38.222831 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-32d16250-6f0c-49ae-b974-ffc580891c03 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1675 microversion: 2.1 time: 0.485112 May 27 15:28:38.223452 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2968/5941] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:37 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1675 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:38.990803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f739a3dd-3b15-408f-90df-e601327417e4 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1660853067", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:28:39.086903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-f739a3dd-3b15-408f-90df-e601327417e4 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] validate_networks() for None {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:28:39.148432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-5c320858-2e4f-4ca5-9670-f6d124f9e3dc req-f2ed6cea-6134-402f-9093-c648df87a247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812d42c0-07f1-4f7c-83b8-848b18cf0186", "name": "network-vif-deleted", "tag": "0d9da5e7-a50c-4ddd-aca9-02eae7d0476c"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:28:39.177239 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-5c320858-2e4f-4ca5-9670-f6d124f9e3dc req-f2ed6cea-6134-402f-9093-c648df87a247 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:39.177994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-5c320858-2e4f-4ca5-9670-f6d124f9e3dc req-f2ed6cea-6134-402f-9093-c648df87a247 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:39.237727 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-5c320858-2e4f-4ca5-9670-f6d124f9e3dc req-f2ed6cea-6134-402f-9093-c648df87a247 service nova] Creating event network-vif-deleted:0d9da5e7-a50c-4ddd-aca9-02eae7d0476c for instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 on n-h1-843621-1 May 27 15:28:39.258370 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-5c320858-2e4f-4ca5-9670-f6d124f9e3dc req-f2ed6cea-6134-402f-9093-c648df87a247 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112252 May 27 15:28:39.261079 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2969/5942] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:28:39.277267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-10cca632-a9f7-4906-8aa4-565c92837f7d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:39.279871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-10cca632-a9f7-4906-8aa4-565c92837f7d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:39.305009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10cca632-a9f7-4906-8aa4-565c92837f7d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:39.306194 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10cca632-a9f7-4906-8aa4-565c92837f7d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:39.309212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10cca632-a9f7-4906-8aa4-565c92837f7d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:39.310143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10cca632-a9f7-4906-8aa4-565c92837f7d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:39.427826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10cca632-a9f7-4906-8aa4-565c92837f7d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:39.432573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10cca632-a9f7-4906-8aa4-565c92837f7d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:39.433828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-10cca632-a9f7-4906-8aa4-565c92837f7d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lazy-loading 'fault' on Instance uuid 812d42c0-07f1-4f7c-83b8-848b18cf0186 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:28:39.617966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-10cca632-a9f7-4906-8aa4-565c92837f7d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f750b3f70eed4477a15c3529371a8af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72c782a808345e093093ea95ce04ae4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:39.656908 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-10cca632-a9f7-4906-8aa4-565c92837f7d tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 200 len: 1328 microversion: 2.1 time: 0.388634 May 27 15:28:39.658389 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2970/5943] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:39 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 1328 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:39.742002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f739a3dd-3b15-408f-90df-e601327417e4 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:28:39.742531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f739a3dd-3b15-408f-90df-e601327417e4 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:28:39.743061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f739a3dd-3b15-408f-90df-e601327417e4 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:28:39.743483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f739a3dd-3b15-408f-90df-e601327417e4 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:28:39.743913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f739a3dd-3b15-408f-90df-e601327417e4 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:28:39.768350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f739a3dd-3b15-408f-90df-e601327417e4 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:39.772562 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f739a3dd-3b15-408f-90df-e601327417e4 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:39.778039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f739a3dd-3b15-408f-90df-e601327417e4 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:39.780123 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f739a3dd-3b15-408f-90df-e601327417e4 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:39.846755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-f739a3dd-3b15-408f-90df-e601327417e4 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Getting quotas for project 41d23e3a9d4b4587b8bb4fc62a3898f9. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:28:39.861823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-f739a3dd-3b15-408f-90df-e601327417e4 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Getting quotas for user 933311285aae4d21b5b8c6b751c1e089 and project 41d23e3a9d4b4587b8bb4fc62a3898f9. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:28:39.901996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f739a3dd-3b15-408f-90df-e601327417e4 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:28:39.905788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f739a3dd-3b15-408f-90df-e601327417e4 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] [instance: d7a9feab-7189-41d0-9912-86f5df688b1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:28:40.023602 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f739a3dd-3b15-408f-90df-e601327417e4 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.037065 May 27 15:28:40.037657 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2974/5944] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:28:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:28:40.048987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-078666e4-1eed-4281-ae9a-d7046d9726df tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:40.049840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-078666e4-1eed-4281-ae9a-d7046d9726df tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] [instance: d7a9feab-7189-41d0-9912-86f5df688b1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:40.068756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=5 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:40.229777 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-078666e4-1eed-4281-ae9a-d7046d9726df tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933311285aae4d21b5b8c6b751c1e089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d23e3a9d4b4587b8bb4fc62a3898f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:40.246950 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-078666e4-1eed-4281-ae9a-d7046d9726df tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] 10.222.0.13 "GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f" status: 200 len: 1215 microversion: 2.1 time: 0.197553 May 27 15:28:40.252144 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2971/5945] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:40 2022] GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f => generated 1215 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:40.676158 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aa5ee9bd-84fd-499c-a630-b7caa6ba66b4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:40.677069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-aa5ee9bd-84fd-499c-a630-b7caa6ba66b4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] [instance: 812d42c0-07f1-4f7c-83b8-848b18cf0186] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:40.697032 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa5ee9bd-84fd-499c-a630-b7caa6ba66b4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:40.703111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa5ee9bd-84fd-499c-a630-b7caa6ba66b4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:40.706963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa5ee9bd-84fd-499c-a630-b7caa6ba66b4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:40.708589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa5ee9bd-84fd-499c-a630-b7caa6ba66b4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:40.759980 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-aa5ee9bd-84fd-499c-a630-b7caa6ba66b4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] HTTP exception thrown: Instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 could not be found. May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aa5ee9bd-84fd-499c-a630-b7caa6ba66b4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Request method failure captured: May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 HTTP/1.1 May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikOwDliVCqTPMRyWTz5VCa0lJbDfMaiA5Q8VkkcxCOAy1xPsZUsWj5pPLtvKr9t-3Mp_2sGNauOrE6ab_oHFj_8BDEOrlb-yDaF-p_CCTZtMT8gxTV_PBncYxYUEN_u4cCR_nROmEBbSl3SF3qPihCPQBj05K88_94KDmUBFQNqLTUVE May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: e72c782a808345e093093ea95ce04ae4 May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerActionsTestJSON-1655989499 May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e72c782a808345e093093ea95ce04ae4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e72c782a808345e093093ea95ce04ae4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e72c782a808345e093093ea95ce04ae4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e72c782a808345e093093ea95ce04ae4", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerActionsTestJSON-1655989499 May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: e72c782a808345e093093ea95ce04ae4 May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerActionsTestJSON-1655989499 May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerActionsTestJSON-1655989499-project May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: f750b3f70eed4477a15c3529371a8af3 May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerActionsTestJSON-1655989499-project May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 could not be found. May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '812d42c0-07f1-4f7c-83b8-848b18cf0186'} May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 could not be found. May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 could not be found. May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:28:40.761812 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:40.766915 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:28:40.766915 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:28:40.766915 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:28:40.766915 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:28:40.766915 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:28:40.766915 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 could not be found. May 27 15:28:40.766915 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:28:40.766915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aa5ee9bd-84fd-499c-a630-b7caa6ba66b4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Returning 404 to user: Instance 812d42c0-07f1-4f7c-83b8-848b18cf0186 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:28:40.773522 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-aa5ee9bd-84fd-499c-a630-b7caa6ba66b4 tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186" status: 404 len: 111 microversion: 2.1 time: 0.092580 May 27 15:28:40.774314 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2975/5946] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:40 2022] GET /compute/v2.1/servers/812d42c0-07f1-4f7c-83b8-848b18cf0186 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:28:40.783151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c31c8407-5994-45f8-92d1-c00a452395fa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] Calling method '.version_select at 0x7fc7753c1d30>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:40.838236 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c31c8407-5994-45f8-92d1-c00a452395fa tempest-ServerActionsTestJSON-1655989499 tempest-ServerActionsTestJSON-1655989499-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1881861425" status: 202 len: 0 microversion: 2.1 time: 0.059114 May 27 15:28:40.838830 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2972/5947] 10.222.0.13 () {58 vars in 1220 bytes} [Fri May 27 15:28:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1881861425 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:28:41.269147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d1b4e9eb-05e3-4a64-96f6-37e61a120596 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:41.269776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d1b4e9eb-05e3-4a64-96f6-37e61a120596 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] [instance: d7a9feab-7189-41d0-9912-86f5df688b1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:41.561826 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d1b4e9eb-05e3-4a64-96f6-37e61a120596 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933311285aae4d21b5b8c6b751c1e089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d23e3a9d4b4587b8bb4fc62a3898f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:41.585765 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d1b4e9eb-05e3-4a64-96f6-37e61a120596 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] 10.222.0.13 "GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f" status: 200 len: 1215 microversion: 2.1 time: 0.320845 May 27 15:28:41.600571 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2976/5948] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:41 2022] GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f => generated 1215 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:42.617498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d258afb0-120d-4d71-875b-b932a85039f9 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:42.618334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d258afb0-120d-4d71-875b-b932a85039f9 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] [instance: d7a9feab-7189-41d0-9912-86f5df688b1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:42.637854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d258afb0-120d-4d71-875b-b932a85039f9 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:42.641854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d258afb0-120d-4d71-875b-b932a85039f9 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:42.642916 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d258afb0-120d-4d71-875b-b932a85039f9 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:42.643561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d258afb0-120d-4d71-875b-b932a85039f9 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:42.893698 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d258afb0-120d-4d71-875b-b932a85039f9 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933311285aae4d21b5b8c6b751c1e089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d23e3a9d4b4587b8bb4fc62a3898f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:42.911495 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d258afb0-120d-4d71-875b-b932a85039f9 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] 10.222.0.13 "GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f" status: 200 len: 1275 microversion: 2.1 time: 0.305989 May 27 15:28:42.912104 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2973/5949] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:42 2022] GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f => generated 1275 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:43.930345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6f8a86ba-345c-40c2-a873-805e5d0255c8 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:43.931655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6f8a86ba-345c-40c2-a873-805e5d0255c8 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] [instance: d7a9feab-7189-41d0-9912-86f5df688b1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:43.952862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f8a86ba-345c-40c2-a873-805e5d0255c8 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:43.961765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f8a86ba-345c-40c2-a873-805e5d0255c8 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:43.963078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f8a86ba-345c-40c2-a873-805e5d0255c8 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:43.971314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f8a86ba-345c-40c2-a873-805e5d0255c8 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:44.326635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6f8a86ba-345c-40c2-a873-805e5d0255c8 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933311285aae4d21b5b8c6b751c1e089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d23e3a9d4b4587b8bb4fc62a3898f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:44.337253 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6f8a86ba-345c-40c2-a873-805e5d0255c8 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] 10.222.0.13 "GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f" status: 200 len: 1273 microversion: 2.1 time: 0.411842 May 27 15:28:44.350074 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2977/5950] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:43 2022] GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f => generated 1273 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:45.369592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4a15112b-b83c-459d-9698-760c31e76a00 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:45.372071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4a15112b-b83c-459d-9698-760c31e76a00 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] [instance: d7a9feab-7189-41d0-9912-86f5df688b1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:45.401746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a15112b-b83c-459d-9698-760c31e76a00 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:45.402704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a15112b-b83c-459d-9698-760c31e76a00 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:45.408122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a15112b-b83c-459d-9698-760c31e76a00 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:45.408707 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4a15112b-b83c-459d-9698-760c31e76a00 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:47.300751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4a15112b-b83c-459d-9698-760c31e76a00 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933311285aae4d21b5b8c6b751c1e089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d23e3a9d4b4587b8bb4fc62a3898f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:47.308921 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4a15112b-b83c-459d-9698-760c31e76a00 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] 10.222.0.13 "GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f" status: 200 len: 1315 microversion: 2.1 time: 1.945804 May 27 15:28:47.315527 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2974/5951] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:45 2022] GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f => generated 1315 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:48.192003 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-058ba35c-0225-40fb-8d89-3c16b39d4486 req-7e1a704b-8025-4904-8e74-572c7da1289d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a9feab-7189-41d0-9912-86f5df688b1f", "tag": "059e4796-decd-425e-8c28-b54b0061dfbd"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:28:48.222934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-058ba35c-0225-40fb-8d89-3c16b39d4486 req-7e1a704b-8025-4904-8e74-572c7da1289d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:48.224657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-058ba35c-0225-40fb-8d89-3c16b39d4486 req-7e1a704b-8025-4904-8e74-572c7da1289d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:48.240062 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-058ba35c-0225-40fb-8d89-3c16b39d4486 req-7e1a704b-8025-4904-8e74-572c7da1289d service nova] Creating event network-changed:059e4796-decd-425e-8c28-b54b0061dfbd for instance d7a9feab-7189-41d0-9912-86f5df688b1f on n-h2-843621-1 May 27 15:28:48.245840 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-058ba35c-0225-40fb-8d89-3c16b39d4486 req-7e1a704b-8025-4904-8e74-572c7da1289d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058574 May 27 15:28:48.247006 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2978/5952] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:28:48.332055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9e61725d-2642-4237-818a-0e214d518c16 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:48.333429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9e61725d-2642-4237-818a-0e214d518c16 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] [instance: d7a9feab-7189-41d0-9912-86f5df688b1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:48.363149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e61725d-2642-4237-818a-0e214d518c16 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:48.363833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e61725d-2642-4237-818a-0e214d518c16 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:48.364796 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e61725d-2642-4237-818a-0e214d518c16 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:48.365468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e61725d-2642-4237-818a-0e214d518c16 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:48.851949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9e61725d-2642-4237-818a-0e214d518c16 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933311285aae4d21b5b8c6b751c1e089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d23e3a9d4b4587b8bb4fc62a3898f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:48.864069 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9e61725d-2642-4237-818a-0e214d518c16 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] 10.222.0.13 "GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f" status: 200 len: 1315 microversion: 2.1 time: 0.535898 May 27 15:28:48.875241 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2975/5953] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:48 2022] GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:49.885898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-05572a6b-9d41-468f-83f3-8fb9e4f0ad7e tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:49.886609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-05572a6b-9d41-468f-83f3-8fb9e4f0ad7e tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] [instance: d7a9feab-7189-41d0-9912-86f5df688b1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:49.902214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:49.916079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05572a6b-9d41-468f-83f3-8fb9e4f0ad7e tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:49.916607 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05572a6b-9d41-468f-83f3-8fb9e4f0ad7e tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:49.917472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05572a6b-9d41-468f-83f3-8fb9e4f0ad7e tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:49.917923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05572a6b-9d41-468f-83f3-8fb9e4f0ad7e tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:50.165714 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-05572a6b-9d41-468f-83f3-8fb9e4f0ad7e tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933311285aae4d21b5b8c6b751c1e089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d23e3a9d4b4587b8bb4fc62a3898f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:50.173736 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-05572a6b-9d41-468f-83f3-8fb9e4f0ad7e tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] 10.222.0.13 "GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f" status: 200 len: 1315 microversion: 2.1 time: 0.292031 May 27 15:28:50.178095 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2979/5954] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:49 2022] GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:51.195184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0acf22bd-43a4-4c8f-932a-2a96f95693a0 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:51.196345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0acf22bd-43a4-4c8f-932a-2a96f95693a0 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] [instance: d7a9feab-7189-41d0-9912-86f5df688b1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:51.205526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:51.218956 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0acf22bd-43a4-4c8f-932a-2a96f95693a0 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:51.219443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0acf22bd-43a4-4c8f-932a-2a96f95693a0 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:51.220278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0acf22bd-43a4-4c8f-932a-2a96f95693a0 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:51.221302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0acf22bd-43a4-4c8f-932a-2a96f95693a0 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:51.644912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0acf22bd-43a4-4c8f-932a-2a96f95693a0 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933311285aae4d21b5b8c6b751c1e089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d23e3a9d4b4587b8bb4fc62a3898f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:51.659633 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0acf22bd-43a4-4c8f-932a-2a96f95693a0 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] 10.222.0.13 "GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f" status: 200 len: 1315 microversion: 2.1 time: 0.465535 May 27 15:28:51.669532 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2976/5955] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:51 2022] GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:52.680774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8e600a75-4595-4e71-ac19-9850906f31aa tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:52.681412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8e600a75-4595-4e71-ac19-9850906f31aa tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] [instance: d7a9feab-7189-41d0-9912-86f5df688b1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:52.704562 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=8 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:52.712933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e600a75-4595-4e71-ac19-9850906f31aa tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:52.716188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e600a75-4595-4e71-ac19-9850906f31aa tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:52.721372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e600a75-4595-4e71-ac19-9850906f31aa tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:52.723548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e600a75-4595-4e71-ac19-9850906f31aa tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:53.043362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8e600a75-4595-4e71-ac19-9850906f31aa tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933311285aae4d21b5b8c6b751c1e089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d23e3a9d4b4587b8bb4fc62a3898f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:53.052932 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8e600a75-4595-4e71-ac19-9850906f31aa tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] 10.222.0.13 "GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f" status: 200 len: 1315 microversion: 2.1 time: 0.376098 May 27 15:28:53.054059 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2980/5956] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:52 2022] GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:53.475584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-abee371a-9b94-4630-8f68-3c0b28178cff req-5ca33959-95e4-4644-b500-f38c48c72c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a9feab-7189-41d0-9912-86f5df688b1f", "name": "network-vif-plugged", "status": "completed", "tag": "059e4796-decd-425e-8c28-b54b0061dfbd"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:28:53.502742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-abee371a-9b94-4630-8f68-3c0b28178cff req-5ca33959-95e4-4644-b500-f38c48c72c9e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:53.504186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-abee371a-9b94-4630-8f68-3c0b28178cff req-5ca33959-95e4-4644-b500-f38c48c72c9e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:53.547435 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-abee371a-9b94-4630-8f68-3c0b28178cff req-5ca33959-95e4-4644-b500-f38c48c72c9e service nova] Creating event network-vif-plugged:059e4796-decd-425e-8c28-b54b0061dfbd for instance d7a9feab-7189-41d0-9912-86f5df688b1f on n-h2-843621-1 May 27 15:28:53.558770 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-abee371a-9b94-4630-8f68-3c0b28178cff req-5ca33959-95e4-4644-b500-f38c48c72c9e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093636 May 27 15:28:53.564880 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2977/5957] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:28:54.070257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-21f0f4de-5f0b-4407-8bac-56db546ac1bb tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:54.071600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-21f0f4de-5f0b-4407-8bac-56db546ac1bb tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] [instance: d7a9feab-7189-41d0-9912-86f5df688b1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:54.081259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21f0f4de-5f0b-4407-8bac-56db546ac1bb tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:54.088383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21f0f4de-5f0b-4407-8bac-56db546ac1bb tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:54.089903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21f0f4de-5f0b-4407-8bac-56db546ac1bb tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:54.094332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21f0f4de-5f0b-4407-8bac-56db546ac1bb tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:54.636204 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-21f0f4de-5f0b-4407-8bac-56db546ac1bb tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933311285aae4d21b5b8c6b751c1e089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d23e3a9d4b4587b8bb4fc62a3898f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:54.658438 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-21f0f4de-5f0b-4407-8bac-56db546ac1bb tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] 10.222.0.13 "GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f" status: 200 len: 1315 microversion: 2.1 time: 0.586639 May 27 15:28:54.659034 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2981/5958] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:54 2022] GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:55.677387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-edc426db-bc11-410c-a37b-519a87d20697 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:55.678398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-edc426db-bc11-410c-a37b-519a87d20697 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] [instance: d7a9feab-7189-41d0-9912-86f5df688b1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:55.697395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-edc426db-bc11-410c-a37b-519a87d20697 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:55.697635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-edc426db-bc11-410c-a37b-519a87d20697 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:55.698468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-edc426db-bc11-410c-a37b-519a87d20697 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:55.699377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-edc426db-bc11-410c-a37b-519a87d20697 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:56.110639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-edc426db-bc11-410c-a37b-519a87d20697 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933311285aae4d21b5b8c6b751c1e089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d23e3a9d4b4587b8bb4fc62a3898f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:56.118693 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-edc426db-bc11-410c-a37b-519a87d20697 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] 10.222.0.13 "GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f" status: 200 len: 1465 microversion: 2.1 time: 0.446623 May 27 15:28:56.119206 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2978/5959] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:55 2022] GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f => generated 1465 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:56.179586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dd63f636-9c96-4854-84ac-ad8b86c16bb9 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:56.180106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dd63f636-9c96-4854-84ac-ad8b86c16bb9 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] [instance: d7a9feab-7189-41d0-9912-86f5df688b1f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:56.194133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd63f636-9c96-4854-84ac-ad8b86c16bb9 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:56.194491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd63f636-9c96-4854-84ac-ad8b86c16bb9 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:56.196617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd63f636-9c96-4854-84ac-ad8b86c16bb9 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:56.198637 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dd63f636-9c96-4854-84ac-ad8b86c16bb9 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:56.285343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dd63f636-9c96-4854-84ac-ad8b86c16bb9 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] [instance: d7a9feab-7189-41d0-9912-86f5df688b1f] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:28:56.514068 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dd63f636-9c96-4854-84ac-ad8b86c16bb9 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f" status: 204 len: 0 microversion: 2.1 time: 0.339348 May 27 15:28:56.519444 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2982/5960] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:28:56 2022] DELETE /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:28:56.535766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7f4e84b3-fb9c-4157-8a3e-140d00106303 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:56.536445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7f4e84b3-fb9c-4157-8a3e-140d00106303 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] [instance: d7a9feab-7189-41d0-9912-86f5df688b1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:56.553947 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f4e84b3-fb9c-4157-8a3e-140d00106303 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:56.554319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f4e84b3-fb9c-4157-8a3e-140d00106303 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:56.556602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f4e84b3-fb9c-4157-8a3e-140d00106303 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:56.557092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f4e84b3-fb9c-4157-8a3e-140d00106303 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:56.832284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7f4e84b3-fb9c-4157-8a3e-140d00106303 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933311285aae4d21b5b8c6b751c1e089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d23e3a9d4b4587b8bb4fc62a3898f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:56.848229 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7f4e84b3-fb9c-4157-8a3e-140d00106303 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] 10.222.0.13 "GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f" status: 200 len: 1471 microversion: 2.1 time: 0.326551 May 27 15:28:56.850541 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2979/5961] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:56 2022] GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f => generated 1471 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:28:57.867762 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cc06dc78-3652-4281-b92e-3a3928b78550 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:57.868460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cc06dc78-3652-4281-b92e-3a3928b78550 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] [instance: d7a9feab-7189-41d0-9912-86f5df688b1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:57.893673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cc06dc78-3652-4281-b92e-3a3928b78550 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:57.896040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cc06dc78-3652-4281-b92e-3a3928b78550 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:57.899577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cc06dc78-3652-4281-b92e-3a3928b78550 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:57.902256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cc06dc78-3652-4281-b92e-3a3928b78550 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:58.272888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9a354113-ee47-4114-970d-d308a2f3ab4c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1174865110", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "eae34bac-ba61-4843-85ca-a4534081bb11"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:28:58.312624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:28:58.315153 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cc06dc78-3652-4281-b92e-3a3928b78550 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933311285aae4d21b5b8c6b751c1e089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d23e3a9d4b4587b8bb4fc62a3898f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:58.323889 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cc06dc78-3652-4281-b92e-3a3928b78550 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] 10.222.0.13 "GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f" status: 200 len: 1471 microversion: 2.1 time: 0.460675 May 27 15:28:58.338305 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2980/5962] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:57 2022] GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f => generated 1471 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:58.399536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-9a354113-ee47-4114-970d-d308a2f3ab4c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] validate_networks() for [('eae34bac-ba61-4843-85ca-a4534081bb11', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:28:59.009716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-8074df59-9e08-4193-93ea-3f2ada226ab6 req-aae9ff53-4d23-4da3-8a2d-d6b3f68d79c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a9feab-7189-41d0-9912-86f5df688b1f", "name": "network-vif-deleted", "tag": "059e4796-decd-425e-8c28-b54b0061dfbd"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:28:59.030706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-8074df59-9e08-4193-93ea-3f2ada226ab6 req-aae9ff53-4d23-4da3-8a2d-d6b3f68d79c0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:59.032334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-8074df59-9e08-4193-93ea-3f2ada226ab6 req-aae9ff53-4d23-4da3-8a2d-d6b3f68d79c0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:59.091238 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-8074df59-9e08-4193-93ea-3f2ada226ab6 req-aae9ff53-4d23-4da3-8a2d-d6b3f68d79c0 service nova] Creating event network-vif-deleted:059e4796-decd-425e-8c28-b54b0061dfbd for instance d7a9feab-7189-41d0-9912-86f5df688b1f on n-h2-843621-1 May 27 15:28:59.106077 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-8074df59-9e08-4193-93ea-3f2ada226ab6 req-aae9ff53-4d23-4da3-8a2d-d6b3f68d79c0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108069 May 27 15:28:59.113155 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2981/5963] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:28:59.238212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-9a354113-ee47-4114-970d-d308a2f3ab4c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:28:59.238660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-9a354113-ee47-4114-970d-d308a2f3ab4c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:28:59.239228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-9a354113-ee47-4114-970d-d308a2f3ab4c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:28:59.239665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-9a354113-ee47-4114-970d-d308a2f3ab4c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:28:59.240631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-9a354113-ee47-4114-970d-d308a2f3ab4c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:28:59.258849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a354113-ee47-4114-970d-d308a2f3ab4c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:59.259412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a354113-ee47-4114-970d-d308a2f3ab4c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:59.260319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a354113-ee47-4114-970d-d308a2f3ab4c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:59.261021 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a354113-ee47-4114-970d-d308a2f3ab4c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:59.290478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-9a354113-ee47-4114-970d-d308a2f3ab4c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Getting quotas for project 7e9b873aac1e4c749b6569d0a43388f8. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:28:59.301121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-9a354113-ee47-4114-970d-d308a2f3ab4c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Getting quotas for user a501d0e6dfb945bda510d3cc3f7e67a2 and project 7e9b873aac1e4c749b6569d0a43388f8. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:28:59.319344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9a354113-ee47-4114-970d-d308a2f3ab4c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:28:59.322143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9a354113-ee47-4114-970d-d308a2f3ab4c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:28:59.345272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bf5f95fa-c3e0-4d0a-b9ca-f49370d78577 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:59.346122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bf5f95fa-c3e0-4d0a-b9ca-f49370d78577 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] [instance: d7a9feab-7189-41d0-9912-86f5df688b1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:59.384382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf5f95fa-c3e0-4d0a-b9ca-f49370d78577 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:59.386066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf5f95fa-c3e0-4d0a-b9ca-f49370d78577 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:59.387749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf5f95fa-c3e0-4d0a-b9ca-f49370d78577 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:59.389498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf5f95fa-c3e0-4d0a-b9ca-f49370d78577 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:59.398020 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9a354113-ee47-4114-970d-d308a2f3ab4c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.736429 May 27 15:28:59.403114 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2983/5964] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:28:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:28:59.431466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3c9e526d-1bf3-44eb-a3f5-da141b842339 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:28:59.432103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3c9e526d-1bf3-44eb-a3f5-da141b842339 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:28:59.504218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf5f95fa-c3e0-4d0a-b9ca-f49370d78577 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:28:59.507011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf5f95fa-c3e0-4d0a-b9ca-f49370d78577 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:28:59.508306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-bf5f95fa-c3e0-4d0a-b9ca-f49370d78577 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lazy-loading 'fault' on Instance uuid d7a9feab-7189-41d0-9912-86f5df688b1f {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:28:59.533209 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3c9e526d-1bf3-44eb-a3f5-da141b842339 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a501d0e6dfb945bda510d3cc3f7e67a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b873aac1e4c749b6569d0a43388f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:59.546584 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3c9e526d-1bf3-44eb-a3f5-da141b842339 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] 10.222.0.13 "GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6" status: 200 len: 1216 microversion: 2.1 time: 0.133380 May 27 15:28:59.547843 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2984/5965] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:59 2022] GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 => generated 1216 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:28:59.591977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bf5f95fa-c3e0-4d0a-b9ca-f49370d78577 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933311285aae4d21b5b8c6b751c1e089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41d23e3a9d4b4587b8bb4fc62a3898f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:28:59.604769 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bf5f95fa-c3e0-4d0a-b9ca-f49370d78577 tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] 10.222.0.13 "GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f" status: 200 len: 1305 microversion: 2.1 time: 0.266182 May 27 15:28:59.617859 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2982/5966] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:28:59 2022] GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f => generated 1305 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:00.563461 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6d1745fa-a002-45c0-a221-af7d40a00386 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:00.564277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6d1745fa-a002-45c0-a221-af7d40a00386 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:00.577979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d1745fa-a002-45c0-a221-af7d40a00386 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:00.584836 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d1745fa-a002-45c0-a221-af7d40a00386 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:00.585972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d1745fa-a002-45c0-a221-af7d40a00386 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:00.586685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d1745fa-a002-45c0-a221-af7d40a00386 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:00.623168 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c50c38d2-1d82-400a-8fb9-f4816b43f06b tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:00.624932 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c50c38d2-1d82-400a-8fb9-f4816b43f06b tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] [instance: d7a9feab-7189-41d0-9912-86f5df688b1f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:00.643735 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c50c38d2-1d82-400a-8fb9-f4816b43f06b tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:00.648068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c50c38d2-1d82-400a-8fb9-f4816b43f06b tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:00.649225 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c50c38d2-1d82-400a-8fb9-f4816b43f06b tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:00.656219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c50c38d2-1d82-400a-8fb9-f4816b43f06b tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:00.746703 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6d1745fa-a002-45c0-a221-af7d40a00386 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a501d0e6dfb945bda510d3cc3f7e67a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b873aac1e4c749b6569d0a43388f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:00.761760 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6d1745fa-a002-45c0-a221-af7d40a00386 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] 10.222.0.13 "GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6" status: 200 len: 1268 microversion: 2.1 time: 0.202065 May 27 15:29:00.763833 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2985/5967] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:00 2022] GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 => generated 1268 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:01.244621 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-c50c38d2-1d82-400a-8fb9-f4816b43f06b tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] HTTP exception thrown: Instance d7a9feab-7189-41d0-9912-86f5df688b1f could not be found. May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c50c38d2-1d82-400a-8fb9-f4816b43f06b tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Request method failure captured: May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f HTTP/1.1 May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikO4hqJudLPfFzvziRL-7saL_YTwV_VQiZJw4_zWD_w9lE80HRJyYw8keGfn-vBf7B1WonapeCQnjORncSlv83e5biuu9sD_YO65Ee2UjYNF46f4BSu41yJ1jUFyYsDrPXgd0gimTqQfcyWRO4tiX9tvUBBTCoSkKEhrf3wYi3CwJnBs May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 41d23e3a9d4b4587b8bb4fc62a3898f9 May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-VolumesNegativeTest-2043950538 May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/41d23e3a9d4b4587b8bb4fc62a3898f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/41d23e3a9d4b4587b8bb4fc62a3898f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/41d23e3a9d4b4587b8bb4fc62a3898f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_41d23e3a9d4b4587b8bb4fc62a3898f9", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-VolumesNegativeTest-2043950538 May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 41d23e3a9d4b4587b8bb4fc62a3898f9 May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-VolumesNegativeTest-2043950538 May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-VolumesNegativeTest-2043950538-project May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 933311285aae4d21b5b8c6b751c1e089 May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-VolumesNegativeTest-2043950538-project May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance d7a9feab-7189-41d0-9912-86f5df688b1f could not be found. May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'd7a9feab-7189-41d0-9912-86f5df688b1f'} May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a9feab-7189-41d0-9912-86f5df688b1f could not be found. May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a9feab-7189-41d0-9912-86f5df688b1f could not be found. May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:29:01.246362 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:29:01.250454 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:29:01.250454 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:29:01.250454 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:29:01.250454 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:29:01.250454 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:29:01.250454 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a9feab-7189-41d0-9912-86f5df688b1f could not be found. May 27 15:29:01.250454 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:29:01.252080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c50c38d2-1d82-400a-8fb9-f4816b43f06b tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] Returning 404 to user: Instance d7a9feab-7189-41d0-9912-86f5df688b1f could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:29:01.253310 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c50c38d2-1d82-400a-8fb9-f4816b43f06b tempest-VolumesNegativeTest-2043950538 tempest-VolumesNegativeTest-2043950538-project] 10.222.0.13 "GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f" status: 404 len: 111 microversion: 2.1 time: 0.634137 May 27 15:29:01.254414 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2983/5968] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:00 2022] GET /compute/v2.1/servers/d7a9feab-7189-41d0-9912-86f5df688b1f => generated 111 bytes in 636 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:29:01.789299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e180b042-0535-410f-8cbf-3a230127578c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:01.790081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e180b042-0535-410f-8cbf-3a230127578c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:01.808986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e180b042-0535-410f-8cbf-3a230127578c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:01.809662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e180b042-0535-410f-8cbf-3a230127578c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:01.811751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e180b042-0535-410f-8cbf-3a230127578c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:01.813053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e180b042-0535-410f-8cbf-3a230127578c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:01.974588 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e180b042-0535-410f-8cbf-3a230127578c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a501d0e6dfb945bda510d3cc3f7e67a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b873aac1e4c749b6569d0a43388f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:01.985302 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e180b042-0535-410f-8cbf-3a230127578c tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] 10.222.0.13 "GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6" status: 200 len: 1274 microversion: 2.1 time: 0.202053 May 27 15:29:01.994357 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2986/5969] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:01 2022] GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 => generated 1274 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:03.013105 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5dd8ed19-dc14-4606-b7db-3327679daa5d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:03.013727 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5dd8ed19-dc14-4606-b7db-3327679daa5d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:03.050126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5dd8ed19-dc14-4606-b7db-3327679daa5d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:03.054681 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5dd8ed19-dc14-4606-b7db-3327679daa5d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:03.056753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5dd8ed19-dc14-4606-b7db-3327679daa5d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:03.057562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5dd8ed19-dc14-4606-b7db-3327679daa5d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:03.479439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5dd8ed19-dc14-4606-b7db-3327679daa5d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a501d0e6dfb945bda510d3cc3f7e67a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b873aac1e4c749b6569d0a43388f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:03.501355 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5dd8ed19-dc14-4606-b7db-3327679daa5d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] 10.222.0.13 "GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6" status: 200 len: 1316 microversion: 2.1 time: 0.492142 May 27 15:29:03.507563 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2984/5970] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:03 2022] GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 => generated 1316 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:04.522840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-79211889-85f8-46aa-b847-24a87797e402 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:04.528093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-79211889-85f8-46aa-b847-24a87797e402 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:04.562835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79211889-85f8-46aa-b847-24a87797e402 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:04.563315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79211889-85f8-46aa-b847-24a87797e402 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:04.564164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79211889-85f8-46aa-b847-24a87797e402 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:04.564612 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-79211889-85f8-46aa-b847-24a87797e402 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:04.947553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-79211889-85f8-46aa-b847-24a87797e402 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a501d0e6dfb945bda510d3cc3f7e67a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b873aac1e4c749b6569d0a43388f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:04.956836 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-79211889-85f8-46aa-b847-24a87797e402 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] 10.222.0.13 "GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6" status: 200 len: 1316 microversion: 2.1 time: 0.439808 May 27 15:29:04.957469 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2987/5971] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:04 2022] GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 => generated 1316 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:05.012840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-9f71b7da-57e0-4203-8518-cca1146d5cb8 req-eb608972-b1c0-4614-8d67-70c80273869a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6", "tag": "7599c971-c1fd-4bb6-a52c-3d484b1fa1d6"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:29:05.026744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9f71b7da-57e0-4203-8518-cca1146d5cb8 req-eb608972-b1c0-4614-8d67-70c80273869a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:05.031858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9f71b7da-57e0-4203-8518-cca1146d5cb8 req-eb608972-b1c0-4614-8d67-70c80273869a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:05.062372 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-9f71b7da-57e0-4203-8518-cca1146d5cb8 req-eb608972-b1c0-4614-8d67-70c80273869a service nova] Creating event network-changed:7599c971-c1fd-4bb6-a52c-3d484b1fa1d6 for instance acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 on n-h2-843621-1 May 27 15:29:05.073386 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-9f71b7da-57e0-4203-8518-cca1146d5cb8 req-eb608972-b1c0-4614-8d67-70c80273869a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060002 May 27 15:29:05.074204 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2985/5972] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:29:05.429492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-44fc3b77-f1ae-4717-862d-759868311dde tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1208911483", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:29:05.543385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-44fc3b77-f1ae-4717-862d-759868311dde tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] validate_networks() for None {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:29:05.974931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e3bffbb6-1bf6-4606-a6e3-ebfc09d96fc7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:05.975647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e3bffbb6-1bf6-4606-a6e3-ebfc09d96fc7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:05.990966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3bffbb6-1bf6-4606-a6e3-ebfc09d96fc7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:05.991501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3bffbb6-1bf6-4606-a6e3-ebfc09d96fc7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:05.992337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3bffbb6-1bf6-4606-a6e3-ebfc09d96fc7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:05.992819 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3bffbb6-1bf6-4606-a6e3-ebfc09d96fc7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:06.050882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-44fc3b77-f1ae-4717-862d-759868311dde tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:29:06.051416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-44fc3b77-f1ae-4717-862d-759868311dde tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:29:06.053157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-44fc3b77-f1ae-4717-862d-759868311dde tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:29:06.055828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-44fc3b77-f1ae-4717-862d-759868311dde tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:29:06.056439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-44fc3b77-f1ae-4717-862d-759868311dde tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:29:06.100828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44fc3b77-f1ae-4717-862d-759868311dde tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:06.101306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44fc3b77-f1ae-4717-862d-759868311dde tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:06.103750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44fc3b77-f1ae-4717-862d-759868311dde tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:06.104216 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-44fc3b77-f1ae-4717-862d-759868311dde tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:06.140123 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:06.183307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-44fc3b77-f1ae-4717-862d-759868311dde tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Getting quotas for project 1131b11617e747f5b809720f01b967c2. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:29:06.195646 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-44fc3b77-f1ae-4717-862d-759868311dde tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Getting quotas for user 203541d760e5425792380cde385039dd and project 1131b11617e747f5b809720f01b967c2. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:29:06.213432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-44fc3b77-f1ae-4717-862d-759868311dde tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:29:06.215796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-44fc3b77-f1ae-4717-862d-759868311dde tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:29:06.274860 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-44fc3b77-f1ae-4717-862d-759868311dde tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.849000 May 27 15:29:06.281868 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2988/5973] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:29:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:29:06.287438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9a7c4e15-8d05-4695-9854-d778cd667229 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:06.288246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9a7c4e15-8d05-4695-9854-d778cd667229 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:06.386410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e3bffbb6-1bf6-4606-a6e3-ebfc09d96fc7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a501d0e6dfb945bda510d3cc3f7e67a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b873aac1e4c749b6569d0a43388f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:06.395637 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e3bffbb6-1bf6-4606-a6e3-ebfc09d96fc7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] 10.222.0.13 "GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6" status: 200 len: 1316 microversion: 2.1 time: 0.425225 May 27 15:29:06.407789 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2986/5974] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:05 2022] GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:06.485181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9a7c4e15-8d05-4695-9854-d778cd667229 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203541d760e5425792380cde385039dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1131b11617e747f5b809720f01b967c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:06.501602 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9a7c4e15-8d05-4695-9854-d778cd667229 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] 10.222.0.13 "GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41" status: 200 len: 1214 microversion: 2.1 time: 0.215034 May 27 15:29:06.502852 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2989/5975] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:06 2022] GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41 => generated 1214 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:07.412179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bdf41306-5e9b-4ac3-aec8-b3d86dee1541 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:07.412993 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bdf41306-5e9b-4ac3-aec8-b3d86dee1541 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:07.428018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bdf41306-5e9b-4ac3-aec8-b3d86dee1541 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:07.431751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bdf41306-5e9b-4ac3-aec8-b3d86dee1541 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:07.435406 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bdf41306-5e9b-4ac3-aec8-b3d86dee1541 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:07.438421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bdf41306-5e9b-4ac3-aec8-b3d86dee1541 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:07.523592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8d832dae-b259-4de0-a4ae-b1617316fe7a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:07.526056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8d832dae-b259-4de0-a4ae-b1617316fe7a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:07.553842 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d832dae-b259-4de0-a4ae-b1617316fe7a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:07.557380 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d832dae-b259-4de0-a4ae-b1617316fe7a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:07.558479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d832dae-b259-4de0-a4ae-b1617316fe7a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:07.580460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d832dae-b259-4de0-a4ae-b1617316fe7a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:07.820728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8d832dae-b259-4de0-a4ae-b1617316fe7a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203541d760e5425792380cde385039dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1131b11617e747f5b809720f01b967c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:07.837583 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8d832dae-b259-4de0-a4ae-b1617316fe7a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] 10.222.0.13 "GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41" status: 200 len: 1210 microversion: 2.1 time: 0.320254 May 27 15:29:07.840285 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2990/5976] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:07 2022] GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41 => generated 1210 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:29:07.935863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bdf41306-5e9b-4ac3-aec8-b3d86dee1541 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a501d0e6dfb945bda510d3cc3f7e67a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b873aac1e4c749b6569d0a43388f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:07.944284 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bdf41306-5e9b-4ac3-aec8-b3d86dee1541 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] 10.222.0.13 "GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6" status: 200 len: 1316 microversion: 2.1 time: 0.536104 May 27 15:29:07.944906 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2987/5977] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:07 2022] GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 => generated 1316 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:08.857644 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fe82b60b-f85e-48fa-acc2-ed4c447d5b5a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:08.858285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fe82b60b-f85e-48fa-acc2-ed4c447d5b5a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:08.875711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe82b60b-f85e-48fa-acc2-ed4c447d5b5a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:08.876446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe82b60b-f85e-48fa-acc2-ed4c447d5b5a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:08.886631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe82b60b-f85e-48fa-acc2-ed4c447d5b5a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:08.888299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe82b60b-f85e-48fa-acc2-ed4c447d5b5a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:08.963779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-83eb1280-a987-435a-8982-8198a5ca1d18 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:08.964161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-83eb1280-a987-435a-8982-8198a5ca1d18 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:08.983058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-83eb1280-a987-435a-8982-8198a5ca1d18 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:08.987152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-83eb1280-a987-435a-8982-8198a5ca1d18 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:08.989500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-83eb1280-a987-435a-8982-8198a5ca1d18 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:08.999592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-83eb1280-a987-435a-8982-8198a5ca1d18 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:09.086385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=92 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:09.166491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fe82b60b-f85e-48fa-acc2-ed4c447d5b5a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203541d760e5425792380cde385039dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1131b11617e747f5b809720f01b967c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:09.188135 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fe82b60b-f85e-48fa-acc2-ed4c447d5b5a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] 10.222.0.13 "GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41" status: 200 len: 1272 microversion: 2.1 time: 0.334718 May 27 15:29:09.190213 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2991/5978] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:08 2022] GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41 => generated 1272 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:09.551260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-83eb1280-a987-435a-8982-8198a5ca1d18 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a501d0e6dfb945bda510d3cc3f7e67a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b873aac1e4c749b6569d0a43388f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:09.575546 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-83eb1280-a987-435a-8982-8198a5ca1d18 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] 10.222.0.13 "GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6" status: 200 len: 1316 microversion: 2.1 time: 0.615029 May 27 15:29:09.577337 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2988/5979] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:08 2022] GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 => generated 1316 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:10.205704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-901b8d4e-0f8c-4f8b-aacb-1906b95536c0 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:10.206328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-901b8d4e-0f8c-4f8b-aacb-1906b95536c0 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:10.243237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-901b8d4e-0f8c-4f8b-aacb-1906b95536c0 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:10.243774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-901b8d4e-0f8c-4f8b-aacb-1906b95536c0 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:10.244692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-901b8d4e-0f8c-4f8b-aacb-1906b95536c0 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:10.245075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-901b8d4e-0f8c-4f8b-aacb-1906b95536c0 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:10.446658 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-12bdc588-d453-48b1-b12e-8040f7a37f59 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1034776168", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "1631597f-4a7a-438e-8048-4ec63140dc41"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:29:10.482440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:10.585717 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-12bdc588-d453-48b1-b12e-8040f7a37f59 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] validate_networks() for [('1631597f-4a7a-438e-8048-4ec63140dc41', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:29:11.000167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-901b8d4e-0f8c-4f8b-aacb-1906b95536c0 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203541d760e5425792380cde385039dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1131b11617e747f5b809720f01b967c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:11.016316 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-901b8d4e-0f8c-4f8b-aacb-1906b95536c0 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] 10.222.0.13 "GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41" status: 200 len: 1314 microversion: 2.1 time: 0.814508 May 27 15:29:11.017443 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2992/5980] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:10 2022] GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41 => generated 1314 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:11.024357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9b7b195e-0b10-4a97-9946-bdf66c80adda tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:11.025250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9b7b195e-0b10-4a97-9946-bdf66c80adda tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:11.047696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b7b195e-0b10-4a97-9946-bdf66c80adda tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:11.050255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b7b195e-0b10-4a97-9946-bdf66c80adda tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:11.051327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b7b195e-0b10-4a97-9946-bdf66c80adda tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:11.054460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9b7b195e-0b10-4a97-9946-bdf66c80adda tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:11.586078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9b7b195e-0b10-4a97-9946-bdf66c80adda tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a501d0e6dfb945bda510d3cc3f7e67a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b873aac1e4c749b6569d0a43388f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:11.600108 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9b7b195e-0b10-4a97-9946-bdf66c80adda tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] 10.222.0.13 "GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6" status: 200 len: 1316 microversion: 2.1 time: 0.581362 May 27 15:29:11.605873 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2993/5981] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:11 2022] GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 => generated 1316 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:11.610890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-dce65e4c-bad7-4521-b17f-e0e619031a8b req-d1be9ecd-16d1-4230-b9a6-6d5aebf383e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6", "name": "network-vif-plugged", "status": "completed", "tag": "7599c971-c1fd-4bb6-a52c-3d484b1fa1d6"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:29:11.649889 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-dce65e4c-bad7-4521-b17f-e0e619031a8b req-d1be9ecd-16d1-4230-b9a6-6d5aebf383e0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:11.655216 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-dce65e4c-bad7-4521-b17f-e0e619031a8b req-d1be9ecd-16d1-4230-b9a6-6d5aebf383e0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:11.696800 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-dce65e4c-bad7-4521-b17f-e0e619031a8b req-d1be9ecd-16d1-4230-b9a6-6d5aebf383e0 service nova] Creating event network-vif-plugged:7599c971-c1fd-4bb6-a52c-3d484b1fa1d6 for instance acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 on n-h2-843621-1 May 27 15:29:11.707990 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-dce65e4c-bad7-4521-b17f-e0e619031a8b req-d1be9ecd-16d1-4230-b9a6-6d5aebf383e0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100698 May 27 15:29:11.713098 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2994/5982] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:29:11.790634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-12bdc588-d453-48b1-b12e-8040f7a37f59 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:29:11.791394 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-12bdc588-d453-48b1-b12e-8040f7a37f59 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:29:11.792314 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-12bdc588-d453-48b1-b12e-8040f7a37f59 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:29:11.792921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-12bdc588-d453-48b1-b12e-8040f7a37f59 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:29:11.793438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-12bdc588-d453-48b1-b12e-8040f7a37f59 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:29:11.806958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12bdc588-d453-48b1-b12e-8040f7a37f59 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:11.807760 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12bdc588-d453-48b1-b12e-8040f7a37f59 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:11.809346 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12bdc588-d453-48b1-b12e-8040f7a37f59 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:11.815228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12bdc588-d453-48b1-b12e-8040f7a37f59 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:11.841484 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-12bdc588-d453-48b1-b12e-8040f7a37f59 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Getting quotas for project 3baeb07bbeb64100b2bee8a44ef25f66. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:29:11.848559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-12bdc588-d453-48b1-b12e-8040f7a37f59 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Getting quotas for user 9ff6334db7c942648631e5112e499cb7 and project 3baeb07bbeb64100b2bee8a44ef25f66. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:29:11.869330 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-12bdc588-d453-48b1-b12e-8040f7a37f59 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:29:11.872066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-12bdc588-d453-48b1-b12e-8040f7a37f59 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:29:12.020735 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-12bdc588-d453-48b1-b12e-8040f7a37f59 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.578011 May 27 15:29:12.022054 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2989/5983] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:29:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:29:12.033334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-95ba882a-be27-4a73-9f52-818e6e06d2ac tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:12.038578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c2129564-1648-454a-9cbf-06e860bf796e tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:12.039828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-95ba882a-be27-4a73-9f52-818e6e06d2ac tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:12.043732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c2129564-1648-454a-9cbf-06e860bf796e tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:12.065778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2129564-1648-454a-9cbf-06e860bf796e tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:12.068412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2129564-1648-454a-9cbf-06e860bf796e tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:12.072806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2129564-1648-454a-9cbf-06e860bf796e tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:12.081453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2129564-1648-454a-9cbf-06e860bf796e tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:12.209341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-95ba882a-be27-4a73-9f52-818e6e06d2ac tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:12.218986 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-95ba882a-be27-4a73-9f52-818e6e06d2ac tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e" status: 200 len: 1219 microversion: 2.1 time: 0.190696 May 27 15:29:12.223275 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2995/5984] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:12 2022] GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e => generated 1219 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:12.397672 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-10a11cd7-5b5d-4d82-897e-b69fcfe91e61 req-960588e8-f9ee-416b-8be8-cb723f591ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ef3dd65-83b9-4cb8-b342-094a2c633c41", "tag": "cd3615cd-65c7-4dd8-adbf-5b459ecc0235"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:29:12.431195 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-10a11cd7-5b5d-4d82-897e-b69fcfe91e61 req-960588e8-f9ee-416b-8be8-cb723f591ee6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:12.431655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-10a11cd7-5b5d-4d82-897e-b69fcfe91e61 req-960588e8-f9ee-416b-8be8-cb723f591ee6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:12.489332 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-10a11cd7-5b5d-4d82-897e-b69fcfe91e61 req-960588e8-f9ee-416b-8be8-cb723f591ee6 service nova] Creating event network-changed:cd3615cd-65c7-4dd8-adbf-5b459ecc0235 for instance 9ef3dd65-83b9-4cb8-b342-094a2c633c41 on n-h1-843621-1 May 27 15:29:12.502899 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-10a11cd7-5b5d-4d82-897e-b69fcfe91e61 req-960588e8-f9ee-416b-8be8-cb723f591ee6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108845 May 27 15:29:12.504178 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2996/5985] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:29:12.626769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-503cb851-bb3a-4511-b38d-2b99d88800aa tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:12.628831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-503cb851-bb3a-4511-b38d-2b99d88800aa tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:12.646314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-503cb851-bb3a-4511-b38d-2b99d88800aa tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:12.647261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-503cb851-bb3a-4511-b38d-2b99d88800aa tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:12.649779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-503cb851-bb3a-4511-b38d-2b99d88800aa tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:12.651969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-503cb851-bb3a-4511-b38d-2b99d88800aa tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:12.657946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c2129564-1648-454a-9cbf-06e860bf796e tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203541d760e5425792380cde385039dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1131b11617e747f5b809720f01b967c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:12.676749 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c2129564-1648-454a-9cbf-06e860bf796e tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] 10.222.0.13 "GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41" status: 200 len: 1314 microversion: 2.1 time: 0.639740 May 27 15:29:12.678040 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2990/5986] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:12 2022] GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41 => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:13.041244 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-503cb851-bb3a-4511-b38d-2b99d88800aa tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a501d0e6dfb945bda510d3cc3f7e67a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b873aac1e4c749b6569d0a43388f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:13.056227 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-503cb851-bb3a-4511-b38d-2b99d88800aa tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] 10.222.0.13 "GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6" status: 200 len: 1316 microversion: 2.1 time: 0.436900 May 27 15:29:13.057514 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2997/5987] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:12 2022] GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 => generated 1316 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:29:13.243479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0592482c-3036-4c21-aff7-05544673ae68 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:13.246068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0592482c-3036-4c21-aff7-05544673ae68 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:13.271518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0592482c-3036-4c21-aff7-05544673ae68 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:13.272506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0592482c-3036-4c21-aff7-05544673ae68 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:13.274101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0592482c-3036-4c21-aff7-05544673ae68 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:13.275118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0592482c-3036-4c21-aff7-05544673ae68 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:13.461780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0592482c-3036-4c21-aff7-05544673ae68 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:13.484604 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0592482c-3036-4c21-aff7-05544673ae68 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e" status: 200 len: 1215 microversion: 2.1 time: 0.246219 May 27 15:29:13.485383 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2991/5988] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:13 2022] GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e => generated 1215 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:29:13.695379 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ac21c2ac-18f9-46f6-8d76-48ab504f1c69 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:13.696638 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ac21c2ac-18f9-46f6-8d76-48ab504f1c69 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:13.711727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac21c2ac-18f9-46f6-8d76-48ab504f1c69 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:13.713181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac21c2ac-18f9-46f6-8d76-48ab504f1c69 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:13.718163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac21c2ac-18f9-46f6-8d76-48ab504f1c69 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:13.718856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac21c2ac-18f9-46f6-8d76-48ab504f1c69 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:14.061827 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ac21c2ac-18f9-46f6-8d76-48ab504f1c69 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203541d760e5425792380cde385039dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1131b11617e747f5b809720f01b967c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:14.080909 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ac21c2ac-18f9-46f6-8d76-48ab504f1c69 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] 10.222.0.13 "GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41" status: 200 len: 1314 microversion: 2.1 time: 0.389766 May 27 15:29:14.091842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-13c6bc11-168c-4bb4-bb75-8e8442643df9 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:14.093641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-13c6bc11-168c-4bb4-bb75-8e8442643df9 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:14.105090 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2998/5989] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:13 2022] GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:14.106817 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-13c6bc11-168c-4bb4-bb75-8e8442643df9 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:14.107969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-13c6bc11-168c-4bb4-bb75-8e8442643df9 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:14.108967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-13c6bc11-168c-4bb4-bb75-8e8442643df9 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:14.109684 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-13c6bc11-168c-4bb4-bb75-8e8442643df9 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:14.360794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-13c6bc11-168c-4bb4-bb75-8e8442643df9 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a501d0e6dfb945bda510d3cc3f7e67a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b873aac1e4c749b6569d0a43388f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:14.387093 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-13c6bc11-168c-4bb4-bb75-8e8442643df9 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] 10.222.0.13 "GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6" status: 200 len: 1504 microversion: 2.1 time: 0.312480 May 27 15:29:14.388338 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2992/5990] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:14 2022] GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:14.410441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f9b0732b-3d1f-4b73-ac40-18b2d5948847 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:14.411160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f9b0732b-3d1f-4b73-ac40-18b2d5948847 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:14.422563 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f9b0732b-3d1f-4b73-ac40-18b2d5948847 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:14.427397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f9b0732b-3d1f-4b73-ac40-18b2d5948847 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:14.428717 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f9b0732b-3d1f-4b73-ac40-18b2d5948847 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:14.429441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f9b0732b-3d1f-4b73-ac40-18b2d5948847 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:14.511552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f18fca30-05fa-45a9-9212-31dfa75967a0 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:14.512711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f18fca30-05fa-45a9-9212-31dfa75967a0 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:14.539528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f18fca30-05fa-45a9-9212-31dfa75967a0 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:14.540011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f18fca30-05fa-45a9-9212-31dfa75967a0 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:14.542235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f18fca30-05fa-45a9-9212-31dfa75967a0 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:14.544113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f18fca30-05fa-45a9-9212-31dfa75967a0 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:14.587645 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f9b0732b-3d1f-4b73-ac40-18b2d5948847 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] 10.222.0.13 "DELETE /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.180521 May 27 15:29:14.588983 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 2999/5991] 10.222.0.13 () {58 vars in 1295 bytes} [Fri May 27 15:29:14 2022] DELETE /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6/os-server-password => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:29:14.607113 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b4c07ef1-bbd0-4232-9c6c-1b1ce5f9e0b7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:14.609881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b4c07ef1-bbd0-4232-9c6c-1b1ce5f9e0b7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:14.619410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4c07ef1-bbd0-4232-9c6c-1b1ce5f9e0b7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:14.619880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4c07ef1-bbd0-4232-9c6c-1b1ce5f9e0b7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:14.621792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4c07ef1-bbd0-4232-9c6c-1b1ce5f9e0b7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:14.622591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4c07ef1-bbd0-4232-9c6c-1b1ce5f9e0b7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:14.670194 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b4c07ef1-bbd0-4232-9c6c-1b1ce5f9e0b7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] 10.222.0.13 "GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.073394 May 27 15:29:14.671476 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3000/5992] 10.222.0.13 () {58 vars in 1292 bytes} [Fri May 27 15:29:14 2022] GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6/os-server-password => generated 16 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:29:14.681013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f18fca30-05fa-45a9-9212-31dfa75967a0 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:14.691546 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f18fca30-05fa-45a9-9212-31dfa75967a0 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e" status: 200 len: 1277 microversion: 2.1 time: 0.186374 May 27 15:29:14.693487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b45b4b60-ca2e-460f-8c59-e5fb1d9da827 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:14.693666 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2993/5993] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:14 2022] GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:29:14.694419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b45b4b60-ca2e-460f-8c59-e5fb1d9da827 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:14.714011 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b45b4b60-ca2e-460f-8c59-e5fb1d9da827 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:14.718137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b45b4b60-ca2e-460f-8c59-e5fb1d9da827 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:14.719204 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b45b4b60-ca2e-460f-8c59-e5fb1d9da827 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:14.722920 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b45b4b60-ca2e-460f-8c59-e5fb1d9da827 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:14.766448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b45b4b60-ca2e-460f-8c59-e5fb1d9da827 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:29:14.890788 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b45b4b60-ca2e-460f-8c59-e5fb1d9da827 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] 10.222.0.13 "DELETE /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6" status: 204 len: 0 microversion: 2.1 time: 0.210986 May 27 15:29:14.892061 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3001/5994] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:29:14 2022] DELETE /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:29:14.900842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a0ee9b60-10ab-430d-91d3-8adbddcba180 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:14.901470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a0ee9b60-10ab-430d-91d3-8adbddcba180 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:14.913257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a0ee9b60-10ab-430d-91d3-8adbddcba180 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:14.916754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a0ee9b60-10ab-430d-91d3-8adbddcba180 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:14.917631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a0ee9b60-10ab-430d-91d3-8adbddcba180 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:14.918335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a0ee9b60-10ab-430d-91d3-8adbddcba180 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:15.107499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a0ee9b60-10ab-430d-91d3-8adbddcba180 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a501d0e6dfb945bda510d3cc3f7e67a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b873aac1e4c749b6569d0a43388f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:15.119724 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a0ee9b60-10ab-430d-91d3-8adbddcba180 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] 10.222.0.13 "GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6" status: 200 len: 1510 microversion: 2.1 time: 0.222984 May 27 15:29:15.122369 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2994/5995] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:14 2022] GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 => generated 1510 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:15.132372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2011015c-2e1b-4149-884a-d2af50a7c414 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:15.132372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2011015c-2e1b-4149-884a-d2af50a7c414 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:15.139371 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2011015c-2e1b-4149-884a-d2af50a7c414 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:15.139848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2011015c-2e1b-4149-884a-d2af50a7c414 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:15.140648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2011015c-2e1b-4149-884a-d2af50a7c414 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:15.141120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2011015c-2e1b-4149-884a-d2af50a7c414 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:15.375986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2011015c-2e1b-4149-884a-d2af50a7c414 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203541d760e5425792380cde385039dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1131b11617e747f5b809720f01b967c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:15.385798 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2011015c-2e1b-4149-884a-d2af50a7c414 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] 10.222.0.13 "GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41" status: 200 len: 1314 microversion: 2.1 time: 0.267138 May 27 15:29:15.387204 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3002/5996] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:15 2022] GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:15.714215 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e5361b06-1980-4d3f-ae41-74c97a1c56d3 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:15.715564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e5361b06-1980-4d3f-ae41-74c97a1c56d3 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:15.736551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5361b06-1980-4d3f-ae41-74c97a1c56d3 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:15.738721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5361b06-1980-4d3f-ae41-74c97a1c56d3 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:15.740962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5361b06-1980-4d3f-ae41-74c97a1c56d3 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:15.741822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5361b06-1980-4d3f-ae41-74c97a1c56d3 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:15.965590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e5361b06-1980-4d3f-ae41-74c97a1c56d3 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:15.994453 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e5361b06-1980-4d3f-ae41-74c97a1c56d3 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e" status: 200 len: 1319 microversion: 2.1 time: 0.278471 May 27 15:29:15.996427 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2995/5997] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:15 2022] GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:16.139806 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7f000312-44a9-48ee-9bb4-380869a8e46d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:16.141129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7f000312-44a9-48ee-9bb4-380869a8e46d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:16.144541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:16.151698 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f000312-44a9-48ee-9bb4-380869a8e46d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:16.153019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f000312-44a9-48ee-9bb4-380869a8e46d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:16.154083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f000312-44a9-48ee-9bb4-380869a8e46d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:16.154675 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f000312-44a9-48ee-9bb4-380869a8e46d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:16.403654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a019b21c-8a88-4eee-aad1-7f7923ffc659 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:16.404373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a019b21c-8a88-4eee-aad1-7f7923ffc659 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:16.426697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a019b21c-8a88-4eee-aad1-7f7923ffc659 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:16.427319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a019b21c-8a88-4eee-aad1-7f7923ffc659 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:16.428241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a019b21c-8a88-4eee-aad1-7f7923ffc659 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:16.428853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a019b21c-8a88-4eee-aad1-7f7923ffc659 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:17.286418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7f000312-44a9-48ee-9bb4-380869a8e46d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a501d0e6dfb945bda510d3cc3f7e67a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b873aac1e4c749b6569d0a43388f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:17.297985 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7f000312-44a9-48ee-9bb4-380869a8e46d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] 10.222.0.13 "GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6" status: 200 len: 1510 microversion: 2.1 time: 1.160165 May 27 15:29:17.299162 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3003/5998] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:16 2022] GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 => generated 1510 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:17.314067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e3472484-cad4-4c2c-b178-f5fab71d506e tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:17.319689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e3472484-cad4-4c2c-b178-f5fab71d506e tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:17.340697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3472484-cad4-4c2c-b178-f5fab71d506e tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:17.347834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3472484-cad4-4c2c-b178-f5fab71d506e tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:17.349095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3472484-cad4-4c2c-b178-f5fab71d506e tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:17.351932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3472484-cad4-4c2c-b178-f5fab71d506e tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:17.587178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a019b21c-8a88-4eee-aad1-7f7923ffc659 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203541d760e5425792380cde385039dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1131b11617e747f5b809720f01b967c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:17.605233 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a019b21c-8a88-4eee-aad1-7f7923ffc659 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] 10.222.0.13 "GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41" status: 200 len: 1314 microversion: 2.1 time: 1.204748 May 27 15:29:17.606443 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2996/5999] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:16 2022] GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41 => generated 1314 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:17.612263 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-b1edd9e5-0d59-41ab-9d8c-1c8baa0ab9be req-58e03a74-be31-4ef3-b89d-68a5aa42a3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6188d8a-aa0f-4e17-881e-5f07753eac4e", "tag": "81ecfcf0-7102-42d2-8300-52fcabf4ecb3"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:29:17.639396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-b1edd9e5-0d59-41ab-9d8c-1c8baa0ab9be req-58e03a74-be31-4ef3-b89d-68a5aa42a3d6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:17.642902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-b1edd9e5-0d59-41ab-9d8c-1c8baa0ab9be req-58e03a74-be31-4ef3-b89d-68a5aa42a3d6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:17.678641 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-b1edd9e5-0d59-41ab-9d8c-1c8baa0ab9be req-58e03a74-be31-4ef3-b89d-68a5aa42a3d6 service nova] Creating event network-changed:81ecfcf0-7102-42d2-8300-52fcabf4ecb3 for instance f6188d8a-aa0f-4e17-881e-5f07753eac4e on n-h2-843621-1 May 27 15:29:17.695087 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-b1edd9e5-0d59-41ab-9d8c-1c8baa0ab9be req-58e03a74-be31-4ef3-b89d-68a5aa42a3d6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086294 May 27 15:29:17.695939 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2997/6000] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:29:17.902276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e3472484-cad4-4c2c-b178-f5fab71d506e tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:17.913513 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e3472484-cad4-4c2c-b178-f5fab71d506e tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e" status: 200 len: 1319 microversion: 2.1 time: 0.611609 May 27 15:29:17.917740 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3004/6001] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:17 2022] GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e => generated 1319 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:18.205212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-37b77437-4511-4e74-affc-b27477bfb645 req-23fe4975-1e5f-4f92-89e7-520b76414dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6", "name": "network-vif-deleted", "tag": "7599c971-c1fd-4bb6-a52c-3d484b1fa1d6"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:29:18.219539 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-37b77437-4511-4e74-affc-b27477bfb645 req-23fe4975-1e5f-4f92-89e7-520b76414dc5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:18.221685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-37b77437-4511-4e74-affc-b27477bfb645 req-23fe4975-1e5f-4f92-89e7-520b76414dc5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:18.271767 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-37b77437-4511-4e74-affc-b27477bfb645 req-23fe4975-1e5f-4f92-89e7-520b76414dc5 service nova] Creating event network-vif-deleted:7599c971-c1fd-4bb6-a52c-3d484b1fa1d6 for instance acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 on n-h2-843621-1 May 27 15:29:18.304564 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-37b77437-4511-4e74-affc-b27477bfb645 req-23fe4975-1e5f-4f92-89e7-520b76414dc5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100201 May 27 15:29:18.306550 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2998/6002] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:29:18.316535 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7494e259-2c7d-4f52-bf20-87221d5c986d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:18.317811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7494e259-2c7d-4f52-bf20-87221d5c986d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:18.325992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7494e259-2c7d-4f52-bf20-87221d5c986d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:18.326809 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7494e259-2c7d-4f52-bf20-87221d5c986d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:18.327842 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7494e259-2c7d-4f52-bf20-87221d5c986d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:18.328505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7494e259-2c7d-4f52-bf20-87221d5c986d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:18.460722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7494e259-2c7d-4f52-bf20-87221d5c986d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a501d0e6dfb945bda510d3cc3f7e67a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b873aac1e4c749b6569d0a43388f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:18.469755 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7494e259-2c7d-4f52-bf20-87221d5c986d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] 10.222.0.13 "GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6" status: 200 len: 1301 microversion: 2.1 time: 0.157660 May 27 15:29:18.470987 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3005/6003] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:18 2022] GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 => generated 1301 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:29:18.625457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-80b31b5f-39b9-42cd-940e-066a55ef0faf tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:18.626411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-80b31b5f-39b9-42cd-940e-066a55ef0faf tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:18.649963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-80b31b5f-39b9-42cd-940e-066a55ef0faf tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:18.650708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-80b31b5f-39b9-42cd-940e-066a55ef0faf tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:18.652336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-80b31b5f-39b9-42cd-940e-066a55ef0faf tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:18.653307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-80b31b5f-39b9-42cd-940e-066a55ef0faf tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:18.905628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-80b31b5f-39b9-42cd-940e-066a55ef0faf tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203541d760e5425792380cde385039dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1131b11617e747f5b809720f01b967c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:18.916589 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-80b31b5f-39b9-42cd-940e-066a55ef0faf tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] 10.222.0.13 "GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41" status: 200 len: 1314 microversion: 2.1 time: 0.296341 May 27 15:29:18.918049 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 2999/6004] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:18 2022] GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:18.940183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ea370746-d704-4fa5-9131-7cb05e67908a tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:18.950144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ea370746-d704-4fa5-9131-7cb05e67908a tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:18.957170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea370746-d704-4fa5-9131-7cb05e67908a tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:18.958098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea370746-d704-4fa5-9131-7cb05e67908a tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:18.959256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea370746-d704-4fa5-9131-7cb05e67908a tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:18.960001 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea370746-d704-4fa5-9131-7cb05e67908a tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:18.987409 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:19.171177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ea370746-d704-4fa5-9131-7cb05e67908a tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:19.182975 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ea370746-d704-4fa5-9131-7cb05e67908a tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e" status: 200 len: 1319 microversion: 2.1 time: 0.252587 May 27 15:29:19.185498 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3006/6005] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:18 2022] GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:19.472833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-66bb7ad8-07b7-4aa7-a5b6-3d3a6768cdc4 req-6b52eee2-9d15-49ba-8d51-0bfbd07860bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef3dd65-83b9-4cb8-b342-094a2c633c41", "name": "network-vif-plugged", "status": "completed", "tag": "cd3615cd-65c7-4dd8-adbf-5b459ecc0235"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:29:19.490347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f4fdd27c-7725-4412-98d8-136cfe6ec9b7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:19.491480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f4fdd27c-7725-4412-98d8-136cfe6ec9b7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:19.511245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-66bb7ad8-07b7-4aa7-a5b6-3d3a6768cdc4 req-6b52eee2-9d15-49ba-8d51-0bfbd07860bf service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:19.513199 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-66bb7ad8-07b7-4aa7-a5b6-3d3a6768cdc4 req-6b52eee2-9d15-49ba-8d51-0bfbd07860bf service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:19.522823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4fdd27c-7725-4412-98d8-136cfe6ec9b7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:19.524764 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4fdd27c-7725-4412-98d8-136cfe6ec9b7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:19.529519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4fdd27c-7725-4412-98d8-136cfe6ec9b7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:19.530432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4fdd27c-7725-4412-98d8-136cfe6ec9b7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:19.587071 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-66bb7ad8-07b7-4aa7-a5b6-3d3a6768cdc4 req-6b52eee2-9d15-49ba-8d51-0bfbd07860bf service nova] Creating event network-vif-plugged:cd3615cd-65c7-4dd8-adbf-5b459ecc0235 for instance 9ef3dd65-83b9-4cb8-b342-094a2c633c41 on n-h1-843621-1 May 27 15:29:19.604842 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-66bb7ad8-07b7-4aa7-a5b6-3d3a6768cdc4 req-6b52eee2-9d15-49ba-8d51-0bfbd07860bf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132833 May 27 15:29:19.605812 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3000/6006] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:29:19.691033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4fdd27c-7725-4412-98d8-136cfe6ec9b7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:19.695086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f4fdd27c-7725-4412-98d8-136cfe6ec9b7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:19.696037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-f4fdd27c-7725-4412-98d8-136cfe6ec9b7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lazy-loading 'fault' on Instance uuid acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:29:19.847458 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f4fdd27c-7725-4412-98d8-136cfe6ec9b7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a501d0e6dfb945bda510d3cc3f7e67a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b873aac1e4c749b6569d0a43388f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:19.864602 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f4fdd27c-7725-4412-98d8-136cfe6ec9b7 tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] 10.222.0.13 "GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6" status: 200 len: 1306 microversion: 2.1 time: 0.379349 May 27 15:29:19.868057 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3007/6007] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:19 2022] GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 => generated 1306 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:19.937382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-152ee5cf-30c6-46d0-b348-d8c584d649a6 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:19.938116 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-152ee5cf-30c6-46d0-b348-d8c584d649a6 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:19.966465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-152ee5cf-30c6-46d0-b348-d8c584d649a6 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:19.968062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-152ee5cf-30c6-46d0-b348-d8c584d649a6 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:19.970292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-152ee5cf-30c6-46d0-b348-d8c584d649a6 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:19.972418 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-152ee5cf-30c6-46d0-b348-d8c584d649a6 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:20.204136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c7d23fb3-1a78-4029-8143-4e8636cbde66 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:20.204881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c7d23fb3-1a78-4029-8143-4e8636cbde66 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:20.226527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c7d23fb3-1a78-4029-8143-4e8636cbde66 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:20.227470 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c7d23fb3-1a78-4029-8143-4e8636cbde66 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:20.234307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c7d23fb3-1a78-4029-8143-4e8636cbde66 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:20.235368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c7d23fb3-1a78-4029-8143-4e8636cbde66 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:20.449586 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-152ee5cf-30c6-46d0-b348-d8c584d649a6 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203541d760e5425792380cde385039dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1131b11617e747f5b809720f01b967c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:20.470773 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-152ee5cf-30c6-46d0-b348-d8c584d649a6 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] 10.222.0.13 "GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41" status: 200 len: 1314 microversion: 2.1 time: 0.539631 May 27 15:29:20.475227 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3001/6008] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:19 2022] GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41 => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:29:20.528158 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c7d23fb3-1a78-4029-8143-4e8636cbde66 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:20.555990 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c7d23fb3-1a78-4029-8143-4e8636cbde66 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e" status: 200 len: 1319 microversion: 2.1 time: 0.352994 May 27 15:29:20.560613 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3008/6009] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:20 2022] GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:29:20.893209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b58f083a-e252-4aee-b78d-f113eaf37a1d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:20.895061 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b58f083a-e252-4aee-b78d-f113eaf37a1d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] [instance: acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:20.938280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b58f083a-e252-4aee-b78d-f113eaf37a1d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:20.942935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b58f083a-e252-4aee-b78d-f113eaf37a1d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:20.944635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b58f083a-e252-4aee-b78d-f113eaf37a1d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:20.948752 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b58f083a-e252-4aee-b78d-f113eaf37a1d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:21.012563 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-b58f083a-e252-4aee-b78d-f113eaf37a1d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] HTTP exception thrown: Instance acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 could not be found. May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b58f083a-e252-4aee-b78d-f113eaf37a1d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Request method failure captured: May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 HTTP/1.1 May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikO45yADLbh7GvnHozLNXrl0c7J9PRmRxYmKpZyYiPbBis1uaX9RWr2nkHpCBTt793J0wpKsSJzLquVsBhttUKu0YurP_MUKBZVdVIQOwtmY0ZLzBu8fu5NRY-UiUCviRPaqB8X2x7FMd2hqSmvwKuGj1Bv4yfv4IQzVTAIMTO4w0Mmc May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 7e9b873aac1e4c749b6569d0a43388f8 May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerPasswordTestJSON-2026767437 May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e9b873aac1e4c749b6569d0a43388f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7e9b873aac1e4c749b6569d0a43388f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7e9b873aac1e4c749b6569d0a43388f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7e9b873aac1e4c749b6569d0a43388f8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerPasswordTestJSON-2026767437 May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 7e9b873aac1e4c749b6569d0a43388f8 May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerPasswordTestJSON-2026767437 May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerPasswordTestJSON-2026767437-project May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: a501d0e6dfb945bda510d3cc3f7e67a2 May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerPasswordTestJSON-2026767437-project May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 could not be found. May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6'} May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 could not be found. May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 could not be found. May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:29:21.021209 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:29:21.025757 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:29:21.025757 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:29:21.025757 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:29:21.025757 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:29:21.025757 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:29:21.025757 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 could not be found. May 27 15:29:21.025757 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:29:21.031006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b58f083a-e252-4aee-b78d-f113eaf37a1d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] Returning 404 to user: Instance acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:29:21.038499 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b58f083a-e252-4aee-b78d-f113eaf37a1d tempest-ServerPasswordTestJSON-2026767437 tempest-ServerPasswordTestJSON-2026767437-project] 10.222.0.13 "GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6" status: 404 len: 111 microversion: 2.1 time: 0.149410 May 27 15:29:21.042839 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3002/6010] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:20 2022] GET /compute/v2.1/servers/acef5bb1-ccab-47a2-a4a8-0ca8d9d826c6 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:29:21.494074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6d4ef749-f7bb-467f-9333-813d1c3231c5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:21.495306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6d4ef749-f7bb-467f-9333-813d1c3231c5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:21.509984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d4ef749-f7bb-467f-9333-813d1c3231c5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:21.510927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d4ef749-f7bb-467f-9333-813d1c3231c5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:21.513866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d4ef749-f7bb-467f-9333-813d1c3231c5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:21.515650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d4ef749-f7bb-467f-9333-813d1c3231c5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:21.579706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7222278a-ab88-4edc-9114-bc2e5142d989 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:21.580492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7222278a-ab88-4edc-9114-bc2e5142d989 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:21.594636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7222278a-ab88-4edc-9114-bc2e5142d989 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:21.595264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7222278a-ab88-4edc-9114-bc2e5142d989 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:21.596342 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7222278a-ab88-4edc-9114-bc2e5142d989 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:21.603965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7222278a-ab88-4edc-9114-bc2e5142d989 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:21.831276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:21.859018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:22.159348 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6d4ef749-f7bb-467f-9333-813d1c3231c5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203541d760e5425792380cde385039dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1131b11617e747f5b809720f01b967c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:22.180631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7222278a-ab88-4edc-9114-bc2e5142d989 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:22.192162 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7222278a-ab88-4edc-9114-bc2e5142d989 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e" status: 200 len: 1319 microversion: 2.1 time: 0.616230 May 27 15:29:22.193247 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3003/6011] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:21 2022] GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e => generated 1319 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:29:22.202641 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6d4ef749-f7bb-467f-9333-813d1c3231c5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] 10.222.0.13 "GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41" status: 200 len: 1463 microversion: 2.1 time: 0.715427 May 27 15:29:22.208251 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3009/6012] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:21 2022] GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41 => generated 1463 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:22.225630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e5a4cdd1-7f9a-4b72-bb78-9de8cd8167f5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3dc95641-59a3-4670-87a0-f056f041efc2", "device": "/dev/sdb"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:29:22.228582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e5a4cdd1-7f9a-4b72-bb78-9de8cd8167f5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:22.236427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5a4cdd1-7f9a-4b72-bb78-9de8cd8167f5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:22.237392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5a4cdd1-7f9a-4b72-bb78-9de8cd8167f5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:22.238849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5a4cdd1-7f9a-4b72-bb78-9de8cd8167f5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:22.239810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5a4cdd1-7f9a-4b72-bb78-9de8cd8167f5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:22.684783 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e5a4cdd1-7f9a-4b72-bb78-9de8cd8167f5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] 10.222.0.13 "POST /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.463473 May 27 15:29:22.686291 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3004/6013] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 15:29:22 2022] POST /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41/os-volume_attachments => generated 194 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:29:23.209525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d85a423e-5e0b-4b0c-b3bd-98acfab3a550 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:23.210278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d85a423e-5e0b-4b0c-b3bd-98acfab3a550 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:23.212964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=18 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:23.240444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d85a423e-5e0b-4b0c-b3bd-98acfab3a550 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:23.241334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d85a423e-5e0b-4b0c-b3bd-98acfab3a550 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:23.242327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d85a423e-5e0b-4b0c-b3bd-98acfab3a550 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:23.244387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d85a423e-5e0b-4b0c-b3bd-98acfab3a550 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:23.557625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d85a423e-5e0b-4b0c-b3bd-98acfab3a550 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:23.570910 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d85a423e-5e0b-4b0c-b3bd-98acfab3a550 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e" status: 200 len: 1319 microversion: 2.1 time: 0.365684 May 27 15:29:23.572163 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3010/6014] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:23 2022] GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:24.510248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-9442b90b-d990-4d7f-89ca-c8f607581450 req-cc524d0f-08b2-4349-a7cc-31ba1d5fb489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6188d8a-aa0f-4e17-881e-5f07753eac4e", "name": "network-vif-plugged", "status": "completed", "tag": "81ecfcf0-7102-42d2-8300-52fcabf4ecb3"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:29:24.528157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9442b90b-d990-4d7f-89ca-c8f607581450 req-cc524d0f-08b2-4349-a7cc-31ba1d5fb489 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:24.528618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9442b90b-d990-4d7f-89ca-c8f607581450 req-cc524d0f-08b2-4349-a7cc-31ba1d5fb489 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:24.560657 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-9442b90b-d990-4d7f-89ca-c8f607581450 req-cc524d0f-08b2-4349-a7cc-31ba1d5fb489 service nova] Creating event network-vif-plugged:81ecfcf0-7102-42d2-8300-52fcabf4ecb3 for instance f6188d8a-aa0f-4e17-881e-5f07753eac4e on n-h2-843621-1 May 27 15:29:24.574655 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-9442b90b-d990-4d7f-89ca-c8f607581450 req-cc524d0f-08b2-4349-a7cc-31ba1d5fb489 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068261 May 27 15:29:24.575876 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3005/6015] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:29:24.593219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4d085717-2842-47e2-953b-a66207d61d6a tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:24.603784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4d085717-2842-47e2-953b-a66207d61d6a tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:24.637736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4d085717-2842-47e2-953b-a66207d61d6a tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:24.643943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4d085717-2842-47e2-953b-a66207d61d6a tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:24.645133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4d085717-2842-47e2-953b-a66207d61d6a tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:24.648320 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4d085717-2842-47e2-953b-a66207d61d6a tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:25.077901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4d085717-2842-47e2-953b-a66207d61d6a tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:25.086428 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4d085717-2842-47e2-953b-a66207d61d6a tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e" status: 200 len: 1319 microversion: 2.1 time: 0.501976 May 27 15:29:25.090001 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3011/6016] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:24 2022] GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e => generated 1319 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:26.107633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-359c3f60-5327-4ae8-b4c1-e047617487dc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:26.108388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-359c3f60-5327-4ae8-b4c1-e047617487dc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:26.142579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-359c3f60-5327-4ae8-b4c1-e047617487dc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:26.143228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-359c3f60-5327-4ae8-b4c1-e047617487dc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:26.144329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-359c3f60-5327-4ae8-b4c1-e047617487dc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:26.148008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-359c3f60-5327-4ae8-b4c1-e047617487dc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:26.547007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-359c3f60-5327-4ae8-b4c1-e047617487dc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:26.563041 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-359c3f60-5327-4ae8-b4c1-e047617487dc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e" status: 200 len: 1319 microversion: 2.1 time: 0.457351 May 27 15:29:26.565243 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3006/6017] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:26 2022] GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e => generated 1319 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:26.992816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4d085717-2842-47e2-953b-a66207d61d6a tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:26.995051 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4d085717-2842-47e2-953b-a66207d61d6a tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002764 May 27 15:29:26.995682 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3012/6018] 10.222.0.13 () {56 vars in 885 bytes} [Fri May 27 15:29:26 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 27 15:29:27.584120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-48e64d35-ef00-454a-95d5-29295593b618 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:27.585404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-48e64d35-ef00-454a-95d5-29295593b618 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:29:27.598236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48e64d35-ef00-454a-95d5-29295593b618 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:27.606115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48e64d35-ef00-454a-95d5-29295593b618 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:27.609097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48e64d35-ef00-454a-95d5-29295593b618 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:27.609834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48e64d35-ef00-454a-95d5-29295593b618 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:27.667151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:27.862244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-48e64d35-ef00-454a-95d5-29295593b618 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:29:27.876730 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-48e64d35-ef00-454a-95d5-29295593b618 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e" status: 200 len: 1508 microversion: 2.1 time: 0.298495 May 27 15:29:27.878499 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3007/6019] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:29:27 2022] GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e => generated 1508 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:29:46.593365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:46.594581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=37 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:47.271115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b3011c20-988a-411a-88e2-64afd95d8e52 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-247192940", "availability_zone": "foo_zone"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:29:47.273022 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:29:47.273022 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 15:29:47.274111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.aggregate [None req-b3011c20-988a-411a-88e2-64afd95d8e52 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] Generated uuid 447e2c22-43a4-498c-8e8e-87557a727c3b for aggregate {{(pid=119249) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 27 15:29:47.371206 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b3011c20-988a-411a-88e2-64afd95d8e52 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.785159 May 27 15:29:47.377313 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3013/6020] 10.222.0.13 () {60 vars in 1163 bytes} [Fri May 27 15:29:46 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:29:47.385046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fc434cf5-d32f-4e2d-a57c-f020387d0acd tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:29:47.387257 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:29:47.387257 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:29:47.404914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:47.408825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:47.473508 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fc434cf5-d32f-4e2d-a57c-f020387d0acd tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.091632 May 27 15:29:47.477320 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3008/6021] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 15:29:47 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:29:47.486091 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fadbb2fb-280e-47a4-aaaa-9c6202826ef3 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:47.488337 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:29:47.488337 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 15:29:47.492585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fadbb2fb-280e-47a4-aaaa-9c6202826ef3 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:47.493107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fadbb2fb-280e-47a4-aaaa-9c6202826ef3 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:47.495859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fadbb2fb-280e-47a4-aaaa-9c6202826ef3 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:47.496996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fadbb2fb-280e-47a4-aaaa-9c6202826ef3 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:47.612903 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fadbb2fb-280e-47a4-aaaa-9c6202826ef3 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] 10.222.0.13 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.131081 May 27 15:29:47.620315 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3014/6022] 10.222.0.13 () {58 vars in 1175 bytes} [Fri May 27 15:29:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:29:47.624366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-95686cdf-adce-4340-b373-b66a30546f37 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:47.627711 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:29:47.627711 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:29:47.645657 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-95686cdf-adce-4340-b373-b66a30546f37 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.025663 May 27 15:29:47.657099 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3009/6023] 10.222.0.13 () {58 vars in 1142 bytes} [Fri May 27 15:29:47 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:29:47.660585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1b3ea2ba-11fb-4c45-ab9e-27b0c6c0bd24 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-843621-1"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:29:47.663509 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:29:47.663509 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 15:29:47.688291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b3ea2ba-11fb-4c45-ab9e-27b0c6c0bd24 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:47.691413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b3ea2ba-11fb-4c45-ab9e-27b0c6c0bd24 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:48.265568 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1b3ea2ba-11fb-4c45-ab9e-27b0c6c0bd24 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.608322 May 27 15:29:48.267122 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3015/6024] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 15:29:47 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:29:48.277805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a6ef5b82-e878-47bf-b9b5-07f135125558 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:48.279141 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:29:48.279141 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:29:48.314028 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a6ef5b82-e878-47bf-b9b5-07f135125558 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.040302 May 27 15:29:48.320238 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3010/6025] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 15:29:48 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:29:48.331979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-041ddd67-105d-4986-98bf-6e6dd5b23f95 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-761828645", "availability_zone": "foo_zone"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:29:48.335476 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:29:48.335476 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 15:29:48.453926 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-041ddd67-105d-4986-98bf-6e6dd5b23f95 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] 10.222.0.13 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.132327 May 27 15:29:48.460465 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3016/6026] 10.222.0.13 () {60 vars in 1172 bytes} [Fri May 27 15:29:48 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:29:48.471881 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-714856f0-cf6c-4458-9fb5-578b50376774 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:29:48.473257 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:29:48.473257 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:29:48.551178 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-714856f0-cf6c-4458-9fb5-578b50376774 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.080642 May 27 15:29:48.553205 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3011/6027] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 15:29:48 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:29:48.565824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-20a2e8ae-d34e-43bb-b95f-8b9c771ca272 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:48.568443 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:29:48.568443 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 15:29:48.593767 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-20a2e8ae-d34e-43bb-b95f-8b9c771ca272 tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] 10.222.0.13 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.033884 May 27 15:29:48.594367 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3017/6028] 10.222.0.13 () {58 vars in 1151 bytes} [Fri May 27 15:29:48 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:29:48.605683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e70a47b0-eb7d-4205-b665-988ad1f7a21e tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-843621-1"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:29:48.607040 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:29:48.607040 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:29:48.628306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e70a47b0-eb7d-4205-b665-988ad1f7a21e tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:48.628846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e70a47b0-eb7d-4205-b665-988ad1f7a21e tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:49.391912 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e70a47b0-eb7d-4205-b665-988ad1f7a21e tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] 10.222.0.13 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.790306 May 27 15:29:49.400522 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3012/6029] 10.222.0.13 () {60 vars in 1193 bytes} [Fri May 27 15:29:48 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:29:49.405929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3a809d00-685c-4840-b26a-84687421ba3b tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:49.407471 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:29:49.407471 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 15:29:49.436703 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3a809d00-685c-4840-b26a-84687421ba3b tempest-TestAggregatesBasicOps-2065001081 tempest-TestAggregatesBasicOps-2065001081-project-admin] 10.222.0.13 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.034644 May 27 15:29:49.438824 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3018/6030] 10.222.0.13 () {58 vars in 1154 bytes} [Fri May 27 15:29:49 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 27 15:29:59.339378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:59.368159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:29:59.843490 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7a906150-028d-4cde-98b8-cfe47144dad5 tempest-PortsAdminExtendedAttrsTestJSON-1626842396 tempest-PortsAdminExtendedAttrsTestJSON-1626842396-project-admin] Calling method '.version_select at 0x7fc7753ca040>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:29:59.844927 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:29:59.844927 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:29:59.847621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a906150-028d-4cde-98b8-cfe47144dad5 tempest-PortsAdminExtendedAttrsTestJSON-1626842396 tempest-PortsAdminExtendedAttrsTestJSON-1626842396-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:59.848481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a906150-028d-4cde-98b8-cfe47144dad5 tempest-PortsAdminExtendedAttrsTestJSON-1626842396 tempest-PortsAdminExtendedAttrsTestJSON-1626842396-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:59.877997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a906150-028d-4cde-98b8-cfe47144dad5 tempest-PortsAdminExtendedAttrsTestJSON-1626842396 tempest-PortsAdminExtendedAttrsTestJSON-1626842396-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:59.888246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a906150-028d-4cde-98b8-cfe47144dad5 tempest-PortsAdminExtendedAttrsTestJSON-1626842396 tempest-PortsAdminExtendedAttrsTestJSON-1626842396-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:59.905844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a906150-028d-4cde-98b8-cfe47144dad5 tempest-PortsAdminExtendedAttrsTestJSON-1626842396 tempest-PortsAdminExtendedAttrsTestJSON-1626842396-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:29:59.906667 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a906150-028d-4cde-98b8-cfe47144dad5 tempest-PortsAdminExtendedAttrsTestJSON-1626842396 tempest-PortsAdminExtendedAttrsTestJSON-1626842396-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:29:59.951587 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7a906150-028d-4cde-98b8-cfe47144dad5 tempest-PortsAdminExtendedAttrsTestJSON-1626842396 tempest-PortsAdminExtendedAttrsTestJSON-1626842396-project-admin] 10.222.0.13 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.624509 May 27 15:29:59.961309 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3013/6031] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 15:29:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:30:09.971205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:30:09.972796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:30:09.974183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:30:10.522076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bcb1f676-2598-43c5-ab5d-d091986ef8ab tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Action: 'create', calling method: .version_select at 0x7fc776f24280>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1818080242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFD6G+pNvePn0ke+7o1znTVadmWGEFOTFdlL8nTW8RFqzRbE/OMIvcQBaMiv9NQbEz5NKRzs2QC+BNxaW91ql6OGhXalARbJxE9lycvE96yKzdI8s1w731mOv0piV/lukA=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:30:10.586377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-bcb1f676-2598-43c5-ab5d-d091986ef8ab tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Getting quotas for project 26d36ed2771b45f48e5359a5e5d6272c. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:30:10.601822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-bcb1f676-2598-43c5-ab5d-d091986ef8ab tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Getting quotas for user 70b46a33d3b34006807b61970dcac05d and project 26d36ed2771b45f48e5359a5e5d6272c. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:30:10.664797 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bcb1f676-2598-43c5-ab5d-d091986ef8ab tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.705879 May 27 15:30:10.673073 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3019/6032] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:30:09 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:30:13.116163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-72eb20d1-2564-4f88-b34a-f22ea3e4e083 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e0f02dd-6fbf-4daa-a397-949325305d1e", "device": "/dev/sdb"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:30:13.117683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-72eb20d1-2564-4f88-b34a-f22ea3e4e083 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:30:13.124996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:30:13.126151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:30:13.141723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72eb20d1-2564-4f88-b34a-f22ea3e4e083 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:13.142606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72eb20d1-2564-4f88-b34a-f22ea3e4e083 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:13.150863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72eb20d1-2564-4f88-b34a-f22ea3e4e083 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:13.151730 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-72eb20d1-2564-4f88-b34a-f22ea3e4e083 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:13.647201 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-72eb20d1-2564-4f88-b34a-f22ea3e4e083 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "POST /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.535774 May 27 15:30:13.648147 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3014/6033] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 15:30:13 2022] POST /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e/os-volume_attachments => generated 194 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:30:23.843405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-be434745-3b6e-42bf-882d-a8d59fc0bfa4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-278031123-access_point-919580686", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "ce17b3d2-f138-4547-9ed7-71e8b3b8682e"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1818080242", "security_groups": [{"name": "tempest-secgroup_access--640841513"}, {"name": "tempest-secgroup_general--1832610270"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:30:23.890179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:30:23.895089 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:30:24.338659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-be434745-3b6e-42bf-882d-a8d59fc0bfa4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] validate_networks() for [('ce17b3d2-f138-4547-9ed7-71e8b3b8682e', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:30:25.190966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-be434745-3b6e-42bf-882d-a8d59fc0bfa4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:30:25.193487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-be434745-3b6e-42bf-882d-a8d59fc0bfa4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:30:25.194170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-be434745-3b6e-42bf-882d-a8d59fc0bfa4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:30:25.195777 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-be434745-3b6e-42bf-882d-a8d59fc0bfa4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:30:25.200726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-be434745-3b6e-42bf-882d-a8d59fc0bfa4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:30:25.228187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be434745-3b6e-42bf-882d-a8d59fc0bfa4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:25.228659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be434745-3b6e-42bf-882d-a8d59fc0bfa4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:25.229498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be434745-3b6e-42bf-882d-a8d59fc0bfa4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:25.229945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be434745-3b6e-42bf-882d-a8d59fc0bfa4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:25.279908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-be434745-3b6e-42bf-882d-a8d59fc0bfa4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Getting quotas for project 26d36ed2771b45f48e5359a5e5d6272c. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:30:25.295407 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-be434745-3b6e-42bf-882d-a8d59fc0bfa4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Getting quotas for user 70b46a33d3b34006807b61970dcac05d and project 26d36ed2771b45f48e5359a5e5d6272c. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:30:25.335555 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-be434745-3b6e-42bf-882d-a8d59fc0bfa4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:30:25.338025 n-d-843621-1 devstack@n-api.service[119249]: WARNING nova.utils [None req-be434745-3b6e-42bf-882d-a8d59fc0bfa4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-278031123-access_point-919580686 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-278031123-acc May 27 15:30:25.338785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-be434745-3b6e-42bf-882d-a8d59fc0bfa4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:30:25.479995 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-be434745-3b6e-42bf-882d-a8d59fc0bfa4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.649441 May 27 15:30:25.490016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:30:25.491159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:30:25.491477 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3020/6034] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:30:23 2022] POST /compute/v2.1/servers => generated 457 bytes in 1662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:30:25.495464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-68d652ca-c22b-4dc2-a8c5-222cf95e75ee tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:30:25.497024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-68d652ca-c22b-4dc2-a8c5-222cf95e75ee tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:30:25.691804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-68d652ca-c22b-4dc2-a8c5-222cf95e75ee tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:30:25.711103 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-68d652ca-c22b-4dc2-a8c5-222cf95e75ee tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 200 len: 1293 microversion: 2.1 time: 0.222826 May 27 15:30:25.719345 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3015/6035] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:30:25 2022] GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 1293 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:30:26.737819 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ca9bad9d-1eac-452c-81bd-256e67db4c2a tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:30:26.738483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ca9bad9d-1eac-452c-81bd-256e67db4c2a tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:30:26.756304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ca9bad9d-1eac-452c-81bd-256e67db4c2a tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:26.758793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ca9bad9d-1eac-452c-81bd-256e67db4c2a tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:26.759865 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ca9bad9d-1eac-452c-81bd-256e67db4c2a tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:26.764076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ca9bad9d-1eac-452c-81bd-256e67db4c2a tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:26.979491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ca9bad9d-1eac-452c-81bd-256e67db4c2a tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:30:26.995300 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ca9bad9d-1eac-452c-81bd-256e67db4c2a tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 200 len: 1297 microversion: 2.1 time: 0.262875 May 27 15:30:26.996016 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3021/6036] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:30:26 2022] GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 1297 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:30:28.013884 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4943c122-62f7-4cdb-85bc-d2c89caec8e0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:30:28.016915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4943c122-62f7-4cdb-85bc-d2c89caec8e0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:30:28.038503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4943c122-62f7-4cdb-85bc-d2c89caec8e0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:28.042298 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4943c122-62f7-4cdb-85bc-d2c89caec8e0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:28.044365 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4943c122-62f7-4cdb-85bc-d2c89caec8e0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:28.044826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4943c122-62f7-4cdb-85bc-d2c89caec8e0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:28.227180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4943c122-62f7-4cdb-85bc-d2c89caec8e0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:30:28.243015 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4943c122-62f7-4cdb-85bc-d2c89caec8e0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 200 len: 1363 microversion: 2.1 time: 0.230671 May 27 15:30:28.245160 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3016/6037] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:30:28 2022] GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:30:29.276826 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2a659fb9-da10-404d-866d-8e185a8bf95c tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:30:29.278342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2a659fb9-da10-404d-866d-8e185a8bf95c tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:30:29.301341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a659fb9-da10-404d-866d-8e185a8bf95c tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:29.302430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a659fb9-da10-404d-866d-8e185a8bf95c tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:29.303840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a659fb9-da10-404d-866d-8e185a8bf95c tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:29.305251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a659fb9-da10-404d-866d-8e185a8bf95c tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:29.546691 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2a659fb9-da10-404d-866d-8e185a8bf95c tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:30:29.558559 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2a659fb9-da10-404d-866d-8e185a8bf95c tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 200 len: 1351 microversion: 2.1 time: 0.298747 May 27 15:30:29.559876 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3022/6038] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:30:29 2022] GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 1351 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:30:30.589955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-568e145c-3423-4673-b70b-efe08b897854 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:30:30.594643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-568e145c-3423-4673-b70b-efe08b897854 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:30:30.690476 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-568e145c-3423-4673-b70b-efe08b897854 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:30.708006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-568e145c-3423-4673-b70b-efe08b897854 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:30.721802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-568e145c-3423-4673-b70b-efe08b897854 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:30.722283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-568e145c-3423-4673-b70b-efe08b897854 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:31.854273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-568e145c-3423-4673-b70b-efe08b897854 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:30:31.877223 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-568e145c-3423-4673-b70b-efe08b897854 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 200 len: 1470 microversion: 2.1 time: 1.301207 May 27 15:30:31.901604 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3017/6039] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:30:30 2022] GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 1470 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:30:32.906706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-784fd144-a151-4fca-8320-eec581f01db5 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:30:32.907369 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-784fd144-a151-4fca-8320-eec581f01db5 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:30:32.940918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-784fd144-a151-4fca-8320-eec581f01db5 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:32.943827 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-784fd144-a151-4fca-8320-eec581f01db5 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:32.948323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-784fd144-a151-4fca-8320-eec581f01db5 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:32.953806 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-784fd144-a151-4fca-8320-eec581f01db5 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:34.062863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-91b52f8d-d532-4c6a-a4cd-4c6800c9434e req-d93b6845-8fcb-4eb1-b062-766a956c74de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27f18944-21e3-46ef-a39b-9fb44399fc44", "tag": "79cf1bd4-870a-4462-b538-7f7842f89048"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:30:34.091283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-91b52f8d-d532-4c6a-a4cd-4c6800c9434e req-d93b6845-8fcb-4eb1-b062-766a956c74de service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:34.096437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-91b52f8d-d532-4c6a-a4cd-4c6800c9434e req-d93b6845-8fcb-4eb1-b062-766a956c74de service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:34.166614 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-91b52f8d-d532-4c6a-a4cd-4c6800c9434e req-d93b6845-8fcb-4eb1-b062-766a956c74de service nova] Creating event network-changed:79cf1bd4-870a-4462-b538-7f7842f89048 for instance 27f18944-21e3-46ef-a39b-9fb44399fc44 on n-h1-843621-1 May 27 15:30:34.178690 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-91b52f8d-d532-4c6a-a4cd-4c6800c9434e req-d93b6845-8fcb-4eb1-b062-766a956c74de service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137970 May 27 15:30:34.181337 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3018/6040] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:30:34.496898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-784fd144-a151-4fca-8320-eec581f01db5 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:30:34.517447 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-784fd144-a151-4fca-8320-eec581f01db5 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 200 len: 1470 microversion: 2.1 time: 1.615427 May 27 15:30:34.518862 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3023/6041] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:30:32 2022] GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 1470 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:30:35.536922 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-88d27071-3b18-4b51-845a-7a39f358cbc6 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:30:35.537782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-88d27071-3b18-4b51-845a-7a39f358cbc6 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:30:35.559165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88d27071-3b18-4b51-845a-7a39f358cbc6 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:35.559552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88d27071-3b18-4b51-845a-7a39f358cbc6 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:35.560393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88d27071-3b18-4b51-845a-7a39f358cbc6 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:35.566842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88d27071-3b18-4b51-845a-7a39f358cbc6 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:35.696442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:30:35.925342 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-88d27071-3b18-4b51-845a-7a39f358cbc6 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:30:35.955026 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-88d27071-3b18-4b51-845a-7a39f358cbc6 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 200 len: 1470 microversion: 2.1 time: 0.411953 May 27 15:30:35.975437 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3019/6042] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:30:35 2022] GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 1470 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:30:36.982699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-51fc43d4-138a-46e5-92a6-a4f8431c02d4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:30:36.983529 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-51fc43d4-138a-46e5-92a6-a4f8431c02d4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:30:37.026312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:30:37.035863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:30:37.056252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51fc43d4-138a-46e5-92a6-a4f8431c02d4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:37.057996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51fc43d4-138a-46e5-92a6-a4f8431c02d4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:37.063247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51fc43d4-138a-46e5-92a6-a4f8431c02d4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:37.065095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51fc43d4-138a-46e5-92a6-a4f8431c02d4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:37.453412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-51fc43d4-138a-46e5-92a6-a4f8431c02d4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:30:37.471007 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-51fc43d4-138a-46e5-92a6-a4f8431c02d4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 200 len: 1470 microversion: 2.1 time: 0.487511 May 27 15:30:37.471543 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3024/6043] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:30:36 2022] GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 1470 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:30:38.489173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-04cb64d1-8875-4892-a739-a0542b344887 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:30:38.490864 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-04cb64d1-8875-4892-a739-a0542b344887 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:30:38.514823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04cb64d1-8875-4892-a739-a0542b344887 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:38.516887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04cb64d1-8875-4892-a739-a0542b344887 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:38.520130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04cb64d1-8875-4892-a739-a0542b344887 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:38.521106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04cb64d1-8875-4892-a739-a0542b344887 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:39.171148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-04cb64d1-8875-4892-a739-a0542b344887 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:30:39.184097 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-04cb64d1-8875-4892-a739-a0542b344887 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 200 len: 1470 microversion: 2.1 time: 0.699087 May 27 15:30:39.195295 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3020/6044] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:30:38 2022] GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 1470 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:30:40.202005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cba2ca80-5adc-4bec-87ad-d213b712ea44 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:30:40.202552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cba2ca80-5adc-4bec-87ad-d213b712ea44 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:30:40.218779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cba2ca80-5adc-4bec-87ad-d213b712ea44 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:40.221238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cba2ca80-5adc-4bec-87ad-d213b712ea44 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:40.224176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cba2ca80-5adc-4bec-87ad-d213b712ea44 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:40.226128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cba2ca80-5adc-4bec-87ad-d213b712ea44 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:40.695626 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cba2ca80-5adc-4bec-87ad-d213b712ea44 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:30:40.721528 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cba2ca80-5adc-4bec-87ad-d213b712ea44 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 200 len: 1470 microversion: 2.1 time: 0.522084 May 27 15:30:40.733879 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3025/6045] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:30:40 2022] GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 1470 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:30:40.837673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-2140fcd8-b595-44ef-9529-e1a7ca655d8f req-95850fde-0e72-46fd-8049-358918483707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27f18944-21e3-46ef-a39b-9fb44399fc44", "name": "network-vif-plugged", "status": "completed", "tag": "79cf1bd4-870a-4462-b538-7f7842f89048"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:30:40.854477 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2140fcd8-b595-44ef-9529-e1a7ca655d8f req-95850fde-0e72-46fd-8049-358918483707 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:40.854950 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-2140fcd8-b595-44ef-9529-e1a7ca655d8f req-95850fde-0e72-46fd-8049-358918483707 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:40.880909 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-2140fcd8-b595-44ef-9529-e1a7ca655d8f req-95850fde-0e72-46fd-8049-358918483707 service nova] Creating event network-vif-plugged:79cf1bd4-870a-4462-b538-7f7842f89048 for instance 27f18944-21e3-46ef-a39b-9fb44399fc44 on n-h1-843621-1 May 27 15:30:40.894634 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-2140fcd8-b595-44ef-9529-e1a7ca655d8f req-95850fde-0e72-46fd-8049-358918483707 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.433944 May 27 15:30:40.897872 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3021/6046] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:30:41.748281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-91ac6372-0999-4546-bf05-98cb4642d3b4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:30:41.780741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-91ac6372-0999-4546-bf05-98cb4642d3b4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:30:41.813565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-91ac6372-0999-4546-bf05-98cb4642d3b4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:41.815313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-91ac6372-0999-4546-bf05-98cb4642d3b4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:41.818733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-91ac6372-0999-4546-bf05-98cb4642d3b4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:41.820501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-91ac6372-0999-4546-bf05-98cb4642d3b4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:42.220704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-91ac6372-0999-4546-bf05-98cb4642d3b4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:30:42.232314 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-91ac6372-0999-4546-bf05-98cb4642d3b4 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 200 len: 1470 microversion: 2.1 time: 0.494300 May 27 15:30:42.233531 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3026/6047] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:30:41 2022] GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 1470 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:30:43.258171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ba52cae8-40ac-4e23-9b93-d8559e067451 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:30:43.258906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ba52cae8-40ac-4e23-9b93-d8559e067451 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:30:43.288022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba52cae8-40ac-4e23-9b93-d8559e067451 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:43.288855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba52cae8-40ac-4e23-9b93-d8559e067451 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:43.291445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba52cae8-40ac-4e23-9b93-d8559e067451 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:43.292068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba52cae8-40ac-4e23-9b93-d8559e067451 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:43.553966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ba52cae8-40ac-4e23-9b93-d8559e067451 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:30:43.581337 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ba52cae8-40ac-4e23-9b93-d8559e067451 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 200 len: 1643 microversion: 2.1 time: 0.332820 May 27 15:30:43.584952 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3022/6048] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:30:43 2022] GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 1643 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:30:43.601786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f17d58ee-e9df-43cf-9469-df039c435f05 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:30:43.602415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f17d58ee-e9df-43cf-9469-df039c435f05 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:30:43.622046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f17d58ee-e9df-43cf-9469-df039c435f05 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:43.622430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f17d58ee-e9df-43cf-9469-df039c435f05 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:43.623230 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f17d58ee-e9df-43cf-9469-df039c435f05 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:43.623686 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f17d58ee-e9df-43cf-9469-df039c435f05 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:44.020835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f17d58ee-e9df-43cf-9469-df039c435f05 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:30:44.038102 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f17d58ee-e9df-43cf-9469-df039c435f05 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 200 len: 1643 microversion: 2.1 time: 0.440150 May 27 15:30:44.042333 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3027/6049] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:30:43 2022] GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 1643 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:30:44.059379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-44a3798a-94b7-424c-89ee-9d000a672f7a tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:30:44.060009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-44a3798a-94b7-424c-89ee-9d000a672f7a tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:30:44.069594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44a3798a-94b7-424c-89ee-9d000a672f7a tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:44.070062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44a3798a-94b7-424c-89ee-9d000a672f7a tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:44.070866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44a3798a-94b7-424c-89ee-9d000a672f7a tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:44.071319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44a3798a-94b7-424c-89ee-9d000a672f7a tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:44.758886 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-44a3798a-94b7-424c-89ee-9d000a672f7a tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 200 len: 1794 microversion: 2.1 time: 0.702945 May 27 15:30:44.760460 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3023/6050] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:30:44 2022] GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 1794 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:30:48.164482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-b9f6a13b-7378-4f6f-a735-22dba5a22f51 req-5b469ed1-519b-4fef-b719-3e61d0f9ea6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27f18944-21e3-46ef-a39b-9fb44399fc44", "tag": "79cf1bd4-870a-4462-b538-7f7842f89048"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:30:48.190375 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b9f6a13b-7378-4f6f-a735-22dba5a22f51 req-5b469ed1-519b-4fef-b719-3e61d0f9ea6a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:30:48.190805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b9f6a13b-7378-4f6f-a735-22dba5a22f51 req-5b469ed1-519b-4fef-b719-3e61d0f9ea6a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:30:48.227605 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-b9f6a13b-7378-4f6f-a735-22dba5a22f51 req-5b469ed1-519b-4fef-b719-3e61d0f9ea6a service nova] Creating event network-changed:79cf1bd4-870a-4462-b538-7f7842f89048 for instance 27f18944-21e3-46ef-a39b-9fb44399fc44 on n-h1-843621-1 May 27 15:30:48.246521 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-b9f6a13b-7378-4f6f-a735-22dba5a22f51 req-5b469ed1-519b-4fef-b719-3e61d0f9ea6a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086211 May 27 15:30:48.249023 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3028/6051] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:31:23.025301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9e6c43d2-f3a0-46ed-a2e9-b57d0354a621 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:31:23.027456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9e6c43d2-f3a0-46ed-a2e9-b57d0354a621 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:31:23.038638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=20 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:31:23.043058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=40 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:31:23.045351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e6c43d2-f3a0-46ed-a2e9-b57d0354a621 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:31:23.048705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e6c43d2-f3a0-46ed-a2e9-b57d0354a621 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:31:23.049849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e6c43d2-f3a0-46ed-a2e9-b57d0354a621 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:31:23.050950 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e6c43d2-f3a0-46ed-a2e9-b57d0354a621 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:31:23.194612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-9e6c43d2-f3a0-46ed-a2e9-b57d0354a621 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lazy-loading 'services' on Instance uuid f6188d8a-aa0f-4e17-881e-5f07753eac4e {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:31:23.396026 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9e6c43d2-f3a0-46ed-a2e9-b57d0354a621 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e/os-volume_attachments/2e0f02dd-6fbf-4daa-a397-949325305d1e" status: 202 len: 0 microversion: 2.1 time: 0.375836 May 27 15:31:23.414173 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3024/6052] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 15:31:23 2022] DELETE /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e/os-volume_attachments/2e0f02dd-6fbf-4daa-a397-949325305d1e => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:31:39.195703 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1dbeb243-9909-4529-96a8-2bea62d88cde tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:31:39.196332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1dbeb243-9909-4529-96a8-2bea62d88cde tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:31:39.208431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:31:39.211082 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=46 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:31:39.213059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1dbeb243-9909-4529-96a8-2bea62d88cde tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:31:39.214234 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1dbeb243-9909-4529-96a8-2bea62d88cde tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:31:39.215203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1dbeb243-9909-4529-96a8-2bea62d88cde tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:31:39.215804 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1dbeb243-9909-4529-96a8-2bea62d88cde tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:31:39.279774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1dbeb243-9909-4529-96a8-2bea62d88cde tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:31:39.430253 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1dbeb243-9909-4529-96a8-2bea62d88cde tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e" status: 204 len: 0 microversion: 2.1 time: 0.239982 May 27 15:31:39.435512 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3029/6053] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:31:39 2022] DELETE /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:31:39.439185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:31:39.440406 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:31:39.445451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-54475d6c-4e0e-4908-ade3-7cc074f50b3c tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:31:39.446173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-54475d6c-4e0e-4908-ade3-7cc074f50b3c tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:31:39.470309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-54475d6c-4e0e-4908-ade3-7cc074f50b3c tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:31:39.470777 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-54475d6c-4e0e-4908-ade3-7cc074f50b3c tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:31:39.471584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-54475d6c-4e0e-4908-ade3-7cc074f50b3c tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:31:39.472039 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-54475d6c-4e0e-4908-ade3-7cc074f50b3c tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:31:39.789741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-54475d6c-4e0e-4908-ade3-7cc074f50b3c tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:31:39.805882 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-54475d6c-4e0e-4908-ade3-7cc074f50b3c tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e" status: 200 len: 1514 microversion: 2.1 time: 0.369094 May 27 15:31:39.815049 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3025/6054] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:31:39 2022] GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e => generated 1514 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:31:40.824498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dc468b7b-f864-48f8-a284-391827f576c7 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:31:40.825249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dc468b7b-f864-48f8-a284-391827f576c7 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:31:40.840298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc468b7b-f864-48f8-a284-391827f576c7 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:31:40.840786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc468b7b-f864-48f8-a284-391827f576c7 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:31:40.841595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc468b7b-f864-48f8-a284-391827f576c7 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:31:40.842026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dc468b7b-f864-48f8-a284-391827f576c7 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:31:41.216068 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-dc468b7b-f864-48f8-a284-391827f576c7 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:31:41.229201 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dc468b7b-f864-48f8-a284-391827f576c7 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e" status: 200 len: 1514 microversion: 2.1 time: 0.409383 May 27 15:31:41.229971 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3030/6055] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:31:40 2022] GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e => generated 1514 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:31:41.986381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-bc6e6f00-afa8-49fa-aba0-10574ce52d30 req-4b3ecf3b-60b2-467c-accf-745ccb08adbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6188d8a-aa0f-4e17-881e-5f07753eac4e", "name": "network-vif-deleted", "tag": "81ecfcf0-7102-42d2-8300-52fcabf4ecb3"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:31:42.013443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-bc6e6f00-afa8-49fa-aba0-10574ce52d30 req-4b3ecf3b-60b2-467c-accf-745ccb08adbf service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:31:42.026462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-bc6e6f00-afa8-49fa-aba0-10574ce52d30 req-4b3ecf3b-60b2-467c-accf-745ccb08adbf service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:31:42.077493 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-bc6e6f00-afa8-49fa-aba0-10574ce52d30 req-4b3ecf3b-60b2-467c-accf-745ccb08adbf service nova] Creating event network-vif-deleted:81ecfcf0-7102-42d2-8300-52fcabf4ecb3 for instance f6188d8a-aa0f-4e17-881e-5f07753eac4e on n-h2-843621-1 May 27 15:31:42.100486 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-bc6e6f00-afa8-49fa-aba0-10574ce52d30 req-4b3ecf3b-60b2-467c-accf-745ccb08adbf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130350 May 27 15:31:42.105828 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3026/6056] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:31:42.247143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-845043d0-cd9f-4714-8005-6c069c0067f0 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:31:42.247849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-845043d0-cd9f-4714-8005-6c069c0067f0 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:31:42.262276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-845043d0-cd9f-4714-8005-6c069c0067f0 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:31:42.268949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-845043d0-cd9f-4714-8005-6c069c0067f0 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:31:42.271588 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-845043d0-cd9f-4714-8005-6c069c0067f0 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:31:42.272232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-845043d0-cd9f-4714-8005-6c069c0067f0 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:31:42.350542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-845043d0-cd9f-4714-8005-6c069c0067f0 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:31:42.351010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-845043d0-cd9f-4714-8005-6c069c0067f0 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:31:42.351483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-845043d0-cd9f-4714-8005-6c069c0067f0 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lazy-loading 'fault' on Instance uuid f6188d8a-aa0f-4e17-881e-5f07753eac4e {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:31:42.492126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-845043d0-cd9f-4714-8005-6c069c0067f0 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:31:42.504040 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-845043d0-cd9f-4714-8005-6c069c0067f0 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e" status: 200 len: 1309 microversion: 2.1 time: 0.260987 May 27 15:31:42.507558 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3031/6057] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:31:42 2022] GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e => generated 1309 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:31:43.523836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e864cf30-2d59-43ee-b4f2-9d2c1b8272cc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:31:43.524567 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e864cf30-2d59-43ee-b4f2-9d2c1b8272cc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: f6188d8a-aa0f-4e17-881e-5f07753eac4e] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:31:43.551424 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e864cf30-2d59-43ee-b4f2-9d2c1b8272cc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:31:43.552085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e864cf30-2d59-43ee-b4f2-9d2c1b8272cc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:31:43.554158 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e864cf30-2d59-43ee-b4f2-9d2c1b8272cc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:31:43.557788 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e864cf30-2d59-43ee-b4f2-9d2c1b8272cc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:31:43.603084 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-e864cf30-2d59-43ee-b4f2-9d2c1b8272cc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] HTTP exception thrown: Instance f6188d8a-aa0f-4e17-881e-5f07753eac4e could not be found. May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e864cf30-2d59-43ee-b4f2-9d2c1b8272cc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Request method failure captured: May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e HTTP/1.1 May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikO210qV7wjiv5jm6c-Yctqld8Y0s9f0chDoCe628qVOsSIxZUueZlT_jMALXabALJeEd1w87o8R60Y-j-9o7I2TzgJDXFxyhfxlRNJynt9EDxaEP3O-Km9O1L-Hp09fHnuAjJMUWsnttaMMXhB60JR2oXGq8EwA4qC8HXvdfVJdd5Oo May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 3baeb07bbeb64100b2bee8a44ef25f66 May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1154843667 May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3baeb07bbeb64100b2bee8a44ef25f66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3baeb07bbeb64100b2bee8a44ef25f66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3baeb07bbeb64100b2bee8a44ef25f66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3baeb07bbeb64100b2bee8a44ef25f66", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-VolumesSnapshotTestJSON-1154843667 May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 3baeb07bbeb64100b2bee8a44ef25f66 May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1154843667 May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-VolumesSnapshotTestJSON-1154843667-project May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 9ff6334db7c942648631e5112e499cb7 May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-VolumesSnapshotTestJSON-1154843667-project May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance f6188d8a-aa0f-4e17-881e-5f07753eac4e could not be found. May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'f6188d8a-aa0f-4e17-881e-5f07753eac4e'} May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6188d8a-aa0f-4e17-881e-5f07753eac4e could not be found. May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6188d8a-aa0f-4e17-881e-5f07753eac4e could not be found. May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:31:43.605797 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:31:43.609888 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:31:43.609888 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:31:43.609888 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:31:43.609888 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:31:43.609888 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:31:43.609888 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6188d8a-aa0f-4e17-881e-5f07753eac4e could not be found. May 27 15:31:43.609888 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:31:43.617378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e864cf30-2d59-43ee-b4f2-9d2c1b8272cc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Returning 404 to user: Instance f6188d8a-aa0f-4e17-881e-5f07753eac4e could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:31:43.618972 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e864cf30-2d59-43ee-b4f2-9d2c1b8272cc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e" status: 404 len: 111 microversion: 2.1 time: 0.101253 May 27 15:31:43.625110 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3027/6058] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:31:43 2022] GET /compute/v2.1/servers/f6188d8a-aa0f-4e17-881e-5f07753eac4e => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:31:55.572009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f95ee983-43dc-4e26-a303-19fc4d8f2de6 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2101584441", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "1631597f-4a7a-438e-8048-4ec63140dc41"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:31:55.591377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:31:55.594625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:31:55.727509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-f95ee983-43dc-4e26-a303-19fc4d8f2de6 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] validate_networks() for [('1631597f-4a7a-438e-8048-4ec63140dc41', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:31:57.310770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f95ee983-43dc-4e26-a303-19fc4d8f2de6 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:31:57.312589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f95ee983-43dc-4e26-a303-19fc4d8f2de6 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:31:57.314017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f95ee983-43dc-4e26-a303-19fc4d8f2de6 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:31:57.314681 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f95ee983-43dc-4e26-a303-19fc4d8f2de6 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:31:57.315399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-f95ee983-43dc-4e26-a303-19fc4d8f2de6 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:31:57.330641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f95ee983-43dc-4e26-a303-19fc4d8f2de6 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:31:57.333574 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f95ee983-43dc-4e26-a303-19fc4d8f2de6 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:31:57.335669 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f95ee983-43dc-4e26-a303-19fc4d8f2de6 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:31:57.339592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f95ee983-43dc-4e26-a303-19fc4d8f2de6 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:31:57.425081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-f95ee983-43dc-4e26-a303-19fc4d8f2de6 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Getting quotas for project 3baeb07bbeb64100b2bee8a44ef25f66. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:31:57.443528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-f95ee983-43dc-4e26-a303-19fc4d8f2de6 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Getting quotas for user 9ff6334db7c942648631e5112e499cb7 and project 3baeb07bbeb64100b2bee8a44ef25f66. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:31:57.495595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f95ee983-43dc-4e26-a303-19fc4d8f2de6 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:31:57.502960 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f95ee983-43dc-4e26-a303-19fc4d8f2de6 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:31:57.603164 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f95ee983-43dc-4e26-a303-19fc4d8f2de6 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.036515 May 27 15:31:57.615173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-61c31260-2d72-4478-acaf-eee6d2906b7f tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:31:57.616005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-61c31260-2d72-4478-acaf-eee6d2906b7f tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:31:57.621170 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3032/6059] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:31:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:31:57.628932 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:31:57.632639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=10 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:31:57.798083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-61c31260-2d72-4478-acaf-eee6d2906b7f tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:31:57.809472 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-61c31260-2d72-4478-acaf-eee6d2906b7f tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1219 microversion: 2.1 time: 0.196219 May 27 15:31:57.813153 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3028/6060] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:31:57 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1219 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:31:58.828706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-55287556-891f-4855-8708-0064caedfaa1 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:31:58.829477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-55287556-891f-4855-8708-0064caedfaa1 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:31:58.949838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-55287556-891f-4855-8708-0064caedfaa1 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:31:58.960154 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-55287556-891f-4855-8708-0064caedfaa1 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1219 microversion: 2.1 time: 0.136797 May 27 15:31:58.964785 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3033/6061] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:31:58 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:31:59.977630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a2a0c288-7e2f-4bb9-9aa4-2903157cb881 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:31:59.978298 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a2a0c288-7e2f-4bb9-9aa4-2903157cb881 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:00.185085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a2a0c288-7e2f-4bb9-9aa4-2903157cb881 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:00.192553 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a2a0c288-7e2f-4bb9-9aa4-2903157cb881 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1219 microversion: 2.1 time: 0.218468 May 27 15:32:00.213211 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3029/6062] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:31:59 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1219 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:01.215335 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-40b11e2f-1d43-473d-9243-e6e6c0e2ba9e tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:01.298220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-40b11e2f-1d43-473d-9243-e6e6c0e2ba9e tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:01.716531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-40b11e2f-1d43-473d-9243-e6e6c0e2ba9e tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:01.731207 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-40b11e2f-1d43-473d-9243-e6e6c0e2ba9e tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1219 microversion: 2.1 time: 0.525095 May 27 15:32:01.733108 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3034/6063] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:01 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1219 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:02.751597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8440366e-1afb-48cc-bc58-82cffff9e585 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:02.752742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8440366e-1afb-48cc-bc58-82cffff9e585 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:02.798783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8440366e-1afb-48cc-bc58-82cffff9e585 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:02.799326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8440366e-1afb-48cc-bc58-82cffff9e585 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:02.800128 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8440366e-1afb-48cc-bc58-82cffff9e585 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:02.800633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8440366e-1afb-48cc-bc58-82cffff9e585 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:03.204963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8440366e-1afb-48cc-bc58-82cffff9e585 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:03.245142 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8440366e-1afb-48cc-bc58-82cffff9e585 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1215 microversion: 2.1 time: 0.499022 May 27 15:32:03.259989 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3030/6064] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:02 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1215 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:04.273920 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f3841b77-e3d5-42a2-96eb-60b5be1fee6f tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:04.276197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f3841b77-e3d5-42a2-96eb-60b5be1fee6f tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:04.315393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3841b77-e3d5-42a2-96eb-60b5be1fee6f tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:04.320802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3841b77-e3d5-42a2-96eb-60b5be1fee6f tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:04.324149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3841b77-e3d5-42a2-96eb-60b5be1fee6f tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:04.325067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f3841b77-e3d5-42a2-96eb-60b5be1fee6f tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:04.661940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f3841b77-e3d5-42a2-96eb-60b5be1fee6f tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:04.674951 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f3841b77-e3d5-42a2-96eb-60b5be1fee6f tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1277 microversion: 2.1 time: 0.404271 May 27 15:32:04.678743 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3035/6065] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:04 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1277 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:05.703214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6a03186c-79ff-4d41-8cdb-d88cfe73479b tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:05.704650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6a03186c-79ff-4d41-8cdb-d88cfe73479b tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:05.727489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6a03186c-79ff-4d41-8cdb-d88cfe73479b tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:05.728350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6a03186c-79ff-4d41-8cdb-d88cfe73479b tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:05.729421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6a03186c-79ff-4d41-8cdb-d88cfe73479b tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:05.730083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6a03186c-79ff-4d41-8cdb-d88cfe73479b tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:06.063552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6a03186c-79ff-4d41-8cdb-d88cfe73479b tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:06.092642 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6a03186c-79ff-4d41-8cdb-d88cfe73479b tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1319 microversion: 2.1 time: 0.395526 May 27 15:32:06.104145 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3031/6066] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:05 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:07.113131 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5d26c671-d6fb-4270-893d-dbe8118e9da8 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:07.114578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5d26c671-d6fb-4270-893d-dbe8118e9da8 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:07.129932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d26c671-d6fb-4270-893d-dbe8118e9da8 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:07.137020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d26c671-d6fb-4270-893d-dbe8118e9da8 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:07.138755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d26c671-d6fb-4270-893d-dbe8118e9da8 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:07.139384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5d26c671-d6fb-4270-893d-dbe8118e9da8 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:07.380945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:07.483670 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5d26c671-d6fb-4270-893d-dbe8118e9da8 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:07.498189 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5d26c671-d6fb-4270-893d-dbe8118e9da8 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1319 microversion: 2.1 time: 0.389335 May 27 15:32:07.511471 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3036/6067] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:07 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:08.518581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d86ebe2a-6af1-4d60-86b9-150c7ab0cbbc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:08.522423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d86ebe2a-6af1-4d60-86b9-150c7ab0cbbc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:08.534566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d86ebe2a-6af1-4d60-86b9-150c7ab0cbbc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:08.535305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d86ebe2a-6af1-4d60-86b9-150c7ab0cbbc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:08.545075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d86ebe2a-6af1-4d60-86b9-150c7ab0cbbc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:08.545710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d86ebe2a-6af1-4d60-86b9-150c7ab0cbbc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:08.754293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-65061247-a14e-4689-9a7b-1a926f31a89e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-306638064", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "c6d8a55a-e4a9-45bd-a38f-83ad65754a73"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1818080242", "security_groups": []}, "os:scheduler_hints": {"different_host": ["27f18944-21e3-46ef-a39b-9fb44399fc44"]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:32:08.857615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-65061247-a14e-4689-9a7b-1a926f31a89e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] validate_networks() for [('c6d8a55a-e4a9-45bd-a38f-83ad65754a73', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:32:08.860064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d86ebe2a-6af1-4d60-86b9-150c7ab0cbbc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:08.908286 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d86ebe2a-6af1-4d60-86b9-150c7ab0cbbc tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1319 microversion: 2.1 time: 0.393819 May 27 15:32:08.909575 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3032/6068] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:08 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:09.638145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-65061247-a14e-4689-9a7b-1a926f31a89e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:32:09.638664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-65061247-a14e-4689-9a7b-1a926f31a89e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:32:09.639178 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-65061247-a14e-4689-9a7b-1a926f31a89e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:32:09.640218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-65061247-a14e-4689-9a7b-1a926f31a89e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:32:09.640663 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-65061247-a14e-4689-9a7b-1a926f31a89e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:32:09.684188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65061247-a14e-4689-9a7b-1a926f31a89e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:09.684700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65061247-a14e-4689-9a7b-1a926f31a89e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:09.687244 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65061247-a14e-4689-9a7b-1a926f31a89e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:09.687725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-65061247-a14e-4689-9a7b-1a926f31a89e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:09.739174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-65061247-a14e-4689-9a7b-1a926f31a89e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Getting quotas for project 26d36ed2771b45f48e5359a5e5d6272c. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:32:09.745324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-65061247-a14e-4689-9a7b-1a926f31a89e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Getting quotas for user 70b46a33d3b34006807b61970dcac05d and project 26d36ed2771b45f48e5359a5e5d6272c. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:32:09.798410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-65061247-a14e-4689-9a7b-1a926f31a89e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:32:09.814782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-65061247-a14e-4689-9a7b-1a926f31a89e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:32:09.938203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d43ef154-d6d2-4a2a-8431-ad04c6afb8b4 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:09.939275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d43ef154-d6d2-4a2a-8431-ad04c6afb8b4 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:09.956233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d43ef154-d6d2-4a2a-8431-ad04c6afb8b4 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:09.956721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d43ef154-d6d2-4a2a-8431-ad04c6afb8b4 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:09.957531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d43ef154-d6d2-4a2a-8431-ad04c6afb8b4 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:09.957992 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d43ef154-d6d2-4a2a-8431-ad04c6afb8b4 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:09.981673 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-65061247-a14e-4689-9a7b-1a926f31a89e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.231610 May 27 15:32:09.982329 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3037/6069] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:32:08 2022] POST /compute/v2.1/servers => generated 361 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:32:10.022415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-48a6d13e-098c-4a9d-bf4b-57137b8c7019 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:10.023185 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-48a6d13e-098c-4a9d-bf4b-57137b8c7019 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:10.191618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:10.263740 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-48a6d13e-098c-4a9d-bf4b-57137b8c7019 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:10.281989 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-48a6d13e-098c-4a9d-bf4b-57137b8c7019 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9" status: 200 len: 1241 microversion: 2.1 time: 0.268648 May 27 15:32:10.286700 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3038/6070] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:10 2022] GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 => generated 1241 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:10.426251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d43ef154-d6d2-4a2a-8431-ad04c6afb8b4 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:10.470690 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d43ef154-d6d2-4a2a-8431-ad04c6afb8b4 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1319 microversion: 2.1 time: 0.547510 May 27 15:32:10.471631 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3033/6071] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:09 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1319 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:32:10.568054 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-22c84170-8580-426c-a4ad-02683e9b0967 req-be5bcbdf-b959-4a39-ab11-72a1c6b55036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c6f1c07-55fe-44fb-9112-d02221419b04", "tag": "1de725e9-803a-4af5-960c-7755a27ab626"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:32:10.583626 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-22c84170-8580-426c-a4ad-02683e9b0967 req-be5bcbdf-b959-4a39-ab11-72a1c6b55036 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:10.584099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-22c84170-8580-426c-a4ad-02683e9b0967 req-be5bcbdf-b959-4a39-ab11-72a1c6b55036 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:10.619368 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-22c84170-8580-426c-a4ad-02683e9b0967 req-be5bcbdf-b959-4a39-ab11-72a1c6b55036 service nova] Creating event network-changed:1de725e9-803a-4af5-960c-7755a27ab626 for instance 9c6f1c07-55fe-44fb-9112-d02221419b04 on n-h2-843621-1 May 27 15:32:10.625283 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-22c84170-8580-426c-a4ad-02683e9b0967 req-be5bcbdf-b959-4a39-ab11-72a1c6b55036 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064141 May 27 15:32:10.626217 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3039/6072] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:32:11.313027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-83fa7799-bc8d-401c-a05e-e0f219042a79 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:11.313883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-83fa7799-bc8d-401c-a05e-e0f219042a79 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:11.324532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-83fa7799-bc8d-401c-a05e-e0f219042a79 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:11.325053 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-83fa7799-bc8d-401c-a05e-e0f219042a79 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:11.325888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-83fa7799-bc8d-401c-a05e-e0f219042a79 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:11.326342 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-83fa7799-bc8d-401c-a05e-e0f219042a79 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:11.490125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f9464e0c-48a0-43ea-ab79-45b8b514e5b3 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:11.490869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f9464e0c-48a0-43ea-ab79-45b8b514e5b3 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:11.503475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f9464e0c-48a0-43ea-ab79-45b8b514e5b3 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:11.503953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f9464e0c-48a0-43ea-ab79-45b8b514e5b3 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:11.512959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f9464e0c-48a0-43ea-ab79-45b8b514e5b3 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:11.513724 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f9464e0c-48a0-43ea-ab79-45b8b514e5b3 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:11.553092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-83fa7799-bc8d-401c-a05e-e0f219042a79 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:11.570770 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-83fa7799-bc8d-401c-a05e-e0f219042a79 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9" status: 200 len: 1293 microversion: 2.1 time: 0.260427 May 27 15:32:11.572946 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3034/6073] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:11 2022] GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 => generated 1293 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:12.413673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f9464e0c-48a0-43ea-ab79-45b8b514e5b3 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:12.446335 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f9464e0c-48a0-43ea-ab79-45b8b514e5b3 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1319 microversion: 2.1 time: 0.961578 May 27 15:32:12.449496 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3040/6074] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:11 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1319 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:32:12.589750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bd35df27-21d9-4c5b-b695-27acbe7f7648 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:12.591106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bd35df27-21d9-4c5b-b695-27acbe7f7648 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:12.606706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd35df27-21d9-4c5b-b695-27acbe7f7648 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:12.607745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd35df27-21d9-4c5b-b695-27acbe7f7648 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:12.610132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd35df27-21d9-4c5b-b695-27acbe7f7648 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:12.610840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd35df27-21d9-4c5b-b695-27acbe7f7648 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:12.839911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bd35df27-21d9-4c5b-b695-27acbe7f7648 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:12.855696 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bd35df27-21d9-4c5b-b695-27acbe7f7648 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9" status: 200 len: 1299 microversion: 2.1 time: 0.269888 May 27 15:32:12.859606 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3035/6075] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:12 2022] GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 => generated 1299 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:13.475382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fcbe4ec4-c595-42ed-b4de-c8851de76364 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:13.476202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fcbe4ec4-c595-42ed-b4de-c8851de76364 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:13.496788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fcbe4ec4-c595-42ed-b4de-c8851de76364 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:13.497269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fcbe4ec4-c595-42ed-b4de-c8851de76364 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:13.508466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fcbe4ec4-c595-42ed-b4de-c8851de76364 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:13.509158 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fcbe4ec4-c595-42ed-b4de-c8851de76364 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:13.879037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9ddeb7cf-de5e-45c4-80e1-4ec15778d41d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:13.880376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9ddeb7cf-de5e-45c4-80e1-4ec15778d41d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:13.903067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ddeb7cf-de5e-45c4-80e1-4ec15778d41d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:13.921654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ddeb7cf-de5e-45c4-80e1-4ec15778d41d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:13.922777 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ddeb7cf-de5e-45c4-80e1-4ec15778d41d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:13.923359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ddeb7cf-de5e-45c4-80e1-4ec15778d41d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:13.992725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fcbe4ec4-c595-42ed-b4de-c8851de76364 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:14.048152 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fcbe4ec4-c595-42ed-b4de-c8851de76364 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1319 microversion: 2.1 time: 0.558628 May 27 15:32:14.055264 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3041/6076] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:13 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1319 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:32:14.123073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9ddeb7cf-de5e-45c4-80e1-4ec15778d41d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:14.134309 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9ddeb7cf-de5e-45c4-80e1-4ec15778d41d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9" status: 200 len: 1299 microversion: 2.1 time: 0.262873 May 27 15:32:14.135564 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3036/6077] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:13 2022] GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 => generated 1299 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:32:15.087088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-335f74cb-f2e0-4caf-8aeb-ed9e0a30d587 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:15.088701 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-335f74cb-f2e0-4caf-8aeb-ed9e0a30d587 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:15.113715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-335f74cb-f2e0-4caf-8aeb-ed9e0a30d587 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:15.117712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-335f74cb-f2e0-4caf-8aeb-ed9e0a30d587 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:15.118736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-335f74cb-f2e0-4caf-8aeb-ed9e0a30d587 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:15.119418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-335f74cb-f2e0-4caf-8aeb-ed9e0a30d587 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:15.154132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9b441bc7-9dd8-4c68-9ddb-d9755d8a5fa0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:15.155623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9b441bc7-9dd8-4c68-9ddb-d9755d8a5fa0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:15.186433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b441bc7-9dd8-4c68-9ddb-d9755d8a5fa0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:15.189137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b441bc7-9dd8-4c68-9ddb-d9755d8a5fa0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:15.190036 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b441bc7-9dd8-4c68-9ddb-d9755d8a5fa0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:15.190493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b441bc7-9dd8-4c68-9ddb-d9755d8a5fa0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:15.947311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-335f74cb-f2e0-4caf-8aeb-ed9e0a30d587 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:15.960094 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-335f74cb-f2e0-4caf-8aeb-ed9e0a30d587 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1319 microversion: 2.1 time: 0.891803 May 27 15:32:15.981612 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3042/6078] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:15 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1319 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:16.105041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9b441bc7-9dd8-4c68-9ddb-d9755d8a5fa0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:16.123041 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9b441bc7-9dd8-4c68-9ddb-d9755d8a5fa0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9" status: 200 len: 1299 microversion: 2.1 time: 0.970519 May 27 15:32:16.125019 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3037/6079] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:15 2022] GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 => generated 1299 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:32:16.187402 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7580be11-104e-4432-8172-9f12b9d8f235 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:16.187919 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7580be11-104e-4432-8172-9f12b9d8f235 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:16.199949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7580be11-104e-4432-8172-9f12b9d8f235 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:16.205445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7580be11-104e-4432-8172-9f12b9d8f235 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:16.209958 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7580be11-104e-4432-8172-9f12b9d8f235 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:16.214884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7580be11-104e-4432-8172-9f12b9d8f235 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:16.426738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-7580be11-104e-4432-8172-9f12b9d8f235 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lazy-loading 'services' on Instance uuid 9ef3dd65-83b9-4cb8-b342-094a2c633c41 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:32:16.588370 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7580be11-104e-4432-8172-9f12b9d8f235 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41/os-volume_attachments/3dc95641-59a3-4670-87a0-f056f041efc2" status: 202 len: 0 microversion: 2.1 time: 0.404342 May 27 15:32:16.607858 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3043/6080] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 15:32:16 2022] DELETE /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41/os-volume_attachments/3dc95641-59a3-4670-87a0-f056f041efc2 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:32:16.996486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cabffc45-55bb-467a-a532-5afddaa9873c tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:17.001690 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cabffc45-55bb-467a-a532-5afddaa9873c tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:17.048643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cabffc45-55bb-467a-a532-5afddaa9873c tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:17.049136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cabffc45-55bb-467a-a532-5afddaa9873c tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:17.050296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cabffc45-55bb-467a-a532-5afddaa9873c tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:17.050744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cabffc45-55bb-467a-a532-5afddaa9873c tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:17.155942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f2dec99b-a7f8-40fb-947e-7dcfd5e0667a tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:17.157365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f2dec99b-a7f8-40fb-947e-7dcfd5e0667a tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:17.171253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2dec99b-a7f8-40fb-947e-7dcfd5e0667a tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:17.171517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2dec99b-a7f8-40fb-947e-7dcfd5e0667a tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:17.172338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2dec99b-a7f8-40fb-947e-7dcfd5e0667a tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:17.180418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2dec99b-a7f8-40fb-947e-7dcfd5e0667a tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:17.666048 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f2dec99b-a7f8-40fb-947e-7dcfd5e0667a tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:17.693257 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f2dec99b-a7f8-40fb-947e-7dcfd5e0667a tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9" status: 200 len: 1299 microversion: 2.1 time: 0.551312 May 27 15:32:17.706622 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3044/6081] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:17 2022] GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 => generated 1299 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:17.970189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cabffc45-55bb-467a-a532-5afddaa9873c tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:17.985948 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cabffc45-55bb-467a-a532-5afddaa9873c tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1319 microversion: 2.1 time: 0.990315 May 27 15:32:17.999766 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3038/6082] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:16 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1319 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:18.244226 n-d-843621-1 devstack@n-api.service[119248]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:32:18.244599 n-d-843621-1 devstack@n-api.service[119248]: Fri May 27 15:32:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:32:18.726057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-55ca9df1-3da3-47f9-b224-47fb344f0240 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:18.728817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-55ca9df1-3da3-47f9-b224-47fb344f0240 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:18.820345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-55ca9df1-3da3-47f9-b224-47fb344f0240 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:18.825249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-55ca9df1-3da3-47f9-b224-47fb344f0240 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:18.828425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-55ca9df1-3da3-47f9-b224-47fb344f0240 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:18.847304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-55ca9df1-3da3-47f9-b224-47fb344f0240 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:19.160558 n-d-843621-1 devstack@n-api.service[119249]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:32:19.160756 n-d-843621-1 devstack@n-api.service[119249]: Fri May 27 15:32:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 (ip 10.222.0.13) !!! May 27 15:32:19.215997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-0dcc439f-d233-4917-822f-b45c99a9ef19 req-b749fa53-8f80-45d6-b647-63eadebc95ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07d0f626-0ada-4ede-8871-7b794c7ba8a9", "tag": "40ebb4c1-11a2-443b-8a56-f58315b0dcb0"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:32:19.236060 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0dcc439f-d233-4917-822f-b45c99a9ef19 req-b749fa53-8f80-45d6-b647-63eadebc95ca service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:19.237436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0dcc439f-d233-4917-822f-b45c99a9ef19 req-b749fa53-8f80-45d6-b647-63eadebc95ca service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:19.271992 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-0dcc439f-d233-4917-822f-b45c99a9ef19 req-b749fa53-8f80-45d6-b647-63eadebc95ca service nova] Creating event network-changed:40ebb4c1-11a2-443b-8a56-f58315b0dcb0 for instance 07d0f626-0ada-4ede-8871-7b794c7ba8a9 on n-h2-843621-1 May 27 15:32:19.281329 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-0dcc439f-d233-4917-822f-b45c99a9ef19 req-b749fa53-8f80-45d6-b647-63eadebc95ca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.540005 May 27 15:32:19.283051 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3039/6083] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:32:19.293291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-78424dec-e1bc-4442-be3d-964da8107108 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:19.295371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-78424dec-e1bc-4442-be3d-964da8107108 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:19.304281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78424dec-e1bc-4442-be3d-964da8107108 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:19.304974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78424dec-e1bc-4442-be3d-964da8107108 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:19.306524 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78424dec-e1bc-4442-be3d-964da8107108 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:19.307274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78424dec-e1bc-4442-be3d-964da8107108 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:19.713282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:19.786357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-55ca9df1-3da3-47f9-b224-47fb344f0240 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:19.815902 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-55ca9df1-3da3-47f9-b224-47fb344f0240 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9" status: 200 len: 1299 microversion: 2.1 time: 1.107805 May 27 15:32:19.842385 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3045/6084] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:18 2022] GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 => generated 1299 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:20.174714 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-78424dec-e1bc-4442-be3d-964da8107108 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:20.186451 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-78424dec-e1bc-4442-be3d-964da8107108 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1319 microversion: 2.1 time: 0.898278 May 27 15:32:20.199421 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3040/6085] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:19 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1319 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:20.843568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-977f6231-66d1-40aa-876e-1ae697215557 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:20.848659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-977f6231-66d1-40aa-876e-1ae697215557 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:20.857447 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=18 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:20.863362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-977f6231-66d1-40aa-876e-1ae697215557 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:20.881168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-977f6231-66d1-40aa-876e-1ae697215557 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:20.882381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-977f6231-66d1-40aa-876e-1ae697215557 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:20.883137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-977f6231-66d1-40aa-876e-1ae697215557 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:21.088588 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-977f6231-66d1-40aa-876e-1ae697215557 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:21.114759 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-977f6231-66d1-40aa-876e-1ae697215557 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9" status: 200 len: 1299 microversion: 2.1 time: 0.276122 May 27 15:32:21.116521 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3046/6086] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:20 2022] GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 => generated 1299 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:21.207030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8c20beca-f72a-46db-94ee-4356f5d1296b tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:21.207652 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8c20beca-f72a-46db-94ee-4356f5d1296b tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:21.216066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8c20beca-f72a-46db-94ee-4356f5d1296b tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:21.216533 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8c20beca-f72a-46db-94ee-4356f5d1296b tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:21.221066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8c20beca-f72a-46db-94ee-4356f5d1296b tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:21.221583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8c20beca-f72a-46db-94ee-4356f5d1296b tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:21.449101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-fc765175-c9c3-4a16-a9fd-49db52901772 req-60353494-4aae-47bd-9275-fdad3558f863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6f1c07-55fe-44fb-9112-d02221419b04", "name": "network-vif-plugged", "status": "completed", "tag": "1de725e9-803a-4af5-960c-7755a27ab626"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:32:21.471948 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-fc765175-c9c3-4a16-a9fd-49db52901772 req-60353494-4aae-47bd-9275-fdad3558f863 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:21.472597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-fc765175-c9c3-4a16-a9fd-49db52901772 req-60353494-4aae-47bd-9275-fdad3558f863 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:21.498784 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-fc765175-c9c3-4a16-a9fd-49db52901772 req-60353494-4aae-47bd-9275-fdad3558f863 service nova] Creating event network-vif-plugged:1de725e9-803a-4af5-960c-7755a27ab626 for instance 9c6f1c07-55fe-44fb-9112-d02221419b04 on n-h2-843621-1 May 27 15:32:21.514450 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-fc765175-c9c3-4a16-a9fd-49db52901772 req-60353494-4aae-47bd-9275-fdad3558f863 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072489 May 27 15:32:21.516343 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3047/6087] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:32:21.648895 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8c20beca-f72a-46db-94ee-4356f5d1296b tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:21.671237 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8c20beca-f72a-46db-94ee-4356f5d1296b tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1319 microversion: 2.1 time: 0.461964 May 27 15:32:21.689168 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3041/6088] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:21 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:32:22.136460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cfbf136e-11a8-4d40-a3b1-852b08a2b3ec tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:22.142108 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cfbf136e-11a8-4d40-a3b1-852b08a2b3ec tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:22.172937 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfbf136e-11a8-4d40-a3b1-852b08a2b3ec tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:22.173962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfbf136e-11a8-4d40-a3b1-852b08a2b3ec tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:22.175450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfbf136e-11a8-4d40-a3b1-852b08a2b3ec tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:22.176247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cfbf136e-11a8-4d40-a3b1-852b08a2b3ec tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:22.700511 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5fc70026-df42-4510-9d22-4d8c69fad9f2 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:22.701352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5fc70026-df42-4510-9d22-4d8c69fad9f2 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:22.733789 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5fc70026-df42-4510-9d22-4d8c69fad9f2 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:22.734416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5fc70026-df42-4510-9d22-4d8c69fad9f2 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:22.735329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5fc70026-df42-4510-9d22-4d8c69fad9f2 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:22.735871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5fc70026-df42-4510-9d22-4d8c69fad9f2 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:23.132933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cfbf136e-11a8-4d40-a3b1-852b08a2b3ec tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:23.141462 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cfbf136e-11a8-4d40-a3b1-852b08a2b3ec tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9" status: 200 len: 1299 microversion: 2.1 time: 1.013322 May 27 15:32:23.145011 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3048/6089] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:22 2022] GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 => generated 1299 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:23.875675 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5fc70026-df42-4510-9d22-4d8c69fad9f2 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:23.889846 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5fc70026-df42-4510-9d22-4d8c69fad9f2 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1319 microversion: 2.1 time: 1.194027 May 27 15:32:23.892110 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3042/6090] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:22 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1319 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:24.158967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6f7989b9-6f9f-4967-8234-97a87fd486d9 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:24.159599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6f7989b9-6f9f-4967-8234-97a87fd486d9 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:24.167495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f7989b9-6f9f-4967-8234-97a87fd486d9 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:24.185522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f7989b9-6f9f-4967-8234-97a87fd486d9 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:24.186634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f7989b9-6f9f-4967-8234-97a87fd486d9 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:24.187262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f7989b9-6f9f-4967-8234-97a87fd486d9 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:24.480466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6f7989b9-6f9f-4967-8234-97a87fd486d9 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:24.502492 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6f7989b9-6f9f-4967-8234-97a87fd486d9 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9" status: 200 len: 1299 microversion: 2.1 time: 0.344703 May 27 15:32:24.503966 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3049/6091] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:24 2022] GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 => generated 1299 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:24.913106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-16f28767-5be8-411d-aaba-c31e278a2add tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:24.915930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-16f28767-5be8-411d-aaba-c31e278a2add tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:24.942640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16f28767-5be8-411d-aaba-c31e278a2add tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:24.943902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16f28767-5be8-411d-aaba-c31e278a2add tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:24.944888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16f28767-5be8-411d-aaba-c31e278a2add tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:24.945441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-16f28767-5be8-411d-aaba-c31e278a2add tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:25.202223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-16f28767-5be8-411d-aaba-c31e278a2add tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:25.214045 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-16f28767-5be8-411d-aaba-c31e278a2add tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1508 microversion: 2.1 time: 0.309932 May 27 15:32:25.226906 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3043/6092] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:24 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1508 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:25.232339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cae3b44c-2ba6-4862-ac35-3e32907679d5 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e29681a-4407-4706-aa2d-4d55a40f42d0", "device": "/dev/sdb"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:32:25.233594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cae3b44c-2ba6-4862-ac35-3e32907679d5 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:25.249165 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cae3b44c-2ba6-4862-ac35-3e32907679d5 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:25.249706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cae3b44c-2ba6-4862-ac35-3e32907679d5 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:25.254604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cae3b44c-2ba6-4862-ac35-3e32907679d5 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:25.255071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cae3b44c-2ba6-4862-ac35-3e32907679d5 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:25.534071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b75a8556-10ab-482d-9bfa-7de79c3f0bbe tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:25.537704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b75a8556-10ab-482d-9bfa-7de79c3f0bbe tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:25.547361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b75a8556-10ab-482d-9bfa-7de79c3f0bbe tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:25.548110 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b75a8556-10ab-482d-9bfa-7de79c3f0bbe tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:25.549838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b75a8556-10ab-482d-9bfa-7de79c3f0bbe tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:25.551088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b75a8556-10ab-482d-9bfa-7de79c3f0bbe tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:25.601339 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cae3b44c-2ba6-4862-ac35-3e32907679d5 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "POST /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372340 May 27 15:32:25.610228 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3050/6093] 10.222.0.13 () {60 vars in 1322 bytes} [Fri May 27 15:32:25 2022] POST /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04/os-volume_attachments => generated 194 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:32:25.779069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b75a8556-10ab-482d-9bfa-7de79c3f0bbe tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:25.793828 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b75a8556-10ab-482d-9bfa-7de79c3f0bbe tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9" status: 200 len: 1299 microversion: 2.1 time: 0.276617 May 27 15:32:25.797449 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3044/6094] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:25 2022] GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 => generated 1299 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:26.553574 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-d4dac47f-b274-40cc-9ad8-1a46d774fc16 req-3230a67e-2716-4f35-893a-7ea1678e60f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07d0f626-0ada-4ede-8871-7b794c7ba8a9", "name": "network-vif-plugged", "status": "completed", "tag": "40ebb4c1-11a2-443b-8a56-f58315b0dcb0"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:32:26.560547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:26.578650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d4dac47f-b274-40cc-9ad8-1a46d774fc16 req-3230a67e-2716-4f35-893a-7ea1678e60f1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:26.585651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d4dac47f-b274-40cc-9ad8-1a46d774fc16 req-3230a67e-2716-4f35-893a-7ea1678e60f1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:26.607453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:26.611668 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-d4dac47f-b274-40cc-9ad8-1a46d774fc16 req-3230a67e-2716-4f35-893a-7ea1678e60f1 service nova] Creating event network-vif-plugged:40ebb4c1-11a2-443b-8a56-f58315b0dcb0 for instance 07d0f626-0ada-4ede-8871-7b794c7ba8a9 on n-h2-843621-1 May 27 15:32:26.620264 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-d4dac47f-b274-40cc-9ad8-1a46d774fc16 req-3230a67e-2716-4f35-893a-7ea1678e60f1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072072 May 27 15:32:26.622987 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3051/6095] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:32:26.812528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e6bbbab-ee09-4c41-9491-9c4f0a8a5f3c tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:26.814004 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e6bbbab-ee09-4c41-9491-9c4f0a8a5f3c tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:26.822273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e6bbbab-ee09-4c41-9491-9c4f0a8a5f3c tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:26.823413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e6bbbab-ee09-4c41-9491-9c4f0a8a5f3c tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:26.824744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e6bbbab-ee09-4c41-9491-9c4f0a8a5f3c tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:26.825417 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e6bbbab-ee09-4c41-9491-9c4f0a8a5f3c tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:27.024944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e6bbbab-ee09-4c41-9491-9c4f0a8a5f3c tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:27.034066 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e6bbbab-ee09-4c41-9491-9c4f0a8a5f3c tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9" status: 200 len: 1299 microversion: 2.1 time: 0.225862 May 27 15:32:27.039098 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3045/6096] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:26 2022] GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 => generated 1299 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:28.056558 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b5a3c4d5-910a-4381-90e9-ed7c3cefd31f tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:28.057835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b5a3c4d5-910a-4381-90e9-ed7c3cefd31f tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:28.078504 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b5a3c4d5-910a-4381-90e9-ed7c3cefd31f tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:28.079230 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b5a3c4d5-910a-4381-90e9-ed7c3cefd31f tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:28.080237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b5a3c4d5-910a-4381-90e9-ed7c3cefd31f tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:28.082284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b5a3c4d5-910a-4381-90e9-ed7c3cefd31f tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:28.217742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b5a3c4d5-910a-4381-90e9-ed7c3cefd31f tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:28.227184 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b5a3c4d5-910a-4381-90e9-ed7c3cefd31f tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9" status: 200 len: 1472 microversion: 2.1 time: 0.175354 May 27 15:32:28.231745 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3052/6097] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:28 2022] GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 => generated 1472 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:28.257876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9a44b966-6c97-49d8-a77e-967f2d672793 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:28.259903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9a44b966-6c97-49d8-a77e-967f2d672793 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:28.266334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=41 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:28.273213 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a44b966-6c97-49d8-a77e-967f2d672793 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:28.274345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a44b966-6c97-49d8-a77e-967f2d672793 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:28.275651 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a44b966-6c97-49d8-a77e-967f2d672793 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:28.276259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a44b966-6c97-49d8-a77e-967f2d672793 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:28.283226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=93 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:28.430909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9a44b966-6c97-49d8-a77e-967f2d672793 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:28.439649 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9a44b966-6c97-49d8-a77e-967f2d672793 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9" status: 200 len: 1472 microversion: 2.1 time: 0.188762 May 27 15:32:28.443539 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3046/6098] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:28 2022] GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 => generated 1472 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:28.456954 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8524c97d-e0c5-4f01-8fd1-cd4b347e8dee tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:28.457586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8524c97d-e0c5-4f01-8fd1-cd4b347e8dee tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:28.468128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8524c97d-e0c5-4f01-8fd1-cd4b347e8dee tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:28.468603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8524c97d-e0c5-4f01-8fd1-cd4b347e8dee tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:28.469428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8524c97d-e0c5-4f01-8fd1-cd4b347e8dee tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:28.469878 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8524c97d-e0c5-4f01-8fd1-cd4b347e8dee tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:28.665709 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8524c97d-e0c5-4f01-8fd1-cd4b347e8dee tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9" status: 200 len: 1623 microversion: 2.1 time: 0.212193 May 27 15:32:28.666310 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3053/6099] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:28 2022] GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 => generated 1623 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:28.683609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f7167111-1ee2-47b0-a9ad-c77e395ac6ba tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:28.684242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f7167111-1ee2-47b0-a9ad-c77e395ac6ba tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:28.694640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7167111-1ee2-47b0-a9ad-c77e395ac6ba tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:28.697744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7167111-1ee2-47b0-a9ad-c77e395ac6ba tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:28.698920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7167111-1ee2-47b0-a9ad-c77e395ac6ba tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:28.704548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f7167111-1ee2-47b0-a9ad-c77e395ac6ba tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:29.146727 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f7167111-1ee2-47b0-a9ad-c77e395ac6ba tempest-TestSecurityGroupsBasicOps-986741615 tempest-TestSecurityGroupsBasicOps-986741615-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 200 len: 1913 microversion: 2.1 time: 0.467655 May 27 15:32:29.147619 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3047/6100] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:28 2022] GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 1913 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:32:29.266345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-724c2cd3-0c27-4ca5-a03a-9c883394b1ff tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:29.266881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-724c2cd3-0c27-4ca5-a03a-9c883394b1ff tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:29.280444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-724c2cd3-0c27-4ca5-a03a-9c883394b1ff tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:29.281635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-724c2cd3-0c27-4ca5-a03a-9c883394b1ff tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:29.282740 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-724c2cd3-0c27-4ca5-a03a-9c883394b1ff tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:29.283360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-724c2cd3-0c27-4ca5-a03a-9c883394b1ff tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:29.315250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-724c2cd3-0c27-4ca5-a03a-9c883394b1ff tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:32:29.457679 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-724c2cd3-0c27-4ca5-a03a-9c883394b1ff tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "DELETE /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9" status: 204 len: 0 microversion: 2.1 time: 0.195742 May 27 15:32:29.458590 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3054/6101] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:32:29 2022] DELETE /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:32:29.469443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-156aa2c8-cf77-4c75-bd2a-3b7d1bacb939 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:29.470160 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-156aa2c8-cf77-4c75-bd2a-3b7d1bacb939 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:29.482759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-156aa2c8-cf77-4c75-bd2a-3b7d1bacb939 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:29.491378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-156aa2c8-cf77-4c75-bd2a-3b7d1bacb939 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:29.492909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-156aa2c8-cf77-4c75-bd2a-3b7d1bacb939 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:29.494541 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-156aa2c8-cf77-4c75-bd2a-3b7d1bacb939 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:29.714027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-156aa2c8-cf77-4c75-bd2a-3b7d1bacb939 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:29.730083 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-156aa2c8-cf77-4c75-bd2a-3b7d1bacb939 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9" status: 200 len: 1478 microversion: 2.1 time: 0.264982 May 27 15:32:29.742417 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3048/6102] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:29 2022] GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 => generated 1478 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:30.753453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8e1bf45f-8747-454a-b662-29aea4c02275 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:30.754781 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8e1bf45f-8747-454a-b662-29aea4c02275 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:30.769170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e1bf45f-8747-454a-b662-29aea4c02275 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:30.769932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e1bf45f-8747-454a-b662-29aea4c02275 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:30.770920 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e1bf45f-8747-454a-b662-29aea4c02275 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:30.773135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e1bf45f-8747-454a-b662-29aea4c02275 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:30.922967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8e1bf45f-8747-454a-b662-29aea4c02275 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:30.939228 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8e1bf45f-8747-454a-b662-29aea4c02275 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9" status: 200 len: 1478 microversion: 2.1 time: 0.193697 May 27 15:32:30.940438 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3055/6103] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:30 2022] GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 => generated 1478 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:31.613537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-4d6a84b0-98eb-4527-92b6-74a5495b037d req-ea4605f5-e17a-4267-811e-aef59078a2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07d0f626-0ada-4ede-8871-7b794c7ba8a9", "name": "network-vif-deleted", "tag": "40ebb4c1-11a2-443b-8a56-f58315b0dcb0"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:32:31.633375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-4d6a84b0-98eb-4527-92b6-74a5495b037d req-ea4605f5-e17a-4267-811e-aef59078a2d3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:31.636047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-4d6a84b0-98eb-4527-92b6-74a5495b037d req-ea4605f5-e17a-4267-811e-aef59078a2d3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:31.660428 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-4d6a84b0-98eb-4527-92b6-74a5495b037d req-ea4605f5-e17a-4267-811e-aef59078a2d3 service nova] Creating event network-vif-deleted:40ebb4c1-11a2-443b-8a56-f58315b0dcb0 for instance 07d0f626-0ada-4ede-8871-7b794c7ba8a9 on n-h2-843621-1 May 27 15:32:31.677335 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-4d6a84b0-98eb-4527-92b6-74a5495b037d req-ea4605f5-e17a-4267-811e-aef59078a2d3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067325 May 27 15:32:31.680084 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3049/6104] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:32:31.958081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-61ca5d72-89ff-4203-b7fb-3e0eef9329ec tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:31.959512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-61ca5d72-89ff-4203-b7fb-3e0eef9329ec tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:31.979539 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-61ca5d72-89ff-4203-b7fb-3e0eef9329ec tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:31.986642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-61ca5d72-89ff-4203-b7fb-3e0eef9329ec tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:31.987865 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-61ca5d72-89ff-4203-b7fb-3e0eef9329ec tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:31.990908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-61ca5d72-89ff-4203-b7fb-3e0eef9329ec tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:32.052775 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-61ca5d72-89ff-4203-b7fb-3e0eef9329ec tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:32.053631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-61ca5d72-89ff-4203-b7fb-3e0eef9329ec tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:32.054255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-61ca5d72-89ff-4203-b7fb-3e0eef9329ec tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lazy-loading 'fault' on Instance uuid 07d0f626-0ada-4ede-8871-7b794c7ba8a9 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:32:32.138968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-61ca5d72-89ff-4203-b7fb-3e0eef9329ec tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:32.149053 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-61ca5d72-89ff-4203-b7fb-3e0eef9329ec tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9" status: 200 len: 1331 microversion: 2.1 time: 0.194861 May 27 15:32:32.150225 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3056/6105] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:31 2022] GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 => generated 1331 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:32.574636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7166d840-35e1-4d06-bcae-bd93dcb1a309 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:32.576004 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7166d840-35e1-4d06-bcae-bd93dcb1a309 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:32.583927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7166d840-35e1-4d06-bcae-bd93dcb1a309 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:32.584658 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7166d840-35e1-4d06-bcae-bd93dcb1a309 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:32.585504 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7166d840-35e1-4d06-bcae-bd93dcb1a309 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:32.586287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7166d840-35e1-4d06-bcae-bd93dcb1a309 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:32.624775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7166d840-35e1-4d06-bcae-bd93dcb1a309 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:32:32.750324 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7166d840-35e1-4d06-bcae-bd93dcb1a309 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41" status: 204 len: 0 microversion: 2.1 time: 0.181799 May 27 15:32:32.757422 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3050/6106] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:32:32 2022] DELETE /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:32:32.764899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-05a80f6f-bc2e-451f-9dab-3f272a304af5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:32.765816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-05a80f6f-bc2e-451f-9dab-3f272a304af5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:32.772810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05a80f6f-bc2e-451f-9dab-3f272a304af5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:32.773359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05a80f6f-bc2e-451f-9dab-3f272a304af5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:32.774111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05a80f6f-bc2e-451f-9dab-3f272a304af5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:32.774774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05a80f6f-bc2e-451f-9dab-3f272a304af5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:33.168451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bf5cc880-a330-4edc-8491-dcb5e55a3811 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:33.169631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bf5cc880-a330-4edc-8491-dcb5e55a3811 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 07d0f626-0ada-4ede-8871-7b794c7ba8a9] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:33.177547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf5cc880-a330-4edc-8491-dcb5e55a3811 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:33.178397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf5cc880-a330-4edc-8491-dcb5e55a3811 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:33.179465 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf5cc880-a330-4edc-8491-dcb5e55a3811 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:33.180142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf5cc880-a330-4edc-8491-dcb5e55a3811 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:33.200474 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-bf5cc880-a330-4edc-8491-dcb5e55a3811 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] HTTP exception thrown: Instance 07d0f626-0ada-4ede-8871-7b794c7ba8a9 could not be found. May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bf5cc880-a330-4edc-8491-dcb5e55a3811 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Request method failure captured: May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 HTTP/1.1 May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikO5_W1j_dljBR6SD3Ls6jngmrLCRuG2hmLgWSbVQDKBmnObLAnqrUAgkv6dMuCfl5wPL0Uoa5XTwAfJxsj90W84Hlbt2ergDXYBC0kesKOhoVPchM1qcJ2QtlqRG4ApWV2A0HfpHVHdi8gOv4CtwYeMrpjsMyUmaE4FTbWacZ7Z9_MY May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 26d36ed2771b45f48e5359a5e5d6272c May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-278031123 May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/26d36ed2771b45f48e5359a5e5d6272c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/26d36ed2771b45f48e5359a5e5d6272c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/26d36ed2771b45f48e5359a5e5d6272c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_26d36ed2771b45f48e5359a5e5d6272c", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-TestSecurityGroupsBasicOps-278031123 May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 26d36ed2771b45f48e5359a5e5d6272c May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-278031123 May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-TestSecurityGroupsBasicOps-278031123-project May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 70b46a33d3b34006807b61970dcac05d May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-TestSecurityGroupsBasicOps-278031123-project May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 07d0f626-0ada-4ede-8871-7b794c7ba8a9 could not be found. May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '07d0f626-0ada-4ede-8871-7b794c7ba8a9'} May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07d0f626-0ada-4ede-8871-7b794c7ba8a9 could not be found. May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07d0f626-0ada-4ede-8871-7b794c7ba8a9 could not be found. May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:32:33.202809 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:32:33.207890 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:32:33.207890 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:32:33.207890 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:32:33.207890 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:32:33.207890 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:32:33.207890 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07d0f626-0ada-4ede-8871-7b794c7ba8a9 could not be found. May 27 15:32:33.207890 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:32:33.211989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bf5cc880-a330-4edc-8491-dcb5e55a3811 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Returning 404 to user: Instance 07d0f626-0ada-4ede-8871-7b794c7ba8a9 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:32:33.213651 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bf5cc880-a330-4edc-8491-dcb5e55a3811 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9" status: 404 len: 111 microversion: 2.1 time: 0.049853 May 27 15:32:33.215025 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3051/6107] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:33 2022] GET /compute/v2.1/servers/07d0f626-0ada-4ede-8871-7b794c7ba8a9 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:32:33.464047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-05a80f6f-bc2e-451f-9dab-3f272a304af5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203541d760e5425792380cde385039dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1131b11617e747f5b809720f01b967c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:33.474321 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-05a80f6f-bc2e-451f-9dab-3f272a304af5 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] 10.222.0.13 "GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41" status: 200 len: 1469 microversion: 2.1 time: 0.714078 May 27 15:32:33.475475 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3057/6108] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:32 2022] GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41 => generated 1469 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:34.491618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b21f058b-03e6-43a1-950c-8409ae381dd9 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:34.492376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b21f058b-03e6-43a1-950c-8409ae381dd9 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:34.508057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b21f058b-03e6-43a1-950c-8409ae381dd9 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:34.508523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b21f058b-03e6-43a1-950c-8409ae381dd9 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:34.511180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b21f058b-03e6-43a1-950c-8409ae381dd9 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:34.511651 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b21f058b-03e6-43a1-950c-8409ae381dd9 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:34.888266 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b21f058b-03e6-43a1-950c-8409ae381dd9 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203541d760e5425792380cde385039dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1131b11617e747f5b809720f01b967c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:34.899822 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b21f058b-03e6-43a1-950c-8409ae381dd9 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] 10.222.0.13 "GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41" status: 200 len: 1469 microversion: 2.1 time: 0.412127 May 27 15:32:34.901372 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3052/6109] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:34 2022] GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41 => generated 1469 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:35.918364 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c37fd5bb-3e48-401e-98bf-1e5625c3315a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:35.919095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c37fd5bb-3e48-401e-98bf-1e5625c3315a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:35.934887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c37fd5bb-3e48-401e-98bf-1e5625c3315a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:35.935672 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c37fd5bb-3e48-401e-98bf-1e5625c3315a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:35.938329 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c37fd5bb-3e48-401e-98bf-1e5625c3315a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:35.938837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c37fd5bb-3e48-401e-98bf-1e5625c3315a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:36.116158 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c37fd5bb-3e48-401e-98bf-1e5625c3315a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203541d760e5425792380cde385039dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1131b11617e747f5b809720f01b967c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:36.131684 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c37fd5bb-3e48-401e-98bf-1e5625c3315a tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] 10.222.0.13 "GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41" status: 200 len: 1427 microversion: 2.1 time: 0.213474 May 27 15:32:36.133775 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3058/6110] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:35 2022] GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41 => generated 1427 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:36.490566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-8b232aeb-af32-4e55-b507-7620b1dc5e97 req-63555c3b-a131-4c16-80a4-ab3cbde90496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef3dd65-83b9-4cb8-b342-094a2c633c41", "name": "network-vif-deleted", "tag": "cd3615cd-65c7-4dd8-adbf-5b459ecc0235"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:32:36.516014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-8b232aeb-af32-4e55-b507-7620b1dc5e97 req-63555c3b-a131-4c16-80a4-ab3cbde90496 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:36.518817 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-8b232aeb-af32-4e55-b507-7620b1dc5e97 req-63555c3b-a131-4c16-80a4-ab3cbde90496 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:36.550268 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-8b232aeb-af32-4e55-b507-7620b1dc5e97 req-63555c3b-a131-4c16-80a4-ab3cbde90496 service nova] Creating event network-vif-deleted:cd3615cd-65c7-4dd8-adbf-5b459ecc0235 for instance 9ef3dd65-83b9-4cb8-b342-094a2c633c41 on n-h1-843621-1 May 27 15:32:36.562125 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-8b232aeb-af32-4e55-b507-7620b1dc5e97 req-63555c3b-a131-4c16-80a4-ab3cbde90496 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077770 May 27 15:32:36.565198 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3053/6111] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:32:37.161400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0c0679d0-80db-4d3a-8c2f-0852a33632da tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:37.162678 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0c0679d0-80db-4d3a-8c2f-0852a33632da tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:37.177485 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c0679d0-80db-4d3a-8c2f-0852a33632da tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:37.178228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c0679d0-80db-4d3a-8c2f-0852a33632da tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:37.184164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c0679d0-80db-4d3a-8c2f-0852a33632da tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:37.184953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c0679d0-80db-4d3a-8c2f-0852a33632da tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:37.276718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c0679d0-80db-4d3a-8c2f-0852a33632da tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:37.278106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c0679d0-80db-4d3a-8c2f-0852a33632da tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:37.280710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-0c0679d0-80db-4d3a-8c2f-0852a33632da tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lazy-loading 'fault' on Instance uuid 9ef3dd65-83b9-4cb8-b342-094a2c633c41 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:32:37.672495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0c0679d0-80db-4d3a-8c2f-0852a33632da tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '203541d760e5425792380cde385039dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1131b11617e747f5b809720f01b967c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:37.684797 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0c0679d0-80db-4d3a-8c2f-0852a33632da tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] 10.222.0.13 "GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41" status: 200 len: 1304 microversion: 2.1 time: 0.528189 May 27 15:32:37.689880 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3059/6112] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:37 2022] GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41 => generated 1304 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:38.708816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee9a80ae-8df4-4ca6-ad4b-d3b9db7b86a2 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:38.710483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ee9a80ae-8df4-4ca6-ad4b-d3b9db7b86a2 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] [instance: 9ef3dd65-83b9-4cb8-b342-094a2c633c41] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:38.727831 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee9a80ae-8df4-4ca6-ad4b-d3b9db7b86a2 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:38.728317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee9a80ae-8df4-4ca6-ad4b-d3b9db7b86a2 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:38.729195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee9a80ae-8df4-4ca6-ad4b-d3b9db7b86a2 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:38.731863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee9a80ae-8df4-4ca6-ad4b-d3b9db7b86a2 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:38.748075 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-ee9a80ae-8df4-4ca6-ad4b-d3b9db7b86a2 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] HTTP exception thrown: Instance 9ef3dd65-83b9-4cb8-b342-094a2c633c41 could not be found. May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee9a80ae-8df4-4ca6-ad4b-d3b9db7b86a2 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Request method failure captured: May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41 HTTP/1.1 May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikO48NIr0Ldh5wHpReiSVCZk4k6WYDSp-5GPt0kobGmI02_oe0o-kfrWnWqVgy9OyMD0DSRHkwELqPTXTizx__BRipbv_vRMaCLgZgtilOh1w3wpQaTmyrCY6K80VZVSO-y45yNKeQgxToJGFnA3fWCpGjJ4CGmOxlB5XhhEr-5OBTyw May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 1131b11617e747f5b809720f01b967c2 May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-VolumesBackupsTest-1630692999 May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1131b11617e747f5b809720f01b967c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1131b11617e747f5b809720f01b967c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1131b11617e747f5b809720f01b967c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1131b11617e747f5b809720f01b967c2", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-VolumesBackupsTest-1630692999 May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 1131b11617e747f5b809720f01b967c2 May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-VolumesBackupsTest-1630692999 May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-VolumesBackupsTest-1630692999-project May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 203541d760e5425792380cde385039dd May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-VolumesBackupsTest-1630692999-project May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 9ef3dd65-83b9-4cb8-b342-094a2c633c41 could not be found. May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '9ef3dd65-83b9-4cb8-b342-094a2c633c41'} May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ef3dd65-83b9-4cb8-b342-094a2c633c41 could not be found. May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ef3dd65-83b9-4cb8-b342-094a2c633c41 could not be found. May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:32:38.750131 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:32:38.754792 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:32:38.754792 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:32:38.754792 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:32:38.754792 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:32:38.754792 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:32:38.754792 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ef3dd65-83b9-4cb8-b342-094a2c633c41 could not be found. May 27 15:32:38.754792 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:32:38.756384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee9a80ae-8df4-4ca6-ad4b-d3b9db7b86a2 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] Returning 404 to user: Instance 9ef3dd65-83b9-4cb8-b342-094a2c633c41 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:32:38.757487 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ee9a80ae-8df4-4ca6-ad4b-d3b9db7b86a2 tempest-VolumesBackupsTest-1630692999 tempest-VolumesBackupsTest-1630692999-project] 10.222.0.13 "GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41" status: 404 len: 111 microversion: 2.1 time: 0.054929 May 27 15:32:38.759116 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3054/6113] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:38 2022] GET /compute/v2.1/servers/9ef3dd65-83b9-4cb8-b342-094a2c633c41 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:32:45.903736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f840769b-5e13-4872-8b6f-52ec08ed947e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:45.904995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f840769b-5e13-4872-8b6f-52ec08ed947e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:45.916832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-c01c0c7a-d389-4a86-98e4-abb8c00d85e3 req-43b1ffae-1cb2-472c-b5ec-ef17f5019e7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27f18944-21e3-46ef-a39b-9fb44399fc44", "tag": "79cf1bd4-870a-4462-b538-7f7842f89048"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:32:45.945935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c01c0c7a-d389-4a86-98e4-abb8c00d85e3 req-43b1ffae-1cb2-472c-b5ec-ef17f5019e7c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:45.950838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c01c0c7a-d389-4a86-98e4-abb8c00d85e3 req-43b1ffae-1cb2-472c-b5ec-ef17f5019e7c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:45.953704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f840769b-5e13-4872-8b6f-52ec08ed947e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:45.955112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f840769b-5e13-4872-8b6f-52ec08ed947e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:45.962814 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f840769b-5e13-4872-8b6f-52ec08ed947e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:45.965717 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f840769b-5e13-4872-8b6f-52ec08ed947e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:46.008493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f840769b-5e13-4872-8b6f-52ec08ed947e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:32:46.010494 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-c01c0c7a-d389-4a86-98e4-abb8c00d85e3 req-43b1ffae-1cb2-472c-b5ec-ef17f5019e7c service nova] Creating event network-changed:79cf1bd4-870a-4462-b538-7f7842f89048 for instance 27f18944-21e3-46ef-a39b-9fb44399fc44 on n-h1-843621-1 May 27 15:32:46.036563 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-c01c0c7a-d389-4a86-98e4-abb8c00d85e3 req-43b1ffae-1cb2-472c-b5ec-ef17f5019e7c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124541 May 27 15:32:46.039367 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3055/6114] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:32:46.176132 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f840769b-5e13-4872-8b6f-52ec08ed947e tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "DELETE /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 204 len: 0 microversion: 2.1 time: 0.278653 May 27 15:32:46.177816 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3060/6115] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:32:45 2022] DELETE /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:32:46.187430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bc17d111-257f-4684-b963-d953bb2471de tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:46.188480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bc17d111-257f-4684-b963-d953bb2471de tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:46.195533 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc17d111-257f-4684-b963-d953bb2471de tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:46.196995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc17d111-257f-4684-b963-d953bb2471de tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:46.198166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc17d111-257f-4684-b963-d953bb2471de tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:46.198789 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc17d111-257f-4684-b963-d953bb2471de tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:46.530600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bc17d111-257f-4684-b963-d953bb2471de tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:46.542796 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bc17d111-257f-4684-b963-d953bb2471de tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 200 len: 1768 microversion: 2.1 time: 0.358200 May 27 15:32:46.543747 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3056/6116] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:46 2022] GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 1768 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:47.565583 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5169f9e0-5d8f-4fa7-80e7-26f3c602a76d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:47.568345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5169f9e0-5d8f-4fa7-80e7-26f3c602a76d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:47.583758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5169f9e0-5d8f-4fa7-80e7-26f3c602a76d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:47.584770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5169f9e0-5d8f-4fa7-80e7-26f3c602a76d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:47.585801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5169f9e0-5d8f-4fa7-80e7-26f3c602a76d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:47.587818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5169f9e0-5d8f-4fa7-80e7-26f3c602a76d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:48.019753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5169f9e0-5d8f-4fa7-80e7-26f3c602a76d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:48.029325 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5169f9e0-5d8f-4fa7-80e7-26f3c602a76d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 200 len: 1768 microversion: 2.1 time: 0.471828 May 27 15:32:48.039183 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3061/6117] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:47 2022] GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 1768 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:49.049081 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b5886692-351c-4455-9d22-e73724fbd458 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:49.049712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b5886692-351c-4455-9d22-e73724fbd458 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:49.068136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5886692-351c-4455-9d22-e73724fbd458 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:49.068917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5886692-351c-4455-9d22-e73724fbd458 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:49.070100 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5886692-351c-4455-9d22-e73724fbd458 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:49.070746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5886692-351c-4455-9d22-e73724fbd458 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:49.348572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b5886692-351c-4455-9d22-e73724fbd458 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:49.358842 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b5886692-351c-4455-9d22-e73724fbd458 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 200 len: 1768 microversion: 2.1 time: 0.313788 May 27 15:32:49.375185 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3057/6118] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:49 2022] GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 1768 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:49.855903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-04c0e621-bfb8-4ac9-9832-5258c3429776 req-6036d774-9ef8-4522-8bc3-e617461cf08b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27f18944-21e3-46ef-a39b-9fb44399fc44", "name": "network-vif-deleted", "tag": "79cf1bd4-870a-4462-b538-7f7842f89048"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:32:49.881786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-04c0e621-bfb8-4ac9-9832-5258c3429776 req-6036d774-9ef8-4522-8bc3-e617461cf08b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:49.882133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-04c0e621-bfb8-4ac9-9832-5258c3429776 req-6036d774-9ef8-4522-8bc3-e617461cf08b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:49.897073 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-04c0e621-bfb8-4ac9-9832-5258c3429776 req-6036d774-9ef8-4522-8bc3-e617461cf08b service nova] Creating event network-vif-deleted:79cf1bd4-870a-4462-b538-7f7842f89048 for instance 27f18944-21e3-46ef-a39b-9fb44399fc44 on n-h1-843621-1 May 27 15:32:49.935257 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-04c0e621-bfb8-4ac9-9832-5258c3429776 req-6036d774-9ef8-4522-8bc3-e617461cf08b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081868 May 27 15:32:49.938538 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3062/6119] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:32:50.376643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9f104a0d-3304-4f09-92bf-1bbc4d0ae04d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:50.378177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9f104a0d-3304-4f09-92bf-1bbc4d0ae04d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:50.391709 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f104a0d-3304-4f09-92bf-1bbc4d0ae04d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:50.411543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f104a0d-3304-4f09-92bf-1bbc4d0ae04d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:50.413096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f104a0d-3304-4f09-92bf-1bbc4d0ae04d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:50.413571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f104a0d-3304-4f09-92bf-1bbc4d0ae04d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:50.501290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f104a0d-3304-4f09-92bf-1bbc4d0ae04d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:50.501764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f104a0d-3304-4f09-92bf-1bbc4d0ae04d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:50.502581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-9f104a0d-3304-4f09-92bf-1bbc4d0ae04d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lazy-loading 'fault' on Instance uuid 27f18944-21e3-46ef-a39b-9fb44399fc44 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:32:50.798315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9f104a0d-3304-4f09-92bf-1bbc4d0ae04d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b46a33d3b34006807b61970dcac05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d36ed2771b45f48e5359a5e5d6272c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:32:50.809492 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9f104a0d-3304-4f09-92bf-1bbc4d0ae04d tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 200 len: 1383 microversion: 2.1 time: 0.437658 May 27 15:32:50.822944 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3058/6120] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:50 2022] GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 1383 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:32:51.846431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f7c42f2a-61ea-4dc6-b595-7eacad0378c0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:51.847180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f7c42f2a-61ea-4dc6-b595-7eacad0378c0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] [instance: 27f18944-21e3-46ef-a39b-9fb44399fc44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:32:51.865809 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f7c42f2a-61ea-4dc6-b595-7eacad0378c0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:51.866104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f7c42f2a-61ea-4dc6-b595-7eacad0378c0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:51.868288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f7c42f2a-61ea-4dc6-b595-7eacad0378c0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:32:51.868872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f7c42f2a-61ea-4dc6-b595-7eacad0378c0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:32:51.899593 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-f7c42f2a-61ea-4dc6-b595-7eacad0378c0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] HTTP exception thrown: Instance 27f18944-21e3-46ef-a39b-9fb44399fc44 could not be found. May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f7c42f2a-61ea-4dc6-b595-7eacad0378c0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Request method failure captured: May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 HTTP/1.1 May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikO5_W1j_dljBR6SD3Ls6jngmrLCRuG2hmLgWSbVQDKBmnObLAnqrUAgkv6dMuCfl5wPL0Uoa5XTwAfJxsj90W84Hlbt2ergDXYBC0kesKOhoVPchM1qcJ2QtlqRG4ApWV2A0HfpHVHdi8gOv4CtwYeMrpjsMyUmaE4FTbWacZ7Z9_MY May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 26d36ed2771b45f48e5359a5e5d6272c May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-278031123 May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/26d36ed2771b45f48e5359a5e5d6272c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/26d36ed2771b45f48e5359a5e5d6272c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/26d36ed2771b45f48e5359a5e5d6272c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_26d36ed2771b45f48e5359a5e5d6272c", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TestSecurityGroupsBasicOps-278031123 May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 26d36ed2771b45f48e5359a5e5d6272c May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-278031123 May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TestSecurityGroupsBasicOps-278031123-project May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 70b46a33d3b34006807b61970dcac05d May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TestSecurityGroupsBasicOps-278031123-project May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 27f18944-21e3-46ef-a39b-9fb44399fc44 could not be found. May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '27f18944-21e3-46ef-a39b-9fb44399fc44'} May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27f18944-21e3-46ef-a39b-9fb44399fc44 could not be found. May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27f18944-21e3-46ef-a39b-9fb44399fc44 could not be found. May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:32:51.902359 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:32:51.906430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:32:51.906430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:32:51.906430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:32:51.906430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:32:51.906430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:32:51.906430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27f18944-21e3-46ef-a39b-9fb44399fc44 could not be found. May 27 15:32:51.906430 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:32:51.909079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f7c42f2a-61ea-4dc6-b595-7eacad0378c0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Returning 404 to user: Instance 27f18944-21e3-46ef-a39b-9fb44399fc44 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:32:51.922106 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f7c42f2a-61ea-4dc6-b595-7eacad0378c0 tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44" status: 404 len: 111 microversion: 2.1 time: 0.092806 May 27 15:32:51.924577 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3063/6121] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:32:51 2022] GET /compute/v2.1/servers/27f18944-21e3-46ef-a39b-9fb44399fc44 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:32:59.105999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d8a4f706-5763-4071-b1b0-6cf330f2325f tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] Calling method '.version_select at 0x7fc775424f70>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:32:59.134988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:32:59.170495 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d8a4f706-5763-4071-b1b0-6cf330f2325f tempest-TestSecurityGroupsBasicOps-278031123 tempest-TestSecurityGroupsBasicOps-278031123-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1818080242" status: 202 len: 0 microversion: 2.1 time: 0.068752 May 27 15:32:59.173357 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3059/6122] 10.222.0.13 () {58 vars in 1277 bytes} [Fri May 27 15:32:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1818080242 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:33:30.385153 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b5dfdb61-7e86-4d8e-8875-8961594386b8 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:33:30.385860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b5dfdb61-7e86-4d8e-8875-8961594386b8 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:33:30.390523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:33:30.392273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:33:30.400166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b5dfdb61-7e86-4d8e-8875-8961594386b8 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:33:30.401710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b5dfdb61-7e86-4d8e-8875-8961594386b8 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:33:30.402643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b5dfdb61-7e86-4d8e-8875-8961594386b8 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:33:30.404300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b5dfdb61-7e86-4d8e-8875-8961594386b8 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:33:30.636405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-b5dfdb61-7e86-4d8e-8875-8961594386b8 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lazy-loading 'services' on Instance uuid 9c6f1c07-55fe-44fb-9112-d02221419b04 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:33:30.754632 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b5dfdb61-7e86-4d8e-8875-8961594386b8 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04/os-volume_attachments/4e29681a-4407-4706-aa2d-4d55a40f42d0" status: 202 len: 0 microversion: 2.1 time: 0.374052 May 27 15:33:30.763571 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3064/6123] 10.222.0.13 () {58 vars in 1415 bytes} [Fri May 27 15:33:30 2022] DELETE /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04/os-volume_attachments/4e29681a-4407-4706-aa2d-4d55a40f42d0 => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:33:52.704633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4e61e360-4813-49c0-a852-40741d339160 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:33:52.707117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4e61e360-4813-49c0-a852-40741d339160 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:33:52.740079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:33:52.750739 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e61e360-4813-49c0-a852-40741d339160 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:33:52.751506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e61e360-4813-49c0-a852-40741d339160 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:33:52.752781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e61e360-4813-49c0-a852-40741d339160 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:33:52.753659 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e61e360-4813-49c0-a852-40741d339160 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:33:52.858506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4e61e360-4813-49c0-a852-40741d339160 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:33:53.056752 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4e61e360-4813-49c0-a852-40741d339160 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 204 len: 0 microversion: 2.1 time: 0.361050 May 27 15:33:53.057428 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3060/6124] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:33:52 2022] DELETE /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:33:53.068020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f1d3c38e-919f-4ff9-a922-405ede517825 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:33:53.070137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f1d3c38e-919f-4ff9-a922-405ede517825 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:33:53.078480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:33:53.079518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:33:53.081913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1d3c38e-919f-4ff9-a922-405ede517825 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:33:53.082621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1d3c38e-919f-4ff9-a922-405ede517825 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:33:53.084372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1d3c38e-919f-4ff9-a922-405ede517825 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:33:53.086243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f1d3c38e-919f-4ff9-a922-405ede517825 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:33:53.467310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f1d3c38e-919f-4ff9-a922-405ede517825 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:33:53.481924 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f1d3c38e-919f-4ff9-a922-405ede517825 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1514 microversion: 2.1 time: 0.419408 May 27 15:33:53.482541 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3065/6125] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:33:53 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1514 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:33:54.501403 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c4ba08b9-b54e-4251-903b-190bb8fe7971 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:33:54.505181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c4ba08b9-b54e-4251-903b-190bb8fe7971 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:33:54.513961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c4ba08b9-b54e-4251-903b-190bb8fe7971 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:33:54.514986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c4ba08b9-b54e-4251-903b-190bb8fe7971 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:33:54.515928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c4ba08b9-b54e-4251-903b-190bb8fe7971 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:33:54.516582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c4ba08b9-b54e-4251-903b-190bb8fe7971 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:33:55.057728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c4ba08b9-b54e-4251-903b-190bb8fe7971 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:33:55.077730 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c4ba08b9-b54e-4251-903b-190bb8fe7971 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1514 microversion: 2.1 time: 0.581407 May 27 15:33:55.088150 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3061/6126] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:33:54 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1514 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:33:56.039214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-59408440-496e-4c28-a753-79a59f0d7732 req-483cd28e-27f8-4210-8124-0e97382464f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6f1c07-55fe-44fb-9112-d02221419b04", "name": "network-vif-deleted", "tag": "1de725e9-803a-4af5-960c-7755a27ab626"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:33:56.101600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-736c31ca-9c4e-4d5d-880a-2e6871448af7 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:33:56.103218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-736c31ca-9c4e-4d5d-880a-2e6871448af7 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:33:56.117169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-59408440-496e-4c28-a753-79a59f0d7732 req-483cd28e-27f8-4210-8124-0e97382464f2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:33:56.122604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-59408440-496e-4c28-a753-79a59f0d7732 req-483cd28e-27f8-4210-8124-0e97382464f2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:33:56.134780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-736c31ca-9c4e-4d5d-880a-2e6871448af7 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:33:56.153675 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-736c31ca-9c4e-4d5d-880a-2e6871448af7 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:33:56.158667 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-736c31ca-9c4e-4d5d-880a-2e6871448af7 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:33:56.160515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-736c31ca-9c4e-4d5d-880a-2e6871448af7 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:33:56.196127 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-59408440-496e-4c28-a753-79a59f0d7732 req-483cd28e-27f8-4210-8124-0e97382464f2 service nova] Creating event network-vif-deleted:1de725e9-803a-4af5-960c-7755a27ab626 for instance 9c6f1c07-55fe-44fb-9112-d02221419b04 on n-h2-843621-1 May 27 15:33:56.207626 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-59408440-496e-4c28-a753-79a59f0d7732 req-483cd28e-27f8-4210-8124-0e97382464f2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173862 May 27 15:33:56.213713 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3066/6127] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:33:56.408641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-736c31ca-9c4e-4d5d-880a-2e6871448af7 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff6334db7c942648631e5112e499cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baeb07bbeb64100b2bee8a44ef25f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:33:56.420642 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-736c31ca-9c4e-4d5d-880a-2e6871448af7 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 200 len: 1304 microversion: 2.1 time: 0.328785 May 27 15:33:56.433209 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3062/6128] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:33:56 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 1304 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:33:57.441743 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-258a41e7-cd68-4de5-a152-b60282c453d4 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:33:57.442995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-258a41e7-cd68-4de5-a152-b60282c453d4 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] [instance: 9c6f1c07-55fe-44fb-9112-d02221419b04] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:33:57.455546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-258a41e7-cd68-4de5-a152-b60282c453d4 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:33:57.459359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-258a41e7-cd68-4de5-a152-b60282c453d4 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:33:57.461007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-258a41e7-cd68-4de5-a152-b60282c453d4 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:33:57.464758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-258a41e7-cd68-4de5-a152-b60282c453d4 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:33:57.499324 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-258a41e7-cd68-4de5-a152-b60282c453d4 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] HTTP exception thrown: Instance 9c6f1c07-55fe-44fb-9112-d02221419b04 could not be found. May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-258a41e7-cd68-4de5-a152-b60282c453d4 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Request method failure captured: May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 HTTP/1.1 May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikO210qV7wjiv5jm6c-Yctqld8Y0s9f0chDoCe628qVOsSIxZUueZlT_jMALXabALJeEd1w87o8R60Y-j-9o7I2TzgJDXFxyhfxlRNJynt9EDxaEP3O-Km9O1L-Hp09fHnuAjJMUWsnttaMMXhB60JR2oXGq8EwA4qC8HXvdfVJdd5Oo May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 3baeb07bbeb64100b2bee8a44ef25f66 May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1154843667 May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3baeb07bbeb64100b2bee8a44ef25f66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3baeb07bbeb64100b2bee8a44ef25f66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3baeb07bbeb64100b2bee8a44ef25f66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3baeb07bbeb64100b2bee8a44ef25f66", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-VolumesSnapshotTestJSON-1154843667 May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 3baeb07bbeb64100b2bee8a44ef25f66 May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1154843667 May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-VolumesSnapshotTestJSON-1154843667-project May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 9ff6334db7c942648631e5112e499cb7 May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-VolumesSnapshotTestJSON-1154843667-project May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 9c6f1c07-55fe-44fb-9112-d02221419b04 could not be found. May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '9c6f1c07-55fe-44fb-9112-d02221419b04'} May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c6f1c07-55fe-44fb-9112-d02221419b04 could not be found. May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c6f1c07-55fe-44fb-9112-d02221419b04 could not be found. May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:33:57.501863 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:33:57.507733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:33:57.507733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:33:57.507733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:33:57.507733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:33:57.507733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:33:57.507733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c6f1c07-55fe-44fb-9112-d02221419b04 could not be found. May 27 15:33:57.507733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:33:57.513577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-258a41e7-cd68-4de5-a152-b60282c453d4 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] Returning 404 to user: Instance 9c6f1c07-55fe-44fb-9112-d02221419b04 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:33:57.514746 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-258a41e7-cd68-4de5-a152-b60282c453d4 tempest-VolumesSnapshotTestJSON-1154843667 tempest-VolumesSnapshotTestJSON-1154843667-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04" status: 404 len: 111 microversion: 2.1 time: 0.078233 May 27 15:33:57.520557 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3067/6129] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:33:57 2022] GET /compute/v2.1/servers/9c6f1c07-55fe-44fb-9112-d02221419b04 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:35:30.741248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:35:30.742815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:35:30.748333 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3dd89acc-8e20-4384-b45c-f0184f325583 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-9156118", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "0ee1599f-7683-4202-a4f4-b143649b0dad"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:35:30.856144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-3dd89acc-8e20-4384-b45c-f0184f325583 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] validate_networks() for [('0ee1599f-7683-4202-a4f4-b143649b0dad', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:35:32.580156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3dd89acc-8e20-4384-b45c-f0184f325583 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:35:32.580156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3dd89acc-8e20-4384-b45c-f0184f325583 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:35:32.580802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3dd89acc-8e20-4384-b45c-f0184f325583 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:35:32.581300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3dd89acc-8e20-4384-b45c-f0184f325583 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:35:32.581741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-3dd89acc-8e20-4384-b45c-f0184f325583 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:35:32.612474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3dd89acc-8e20-4384-b45c-f0184f325583 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:32.615160 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3dd89acc-8e20-4384-b45c-f0184f325583 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:32.616178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3dd89acc-8e20-4384-b45c-f0184f325583 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:32.619270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3dd89acc-8e20-4384-b45c-f0184f325583 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:32.663034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-3dd89acc-8e20-4384-b45c-f0184f325583 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Getting quotas for project 55587bbc3b45490a8faec4ea059a08a2. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:35:32.677724 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-3dd89acc-8e20-4384-b45c-f0184f325583 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Getting quotas for user 301ac6aa464c4ee0abfba0dff15149c9 and project 55587bbc3b45490a8faec4ea059a08a2. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:35:32.718208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3dd89acc-8e20-4384-b45c-f0184f325583 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:35:32.785072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3dd89acc-8e20-4384-b45c-f0184f325583 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:35:32.880358 n-d-843621-1 devstack@n-api.service[119248]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3dd89acc-8e20-4384-b45c-f0184f325583 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [afb36b4d-95cb-487d-833f-752e8a9a2ce9] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 15:35:33.890728 n-d-843621-1 devstack@n-api.service[119248]: INFO oslo.messaging._drivers.impl_rabbit [None req-3dd89acc-8e20-4384-b45c-f0184f325583 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [afb36b4d-95cb-487d-833f-752e8a9a2ce9] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 60706. May 27 15:35:33.895272 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3dd89acc-8e20-4384-b45c-f0184f325583 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.158491 May 27 15:35:33.896283 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3063/6130] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:35:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 3160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:35:33.908812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:35:33.910216 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=10 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:35:33.923914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-44725a4f-b5b4-44b1-a863-982c1b048ed1 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:35:33.924591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-44725a4f-b5b4-44b1-a863-982c1b048ed1 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:35:34.129713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-44725a4f-b5b4-44b1-a863-982c1b048ed1 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:35:34.138302 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-44725a4f-b5b4-44b1-a863-982c1b048ed1 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d" status: 200 len: 1211 microversion: 2.1 time: 0.231685 May 27 15:35:34.143587 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3068/6131] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:35:33 2022] GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d => generated 1211 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:35:35.158462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ea02e421-ad31-4c9b-a766-e02094ce3ff9 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:35:35.159232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ea02e421-ad31-4c9b-a766-e02094ce3ff9 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:35:35.406688 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ea02e421-ad31-4c9b-a766-e02094ce3ff9 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:35:35.417415 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ea02e421-ad31-4c9b-a766-e02094ce3ff9 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d" status: 200 len: 1211 microversion: 2.1 time: 0.262963 May 27 15:35:35.417935 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3064/6132] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:35:35 2022] GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d => generated 1211 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:35:36.435399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b855cdb4-a5af-4c79-b46f-d55e8153cbcf tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:35:36.436024 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b855cdb4-a5af-4c79-b46f-d55e8153cbcf tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:35:36.453414 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b855cdb4-a5af-4c79-b46f-d55e8153cbcf tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:36.455568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b855cdb4-a5af-4c79-b46f-d55e8153cbcf tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:36.456457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b855cdb4-a5af-4c79-b46f-d55e8153cbcf tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:36.458623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b855cdb4-a5af-4c79-b46f-d55e8153cbcf tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:36.594483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b855cdb4-a5af-4c79-b46f-d55e8153cbcf tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:35:36.610075 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b855cdb4-a5af-4c79-b46f-d55e8153cbcf tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d" status: 200 len: 1269 microversion: 2.1 time: 0.178191 May 27 15:35:36.611723 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3069/6133] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:35:36 2022] GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d => generated 1269 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:35:37.628246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bc0b40de-d24a-4f65-9e13-16081997f9e4 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:35:37.629141 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bc0b40de-d24a-4f65-9e13-16081997f9e4 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:35:37.649077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc0b40de-d24a-4f65-9e13-16081997f9e4 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:37.653857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc0b40de-d24a-4f65-9e13-16081997f9e4 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:37.654983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc0b40de-d24a-4f65-9e13-16081997f9e4 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:37.655677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc0b40de-d24a-4f65-9e13-16081997f9e4 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:37.918693 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bc0b40de-d24a-4f65-9e13-16081997f9e4 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:35:37.927719 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bc0b40de-d24a-4f65-9e13-16081997f9e4 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d" status: 200 len: 1311 microversion: 2.1 time: 0.304050 May 27 15:35:37.932062 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3065/6134] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:35:37 2022] GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d => generated 1311 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:35:38.185201 n-d-843621-1 devstack@n-api.service[119248]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:35:38.185666 n-d-843621-1 devstack@n-api.service[119248]: Fri May 27 15:35:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:35:38.948695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e0148836-488e-4a7a-9048-bf0c93c89526 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:35:38.949995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e0148836-488e-4a7a-9048-bf0c93c89526 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:35:38.958816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0148836-488e-4a7a-9048-bf0c93c89526 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:38.959672 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0148836-488e-4a7a-9048-bf0c93c89526 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:38.960696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0148836-488e-4a7a-9048-bf0c93c89526 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:38.961357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e0148836-488e-4a7a-9048-bf0c93c89526 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:39.177673 n-d-843621-1 devstack@n-api.service[119249]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:35:39.177927 n-d-843621-1 devstack@n-api.service[119249]: Fri May 27 15:35:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d (ip 10.222.0.13) !!! May 27 15:35:39.257116 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e0148836-488e-4a7a-9048-bf0c93c89526 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:35:39.264718 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e0148836-488e-4a7a-9048-bf0c93c89526 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d" status: 200 len: 1311 microversion: 2.1 time: 0.320465 May 27 15:35:39.276999 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3070/6135] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:35:38 2022] GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d => generated 1311 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:35:39.994943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-beb0f4a4-25db-492e-bcf6-7f69d2dbca94 req-ec80ab5b-2070-4eed-8fa8-0fd562ed08f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c840f5d-e203-4b56-af39-9d9137aea98d", "tag": "a15be6dc-5472-4231-9d56-dd4e20531bf4"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:35:40.030110 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-beb0f4a4-25db-492e-bcf6-7f69d2dbca94 req-ec80ab5b-2070-4eed-8fa8-0fd562ed08f7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:40.030889 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-beb0f4a4-25db-492e-bcf6-7f69d2dbca94 req-ec80ab5b-2070-4eed-8fa8-0fd562ed08f7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:40.054549 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-beb0f4a4-25db-492e-bcf6-7f69d2dbca94 req-ec80ab5b-2070-4eed-8fa8-0fd562ed08f7 service nova] Creating event network-changed:a15be6dc-5472-4231-9d56-dd4e20531bf4 for instance 5c840f5d-e203-4b56-af39-9d9137aea98d on n-h1-843621-1 May 27 15:35:40.061879 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-beb0f4a4-25db-492e-bcf6-7f69d2dbca94 req-ec80ab5b-2070-4eed-8fa8-0fd562ed08f7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.369158 May 27 15:35:40.063030 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3066/6136] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:35:40.282243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-488ba8ac-3855-4c42-bbb3-4454e7c1497a tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:35:40.282886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-488ba8ac-3855-4c42-bbb3-4454e7c1497a tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:35:40.299656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-488ba8ac-3855-4c42-bbb3-4454e7c1497a tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:40.309515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-488ba8ac-3855-4c42-bbb3-4454e7c1497a tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:40.310598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-488ba8ac-3855-4c42-bbb3-4454e7c1497a tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:40.313976 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-488ba8ac-3855-4c42-bbb3-4454e7c1497a tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:41.047239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-488ba8ac-3855-4c42-bbb3-4454e7c1497a tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:35:41.071104 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-488ba8ac-3855-4c42-bbb3-4454e7c1497a tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d" status: 200 len: 1311 microversion: 2.1 time: 0.793396 May 27 15:35:41.072469 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3071/6137] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:35:40 2022] GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d => generated 1311 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:35:42.090666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a71109ae-a1eb-4de5-9ca0-873d43838cc7 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:35:42.091387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a71109ae-a1eb-4de5-9ca0-873d43838cc7 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:35:42.106485 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a71109ae-a1eb-4de5-9ca0-873d43838cc7 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:42.107855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a71109ae-a1eb-4de5-9ca0-873d43838cc7 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:42.110143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a71109ae-a1eb-4de5-9ca0-873d43838cc7 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:42.113042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a71109ae-a1eb-4de5-9ca0-873d43838cc7 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:42.482162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a71109ae-a1eb-4de5-9ca0-873d43838cc7 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:35:42.498092 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a71109ae-a1eb-4de5-9ca0-873d43838cc7 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d" status: 200 len: 1311 microversion: 2.1 time: 0.413649 May 27 15:35:42.511532 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3067/6138] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:35:42 2022] GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d => generated 1311 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:35:43.518417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-958f5bc8-e566-408a-8f70-b3b36497d602 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:35:43.519224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-958f5bc8-e566-408a-8f70-b3b36497d602 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:35:43.532267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-958f5bc8-e566-408a-8f70-b3b36497d602 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:43.535756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-958f5bc8-e566-408a-8f70-b3b36497d602 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:43.536589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-958f5bc8-e566-408a-8f70-b3b36497d602 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:43.537249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-958f5bc8-e566-408a-8f70-b3b36497d602 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:44.112823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-958f5bc8-e566-408a-8f70-b3b36497d602 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:35:44.130042 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-958f5bc8-e566-408a-8f70-b3b36497d602 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d" status: 200 len: 1311 microversion: 2.1 time: 0.616578 May 27 15:35:44.139529 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3072/6139] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:35:43 2022] GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d => generated 1311 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:35:45.148483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-26da741e-3888-4e95-a61d-2190789bc202 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:35:45.149291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-26da741e-3888-4e95-a61d-2190789bc202 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:35:45.162682 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:35:45.172062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26da741e-3888-4e95-a61d-2190789bc202 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:45.172864 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26da741e-3888-4e95-a61d-2190789bc202 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:45.175031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26da741e-3888-4e95-a61d-2190789bc202 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:45.177412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26da741e-3888-4e95-a61d-2190789bc202 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:45.411248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=8 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:35:45.686536 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-26da741e-3888-4e95-a61d-2190789bc202 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:35:45.706765 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-26da741e-3888-4e95-a61d-2190789bc202 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d" status: 200 len: 1311 microversion: 2.1 time: 0.562460 May 27 15:35:45.708951 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3068/6140] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:35:45 2022] GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d => generated 1311 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:35:46.728177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-495a8f4f-621a-4ad5-be4e-d00ddfe5de05 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:35:46.729418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-495a8f4f-621a-4ad5-be4e-d00ddfe5de05 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:35:46.738176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:35:46.741510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-495a8f4f-621a-4ad5-be4e-d00ddfe5de05 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:46.746642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-495a8f4f-621a-4ad5-be4e-d00ddfe5de05 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:46.747688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-495a8f4f-621a-4ad5-be4e-d00ddfe5de05 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:46.748315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-495a8f4f-621a-4ad5-be4e-d00ddfe5de05 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:47.018502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-495a8f4f-621a-4ad5-be4e-d00ddfe5de05 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:35:47.027608 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-495a8f4f-621a-4ad5-be4e-d00ddfe5de05 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d" status: 200 len: 1311 microversion: 2.1 time: 0.303340 May 27 15:35:47.028217 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3073/6141] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:35:46 2022] GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d => generated 1311 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:35:48.073911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f2b7a1eb-8578-4287-90f4-feeb10ff3376 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:35:48.074911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f2b7a1eb-8578-4287-90f4-feeb10ff3376 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:35:48.098297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f2b7a1eb-8578-4287-90f4-feeb10ff3376 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:48.102458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f2b7a1eb-8578-4287-90f4-feeb10ff3376 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:48.103926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f2b7a1eb-8578-4287-90f4-feeb10ff3376 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:48.110082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f2b7a1eb-8578-4287-90f4-feeb10ff3376 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:48.400962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f2b7a1eb-8578-4287-90f4-feeb10ff3376 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:35:48.409045 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f2b7a1eb-8578-4287-90f4-feeb10ff3376 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d" status: 200 len: 1311 microversion: 2.1 time: 0.354902 May 27 15:35:48.409648 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3069/6142] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:35:48 2022] GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d => generated 1311 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:35:49.427198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cf636f5a-ab70-4e7b-8f1d-b6e0753c40e0 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:35:49.427877 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cf636f5a-ab70-4e7b-8f1d-b6e0753c40e0 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:35:49.451491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cf636f5a-ab70-4e7b-8f1d-b6e0753c40e0 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:49.455157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cf636f5a-ab70-4e7b-8f1d-b6e0753c40e0 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:49.463187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cf636f5a-ab70-4e7b-8f1d-b6e0753c40e0 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:49.468845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cf636f5a-ab70-4e7b-8f1d-b6e0753c40e0 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:49.678799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-8086f623-0bfd-429f-aaf3-03e9b7bb6ae5 req-9cba3806-14e4-48b2-b17f-78b5020640b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c840f5d-e203-4b56-af39-9d9137aea98d", "name": "network-vif-plugged", "status": "completed", "tag": "a15be6dc-5472-4231-9d56-dd4e20531bf4"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:35:49.693039 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-8086f623-0bfd-429f-aaf3-03e9b7bb6ae5 req-9cba3806-14e4-48b2-b17f-78b5020640b5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:49.701790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-8086f623-0bfd-429f-aaf3-03e9b7bb6ae5 req-9cba3806-14e4-48b2-b17f-78b5020640b5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:49.717737 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-8086f623-0bfd-429f-aaf3-03e9b7bb6ae5 req-9cba3806-14e4-48b2-b17f-78b5020640b5 service nova] Creating event network-vif-plugged:a15be6dc-5472-4231-9d56-dd4e20531bf4 for instance 5c840f5d-e203-4b56-af39-9d9137aea98d on n-h1-843621-1 May 27 15:35:49.726551 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-8086f623-0bfd-429f-aaf3-03e9b7bb6ae5 req-9cba3806-14e4-48b2-b17f-78b5020640b5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165853 May 27 15:35:49.727500 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3070/6143] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:35:49.766282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cf636f5a-ab70-4e7b-8f1d-b6e0753c40e0 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:35:49.778544 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cf636f5a-ab70-4e7b-8f1d-b6e0753c40e0 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d" status: 200 len: 1311 microversion: 2.1 time: 0.356090 May 27 15:35:49.788655 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3074/6144] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:35:49 2022] GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d => generated 1311 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:35:50.797518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0a5731b7-5f13-4723-8c11-688a5548bf83 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:35:50.798409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0a5731b7-5f13-4723-8c11-688a5548bf83 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:35:50.815775 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a5731b7-5f13-4723-8c11-688a5548bf83 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:50.818218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a5731b7-5f13-4723-8c11-688a5548bf83 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:50.819057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a5731b7-5f13-4723-8c11-688a5548bf83 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:50.822352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a5731b7-5f13-4723-8c11-688a5548bf83 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:51.076916 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0a5731b7-5f13-4723-8c11-688a5548bf83 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:35:51.090713 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0a5731b7-5f13-4723-8c11-688a5548bf83 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d" status: 200 len: 1311 microversion: 2.1 time: 0.296576 May 27 15:35:51.091329 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3071/6145] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:35:50 2022] GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d => generated 1311 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:35:52.109082 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b90da841-e869-4650-933a-176ee2d0da24 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:35:52.109707 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b90da841-e869-4650-933a-176ee2d0da24 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:35:52.122853 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b90da841-e869-4650-933a-176ee2d0da24 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:52.125708 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b90da841-e869-4650-933a-176ee2d0da24 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:52.126693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b90da841-e869-4650-933a-176ee2d0da24 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:52.128286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b90da841-e869-4650-933a-176ee2d0da24 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:52.440411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b90da841-e869-4650-933a-176ee2d0da24 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:35:52.449149 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b90da841-e869-4650-933a-176ee2d0da24 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d" status: 200 len: 1496 microversion: 2.1 time: 0.344421 May 27 15:35:52.464574 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3075/6146] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:35:52 2022] GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d => generated 1496 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:35:53.247428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-322ea734-51b5-4507-be16-7e946acc1552 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:35:53.248022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-322ea734-51b5-4507-be16-7e946acc1552 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:35:53.260436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-322ea734-51b5-4507-be16-7e946acc1552 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:53.263536 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-322ea734-51b5-4507-be16-7e946acc1552 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:53.266152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-322ea734-51b5-4507-be16-7e946acc1552 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:53.266770 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-322ea734-51b5-4507-be16-7e946acc1552 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:53.341171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-322ea734-51b5-4507-be16-7e946acc1552 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:35:53.510157 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-322ea734-51b5-4507-be16-7e946acc1552 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d" status: 204 len: 0 microversion: 2.1 time: 0.265007 May 27 15:35:53.511381 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3072/6147] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:35:53 2022] DELETE /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:35:53.522960 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c029ee8d-c6bd-4244-a761-fb657d1a5566 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:35:53.524787 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c029ee8d-c6bd-4244-a761-fb657d1a5566 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:35:53.535648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c029ee8d-c6bd-4244-a761-fb657d1a5566 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:53.536607 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c029ee8d-c6bd-4244-a761-fb657d1a5566 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:53.537641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c029ee8d-c6bd-4244-a761-fb657d1a5566 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:53.538249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c029ee8d-c6bd-4244-a761-fb657d1a5566 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:53.718130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c029ee8d-c6bd-4244-a761-fb657d1a5566 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:35:53.728401 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c029ee8d-c6bd-4244-a761-fb657d1a5566 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d" status: 200 len: 1502 microversion: 2.1 time: 0.212485 May 27 15:35:53.732617 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3076/6148] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:35:53 2022] GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d => generated 1502 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:35:54.749692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b76a5024-0353-4ce9-a9d0-39d27cecf2f8 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:35:54.750411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b76a5024-0353-4ce9-a9d0-39d27cecf2f8 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:35:54.763197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b76a5024-0353-4ce9-a9d0-39d27cecf2f8 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:54.763669 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b76a5024-0353-4ce9-a9d0-39d27cecf2f8 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:54.764458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b76a5024-0353-4ce9-a9d0-39d27cecf2f8 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:54.777064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b76a5024-0353-4ce9-a9d0-39d27cecf2f8 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:55.253403 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b76a5024-0353-4ce9-a9d0-39d27cecf2f8 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:35:55.262408 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b76a5024-0353-4ce9-a9d0-39d27cecf2f8 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d" status: 200 len: 1502 microversion: 2.1 time: 0.517082 May 27 15:35:55.263005 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3073/6149] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:35:54 2022] GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d => generated 1502 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:35:55.871945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-f4001d10-d184-4052-8ece-55f93efcfaa9 req-6474c45e-7133-42d2-9271-e0c1b8d47611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c840f5d-e203-4b56-af39-9d9137aea98d", "name": "network-vif-deleted", "tag": "a15be6dc-5472-4231-9d56-dd4e20531bf4"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:35:55.887260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f4001d10-d184-4052-8ece-55f93efcfaa9 req-6474c45e-7133-42d2-9271-e0c1b8d47611 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:55.887720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f4001d10-d184-4052-8ece-55f93efcfaa9 req-6474c45e-7133-42d2-9271-e0c1b8d47611 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:55.908907 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-f4001d10-d184-4052-8ece-55f93efcfaa9 req-6474c45e-7133-42d2-9271-e0c1b8d47611 service nova] Creating event network-vif-deleted:a15be6dc-5472-4231-9d56-dd4e20531bf4 for instance 5c840f5d-e203-4b56-af39-9d9137aea98d on n-h1-843621-1 May 27 15:35:55.927027 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-f4001d10-d184-4052-8ece-55f93efcfaa9 req-6474c45e-7133-42d2-9271-e0c1b8d47611 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058237 May 27 15:35:55.929730 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3077/6150] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:35:56.284015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c3111b6d-3723-4ca9-b0c4-6ca64a75503f tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:35:56.285518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c3111b6d-3723-4ca9-b0c4-6ca64a75503f tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:35:56.293762 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3111b6d-3723-4ca9-b0c4-6ca64a75503f tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:56.294574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3111b6d-3723-4ca9-b0c4-6ca64a75503f tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:56.295591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3111b6d-3723-4ca9-b0c4-6ca64a75503f tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:56.296287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3111b6d-3723-4ca9-b0c4-6ca64a75503f tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:56.408098 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3111b6d-3723-4ca9-b0c4-6ca64a75503f tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:56.408814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3111b6d-3723-4ca9-b0c4-6ca64a75503f tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:56.409445 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-c3111b6d-3723-4ca9-b0c4-6ca64a75503f tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lazy-loading 'fault' on Instance uuid 5c840f5d-e203-4b56-af39-9d9137aea98d {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:35:56.489228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c3111b6d-3723-4ca9-b0c4-6ca64a75503f tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:35:56.504589 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c3111b6d-3723-4ca9-b0c4-6ca64a75503f tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d" status: 200 len: 1301 microversion: 2.1 time: 0.227762 May 27 15:35:56.521213 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3074/6151] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:35:56 2022] GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d => generated 1301 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:35:57.529510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-22b481fb-6cf3-4e87-b0e2-072ddf948e7a tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:35:57.530937 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-22b481fb-6cf3-4e87-b0e2-072ddf948e7a tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: 5c840f5d-e203-4b56-af39-9d9137aea98d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:35:57.547964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-22b481fb-6cf3-4e87-b0e2-072ddf948e7a tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:57.548900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-22b481fb-6cf3-4e87-b0e2-072ddf948e7a tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:57.550034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-22b481fb-6cf3-4e87-b0e2-072ddf948e7a tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:57.551549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-22b481fb-6cf3-4e87-b0e2-072ddf948e7a tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:57.585958 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-22b481fb-6cf3-4e87-b0e2-072ddf948e7a tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] HTTP exception thrown: Instance 5c840f5d-e203-4b56-af39-9d9137aea98d could not be found. May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-22b481fb-6cf3-4e87-b0e2-072ddf948e7a tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Request method failure captured: May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d HTTP/1.1 May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikO--K_I1CvyX6wyxCqomG4ozhoIIe0axu5nfm1H9S5LxvVbUs4_61czgqz_CQbDG13VubUyVfAMIxqIUhZc5KzOoewD7c2X5DTEhq0xzgj1lSDeL9Ip8-bwPZpxomegaQKfg8r-LMw8MRTu5pKKz_isUL1txx3CUPLjQfhXgTL4Sgho May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 55587bbc3b45490a8faec4ea059a08a2 May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-VolumesActionsTest-1447083401 May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/55587bbc3b45490a8faec4ea059a08a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/55587bbc3b45490a8faec4ea059a08a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/55587bbc3b45490a8faec4ea059a08a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_55587bbc3b45490a8faec4ea059a08a2", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-VolumesActionsTest-1447083401 May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 55587bbc3b45490a8faec4ea059a08a2 May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-VolumesActionsTest-1447083401 May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-VolumesActionsTest-1447083401-project May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 301ac6aa464c4ee0abfba0dff15149c9 May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-VolumesActionsTest-1447083401-project May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 5c840f5d-e203-4b56-af39-9d9137aea98d could not be found. May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '5c840f5d-e203-4b56-af39-9d9137aea98d'} May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c840f5d-e203-4b56-af39-9d9137aea98d could not be found. May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c840f5d-e203-4b56-af39-9d9137aea98d could not be found. May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:35:57.587943 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:35:57.592589 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:35:57.592589 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:35:57.592589 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:35:57.592589 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:35:57.592589 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:35:57.592589 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c840f5d-e203-4b56-af39-9d9137aea98d could not be found. May 27 15:35:57.592589 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:35:57.598796 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-22b481fb-6cf3-4e87-b0e2-072ddf948e7a tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Returning 404 to user: Instance 5c840f5d-e203-4b56-af39-9d9137aea98d could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:35:57.600063 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-22b481fb-6cf3-4e87-b0e2-072ddf948e7a tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d" status: 404 len: 111 microversion: 2.1 time: 0.076404 May 27 15:35:57.604942 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3078/6152] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:35:57 2022] GET /compute/v2.1/servers/5c840f5d-e203-4b56-af39-9d9137aea98d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:35:57.696943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-483dcad6-c95a-42c5-8df1-fe03da33ae29 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-205850251", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "0ee1599f-7683-4202-a4f4-b143649b0dad"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:35:57.830263 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-483dcad6-c95a-42c5-8df1-fe03da33ae29 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] validate_networks() for [('0ee1599f-7683-4202-a4f4-b143649b0dad', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:35:58.362377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-483dcad6-c95a-42c5-8df1-fe03da33ae29 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:35:58.362946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-483dcad6-c95a-42c5-8df1-fe03da33ae29 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:35:58.363555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-483dcad6-c95a-42c5-8df1-fe03da33ae29 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:35:58.364273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-483dcad6-c95a-42c5-8df1-fe03da33ae29 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:35:58.364802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-483dcad6-c95a-42c5-8df1-fe03da33ae29 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:35:58.389186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-483dcad6-c95a-42c5-8df1-fe03da33ae29 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:58.391047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-483dcad6-c95a-42c5-8df1-fe03da33ae29 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:58.393455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-483dcad6-c95a-42c5-8df1-fe03da33ae29 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:35:58.395104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-483dcad6-c95a-42c5-8df1-fe03da33ae29 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:35:58.443564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-483dcad6-c95a-42c5-8df1-fe03da33ae29 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Getting quotas for project 55587bbc3b45490a8faec4ea059a08a2. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:35:58.450928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-483dcad6-c95a-42c5-8df1-fe03da33ae29 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Getting quotas for user 301ac6aa464c4ee0abfba0dff15149c9 and project 55587bbc3b45490a8faec4ea059a08a2. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:35:58.476059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-483dcad6-c95a-42c5-8df1-fe03da33ae29 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:35:58.478716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-483dcad6-c95a-42c5-8df1-fe03da33ae29 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: f00b8092-cc5e-48ca-8dcb-d07ce6731697] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:35:58.557588 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-483dcad6-c95a-42c5-8df1-fe03da33ae29 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.865581 May 27 15:35:58.561375 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3075/6153] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:35:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:35:58.572972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5b513298-ea37-4fa9-80b7-0f9034b92ee9 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:35:58.574290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5b513298-ea37-4fa9-80b7-0f9034b92ee9 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: f00b8092-cc5e-48ca-8dcb-d07ce6731697] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:35:59.091595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5b513298-ea37-4fa9-80b7-0f9034b92ee9 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:35:59.103966 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5b513298-ea37-4fa9-80b7-0f9034b92ee9 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697" status: 200 len: 1213 microversion: 2.1 time: 0.536115 May 27 15:35:59.106204 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3079/6154] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:35:58 2022] GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697 => generated 1213 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:36:00.122566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9792e694-2e22-4dbc-a632-7eaa92ead875 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:00.123449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9792e694-2e22-4dbc-a632-7eaa92ead875 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: f00b8092-cc5e-48ca-8dcb-d07ce6731697] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:00.147084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9792e694-2e22-4dbc-a632-7eaa92ead875 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:00.147605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9792e694-2e22-4dbc-a632-7eaa92ead875 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:00.148416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9792e694-2e22-4dbc-a632-7eaa92ead875 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:00.148983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9792e694-2e22-4dbc-a632-7eaa92ead875 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:00.287464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9792e694-2e22-4dbc-a632-7eaa92ead875 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:00.297107 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9792e694-2e22-4dbc-a632-7eaa92ead875 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697" status: 200 len: 1265 microversion: 2.1 time: 0.178450 May 27 15:36:00.300523 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3076/6155] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:00 2022] GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:36:01.316558 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c4aac0b0-f64b-493b-b4b6-8f6600cd5476 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:01.317273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c4aac0b0-f64b-493b-b4b6-8f6600cd5476 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: f00b8092-cc5e-48ca-8dcb-d07ce6731697] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:01.328145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c4aac0b0-f64b-493b-b4b6-8f6600cd5476 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:01.333514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c4aac0b0-f64b-493b-b4b6-8f6600cd5476 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:01.334374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c4aac0b0-f64b-493b-b4b6-8f6600cd5476 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:01.334833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c4aac0b0-f64b-493b-b4b6-8f6600cd5476 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:02.490294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c4aac0b0-f64b-493b-b4b6-8f6600cd5476 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:02.498396 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c4aac0b0-f64b-493b-b4b6-8f6600cd5476 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697" status: 200 len: 1313 microversion: 2.1 time: 1.185783 May 27 15:36:02.498970 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3080/6156] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:01 2022] GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697 => generated 1313 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:36:03.518339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0f73dc0b-0d55-4de8-8a2b-aa1913e87c31 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:03.522049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0f73dc0b-0d55-4de8-8a2b-aa1913e87c31 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: f00b8092-cc5e-48ca-8dcb-d07ce6731697] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:03.541094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:36:03.547654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f73dc0b-0d55-4de8-8a2b-aa1913e87c31 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:03.549240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f73dc0b-0d55-4de8-8a2b-aa1913e87c31 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:03.552082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f73dc0b-0d55-4de8-8a2b-aa1913e87c31 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:03.553280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f73dc0b-0d55-4de8-8a2b-aa1913e87c31 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:03.569619 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:36:03.738617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-74c1078b-811e-4f99-8ebb-f3f8e0c3d7e4 req-1c113c11-204f-4557-8fb5-9459069a18a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f00b8092-cc5e-48ca-8dcb-d07ce6731697", "tag": "e37bc996-9b26-4545-b8f1-b20f1a50f4ac"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:36:03.770188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-74c1078b-811e-4f99-8ebb-f3f8e0c3d7e4 req-1c113c11-204f-4557-8fb5-9459069a18a2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:03.770664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-74c1078b-811e-4f99-8ebb-f3f8e0c3d7e4 req-1c113c11-204f-4557-8fb5-9459069a18a2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:03.806574 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-74c1078b-811e-4f99-8ebb-f3f8e0c3d7e4 req-1c113c11-204f-4557-8fb5-9459069a18a2 service nova] Creating event network-changed:e37bc996-9b26-4545-b8f1-b20f1a50f4ac for instance f00b8092-cc5e-48ca-8dcb-d07ce6731697 on n-h1-843621-1 May 27 15:36:03.821671 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-74c1078b-811e-4f99-8ebb-f3f8e0c3d7e4 req-1c113c11-204f-4557-8fb5-9459069a18a2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085560 May 27 15:36:03.826376 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3081/6157] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:36:04.356634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0f73dc0b-0d55-4de8-8a2b-aa1913e87c31 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:04.371795 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0f73dc0b-0d55-4de8-8a2b-aa1913e87c31 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697" status: 200 len: 1313 microversion: 2.1 time: 0.860081 May 27 15:36:04.376217 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3077/6158] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:03 2022] GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697 => generated 1313 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:36:05.390376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-953894f0-0760-4eab-b287-70050c8a651f tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:05.391870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-953894f0-0760-4eab-b287-70050c8a651f tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: f00b8092-cc5e-48ca-8dcb-d07ce6731697] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:05.401233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=33 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:36:05.403722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-953894f0-0760-4eab-b287-70050c8a651f tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:05.404262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-953894f0-0760-4eab-b287-70050c8a651f tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:05.405705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-953894f0-0760-4eab-b287-70050c8a651f tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:05.406404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-953894f0-0760-4eab-b287-70050c8a651f tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:05.432925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=61 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:36:05.729860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-953894f0-0760-4eab-b287-70050c8a651f tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:05.740025 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-953894f0-0760-4eab-b287-70050c8a651f tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697" status: 200 len: 1313 microversion: 2.1 time: 0.353399 May 27 15:36:05.744551 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3082/6159] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:05 2022] GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697 => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:36:06.761116 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-82fd4de9-40eb-4761-9730-d434603b4c1e tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:06.761739 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-82fd4de9-40eb-4761-9730-d434603b4c1e tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: f00b8092-cc5e-48ca-8dcb-d07ce6731697] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:06.773467 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82fd4de9-40eb-4761-9730-d434603b4c1e tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:06.774125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82fd4de9-40eb-4761-9730-d434603b4c1e tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:06.776924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82fd4de9-40eb-4761-9730-d434603b4c1e tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:06.777557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82fd4de9-40eb-4761-9730-d434603b4c1e tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:07.105452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-82fd4de9-40eb-4761-9730-d434603b4c1e tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:07.120495 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-82fd4de9-40eb-4761-9730-d434603b4c1e tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697" status: 200 len: 1313 microversion: 2.1 time: 0.358548 May 27 15:36:07.121740 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3078/6160] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:06 2022] GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:36:08.138254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-01d545e0-5a92-4cdc-ac7b-d33366d8e9c6 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:08.139615 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-01d545e0-5a92-4cdc-ac7b-d33366d8e9c6 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: f00b8092-cc5e-48ca-8dcb-d07ce6731697] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:08.153789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01d545e0-5a92-4cdc-ac7b-d33366d8e9c6 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:08.154862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01d545e0-5a92-4cdc-ac7b-d33366d8e9c6 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:08.156200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01d545e0-5a92-4cdc-ac7b-d33366d8e9c6 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:08.156851 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-01d545e0-5a92-4cdc-ac7b-d33366d8e9c6 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:08.699931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-01d545e0-5a92-4cdc-ac7b-d33366d8e9c6 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:08.708374 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-01d545e0-5a92-4cdc-ac7b-d33366d8e9c6 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697" status: 200 len: 1313 microversion: 2.1 time: 0.574159 May 27 15:36:08.717072 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3083/6161] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:08 2022] GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697 => generated 1313 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:36:09.726132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-767d4be8-fd66-4245-ac45-a53b607fd310 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:09.726751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-767d4be8-fd66-4245-ac45-a53b607fd310 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: f00b8092-cc5e-48ca-8dcb-d07ce6731697] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:09.729872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:36:09.733282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:36:09.749971 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-767d4be8-fd66-4245-ac45-a53b607fd310 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:09.750615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-767d4be8-fd66-4245-ac45-a53b607fd310 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:09.751566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-767d4be8-fd66-4245-ac45-a53b607fd310 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:09.756431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-767d4be8-fd66-4245-ac45-a53b607fd310 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:10.155662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-767d4be8-fd66-4245-ac45-a53b607fd310 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:10.169090 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-767d4be8-fd66-4245-ac45-a53b607fd310 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697" status: 200 len: 1313 microversion: 2.1 time: 0.447821 May 27 15:36:10.170481 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3079/6162] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:09 2022] GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697 => generated 1313 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:36:11.193309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e6a342ed-3b7b-43b8-941e-adb8b7bd6828 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:11.194495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e6a342ed-3b7b-43b8-941e-adb8b7bd6828 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: f00b8092-cc5e-48ca-8dcb-d07ce6731697] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:11.205684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:36:11.212107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e6a342ed-3b7b-43b8-941e-adb8b7bd6828 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:11.213439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e6a342ed-3b7b-43b8-941e-adb8b7bd6828 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:11.215824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e6a342ed-3b7b-43b8-941e-adb8b7bd6828 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:11.216101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e6a342ed-3b7b-43b8-941e-adb8b7bd6828 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:11.510025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e6a342ed-3b7b-43b8-941e-adb8b7bd6828 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:11.522531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-e3f6beb5-db74-4dc2-9c68-032d7cdd50cf req-6a6a7c55-8985-4b91-bfa3-84303766df78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f00b8092-cc5e-48ca-8dcb-d07ce6731697", "name": "network-vif-plugged", "status": "completed", "tag": "e37bc996-9b26-4545-b8f1-b20f1a50f4ac"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:36:11.525316 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e6a342ed-3b7b-43b8-941e-adb8b7bd6828 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697" status: 200 len: 1313 microversion: 2.1 time: 0.341562 May 27 15:36:11.526231 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3084/6163] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:11 2022] GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:36:11.566736 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e3f6beb5-db74-4dc2-9c68-032d7cdd50cf req-6a6a7c55-8985-4b91-bfa3-84303766df78 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:11.567198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e3f6beb5-db74-4dc2-9c68-032d7cdd50cf req-6a6a7c55-8985-4b91-bfa3-84303766df78 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:11.607905 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-e3f6beb5-db74-4dc2-9c68-032d7cdd50cf req-6a6a7c55-8985-4b91-bfa3-84303766df78 service nova] Creating event network-vif-plugged:e37bc996-9b26-4545-b8f1-b20f1a50f4ac for instance f00b8092-cc5e-48ca-8dcb-d07ce6731697 on n-h1-843621-1 May 27 15:36:11.628611 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-e3f6beb5-db74-4dc2-9c68-032d7cdd50cf req-6a6a7c55-8985-4b91-bfa3-84303766df78 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107464 May 27 15:36:11.650188 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3080/6164] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:36:12.546040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-408e0a32-be05-4b29-aa87-dae4bbc19f63 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:12.548143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-408e0a32-be05-4b29-aa87-dae4bbc19f63 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: f00b8092-cc5e-48ca-8dcb-d07ce6731697] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:12.565710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-408e0a32-be05-4b29-aa87-dae4bbc19f63 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:12.566567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-408e0a32-be05-4b29-aa87-dae4bbc19f63 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:12.567702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-408e0a32-be05-4b29-aa87-dae4bbc19f63 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:12.568766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-408e0a32-be05-4b29-aa87-dae4bbc19f63 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:12.741761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-408e0a32-be05-4b29-aa87-dae4bbc19f63 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:12.752552 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-408e0a32-be05-4b29-aa87-dae4bbc19f63 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697" status: 200 len: 1313 microversion: 2.1 time: 0.211695 May 27 15:36:12.754090 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3085/6165] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:12 2022] GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:36:13.774162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-287c7aef-562d-4ea1-b59d-84c872d977e1 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:13.776031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-287c7aef-562d-4ea1-b59d-84c872d977e1 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: f00b8092-cc5e-48ca-8dcb-d07ce6731697] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:13.794229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-287c7aef-562d-4ea1-b59d-84c872d977e1 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:13.798790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-287c7aef-562d-4ea1-b59d-84c872d977e1 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:13.803087 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-287c7aef-562d-4ea1-b59d-84c872d977e1 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:13.805064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-287c7aef-562d-4ea1-b59d-84c872d977e1 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:14.434546 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-287c7aef-562d-4ea1-b59d-84c872d977e1 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:14.447342 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-287c7aef-562d-4ea1-b59d-84c872d977e1 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697" status: 200 len: 1498 microversion: 2.1 time: 0.680447 May 27 15:36:14.448297 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3081/6166] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:13 2022] GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697 => generated 1498 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:36:15.311639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-842dd7ea-2e28-49d9-b7ee-d946222a69d0 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:15.312160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-842dd7ea-2e28-49d9-b7ee-d946222a69d0 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: f00b8092-cc5e-48ca-8dcb-d07ce6731697] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:15.329446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-842dd7ea-2e28-49d9-b7ee-d946222a69d0 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:15.330173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-842dd7ea-2e28-49d9-b7ee-d946222a69d0 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:15.331256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-842dd7ea-2e28-49d9-b7ee-d946222a69d0 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:15.331874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-842dd7ea-2e28-49d9-b7ee-d946222a69d0 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:15.396973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-842dd7ea-2e28-49d9-b7ee-d946222a69d0 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: f00b8092-cc5e-48ca-8dcb-d07ce6731697] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:36:15.569097 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-842dd7ea-2e28-49d9-b7ee-d946222a69d0 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697" status: 204 len: 0 microversion: 2.1 time: 0.262599 May 27 15:36:15.573342 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3086/6167] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:36:15 2022] DELETE /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:36:15.578925 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-84ec166e-1650-45ec-a062-c90764956fb3 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:15.579792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-84ec166e-1650-45ec-a062-c90764956fb3 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: f00b8092-cc5e-48ca-8dcb-d07ce6731697] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:15.602427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84ec166e-1650-45ec-a062-c90764956fb3 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:15.603298 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84ec166e-1650-45ec-a062-c90764956fb3 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:15.606976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84ec166e-1650-45ec-a062-c90764956fb3 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:15.608575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-84ec166e-1650-45ec-a062-c90764956fb3 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:16.078463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-84ec166e-1650-45ec-a062-c90764956fb3 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:16.093379 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-84ec166e-1650-45ec-a062-c90764956fb3 tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697" status: 200 len: 1504 microversion: 2.1 time: 0.518591 May 27 15:36:16.105488 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3082/6168] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:15 2022] GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697 => generated 1504 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:36:17.115050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ab02fe74-c5a1-4d8c-a7a9-09b9a1de228e tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:17.116384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ab02fe74-c5a1-4d8c-a7a9-09b9a1de228e tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: f00b8092-cc5e-48ca-8dcb-d07ce6731697] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:17.131121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab02fe74-c5a1-4d8c-a7a9-09b9a1de228e tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:17.132120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab02fe74-c5a1-4d8c-a7a9-09b9a1de228e tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:17.134161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab02fe74-c5a1-4d8c-a7a9-09b9a1de228e tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:17.135241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab02fe74-c5a1-4d8c-a7a9-09b9a1de228e tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:18.313724 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-59a9d702-9fec-47e8-8f5a-67360f642898 req-3c2900d0-51fd-48ca-a444-8a8e6ecfbf7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f00b8092-cc5e-48ca-8dcb-d07ce6731697", "name": "network-vif-deleted", "tag": "e37bc996-9b26-4545-b8f1-b20f1a50f4ac"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:36:18.344350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-59a9d702-9fec-47e8-8f5a-67360f642898 req-3c2900d0-51fd-48ca-a444-8a8e6ecfbf7c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:18.345271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-59a9d702-9fec-47e8-8f5a-67360f642898 req-3c2900d0-51fd-48ca-a444-8a8e6ecfbf7c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:18.397624 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-59a9d702-9fec-47e8-8f5a-67360f642898 req-3c2900d0-51fd-48ca-a444-8a8e6ecfbf7c service nova] Creating event network-vif-deleted:e37bc996-9b26-4545-b8f1-b20f1a50f4ac for instance f00b8092-cc5e-48ca-8dcb-d07ce6731697 on n-h1-843621-1 May 27 15:36:18.427303 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-59a9d702-9fec-47e8-8f5a-67360f642898 req-3c2900d0-51fd-48ca-a444-8a8e6ecfbf7c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112448 May 27 15:36:18.433130 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3083/6169] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:36:18.441447 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ab02fe74-c5a1-4d8c-a7a9-09b9a1de228e tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '301ac6aa464c4ee0abfba0dff15149c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55587bbc3b45490a8faec4ea059a08a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:18.457461 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ab02fe74-c5a1-4d8c-a7a9-09b9a1de228e tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697" status: 200 len: 1504 microversion: 2.1 time: 1.348037 May 27 15:36:18.463682 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3087/6170] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:17 2022] GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697 => generated 1504 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:36:19.481457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-78e8394a-09b5-4e68-b38b-90012cc14cce tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:19.482184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-78e8394a-09b5-4e68-b38b-90012cc14cce tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] [instance: f00b8092-cc5e-48ca-8dcb-d07ce6731697] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:19.507967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78e8394a-09b5-4e68-b38b-90012cc14cce tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:19.508466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78e8394a-09b5-4e68-b38b-90012cc14cce tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:19.509351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78e8394a-09b5-4e68-b38b-90012cc14cce tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:19.509812 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78e8394a-09b5-4e68-b38b-90012cc14cce tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:19.565039 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-78e8394a-09b5-4e68-b38b-90012cc14cce tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] HTTP exception thrown: Instance f00b8092-cc5e-48ca-8dcb-d07ce6731697 could not be found. May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-78e8394a-09b5-4e68-b38b-90012cc14cce tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Request method failure captured: May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697 HTTP/1.1 May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikO--K_I1CvyX6wyxCqomG4ozhoIIe0axu5nfm1H9S5LxvVbUs4_61czgqz_CQbDG13VubUyVfAMIxqIUhZc5KzOoewD7c2X5DTEhq0xzgj1lSDeL9Ip8-bwPZpxomegaQKfg8r-LMw8MRTu5pKKz_isUL1txx3CUPLjQfhXgTL4Sgho May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 55587bbc3b45490a8faec4ea059a08a2 May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-VolumesActionsTest-1447083401 May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/55587bbc3b45490a8faec4ea059a08a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/55587bbc3b45490a8faec4ea059a08a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/55587bbc3b45490a8faec4ea059a08a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_55587bbc3b45490a8faec4ea059a08a2", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-VolumesActionsTest-1447083401 May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 55587bbc3b45490a8faec4ea059a08a2 May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-VolumesActionsTest-1447083401 May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-VolumesActionsTest-1447083401-project May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 301ac6aa464c4ee0abfba0dff15149c9 May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-VolumesActionsTest-1447083401-project May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance f00b8092-cc5e-48ca-8dcb-d07ce6731697 could not be found. May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'f00b8092-cc5e-48ca-8dcb-d07ce6731697'} May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f00b8092-cc5e-48ca-8dcb-d07ce6731697 could not be found. May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f00b8092-cc5e-48ca-8dcb-d07ce6731697 could not be found. May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:36:19.566971 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:36:19.572496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:36:19.572496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:36:19.572496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:36:19.572496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:36:19.572496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:36:19.572496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f00b8092-cc5e-48ca-8dcb-d07ce6731697 could not be found. May 27 15:36:19.572496 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:36:19.572496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-78e8394a-09b5-4e68-b38b-90012cc14cce tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] Returning 404 to user: Instance f00b8092-cc5e-48ca-8dcb-d07ce6731697 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:36:19.577854 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-78e8394a-09b5-4e68-b38b-90012cc14cce tempest-VolumesActionsTest-1447083401 tempest-VolumesActionsTest-1447083401-project] 10.222.0.13 "GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697" status: 404 len: 111 microversion: 2.1 time: 0.093239 May 27 15:36:19.578549 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3084/6171] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:19 2022] GET /compute/v2.1/servers/f00b8092-cc5e-48ca-8dcb-d07ce6731697 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:36:40.594988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-10104110-c38f-461a-9550-e696f6332517 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-161353984", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "28a8beb0-c374-4e68-9d9b-d94abb76bbdb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8b1a4599-fc38-4529-b66a-d319c59ff383"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:36:40.619109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:36:40.633678 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:36:40.809933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-10104110-c38f-461a-9550-e696f6332517 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] validate_networks() for [('8b1a4599-fc38-4529-b66a-d319c59ff383', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:36:42.492160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-10104110-c38f-461a-9550-e696f6332517 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:36:42.493688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-10104110-c38f-461a-9550-e696f6332517 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:36:42.494197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-10104110-c38f-461a-9550-e696f6332517 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:36:42.494617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-10104110-c38f-461a-9550-e696f6332517 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:36:42.495040 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-10104110-c38f-461a-9550-e696f6332517 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:36:42.523943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10104110-c38f-461a-9550-e696f6332517 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:42.524385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10104110-c38f-461a-9550-e696f6332517 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:42.531504 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10104110-c38f-461a-9550-e696f6332517 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:42.533388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-10104110-c38f-461a-9550-e696f6332517 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:42.625857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-10104110-c38f-461a-9550-e696f6332517 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Getting quotas for project 536a3b9dd9a745c089e2da27b9f536ff. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:36:42.661635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-10104110-c38f-461a-9550-e696f6332517 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Getting quotas for user a058052ef3fd4ee58291ccc9837558cc and project 536a3b9dd9a745c089e2da27b9f536ff. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:36:42.899104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-10104110-c38f-461a-9550-e696f6332517 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:36:42.901338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-10104110-c38f-461a-9550-e696f6332517 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='28a8beb0-c374-4e68-9d9b-d94abb76bbdb',volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:36:43.269119 n-d-843621-1 devstack@n-api.service[119249]: ERROR oslo.messaging._drivers.impl_rabbit [None req-10104110-c38f-461a-9550-e696f6332517 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [13a5fdd9-d3ad-484a-b6e8-c3e98b7862f4] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 15:36:44.285897 n-d-843621-1 devstack@n-api.service[119249]: INFO oslo.messaging._drivers.impl_rabbit [None req-10104110-c38f-461a-9550-e696f6332517 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [13a5fdd9-d3ad-484a-b6e8-c3e98b7862f4] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 33878. May 27 15:36:44.293873 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-10104110-c38f-461a-9550-e696f6332517 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.703551 May 27 15:36:44.303381 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3088/6172] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:36:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:36:44.309927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7f99cb13-17c4-497f-a4aa-a7d867545fef tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:44.310592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7f99cb13-17c4-497f-a4aa-a7d867545fef tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:44.324336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=15 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:36:44.333457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=35 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:36:44.611885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7f99cb13-17c4-497f-a4aa-a7d867545fef tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:44.619673 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7f99cb13-17c4-497f-a4aa-a7d867545fef tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1056 microversion: 2.1 time: 0.315750 May 27 15:36:44.629057 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3085/6173] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:44 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1056 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:36:45.668904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6b56bf74-2217-464c-bd75-725980c852de tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:45.670632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6b56bf74-2217-464c-bd75-725980c852de tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:46.341416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6b56bf74-2217-464c-bd75-725980c852de tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:46.341416 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6b56bf74-2217-464c-bd75-725980c852de tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1056 microversion: 2.1 time: 0.527365 May 27 15:36:46.341416 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3089/6174] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:45 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1056 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:36:47.183788 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fc559d87-94ec-406a-80b7-76fc751a2ca4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:47.184322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fc559d87-94ec-406a-80b7-76fc751a2ca4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:47.211281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fc559d87-94ec-406a-80b7-76fc751a2ca4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:47.211754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fc559d87-94ec-406a-80b7-76fc751a2ca4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:47.218369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fc559d87-94ec-406a-80b7-76fc751a2ca4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:47.221692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fc559d87-94ec-406a-80b7-76fc751a2ca4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:47.707821 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fc559d87-94ec-406a-80b7-76fc751a2ca4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:47.722686 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fc559d87-94ec-406a-80b7-76fc751a2ca4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1162 microversion: 2.1 time: 0.538014 May 27 15:36:47.724119 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3086/6175] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:47 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1162 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:36:48.741764 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9a9101d2-d705-47c6-b4d1-5bec7912446b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:48.742409 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9a9101d2-d705-47c6-b4d1-5bec7912446b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:48.771104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a9101d2-d705-47c6-b4d1-5bec7912446b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:48.778184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a9101d2-d705-47c6-b4d1-5bec7912446b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:48.785835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a9101d2-d705-47c6-b4d1-5bec7912446b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:48.787013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a9101d2-d705-47c6-b4d1-5bec7912446b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:49.050233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9a9101d2-d705-47c6-b4d1-5bec7912446b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:49.093485 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9a9101d2-d705-47c6-b4d1-5bec7912446b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1172 microversion: 2.1 time: 0.357893 May 27 15:36:49.112662 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3090/6176] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:48 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1172 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:36:50.129120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2aea75ea-759d-439b-b917-5814b4e74e3d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:50.129761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2aea75ea-759d-439b-b917-5814b4e74e3d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:50.150242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2aea75ea-759d-439b-b917-5814b4e74e3d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:50.150716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2aea75ea-759d-439b-b917-5814b4e74e3d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:50.151537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2aea75ea-759d-439b-b917-5814b4e74e3d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:50.151982 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2aea75ea-759d-439b-b917-5814b4e74e3d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:50.681652 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2aea75ea-759d-439b-b917-5814b4e74e3d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:50.695223 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2aea75ea-759d-439b-b917-5814b4e74e3d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1214 microversion: 2.1 time: 0.571588 May 27 15:36:50.695825 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3087/6177] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:50 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1214 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:36:51.711648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b3ec2bff-4f98-45cc-a8ae-01e0e9728665 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:51.712272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b3ec2bff-4f98-45cc-a8ae-01e0e9728665 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:51.729308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3ec2bff-4f98-45cc-a8ae-01e0e9728665 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:51.729594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3ec2bff-4f98-45cc-a8ae-01e0e9728665 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:51.730465 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3ec2bff-4f98-45cc-a8ae-01e0e9728665 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:51.730817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b3ec2bff-4f98-45cc-a8ae-01e0e9728665 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:51.822763 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-c6e67683-a9df-4dff-ab83-0960249121d1 req-c512102a-2693-4da6-8e9a-3036fec2b031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40cbf42e-b050-445e-8636-38d993b11e44", "tag": "84ed2c07-a306-4567-9f7f-ba25ab3bdccc"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:36:51.855623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c6e67683-a9df-4dff-ab83-0960249121d1 req-c512102a-2693-4da6-8e9a-3036fec2b031 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:51.856087 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-c6e67683-a9df-4dff-ab83-0960249121d1 req-c512102a-2693-4da6-8e9a-3036fec2b031 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:51.975699 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-c6e67683-a9df-4dff-ab83-0960249121d1 req-c512102a-2693-4da6-8e9a-3036fec2b031 service nova] Creating event network-changed:84ed2c07-a306-4567-9f7f-ba25ab3bdccc for instance 40cbf42e-b050-445e-8636-38d993b11e44 on n-h1-843621-1 May 27 15:36:52.000105 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-c6e67683-a9df-4dff-ab83-0960249121d1 req-c512102a-2693-4da6-8e9a-3036fec2b031 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177791 May 27 15:36:52.008643 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3088/6178] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:36:52.580450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:36:52.740429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b3ec2bff-4f98-45cc-a8ae-01e0e9728665 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:52.754693 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b3ec2bff-4f98-45cc-a8ae-01e0e9728665 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1214 microversion: 2.1 time: 1.046836 May 27 15:36:52.755938 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3091/6179] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:51 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1214 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:36:53.773828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0009ebb6-d3a0-47d8-94e1-2f8c18117dce tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:53.774805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0009ebb6-d3a0-47d8-94e1-2f8c18117dce tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:53.813160 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0009ebb6-d3a0-47d8-94e1-2f8c18117dce tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:53.816215 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0009ebb6-d3a0-47d8-94e1-2f8c18117dce tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:53.818737 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0009ebb6-d3a0-47d8-94e1-2f8c18117dce tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:53.821159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0009ebb6-d3a0-47d8-94e1-2f8c18117dce tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:54.623337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:36:54.747415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0009ebb6-d3a0-47d8-94e1-2f8c18117dce tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:54.761060 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0009ebb6-d3a0-47d8-94e1-2f8c18117dce tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1214 microversion: 2.1 time: 0.990820 May 27 15:36:54.774119 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3089/6180] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:53 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1214 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:36:55.789474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6b6c51bb-b3de-4b80-b27e-80ba037ad41c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:55.790845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6b6c51bb-b3de-4b80-b27e-80ba037ad41c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:55.802377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b6c51bb-b3de-4b80-b27e-80ba037ad41c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:55.808454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b6c51bb-b3de-4b80-b27e-80ba037ad41c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:55.810649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b6c51bb-b3de-4b80-b27e-80ba037ad41c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:55.818442 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6b6c51bb-b3de-4b80-b27e-80ba037ad41c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:56.156663 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=8 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:36:57.159712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6b6c51bb-b3de-4b80-b27e-80ba037ad41c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:57.178677 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6b6c51bb-b3de-4b80-b27e-80ba037ad41c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1214 microversion: 2.1 time: 1.393574 May 27 15:36:57.182061 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3092/6181] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:55 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1214 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:36:58.204020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9e992e8e-fe69-4852-b783-e529b83dc796 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:36:58.206643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9e992e8e-fe69-4852-b783-e529b83dc796 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:36:58.257222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e992e8e-fe69-4852-b783-e529b83dc796 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:58.265818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e992e8e-fe69-4852-b783-e529b83dc796 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:58.270079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e992e8e-fe69-4852-b783-e529b83dc796 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:36:58.275786 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e992e8e-fe69-4852-b783-e529b83dc796 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:36:59.155313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9e992e8e-fe69-4852-b783-e529b83dc796 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:36:59.188888 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9e992e8e-fe69-4852-b783-e529b83dc796 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1214 microversion: 2.1 time: 0.993822 May 27 15:36:59.190352 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3090/6182] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:36:58 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1214 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:00.207373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-32f3f0a7-7ed4-4427-8811-7787f21a711e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:00.208111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-32f3f0a7-7ed4-4427-8811-7787f21a711e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:00.228247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32f3f0a7-7ed4-4427-8811-7787f21a711e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:00.233386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32f3f0a7-7ed4-4427-8811-7787f21a711e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:00.234614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32f3f0a7-7ed4-4427-8811-7787f21a711e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:00.235180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-32f3f0a7-7ed4-4427-8811-7787f21a711e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:01.115447 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-32f3f0a7-7ed4-4427-8811-7787f21a711e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:01.126966 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-32f3f0a7-7ed4-4427-8811-7787f21a711e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1214 microversion: 2.1 time: 0.923937 May 27 15:37:01.150169 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3093/6183] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:00 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1214 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:02.157312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c91c111a-ef7e-41f3-8bab-09c69610bf5e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:02.158641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c91c111a-ef7e-41f3-8bab-09c69610bf5e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:02.180278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c91c111a-ef7e-41f3-8bab-09c69610bf5e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:02.183401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c91c111a-ef7e-41f3-8bab-09c69610bf5e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:02.190016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c91c111a-ef7e-41f3-8bab-09c69610bf5e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:02.193253 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c91c111a-ef7e-41f3-8bab-09c69610bf5e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:02.845254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c91c111a-ef7e-41f3-8bab-09c69610bf5e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:02.851057 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c91c111a-ef7e-41f3-8bab-09c69610bf5e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1214 microversion: 2.1 time: 0.697857 May 27 15:37:02.862086 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3091/6184] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:02 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1214 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:03.883735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0c367803-4217-4995-a08c-d3b9b7af99fe tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:03.885418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0c367803-4217-4995-a08c-d3b9b7af99fe tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:03.911186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c367803-4217-4995-a08c-d3b9b7af99fe tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:03.912508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c367803-4217-4995-a08c-d3b9b7af99fe tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:03.917999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c367803-4217-4995-a08c-d3b9b7af99fe tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:03.918510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0c367803-4217-4995-a08c-d3b9b7af99fe tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:04.189983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0c367803-4217-4995-a08c-d3b9b7af99fe tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:04.203926 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0c367803-4217-4995-a08c-d3b9b7af99fe tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1214 microversion: 2.1 time: 0.328939 May 27 15:37:04.205919 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3094/6185] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:03 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1214 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:05.222232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9f6e099e-3aba-4fe4-be6e-d6fa33fdfc3b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:05.222871 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9f6e099e-3aba-4fe4-be6e-d6fa33fdfc3b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:05.266481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f6e099e-3aba-4fe4-be6e-d6fa33fdfc3b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:05.269441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f6e099e-3aba-4fe4-be6e-d6fa33fdfc3b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:05.273784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f6e099e-3aba-4fe4-be6e-d6fa33fdfc3b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:05.274387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9f6e099e-3aba-4fe4-be6e-d6fa33fdfc3b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:06.364198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9f6e099e-3aba-4fe4-be6e-d6fa33fdfc3b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:06.391351 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9f6e099e-3aba-4fe4-be6e-d6fa33fdfc3b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1214 microversion: 2.1 time: 1.173910 May 27 15:37:06.395092 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3092/6186] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:05 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1214 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:07.418217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d6fdff69-8879-4edb-9bab-7e8bce9bb9fb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:07.420377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d6fdff69-8879-4edb-9bab-7e8bce9bb9fb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:07.433905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6fdff69-8879-4edb-9bab-7e8bce9bb9fb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:07.449137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6fdff69-8879-4edb-9bab-7e8bce9bb9fb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:07.451110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6fdff69-8879-4edb-9bab-7e8bce9bb9fb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:07.459671 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6fdff69-8879-4edb-9bab-7e8bce9bb9fb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:08.645360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d6fdff69-8879-4edb-9bab-7e8bce9bb9fb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:08.659072 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d6fdff69-8879-4edb-9bab-7e8bce9bb9fb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1214 microversion: 2.1 time: 1.249044 May 27 15:37:08.661039 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3095/6187] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:07 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1214 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:09.678168 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-09aeb091-44ad-49b3-82b2-5a782dc6f976 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:09.680184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-09aeb091-44ad-49b3-82b2-5a782dc6f976 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:09.703209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-09aeb091-44ad-49b3-82b2-5a782dc6f976 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:09.703681 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-09aeb091-44ad-49b3-82b2-5a782dc6f976 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:09.704498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-09aeb091-44ad-49b3-82b2-5a782dc6f976 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:09.705524 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-09aeb091-44ad-49b3-82b2-5a782dc6f976 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:10.310718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-09aeb091-44ad-49b3-82b2-5a782dc6f976 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:10.321841 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-09aeb091-44ad-49b3-82b2-5a782dc6f976 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1214 microversion: 2.1 time: 0.649871 May 27 15:37:10.339074 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3093/6188] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:09 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1214 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:11.339515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-729cd2d4-67a4-4c40-bb61-23a55e00f6c8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:11.340069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-729cd2d4-67a4-4c40-bb61-23a55e00f6c8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:11.349029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:37:11.373115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-729cd2d4-67a4-4c40-bb61-23a55e00f6c8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:11.373588 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-729cd2d4-67a4-4c40-bb61-23a55e00f6c8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:11.374393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-729cd2d4-67a4-4c40-bb61-23a55e00f6c8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:11.374844 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-729cd2d4-67a4-4c40-bb61-23a55e00f6c8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:11.378770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=39 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:37:11.867557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-729cd2d4-67a4-4c40-bb61-23a55e00f6c8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:11.892579 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-729cd2d4-67a4-4c40-bb61-23a55e00f6c8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1214 microversion: 2.1 time: 0.556569 May 27 15:37:11.920910 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3096/6189] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:11 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1214 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:12.939723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-21e9d51f-beec-4f94-8398-1777e3c5cd5a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:12.941157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-21e9d51f-beec-4f94-8398-1777e3c5cd5a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:12.955697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21e9d51f-beec-4f94-8398-1777e3c5cd5a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:12.961380 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21e9d51f-beec-4f94-8398-1777e3c5cd5a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:12.962584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21e9d51f-beec-4f94-8398-1777e3c5cd5a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:12.963304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-21e9d51f-beec-4f94-8398-1777e3c5cd5a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:13.295443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-21e9d51f-beec-4f94-8398-1777e3c5cd5a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:13.304497 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-21e9d51f-beec-4f94-8398-1777e3c5cd5a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1214 microversion: 2.1 time: 0.370027 May 27 15:37:13.338912 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3094/6190] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:12 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1214 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:14.326399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-96dad8d5-0ab3-41b8-a619-7cd109a2ec51 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:14.327026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-96dad8d5-0ab3-41b8-a619-7cd109a2ec51 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:14.340953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96dad8d5-0ab3-41b8-a619-7cd109a2ec51 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:14.341745 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96dad8d5-0ab3-41b8-a619-7cd109a2ec51 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:14.346159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96dad8d5-0ab3-41b8-a619-7cd109a2ec51 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:14.353467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96dad8d5-0ab3-41b8-a619-7cd109a2ec51 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:14.772751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-96dad8d5-0ab3-41b8-a619-7cd109a2ec51 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:14.790057 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-96dad8d5-0ab3-41b8-a619-7cd109a2ec51 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1214 microversion: 2.1 time: 0.467337 May 27 15:37:14.800305 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3097/6191] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:14 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1214 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:15.811257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fcac73d3-72ed-4ccd-a903-b34d1b8c38fc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:15.811932 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fcac73d3-72ed-4ccd-a903-b34d1b8c38fc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:15.828614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=23 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:37:15.833285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fcac73d3-72ed-4ccd-a903-b34d1b8c38fc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:15.846142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fcac73d3-72ed-4ccd-a903-b34d1b8c38fc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:15.846142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fcac73d3-72ed-4ccd-a903-b34d1b8c38fc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:15.852332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fcac73d3-72ed-4ccd-a903-b34d1b8c38fc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:15.857213 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=51 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:37:16.688111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fcac73d3-72ed-4ccd-a903-b34d1b8c38fc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:16.696511 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fcac73d3-72ed-4ccd-a903-b34d1b8c38fc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1214 microversion: 2.1 time: 0.891734 May 27 15:37:16.709059 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3095/6192] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:15 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1214 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:17.717627 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3d767b72-4bb0-4a26-8b28-447c2e206126 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:17.719126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3d767b72-4bb0-4a26-8b28-447c2e206126 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:17.740233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d767b72-4bb0-4a26-8b28-447c2e206126 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:17.740921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d767b72-4bb0-4a26-8b28-447c2e206126 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:17.748082 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d767b72-4bb0-4a26-8b28-447c2e206126 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:17.754704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d767b72-4bb0-4a26-8b28-447c2e206126 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:18.182366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3d767b72-4bb0-4a26-8b28-447c2e206126 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:18.191828 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3d767b72-4bb0-4a26-8b28-447c2e206126 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1214 microversion: 2.1 time: 0.480786 May 27 15:37:18.222197 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3098/6193] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:17 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1214 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:19.239912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8e4e94bc-22be-4f58-af5a-ef19a49d8eab tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:19.240492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8e4e94bc-22be-4f58-af5a-ef19a49d8eab tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:19.254095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e4e94bc-22be-4f58-af5a-ef19a49d8eab tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:19.254573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e4e94bc-22be-4f58-af5a-ef19a49d8eab tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:19.255396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e4e94bc-22be-4f58-af5a-ef19a49d8eab tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:19.259796 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8e4e94bc-22be-4f58-af5a-ef19a49d8eab tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:19.686147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8e4e94bc-22be-4f58-af5a-ef19a49d8eab tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:19.701231 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8e4e94bc-22be-4f58-af5a-ef19a49d8eab tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1214 microversion: 2.1 time: 0.462584 May 27 15:37:19.712273 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3096/6194] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:19 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1214 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:20.723337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-874ef282-554d-481b-9d53-e446ca92aeaf tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:20.724063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-874ef282-554d-481b-9d53-e446ca92aeaf tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:20.766403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-874ef282-554d-481b-9d53-e446ca92aeaf tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:20.768075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-874ef282-554d-481b-9d53-e446ca92aeaf tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:20.773046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-874ef282-554d-481b-9d53-e446ca92aeaf tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:20.778923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-874ef282-554d-481b-9d53-e446ca92aeaf tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:21.854946 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-874ef282-554d-481b-9d53-e446ca92aeaf tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:21.863862 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-874ef282-554d-481b-9d53-e446ca92aeaf tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1202 microversion: 2.1 time: 1.148521 May 27 15:37:21.867850 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3099/6195] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:20 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1202 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:22.883586 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-949d1bbd-0e69-46a0-96b4-eeff2ecec3d4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:22.884215 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-949d1bbd-0e69-46a0-96b4-eeff2ecec3d4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:22.900809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-949d1bbd-0e69-46a0-96b4-eeff2ecec3d4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:22.901393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-949d1bbd-0e69-46a0-96b4-eeff2ecec3d4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:22.902322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-949d1bbd-0e69-46a0-96b4-eeff2ecec3d4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:22.902777 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-949d1bbd-0e69-46a0-96b4-eeff2ecec3d4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:23.641687 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-949d1bbd-0e69-46a0-96b4-eeff2ecec3d4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:23.657954 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-949d1bbd-0e69-46a0-96b4-eeff2ecec3d4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1202 microversion: 2.1 time: 0.779080 May 27 15:37:23.658546 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3097/6196] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:22 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1202 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:24.675394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c1105c1b-4a26-4480-93ff-dc7f2b0a6753 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:24.676031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c1105c1b-4a26-4480-93ff-dc7f2b0a6753 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:24.688122 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1105c1b-4a26-4480-93ff-dc7f2b0a6753 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:24.688613 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1105c1b-4a26-4480-93ff-dc7f2b0a6753 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:24.689540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1105c1b-4a26-4480-93ff-dc7f2b0a6753 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:24.689984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1105c1b-4a26-4480-93ff-dc7f2b0a6753 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:24.869869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c1105c1b-4a26-4480-93ff-dc7f2b0a6753 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:24.879028 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c1105c1b-4a26-4480-93ff-dc7f2b0a6753 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1202 microversion: 2.1 time: 0.207280 May 27 15:37:24.889684 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3100/6197] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:24 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1202 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:25.897033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-50c56f39-3e07-4337-a782-edac35071231 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:25.898325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-50c56f39-3e07-4337-a782-edac35071231 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:25.911897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-50c56f39-3e07-4337-a782-edac35071231 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:25.914604 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-50c56f39-3e07-4337-a782-edac35071231 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:25.915447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-50c56f39-3e07-4337-a782-edac35071231 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:25.915986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-50c56f39-3e07-4337-a782-edac35071231 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:26.477393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-50c56f39-3e07-4337-a782-edac35071231 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:26.490409 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-50c56f39-3e07-4337-a782-edac35071231 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1202 microversion: 2.1 time: 0.597059 May 27 15:37:26.493908 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3098/6198] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:25 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1202 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:27.509188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7c6beff9-d892-494f-9d9e-ef3f44f64fd0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:27.510530 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7c6beff9-d892-494f-9d9e-ef3f44f64fd0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:27.531500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7c6beff9-d892-494f-9d9e-ef3f44f64fd0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:27.531973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7c6beff9-d892-494f-9d9e-ef3f44f64fd0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:27.533671 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7c6beff9-d892-494f-9d9e-ef3f44f64fd0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:27.534144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7c6beff9-d892-494f-9d9e-ef3f44f64fd0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:27.924628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7c6beff9-d892-494f-9d9e-ef3f44f64fd0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:27.933442 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7c6beff9-d892-494f-9d9e-ef3f44f64fd0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1202 microversion: 2.1 time: 0.428860 May 27 15:37:27.934282 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3101/6199] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:27 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1202 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:28.954858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5a709db2-49c2-4a5f-83e0-cb6367b704fa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:28.956211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5a709db2-49c2-4a5f-83e0-cb6367b704fa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:28.982136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a709db2-49c2-4a5f-83e0-cb6367b704fa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:28.983178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a709db2-49c2-4a5f-83e0-cb6367b704fa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:28.984325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a709db2-49c2-4a5f-83e0-cb6367b704fa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:28.985005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a709db2-49c2-4a5f-83e0-cb6367b704fa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:29.356643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5a709db2-49c2-4a5f-83e0-cb6367b704fa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:29.370334 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5a709db2-49c2-4a5f-83e0-cb6367b704fa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1202 microversion: 2.1 time: 0.420063 May 27 15:37:29.370939 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3099/6200] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:28 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1202 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:30.388437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-280e110f-821a-49ab-9f4f-d35ba388f9ec tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:30.391077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-280e110f-821a-49ab-9f4f-d35ba388f9ec tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:30.403231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-280e110f-821a-49ab-9f4f-d35ba388f9ec tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:30.407460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-280e110f-821a-49ab-9f4f-d35ba388f9ec tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:30.411594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-280e110f-821a-49ab-9f4f-d35ba388f9ec tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:30.414427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-280e110f-821a-49ab-9f4f-d35ba388f9ec tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:31.031704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-280e110f-821a-49ab-9f4f-d35ba388f9ec tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:31.053166 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-280e110f-821a-49ab-9f4f-d35ba388f9ec tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1202 microversion: 2.1 time: 0.667875 May 27 15:37:31.064772 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3102/6201] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:30 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1202 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:32.071940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-efb315f8-d62c-430a-8766-117791eec0cc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:32.083956 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-efb315f8-d62c-430a-8766-117791eec0cc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:32.105088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-efb315f8-d62c-430a-8766-117791eec0cc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:32.123568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-efb315f8-d62c-430a-8766-117791eec0cc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:32.126661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-efb315f8-d62c-430a-8766-117791eec0cc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:32.127559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-efb315f8-d62c-430a-8766-117791eec0cc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:32.690465 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-51b2ac31-7d53-4c3b-ab1e-37fd98f432d2 req-39746f31-17b7-4cb6-bb6d-2d752e3eece4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40cbf42e-b050-445e-8636-38d993b11e44", "name": "network-vif-plugged", "status": "completed", "tag": "84ed2c07-a306-4567-9f7f-ba25ab3bdccc"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:37:32.714997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-51b2ac31-7d53-4c3b-ab1e-37fd98f432d2 req-39746f31-17b7-4cb6-bb6d-2d752e3eece4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:32.715762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-51b2ac31-7d53-4c3b-ab1e-37fd98f432d2 req-39746f31-17b7-4cb6-bb6d-2d752e3eece4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:32.762481 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-51b2ac31-7d53-4c3b-ab1e-37fd98f432d2 req-39746f31-17b7-4cb6-bb6d-2d752e3eece4 service nova] Creating event network-vif-plugged:84ed2c07-a306-4567-9f7f-ba25ab3bdccc for instance 40cbf42e-b050-445e-8636-38d993b11e44 on n-h1-843621-1 May 27 15:37:32.780778 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-51b2ac31-7d53-4c3b-ab1e-37fd98f432d2 req-39746f31-17b7-4cb6-bb6d-2d752e3eece4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097496 May 27 15:37:32.785025 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3103/6202] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:37:32.795347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-efb315f8-d62c-430a-8766-117791eec0cc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:32.833963 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-efb315f8-d62c-430a-8766-117791eec0cc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1202 microversion: 2.1 time: 0.757188 May 27 15:37:32.834918 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3100/6203] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:32 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1202 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:33.854761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ed803481-e9b8-4212-a127-ea7a94b64cc4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:33.857146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ed803481-e9b8-4212-a127-ea7a94b64cc4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:33.871224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ed803481-e9b8-4212-a127-ea7a94b64cc4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:33.871814 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ed803481-e9b8-4212-a127-ea7a94b64cc4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:33.896115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ed803481-e9b8-4212-a127-ea7a94b64cc4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:33.906265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ed803481-e9b8-4212-a127-ea7a94b64cc4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:34.193897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ed803481-e9b8-4212-a127-ea7a94b64cc4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:34.212618 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ed803481-e9b8-4212-a127-ea7a94b64cc4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1202 microversion: 2.1 time: 0.360775 May 27 15:37:34.213567 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3104/6204] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:33 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1202 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:35.232624 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-000e0a01-f508-42eb-b57a-b63efa1aba41 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:35.234758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-000e0a01-f508-42eb-b57a-b63efa1aba41 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:35.244986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-000e0a01-f508-42eb-b57a-b63efa1aba41 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:35.252144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-000e0a01-f508-42eb-b57a-b63efa1aba41 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:35.257323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-000e0a01-f508-42eb-b57a-b63efa1aba41 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:35.258474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-000e0a01-f508-42eb-b57a-b63efa1aba41 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:35.609011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-000e0a01-f508-42eb-b57a-b63efa1aba41 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:35.622024 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-000e0a01-f508-42eb-b57a-b63efa1aba41 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1388 microversion: 2.1 time: 0.395153 May 27 15:37:35.623598 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3101/6205] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:35 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1388 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:35.640659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3ef03b20-55c0-4ec0-a5fe-13fced26c783 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:35.642084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3ef03b20-55c0-4ec0-a5fe-13fced26c783 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:35.660561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ef03b20-55c0-4ec0-a5fe-13fced26c783 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:35.661127 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ef03b20-55c0-4ec0-a5fe-13fced26c783 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:35.662029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ef03b20-55c0-4ec0-a5fe-13fced26c783 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:35.662595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ef03b20-55c0-4ec0-a5fe-13fced26c783 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:36.462810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3ef03b20-55c0-4ec0-a5fe-13fced26c783 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:36.477208 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3ef03b20-55c0-4ec0-a5fe-13fced26c783 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1388 microversion: 2.1 time: 0.841259 May 27 15:37:36.481306 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3105/6206] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:35 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1388 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:36.496826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0ce42401-de5e-4881-9390-f485f67678a6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:36.497565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0ce42401-de5e-4881-9390-f485f67678a6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:36.516277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ce42401-de5e-4881-9390-f485f67678a6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:36.517482 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ce42401-de5e-4881-9390-f485f67678a6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:36.518348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ce42401-de5e-4881-9390-f485f67678a6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:36.518966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ce42401-de5e-4881-9390-f485f67678a6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:37.854936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0ce42401-de5e-4881-9390-f485f67678a6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:37.875347 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0ce42401-de5e-4881-9390-f485f67678a6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1388 microversion: 2.1 time: 1.382894 May 27 15:37:37.888381 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3102/6207] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:36 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1388 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:37.893945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2d0e12e3-c59c-46fd-81c2-3635574f877d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:37.895143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2d0e12e3-c59c-46fd-81c2-3635574f877d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:37.915780 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2d0e12e3-c59c-46fd-81c2-3635574f877d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:37.916397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2d0e12e3-c59c-46fd-81c2-3635574f877d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:37.917384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2d0e12e3-c59c-46fd-81c2-3635574f877d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:37.918244 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2d0e12e3-c59c-46fd-81c2-3635574f877d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:37.980214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2d0e12e3-c59c-46fd-81c2-3635574f877d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:37:38.112115 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2d0e12e3-c59c-46fd-81c2-3635574f877d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "DELETE /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 204 len: 0 microversion: 2.1 time: 0.221879 May 27 15:37:38.113045 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3106/6208] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:37:37 2022] DELETE /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:37:38.123126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f22d9749-5df9-4c7e-b876-1ed0df374bf5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:38.124125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f22d9749-5df9-4c7e-b876-1ed0df374bf5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:38.132428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f22d9749-5df9-4c7e-b876-1ed0df374bf5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:38.133232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f22d9749-5df9-4c7e-b876-1ed0df374bf5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:38.134261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f22d9749-5df9-4c7e-b876-1ed0df374bf5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:38.134910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f22d9749-5df9-4c7e-b876-1ed0df374bf5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:38.900507 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f22d9749-5df9-4c7e-b876-1ed0df374bf5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:38.923686 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f22d9749-5df9-4c7e-b876-1ed0df374bf5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1394 microversion: 2.1 time: 0.796885 May 27 15:37:38.924368 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3103/6209] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:38 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1394 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:39.942652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-011814c0-12c3-4137-9ac3-ee7204d5b46b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:39.944170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-011814c0-12c3-4137-9ac3-ee7204d5b46b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:39.959627 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-011814c0-12c3-4137-9ac3-ee7204d5b46b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:39.963573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-011814c0-12c3-4137-9ac3-ee7204d5b46b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:39.966778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-011814c0-12c3-4137-9ac3-ee7204d5b46b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:39.967554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-011814c0-12c3-4137-9ac3-ee7204d5b46b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:40.967358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-011814c0-12c3-4137-9ac3-ee7204d5b46b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:40.984329 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-011814c0-12c3-4137-9ac3-ee7204d5b46b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1394 microversion: 2.1 time: 1.046313 May 27 15:37:40.986381 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3107/6210] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:39 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1394 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:41.496272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-0fbcce56-c580-43b7-a99e-5985d0e5d49a req-e9155063-085e-42b0-91fb-6881c075f1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40cbf42e-b050-445e-8636-38d993b11e44", "name": "network-vif-deleted", "tag": "84ed2c07-a306-4567-9f7f-ba25ab3bdccc"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:37:41.525450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0fbcce56-c580-43b7-a99e-5985d0e5d49a req-e9155063-085e-42b0-91fb-6881c075f1d2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:41.525985 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0fbcce56-c580-43b7-a99e-5985d0e5d49a req-e9155063-085e-42b0-91fb-6881c075f1d2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:41.623865 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-0fbcce56-c580-43b7-a99e-5985d0e5d49a req-e9155063-085e-42b0-91fb-6881c075f1d2 service nova] Creating event network-vif-deleted:84ed2c07-a306-4567-9f7f-ba25ab3bdccc for instance 40cbf42e-b050-445e-8636-38d993b11e44 on n-h1-843621-1 May 27 15:37:41.653439 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-0fbcce56-c580-43b7-a99e-5985d0e5d49a req-e9155063-085e-42b0-91fb-6881c075f1d2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155500 May 27 15:37:41.659646 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3104/6211] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:37:42.005577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-57bdcdd7-f1d7-4f38-9a0b-c5cd2a6be7d6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:42.007010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-57bdcdd7-f1d7-4f38-9a0b-c5cd2a6be7d6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:42.018327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:37:42.028181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57bdcdd7-f1d7-4f38-9a0b-c5cd2a6be7d6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:42.031582 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57bdcdd7-f1d7-4f38-9a0b-c5cd2a6be7d6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:42.032709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57bdcdd7-f1d7-4f38-9a0b-c5cd2a6be7d6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:42.036596 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57bdcdd7-f1d7-4f38-9a0b-c5cd2a6be7d6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:42.115412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:37:42.408267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-57bdcdd7-f1d7-4f38-9a0b-c5cd2a6be7d6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:42.424751 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-57bdcdd7-f1d7-4f38-9a0b-c5cd2a6be7d6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1187 microversion: 2.1 time: 0.427037 May 27 15:37:42.435068 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3108/6212] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:41 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1187 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:43.443966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1fdd4c97-a0f2-4cd5-b2a5-2d882c22f30a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:43.445481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1fdd4c97-a0f2-4cd5-b2a5-2d882c22f30a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:43.461980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1fdd4c97-a0f2-4cd5-b2a5-2d882c22f30a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:43.462366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1fdd4c97-a0f2-4cd5-b2a5-2d882c22f30a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:43.463188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1fdd4c97-a0f2-4cd5-b2a5-2d882c22f30a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:43.463645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1fdd4c97-a0f2-4cd5-b2a5-2d882c22f30a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:43.597499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1fdd4c97-a0f2-4cd5-b2a5-2d882c22f30a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:43.607060 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1fdd4c97-a0f2-4cd5-b2a5-2d882c22f30a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1187 microversion: 2.1 time: 0.168212 May 27 15:37:43.613736 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3105/6213] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:43 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1187 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:44.630573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f2ed6d1e-e3ee-4b79-8df1-a62571d65abf tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:44.631944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f2ed6d1e-e3ee-4b79-8df1-a62571d65abf tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:44.640704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2ed6d1e-e3ee-4b79-8df1-a62571d65abf tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:44.651548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2ed6d1e-e3ee-4b79-8df1-a62571d65abf tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:44.652722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2ed6d1e-e3ee-4b79-8df1-a62571d65abf tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:44.653341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f2ed6d1e-e3ee-4b79-8df1-a62571d65abf tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:44.781849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f2ed6d1e-e3ee-4b79-8df1-a62571d65abf tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:44.792851 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f2ed6d1e-e3ee-4b79-8df1-a62571d65abf tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1187 microversion: 2.1 time: 0.166894 May 27 15:37:44.807126 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3109/6214] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:44 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1187 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:45.817089 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6b06c9ee-08c8-4293-a2e9-804ce7a7e6af tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:45.818423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6b06c9ee-08c8-4293-a2e9-804ce7a7e6af tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:45.853042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b06c9ee-08c8-4293-a2e9-804ce7a7e6af tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:45.854591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b06c9ee-08c8-4293-a2e9-804ce7a7e6af tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:45.858886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b06c9ee-08c8-4293-a2e9-804ce7a7e6af tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:45.859806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b06c9ee-08c8-4293-a2e9-804ce7a7e6af tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:46.072106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6b06c9ee-08c8-4293-a2e9-804ce7a7e6af tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:46.081454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=66 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:37:46.094091 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6b06c9ee-08c8-4293-a2e9-804ce7a7e6af tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1187 microversion: 2.1 time: 0.280156 May 27 15:37:46.098291 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3106/6215] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:45 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1187 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:47.121730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-15933b8b-5329-468e-9142-dce3d365e538 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:47.122921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-15933b8b-5329-468e-9142-dce3d365e538 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:47.162667 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15933b8b-5329-468e-9142-dce3d365e538 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:47.163153 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15933b8b-5329-468e-9142-dce3d365e538 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:47.163975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15933b8b-5329-468e-9142-dce3d365e538 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:47.164424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-15933b8b-5329-468e-9142-dce3d365e538 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:47.388594 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-15933b8b-5329-468e-9142-dce3d365e538 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:47.399222 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-15933b8b-5329-468e-9142-dce3d365e538 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1187 microversion: 2.1 time: 0.286082 May 27 15:37:47.426960 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3110/6216] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:47 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1187 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:48.434977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bdcf2d1a-d492-43e0-939b-c862064cdd75 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:48.435621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bdcf2d1a-d492-43e0-939b-c862064cdd75 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:48.439821 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=24 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:37:48.475890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bdcf2d1a-d492-43e0-939b-c862064cdd75 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:48.476560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bdcf2d1a-d492-43e0-939b-c862064cdd75 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:48.482024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bdcf2d1a-d492-43e0-939b-c862064cdd75 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:48.482704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bdcf2d1a-d492-43e0-939b-c862064cdd75 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:48.653990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bdcf2d1a-d492-43e0-939b-c862064cdd75 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:48.666634 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bdcf2d1a-d492-43e0-939b-c862064cdd75 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1187 microversion: 2.1 time: 0.239021 May 27 15:37:48.668581 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3107/6217] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:48 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1187 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:49.686386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-43e2b989-d5e6-44a3-ae5f-34d549c58584 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:49.688046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-43e2b989-d5e6-44a3-ae5f-34d549c58584 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:49.697668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43e2b989-d5e6-44a3-ae5f-34d549c58584 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:49.698469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43e2b989-d5e6-44a3-ae5f-34d549c58584 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:49.699427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43e2b989-d5e6-44a3-ae5f-34d549c58584 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:49.700032 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-43e2b989-d5e6-44a3-ae5f-34d549c58584 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:50.075377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-43e2b989-d5e6-44a3-ae5f-34d549c58584 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:50.089856 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-43e2b989-d5e6-44a3-ae5f-34d549c58584 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1187 microversion: 2.1 time: 0.407557 May 27 15:37:50.108738 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3111/6218] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:49 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1187 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:51.130038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5849a96e-fe0e-402c-9ecc-9f920f13530f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:51.134569 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5849a96e-fe0e-402c-9ecc-9f920f13530f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:51.163271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5849a96e-fe0e-402c-9ecc-9f920f13530f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:51.167079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5849a96e-fe0e-402c-9ecc-9f920f13530f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:51.170186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5849a96e-fe0e-402c-9ecc-9f920f13530f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:51.172224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5849a96e-fe0e-402c-9ecc-9f920f13530f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:51.552924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5849a96e-fe0e-402c-9ecc-9f920f13530f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:51.565301 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5849a96e-fe0e-402c-9ecc-9f920f13530f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1187 microversion: 2.1 time: 0.439128 May 27 15:37:51.572956 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3108/6219] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:51 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1187 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:52.584633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a860ddc4-c864-4cab-b45d-56e982cee903 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:52.587086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a860ddc4-c864-4cab-b45d-56e982cee903 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:52.678325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a860ddc4-c864-4cab-b45d-56e982cee903 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:52.678325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a860ddc4-c864-4cab-b45d-56e982cee903 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:52.678325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a860ddc4-c864-4cab-b45d-56e982cee903 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:52.678325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a860ddc4-c864-4cab-b45d-56e982cee903 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:53.005070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a860ddc4-c864-4cab-b45d-56e982cee903 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:53.018751 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a860ddc4-c864-4cab-b45d-56e982cee903 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1187 microversion: 2.1 time: 0.438679 May 27 15:37:53.024392 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3112/6220] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:52 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1187 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:54.039949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eb27c6f5-1051-435a-846d-b5957fa0d74e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:54.040583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-eb27c6f5-1051-435a-846d-b5957fa0d74e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:54.065012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb27c6f5-1051-435a-846d-b5957fa0d74e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:54.073453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb27c6f5-1051-435a-846d-b5957fa0d74e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:54.085057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb27c6f5-1051-435a-846d-b5957fa0d74e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:54.085833 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb27c6f5-1051-435a-846d-b5957fa0d74e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:54.310814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eb27c6f5-1051-435a-846d-b5957fa0d74e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:54.335349 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-eb27c6f5-1051-435a-846d-b5957fa0d74e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1187 microversion: 2.1 time: 0.294479 May 27 15:37:54.340717 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3109/6221] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:54 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1187 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:55.359169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-be1a4276-97f8-4602-9fa0-95b70efeea6e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:55.359803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-be1a4276-97f8-4602-9fa0-95b70efeea6e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:55.382988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be1a4276-97f8-4602-9fa0-95b70efeea6e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:55.393265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be1a4276-97f8-4602-9fa0-95b70efeea6e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:55.394209 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be1a4276-97f8-4602-9fa0-95b70efeea6e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:55.394679 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be1a4276-97f8-4602-9fa0-95b70efeea6e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:55.797753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-be1a4276-97f8-4602-9fa0-95b70efeea6e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:55.808744 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-be1a4276-97f8-4602-9fa0-95b70efeea6e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1187 microversion: 2.1 time: 0.458467 May 27 15:37:55.814003 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3113/6222] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:55 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1187 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:56.830152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b2115dbc-0a8a-4cb7-9564-065a3a544a63 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:56.831446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b2115dbc-0a8a-4cb7-9564-065a3a544a63 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:56.844609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2115dbc-0a8a-4cb7-9564-065a3a544a63 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:56.845448 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2115dbc-0a8a-4cb7-9564-065a3a544a63 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:56.846390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2115dbc-0a8a-4cb7-9564-065a3a544a63 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:56.846900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b2115dbc-0a8a-4cb7-9564-065a3a544a63 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:57.011828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b2115dbc-0a8a-4cb7-9564-065a3a544a63 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:57.033194 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b2115dbc-0a8a-4cb7-9564-065a3a544a63 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1187 microversion: 2.1 time: 0.207769 May 27 15:37:57.037280 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3110/6223] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:56 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1187 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:58.056408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bca38fe6-e5d8-4895-b506-e4e8046a85a0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:58.057713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bca38fe6-e5d8-4895-b506-e4e8046a85a0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:58.074901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bca38fe6-e5d8-4895-b506-e4e8046a85a0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:58.077229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bca38fe6-e5d8-4895-b506-e4e8046a85a0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:58.078273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bca38fe6-e5d8-4895-b506-e4e8046a85a0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:58.080128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bca38fe6-e5d8-4895-b506-e4e8046a85a0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:58.297542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bca38fe6-e5d8-4895-b506-e4e8046a85a0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:58.306534 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bca38fe6-e5d8-4895-b506-e4e8046a85a0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1187 microversion: 2.1 time: 0.256569 May 27 15:37:58.312948 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3114/6224] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:58 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1187 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:37:59.330261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b3b3b0c1-3b53-4f1c-9059-bf36275d7cd0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:37:59.331523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b3b3b0c1-3b53-4f1c-9059-bf36275d7cd0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:37:59.348357 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b3b3b0c1-3b53-4f1c-9059-bf36275d7cd0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:59.350870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b3b3b0c1-3b53-4f1c-9059-bf36275d7cd0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:59.359925 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b3b3b0c1-3b53-4f1c-9059-bf36275d7cd0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:37:59.360861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b3b3b0c1-3b53-4f1c-9059-bf36275d7cd0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:37:59.751424 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b3b3b0c1-3b53-4f1c-9059-bf36275d7cd0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:37:59.764768 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b3b3b0c1-3b53-4f1c-9059-bf36275d7cd0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1187 microversion: 2.1 time: 0.440149 May 27 15:37:59.777300 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3111/6225] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:37:59 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1187 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:38:00.784349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-35671ad6-301e-420b-837c-cfac60c8d0a3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:38:00.787550 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-35671ad6-301e-420b-837c-cfac60c8d0a3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:38:00.803384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35671ad6-301e-420b-837c-cfac60c8d0a3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:00.803835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35671ad6-301e-420b-837c-cfac60c8d0a3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:00.823388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35671ad6-301e-420b-837c-cfac60c8d0a3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:00.823998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-35671ad6-301e-420b-837c-cfac60c8d0a3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:01.444664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-35671ad6-301e-420b-837c-cfac60c8d0a3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:38:01.455186 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-35671ad6-301e-420b-837c-cfac60c8d0a3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1187 microversion: 2.1 time: 0.675480 May 27 15:38:01.461147 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3115/6226] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:38:00 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1187 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:38:02.475024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9567d798-e012-469c-a032-ae890982a2eb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:38:02.476230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9567d798-e012-469c-a032-ae890982a2eb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:38:02.503516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9567d798-e012-469c-a032-ae890982a2eb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:02.510229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9567d798-e012-469c-a032-ae890982a2eb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:02.521990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9567d798-e012-469c-a032-ae890982a2eb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:02.534512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9567d798-e012-469c-a032-ae890982a2eb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:02.923579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9567d798-e012-469c-a032-ae890982a2eb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:38:02.942453 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9567d798-e012-469c-a032-ae890982a2eb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 200 len: 1187 microversion: 2.1 time: 0.468194 May 27 15:38:02.953366 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3112/6227] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:38:02 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 1187 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:38:03.963823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8b877a28-1b95-4a65-a4c5-3e6578e67a4c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:38:03.964463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8b877a28-1b95-4a65-a4c5-3e6578e67a4c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 40cbf42e-b050-445e-8636-38d993b11e44] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:38:03.992533 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b877a28-1b95-4a65-a4c5-3e6578e67a4c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:03.994052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b877a28-1b95-4a65-a4c5-3e6578e67a4c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:03.994929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b877a28-1b95-4a65-a4c5-3e6578e67a4c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:03.995391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8b877a28-1b95-4a65-a4c5-3e6578e67a4c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:04.052280 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-8b877a28-1b95-4a65-a4c5-3e6578e67a4c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] HTTP exception thrown: Instance 40cbf42e-b050-445e-8636-38d993b11e44 could not be found. May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8b877a28-1b95-4a65-a4c5-3e6578e67a4c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Request method failure captured: May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 HTTP/1.1 May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikO_1Chjp-7OdQPlgoy0i68J74Yy9denIkk1niNkSk2uFWUy4CftwGV6LxM4FCEGakqUTp0mkulJ5awBDUhVVOjGCfP23UpxiQizq-3BPePUyAFyMxEgrT5T05iojcJbMyfNSyzYbX68HBU5apXXyE_-yRBe0ARJTHso9aoG2B7TFtpc May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_536a3b9dd9a745c089e2da27b9f536ff", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TestVolumeBootPattern-685942222 May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TestVolumeBootPattern-685942222-project May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: a058052ef3fd4ee58291ccc9837558cc May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TestVolumeBootPattern-685942222-project May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 40cbf42e-b050-445e-8636-38d993b11e44 could not be found. May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '40cbf42e-b050-445e-8636-38d993b11e44'} May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40cbf42e-b050-445e-8636-38d993b11e44 could not be found. May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40cbf42e-b050-445e-8636-38d993b11e44 could not be found. May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:38:04.054733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:38:04.058866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:38:04.058866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:38:04.058866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:38:04.058866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:38:04.058866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:38:04.058866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40cbf42e-b050-445e-8636-38d993b11e44 could not be found. May 27 15:38:04.058866 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:38:04.068887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8b877a28-1b95-4a65-a4c5-3e6578e67a4c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Returning 404 to user: Instance 40cbf42e-b050-445e-8636-38d993b11e44 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:38:04.071296 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8b877a28-1b95-4a65-a4c5-3e6578e67a4c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44" status: 404 len: 111 microversion: 2.1 time: 0.115081 May 27 15:38:04.082669 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3116/6228] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:38:03 2022] GET /compute/v2.1/servers/40cbf42e-b050-445e-8636-38d993b11e44 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:38:06.356801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-165122f1-99a1-4544-b104-df9c15773511 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Action: 'create', calling method: .version_select at 0x7fc7753ca8b0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-931418992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZqmGZaRq+hh8BbHCOjZSrEDn0FjSDCrMg5JKCP3ppnsovsoEJibMvbdoyVdHz5e1WvlT6CcH39kXjQ0RerIl7R943iRbSZl2hnXP02gnfF3gHvbXvdSo6Dxgp9J3thgg=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:38:06.432165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-165122f1-99a1-4544-b104-df9c15773511 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Getting quotas for project de878c1f022b4e9aa0b61f95b68536f8. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:38:06.459963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-165122f1-99a1-4544-b104-df9c15773511 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Getting quotas for user e07458324aa44b6f97714ab2ab2b9e92 and project de878c1f022b4e9aa0b61f95b68536f8. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:38:06.549640 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-165122f1-99a1-4544-b104-df9c15773511 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.585856 May 27 15:38:06.560579 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3113/6229] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:38:05 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:38:10.519495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-18d72e7e-1138-4364-9e3e-d4d9818ba25a tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-936202402", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-931418992", "security_groups": [{"name": "tempest-secgroup-smoke-1250801221"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "348c9435-ee19-4cfa-aca2-3e856b06c01d"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:38:10.692091 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-18d72e7e-1138-4364-9e3e-d4d9818ba25a tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] validate_networks() for [('348c9435-ee19-4cfa-aca2-3e856b06c01d', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:38:12.373790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=22 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:38:12.383480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-18d72e7e-1138-4364-9e3e-d4d9818ba25a tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Getting quotas for project de878c1f022b4e9aa0b61f95b68536f8. Resources: dict_keys(['metadata_items']) {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:38:12.398737 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-18d72e7e-1138-4364-9e3e-d4d9818ba25a tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Getting quotas for user e07458324aa44b6f97714ab2ab2b9e92 and project de878c1f022b4e9aa0b61f95b68536f8. Resources: dict_keys(['metadata_items']) {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:38:12.434508 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-18d72e7e-1138-4364-9e3e-d4d9818ba25a tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:38:12.434867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-18d72e7e-1138-4364-9e3e-d4d9818ba25a tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:38:12.435355 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-18d72e7e-1138-4364-9e3e-d4d9818ba25a tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:38:12.438232 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-18d72e7e-1138-4364-9e3e-d4d9818ba25a tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:38:12.438720 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-18d72e7e-1138-4364-9e3e-d4d9818ba25a tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:38:12.464659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-18d72e7e-1138-4364-9e3e-d4d9818ba25a tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:12.465272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-18d72e7e-1138-4364-9e3e-d4d9818ba25a tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:12.466197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-18d72e7e-1138-4364-9e3e-d4d9818ba25a tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:12.466756 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-18d72e7e-1138-4364-9e3e-d4d9818ba25a tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:12.477934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=50 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:38:12.493873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-18d72e7e-1138-4364-9e3e-d4d9818ba25a tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Getting quotas for project de878c1f022b4e9aa0b61f95b68536f8. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:38:12.500303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-18d72e7e-1138-4364-9e3e-d4d9818ba25a tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Getting quotas for user e07458324aa44b6f97714ab2ab2b9e92 and project de878c1f022b4e9aa0b61f95b68536f8. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:38:12.515492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-18d72e7e-1138-4364-9e3e-d4d9818ba25a tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:38:12.518165 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-18d72e7e-1138-4364-9e3e-d4d9818ba25a tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:38:12.596186 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-18d72e7e-1138-4364-9e3e-d4d9818ba25a tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.081417 May 27 15:38:12.600861 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3117/6230] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:38:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 2087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 15:38:12.612380 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ff159d41-9a9c-49fb-9880-2fa941aec38e tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:38:12.613053 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ff159d41-9a9c-49fb-9880-2fa941aec38e tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:38:12.739078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ff159d41-9a9c-49fb-9880-2fa941aec38e tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07458324aa44b6f97714ab2ab2b9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de878c1f022b4e9aa0b61f95b68536f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:38:12.747296 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ff159d41-9a9c-49fb-9880-2fa941aec38e tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b" status: 200 len: 1301 microversion: 2.1 time: 0.139096 May 27 15:38:12.767932 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3114/6231] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:38:12 2022] GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b => generated 1301 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:38:13.772835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6f8aa995-974e-4a6b-85d1-31c45aeacc93 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:38:13.775404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6f8aa995-974e-4a6b-85d1-31c45aeacc93 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:38:13.794164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f8aa995-974e-4a6b-85d1-31c45aeacc93 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:13.794871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f8aa995-974e-4a6b-85d1-31c45aeacc93 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:13.795823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f8aa995-974e-4a6b-85d1-31c45aeacc93 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:13.797208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f8aa995-974e-4a6b-85d1-31c45aeacc93 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:13.998197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6f8aa995-974e-4a6b-85d1-31c45aeacc93 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07458324aa44b6f97714ab2ab2b9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de878c1f022b4e9aa0b61f95b68536f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:38:14.011102 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6f8aa995-974e-4a6b-85d1-31c45aeacc93 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b" status: 200 len: 1297 microversion: 2.1 time: 0.248265 May 27 15:38:14.012348 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3118/6232] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:38:13 2022] GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b => generated 1297 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:38:15.028002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4e869d1a-1225-4714-9dd0-9fc8a2b26bfc tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:38:15.028734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4e869d1a-1225-4714-9dd0-9fc8a2b26bfc tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:38:15.044063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=37 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:38:15.053391 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e869d1a-1225-4714-9dd0-9fc8a2b26bfc tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:15.057652 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e869d1a-1225-4714-9dd0-9fc8a2b26bfc tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:15.058611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e869d1a-1225-4714-9dd0-9fc8a2b26bfc tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:15.059141 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e869d1a-1225-4714-9dd0-9fc8a2b26bfc tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:15.313096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4e869d1a-1225-4714-9dd0-9fc8a2b26bfc tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07458324aa44b6f97714ab2ab2b9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de878c1f022b4e9aa0b61f95b68536f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:38:15.331670 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4e869d1a-1225-4714-9dd0-9fc8a2b26bfc tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b" status: 200 len: 1359 microversion: 2.1 time: 0.298472 May 27 15:38:15.333560 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3115/6233] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:38:15 2022] GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b => generated 1359 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:38:16.352413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f7790af8-dab5-416f-9760-df6750129cda tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:38:16.353695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f7790af8-dab5-416f-9760-df6750129cda tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:38:16.364937 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f7790af8-dab5-416f-9760-df6750129cda tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:16.365544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f7790af8-dab5-416f-9760-df6750129cda tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:16.366477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f7790af8-dab5-416f-9760-df6750129cda tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:16.367067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f7790af8-dab5-416f-9760-df6750129cda tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:16.572305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f7790af8-dab5-416f-9760-df6750129cda tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07458324aa44b6f97714ab2ab2b9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de878c1f022b4e9aa0b61f95b68536f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:38:16.589222 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f7790af8-dab5-416f-9760-df6750129cda tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b" status: 200 len: 1359 microversion: 2.1 time: 0.242996 May 27 15:38:16.600281 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3119/6234] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:38:16 2022] GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:38:17.608430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ffccbde5-48ab-46c5-b5c8-5427491e32db tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:38:17.609097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ffccbde5-48ab-46c5-b5c8-5427491e32db tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:38:17.634226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ffccbde5-48ab-46c5-b5c8-5427491e32db tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:17.634690 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ffccbde5-48ab-46c5-b5c8-5427491e32db tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:17.637925 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ffccbde5-48ab-46c5-b5c8-5427491e32db tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:17.638655 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ffccbde5-48ab-46c5-b5c8-5427491e32db tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:18.206886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ffccbde5-48ab-46c5-b5c8-5427491e32db tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07458324aa44b6f97714ab2ab2b9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de878c1f022b4e9aa0b61f95b68536f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:38:18.216041 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ffccbde5-48ab-46c5-b5c8-5427491e32db tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b" status: 200 len: 1427 microversion: 2.1 time: 0.611898 May 27 15:38:18.219698 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3116/6235] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:38:17 2022] GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b => generated 1427 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:38:18.955581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-4484defc-d211-45ef-bdab-ef41edc8b827 req-98efb5dd-2e08-437a-afc5-351e4854e50f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d3f014f-f6ed-471c-a518-f315e3b9d71b", "tag": "d433bb92-2c24-4b34-ad75-7396c0dd6be1"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:38:18.980451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4484defc-d211-45ef-bdab-ef41edc8b827 req-98efb5dd-2e08-437a-afc5-351e4854e50f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:18.980934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4484defc-d211-45ef-bdab-ef41edc8b827 req-98efb5dd-2e08-437a-afc5-351e4854e50f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:19.018057 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-4484defc-d211-45ef-bdab-ef41edc8b827 req-98efb5dd-2e08-437a-afc5-351e4854e50f service nova] Creating event network-changed:d433bb92-2c24-4b34-ad75-7396c0dd6be1 for instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b on n-h1-843621-1 May 27 15:38:19.031596 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-4484defc-d211-45ef-bdab-ef41edc8b827 req-98efb5dd-2e08-437a-afc5-351e4854e50f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087043 May 27 15:38:19.034302 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3120/6236] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:38:19.237744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ace23945-a879-40d5-8edb-feaff6a28b97 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:38:19.238428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ace23945-a879-40d5-8edb-feaff6a28b97 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:38:19.253429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:38:19.266455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ace23945-a879-40d5-8edb-feaff6a28b97 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:19.267428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ace23945-a879-40d5-8edb-feaff6a28b97 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:19.268758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ace23945-a879-40d5-8edb-feaff6a28b97 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:19.269373 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ace23945-a879-40d5-8edb-feaff6a28b97 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:19.817644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ace23945-a879-40d5-8edb-feaff6a28b97 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07458324aa44b6f97714ab2ab2b9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de878c1f022b4e9aa0b61f95b68536f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:38:19.834519 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ace23945-a879-40d5-8edb-feaff6a28b97 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b" status: 200 len: 1427 microversion: 2.1 time: 0.594880 May 27 15:38:19.850204 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3117/6237] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:38:19 2022] GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b => generated 1427 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:38:20.863612 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4fceccdd-2e0e-4fde-ae97-6c5b4c8aac7d tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:38:20.864568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4fceccdd-2e0e-4fde-ae97-6c5b4c8aac7d tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:38:20.873271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4fceccdd-2e0e-4fde-ae97-6c5b4c8aac7d tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:20.873816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4fceccdd-2e0e-4fde-ae97-6c5b4c8aac7d tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:20.874546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4fceccdd-2e0e-4fde-ae97-6c5b4c8aac7d tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:20.883487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4fceccdd-2e0e-4fde-ae97-6c5b4c8aac7d tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:21.152538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4fceccdd-2e0e-4fde-ae97-6c5b4c8aac7d tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07458324aa44b6f97714ab2ab2b9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de878c1f022b4e9aa0b61f95b68536f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:38:21.172013 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4fceccdd-2e0e-4fde-ae97-6c5b4c8aac7d tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b" status: 200 len: 1427 microversion: 2.1 time: 0.312789 May 27 15:38:21.182944 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3121/6238] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:38:20 2022] GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b => generated 1427 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:38:22.190079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-109c2861-b2c1-49b8-b03e-c8ca0e5350ea tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:38:22.190707 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-109c2861-b2c1-49b8-b03e-c8ca0e5350ea tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:38:22.210924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-109c2861-b2c1-49b8-b03e-c8ca0e5350ea tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:22.211404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-109c2861-b2c1-49b8-b03e-c8ca0e5350ea tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:22.212234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-109c2861-b2c1-49b8-b03e-c8ca0e5350ea tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:22.212718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-109c2861-b2c1-49b8-b03e-c8ca0e5350ea tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:22.746627 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:38:22.844896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-109c2861-b2c1-49b8-b03e-c8ca0e5350ea tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07458324aa44b6f97714ab2ab2b9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de878c1f022b4e9aa0b61f95b68536f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:38:22.853590 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-109c2861-b2c1-49b8-b03e-c8ca0e5350ea tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b" status: 200 len: 1427 microversion: 2.1 time: 0.668376 May 27 15:38:22.858291 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3118/6239] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:38:22 2022] GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b => generated 1427 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:38:23.880585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e80b41f7-bcc2-4689-9020-1752ab6fd594 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:38:23.882636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e80b41f7-bcc2-4689-9020-1752ab6fd594 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:38:23.895665 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:38:23.900611 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=10 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:38:23.909134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e80b41f7-bcc2-4689-9020-1752ab6fd594 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:23.916932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e80b41f7-bcc2-4689-9020-1752ab6fd594 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:23.918303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e80b41f7-bcc2-4689-9020-1752ab6fd594 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:23.918901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e80b41f7-bcc2-4689-9020-1752ab6fd594 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:24.170265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e80b41f7-bcc2-4689-9020-1752ab6fd594 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07458324aa44b6f97714ab2ab2b9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de878c1f022b4e9aa0b61f95b68536f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:38:24.184028 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e80b41f7-bcc2-4689-9020-1752ab6fd594 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b" status: 200 len: 1427 microversion: 2.1 time: 0.309020 May 27 15:38:24.194997 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3122/6240] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:38:23 2022] GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b => generated 1427 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:38:25.202155 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-95f2a6f3-bb4a-466a-a9d9-1f7ce2808c10 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:38:25.202807 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-95f2a6f3-bb4a-466a-a9d9-1f7ce2808c10 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:38:25.216314 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-95f2a6f3-bb4a-466a-a9d9-1f7ce2808c10 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:25.222528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-95f2a6f3-bb4a-466a-a9d9-1f7ce2808c10 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:25.226057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-95f2a6f3-bb4a-466a-a9d9-1f7ce2808c10 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:25.227832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-95f2a6f3-bb4a-466a-a9d9-1f7ce2808c10 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:26.021396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-95f2a6f3-bb4a-466a-a9d9-1f7ce2808c10 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07458324aa44b6f97714ab2ab2b9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de878c1f022b4e9aa0b61f95b68536f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:38:26.030375 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-95f2a6f3-bb4a-466a-a9d9-1f7ce2808c10 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b" status: 200 len: 1427 microversion: 2.1 time: 0.832379 May 27 15:38:26.031336 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3119/6241] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:38:25 2022] GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b => generated 1427 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:38:26.493949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-af27743e-83a3-4258-bdae-8f1c08f22d51 req-04f47320-c0b8-4031-86ab-4220dc460ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3f014f-f6ed-471c-a518-f315e3b9d71b", "name": "network-vif-plugged", "status": "completed", "tag": "d433bb92-2c24-4b34-ad75-7396c0dd6be1"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:38:26.510143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-af27743e-83a3-4258-bdae-8f1c08f22d51 req-04f47320-c0b8-4031-86ab-4220dc460ba9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:26.510600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-af27743e-83a3-4258-bdae-8f1c08f22d51 req-04f47320-c0b8-4031-86ab-4220dc460ba9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:26.544062 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-af27743e-83a3-4258-bdae-8f1c08f22d51 req-04f47320-c0b8-4031-86ab-4220dc460ba9 service nova] Creating event network-vif-plugged:d433bb92-2c24-4b34-ad75-7396c0dd6be1 for instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b on n-h1-843621-1 May 27 15:38:26.551264 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-af27743e-83a3-4258-bdae-8f1c08f22d51 req-04f47320-c0b8-4031-86ab-4220dc460ba9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061135 May 27 15:38:26.552460 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3123/6242] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:38:27.048077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d6639819-a37c-4b59-aa36-56e3af68c5cf tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:38:27.051749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d6639819-a37c-4b59-aa36-56e3af68c5cf tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:38:27.064810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d6639819-a37c-4b59-aa36-56e3af68c5cf tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:27.074336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d6639819-a37c-4b59-aa36-56e3af68c5cf tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:27.075299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d6639819-a37c-4b59-aa36-56e3af68c5cf tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:27.075758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d6639819-a37c-4b59-aa36-56e3af68c5cf tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:27.462033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d6639819-a37c-4b59-aa36-56e3af68c5cf tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07458324aa44b6f97714ab2ab2b9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de878c1f022b4e9aa0b61f95b68536f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:38:27.474125 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d6639819-a37c-4b59-aa36-56e3af68c5cf tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b" status: 200 len: 1427 microversion: 2.1 time: 0.430383 May 27 15:38:27.477377 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3120/6243] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:38:27 2022] GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b => generated 1427 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:38:28.493811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-37c769e2-d115-43a7-82f3-c8dad41c64f3 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:38:28.495107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-37c769e2-d115-43a7-82f3-c8dad41c64f3 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:38:28.505111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-37c769e2-d115-43a7-82f3-c8dad41c64f3 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:28.505111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-37c769e2-d115-43a7-82f3-c8dad41c64f3 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:28.506408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-37c769e2-d115-43a7-82f3-c8dad41c64f3 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:28.507059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-37c769e2-d115-43a7-82f3-c8dad41c64f3 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:28.754595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-37c769e2-d115-43a7-82f3-c8dad41c64f3 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07458324aa44b6f97714ab2ab2b9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de878c1f022b4e9aa0b61f95b68536f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:38:28.765142 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-37c769e2-d115-43a7-82f3-c8dad41c64f3 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b" status: 200 len: 1607 microversion: 2.1 time: 0.276608 May 27 15:38:28.777722 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3124/6244] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:38:28 2022] GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b => generated 1607 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:38:28.785229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ef0e8884-c89d-4bb5-8ae9-3dbbc6389a84 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:38:28.785974 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ef0e8884-c89d-4bb5-8ae9-3dbbc6389a84 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:38:28.797601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef0e8884-c89d-4bb5-8ae9-3dbbc6389a84 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:28.798870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef0e8884-c89d-4bb5-8ae9-3dbbc6389a84 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:28.800456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef0e8884-c89d-4bb5-8ae9-3dbbc6389a84 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:28.820362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef0e8884-c89d-4bb5-8ae9-3dbbc6389a84 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:29.102595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ef0e8884-c89d-4bb5-8ae9-3dbbc6389a84 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07458324aa44b6f97714ab2ab2b9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de878c1f022b4e9aa0b61f95b68536f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:38:29.118648 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ef0e8884-c89d-4bb5-8ae9-3dbbc6389a84 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b" status: 200 len: 1607 microversion: 2.1 time: 0.337844 May 27 15:38:29.123890 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3121/6245] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:38:28 2022] GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b => generated 1607 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:38:29.178130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2eebb6c2-9b78-4d86-bd95-181acb35cb57 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:38:29.179058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2eebb6c2-9b78-4d86-bd95-181acb35cb57 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:38:29.209208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2eebb6c2-9b78-4d86-bd95-181acb35cb57 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:29.215220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2eebb6c2-9b78-4d86-bd95-181acb35cb57 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:29.219108 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2eebb6c2-9b78-4d86-bd95-181acb35cb57 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:29.221247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2eebb6c2-9b78-4d86-bd95-181acb35cb57 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:29.535229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2eebb6c2-9b78-4d86-bd95-181acb35cb57 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07458324aa44b6f97714ab2ab2b9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de878c1f022b4e9aa0b61f95b68536f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:38:29.561074 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2eebb6c2-9b78-4d86-bd95-181acb35cb57 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b" status: 200 len: 1607 microversion: 2.1 time: 0.402158 May 27 15:38:29.575578 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3125/6246] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:38:29 2022] GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b => generated 1607 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:38:34.695427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-503f7e69-3c69-4e68-9ce6-85805d879946 req-7a4bcfce-0785-4885-b6b1-341dea2211eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d3f014f-f6ed-471c-a518-f315e3b9d71b", "tag": "d433bb92-2c24-4b34-ad75-7396c0dd6be1"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:38:34.727914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-503f7e69-3c69-4e68-9ce6-85805d879946 req-7a4bcfce-0785-4885-b6b1-341dea2211eb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:34.731339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-503f7e69-3c69-4e68-9ce6-85805d879946 req-7a4bcfce-0785-4885-b6b1-341dea2211eb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:34.760952 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-503f7e69-3c69-4e68-9ce6-85805d879946 req-7a4bcfce-0785-4885-b6b1-341dea2211eb service nova] Creating event network-changed:d433bb92-2c24-4b34-ad75-7396c0dd6be1 for instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b on n-h1-843621-1 May 27 15:38:34.775408 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-503f7e69-3c69-4e68-9ce6-85805d879946 req-7a4bcfce-0785-4885-b6b1-341dea2211eb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.223632 May 27 15:38:34.779826 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3122/6247] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:38:57.639336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7de8d983-2a07-47c1-b592-da9441bf1fb3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1906451741", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1bde9e6b-5f2f-4068-bc8e-13f96f1d6ef1", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "8b1a4599-fc38-4529-b66a-d319c59ff383"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:38:57.654658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:38:57.656051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=41 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:38:57.766797 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-7de8d983-2a07-47c1-b592-da9441bf1fb3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] validate_networks() for [('8b1a4599-fc38-4529-b66a-d319c59ff383', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:38:58.262984 n-d-843621-1 devstack@n-api.service[119248]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:38:58.263737 n-d-843621-1 devstack@n-api.service[119248]: Fri May 27 15:38:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:38:58.707763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-7de8d983-2a07-47c1-b592-da9441bf1fb3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:38:58.709986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-7de8d983-2a07-47c1-b592-da9441bf1fb3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:38:58.711889 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-7de8d983-2a07-47c1-b592-da9441bf1fb3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:38:58.712598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-7de8d983-2a07-47c1-b592-da9441bf1fb3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:38:58.713514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-7de8d983-2a07-47c1-b592-da9441bf1fb3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:38:58.728875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7de8d983-2a07-47c1-b592-da9441bf1fb3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:58.729760 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7de8d983-2a07-47c1-b592-da9441bf1fb3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:58.741404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7de8d983-2a07-47c1-b592-da9441bf1fb3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:38:58.743072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7de8d983-2a07-47c1-b592-da9441bf1fb3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:38:58.789821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-7de8d983-2a07-47c1-b592-da9441bf1fb3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Getting quotas for project 536a3b9dd9a745c089e2da27b9f536ff. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:38:58.805595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-7de8d983-2a07-47c1-b592-da9441bf1fb3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Getting quotas for user a058052ef3fd4ee58291ccc9837558cc and project 536a3b9dd9a745c089e2da27b9f536ff. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:38:58.835525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7de8d983-2a07-47c1-b592-da9441bf1fb3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:38:58.838165 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7de8d983-2a07-47c1-b592-da9441bf1fb3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1bde9e6b-5f2f-4068-bc8e-13f96f1d6ef1',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:38:58.995418 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7de8d983-2a07-47c1-b592-da9441bf1fb3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.360944 May 27 15:38:59.003972 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3126/6248] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:38:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:38:59.010185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-091ab641-82b4-472a-9405-2c1104f45374 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:38:59.011777 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-091ab641-82b4-472a-9405-2c1104f45374 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:38:59.019772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=11 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:38:59.036359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=44 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:38:59.190194 n-d-843621-1 devstack@n-api.service[119249]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:38:59.190391 n-d-843621-1 devstack@n-api.service[119249]: Fri May 27 15:38:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:38:59.225904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-091ab641-82b4-472a-9405-2c1104f45374 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:38:59.242879 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-091ab641-82b4-472a-9405-2c1104f45374 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1057 microversion: 2.1 time: 0.232943 May 27 15:38:59.244087 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3123/6249] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:38:59 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1057 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:00.261166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2335da77-9b2e-4362-ad79-2640753f8c42 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:00.261166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2335da77-9b2e-4362-ad79-2640753f8c42 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:00.851673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2335da77-9b2e-4362-ad79-2640753f8c42 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:00.859577 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2335da77-9b2e-4362-ad79-2640753f8c42 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1057 microversion: 2.1 time: 0.603140 May 27 15:39:00.860812 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3127/6250] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:00 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1057 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:39:01.879141 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e563e192-9123-480a-a248-756307edd3ea tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:01.879828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e563e192-9123-480a-a248-756307edd3ea tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:01.911777 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e563e192-9123-480a-a248-756307edd3ea tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:01.912234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e563e192-9123-480a-a248-756307edd3ea tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:01.913122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e563e192-9123-480a-a248-756307edd3ea tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:01.913677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e563e192-9123-480a-a248-756307edd3ea tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:02.191994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e563e192-9123-480a-a248-756307edd3ea tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:02.219479 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e563e192-9123-480a-a248-756307edd3ea tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1127 microversion: 2.1 time: 0.345380 May 27 15:39:02.220398 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3124/6251] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:01 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1127 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:03.244225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-95505530-3216-4a84-a100-9fe7b85eda9d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:03.248603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-95505530-3216-4a84-a100-9fe7b85eda9d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:03.263008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-95505530-3216-4a84-a100-9fe7b85eda9d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:03.268254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-95505530-3216-4a84-a100-9fe7b85eda9d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:03.269513 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-95505530-3216-4a84-a100-9fe7b85eda9d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:03.270270 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-95505530-3216-4a84-a100-9fe7b85eda9d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:04.654395 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-95505530-3216-4a84-a100-9fe7b85eda9d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:04.669513 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-95505530-3216-4a84-a100-9fe7b85eda9d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 1.433420 May 27 15:39:04.673277 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3128/6252] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:03 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:05.696696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3143fd08-191c-48e8-876f-f9e586997bdd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:05.696696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3143fd08-191c-48e8-876f-f9e586997bdd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:05.712941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3143fd08-191c-48e8-876f-f9e586997bdd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:05.713322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3143fd08-191c-48e8-876f-f9e586997bdd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:05.714126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3143fd08-191c-48e8-876f-f9e586997bdd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:05.714582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3143fd08-191c-48e8-876f-f9e586997bdd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:06.309443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3143fd08-191c-48e8-876f-f9e586997bdd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:06.347026 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3143fd08-191c-48e8-876f-f9e586997bdd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.662944 May 27 15:39:06.347632 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3125/6253] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:05 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:07.365726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f52f777b-b7da-4a8e-997b-5ff0d4ac2e1d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:07.366921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f52f777b-b7da-4a8e-997b-5ff0d4ac2e1d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:07.378719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f52f777b-b7da-4a8e-997b-5ff0d4ac2e1d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:07.389177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f52f777b-b7da-4a8e-997b-5ff0d4ac2e1d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:07.401983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f52f777b-b7da-4a8e-997b-5ff0d4ac2e1d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:07.406675 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f52f777b-b7da-4a8e-997b-5ff0d4ac2e1d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:07.971951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f52f777b-b7da-4a8e-997b-5ff0d4ac2e1d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:07.980013 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f52f777b-b7da-4a8e-997b-5ff0d4ac2e1d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.620316 May 27 15:39:08.002147 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3129/6254] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:07 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:08.147524 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-e1f92571-f814-4f5e-b395-b0104c919f6c req-db9d670d-4db1-4ffb-85ba-7b3b93bac4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f3208d3-183a-4bf5-a050-6d264305d4bf", "tag": "13060e47-d902-4710-933c-02e3a87d99c5"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:39:08.183561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e1f92571-f814-4f5e-b395-b0104c919f6c req-db9d670d-4db1-4ffb-85ba-7b3b93bac4c7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:08.184990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e1f92571-f814-4f5e-b395-b0104c919f6c req-db9d670d-4db1-4ffb-85ba-7b3b93bac4c7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:08.223373 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-e1f92571-f814-4f5e-b395-b0104c919f6c req-db9d670d-4db1-4ffb-85ba-7b3b93bac4c7 service nova] Creating event network-changed:13060e47-d902-4710-933c-02e3a87d99c5 for instance 8f3208d3-183a-4bf5-a050-6d264305d4bf on n-h2-843621-1 May 27 15:39:08.244323 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-e1f92571-f814-4f5e-b395-b0104c919f6c req-db9d670d-4db1-4ffb-85ba-7b3b93bac4c7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104474 May 27 15:39:08.246104 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3126/6255] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:39:09.015574 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4679537a-d5d7-435d-a03e-e9f4b3ee091e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:09.022694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4679537a-d5d7-435d-a03e-e9f4b3ee091e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:09.040396 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:39:09.046194 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4679537a-d5d7-435d-a03e-e9f4b3ee091e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:09.046672 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4679537a-d5d7-435d-a03e-e9f4b3ee091e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:09.048885 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4679537a-d5d7-435d-a03e-e9f4b3ee091e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:09.049526 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4679537a-d5d7-435d-a03e-e9f4b3ee091e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:09.581290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4679537a-d5d7-435d-a03e-e9f4b3ee091e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:09.590197 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4679537a-d5d7-435d-a03e-e9f4b3ee091e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.584050 May 27 15:39:09.597890 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3130/6256] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:09 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:10.624276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-02762e63-83bb-4754-aa55-9a676c756c6f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:10.626233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-02762e63-83bb-4754-aa55-9a676c756c6f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:10.631381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:39:10.659539 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02762e63-83bb-4754-aa55-9a676c756c6f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:10.664235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02762e63-83bb-4754-aa55-9a676c756c6f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:10.665497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02762e63-83bb-4754-aa55-9a676c756c6f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:10.666772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-02762e63-83bb-4754-aa55-9a676c756c6f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:11.071913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-02762e63-83bb-4754-aa55-9a676c756c6f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:11.081439 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-02762e63-83bb-4754-aa55-9a676c756c6f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.461206 May 27 15:39:11.086347 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3127/6257] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:10 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:12.102755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-45fec6c7-abe4-4eb5-a75a-21a02ebf6499 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:12.104070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-45fec6c7-abe4-4eb5-a75a-21a02ebf6499 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:12.108187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=8 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:39:12.120372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45fec6c7-abe4-4eb5-a75a-21a02ebf6499 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:12.120878 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45fec6c7-abe4-4eb5-a75a-21a02ebf6499 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:12.121677 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45fec6c7-abe4-4eb5-a75a-21a02ebf6499 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:12.122143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45fec6c7-abe4-4eb5-a75a-21a02ebf6499 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:12.482064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-45fec6c7-abe4-4eb5-a75a-21a02ebf6499 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:12.499942 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-45fec6c7-abe4-4eb5-a75a-21a02ebf6499 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.400870 May 27 15:39:12.508994 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3131/6258] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:12 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:13.518112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-57e86730-90c0-444e-b0ca-e58a1ddcb499 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:13.519442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-57e86730-90c0-444e-b0ca-e58a1ddcb499 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:13.536405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57e86730-90c0-444e-b0ca-e58a1ddcb499 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:13.537406 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57e86730-90c0-444e-b0ca-e58a1ddcb499 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:13.538741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57e86730-90c0-444e-b0ca-e58a1ddcb499 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:13.539427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-57e86730-90c0-444e-b0ca-e58a1ddcb499 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:13.998388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-57e86730-90c0-444e-b0ca-e58a1ddcb499 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:14.043482 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-57e86730-90c0-444e-b0ca-e58a1ddcb499 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.529756 May 27 15:39:14.059717 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3128/6259] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:13 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:15.066447 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c2a7514c-6ebd-464a-b294-6556de0a8577 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:15.067198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c2a7514c-6ebd-464a-b294-6556de0a8577 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:15.086384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2a7514c-6ebd-464a-b294-6556de0a8577 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:15.087193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2a7514c-6ebd-464a-b294-6556de0a8577 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:15.088781 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2a7514c-6ebd-464a-b294-6556de0a8577 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:15.089581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c2a7514c-6ebd-464a-b294-6556de0a8577 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:15.656785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c2a7514c-6ebd-464a-b294-6556de0a8577 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:15.681346 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c2a7514c-6ebd-464a-b294-6556de0a8577 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.619048 May 27 15:39:15.682198 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3132/6260] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:15 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:16.707925 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4aaac796-821a-40a4-92c0-fa5026392003 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:16.708560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4aaac796-821a-40a4-92c0-fa5026392003 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:16.735887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4aaac796-821a-40a4-92c0-fa5026392003 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:16.746839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4aaac796-821a-40a4-92c0-fa5026392003 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:16.748879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4aaac796-821a-40a4-92c0-fa5026392003 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:16.754665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4aaac796-821a-40a4-92c0-fa5026392003 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:17.445343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4aaac796-821a-40a4-92c0-fa5026392003 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:17.458117 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4aaac796-821a-40a4-92c0-fa5026392003 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.760771 May 27 15:39:17.461499 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3129/6261] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:16 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:18.477985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-895f3e31-5131-4202-af04-e4ae4528ec55 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:18.479306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-895f3e31-5131-4202-af04-e4ae4528ec55 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:18.495689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-895f3e31-5131-4202-af04-e4ae4528ec55 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:18.499924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-895f3e31-5131-4202-af04-e4ae4528ec55 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:18.502071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-895f3e31-5131-4202-af04-e4ae4528ec55 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:18.509398 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-895f3e31-5131-4202-af04-e4ae4528ec55 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:19.826589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-895f3e31-5131-4202-af04-e4ae4528ec55 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:19.836383 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-895f3e31-5131-4202-af04-e4ae4528ec55 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 1.363823 May 27 15:39:19.837019 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3133/6262] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:18 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:20.854919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6840b5a8-d350-47ef-bbb4-de5f378c13f7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:20.856293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6840b5a8-d350-47ef-bbb4-de5f378c13f7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:20.878640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6840b5a8-d350-47ef-bbb4-de5f378c13f7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:20.884562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6840b5a8-d350-47ef-bbb4-de5f378c13f7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:20.885678 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6840b5a8-d350-47ef-bbb4-de5f378c13f7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:20.886300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6840b5a8-d350-47ef-bbb4-de5f378c13f7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:21.631719 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6840b5a8-d350-47ef-bbb4-de5f378c13f7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:21.645735 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6840b5a8-d350-47ef-bbb4-de5f378c13f7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.790110 May 27 15:39:21.647797 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3130/6263] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:20 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:22.669138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1b671390-e559-4682-b06f-fd8145604d70 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:22.669888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1b671390-e559-4682-b06f-fd8145604d70 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:22.691264 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b671390-e559-4682-b06f-fd8145604d70 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:22.695219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b671390-e559-4682-b06f-fd8145604d70 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:22.698930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b671390-e559-4682-b06f-fd8145604d70 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:22.701589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1b671390-e559-4682-b06f-fd8145604d70 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:23.260118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1b671390-e559-4682-b06f-fd8145604d70 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:23.273495 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1b671390-e559-4682-b06f-fd8145604d70 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.608977 May 27 15:39:23.274459 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3134/6264] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:22 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:24.291300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-53ba8279-35c3-4bd0-b64f-b52b8261fe35 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:24.291933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-53ba8279-35c3-4bd0-b64f-b52b8261fe35 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:24.302236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53ba8279-35c3-4bd0-b64f-b52b8261fe35 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:24.302711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53ba8279-35c3-4bd0-b64f-b52b8261fe35 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:24.303624 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53ba8279-35c3-4bd0-b64f-b52b8261fe35 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:24.303971 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-53ba8279-35c3-4bd0-b64f-b52b8261fe35 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:24.510125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-53ba8279-35c3-4bd0-b64f-b52b8261fe35 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:24.522577 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-53ba8279-35c3-4bd0-b64f-b52b8261fe35 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.235590 May 27 15:39:24.525007 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3131/6265] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:24 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:25.545879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c87417cc-b243-4855-9e88-f8e2c4dce538 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:25.546504 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c87417cc-b243-4855-9e88-f8e2c4dce538 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:25.555770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c87417cc-b243-4855-9e88-f8e2c4dce538 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:25.556218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c87417cc-b243-4855-9e88-f8e2c4dce538 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:25.557199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c87417cc-b243-4855-9e88-f8e2c4dce538 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:25.558066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c87417cc-b243-4855-9e88-f8e2c4dce538 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:25.855205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c87417cc-b243-4855-9e88-f8e2c4dce538 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:25.863755 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c87417cc-b243-4855-9e88-f8e2c4dce538 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.322067 May 27 15:39:25.864343 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3135/6266] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:25 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:26.883869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-92030b80-e734-4444-b4d1-e321f8cc97f4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:26.884511 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-92030b80-e734-4444-b4d1-e321f8cc97f4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:26.902699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-92030b80-e734-4444-b4d1-e321f8cc97f4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:26.903519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-92030b80-e734-4444-b4d1-e321f8cc97f4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:26.905834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-92030b80-e734-4444-b4d1-e321f8cc97f4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:26.907708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-92030b80-e734-4444-b4d1-e321f8cc97f4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:27.177351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-92030b80-e734-4444-b4d1-e321f8cc97f4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:27.193168 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-92030b80-e734-4444-b4d1-e321f8cc97f4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.314863 May 27 15:39:27.194829 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3132/6267] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:26 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:28.212789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4900b1f0-43d3-4b54-815f-c7247d73035e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:28.213326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4900b1f0-43d3-4b54-815f-c7247d73035e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:28.228808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:39:28.235431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4900b1f0-43d3-4b54-815f-c7247d73035e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:28.238540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4900b1f0-43d3-4b54-815f-c7247d73035e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:28.239268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4900b1f0-43d3-4b54-815f-c7247d73035e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:28.249486 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4900b1f0-43d3-4b54-815f-c7247d73035e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:28.294055 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=51 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:39:28.505545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4900b1f0-43d3-4b54-815f-c7247d73035e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:28.526835 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4900b1f0-43d3-4b54-815f-c7247d73035e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.315022 May 27 15:39:28.533394 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3136/6268] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:28 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:29.539961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-77724588-95ce-4afa-b032-cf6390ac2319 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:29.541371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-77724588-95ce-4afa-b032-cf6390ac2319 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:29.549093 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=23 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:39:29.551508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77724588-95ce-4afa-b032-cf6390ac2319 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:29.552208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77724588-95ce-4afa-b032-cf6390ac2319 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:29.553672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77724588-95ce-4afa-b032-cf6390ac2319 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:29.554797 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77724588-95ce-4afa-b032-cf6390ac2319 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:29.562103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=51 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:39:29.821953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-77724588-95ce-4afa-b032-cf6390ac2319 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:29.833872 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-77724588-95ce-4afa-b032-cf6390ac2319 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.298144 May 27 15:39:29.835138 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3133/6269] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:29 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:30.853298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2ab9ddef-257f-4b10-8c7b-b995197366ab tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:30.853996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2ab9ddef-257f-4b10-8c7b-b995197366ab tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:30.869133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2ab9ddef-257f-4b10-8c7b-b995197366ab tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:30.871907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2ab9ddef-257f-4b10-8c7b-b995197366ab tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:30.873904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2ab9ddef-257f-4b10-8c7b-b995197366ab tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:30.874370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2ab9ddef-257f-4b10-8c7b-b995197366ab tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:31.254682 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2ab9ddef-257f-4b10-8c7b-b995197366ab tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:31.279063 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2ab9ddef-257f-4b10-8c7b-b995197366ab tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.430971 May 27 15:39:31.280365 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3137/6270] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:30 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:39:32.296319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3ef472c3-81eb-4ccf-b6f1-1ba7c865ea19 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:32.298217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3ef472c3-81eb-4ccf-b6f1-1ba7c865ea19 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:32.320179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3ef472c3-81eb-4ccf-b6f1-1ba7c865ea19 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:32.320648 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3ef472c3-81eb-4ccf-b6f1-1ba7c865ea19 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:32.327505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3ef472c3-81eb-4ccf-b6f1-1ba7c865ea19 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:32.327980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3ef472c3-81eb-4ccf-b6f1-1ba7c865ea19 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:32.565852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3ef472c3-81eb-4ccf-b6f1-1ba7c865ea19 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:32.574645 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3ef472c3-81eb-4ccf-b6f1-1ba7c865ea19 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.282726 May 27 15:39:32.575492 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3134/6271] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:32 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:33.592890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8fc8aac6-e1d1-4929-a4b5-241a4fa03cbb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:33.595590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8fc8aac6-e1d1-4929-a4b5-241a4fa03cbb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:33.604259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8fc8aac6-e1d1-4929-a4b5-241a4fa03cbb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:33.605364 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8fc8aac6-e1d1-4929-a4b5-241a4fa03cbb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:33.606410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8fc8aac6-e1d1-4929-a4b5-241a4fa03cbb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:33.607062 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8fc8aac6-e1d1-4929-a4b5-241a4fa03cbb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:33.850541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8fc8aac6-e1d1-4929-a4b5-241a4fa03cbb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:33.860046 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8fc8aac6-e1d1-4929-a4b5-241a4fa03cbb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.272323 May 27 15:39:33.866696 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3138/6272] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:33 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:34.884579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-12457399-3544-469b-a8e5-0acbe196b355 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:34.885837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-12457399-3544-469b-a8e5-0acbe196b355 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:34.897635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12457399-3544-469b-a8e5-0acbe196b355 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:34.898104 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12457399-3544-469b-a8e5-0acbe196b355 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:34.898915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12457399-3544-469b-a8e5-0acbe196b355 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:34.899370 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12457399-3544-469b-a8e5-0acbe196b355 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:35.182629 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-12457399-3544-469b-a8e5-0acbe196b355 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:35.192571 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-12457399-3544-469b-a8e5-0acbe196b355 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.313629 May 27 15:39:35.193909 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3135/6273] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:34 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:36.211296 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-517b3ed5-2ec0-4cfe-a79f-9801c1cacf2d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:36.212792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-517b3ed5-2ec0-4cfe-a79f-9801c1cacf2d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:36.225883 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-517b3ed5-2ec0-4cfe-a79f-9801c1cacf2d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:36.226688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-517b3ed5-2ec0-4cfe-a79f-9801c1cacf2d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:36.227971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-517b3ed5-2ec0-4cfe-a79f-9801c1cacf2d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:36.228648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-517b3ed5-2ec0-4cfe-a79f-9801c1cacf2d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:36.538278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-517b3ed5-2ec0-4cfe-a79f-9801c1cacf2d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:36.565557 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-517b3ed5-2ec0-4cfe-a79f-9801c1cacf2d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.358800 May 27 15:39:36.567358 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3139/6274] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:36 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:37.583413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-48c6c2c9-89e6-42b1-9bf1-a3fcfec69677 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:37.584597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-48c6c2c9-89e6-42b1-9bf1-a3fcfec69677 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:37.593350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48c6c2c9-89e6-42b1-9bf1-a3fcfec69677 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:37.594645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48c6c2c9-89e6-42b1-9bf1-a3fcfec69677 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:37.595834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48c6c2c9-89e6-42b1-9bf1-a3fcfec69677 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:37.596463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48c6c2c9-89e6-42b1-9bf1-a3fcfec69677 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:37.790981 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-48c6c2c9-89e6-42b1-9bf1-a3fcfec69677 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:37.811386 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-48c6c2c9-89e6-42b1-9bf1-a3fcfec69677 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.231854 May 27 15:39:37.815552 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3136/6275] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:37 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:38.833179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9da39043-0e7b-4e17-9d8f-61642ecae1e7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:38.833817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9da39043-0e7b-4e17-9d8f-61642ecae1e7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:38.851450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9da39043-0e7b-4e17-9d8f-61642ecae1e7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:38.852121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9da39043-0e7b-4e17-9d8f-61642ecae1e7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:38.853146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9da39043-0e7b-4e17-9d8f-61642ecae1e7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:38.853759 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9da39043-0e7b-4e17-9d8f-61642ecae1e7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:39.094276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9da39043-0e7b-4e17-9d8f-61642ecae1e7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:39.105351 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9da39043-0e7b-4e17-9d8f-61642ecae1e7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.276541 May 27 15:39:39.116586 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3140/6276] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:38 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:40.124074 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7d0c4f3d-6827-4967-9983-db68fee29085 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:40.124958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7d0c4f3d-6827-4967-9983-db68fee29085 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:40.139906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d0c4f3d-6827-4967-9983-db68fee29085 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:40.140485 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d0c4f3d-6827-4967-9983-db68fee29085 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:40.142672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d0c4f3d-6827-4967-9983-db68fee29085 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:40.145664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d0c4f3d-6827-4967-9983-db68fee29085 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:40.356330 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7d0c4f3d-6827-4967-9983-db68fee29085 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:40.376145 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7d0c4f3d-6827-4967-9983-db68fee29085 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.255462 May 27 15:39:40.377371 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3137/6277] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:40 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:39:41.397276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-56c99f27-6ae3-4daf-8ab5-11f8c0324fe4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:41.398047 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-56c99f27-6ae3-4daf-8ab5-11f8c0324fe4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:41.414693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56c99f27-6ae3-4daf-8ab5-11f8c0324fe4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:41.415791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56c99f27-6ae3-4daf-8ab5-11f8c0324fe4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:41.419312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56c99f27-6ae3-4daf-8ab5-11f8c0324fe4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:41.419906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56c99f27-6ae3-4daf-8ab5-11f8c0324fe4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:41.624043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-56c99f27-6ae3-4daf-8ab5-11f8c0324fe4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:41.634295 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-56c99f27-6ae3-4daf-8ab5-11f8c0324fe4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.243531 May 27 15:39:41.635384 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3141/6278] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:41 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:42.681367 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8307ae2a-4e39-4e1c-b5ed-7148e61d8874 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:42.682620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8307ae2a-4e39-4e1c-b5ed-7148e61d8874 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:42.691541 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8307ae2a-4e39-4e1c-b5ed-7148e61d8874 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:42.692291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8307ae2a-4e39-4e1c-b5ed-7148e61d8874 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:42.693314 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8307ae2a-4e39-4e1c-b5ed-7148e61d8874 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:42.694062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8307ae2a-4e39-4e1c-b5ed-7148e61d8874 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:42.924852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8307ae2a-4e39-4e1c-b5ed-7148e61d8874 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:42.934290 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8307ae2a-4e39-4e1c-b5ed-7148e61d8874 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.285876 May 27 15:39:42.935490 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3138/6279] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:42 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:43.955286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-27cf2fb5-a722-42ad-b737-8972a3265211 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:43.956732 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-27cf2fb5-a722-42ad-b737-8972a3265211 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:43.966531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-27cf2fb5-a722-42ad-b737-8972a3265211 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:43.967687 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-27cf2fb5-a722-42ad-b737-8972a3265211 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:43.970317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-27cf2fb5-a722-42ad-b737-8972a3265211 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:43.971257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-27cf2fb5-a722-42ad-b737-8972a3265211 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:44.173332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-27cf2fb5-a722-42ad-b737-8972a3265211 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:44.183722 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-27cf2fb5-a722-42ad-b737-8972a3265211 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.234749 May 27 15:39:44.194754 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3142/6280] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:43 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:45.203655 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-45ba0cfa-3f7c-44de-bcb5-7f664533eca1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:45.205556 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-45ba0cfa-3f7c-44de-bcb5-7f664533eca1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:45.214377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45ba0cfa-3f7c-44de-bcb5-7f664533eca1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:45.215339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45ba0cfa-3f7c-44de-bcb5-7f664533eca1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:45.216358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45ba0cfa-3f7c-44de-bcb5-7f664533eca1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:45.218271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-45ba0cfa-3f7c-44de-bcb5-7f664533eca1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:45.400341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-45ba0cfa-3f7c-44de-bcb5-7f664533eca1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:45.411502 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-45ba0cfa-3f7c-44de-bcb5-7f664533eca1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.212710 May 27 15:39:45.412713 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3139/6281] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:45 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:46.433114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b84c12cc-c888-4716-b74c-41bd255acf7a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:46.433868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b84c12cc-c888-4716-b74c-41bd255acf7a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:46.446661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b84c12cc-c888-4716-b74c-41bd255acf7a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:46.447494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b84c12cc-c888-4716-b74c-41bd255acf7a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:46.448709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b84c12cc-c888-4716-b74c-41bd255acf7a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:46.450100 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b84c12cc-c888-4716-b74c-41bd255acf7a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:46.635028 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b84c12cc-c888-4716-b74c-41bd255acf7a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:46.655875 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b84c12cc-c888-4716-b74c-41bd255acf7a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.230400 May 27 15:39:46.657137 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3143/6282] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:46 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:47.674155 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2b977db2-0652-4c77-bb7a-fdab61ec168a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:47.674794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2b977db2-0652-4c77-bb7a-fdab61ec168a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:47.685630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b977db2-0652-4c77-bb7a-fdab61ec168a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:47.686565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b977db2-0652-4c77-bb7a-fdab61ec168a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:47.689911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b977db2-0652-4c77-bb7a-fdab61ec168a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:47.690374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b977db2-0652-4c77-bb7a-fdab61ec168a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:47.907991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2b977db2-0652-4c77-bb7a-fdab61ec168a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:47.918754 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2b977db2-0652-4c77-bb7a-fdab61ec168a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1169 microversion: 2.1 time: 0.248609 May 27 15:39:47.929504 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3140/6283] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:47 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1169 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:48.936565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-678c31ce-660c-46e7-836e-ebea6c41f52e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:48.937829 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-678c31ce-660c-46e7-836e-ebea6c41f52e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:48.957102 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-678c31ce-660c-46e7-836e-ebea6c41f52e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:48.957848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-678c31ce-660c-46e7-836e-ebea6c41f52e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:48.960566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-678c31ce-660c-46e7-836e-ebea6c41f52e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:48.961349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-678c31ce-660c-46e7-836e-ebea6c41f52e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:49.167471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0b1c810f-5d00-4d4c-864a-dbfa2f520be4 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:49.169164 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0b1c810f-5d00-4d4c-864a-dbfa2f520be4 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:49.178221 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-678c31ce-660c-46e7-836e-ebea6c41f52e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:49.180756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0b1c810f-5d00-4d4c-864a-dbfa2f520be4 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:49.181435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0b1c810f-5d00-4d4c-864a-dbfa2f520be4 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:49.182406 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0b1c810f-5d00-4d4c-864a-dbfa2f520be4 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:49.183015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0b1c810f-5d00-4d4c-864a-dbfa2f520be4 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:49.188392 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-678c31ce-660c-46e7-836e-ebea6c41f52e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1203 microversion: 2.1 time: 0.256131 May 27 15:39:49.188928 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3144/6284] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:48 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1203 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:49.221629 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0b1c810f-5d00-4d4c-864a-dbfa2f520be4 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.059064 May 27 15:39:49.223099 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3141/6285] 10.222.0.13 () {58 vars in 1292 bytes} [Fri May 27 15:39:49 2022] GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b/os-server-password => generated 116 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:39:50.210397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e8cff792-242c-4276-8035-81c6ee0ae472 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:50.211979 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e8cff792-242c-4276-8035-81c6ee0ae472 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:50.223290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8cff792-242c-4276-8035-81c6ee0ae472 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:50.224022 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8cff792-242c-4276-8035-81c6ee0ae472 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:50.225295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8cff792-242c-4276-8035-81c6ee0ae472 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:50.226084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8cff792-242c-4276-8035-81c6ee0ae472 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:50.415432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e8cff792-242c-4276-8035-81c6ee0ae472 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:50.423452 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e8cff792-242c-4276-8035-81c6ee0ae472 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1203 microversion: 2.1 time: 0.221380 May 27 15:39:50.424448 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3145/6286] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:50 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1203 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:51.440657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2e3dba00-f387-4cba-848c-15f3bc9a4b5c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:51.441320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2e3dba00-f387-4cba-848c-15f3bc9a4b5c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:51.450755 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e3dba00-f387-4cba-848c-15f3bc9a4b5c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:51.451413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e3dba00-f387-4cba-848c-15f3bc9a4b5c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:51.452478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e3dba00-f387-4cba-848c-15f3bc9a4b5c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:51.453832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2e3dba00-f387-4cba-848c-15f3bc9a4b5c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:51.636510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2e3dba00-f387-4cba-848c-15f3bc9a4b5c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:51.645479 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2e3dba00-f387-4cba-848c-15f3bc9a4b5c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1203 microversion: 2.1 time: 0.209553 May 27 15:39:51.665197 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3142/6287] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:51 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1203 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:52.682714 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1a0c20a0-5054-4ba4-abf7-5cee59981201 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:52.683285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1a0c20a0-5054-4ba4-abf7-5cee59981201 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:52.690758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a0c20a0-5054-4ba4-abf7-5cee59981201 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:52.691245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a0c20a0-5054-4ba4-abf7-5cee59981201 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:52.692317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a0c20a0-5054-4ba4-abf7-5cee59981201 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:52.692790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a0c20a0-5054-4ba4-abf7-5cee59981201 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:52.828956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1a0c20a0-5054-4ba4-abf7-5cee59981201 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:52.841041 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1a0c20a0-5054-4ba4-abf7-5cee59981201 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1203 microversion: 2.1 time: 0.161335 May 27 15:39:52.841041 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3146/6288] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:52 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:39:53.857791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cd2de2a3-222a-44c4-83e2-94ed88ed87db tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:53.859001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cd2de2a3-222a-44c4-83e2-94ed88ed87db tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:53.868296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cd2de2a3-222a-44c4-83e2-94ed88ed87db tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:53.869386 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cd2de2a3-222a-44c4-83e2-94ed88ed87db tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:53.870391 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cd2de2a3-222a-44c4-83e2-94ed88ed87db tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:53.871151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cd2de2a3-222a-44c4-83e2-94ed88ed87db tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:54.058856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cd2de2a3-222a-44c4-83e2-94ed88ed87db tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:54.067336 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cd2de2a3-222a-44c4-83e2-94ed88ed87db tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1203 microversion: 2.1 time: 0.214336 May 27 15:39:54.068403 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3143/6289] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:53 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1203 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:55.085646 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-799427ff-a7ed-4ba1-86a7-4f8af60860ba tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:55.086353 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-799427ff-a7ed-4ba1-86a7-4f8af60860ba tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:55.095516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-799427ff-a7ed-4ba1-86a7-4f8af60860ba tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:55.096831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-799427ff-a7ed-4ba1-86a7-4f8af60860ba tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:55.098393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-799427ff-a7ed-4ba1-86a7-4f8af60860ba tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:55.099579 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-799427ff-a7ed-4ba1-86a7-4f8af60860ba tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:55.278035 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-799427ff-a7ed-4ba1-86a7-4f8af60860ba tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:55.292355 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-799427ff-a7ed-4ba1-86a7-4f8af60860ba tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1203 microversion: 2.1 time: 0.210849 May 27 15:39:55.292979 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3147/6290] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:55 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1203 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:56.311437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ef7a77f5-25eb-42be-b913-c94c28d41cba tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:56.312136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ef7a77f5-25eb-42be-b913-c94c28d41cba tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:56.323480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef7a77f5-25eb-42be-b913-c94c28d41cba tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:56.324694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef7a77f5-25eb-42be-b913-c94c28d41cba tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:56.325496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef7a77f5-25eb-42be-b913-c94c28d41cba tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:56.325948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ef7a77f5-25eb-42be-b913-c94c28d41cba tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:56.539434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ef7a77f5-25eb-42be-b913-c94c28d41cba tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:56.551807 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ef7a77f5-25eb-42be-b913-c94c28d41cba tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1203 microversion: 2.1 time: 0.245777 May 27 15:39:56.552595 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3144/6291] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:56 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1203 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:57.570872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9a42eb7e-0713-465b-8277-74eec1276dc3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:57.571705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9a42eb7e-0713-465b-8277-74eec1276dc3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:57.579566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a42eb7e-0713-465b-8277-74eec1276dc3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:57.580316 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a42eb7e-0713-465b-8277-74eec1276dc3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:57.581907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a42eb7e-0713-465b-8277-74eec1276dc3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:57.582624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a42eb7e-0713-465b-8277-74eec1276dc3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:57.781196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9a42eb7e-0713-465b-8277-74eec1276dc3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:57.796317 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9a42eb7e-0713-465b-8277-74eec1276dc3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1203 microversion: 2.1 time: 0.231308 May 27 15:39:57.799073 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3148/6292] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:57 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1203 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:58.815614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6926b208-f728-4f2b-88d0-0efab4a08acb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:39:58.816146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6926b208-f728-4f2b-88d0-0efab4a08acb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:39:58.823428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6926b208-f728-4f2b-88d0-0efab4a08acb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:58.824272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6926b208-f728-4f2b-88d0-0efab4a08acb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:58.825284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6926b208-f728-4f2b-88d0-0efab4a08acb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:58.825890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6926b208-f728-4f2b-88d0-0efab4a08acb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:58.999780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6926b208-f728-4f2b-88d0-0efab4a08acb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:39:59.009798 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6926b208-f728-4f2b-88d0-0efab4a08acb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1203 microversion: 2.1 time: 0.198761 May 27 15:39:59.011737 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3145/6293] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:39:58 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1203 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:39:59.813863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-56a9cff8-5113-4928-9e4a-4366d87b0a93 req-f99e29d2-9012-4d5a-be16-66f6ebe7e4bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f3208d3-183a-4bf5-a050-6d264305d4bf", "name": "network-vif-plugged", "status": "completed", "tag": "13060e47-d902-4710-933c-02e3a87d99c5"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:39:59.829735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=26 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:39:59.835742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-56a9cff8-5113-4928-9e4a-4366d87b0a93 req-f99e29d2-9012-4d5a-be16-66f6ebe7e4bb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:39:59.837229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-56a9cff8-5113-4928-9e4a-4366d87b0a93 req-f99e29d2-9012-4d5a-be16-66f6ebe7e4bb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:39:59.855529 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=78 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:39:59.868956 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-56a9cff8-5113-4928-9e4a-4366d87b0a93 req-f99e29d2-9012-4d5a-be16-66f6ebe7e4bb service nova] Creating event network-vif-plugged:13060e47-d902-4710-933c-02e3a87d99c5 for instance 8f3208d3-183a-4bf5-a050-6d264305d4bf on n-h2-843621-1 May 27 15:39:59.875521 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-56a9cff8-5113-4928-9e4a-4366d87b0a93 req-f99e29d2-9012-4d5a-be16-66f6ebe7e4bb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066624 May 27 15:39:59.877392 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3149/6294] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:40:00.027594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dc6c6813-7ec9-4c33-9fc2-49162ff80db1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:40:00.033874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dc6c6813-7ec9-4c33-9fc2-49162ff80db1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:40:00.037062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=26 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:40:00.044531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dc6c6813-7ec9-4c33-9fc2-49162ff80db1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:00.045180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dc6c6813-7ec9-4c33-9fc2-49162ff80db1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:00.046109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dc6c6813-7ec9-4c33-9fc2-49162ff80db1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:00.046975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-dc6c6813-7ec9-4c33-9fc2-49162ff80db1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:00.051247 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=76 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:40:00.280908 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dc6c6813-7ec9-4c33-9fc2-49162ff80db1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:40:00.290592 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dc6c6813-7ec9-4c33-9fc2-49162ff80db1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1203 microversion: 2.1 time: 0.266926 May 27 15:40:00.291696 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3146/6295] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:40:00 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1203 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:40:01.316222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e3cc1fd9-bb27-4021-8782-698971e7967c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:40:01.317875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e3cc1fd9-bb27-4021-8782-698971e7967c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:40:01.332526 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3cc1fd9-bb27-4021-8782-698971e7967c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:01.333309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3cc1fd9-bb27-4021-8782-698971e7967c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:01.334621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3cc1fd9-bb27-4021-8782-698971e7967c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:01.335519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e3cc1fd9-bb27-4021-8782-698971e7967c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:01.533243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e3cc1fd9-bb27-4021-8782-698971e7967c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:40:01.543052 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e3cc1fd9-bb27-4021-8782-698971e7967c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1390 microversion: 2.1 time: 0.233299 May 27 15:40:01.543645 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3150/6296] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:40:01 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1390 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:40:01.560368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-47b3a62a-fc75-42ad-9357-cb4c02906222 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:40:01.561316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-47b3a62a-fc75-42ad-9357-cb4c02906222 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:40:01.571682 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47b3a62a-fc75-42ad-9357-cb4c02906222 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:01.572160 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47b3a62a-fc75-42ad-9357-cb4c02906222 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:01.572999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47b3a62a-fc75-42ad-9357-cb4c02906222 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:01.573459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-47b3a62a-fc75-42ad-9357-cb4c02906222 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:01.787723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-47b3a62a-fc75-42ad-9357-cb4c02906222 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:40:01.796772 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-47b3a62a-fc75-42ad-9357-cb4c02906222 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1390 microversion: 2.1 time: 0.240578 May 27 15:40:01.797642 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3147/6297] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:40:01 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1390 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:40:01.814096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9d4111f2-87ef-402b-86ae-f59b660ab7d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:40:01.814726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9d4111f2-87ef-402b-86ae-f59b660ab7d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:40:01.830125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d4111f2-87ef-402b-86ae-f59b660ab7d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:01.831280 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d4111f2-87ef-402b-86ae-f59b660ab7d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:01.832164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d4111f2-87ef-402b-86ae-f59b660ab7d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:01.832710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d4111f2-87ef-402b-86ae-f59b660ab7d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:01.996987 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9d4111f2-87ef-402b-86ae-f59b660ab7d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:40:02.009037 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9d4111f2-87ef-402b-86ae-f59b660ab7d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1390 microversion: 2.1 time: 0.199273 May 27 15:40:02.010403 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3151/6298] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:40:01 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1390 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:40:02.100938 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-69d4820e-6f33-4ab6-b0e1-efd55f475c7b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:40:02.101464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-69d4820e-6f33-4ab6-b0e1-efd55f475c7b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:40:02.108419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-69d4820e-6f33-4ab6-b0e1-efd55f475c7b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:02.109092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-69d4820e-6f33-4ab6-b0e1-efd55f475c7b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:02.113744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-69d4820e-6f33-4ab6-b0e1-efd55f475c7b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:02.114451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-69d4820e-6f33-4ab6-b0e1-efd55f475c7b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:02.157628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-69d4820e-6f33-4ab6-b0e1-efd55f475c7b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:40:02.292940 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-69d4820e-6f33-4ab6-b0e1-efd55f475c7b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 204 len: 0 microversion: 2.1 time: 0.195935 May 27 15:40:02.294952 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3148/6299] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:40:02 2022] DELETE /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:40:02.305100 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7bb96c41-aeed-40af-99bc-e6bc069ccee1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:40:02.305741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7bb96c41-aeed-40af-99bc-e6bc069ccee1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:40:02.314180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7bb96c41-aeed-40af-99bc-e6bc069ccee1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:02.314642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7bb96c41-aeed-40af-99bc-e6bc069ccee1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:02.315774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7bb96c41-aeed-40af-99bc-e6bc069ccee1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:02.316618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7bb96c41-aeed-40af-99bc-e6bc069ccee1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:02.540490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7bb96c41-aeed-40af-99bc-e6bc069ccee1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:40:02.594252 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7bb96c41-aeed-40af-99bc-e6bc069ccee1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1396 microversion: 2.1 time: 0.292458 May 27 15:40:02.596144 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3152/6300] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:40:02 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1396 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:40:03.639198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-87baf4d7-1577-41d5-b539-55fd57faab07 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:40:03.639198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-87baf4d7-1577-41d5-b539-55fd57faab07 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:40:03.646034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87baf4d7-1577-41d5-b539-55fd57faab07 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:03.646538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87baf4d7-1577-41d5-b539-55fd57faab07 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:03.647341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87baf4d7-1577-41d5-b539-55fd57faab07 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:03.647793 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-87baf4d7-1577-41d5-b539-55fd57faab07 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:03.945599 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-87baf4d7-1577-41d5-b539-55fd57faab07 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:40:03.959455 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-87baf4d7-1577-41d5-b539-55fd57faab07 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1396 microversion: 2.1 time: 0.347012 May 27 15:40:03.960750 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3149/6301] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:40:03 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1396 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:40:04.464763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-6102ad0d-d271-4918-98d4-eab8a5350824 req-7ddd6ac7-df52-4609-afa8-2c80af09b561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f3208d3-183a-4bf5-a050-6d264305d4bf", "name": "network-vif-deleted", "tag": "13060e47-d902-4710-933c-02e3a87d99c5"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:40:04.480758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6102ad0d-d271-4918-98d4-eab8a5350824 req-7ddd6ac7-df52-4609-afa8-2c80af09b561 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:04.481657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6102ad0d-d271-4918-98d4-eab8a5350824 req-7ddd6ac7-df52-4609-afa8-2c80af09b561 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:04.499877 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-6102ad0d-d271-4918-98d4-eab8a5350824 req-7ddd6ac7-df52-4609-afa8-2c80af09b561 service nova] Creating event network-vif-deleted:13060e47-d902-4710-933c-02e3a87d99c5 for instance 8f3208d3-183a-4bf5-a050-6d264305d4bf on n-h2-843621-1 May 27 15:40:04.508560 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-6102ad0d-d271-4918-98d4-eab8a5350824 req-7ddd6ac7-df52-4609-afa8-2c80af09b561 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048280 May 27 15:40:04.513958 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3153/6302] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:40:04.978642 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-234a0ba2-183e-4315-bfb6-98e730a55e8d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:40:04.979987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-234a0ba2-183e-4315-bfb6-98e730a55e8d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:40:04.991526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-234a0ba2-183e-4315-bfb6-98e730a55e8d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:04.992215 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-234a0ba2-183e-4315-bfb6-98e730a55e8d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:04.993209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-234a0ba2-183e-4315-bfb6-98e730a55e8d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:04.993665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-234a0ba2-183e-4315-bfb6-98e730a55e8d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:05.077052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-234a0ba2-183e-4315-bfb6-98e730a55e8d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:40:05.098579 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-234a0ba2-183e-4315-bfb6-98e730a55e8d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1188 microversion: 2.1 time: 0.123994 May 27 15:40:05.099176 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3150/6303] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:40:04 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1188 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:40:06.151390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3a8e5d76-9c9f-47dd-aa84-bc1544476f1c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:40:06.153158 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3a8e5d76-9c9f-47dd-aa84-bc1544476f1c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:40:06.173396 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a8e5d76-9c9f-47dd-aa84-bc1544476f1c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:06.174096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a8e5d76-9c9f-47dd-aa84-bc1544476f1c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:06.177681 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a8e5d76-9c9f-47dd-aa84-bc1544476f1c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:06.178623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3a8e5d76-9c9f-47dd-aa84-bc1544476f1c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:06.260842 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3a8e5d76-9c9f-47dd-aa84-bc1544476f1c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:40:06.271472 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3a8e5d76-9c9f-47dd-aa84-bc1544476f1c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1188 microversion: 2.1 time: 0.156413 May 27 15:40:06.278463 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3154/6304] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:40:06 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1188 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:40:07.289429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-26d5abf2-3411-4395-90a9-33d1f8896b36 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:40:07.290046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-26d5abf2-3411-4395-90a9-33d1f8896b36 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:40:07.306592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26d5abf2-3411-4395-90a9-33d1f8896b36 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:07.307306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26d5abf2-3411-4395-90a9-33d1f8896b36 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:07.308777 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26d5abf2-3411-4395-90a9-33d1f8896b36 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:07.309235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-26d5abf2-3411-4395-90a9-33d1f8896b36 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:07.431004 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-26d5abf2-3411-4395-90a9-33d1f8896b36 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:40:07.441236 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-26d5abf2-3411-4395-90a9-33d1f8896b36 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1188 microversion: 2.1 time: 0.157095 May 27 15:40:07.450562 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3151/6305] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:40:07 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1188 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:40:08.460106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-eed257ca-b67e-4456-afff-04f0c2f39983 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:40:08.461385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-eed257ca-b67e-4456-afff-04f0c2f39983 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:40:08.473984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eed257ca-b67e-4456-afff-04f0c2f39983 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:08.474438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eed257ca-b67e-4456-afff-04f0c2f39983 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:08.475238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eed257ca-b67e-4456-afff-04f0c2f39983 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:08.475691 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eed257ca-b67e-4456-afff-04f0c2f39983 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:08.577611 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-eed257ca-b67e-4456-afff-04f0c2f39983 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:40:08.599065 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-eed257ca-b67e-4456-afff-04f0c2f39983 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1188 microversion: 2.1 time: 0.142716 May 27 15:40:08.600341 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3155/6306] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:40:08 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1188 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:40:09.619544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-23dcbaa2-0fe2-48fb-b33e-4ef339aee71c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:40:09.621262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-23dcbaa2-0fe2-48fb-b33e-4ef339aee71c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:40:09.636250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23dcbaa2-0fe2-48fb-b33e-4ef339aee71c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:09.637066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23dcbaa2-0fe2-48fb-b33e-4ef339aee71c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:09.638153 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23dcbaa2-0fe2-48fb-b33e-4ef339aee71c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:09.638910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23dcbaa2-0fe2-48fb-b33e-4ef339aee71c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:09.712026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-23dcbaa2-0fe2-48fb-b33e-4ef339aee71c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:40:09.721430 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-23dcbaa2-0fe2-48fb-b33e-4ef339aee71c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1188 microversion: 2.1 time: 0.106161 May 27 15:40:09.722625 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3152/6307] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:40:09 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1188 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:40:10.739506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b9672e87-9674-4169-8aec-62e7c78ac5fb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:40:10.741124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b9672e87-9674-4169-8aec-62e7c78ac5fb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:40:10.750820 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9672e87-9674-4169-8aec-62e7c78ac5fb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:10.751835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9672e87-9674-4169-8aec-62e7c78ac5fb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:10.752862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9672e87-9674-4169-8aec-62e7c78ac5fb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:10.753511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9672e87-9674-4169-8aec-62e7c78ac5fb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:10.850415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b9672e87-9674-4169-8aec-62e7c78ac5fb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:40:10.861115 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b9672e87-9674-4169-8aec-62e7c78ac5fb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1188 microversion: 2.1 time: 0.123957 May 27 15:40:10.862037 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3156/6308] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:40:10 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1188 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:40:11.878614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b5e1eb30-c137-4087-9124-ba7889427791 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:40:11.879383 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b5e1eb30-c137-4087-9124-ba7889427791 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:40:11.887924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5e1eb30-c137-4087-9124-ba7889427791 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:11.887924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5e1eb30-c137-4087-9124-ba7889427791 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:11.889150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5e1eb30-c137-4087-9124-ba7889427791 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:11.889748 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b5e1eb30-c137-4087-9124-ba7889427791 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:11.959811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b5e1eb30-c137-4087-9124-ba7889427791 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:40:11.968123 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b5e1eb30-c137-4087-9124-ba7889427791 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1188 microversion: 2.1 time: 0.093958 May 27 15:40:11.968718 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3153/6309] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:40:11 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:40:12.986004 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-49ea11c6-afaa-4fbd-b354-587a98be40ea tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:40:12.986812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-49ea11c6-afaa-4fbd-b354-587a98be40ea tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:40:12.994258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-49ea11c6-afaa-4fbd-b354-587a98be40ea tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:12.994712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-49ea11c6-afaa-4fbd-b354-587a98be40ea tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:12.995471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-49ea11c6-afaa-4fbd-b354-587a98be40ea tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:12.995913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-49ea11c6-afaa-4fbd-b354-587a98be40ea tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:13.058680 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-49ea11c6-afaa-4fbd-b354-587a98be40ea tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:40:13.069929 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-49ea11c6-afaa-4fbd-b354-587a98be40ea tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1188 microversion: 2.1 time: 0.087221 May 27 15:40:13.070936 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3157/6310] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:40:12 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1188 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:40:14.088860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d2d9ab5c-cba1-45e1-a6bb-b0e14933638d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:40:14.089399 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d2d9ab5c-cba1-45e1-a6bb-b0e14933638d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:40:14.098570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2d9ab5c-cba1-45e1-a6bb-b0e14933638d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:14.098570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2d9ab5c-cba1-45e1-a6bb-b0e14933638d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:14.099121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2d9ab5c-cba1-45e1-a6bb-b0e14933638d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:14.099727 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d2d9ab5c-cba1-45e1-a6bb-b0e14933638d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:14.199606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d2d9ab5c-cba1-45e1-a6bb-b0e14933638d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:40:14.211010 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d2d9ab5c-cba1-45e1-a6bb-b0e14933638d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 200 len: 1188 microversion: 2.1 time: 0.126615 May 27 15:40:14.212307 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3154/6311] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:40:14 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 1188 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:40:15.238385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4619c4c2-cad5-4180-8033-a05d1d208d09 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:40:15.241145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4619c4c2-cad5-4180-8033-a05d1d208d09 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:40:15.258493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4619c4c2-cad5-4180-8033-a05d1d208d09 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:15.263302 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4619c4c2-cad5-4180-8033-a05d1d208d09 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:15.264616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4619c4c2-cad5-4180-8033-a05d1d208d09 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:15.267276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4619c4c2-cad5-4180-8033-a05d1d208d09 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:15.307009 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-4619c4c2-cad5-4180-8033-a05d1d208d09 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] HTTP exception thrown: Instance 8f3208d3-183a-4bf5-a050-6d264305d4bf could not be found. May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4619c4c2-cad5-4180-8033-a05d1d208d09 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Request method failure captured: May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf HTTP/1.1 May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikO_1Chjp-7OdQPlgoy0i68J74Yy9denIkk1niNkSk2uFWUy4CftwGV6LxM4FCEGakqUTp0mkulJ5awBDUhVVOjGCfP23UpxiQizq-3BPePUyAFyMxEgrT5T05iojcJbMyfNSyzYbX68HBU5apXXyE_-yRBe0ARJTHso9aoG2B7TFtpc May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_536a3b9dd9a745c089e2da27b9f536ff", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TestVolumeBootPattern-685942222 May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TestVolumeBootPattern-685942222-project May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: a058052ef3fd4ee58291ccc9837558cc May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TestVolumeBootPattern-685942222-project May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 8f3208d3-183a-4bf5-a050-6d264305d4bf could not be found. May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '8f3208d3-183a-4bf5-a050-6d264305d4bf'} May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f3208d3-183a-4bf5-a050-6d264305d4bf could not be found. May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f3208d3-183a-4bf5-a050-6d264305d4bf could not be found. May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:40:15.309768 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:40:15.315880 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:40:15.315880 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:40:15.315880 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:40:15.315880 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:40:15.315880 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:40:15.315880 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f3208d3-183a-4bf5-a050-6d264305d4bf could not be found. May 27 15:40:15.315880 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:40:15.315880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4619c4c2-cad5-4180-8033-a05d1d208d09 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Returning 404 to user: Instance 8f3208d3-183a-4bf5-a050-6d264305d4bf could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:40:15.315880 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4619c4c2-cad5-4180-8033-a05d1d208d09 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 404 len: 111 microversion: 2.1 time: 0.084100 May 27 15:40:15.315880 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3158/6312] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:40:15 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:40:23.844831 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2932c347-fd7a-4754-8c97-1033a2bf6871 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:40:23.845923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2932c347-fd7a-4754-8c97-1033a2bf6871 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:40:23.853806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2932c347-fd7a-4754-8c97-1033a2bf6871 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:23.854559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2932c347-fd7a-4754-8c97-1033a2bf6871 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:23.855545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2932c347-fd7a-4754-8c97-1033a2bf6871 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:23.856245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2932c347-fd7a-4754-8c97-1033a2bf6871 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:23.874154 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-2932c347-fd7a-4754-8c97-1033a2bf6871 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] HTTP exception thrown: Instance 8f3208d3-183a-4bf5-a050-6d264305d4bf could not be found. May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2932c347-fd7a-4754-8c97-1033a2bf6871 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Request method failure captured: May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf HTTP/1.1 May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikO_1Chjp-7OdQPlgoy0i68J74Yy9denIkk1niNkSk2uFWUy4CftwGV6LxM4FCEGakqUTp0mkulJ5awBDUhVVOjGCfP23UpxiQizq-3BPePUyAFyMxEgrT5T05iojcJbMyfNSyzYbX68HBU5apXXyE_-yRBe0ARJTHso9aoG2B7TFtpc May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_536a3b9dd9a745c089e2da27b9f536ff", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-TestVolumeBootPattern-685942222 May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-TestVolumeBootPattern-685942222-project May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: a058052ef3fd4ee58291ccc9837558cc May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-TestVolumeBootPattern-685942222-project May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 8f3208d3-183a-4bf5-a050-6d264305d4bf could not be found. May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '8f3208d3-183a-4bf5-a050-6d264305d4bf'} May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f3208d3-183a-4bf5-a050-6d264305d4bf could not be found. May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:40:23.876869 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:40:23.880543 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f3208d3-183a-4bf5-a050-6d264305d4bf could not be found. May 27 15:40:23.880543 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:40:23.880543 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:40:23.880543 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:40:23.880543 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:40:23.880543 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:40:23.880543 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:40:23.880543 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:40:23.880543 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:40:23.880543 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f3208d3-183a-4bf5-a050-6d264305d4bf could not be found. May 27 15:40:23.880543 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:40:23.883933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2932c347-fd7a-4754-8c97-1033a2bf6871 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Returning 404 to user: Instance 8f3208d3-183a-4bf5-a050-6d264305d4bf could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:40:23.885031 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2932c347-fd7a-4754-8c97-1033a2bf6871 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 404 len: 111 microversion: 2.1 time: 0.044178 May 27 15:40:23.886199 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3155/6313] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:40:23 2022] DELETE /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:40:23.895250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2470ede1-8f7b-4904-abdf-cbbb468ac648 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:40:23.896476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2470ede1-8f7b-4904-abdf-cbbb468ac648 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 8f3208d3-183a-4bf5-a050-6d264305d4bf] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:40:23.904959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2470ede1-8f7b-4904-abdf-cbbb468ac648 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:23.905692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2470ede1-8f7b-4904-abdf-cbbb468ac648 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:23.906694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2470ede1-8f7b-4904-abdf-cbbb468ac648 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:40:23.907441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2470ede1-8f7b-4904-abdf-cbbb468ac648 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:40:23.925112 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-2470ede1-8f7b-4904-abdf-cbbb468ac648 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] HTTP exception thrown: Instance 8f3208d3-183a-4bf5-a050-6d264305d4bf could not be found. May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2470ede1-8f7b-4904-abdf-cbbb468ac648 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Request method failure captured: May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf HTTP/1.1 May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikO_1Chjp-7OdQPlgoy0i68J74Yy9denIkk1niNkSk2uFWUy4CftwGV6LxM4FCEGakqUTp0mkulJ5awBDUhVVOjGCfP23UpxiQizq-3BPePUyAFyMxEgrT5T05iojcJbMyfNSyzYbX68HBU5apXXyE_-yRBe0ARJTHso9aoG2B7TFtpc May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_536a3b9dd9a745c089e2da27b9f536ff", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TestVolumeBootPattern-685942222 May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TestVolumeBootPattern-685942222-project May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: a058052ef3fd4ee58291ccc9837558cc May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TestVolumeBootPattern-685942222-project May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 8f3208d3-183a-4bf5-a050-6d264305d4bf could not be found. May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '8f3208d3-183a-4bf5-a050-6d264305d4bf'} May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f3208d3-183a-4bf5-a050-6d264305d4bf could not be found. May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f3208d3-183a-4bf5-a050-6d264305d4bf could not be found. May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:40:23.927846 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:40:23.931282 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:40:23.931282 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:40:23.931282 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:40:23.931282 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:40:23.931282 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:40:23.931282 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f3208d3-183a-4bf5-a050-6d264305d4bf could not be found. May 27 15:40:23.931282 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:40:23.932949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2470ede1-8f7b-4904-abdf-cbbb468ac648 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Returning 404 to user: Instance 8f3208d3-183a-4bf5-a050-6d264305d4bf could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:40:23.934631 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2470ede1-8f7b-4904-abdf-cbbb468ac648 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf" status: 404 len: 111 microversion: 2.1 time: 0.044615 May 27 15:40:23.935847 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3159/6314] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:40:23 2022] GET /compute/v2.1/servers/8f3208d3-183a-4bf5-a050-6d264305d4bf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:40:38.203863 n-d-843621-1 devstack@n-api.service[119248]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:40:38.204426 n-d-843621-1 devstack@n-api.service[119248]: Fri May 27 15:40:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:41:01.852398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0b5e5c27-dca4-4b3e-bdc8-3bbcfdf58369 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-770920810", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "03780378-68ad-421a-8ee0-604588a72f0d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "8b1a4599-fc38-4529-b66a-d319c59ff383"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:41:01.861751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:41:01.863123 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:41:01.930305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-0b5e5c27-dca4-4b3e-bdc8-3bbcfdf58369 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] validate_networks() for [('8b1a4599-fc38-4529-b66a-d319c59ff383', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:41:02.646955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-0b5e5c27-dca4-4b3e-bdc8-3bbcfdf58369 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:41:02.647750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-0b5e5c27-dca4-4b3e-bdc8-3bbcfdf58369 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:41:02.648660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-0b5e5c27-dca4-4b3e-bdc8-3bbcfdf58369 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:41:02.649261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-0b5e5c27-dca4-4b3e-bdc8-3bbcfdf58369 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:41:02.649700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-0b5e5c27-dca4-4b3e-bdc8-3bbcfdf58369 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:41:02.663790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0b5e5c27-dca4-4b3e-bdc8-3bbcfdf58369 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:02.664252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0b5e5c27-dca4-4b3e-bdc8-3bbcfdf58369 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:02.665353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0b5e5c27-dca4-4b3e-bdc8-3bbcfdf58369 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:02.665978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0b5e5c27-dca4-4b3e-bdc8-3bbcfdf58369 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:02.686497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-0b5e5c27-dca4-4b3e-bdc8-3bbcfdf58369 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Getting quotas for project 536a3b9dd9a745c089e2da27b9f536ff. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:41:02.695190 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-0b5e5c27-dca4-4b3e-bdc8-3bbcfdf58369 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Getting quotas for user a058052ef3fd4ee58291ccc9837558cc and project 536a3b9dd9a745c089e2da27b9f536ff. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:41:02.777903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0b5e5c27-dca4-4b3e-bdc8-3bbcfdf58369 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:41:02.782837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0b5e5c27-dca4-4b3e-bdc8-3bbcfdf58369 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='03780378-68ad-421a-8ee0-604588a72f0d',volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:41:02.967575 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0b5e5c27-dca4-4b3e-bdc8-3bbcfdf58369 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.119190 May 27 15:41:02.970116 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3156/6315] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:41:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:41:02.980719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0071931b-be2f-4cf2-b59a-f03b6d7b1115 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:02.981995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0071931b-be2f-4cf2-b59a-f03b6d7b1115 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:02.998826 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=21 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:41:03.000313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=49 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:41:03.073148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0071931b-be2f-4cf2-b59a-f03b6d7b1115 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:03.081297 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0071931b-be2f-4cf2-b59a-f03b6d7b1115 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1070 microversion: 2.1 time: 0.105149 May 27 15:41:03.081875 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3160/6316] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:02 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1070 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:04.100365 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-10d2d3e3-7303-486d-9ac6-71e20f711e1c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:04.102258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-10d2d3e3-7303-486d-9ac6-71e20f711e1c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:04.114520 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10d2d3e3-7303-486d-9ac6-71e20f711e1c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:04.116625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10d2d3e3-7303-486d-9ac6-71e20f711e1c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:04.117985 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10d2d3e3-7303-486d-9ac6-71e20f711e1c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:04.118782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-10d2d3e3-7303-486d-9ac6-71e20f711e1c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:04.219273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-10d2d3e3-7303-486d-9ac6-71e20f711e1c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:04.228754 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-10d2d3e3-7303-486d-9ac6-71e20f711e1c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1168 microversion: 2.1 time: 0.133314 May 27 15:41:04.245538 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3157/6317] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:04 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1168 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:05.255789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-070ad54d-3575-4dc3-bdc9-9a1722369876 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:05.257855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-070ad54d-3575-4dc3-bdc9-9a1722369876 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:05.282287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-070ad54d-3575-4dc3-bdc9-9a1722369876 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:05.284916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-070ad54d-3575-4dc3-bdc9-9a1722369876 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:05.290869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-070ad54d-3575-4dc3-bdc9-9a1722369876 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:05.294168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-070ad54d-3575-4dc3-bdc9-9a1722369876 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:05.517131 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-070ad54d-3575-4dc3-bdc9-9a1722369876 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:05.527679 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-070ad54d-3575-4dc3-bdc9-9a1722369876 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1186 microversion: 2.1 time: 0.282770 May 27 15:41:05.528258 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3161/6318] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:05 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1186 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:06.574754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9ac25a87-f8c6-42b5-add7-563c2bb109aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:06.575484 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9ac25a87-f8c6-42b5-add7-563c2bb109aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:06.587369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ac25a87-f8c6-42b5-add7-563c2bb109aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:06.599836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ac25a87-f8c6-42b5-add7-563c2bb109aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:06.601188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ac25a87-f8c6-42b5-add7-563c2bb109aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:06.602029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9ac25a87-f8c6-42b5-add7-563c2bb109aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:07.208438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9ac25a87-f8c6-42b5-add7-563c2bb109aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:07.217045 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9ac25a87-f8c6-42b5-add7-563c2bb109aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1228 microversion: 2.1 time: 0.646231 May 27 15:41:07.221307 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3158/6319] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:06 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1228 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:07.928634 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-2daf9c7b-d06f-4210-a6cd-5180f62920ad req-1150dd7f-9815-4791-bc07-c7fa141ed8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6af796d-7206-4727-a59b-126015546cfa", "tag": "4b95e0c6-d5a4-4811-9824-212fb5ed2125"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:41:07.966005 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2daf9c7b-d06f-4210-a6cd-5180f62920ad req-1150dd7f-9815-4791-bc07-c7fa141ed8b9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:07.966473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2daf9c7b-d06f-4210-a6cd-5180f62920ad req-1150dd7f-9815-4791-bc07-c7fa141ed8b9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:08.003275 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-2daf9c7b-d06f-4210-a6cd-5180f62920ad req-1150dd7f-9815-4791-bc07-c7fa141ed8b9 service nova] Creating event network-changed:4b95e0c6-d5a4-4811-9824-212fb5ed2125 for instance e6af796d-7206-4727-a59b-126015546cfa on n-h2-843621-1 May 27 15:41:08.011342 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-2daf9c7b-d06f-4210-a6cd-5180f62920ad req-1150dd7f-9815-4791-bc07-c7fa141ed8b9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093514 May 27 15:41:08.018689 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3162/6320] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:41:08.238057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4ffa343c-7cf0-4312-92e9-1fdd69abe026 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:08.238694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4ffa343c-7cf0-4312-92e9-1fdd69abe026 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:08.261673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ffa343c-7cf0-4312-92e9-1fdd69abe026 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:08.273320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ffa343c-7cf0-4312-92e9-1fdd69abe026 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:08.274381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ffa343c-7cf0-4312-92e9-1fdd69abe026 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:08.274938 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ffa343c-7cf0-4312-92e9-1fdd69abe026 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:08.680997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4ffa343c-7cf0-4312-92e9-1fdd69abe026 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:08.692309 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4ffa343c-7cf0-4312-92e9-1fdd69abe026 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1228 microversion: 2.1 time: 0.458268 May 27 15:41:08.697078 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3159/6321] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:08 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1228 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:09.714818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7aa74e59-ff5f-490e-a679-e8390ed6fc48 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:09.716223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7aa74e59-ff5f-490e-a679-e8390ed6fc48 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:09.725661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7aa74e59-ff5f-490e-a679-e8390ed6fc48 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:09.726427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7aa74e59-ff5f-490e-a679-e8390ed6fc48 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:09.728045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7aa74e59-ff5f-490e-a679-e8390ed6fc48 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:09.728689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7aa74e59-ff5f-490e-a679-e8390ed6fc48 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:09.923293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7aa74e59-ff5f-490e-a679-e8390ed6fc48 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:09.932186 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7aa74e59-ff5f-490e-a679-e8390ed6fc48 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1228 microversion: 2.1 time: 0.225531 May 27 15:41:09.941523 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3163/6322] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:09 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1228 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:10.951785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4e0364d2-a362-4ead-9d9a-aae97f38bbc9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:10.952462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4e0364d2-a362-4ead-9d9a-aae97f38bbc9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:10.994314 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e0364d2-a362-4ead-9d9a-aae97f38bbc9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:10.996944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e0364d2-a362-4ead-9d9a-aae97f38bbc9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:10.998416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e0364d2-a362-4ead-9d9a-aae97f38bbc9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:10.999223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4e0364d2-a362-4ead-9d9a-aae97f38bbc9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:11.268098 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4e0364d2-a362-4ead-9d9a-aae97f38bbc9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:11.277135 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4e0364d2-a362-4ead-9d9a-aae97f38bbc9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1228 microversion: 2.1 time: 0.332419 May 27 15:41:11.279635 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3160/6323] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:10 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1228 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:12.301052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-189c207a-7fa7-4340-8166-20c8c7abc9a4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:12.302203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-189c207a-7fa7-4340-8166-20c8c7abc9a4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:12.331565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-189c207a-7fa7-4340-8166-20c8c7abc9a4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:12.332045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-189c207a-7fa7-4340-8166-20c8c7abc9a4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:12.338373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-189c207a-7fa7-4340-8166-20c8c7abc9a4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:12.338941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-189c207a-7fa7-4340-8166-20c8c7abc9a4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:12.563029 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-189c207a-7fa7-4340-8166-20c8c7abc9a4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:12.572009 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-189c207a-7fa7-4340-8166-20c8c7abc9a4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1228 microversion: 2.1 time: 0.278048 May 27 15:41:12.581119 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3164/6324] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:12 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1228 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:13.588848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c8c4d22e-b8f2-4402-a510-b98e381df01a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:13.590078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c8c4d22e-b8f2-4402-a510-b98e381df01a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:13.598647 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:41:13.605082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:41:13.607439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8c4d22e-b8f2-4402-a510-b98e381df01a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:13.608356 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8c4d22e-b8f2-4402-a510-b98e381df01a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:13.609977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8c4d22e-b8f2-4402-a510-b98e381df01a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:13.612120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8c4d22e-b8f2-4402-a510-b98e381df01a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:13.880063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c8c4d22e-b8f2-4402-a510-b98e381df01a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:13.893404 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c8c4d22e-b8f2-4402-a510-b98e381df01a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1228 microversion: 2.1 time: 0.304126 May 27 15:41:13.894051 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3161/6325] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:13 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1228 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:14.910196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7768c018-da4b-4757-8927-0bfff40009b0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:14.910825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7768c018-da4b-4757-8927-0bfff40009b0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:14.929953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:41:14.933303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7768c018-da4b-4757-8927-0bfff40009b0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:14.933766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7768c018-da4b-4757-8927-0bfff40009b0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:14.934563 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7768c018-da4b-4757-8927-0bfff40009b0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:14.935010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7768c018-da4b-4757-8927-0bfff40009b0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:15.167686 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7768c018-da4b-4757-8927-0bfff40009b0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:15.177116 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7768c018-da4b-4757-8927-0bfff40009b0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1228 microversion: 2.1 time: 0.270719 May 27 15:41:15.187720 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3165/6326] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:14 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1228 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:16.197179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-36deebcb-6502-4a77-aefc-d9e832834093 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:16.199512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-36deebcb-6502-4a77-aefc-d9e832834093 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:16.204918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-36deebcb-6502-4a77-aefc-d9e832834093 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:16.205565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-36deebcb-6502-4a77-aefc-d9e832834093 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:16.206504 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-36deebcb-6502-4a77-aefc-d9e832834093 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:16.207103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-36deebcb-6502-4a77-aefc-d9e832834093 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:16.380218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-36deebcb-6502-4a77-aefc-d9e832834093 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:16.388366 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-36deebcb-6502-4a77-aefc-d9e832834093 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1228 microversion: 2.1 time: 0.197309 May 27 15:41:16.389601 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3162/6327] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:16 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1228 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:17.407893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b91375bd-feac-4bac-b364-37a94e68cba3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:17.408627 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b91375bd-feac-4bac-b364-37a94e68cba3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:17.418431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b91375bd-feac-4bac-b364-37a94e68cba3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:17.419023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b91375bd-feac-4bac-b364-37a94e68cba3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:17.420174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b91375bd-feac-4bac-b364-37a94e68cba3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:17.420768 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b91375bd-feac-4bac-b364-37a94e68cba3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:17.576642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b91375bd-feac-4bac-b364-37a94e68cba3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:17.585491 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b91375bd-feac-4bac-b364-37a94e68cba3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1228 microversion: 2.1 time: 0.182392 May 27 15:41:17.585919 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3166/6328] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:17 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1228 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:18.603403 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-38eb8954-073f-4793-8c75-6dc32e9052c4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:18.605156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-38eb8954-073f-4793-8c75-6dc32e9052c4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:18.615377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-38eb8954-073f-4793-8c75-6dc32e9052c4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:18.616174 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-38eb8954-073f-4793-8c75-6dc32e9052c4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:18.617347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-38eb8954-073f-4793-8c75-6dc32e9052c4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:18.618235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-38eb8954-073f-4793-8c75-6dc32e9052c4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:18.790850 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-38eb8954-073f-4793-8c75-6dc32e9052c4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:18.800772 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-38eb8954-073f-4793-8c75-6dc32e9052c4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1228 microversion: 2.1 time: 0.202267 May 27 15:41:18.801844 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3163/6329] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:18 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1228 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:19.820098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3264dc14-d708-4524-91f9-0d1c38824bd7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:19.821741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3264dc14-d708-4524-91f9-0d1c38824bd7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:19.830108 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3264dc14-d708-4524-91f9-0d1c38824bd7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:19.830848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3264dc14-d708-4524-91f9-0d1c38824bd7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:19.833140 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3264dc14-d708-4524-91f9-0d1c38824bd7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:19.833826 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3264dc14-d708-4524-91f9-0d1c38824bd7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:19.988959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3264dc14-d708-4524-91f9-0d1c38824bd7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:19.997270 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3264dc14-d708-4524-91f9-0d1c38824bd7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1228 microversion: 2.1 time: 0.182587 May 27 15:41:19.998404 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3167/6330] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:19 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1228 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:21.014949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-40c2c267-761e-40e6-bd0e-af330395b09f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:21.015492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-40c2c267-761e-40e6-bd0e-af330395b09f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:21.023576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-40c2c267-761e-40e6-bd0e-af330395b09f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:21.024040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-40c2c267-761e-40e6-bd0e-af330395b09f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:21.024944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-40c2c267-761e-40e6-bd0e-af330395b09f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:21.025375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-40c2c267-761e-40e6-bd0e-af330395b09f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:21.178663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-40c2c267-761e-40e6-bd0e-af330395b09f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:21.188332 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-40c2c267-761e-40e6-bd0e-af330395b09f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1228 microversion: 2.1 time: 0.177237 May 27 15:41:21.189261 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3164/6331] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:21 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1228 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:22.207205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2c9bc9d7-952f-4eee-9c12-ddc593f91b24 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:22.208590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2c9bc9d7-952f-4eee-9c12-ddc593f91b24 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:22.216598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c9bc9d7-952f-4eee-9c12-ddc593f91b24 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:22.217454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c9bc9d7-952f-4eee-9c12-ddc593f91b24 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:22.218567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c9bc9d7-952f-4eee-9c12-ddc593f91b24 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:22.219235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2c9bc9d7-952f-4eee-9c12-ddc593f91b24 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:22.393908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2c9bc9d7-952f-4eee-9c12-ddc593f91b24 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:22.403305 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2c9bc9d7-952f-4eee-9c12-ddc593f91b24 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1228 microversion: 2.1 time: 0.200743 May 27 15:41:22.404798 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3168/6332] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:22 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1228 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:23.422890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c2f093e8-398b-4b73-bffe-9c6c640a39a7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:23.423500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c2f093e8-398b-4b73-bffe-9c6c640a39a7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:23.440538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2f093e8-398b-4b73-bffe-9c6c640a39a7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:23.442164 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2f093e8-398b-4b73-bffe-9c6c640a39a7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:23.443926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2f093e8-398b-4b73-bffe-9c6c640a39a7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:23.444851 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c2f093e8-398b-4b73-bffe-9c6c640a39a7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:23.745206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c2f093e8-398b-4b73-bffe-9c6c640a39a7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:23.754559 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c2f093e8-398b-4b73-bffe-9c6c640a39a7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1228 microversion: 2.1 time: 0.338381 May 27 15:41:23.765679 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3165/6333] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:23 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1228 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:24.773930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-98ce2ff4-3ceb-4988-85a2-17d68d64c6f3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:24.775531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-98ce2ff4-3ceb-4988-85a2-17d68d64c6f3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:24.787246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98ce2ff4-3ceb-4988-85a2-17d68d64c6f3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:24.788119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98ce2ff4-3ceb-4988-85a2-17d68d64c6f3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:24.789214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98ce2ff4-3ceb-4988-85a2-17d68d64c6f3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:24.789881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-98ce2ff4-3ceb-4988-85a2-17d68d64c6f3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:24.977341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-98ce2ff4-3ceb-4988-85a2-17d68d64c6f3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:24.986383 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-98ce2ff4-3ceb-4988-85a2-17d68d64c6f3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1216 microversion: 2.1 time: 0.218599 May 27 15:41:24.987627 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3169/6334] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:24 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1216 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:26.004874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-24cfe43c-8465-4366-938d-9c93fcb34862 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:26.005697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-24cfe43c-8465-4366-938d-9c93fcb34862 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:26.018193 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24cfe43c-8465-4366-938d-9c93fcb34862 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:26.018757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24cfe43c-8465-4366-938d-9c93fcb34862 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:26.019701 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24cfe43c-8465-4366-938d-9c93fcb34862 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:26.020242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-24cfe43c-8465-4366-938d-9c93fcb34862 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:26.196145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-24cfe43c-8465-4366-938d-9c93fcb34862 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:26.206706 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-24cfe43c-8465-4366-938d-9c93fcb34862 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1216 microversion: 2.1 time: 0.206331 May 27 15:41:26.210420 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3166/6335] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:25 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1216 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:27.224998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-30f44799-24a8-45c6-9b28-341afe0c6395 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:27.226927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-30f44799-24a8-45c6-9b28-341afe0c6395 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:27.236990 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30f44799-24a8-45c6-9b28-341afe0c6395 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:27.237414 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30f44799-24a8-45c6-9b28-341afe0c6395 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:27.238256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30f44799-24a8-45c6-9b28-341afe0c6395 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:27.238791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-30f44799-24a8-45c6-9b28-341afe0c6395 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:27.416716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-30f44799-24a8-45c6-9b28-341afe0c6395 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:27.426853 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-30f44799-24a8-45c6-9b28-341afe0c6395 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1216 microversion: 2.1 time: 0.206640 May 27 15:41:27.428045 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3170/6336] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:27 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1216 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:28.444606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f1ff291a-f0b6-436e-be39-7c1b33ca78d2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:28.445365 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f1ff291a-f0b6-436e-be39-7c1b33ca78d2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:28.453308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1ff291a-f0b6-436e-be39-7c1b33ca78d2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:28.454178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1ff291a-f0b6-436e-be39-7c1b33ca78d2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:28.455444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1ff291a-f0b6-436e-be39-7c1b33ca78d2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:28.456347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1ff291a-f0b6-436e-be39-7c1b33ca78d2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:28.651395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f1ff291a-f0b6-436e-be39-7c1b33ca78d2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:28.666119 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f1ff291a-f0b6-436e-be39-7c1b33ca78d2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1216 microversion: 2.1 time: 0.223745 May 27 15:41:28.667106 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3167/6337] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:28 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1216 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:29.694581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8baf6243-5544-413e-96a6-b4a0bbc30b6a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:29.697588 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8baf6243-5544-413e-96a6-b4a0bbc30b6a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:29.706320 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8baf6243-5544-413e-96a6-b4a0bbc30b6a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:29.706913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8baf6243-5544-413e-96a6-b4a0bbc30b6a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:29.708145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8baf6243-5544-413e-96a6-b4a0bbc30b6a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:29.708644 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8baf6243-5544-413e-96a6-b4a0bbc30b6a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:29.883531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8baf6243-5544-413e-96a6-b4a0bbc30b6a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:29.897534 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8baf6243-5544-413e-96a6-b4a0bbc30b6a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1216 microversion: 2.1 time: 0.207152 May 27 15:41:29.898146 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3171/6338] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:29 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1216 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:30.695473 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7511f8ac-cd94-4eb4-bd3e-71434f2d34ba tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Action: 'create', calling method: .version_select at 0x7fc7765d39d0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1227253600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0FokNwLgsqnOiV9vkxKmAJogFCOgFuc+O9qdn7RmqqN6Y0eIwKDycX0yo0/IwQO5Ol3Nvdf4MomUIvnvXrkx8R+WdQhM0poBL7hhFnv6m+H5jGedyruSMh3UdCG8FIzA=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:41:30.712337 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-7511f8ac-cd94-4eb4-bd3e-71434f2d34ba tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Getting quotas for project 1ea3e0f4205d4e068c4844728fe555bf. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:41:30.719879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-7511f8ac-cd94-4eb4-bd3e-71434f2d34ba tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Getting quotas for user 07cf46905eac42d8b2f775f8f23fe80c and project 1ea3e0f4205d4e068c4844728fe555bf. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:41:30.763993 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7511f8ac-cd94-4eb4-bd3e-71434f2d34ba tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.075270 May 27 15:41:30.765678 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3168/6339] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:41:30 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:41:30.919445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5f7cb3cd-b005-4662-b648-6429f8a459a0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:30.920064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5f7cb3cd-b005-4662-b648-6429f8a459a0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:30.929944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5f7cb3cd-b005-4662-b648-6429f8a459a0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:30.930410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5f7cb3cd-b005-4662-b648-6429f8a459a0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:30.931452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5f7cb3cd-b005-4662-b648-6429f8a459a0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:30.932077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5f7cb3cd-b005-4662-b648-6429f8a459a0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:31.134065 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5f7cb3cd-b005-4662-b648-6429f8a459a0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:31.150744 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5f7cb3cd-b005-4662-b648-6429f8a459a0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1216 microversion: 2.1 time: 0.237832 May 27 15:41:31.164421 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3172/6340] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:30 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1216 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:32.180068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-74a7a625-6ce5-442e-8540-eeb011f65f1d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:32.181222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-74a7a625-6ce5-442e-8540-eeb011f65f1d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:32.192860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:41:32.194509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74a7a625-6ce5-442e-8540-eeb011f65f1d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:32.197363 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74a7a625-6ce5-442e-8540-eeb011f65f1d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:32.198639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74a7a625-6ce5-442e-8540-eeb011f65f1d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:32.199429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-74a7a625-6ce5-442e-8540-eeb011f65f1d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:32.274630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=69 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:41:32.468455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-74a7a625-6ce5-442e-8540-eeb011f65f1d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:32.478963 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-74a7a625-6ce5-442e-8540-eeb011f65f1d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1216 microversion: 2.1 time: 0.312027 May 27 15:41:32.481367 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3169/6341] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:32 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1216 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:32.763695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ac70a693-a35f-4ccf-9107-0e13b1bbb9cb tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1911945403", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3d9ec8c9-10ac-4174-8441-adf654b4accd", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1227253600", "security_groups": [{"name": "tempest-secgroup-smoke-1836047850"}], "networks": [{"uuid": "da31f210-63dd-4bdf-99cc-bc9a2ab995d7"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:41:32.910998 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-ac70a693-a35f-4ccf-9107-0e13b1bbb9cb tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] validate_networks() for [('da31f210-63dd-4bdf-99cc-bc9a2ab995d7', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:41:33.119125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=31 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:41:33.380090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ac70a693-a35f-4ccf-9107-0e13b1bbb9cb tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:41:33.380536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ac70a693-a35f-4ccf-9107-0e13b1bbb9cb tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:41:33.381037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ac70a693-a35f-4ccf-9107-0e13b1bbb9cb tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:41:33.381451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ac70a693-a35f-4ccf-9107-0e13b1bbb9cb tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:41:33.381869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ac70a693-a35f-4ccf-9107-0e13b1bbb9cb tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:41:33.391787 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac70a693-a35f-4ccf-9107-0e13b1bbb9cb tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:33.392147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac70a693-a35f-4ccf-9107-0e13b1bbb9cb tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:33.393172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac70a693-a35f-4ccf-9107-0e13b1bbb9cb tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:33.393778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ac70a693-a35f-4ccf-9107-0e13b1bbb9cb tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:33.402858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=69 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:41:33.418135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-ac70a693-a35f-4ccf-9107-0e13b1bbb9cb tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Getting quotas for project 1ea3e0f4205d4e068c4844728fe555bf. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:41:33.424875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-ac70a693-a35f-4ccf-9107-0e13b1bbb9cb tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Getting quotas for user 07cf46905eac42d8b2f775f8f23fe80c and project 1ea3e0f4205d4e068c4844728fe555bf. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:41:33.508223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a3bfdf41-00f5-47d1-a906-a4ec5c2d3711 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:33.509554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a3bfdf41-00f5-47d1-a906-a4ec5c2d3711 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:33.513053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ac70a693-a35f-4ccf-9107-0e13b1bbb9cb tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:41:33.518645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a3bfdf41-00f5-47d1-a906-a4ec5c2d3711 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:33.519673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a3bfdf41-00f5-47d1-a906-a4ec5c2d3711 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:33.519823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ac70a693-a35f-4ccf-9107-0e13b1bbb9cb tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d9ec8c9-10ac-4174-8441-adf654b4accd',volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:41:33.520933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a3bfdf41-00f5-47d1-a906-a4ec5c2d3711 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:33.521626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a3bfdf41-00f5-47d1-a906-a4ec5c2d3711 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:33.731707 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a3bfdf41-00f5-47d1-a906-a4ec5c2d3711 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:33.742687 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a3bfdf41-00f5-47d1-a906-a4ec5c2d3711 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1216 microversion: 2.1 time: 0.238235 May 27 15:41:33.752796 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3170/6342] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:33 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1216 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:41:33.782512 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ac70a693-a35f-4ccf-9107-0e13b1bbb9cb tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.022916 May 27 15:41:33.783166 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3173/6343] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:41:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:41:33.793992 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a190d941-280d-4494-ac9a-1ed06ea2a479 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:33.794983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a190d941-280d-4494-ac9a-1ed06ea2a479 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:33.852585 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a190d941-280d-4494-ac9a-1ed06ea2a479 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:33.866505 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a190d941-280d-4494-ac9a-1ed06ea2a479 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1099 microversion: 2.1 time: 0.076493 May 27 15:41:33.867010 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3171/6344] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:33 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1099 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:34.407847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-321c3604-c3ab-4be1-9d11-21861f6bd77b req-78f24b9f-b7a3-4f74-8f67-65ba8d1cb859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6af796d-7206-4727-a59b-126015546cfa", "name": "network-vif-plugged", "status": "completed", "tag": "4b95e0c6-d5a4-4811-9824-212fb5ed2125"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:41:34.416748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-321c3604-c3ab-4be1-9d11-21861f6bd77b req-78f24b9f-b7a3-4f74-8f67-65ba8d1cb859 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:34.417256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-321c3604-c3ab-4be1-9d11-21861f6bd77b req-78f24b9f-b7a3-4f74-8f67-65ba8d1cb859 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:34.429601 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-321c3604-c3ab-4be1-9d11-21861f6bd77b req-78f24b9f-b7a3-4f74-8f67-65ba8d1cb859 service nova] Creating event network-vif-plugged:4b95e0c6-d5a4-4811-9824-212fb5ed2125 for instance e6af796d-7206-4727-a59b-126015546cfa on n-h2-843621-1 May 27 15:41:34.435104 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-321c3604-c3ab-4be1-9d11-21861f6bd77b req-78f24b9f-b7a3-4f74-8f67-65ba8d1cb859 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220558 May 27 15:41:34.435731 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3174/6345] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:41:34.772663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1f1709b2-050a-4362-8c03-f935460ffa67 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:34.775343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1f1709b2-050a-4362-8c03-f935460ffa67 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:34.787431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f1709b2-050a-4362-8c03-f935460ffa67 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:34.788366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f1709b2-050a-4362-8c03-f935460ffa67 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:34.789602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f1709b2-050a-4362-8c03-f935460ffa67 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:34.790253 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f1709b2-050a-4362-8c03-f935460ffa67 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:34.889327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-665e67d1-4e72-4496-b8a6-3126c3dc0c29 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:34.890738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-665e67d1-4e72-4496-b8a6-3126c3dc0c29 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:34.954645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-665e67d1-4e72-4496-b8a6-3126c3dc0c29 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:34.965801 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-665e67d1-4e72-4496-b8a6-3126c3dc0c29 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1099 microversion: 2.1 time: 0.084630 May 27 15:41:34.966794 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3175/6346] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:34 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1099 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:41:35.141519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1f1709b2-050a-4362-8c03-f935460ffa67 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:35.152097 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1f1709b2-050a-4362-8c03-f935460ffa67 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1216 microversion: 2.1 time: 0.394965 May 27 15:41:35.152991 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3172/6347] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:34 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1216 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:35.985341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6993a4e0-c2a3-49f9-bc4a-937db9393f10 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:35.985963 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6993a4e0-c2a3-49f9-bc4a-937db9393f10 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:35.993732 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6993a4e0-c2a3-49f9-bc4a-937db9393f10 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:35.994331 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6993a4e0-c2a3-49f9-bc4a-937db9393f10 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:35.995118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6993a4e0-c2a3-49f9-bc4a-937db9393f10 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:35.995560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6993a4e0-c2a3-49f9-bc4a-937db9393f10 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:36.064169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6993a4e0-c2a3-49f9-bc4a-937db9393f10 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:36.072269 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6993a4e0-c2a3-49f9-bc4a-937db9393f10 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1197 microversion: 2.1 time: 0.092759 May 27 15:41:36.072858 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3176/6348] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:35 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:36.169457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e3f4bec8-85ab-49b5-b97c-470a305565da tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:36.170075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e3f4bec8-85ab-49b5-b97c-470a305565da tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:36.185139 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3f4bec8-85ab-49b5-b97c-470a305565da tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:36.185600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3f4bec8-85ab-49b5-b97c-470a305565da tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:36.186980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3f4bec8-85ab-49b5-b97c-470a305565da tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:36.187671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e3f4bec8-85ab-49b5-b97c-470a305565da tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:36.333103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e3f4bec8-85ab-49b5-b97c-470a305565da tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:36.370771 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e3f4bec8-85ab-49b5-b97c-470a305565da tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1402 microversion: 2.1 time: 0.205082 May 27 15:41:36.374321 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3173/6349] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:36 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1402 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:36.397226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-203c5081-6f2e-4535-ac91-92b5cc306310 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:36.398046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-203c5081-6f2e-4535-ac91-92b5cc306310 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:36.417289 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-203c5081-6f2e-4535-ac91-92b5cc306310 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:36.417759 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-203c5081-6f2e-4535-ac91-92b5cc306310 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:36.419246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-203c5081-6f2e-4535-ac91-92b5cc306310 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:36.419700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-203c5081-6f2e-4535-ac91-92b5cc306310 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:36.653602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-203c5081-6f2e-4535-ac91-92b5cc306310 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:36.663733 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-203c5081-6f2e-4535-ac91-92b5cc306310 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1402 microversion: 2.1 time: 0.276470 May 27 15:41:36.664709 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3177/6350] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:36 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1402 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:36.682646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c4ac54e5-f183-4501-8bd1-4f6577b5816c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-542516154"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:41:36.684776 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c4ac54e5-f183-4501-8bd1-4f6577b5816c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:36.698048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c4ac54e5-f183-4501-8bd1-4f6577b5816c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:36.698745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c4ac54e5-f183-4501-8bd1-4f6577b5816c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:36.699802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c4ac54e5-f183-4501-8bd1-4f6577b5816c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:36.700325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c4ac54e5-f183-4501-8bd1-4f6577b5816c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:36.858357 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.compute.api [None req-c4ac54e5-f183-4501-8bd1-4f6577b5816c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Attempting to quiesce instance before volume snapshot. May 27 15:41:36.920986 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.compute.api [None req-c4ac54e5-f183-4501-8bd1-4f6577b5816c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Skipping quiescing instance because the operation is not supported by the underlying compute driver. May 27 15:41:37.066285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c4ac54e5-f183-4501-8bd1-4f6577b5816c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Creating snapshot from volume 03780378-68ad-421a-8ee0-604588a72f0d. {{(pid=119248) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} May 27 15:41:37.089404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8e022af9-0107-4f6d-9c5f-4000a781af17 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:37.090080 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8e022af9-0107-4f6d-9c5f-4000a781af17 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:37.100406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e022af9-0107-4f6d-9c5f-4000a781af17 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:37.103421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e022af9-0107-4f6d-9c5f-4000a781af17 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:37.105941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e022af9-0107-4f6d-9c5f-4000a781af17 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:37.106747 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e022af9-0107-4f6d-9c5f-4000a781af17 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:37.217041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8e022af9-0107-4f6d-9c5f-4000a781af17 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:37.230035 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8e022af9-0107-4f6d-9c5f-4000a781af17 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1215 microversion: 2.1 time: 0.144445 May 27 15:41:37.239758 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3178/6351] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:37 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1215 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:41:38.257849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-12348faa-1a86-47c7-bf0b-48e03ae31ae7 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:38.259909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-12348faa-1a86-47c7-bf0b-48e03ae31ae7 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:38.285882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12348faa-1a86-47c7-bf0b-48e03ae31ae7 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:38.296321 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12348faa-1a86-47c7-bf0b-48e03ae31ae7 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:38.297405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12348faa-1a86-47c7-bf0b-48e03ae31ae7 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:38.297883 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12348faa-1a86-47c7-bf0b-48e03ae31ae7 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:38.790636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-12348faa-1a86-47c7-bf0b-48e03ae31ae7 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:38.807906 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-12348faa-1a86-47c7-bf0b-48e03ae31ae7 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1283 microversion: 2.1 time: 0.563779 May 27 15:41:38.811911 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3179/6352] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:38 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1283 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:41:38.999104 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c4ac54e5-f183-4501-8bd1-4f6577b5816c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "POST /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa/action" status: 202 len: 0 microversion: 2.1 time: 2.321400 May 27 15:41:39.000727 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3174/6353] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:41:36 2022] POST /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa/action => generated 0 bytes in 2324 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 27 15:41:39.229016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-8af66b51-dd92-4e2e-9c3e-f5ab5dd39b7d req-ec8eb010-aa02-449e-9cd8-9f96dd80db14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b906c8f-6531-467b-a584-6dd84aa3220f", "tag": "9c47d3f6-239b-470a-8b8a-e72ffb217963"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:41:39.247344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-8af66b51-dd92-4e2e-9c3e-f5ab5dd39b7d req-ec8eb010-aa02-449e-9cd8-9f96dd80db14 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:39.247870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-8af66b51-dd92-4e2e-9c3e-f5ab5dd39b7d req-ec8eb010-aa02-449e-9cd8-9f96dd80db14 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:39.281675 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-8af66b51-dd92-4e2e-9c3e-f5ab5dd39b7d req-ec8eb010-aa02-449e-9cd8-9f96dd80db14 service nova] Creating event network-changed:9c47d3f6-239b-470a-8b8a-e72ffb217963 for instance 9b906c8f-6531-467b-a584-6dd84aa3220f on n-h1-843621-1 May 27 15:41:39.304500 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-8af66b51-dd92-4e2e-9c3e-f5ab5dd39b7d req-ec8eb010-aa02-449e-9cd8-9f96dd80db14 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176862 May 27 15:41:39.314063 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3180/6354] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:41:39.831015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-98b55f21-8af1-4f92-a29b-66be808638e0 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:39.831993 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-98b55f21-8af1-4f92-a29b-66be808638e0 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:39.845421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98b55f21-8af1-4f92-a29b-66be808638e0 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:39.846346 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98b55f21-8af1-4f92-a29b-66be808638e0 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:39.850420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98b55f21-8af1-4f92-a29b-66be808638e0 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:39.851129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-98b55f21-8af1-4f92-a29b-66be808638e0 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:40.135080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-98b55f21-8af1-4f92-a29b-66be808638e0 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:40.145776 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-98b55f21-8af1-4f92-a29b-66be808638e0 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1283 microversion: 2.1 time: 0.321755 May 27 15:41:40.147810 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3175/6355] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:39 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1283 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:41.164718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-04cb5d4c-a44d-46e8-bf6f-5c282dd1e951 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:41.165579 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-04cb5d4c-a44d-46e8-bf6f-5c282dd1e951 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:41.183482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04cb5d4c-a44d-46e8-bf6f-5c282dd1e951 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:41.184901 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04cb5d4c-a44d-46e8-bf6f-5c282dd1e951 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:41.185772 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04cb5d4c-a44d-46e8-bf6f-5c282dd1e951 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:41.186240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-04cb5d4c-a44d-46e8-bf6f-5c282dd1e951 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:41.612211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-04cb5d4c-a44d-46e8-bf6f-5c282dd1e951 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:41.626379 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-04cb5d4c-a44d-46e8-bf6f-5c282dd1e951 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1283 microversion: 2.1 time: 0.466332 May 27 15:41:41.636746 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3181/6356] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:41 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1283 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:42.578066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0f64d78f-8d40-4c46-9e12-72edbc64c808 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1398105160", "imageRef": "b5d0ce7b-8543-4b85-afb9-3717e5fcfecd", "flavorRef": "452", "networks": [{"uuid": "8b1a4599-fc38-4529-b66a-d319c59ff383"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:41:42.647218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-edbf138e-72b2-46c0-9bd0-826c8c0676f5 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:42.648085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-edbf138e-72b2-46c0-9bd0-826c8c0676f5 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:42.664474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-edbf138e-72b2-46c0-9bd0-826c8c0676f5 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:42.673679 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-edbf138e-72b2-46c0-9bd0-826c8c0676f5 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:42.674701 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-edbf138e-72b2-46c0-9bd0-826c8c0676f5 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:42.675170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-edbf138e-72b2-46c0-9bd0-826c8c0676f5 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:42.678036 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-0f64d78f-8d40-4c46-9e12-72edbc64c808 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] validate_networks() for [('8b1a4599-fc38-4529-b66a-d319c59ff383', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:41:42.939153 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-edbf138e-72b2-46c0-9bd0-826c8c0676f5 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:42.953237 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-edbf138e-72b2-46c0-9bd0-826c8c0676f5 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1283 microversion: 2.1 time: 0.311930 May 27 15:41:42.961172 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3182/6357] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:42 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1283 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:43.278032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-0f64d78f-8d40-4c46-9e12-72edbc64c808 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:41:43.278857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-0f64d78f-8d40-4c46-9e12-72edbc64c808 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:41:43.279662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-0f64d78f-8d40-4c46-9e12-72edbc64c808 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:41:43.280824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-0f64d78f-8d40-4c46-9e12-72edbc64c808 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:41:43.281439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-0f64d78f-8d40-4c46-9e12-72edbc64c808 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:41:43.301055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f64d78f-8d40-4c46-9e12-72edbc64c808 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:43.301754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f64d78f-8d40-4c46-9e12-72edbc64c808 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:43.302785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f64d78f-8d40-4c46-9e12-72edbc64c808 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:43.303568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0f64d78f-8d40-4c46-9e12-72edbc64c808 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:43.351092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-0f64d78f-8d40-4c46-9e12-72edbc64c808 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Getting quotas for project 536a3b9dd9a745c089e2da27b9f536ff. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:41:43.367913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-0f64d78f-8d40-4c46-9e12-72edbc64c808 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Getting quotas for user a058052ef3fd4ee58291ccc9837558cc and project 536a3b9dd9a745c089e2da27b9f536ff. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:41:43.388513 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0f64d78f-8d40-4c46-9e12-72edbc64c808 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:41:43.395055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0f64d78f-8d40-4c46-9e12-72edbc64c808 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='4670ef15-030f-47c0-b186-aba76ed3e1b8',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:41:43.526832 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0f64d78f-8d40-4c46-9e12-72edbc64c808 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.953989 May 27 15:41:43.535519 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3176/6358] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:41:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:41:43.545519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ecfc2182-8ea1-4139-b2c2-1b368fa8dbbd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:43.546659 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ecfc2182-8ea1-4139-b2c2-1b368fa8dbbd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:43.549522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:41:43.647085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ecfc2182-8ea1-4139-b2c2-1b368fa8dbbd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:43.658541 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ecfc2182-8ea1-4139-b2c2-1b368fa8dbbd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1230 microversion: 2.1 time: 0.116385 May 27 15:41:43.670415 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3183/6359] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:43 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1230 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:43.971353 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-95de70a2-f736-420c-a91b-d96b37ea92c6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:43.972126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-95de70a2-f736-420c-a91b-d96b37ea92c6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:43.989151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-95de70a2-f736-420c-a91b-d96b37ea92c6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:43.990027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-95de70a2-f736-420c-a91b-d96b37ea92c6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:43.991026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-95de70a2-f736-420c-a91b-d96b37ea92c6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:43.991487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-95de70a2-f736-420c-a91b-d96b37ea92c6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:44.353256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-95de70a2-f736-420c-a91b-d96b37ea92c6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:44.364571 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-95de70a2-f736-420c-a91b-d96b37ea92c6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1283 microversion: 2.1 time: 0.397735 May 27 15:41:44.365876 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3177/6360] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:43 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1283 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:44.678181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-83433385-9d4d-4682-baf4-328285e2701a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:44.679675 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-83433385-9d4d-4682-baf4-328285e2701a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:44.692065 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-83433385-9d4d-4682-baf4-328285e2701a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:44.692822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-83433385-9d4d-4682-baf4-328285e2701a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:44.693853 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-83433385-9d4d-4682-baf4-328285e2701a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:44.694516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-83433385-9d4d-4682-baf4-328285e2701a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:44.796749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-83433385-9d4d-4682-baf4-328285e2701a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:44.804805 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-83433385-9d4d-4682-baf4-328285e2701a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1282 microversion: 2.1 time: 0.132403 May 27 15:41:44.805925 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3184/6361] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:44 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1282 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:45.384704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-88bb562f-849f-4117-b4c3-e92ceff756e1 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:45.386812 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-88bb562f-849f-4117-b4c3-e92ceff756e1 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:45.407143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88bb562f-849f-4117-b4c3-e92ceff756e1 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:45.408017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88bb562f-849f-4117-b4c3-e92ceff756e1 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:45.409298 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88bb562f-849f-4117-b4c3-e92ceff756e1 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:45.412089 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88bb562f-849f-4117-b4c3-e92ceff756e1 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:45.763636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-88bb562f-849f-4117-b4c3-e92ceff756e1 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:45.789239 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-88bb562f-849f-4117-b4c3-e92ceff756e1 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1283 microversion: 2.1 time: 0.409651 May 27 15:41:45.793044 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3178/6362] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:45 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1283 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:45.823096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-316fd72a-7d4b-4f0f-bd8c-2e85f1118932 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:45.824860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-316fd72a-7d4b-4f0f-bd8c-2e85f1118932 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:45.843803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-316fd72a-7d4b-4f0f-bd8c-2e85f1118932 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:45.846296 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-316fd72a-7d4b-4f0f-bd8c-2e85f1118932 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:45.850641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-316fd72a-7d4b-4f0f-bd8c-2e85f1118932 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:45.852560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-316fd72a-7d4b-4f0f-bd8c-2e85f1118932 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:46.227436 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-316fd72a-7d4b-4f0f-bd8c-2e85f1118932 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:46.243236 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-316fd72a-7d4b-4f0f-bd8c-2e85f1118932 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1300 microversion: 2.1 time: 0.424559 May 27 15:41:46.244899 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3185/6363] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:45 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1300 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:46.809900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2a401a66-a09a-4308-b182-a30110238cfc tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:46.810550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2a401a66-a09a-4308-b182-a30110238cfc tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:46.835294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a401a66-a09a-4308-b182-a30110238cfc tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:46.836078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a401a66-a09a-4308-b182-a30110238cfc tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:46.837153 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a401a66-a09a-4308-b182-a30110238cfc tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:46.837813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2a401a66-a09a-4308-b182-a30110238cfc tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:47.263606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-548caff5-11f8-4ca5-aad7-e1382bffa6e7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:47.264229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-548caff5-11f8-4ca5-aad7-e1382bffa6e7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:47.282960 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-548caff5-11f8-4ca5-aad7-e1382bffa6e7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:47.283437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-548caff5-11f8-4ca5-aad7-e1382bffa6e7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:47.284252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-548caff5-11f8-4ca5-aad7-e1382bffa6e7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:47.291332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-548caff5-11f8-4ca5-aad7-e1382bffa6e7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:47.736456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2a401a66-a09a-4308-b182-a30110238cfc tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:47.738858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-548caff5-11f8-4ca5-aad7-e1382bffa6e7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:47.746675 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-548caff5-11f8-4ca5-aad7-e1382bffa6e7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.486838 May 27 15:41:47.755192 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3186/6364] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:47 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:41:47.772952 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2a401a66-a09a-4308-b182-a30110238cfc tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1283 microversion: 2.1 time: 0.966930 May 27 15:41:47.776040 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3179/6365] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:46 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1283 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:48.399012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-9b2e8404-702c-45f8-a13e-914c6b9ba3d7 req-15f5ca34-fed9-49e2-820e-67d0aa693efe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb94ca36-b7e2-4e64-b7b9-367737956d7d", "tag": "cdde177a-5a35-4a1d-92a8-6b46b3588b45"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:41:48.434706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-9b2e8404-702c-45f8-a13e-914c6b9ba3d7 req-15f5ca34-fed9-49e2-820e-67d0aa693efe service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:48.437881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-9b2e8404-702c-45f8-a13e-914c6b9ba3d7 req-15f5ca34-fed9-49e2-820e-67d0aa693efe service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:48.495692 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-9b2e8404-702c-45f8-a13e-914c6b9ba3d7 req-15f5ca34-fed9-49e2-820e-67d0aa693efe service nova] Creating event network-changed:cdde177a-5a35-4a1d-92a8-6b46b3588b45 for instance eb94ca36-b7e2-4e64-b7b9-367737956d7d on n-h2-843621-1 May 27 15:41:48.521039 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-9b2e8404-702c-45f8-a13e-914c6b9ba3d7 req-15f5ca34-fed9-49e2-820e-67d0aa693efe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142055 May 27 15:41:48.528157 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3187/6366] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:41:48.775529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9dc2e3d9-dcfd-41d4-86d1-8771e76147d3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:48.777543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9dc2e3d9-dcfd-41d4-86d1-8771e76147d3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:48.797027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2afa6ab0-6359-45ef-894b-ba620e6d60f5 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:48.798012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2afa6ab0-6359-45ef-894b-ba620e6d60f5 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:48.814940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9dc2e3d9-dcfd-41d4-86d1-8771e76147d3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:48.818081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2afa6ab0-6359-45ef-894b-ba620e6d60f5 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:48.822077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2afa6ab0-6359-45ef-894b-ba620e6d60f5 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:48.823187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2afa6ab0-6359-45ef-894b-ba620e6d60f5 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:48.824272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9dc2e3d9-dcfd-41d4-86d1-8771e76147d3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:48.827725 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9dc2e3d9-dcfd-41d4-86d1-8771e76147d3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:48.829167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2afa6ab0-6359-45ef-894b-ba620e6d60f5 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:48.832816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9dc2e3d9-dcfd-41d4-86d1-8771e76147d3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:49.481945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2afa6ab0-6359-45ef-894b-ba620e6d60f5 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:49.499912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9dc2e3d9-dcfd-41d4-86d1-8771e76147d3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:49.507953 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2afa6ab0-6359-45ef-894b-ba620e6d60f5 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1283 microversion: 2.1 time: 0.715686 May 27 15:41:49.533091 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9dc2e3d9-dcfd-41d4-86d1-8771e76147d3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.762322 May 27 15:41:49.542464 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3188/6367] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:48 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1283 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:49.542680 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3180/6368] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:48 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:50.391480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f368c6f3-6658-4fa0-9a59-10e1a8c2f238 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'create', calling method: .version_select at 0x7fc775bdfe50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-436911935", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTE6hQKgvmndUk7+hLifmGE7CbH+xB4vgnBPt9OGhUzt4hUxNYEetSD3RslDU9TDN44fTbZ/dIbx9nLJrAbyHnKVGPOi5JNnP7eCQlis2fybM1fEtHLIYqwcVr4Lh/TjQ=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:41:50.421849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-f368c6f3-6658-4fa0-9a59-10e1a8c2f238 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Getting quotas for project 3255afe7ba134153bcbe682b574e7803. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:41:50.429160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-f368c6f3-6658-4fa0-9a59-10e1a8c2f238 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Getting quotas for user 499fa1ef3ed047a8a92c7a23be43c8f0 and project 3255afe7ba134153bcbe682b574e7803. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:41:50.480485 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f368c6f3-6658-4fa0-9a59-10e1a8c2f238 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.450360 May 27 15:41:50.487905 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3189/6369] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:41:50 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:41:50.526750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-134149ab-cee6-4c2f-9b41-9778db9ecafe tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:50.527573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-134149ab-cee6-4c2f-9b41-9778db9ecafe tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:50.544951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-134149ab-cee6-4c2f-9b41-9778db9ecafe tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:50.547618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-134149ab-cee6-4c2f-9b41-9778db9ecafe tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:50.551468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-357e4f3f-6dfa-4128-baff-3617001ea547 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:50.552151 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-357e4f3f-6dfa-4128-baff-3617001ea547 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:50.553377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-134149ab-cee6-4c2f-9b41-9778db9ecafe tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:50.554639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-134149ab-cee6-4c2f-9b41-9778db9ecafe tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:50.564060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-357e4f3f-6dfa-4128-baff-3617001ea547 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:50.567613 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-357e4f3f-6dfa-4128-baff-3617001ea547 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:50.568832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-357e4f3f-6dfa-4128-baff-3617001ea547 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:50.569812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-357e4f3f-6dfa-4128-baff-3617001ea547 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:51.088869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-134149ab-cee6-4c2f-9b41-9778db9ecafe tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:51.095577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-357e4f3f-6dfa-4128-baff-3617001ea547 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:51.105917 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-134149ab-cee6-4c2f-9b41-9778db9ecafe tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1283 microversion: 2.1 time: 0.583505 May 27 15:41:51.107858 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-357e4f3f-6dfa-4128-baff-3617001ea547 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.561759 May 27 15:41:51.108556 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3181/6370] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:50 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1283 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:51.119577 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3190/6371] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:50 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:41:52.129106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6d834b33-1c4c-4bb8-b8f5-8ed359066ef8 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:52.130175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6d834b33-1c4c-4bb8-b8f5-8ed359066ef8 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:52.143620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d81bb63e-27cf-438e-9ce9-021257a0f118 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:52.145848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d81bb63e-27cf-438e-9ce9-021257a0f118 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:52.159886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d834b33-1c4c-4bb8-b8f5-8ed359066ef8 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:52.161306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d834b33-1c4c-4bb8-b8f5-8ed359066ef8 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:52.162398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d834b33-1c4c-4bb8-b8f5-8ed359066ef8 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:52.163019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d834b33-1c4c-4bb8-b8f5-8ed359066ef8 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:52.173942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d81bb63e-27cf-438e-9ce9-021257a0f118 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:52.178560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d81bb63e-27cf-438e-9ce9-021257a0f118 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:52.180249 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d81bb63e-27cf-438e-9ce9-021257a0f118 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:52.184282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d81bb63e-27cf-438e-9ce9-021257a0f118 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:52.596703 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d81bb63e-27cf-438e-9ce9-021257a0f118 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:52.616539 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d81bb63e-27cf-438e-9ce9-021257a0f118 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.483762 May 27 15:41:52.625916 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6d834b33-1c4c-4bb8-b8f5-8ed359066ef8 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:52.637492 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3191/6372] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:52 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:52.653071 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6d834b33-1c4c-4bb8-b8f5-8ed359066ef8 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1283 microversion: 2.1 time: 0.530839 May 27 15:41:52.654232 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3182/6373] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:52 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1283 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:53.657222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-52c4959b-6a4f-4d22-bab4-71f2d961b769 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:53.658622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-52c4959b-6a4f-4d22-bab4-71f2d961b769 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:53.671554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2fa64f99-0600-46b5-9e1d-04eb0f988f4b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:53.672988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2fa64f99-0600-46b5-9e1d-04eb0f988f4b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:53.678704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52c4959b-6a4f-4d22-bab4-71f2d961b769 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:53.679782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52c4959b-6a4f-4d22-bab4-71f2d961b769 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:53.681233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:41:53.682332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52c4959b-6a4f-4d22-bab4-71f2d961b769 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:53.683700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=12 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:41:53.684395 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52c4959b-6a4f-4d22-bab4-71f2d961b769 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:53.691558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2fa64f99-0600-46b5-9e1d-04eb0f988f4b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:53.692365 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2fa64f99-0600-46b5-9e1d-04eb0f988f4b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:53.693317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2fa64f99-0600-46b5-9e1d-04eb0f988f4b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:53.694602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2fa64f99-0600-46b5-9e1d-04eb0f988f4b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:54.035329 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-52c4959b-6a4f-4d22-bab4-71f2d961b769 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:54.043033 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-52c4959b-6a4f-4d22-bab4-71f2d961b769 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.390112 May 27 15:41:54.053324 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3192/6374] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:53 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:54.147546 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2fa64f99-0600-46b5-9e1d-04eb0f988f4b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:54.162675 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2fa64f99-0600-46b5-9e1d-04eb0f988f4b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1271 microversion: 2.1 time: 0.494956 May 27 15:41:54.163890 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3183/6375] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:53 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1271 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:55.059469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-300a2807-896b-4c3c-9196-b5f9e743b546 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:55.060191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-300a2807-896b-4c3c-9196-b5f9e743b546 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:55.069433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-300a2807-896b-4c3c-9196-b5f9e743b546 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:55.072463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-300a2807-896b-4c3c-9196-b5f9e743b546 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:55.073487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-300a2807-896b-4c3c-9196-b5f9e743b546 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:55.076137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-300a2807-896b-4c3c-9196-b5f9e743b546 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:55.186099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-39c5a9d4-4378-428e-9587-0293e76c94e1 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:55.188184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-39c5a9d4-4378-428e-9587-0293e76c94e1 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:55.216460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39c5a9d4-4378-428e-9587-0293e76c94e1 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:55.219101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39c5a9d4-4378-428e-9587-0293e76c94e1 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:55.220527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39c5a9d4-4378-428e-9587-0293e76c94e1 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:55.228355 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-39c5a9d4-4378-428e-9587-0293e76c94e1 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:55.340906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-300a2807-896b-4c3c-9196-b5f9e743b546 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:55.353208 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-300a2807-896b-4c3c-9196-b5f9e743b546 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.297279 May 27 15:41:55.363205 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3193/6376] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:55 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:55.470794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-39c5a9d4-4378-428e-9587-0293e76c94e1 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:55.489389 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-39c5a9d4-4378-428e-9587-0293e76c94e1 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1271 microversion: 2.1 time: 0.306437 May 27 15:41:55.490369 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3184/6377] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:55 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1271 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:56.370435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-de31c245-7fdb-4d43-a952-d71326a50f15 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:56.371653 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-de31c245-7fdb-4d43-a952-d71326a50f15 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:56.388361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de31c245-7fdb-4d43-a952-d71326a50f15 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:56.389159 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de31c245-7fdb-4d43-a952-d71326a50f15 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:56.390214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de31c245-7fdb-4d43-a952-d71326a50f15 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:56.390861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de31c245-7fdb-4d43-a952-d71326a50f15 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:56.520718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-73591dc6-5efe-4880-bba5-53bbe44589b2 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:56.523327 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-73591dc6-5efe-4880-bba5-53bbe44589b2 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:56.578646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73591dc6-5efe-4880-bba5-53bbe44589b2 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:56.580534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73591dc6-5efe-4880-bba5-53bbe44589b2 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:56.582938 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73591dc6-5efe-4880-bba5-53bbe44589b2 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:56.584630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73591dc6-5efe-4880-bba5-53bbe44589b2 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:56.652980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:41:56.834224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-de31c245-7fdb-4d43-a952-d71326a50f15 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:56.856906 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-de31c245-7fdb-4d43-a952-d71326a50f15 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.490089 May 27 15:41:56.873348 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3194/6378] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:56 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:57.044407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-73591dc6-5efe-4880-bba5-53bbe44589b2 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:57.069061 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-73591dc6-5efe-4880-bba5-53bbe44589b2 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1271 microversion: 2.1 time: 0.563042 May 27 15:41:57.081607 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3185/6379] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:56 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1271 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:57.879428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0288401d-d432-416e-a990-95e6ce2ed36b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:57.880861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0288401d-d432-416e-a990-95e6ce2ed36b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:57.895008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0288401d-d432-416e-a990-95e6ce2ed36b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:57.901909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0288401d-d432-416e-a990-95e6ce2ed36b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:57.903168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0288401d-d432-416e-a990-95e6ce2ed36b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:57.903797 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0288401d-d432-416e-a990-95e6ce2ed36b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:57.993587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:41:58.090136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-88aa9e3c-60b7-491e-8d64-dc394287d631 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:58.090924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-88aa9e3c-60b7-491e-8d64-dc394287d631 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:58.110604 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88aa9e3c-60b7-491e-8d64-dc394287d631 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:58.111270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88aa9e3c-60b7-491e-8d64-dc394287d631 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:58.112760 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88aa9e3c-60b7-491e-8d64-dc394287d631 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:58.113589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88aa9e3c-60b7-491e-8d64-dc394287d631 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:58.694819 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0288401d-d432-416e-a990-95e6ce2ed36b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:58.706262 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0288401d-d432-416e-a990-95e6ce2ed36b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.832508 May 27 15:41:58.717914 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3195/6380] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:57 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:58.765715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-88aa9e3c-60b7-491e-8d64-dc394287d631 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:41:58.789647 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-88aa9e3c-60b7-491e-8d64-dc394287d631 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1271 microversion: 2.1 time: 0.704213 May 27 15:41:58.790807 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3186/6381] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:58 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1271 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:41:59.734928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6d2ccbfb-8548-475e-a740-de1099001d68 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:59.736193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6d2ccbfb-8548-475e-a740-de1099001d68 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:59.747940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d2ccbfb-8548-475e-a740-de1099001d68 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:59.748419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d2ccbfb-8548-475e-a740-de1099001d68 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:59.749792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d2ccbfb-8548-475e-a740-de1099001d68 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:59.750368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6d2ccbfb-8548-475e-a740-de1099001d68 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:59.822119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8aa8bdba-a35d-4e21-a41e-badccdf9d551 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:41:59.823648 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8aa8bdba-a35d-4e21-a41e-badccdf9d551 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:41:59.847121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8aa8bdba-a35d-4e21-a41e-badccdf9d551 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:59.850842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8aa8bdba-a35d-4e21-a41e-badccdf9d551 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:41:59.853228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8aa8bdba-a35d-4e21-a41e-badccdf9d551 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:41:59.854213 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8aa8bdba-a35d-4e21-a41e-badccdf9d551 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:00.324240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6d2ccbfb-8548-475e-a740-de1099001d68 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:00.349479 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6d2ccbfb-8548-475e-a740-de1099001d68 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.625804 May 27 15:42:00.353901 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3196/6382] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:59 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:00.437912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8aa8bdba-a35d-4e21-a41e-badccdf9d551 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:00.475458 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8aa8bdba-a35d-4e21-a41e-badccdf9d551 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1271 microversion: 2.1 time: 0.657500 May 27 15:42:00.476642 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3187/6383] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:41:59 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1271 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:00.648879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7dba3ac0-17f1-4612-afee-eaebf927e048 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1903261708", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "d5ed7507-a96c-4be6-a799-b70522b6d2e4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-436911935", "security_groups": [{"name": "tempest-secgroup-smoke-1340880127"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:42:00.662642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=14 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:42:00.873466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-7dba3ac0-17f1-4612-afee-eaebf927e048 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] validate_networks() for [('d5ed7507-a96c-4be6-a799-b70522b6d2e4', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:42:01.374077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-23d7bf99-3b3f-455a-aab2-da77e2e97ae7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:01.374841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-23d7bf99-3b3f-455a-aab2-da77e2e97ae7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:01.393122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23d7bf99-3b3f-455a-aab2-da77e2e97ae7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:01.393895 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23d7bf99-3b3f-455a-aab2-da77e2e97ae7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:01.394870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23d7bf99-3b3f-455a-aab2-da77e2e97ae7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:01.395500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23d7bf99-3b3f-455a-aab2-da77e2e97ae7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:02.005503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-23d7bf99-3b3f-455a-aab2-da77e2e97ae7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:02.024930 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-23d7bf99-3b3f-455a-aab2-da77e2e97ae7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.656788 May 27 15:42:02.029264 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3188/6384] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:01 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:02.040817 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f1385367-ece8-4f88-aed0-fbb1f4fa8e6e tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:02.041960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f1385367-ece8-4f88-aed0-fbb1f4fa8e6e tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:02.068886 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1385367-ece8-4f88-aed0-fbb1f4fa8e6e tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:02.069435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1385367-ece8-4f88-aed0-fbb1f4fa8e6e tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:02.070783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1385367-ece8-4f88-aed0-fbb1f4fa8e6e tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:02.071412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f1385367-ece8-4f88-aed0-fbb1f4fa8e6e tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:02.082217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-7dba3ac0-17f1-4612-afee-eaebf927e048 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:42:02.082732 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-7dba3ac0-17f1-4612-afee-eaebf927e048 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:42:02.085933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-7dba3ac0-17f1-4612-afee-eaebf927e048 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:42:02.086571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-7dba3ac0-17f1-4612-afee-eaebf927e048 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:42:02.087002 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-7dba3ac0-17f1-4612-afee-eaebf927e048 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:42:02.106710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7dba3ac0-17f1-4612-afee-eaebf927e048 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:02.111394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7dba3ac0-17f1-4612-afee-eaebf927e048 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:02.112588 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7dba3ac0-17f1-4612-afee-eaebf927e048 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:02.113483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7dba3ac0-17f1-4612-afee-eaebf927e048 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:02.147670 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-7dba3ac0-17f1-4612-afee-eaebf927e048 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Getting quotas for project 3255afe7ba134153bcbe682b574e7803. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:42:02.156524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-7dba3ac0-17f1-4612-afee-eaebf927e048 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Getting quotas for user 499fa1ef3ed047a8a92c7a23be43c8f0 and project 3255afe7ba134153bcbe682b574e7803. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:42:02.176619 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7dba3ac0-17f1-4612-afee-eaebf927e048 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:42:02.179649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7dba3ac0-17f1-4612-afee-eaebf927e048 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:42:02.273940 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7dba3ac0-17f1-4612-afee-eaebf927e048 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.629329 May 27 15:42:02.279873 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3197/6385] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:42:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:42:02.287818 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-20973c53-a95b-438e-89bb-310e7ec49f60 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:02.288537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-20973c53-a95b-438e-89bb-310e7ec49f60 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:02.445293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-20973c53-a95b-438e-89bb-310e7ec49f60 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:02.457329 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-20973c53-a95b-438e-89bb-310e7ec49f60 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1266 microversion: 2.1 time: 0.175614 May 27 15:42:02.459866 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3198/6386] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:02 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:02.539207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f1385367-ece8-4f88-aed0-fbb1f4fa8e6e tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:02.567815 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f1385367-ece8-4f88-aed0-fbb1f4fa8e6e tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1271 microversion: 2.1 time: 0.536058 May 27 15:42:02.575497 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3189/6387] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:02 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1271 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:03.049218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cd30ed1f-c404-44ec-a389-2576187415f0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:03.050084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cd30ed1f-c404-44ec-a389-2576187415f0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:03.071597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cd30ed1f-c404-44ec-a389-2576187415f0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:03.074696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cd30ed1f-c404-44ec-a389-2576187415f0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:03.078513 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cd30ed1f-c404-44ec-a389-2576187415f0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:03.079458 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cd30ed1f-c404-44ec-a389-2576187415f0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:03.288843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cd30ed1f-c404-44ec-a389-2576187415f0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:03.304620 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cd30ed1f-c404-44ec-a389-2576187415f0 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.260287 May 27 15:42:03.306181 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3199/6388] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:03 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:03.487547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-27ba16f2-9972-47a5-9b16-943a6ba34050 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:03.489156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-27ba16f2-9972-47a5-9b16-943a6ba34050 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:03.508906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:42:03.513816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27ba16f2-9972-47a5-9b16-943a6ba34050 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:03.518696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27ba16f2-9972-47a5-9b16-943a6ba34050 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:03.522722 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27ba16f2-9972-47a5-9b16-943a6ba34050 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:03.526197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-27ba16f2-9972-47a5-9b16-943a6ba34050 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:03.591682 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d11e3f8a-8a8a-4b39-a21e-70c11649b1a6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:03.592328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d11e3f8a-8a8a-4b39-a21e-70c11649b1a6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:03.602930 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:42:03.605586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d11e3f8a-8a8a-4b39-a21e-70c11649b1a6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:03.609288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d11e3f8a-8a8a-4b39-a21e-70c11649b1a6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:03.610342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d11e3f8a-8a8a-4b39-a21e-70c11649b1a6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:03.610988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d11e3f8a-8a8a-4b39-a21e-70c11649b1a6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:03.814194 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-27ba16f2-9972-47a5-9b16-943a6ba34050 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:03.825129 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-27ba16f2-9972-47a5-9b16-943a6ba34050 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1262 microversion: 2.1 time: 0.349479 May 27 15:42:03.825730 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3190/6389] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:03 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1262 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:03.982180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d11e3f8a-8a8a-4b39-a21e-70c11649b1a6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:03.999979 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d11e3f8a-8a8a-4b39-a21e-70c11649b1a6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1271 microversion: 2.1 time: 0.412057 May 27 15:42:04.010844 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3200/6390] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:03 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1271 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:42:04.324219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bd395a13-e188-4820-b858-0eea7f9daf3e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:04.325215 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bd395a13-e188-4820-b858-0eea7f9daf3e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:04.336035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd395a13-e188-4820-b858-0eea7f9daf3e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:04.342846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd395a13-e188-4820-b858-0eea7f9daf3e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:04.344235 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd395a13-e188-4820-b858-0eea7f9daf3e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:04.357556 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd395a13-e188-4820-b858-0eea7f9daf3e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:04.599058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bd395a13-e188-4820-b858-0eea7f9daf3e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:04.618455 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bd395a13-e188-4820-b858-0eea7f9daf3e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.298435 May 27 15:42:04.630004 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3191/6391] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:04 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:04.842856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3301dfbb-a44b-41ec-a3ce-e945fd26ddc9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:04.843476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3301dfbb-a44b-41ec-a3ce-e945fd26ddc9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:04.856660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3301dfbb-a44b-41ec-a3ce-e945fd26ddc9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:04.857150 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3301dfbb-a44b-41ec-a3ce-e945fd26ddc9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:04.858001 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3301dfbb-a44b-41ec-a3ce-e945fd26ddc9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:04.858441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3301dfbb-a44b-41ec-a3ce-e945fd26ddc9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:05.005794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3301dfbb-a44b-41ec-a3ce-e945fd26ddc9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:05.018767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-05884167-facd-4f02-8040-c91e1700d28b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:05.019396 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-05884167-facd-4f02-8040-c91e1700d28b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:05.020717 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3301dfbb-a44b-41ec-a3ce-e945fd26ddc9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1324 microversion: 2.1 time: 0.181616 May 27 15:42:05.021566 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3201/6392] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:04 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1324 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:05.027875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05884167-facd-4f02-8040-c91e1700d28b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:05.028351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05884167-facd-4f02-8040-c91e1700d28b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:05.029175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05884167-facd-4f02-8040-c91e1700d28b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:05.029824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05884167-facd-4f02-8040-c91e1700d28b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:05.299292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-05884167-facd-4f02-8040-c91e1700d28b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:05.309174 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-05884167-facd-4f02-8040-c91e1700d28b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1271 microversion: 2.1 time: 0.295354 May 27 15:42:05.320419 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3192/6393] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:05 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1271 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:42:05.637106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3bac74a7-dd6c-4b84-b760-625bbf2cd395 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:05.637729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3bac74a7-dd6c-4b84-b760-625bbf2cd395 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:05.648729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3bac74a7-dd6c-4b84-b760-625bbf2cd395 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:05.649162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3bac74a7-dd6c-4b84-b760-625bbf2cd395 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:05.649951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3bac74a7-dd6c-4b84-b760-625bbf2cd395 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:05.650399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3bac74a7-dd6c-4b84-b760-625bbf2cd395 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:05.985048 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3bac74a7-dd6c-4b84-b760-625bbf2cd395 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:05.995074 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3bac74a7-dd6c-4b84-b760-625bbf2cd395 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.362386 May 27 15:42:06.005997 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3202/6394] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:05 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:06.029649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-a0b20cd0-3bda-44f1-98db-5f85349a2465 req-b3c7d776-68a4-498a-9735-cd12e1ff011d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b906c8f-6531-467b-a584-6dd84aa3220f", "name": "network-vif-plugged", "status": "completed", "tag": "9c47d3f6-239b-470a-8b8a-e72ffb217963"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:42:06.042969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-954a2689-7ef9-4f56-8f85-b72162b65253 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:06.043765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-954a2689-7ef9-4f56-8f85-b72162b65253 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:06.052705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-a0b20cd0-3bda-44f1-98db-5f85349a2465 req-b3c7d776-68a4-498a-9735-cd12e1ff011d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:06.054968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-a0b20cd0-3bda-44f1-98db-5f85349a2465 req-b3c7d776-68a4-498a-9735-cd12e1ff011d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:06.067628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-954a2689-7ef9-4f56-8f85-b72162b65253 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:06.069081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-954a2689-7ef9-4f56-8f85-b72162b65253 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:06.069909 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-954a2689-7ef9-4f56-8f85-b72162b65253 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:06.070377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-954a2689-7ef9-4f56-8f85-b72162b65253 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:06.105792 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-a0b20cd0-3bda-44f1-98db-5f85349a2465 req-b3c7d776-68a4-498a-9735-cd12e1ff011d service nova] Creating event network-vif-plugged:9c47d3f6-239b-470a-8b8a-e72ffb217963 for instance 9b906c8f-6531-467b-a584-6dd84aa3220f on n-h1-843621-1 May 27 15:42:06.124813 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-a0b20cd0-3bda-44f1-98db-5f85349a2465 req-b3c7d776-68a4-498a-9735-cd12e1ff011d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098951 May 27 15:42:06.130270 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3193/6395] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:42:06.330114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c8cd5788-ca54-471d-8397-fa2db5b5e6dd tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:06.331191 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c8cd5788-ca54-471d-8397-fa2db5b5e6dd tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:06.347735 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8cd5788-ca54-471d-8397-fa2db5b5e6dd tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:06.348823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8cd5788-ca54-471d-8397-fa2db5b5e6dd tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:06.349986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8cd5788-ca54-471d-8397-fa2db5b5e6dd tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:06.352092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c8cd5788-ca54-471d-8397-fa2db5b5e6dd tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:06.431149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-954a2689-7ef9-4f56-8f85-b72162b65253 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:06.442356 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-954a2689-7ef9-4f56-8f85-b72162b65253 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1392 microversion: 2.1 time: 0.407798 May 27 15:42:06.443431 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3203/6396] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:06 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1392 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:42:06.604781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c8cd5788-ca54-471d-8397-fa2db5b5e6dd tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:06.615357 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c8cd5788-ca54-471d-8397-fa2db5b5e6dd tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1271 microversion: 2.1 time: 0.290380 May 27 15:42:06.616098 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3194/6397] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:06 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1271 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:07.019186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2f162724-3850-40e1-a30b-05790ad15e07 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:07.022256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2f162724-3850-40e1-a30b-05790ad15e07 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:07.037285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2f162724-3850-40e1-a30b-05790ad15e07 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:07.038074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2f162724-3850-40e1-a30b-05790ad15e07 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:07.040346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2f162724-3850-40e1-a30b-05790ad15e07 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:07.041531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2f162724-3850-40e1-a30b-05790ad15e07 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:07.233923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2f162724-3850-40e1-a30b-05790ad15e07 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:07.244806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-245d3c89-f918-4687-9b78-9946bb6eacfd req-f8f4b36d-033b-4518-8896-779cc1c34965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6356ecad-39d9-4149-8277-8b378d9c806a", "tag": "6ca629e8-ab17-45ed-8a13-e4d4f0af9e12"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:42:07.257576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-245d3c89-f918-4687-9b78-9946bb6eacfd req-f8f4b36d-033b-4518-8896-779cc1c34965 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:07.258749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-245d3c89-f918-4687-9b78-9946bb6eacfd req-f8f4b36d-033b-4518-8896-779cc1c34965 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:07.271024 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2f162724-3850-40e1-a30b-05790ad15e07 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.260351 May 27 15:42:07.274048 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3204/6398] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:07 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:07.277639 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-245d3c89-f918-4687-9b78-9946bb6eacfd req-f8f4b36d-033b-4518-8896-779cc1c34965 service nova] Creating event network-changed:6ca629e8-ab17-45ed-8a13-e4d4f0af9e12 for instance 6356ecad-39d9-4149-8277-8b378d9c806a on n-h1-843621-1 May 27 15:42:07.283028 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-245d3c89-f918-4687-9b78-9946bb6eacfd req-f8f4b36d-033b-4518-8896-779cc1c34965 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043017 May 27 15:42:07.283713 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3195/6399] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:42:07.460472 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-641c9c43-c358-42b1-8a32-a0e5d38bea7a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:07.461545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-641c9c43-c358-42b1-8a32-a0e5d38bea7a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:07.473980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-641c9c43-c358-42b1-8a32-a0e5d38bea7a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:07.474856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-641c9c43-c358-42b1-8a32-a0e5d38bea7a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:07.476320 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-641c9c43-c358-42b1-8a32-a0e5d38bea7a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:07.478262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-641c9c43-c358-42b1-8a32-a0e5d38bea7a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:07.638095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-924c4e35-d66f-4b68-a8ea-d2d4d4044fc2 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:07.639508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-924c4e35-d66f-4b68-a8ea-d2d4d4044fc2 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:07.666885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-924c4e35-d66f-4b68-a8ea-d2d4d4044fc2 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:07.669248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-924c4e35-d66f-4b68-a8ea-d2d4d4044fc2 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:07.671515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-924c4e35-d66f-4b68-a8ea-d2d4d4044fc2 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:07.672219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-924c4e35-d66f-4b68-a8ea-d2d4d4044fc2 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:07.682019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-641c9c43-c358-42b1-8a32-a0e5d38bea7a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:07.691259 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-641c9c43-c358-42b1-8a32-a0e5d38bea7a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1392 microversion: 2.1 time: 0.235601 May 27 15:42:07.715031 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3205/6400] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:07 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1392 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:07.886421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-924c4e35-d66f-4b68-a8ea-d2d4d4044fc2 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:07.895063 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-924c4e35-d66f-4b68-a8ea-d2d4d4044fc2 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1271 microversion: 2.1 time: 0.264295 May 27 15:42:07.906043 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3196/6401] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:07 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1271 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:08.293274 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e27df476-c742-4283-9327-50a2219308cb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:08.295211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e27df476-c742-4283-9327-50a2219308cb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:08.332366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e27df476-c742-4283-9327-50a2219308cb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:08.344543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e27df476-c742-4283-9327-50a2219308cb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:08.347194 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e27df476-c742-4283-9327-50a2219308cb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:08.348920 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e27df476-c742-4283-9327-50a2219308cb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:08.632125 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e27df476-c742-4283-9327-50a2219308cb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:08.641468 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e27df476-c742-4283-9327-50a2219308cb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.353839 May 27 15:42:08.651086 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3206/6402] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:08 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:08.711709 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-902ec54a-1003-4a56-ad21-73a1085cef37 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:08.712641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-902ec54a-1003-4a56-ad21-73a1085cef37 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:08.720415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-902ec54a-1003-4a56-ad21-73a1085cef37 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:08.720946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-902ec54a-1003-4a56-ad21-73a1085cef37 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:08.721846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-902ec54a-1003-4a56-ad21-73a1085cef37 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:08.731232 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-902ec54a-1003-4a56-ad21-73a1085cef37 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:08.913203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a93f191b-a95a-4f85-be81-d5fa1868f7e6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:08.914684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a93f191b-a95a-4f85-be81-d5fa1868f7e6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:08.927039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a93f191b-a95a-4f85-be81-d5fa1868f7e6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:08.927609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-902ec54a-1003-4a56-ad21-73a1085cef37 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:08.929124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a93f191b-a95a-4f85-be81-d5fa1868f7e6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:08.929944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a93f191b-a95a-4f85-be81-d5fa1868f7e6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:08.930548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a93f191b-a95a-4f85-be81-d5fa1868f7e6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:08.940908 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-902ec54a-1003-4a56-ad21-73a1085cef37 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1392 microversion: 2.1 time: 0.233115 May 27 15:42:08.951622 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3197/6403] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:08 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1392 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:42:09.149635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a93f191b-a95a-4f85-be81-d5fa1868f7e6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:09.160238 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a93f191b-a95a-4f85-be81-d5fa1868f7e6 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1460 microversion: 2.1 time: 0.251884 May 27 15:42:09.164710 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3207/6404] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:08 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1460 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:09.184626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d67d02b1-e940-403a-b7ad-f08b719b628d tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:09.185538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d67d02b1-e940-403a-b7ad-f08b719b628d tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:09.193044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d67d02b1-e940-403a-b7ad-f08b719b628d tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:09.193723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d67d02b1-e940-403a-b7ad-f08b719b628d tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:09.194611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d67d02b1-e940-403a-b7ad-f08b719b628d tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:09.195166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d67d02b1-e940-403a-b7ad-f08b719b628d tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:09.372444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d67d02b1-e940-403a-b7ad-f08b719b628d tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:09.387568 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d67d02b1-e940-403a-b7ad-f08b719b628d tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1460 microversion: 2.1 time: 0.210965 May 27 15:42:09.388316 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3198/6405] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:09 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1460 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:09.663162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b2668689-bfa8-4a8c-9555-c1f3a46407cc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:09.667204 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b2668689-bfa8-4a8c-9555-c1f3a46407cc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:09.681599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b2668689-bfa8-4a8c-9555-c1f3a46407cc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:09.682475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b2668689-bfa8-4a8c-9555-c1f3a46407cc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:09.683549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b2668689-bfa8-4a8c-9555-c1f3a46407cc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:09.684214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b2668689-bfa8-4a8c-9555-c1f3a46407cc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:09.947572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b2668689-bfa8-4a8c-9555-c1f3a46407cc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:09.959872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8420c00d-9fdc-414b-9a33-e64f4f40fe82 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:09.961584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8420c00d-9fdc-414b-9a33-e64f4f40fe82 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:09.966872 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b2668689-bfa8-4a8c-9555-c1f3a46407cc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.310974 May 27 15:42:09.969409 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3208/6406] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:09 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:09.979781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8420c00d-9fdc-414b-9a33-e64f4f40fe82 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:09.980901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8420c00d-9fdc-414b-9a33-e64f4f40fe82 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:09.981985 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8420c00d-9fdc-414b-9a33-e64f4f40fe82 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:09.982609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8420c00d-9fdc-414b-9a33-e64f4f40fe82 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:10.213885 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8420c00d-9fdc-414b-9a33-e64f4f40fe82 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:10.228942 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8420c00d-9fdc-414b-9a33-e64f4f40fe82 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1392 microversion: 2.1 time: 0.273106 May 27 15:42:10.244108 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3199/6407] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:09 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1392 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:42:10.991895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-eb2cdc60-fe53-4186-b3d4-b8149d15003b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:10.993730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-eb2cdc60-fe53-4186-b3d4-b8149d15003b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:11.007501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb2cdc60-fe53-4186-b3d4-b8149d15003b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:11.012983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb2cdc60-fe53-4186-b3d4-b8149d15003b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:11.016482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb2cdc60-fe53-4186-b3d4-b8149d15003b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:11.017512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-eb2cdc60-fe53-4186-b3d4-b8149d15003b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:11.253111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fe37d0dd-059c-4b4c-a7d7-223c475a7873 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:11.253984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fe37d0dd-059c-4b4c-a7d7-223c475a7873 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:11.266622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fe37d0dd-059c-4b4c-a7d7-223c475a7873 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:11.267100 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fe37d0dd-059c-4b4c-a7d7-223c475a7873 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:11.267916 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fe37d0dd-059c-4b4c-a7d7-223c475a7873 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:11.268375 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fe37d0dd-059c-4b4c-a7d7-223c475a7873 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:11.293390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-eb2cdc60-fe53-4186-b3d4-b8149d15003b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:11.310968 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-eb2cdc60-fe53-4186-b3d4-b8149d15003b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.327995 May 27 15:42:11.312997 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3209/6408] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:10 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:11.532205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fe37d0dd-059c-4b4c-a7d7-223c475a7873 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:11.547528 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fe37d0dd-059c-4b4c-a7d7-223c475a7873 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1392 microversion: 2.1 time: 0.298627 May 27 15:42:11.549097 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3200/6409] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:11 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1392 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:12.330084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4246920f-adbc-4d7c-859f-a45d5d7efc95 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:12.331027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4246920f-adbc-4d7c-859f-a45d5d7efc95 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:12.344215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:42:12.350277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4246920f-adbc-4d7c-859f-a45d5d7efc95 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:12.363857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4246920f-adbc-4d7c-859f-a45d5d7efc95 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:12.369965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4246920f-adbc-4d7c-859f-a45d5d7efc95 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:12.370736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4246920f-adbc-4d7c-859f-a45d5d7efc95 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:12.466889 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=8 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:42:12.572815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ec2da31d-0652-4128-913b-f7ac33c2ad73 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:12.575014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ec2da31d-0652-4128-913b-f7ac33c2ad73 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:12.592031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec2da31d-0652-4128-913b-f7ac33c2ad73 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:12.603118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec2da31d-0652-4128-913b-f7ac33c2ad73 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:12.604857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec2da31d-0652-4128-913b-f7ac33c2ad73 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:12.606977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ec2da31d-0652-4128-913b-f7ac33c2ad73 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:12.689827 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4246920f-adbc-4d7c-859f-a45d5d7efc95 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:12.702796 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4246920f-adbc-4d7c-859f-a45d5d7efc95 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.377240 May 27 15:42:12.718999 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3210/6410] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:12 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:42:12.907443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ec2da31d-0652-4128-913b-f7ac33c2ad73 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:12.923717 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ec2da31d-0652-4128-913b-f7ac33c2ad73 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1392 microversion: 2.1 time: 0.356539 May 27 15:42:12.928234 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3201/6411] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:12 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1392 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:42:13.169821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-88ea6e46-af93-4aa8-95f9-5f11a3aebf71 req-72f806ca-dc64-4fbe-a536-2e4f701abb2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b906c8f-6531-467b-a584-6dd84aa3220f", "tag": "9c47d3f6-239b-470a-8b8a-e72ffb217963"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:42:13.194974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-88ea6e46-af93-4aa8-95f9-5f11a3aebf71 req-72f806ca-dc64-4fbe-a536-2e4f701abb2c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:13.195337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-88ea6e46-af93-4aa8-95f9-5f11a3aebf71 req-72f806ca-dc64-4fbe-a536-2e4f701abb2c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:13.235194 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-88ea6e46-af93-4aa8-95f9-5f11a3aebf71 req-72f806ca-dc64-4fbe-a536-2e4f701abb2c service nova] Creating event network-changed:9c47d3f6-239b-470a-8b8a-e72ffb217963 for instance 9b906c8f-6531-467b-a584-6dd84aa3220f on n-h1-843621-1 May 27 15:42:13.247857 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-88ea6e46-af93-4aa8-95f9-5f11a3aebf71 req-72f806ca-dc64-4fbe-a536-2e4f701abb2c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086563 May 27 15:42:13.251948 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3211/6412] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:42:13.721284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-04adb6ca-67e2-4af0-ad07-ee90dfb70a60 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:13.722102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-04adb6ca-67e2-4af0-ad07-ee90dfb70a60 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:13.739230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04adb6ca-67e2-4af0-ad07-ee90dfb70a60 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:13.739948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04adb6ca-67e2-4af0-ad07-ee90dfb70a60 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:13.743067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04adb6ca-67e2-4af0-ad07-ee90dfb70a60 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:13.746489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-04adb6ca-67e2-4af0-ad07-ee90dfb70a60 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:13.946251 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-73350b5c-83dd-47c9-9fbf-3697e4565e4e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:13.947543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-73350b5c-83dd-47c9-9fbf-3697e4565e4e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:13.971415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73350b5c-83dd-47c9-9fbf-3697e4565e4e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:13.981538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73350b5c-83dd-47c9-9fbf-3697e4565e4e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:13.982636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73350b5c-83dd-47c9-9fbf-3697e4565e4e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:13.983275 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-73350b5c-83dd-47c9-9fbf-3697e4565e4e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:14.432112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-73350b5c-83dd-47c9-9fbf-3697e4565e4e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:14.447263 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-73350b5c-83dd-47c9-9fbf-3697e4565e4e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1392 microversion: 2.1 time: 0.504945 May 27 15:42:14.451208 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3212/6413] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:13 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1392 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:14.493769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-04adb6ca-67e2-4af0-ad07-ee90dfb70a60 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:14.503429 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-04adb6ca-67e2-4af0-ad07-ee90dfb70a60 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.786719 May 27 15:42:14.507892 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3202/6414] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:13 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:15.464368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5dee2040-12a6-4e20-8313-aa125c2dab98 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:15.465813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5dee2040-12a6-4e20-8313-aa125c2dab98 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:15.478558 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5dee2040-12a6-4e20-8313-aa125c2dab98 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:15.479411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5dee2040-12a6-4e20-8313-aa125c2dab98 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:15.480613 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5dee2040-12a6-4e20-8313-aa125c2dab98 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:15.481425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5dee2040-12a6-4e20-8313-aa125c2dab98 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:15.507928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-02aeae20-3511-4d82-bc95-7e7941c8be19 req-456fd98c-c76e-40ec-b2b0-0a132e396778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b906c8f-6531-467b-a584-6dd84aa3220f", "tag": "9c47d3f6-239b-470a-8b8a-e72ffb217963"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:42:15.533987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-02aeae20-3511-4d82-bc95-7e7941c8be19 req-456fd98c-c76e-40ec-b2b0-0a132e396778 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:15.535395 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-02aeae20-3511-4d82-bc95-7e7941c8be19 req-456fd98c-c76e-40ec-b2b0-0a132e396778 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:15.548115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:42:15.564943 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-02aeae20-3511-4d82-bc95-7e7941c8be19 req-456fd98c-c76e-40ec-b2b0-0a132e396778 service nova] Creating event network-changed:9c47d3f6-239b-470a-8b8a-e72ffb217963 for instance 9b906c8f-6531-467b-a584-6dd84aa3220f on n-h1-843621-1 May 27 15:42:15.571250 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-02aeae20-3511-4d82-bc95-7e7941c8be19 req-456fd98c-c76e-40ec-b2b0-0a132e396778 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068689 May 27 15:42:15.572918 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3203/6415] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:42:15.592322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ba4b3606-4fea-4cec-a074-f40dbf9b1642 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:15.593505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ba4b3606-4fea-4cec-a074-f40dbf9b1642 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:15.627592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba4b3606-4fea-4cec-a074-f40dbf9b1642 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:15.630092 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba4b3606-4fea-4cec-a074-f40dbf9b1642 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:15.632771 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba4b3606-4fea-4cec-a074-f40dbf9b1642 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:15.633459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba4b3606-4fea-4cec-a074-f40dbf9b1642 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:15.760567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5dee2040-12a6-4e20-8313-aa125c2dab98 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:15.769659 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5dee2040-12a6-4e20-8313-aa125c2dab98 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1392 microversion: 2.1 time: 0.309703 May 27 15:42:15.775494 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3213/6416] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:15 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1392 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:15.913130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ba4b3606-4fea-4cec-a074-f40dbf9b1642 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:15.927409 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ba4b3606-4fea-4cec-a074-f40dbf9b1642 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.352820 May 27 15:42:15.928269 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3204/6417] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:15 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:15.992750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-176c9e19-527a-4f8d-83f6-e9f4f4f41867 req-0d755e25-e62b-42e0-879c-42a3c98684d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6356ecad-39d9-4149-8277-8b378d9c806a", "name": "network-vif-plugged", "status": "completed", "tag": "6ca629e8-ab17-45ed-8a13-e4d4f0af9e12"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:42:16.007221 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-176c9e19-527a-4f8d-83f6-e9f4f4f41867 req-0d755e25-e62b-42e0-879c-42a3c98684d4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:16.007675 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-176c9e19-527a-4f8d-83f6-e9f4f4f41867 req-0d755e25-e62b-42e0-879c-42a3c98684d4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:16.035847 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-176c9e19-527a-4f8d-83f6-e9f4f4f41867 req-0d755e25-e62b-42e0-879c-42a3c98684d4 service nova] Creating event network-vif-plugged:6ca629e8-ab17-45ed-8a13-e4d4f0af9e12 for instance 6356ecad-39d9-4149-8277-8b378d9c806a on n-h1-843621-1 May 27 15:42:16.057500 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-176c9e19-527a-4f8d-83f6-e9f4f4f41867 req-0d755e25-e62b-42e0-879c-42a3c98684d4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068473 May 27 15:42:16.058484 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3214/6418] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:42:16.791430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-70430cb0-f385-4460-a99e-0d5cd94deb08 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:16.792077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-70430cb0-f385-4460-a99e-0d5cd94deb08 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:16.799215 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-70430cb0-f385-4460-a99e-0d5cd94deb08 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:16.799703 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-70430cb0-f385-4460-a99e-0d5cd94deb08 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:16.800532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-70430cb0-f385-4460-a99e-0d5cd94deb08 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:16.813351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-70430cb0-f385-4460-a99e-0d5cd94deb08 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:16.947204 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-62022c89-a82d-4b7f-b1c4-8e790e62b816 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:16.948864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-62022c89-a82d-4b7f-b1c4-8e790e62b816 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:16.957072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-62022c89-a82d-4b7f-b1c4-8e790e62b816 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:16.957934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-62022c89-a82d-4b7f-b1c4-8e790e62b816 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:16.959120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-62022c89-a82d-4b7f-b1c4-8e790e62b816 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:16.959822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-62022c89-a82d-4b7f-b1c4-8e790e62b816 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:16.963429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:42:16.979751 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-70430cb0-f385-4460-a99e-0d5cd94deb08 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:16.999631 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-70430cb0-f385-4460-a99e-0d5cd94deb08 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1392 microversion: 2.1 time: 0.211932 May 27 15:42:17.010878 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3205/6419] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:16 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1392 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:17.141203 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-62022c89-a82d-4b7f-b1c4-8e790e62b816 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:17.149548 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-62022c89-a82d-4b7f-b1c4-8e790e62b816 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.207617 May 27 15:42:17.150146 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3215/6420] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:16 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:17.592799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-394bd6c9-48b1-446a-bbe8-0757a3af9799 req-35a9b02a-8820-4765-b2eb-ce806ac66bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b906c8f-6531-467b-a584-6dd84aa3220f", "tag": "9c47d3f6-239b-470a-8b8a-e72ffb217963"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:42:17.607592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-394bd6c9-48b1-446a-bbe8-0757a3af9799 req-35a9b02a-8820-4765-b2eb-ce806ac66bc9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:17.610236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-394bd6c9-48b1-446a-bbe8-0757a3af9799 req-35a9b02a-8820-4765-b2eb-ce806ac66bc9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:17.628821 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-394bd6c9-48b1-446a-bbe8-0757a3af9799 req-35a9b02a-8820-4765-b2eb-ce806ac66bc9 service nova] Creating event network-changed:9c47d3f6-239b-470a-8b8a-e72ffb217963 for instance 9b906c8f-6531-467b-a584-6dd84aa3220f on n-h1-843621-1 May 27 15:42:17.636008 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-394bd6c9-48b1-446a-bbe8-0757a3af9799 req-35a9b02a-8820-4765-b2eb-ce806ac66bc9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047825 May 27 15:42:17.637240 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3206/6421] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:42:18.019328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-007cff22-3410-4dd0-889d-777a4f507256 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:18.019992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-007cff22-3410-4dd0-889d-777a4f507256 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:18.034914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-007cff22-3410-4dd0-889d-777a4f507256 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:18.036540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-007cff22-3410-4dd0-889d-777a4f507256 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:18.042034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-007cff22-3410-4dd0-889d-777a4f507256 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:18.042826 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-007cff22-3410-4dd0-889d-777a4f507256 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:18.170747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7279cab8-dcc9-4c8e-b765-7517aa8de329 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:18.172226 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7279cab8-dcc9-4c8e-b765-7517aa8de329 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:18.202559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7279cab8-dcc9-4c8e-b765-7517aa8de329 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:18.203162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7279cab8-dcc9-4c8e-b765-7517aa8de329 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:18.204036 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7279cab8-dcc9-4c8e-b765-7517aa8de329 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:18.204506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7279cab8-dcc9-4c8e-b765-7517aa8de329 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:18.299000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-007cff22-3410-4dd0-889d-777a4f507256 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:18.311633 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-007cff22-3410-4dd0-889d-777a4f507256 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1564 microversion: 2.1 time: 0.295892 May 27 15:42:18.315884 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3216/6422] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:18 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1564 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:18.333617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2df20201-a5a1-4d51-8f99-71a2b77c366e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:18.334516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2df20201-a5a1-4d51-8f99-71a2b77c366e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:18.348418 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2df20201-a5a1-4d51-8f99-71a2b77c366e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:18.349242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2df20201-a5a1-4d51-8f99-71a2b77c366e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:18.384398 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2df20201-a5a1-4d51-8f99-71a2b77c366e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:18.386312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2df20201-a5a1-4d51-8f99-71a2b77c366e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:18.607037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7279cab8-dcc9-4c8e-b765-7517aa8de329 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:18.617244 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7279cab8-dcc9-4c8e-b765-7517aa8de329 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1342 microversion: 2.1 time: 0.449651 May 27 15:42:18.630622 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3207/6423] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:18 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1342 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:18.667426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2df20201-a5a1-4d51-8f99-71a2b77c366e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:18.678824 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2df20201-a5a1-4d51-8f99-71a2b77c366e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1564 microversion: 2.1 time: 0.347804 May 27 15:42:18.679717 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3217/6424] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:18 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1564 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:19.636483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a47ffb0e-5208-4973-a31f-881207d12093 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:19.638350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a47ffb0e-5208-4973-a31f-881207d12093 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:19.669463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a47ffb0e-5208-4973-a31f-881207d12093 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:19.671322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a47ffb0e-5208-4973-a31f-881207d12093 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:19.681134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a47ffb0e-5208-4973-a31f-881207d12093 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:19.683665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a47ffb0e-5208-4973-a31f-881207d12093 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:20.314932 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a47ffb0e-5208-4973-a31f-881207d12093 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:20.324328 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a47ffb0e-5208-4973-a31f-881207d12093 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1376 microversion: 2.1 time: 0.692520 May 27 15:42:20.325754 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3208/6425] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:19 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1376 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:21.345223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7031ee75-8c24-4dbc-9e32-371f9d5d30c3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:21.346038 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7031ee75-8c24-4dbc-9e32-371f9d5d30c3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:21.354872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7031ee75-8c24-4dbc-9e32-371f9d5d30c3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:21.356162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7031ee75-8c24-4dbc-9e32-371f9d5d30c3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:21.357750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7031ee75-8c24-4dbc-9e32-371f9d5d30c3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:21.358433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7031ee75-8c24-4dbc-9e32-371f9d5d30c3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:21.473656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ac63d07b-1637-4825-be43-6ca46de2c6b5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:21.474829 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ac63d07b-1637-4825-be43-6ca46de2c6b5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:21.486687 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac63d07b-1637-4825-be43-6ca46de2c6b5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:21.487168 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac63d07b-1637-4825-be43-6ca46de2c6b5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:21.487969 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac63d07b-1637-4825-be43-6ca46de2c6b5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:21.489673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac63d07b-1637-4825-be43-6ca46de2c6b5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:21.685366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ac63d07b-1637-4825-be43-6ca46de2c6b5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:21.701843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7031ee75-8c24-4dbc-9e32-371f9d5d30c3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:21.707019 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ac63d07b-1637-4825-be43-6ca46de2c6b5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1564 microversion: 2.1 time: 0.237349 May 27 15:42:21.707627 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3209/6426] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:21 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1564 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:21.715182 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7031ee75-8c24-4dbc-9e32-371f9d5d30c3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1376 microversion: 2.1 time: 0.373553 May 27 15:42:21.715182 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3218/6427] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:21 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1376 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:21.722750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-bcfea60b-e5c1-4255-a739-9a747bfbd5f3 req-fb2d08af-fa9a-4c25-be41-70ac372722d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6356ecad-39d9-4149-8277-8b378d9c806a", "tag": "6ca629e8-ab17-45ed-8a13-e4d4f0af9e12"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:42:21.738725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-bcfea60b-e5c1-4255-a739-9a747bfbd5f3 req-fb2d08af-fa9a-4c25-be41-70ac372722d5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:21.738725 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-bcfea60b-e5c1-4255-a739-9a747bfbd5f3 req-fb2d08af-fa9a-4c25-be41-70ac372722d5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:21.751381 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-bcfea60b-e5c1-4255-a739-9a747bfbd5f3 req-fb2d08af-fa9a-4c25-be41-70ac372722d5 service nova] Creating event network-changed:6ca629e8-ab17-45ed-8a13-e4d4f0af9e12 for instance 6356ecad-39d9-4149-8277-8b378d9c806a on n-h1-843621-1 May 27 15:42:21.757425 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-bcfea60b-e5c1-4255-a739-9a747bfbd5f3 req-fb2d08af-fa9a-4c25-be41-70ac372722d5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041924 May 27 15:42:21.758595 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3219/6428] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:42:22.735254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3753e12c-111f-41b5-aa72-58f8cbd9b258 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:22.735941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3753e12c-111f-41b5-aa72-58f8cbd9b258 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:22.747707 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3753e12c-111f-41b5-aa72-58f8cbd9b258 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:22.748380 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3753e12c-111f-41b5-aa72-58f8cbd9b258 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:22.750107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3753e12c-111f-41b5-aa72-58f8cbd9b258 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:22.750576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3753e12c-111f-41b5-aa72-58f8cbd9b258 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:22.919970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3753e12c-111f-41b5-aa72-58f8cbd9b258 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:22.929098 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3753e12c-111f-41b5-aa72-58f8cbd9b258 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1376 microversion: 2.1 time: 0.198531 May 27 15:42:22.930995 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3210/6429] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:22 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1376 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:23.955424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a501db7c-23d8-4536-bcd7-9808701b0e13 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:23.956320 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a501db7c-23d8-4536-bcd7-9808701b0e13 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:23.962980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a501db7c-23d8-4536-bcd7-9808701b0e13 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:23.963514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a501db7c-23d8-4536-bcd7-9808701b0e13 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:23.964356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a501db7c-23d8-4536-bcd7-9808701b0e13 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:23.964893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a501db7c-23d8-4536-bcd7-9808701b0e13 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:24.123294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a501db7c-23d8-4536-bcd7-9808701b0e13 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:24.132417 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a501db7c-23d8-4536-bcd7-9808701b0e13 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1376 microversion: 2.1 time: 0.188720 May 27 15:42:24.133057 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3220/6430] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:23 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1376 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:25.150501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7d345bc8-6737-4b55-9aed-71b920f6ada1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:25.151151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7d345bc8-6737-4b55-9aed-71b920f6ada1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:25.158994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d345bc8-6737-4b55-9aed-71b920f6ada1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:25.159478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d345bc8-6737-4b55-9aed-71b920f6ada1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:25.160274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d345bc8-6737-4b55-9aed-71b920f6ada1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:25.160773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d345bc8-6737-4b55-9aed-71b920f6ada1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:25.382860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7d345bc8-6737-4b55-9aed-71b920f6ada1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:25.397261 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7d345bc8-6737-4b55-9aed-71b920f6ada1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1376 microversion: 2.1 time: 0.250671 May 27 15:42:25.397868 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3211/6431] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:25 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1376 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:26.415678 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-552471de-0c1e-44f6-8da4-6aadeda86f95 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:26.416225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-552471de-0c1e-44f6-8da4-6aadeda86f95 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:26.423916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-552471de-0c1e-44f6-8da4-6aadeda86f95 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:26.424380 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-552471de-0c1e-44f6-8da4-6aadeda86f95 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:26.425217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-552471de-0c1e-44f6-8da4-6aadeda86f95 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:26.425656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-552471de-0c1e-44f6-8da4-6aadeda86f95 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:26.609592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-552471de-0c1e-44f6-8da4-6aadeda86f95 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:26.618722 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-552471de-0c1e-44f6-8da4-6aadeda86f95 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1376 microversion: 2.1 time: 0.207054 May 27 15:42:26.622676 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3221/6432] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:26 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1376 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:42:27.642758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-db86e89a-12b5-4fbf-bca4-a56677c294dd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:27.643442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-db86e89a-12b5-4fbf-bca4-a56677c294dd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:27.651785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db86e89a-12b5-4fbf-bca4-a56677c294dd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:27.652379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db86e89a-12b5-4fbf-bca4-a56677c294dd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:27.653275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db86e89a-12b5-4fbf-bca4-a56677c294dd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:27.653921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db86e89a-12b5-4fbf-bca4-a56677c294dd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:27.869948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-db86e89a-12b5-4fbf-bca4-a56677c294dd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:27.883323 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-db86e89a-12b5-4fbf-bca4-a56677c294dd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1376 microversion: 2.1 time: 0.246845 May 27 15:42:27.884218 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3212/6433] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:27 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1376 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:28.905635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-42b5c293-c84f-4d89-91a4-0457279b2def tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:28.906405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-42b5c293-c84f-4d89-91a4-0457279b2def tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:28.913935 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42b5c293-c84f-4d89-91a4-0457279b2def tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:28.914622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42b5c293-c84f-4d89-91a4-0457279b2def tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:28.915639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42b5c293-c84f-4d89-91a4-0457279b2def tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:28.916228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42b5c293-c84f-4d89-91a4-0457279b2def tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:29.153299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-42b5c293-c84f-4d89-91a4-0457279b2def tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:29.161345 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-42b5c293-c84f-4d89-91a4-0457279b2def tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1376 microversion: 2.1 time: 0.259615 May 27 15:42:29.161942 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3222/6434] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:28 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1376 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:30.180732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-149a78a5-aa22-47bc-a0c4-c4a74057b0be tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:30.181734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-149a78a5-aa22-47bc-a0c4-c4a74057b0be tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:30.190001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-149a78a5-aa22-47bc-a0c4-c4a74057b0be tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:30.190652 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-149a78a5-aa22-47bc-a0c4-c4a74057b0be tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:30.191814 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-149a78a5-aa22-47bc-a0c4-c4a74057b0be tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:30.192583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-149a78a5-aa22-47bc-a0c4-c4a74057b0be tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:30.339344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-149a78a5-aa22-47bc-a0c4-c4a74057b0be tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:30.349231 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-149a78a5-aa22-47bc-a0c4-c4a74057b0be tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1376 microversion: 2.1 time: 0.173667 May 27 15:42:30.360247 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3213/6435] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:30 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1376 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:30.503024 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-f20a8f01-3380-497c-bfbb-e6003828e9fa req-4ca312fb-32a6-47cc-9516-6efe176b2821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb94ca36-b7e2-4e64-b7b9-367737956d7d", "name": "network-vif-plugged", "status": "completed", "tag": "cdde177a-5a35-4a1d-92a8-6b46b3588b45"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:42:30.517986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f20a8f01-3380-497c-bfbb-e6003828e9fa req-4ca312fb-32a6-47cc-9516-6efe176b2821 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:30.519066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f20a8f01-3380-497c-bfbb-e6003828e9fa req-4ca312fb-32a6-47cc-9516-6efe176b2821 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:30.533836 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-f20a8f01-3380-497c-bfbb-e6003828e9fa req-4ca312fb-32a6-47cc-9516-6efe176b2821 service nova] Creating event network-vif-plugged:cdde177a-5a35-4a1d-92a8-6b46b3588b45 for instance eb94ca36-b7e2-4e64-b7b9-367737956d7d on n-h2-843621-1 May 27 15:42:30.540077 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-f20a8f01-3380-497c-bfbb-e6003828e9fa req-4ca312fb-32a6-47cc-9516-6efe176b2821 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042234 May 27 15:42:30.540859 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3223/6436] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:42:31.367778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0ad86be5-f59a-4fe0-a928-c774bfc77152 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:31.368420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0ad86be5-f59a-4fe0-a928-c774bfc77152 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:31.377493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ad86be5-f59a-4fe0-a928-c774bfc77152 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:31.377998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ad86be5-f59a-4fe0-a928-c774bfc77152 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:31.378803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ad86be5-f59a-4fe0-a928-c774bfc77152 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:31.379261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ad86be5-f59a-4fe0-a928-c774bfc77152 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:31.631222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0ad86be5-f59a-4fe0-a928-c774bfc77152 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:31.655820 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0ad86be5-f59a-4fe0-a928-c774bfc77152 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1376 microversion: 2.1 time: 0.292635 May 27 15:42:31.656711 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3214/6437] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:31 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1376 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:32.676557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d725c5c4-21ce-4c97-9c27-2a271af31b77 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:32.677333 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d725c5c4-21ce-4c97-9c27-2a271af31b77 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:32.685622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d725c5c4-21ce-4c97-9c27-2a271af31b77 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:32.686983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d725c5c4-21ce-4c97-9c27-2a271af31b77 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:32.688306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d725c5c4-21ce-4c97-9c27-2a271af31b77 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:32.688778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d725c5c4-21ce-4c97-9c27-2a271af31b77 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:32.938036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d725c5c4-21ce-4c97-9c27-2a271af31b77 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:32.952586 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d725c5c4-21ce-4c97-9c27-2a271af31b77 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1562 microversion: 2.1 time: 0.282938 May 27 15:42:32.956541 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3224/6438] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:32 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1562 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:32.979430 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ba259b23-9243-4f9a-86d6-f9eb166aadca tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:32.980228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ba259b23-9243-4f9a-86d6-f9eb166aadca tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:32.992333 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba259b23-9243-4f9a-86d6-f9eb166aadca tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:32.993138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba259b23-9243-4f9a-86d6-f9eb166aadca tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:32.994103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba259b23-9243-4f9a-86d6-f9eb166aadca tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:32.994718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba259b23-9243-4f9a-86d6-f9eb166aadca tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:33.323025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ba259b23-9243-4f9a-86d6-f9eb166aadca tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:33.332051 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ba259b23-9243-4f9a-86d6-f9eb166aadca tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1562 microversion: 2.1 time: 0.362248 May 27 15:42:33.332765 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3215/6439] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:32 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1562 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:33.426146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2f4954c1-ae7e-4c0d-b411-d0e2bf8fcc98 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:33.428404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2f4954c1-ae7e-4c0d-b411-d0e2bf8fcc98 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:33.433240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2f4954c1-ae7e-4c0d-b411-d0e2bf8fcc98 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:33.433698 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2f4954c1-ae7e-4c0d-b411-d0e2bf8fcc98 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:33.434513 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2f4954c1-ae7e-4c0d-b411-d0e2bf8fcc98 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:33.434933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2f4954c1-ae7e-4c0d-b411-d0e2bf8fcc98 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:33.462096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2f4954c1-ae7e-4c0d-b411-d0e2bf8fcc98 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:42:33.557092 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2f4954c1-ae7e-4c0d-b411-d0e2bf8fcc98 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "DELETE /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 204 len: 0 microversion: 2.1 time: 0.134603 May 27 15:42:33.558755 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3225/6440] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:42:33 2022] DELETE /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:42:33.567441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4713e0c1-9edc-4259-ac67-5a7f86eff852 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:33.568491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4713e0c1-9edc-4259-ac67-5a7f86eff852 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:33.570755 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=52 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:42:33.576804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4713e0c1-9edc-4259-ac67-5a7f86eff852 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:33.577332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4713e0c1-9edc-4259-ac67-5a7f86eff852 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:33.578384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4713e0c1-9edc-4259-ac67-5a7f86eff852 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:33.578930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4713e0c1-9edc-4259-ac67-5a7f86eff852 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:33.828506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4713e0c1-9edc-4259-ac67-5a7f86eff852 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:33.838238 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4713e0c1-9edc-4259-ac67-5a7f86eff852 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1568 microversion: 2.1 time: 0.274642 May 27 15:42:33.838826 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3216/6441] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:33 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1568 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:34.858343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-08266996-c129-4e21-90a5-bccdf792165e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:34.859769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-08266996-c129-4e21-90a5-bccdf792165e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:34.865387 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:42:34.873765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08266996-c129-4e21-90a5-bccdf792165e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:34.874591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08266996-c129-4e21-90a5-bccdf792165e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:34.875798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08266996-c129-4e21-90a5-bccdf792165e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:34.876652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-08266996-c129-4e21-90a5-bccdf792165e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:35.105062 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-08266996-c129-4e21-90a5-bccdf792165e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:35.113934 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-08266996-c129-4e21-90a5-bccdf792165e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1568 microversion: 2.1 time: 0.261999 May 27 15:42:35.120775 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3226/6442] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:34 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1568 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:35.435344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d96e6d8e-d083-422a-979e-549c35cd20d6 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Action: 'create', calling method: .version_select at 0x7fc775f0d1f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-274714903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFP520SmIX8yCi1OnssZ52DjqqNiepfAPQYfEgs7QMRv/EcvWk9ERvkoJIoS1sqi0bGvWV7hpjoofVQ/Ti2L0bK9/ul+3UqeTQwAdHok7Z6T0nsUwJrlV/GPbCeObEzEdQ=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:42:35.455360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-d96e6d8e-d083-422a-979e-549c35cd20d6 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Getting quotas for project 750a9fb34cb440b98e8a99f3a0775da2. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:42:35.464560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-d96e6d8e-d083-422a-979e-549c35cd20d6 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Getting quotas for user ca3a1b4ce9b04d87978051169855e4a8 and project 750a9fb34cb440b98e8a99f3a0775da2. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:42:35.497941 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d96e6d8e-d083-422a-979e-549c35cd20d6 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.066951 May 27 15:42:35.499116 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3217/6443] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:42:35 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:42:35.874022 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-6424d01a-c90c-4b78-96ed-109abd2e87f8 req-683c87ed-2c36-4945-b074-c5015d3036f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb94ca36-b7e2-4e64-b7b9-367737956d7d", "name": "network-vif-deleted", "tag": "cdde177a-5a35-4a1d-92a8-6b46b3588b45"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:42:35.912623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6424d01a-c90c-4b78-96ed-109abd2e87f8 req-683c87ed-2c36-4945-b074-c5015d3036f8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:35.913188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6424d01a-c90c-4b78-96ed-109abd2e87f8 req-683c87ed-2c36-4945-b074-c5015d3036f8 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:35.937431 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-6424d01a-c90c-4b78-96ed-109abd2e87f8 req-683c87ed-2c36-4945-b074-c5015d3036f8 service nova] Creating event network-vif-deleted:cdde177a-5a35-4a1d-92a8-6b46b3588b45 for instance eb94ca36-b7e2-4e64-b7b9-367737956d7d on n-h2-843621-1 May 27 15:42:35.946443 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-6424d01a-c90c-4b78-96ed-109abd2e87f8 req-683c87ed-2c36-4945-b074-c5015d3036f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078670 May 27 15:42:35.947720 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3227/6444] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:42:36.131914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3944a760-5b4d-4509-930a-5f7a42bfeb10 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:36.137204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3944a760-5b4d-4509-930a-5f7a42bfeb10 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:36.165716 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3944a760-5b4d-4509-930a-5f7a42bfeb10 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:36.167459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3944a760-5b4d-4509-930a-5f7a42bfeb10 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:36.179842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3944a760-5b4d-4509-930a-5f7a42bfeb10 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:36.180608 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3944a760-5b4d-4509-930a-5f7a42bfeb10 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:36.395765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3944a760-5b4d-4509-930a-5f7a42bfeb10 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:36.409527 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3944a760-5b4d-4509-930a-5f7a42bfeb10 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1361 microversion: 2.1 time: 0.280313 May 27 15:42:36.423191 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3218/6445] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:36 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1361 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:37.431233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2f8ea18a-f28e-4edb-8509-26a170279478 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:37.433849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2f8ea18a-f28e-4edb-8509-26a170279478 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:37.450552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2f8ea18a-f28e-4edb-8509-26a170279478 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:37.451156 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2f8ea18a-f28e-4edb-8509-26a170279478 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:37.452083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2f8ea18a-f28e-4edb-8509-26a170279478 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:37.452713 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2f8ea18a-f28e-4edb-8509-26a170279478 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:37.516072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2b5bde64-c04d-47e7-9992-8b6c4b2c213a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-545845202", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "c9addded-0237-4855-98c0-ce5ad4c175f4"}], "key_name": "tempest-TestNetworkBasicOps-274714903", "security_groups": [{"name": "tempest-secgroup-smoke-1053556128"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:42:37.542511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2f8ea18a-f28e-4edb-8509-26a170279478 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:37.551499 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2f8ea18a-f28e-4edb-8509-26a170279478 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1361 microversion: 2.1 time: 0.126573 May 27 15:42:37.552773 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3228/6446] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:37 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1361 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:37.650577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-2b5bde64-c04d-47e7-9992-8b6c4b2c213a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] validate_networks() for [('c9addded-0237-4855-98c0-ce5ad4c175f4', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:42:38.052831 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-2b5bde64-c04d-47e7-9992-8b6c4b2c213a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:42:38.053274 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-2b5bde64-c04d-47e7-9992-8b6c4b2c213a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:42:38.053765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-2b5bde64-c04d-47e7-9992-8b6c4b2c213a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:42:38.054195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-2b5bde64-c04d-47e7-9992-8b6c4b2c213a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:42:38.054624 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-2b5bde64-c04d-47e7-9992-8b6c4b2c213a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:42:38.065909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b5bde64-c04d-47e7-9992-8b6c4b2c213a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:38.066413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b5bde64-c04d-47e7-9992-8b6c4b2c213a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:38.067402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b5bde64-c04d-47e7-9992-8b6c4b2c213a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:38.068019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b5bde64-c04d-47e7-9992-8b6c4b2c213a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:38.093920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-2b5bde64-c04d-47e7-9992-8b6c4b2c213a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Getting quotas for project 750a9fb34cb440b98e8a99f3a0775da2. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:42:38.100966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-2b5bde64-c04d-47e7-9992-8b6c4b2c213a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Getting quotas for user ca3a1b4ce9b04d87978051169855e4a8 and project 750a9fb34cb440b98e8a99f3a0775da2. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:42:38.116302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2b5bde64-c04d-47e7-9992-8b6c4b2c213a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:42:38.119591 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2b5bde64-c04d-47e7-9992-8b6c4b2c213a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 6087fdea-edfd-41b9-98c8-ae168fadaf81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:42:38.185588 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2b5bde64-c04d-47e7-9992-8b6c4b2c213a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.674190 May 27 15:42:38.187067 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3219/6447] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:42:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 15:42:38.197177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-96e473fe-099e-4e0e-aa57-2b76a7160472 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:38.197866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-96e473fe-099e-4e0e-aa57-2b76a7160472 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 6087fdea-edfd-41b9-98c8-ae168fadaf81] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:38.315196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-96e473fe-099e-4e0e-aa57-2b76a7160472 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:38.340330 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-96e473fe-099e-4e0e-aa57-2b76a7160472 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81" status: 200 len: 1247 microversion: 2.1 time: 0.147111 May 27 15:42:38.351933 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3229/6448] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:38 2022] GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81 => generated 1247 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:38.571462 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f3e672da-8826-44b5-8f13-0af691d6b786 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:38.572359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f3e672da-8826-44b5-8f13-0af691d6b786 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:38.590946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f3e672da-8826-44b5-8f13-0af691d6b786 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:38.591623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f3e672da-8826-44b5-8f13-0af691d6b786 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:38.593097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f3e672da-8826-44b5-8f13-0af691d6b786 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:38.593644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f3e672da-8826-44b5-8f13-0af691d6b786 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:38.689545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f3e672da-8826-44b5-8f13-0af691d6b786 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:38.700042 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f3e672da-8826-44b5-8f13-0af691d6b786 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1361 microversion: 2.1 time: 0.134533 May 27 15:42:38.701175 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3220/6449] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:38 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1361 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:39.361540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d55e39cd-3916-4dd4-b437-65134a50ede9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:39.363288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d55e39cd-3916-4dd4-b437-65134a50ede9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 6087fdea-edfd-41b9-98c8-ae168fadaf81] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:39.371504 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d55e39cd-3916-4dd4-b437-65134a50ede9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:39.372241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d55e39cd-3916-4dd4-b437-65134a50ede9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:39.374306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d55e39cd-3916-4dd4-b437-65134a50ede9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:39.375144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d55e39cd-3916-4dd4-b437-65134a50ede9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:39.472918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d55e39cd-3916-4dd4-b437-65134a50ede9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:39.487389 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d55e39cd-3916-4dd4-b437-65134a50ede9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81" status: 200 len: 1299 microversion: 2.1 time: 0.131541 May 27 15:42:39.488477 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3230/6450] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:39 2022] GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81 => generated 1299 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:39.720940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e246d43c-f46f-4161-b457-8474390c1080 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:39.721620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e246d43c-f46f-4161-b457-8474390c1080 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:39.730382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e246d43c-f46f-4161-b457-8474390c1080 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:39.731221 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e246d43c-f46f-4161-b457-8474390c1080 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:39.732086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e246d43c-f46f-4161-b457-8474390c1080 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:39.733116 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e246d43c-f46f-4161-b457-8474390c1080 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:39.816423 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e246d43c-f46f-4161-b457-8474390c1080 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:39.828473 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e246d43c-f46f-4161-b457-8474390c1080 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1361 microversion: 2.1 time: 0.111998 May 27 15:42:39.829255 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3221/6451] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:39 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1361 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:40.515358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-153b4295-c387-4a53-8bcc-0d670e0e4072 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:40.517075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-153b4295-c387-4a53-8bcc-0d670e0e4072 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 6087fdea-edfd-41b9-98c8-ae168fadaf81] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:40.529257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-153b4295-c387-4a53-8bcc-0d670e0e4072 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:40.529820 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-153b4295-c387-4a53-8bcc-0d670e0e4072 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:40.530974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-153b4295-c387-4a53-8bcc-0d670e0e4072 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:40.531435 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-153b4295-c387-4a53-8bcc-0d670e0e4072 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:40.852100 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-131ec8e5-56da-47d1-8e98-afda54f0afe8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:40.855329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-131ec8e5-56da-47d1-8e98-afda54f0afe8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:40.871094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-153b4295-c387-4a53-8bcc-0d670e0e4072 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:40.881477 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-131ec8e5-56da-47d1-8e98-afda54f0afe8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:40.883986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-131ec8e5-56da-47d1-8e98-afda54f0afe8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:40.885686 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-153b4295-c387-4a53-8bcc-0d670e0e4072 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81" status: 200 len: 1373 microversion: 2.1 time: 0.380331 May 27 15:42:40.888371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-131ec8e5-56da-47d1-8e98-afda54f0afe8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:40.888531 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3231/6452] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:40 2022] GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81 => generated 1373 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:40.889205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-131ec8e5-56da-47d1-8e98-afda54f0afe8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:40.987044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-131ec8e5-56da-47d1-8e98-afda54f0afe8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:40.990571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:42:40.997295 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-131ec8e5-56da-47d1-8e98-afda54f0afe8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1361 microversion: 2.1 time: 0.155698 May 27 15:42:41.007620 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3222/6453] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:40 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:41.219377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-655df557-a044-4797-87da-479b17207d5a req-afb558a4-94a6-4f7d-96d2-8e393dbf7515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6087fdea-edfd-41b9-98c8-ae168fadaf81", "tag": "01fc641f-9507-496a-b5e4-68418ee850ce"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:42:41.239805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-655df557-a044-4797-87da-479b17207d5a req-afb558a4-94a6-4f7d-96d2-8e393dbf7515 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:41.240637 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-655df557-a044-4797-87da-479b17207d5a req-afb558a4-94a6-4f7d-96d2-8e393dbf7515 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:41.256350 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-655df557-a044-4797-87da-479b17207d5a req-afb558a4-94a6-4f7d-96d2-8e393dbf7515 service nova] Creating event network-changed:01fc641f-9507-496a-b5e4-68418ee850ce for instance 6087fdea-edfd-41b9-98c8-ae168fadaf81 on n-h1-843621-1 May 27 15:42:41.265066 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-655df557-a044-4797-87da-479b17207d5a req-afb558a4-94a6-4f7d-96d2-8e393dbf7515 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057379 May 27 15:42:41.266297 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3232/6454] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:42:41.906471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ea1d240d-f093-4b08-92c2-e10110a16906 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:41.907109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ea1d240d-f093-4b08-92c2-e10110a16906 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 6087fdea-edfd-41b9-98c8-ae168fadaf81] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:41.916490 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea1d240d-f093-4b08-92c2-e10110a16906 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:41.917303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea1d240d-f093-4b08-92c2-e10110a16906 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:41.918244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea1d240d-f093-4b08-92c2-e10110a16906 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:41.918715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ea1d240d-f093-4b08-92c2-e10110a16906 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:42.023298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8a8b8233-a23e-447b-8ace-1e24e4d6b5e4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:42.024882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8a8b8233-a23e-447b-8ace-1e24e4d6b5e4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:42.032357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a8b8233-a23e-447b-8ace-1e24e4d6b5e4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:42.033086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a8b8233-a23e-447b-8ace-1e24e4d6b5e4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:42.034137 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a8b8233-a23e-447b-8ace-1e24e4d6b5e4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:42.034750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a8b8233-a23e-447b-8ace-1e24e4d6b5e4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:42.108967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ea1d240d-f093-4b08-92c2-e10110a16906 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:42.117790 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ea1d240d-f093-4b08-92c2-e10110a16906 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81" status: 200 len: 1373 microversion: 2.1 time: 0.214848 May 27 15:42:42.119526 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3223/6455] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:41 2022] GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81 => generated 1373 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:42:42.133211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8a8b8233-a23e-447b-8ace-1e24e4d6b5e4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:42.135797 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:42:42.144909 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8a8b8233-a23e-447b-8ace-1e24e4d6b5e4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1361 microversion: 2.1 time: 0.133288 May 27 15:42:42.145674 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3233/6456] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:42 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1361 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:42:43.137613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-88ebbda5-bb51-4db4-977c-899b10bc1325 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:43.139898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-88ebbda5-bb51-4db4-977c-899b10bc1325 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 6087fdea-edfd-41b9-98c8-ae168fadaf81] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:43.150549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88ebbda5-bb51-4db4-977c-899b10bc1325 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:43.151825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88ebbda5-bb51-4db4-977c-899b10bc1325 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:43.152907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88ebbda5-bb51-4db4-977c-899b10bc1325 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:43.153876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-88ebbda5-bb51-4db4-977c-899b10bc1325 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:43.165746 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-083158bf-e552-4f6b-bc27-1608b42e01c7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:43.166903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-083158bf-e552-4f6b-bc27-1608b42e01c7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:43.182145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-083158bf-e552-4f6b-bc27-1608b42e01c7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:43.184045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-083158bf-e552-4f6b-bc27-1608b42e01c7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:43.184956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-083158bf-e552-4f6b-bc27-1608b42e01c7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:43.188944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-083158bf-e552-4f6b-bc27-1608b42e01c7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:43.298391 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-083158bf-e552-4f6b-bc27-1608b42e01c7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:43.306449 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-083158bf-e552-4f6b-bc27-1608b42e01c7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1361 microversion: 2.1 time: 0.147129 May 27 15:42:43.317534 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3234/6457] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:43 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:43.381903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-88ebbda5-bb51-4db4-977c-899b10bc1325 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:43.391579 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-88ebbda5-bb51-4db4-977c-899b10bc1325 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81" status: 200 len: 1373 microversion: 2.1 time: 0.259425 May 27 15:42:43.392163 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3224/6458] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:43 2022] GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81 => generated 1373 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:44.324328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-df691bc1-d225-4f61-ac10-1371008a0716 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:44.325834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-df691bc1-d225-4f61-ac10-1371008a0716 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:44.334058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df691bc1-d225-4f61-ac10-1371008a0716 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:44.334278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df691bc1-d225-4f61-ac10-1371008a0716 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:44.335051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df691bc1-d225-4f61-ac10-1371008a0716 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:44.335792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-df691bc1-d225-4f61-ac10-1371008a0716 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:44.408999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-635d4ffa-e4a9-4bf8-a7e4-3db412641ded tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:44.410405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-635d4ffa-e4a9-4bf8-a7e4-3db412641ded tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 6087fdea-edfd-41b9-98c8-ae168fadaf81] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:44.428940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-635d4ffa-e4a9-4bf8-a7e4-3db412641ded tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:44.429754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-635d4ffa-e4a9-4bf8-a7e4-3db412641ded tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:44.430913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-635d4ffa-e4a9-4bf8-a7e4-3db412641ded tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:44.431628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-635d4ffa-e4a9-4bf8-a7e4-3db412641ded tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:44.439223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-df691bc1-d225-4f61-ac10-1371008a0716 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:44.452541 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-df691bc1-d225-4f61-ac10-1371008a0716 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1361 microversion: 2.1 time: 0.131498 May 27 15:42:44.453575 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3235/6459] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:44 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1361 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:44.590225 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-635d4ffa-e4a9-4bf8-a7e4-3db412641ded tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:44.599800 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-635d4ffa-e4a9-4bf8-a7e4-3db412641ded tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81" status: 200 len: 1373 microversion: 2.1 time: 0.195188 May 27 15:42:44.600501 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3225/6460] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:44 2022] GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81 => generated 1373 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:45.470568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fb1d4384-d91d-4999-a4cd-ea8f88ecd6bb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:45.471223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fb1d4384-d91d-4999-a4cd-ea8f88ecd6bb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:45.478381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb1d4384-d91d-4999-a4cd-ea8f88ecd6bb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:45.478785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb1d4384-d91d-4999-a4cd-ea8f88ecd6bb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:45.479561 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb1d4384-d91d-4999-a4cd-ea8f88ecd6bb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:45.480008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fb1d4384-d91d-4999-a4cd-ea8f88ecd6bb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:45.544360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fb1d4384-d91d-4999-a4cd-ea8f88ecd6bb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:45.553469 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fb1d4384-d91d-4999-a4cd-ea8f88ecd6bb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1361 microversion: 2.1 time: 0.087362 May 27 15:42:45.554052 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3236/6461] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:45 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1361 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:45.616554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e7cdc96b-90de-4cb6-ad35-f29d337e137e tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:45.617421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e7cdc96b-90de-4cb6-ad35-f29d337e137e tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 6087fdea-edfd-41b9-98c8-ae168fadaf81] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:45.624521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7cdc96b-90de-4cb6-ad35-f29d337e137e tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:45.625828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7cdc96b-90de-4cb6-ad35-f29d337e137e tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:45.625828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7cdc96b-90de-4cb6-ad35-f29d337e137e tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:45.626253 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7cdc96b-90de-4cb6-ad35-f29d337e137e tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:45.772157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e7cdc96b-90de-4cb6-ad35-f29d337e137e tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:45.780484 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e7cdc96b-90de-4cb6-ad35-f29d337e137e tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81" status: 200 len: 1373 microversion: 2.1 time: 0.167810 May 27 15:42:45.781458 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3226/6462] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:45 2022] GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:46.573146 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d11dc49b-8f06-430b-975b-770fb9b59f3f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:46.573653 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d11dc49b-8f06-430b-975b-770fb9b59f3f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:46.585136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d11dc49b-8f06-430b-975b-770fb9b59f3f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:46.585870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d11dc49b-8f06-430b-975b-770fb9b59f3f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:46.587138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d11dc49b-8f06-430b-975b-770fb9b59f3f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:46.587744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d11dc49b-8f06-430b-975b-770fb9b59f3f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:46.627761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d11dc49b-8f06-430b-975b-770fb9b59f3f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:46.628467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d11dc49b-8f06-430b-975b-770fb9b59f3f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:46.629113 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-d11dc49b-8f06-430b-975b-770fb9b59f3f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lazy-loading 'fault' on Instance uuid eb94ca36-b7e2-4e64-b7b9-367737956d7d {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:42:46.673412 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d11dc49b-8f06-430b-975b-770fb9b59f3f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:46.682201 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d11dc49b-8f06-430b-975b-770fb9b59f3f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 200 len: 1320 microversion: 2.1 time: 0.114878 May 27 15:42:46.682889 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3237/6463] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:46 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 1320 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:46.799244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4701c3de-8ade-4887-84a2-2813f6cf8942 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:46.799877 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4701c3de-8ade-4887-84a2-2813f6cf8942 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 6087fdea-edfd-41b9-98c8-ae168fadaf81] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:46.806037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4701c3de-8ade-4887-84a2-2813f6cf8942 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:46.806507 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4701c3de-8ade-4887-84a2-2813f6cf8942 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:46.807299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4701c3de-8ade-4887-84a2-2813f6cf8942 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:46.807757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4701c3de-8ade-4887-84a2-2813f6cf8942 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:46.949066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4701c3de-8ade-4887-84a2-2813f6cf8942 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:46.956902 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4701c3de-8ade-4887-84a2-2813f6cf8942 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81" status: 200 len: 1373 microversion: 2.1 time: 0.163165 May 27 15:42:46.957718 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3227/6464] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:46 2022] GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:47.699416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-841eff71-868a-4bb6-858a-417977011aa4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:47.700083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-841eff71-868a-4bb6-858a-417977011aa4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:47.707962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-841eff71-868a-4bb6-858a-417977011aa4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:47.708478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-841eff71-868a-4bb6-858a-417977011aa4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:47.709288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-841eff71-868a-4bb6-858a-417977011aa4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:47.709736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-841eff71-868a-4bb6-858a-417977011aa4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:47.726474 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-841eff71-868a-4bb6-858a-417977011aa4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] HTTP exception thrown: Instance eb94ca36-b7e2-4e64-b7b9-367737956d7d could not be found. May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-841eff71-868a-4bb6-858a-417977011aa4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Request method failure captured: May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d HTTP/1.1 May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikO_1Chjp-7OdQPlgoy0i68J74Yy9denIkk1niNkSk2uFWUy4CftwGV6LxM4FCEGakqUTp0mkulJ5awBDUhVVOjGCfP23UpxiQizq-3BPePUyAFyMxEgrT5T05iojcJbMyfNSyzYbX68HBU5apXXyE_-yRBe0ARJTHso9aoG2B7TFtpc May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_536a3b9dd9a745c089e2da27b9f536ff", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TestVolumeBootPattern-685942222 May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TestVolumeBootPattern-685942222-project May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: a058052ef3fd4ee58291ccc9837558cc May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TestVolumeBootPattern-685942222-project May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance eb94ca36-b7e2-4e64-b7b9-367737956d7d could not be found. May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'eb94ca36-b7e2-4e64-b7b9-367737956d7d'} May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb94ca36-b7e2-4e64-b7b9-367737956d7d could not be found. May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb94ca36-b7e2-4e64-b7b9-367737956d7d could not be found. May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:42:47.728157 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:42:47.732830 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:42:47.732830 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:42:47.732830 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:42:47.732830 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:42:47.732830 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:42:47.732830 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb94ca36-b7e2-4e64-b7b9-367737956d7d could not be found. May 27 15:42:47.732830 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:42:47.732830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-841eff71-868a-4bb6-858a-417977011aa4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Returning 404 to user: Instance eb94ca36-b7e2-4e64-b7b9-367737956d7d could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:42:47.732830 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-841eff71-868a-4bb6-858a-417977011aa4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 404 len: 111 microversion: 2.1 time: 0.034217 May 27 15:42:47.733588 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3238/6465] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:47 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:42:47.973893 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-34257ae6-b1b4-4f7f-bcab-6920ba4907fb req-ecbfb142-0aa2-4555-8ef7-8ba1f08a4c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6087fdea-edfd-41b9-98c8-ae168fadaf81", "name": "network-vif-plugged", "status": "completed", "tag": "01fc641f-9507-496a-b5e4-68418ee850ce"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:42:47.976136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-424d3bf8-11cf-41b2-8320-b0f7b851cbef tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:47.977883 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-424d3bf8-11cf-41b2-8320-b0f7b851cbef tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 6087fdea-edfd-41b9-98c8-ae168fadaf81] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:47.986310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-424d3bf8-11cf-41b2-8320-b0f7b851cbef tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:47.987101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-424d3bf8-11cf-41b2-8320-b0f7b851cbef tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:47.988095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-424d3bf8-11cf-41b2-8320-b0f7b851cbef tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:47.988729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-424d3bf8-11cf-41b2-8320-b0f7b851cbef tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:47.993278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-34257ae6-b1b4-4f7f-bcab-6920ba4907fb req-ecbfb142-0aa2-4555-8ef7-8ba1f08a4c1e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:47.994134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-34257ae6-b1b4-4f7f-bcab-6920ba4907fb req-ecbfb142-0aa2-4555-8ef7-8ba1f08a4c1e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:48.010483 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-34257ae6-b1b4-4f7f-bcab-6920ba4907fb req-ecbfb142-0aa2-4555-8ef7-8ba1f08a4c1e service nova] Creating event network-vif-plugged:01fc641f-9507-496a-b5e4-68418ee850ce for instance 6087fdea-edfd-41b9-98c8-ae168fadaf81 on n-h1-843621-1 May 27 15:42:48.021054 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-34257ae6-b1b4-4f7f-bcab-6920ba4907fb req-ecbfb142-0aa2-4555-8ef7-8ba1f08a4c1e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052727 May 27 15:42:48.022927 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3228/6466] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:42:48.156965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-424d3bf8-11cf-41b2-8320-b0f7b851cbef tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:48.165645 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-424d3bf8-11cf-41b2-8320-b0f7b851cbef tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81" status: 200 len: 1373 microversion: 2.1 time: 0.195304 May 27 15:42:48.167210 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3239/6467] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:47 2022] GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81 => generated 1373 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:49.186774 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3cf3cfd1-6014-4ead-9331-d16ff6e8a221 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:49.189564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3cf3cfd1-6014-4ead-9331-d16ff6e8a221 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 6087fdea-edfd-41b9-98c8-ae168fadaf81] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:49.192043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:42:49.193779 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=10 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:42:49.205527 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3cf3cfd1-6014-4ead-9331-d16ff6e8a221 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:49.206246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3cf3cfd1-6014-4ead-9331-d16ff6e8a221 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:49.207477 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3cf3cfd1-6014-4ead-9331-d16ff6e8a221 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:49.208168 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3cf3cfd1-6014-4ead-9331-d16ff6e8a221 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:49.407415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3cf3cfd1-6014-4ead-9331-d16ff6e8a221 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:49.417537 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3cf3cfd1-6014-4ead-9331-d16ff6e8a221 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81" status: 200 len: 1373 microversion: 2.1 time: 0.237501 May 27 15:42:49.420389 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3229/6468] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:49 2022] GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81 => generated 1373 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:50.284194 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-1756fb03-52db-434a-af92-55fc722058d0 req-09bb28c6-a024-4a85-adcb-4af057a41e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b906c8f-6531-467b-a584-6dd84aa3220f", "tag": "9c47d3f6-239b-470a-8b8a-e72ffb217963"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:42:50.287085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7e92c2fa-d3f6-4a14-bd9b-8d861940ba28 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:50.287779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7e92c2fa-d3f6-4a14-bd9b-8d861940ba28 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:50.298702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:42:50.305870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-1756fb03-52db-434a-af92-55fc722058d0 req-09bb28c6-a024-4a85-adcb-4af057a41e6c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:50.306327 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-1756fb03-52db-434a-af92-55fc722058d0 req-09bb28c6-a024-4a85-adcb-4af057a41e6c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:50.308328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e92c2fa-d3f6-4a14-bd9b-8d861940ba28 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:50.308835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e92c2fa-d3f6-4a14-bd9b-8d861940ba28 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:50.309632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e92c2fa-d3f6-4a14-bd9b-8d861940ba28 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:50.310084 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e92c2fa-d3f6-4a14-bd9b-8d861940ba28 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:50.332884 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-1756fb03-52db-434a-af92-55fc722058d0 req-09bb28c6-a024-4a85-adcb-4af057a41e6c service nova] Creating event network-changed:9c47d3f6-239b-470a-8b8a-e72ffb217963 for instance 9b906c8f-6531-467b-a584-6dd84aa3220f on n-h1-843621-1 May 27 15:42:50.343779 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-1756fb03-52db-434a-af92-55fc722058d0 req-09bb28c6-a024-4a85-adcb-4af057a41e6c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063725 May 27 15:42:50.344411 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3230/6469] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:42:50.368843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7e92c2fa-d3f6-4a14-bd9b-8d861940ba28 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:42:50.437854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2b8b79f1-3667-4f9a-be65-bab7d163a17a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:50.439002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2b8b79f1-3667-4f9a-be65-bab7d163a17a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 6087fdea-edfd-41b9-98c8-ae168fadaf81] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:50.456968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b8b79f1-3667-4f9a-be65-bab7d163a17a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:50.458358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b8b79f1-3667-4f9a-be65-bab7d163a17a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:50.462271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b8b79f1-3667-4f9a-be65-bab7d163a17a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:50.462918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b8b79f1-3667-4f9a-be65-bab7d163a17a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:50.515959 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7e92c2fa-d3f6-4a14-bd9b-8d861940ba28 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 204 len: 0 microversion: 2.1 time: 0.238953 May 27 15:42:50.516861 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3240/6470] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:42:50 2022] DELETE /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:42:50.528495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3e4aba43-9e67-40ee-a369-e744162927f3 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:50.531011 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3e4aba43-9e67-40ee-a369-e744162927f3 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:50.544473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e4aba43-9e67-40ee-a369-e744162927f3 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:50.546530 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e4aba43-9e67-40ee-a369-e744162927f3 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:50.549207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e4aba43-9e67-40ee-a369-e744162927f3 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:50.551056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3e4aba43-9e67-40ee-a369-e744162927f3 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:50.725318 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2b8b79f1-3667-4f9a-be65-bab7d163a17a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:50.744744 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2b8b79f1-3667-4f9a-be65-bab7d163a17a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81" status: 200 len: 1546 microversion: 2.1 time: 0.312498 May 27 15:42:50.746770 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3231/6471] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:50 2022] GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81 => generated 1546 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:42:50.781201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3f1229f2-13ba-41fe-9bc0-d814bc219705 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:50.782739 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3f1229f2-13ba-41fe-9bc0-d814bc219705 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 6087fdea-edfd-41b9-98c8-ae168fadaf81] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:50.795419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f1229f2-13ba-41fe-9bc0-d814bc219705 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:50.796246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f1229f2-13ba-41fe-9bc0-d814bc219705 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:50.797313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f1229f2-13ba-41fe-9bc0-d814bc219705 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:50.798023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f1229f2-13ba-41fe-9bc0-d814bc219705 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:50.867911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3e4aba43-9e67-40ee-a369-e744162927f3 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:50.880314 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3e4aba43-9e67-40ee-a369-e744162927f3 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1584 microversion: 2.1 time: 0.358800 May 27 15:42:50.882527 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3241/6472] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:50 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1584 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:50.997840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3f1229f2-13ba-41fe-9bc0-d814bc219705 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:51.007967 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3f1229f2-13ba-41fe-9bc0-d814bc219705 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81" status: 200 len: 1546 microversion: 2.1 time: 0.236382 May 27 15:42:51.008992 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3232/6473] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:50 2022] GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81 => generated 1546 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:42:51.901577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-be244240-68e4-4241-adc7-4ad4cf0119ee tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:51.902197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-be244240-68e4-4241-adc7-4ad4cf0119ee tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:51.910441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be244240-68e4-4241-adc7-4ad4cf0119ee tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:51.910907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be244240-68e4-4241-adc7-4ad4cf0119ee tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:51.911874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be244240-68e4-4241-adc7-4ad4cf0119ee tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:51.912567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be244240-68e4-4241-adc7-4ad4cf0119ee tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:52.177523 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-be244240-68e4-4241-adc7-4ad4cf0119ee tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:52.187205 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-be244240-68e4-4241-adc7-4ad4cf0119ee tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1584 microversion: 2.1 time: 0.289558 May 27 15:42:52.189899 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3242/6474] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:51 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1584 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:52.933085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-ab100132-b2ff-4a91-be48-9123057cced7 req-dffd80e8-ad53-40d7-8763-23c72ce0e58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b906c8f-6531-467b-a584-6dd84aa3220f", "name": "network-vif-deleted", "tag": "9c47d3f6-239b-470a-8b8a-e72ffb217963"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:42:52.944450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-ab100132-b2ff-4a91-be48-9123057cced7 req-dffd80e8-ad53-40d7-8763-23c72ce0e58f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:52.945194 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-ab100132-b2ff-4a91-be48-9123057cced7 req-dffd80e8-ad53-40d7-8763-23c72ce0e58f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:52.958659 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-ab100132-b2ff-4a91-be48-9123057cced7 req-dffd80e8-ad53-40d7-8763-23c72ce0e58f service nova] Creating event network-vif-deleted:9c47d3f6-239b-470a-8b8a-e72ffb217963 for instance 9b906c8f-6531-467b-a584-6dd84aa3220f on n-h1-843621-1 May 27 15:42:52.967539 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-ab100132-b2ff-4a91-be48-9123057cced7 req-dffd80e8-ad53-40d7-8763-23c72ce0e58f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039021 May 27 15:42:52.970911 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3233/6475] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:42:53.207798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-53279eef-4f8d-4c1d-a6d5-8db277ae07fa tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:53.209247 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-53279eef-4f8d-4c1d-a6d5-8db277ae07fa tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:53.234045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-53279eef-4f8d-4c1d-a6d5-8db277ae07fa tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:53.235253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-53279eef-4f8d-4c1d-a6d5-8db277ae07fa tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:53.239714 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-53279eef-4f8d-4c1d-a6d5-8db277ae07fa tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:53.240453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-53279eef-4f8d-4c1d-a6d5-8db277ae07fa tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:53.346429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-012926f0-bc25-4098-95f0-f86b523421b5 req-7da9e289-aede-43f2-b1c2-ce5b1e700260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6087fdea-edfd-41b9-98c8-ae168fadaf81", "tag": "01fc641f-9507-496a-b5e4-68418ee850ce"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:42:53.364717 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-012926f0-bc25-4098-95f0-f86b523421b5 req-7da9e289-aede-43f2-b1c2-ce5b1e700260 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:53.365785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-012926f0-bc25-4098-95f0-f86b523421b5 req-7da9e289-aede-43f2-b1c2-ce5b1e700260 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:53.408447 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-012926f0-bc25-4098-95f0-f86b523421b5 req-7da9e289-aede-43f2-b1c2-ce5b1e700260 service nova] Creating event network-changed:01fc641f-9507-496a-b5e4-68418ee850ce for instance 6087fdea-edfd-41b9-98c8-ae168fadaf81 on n-h1-843621-1 May 27 15:42:53.451914 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-012926f0-bc25-4098-95f0-f86b523421b5 req-7da9e289-aede-43f2-b1c2-ce5b1e700260 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093557 May 27 15:42:53.454965 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3234/6476] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:42:53.466382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-53279eef-4f8d-4c1d-a6d5-8db277ae07fa tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:53.478739 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-53279eef-4f8d-4c1d-a6d5-8db277ae07fa tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1230 microversion: 2.1 time: 0.275251 May 27 15:42:53.480802 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3243/6477] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:53 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1230 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:54.499600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-59d0e8a1-0e5f-4a90-b349-7ff27566e96b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:54.500641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-59d0e8a1-0e5f-4a90-b349-7ff27566e96b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:54.518091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-59d0e8a1-0e5f-4a90-b349-7ff27566e96b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:54.518656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-59d0e8a1-0e5f-4a90-b349-7ff27566e96b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:54.521419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-59d0e8a1-0e5f-4a90-b349-7ff27566e96b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:54.521904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-59d0e8a1-0e5f-4a90-b349-7ff27566e96b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:54.687088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-59d0e8a1-0e5f-4a90-b349-7ff27566e96b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:54.704619 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-59d0e8a1-0e5f-4a90-b349-7ff27566e96b tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1230 microversion: 2.1 time: 0.210615 May 27 15:42:54.716080 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3235/6478] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:54 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1230 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:55.246124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-07484614-7c31-4f62-a0a2-5104916b779c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:55.246626 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-07484614-7c31-4f62-a0a2-5104916b779c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:55.254340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07484614-7c31-4f62-a0a2-5104916b779c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:55.254804 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07484614-7c31-4f62-a0a2-5104916b779c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:55.255583 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07484614-7c31-4f62-a0a2-5104916b779c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:55.256023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07484614-7c31-4f62-a0a2-5104916b779c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:55.285252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-07484614-7c31-4f62-a0a2-5104916b779c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:42:55.364029 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-07484614-7c31-4f62-a0a2-5104916b779c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 204 len: 0 microversion: 2.1 time: 0.121324 May 27 15:42:55.366495 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3244/6479] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:42:55 2022] DELETE /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:42:55.373449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-edd0c784-4012-4700-9ae5-68d6be5e3a7a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:55.374236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-edd0c784-4012-4700-9ae5-68d6be5e3a7a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:55.381352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-edd0c784-4012-4700-9ae5-68d6be5e3a7a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:55.382120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-edd0c784-4012-4700-9ae5-68d6be5e3a7a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:55.382957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-edd0c784-4012-4700-9ae5-68d6be5e3a7a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:55.383501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-edd0c784-4012-4700-9ae5-68d6be5e3a7a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:55.535849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-edd0c784-4012-4700-9ae5-68d6be5e3a7a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:55.544057 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-edd0c784-4012-4700-9ae5-68d6be5e3a7a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1408 microversion: 2.1 time: 0.174610 May 27 15:42:55.544652 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3236/6480] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:55 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:55.722693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-81deaf98-6950-4ecb-b47c-a03055c61fa3 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:55.723315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-81deaf98-6950-4ecb-b47c-a03055c61fa3 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:55.729648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81deaf98-6950-4ecb-b47c-a03055c61fa3 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:55.730101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81deaf98-6950-4ecb-b47c-a03055c61fa3 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:55.730888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81deaf98-6950-4ecb-b47c-a03055c61fa3 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:55.731323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81deaf98-6950-4ecb-b47c-a03055c61fa3 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:55.798133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-81deaf98-6950-4ecb-b47c-a03055c61fa3 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:55.806117 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-81deaf98-6950-4ecb-b47c-a03055c61fa3 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1230 microversion: 2.1 time: 0.087957 May 27 15:42:55.806691 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3245/6481] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:55 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1230 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:56.562361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bf186001-5b9c-47cf-84ee-f63276327ce1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:56.562986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bf186001-5b9c-47cf-84ee-f63276327ce1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:56.570115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf186001-5b9c-47cf-84ee-f63276327ce1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:56.570581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf186001-5b9c-47cf-84ee-f63276327ce1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:56.571368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf186001-5b9c-47cf-84ee-f63276327ce1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:56.571822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf186001-5b9c-47cf-84ee-f63276327ce1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:56.721501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bf186001-5b9c-47cf-84ee-f63276327ce1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:56.729551 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bf186001-5b9c-47cf-84ee-f63276327ce1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1408 microversion: 2.1 time: 0.171577 May 27 15:42:56.730133 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3237/6482] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:56 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:42:56.823286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d5b1070a-fdb9-434e-8746-03c24bdd2310 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:56.824196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d5b1070a-fdb9-434e-8746-03c24bdd2310 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:56.834680 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d5b1070a-fdb9-434e-8746-03c24bdd2310 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:56.835328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d5b1070a-fdb9-434e-8746-03c24bdd2310 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:56.836252 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d5b1070a-fdb9-434e-8746-03c24bdd2310 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:56.836891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d5b1070a-fdb9-434e-8746-03c24bdd2310 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:56.929952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d5b1070a-fdb9-434e-8746-03c24bdd2310 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:56.938713 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d5b1070a-fdb9-434e-8746-03c24bdd2310 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1230 microversion: 2.1 time: 0.119549 May 27 15:42:56.939389 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3246/6483] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:56 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1230 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:57.357136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-61880d8c-b024-40e3-b34d-d84031366e1b req-d6be6323-78a1-45a4-a443-9dbb484488ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6af796d-7206-4727-a59b-126015546cfa", "name": "network-vif-deleted", "tag": "4b95e0c6-d5a4-4811-9824-212fb5ed2125"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:42:57.373537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-61880d8c-b024-40e3-b34d-d84031366e1b req-d6be6323-78a1-45a4-a443-9dbb484488ef service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:57.374459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-61880d8c-b024-40e3-b34d-d84031366e1b req-d6be6323-78a1-45a4-a443-9dbb484488ef service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:57.388977 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-61880d8c-b024-40e3-b34d-d84031366e1b req-d6be6323-78a1-45a4-a443-9dbb484488ef service nova] Creating event network-vif-deleted:4b95e0c6-d5a4-4811-9824-212fb5ed2125 for instance e6af796d-7206-4727-a59b-126015546cfa on n-h2-843621-1 May 27 15:42:57.395876 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-61880d8c-b024-40e3-b34d-d84031366e1b req-d6be6323-78a1-45a4-a443-9dbb484488ef service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045311 May 27 15:42:57.396253 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3238/6484] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:42:57.415898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-55432783-a6b9-4583-b317-497ab774ced1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:42:57.417490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-55432783-a6b9-4583-b317-497ab774ced1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:57.426161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-55432783-a6b9-4583-b317-497ab774ced1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:57.426633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-55432783-a6b9-4583-b317-497ab774ced1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:57.427570 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-55432783-a6b9-4583-b317-497ab774ced1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:57.428173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-55432783-a6b9-4583-b317-497ab774ced1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:57.444012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:42:57.493400 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-55432783-a6b9-4583-b317-497ab774ced1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a/action" status: 200 len: 24576 microversion: 2.1 time: 0.082708 May 27 15:42:57.494271 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3247/6485] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:42:57 2022] POST /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a/action => generated 24576 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:42:57.746722 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6502c294-e86d-4628-9014-4eeb4dd80215 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:57.747601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6502c294-e86d-4628-9014-4eeb4dd80215 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:57.755381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6502c294-e86d-4628-9014-4eeb4dd80215 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:57.756034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6502c294-e86d-4628-9014-4eeb4dd80215 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:57.756984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6502c294-e86d-4628-9014-4eeb4dd80215 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:57.757577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6502c294-e86d-4628-9014-4eeb4dd80215 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:57.828903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6502c294-e86d-4628-9014-4eeb4dd80215 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:57.837151 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6502c294-e86d-4628-9014-4eeb4dd80215 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1201 microversion: 2.1 time: 0.094757 May 27 15:42:57.837737 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3239/6486] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:57 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1201 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:42:57.956202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-96a8e68a-3bec-42ed-b5b0-561d279b9980 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:57.956848 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-96a8e68a-3bec-42ed-b5b0-561d279b9980 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:57.964842 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96a8e68a-3bec-42ed-b5b0-561d279b9980 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:57.965299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96a8e68a-3bec-42ed-b5b0-561d279b9980 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:57.966081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96a8e68a-3bec-42ed-b5b0-561d279b9980 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:57.966532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96a8e68a-3bec-42ed-b5b0-561d279b9980 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:58.034021 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-96a8e68a-3bec-42ed-b5b0-561d279b9980 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:58.042197 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-96a8e68a-3bec-42ed-b5b0-561d279b9980 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1230 microversion: 2.1 time: 0.090454 May 27 15:42:58.043090 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3248/6487] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:57 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1230 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:58.855742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7d1ea403-793c-4fac-b8f6-224ed2742b66 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:58.856393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7d1ea403-793c-4fac-b8f6-224ed2742b66 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:58.864411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d1ea403-793c-4fac-b8f6-224ed2742b66 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:58.864920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d1ea403-793c-4fac-b8f6-224ed2742b66 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:58.865723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d1ea403-793c-4fac-b8f6-224ed2742b66 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:58.866185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7d1ea403-793c-4fac-b8f6-224ed2742b66 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:58.930292 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7d1ea403-793c-4fac-b8f6-224ed2742b66 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:58.938128 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7d1ea403-793c-4fac-b8f6-224ed2742b66 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1201 microversion: 2.1 time: 0.087313 May 27 15:42:58.938727 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3240/6488] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:58 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1201 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:59.062384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d746ebfb-d43b-4182-a4e3-9c6651a2f01e tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:59.063121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d746ebfb-d43b-4182-a4e3-9c6651a2f01e tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:59.070402 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d746ebfb-d43b-4182-a4e3-9c6651a2f01e tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:59.070868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d746ebfb-d43b-4182-a4e3-9c6651a2f01e tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:59.071657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d746ebfb-d43b-4182-a4e3-9c6651a2f01e tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:59.072109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d746ebfb-d43b-4182-a4e3-9c6651a2f01e tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:59.140511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d746ebfb-d43b-4182-a4e3-9c6651a2f01e tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:42:59.148728 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d746ebfb-d43b-4182-a4e3-9c6651a2f01e tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1230 microversion: 2.1 time: 0.090403 May 27 15:42:59.149677 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3249/6489] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:59 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1230 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:42:59.954792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-436dcbeb-05fa-43d1-b6c9-852bc1725b01 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:42:59.955406 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-436dcbeb-05fa-43d1-b6c9-852bc1725b01 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:42:59.963062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-436dcbeb-05fa-43d1-b6c9-852bc1725b01 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:59.963542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-436dcbeb-05fa-43d1-b6c9-852bc1725b01 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:42:59.964371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-436dcbeb-05fa-43d1-b6c9-852bc1725b01 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:42:59.964865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-436dcbeb-05fa-43d1-b6c9-852bc1725b01 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:00.031571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-436dcbeb-05fa-43d1-b6c9-852bc1725b01 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:00.039766 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-436dcbeb-05fa-43d1-b6c9-852bc1725b01 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1201 microversion: 2.1 time: 0.088985 May 27 15:43:00.040439 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3241/6490] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:42:59 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1201 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:00.166442 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-96e8ca5d-5d0d-45aa-9e6e-948e252e814d tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:00.167057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-96e8ca5d-5d0d-45aa-9e6e-948e252e814d tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:00.174503 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96e8ca5d-5d0d-45aa-9e6e-948e252e814d tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:00.175243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96e8ca5d-5d0d-45aa-9e6e-948e252e814d tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:00.175712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96e8ca5d-5d0d-45aa-9e6e-948e252e814d tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:00.177451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-96e8ca5d-5d0d-45aa-9e6e-948e252e814d tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:00.244236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-96e8ca5d-5d0d-45aa-9e6e-948e252e814d tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:00.252760 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-96e8ca5d-5d0d-45aa-9e6e-948e252e814d tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1230 microversion: 2.1 time: 0.090223 May 27 15:43:00.253334 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3250/6491] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:00 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1230 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:01.057635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2fe7a656-b73a-4ef6-a615-b33b80261cf3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:01.058409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2fe7a656-b73a-4ef6-a615-b33b80261cf3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:01.066202 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2fe7a656-b73a-4ef6-a615-b33b80261cf3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:01.066918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2fe7a656-b73a-4ef6-a615-b33b80261cf3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:01.067461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2fe7a656-b73a-4ef6-a615-b33b80261cf3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:01.067921 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2fe7a656-b73a-4ef6-a615-b33b80261cf3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:01.143979 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2fe7a656-b73a-4ef6-a615-b33b80261cf3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:01.148859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:43:01.153876 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2fe7a656-b73a-4ef6-a615-b33b80261cf3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1201 microversion: 2.1 time: 0.100375 May 27 15:43:01.154464 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3242/6492] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:01 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1201 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:01.271657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-57453341-7e7e-4caa-9395-b21160221d53 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:01.272366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-57453341-7e7e-4caa-9395-b21160221d53 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:01.278753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57453341-7e7e-4caa-9395-b21160221d53 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:01.279221 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57453341-7e7e-4caa-9395-b21160221d53 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:01.279996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57453341-7e7e-4caa-9395-b21160221d53 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:01.280432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57453341-7e7e-4caa-9395-b21160221d53 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:01.343793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-57453341-7e7e-4caa-9395-b21160221d53 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:01.352615 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-57453341-7e7e-4caa-9395-b21160221d53 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1230 microversion: 2.1 time: 0.085889 May 27 15:43:01.353214 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3251/6493] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:01 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1230 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:02.171436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5f2d4d9c-ad4f-4d16-b455-7cb8812a5247 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:02.172225 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5f2d4d9c-ad4f-4d16-b455-7cb8812a5247 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:02.180820 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f2d4d9c-ad4f-4d16-b455-7cb8812a5247 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:02.180975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f2d4d9c-ad4f-4d16-b455-7cb8812a5247 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:02.181807 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f2d4d9c-ad4f-4d16-b455-7cb8812a5247 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:02.182198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5f2d4d9c-ad4f-4d16-b455-7cb8812a5247 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:02.254453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5f2d4d9c-ad4f-4d16-b455-7cb8812a5247 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:02.263161 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5f2d4d9c-ad4f-4d16-b455-7cb8812a5247 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1201 microversion: 2.1 time: 0.095811 May 27 15:43:02.264234 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3243/6494] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:02 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1201 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:02.369843 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f0c65018-016c-491d-a59c-ebdd3c9b8d19 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:02.370469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f0c65018-016c-491d-a59c-ebdd3c9b8d19 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:02.377610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0c65018-016c-491d-a59c-ebdd3c9b8d19 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:02.378078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0c65018-016c-491d-a59c-ebdd3c9b8d19 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:02.378898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0c65018-016c-491d-a59c-ebdd3c9b8d19 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:02.379346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0c65018-016c-491d-a59c-ebdd3c9b8d19 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:02.445465 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f0c65018-016c-491d-a59c-ebdd3c9b8d19 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07cf46905eac42d8b2f775f8f23fe80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea3e0f4205d4e068c4844728fe555bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:02.454002 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f0c65018-016c-491d-a59c-ebdd3c9b8d19 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 200 len: 1230 microversion: 2.1 time: 0.088188 May 27 15:43:02.454606 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3252/6495] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:02 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 1230 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:03.286882 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8b1ad06a-47e7-4ae2-8d93-ea1e4ecdfe9d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:03.287519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8b1ad06a-47e7-4ae2-8d93-ea1e4ecdfe9d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:03.295763 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b1ad06a-47e7-4ae2-8d93-ea1e4ecdfe9d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:03.296240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b1ad06a-47e7-4ae2-8d93-ea1e4ecdfe9d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:03.297351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b1ad06a-47e7-4ae2-8d93-ea1e4ecdfe9d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:03.298038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b1ad06a-47e7-4ae2-8d93-ea1e4ecdfe9d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:03.390581 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8b1ad06a-47e7-4ae2-8d93-ea1e4ecdfe9d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:03.399549 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8b1ad06a-47e7-4ae2-8d93-ea1e4ecdfe9d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1201 microversion: 2.1 time: 0.116527 May 27 15:43:03.400401 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3244/6496] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:03 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1201 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:03.473401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c1997f09-f2e3-48f5-a7d9-1d1b13805301 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:03.474581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c1997f09-f2e3-48f5-a7d9-1d1b13805301 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] [instance: 9b906c8f-6531-467b-a584-6dd84aa3220f] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:03.485291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1997f09-f2e3-48f5-a7d9-1d1b13805301 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:03.485932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1997f09-f2e3-48f5-a7d9-1d1b13805301 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:03.487050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1997f09-f2e3-48f5-a7d9-1d1b13805301 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:03.487692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c1997f09-f2e3-48f5-a7d9-1d1b13805301 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:03.507610 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-c1997f09-f2e3-48f5-a7d9-1d1b13805301 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] HTTP exception thrown: Instance 9b906c8f-6531-467b-a584-6dd84aa3220f could not be found. May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c1997f09-f2e3-48f5-a7d9-1d1b13805301 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Request method failure captured: May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f HTTP/1.1 May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikPA6HPbFL21wXgiuFpmGJml2YP2_SOd5BsWOuUoCSCnDH_3-6P2lEEoo0SbrqD5spn59LvrKP5_YHYG2eXBYq8JkUK_jaP2bKU3Sfmua9UqW9hxNzmSehPfA8-if1c2W3DjxHP4FohNHrOFn4fmWFgaXTQlSBQUs3Nn-AYrioa896zs May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 1ea3e0f4205d4e068c4844728fe555bf May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TestVolumeBackupRestore-789710395 May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ea3e0f4205d4e068c4844728fe555bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1ea3e0f4205d4e068c4844728fe555bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1ea3e0f4205d4e068c4844728fe555bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1ea3e0f4205d4e068c4844728fe555bf", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TestVolumeBackupRestore-789710395 May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 1ea3e0f4205d4e068c4844728fe555bf May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TestVolumeBackupRestore-789710395 May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TestVolumeBackupRestore-789710395-project May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 07cf46905eac42d8b2f775f8f23fe80c May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TestVolumeBackupRestore-789710395-project May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 9b906c8f-6531-467b-a584-6dd84aa3220f could not be found. May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '9b906c8f-6531-467b-a584-6dd84aa3220f'} May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b906c8f-6531-467b-a584-6dd84aa3220f could not be found. May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b906c8f-6531-467b-a584-6dd84aa3220f could not be found. May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:43:03.513626 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:03.522580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:03.522580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:43:03.522580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:43:03.522580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:43:03.522580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:43:03.522580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b906c8f-6531-467b-a584-6dd84aa3220f could not be found. May 27 15:43:03.522580 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:03.522580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c1997f09-f2e3-48f5-a7d9-1d1b13805301 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Returning 404 to user: Instance 9b906c8f-6531-467b-a584-6dd84aa3220f could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:43:03.522580 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c1997f09-f2e3-48f5-a7d9-1d1b13805301 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f" status: 404 len: 111 microversion: 2.1 time: 0.044511 May 27 15:43:03.522580 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3253/6497] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:03 2022] GET /compute/v2.1/servers/9b906c8f-6531-467b-a584-6dd84aa3220f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:43:03.713449 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-643e7266-a8cb-4b68-8339-c72b11a4ce65 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] Calling method '.version_select at 0x7fc776d4aa60>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:03.723052 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:43:03.741739 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-643e7266-a8cb-4b68-8339-c72b11a4ce65 tempest-TestVolumeBackupRestore-789710395 tempest-TestVolumeBackupRestore-789710395-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1227253600" status: 202 len: 0 microversion: 2.1 time: 0.033131 May 27 15:43:03.742726 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3245/6498] 10.222.0.13 () {58 vars in 1268 bytes} [Fri May 27 15:43:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1227253600 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:43:04.416839 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b593f909-83e9-421e-a464-08a85174e9b8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:04.417454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b593f909-83e9-421e-a464-08a85174e9b8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:04.424800 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b593f909-83e9-421e-a464-08a85174e9b8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:04.425409 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b593f909-83e9-421e-a464-08a85174e9b8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:04.426219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b593f909-83e9-421e-a464-08a85174e9b8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:04.426673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b593f909-83e9-421e-a464-08a85174e9b8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:04.502600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b593f909-83e9-421e-a464-08a85174e9b8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:04.516475 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b593f909-83e9-421e-a464-08a85174e9b8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1201 microversion: 2.1 time: 0.103090 May 27 15:43:04.517587 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3254/6499] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:04 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1201 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:05.537512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6b0d7ba0-5ab1-4269-a12e-2168b6696acb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:05.538729 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6b0d7ba0-5ab1-4269-a12e-2168b6696acb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:05.546858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b0d7ba0-5ab1-4269-a12e-2168b6696acb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:05.547614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b0d7ba0-5ab1-4269-a12e-2168b6696acb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:05.548460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b0d7ba0-5ab1-4269-a12e-2168b6696acb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:05.549147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6b0d7ba0-5ab1-4269-a12e-2168b6696acb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:05.623499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6b0d7ba0-5ab1-4269-a12e-2168b6696acb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:05.633703 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6b0d7ba0-5ab1-4269-a12e-2168b6696acb tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1201 microversion: 2.1 time: 0.101291 May 27 15:43:05.634336 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3246/6500] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:05 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1201 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:06.652999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b410e4ed-b91c-4f14-8aec-82033e5cb535 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:06.655192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b410e4ed-b91c-4f14-8aec-82033e5cb535 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:06.658861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:43:06.668288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b410e4ed-b91c-4f14-8aec-82033e5cb535 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:06.668824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b410e4ed-b91c-4f14-8aec-82033e5cb535 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:06.669856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b410e4ed-b91c-4f14-8aec-82033e5cb535 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:06.670479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b410e4ed-b91c-4f14-8aec-82033e5cb535 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:06.754825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b410e4ed-b91c-4f14-8aec-82033e5cb535 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:06.770465 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b410e4ed-b91c-4f14-8aec-82033e5cb535 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1201 microversion: 2.1 time: 0.122449 May 27 15:43:06.773550 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3255/6501] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:06 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1201 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:07.797461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d0412578-8301-4f53-9895-e7def76f7324 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:07.798125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d0412578-8301-4f53-9895-e7def76f7324 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:07.805845 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0412578-8301-4f53-9895-e7def76f7324 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:07.806321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0412578-8301-4f53-9895-e7def76f7324 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:07.807143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0412578-8301-4f53-9895-e7def76f7324 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:07.807597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d0412578-8301-4f53-9895-e7def76f7324 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:07.889891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d0412578-8301-4f53-9895-e7def76f7324 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:07.898442 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d0412578-8301-4f53-9895-e7def76f7324 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1201 microversion: 2.1 time: 0.106869 May 27 15:43:07.899049 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3247/6502] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:07 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1201 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:08.916057 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e22b4c3f-b59d-4697-9593-ad4ead4c9e9c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:08.916740 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e22b4c3f-b59d-4697-9593-ad4ead4c9e9c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:08.923865 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e22b4c3f-b59d-4697-9593-ad4ead4c9e9c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:08.924315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e22b4c3f-b59d-4697-9593-ad4ead4c9e9c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:08.925212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e22b4c3f-b59d-4697-9593-ad4ead4c9e9c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:08.925652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e22b4c3f-b59d-4697-9593-ad4ead4c9e9c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:08.995151 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e22b4c3f-b59d-4697-9593-ad4ead4c9e9c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:09.003253 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e22b4c3f-b59d-4697-9593-ad4ead4c9e9c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1201 microversion: 2.1 time: 0.091084 May 27 15:43:09.003834 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3256/6503] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:08 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:43:10.020811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-89985f67-9a60-4c56-b2c8-4222f59fca63 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:10.021608 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-89985f67-9a60-4c56-b2c8-4222f59fca63 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:10.028745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89985f67-9a60-4c56-b2c8-4222f59fca63 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:10.029781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89985f67-9a60-4c56-b2c8-4222f59fca63 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:10.030578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89985f67-9a60-4c56-b2c8-4222f59fca63 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:10.031035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89985f67-9a60-4c56-b2c8-4222f59fca63 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:10.097468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-89985f67-9a60-4c56-b2c8-4222f59fca63 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:10.105295 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-89985f67-9a60-4c56-b2c8-4222f59fca63 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1201 microversion: 2.1 time: 0.088644 May 27 15:43:10.105881 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3248/6504] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:10 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1201 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:11.122014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b15f1506-b4a4-4b9e-bedd-b36312954f51 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:11.123243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b15f1506-b4a4-4b9e-bedd-b36312954f51 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:11.130941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b15f1506-b4a4-4b9e-bedd-b36312954f51 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:11.131406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b15f1506-b4a4-4b9e-bedd-b36312954f51 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:11.132200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b15f1506-b4a4-4b9e-bedd-b36312954f51 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:11.132657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b15f1506-b4a4-4b9e-bedd-b36312954f51 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:11.201226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b15f1506-b4a4-4b9e-bedd-b36312954f51 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:11.208956 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b15f1506-b4a4-4b9e-bedd-b36312954f51 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1201 microversion: 2.1 time: 0.090830 May 27 15:43:11.209557 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3257/6505] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:11 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:12.227609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-804793ff-5413-459a-8dfe-6025349174ee tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:12.228323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-804793ff-5413-459a-8dfe-6025349174ee tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:12.239026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-804793ff-5413-459a-8dfe-6025349174ee tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:12.242113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-804793ff-5413-459a-8dfe-6025349174ee tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:12.245176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-804793ff-5413-459a-8dfe-6025349174ee tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:12.245622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-804793ff-5413-459a-8dfe-6025349174ee tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:12.313593 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-804793ff-5413-459a-8dfe-6025349174ee tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:12.314063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-804793ff-5413-459a-8dfe-6025349174ee tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:12.314531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-804793ff-5413-459a-8dfe-6025349174ee tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lazy-loading 'fault' on Instance uuid e6af796d-7206-4727-a59b-126015546cfa {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:43:12.371539 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-804793ff-5413-459a-8dfe-6025349174ee tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:12.384993 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-804793ff-5413-459a-8dfe-6025349174ee tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 200 len: 1206 microversion: 2.1 time: 0.162863 May 27 15:43:12.386127 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3249/6506] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:12 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 1206 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:13.409193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5cc16484-ff30-410a-8790-46352b97b521 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:13.409939 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5cc16484-ff30-410a-8790-46352b97b521 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:13.417298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5cc16484-ff30-410a-8790-46352b97b521 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:13.417855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5cc16484-ff30-410a-8790-46352b97b521 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:13.418649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5cc16484-ff30-410a-8790-46352b97b521 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:13.419172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5cc16484-ff30-410a-8790-46352b97b521 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:13.433932 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-5cc16484-ff30-410a-8790-46352b97b521 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] HTTP exception thrown: Instance e6af796d-7206-4727-a59b-126015546cfa could not be found. May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5cc16484-ff30-410a-8790-46352b97b521 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Request method failure captured: May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa HTTP/1.1 May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikO_1Chjp-7OdQPlgoy0i68J74Yy9denIkk1niNkSk2uFWUy4CftwGV6LxM4FCEGakqUTp0mkulJ5awBDUhVVOjGCfP23UpxiQizq-3BPePUyAFyMxEgrT5T05iojcJbMyfNSyzYbX68HBU5apXXyE_-yRBe0ARJTHso9aoG2B7TFtpc May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_536a3b9dd9a745c089e2da27b9f536ff", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TestVolumeBootPattern-685942222 May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TestVolumeBootPattern-685942222-project May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: a058052ef3fd4ee58291ccc9837558cc May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TestVolumeBootPattern-685942222-project May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance e6af796d-7206-4727-a59b-126015546cfa could not be found. May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'e6af796d-7206-4727-a59b-126015546cfa'} May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6af796d-7206-4727-a59b-126015546cfa could not be found. May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6af796d-7206-4727-a59b-126015546cfa could not be found. May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:43:13.436066 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:13.440533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:13.440533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:43:13.440533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:43:13.440533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:43:13.440533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:43:13.440533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6af796d-7206-4727-a59b-126015546cfa could not be found. May 27 15:43:13.440533 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:13.440533 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5cc16484-ff30-410a-8790-46352b97b521 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Returning 404 to user: Instance e6af796d-7206-4727-a59b-126015546cfa could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:43:13.440533 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5cc16484-ff30-410a-8790-46352b97b521 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 404 len: 111 microversion: 2.1 time: 0.032483 May 27 15:43:13.440533 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3258/6507] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:13 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:43:22.052121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-816f3fba-88f3-447d-a37a-7b72b2edeedc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:22.053636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-816f3fba-88f3-447d-a37a-7b72b2edeedc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:22.062944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-816f3fba-88f3-447d-a37a-7b72b2edeedc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:22.063931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-816f3fba-88f3-447d-a37a-7b72b2edeedc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:22.065392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-816f3fba-88f3-447d-a37a-7b72b2edeedc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:22.066638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-816f3fba-88f3-447d-a37a-7b72b2edeedc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:22.083701 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-816f3fba-88f3-447d-a37a-7b72b2edeedc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] HTTP exception thrown: Instance eb94ca36-b7e2-4e64-b7b9-367737956d7d could not be found. May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-816f3fba-88f3-447d-a37a-7b72b2edeedc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Request method failure captured: May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d HTTP/1.1 May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikO_1Chjp-7OdQPlgoy0i68J74Yy9denIkk1niNkSk2uFWUy4CftwGV6LxM4FCEGakqUTp0mkulJ5awBDUhVVOjGCfP23UpxiQizq-3BPePUyAFyMxEgrT5T05iojcJbMyfNSyzYbX68HBU5apXXyE_-yRBe0ARJTHso9aoG2B7TFtpc May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_536a3b9dd9a745c089e2da27b9f536ff", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-TestVolumeBootPattern-685942222 May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-TestVolumeBootPattern-685942222-project May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: a058052ef3fd4ee58291ccc9837558cc May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-TestVolumeBootPattern-685942222-project May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance eb94ca36-b7e2-4e64-b7b9-367737956d7d could not be found. May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'eb94ca36-b7e2-4e64-b7b9-367737956d7d'} May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb94ca36-b7e2-4e64-b7b9-367737956d7d could not be found. May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:43:22.086915 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:43:22.091328 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb94ca36-b7e2-4e64-b7b9-367737956d7d could not be found. May 27 15:43:22.091328 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:43:22.091328 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:43:22.091328 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:43:22.091328 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:22.091328 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:43:22.091328 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:43:22.091328 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:43:22.091328 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:43:22.091328 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb94ca36-b7e2-4e64-b7b9-367737956d7d could not be found. May 27 15:43:22.091328 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:43:22.093470 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-816f3fba-88f3-447d-a37a-7b72b2edeedc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Returning 404 to user: Instance eb94ca36-b7e2-4e64-b7b9-367737956d7d could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:43:22.095159 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-816f3fba-88f3-447d-a37a-7b72b2edeedc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "DELETE /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 404 len: 111 microversion: 2.1 time: 0.047810 May 27 15:43:22.096411 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3250/6508] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:43:22 2022] DELETE /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:43:22.104449 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-167129bf-e30a-4394-a099-784817570f0e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:22.105122 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-167129bf-e30a-4394-a099-784817570f0e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: eb94ca36-b7e2-4e64-b7b9-367737956d7d] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:22.126129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-167129bf-e30a-4394-a099-784817570f0e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:22.127106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-167129bf-e30a-4394-a099-784817570f0e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:22.129152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-167129bf-e30a-4394-a099-784817570f0e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:22.131602 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-167129bf-e30a-4394-a099-784817570f0e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:22.161414 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-167129bf-e30a-4394-a099-784817570f0e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] HTTP exception thrown: Instance eb94ca36-b7e2-4e64-b7b9-367737956d7d could not be found. May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-167129bf-e30a-4394-a099-784817570f0e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Request method failure captured: May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d HTTP/1.1 May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikO_1Chjp-7OdQPlgoy0i68J74Yy9denIkk1niNkSk2uFWUy4CftwGV6LxM4FCEGakqUTp0mkulJ5awBDUhVVOjGCfP23UpxiQizq-3BPePUyAFyMxEgrT5T05iojcJbMyfNSyzYbX68HBU5apXXyE_-yRBe0ARJTHso9aoG2B7TFtpc May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_536a3b9dd9a745c089e2da27b9f536ff", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TestVolumeBootPattern-685942222 May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TestVolumeBootPattern-685942222-project May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: a058052ef3fd4ee58291ccc9837558cc May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TestVolumeBootPattern-685942222-project May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance eb94ca36-b7e2-4e64-b7b9-367737956d7d could not be found. May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'eb94ca36-b7e2-4e64-b7b9-367737956d7d'} May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb94ca36-b7e2-4e64-b7b9-367737956d7d could not be found. May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb94ca36-b7e2-4e64-b7b9-367737956d7d could not be found. May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:43:22.163010 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:22.168711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:22.168711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:43:22.168711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:43:22.168711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:43:22.168711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:43:22.168711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb94ca36-b7e2-4e64-b7b9-367737956d7d could not be found. May 27 15:43:22.168711 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:22.168711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-167129bf-e30a-4394-a099-784817570f0e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Returning 404 to user: Instance eb94ca36-b7e2-4e64-b7b9-367737956d7d could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:43:22.168711 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-167129bf-e30a-4394-a099-784817570f0e tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d" status: 404 len: 111 microversion: 2.1 time: 0.063911 May 27 15:43:22.168711 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3259/6509] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:22 2022] GET /compute/v2.1/servers/eb94ca36-b7e2-4e64-b7b9-367737956d7d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:43:22.898416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1676c96c-be33-4430-8136-ffef835209df tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:22.899479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1676c96c-be33-4430-8136-ffef835209df tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:22.906837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1676c96c-be33-4430-8136-ffef835209df tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:22.907391 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1676c96c-be33-4430-8136-ffef835209df tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:22.908374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1676c96c-be33-4430-8136-ffef835209df tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:22.909416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1676c96c-be33-4430-8136-ffef835209df tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:22.934576 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-1676c96c-be33-4430-8136-ffef835209df tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] HTTP exception thrown: Instance e6af796d-7206-4727-a59b-126015546cfa could not be found. May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1676c96c-be33-4430-8136-ffef835209df tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Request method failure captured: May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa HTTP/1.1 May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikO_1Chjp-7OdQPlgoy0i68J74Yy9denIkk1niNkSk2uFWUy4CftwGV6LxM4FCEGakqUTp0mkulJ5awBDUhVVOjGCfP23UpxiQizq-3BPePUyAFyMxEgrT5T05iojcJbMyfNSyzYbX68HBU5apXXyE_-yRBe0ARJTHso9aoG2B7TFtpc May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_536a3b9dd9a745c089e2da27b9f536ff", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-TestVolumeBootPattern-685942222 May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-TestVolumeBootPattern-685942222-project May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: a058052ef3fd4ee58291ccc9837558cc May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-TestVolumeBootPattern-685942222-project May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance e6af796d-7206-4727-a59b-126015546cfa could not be found. May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'e6af796d-7206-4727-a59b-126015546cfa'} May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6af796d-7206-4727-a59b-126015546cfa could not be found. May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:43:22.936758 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:43:22.942174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6af796d-7206-4727-a59b-126015546cfa could not be found. May 27 15:43:22.942174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:43:22.942174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:43:22.942174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:43:22.942174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:22.942174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:43:22.942174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:43:22.942174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:43:22.942174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:43:22.942174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6af796d-7206-4727-a59b-126015546cfa could not be found. May 27 15:43:22.942174 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:43:22.942174 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1676c96c-be33-4430-8136-ffef835209df tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Returning 404 to user: Instance e6af796d-7206-4727-a59b-126015546cfa could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:43:22.942174 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1676c96c-be33-4430-8136-ffef835209df tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 404 len: 111 microversion: 2.1 time: 0.044665 May 27 15:43:22.942174 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3251/6510] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:43:22 2022] DELETE /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:43:22.948103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c3b47db7-0191-45a5-9442-5928d51513a3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:22.948868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c3b47db7-0191-45a5-9442-5928d51513a3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: e6af796d-7206-4727-a59b-126015546cfa] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:22.960279 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3b47db7-0191-45a5-9442-5928d51513a3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:22.961003 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3b47db7-0191-45a5-9442-5928d51513a3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:22.961977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3b47db7-0191-45a5-9442-5928d51513a3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:22.962597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3b47db7-0191-45a5-9442-5928d51513a3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:22.978666 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-c3b47db7-0191-45a5-9442-5928d51513a3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] HTTP exception thrown: Instance e6af796d-7206-4727-a59b-126015546cfa could not be found. May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c3b47db7-0191-45a5-9442-5928d51513a3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Request method failure captured: May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa HTTP/1.1 May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikO_1Chjp-7OdQPlgoy0i68J74Yy9denIkk1niNkSk2uFWUy4CftwGV6LxM4FCEGakqUTp0mkulJ5awBDUhVVOjGCfP23UpxiQizq-3BPePUyAFyMxEgrT5T05iojcJbMyfNSyzYbX68HBU5apXXyE_-yRBe0ARJTHso9aoG2B7TFtpc May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_536a3b9dd9a745c089e2da27b9f536ff", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TestVolumeBootPattern-685942222 May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TestVolumeBootPattern-685942222-project May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: a058052ef3fd4ee58291ccc9837558cc May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TestVolumeBootPattern-685942222-project May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance e6af796d-7206-4727-a59b-126015546cfa could not be found. May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'e6af796d-7206-4727-a59b-126015546cfa'} May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6af796d-7206-4727-a59b-126015546cfa could not be found. May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6af796d-7206-4727-a59b-126015546cfa could not be found. May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:43:22.980536 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:22.986654 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:22.986654 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:43:22.986654 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:43:22.986654 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:43:22.986654 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:43:22.986654 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6af796d-7206-4727-a59b-126015546cfa could not be found. May 27 15:43:22.986654 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:22.988524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c3b47db7-0191-45a5-9442-5928d51513a3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Returning 404 to user: Instance e6af796d-7206-4727-a59b-126015546cfa could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:43:22.989635 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c3b47db7-0191-45a5-9442-5928d51513a3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa" status: 404 len: 111 microversion: 2.1 time: 0.046343 May 27 15:43:22.990737 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3260/6511] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:22 2022] GET /compute/v2.1/servers/e6af796d-7206-4727-a59b-126015546cfa => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:43:23.081136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0a35af6b-f923-498d-9643-d3298ad07a23 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Action: 'create', calling method: .version_select at 0x7fc775f78550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1197035446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv1AVOayNEce2ah2XrBsdM4KzS5ftPvrtALUCtt7yzQJlLmo5NmzRDcFj8yV1yJbo4Nq47lS+TYaMWu+Bu8T9UPUFGtoC2l8CqxrpJ41fTFqY+Nb2k2o/VdM/Dc17m9yQ=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:43:23.107824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-0a35af6b-f923-498d-9643-d3298ad07a23 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Getting quotas for project 536a3b9dd9a745c089e2da27b9f536ff. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:43:23.113989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-0a35af6b-f923-498d-9643-d3298ad07a23 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Getting quotas for user a058052ef3fd4ee58291ccc9837558cc and project 536a3b9dd9a745c089e2da27b9f536ff. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:43:23.148408 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0a35af6b-f923-498d-9643-d3298ad07a23 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.074106 May 27 15:43:23.149735 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3252/6512] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:43:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:43:27.823206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-51c6fc72-d927-4d8d-8df8-e7ca604d86b9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:43:27.825062 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-51c6fc72-d927-4d8d-8df8-e7ca604d86b9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 6087fdea-edfd-41b9-98c8-ae168fadaf81] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:27.831860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51c6fc72-d927-4d8d-8df8-e7ca604d86b9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:27.832320 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51c6fc72-d927-4d8d-8df8-e7ca604d86b9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:27.833276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51c6fc72-d927-4d8d-8df8-e7ca604d86b9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:27.833939 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-51c6fc72-d927-4d8d-8df8-e7ca604d86b9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:27.837761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=64 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:43:27.884241 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-51c6fc72-d927-4d8d-8df8-e7ca604d86b9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "POST /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81/action" status: 200 len: 24557 microversion: 2.1 time: 0.064765 May 27 15:43:27.886344 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3261/6513] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:43:27 2022] POST /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81/action => generated 24557 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:43:27.926852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bb63b5e0-a696-4935-bf74-ed775ee723ca tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:27.927564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bb63b5e0-a696-4935-bf74-ed775ee723ca tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:27.936297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb63b5e0-a696-4935-bf74-ed775ee723ca tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:27.936976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb63b5e0-a696-4935-bf74-ed775ee723ca tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:27.937942 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb63b5e0-a696-4935-bf74-ed775ee723ca tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:27.938540 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb63b5e0-a696-4935-bf74-ed775ee723ca tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:28.224913 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bb63b5e0-a696-4935-bf74-ed775ee723ca tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1834 microversion: 2.1 time: 0.301829 May 27 15:43:28.239356 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3253/6514] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:27 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1834 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:28.261168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4054d1d6-f9c3-4317-93cf-fdae3e92174a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:28.261168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4054d1d6-f9c3-4317-93cf-fdae3e92174a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:28.268175 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4054d1d6-f9c3-4317-93cf-fdae3e92174a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:28.268448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4054d1d6-f9c3-4317-93cf-fdae3e92174a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:28.269547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4054d1d6-f9c3-4317-93cf-fdae3e92174a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:28.269990 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4054d1d6-f9c3-4317-93cf-fdae3e92174a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:28.451261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4054d1d6-f9c3-4317-93cf-fdae3e92174a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:28.461211 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4054d1d6-f9c3-4317-93cf-fdae3e92174a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1683 microversion: 2.1 time: 0.208491 May 27 15:43:28.461832 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3262/6515] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:28 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1683 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:28.583933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-55a315ae-9f23-4165-8b60-1a7190cf3680 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:43:28.587788 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-55a315ae-9f23-4165-8b60-1a7190cf3680 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:28.595621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55a315ae-9f23-4165-8b60-1a7190cf3680 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:28.596574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55a315ae-9f23-4165-8b60-1a7190cf3680 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:28.598276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55a315ae-9f23-4165-8b60-1a7190cf3680 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:28.599123 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-55a315ae-9f23-4165-8b60-1a7190cf3680 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:28.662607 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-55a315ae-9f23-4165-8b60-1a7190cf3680 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a/action" status: 200 len: 32650 microversion: 2.1 time: 0.082779 May 27 15:43:28.663250 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3254/6516] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:43:28 2022] POST /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a/action => generated 32650 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:43:28.893945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b62344a4-86ff-4255-9160-061f5c4005ac tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:43:28.894630 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b62344a4-86ff-4255-9160-061f5c4005ac tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:28.901703 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b62344a4-86ff-4255-9160-061f5c4005ac tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:28.902154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b62344a4-86ff-4255-9160-061f5c4005ac tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:28.902924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b62344a4-86ff-4255-9160-061f5c4005ac tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:28.903362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b62344a4-86ff-4255-9160-061f5c4005ac tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:29.105483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b62344a4-86ff-4255-9160-061f5c4005ac tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd7af5c98df8f4a89a21a3360b6daff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e228df8d7e48e287174977291bb85e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:29.106106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b62344a4-86ff-4255-9160-061f5c4005ac tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] flavor_id is None. Assuming migration. {{(pid=119249) resize /opt/stack/nova/nova/compute/api.py:4142}} May 27 15:43:29.106554 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b62344a4-86ff-4255-9160-061f5c4005ac tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119249) resize /opt/stack/nova/nova/compute/api.py:4166}} May 27 15:43:29.360682 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b62344a4-86ff-4255-9160-061f5c4005ac tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a/action" status: 202 len: 0 microversion: 2.1 time: 0.470417 May 27 15:43:29.361636 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3263/6517] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:43:28 2022] POST /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:43:29.370431 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-37e76912-5128-4cbe-bf03-69b70fe0e1a3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:29.371239 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-37e76912-5128-4cbe-bf03-69b70fe0e1a3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:29.379203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-37e76912-5128-4cbe-bf03-69b70fe0e1a3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:29.379681 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-37e76912-5128-4cbe-bf03-69b70fe0e1a3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:29.380489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-37e76912-5128-4cbe-bf03-69b70fe0e1a3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:29.380977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-37e76912-5128-4cbe-bf03-69b70fe0e1a3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:29.531750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-37e76912-5128-4cbe-bf03-69b70fe0e1a3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:29.540115 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-37e76912-5128-4cbe-bf03-69b70fe0e1a3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1692 microversion: 2.1 time: 0.174114 May 27 15:43:29.540722 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3255/6518] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:29 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:43:30.559355 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-42521d9f-0a0e-4630-8cfc-5de545f5e6b9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:30.560106 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-42521d9f-0a0e-4630-8cfc-5de545f5e6b9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:30.567191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42521d9f-0a0e-4630-8cfc-5de545f5e6b9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:30.567887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42521d9f-0a0e-4630-8cfc-5de545f5e6b9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:30.568767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42521d9f-0a0e-4630-8cfc-5de545f5e6b9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:30.569289 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42521d9f-0a0e-4630-8cfc-5de545f5e6b9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:30.710492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-42521d9f-0a0e-4630-8cfc-5de545f5e6b9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:30.719016 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-42521d9f-0a0e-4630-8cfc-5de545f5e6b9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1692 microversion: 2.1 time: 0.165009 May 27 15:43:30.719590 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3264/6519] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:30 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:31.735495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a91e5555-f8de-471c-b899-25163fe48490 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:31.736978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a91e5555-f8de-471c-b899-25163fe48490 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:31.744584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a91e5555-f8de-471c-b899-25163fe48490 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:31.745182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a91e5555-f8de-471c-b899-25163fe48490 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:31.746070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a91e5555-f8de-471c-b899-25163fe48490 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:31.746545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a91e5555-f8de-471c-b899-25163fe48490 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:31.885281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a91e5555-f8de-471c-b899-25163fe48490 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:31.893853 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a91e5555-f8de-471c-b899-25163fe48490 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1697 microversion: 2.1 time: 0.162318 May 27 15:43:31.894426 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3256/6520] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:31 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:32.911357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-42b92f4b-9cc2-48cc-ba5b-3109b91415db tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:32.912100 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-42b92f4b-9cc2-48cc-ba5b-3109b91415db tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:32.919211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42b92f4b-9cc2-48cc-ba5b-3109b91415db tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:32.919673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42b92f4b-9cc2-48cc-ba5b-3109b91415db tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:32.920458 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42b92f4b-9cc2-48cc-ba5b-3109b91415db tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:32.920939 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42b92f4b-9cc2-48cc-ba5b-3109b91415db tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:33.066965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-42b92f4b-9cc2-48cc-ba5b-3109b91415db tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:33.075133 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-42b92f4b-9cc2-48cc-ba5b-3109b91415db tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1697 microversion: 2.1 time: 0.167711 May 27 15:43:33.076350 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3265/6521] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:32 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:34.094344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3e1a5b25-c330-4fda-97b5-c720a57f2c12 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:34.094988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3e1a5b25-c330-4fda-97b5-c720a57f2c12 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:34.098537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:43:34.099515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:43:34.108574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e1a5b25-c330-4fda-97b5-c720a57f2c12 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:34.109091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e1a5b25-c330-4fda-97b5-c720a57f2c12 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:34.109900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e1a5b25-c330-4fda-97b5-c720a57f2c12 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:34.110354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e1a5b25-c330-4fda-97b5-c720a57f2c12 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:34.113987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=65 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:43:34.271773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3e1a5b25-c330-4fda-97b5-c720a57f2c12 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:34.279779 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3e1a5b25-c330-4fda-97b5-c720a57f2c12 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1697 microversion: 2.1 time: 0.190100 May 27 15:43:34.280456 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3257/6522] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:34 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1697 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:43:35.297086 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fa340f18-a2e2-455e-919c-79ef3127cd4f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:35.297822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fa340f18-a2e2-455e-919c-79ef3127cd4f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:35.304918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa340f18-a2e2-455e-919c-79ef3127cd4f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:35.305370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa340f18-a2e2-455e-919c-79ef3127cd4f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:35.306219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa340f18-a2e2-455e-919c-79ef3127cd4f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:35.306575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fa340f18-a2e2-455e-919c-79ef3127cd4f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:35.446914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fa340f18-a2e2-455e-919c-79ef3127cd4f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:35.455086 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fa340f18-a2e2-455e-919c-79ef3127cd4f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1697 microversion: 2.1 time: 0.162631 May 27 15:43:35.455696 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3266/6523] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:35 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:36.472239 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-edbf69e4-37db-4626-9495-b61914a8eeb2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:36.472927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-edbf69e4-37db-4626-9495-b61914a8eeb2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:36.480187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-edbf69e4-37db-4626-9495-b61914a8eeb2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:36.480657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-edbf69e4-37db-4626-9495-b61914a8eeb2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:36.481476 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-edbf69e4-37db-4626-9495-b61914a8eeb2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:36.482554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-edbf69e4-37db-4626-9495-b61914a8eeb2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:36.629444 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-edbf69e4-37db-4626-9495-b61914a8eeb2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:36.637412 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-edbf69e4-37db-4626-9495-b61914a8eeb2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1697 microversion: 2.1 time: 0.169290 May 27 15:43:36.638489 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3258/6524] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:36 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:37.655355 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-497bef92-8cbc-4b4d-99ec-9ff8dd49947d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:37.655898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-497bef92-8cbc-4b4d-99ec-9ff8dd49947d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:37.658762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=26 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:43:37.664211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-497bef92-8cbc-4b4d-99ec-9ff8dd49947d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:37.664687 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-497bef92-8cbc-4b4d-99ec-9ff8dd49947d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:37.665466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-497bef92-8cbc-4b4d-99ec-9ff8dd49947d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:37.665914 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-497bef92-8cbc-4b4d-99ec-9ff8dd49947d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:37.806891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-497bef92-8cbc-4b4d-99ec-9ff8dd49947d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:37.814570 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-497bef92-8cbc-4b4d-99ec-9ff8dd49947d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1697 microversion: 2.1 time: 0.163265 May 27 15:43:37.815155 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3267/6525] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:37 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:38.833381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f8ed7d92-f2d7-430e-b0ba-f8041ad6ed5a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:38.834025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f8ed7d92-f2d7-430e-b0ba-f8041ad6ed5a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:38.842929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8ed7d92-f2d7-430e-b0ba-f8041ad6ed5a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:38.843742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8ed7d92-f2d7-430e-b0ba-f8041ad6ed5a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:38.845664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8ed7d92-f2d7-430e-b0ba-f8041ad6ed5a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:38.845664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8ed7d92-f2d7-430e-b0ba-f8041ad6ed5a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:38.982202 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f8ed7d92-f2d7-430e-b0ba-f8041ad6ed5a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:38.990779 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f8ed7d92-f2d7-430e-b0ba-f8041ad6ed5a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1697 microversion: 2.1 time: 0.162662 May 27 15:43:38.991509 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3259/6526] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:38 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:40.017266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-82c975b8-ff50-4ec5-93da-30bc50d3179d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:40.017884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-82c975b8-ff50-4ec5-93da-30bc50d3179d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:40.024947 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82c975b8-ff50-4ec5-93da-30bc50d3179d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:40.025400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82c975b8-ff50-4ec5-93da-30bc50d3179d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:40.026162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82c975b8-ff50-4ec5-93da-30bc50d3179d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:40.026600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-82c975b8-ff50-4ec5-93da-30bc50d3179d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:40.161991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-82c975b8-ff50-4ec5-93da-30bc50d3179d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:40.170363 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-82c975b8-ff50-4ec5-93da-30bc50d3179d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1697 microversion: 2.1 time: 0.156972 May 27 15:43:40.170957 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3268/6527] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:40 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:41.188126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1db5993c-29d6-4e7a-ad7a-9a8637b3e9d6 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:41.188860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1db5993c-29d6-4e7a-ad7a-9a8637b3e9d6 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:41.196120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1db5993c-29d6-4e7a-ad7a-9a8637b3e9d6 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:41.196606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1db5993c-29d6-4e7a-ad7a-9a8637b3e9d6 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:41.197435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1db5993c-29d6-4e7a-ad7a-9a8637b3e9d6 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:41.197902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1db5993c-29d6-4e7a-ad7a-9a8637b3e9d6 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:41.339099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1db5993c-29d6-4e7a-ad7a-9a8637b3e9d6 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:41.349197 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1db5993c-29d6-4e7a-ad7a-9a8637b3e9d6 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1697 microversion: 2.1 time: 0.165528 May 27 15:43:41.349837 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3260/6528] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:41 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:42.375136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-67fbcc6d-0006-489f-9c59-9048971d49fb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:42.375911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-67fbcc6d-0006-489f-9c59-9048971d49fb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:42.384425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67fbcc6d-0006-489f-9c59-9048971d49fb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:42.384942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67fbcc6d-0006-489f-9c59-9048971d49fb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:42.385759 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67fbcc6d-0006-489f-9c59-9048971d49fb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:42.386476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-67fbcc6d-0006-489f-9c59-9048971d49fb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:42.547595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-67fbcc6d-0006-489f-9c59-9048971d49fb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:42.559117 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-67fbcc6d-0006-489f-9c59-9048971d49fb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1697 microversion: 2.1 time: 0.188251 May 27 15:43:42.560816 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3269/6529] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:42 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1697 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:43.577985 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0359e8e8-221c-436c-be02-026ac20d66a2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:43.578794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0359e8e8-221c-436c-be02-026ac20d66a2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:43.586412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0359e8e8-221c-436c-be02-026ac20d66a2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:43.586884 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0359e8e8-221c-436c-be02-026ac20d66a2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:43.587670 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0359e8e8-221c-436c-be02-026ac20d66a2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:43.588127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0359e8e8-221c-436c-be02-026ac20d66a2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:43.742525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0359e8e8-221c-436c-be02-026ac20d66a2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:43.751327 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0359e8e8-221c-436c-be02-026ac20d66a2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1697 microversion: 2.1 time: 0.177266 May 27 15:43:43.760323 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3261/6530] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:43 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1697 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:44.776817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-90afc900-404a-46da-9507-ad229d2325bd tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:44.777444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-90afc900-404a-46da-9507-ad229d2325bd tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:44.784573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90afc900-404a-46da-9507-ad229d2325bd tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:44.785077 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90afc900-404a-46da-9507-ad229d2325bd tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:44.785854 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90afc900-404a-46da-9507-ad229d2325bd tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:44.786305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-90afc900-404a-46da-9507-ad229d2325bd tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:44.927728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-90afc900-404a-46da-9507-ad229d2325bd tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:44.936143 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-90afc900-404a-46da-9507-ad229d2325bd tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1697 microversion: 2.1 time: 0.163118 May 27 15:43:44.936966 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3270/6531] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:44 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:44.965389 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cb72104d-9972-4223-bb2a-7df1d7425021 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1512721394", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1197035446", "security_groups": [{"name": "tempest-secgroup-smoke-2103483646"}], "block_device_mapping_v2": [{"uuid": "70ca327c-9782-4cce-ad26-85909766cc6d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8b1a4599-fc38-4529-b66a-d319c59ff383"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:43:45.081759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-cb72104d-9972-4223-bb2a-7df1d7425021 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] validate_networks() for [('8b1a4599-fc38-4529-b66a-d319c59ff383', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:43:45.498485 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-cb72104d-9972-4223-bb2a-7df1d7425021 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:43:45.498992 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-cb72104d-9972-4223-bb2a-7df1d7425021 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:43:45.499728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-cb72104d-9972-4223-bb2a-7df1d7425021 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:43:45.500208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-cb72104d-9972-4223-bb2a-7df1d7425021 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:43:45.500912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-cb72104d-9972-4223-bb2a-7df1d7425021 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:43:45.510350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb72104d-9972-4223-bb2a-7df1d7425021 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:45.510815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb72104d-9972-4223-bb2a-7df1d7425021 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:45.511902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb72104d-9972-4223-bb2a-7df1d7425021 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:45.512463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb72104d-9972-4223-bb2a-7df1d7425021 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:45.532965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-cb72104d-9972-4223-bb2a-7df1d7425021 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Getting quotas for project 536a3b9dd9a745c089e2da27b9f536ff. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:43:45.538434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-cb72104d-9972-4223-bb2a-7df1d7425021 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Getting quotas for user a058052ef3fd4ee58291ccc9837558cc and project 536a3b9dd9a745c089e2da27b9f536ff. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:43:45.600360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cb72104d-9972-4223-bb2a-7df1d7425021 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:43:45.602523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cb72104d-9972-4223-bb2a-7df1d7425021 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='70ca327c-9782-4cce-ad26-85909766cc6d',volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:43:45.744516 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cb72104d-9972-4223-bb2a-7df1d7425021 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.782769 May 27 15:43:45.746516 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3262/6532] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:43:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:43:45.756942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ef01026d-5a55-4198-b8d5-a1eda3b388d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:45.758117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ef01026d-5a55-4198-b8d5-a1eda3b388d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:45.865668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ef01026d-5a55-4198-b8d5-a1eda3b388d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:45.873087 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ef01026d-5a55-4198-b8d5-a1eda3b388d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1095 microversion: 2.1 time: 0.120726 May 27 15:43:45.873842 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3271/6533] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:45 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1095 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:45.954369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-59157d64-f782-4f5b-a2e3-65db31494746 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:45.955001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-59157d64-f782-4f5b-a2e3-65db31494746 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:45.962054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-59157d64-f782-4f5b-a2e3-65db31494746 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:45.962620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-59157d64-f782-4f5b-a2e3-65db31494746 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:45.963463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-59157d64-f782-4f5b-a2e3-65db31494746 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:45.964152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-59157d64-f782-4f5b-a2e3-65db31494746 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:46.118544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-59157d64-f782-4f5b-a2e3-65db31494746 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:46.127819 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-59157d64-f782-4f5b-a2e3-65db31494746 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1697 microversion: 2.1 time: 0.178348 May 27 15:43:46.128427 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3263/6534] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:45 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:46.890307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-521fbe8a-89c5-478a-95fe-ec742729b505 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:46.897679 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-521fbe8a-89c5-478a-95fe-ec742729b505 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:46.907477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-521fbe8a-89c5-478a-95fe-ec742729b505 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:46.908185 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-521fbe8a-89c5-478a-95fe-ec742729b505 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:46.909130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-521fbe8a-89c5-478a-95fe-ec742729b505 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:46.909576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-521fbe8a-89c5-478a-95fe-ec742729b505 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:46.997433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-521fbe8a-89c5-478a-95fe-ec742729b505 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:47.006387 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-521fbe8a-89c5-478a-95fe-ec742729b505 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1211 microversion: 2.1 time: 0.120013 May 27 15:43:47.007014 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3272/6535] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:46 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1211 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:47.145048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fe39290b-c6f1-4555-b9da-abd13c8fb8f5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:47.146239 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fe39290b-c6f1-4555-b9da-abd13c8fb8f5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:47.153231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fe39290b-c6f1-4555-b9da-abd13c8fb8f5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:47.154272 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fe39290b-c6f1-4555-b9da-abd13c8fb8f5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:47.155263 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fe39290b-c6f1-4555-b9da-abd13c8fb8f5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:47.155733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fe39290b-c6f1-4555-b9da-abd13c8fb8f5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:47.402701 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fe39290b-c6f1-4555-b9da-abd13c8fb8f5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:47.412061 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fe39290b-c6f1-4555-b9da-abd13c8fb8f5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1697 microversion: 2.1 time: 0.270875 May 27 15:43:47.412899 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3264/6536] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:47 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1697 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:48.026482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4faf6ab6-4598-4fa4-9edb-dc7ac614ad31 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:48.027749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4faf6ab6-4598-4fa4-9edb-dc7ac614ad31 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:48.034993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4faf6ab6-4598-4fa4-9edb-dc7ac614ad31 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:48.035457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4faf6ab6-4598-4fa4-9edb-dc7ac614ad31 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:48.036254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4faf6ab6-4598-4fa4-9edb-dc7ac614ad31 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:48.036722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4faf6ab6-4598-4fa4-9edb-dc7ac614ad31 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:48.253058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4faf6ab6-4598-4fa4-9edb-dc7ac614ad31 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:48.261430 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4faf6ab6-4598-4fa4-9edb-dc7ac614ad31 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1279 microversion: 2.1 time: 0.240259 May 27 15:43:48.262121 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3273/6537] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:48 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1279 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:48.440841 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-39ff4371-ffd9-4151-a188-07335240ffc1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:48.442094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-39ff4371-ffd9-4151-a188-07335240ffc1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:48.453214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-39ff4371-ffd9-4151-a188-07335240ffc1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:48.457717 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-39ff4371-ffd9-4151-a188-07335240ffc1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:48.462095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-39ff4371-ffd9-4151-a188-07335240ffc1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:48.462754 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-39ff4371-ffd9-4151-a188-07335240ffc1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:48.467635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-96855322-f6ae-4c73-bab7-f93262dd8e4e req-6f675cd2-5fe3-4a1e-90f0-67a29bb29046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb", "tag": "e00c910d-0165-4807-830e-1511dd7dcd0f"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:43:48.481311 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-96855322-f6ae-4c73-bab7-f93262dd8e4e req-6f675cd2-5fe3-4a1e-90f0-67a29bb29046 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:48.482428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-96855322-f6ae-4c73-bab7-f93262dd8e4e req-6f675cd2-5fe3-4a1e-90f0-67a29bb29046 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:48.514857 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-96855322-f6ae-4c73-bab7-f93262dd8e4e req-6f675cd2-5fe3-4a1e-90f0-67a29bb29046 service nova] Creating event network-changed:e00c910d-0165-4807-830e-1511dd7dcd0f for instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb on n-h2-843621-1 May 27 15:43:48.524651 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-96855322-f6ae-4c73-bab7-f93262dd8e4e req-6f675cd2-5fe3-4a1e-90f0-67a29bb29046 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188941 May 27 15:43:48.525870 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3265/6538] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:43:48.753317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-39ff4371-ffd9-4151-a188-07335240ffc1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:48.764617 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-39ff4371-ffd9-4151-a188-07335240ffc1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1697 microversion: 2.1 time: 0.337802 May 27 15:43:48.765871 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3274/6539] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:48 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1697 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:49.260828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-e1e32be9-27a0-4f22-9851-988db40626ff req-73d83d89-063b-480d-abe7-caa3d4ef547f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6356ecad-39d9-4149-8277-8b378d9c806a", "name": "network-vif-unplugged", "status": "completed", "tag": "6ca629e8-ab17-45ed-8a13-e4d4f0af9e12"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:43:49.313813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-363ff098-8db1-4806-8061-3cad7cfcbcf6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:49.321533 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-363ff098-8db1-4806-8061-3cad7cfcbcf6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:49.331792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e1e32be9-27a0-4f22-9851-988db40626ff req-73d83d89-063b-480d-abe7-caa3d4ef547f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:49.337162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e1e32be9-27a0-4f22-9851-988db40626ff req-73d83d89-063b-480d-abe7-caa3d4ef547f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:49.353617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-363ff098-8db1-4806-8061-3cad7cfcbcf6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:49.358207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-363ff098-8db1-4806-8061-3cad7cfcbcf6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:49.359262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-363ff098-8db1-4806-8061-3cad7cfcbcf6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:49.360226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-363ff098-8db1-4806-8061-3cad7cfcbcf6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:49.381094 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-e1e32be9-27a0-4f22-9851-988db40626ff req-73d83d89-063b-480d-abe7-caa3d4ef547f service nova] Creating event network-vif-unplugged:6ca629e8-ab17-45ed-8a13-e4d4f0af9e12 for instance 6356ecad-39d9-4149-8277-8b378d9c806a on n-h2-843621-1 May 27 15:43:49.403279 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [req-e1e32be9-27a0-4f22-9851-988db40626ff req-73d83d89-063b-480d-abe7-caa3d4ef547f service nova] Instance 6356ecad-39d9-4149-8277-8b378d9c806a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119248) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 15:43:49.442293 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-e1e32be9-27a0-4f22-9851-988db40626ff req-73d83d89-063b-480d-abe7-caa3d4ef547f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.186588 May 27 15:43:49.445022 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3266/6540] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:43:49.722462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-363ff098-8db1-4806-8061-3cad7cfcbcf6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:49.734408 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-363ff098-8db1-4806-8061-3cad7cfcbcf6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1279 microversion: 2.1 time: 0.456475 May 27 15:43:49.737388 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3275/6541] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:49 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1279 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:49.786941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-528f0a6f-6bca-47a5-898e-e65e1d111884 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:49.791413 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-528f0a6f-6bca-47a5-898e-e65e1d111884 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:49.806898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-528f0a6f-6bca-47a5-898e-e65e1d111884 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:49.808251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-528f0a6f-6bca-47a5-898e-e65e1d111884 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:49.810202 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-528f0a6f-6bca-47a5-898e-e65e1d111884 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:49.811434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-528f0a6f-6bca-47a5-898e-e65e1d111884 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:50.111193 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-528f0a6f-6bca-47a5-898e-e65e1d111884 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:50.125574 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-528f0a6f-6bca-47a5-898e-e65e1d111884 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1696 microversion: 2.1 time: 0.344021 May 27 15:43:50.126329 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3267/6542] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:49 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1696 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:50.753404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-efe71ae8-2f5b-4b10-a7f8-5f03363ceef6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:50.754109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-efe71ae8-2f5b-4b10-a7f8-5f03363ceef6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:50.761362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efe71ae8-2f5b-4b10-a7f8-5f03363ceef6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:50.761832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efe71ae8-2f5b-4b10-a7f8-5f03363ceef6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:50.762608 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efe71ae8-2f5b-4b10-a7f8-5f03363ceef6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:50.763048 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efe71ae8-2f5b-4b10-a7f8-5f03363ceef6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:50.904330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-efe71ae8-2f5b-4b10-a7f8-5f03363ceef6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:50.912398 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-efe71ae8-2f5b-4b10-a7f8-5f03363ceef6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1279 microversion: 2.1 time: 0.162840 May 27 15:43:50.913029 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3276/6543] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:50 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:51.143873 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d4fde9e1-338a-4de2-bf39-a0f2c7b6f10d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:51.144505 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d4fde9e1-338a-4de2-bf39-a0f2c7b6f10d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:51.151560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4fde9e1-338a-4de2-bf39-a0f2c7b6f10d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:51.152033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4fde9e1-338a-4de2-bf39-a0f2c7b6f10d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:51.152861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4fde9e1-338a-4de2-bf39-a0f2c7b6f10d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:51.153322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d4fde9e1-338a-4de2-bf39-a0f2c7b6f10d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:51.296961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d4fde9e1-338a-4de2-bf39-a0f2c7b6f10d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:51.304936 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d4fde9e1-338a-4de2-bf39-a0f2c7b6f10d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1694 microversion: 2.1 time: 0.164938 May 27 15:43:51.305528 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3268/6544] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:51 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:51.502635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-431c18de-91fd-41f2-9f9d-b9b1115ce013 req-a712da6c-8ff4-43e5-a804-20bfe8fc4009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6356ecad-39d9-4149-8277-8b378d9c806a", "tag": "6ca629e8-ab17-45ed-8a13-e4d4f0af9e12"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:43:51.512104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-431c18de-91fd-41f2-9f9d-b9b1115ce013 req-a712da6c-8ff4-43e5-a804-20bfe8fc4009 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:51.512549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-431c18de-91fd-41f2-9f9d-b9b1115ce013 req-a712da6c-8ff4-43e5-a804-20bfe8fc4009 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:51.524875 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-431c18de-91fd-41f2-9f9d-b9b1115ce013 req-a712da6c-8ff4-43e5-a804-20bfe8fc4009 service nova] Creating event network-changed:6ca629e8-ab17-45ed-8a13-e4d4f0af9e12 for instance 6356ecad-39d9-4149-8277-8b378d9c806a on n-h2-843621-1 May 27 15:43:51.526470 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:43:51.534601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [req-431c18de-91fd-41f2-9f9d-b9b1115ce013 req-a712da6c-8ff4-43e5-a804-20bfe8fc4009 service nova] Instance 6356ecad-39d9-4149-8277-8b378d9c806a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119249) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 15:43:51.549004 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-431c18de-91fd-41f2-9f9d-b9b1115ce013 req-a712da6c-8ff4-43e5-a804-20bfe8fc4009 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052671 May 27 15:43:51.549977 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3277/6545] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:43:51.931363 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e7c0eb0e-e8a8-472c-a4af-7dc50e4af8e3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:51.932265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e7c0eb0e-e8a8-472c-a4af-7dc50e4af8e3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:51.938912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7c0eb0e-e8a8-472c-a4af-7dc50e4af8e3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:51.939704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7c0eb0e-e8a8-472c-a4af-7dc50e4af8e3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:51.940733 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7c0eb0e-e8a8-472c-a4af-7dc50e4af8e3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:51.941187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e7c0eb0e-e8a8-472c-a4af-7dc50e4af8e3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:52.120828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e7c0eb0e-e8a8-472c-a4af-7dc50e4af8e3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:52.137883 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e7c0eb0e-e8a8-472c-a4af-7dc50e4af8e3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1279 microversion: 2.1 time: 0.211148 May 27 15:43:52.151074 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3269/6546] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:51 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1279 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:52.328283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-da4f95a2-8729-41e1-bdde-9417d101a5dc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:52.329657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-da4f95a2-8729-41e1-bdde-9417d101a5dc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:52.338940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da4f95a2-8729-41e1-bdde-9417d101a5dc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:52.339509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da4f95a2-8729-41e1-bdde-9417d101a5dc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:52.341059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da4f95a2-8729-41e1-bdde-9417d101a5dc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:52.341583 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-da4f95a2-8729-41e1-bdde-9417d101a5dc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:52.517070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-da4f95a2-8729-41e1-bdde-9417d101a5dc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:52.525660 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-da4f95a2-8729-41e1-bdde-9417d101a5dc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1691 microversion: 2.1 time: 0.203718 May 27 15:43:52.526585 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3278/6547] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:52 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1691 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:52.542757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-514e0e77-bc0f-40d0-afd2-ce1b058523cc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:43:52.543308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-514e0e77-bc0f-40d0-afd2-ce1b058523cc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:52.550826 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-514e0e77-bc0f-40d0-afd2-ce1b058523cc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:52.551579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-514e0e77-bc0f-40d0-afd2-ce1b058523cc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:52.552376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-514e0e77-bc0f-40d0-afd2-ce1b058523cc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:52.552895 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-514e0e77-bc0f-40d0-afd2-ce1b058523cc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:52.628339 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-514e0e77-bc0f-40d0-afd2-ce1b058523cc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a/action" status: 204 len: 0 microversion: 2.1 time: 0.089275 May 27 15:43:52.629326 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3270/6548] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:43:52 2022] POST /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a/action => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:43:52.639236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e7e4961c-6795-4990-8e2d-f0ee956435d2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:52.640241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e7e4961c-6795-4990-8e2d-f0ee956435d2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:52.653282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e7e4961c-6795-4990-8e2d-f0ee956435d2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:52.653892 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e7e4961c-6795-4990-8e2d-f0ee956435d2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:52.656951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e7e4961c-6795-4990-8e2d-f0ee956435d2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:52.658152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e7e4961c-6795-4990-8e2d-f0ee956435d2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:52.835309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e7e4961c-6795-4990-8e2d-f0ee956435d2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:52.844528 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e7e4961c-6795-4990-8e2d-f0ee956435d2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1691 microversion: 2.1 time: 0.210196 May 27 15:43:52.852880 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3279/6549] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:52 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1691 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:53.017501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f8c36b6b-790b-4b96-a40f-e093f2bc1df1 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:53.018550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f8c36b6b-790b-4b96-a40f-e093f2bc1df1 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:53.025605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8c36b6b-790b-4b96-a40f-e093f2bc1df1 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:53.026115 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8c36b6b-790b-4b96-a40f-e093f2bc1df1 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:53.027198 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8c36b6b-790b-4b96-a40f-e093f2bc1df1 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:53.027671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8c36b6b-790b-4b96-a40f-e093f2bc1df1 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:53.077006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f8c36b6b-790b-4b96-a40f-e093f2bc1df1 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:43:53.160872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-92dc59e1-8a63-49dc-9080-554b719fd67a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:53.161904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-92dc59e1-8a63-49dc-9080-554b719fd67a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:53.174394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-92dc59e1-8a63-49dc-9080-554b719fd67a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:53.177492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-92dc59e1-8a63-49dc-9080-554b719fd67a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:53.178545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-92dc59e1-8a63-49dc-9080-554b719fd67a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:53.179906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-92dc59e1-8a63-49dc-9080-554b719fd67a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:53.226515 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f8c36b6b-790b-4b96-a40f-e093f2bc1df1 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b" status: 204 len: 0 microversion: 2.1 time: 0.361149 May 27 15:43:53.233953 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3271/6550] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:43:52 2022] DELETE /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:43:53.245100 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-82fed13d-3fae-4065-a185-237186f31281 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:53.246243 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-82fed13d-3fae-4065-a185-237186f31281 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:53.258785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82fed13d-3fae-4065-a185-237186f31281 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:53.259515 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82fed13d-3fae-4065-a185-237186f31281 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:53.260329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82fed13d-3fae-4065-a185-237186f31281 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:53.260811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-82fed13d-3fae-4065-a185-237186f31281 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:53.291625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:43:53.451248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-92dc59e1-8a63-49dc-9080-554b719fd67a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:53.458322 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-92dc59e1-8a63-49dc-9080-554b719fd67a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1279 microversion: 2.1 time: 0.303637 May 27 15:43:53.459454 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3280/6551] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:53 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1279 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:43:53.512110 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-82fed13d-3fae-4065-a185-237186f31281 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07458324aa44b6f97714ab2ab2b9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de878c1f022b4e9aa0b61f95b68536f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:53.522513 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-82fed13d-3fae-4065-a185-237186f31281 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b" status: 200 len: 1731 microversion: 2.1 time: 0.283277 May 27 15:43:53.523645 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3272/6552] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:53 2022] GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b => generated 1731 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:53.862884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2db839ef-2fb7-4c9d-8ae8-81755e449752 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:53.863769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2db839ef-2fb7-4c9d-8ae8-81755e449752 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:53.870430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2db839ef-2fb7-4c9d-8ae8-81755e449752 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:53.870919 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2db839ef-2fb7-4c9d-8ae8-81755e449752 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:53.871701 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2db839ef-2fb7-4c9d-8ae8-81755e449752 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:53.872643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2db839ef-2fb7-4c9d-8ae8-81755e449752 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:54.042658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2db839ef-2fb7-4c9d-8ae8-81755e449752 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:54.053859 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2db839ef-2fb7-4c9d-8ae8-81755e449752 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1691 microversion: 2.1 time: 0.194816 May 27 15:43:54.054853 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3281/6553] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:53 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1691 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:54.477635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8a56fc15-2d66-4933-92a6-85a1fc0c05d9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:54.478285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8a56fc15-2d66-4933-92a6-85a1fc0c05d9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:54.486793 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a56fc15-2d66-4933-92a6-85a1fc0c05d9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:54.487268 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a56fc15-2d66-4933-92a6-85a1fc0c05d9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:54.488065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a56fc15-2d66-4933-92a6-85a1fc0c05d9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:54.488896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a56fc15-2d66-4933-92a6-85a1fc0c05d9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:54.541361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b4c10111-4cf7-4aa3-b394-fadde6fa5165 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:54.543108 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b4c10111-4cf7-4aa3-b394-fadde6fa5165 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:54.556565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4c10111-4cf7-4aa3-b394-fadde6fa5165 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:54.557454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4c10111-4cf7-4aa3-b394-fadde6fa5165 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:54.558482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4c10111-4cf7-4aa3-b394-fadde6fa5165 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:54.559308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b4c10111-4cf7-4aa3-b394-fadde6fa5165 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:54.654836 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b4c10111-4cf7-4aa3-b394-fadde6fa5165 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07458324aa44b6f97714ab2ab2b9e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de878c1f022b4e9aa0b61f95b68536f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:54.672472 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b4c10111-4cf7-4aa3-b394-fadde6fa5165 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b" status: 200 len: 1663 microversion: 2.1 time: 0.134731 May 27 15:43:54.673576 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3282/6554] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:54 2022] GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b => generated 1663 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:43:54.678774 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8a56fc15-2d66-4933-92a6-85a1fc0c05d9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:54.692271 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8a56fc15-2d66-4933-92a6-85a1fc0c05d9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1279 microversion: 2.1 time: 0.218135 May 27 15:43:54.694300 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3273/6555] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:54 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1279 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:54.867147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-13c80927-3169-428c-a9db-6eac51bd4208 req-652c9a12-6b76-4403-b5c2-678a7eaa3e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6356ecad-39d9-4149-8277-8b378d9c806a", "name": "network-vif-plugged", "status": "completed", "tag": "6ca629e8-ab17-45ed-8a13-e4d4f0af9e12"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:43:54.889330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-13c80927-3169-428c-a9db-6eac51bd4208 req-652c9a12-6b76-4403-b5c2-678a7eaa3e2c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:54.890056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-13c80927-3169-428c-a9db-6eac51bd4208 req-652c9a12-6b76-4403-b5c2-678a7eaa3e2c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:54.910989 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-13c80927-3169-428c-a9db-6eac51bd4208 req-652c9a12-6b76-4403-b5c2-678a7eaa3e2c service nova] Creating event network-vif-plugged:6ca629e8-ab17-45ed-8a13-e4d4f0af9e12 for instance 6356ecad-39d9-4149-8277-8b378d9c806a on n-h2-843621-1 May 27 15:43:54.918346 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-13c80927-3169-428c-a9db-6eac51bd4208 req-652c9a12-6b76-4403-b5c2-678a7eaa3e2c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054770 May 27 15:43:54.919490 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3283/6556] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:43:55.073014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c0a39ac8-8b03-496d-aa86-3dd1a4ab9356 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:55.073672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c0a39ac8-8b03-496d-aa86-3dd1a4ab9356 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:55.092646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0a39ac8-8b03-496d-aa86-3dd1a4ab9356 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:55.093853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0a39ac8-8b03-496d-aa86-3dd1a4ab9356 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:55.095358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0a39ac8-8b03-496d-aa86-3dd1a4ab9356 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:55.097050 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c0a39ac8-8b03-496d-aa86-3dd1a4ab9356 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:55.139942 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-a34d589d-ccaa-4737-b365-9e86bdefea39 req-1bdc80ca-d06d-4f5c-b114-d762a5ab144b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3f014f-f6ed-471c-a518-f315e3b9d71b", "name": "network-vif-deleted", "tag": "d433bb92-2c24-4b34-ad75-7396c0dd6be1"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:43:55.165275 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-a34d589d-ccaa-4737-b365-9e86bdefea39 req-1bdc80ca-d06d-4f5c-b114-d762a5ab144b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:55.167793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-a34d589d-ccaa-4737-b365-9e86bdefea39 req-1bdc80ca-d06d-4f5c-b114-d762a5ab144b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:55.183944 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-a34d589d-ccaa-4737-b365-9e86bdefea39 req-1bdc80ca-d06d-4f5c-b114-d762a5ab144b service nova] Creating event network-vif-deleted:d433bb92-2c24-4b34-ad75-7396c0dd6be1 for instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b on n-h1-843621-1 May 27 15:43:55.191766 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-a34d589d-ccaa-4737-b365-9e86bdefea39 req-1bdc80ca-d06d-4f5c-b114-d762a5ab144b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057587 May 27 15:43:55.193288 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3284/6557] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:43:55.273563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c0a39ac8-8b03-496d-aa86-3dd1a4ab9356 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:55.284658 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c0a39ac8-8b03-496d-aa86-3dd1a4ab9356 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1683 microversion: 2.1 time: 0.215639 May 27 15:43:55.286053 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3274/6558] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:55 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1683 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:55.694795 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6560e12c-2ec1-447d-994e-cc59584698fe tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:55.695426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6560e12c-2ec1-447d-994e-cc59584698fe tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:55.703466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6560e12c-2ec1-447d-994e-cc59584698fe tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:55.703947 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6560e12c-2ec1-447d-994e-cc59584698fe tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:55.704774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6560e12c-2ec1-447d-994e-cc59584698fe tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:55.706036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6560e12c-2ec1-447d-994e-cc59584698fe tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:55.715296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9e2744f5-495f-454d-a52c-2c816b4a677d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:55.716617 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9e2744f5-495f-454d-a52c-2c816b4a677d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:55.721048 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:43:55.721260 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-6560e12c-2ec1-447d-994e-cc59584698fe tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] HTTP exception thrown: Instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b could not be found. May 27 15:43:55.722636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6560e12c-2ec1-447d-994e-cc59584698fe tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Request method failure captured: May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b HTTP/1.1 May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikPBNvU51dHpDvN3zYmUp94NVXyBlowsuhZRcyCLXwdYuwUT-8cq9H2Ofe7gs9gCdabgrsg75za_UYDiGFgcHdvuPwBvE0GgKSbROm5-KDIkZaGMKLqO8rrztExBasyQC3BaCBLPhE8PKQMGBM4NnPxrEv9i1HPwl58OsXI6LQjq_iH8 May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: de878c1f022b4e9aa0b61f95b68536f8 May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TestServerBasicOps-144224158 May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/de878c1f022b4e9aa0b61f95b68536f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/de878c1f022b4e9aa0b61f95b68536f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/de878c1f022b4e9aa0b61f95b68536f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_de878c1f022b4e9aa0b61f95b68536f8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TestServerBasicOps-144224158 May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: de878c1f022b4e9aa0b61f95b68536f8 May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TestServerBasicOps-144224158 May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TestServerBasicOps-144224158-project May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: e07458324aa44b6f97714ab2ab2b9e92 May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TestServerBasicOps-144224158-project May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b could not be found. May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '2d3f014f-f6ed-471c-a518-f315e3b9d71b'} May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b could not be found. May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b could not be found. May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:43:55.722902 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:55.727880 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:55.727880 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:43:55.727880 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:43:55.727880 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:43:55.727880 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:43:55.727880 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b could not be found. May 27 15:43:55.727880 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:55.729317 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6560e12c-2ec1-447d-994e-cc59584698fe tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Returning 404 to user: Instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:43:55.730362 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6560e12c-2ec1-447d-994e-cc59584698fe tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b" status: 404 len: 111 microversion: 2.1 time: 0.042928 May 27 15:43:55.731404 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3285/6559] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:55 2022] GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:43:55.734302 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e2744f5-495f-454d-a52c-2c816b4a677d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:55.736341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e2744f5-495f-454d-a52c-2c816b4a677d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:55.737262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e2744f5-495f-454d-a52c-2c816b4a677d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:55.737731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9e2744f5-495f-454d-a52c-2c816b4a677d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:55.900455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9e2744f5-495f-454d-a52c-2c816b4a677d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:55.910826 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9e2744f5-495f-454d-a52c-2c816b4a677d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1279 microversion: 2.1 time: 0.203166 May 27 15:43:55.912432 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3275/6560] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:55 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1279 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:43:56.277959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8633cefe-4689-4c4e-bfff-84b0ad8be506 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:56.279105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8633cefe-4689-4c4e-bfff-84b0ad8be506 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:56.281652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:43:56.287240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8633cefe-4689-4c4e-bfff-84b0ad8be506 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:56.287782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8633cefe-4689-4c4e-bfff-84b0ad8be506 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:56.288641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8633cefe-4689-4c4e-bfff-84b0ad8be506 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:56.289195 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8633cefe-4689-4c4e-bfff-84b0ad8be506 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:56.304550 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-8633cefe-4689-4c4e-bfff-84b0ad8be506 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] HTTP exception thrown: Instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b could not be found. May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8633cefe-4689-4c4e-bfff-84b0ad8be506 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Request method failure captured: May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b HTTP/1.1 May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikPBNvU51dHpDvN3zYmUp94NVXyBlowsuhZRcyCLXwdYuwUT-8cq9H2Ofe7gs9gCdabgrsg75za_UYDiGFgcHdvuPwBvE0GgKSbROm5-KDIkZaGMKLqO8rrztExBasyQC3BaCBLPhE8PKQMGBM4NnPxrEv9i1HPwl58OsXI6LQjq_iH8 May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: de878c1f022b4e9aa0b61f95b68536f8 May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TestServerBasicOps-144224158 May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/de878c1f022b4e9aa0b61f95b68536f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/de878c1f022b4e9aa0b61f95b68536f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/de878c1f022b4e9aa0b61f95b68536f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_de878c1f022b4e9aa0b61f95b68536f8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TestServerBasicOps-144224158 May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: de878c1f022b4e9aa0b61f95b68536f8 May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TestServerBasicOps-144224158 May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TestServerBasicOps-144224158-project May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: e07458324aa44b6f97714ab2ab2b9e92 May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TestServerBasicOps-144224158-project May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b could not be found. May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '2d3f014f-f6ed-471c-a518-f315e3b9d71b'} May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b could not be found. May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:43:56.306217 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b could not be found. May 27 15:43:56.310303 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:56.310303 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:43:56.310303 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:56.310303 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:56.310303 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:43:56.310303 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:43:56.310303 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:43:56.310303 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:43:56.310303 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b could not be found. May 27 15:43:56.310303 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:43:56.310303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8633cefe-4689-4c4e-bfff-84b0ad8be506 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Returning 404 to user: Instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:43:56.310303 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8633cefe-4689-4c4e-bfff-84b0ad8be506 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b" status: 404 len: 111 microversion: 2.1 time: 0.034957 May 27 15:43:56.310303 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3286/6561] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:43:56 2022] DELETE /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:43:56.316554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee031acd-576f-4800-bdc5-7ee4fecd8197 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:56.317220 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ee031acd-576f-4800-bdc5-7ee4fecd8197 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] [instance: 2d3f014f-f6ed-471c-a518-f315e3b9d71b] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:56.324468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee031acd-576f-4800-bdc5-7ee4fecd8197 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:56.324988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee031acd-576f-4800-bdc5-7ee4fecd8197 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:56.326329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee031acd-576f-4800-bdc5-7ee4fecd8197 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:56.326792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee031acd-576f-4800-bdc5-7ee4fecd8197 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:56.341835 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-ee031acd-576f-4800-bdc5-7ee4fecd8197 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] HTTP exception thrown: Instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b could not be found. May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee031acd-576f-4800-bdc5-7ee4fecd8197 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Request method failure captured: May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b HTTP/1.1 May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikPBNvU51dHpDvN3zYmUp94NVXyBlowsuhZRcyCLXwdYuwUT-8cq9H2Ofe7gs9gCdabgrsg75za_UYDiGFgcHdvuPwBvE0GgKSbROm5-KDIkZaGMKLqO8rrztExBasyQC3BaCBLPhE8PKQMGBM4NnPxrEv9i1HPwl58OsXI6LQjq_iH8 May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: de878c1f022b4e9aa0b61f95b68536f8 May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-TestServerBasicOps-144224158 May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/de878c1f022b4e9aa0b61f95b68536f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/de878c1f022b4e9aa0b61f95b68536f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/de878c1f022b4e9aa0b61f95b68536f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_de878c1f022b4e9aa0b61f95b68536f8", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-TestServerBasicOps-144224158 May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: de878c1f022b4e9aa0b61f95b68536f8 May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-TestServerBasicOps-144224158 May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-TestServerBasicOps-144224158-project May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: e07458324aa44b6f97714ab2ab2b9e92 May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-TestServerBasicOps-144224158-project May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b could not be found. May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '2d3f014f-f6ed-471c-a518-f315e3b9d71b'} May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b could not be found. May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b could not be found. May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:43:56.343648 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:43:56.351082 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:43:56.351082 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:43:56.351082 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:43:56.351082 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:43:56.351082 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:43:56.351082 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b could not be found. May 27 15:43:56.351082 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:43:56.351082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee031acd-576f-4800-bdc5-7ee4fecd8197 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Returning 404 to user: Instance 2d3f014f-f6ed-471c-a518-f315e3b9d71b could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:43:56.351082 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ee031acd-576f-4800-bdc5-7ee4fecd8197 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b" status: 404 len: 111 microversion: 2.1 time: 0.032534 May 27 15:43:56.351082 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3276/6562] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:56 2022] GET /compute/v2.1/servers/2d3f014f-f6ed-471c-a518-f315e3b9d71b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:43:56.522535 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b497cc96-9093-458d-979a-33e233910416 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] Calling method '.version_select at 0x7fc775aa0310>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:56.563191 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b497cc96-9093-458d-979a-33e233910416 tempest-TestServerBasicOps-144224158 tempest-TestServerBasicOps-144224158-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-931418992" status: 202 len: 0 microversion: 2.1 time: 0.044361 May 27 15:43:56.563770 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3287/6563] 10.222.0.13 () {58 vars in 1250 bytes} [Fri May 27 15:43:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-931418992 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:43:56.932250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-db0d3064-5b69-4e83-b635-6628b6b4e0d6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:56.933347 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-db0d3064-5b69-4e83-b635-6628b6b4e0d6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:56.941174 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db0d3064-5b69-4e83-b635-6628b6b4e0d6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:56.941621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db0d3064-5b69-4e83-b635-6628b6b4e0d6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:56.942499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db0d3064-5b69-4e83-b635-6628b6b4e0d6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:56.942880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-db0d3064-5b69-4e83-b635-6628b6b4e0d6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:57.186789 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-db0d3064-5b69-4e83-b635-6628b6b4e0d6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:57.195179 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-db0d3064-5b69-4e83-b635-6628b6b4e0d6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1279 microversion: 2.1 time: 0.266751 May 27 15:43:57.195884 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3277/6564] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:56 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1279 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:58.213805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8ee880b7-eb32-4b88-ae3f-949c1dadc180 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:58.214422 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8ee880b7-eb32-4b88-ae3f-949c1dadc180 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:58.225479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ee880b7-eb32-4b88-ae3f-949c1dadc180 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:58.226006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ee880b7-eb32-4b88-ae3f-949c1dadc180 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:58.226801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ee880b7-eb32-4b88-ae3f-949c1dadc180 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:58.227258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ee880b7-eb32-4b88-ae3f-949c1dadc180 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:58.469176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8ee880b7-eb32-4b88-ae3f-949c1dadc180 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:58.477390 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8ee880b7-eb32-4b88-ae3f-949c1dadc180 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1267 microversion: 2.1 time: 0.268183 May 27 15:43:58.478106 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3288/6565] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:58 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1267 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:43:59.495036 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a9079b7a-0b98-47c2-8343-14fdeb199c16 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:43:59.495665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a9079b7a-0b98-47c2-8343-14fdeb199c16 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:43:59.505370 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a9079b7a-0b98-47c2-8343-14fdeb199c16 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:59.505851 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a9079b7a-0b98-47c2-8343-14fdeb199c16 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:59.506875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a9079b7a-0b98-47c2-8343-14fdeb199c16 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:43:59.507341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a9079b7a-0b98-47c2-8343-14fdeb199c16 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:43:59.724500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a9079b7a-0b98-47c2-8343-14fdeb199c16 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:43:59.734088 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a9079b7a-0b98-47c2-8343-14fdeb199c16 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1267 microversion: 2.1 time: 0.242874 May 27 15:43:59.735608 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3278/6566] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:43:59 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1267 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:00.753906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bb059316-36d3-49de-a935-9f123ebd6637 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:00.754711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bb059316-36d3-49de-a935-9f123ebd6637 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:00.763667 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb059316-36d3-49de-a935-9f123ebd6637 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:00.764132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb059316-36d3-49de-a935-9f123ebd6637 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:00.764944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb059316-36d3-49de-a935-9f123ebd6637 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:00.765390 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bb059316-36d3-49de-a935-9f123ebd6637 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:00.984015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bb059316-36d3-49de-a935-9f123ebd6637 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:00.992060 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bb059316-36d3-49de-a935-9f123ebd6637 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1267 microversion: 2.1 time: 0.244021 May 27 15:44:00.992640 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3289/6567] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:00 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:02.010832 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-77cf5bb2-fdb0-4d35-b55e-952360d0e474 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:02.012441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-77cf5bb2-fdb0-4d35-b55e-952360d0e474 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:02.020049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77cf5bb2-fdb0-4d35-b55e-952360d0e474 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:02.021113 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77cf5bb2-fdb0-4d35-b55e-952360d0e474 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:02.022172 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77cf5bb2-fdb0-4d35-b55e-952360d0e474 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:02.022841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77cf5bb2-fdb0-4d35-b55e-952360d0e474 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:02.253804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-77cf5bb2-fdb0-4d35-b55e-952360d0e474 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:02.262116 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-77cf5bb2-fdb0-4d35-b55e-952360d0e474 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1267 microversion: 2.1 time: 0.255701 May 27 15:44:02.263613 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3279/6568] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:02 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1267 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:44:03.280613 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-be470731-11db-4d04-8d88-04ef5f797958 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:03.281394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-be470731-11db-4d04-8d88-04ef5f797958 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:03.289130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be470731-11db-4d04-8d88-04ef5f797958 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:03.290085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be470731-11db-4d04-8d88-04ef5f797958 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:03.291090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be470731-11db-4d04-8d88-04ef5f797958 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:03.291695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be470731-11db-4d04-8d88-04ef5f797958 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:03.561813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-be470731-11db-4d04-8d88-04ef5f797958 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:03.570574 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-be470731-11db-4d04-8d88-04ef5f797958 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1267 microversion: 2.1 time: 0.294670 May 27 15:44:03.571160 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3290/6569] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:03 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1267 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:04.587880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5025d132-cf2a-4ac9-bb62-cb2e6c970698 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:04.588572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5025d132-cf2a-4ac9-bb62-cb2e6c970698 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:04.591634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:44:04.597978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5025d132-cf2a-4ac9-bb62-cb2e6c970698 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:04.598456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5025d132-cf2a-4ac9-bb62-cb2e6c970698 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:04.599307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5025d132-cf2a-4ac9-bb62-cb2e6c970698 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:04.599769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5025d132-cf2a-4ac9-bb62-cb2e6c970698 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:04.751346 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5025d132-cf2a-4ac9-bb62-cb2e6c970698 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:04.759670 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5025d132-cf2a-4ac9-bb62-cb2e6c970698 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1267 microversion: 2.1 time: 0.175722 May 27 15:44:04.760057 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3280/6570] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:04 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:05.775641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4e777f30-fa35-42d1-90a8-c5ce86d1ea0d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:05.776351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4e777f30-fa35-42d1-90a8-c5ce86d1ea0d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:05.784617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e777f30-fa35-42d1-90a8-c5ce86d1ea0d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:05.785096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e777f30-fa35-42d1-90a8-c5ce86d1ea0d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:05.785882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e777f30-fa35-42d1-90a8-c5ce86d1ea0d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:05.786325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4e777f30-fa35-42d1-90a8-c5ce86d1ea0d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:05.939327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4e777f30-fa35-42d1-90a8-c5ce86d1ea0d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:05.948737 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4e777f30-fa35-42d1-90a8-c5ce86d1ea0d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1267 microversion: 2.1 time: 0.176972 May 27 15:44:05.953244 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3291/6571] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:05 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:06.966495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c52aef42-4c93-4c70-a37e-9bf3c8f19c17 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:06.967149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c52aef42-4c93-4c70-a37e-9bf3c8f19c17 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:06.975491 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c52aef42-4c93-4c70-a37e-9bf3c8f19c17 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:06.975971 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c52aef42-4c93-4c70-a37e-9bf3c8f19c17 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:06.977001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c52aef42-4c93-4c70-a37e-9bf3c8f19c17 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:06.977474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c52aef42-4c93-4c70-a37e-9bf3c8f19c17 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:07.139625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c52aef42-4c93-4c70-a37e-9bf3c8f19c17 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:07.151385 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c52aef42-4c93-4c70-a37e-9bf3c8f19c17 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1267 microversion: 2.1 time: 0.189442 May 27 15:44:07.152189 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3281/6572] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:06 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:08.173462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5e8dfd33-493f-4cce-bf9b-b857a7b12fe1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:08.175346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5e8dfd33-493f-4cce-bf9b-b857a7b12fe1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:08.188470 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:44:08.203133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e8dfd33-493f-4cce-bf9b-b857a7b12fe1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:08.204193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e8dfd33-493f-4cce-bf9b-b857a7b12fe1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:08.205352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e8dfd33-493f-4cce-bf9b-b857a7b12fe1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:08.206337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5e8dfd33-493f-4cce-bf9b-b857a7b12fe1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:08.489250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5e8dfd33-493f-4cce-bf9b-b857a7b12fe1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:08.499867 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5e8dfd33-493f-4cce-bf9b-b857a7b12fe1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1267 microversion: 2.1 time: 0.333103 May 27 15:44:08.500475 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3292/6573] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:08 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1267 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:09.104376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-e7eb5fce-a312-4070-8f04-cf571f93907a req-bc7f9aa3-8552-4790-856a-6f5ed0df5558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb", "name": "network-vif-plugged", "status": "completed", "tag": "e00c910d-0165-4807-830e-1511dd7dcd0f"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:09.116131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e7eb5fce-a312-4070-8f04-cf571f93907a req-bc7f9aa3-8552-4790-856a-6f5ed0df5558 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:09.116931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e7eb5fce-a312-4070-8f04-cf571f93907a req-bc7f9aa3-8552-4790-856a-6f5ed0df5558 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:09.131423 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-e7eb5fce-a312-4070-8f04-cf571f93907a req-bc7f9aa3-8552-4790-856a-6f5ed0df5558 service nova] Creating event network-vif-plugged:e00c910d-0165-4807-830e-1511dd7dcd0f for instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb on n-h2-843621-1 May 27 15:44:09.137811 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-e7eb5fce-a312-4070-8f04-cf571f93907a req-bc7f9aa3-8552-4790-856a-6f5ed0df5558 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037676 May 27 15:44:09.138591 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3282/6574] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:44:09.519307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8a2df111-3fe0-49ad-860e-6aa80d6a6600 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:09.520567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8a2df111-3fe0-49ad-860e-6aa80d6a6600 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:09.528991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a2df111-3fe0-49ad-860e-6aa80d6a6600 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:09.529932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a2df111-3fe0-49ad-860e-6aa80d6a6600 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:09.531074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a2df111-3fe0-49ad-860e-6aa80d6a6600 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:09.531788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a2df111-3fe0-49ad-860e-6aa80d6a6600 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:09.829809 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8a2df111-3fe0-49ad-860e-6aa80d6a6600 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:09.852248 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8a2df111-3fe0-49ad-860e-6aa80d6a6600 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1267 microversion: 2.1 time: 0.331097 May 27 15:44:09.857147 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3293/6575] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:09 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1267 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:10.748013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8f80a51e-1ccd-495b-bdf5-264a4897a940 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Action: 'create', calling method: .version_select at 0x7fc7757149d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-462017487", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6gBXN5IeiNwFNnoJNc418NIbRzvIk8WciQpwDqRWmCapcKGZL/fT7SfLIcHiU9/kB07TvbNQSoCdKJcK8hpAdk8e9GZMoYMbR9DCqdUUV62x5E0TT2h71DCS8Tux9Z/g=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:10.793557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-8f80a51e-1ccd-495b-bdf5-264a4897a940 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Getting quotas for project 750a9fb34cb440b98e8a99f3a0775da2. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:44:10.819295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-8f80a51e-1ccd-495b-bdf5-264a4897a940 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Getting quotas for user ca3a1b4ce9b04d87978051169855e4a8 and project 750a9fb34cb440b98e8a99f3a0775da2. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:44:10.865802 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8f80a51e-1ccd-495b-bdf5-264a4897a940 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.125652 May 27 15:44:10.868427 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3283/6576] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:44:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:44:10.877835 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7924b618-d6ec-4902-bbe7-ecf8e8ec75a5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:10.878566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7924b618-d6ec-4902-bbe7-ecf8e8ec75a5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:10.890744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7924b618-d6ec-4902-bbe7-ecf8e8ec75a5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:10.895076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7924b618-d6ec-4902-bbe7-ecf8e8ec75a5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:10.896035 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7924b618-d6ec-4902-bbe7-ecf8e8ec75a5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:10.899094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7924b618-d6ec-4902-bbe7-ecf8e8ec75a5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:11.242881 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7924b618-d6ec-4902-bbe7-ecf8e8ec75a5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:11.256189 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7924b618-d6ec-4902-bbe7-ecf8e8ec75a5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1453 microversion: 2.1 time: 0.383114 May 27 15:44:11.257265 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3294/6577] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:10 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1453 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:11.275054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ee5e8b91-ae29-4413-9f37-d07dab03dba8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:11.275881 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ee5e8b91-ae29-4413-9f37-d07dab03dba8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:11.282927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee5e8b91-ae29-4413-9f37-d07dab03dba8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:11.283660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee5e8b91-ae29-4413-9f37-d07dab03dba8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:11.284549 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee5e8b91-ae29-4413-9f37-d07dab03dba8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:11.285231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ee5e8b91-ae29-4413-9f37-d07dab03dba8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:11.613645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ee5e8b91-ae29-4413-9f37-d07dab03dba8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:11.632571 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ee5e8b91-ae29-4413-9f37-d07dab03dba8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1453 microversion: 2.1 time: 0.361972 May 27 15:44:11.646128 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3284/6578] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:11 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1453 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:13.175737 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e54570c3-eb40-4d19-84f3-82a2f015b3f3 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1089450166", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "dd181c3f-8a71-4339-874c-657aa73ab537"}], "key_name": "tempest-TestNetworkBasicOps-462017487", "security_groups": [{"name": "tempest-secgroup-smoke-1699115402"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:13.470776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-e54570c3-eb40-4d19-84f3-82a2f015b3f3 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] validate_networks() for [('dd181c3f-8a71-4339-874c-657aa73ab537', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:44:15.044946 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-e54570c3-eb40-4d19-84f3-82a2f015b3f3 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:44:15.045533 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-e54570c3-eb40-4d19-84f3-82a2f015b3f3 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:44:15.045856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-e54570c3-eb40-4d19-84f3-82a2f015b3f3 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:44:15.046282 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-e54570c3-eb40-4d19-84f3-82a2f015b3f3 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:44:15.046709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-e54570c3-eb40-4d19-84f3-82a2f015b3f3 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:44:15.063863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e54570c3-eb40-4d19-84f3-82a2f015b3f3 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:15.065911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e54570c3-eb40-4d19-84f3-82a2f015b3f3 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:15.066977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e54570c3-eb40-4d19-84f3-82a2f015b3f3 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:15.067601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e54570c3-eb40-4d19-84f3-82a2f015b3f3 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:15.088940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-e54570c3-eb40-4d19-84f3-82a2f015b3f3 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Getting quotas for project 750a9fb34cb440b98e8a99f3a0775da2. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:44:15.095807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-e54570c3-eb40-4d19-84f3-82a2f015b3f3 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Getting quotas for user ca3a1b4ce9b04d87978051169855e4a8 and project 750a9fb34cb440b98e8a99f3a0775da2. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:44:15.127840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e54570c3-eb40-4d19-84f3-82a2f015b3f3 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:44:15.130629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e54570c3-eb40-4d19-84f3-82a2f015b3f3 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 8e001efa-96fd-46dc-abf3-55c6baeb2175] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:44:15.204307 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e54570c3-eb40-4d19-84f3-82a2f015b3f3 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.028296 May 27 15:44:15.205914 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3295/6579] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:44:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 2035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:44:15.216664 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d223f015-f2bd-4db4-9a6b-8ff9f1347841 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:15.217358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d223f015-f2bd-4db4-9a6b-8ff9f1347841 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 8e001efa-96fd-46dc-abf3-55c6baeb2175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:15.332828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d223f015-f2bd-4db4-9a6b-8ff9f1347841 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:15.344653 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d223f015-f2bd-4db4-9a6b-8ff9f1347841 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175" status: 200 len: 1248 microversion: 2.1 time: 0.132812 May 27 15:44:15.345689 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3285/6580] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:15 2022] GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175 => generated 1248 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:16.362845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2f6a304a-ad28-495d-8f07-a3de4ec887d9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:16.363467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2f6a304a-ad28-495d-8f07-a3de4ec887d9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 8e001efa-96fd-46dc-abf3-55c6baeb2175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:16.374112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2f6a304a-ad28-495d-8f07-a3de4ec887d9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:16.374491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2f6a304a-ad28-495d-8f07-a3de4ec887d9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:16.375296 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2f6a304a-ad28-495d-8f07-a3de4ec887d9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:16.375752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2f6a304a-ad28-495d-8f07-a3de4ec887d9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:16.464733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2f6a304a-ad28-495d-8f07-a3de4ec887d9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:16.476639 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2f6a304a-ad28-495d-8f07-a3de4ec887d9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175" status: 200 len: 1308 microversion: 2.1 time: 0.117500 May 27 15:44:16.479620 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3296/6581] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:16 2022] GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175 => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:16.836234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-277417cc-7323-4f1c-8da2-430b6c249190 req-60f24d8c-dd88-45ae-9e7c-64d47f47bc8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb", "tag": "e00c910d-0165-4807-830e-1511dd7dcd0f"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:16.854742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-277417cc-7323-4f1c-8da2-430b6c249190 req-60f24d8c-dd88-45ae-9e7c-64d47f47bc8c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:16.855653 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-277417cc-7323-4f1c-8da2-430b6c249190 req-60f24d8c-dd88-45ae-9e7c-64d47f47bc8c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:16.871155 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-277417cc-7323-4f1c-8da2-430b6c249190 req-60f24d8c-dd88-45ae-9e7c-64d47f47bc8c service nova] Creating event network-changed:e00c910d-0165-4807-830e-1511dd7dcd0f for instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb on n-h2-843621-1 May 27 15:44:16.879640 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-277417cc-7323-4f1c-8da2-430b6c249190 req-60f24d8c-dd88-45ae-9e7c-64d47f47bc8c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048963 May 27 15:44:16.881829 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3286/6582] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:44:17.500728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4663702f-2fd8-4b29-8cbf-59c9bdb04745 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:17.501821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4663702f-2fd8-4b29-8cbf-59c9bdb04745 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 8e001efa-96fd-46dc-abf3-55c6baeb2175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:17.511919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fb0f4fff-c966-426c-b71a-5c3a6cc0b42e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:17.514020 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fb0f4fff-c966-426c-b71a-5c3a6cc0b42e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:17.514959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4663702f-2fd8-4b29-8cbf-59c9bdb04745 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:17.517157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4663702f-2fd8-4b29-8cbf-59c9bdb04745 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:17.520902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4663702f-2fd8-4b29-8cbf-59c9bdb04745 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:17.521646 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4663702f-2fd8-4b29-8cbf-59c9bdb04745 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:17.529675 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb0f4fff-c966-426c-b71a-5c3a6cc0b42e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:17.532185 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb0f4fff-c966-426c-b71a-5c3a6cc0b42e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:17.533350 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb0f4fff-c966-426c-b71a-5c3a6cc0b42e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:17.535634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb0f4fff-c966-426c-b71a-5c3a6cc0b42e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:17.624283 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fb0f4fff-c966-426c-b71a-5c3a6cc0b42e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a/action" status: 200 len: 24574 microversion: 2.1 time: 0.117457 May 27 15:44:17.625238 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3287/6583] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:44:17 2022] POST /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a/action => generated 24574 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:44:18.376444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4663702f-2fd8-4b29-8cbf-59c9bdb04745 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:18.387418 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4663702f-2fd8-4b29-8cbf-59c9bdb04745 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175" status: 200 len: 1374 microversion: 2.1 time: 0.890224 May 27 15:44:18.388321 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3297/6584] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:17 2022] GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175 => generated 1374 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:19.042116 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-701d6e6e-b7ae-4fe1-ad7d-44d73c89a38c req-53241c37-8ce7-4e48-bf18-a588fddfeb8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e001efa-96fd-46dc-abf3-55c6baeb2175", "tag": "c98f39fe-0f53-43d1-b9cc-529d63f9cbfa"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:19.068864 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-701d6e6e-b7ae-4fe1-ad7d-44d73c89a38c req-53241c37-8ce7-4e48-bf18-a588fddfeb8c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:19.069349 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-701d6e6e-b7ae-4fe1-ad7d-44d73c89a38c req-53241c37-8ce7-4e48-bf18-a588fddfeb8c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:19.085409 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-701d6e6e-b7ae-4fe1-ad7d-44d73c89a38c req-53241c37-8ce7-4e48-bf18-a588fddfeb8c service nova] Creating event network-changed:c98f39fe-0f53-43d1-b9cc-529d63f9cbfa for instance 8e001efa-96fd-46dc-abf3-55c6baeb2175 on n-h1-843621-1 May 27 15:44:19.092146 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-701d6e6e-b7ae-4fe1-ad7d-44d73c89a38c req-53241c37-8ce7-4e48-bf18-a588fddfeb8c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054321 May 27 15:44:19.092999 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3288/6585] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:44:19.405574 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b64adc34-c57b-4a1e-b24f-1f786152c72b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:19.408216 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b64adc34-c57b-4a1e-b24f-1f786152c72b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 8e001efa-96fd-46dc-abf3-55c6baeb2175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:19.419335 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b64adc34-c57b-4a1e-b24f-1f786152c72b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:19.420395 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b64adc34-c57b-4a1e-b24f-1f786152c72b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:19.421723 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b64adc34-c57b-4a1e-b24f-1f786152c72b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:19.423181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b64adc34-c57b-4a1e-b24f-1f786152c72b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:19.679114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b64adc34-c57b-4a1e-b24f-1f786152c72b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:19.683209 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:44:19.694075 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b64adc34-c57b-4a1e-b24f-1f786152c72b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175" status: 200 len: 1374 microversion: 2.1 time: 0.292802 May 27 15:44:19.694821 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3298/6586] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:19 2022] GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175 => generated 1374 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:19.783180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-853318b0-5f67-4227-a7c9-81b1f65e6728 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:19.784391 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:44:19.784391 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:44:19.786476 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-853318b0-5f67-4227-a7c9-81b1f65e6728 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:19.786956 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-853318b0-5f67-4227-a7c9-81b1f65e6728 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:19.788323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-853318b0-5f67-4227-a7c9-81b1f65e6728 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:19.789018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-853318b0-5f67-4227-a7c9-81b1f65e6728 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:19.815730 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-853318b0-5f67-4227-a7c9-81b1f65e6728 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.191577 May 27 15:44:19.816122 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3289/6587] 10.222.0.13 () {58 vars in 1184 bytes} [Fri May 27 15:44:19 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:44:19.926116 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-66e94870-01b1-47ab-8070-bac92dce737b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-657431655", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "availability_zone": "nova:n-h2-843621-1", "networks": [{"uuid": "e4bf89d8-7e6c-4caf-9df5-f95917916593"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:19.988531 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-66e94870-01b1-47ab-8070-bac92dce737b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] validate_networks() for [('e4bf89d8-7e6c-4caf-9df5-f95917916593', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:44:20.399492 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-66e94870-01b1-47ab-8070-bac92dce737b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:44:20.400031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-66e94870-01b1-47ab-8070-bac92dce737b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:44:20.400578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-66e94870-01b1-47ab-8070-bac92dce737b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:44:20.401085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-66e94870-01b1-47ab-8070-bac92dce737b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:44:20.401570 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-66e94870-01b1-47ab-8070-bac92dce737b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:44:20.411727 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66e94870-01b1-47ab-8070-bac92dce737b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:20.412360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66e94870-01b1-47ab-8070-bac92dce737b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:20.413231 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66e94870-01b1-47ab-8070-bac92dce737b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:20.413729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-66e94870-01b1-47ab-8070-bac92dce737b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:20.432326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-66e94870-01b1-47ab-8070-bac92dce737b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Getting quotas for project e72f43934920456bb3949741dcb6ef3d. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:44:20.437542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-66e94870-01b1-47ab-8070-bac92dce737b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Getting quotas for user c1bd4e9c802c481db8c256b0ac773b36 and project e72f43934920456bb3949741dcb6ef3d. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:44:20.450372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-66e94870-01b1-47ab-8070-bac92dce737b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:44:20.452536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-66e94870-01b1-47ab-8070-bac92dce737b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 15a78847-f450-4247-8db9-36883bf2eebd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:44:20.497623 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-66e94870-01b1-47ab-8070-bac92dce737b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575290 May 27 15:44:20.498284 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3299/6588] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:44:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:44:20.508045 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f30a7a53-f17c-46b8-aaba-031b9bfe55b8 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:20.508803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f30a7a53-f17c-46b8-aaba-031b9bfe55b8 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 15a78847-f450-4247-8db9-36883bf2eebd] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:20.570462 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f30a7a53-f17c-46b8-aaba-031b9bfe55b8 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd" status: 200 len: 1328 microversion: 2.1 time: 0.066130 May 27 15:44:20.571253 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3290/6589] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:20 2022] GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd => generated 1328 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:20.711443 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9a3e391f-2067-4dad-8dfb-8e4e447973e9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:20.712442 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9a3e391f-2067-4dad-8dfb-8e4e447973e9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 8e001efa-96fd-46dc-abf3-55c6baeb2175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:20.720849 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a3e391f-2067-4dad-8dfb-8e4e447973e9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:20.721376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a3e391f-2067-4dad-8dfb-8e4e447973e9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:20.722422 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a3e391f-2067-4dad-8dfb-8e4e447973e9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:20.724076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9a3e391f-2067-4dad-8dfb-8e4e447973e9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:20.876396 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9a3e391f-2067-4dad-8dfb-8e4e447973e9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:20.884136 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9a3e391f-2067-4dad-8dfb-8e4e447973e9 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175" status: 200 len: 1374 microversion: 2.1 time: 0.176623 May 27 15:44:20.884990 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3300/6590] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:20 2022] GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:21.588570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6f56bdd9-c101-4eee-a421-f26def214604 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:21.589435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6f56bdd9-c101-4eee-a421-f26def214604 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 15a78847-f450-4247-8db9-36883bf2eebd] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:21.604698 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f56bdd9-c101-4eee-a421-f26def214604 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:21.605496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f56bdd9-c101-4eee-a421-f26def214604 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:21.607364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f56bdd9-c101-4eee-a421-f26def214604 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:21.607973 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6f56bdd9-c101-4eee-a421-f26def214604 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:21.786242 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6f56bdd9-c101-4eee-a421-f26def214604 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd" status: 200 len: 1423 microversion: 2.1 time: 0.201308 May 27 15:44:21.789067 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3291/6591] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:21 2022] GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd => generated 1423 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:21.904875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6f7f200d-6b29-4c24-beec-cbc3ef422e90 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:21.906006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6f7f200d-6b29-4c24-beec-cbc3ef422e90 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 8e001efa-96fd-46dc-abf3-55c6baeb2175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:21.916591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f7f200d-6b29-4c24-beec-cbc3ef422e90 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:21.917207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f7f200d-6b29-4c24-beec-cbc3ef422e90 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:21.918204 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f7f200d-6b29-4c24-beec-cbc3ef422e90 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:21.918855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6f7f200d-6b29-4c24-beec-cbc3ef422e90 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:22.094012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6f7f200d-6b29-4c24-beec-cbc3ef422e90 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:22.103969 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6f7f200d-6b29-4c24-beec-cbc3ef422e90 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175" status: 200 len: 1374 microversion: 2.1 time: 0.204336 May 27 15:44:22.104900 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3301/6592] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:21 2022] GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175 => generated 1374 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:22.824230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b4703307-744b-4659-be83-b6f0151fb45a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:22.826621 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b4703307-744b-4659-be83-b6f0151fb45a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 15a78847-f450-4247-8db9-36883bf2eebd] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:22.836770 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4703307-744b-4659-be83-b6f0151fb45a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:22.837477 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4703307-744b-4659-be83-b6f0151fb45a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:22.839018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4703307-744b-4659-be83-b6f0151fb45a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:22.839662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4703307-744b-4659-be83-b6f0151fb45a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:23.023049 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b4703307-744b-4659-be83-b6f0151fb45a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd" status: 200 len: 1463 microversion: 2.1 time: 0.201035 May 27 15:44:23.034276 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3292/6593] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:22 2022] GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd => generated 1463 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:23.130497 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d882fb21-0bbb-4e6e-b342-0b60840946d5 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:23.135006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d882fb21-0bbb-4e6e-b342-0b60840946d5 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 8e001efa-96fd-46dc-abf3-55c6baeb2175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:23.154343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d882fb21-0bbb-4e6e-b342-0b60840946d5 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:23.155200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d882fb21-0bbb-4e6e-b342-0b60840946d5 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:23.156207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d882fb21-0bbb-4e6e-b342-0b60840946d5 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:23.156877 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d882fb21-0bbb-4e6e-b342-0b60840946d5 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:23.370035 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d882fb21-0bbb-4e6e-b342-0b60840946d5 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:23.378166 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d882fb21-0bbb-4e6e-b342-0b60840946d5 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175" status: 200 len: 1374 microversion: 2.1 time: 0.258076 May 27 15:44:23.378874 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3302/6594] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:23 2022] GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175 => generated 1374 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:23.489762 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-135c15b6-07d5-41e7-90e9-9de62ff62563 req-17eeb915-c7aa-40bc-a389-6b1b2ed6d1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a78847-f450-4247-8db9-36883bf2eebd", "tag": "8674b0da-0a36-4616-a0a3-f915507a18c3"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:23.510616 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-135c15b6-07d5-41e7-90e9-9de62ff62563 req-17eeb915-c7aa-40bc-a389-6b1b2ed6d1c0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:23.511371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-135c15b6-07d5-41e7-90e9-9de62ff62563 req-17eeb915-c7aa-40bc-a389-6b1b2ed6d1c0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:23.515898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=83 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:44:23.529488 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-135c15b6-07d5-41e7-90e9-9de62ff62563 req-17eeb915-c7aa-40bc-a389-6b1b2ed6d1c0 service nova] Creating event network-changed:8674b0da-0a36-4616-a0a3-f915507a18c3 for instance 15a78847-f450-4247-8db9-36883bf2eebd on n-h2-843621-1 May 27 15:44:23.536060 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-135c15b6-07d5-41e7-90e9-9de62ff62563 req-17eeb915-c7aa-40bc-a389-6b1b2ed6d1c0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049941 May 27 15:44:23.537355 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3293/6595] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:44:23.828220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b5d7e0e3-aae4-4e5e-b839-c881c70e6bb6 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:23.829834 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b5d7e0e3-aae4-4e5e-b839-c881c70e6bb6 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:23.838474 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b5d7e0e3-aae4-4e5e-b839-c881c70e6bb6 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:23.838858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b5d7e0e3-aae4-4e5e-b839-c881c70e6bb6 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:23.839567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b5d7e0e3-aae4-4e5e-b839-c881c70e6bb6 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:23.843855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b5d7e0e3-aae4-4e5e-b839-c881c70e6bb6 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:24.003710 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b5d7e0e3-aae4-4e5e-b839-c881c70e6bb6 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1834 microversion: 2.1 time: 0.184491 May 27 15:44:24.004310 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3303/6596] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:23 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1834 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:24.042734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-96346aa8-30d6-4d96-99e9-f62c7674b63a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:24.044319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-96346aa8-30d6-4d96-99e9-f62c7674b63a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 15a78847-f450-4247-8db9-36883bf2eebd] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:24.050954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-96346aa8-30d6-4d96-99e9-f62c7674b63a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:24.051688 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-96346aa8-30d6-4d96-99e9-f62c7674b63a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:24.052503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-96346aa8-30d6-4d96-99e9-f62c7674b63a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:24.053154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-96346aa8-30d6-4d96-99e9-f62c7674b63a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:24.294289 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-96346aa8-30d6-4d96-99e9-f62c7674b63a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd" status: 200 len: 1463 microversion: 2.1 time: 0.255847 May 27 15:44:24.296902 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3294/6597] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:24 2022] GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd => generated 1463 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:24.396097 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6e64601e-b16a-493d-9ecd-1b448f80d4f4 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:24.397368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6e64601e-b16a-493d-9ecd-1b448f80d4f4 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 8e001efa-96fd-46dc-abf3-55c6baeb2175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:24.405752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6e64601e-b16a-493d-9ecd-1b448f80d4f4 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:24.406479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6e64601e-b16a-493d-9ecd-1b448f80d4f4 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:24.407671 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6e64601e-b16a-493d-9ecd-1b448f80d4f4 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:24.408280 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6e64601e-b16a-493d-9ecd-1b448f80d4f4 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:24.606448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6e64601e-b16a-493d-9ecd-1b448f80d4f4 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:24.614807 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6e64601e-b16a-493d-9ecd-1b448f80d4f4 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175" status: 200 len: 1374 microversion: 2.1 time: 0.223098 May 27 15:44:24.615380 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3304/6598] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:24 2022] GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175 => generated 1374 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:25.087428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-640aa08c-52ac-4fa3-b51a-d0cee7f6a2ad tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:25.087975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-640aa08c-52ac-4fa3-b51a-d0cee7f6a2ad tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:25.089623 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-304ec39e-831f-4374-b9bb-5e51e5cb5bfd req-4bdc46e2-f749-4b8d-ad16-a15f26bcca9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6356ecad-39d9-4149-8277-8b378d9c806a", "tag": "6ca629e8-ab17-45ed-8a13-e4d4f0af9e12"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:25.095514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-640aa08c-52ac-4fa3-b51a-d0cee7f6a2ad tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:25.096284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-640aa08c-52ac-4fa3-b51a-d0cee7f6a2ad tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:25.097303 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-640aa08c-52ac-4fa3-b51a-d0cee7f6a2ad tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:25.098003 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-640aa08c-52ac-4fa3-b51a-d0cee7f6a2ad tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:25.100182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-304ec39e-831f-4374-b9bb-5e51e5cb5bfd req-4bdc46e2-f749-4b8d-ad16-a15f26bcca9b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:25.100650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-304ec39e-831f-4374-b9bb-5e51e5cb5bfd req-4bdc46e2-f749-4b8d-ad16-a15f26bcca9b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:25.123719 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-304ec39e-831f-4374-b9bb-5e51e5cb5bfd req-4bdc46e2-f749-4b8d-ad16-a15f26bcca9b service nova] Creating event network-changed:6ca629e8-ab17-45ed-8a13-e4d4f0af9e12 for instance 6356ecad-39d9-4149-8277-8b378d9c806a on n-h2-843621-1 May 27 15:44:25.133581 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-304ec39e-831f-4374-b9bb-5e51e5cb5bfd req-4bdc46e2-f749-4b8d-ad16-a15f26bcca9b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049025 May 27 15:44:25.134202 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3305/6599] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:44:25.150257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-640aa08c-52ac-4fa3-b51a-d0cee7f6a2ad tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:44:25.263883 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-640aa08c-52ac-4fa3-b51a-d0cee7f6a2ad tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 204 len: 0 microversion: 2.1 time: 0.180184 May 27 15:44:25.269805 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3295/6600] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:44:25 2022] DELETE /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:44:25.274876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d4e3434e-1609-4ff6-8d49-848383a6260f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:25.275596 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d4e3434e-1609-4ff6-8d49-848383a6260f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:25.283660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d4e3434e-1609-4ff6-8d49-848383a6260f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:25.284450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d4e3434e-1609-4ff6-8d49-848383a6260f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:25.285519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d4e3434e-1609-4ff6-8d49-848383a6260f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:25.286271 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d4e3434e-1609-4ff6-8d49-848383a6260f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:25.318086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d8aed7ef-f6d6-487c-a47d-b0b15507b52c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:25.319003 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d8aed7ef-f6d6-487c-a47d-b0b15507b52c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 15a78847-f450-4247-8db9-36883bf2eebd] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:25.334032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8aed7ef-f6d6-487c-a47d-b0b15507b52c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:25.334718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8aed7ef-f6d6-487c-a47d-b0b15507b52c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:25.336521 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8aed7ef-f6d6-487c-a47d-b0b15507b52c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:25.337313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8aed7ef-f6d6-487c-a47d-b0b15507b52c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:25.492355 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d4e3434e-1609-4ff6-8d49-848383a6260f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:25.500096 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d4e3434e-1609-4ff6-8d49-848383a6260f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1689 microversion: 2.1 time: 0.230209 May 27 15:44:25.510471 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3306/6601] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:25 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1689 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:44:25.533339 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d8aed7ef-f6d6-487c-a47d-b0b15507b52c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd" status: 200 len: 1463 microversion: 2.1 time: 0.223677 May 27 15:44:25.533943 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3296/6602] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:25 2022] GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd => generated 1463 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:44:25.632995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a2e58abe-9cf8-4489-bdfe-746a2724113b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:25.633627 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a2e58abe-9cf8-4489-bdfe-746a2724113b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 8e001efa-96fd-46dc-abf3-55c6baeb2175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:25.640631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a2e58abe-9cf8-4489-bdfe-746a2724113b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:25.641118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a2e58abe-9cf8-4489-bdfe-746a2724113b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:25.641967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a2e58abe-9cf8-4489-bdfe-746a2724113b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:25.642551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a2e58abe-9cf8-4489-bdfe-746a2724113b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:25.785776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a2e58abe-9cf8-4489-bdfe-746a2724113b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:25.793357 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a2e58abe-9cf8-4489-bdfe-746a2724113b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175" status: 200 len: 1374 microversion: 2.1 time: 0.164325 May 27 15:44:25.793982 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3307/6603] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:25 2022] GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:26.406374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-06db08fc-4964-48cd-a52c-3b54324a37fc req-18889eb5-9470-481b-9fba-94b49f9aa82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e001efa-96fd-46dc-abf3-55c6baeb2175", "name": "network-vif-plugged", "status": "completed", "tag": "c98f39fe-0f53-43d1-b9cc-529d63f9cbfa"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:26.415422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-06db08fc-4964-48cd-a52c-3b54324a37fc req-18889eb5-9470-481b-9fba-94b49f9aa82d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:26.415964 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-06db08fc-4964-48cd-a52c-3b54324a37fc req-18889eb5-9470-481b-9fba-94b49f9aa82d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:26.428017 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-06db08fc-4964-48cd-a52c-3b54324a37fc req-18889eb5-9470-481b-9fba-94b49f9aa82d service nova] Creating event network-vif-plugged:c98f39fe-0f53-43d1-b9cc-529d63f9cbfa for instance 8e001efa-96fd-46dc-abf3-55c6baeb2175 on n-h1-843621-1 May 27 15:44:26.433193 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-06db08fc-4964-48cd-a52c-3b54324a37fc req-18889eb5-9470-481b-9fba-94b49f9aa82d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030400 May 27 15:44:26.433738 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3297/6604] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:44:26.517344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ecdc1d7d-6b86-42f0-8963-437168558756 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:26.518148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ecdc1d7d-6b86-42f0-8963-437168558756 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:26.525138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecdc1d7d-6b86-42f0-8963-437168558756 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:26.525646 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecdc1d7d-6b86-42f0-8963-437168558756 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:26.526364 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecdc1d7d-6b86-42f0-8963-437168558756 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:26.526812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecdc1d7d-6b86-42f0-8963-437168558756 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:26.551884 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7feebec4-4052-4e1a-ac57-13c9c6ceda72 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:26.553028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7feebec4-4052-4e1a-ac57-13c9c6ceda72 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 15a78847-f450-4247-8db9-36883bf2eebd] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:26.562171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7feebec4-4052-4e1a-ac57-13c9c6ceda72 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:26.563002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7feebec4-4052-4e1a-ac57-13c9c6ceda72 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:26.564135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7feebec4-4052-4e1a-ac57-13c9c6ceda72 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:26.564986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7feebec4-4052-4e1a-ac57-13c9c6ceda72 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:26.806292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ecdc1d7d-6b86-42f0-8963-437168558756 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:26.814627 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ecdc1d7d-6b86-42f0-8963-437168558756 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1689 microversion: 2.1 time: 0.301119 May 27 15:44:26.815778 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3308/6605] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:26 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1689 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:26.821058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-21710d62-9ddf-44cd-9e45-d1894e32abdc tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:26.822199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-21710d62-9ddf-44cd-9e45-d1894e32abdc tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 8e001efa-96fd-46dc-abf3-55c6baeb2175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:26.828704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21710d62-9ddf-44cd-9e45-d1894e32abdc tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:26.829601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21710d62-9ddf-44cd-9e45-d1894e32abdc tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:26.830840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21710d62-9ddf-44cd-9e45-d1894e32abdc tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:26.831999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21710d62-9ddf-44cd-9e45-d1894e32abdc tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:26.842316 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7feebec4-4052-4e1a-ac57-13c9c6ceda72 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd" status: 200 len: 1463 microversion: 2.1 time: 0.294990 May 27 15:44:26.842919 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3298/6606] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:26 2022] GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd => generated 1463 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:27.451468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-21710d62-9ddf-44cd-9e45-d1894e32abdc tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:27.459180 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-21710d62-9ddf-44cd-9e45-d1894e32abdc tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175" status: 200 len: 1374 microversion: 2.1 time: 0.642135 May 27 15:44:27.459758 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3309/6607] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:26 2022] GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175 => generated 1374 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:27.796652 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-9bb32060-c4ca-495e-9f89-1d3959b67a28 req-c2665d3e-f2b6-48bd-8d14-91bb6c546b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6356ecad-39d9-4149-8277-8b378d9c806a", "name": "network-vif-deleted", "tag": "6ca629e8-ab17-45ed-8a13-e4d4f0af9e12"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:27.806258 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9bb32060-c4ca-495e-9f89-1d3959b67a28 req-c2665d3e-f2b6-48bd-8d14-91bb6c546b14 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:27.806736 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9bb32060-c4ca-495e-9f89-1d3959b67a28 req-c2665d3e-f2b6-48bd-8d14-91bb6c546b14 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:27.818811 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-9bb32060-c4ca-495e-9f89-1d3959b67a28 req-c2665d3e-f2b6-48bd-8d14-91bb6c546b14 service nova] Creating event network-vif-deleted:6ca629e8-ab17-45ed-8a13-e4d4f0af9e12 for instance 6356ecad-39d9-4149-8277-8b378d9c806a on n-h2-843621-1 May 27 15:44:27.823534 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-9bb32060-c4ca-495e-9f89-1d3959b67a28 req-c2665d3e-f2b6-48bd-8d14-91bb6c546b14 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031168 May 27 15:44:27.824129 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3299/6608] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:44:27.831574 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-170f66a4-ed3a-42ef-a32a-aea92618de5e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:27.832301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-170f66a4-ed3a-42ef-a32a-aea92618de5e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:27.840538 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-170f66a4-ed3a-42ef-a32a-aea92618de5e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:27.841049 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-170f66a4-ed3a-42ef-a32a-aea92618de5e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:27.841872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-170f66a4-ed3a-42ef-a32a-aea92618de5e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:27.842360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-170f66a4-ed3a-42ef-a32a-aea92618de5e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:27.860646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3fed2fc1-a3fc-4e2e-bccc-8cb8b4137a94 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:27.861667 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3fed2fc1-a3fc-4e2e-bccc-8cb8b4137a94 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 15a78847-f450-4247-8db9-36883bf2eebd] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:27.868534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3fed2fc1-a3fc-4e2e-bccc-8cb8b4137a94 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:27.869135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3fed2fc1-a3fc-4e2e-bccc-8cb8b4137a94 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:27.870177 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3fed2fc1-a3fc-4e2e-bccc-8cb8b4137a94 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:27.870710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3fed2fc1-a3fc-4e2e-bccc-8cb8b4137a94 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:27.915749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-170f66a4-ed3a-42ef-a32a-aea92618de5e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:27.927232 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-170f66a4-ed3a-42ef-a32a-aea92618de5e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 200 len: 1351 microversion: 2.1 time: 0.099461 May 27 15:44:27.927865 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3310/6609] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:27 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 1351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:28.010778 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3fed2fc1-a3fc-4e2e-bccc-8cb8b4137a94 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd" status: 200 len: 1463 microversion: 2.1 time: 0.155182 May 27 15:44:28.011915 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3300/6610] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:27 2022] GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd => generated 1463 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:44:28.476711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fe63608d-520e-4a1d-9f4a-66aad61d5bdf tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:28.477351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fe63608d-520e-4a1d-9f4a-66aad61d5bdf tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 8e001efa-96fd-46dc-abf3-55c6baeb2175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:28.484717 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe63608d-520e-4a1d-9f4a-66aad61d5bdf tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:28.485165 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe63608d-520e-4a1d-9f4a-66aad61d5bdf tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:28.485928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe63608d-520e-4a1d-9f4a-66aad61d5bdf tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:28.486374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe63608d-520e-4a1d-9f4a-66aad61d5bdf tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:28.654545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fe63608d-520e-4a1d-9f4a-66aad61d5bdf tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:28.664377 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fe63608d-520e-4a1d-9f4a-66aad61d5bdf tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175" status: 200 len: 1547 microversion: 2.1 time: 0.192615 May 27 15:44:28.665453 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3311/6611] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:28 2022] GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175 => generated 1547 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:28.687891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2dcbfd39-a027-4b24-8eba-d2f386aca305 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:28.688727 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2dcbfd39-a027-4b24-8eba-d2f386aca305 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 8e001efa-96fd-46dc-abf3-55c6baeb2175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:28.695928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2dcbfd39-a027-4b24-8eba-d2f386aca305 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:28.696402 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2dcbfd39-a027-4b24-8eba-d2f386aca305 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:28.699028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2dcbfd39-a027-4b24-8eba-d2f386aca305 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:28.700531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2dcbfd39-a027-4b24-8eba-d2f386aca305 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:28.872589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2dcbfd39-a027-4b24-8eba-d2f386aca305 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:28.882323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-a2815458-3e8e-4a5a-8f68-7ada2759e109 req-ad46e663-fe22-4c8e-9230-f61d6350112b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a78847-f450-4247-8db9-36883bf2eebd", "name": "network-vif-plugged", "status": "completed", "tag": "8674b0da-0a36-4616-a0a3-f915507a18c3"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:28.886238 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2dcbfd39-a027-4b24-8eba-d2f386aca305 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175" status: 200 len: 1547 microversion: 2.1 time: 0.203340 May 27 15:44:28.888554 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3301/6612] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:28 2022] GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175 => generated 1547 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:28.897230 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-a2815458-3e8e-4a5a-8f68-7ada2759e109 req-ad46e663-fe22-4c8e-9230-f61d6350112b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:28.897686 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-a2815458-3e8e-4a5a-8f68-7ada2759e109 req-ad46e663-fe22-4c8e-9230-f61d6350112b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:28.912882 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-a2815458-3e8e-4a5a-8f68-7ada2759e109 req-ad46e663-fe22-4c8e-9230-f61d6350112b service nova] Creating event network-vif-plugged:8674b0da-0a36-4616-a0a3-f915507a18c3 for instance 15a78847-f450-4247-8db9-36883bf2eebd on n-h2-843621-1 May 27 15:44:28.917691 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-a2815458-3e8e-4a5a-8f68-7ada2759e109 req-ad46e663-fe22-4c8e-9230-f61d6350112b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039807 May 27 15:44:28.918383 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3312/6613] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:44:28.948374 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-89852f6d-2a2d-428b-89d7-73b806b62223 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:28.949065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-89852f6d-2a2d-428b-89d7-73b806b62223 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 6356ecad-39d9-4149-8277-8b378d9c806a] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:28.956358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89852f6d-2a2d-428b-89d7-73b806b62223 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:28.957223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89852f6d-2a2d-428b-89d7-73b806b62223 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:28.960511 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89852f6d-2a2d-428b-89d7-73b806b62223 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:28.961222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89852f6d-2a2d-428b-89d7-73b806b62223 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:28.980486 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-89852f6d-2a2d-428b-89d7-73b806b62223 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] HTTP exception thrown: Instance 6356ecad-39d9-4149-8277-8b378d9c806a could not be found. May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-89852f6d-2a2d-428b-89d7-73b806b62223 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Request method failure captured: May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a HTTP/1.1 May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikPE8HKsBFVmDjnurTK4MmS5qV_xRSU-M7F4Wkd_TzQv2GmcoU1aDqk4cUYKxa-vX6YTiuiSIkKiSvKPFRD8cWehUx9Pm5FcQMK-uoH6NmDsBRqEpYqdKyByRTnQFvK6M-nxSszSM8yHouf7ypqvuFHP-I4lMAC05OHG2zCrZxHLPq0k May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 3255afe7ba134153bcbe682b574e7803 May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-126916587 May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3255afe7ba134153bcbe682b574e7803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3255afe7ba134153bcbe682b574e7803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3255afe7ba134153bcbe682b574e7803"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3255afe7ba134153bcbe682b574e7803", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-TestNetworkAdvancedServerOps-126916587 May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 3255afe7ba134153bcbe682b574e7803 May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-126916587 May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-TestNetworkAdvancedServerOps-126916587-project May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 499fa1ef3ed047a8a92c7a23be43c8f0 May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-TestNetworkAdvancedServerOps-126916587-project May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 6356ecad-39d9-4149-8277-8b378d9c806a could not be found. May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '6356ecad-39d9-4149-8277-8b378d9c806a'} May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6356ecad-39d9-4149-8277-8b378d9c806a could not be found. May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6356ecad-39d9-4149-8277-8b378d9c806a could not be found. May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:44:28.982876 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:44:28.987672 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:44:28.987672 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:44:28.987672 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:44:28.987672 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:44:28.987672 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:44:28.987672 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6356ecad-39d9-4149-8277-8b378d9c806a could not be found. May 27 15:44:28.987672 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:44:28.987672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-89852f6d-2a2d-428b-89d7-73b806b62223 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Returning 404 to user: Instance 6356ecad-39d9-4149-8277-8b378d9c806a could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:44:28.987672 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-89852f6d-2a2d-428b-89d7-73b806b62223 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a" status: 404 len: 111 microversion: 2.1 time: 0.042301 May 27 15:44:28.987672 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3302/6614] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:28 2022] GET /compute/v2.1/servers/6356ecad-39d9-4149-8277-8b378d9c806a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:44:29.030929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-58c69a2b-f6c0-4c2b-a382-5045965106df tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:29.031748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-58c69a2b-f6c0-4c2b-a382-5045965106df tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 15a78847-f450-4247-8db9-36883bf2eebd] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:29.038403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58c69a2b-f6c0-4c2b-a382-5045965106df tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:29.038956 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58c69a2b-f6c0-4c2b-a382-5045965106df tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:29.040065 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58c69a2b-f6c0-4c2b-a382-5045965106df tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:29.040663 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58c69a2b-f6c0-4c2b-a382-5045965106df tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:29.202432 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-58c69a2b-f6c0-4c2b-a382-5045965106df tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd" status: 200 len: 1463 microversion: 2.1 time: 0.177438 May 27 15:44:29.203199 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3313/6615] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:29 2022] GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd => generated 1463 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:30.220588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9c5f0dd2-b5e8-410f-9263-e5365d6d7608 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:30.222193 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9c5f0dd2-b5e8-410f-9263-e5365d6d7608 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 15a78847-f450-4247-8db9-36883bf2eebd] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:30.230130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:44:30.239517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c5f0dd2-b5e8-410f-9263-e5365d6d7608 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:30.240573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c5f0dd2-b5e8-410f-9263-e5365d6d7608 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:30.241657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c5f0dd2-b5e8-410f-9263-e5365d6d7608 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:30.242475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9c5f0dd2-b5e8-410f-9263-e5365d6d7608 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:30.393774 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9c5f0dd2-b5e8-410f-9263-e5365d6d7608 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd" status: 200 len: 1648 microversion: 2.1 time: 0.178036 May 27 15:44:30.394485 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3303/6616] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:30 2022] GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd => generated 1648 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:30.410943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-768defb8-45bc-46fc-9d7b-abfb4a33bd7c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:30.411596 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-768defb8-45bc-46fc-9d7b-abfb4a33bd7c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 15a78847-f450-4247-8db9-36883bf2eebd] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:30.421772 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-768defb8-45bc-46fc-9d7b-abfb4a33bd7c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:30.422359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-768defb8-45bc-46fc-9d7b-abfb4a33bd7c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:30.423222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-768defb8-45bc-46fc-9d7b-abfb4a33bd7c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:30.423730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-768defb8-45bc-46fc-9d7b-abfb4a33bd7c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:30.424581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:44:30.443788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=12 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:44:30.658664 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-768defb8-45bc-46fc-9d7b-abfb4a33bd7c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd" status: 200 len: 1648 microversion: 2.1 time: 0.251350 May 27 15:44:30.659561 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3314/6617] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:30 2022] GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd => generated 1648 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:30.676084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-379c4204-64eb-4502-be0f-ab8b8b9ddb96 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:30.676760 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-379c4204-64eb-4502-be0f-ab8b8b9ddb96 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 15a78847-f450-4247-8db9-36883bf2eebd] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:30.689025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=8 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:44:30.691636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-379c4204-64eb-4502-be0f-ab8b8b9ddb96 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:30.692129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-379c4204-64eb-4502-be0f-ab8b8b9ddb96 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:30.693328 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-379c4204-64eb-4502-be0f-ab8b8b9ddb96 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:30.694049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-379c4204-64eb-4502-be0f-ab8b8b9ddb96 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:30.963792 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-379c4204-64eb-4502-be0f-ab8b8b9ddb96 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd" status: 200 len: 1648 microversion: 2.1 time: 0.291491 May 27 15:44:30.965233 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3304/6618] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:30 2022] GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd => generated 1648 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:31.025272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-474ae1cc-61a1-4046-9696-7b6e35ed0e5e tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-62244619", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "availability_zone": "nova:n-h1-843621-1", "networks": [{"uuid": "e4bf89d8-7e6c-4caf-9df5-f95917916593"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:31.100052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-474ae1cc-61a1-4046-9696-7b6e35ed0e5e tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] validate_networks() for [('e4bf89d8-7e6c-4caf-9df5-f95917916593', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:44:31.852303 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-474ae1cc-61a1-4046-9696-7b6e35ed0e5e tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:44:31.853037 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-474ae1cc-61a1-4046-9696-7b6e35ed0e5e tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:44:31.853432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-474ae1cc-61a1-4046-9696-7b6e35ed0e5e tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:44:31.854025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-474ae1cc-61a1-4046-9696-7b6e35ed0e5e tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:44:31.854553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-474ae1cc-61a1-4046-9696-7b6e35ed0e5e tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:44:31.865493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-474ae1cc-61a1-4046-9696-7b6e35ed0e5e tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:31.866434 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-474ae1cc-61a1-4046-9696-7b6e35ed0e5e tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:31.867807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-474ae1cc-61a1-4046-9696-7b6e35ed0e5e tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:31.868721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-474ae1cc-61a1-4046-9696-7b6e35ed0e5e tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:31.895389 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-474ae1cc-61a1-4046-9696-7b6e35ed0e5e tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Getting quotas for project e72f43934920456bb3949741dcb6ef3d. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:44:31.905691 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-474ae1cc-61a1-4046-9696-7b6e35ed0e5e tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Getting quotas for user c1bd4e9c802c481db8c256b0ac773b36 and project e72f43934920456bb3949741dcb6ef3d. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:44:31.926580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-474ae1cc-61a1-4046-9696-7b6e35ed0e5e tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:44:31.931410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-474ae1cc-61a1-4046-9696-7b6e35ed0e5e tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:44:31.994052 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-474ae1cc-61a1-4046-9696-7b6e35ed0e5e tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.974775 May 27 15:44:31.995025 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3315/6619] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:44:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 15:44:32.007043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e18d870e-d4e3-45aa-a49d-f178e2e4902d tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:32.007834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e18d870e-d4e3-45aa-a49d-f178e2e4902d tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:32.142285 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e18d870e-d4e3-45aa-a49d-f178e2e4902d tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 200 len: 1327 microversion: 2.1 time: 0.139673 May 27 15:44:32.146235 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3305/6620] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:32 2022] GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 1327 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:33.110831 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a25b0f29-08b0-4c2d-9e50-27c816566adb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '.version_select at 0x7fc775aee040>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:33.134214 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a25b0f29-08b0-4c2d-9e50-27c816566adb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-436911935" status: 202 len: 0 microversion: 2.1 time: 0.028181 May 27 15:44:33.135233 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3316/6621] 10.222.0.13 () {58 vars in 1280 bytes} [Fri May 27 15:44:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-436911935 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:44:33.174229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4180c59d-f248-435b-898a-be20d7b884ce tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:33.174229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4180c59d-f248-435b-898a-be20d7b884ce tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:33.174229 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4180c59d-f248-435b-898a-be20d7b884ce tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:33.175345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4180c59d-f248-435b-898a-be20d7b884ce tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:33.176028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4180c59d-f248-435b-898a-be20d7b884ce tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:33.176119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4180c59d-f248-435b-898a-be20d7b884ce tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:33.183324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-32bdb83d-5b54-457b-9092-73a2c1fb20ae tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'create', calling method: .version_select at 0x7fc775abcee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1954577956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGS4xEkDU7Wr8wbyrKQnKOo9DpGh6iyJHLg9lS5fEOnYDmV/P2fk1jiicNO3louZoyIqNbwL/B9xXBPmIvyVc2VgXR0+kklYdkOUUhI2ixTWwHA1ng0GdUL/5Z12ur9toA=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:33.194359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:44:33.221298 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-32bdb83d-5b54-457b-9092-73a2c1fb20ae tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Getting quotas for project 3255afe7ba134153bcbe682b574e7803. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:44:33.226782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-32bdb83d-5b54-457b-9092-73a2c1fb20ae tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Getting quotas for user 499fa1ef3ed047a8a92c7a23be43c8f0 and project 3255afe7ba134153bcbe682b574e7803. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:44:33.273501 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-32bdb83d-5b54-457b-9092-73a2c1fb20ae tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.094272 May 27 15:44:33.274120 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3317/6622] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:44:33 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:44:33.381539 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4180c59d-f248-435b-898a-be20d7b884ce tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 200 len: 1414 microversion: 2.1 time: 0.221178 May 27 15:44:33.392937 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3306/6623] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:33 2022] GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 1414 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:34.406267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8223f9e8-9934-44cc-858d-88f997330536 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:34.414134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8223f9e8-9934-44cc-858d-88f997330536 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:34.425621 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8223f9e8-9934-44cc-858d-88f997330536 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:34.430880 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8223f9e8-9934-44cc-858d-88f997330536 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:34.432352 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8223f9e8-9934-44cc-858d-88f997330536 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:34.435878 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8223f9e8-9934-44cc-858d-88f997330536 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:34.667442 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8223f9e8-9934-44cc-858d-88f997330536 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 200 len: 1462 microversion: 2.1 time: 0.265757 May 27 15:44:34.681555 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3318/6624] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:34 2022] GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 1462 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:35.627270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-02556b24-afca-4b58-91e0-fa4c47ba1d40 req-96117c8c-867c-4786-a112-32e586260f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91", "tag": "b7507d30-7137-41ea-aa1a-780c8fcad017"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:35.643279 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:44:35.649825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-02556b24-afca-4b58-91e0-fa4c47ba1d40 req-96117c8c-867c-4786-a112-32e586260f36 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:35.650646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-02556b24-afca-4b58-91e0-fa4c47ba1d40 req-96117c8c-867c-4786-a112-32e586260f36 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:35.689300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-979eb585-f588-4ba4-af72-1dcfd97784b8 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:35.690789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-979eb585-f588-4ba4-af72-1dcfd97784b8 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:35.703618 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-02556b24-afca-4b58-91e0-fa4c47ba1d40 req-96117c8c-867c-4786-a112-32e586260f36 service nova] Creating event network-changed:b7507d30-7137-41ea-aa1a-780c8fcad017 for instance 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 on n-h1-843621-1 May 27 15:44:35.709716 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-02556b24-afca-4b58-91e0-fa4c47ba1d40 req-96117c8c-867c-4786-a112-32e586260f36 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087698 May 27 15:44:35.712306 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3307/6625] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:44:35.713886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-979eb585-f588-4ba4-af72-1dcfd97784b8 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:35.714536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-979eb585-f588-4ba4-af72-1dcfd97784b8 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:35.715410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-979eb585-f588-4ba4-af72-1dcfd97784b8 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:35.715865 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-979eb585-f588-4ba4-af72-1dcfd97784b8 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:35.899050 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-979eb585-f588-4ba4-af72-1dcfd97784b8 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 200 len: 1462 microversion: 2.1 time: 0.214677 May 27 15:44:35.901799 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3319/6626] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:35 2022] GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 1462 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:36.918275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-51de3e11-ce04-4f2d-bc16-f1bcce405b2f tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:36.919024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-51de3e11-ce04-4f2d-bc16-f1bcce405b2f tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:36.926046 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51de3e11-ce04-4f2d-bc16-f1bcce405b2f tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:36.926589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51de3e11-ce04-4f2d-bc16-f1bcce405b2f tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:36.927412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51de3e11-ce04-4f2d-bc16-f1bcce405b2f tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:36.927876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-51de3e11-ce04-4f2d-bc16-f1bcce405b2f tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:37.064593 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-51de3e11-ce04-4f2d-bc16-f1bcce405b2f tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 200 len: 1462 microversion: 2.1 time: 0.151458 May 27 15:44:37.065221 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3308/6627] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:36 2022] GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 1462 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:38.085578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-94b57269-2fc9-4888-bdcd-4d0a72bbaf47 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:38.087479 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-94b57269-2fc9-4888-bdcd-4d0a72bbaf47 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:38.097192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94b57269-2fc9-4888-bdcd-4d0a72bbaf47 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:38.098019 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94b57269-2fc9-4888-bdcd-4d0a72bbaf47 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:38.099199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94b57269-2fc9-4888-bdcd-4d0a72bbaf47 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:38.099884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-94b57269-2fc9-4888-bdcd-4d0a72bbaf47 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:38.103240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=100 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:44:38.403585 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-94b57269-2fc9-4888-bdcd-4d0a72bbaf47 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 200 len: 1462 microversion: 2.1 time: 0.324065 May 27 15:44:38.404699 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3320/6628] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:38 2022] GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 1462 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:39.420342 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-96f348e1-44e6-4b67-98d5-1e522eeffcdc tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:39.421166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-96f348e1-44e6-4b67-98d5-1e522eeffcdc tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:39.439032 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-96f348e1-44e6-4b67-98d5-1e522eeffcdc tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:39.439913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-96f348e1-44e6-4b67-98d5-1e522eeffcdc tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:39.441118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-96f348e1-44e6-4b67-98d5-1e522eeffcdc tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:39.441753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-96f348e1-44e6-4b67-98d5-1e522eeffcdc tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:39.661173 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-96f348e1-44e6-4b67-98d5-1e522eeffcdc tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 200 len: 1462 microversion: 2.1 time: 0.244542 May 27 15:44:39.662540 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3309/6629] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:39 2022] GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 1462 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:40.688451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d35a8c8e-2cd1-4114-91e8-65a09775ec20 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:40.689702 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d35a8c8e-2cd1-4114-91e8-65a09775ec20 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:40.700767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d35a8c8e-2cd1-4114-91e8-65a09775ec20 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:40.701677 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d35a8c8e-2cd1-4114-91e8-65a09775ec20 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:40.709463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d35a8c8e-2cd1-4114-91e8-65a09775ec20 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:40.710187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d35a8c8e-2cd1-4114-91e8-65a09775ec20 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:40.916731 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d35a8c8e-2cd1-4114-91e8-65a09775ec20 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 200 len: 1462 microversion: 2.1 time: 0.238289 May 27 15:44:40.918069 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3321/6630] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:40 2022] GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 1462 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:41.934330 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-18251c3b-55e8-4b7b-9267-2da9dbfc19cf tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:41.934972 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-18251c3b-55e8-4b7b-9267-2da9dbfc19cf tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:41.943800 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18251c3b-55e8-4b7b-9267-2da9dbfc19cf tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:41.944244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18251c3b-55e8-4b7b-9267-2da9dbfc19cf tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:41.945164 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18251c3b-55e8-4b7b-9267-2da9dbfc19cf tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:41.945634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-18251c3b-55e8-4b7b-9267-2da9dbfc19cf tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:42.113841 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-18251c3b-55e8-4b7b-9267-2da9dbfc19cf tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 200 len: 1462 microversion: 2.1 time: 0.182627 May 27 15:44:42.114976 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3310/6631] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:41 2022] GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 1462 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:42.526618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ba733e15-775c-457c-9640-1a0a1eecbe77 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-823699945", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "2b85a2ec-34c5-4968-9017-dcd40f454491"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1954577956", "security_groups": [{"name": "tempest-secgroup-smoke-1405018271"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:42.549262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:44:42.691527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-ba733e15-775c-457c-9640-1a0a1eecbe77 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] validate_networks() for [('2b85a2ec-34c5-4968-9017-dcd40f454491', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:44:42.854084 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-4fb6eda0-fc96-4ccc-a728-49dcfe00ec4a req-39951122-00ec-45b0-98de-360cd2dc333a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91", "name": "network-vif-plugged", "status": "completed", "tag": "b7507d30-7137-41ea-aa1a-780c8fcad017"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:42.870446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:44:42.873267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-4fb6eda0-fc96-4ccc-a728-49dcfe00ec4a req-39951122-00ec-45b0-98de-360cd2dc333a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:42.873992 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-4fb6eda0-fc96-4ccc-a728-49dcfe00ec4a req-39951122-00ec-45b0-98de-360cd2dc333a service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:42.891815 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-4fb6eda0-fc96-4ccc-a728-49dcfe00ec4a req-39951122-00ec-45b0-98de-360cd2dc333a service nova] Creating event network-vif-plugged:b7507d30-7137-41ea-aa1a-780c8fcad017 for instance 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 on n-h1-843621-1 May 27 15:44:42.903247 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-4fb6eda0-fc96-4ccc-a728-49dcfe00ec4a req-39951122-00ec-45b0-98de-360cd2dc333a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052052 May 27 15:44:42.908784 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3311/6632] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:44:43.131957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4456a7f4-4429-443a-8954-1dff53b09521 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:43.132787 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4456a7f4-4429-443a-8954-1dff53b09521 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:43.145759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4456a7f4-4429-443a-8954-1dff53b09521 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:43.146372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4456a7f4-4429-443a-8954-1dff53b09521 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:43.147288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4456a7f4-4429-443a-8954-1dff53b09521 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:43.147860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4456a7f4-4429-443a-8954-1dff53b09521 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:43.243601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=10 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:44:43.278593 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ba733e15-775c-457c-9640-1a0a1eecbe77 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:44:43.279529 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ba733e15-775c-457c-9640-1a0a1eecbe77 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:44:43.280884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ba733e15-775c-457c-9640-1a0a1eecbe77 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:44:43.281916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ba733e15-775c-457c-9640-1a0a1eecbe77 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:44:43.282600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ba733e15-775c-457c-9640-1a0a1eecbe77 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:44:43.297814 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ba733e15-775c-457c-9640-1a0a1eecbe77 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:43.298618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ba733e15-775c-457c-9640-1a0a1eecbe77 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:43.313690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ba733e15-775c-457c-9640-1a0a1eecbe77 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:43.315013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ba733e15-775c-457c-9640-1a0a1eecbe77 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:43.338380 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4456a7f4-4429-443a-8954-1dff53b09521 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 200 len: 1462 microversion: 2.1 time: 0.210977 May 27 15:44:43.339241 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3312/6633] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:43 2022] GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 1462 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:43.362577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-ba733e15-775c-457c-9640-1a0a1eecbe77 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Getting quotas for project 3255afe7ba134153bcbe682b574e7803. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:44:43.374194 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-ba733e15-775c-457c-9640-1a0a1eecbe77 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Getting quotas for user 499fa1ef3ed047a8a92c7a23be43c8f0 and project 3255afe7ba134153bcbe682b574e7803. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:44:43.396650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ba733e15-775c-457c-9640-1a0a1eecbe77 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:44:43.399088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ba733e15-775c-457c-9640-1a0a1eecbe77 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:44:43.455212 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ba733e15-775c-457c-9640-1a0a1eecbe77 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.932780 May 27 15:44:43.456134 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3322/6634] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:44:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:44:43.467155 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-67dcf5bc-c5bf-42bc-931e-eafcf999e86d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:43.468383 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-67dcf5bc-c5bf-42bc-931e-eafcf999e86d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:43.586181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-67dcf5bc-c5bf-42bc-931e-eafcf999e86d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:43.603865 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-67dcf5bc-c5bf-42bc-931e-eafcf999e86d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1266 microversion: 2.1 time: 0.140805 May 27 15:44:43.605188 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3313/6635] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:43 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:44.355663 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2bd5561d-8e95-4876-b06e-6def1c52bb1a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:44.356488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2bd5561d-8e95-4876-b06e-6def1c52bb1a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:44.375290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2bd5561d-8e95-4876-b06e-6def1c52bb1a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:44.378188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2bd5561d-8e95-4876-b06e-6def1c52bb1a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:44.379705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2bd5561d-8e95-4876-b06e-6def1c52bb1a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:44.380550 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2bd5561d-8e95-4876-b06e-6def1c52bb1a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:44.623002 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2bd5561d-8e95-4876-b06e-6def1c52bb1a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 200 len: 1462 microversion: 2.1 time: 0.271079 May 27 15:44:44.623251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-548bdee8-e6c6-4253-8901-eee505cf47fc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:44.623777 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-548bdee8-e6c6-4253-8901-eee505cf47fc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:44.627185 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3323/6636] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:44 2022] GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 1462 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:44.636414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-548bdee8-e6c6-4253-8901-eee505cf47fc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:44.637233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-548bdee8-e6c6-4253-8901-eee505cf47fc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:44.639182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-548bdee8-e6c6-4253-8901-eee505cf47fc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:44.639649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-548bdee8-e6c6-4253-8901-eee505cf47fc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:44.648620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:44:44.764828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-548bdee8-e6c6-4253-8901-eee505cf47fc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:44.773816 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-548bdee8-e6c6-4253-8901-eee505cf47fc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1318 microversion: 2.1 time: 0.155378 May 27 15:44:44.774425 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3314/6637] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:44 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:45.648012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6ddcaef0-7c81-4024-b8db-4fef06f9a906 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:45.648809 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6ddcaef0-7c81-4024-b8db-4fef06f9a906 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:45.657031 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ddcaef0-7c81-4024-b8db-4fef06f9a906 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:45.657601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ddcaef0-7c81-4024-b8db-4fef06f9a906 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:45.658460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ddcaef0-7c81-4024-b8db-4fef06f9a906 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:45.659482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ddcaef0-7c81-4024-b8db-4fef06f9a906 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:45.799959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b059e2f1-fbe2-41df-91f9-a8a2b66ce3e1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:45.802531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b059e2f1-fbe2-41df-91f9-a8a2b66ce3e1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:45.804538 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6ddcaef0-7c81-4024-b8db-4fef06f9a906 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 200 len: 1648 microversion: 2.1 time: 0.160531 May 27 15:44:45.815794 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3324/6638] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:45 2022] GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 1648 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:45.820231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b059e2f1-fbe2-41df-91f9-a8a2b66ce3e1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:45.820497 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-45c6cc63-70a1-47c0-8cb4-0d2ae7be3a4b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:45.821056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-45c6cc63-70a1-47c0-8cb4-0d2ae7be3a4b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:45.822206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b059e2f1-fbe2-41df-91f9-a8a2b66ce3e1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:45.825252 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b059e2f1-fbe2-41df-91f9-a8a2b66ce3e1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:45.827916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45c6cc63-70a1-47c0-8cb4-0d2ae7be3a4b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:45.828629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45c6cc63-70a1-47c0-8cb4-0d2ae7be3a4b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:45.829532 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45c6cc63-70a1-47c0-8cb4-0d2ae7be3a4b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:45.829872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-45c6cc63-70a1-47c0-8cb4-0d2ae7be3a4b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:45.840867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b059e2f1-fbe2-41df-91f9-a8a2b66ce3e1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:45.939206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b059e2f1-fbe2-41df-91f9-a8a2b66ce3e1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:45.948301 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b059e2f1-fbe2-41df-91f9-a8a2b66ce3e1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1324 microversion: 2.1 time: 0.159059 May 27 15:44:45.957161 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3315/6639] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:45 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1324 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:44:45.998416 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-45c6cc63-70a1-47c0-8cb4-0d2ae7be3a4b tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 200 len: 1648 microversion: 2.1 time: 0.181431 May 27 15:44:45.999005 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3325/6640] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:45 2022] GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 1648 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:46.014746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-44dac7e4-3212-4ac3-84de-bdc15cb05b7d tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:46.015389 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-44dac7e4-3212-4ac3-84de-bdc15cb05b7d tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:46.021846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44dac7e4-3212-4ac3-84de-bdc15cb05b7d tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:46.022327 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44dac7e4-3212-4ac3-84de-bdc15cb05b7d tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:46.023129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44dac7e4-3212-4ac3-84de-bdc15cb05b7d tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:46.023596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44dac7e4-3212-4ac3-84de-bdc15cb05b7d tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:46.155835 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-44dac7e4-3212-4ac3-84de-bdc15cb05b7d tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 200 len: 1648 microversion: 2.1 time: 0.145546 May 27 15:44:46.156646 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3316/6641] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:46 2022] GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 1648 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:46.172748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-deb5333f-2c59-450e-99d3-23121373c3b5 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:46.173345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-deb5333f-2c59-450e-99d3-23121373c3b5 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:46.192313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-deb5333f-2c59-450e-99d3-23121373c3b5 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:46.192794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-deb5333f-2c59-450e-99d3-23121373c3b5 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:46.194530 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-deb5333f-2c59-450e-99d3-23121373c3b5 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:46.196455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-deb5333f-2c59-450e-99d3-23121373c3b5 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:46.229568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-deb5333f-2c59-450e-99d3-23121373c3b5 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:44:46.342554 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-deb5333f-2c59-450e-99d3-23121373c3b5 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "DELETE /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 204 len: 0 microversion: 2.1 time: 0.173303 May 27 15:44:46.343441 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3326/6642] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:44:46 2022] DELETE /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:44:46.351859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3465065b-3da3-4767-b02a-d54979c197bb tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:46.353131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3465065b-3da3-4767-b02a-d54979c197bb tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:46.371263 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3465065b-3da3-4767-b02a-d54979c197bb tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:46.372498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3465065b-3da3-4767-b02a-d54979c197bb tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:46.373605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3465065b-3da3-4767-b02a-d54979c197bb tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:46.374077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3465065b-3da3-4767-b02a-d54979c197bb tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:46.587285 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3465065b-3da3-4767-b02a-d54979c197bb tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 200 len: 1654 microversion: 2.1 time: 0.239463 May 27 15:44:46.593907 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3317/6643] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:46 2022] GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 1654 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:46.967753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6ce43c93-9828-4f8d-82fc-b8351d93b00a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:46.969587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6ce43c93-9828-4f8d-82fc-b8351d93b00a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:46.977586 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ce43c93-9828-4f8d-82fc-b8351d93b00a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:46.978211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ce43c93-9828-4f8d-82fc-b8351d93b00a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:46.979130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ce43c93-9828-4f8d-82fc-b8351d93b00a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:46.979841 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ce43c93-9828-4f8d-82fc-b8351d93b00a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:47.045712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-b11514c1-d4d0-4941-a2ff-0000a20aecba req-f06998d2-10ee-439c-9b17-4a5625354063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbedb8ed-f021-49ed-9256-199efa92a399", "tag": "d8fec746-ba21-483f-bd39-946bac92ddd8"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:47.056905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-b11514c1-d4d0-4941-a2ff-0000a20aecba req-f06998d2-10ee-439c-9b17-4a5625354063 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:47.057665 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-b11514c1-d4d0-4941-a2ff-0000a20aecba req-f06998d2-10ee-439c-9b17-4a5625354063 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:47.072414 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-b11514c1-d4d0-4941-a2ff-0000a20aecba req-f06998d2-10ee-439c-9b17-4a5625354063 service nova] Creating event network-changed:d8fec746-ba21-483f-bd39-946bac92ddd8 for instance bbedb8ed-f021-49ed-9256-199efa92a399 on n-h1-843621-1 May 27 15:44:47.077732 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-b11514c1-d4d0-4941-a2ff-0000a20aecba req-f06998d2-10ee-439c-9b17-4a5625354063 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036485 May 27 15:44:47.078459 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3318/6644] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:44:47.155330 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6ce43c93-9828-4f8d-82fc-b8351d93b00a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:47.163312 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6ce43c93-9828-4f8d-82fc-b8351d93b00a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1392 microversion: 2.1 time: 0.200827 May 27 15:44:47.163906 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3327/6645] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:46 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1392 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:47.607544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bc664641-3694-4ae2-94c7-091efecdfeb2 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:47.608289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bc664641-3694-4ae2-94c7-091efecdfeb2 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:47.615012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc664641-3694-4ae2-94c7-091efecdfeb2 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:47.615474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc664641-3694-4ae2-94c7-091efecdfeb2 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:47.616257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc664641-3694-4ae2-94c7-091efecdfeb2 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:47.616734 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bc664641-3694-4ae2-94c7-091efecdfeb2 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:47.762268 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bc664641-3694-4ae2-94c7-091efecdfeb2 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 200 len: 1654 microversion: 2.1 time: 0.159324 May 27 15:44:47.762857 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3319/6646] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:47 2022] GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 1654 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:48.181096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7d97ebdf-ab2e-4ee4-8491-f1d3a64969c0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:48.182356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7d97ebdf-ab2e-4ee4-8491-f1d3a64969c0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:48.189620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d97ebdf-ab2e-4ee4-8491-f1d3a64969c0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:48.190635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d97ebdf-ab2e-4ee4-8491-f1d3a64969c0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:48.191618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d97ebdf-ab2e-4ee4-8491-f1d3a64969c0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:48.192973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7d97ebdf-ab2e-4ee4-8491-f1d3a64969c0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:48.343302 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7d97ebdf-ab2e-4ee4-8491-f1d3a64969c0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:48.351412 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7d97ebdf-ab2e-4ee4-8491-f1d3a64969c0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1392 microversion: 2.1 time: 0.175891 May 27 15:44:48.352069 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3328/6647] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:48 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:48.779601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eae14671-2630-46fb-8519-cc2dbcd4e96a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:48.780352 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-eae14671-2630-46fb-8519-cc2dbcd4e96a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:48.787842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eae14671-2630-46fb-8519-cc2dbcd4e96a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:48.788325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eae14671-2630-46fb-8519-cc2dbcd4e96a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:48.789234 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eae14671-2630-46fb-8519-cc2dbcd4e96a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:48.789732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eae14671-2630-46fb-8519-cc2dbcd4e96a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:48.939958 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-eae14671-2630-46fb-8519-cc2dbcd4e96a tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 200 len: 1654 microversion: 2.1 time: 0.164077 May 27 15:44:48.941303 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3320/6648] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:48 2022] GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 1654 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:49.100731 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-b9a20f7b-6a97-4672-9254-aef6c0819793 req-c5bc5672-3fe6-4445-8f80-3b84b48329ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91", "name": "network-vif-deleted", "tag": "b7507d30-7137-41ea-aa1a-780c8fcad017"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:49.113248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b9a20f7b-6a97-4672-9254-aef6c0819793 req-c5bc5672-3fe6-4445-8f80-3b84b48329ee service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:49.113757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b9a20f7b-6a97-4672-9254-aef6c0819793 req-c5bc5672-3fe6-4445-8f80-3b84b48329ee service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:49.126424 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-b9a20f7b-6a97-4672-9254-aef6c0819793 req-c5bc5672-3fe6-4445-8f80-3b84b48329ee service nova] Creating event network-vif-deleted:b7507d30-7137-41ea-aa1a-780c8fcad017 for instance 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 on n-h1-843621-1 May 27 15:44:49.131756 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-b9a20f7b-6a97-4672-9254-aef6c0819793 req-c5bc5672-3fe6-4445-8f80-3b84b48329ee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035291 May 27 15:44:49.132722 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3329/6649] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:44:49.368649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e78cc79b-717c-4e38-a150-e6233a696ca3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:49.369311 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e78cc79b-717c-4e38-a150-e6233a696ca3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:49.376305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e78cc79b-717c-4e38-a150-e6233a696ca3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:49.376874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e78cc79b-717c-4e38-a150-e6233a696ca3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:49.377646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e78cc79b-717c-4e38-a150-e6233a696ca3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:49.378125 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e78cc79b-717c-4e38-a150-e6233a696ca3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:49.510956 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e78cc79b-717c-4e38-a150-e6233a696ca3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:49.518914 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e78cc79b-717c-4e38-a150-e6233a696ca3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1392 microversion: 2.1 time: 0.154247 May 27 15:44:49.519489 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3321/6650] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:49 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:49.959314 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e8b5a089-b1b1-4a92-b38b-2b3fe2aed5fe tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:49.960036 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e8b5a089-b1b1-4a92-b38b-2b3fe2aed5fe tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:49.967793 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8b5a089-b1b1-4a92-b38b-2b3fe2aed5fe tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:49.968536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8b5a089-b1b1-4a92-b38b-2b3fe2aed5fe tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:49.969429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8b5a089-b1b1-4a92-b38b-2b3fe2aed5fe tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:49.970191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8b5a089-b1b1-4a92-b38b-2b3fe2aed5fe tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:50.055522 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e8b5a089-b1b1-4a92-b38b-2b3fe2aed5fe tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 200 len: 1612 microversion: 2.1 time: 0.101251 May 27 15:44:50.056405 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3330/6651] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:49 2022] GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 1612 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:50.535267 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-be4296b4-65ea-4bde-8df9-fed89deb5a98 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:50.535958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-be4296b4-65ea-4bde-8df9-fed89deb5a98 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:50.543024 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be4296b4-65ea-4bde-8df9-fed89deb5a98 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:50.543506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be4296b4-65ea-4bde-8df9-fed89deb5a98 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:50.544294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be4296b4-65ea-4bde-8df9-fed89deb5a98 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:50.544788 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-be4296b4-65ea-4bde-8df9-fed89deb5a98 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:50.678993 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-be4296b4-65ea-4bde-8df9-fed89deb5a98 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:50.687153 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-be4296b4-65ea-4bde-8df9-fed89deb5a98 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1392 microversion: 2.1 time: 0.155876 May 27 15:44:50.687745 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3322/6652] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:50 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:51.072951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6c14cd5e-5de9-4dde-a7d6-d9cd33274620 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:51.073662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6c14cd5e-5de9-4dde-a7d6-d9cd33274620 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:51.080828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6c14cd5e-5de9-4dde-a7d6-d9cd33274620 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:51.081309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6c14cd5e-5de9-4dde-a7d6-d9cd33274620 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:51.082072 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6c14cd5e-5de9-4dde-a7d6-d9cd33274620 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:51.082514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6c14cd5e-5de9-4dde-a7d6-d9cd33274620 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:51.150724 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6c14cd5e-5de9-4dde-a7d6-d9cd33274620 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 200 len: 1612 microversion: 2.1 time: 0.081691 May 27 15:44:51.151301 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3331/6653] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:51 2022] GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 1612 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:51.704930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-99a52f54-2538-4857-929d-b2298d245db8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:51.705504 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-99a52f54-2538-4857-929d-b2298d245db8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:51.712475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99a52f54-2538-4857-929d-b2298d245db8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:51.713037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99a52f54-2538-4857-929d-b2298d245db8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:51.714027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99a52f54-2538-4857-929d-b2298d245db8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:51.714485 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99a52f54-2538-4857-929d-b2298d245db8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:51.857822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-99a52f54-2538-4857-929d-b2298d245db8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:51.866303 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-99a52f54-2538-4857-929d-b2298d245db8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1392 microversion: 2.1 time: 0.165319 May 27 15:44:51.867012 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3323/6654] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:51 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:52.167268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4c8d8d53-2a10-49db-bb99-f6c3beab03d3 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:52.167969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4c8d8d53-2a10-49db-bb99-f6c3beab03d3 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:52.175408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4c8d8d53-2a10-49db-bb99-f6c3beab03d3 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:52.175859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4c8d8d53-2a10-49db-bb99-f6c3beab03d3 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:52.176626 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4c8d8d53-2a10-49db-bb99-f6c3beab03d3 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:52.177108 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4c8d8d53-2a10-49db-bb99-f6c3beab03d3 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:52.191506 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-4c8d8d53-2a10-49db-bb99-f6c3beab03d3 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] HTTP exception thrown: Instance 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 could not be found. May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4c8d8d53-2a10-49db-bb99-f6c3beab03d3 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Request method failure captured: May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 HTTP/1.1 May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikPHTbflpUBUedVTYxzwMS8cWZXQZS7_Tw1TPtGV3iyH0I7gz_GuWZgz9OA5CPe3xaMUvASOiF7q5BVscwAaLnKW4t6JxGgqoBh2B2nLKk6dPXtebHgM4XHUghIZvir0Q8Mtms2eL1KPKZ-Yp1dDRWzDorVi0lwroMpkEtlmqJpyoEEg May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: e72f43934920456bb3949741dcb6ef3d May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TestServerMultinode-4806801 May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,admin,member May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,admin,member May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e72f43934920456bb3949741dcb6ef3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e72f43934920456bb3949741dcb6ef3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e72f43934920456bb3949741dcb6ef3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e72f43934920456bb3949741dcb6ef3d", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TestServerMultinode-4806801 May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: e72f43934920456bb3949741dcb6ef3d May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TestServerMultinode-4806801 May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TestServerMultinode-4806801-project-admin May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: c1bd4e9c802c481db8c256b0ac773b36 May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TestServerMultinode-4806801-project-admin May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 could not be found. May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91'} May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 could not be found. May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 could not be found. May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:44:52.193246 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:44:52.197789 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:44:52.197789 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:44:52.197789 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:44:52.197789 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:44:52.197789 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:44:52.197789 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 could not be found. May 27 15:44:52.197789 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:44:52.197789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4c8d8d53-2a10-49db-bb99-f6c3beab03d3 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Returning 404 to user: Instance 5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:44:52.197789 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4c8d8d53-2a10-49db-bb99-f6c3beab03d3 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91" status: 404 len: 111 microversion: 2.1 time: 0.031119 May 27 15:44:52.197789 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3332/6655] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:52 2022] GET /compute/v2.1/servers/5f57457b-3ca2-49f2-8d9c-d04f9fa6fa91 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:44:52.204440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7ee3f72b-fef3-49e7-871a-6f756b9b62c0 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:52.205082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7ee3f72b-fef3-49e7-871a-6f756b9b62c0 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 15a78847-f450-4247-8db9-36883bf2eebd] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:52.211540 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7ee3f72b-fef3-49e7-871a-6f756b9b62c0 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:52.212035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7ee3f72b-fef3-49e7-871a-6f756b9b62c0 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:52.212851 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7ee3f72b-fef3-49e7-871a-6f756b9b62c0 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:52.213319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7ee3f72b-fef3-49e7-871a-6f756b9b62c0 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:52.239677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7ee3f72b-fef3-49e7-871a-6f756b9b62c0 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 15a78847-f450-4247-8db9-36883bf2eebd] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:44:52.321205 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7ee3f72b-fef3-49e7-871a-6f756b9b62c0 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "DELETE /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd" status: 204 len: 0 microversion: 2.1 time: 0.120153 May 27 15:44:52.321905 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3324/6656] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:44:52 2022] DELETE /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:44:52.337577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c3a554d9-6f0a-4e6b-8e56-8c961a0484c0 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:52.338201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c3a554d9-6f0a-4e6b-8e56-8c961a0484c0 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 15a78847-f450-4247-8db9-36883bf2eebd] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:52.347719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3a554d9-6f0a-4e6b-8e56-8c961a0484c0 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:52.348201 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3a554d9-6f0a-4e6b-8e56-8c961a0484c0 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:52.349004 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3a554d9-6f0a-4e6b-8e56-8c961a0484c0 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:52.349454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3a554d9-6f0a-4e6b-8e56-8c961a0484c0 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:52.488330 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c3a554d9-6f0a-4e6b-8e56-8c961a0484c0 tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd" status: 200 len: 1654 microversion: 2.1 time: 0.154307 May 27 15:44:52.488953 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3333/6657] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:52 2022] GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd => generated 1654 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:52.884248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c600d712-faef-49da-95d5-45abb479beef tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:52.884995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c600d712-faef-49da-95d5-45abb479beef tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:52.894858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c600d712-faef-49da-95d5-45abb479beef tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:52.895335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c600d712-faef-49da-95d5-45abb479beef tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:52.896172 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c600d712-faef-49da-95d5-45abb479beef tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:52.896634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c600d712-faef-49da-95d5-45abb479beef tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:53.030112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c600d712-faef-49da-95d5-45abb479beef tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:53.038136 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c600d712-faef-49da-95d5-45abb479beef tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1392 microversion: 2.1 time: 0.158333 May 27 15:44:53.038725 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3325/6658] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:52 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:53.506543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f21650e5-bc95-4c5c-aae0-7923cf5ca29d tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:53.507164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f21650e5-bc95-4c5c-aae0-7923cf5ca29d tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 15a78847-f450-4247-8db9-36883bf2eebd] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:53.509983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:44:53.510755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:44:53.516824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f21650e5-bc95-4c5c-aae0-7923cf5ca29d tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:53.517284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f21650e5-bc95-4c5c-aae0-7923cf5ca29d tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:53.518055 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f21650e5-bc95-4c5c-aae0-7923cf5ca29d tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:53.518511 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f21650e5-bc95-4c5c-aae0-7923cf5ca29d tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:53.654642 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f21650e5-bc95-4c5c-aae0-7923cf5ca29d tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd" status: 200 len: 1654 microversion: 2.1 time: 0.151851 May 27 15:44:53.655211 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3334/6659] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:53 2022] GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd => generated 1654 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:54.055865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-641326e4-742b-433e-9f69-e593cea1cae7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:54.057107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-641326e4-742b-433e-9f69-e593cea1cae7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:54.059193 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:44:54.065765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-641326e4-742b-433e-9f69-e593cea1cae7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:54.066241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-641326e4-742b-433e-9f69-e593cea1cae7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:54.067173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-641326e4-742b-433e-9f69-e593cea1cae7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:54.067499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-641326e4-742b-433e-9f69-e593cea1cae7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:54.184517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-d1838587-514b-487b-af07-5ff59e256ec8 req-fe6aa111-eceb-46d8-8ba3-12b69b5e8d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a78847-f450-4247-8db9-36883bf2eebd", "name": "network-vif-deleted", "tag": "8674b0da-0a36-4616-a0a3-f915507a18c3"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:54.202886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d1838587-514b-487b-af07-5ff59e256ec8 req-fe6aa111-eceb-46d8-8ba3-12b69b5e8d24 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:54.203569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d1838587-514b-487b-af07-5ff59e256ec8 req-fe6aa111-eceb-46d8-8ba3-12b69b5e8d24 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:54.217374 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-d1838587-514b-487b-af07-5ff59e256ec8 req-fe6aa111-eceb-46d8-8ba3-12b69b5e8d24 service nova] Creating event network-vif-deleted:8674b0da-0a36-4616-a0a3-f915507a18c3 for instance 15a78847-f450-4247-8db9-36883bf2eebd on n-h2-843621-1 May 27 15:44:54.222956 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-d1838587-514b-487b-af07-5ff59e256ec8 req-fe6aa111-eceb-46d8-8ba3-12b69b5e8d24 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043164 May 27 15:44:54.229283 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3335/6660] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:44:54.271957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-641326e4-742b-433e-9f69-e593cea1cae7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:54.280941 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-641326e4-742b-433e-9f69-e593cea1cae7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1392 microversion: 2.1 time: 0.228914 May 27 15:44:54.281543 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3326/6661] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:54 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1392 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:54.493974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-b24f59da-011e-4e57-ae39-f6ce9bd151eb req-00fcc97e-7d3d-432c-aeb9-3fc19383adb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbedb8ed-f021-49ed-9256-199efa92a399", "name": "network-vif-plugged", "status": "completed", "tag": "d8fec746-ba21-483f-bd39-946bac92ddd8"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:54.504212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b24f59da-011e-4e57-ae39-f6ce9bd151eb req-00fcc97e-7d3d-432c-aeb9-3fc19383adb3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:54.504212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b24f59da-011e-4e57-ae39-f6ce9bd151eb req-00fcc97e-7d3d-432c-aeb9-3fc19383adb3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:54.519511 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-b24f59da-011e-4e57-ae39-f6ce9bd151eb req-00fcc97e-7d3d-432c-aeb9-3fc19383adb3 service nova] Creating event network-vif-plugged:d8fec746-ba21-483f-bd39-946bac92ddd8 for instance bbedb8ed-f021-49ed-9256-199efa92a399 on n-h1-843621-1 May 27 15:44:54.525173 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-b24f59da-011e-4e57-ae39-f6ce9bd151eb req-00fcc97e-7d3d-432c-aeb9-3fc19383adb3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035911 May 27 15:44:54.525800 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3336/6662] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:44:54.672195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6bb5fb8b-c398-46a4-b205-7b0c4b2c068c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:54.674023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6bb5fb8b-c398-46a4-b205-7b0c4b2c068c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] [instance: 15a78847-f450-4247-8db9-36883bf2eebd] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:54.680880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6bb5fb8b-c398-46a4-b205-7b0c4b2c068c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:54.681354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6bb5fb8b-c398-46a4-b205-7b0c4b2c068c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:54.682154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6bb5fb8b-c398-46a4-b205-7b0c4b2c068c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:54.682607 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6bb5fb8b-c398-46a4-b205-7b0c4b2c068c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:54.697718 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-6bb5fb8b-c398-46a4-b205-7b0c4b2c068c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] HTTP exception thrown: Instance 15a78847-f450-4247-8db9-36883bf2eebd could not be found. May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6bb5fb8b-c398-46a4-b205-7b0c4b2c068c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Request method failure captured: May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd HTTP/1.1 May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikPHTbflpUBUedVTYxzwMS8cWZXQZS7_Tw1TPtGV3iyH0I7gz_GuWZgz9OA5CPe3xaMUvASOiF7q5BVscwAaLnKW4t6JxGgqoBh2B2nLKk6dPXtebHgM4XHUghIZvir0Q8Mtms2eL1KPKZ-Yp1dDRWzDorVi0lwroMpkEtlmqJpyoEEg May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: e72f43934920456bb3949741dcb6ef3d May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-TestServerMultinode-4806801 May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e72f43934920456bb3949741dcb6ef3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e72f43934920456bb3949741dcb6ef3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e72f43934920456bb3949741dcb6ef3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e72f43934920456bb3949741dcb6ef3d", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-TestServerMultinode-4806801 May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: e72f43934920456bb3949741dcb6ef3d May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-TestServerMultinode-4806801 May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-TestServerMultinode-4806801-project-admin May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: c1bd4e9c802c481db8c256b0ac773b36 May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-TestServerMultinode-4806801-project-admin May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 15a78847-f450-4247-8db9-36883bf2eebd could not be found. May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '15a78847-f450-4247-8db9-36883bf2eebd'} May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15a78847-f450-4247-8db9-36883bf2eebd could not be found. May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a78847-f450-4247-8db9-36883bf2eebd could not be found. May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:44:54.699475 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:44:54.704617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:44:54.704617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:44:54.704617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:44:54.704617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:44:54.704617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:44:54.704617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a78847-f450-4247-8db9-36883bf2eebd could not be found. May 27 15:44:54.704617 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:44:54.704617 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6bb5fb8b-c398-46a4-b205-7b0c4b2c068c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] Returning 404 to user: Instance 15a78847-f450-4247-8db9-36883bf2eebd could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:44:54.704617 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6bb5fb8b-c398-46a4-b205-7b0c4b2c068c tempest-TestServerMultinode-4806801 tempest-TestServerMultinode-4806801-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd" status: 404 len: 111 microversion: 2.1 time: 0.033058 May 27 15:44:54.704617 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3327/6663] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:54 2022] GET /compute/v2.1/servers/15a78847-f450-4247-8db9-36883bf2eebd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:44:55.301315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0d5b3871-2e64-4048-b7e7-fa058db38f2e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:55.301933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0d5b3871-2e64-4048-b7e7-fa058db38f2e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:55.308496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0d5b3871-2e64-4048-b7e7-fa058db38f2e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:55.308984 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0d5b3871-2e64-4048-b7e7-fa058db38f2e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:55.309762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0d5b3871-2e64-4048-b7e7-fa058db38f2e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:55.310207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0d5b3871-2e64-4048-b7e7-fa058db38f2e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:55.442498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0d5b3871-2e64-4048-b7e7-fa058db38f2e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:55.450659 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0d5b3871-2e64-4048-b7e7-fa058db38f2e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1392 microversion: 2.1 time: 0.155403 May 27 15:44:55.451244 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3337/6664] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:55 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:56.467975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-483aae79-039a-485a-87d9-110c4e99c7e0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:56.468609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-483aae79-039a-485a-87d9-110c4e99c7e0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:56.475719 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-483aae79-039a-485a-87d9-110c4e99c7e0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:56.476127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-483aae79-039a-485a-87d9-110c4e99c7e0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:56.476951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-483aae79-039a-485a-87d9-110c4e99c7e0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:56.477409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-483aae79-039a-485a-87d9-110c4e99c7e0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:56.709323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-483aae79-039a-485a-87d9-110c4e99c7e0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:56.717329 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-483aae79-039a-485a-87d9-110c4e99c7e0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1563 microversion: 2.1 time: 0.253782 May 27 15:44:56.717919 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3328/6665] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:56 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1563 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:44:56.734014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-81fbf20f-ec05-4597-81d3-3b1962498ae8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:56.734552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-81fbf20f-ec05-4597-81d3-3b1962498ae8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:56.741172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81fbf20f-ec05-4597-81d3-3b1962498ae8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:56.741628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81fbf20f-ec05-4597-81d3-3b1962498ae8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:56.742407 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81fbf20f-ec05-4597-81d3-3b1962498ae8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:56.742855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-81fbf20f-ec05-4597-81d3-3b1962498ae8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:56.761260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:44:57.031736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-81fbf20f-ec05-4597-81d3-3b1962498ae8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:57.040474 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-81fbf20f-ec05-4597-81d3-3b1962498ae8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1563 microversion: 2.1 time: 0.310445 May 27 15:44:57.041054 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3338/6666] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:56 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1563 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:44:59.412358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-efb8e775-4b78-46d2-90fa-879f3285dcf3 req-60a7d908-2f09-4950-96ba-fb51c831cb55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbedb8ed-f021-49ed-9256-199efa92a399", "tag": "d8fec746-ba21-483f-bd39-946bac92ddd8"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:44:59.415059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a1d30319-2d76-4112-855d-ada197ec2e62 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:44:59.419903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a1d30319-2d76-4112-855d-ada197ec2e62 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:44:59.434509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-efb8e775-4b78-46d2-90fa-879f3285dcf3 req-60a7d908-2f09-4950-96ba-fb51c831cb55 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:59.435082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a1d30319-2d76-4112-855d-ada197ec2e62 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:59.435988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a1d30319-2d76-4112-855d-ada197ec2e62 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:59.436648 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-efb8e775-4b78-46d2-90fa-879f3285dcf3 req-60a7d908-2f09-4950-96ba-fb51c831cb55 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:59.437686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a1d30319-2d76-4112-855d-ada197ec2e62 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:44:59.442867 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a1d30319-2d76-4112-855d-ada197ec2e62 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:44:59.465969 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-efb8e775-4b78-46d2-90fa-879f3285dcf3 req-60a7d908-2f09-4950-96ba-fb51c831cb55 service nova] Creating event network-changed:d8fec746-ba21-483f-bd39-946bac92ddd8 for instance bbedb8ed-f021-49ed-9256-199efa92a399 on n-h1-843621-1 May 27 15:44:59.472316 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-efb8e775-4b78-46d2-90fa-879f3285dcf3 req-60a7d908-2f09-4950-96ba-fb51c831cb55 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063042 May 27 15:44:59.473872 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3339/6667] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:44:59.710002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a1d30319-2d76-4112-855d-ada197ec2e62 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:44:59.718840 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a1d30319-2d76-4112-855d-ada197ec2e62 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1563 microversion: 2.1 time: 0.313368 May 27 15:44:59.732128 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3329/6668] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:44:59 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1563 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:45:09.364826 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e8d35140-3f46-4a32-9209-0ac1af77494c tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:09.367148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e8d35140-3f46-4a32-9209-0ac1af77494c tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 8e001efa-96fd-46dc-abf3-55c6baeb2175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:09.371955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:45:09.377651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8d35140-3f46-4a32-9209-0ac1af77494c tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:09.378218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8d35140-3f46-4a32-9209-0ac1af77494c tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:09.379176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8d35140-3f46-4a32-9209-0ac1af77494c tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:09.379620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8d35140-3f46-4a32-9209-0ac1af77494c tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:09.409229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e8d35140-3f46-4a32-9209-0ac1af77494c tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 8e001efa-96fd-46dc-abf3-55c6baeb2175] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:45:09.501017 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e8d35140-3f46-4a32-9209-0ac1af77494c tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175" status: 204 len: 0 microversion: 2.1 time: 0.144733 May 27 15:45:09.502263 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3340/6669] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:45:09 2022] DELETE /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:45:09.513999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-12561a8c-2b45-4b8a-b037-1ffc3f3899f0 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:09.515392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-12561a8c-2b45-4b8a-b037-1ffc3f3899f0 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 8e001efa-96fd-46dc-abf3-55c6baeb2175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:09.519946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:45:09.527828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12561a8c-2b45-4b8a-b037-1ffc3f3899f0 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:09.528540 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12561a8c-2b45-4b8a-b037-1ffc3f3899f0 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:09.530386 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12561a8c-2b45-4b8a-b037-1ffc3f3899f0 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:09.531509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12561a8c-2b45-4b8a-b037-1ffc3f3899f0 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:09.554144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:45:09.704646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-12561a8c-2b45-4b8a-b037-1ffc3f3899f0 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:45:09.715543 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-12561a8c-2b45-4b8a-b037-1ffc3f3899f0 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175" status: 200 len: 1553 microversion: 2.1 time: 0.208657 May 27 15:45:09.716416 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3330/6670] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:45:09 2022] GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175 => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:45:10.735059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6df22c41-b178-4e1c-adb8-6467407a0e3b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:10.737463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6df22c41-b178-4e1c-adb8-6467407a0e3b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 8e001efa-96fd-46dc-abf3-55c6baeb2175] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:10.747558 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6df22c41-b178-4e1c-adb8-6467407a0e3b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:10.748220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6df22c41-b178-4e1c-adb8-6467407a0e3b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:10.749258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6df22c41-b178-4e1c-adb8-6467407a0e3b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:10.749860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6df22c41-b178-4e1c-adb8-6467407a0e3b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:10.925771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6df22c41-b178-4e1c-adb8-6467407a0e3b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:45:10.937319 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6df22c41-b178-4e1c-adb8-6467407a0e3b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175" status: 200 len: 1553 microversion: 2.1 time: 0.207676 May 27 15:45:10.938183 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3341/6671] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:45:10 2022] GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175 => generated 1553 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:45:11.955612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8ae2a2ac-6f8d-4b11-8ab1-e4e0a52609d4 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:11.956825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8ae2a2ac-6f8d-4b11-8ab1-e4e0a52609d4 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 8e001efa-96fd-46dc-abf3-55c6baeb2175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:11.964578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ae2a2ac-6f8d-4b11-8ab1-e4e0a52609d4 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:11.965888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ae2a2ac-6f8d-4b11-8ab1-e4e0a52609d4 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:11.966698 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ae2a2ac-6f8d-4b11-8ab1-e4e0a52609d4 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:11.967151 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8ae2a2ac-6f8d-4b11-8ab1-e4e0a52609d4 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:12.124790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8ae2a2ac-6f8d-4b11-8ab1-e4e0a52609d4 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:45:12.135602 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8ae2a2ac-6f8d-4b11-8ab1-e4e0a52609d4 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175" status: 200 len: 1553 microversion: 2.1 time: 0.183853 May 27 15:45:12.140306 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3331/6672] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:45:11 2022] GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175 => generated 1553 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:45:12.235187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-6dbf4067-3315-4e83-8b9d-26eb6c25c7b7 req-277d357e-340b-4882-8292-6b5ddbb04755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e001efa-96fd-46dc-abf3-55c6baeb2175", "name": "network-vif-deleted", "tag": "c98f39fe-0f53-43d1-b9cc-529d63f9cbfa"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:45:12.250003 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6dbf4067-3315-4e83-8b9d-26eb6c25c7b7 req-277d357e-340b-4882-8292-6b5ddbb04755 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:12.250453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-6dbf4067-3315-4e83-8b9d-26eb6c25c7b7 req-277d357e-340b-4882-8292-6b5ddbb04755 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:12.271029 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-6dbf4067-3315-4e83-8b9d-26eb6c25c7b7 req-277d357e-340b-4882-8292-6b5ddbb04755 service nova] Creating event network-vif-deleted:c98f39fe-0f53-43d1-b9cc-529d63f9cbfa for instance 8e001efa-96fd-46dc-abf3-55c6baeb2175 on n-h1-843621-1 May 27 15:45:12.277787 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-6dbf4067-3315-4e83-8b9d-26eb6c25c7b7 req-277d357e-340b-4882-8292-6b5ddbb04755 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051549 May 27 15:45:12.281502 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3342/6673] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:45:13.159770 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7a2ef6a9-6676-474e-9f9a-fb941f176ec2 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:13.160625 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7a2ef6a9-6676-474e-9f9a-fb941f176ec2 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 8e001efa-96fd-46dc-abf3-55c6baeb2175] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:13.168078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a2ef6a9-6676-474e-9f9a-fb941f176ec2 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:13.168562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a2ef6a9-6676-474e-9f9a-fb941f176ec2 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:13.169399 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a2ef6a9-6676-474e-9f9a-fb941f176ec2 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:13.169862 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7a2ef6a9-6676-474e-9f9a-fb941f176ec2 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:13.185503 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-7a2ef6a9-6676-474e-9f9a-fb941f176ec2 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] HTTP exception thrown: Instance 8e001efa-96fd-46dc-abf3-55c6baeb2175 could not be found. May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7a2ef6a9-6676-474e-9f9a-fb941f176ec2 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Request method failure captured: May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175 HTTP/1.1 May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikPFjfNMH09PFYuQ-ndbtQ6PP06JP_XG0bzENoRorw6lBL6L-00NEp9ytkB7dDSMegx8DF40LTZV1ZZd8UMZ5EMNTHtQ6RtjgZ2AzcfM-COrkzKSsgZQfbJFELCPueafvszvfyCx2SJnff4LtpgFHBdUitGd-XigPrOZ5pQyTXF4J9x4 May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 750a9fb34cb440b98e8a99f3a0775da2 May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-TestNetworkBasicOps-1029053056 May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/750a9fb34cb440b98e8a99f3a0775da2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/750a9fb34cb440b98e8a99f3a0775da2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/750a9fb34cb440b98e8a99f3a0775da2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_750a9fb34cb440b98e8a99f3a0775da2", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-TestNetworkBasicOps-1029053056 May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 750a9fb34cb440b98e8a99f3a0775da2 May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-TestNetworkBasicOps-1029053056 May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-TestNetworkBasicOps-1029053056-project May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: ca3a1b4ce9b04d87978051169855e4a8 May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-TestNetworkBasicOps-1029053056-project May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 8e001efa-96fd-46dc-abf3-55c6baeb2175 could not be found. May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '8e001efa-96fd-46dc-abf3-55c6baeb2175'} May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e001efa-96fd-46dc-abf3-55c6baeb2175 could not be found. May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e001efa-96fd-46dc-abf3-55c6baeb2175 could not be found. May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:45:13.187145 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:45:13.195588 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:45:13.195588 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:45:13.195588 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:45:13.195588 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:45:13.195588 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:45:13.195588 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e001efa-96fd-46dc-abf3-55c6baeb2175 could not be found. May 27 15:45:13.195588 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:45:13.195588 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7a2ef6a9-6676-474e-9f9a-fb941f176ec2 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Returning 404 to user: Instance 8e001efa-96fd-46dc-abf3-55c6baeb2175 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:45:13.195588 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7a2ef6a9-6676-474e-9f9a-fb941f176ec2 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175" status: 404 len: 111 microversion: 2.1 time: 0.033010 May 27 15:45:13.195588 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3332/6674] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:45:13 2022] GET /compute/v2.1/servers/8e001efa-96fd-46dc-abf3-55c6baeb2175 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:45:13.380565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ec633ed2-58b8-434b-b7a2-b199465fef92 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '.version_select at 0x7fc775abc550>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:13.403519 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ec633ed2-58b8-434b-b7a2-b199465fef92 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-462017487" status: 202 len: 0 microversion: 2.1 time: 0.028328 May 27 15:45:13.404475 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3343/6675] 10.222.0.13 () {58 vars in 1253 bytes} [Fri May 27 15:45:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-462017487 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:45:15.507704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6d432b82-159d-4d8e-9241-e294d28cd903 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:15.508442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6d432b82-159d-4d8e-9241-e294d28cd903 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 6087fdea-edfd-41b9-98c8-ae168fadaf81] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:15.510248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-f3489c70-3c9a-492f-982e-b4ccc60fa702 req-7887b283-4d5f-4a20-849c-2dafa14f4b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6087fdea-edfd-41b9-98c8-ae168fadaf81", "tag": "01fc641f-9507-496a-b5e4-68418ee850ce"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:45:15.522120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f3489c70-3c9a-492f-982e-b4ccc60fa702 req-7887b283-4d5f-4a20-849c-2dafa14f4b77 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:15.522773 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f3489c70-3c9a-492f-982e-b4ccc60fa702 req-7887b283-4d5f-4a20-849c-2dafa14f4b77 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:15.524139 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d432b82-159d-4d8e-9241-e294d28cd903 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:15.524782 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d432b82-159d-4d8e-9241-e294d28cd903 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:15.533287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d432b82-159d-4d8e-9241-e294d28cd903 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:15.534476 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6d432b82-159d-4d8e-9241-e294d28cd903 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:15.539269 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-f3489c70-3c9a-492f-982e-b4ccc60fa702 req-7887b283-4d5f-4a20-849c-2dafa14f4b77 service nova] Creating event network-changed:01fc641f-9507-496a-b5e4-68418ee850ce for instance 6087fdea-edfd-41b9-98c8-ae168fadaf81 on n-h1-843621-1 May 27 15:45:15.548465 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-f3489c70-3c9a-492f-982e-b4ccc60fa702 req-7887b283-4d5f-4a20-849c-2dafa14f4b77 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044054 May 27 15:45:15.549771 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3344/6676] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:45:15.573689 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6d432b82-159d-4d8e-9241-e294d28cd903 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 6087fdea-edfd-41b9-98c8-ae168fadaf81] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:45:15.691887 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6d432b82-159d-4d8e-9241-e294d28cd903 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81" status: 204 len: 0 microversion: 2.1 time: 0.189857 May 27 15:45:15.694010 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3333/6677] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:45:15 2022] DELETE /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:45:15.706041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-57dcb7b8-e585-43d5-a5f1-12113cf02d12 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:15.706827 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-57dcb7b8-e585-43d5-a5f1-12113cf02d12 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 6087fdea-edfd-41b9-98c8-ae168fadaf81] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:15.714121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57dcb7b8-e585-43d5-a5f1-12113cf02d12 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:15.714771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57dcb7b8-e585-43d5-a5f1-12113cf02d12 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:15.715937 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57dcb7b8-e585-43d5-a5f1-12113cf02d12 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:15.716460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57dcb7b8-e585-43d5-a5f1-12113cf02d12 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:15.897360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-57dcb7b8-e585-43d5-a5f1-12113cf02d12 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:45:15.906399 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-57dcb7b8-e585-43d5-a5f1-12113cf02d12 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81" status: 200 len: 1671 microversion: 2.1 time: 0.205575 May 27 15:45:15.907314 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3345/6678] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:45:15 2022] GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81 => generated 1671 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:45:16.925387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3c18b7cf-73a7-4136-825a-f4a4b21d7555 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:16.926028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3c18b7cf-73a7-4136-825a-f4a4b21d7555 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 6087fdea-edfd-41b9-98c8-ae168fadaf81] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:16.933250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c18b7cf-73a7-4136-825a-f4a4b21d7555 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:16.934257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c18b7cf-73a7-4136-825a-f4a4b21d7555 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:16.935029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c18b7cf-73a7-4136-825a-f4a4b21d7555 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:16.935488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3c18b7cf-73a7-4136-825a-f4a4b21d7555 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:17.069749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3c18b7cf-73a7-4136-825a-f4a4b21d7555 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:45:17.078068 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3c18b7cf-73a7-4136-825a-f4a4b21d7555 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81" status: 200 len: 1671 microversion: 2.1 time: 0.157058 May 27 15:45:17.078655 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3334/6679] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:45:16 2022] GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:45:18.087212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-71a67dd9-7087-4851-8a26-eb2ed2fd81d4 req-c4ffdd7e-19d1-4c7a-9aae-7827a0c7d328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6087fdea-edfd-41b9-98c8-ae168fadaf81", "name": "network-vif-deleted", "tag": "01fc641f-9507-496a-b5e4-68418ee850ce"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:45:18.096099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eb3cfe92-89e2-45a0-a1c0-3344cab9b916 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:18.096954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-eb3cfe92-89e2-45a0-a1c0-3344cab9b916 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 6087fdea-edfd-41b9-98c8-ae168fadaf81] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:18.097646 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-71a67dd9-7087-4851-8a26-eb2ed2fd81d4 req-c4ffdd7e-19d1-4c7a-9aae-7827a0c7d328 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:18.098222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-71a67dd9-7087-4851-8a26-eb2ed2fd81d4 req-c4ffdd7e-19d1-4c7a-9aae-7827a0c7d328 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:18.104639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb3cfe92-89e2-45a0-a1c0-3344cab9b916 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:18.105138 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb3cfe92-89e2-45a0-a1c0-3344cab9b916 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:18.105930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb3cfe92-89e2-45a0-a1c0-3344cab9b916 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:18.106386 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb3cfe92-89e2-45a0-a1c0-3344cab9b916 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:18.110171 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-71a67dd9-7087-4851-8a26-eb2ed2fd81d4 req-c4ffdd7e-19d1-4c7a-9aae-7827a0c7d328 service nova] Creating event network-vif-deleted:01fc641f-9507-496a-b5e4-68418ee850ce for instance 6087fdea-edfd-41b9-98c8-ae168fadaf81 on n-h1-843621-1 May 27 15:45:18.115683 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-71a67dd9-7087-4851-8a26-eb2ed2fd81d4 req-c4ffdd7e-19d1-4c7a-9aae-7827a0c7d328 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031877 May 27 15:45:18.116536 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3346/6680] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:45:18.176541 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eb3cfe92-89e2-45a0-a1c0-3344cab9b916 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:45:18.185074 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-eb3cfe92-89e2-45a0-a1c0-3344cab9b916 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81" status: 200 len: 1484 microversion: 2.1 time: 0.092746 May 27 15:45:18.185648 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3335/6681] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:45:18 2022] GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81 => generated 1484 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:45:19.204453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ef2428bb-05de-48f2-9df9-e6dd4b79984d tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:19.205171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ef2428bb-05de-48f2-9df9-e6dd4b79984d tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 6087fdea-edfd-41b9-98c8-ae168fadaf81] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:19.211432 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef2428bb-05de-48f2-9df9-e6dd4b79984d tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:19.211883 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef2428bb-05de-48f2-9df9-e6dd4b79984d tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:19.212641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef2428bb-05de-48f2-9df9-e6dd4b79984d tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:19.213099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ef2428bb-05de-48f2-9df9-e6dd4b79984d tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:19.228065 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-ef2428bb-05de-48f2-9df9-e6dd4b79984d tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] HTTP exception thrown: Instance 6087fdea-edfd-41b9-98c8-ae168fadaf81 could not be found. May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ef2428bb-05de-48f2-9df9-e6dd4b79984d tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Request method failure captured: May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81 HTTP/1.1 May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikPFjfNMH09PFYuQ-ndbtQ6PP06JP_XG0bzENoRorw6lBL6L-00NEp9ytkB7dDSMegx8DF40LTZV1ZZd8UMZ5EMNTHtQ6RtjgZ2AzcfM-COrkzKSsgZQfbJFELCPueafvszvfyCx2SJnff4LtpgFHBdUitGd-XigPrOZ5pQyTXF4J9x4 May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 750a9fb34cb440b98e8a99f3a0775da2 May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TestNetworkBasicOps-1029053056 May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/750a9fb34cb440b98e8a99f3a0775da2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/750a9fb34cb440b98e8a99f3a0775da2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/750a9fb34cb440b98e8a99f3a0775da2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_750a9fb34cb440b98e8a99f3a0775da2", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TestNetworkBasicOps-1029053056 May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 750a9fb34cb440b98e8a99f3a0775da2 May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TestNetworkBasicOps-1029053056 May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TestNetworkBasicOps-1029053056-project May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: ca3a1b4ce9b04d87978051169855e4a8 May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TestNetworkBasicOps-1029053056-project May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 6087fdea-edfd-41b9-98c8-ae168fadaf81 could not be found. May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '6087fdea-edfd-41b9-98c8-ae168fadaf81'} May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6087fdea-edfd-41b9-98c8-ae168fadaf81 could not be found. May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6087fdea-edfd-41b9-98c8-ae168fadaf81 could not be found. May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:45:19.229733 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:45:19.235018 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:45:19.235018 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:45:19.235018 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:45:19.235018 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:45:19.235018 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:45:19.235018 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6087fdea-edfd-41b9-98c8-ae168fadaf81 could not be found. May 27 15:45:19.235018 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:45:19.235018 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ef2428bb-05de-48f2-9df9-e6dd4b79984d tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Returning 404 to user: Instance 6087fdea-edfd-41b9-98c8-ae168fadaf81 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:45:19.235018 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ef2428bb-05de-48f2-9df9-e6dd4b79984d tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81" status: 404 len: 111 microversion: 2.1 time: 0.034153 May 27 15:45:19.235018 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3347/6682] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:45:19 2022] GET /compute/v2.1/servers/6087fdea-edfd-41b9-98c8-ae168fadaf81 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:45:19.392828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8e77c162-c88b-424b-afa1-afbd85204e4b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '.version_select at 0x7fc7760788b0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:19.412135 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8e77c162-c88b-424b-afa1-afbd85204e4b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-274714903" status: 202 len: 0 microversion: 2.1 time: 0.023182 May 27 15:45:19.413567 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3336/6683] 10.222.0.13 () {58 vars in 1253 bytes} [Fri May 27 15:45:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-274714903 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:45:27.566026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3d3df43b-3fa0-4432-bbff-c642fbeba42f tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Action: 'create', calling method: .version_select at 0x7fc775a0e820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2008141025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUsPRoLsyHauGWJwzAa1mSmmzL1NLHx7Cyw51D5Re/gnKi7DJKM5/6bbuGvsJ7krNFBWJhBECdPpFMlm04n2HoqnflYXJtZpsfCdGVXUYNmTeSPjW4vkBsa+Z+CfM/Vsw=="}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:45:27.583476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-3d3df43b-3fa0-4432-bbff-c642fbeba42f tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Getting quotas for project 750a9fb34cb440b98e8a99f3a0775da2. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:45:27.593261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-3d3df43b-3fa0-4432-bbff-c642fbeba42f tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Getting quotas for user ca3a1b4ce9b04d87978051169855e4a8 and project 750a9fb34cb440b98e8a99f3a0775da2. Resources: {'key_pairs'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:45:27.617524 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3d3df43b-3fa0-4432-bbff-c642fbeba42f tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.055452 May 27 15:45:27.618145 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3348/6684] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:45:27 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:45:28.695194 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:45:28.700813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-561adfae-81d4-451a-9679-b8b37e34ce47 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1788901577", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "ffe594d0-e08e-41e7-9942-38598a8c5c2e"}], "key_name": "tempest-TestNetworkBasicOps-2008141025", "security_groups": [{"name": "tempest-secgroup-smoke-1043627468"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:45:28.812923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-561adfae-81d4-451a-9679-b8b37e34ce47 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] validate_networks() for [('ffe594d0-e08e-41e7-9942-38598a8c5c2e', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:45:29.189939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-561adfae-81d4-451a-9679-b8b37e34ce47 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:45:29.190579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-561adfae-81d4-451a-9679-b8b37e34ce47 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:45:29.191080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-561adfae-81d4-451a-9679-b8b37e34ce47 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:45:29.191510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-561adfae-81d4-451a-9679-b8b37e34ce47 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:45:29.191944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-561adfae-81d4-451a-9679-b8b37e34ce47 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:45:29.200995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-561adfae-81d4-451a-9679-b8b37e34ce47 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:29.201467 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-561adfae-81d4-451a-9679-b8b37e34ce47 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:29.203297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-561adfae-81d4-451a-9679-b8b37e34ce47 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:29.203756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-561adfae-81d4-451a-9679-b8b37e34ce47 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:29.221844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-561adfae-81d4-451a-9679-b8b37e34ce47 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Getting quotas for project 750a9fb34cb440b98e8a99f3a0775da2. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:45:29.227906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-561adfae-81d4-451a-9679-b8b37e34ce47 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Getting quotas for user ca3a1b4ce9b04d87978051169855e4a8 and project 750a9fb34cb440b98e8a99f3a0775da2. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:45:29.241457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-561adfae-81d4-451a-9679-b8b37e34ce47 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:45:29.243824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-561adfae-81d4-451a-9679-b8b37e34ce47 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 7a8079b8-522c-4c11-ad13-1206a84ff10c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:45:29.294964 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-561adfae-81d4-451a-9679-b8b37e34ce47 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.601214 May 27 15:45:29.295589 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3337/6685] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:45:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:45:29.302852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:45:29.306950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-92043a10-4666-4514-8ff0-c2915af7b1d6 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:29.307578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-92043a10-4666-4514-8ff0-c2915af7b1d6 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 7a8079b8-522c-4c11-ad13-1206a84ff10c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:29.415078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-92043a10-4666-4514-8ff0-c2915af7b1d6 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:45:29.432990 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-92043a10-4666-4514-8ff0-c2915af7b1d6 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c" status: 200 len: 1249 microversion: 2.1 time: 0.131672 May 27 15:45:29.433649 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3349/6686] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:45:29 2022] GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c => generated 1249 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:45:30.452940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ca35828a-0fec-49cf-91ff-fb5683230dfd tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:30.454710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ca35828a-0fec-49cf-91ff-fb5683230dfd tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 7a8079b8-522c-4c11-ad13-1206a84ff10c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:30.472568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca35828a-0fec-49cf-91ff-fb5683230dfd tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:30.473073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca35828a-0fec-49cf-91ff-fb5683230dfd tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:30.473876 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca35828a-0fec-49cf-91ff-fb5683230dfd tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:30.474334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca35828a-0fec-49cf-91ff-fb5683230dfd tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:30.551344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ca35828a-0fec-49cf-91ff-fb5683230dfd tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:45:30.559880 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ca35828a-0fec-49cf-91ff-fb5683230dfd tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c" status: 200 len: 1307 microversion: 2.1 time: 0.113512 May 27 15:45:30.560444 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3338/6687] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:45:30 2022] GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c => generated 1307 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:45:31.577255 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-879514b8-6fab-44af-8b46-9e70a9c69467 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:31.578020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-879514b8-6fab-44af-8b46-9e70a9c69467 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 7a8079b8-522c-4c11-ad13-1206a84ff10c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:31.586765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-879514b8-6fab-44af-8b46-9e70a9c69467 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:31.587260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-879514b8-6fab-44af-8b46-9e70a9c69467 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:31.588107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-879514b8-6fab-44af-8b46-9e70a9c69467 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:31.588556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-879514b8-6fab-44af-8b46-9e70a9c69467 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:31.792794 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-879514b8-6fab-44af-8b46-9e70a9c69467 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:45:31.804232 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-879514b8-6fab-44af-8b46-9e70a9c69467 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c" status: 200 len: 1375 microversion: 2.1 time: 0.231160 May 27 15:45:31.814561 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3350/6688] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:45:31 2022] GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c => generated 1375 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:45:31.910732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-6874c2ff-7f37-4302-a3a4-77dec64a05ce req-f62c2773-e76f-4fde-9bbe-f7c26edafb9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8079b8-522c-4c11-ad13-1206a84ff10c", "tag": "54be5df5-dbd5-4f13-ad83-9e06694f0d20"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:45:31.921609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-6874c2ff-7f37-4302-a3a4-77dec64a05ce req-f62c2773-e76f-4fde-9bbe-f7c26edafb9b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:31.922083 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-6874c2ff-7f37-4302-a3a4-77dec64a05ce req-f62c2773-e76f-4fde-9bbe-f7c26edafb9b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:31.939574 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-6874c2ff-7f37-4302-a3a4-77dec64a05ce req-f62c2773-e76f-4fde-9bbe-f7c26edafb9b service nova] Creating event network-changed:54be5df5-dbd5-4f13-ad83-9e06694f0d20 for instance 7a8079b8-522c-4c11-ad13-1206a84ff10c on n-h2-843621-1 May 27 15:45:31.945121 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-6874c2ff-7f37-4302-a3a4-77dec64a05ce req-f62c2773-e76f-4fde-9bbe-f7c26edafb9b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038638 May 27 15:45:31.946034 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3339/6689] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:45:32.822837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0f4d3d97-0d60-40e3-8620-5767f384b43d tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:32.823407 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0f4d3d97-0d60-40e3-8620-5767f384b43d tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 7a8079b8-522c-4c11-ad13-1206a84ff10c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:32.830408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0f4d3d97-0d60-40e3-8620-5767f384b43d tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:32.830867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0f4d3d97-0d60-40e3-8620-5767f384b43d tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:32.831654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0f4d3d97-0d60-40e3-8620-5767f384b43d tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:32.832101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0f4d3d97-0d60-40e3-8620-5767f384b43d tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:32.961867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0f4d3d97-0d60-40e3-8620-5767f384b43d tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:45:32.970019 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0f4d3d97-0d60-40e3-8620-5767f384b43d tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c" status: 200 len: 1375 microversion: 2.1 time: 0.151148 May 27 15:45:32.970597 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3351/6690] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:45:32 2022] GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c => generated 1375 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:45:33.073162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-68753a6f-312b-4893-8819-ecfb9de365b7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:45:33.074628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-68753a6f-312b-4893-8819-ecfb9de365b7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:33.081129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68753a6f-312b-4893-8819-ecfb9de365b7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:33.081605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68753a6f-312b-4893-8819-ecfb9de365b7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:33.082393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68753a6f-312b-4893-8819-ecfb9de365b7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:33.082855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-68753a6f-312b-4893-8819-ecfb9de365b7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:33.134134 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-68753a6f-312b-4893-8819-ecfb9de365b7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399/action" status: 200 len: 24564 microversion: 2.1 time: 0.065980 May 27 15:45:33.134781 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3340/6691] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:45:33 2022] POST /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399/action => generated 24564 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:45:33.986850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-22deb40e-1810-4734-a235-299c83361605 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:33.987410 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-22deb40e-1810-4734-a235-299c83361605 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 7a8079b8-522c-4c11-ad13-1206a84ff10c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:33.994451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-22deb40e-1810-4734-a235-299c83361605 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:33.994904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-22deb40e-1810-4734-a235-299c83361605 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:33.995709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-22deb40e-1810-4734-a235-299c83361605 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:33.996152 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-22deb40e-1810-4734-a235-299c83361605 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:34.138478 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-22deb40e-1810-4734-a235-299c83361605 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:45:34.146353 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-22deb40e-1810-4734-a235-299c83361605 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c" status: 200 len: 1375 microversion: 2.1 time: 0.163486 May 27 15:45:34.146924 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3352/6692] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:45:33 2022] GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:45:35.163948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ba7683ba-8a5b-4d3d-968c-3d47acf2a5fd tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:35.164666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ba7683ba-8a5b-4d3d-968c-3d47acf2a5fd tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 7a8079b8-522c-4c11-ad13-1206a84ff10c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:35.172433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba7683ba-8a5b-4d3d-968c-3d47acf2a5fd tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:35.172937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba7683ba-8a5b-4d3d-968c-3d47acf2a5fd tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:35.173726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba7683ba-8a5b-4d3d-968c-3d47acf2a5fd tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:35.174184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba7683ba-8a5b-4d3d-968c-3d47acf2a5fd tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:35.309590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ba7683ba-8a5b-4d3d-968c-3d47acf2a5fd tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:45:35.317068 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ba7683ba-8a5b-4d3d-968c-3d47acf2a5fd tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c" status: 200 len: 1375 microversion: 2.1 time: 0.157590 May 27 15:45:35.317635 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3341/6693] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:45:35 2022] GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:45:36.333699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-165d4540-8e6f-4964-87a0-ebf0ae84bf7a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:36.334239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-165d4540-8e6f-4964-87a0-ebf0ae84bf7a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 7a8079b8-522c-4c11-ad13-1206a84ff10c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:36.341645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-165d4540-8e6f-4964-87a0-ebf0ae84bf7a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:36.342101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-165d4540-8e6f-4964-87a0-ebf0ae84bf7a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:36.342868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-165d4540-8e6f-4964-87a0-ebf0ae84bf7a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:36.343312 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-165d4540-8e6f-4964-87a0-ebf0ae84bf7a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:36.476300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-165d4540-8e6f-4964-87a0-ebf0ae84bf7a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:45:36.484790 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-165d4540-8e6f-4964-87a0-ebf0ae84bf7a tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c" status: 200 len: 1375 microversion: 2.1 time: 0.155000 May 27 15:45:36.485490 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3353/6694] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:45:36 2022] GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:45:37.254334 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-eca011aa-e86f-404c-94f3-8df295ec1213 req-5788ef83-973e-452b-8157-140ce6c6831d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8079b8-522c-4c11-ad13-1206a84ff10c", "name": "network-vif-plugged", "status": "completed", "tag": "54be5df5-dbd5-4f13-ad83-9e06694f0d20"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:45:37.266534 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-eca011aa-e86f-404c-94f3-8df295ec1213 req-5788ef83-973e-452b-8157-140ce6c6831d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:37.266962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-eca011aa-e86f-404c-94f3-8df295ec1213 req-5788ef83-973e-452b-8157-140ce6c6831d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:37.279284 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-eca011aa-e86f-404c-94f3-8df295ec1213 req-5788ef83-973e-452b-8157-140ce6c6831d service nova] Creating event network-vif-plugged:54be5df5-dbd5-4f13-ad83-9e06694f0d20 for instance 7a8079b8-522c-4c11-ad13-1206a84ff10c on n-h2-843621-1 May 27 15:45:37.284730 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-eca011aa-e86f-404c-94f3-8df295ec1213 req-5788ef83-973e-452b-8157-140ce6c6831d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034634 May 27 15:45:37.285447 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3342/6695] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:45:37.502397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2a0146cf-e8a0-4d43-a9ab-0dcc04e1dbad tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:37.503020 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2a0146cf-e8a0-4d43-a9ab-0dcc04e1dbad tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 7a8079b8-522c-4c11-ad13-1206a84ff10c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:37.510023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a0146cf-e8a0-4d43-a9ab-0dcc04e1dbad tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:37.510484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a0146cf-e8a0-4d43-a9ab-0dcc04e1dbad tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:37.511264 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a0146cf-e8a0-4d43-a9ab-0dcc04e1dbad tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:37.511728 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a0146cf-e8a0-4d43-a9ab-0dcc04e1dbad tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:37.655165 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2a0146cf-e8a0-4d43-a9ab-0dcc04e1dbad tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:45:37.665464 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2a0146cf-e8a0-4d43-a9ab-0dcc04e1dbad tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c" status: 200 len: 1375 microversion: 2.1 time: 0.166799 May 27 15:45:37.666149 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3354/6696] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:45:37 2022] GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:45:38.685317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4003b617-7575-4bfc-b653-1d9634b1646b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:38.686043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4003b617-7575-4bfc-b653-1d9634b1646b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 7a8079b8-522c-4c11-ad13-1206a84ff10c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:38.692380 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4003b617-7575-4bfc-b653-1d9634b1646b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:38.693022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4003b617-7575-4bfc-b653-1d9634b1646b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:38.694344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4003b617-7575-4bfc-b653-1d9634b1646b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:38.694961 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4003b617-7575-4bfc-b653-1d9634b1646b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:38.837390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4003b617-7575-4bfc-b653-1d9634b1646b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:45:38.845550 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4003b617-7575-4bfc-b653-1d9634b1646b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c" status: 200 len: 1546 microversion: 2.1 time: 0.166214 May 27 15:45:38.846133 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3343/6697] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:45:38 2022] GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c => generated 1546 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:45:38.862455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f0c6069b-3d16-4eca-a5a5-c34ff345a91f tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:45:38.863068 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f0c6069b-3d16-4eca-a5a5-c34ff345a91f tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 7a8079b8-522c-4c11-ad13-1206a84ff10c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:45:38.869643 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0c6069b-3d16-4eca-a5a5-c34ff345a91f tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:38.870092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0c6069b-3d16-4eca-a5a5-c34ff345a91f tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:38.870851 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0c6069b-3d16-4eca-a5a5-c34ff345a91f tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:38.871313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f0c6069b-3d16-4eca-a5a5-c34ff345a91f tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:39.002345 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f0c6069b-3d16-4eca-a5a5-c34ff345a91f tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:45:39.010088 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f0c6069b-3d16-4eca-a5a5-c34ff345a91f tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c" status: 200 len: 1546 microversion: 2.1 time: 0.151659 May 27 15:45:39.010643 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3355/6698] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:45:38 2022] GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:45:40.944890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-992751d5-86d1-4575-b661-846a5c92fab2 req-94a8bf89-ea05-471d-ad39-287b5a30deba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8079b8-522c-4c11-ad13-1206a84ff10c", "tag": "54be5df5-dbd5-4f13-ad83-9e06694f0d20"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:45:40.953913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:45:40.955120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:45:40.956753 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:45:40.959131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-992751d5-86d1-4575-b661-846a5c92fab2 req-94a8bf89-ea05-471d-ad39-287b5a30deba service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:45:40.959784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-992751d5-86d1-4575-b661-846a5c92fab2 req-94a8bf89-ea05-471d-ad39-287b5a30deba service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:45:40.974517 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-992751d5-86d1-4575-b661-846a5c92fab2 req-94a8bf89-ea05-471d-ad39-287b5a30deba service nova] Creating event network-changed:54be5df5-dbd5-4f13-ad83-9e06694f0d20 for instance 7a8079b8-522c-4c11-ad13-1206a84ff10c on n-h2-843621-1 May 27 15:45:40.982375 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-992751d5-86d1-4575-b661-846a5c92fab2 req-94a8bf89-ea05-471d-ad39-287b5a30deba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041202 May 27 15:45:40.983145 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3344/6699] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:46:03.619684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-56bcc1da-9356-47a8-9b79-c4802645c475 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:03.620217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-56bcc1da-9356-47a8-9b79-c4802645c475 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:03.622281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:46:03.623576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:46:03.624222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=36 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:46:03.631015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56bcc1da-9356-47a8-9b79-c4802645c475 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:03.631476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56bcc1da-9356-47a8-9b79-c4802645c475 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:03.632263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56bcc1da-9356-47a8-9b79-c4802645c475 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:03.632742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-56bcc1da-9356-47a8-9b79-c4802645c475 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:04.022321 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-56bcc1da-9356-47a8-9b79-c4802645c475 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1833 microversion: 2.1 time: 0.406387 May 27 15:46:04.022928 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3356/6700] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:03 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1833 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:04.038076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=30 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:46:04.042857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-48b6079f-ef53-4c6c-83e9-8109ddfb738c tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:04.043626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-48b6079f-ef53-4c6c-83e9-8109ddfb738c tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:04.051493 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48b6079f-ef53-4c6c-83e9-8109ddfb738c tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:04.051975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48b6079f-ef53-4c6c-83e9-8109ddfb738c tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:04.052799 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48b6079f-ef53-4c6c-83e9-8109ddfb738c tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:04.053312 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48b6079f-ef53-4c6c-83e9-8109ddfb738c tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:04.183676 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-26a11dce-655f-4673-8e00-c01223f0c5f1 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:46:04.184704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-26a11dce-655f-4673-8e00-c01223f0c5f1 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 7a8079b8-522c-4c11-ad13-1206a84ff10c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:04.191095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26a11dce-655f-4673-8e00-c01223f0c5f1 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:04.191525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26a11dce-655f-4673-8e00-c01223f0c5f1 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:04.192309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26a11dce-655f-4673-8e00-c01223f0c5f1 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:04.192801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-26a11dce-655f-4673-8e00-c01223f0c5f1 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:04.195750 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-48b6079f-ef53-4c6c-83e9-8109ddfb738c tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:04.206017 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-48b6079f-ef53-4c6c-83e9-8109ddfb738c tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1682 microversion: 2.1 time: 0.170234 May 27 15:46:04.207168 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3345/6701] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:04 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:04.244439 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-26a11dce-655f-4673-8e00-c01223f0c5f1 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "POST /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c/action" status: 200 len: 24573 microversion: 2.1 time: 0.065646 May 27 15:46:04.246740 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3357/6702] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:46:04 2022] POST /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c/action => generated 24573 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 15:46:04.302732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3fd22951-fd72-4ca5-beed-6f69073edfbe tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:46:04.303693 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3fd22951-fd72-4ca5-beed-6f69073edfbe tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:04.310606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3fd22951-fd72-4ca5-beed-6f69073edfbe tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:04.311080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3fd22951-fd72-4ca5-beed-6f69073edfbe tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:04.311866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3fd22951-fd72-4ca5-beed-6f69073edfbe tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:04.312324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3fd22951-fd72-4ca5-beed-6f69073edfbe tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:04.371376 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3fd22951-fd72-4ca5-beed-6f69073edfbe tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399/action" status: 200 len: 32639 microversion: 2.1 time: 0.071824 May 27 15:46:04.372043 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3346/6703] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:46:04 2022] POST /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399/action => generated 32639 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:46:04.592653 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-928a81af-c70a-4df6-b289-3ba31b1f7e17 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:46:04.593342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-928a81af-c70a-4df6-b289-3ba31b1f7e17 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:04.600776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-928a81af-c70a-4df6-b289-3ba31b1f7e17 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:04.601235 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-928a81af-c70a-4df6-b289-3ba31b1f7e17 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:04.602110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-928a81af-c70a-4df6-b289-3ba31b1f7e17 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:04.602550 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-928a81af-c70a-4df6-b289-3ba31b1f7e17 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:04.632890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-928a81af-c70a-4df6-b289-3ba31b1f7e17 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd7af5c98df8f4a89a21a3360b6daff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78e228df8d7e48e287174977291bb85e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:04.633610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-928a81af-c70a-4df6-b289-3ba31b1f7e17 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] flavor_id is None. Assuming migration. {{(pid=119249) resize /opt/stack/nova/nova/compute/api.py:4142}} May 27 15:46:04.633887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-928a81af-c70a-4df6-b289-3ba31b1f7e17 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119249) resize /opt/stack/nova/nova/compute/api.py:4166}} May 27 15:46:04.750286 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-928a81af-c70a-4df6-b289-3ba31b1f7e17 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399/action" status: 202 len: 0 microversion: 2.1 time: 0.161948 May 27 15:46:04.750894 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3358/6704] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:46:04 2022] POST /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:46:04.760129 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4f0e08c5-312c-44e7-a5b3-c47efc879669 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:04.761011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4f0e08c5-312c-44e7-a5b3-c47efc879669 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:04.768539 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4f0e08c5-312c-44e7-a5b3-c47efc879669 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:04.769063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4f0e08c5-312c-44e7-a5b3-c47efc879669 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:04.769874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4f0e08c5-312c-44e7-a5b3-c47efc879669 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:04.770338 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4f0e08c5-312c-44e7-a5b3-c47efc879669 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:04.919576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4f0e08c5-312c-44e7-a5b3-c47efc879669 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:04.927589 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4f0e08c5-312c-44e7-a5b3-c47efc879669 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1691 microversion: 2.1 time: 0.172046 May 27 15:46:04.928501 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3347/6705] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:04 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:05.948525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7938c95b-64c6-4c83-a528-ec3977aa11ec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:05.949236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7938c95b-64c6-4c83-a528-ec3977aa11ec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:05.957189 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7938c95b-64c6-4c83-a528-ec3977aa11ec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:05.957647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7938c95b-64c6-4c83-a528-ec3977aa11ec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:05.958450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7938c95b-64c6-4c83-a528-ec3977aa11ec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:05.958893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7938c95b-64c6-4c83-a528-ec3977aa11ec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:06.114983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7938c95b-64c6-4c83-a528-ec3977aa11ec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:06.123419 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7938c95b-64c6-4c83-a528-ec3977aa11ec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1691 microversion: 2.1 time: 0.181112 May 27 15:46:06.123995 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3359/6706] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:05 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:07.141849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-765c501e-ae91-41c7-bd05-fa87e1c2cf69 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:07.142478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-765c501e-ae91-41c7-bd05-fa87e1c2cf69 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:07.152744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-765c501e-ae91-41c7-bd05-fa87e1c2cf69 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:07.153218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-765c501e-ae91-41c7-bd05-fa87e1c2cf69 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:07.154015 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-765c501e-ae91-41c7-bd05-fa87e1c2cf69 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:07.154466 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-765c501e-ae91-41c7-bd05-fa87e1c2cf69 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:07.292086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-765c501e-ae91-41c7-bd05-fa87e1c2cf69 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:07.300077 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-765c501e-ae91-41c7-bd05-fa87e1c2cf69 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1696 microversion: 2.1 time: 0.163019 May 27 15:46:07.300707 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3348/6707] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:07 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:08.317614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1a8ca473-a493-4940-a1d2-98ba99456a33 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:08.318226 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1a8ca473-a493-4940-a1d2-98ba99456a33 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:08.325280 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a8ca473-a493-4940-a1d2-98ba99456a33 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:08.325749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a8ca473-a493-4940-a1d2-98ba99456a33 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:08.326536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a8ca473-a493-4940-a1d2-98ba99456a33 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:08.326991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1a8ca473-a493-4940-a1d2-98ba99456a33 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:08.462768 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1a8ca473-a493-4940-a1d2-98ba99456a33 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:08.471202 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1a8ca473-a493-4940-a1d2-98ba99456a33 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1696 microversion: 2.1 time: 0.157542 May 27 15:46:08.471778 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3360/6708] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:08 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:09.488984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e2964d28-8971-4abc-86ae-5a0f7f11bfdb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:09.489617 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e2964d28-8971-4abc-86ae-5a0f7f11bfdb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:09.496609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2964d28-8971-4abc-86ae-5a0f7f11bfdb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:09.497108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2964d28-8971-4abc-86ae-5a0f7f11bfdb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:09.497889 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2964d28-8971-4abc-86ae-5a0f7f11bfdb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:09.498398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2964d28-8971-4abc-86ae-5a0f7f11bfdb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:09.632960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e2964d28-8971-4abc-86ae-5a0f7f11bfdb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:09.641090 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e2964d28-8971-4abc-86ae-5a0f7f11bfdb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1696 microversion: 2.1 time: 0.155988 May 27 15:46:09.641673 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3349/6709] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:09 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:10.658802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-83a99ec5-db4b-477b-a891-fdab646ade73 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:10.659433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-83a99ec5-db4b-477b-a891-fdab646ade73 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:10.666560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-83a99ec5-db4b-477b-a891-fdab646ade73 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:10.667013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-83a99ec5-db4b-477b-a891-fdab646ade73 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:10.667783 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-83a99ec5-db4b-477b-a891-fdab646ade73 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:10.668224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-83a99ec5-db4b-477b-a891-fdab646ade73 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:10.671026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a31bcddb-eaa7-4cc4-8e20-6a9d302ea1f5 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:46:10.672041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a31bcddb-eaa7-4cc4-8e20-6a9d302ea1f5 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 7a8079b8-522c-4c11-ad13-1206a84ff10c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:10.682417 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a31bcddb-eaa7-4cc4-8e20-6a9d302ea1f5 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:10.682900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a31bcddb-eaa7-4cc4-8e20-6a9d302ea1f5 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:10.683711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a31bcddb-eaa7-4cc4-8e20-6a9d302ea1f5 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:10.684842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a31bcddb-eaa7-4cc4-8e20-6a9d302ea1f5 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:10.736421 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a31bcddb-eaa7-4cc4-8e20-6a9d302ea1f5 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "POST /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c/action" status: 200 len: 32641 microversion: 2.1 time: 0.069956 May 27 15:46:10.737319 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3350/6710] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:46:10 2022] POST /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c/action => generated 32641 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 15:46:10.816242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-83a99ec5-db4b-477b-a891-fdab646ade73 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:10.824224 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-83a99ec5-db4b-477b-a891-fdab646ade73 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1696 microversion: 2.1 time: 0.169816 May 27 15:46:10.825191 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3361/6711] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:10 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:11.736066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-78432118-2c10-4441-932e-29ea87ae5a5b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:11.736798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-78432118-2c10-4441-932e-29ea87ae5a5b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:11.744559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78432118-2c10-4441-932e-29ea87ae5a5b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:11.745486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78432118-2c10-4441-932e-29ea87ae5a5b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:11.745911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78432118-2c10-4441-932e-29ea87ae5a5b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:11.746379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-78432118-2c10-4441-932e-29ea87ae5a5b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:11.780009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4839c2f2-3873-4dd9-842f-d9f6f9086e3e tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:11.780516 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4839c2f2-3873-4dd9-842f-d9f6f9086e3e tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 7a8079b8-522c-4c11-ad13-1206a84ff10c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:11.785903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-78432118-2c10-4441-932e-29ea87ae5a5b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:46:11.787907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4839c2f2-3873-4dd9-842f-d9f6f9086e3e tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:11.788371 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4839c2f2-3873-4dd9-842f-d9f6f9086e3e tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:11.789202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4839c2f2-3873-4dd9-842f-d9f6f9086e3e tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:11.789652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4839c2f2-3873-4dd9-842f-d9f6f9086e3e tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:11.829154 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4839c2f2-3873-4dd9-842f-d9f6f9086e3e tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 7a8079b8-522c-4c11-ad13-1206a84ff10c] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:46:11.884922 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-78432118-2c10-4441-932e-29ea87ae5a5b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 204 len: 0 microversion: 2.1 time: 0.153187 May 27 15:46:11.886253 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3351/6712] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:46:11 2022] DELETE /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:46:11.892606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-e06251f2-8a39-4462-8b41-73feb24c5cc4 req-c46fa0fb-0980-412b-b8a3-0f8c3593581c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8079b8-522c-4c11-ad13-1206a84ff10c", "tag": "54be5df5-dbd5-4f13-ad83-9e06694f0d20"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:46:11.901478 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e06251f2-8a39-4462-8b41-73feb24c5cc4 req-c46fa0fb-0980-412b-b8a3-0f8c3593581c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:11.902316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e06251f2-8a39-4462-8b41-73feb24c5cc4 req-c46fa0fb-0980-412b-b8a3-0f8c3593581c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:11.915154 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-e06251f2-8a39-4462-8b41-73feb24c5cc4 req-c46fa0fb-0980-412b-b8a3-0f8c3593581c service nova] Creating event network-changed:54be5df5-dbd5-4f13-ad83-9e06694f0d20 for instance 7a8079b8-522c-4c11-ad13-1206a84ff10c on n-h2-843621-1 May 27 15:46:11.915744 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4839c2f2-3873-4dd9-842f-d9f6f9086e3e tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c" status: 204 len: 0 microversion: 2.1 time: 0.139527 May 27 15:46:11.916349 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3362/6713] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:46:11 2022] DELETE /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:46:11.922295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d4704dfe-e51f-4174-9236-6121dda5026a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:11.923011 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d4704dfe-e51f-4174-9236-6121dda5026a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:11.925140 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-e06251f2-8a39-4462-8b41-73feb24c5cc4 req-c46fa0fb-0980-412b-b8a3-0f8c3593581c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037050 May 27 15:46:11.926017 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3352/6714] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:46:11.929782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d4704dfe-e51f-4174-9236-6121dda5026a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:11.930256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d4704dfe-e51f-4174-9236-6121dda5026a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:11.931142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d4704dfe-e51f-4174-9236-6121dda5026a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:11.931480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d4704dfe-e51f-4174-9236-6121dda5026a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:11.933345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3cabe422-8861-40c8-9f17-e712970b2b6f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:11.934300 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3cabe422-8861-40c8-9f17-e712970b2b6f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:11.941042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3cabe422-8861-40c8-9f17-e712970b2b6f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:11.941813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3cabe422-8861-40c8-9f17-e712970b2b6f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:11.942830 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3cabe422-8861-40c8-9f17-e712970b2b6f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:11.943506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3cabe422-8861-40c8-9f17-e712970b2b6f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:12.147751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d4704dfe-e51f-4174-9236-6121dda5026a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:12.153002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3cabe422-8861-40c8-9f17-e712970b2b6f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:12.161376 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d4704dfe-e51f-4174-9236-6121dda5026a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1696 microversion: 2.1 time: 0.243783 May 27 15:46:12.161597 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3cabe422-8861-40c8-9f17-e712970b2b6f tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1578 microversion: 2.1 time: 0.234213 May 27 15:46:12.165056 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3363/6715] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:11 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1696 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:12.165217 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3353/6716] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:11 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1578 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:12.166910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d6a98347-cca3-466d-ba11-c928b725c65b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:12.167635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d6a98347-cca3-466d-ba11-c928b725c65b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 7a8079b8-522c-4c11-ad13-1206a84ff10c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:12.175212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6a98347-cca3-466d-ba11-c928b725c65b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:12.175679 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6a98347-cca3-466d-ba11-c928b725c65b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:12.176475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6a98347-cca3-466d-ba11-c928b725c65b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:12.177069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6a98347-cca3-466d-ba11-c928b725c65b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:12.324370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d6a98347-cca3-466d-ba11-c928b725c65b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:12.332903 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d6a98347-cca3-466d-ba11-c928b725c65b tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c" status: 200 len: 1671 microversion: 2.1 time: 0.169713 May 27 15:46:12.333485 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3364/6717] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:12 2022] GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:13.179111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f15bc0fd-d89f-41b0-9d04-a6af531f0090 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:13.179744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f15bc0fd-d89f-41b0-9d04-a6af531f0090 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:13.182707 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-41083461-24fb-41d7-a4ab-3f53851bb1d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:13.183339 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-41083461-24fb-41d7-a4ab-3f53851bb1d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:13.187812 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f15bc0fd-d89f-41b0-9d04-a6af531f0090 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:13.188284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f15bc0fd-d89f-41b0-9d04-a6af531f0090 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:13.189119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f15bc0fd-d89f-41b0-9d04-a6af531f0090 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:13.189578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f15bc0fd-d89f-41b0-9d04-a6af531f0090 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:13.191041 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-41083461-24fb-41d7-a4ab-3f53851bb1d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:13.191494 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-41083461-24fb-41d7-a4ab-3f53851bb1d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:13.192264 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-41083461-24fb-41d7-a4ab-3f53851bb1d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:13.192758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-41083461-24fb-41d7-a4ab-3f53851bb1d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:13.401335 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-41083461-24fb-41d7-a4ab-3f53851bb1d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:13.406459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f15bc0fd-d89f-41b0-9d04-a6af531f0090 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:13.409760 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-41083461-24fb-41d7-a4ab-3f53851bb1d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1578 microversion: 2.1 time: 0.230954 May 27 15:46:13.410342 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3365/6718] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:13 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1578 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:46:13.414742 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f15bc0fd-d89f-41b0-9d04-a6af531f0090 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1696 microversion: 2.1 time: 0.239458 May 27 15:46:13.414991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2e2fe9ae-6f29-463c-894e-0b3a558a5d64 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:13.424738 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3354/6719] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:13 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1696 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:13.424941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2e2fe9ae-6f29-463c-894e-0b3a558a5d64 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 7a8079b8-522c-4c11-ad13-1206a84ff10c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:13.424941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e2fe9ae-6f29-463c-894e-0b3a558a5d64 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:13.424941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e2fe9ae-6f29-463c-894e-0b3a558a5d64 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:13.424941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e2fe9ae-6f29-463c-894e-0b3a558a5d64 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:13.424941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2e2fe9ae-6f29-463c-894e-0b3a558a5d64 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:13.570571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2e2fe9ae-6f29-463c-894e-0b3a558a5d64 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:13.578330 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2e2fe9ae-6f29-463c-894e-0b3a558a5d64 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c" status: 200 len: 1671 microversion: 2.1 time: 0.166964 May 27 15:46:13.578908 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3366/6720] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:13 2022] GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:14.427398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-409a9674-be37-4372-bae0-e56e9b1a6789 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:14.428059 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-409a9674-be37-4372-bae0-e56e9b1a6789 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:14.431095 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-092217fc-6c1c-4bb4-a88b-e742b929004b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:14.431716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-092217fc-6c1c-4bb4-a88b-e742b929004b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:14.436294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-409a9674-be37-4372-bae0-e56e9b1a6789 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:14.436916 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-409a9674-be37-4372-bae0-e56e9b1a6789 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:14.437774 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-409a9674-be37-4372-bae0-e56e9b1a6789 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:14.438322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-409a9674-be37-4372-bae0-e56e9b1a6789 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:14.440937 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-092217fc-6c1c-4bb4-a88b-e742b929004b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:14.441562 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-092217fc-6c1c-4bb4-a88b-e742b929004b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:14.442501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-092217fc-6c1c-4bb4-a88b-e742b929004b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:14.443211 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-092217fc-6c1c-4bb4-a88b-e742b929004b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:14.812905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-409a9674-be37-4372-bae0-e56e9b1a6789 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:14.822201 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-409a9674-be37-4372-bae0-e56e9b1a6789 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1578 microversion: 2.1 time: 0.398810 May 27 15:46:14.832215 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3355/6721] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:14 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1578 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:14.837652 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-061c3807-e7d2-4fd4-82e2-20bdebd0b96c tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:14.838542 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-061c3807-e7d2-4fd4-82e2-20bdebd0b96c tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 7a8079b8-522c-4c11-ad13-1206a84ff10c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:14.845532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-061c3807-e7d2-4fd4-82e2-20bdebd0b96c tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:14.846009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-061c3807-e7d2-4fd4-82e2-20bdebd0b96c tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:14.846844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-061c3807-e7d2-4fd4-82e2-20bdebd0b96c tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:14.847306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-061c3807-e7d2-4fd4-82e2-20bdebd0b96c tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:14.882877 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-092217fc-6c1c-4bb4-a88b-e742b929004b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:14.892143 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-092217fc-6c1c-4bb4-a88b-e742b929004b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1696 microversion: 2.1 time: 0.464706 May 27 15:46:14.900754 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3367/6722] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:14 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1696 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:46:15.473768 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-ff6d94ba-394b-47f5-b2e6-28618ab54616 req-d446da18-4312-4a71-865c-f7f86535dcc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb", "name": "network-vif-deleted", "tag": "e00c910d-0165-4807-830e-1511dd7dcd0f"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:46:15.484373 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ff6d94ba-394b-47f5-b2e6-28618ab54616 req-d446da18-4312-4a71-865c-f7f86535dcc9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:15.484889 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ff6d94ba-394b-47f5-b2e6-28618ab54616 req-d446da18-4312-4a71-865c-f7f86535dcc9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:15.499693 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-ff6d94ba-394b-47f5-b2e6-28618ab54616 req-d446da18-4312-4a71-865c-f7f86535dcc9 service nova] Creating event network-vif-deleted:e00c910d-0165-4807-830e-1511dd7dcd0f for instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb on n-h2-843621-1 May 27 15:46:15.503890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-061c3807-e7d2-4fd4-82e2-20bdebd0b96c tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a1b4ce9b04d87978051169855e4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '750a9fb34cb440b98e8a99f3a0775da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:15.506461 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-ff6d94ba-394b-47f5-b2e6-28618ab54616 req-d446da18-4312-4a71-865c-f7f86535dcc9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035981 May 27 15:46:15.511904 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3368/6723] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:46:15.517724 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-061c3807-e7d2-4fd4-82e2-20bdebd0b96c tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c" status: 200 len: 1671 microversion: 2.1 time: 0.683982 May 27 15:46:15.518337 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3356/6724] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:14 2022] GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c => generated 1671 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:15.844481 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-513c25d4-1274-4bbd-8e18-5e98a9a71d29 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:15.848334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-513c25d4-1274-4bbd-8e18-5e98a9a71d29 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:15.860145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-513c25d4-1274-4bbd-8e18-5e98a9a71d29 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:15.861000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-513c25d4-1274-4bbd-8e18-5e98a9a71d29 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:15.862564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-513c25d4-1274-4bbd-8e18-5e98a9a71d29 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:15.864633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-513c25d4-1274-4bbd-8e18-5e98a9a71d29 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:15.917710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-744d5717-a345-46d4-a395-c08088026104 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:15.919197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-744d5717-a345-46d4-a395-c08088026104 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:15.935027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-744d5717-a345-46d4-a395-c08088026104 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:15.936570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-744d5717-a345-46d4-a395-c08088026104 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:15.936570 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-744d5717-a345-46d4-a395-c08088026104 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:15.939164 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-744d5717-a345-46d4-a395-c08088026104 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:15.992786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-513c25d4-1274-4bbd-8e18-5e98a9a71d29 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:16.003128 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-513c25d4-1274-4bbd-8e18-5e98a9a71d29 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1226 microversion: 2.1 time: 0.166914 May 27 15:46:16.012218 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3369/6725] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:15 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1226 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:16.013647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-81cb58ae-6e45-44ac-962c-3a9d3cea68d5 req-3ac62fe2-461d-4570-9681-f8e9272be2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8079b8-522c-4c11-ad13-1206a84ff10c", "name": "network-vif-deleted", "tag": "54be5df5-dbd5-4f13-ad83-9e06694f0d20"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:46:16.037110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-81cb58ae-6e45-44ac-962c-3a9d3cea68d5 req-3ac62fe2-461d-4570-9681-f8e9272be2a4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:16.037577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-81cb58ae-6e45-44ac-962c-3a9d3cea68d5 req-3ac62fe2-461d-4570-9681-f8e9272be2a4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:16.049969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:46:16.052607 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-81cb58ae-6e45-44ac-962c-3a9d3cea68d5 req-3ac62fe2-461d-4570-9681-f8e9272be2a4 service nova] Creating event network-vif-deleted:54be5df5-dbd5-4f13-ad83-9e06694f0d20 for instance 7a8079b8-522c-4c11-ad13-1206a84ff10c on n-h2-843621-1 May 27 15:46:16.071387 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-81cb58ae-6e45-44ac-962c-3a9d3cea68d5 req-3ac62fe2-461d-4570-9681-f8e9272be2a4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066356 May 27 15:46:16.077292 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3370/6726] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:46:16.133427 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-744d5717-a345-46d4-a395-c08088026104 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:16.143641 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-744d5717-a345-46d4-a395-c08088026104 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1696 microversion: 2.1 time: 0.237446 May 27 15:46:16.144603 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3357/6727] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:15 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1696 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:16.536136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bd374dd7-5df1-4239-ad59-7f3bb356e554 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:16.538335 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bd374dd7-5df1-4239-ad59-7f3bb356e554 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] [instance: 7a8079b8-522c-4c11-ad13-1206a84ff10c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:16.545685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd374dd7-5df1-4239-ad59-7f3bb356e554 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:16.546149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd374dd7-5df1-4239-ad59-7f3bb356e554 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:16.546973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd374dd7-5df1-4239-ad59-7f3bb356e554 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:16.547426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bd374dd7-5df1-4239-ad59-7f3bb356e554 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:16.562588 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-bd374dd7-5df1-4239-ad59-7f3bb356e554 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] HTTP exception thrown: Instance 7a8079b8-522c-4c11-ad13-1206a84ff10c could not be found. May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bd374dd7-5df1-4239-ad59-7f3bb356e554 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Request method failure captured: May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c HTTP/1.1 May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikPFjfNMH09PFYuQ-ndbtQ6PP06JP_XG0bzENoRorw6lBL6L-00NEp9ytkB7dDSMegx8DF40LTZV1ZZd8UMZ5EMNTHtQ6RtjgZ2AzcfM-COrkzKSsgZQfbJFELCPueafvszvfyCx2SJnff4LtpgFHBdUitGd-XigPrOZ5pQyTXF4J9x4 May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 750a9fb34cb440b98e8a99f3a0775da2 May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TestNetworkBasicOps-1029053056 May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/750a9fb34cb440b98e8a99f3a0775da2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/750a9fb34cb440b98e8a99f3a0775da2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/750a9fb34cb440b98e8a99f3a0775da2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_750a9fb34cb440b98e8a99f3a0775da2", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TestNetworkBasicOps-1029053056 May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 750a9fb34cb440b98e8a99f3a0775da2 May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TestNetworkBasicOps-1029053056 May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TestNetworkBasicOps-1029053056-project May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: ca3a1b4ce9b04d87978051169855e4a8 May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TestNetworkBasicOps-1029053056-project May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 7a8079b8-522c-4c11-ad13-1206a84ff10c could not be found. May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '7a8079b8-522c-4c11-ad13-1206a84ff10c'} May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a8079b8-522c-4c11-ad13-1206a84ff10c could not be found. May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a8079b8-522c-4c11-ad13-1206a84ff10c could not be found. May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:46:16.564292 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:46:16.568488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:46:16.568488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:46:16.568488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:46:16.568488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:46:16.568488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:46:16.568488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a8079b8-522c-4c11-ad13-1206a84ff10c could not be found. May 27 15:46:16.568488 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:46:16.568488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bd374dd7-5df1-4239-ad59-7f3bb356e554 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Returning 404 to user: Instance 7a8079b8-522c-4c11-ad13-1206a84ff10c could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:46:16.568488 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bd374dd7-5df1-4239-ad59-7f3bb356e554 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c" status: 404 len: 111 microversion: 2.1 time: 0.035293 May 27 15:46:16.570027 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3371/6728] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:16 2022] GET /compute/v2.1/servers/7a8079b8-522c-4c11-ad13-1206a84ff10c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:46:16.760346 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-626c12bc-7583-442c-bed6-aad6ea276054 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] Calling method '.version_select at 0x7fc776054790>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:16.784699 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-626c12bc-7583-442c-bed6-aad6ea276054 tempest-TestNetworkBasicOps-1029053056 tempest-TestNetworkBasicOps-1029053056-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2008141025" status: 202 len: 0 microversion: 2.1 time: 0.028554 May 27 15:46:16.785859 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3358/6729] 10.222.0.13 () {58 vars in 1256 bytes} [Fri May 27 15:46:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2008141025 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:46:17.022499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4520163f-420d-406b-973d-bb66ed809318 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:17.023537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4520163f-420d-406b-973d-bb66ed809318 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:17.033522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4520163f-420d-406b-973d-bb66ed809318 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:17.034453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4520163f-420d-406b-973d-bb66ed809318 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:17.035748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4520163f-420d-406b-973d-bb66ed809318 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:17.036449 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4520163f-420d-406b-973d-bb66ed809318 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:17.114076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4520163f-420d-406b-973d-bb66ed809318 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:17.122561 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4520163f-420d-406b-973d-bb66ed809318 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1226 microversion: 2.1 time: 0.106181 May 27 15:46:17.123818 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3372/6730] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:17 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:17.163238 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-381ac23a-b7f6-4295-a41c-932849a0ac18 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:17.163883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-381ac23a-b7f6-4295-a41c-932849a0ac18 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:17.172180 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-381ac23a-b7f6-4295-a41c-932849a0ac18 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:17.172662 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-381ac23a-b7f6-4295-a41c-932849a0ac18 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:17.173639 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-381ac23a-b7f6-4295-a41c-932849a0ac18 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:17.174109 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-381ac23a-b7f6-4295-a41c-932849a0ac18 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:17.343623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-381ac23a-b7f6-4295-a41c-932849a0ac18 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:17.353958 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-381ac23a-b7f6-4295-a41c-932849a0ac18 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1696 microversion: 2.1 time: 0.194826 May 27 15:46:17.364146 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3359/6731] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:17 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1696 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:18.142838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4110cabf-f83e-4b6d-acc9-1d11838a87e8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:18.143495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4110cabf-f83e-4b6d-acc9-1d11838a87e8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:18.153340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4110cabf-f83e-4b6d-acc9-1d11838a87e8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:18.153802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4110cabf-f83e-4b6d-acc9-1d11838a87e8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:18.154628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4110cabf-f83e-4b6d-acc9-1d11838a87e8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:18.155071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4110cabf-f83e-4b6d-acc9-1d11838a87e8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:18.245940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4110cabf-f83e-4b6d-acc9-1d11838a87e8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:18.261072 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4110cabf-f83e-4b6d-acc9-1d11838a87e8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1226 microversion: 2.1 time: 0.124276 May 27 15:46:18.269014 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3373/6732] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:18 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1226 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:18.371609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3b8e4b6c-1b3e-4d23-ba79-d22685e9ca88 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:18.372590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3b8e4b6c-1b3e-4d23-ba79-d22685e9ca88 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:18.380572 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b8e4b6c-1b3e-4d23-ba79-d22685e9ca88 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:18.381201 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b8e4b6c-1b3e-4d23-ba79-d22685e9ca88 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:18.382415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b8e4b6c-1b3e-4d23-ba79-d22685e9ca88 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:18.383071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3b8e4b6c-1b3e-4d23-ba79-d22685e9ca88 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:18.523907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3b8e4b6c-1b3e-4d23-ba79-d22685e9ca88 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:18.532582 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3b8e4b6c-1b3e-4d23-ba79-d22685e9ca88 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1696 microversion: 2.1 time: 0.165041 May 27 15:46:18.534183 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3360/6733] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:18 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:19.288968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f52b465e-fde5-4db2-8b34-79f776e65bb9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:19.295524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f52b465e-fde5-4db2-8b34-79f776e65bb9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:19.319510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f52b465e-fde5-4db2-8b34-79f776e65bb9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:19.323262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f52b465e-fde5-4db2-8b34-79f776e65bb9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:19.324117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f52b465e-fde5-4db2-8b34-79f776e65bb9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:19.324571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f52b465e-fde5-4db2-8b34-79f776e65bb9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:19.551190 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7dfdd514-e584-4e56-ab24-ce9a9ed161af tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:19.552221 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7dfdd514-e584-4e56-ab24-ce9a9ed161af tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:19.559122 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f52b465e-fde5-4db2-8b34-79f776e65bb9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:19.559666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7dfdd514-e584-4e56-ab24-ce9a9ed161af tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:19.560329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7dfdd514-e584-4e56-ab24-ce9a9ed161af tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:19.562153 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7dfdd514-e584-4e56-ab24-ce9a9ed161af tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:19.562765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7dfdd514-e584-4e56-ab24-ce9a9ed161af tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:19.573341 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f52b465e-fde5-4db2-8b34-79f776e65bb9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1226 microversion: 2.1 time: 0.289435 May 27 15:46:19.573932 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3374/6734] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:19 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1226 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:19.913420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7dfdd514-e584-4e56-ab24-ce9a9ed161af tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:19.922156 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7dfdd514-e584-4e56-ab24-ce9a9ed161af tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1695 microversion: 2.1 time: 0.375056 May 27 15:46:19.923347 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3361/6735] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:19 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1695 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:46:20.323750 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-85115765-9dab-4719-890d-181cbf75da4b req-a9a5a9d9-b1ed-4bf4-b8dc-e7b5d922e58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbedb8ed-f021-49ed-9256-199efa92a399", "name": "network-vif-unplugged", "status": "completed", "tag": "d8fec746-ba21-483f-bd39-946bac92ddd8"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:46:20.336469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-85115765-9dab-4719-890d-181cbf75da4b req-a9a5a9d9-b1ed-4bf4-b8dc-e7b5d922e58f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:20.339660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-85115765-9dab-4719-890d-181cbf75da4b req-a9a5a9d9-b1ed-4bf4-b8dc-e7b5d922e58f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:20.360610 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-85115765-9dab-4719-890d-181cbf75da4b req-a9a5a9d9-b1ed-4bf4-b8dc-e7b5d922e58f service nova] Creating event network-vif-unplugged:d8fec746-ba21-483f-bd39-946bac92ddd8 for instance bbedb8ed-f021-49ed-9256-199efa92a399 on n-h2-843621-1 May 27 15:46:20.369088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [req-85115765-9dab-4719-890d-181cbf75da4b req-a9a5a9d9-b1ed-4bf4-b8dc-e7b5d922e58f service nova] Instance bbedb8ed-f021-49ed-9256-199efa92a399 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119249) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 15:46:20.398627 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-85115765-9dab-4719-890d-181cbf75da4b req-a9a5a9d9-b1ed-4bf4-b8dc-e7b5d922e58f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086699 May 27 15:46:20.400012 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3375/6736] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:46:20.591091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-13bbe6da-06f9-491b-970b-e899092a171a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:20.591900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-13bbe6da-06f9-491b-970b-e899092a171a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:20.604108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-13bbe6da-06f9-491b-970b-e899092a171a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:20.610397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-13bbe6da-06f9-491b-970b-e899092a171a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:20.611403 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-13bbe6da-06f9-491b-970b-e899092a171a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:20.612100 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-13bbe6da-06f9-491b-970b-e899092a171a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:20.620362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:46:20.826206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-13bbe6da-06f9-491b-970b-e899092a171a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:20.840397 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-13bbe6da-06f9-491b-970b-e899092a171a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1226 microversion: 2.1 time: 0.253089 May 27 15:46:20.841375 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3362/6737] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:20 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1226 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:20.941382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8e913d71-def6-4ad0-a1e2-f8b08ad1af91 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:20.942360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8e913d71-def6-4ad0-a1e2-f8b08ad1af91 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:20.949837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e913d71-def6-4ad0-a1e2-f8b08ad1af91 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:20.950559 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e913d71-def6-4ad0-a1e2-f8b08ad1af91 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:20.952200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e913d71-def6-4ad0-a1e2-f8b08ad1af91 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:20.952967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e913d71-def6-4ad0-a1e2-f8b08ad1af91 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:21.214784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8e913d71-def6-4ad0-a1e2-f8b08ad1af91 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:21.231865 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8e913d71-def6-4ad0-a1e2-f8b08ad1af91 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1695 microversion: 2.1 time: 0.294575 May 27 15:46:21.234394 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3376/6738] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:20 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1695 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:46:21.859278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0c88370b-de60-4d94-8d9e-42ee885d8013 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:21.860567 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0c88370b-de60-4d94-8d9e-42ee885d8013 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:21.870370 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c88370b-de60-4d94-8d9e-42ee885d8013 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:21.870858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c88370b-de60-4d94-8d9e-42ee885d8013 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:21.871670 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c88370b-de60-4d94-8d9e-42ee885d8013 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:21.873757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0c88370b-de60-4d94-8d9e-42ee885d8013 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:21.952931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0c88370b-de60-4d94-8d9e-42ee885d8013 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:21.961701 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0c88370b-de60-4d94-8d9e-42ee885d8013 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1226 microversion: 2.1 time: 0.106941 May 27 15:46:21.962119 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3363/6739] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:21 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:22.251306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-354a986a-e02d-4b80-85aa-214de711b29d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:22.251915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-354a986a-e02d-4b80-85aa-214de711b29d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:22.259742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-354a986a-e02d-4b80-85aa-214de711b29d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:22.260459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-354a986a-e02d-4b80-85aa-214de711b29d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:22.261490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-354a986a-e02d-4b80-85aa-214de711b29d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:22.263673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-354a986a-e02d-4b80-85aa-214de711b29d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:22.421648 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-e0830893-e5a2-40a2-bfe9-00d371aac530 req-46d6b2a8-029f-4310-bae6-bb407654f2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbedb8ed-f021-49ed-9256-199efa92a399", "tag": "d8fec746-ba21-483f-bd39-946bac92ddd8"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:46:22.434384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e0830893-e5a2-40a2-bfe9-00d371aac530 req-46d6b2a8-029f-4310-bae6-bb407654f2e5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:22.434983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-e0830893-e5a2-40a2-bfe9-00d371aac530 req-46d6b2a8-029f-4310-bae6-bb407654f2e5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:22.441585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-354a986a-e02d-4b80-85aa-214de711b29d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:22.451284 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-354a986a-e02d-4b80-85aa-214de711b29d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1693 microversion: 2.1 time: 0.203426 May 27 15:46:22.453369 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-e0830893-e5a2-40a2-bfe9-00d371aac530 req-46d6b2a8-029f-4310-bae6-bb407654f2e5 service nova] Creating event network-changed:d8fec746-ba21-483f-bd39-946bac92ddd8 for instance bbedb8ed-f021-49ed-9256-199efa92a399 on n-h2-843621-1 May 27 15:46:22.453527 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3377/6740] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:22 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1693 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:22.461148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [req-e0830893-e5a2-40a2-bfe9-00d371aac530 req-46d6b2a8-029f-4310-bae6-bb407654f2e5 service nova] Instance bbedb8ed-f021-49ed-9256-199efa92a399 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119248) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 15:46:22.473474 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-e0830893-e5a2-40a2-bfe9-00d371aac530 req-46d6b2a8-029f-4310-bae6-bb407654f2e5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057673 May 27 15:46:22.474089 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3364/6741] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:46:22.979365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7fd81186-c400-4ccb-8167-ec1ddea35a4a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:22.980399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7fd81186-c400-4ccb-8167-ec1ddea35a4a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:22.987676 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fd81186-c400-4ccb-8167-ec1ddea35a4a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:22.988502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fd81186-c400-4ccb-8167-ec1ddea35a4a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:22.989544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fd81186-c400-4ccb-8167-ec1ddea35a4a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:22.990214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fd81186-c400-4ccb-8167-ec1ddea35a4a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:23.059681 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7fd81186-c400-4ccb-8167-ec1ddea35a4a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:23.069446 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7fd81186-c400-4ccb-8167-ec1ddea35a4a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1226 microversion: 2.1 time: 0.093941 May 27 15:46:23.070725 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3378/6742] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:22 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:23.471536 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3a7f5291-8d31-44cd-b2e4-b085dd64f4c3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:23.472333 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3a7f5291-8d31-44cd-b2e4-b085dd64f4c3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:23.479924 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a7f5291-8d31-44cd-b2e4-b085dd64f4c3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:23.480399 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a7f5291-8d31-44cd-b2e4-b085dd64f4c3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:23.481250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a7f5291-8d31-44cd-b2e4-b085dd64f4c3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:23.481705 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3a7f5291-8d31-44cd-b2e4-b085dd64f4c3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:23.675167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3a7f5291-8d31-44cd-b2e4-b085dd64f4c3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:23.683078 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3a7f5291-8d31-44cd-b2e4-b085dd64f4c3 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1690 microversion: 2.1 time: 0.216378 May 27 15:46:23.683680 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3365/6743] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:23 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1690 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:23.699869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a9f67fc3-132d-4183-bc9a-a9de1519fd4d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:46:23.701043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a9f67fc3-132d-4183-bc9a-a9de1519fd4d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:23.708863 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a9f67fc3-132d-4183-bc9a-a9de1519fd4d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:23.709346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a9f67fc3-132d-4183-bc9a-a9de1519fd4d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:23.710149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a9f67fc3-132d-4183-bc9a-a9de1519fd4d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:23.710776 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a9f67fc3-132d-4183-bc9a-a9de1519fd4d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:23.829972 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a9f67fc3-132d-4183-bc9a-a9de1519fd4d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399/action" status: 202 len: 0 microversion: 2.1 time: 0.133247 May 27 15:46:23.829972 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3379/6744] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:46:23 2022] POST /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:46:23.838358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6efb2802-de20-4fd2-a4e5-cef382678fbb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:23.839057 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6efb2802-de20-4fd2-a4e5-cef382678fbb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:23.850037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6efb2802-de20-4fd2-a4e5-cef382678fbb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:23.850592 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6efb2802-de20-4fd2-a4e5-cef382678fbb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:23.851496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6efb2802-de20-4fd2-a4e5-cef382678fbb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:23.852050 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6efb2802-de20-4fd2-a4e5-cef382678fbb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:24.087386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6451eaf4-39b3-4598-bc1c-28775acf18da tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:24.088441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6451eaf4-39b3-4598-bc1c-28775acf18da tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:24.095753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6451eaf4-39b3-4598-bc1c-28775acf18da tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:24.096212 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6451eaf4-39b3-4598-bc1c-28775acf18da tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:24.097064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6451eaf4-39b3-4598-bc1c-28775acf18da tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:24.097642 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6451eaf4-39b3-4598-bc1c-28775acf18da tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:24.103230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6efb2802-de20-4fd2-a4e5-cef382678fbb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:24.112656 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6efb2802-de20-4fd2-a4e5-cef382678fbb tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1689 microversion: 2.1 time: 0.278219 May 27 15:46:24.124165 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3366/6745] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:23 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1689 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:24.517475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6451eaf4-39b3-4598-bc1c-28775acf18da tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:24.525621 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6451eaf4-39b3-4598-bc1c-28775acf18da tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1226 microversion: 2.1 time: 0.442709 May 27 15:46:24.526286 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3380/6746] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:24 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1226 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:46:25.130018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8dc077a3-97bb-44be-996b-a76deed2dab1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:25.130586 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8dc077a3-97bb-44be-996b-a76deed2dab1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:25.138073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8dc077a3-97bb-44be-996b-a76deed2dab1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:25.139326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8dc077a3-97bb-44be-996b-a76deed2dab1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:25.140135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8dc077a3-97bb-44be-996b-a76deed2dab1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:25.140596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8dc077a3-97bb-44be-996b-a76deed2dab1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:25.285536 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8dc077a3-97bb-44be-996b-a76deed2dab1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:25.293843 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8dc077a3-97bb-44be-996b-a76deed2dab1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1689 microversion: 2.1 time: 0.167967 May 27 15:46:25.294442 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3367/6747] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:25 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:25.542543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1ecf47b8-3903-4069-9da5-b6b40cb087c8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:25.543225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1ecf47b8-3903-4069-9da5-b6b40cb087c8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:25.550685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ecf47b8-3903-4069-9da5-b6b40cb087c8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:25.551144 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ecf47b8-3903-4069-9da5-b6b40cb087c8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:25.551916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ecf47b8-3903-4069-9da5-b6b40cb087c8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:25.552357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1ecf47b8-3903-4069-9da5-b6b40cb087c8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:25.617140 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1ecf47b8-3903-4069-9da5-b6b40cb087c8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:25.625804 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1ecf47b8-3903-4069-9da5-b6b40cb087c8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 200 len: 1226 microversion: 2.1 time: 0.087151 May 27 15:46:25.626393 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3381/6748] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:25 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:26.311316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fb32b480-a919-40d7-8591-3c036c73b001 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:26.311936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fb32b480-a919-40d7-8591-3c036c73b001 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:26.319487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb32b480-a919-40d7-8591-3c036c73b001 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:26.319990 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb32b480-a919-40d7-8591-3c036c73b001 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:26.320824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb32b480-a919-40d7-8591-3c036c73b001 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:26.321368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb32b480-a919-40d7-8591-3c036c73b001 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:26.465661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fb32b480-a919-40d7-8591-3c036c73b001 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:26.474302 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fb32b480-a919-40d7-8591-3c036c73b001 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1689 microversion: 2.1 time: 0.166872 May 27 15:46:26.474885 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3368/6749] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:26 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:26.644025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2a919eee-3109-4c72-9c46-0b51d26b6ce9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:26.645357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2a919eee-3109-4c72-9c46-0b51d26b6ce9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:26.651622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a919eee-3109-4c72-9c46-0b51d26b6ce9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:26.652081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a919eee-3109-4c72-9c46-0b51d26b6ce9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:26.653107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a919eee-3109-4c72-9c46-0b51d26b6ce9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:26.653560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2a919eee-3109-4c72-9c46-0b51d26b6ce9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:26.669599 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-2a919eee-3109-4c72-9c46-0b51d26b6ce9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] HTTP exception thrown: Instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb could not be found. May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2a919eee-3109-4c72-9c46-0b51d26b6ce9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Request method failure captured: May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb HTTP/1.1 May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikO_1Chjp-7OdQPlgoy0i68J74Yy9denIkk1niNkSk2uFWUy4CftwGV6LxM4FCEGakqUTp0mkulJ5awBDUhVVOjGCfP23UpxiQizq-3BPePUyAFyMxEgrT5T05iojcJbMyfNSyzYbX68HBU5apXXyE_-yRBe0ARJTHso9aoG2B7TFtpc May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_536a3b9dd9a745c089e2da27b9f536ff", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TestVolumeBootPattern-685942222 May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TestVolumeBootPattern-685942222-project May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: a058052ef3fd4ee58291ccc9837558cc May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TestVolumeBootPattern-685942222-project May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb could not be found. May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb'} May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb could not be found. May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb could not be found. May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:46:26.671324 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:46:26.676444 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:46:26.676444 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:46:26.676444 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:46:26.676444 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:46:26.676444 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:46:26.676444 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb could not be found. May 27 15:46:26.676444 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:46:26.676444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2a919eee-3109-4c72-9c46-0b51d26b6ce9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Returning 404 to user: Instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:46:26.676444 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2a919eee-3109-4c72-9c46-0b51d26b6ce9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 404 len: 111 microversion: 2.1 time: 0.034487 May 27 15:46:26.676444 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3382/6750] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:26 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:46:26.818626 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-aebad032-6f77-44aa-ab80-a67320d3f5bc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-8114304", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1197035446", "security_groups": [{"name": "tempest-secgroup-smoke-2103483646"}], "block_device_mapping_v2": [{"uuid": "70ca327c-9782-4cce-ad26-85909766cc6d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8b1a4599-fc38-4529-b66a-d319c59ff383"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:46:26.940730 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-aebad032-6f77-44aa-ab80-a67320d3f5bc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] validate_networks() for [('8b1a4599-fc38-4529-b66a-d319c59ff383', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:46:27.491749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6ed2e917-41f4-492a-bf63-69f62de3a512 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:27.492640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6ed2e917-41f4-492a-bf63-69f62de3a512 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:27.502873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ed2e917-41f4-492a-bf63-69f62de3a512 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:27.503719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ed2e917-41f4-492a-bf63-69f62de3a512 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:27.503854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-aebad032-6f77-44aa-ab80-a67320d3f5bc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:46:27.504311 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-aebad032-6f77-44aa-ab80-a67320d3f5bc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:46:27.504894 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-aebad032-6f77-44aa-ab80-a67320d3f5bc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:46:27.505379 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-aebad032-6f77-44aa-ab80-a67320d3f5bc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:46:27.505818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-aebad032-6f77-44aa-ab80-a67320d3f5bc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:46:27.508035 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ed2e917-41f4-492a-bf63-69f62de3a512 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:27.508613 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ed2e917-41f4-492a-bf63-69f62de3a512 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:27.519825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aebad032-6f77-44aa-ab80-a67320d3f5bc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:27.520578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aebad032-6f77-44aa-ab80-a67320d3f5bc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:27.521605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aebad032-6f77-44aa-ab80-a67320d3f5bc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:27.522253 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-aebad032-6f77-44aa-ab80-a67320d3f5bc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:27.551824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-aebad032-6f77-44aa-ab80-a67320d3f5bc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Getting quotas for project 536a3b9dd9a745c089e2da27b9f536ff. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:46:27.567843 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-aebad032-6f77-44aa-ab80-a67320d3f5bc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Getting quotas for user a058052ef3fd4ee58291ccc9837558cc and project 536a3b9dd9a745c089e2da27b9f536ff. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:46:27.704897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6ed2e917-41f4-492a-bf63-69f62de3a512 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:27.713586 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-aebad032-6f77-44aa-ab80-a67320d3f5bc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:46:27.714751 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6ed2e917-41f4-492a-bf63-69f62de3a512 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1689 microversion: 2.1 time: 0.227132 May 27 15:46:27.715633 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3383/6751] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:27 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1689 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:27.726923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-aebad032-6f77-44aa-ab80-a67320d3f5bc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='70ca327c-9782-4cce-ad26-85909766cc6d',volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:46:27.851933 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-fb8f03e7-e0fe-4871-abc4-07b82eec76dc req-493d3b08-49fd-49cf-b4fc-00d689422f03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbedb8ed-f021-49ed-9256-199efa92a399", "tag": "d8fec746-ba21-483f-bd39-946bac92ddd8"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:46:27.862455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-fb8f03e7-e0fe-4871-abc4-07b82eec76dc req-493d3b08-49fd-49cf-b4fc-00d689422f03 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:27.862908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-fb8f03e7-e0fe-4871-abc4-07b82eec76dc req-493d3b08-49fd-49cf-b4fc-00d689422f03 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:27.885188 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-fb8f03e7-e0fe-4871-abc4-07b82eec76dc req-493d3b08-49fd-49cf-b4fc-00d689422f03 service nova] Creating event network-changed:d8fec746-ba21-483f-bd39-946bac92ddd8 for instance bbedb8ed-f021-49ed-9256-199efa92a399 on n-h1-843621-1 May 27 15:46:27.893947 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [req-fb8f03e7-e0fe-4871-abc4-07b82eec76dc req-493d3b08-49fd-49cf-b4fc-00d689422f03 service nova] Instance bbedb8ed-f021-49ed-9256-199efa92a399 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119249) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 15:46:27.906401 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-aebad032-6f77-44aa-ab80-a67320d3f5bc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.093332 May 27 15:46:27.907788 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3369/6752] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:46:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 15:46:27.910355 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-fb8f03e7-e0fe-4871-abc4-07b82eec76dc req-493d3b08-49fd-49cf-b4fc-00d689422f03 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062961 May 27 15:46:27.910965 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3384/6753] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:46:27.918622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-dcb339fe-26da-4849-9745-a21f4918b293 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:27.919463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-dcb339fe-26da-4849-9745-a21f4918b293 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:28.011459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-dcb339fe-26da-4849-9745-a21f4918b293 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:28.031357 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-dcb339fe-26da-4849-9745-a21f4918b293 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1092 microversion: 2.1 time: 0.116838 May 27 15:46:28.031955 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3370/6754] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:27 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1092 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:28.733395 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c91c96ec-d147-4617-a04c-a4add383bd65 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:28.734187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c91c96ec-d147-4617-a04c-a4add383bd65 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:28.741976 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c91c96ec-d147-4617-a04c-a4add383bd65 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:28.742431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c91c96ec-d147-4617-a04c-a4add383bd65 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:28.743206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c91c96ec-d147-4617-a04c-a4add383bd65 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:28.743757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c91c96ec-d147-4617-a04c-a4add383bd65 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:28.882539 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c91c96ec-d147-4617-a04c-a4add383bd65 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:28.892088 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c91c96ec-d147-4617-a04c-a4add383bd65 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1689 microversion: 2.1 time: 0.163314 May 27 15:46:28.892701 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3385/6755] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:28 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:29.049329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0bf276f8-1202-4947-81fa-31c17933034a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:29.050424 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0bf276f8-1202-4947-81fa-31c17933034a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:29.058609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bf276f8-1202-4947-81fa-31c17933034a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:29.059034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bf276f8-1202-4947-81fa-31c17933034a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:29.059844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bf276f8-1202-4947-81fa-31c17933034a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:29.060306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0bf276f8-1202-4947-81fa-31c17933034a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:29.154823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0bf276f8-1202-4947-81fa-31c17933034a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:29.162979 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0bf276f8-1202-4947-81fa-31c17933034a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1198 microversion: 2.1 time: 0.118179 May 27 15:46:29.163570 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3371/6756] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:29 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1198 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:29.912016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e83e9acf-da0b-4fc0-9dae-3051d9111fe4 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:29.913590 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e83e9acf-da0b-4fc0-9dae-3051d9111fe4 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:29.922619 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e83e9acf-da0b-4fc0-9dae-3051d9111fe4 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:29.924446 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e83e9acf-da0b-4fc0-9dae-3051d9111fe4 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:29.925504 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e83e9acf-da0b-4fc0-9dae-3051d9111fe4 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:29.927278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e83e9acf-da0b-4fc0-9dae-3051d9111fe4 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:30.158063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e83e9acf-da0b-4fc0-9dae-3051d9111fe4 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:30.166732 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e83e9acf-da0b-4fc0-9dae-3051d9111fe4 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1689 microversion: 2.1 time: 0.259080 May 27 15:46:30.167469 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3386/6757] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:29 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1689 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:30.184069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eda019c9-a48b-4bae-b981-107c9115bb08 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:30.184849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-eda019c9-a48b-4bae-b981-107c9115bb08 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:30.192094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eda019c9-a48b-4bae-b981-107c9115bb08 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:30.192564 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eda019c9-a48b-4bae-b981-107c9115bb08 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:30.193398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eda019c9-a48b-4bae-b981-107c9115bb08 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:30.193858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eda019c9-a48b-4bae-b981-107c9115bb08 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:30.408923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eda019c9-a48b-4bae-b981-107c9115bb08 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:30.417301 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-eda019c9-a48b-4bae-b981-107c9115bb08 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1276 microversion: 2.1 time: 0.237022 May 27 15:46:30.417915 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3372/6758] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:30 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1276 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:30.760752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-aa4bded0-34e5-4913-8c58-b612faa1fe3e req-f87bc3a1-c88f-475a-a7a2-08d0f5c79faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8e1380-0f05-41dd-90ff-b826b109ccdc", "tag": "e4f8426c-49f1-4d16-9c50-aeb2c5389a71"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:46:30.783675 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-aa4bded0-34e5-4913-8c58-b612faa1fe3e req-f87bc3a1-c88f-475a-a7a2-08d0f5c79faf service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:30.789591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-aa4bded0-34e5-4913-8c58-b612faa1fe3e req-f87bc3a1-c88f-475a-a7a2-08d0f5c79faf service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:30.811963 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-aa4bded0-34e5-4913-8c58-b612faa1fe3e req-f87bc3a1-c88f-475a-a7a2-08d0f5c79faf service nova] Creating event network-changed:e4f8426c-49f1-4d16-9c50-aeb2c5389a71 for instance ba8e1380-0f05-41dd-90ff-b826b109ccdc on n-h2-843621-1 May 27 15:46:30.826041 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-aa4bded0-34e5-4913-8c58-b612faa1fe3e req-f87bc3a1-c88f-475a-a7a2-08d0f5c79faf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068655 May 27 15:46:30.828312 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3387/6759] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:46:31.187796 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0ab9c630-4328-4f90-95d1-279f311a0e7b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:31.189016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0ab9c630-4328-4f90-95d1-279f311a0e7b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:31.205009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ab9c630-4328-4f90-95d1-279f311a0e7b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:31.206061 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ab9c630-4328-4f90-95d1-279f311a0e7b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:31.211137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ab9c630-4328-4f90-95d1-279f311a0e7b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:31.215192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0ab9c630-4328-4f90-95d1-279f311a0e7b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:31.435383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-21151e9a-db25-4490-8439-04a4a7cb0609 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:31.436757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-21151e9a-db25-4490-8439-04a4a7cb0609 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:31.444385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21151e9a-db25-4490-8439-04a4a7cb0609 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:31.445112 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21151e9a-db25-4490-8439-04a4a7cb0609 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:31.446092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21151e9a-db25-4490-8439-04a4a7cb0609 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:31.446722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-21151e9a-db25-4490-8439-04a4a7cb0609 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:31.473640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:46:31.477275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0ab9c630-4328-4f90-95d1-279f311a0e7b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:31.488467 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0ab9c630-4328-4f90-95d1-279f311a0e7b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1689 microversion: 2.1 time: 0.305137 May 27 15:46:31.498140 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3373/6760] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:31 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1689 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:31.692379 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-21151e9a-db25-4490-8439-04a4a7cb0609 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:31.704150 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-21151e9a-db25-4490-8439-04a4a7cb0609 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1276 microversion: 2.1 time: 0.273009 May 27 15:46:31.705108 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3388/6761] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:31 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1276 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:32.505526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-07bd1a9c-7260-4aa1-a1ba-ce69c9716970 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:32.506182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-07bd1a9c-7260-4aa1-a1ba-ce69c9716970 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:32.513883 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-07bd1a9c-7260-4aa1-a1ba-ce69c9716970 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:32.514357 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-07bd1a9c-7260-4aa1-a1ba-ce69c9716970 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:32.515540 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-07bd1a9c-7260-4aa1-a1ba-ce69c9716970 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:32.515706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-07bd1a9c-7260-4aa1-a1ba-ce69c9716970 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:32.658563 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-07bd1a9c-7260-4aa1-a1ba-ce69c9716970 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:32.666999 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-07bd1a9c-7260-4aa1-a1ba-ce69c9716970 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1682 microversion: 2.1 time: 0.165460 May 27 15:46:32.667582 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3374/6762] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:32 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:32.722599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9106b5eb-124b-46be-832b-8e579dfeef11 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:32.723429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9106b5eb-124b-46be-832b-8e579dfeef11 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:32.730388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9106b5eb-124b-46be-832b-8e579dfeef11 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:32.730917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9106b5eb-124b-46be-832b-8e579dfeef11 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:32.731804 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9106b5eb-124b-46be-832b-8e579dfeef11 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:32.733073 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9106b5eb-124b-46be-832b-8e579dfeef11 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:32.882606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9106b5eb-124b-46be-832b-8e579dfeef11 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:32.890739 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9106b5eb-124b-46be-832b-8e579dfeef11 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1276 microversion: 2.1 time: 0.173212 May 27 15:46:32.891246 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3389/6763] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:32 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1276 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:33.907512 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0b85be5f-d24e-4450-8803-62594d8410e5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:33.908134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0b85be5f-d24e-4450-8803-62594d8410e5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:33.915275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0b85be5f-d24e-4450-8803-62594d8410e5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:33.915880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0b85be5f-d24e-4450-8803-62594d8410e5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:33.916701 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0b85be5f-d24e-4450-8803-62594d8410e5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:33.917148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0b85be5f-d24e-4450-8803-62594d8410e5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:34.313134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0b85be5f-d24e-4450-8803-62594d8410e5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:34.321379 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0b85be5f-d24e-4450-8803-62594d8410e5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1276 microversion: 2.1 time: 0.418349 May 27 15:46:34.323646 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3375/6764] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:33 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1276 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:35.123534 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-3d3beb1f-b807-41ff-8b16-349f07de3c14 req-a7e4bd99-df7d-4c82-b887-25c2ba43bb5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbedb8ed-f021-49ed-9256-199efa92a399", "name": "network-vif-plugged", "status": "completed", "tag": "d8fec746-ba21-483f-bd39-946bac92ddd8"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:46:35.127056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:46:35.133183 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3d3beb1f-b807-41ff-8b16-349f07de3c14 req-a7e4bd99-df7d-4c82-b887-25c2ba43bb5d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:35.133939 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3d3beb1f-b807-41ff-8b16-349f07de3c14 req-a7e4bd99-df7d-4c82-b887-25c2ba43bb5d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:35.146469 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-3d3beb1f-b807-41ff-8b16-349f07de3c14 req-a7e4bd99-df7d-4c82-b887-25c2ba43bb5d service nova] Creating event network-vif-plugged:d8fec746-ba21-483f-bd39-946bac92ddd8 for instance bbedb8ed-f021-49ed-9256-199efa92a399 on n-h1-843621-1 May 27 15:46:35.151299 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-3d3beb1f-b807-41ff-8b16-349f07de3c14 req-a7e4bd99-df7d-4c82-b887-25c2ba43bb5d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190913 May 27 15:46:35.151909 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3390/6765] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:46:35.400536 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5a28436c-6b7f-4a55-b045-d9a6fc09c19c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:35.401289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5a28436c-6b7f-4a55-b045-d9a6fc09c19c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:35.403384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:46:35.409469 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a28436c-6b7f-4a55-b045-d9a6fc09c19c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:35.410041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a28436c-6b7f-4a55-b045-d9a6fc09c19c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:35.410908 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a28436c-6b7f-4a55-b045-d9a6fc09c19c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:35.411447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5a28436c-6b7f-4a55-b045-d9a6fc09c19c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:35.542946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5a28436c-6b7f-4a55-b045-d9a6fc09c19c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:35.550918 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5a28436c-6b7f-4a55-b045-d9a6fc09c19c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1276 microversion: 2.1 time: 0.216049 May 27 15:46:35.551503 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3376/6766] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:35 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1276 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:36.569483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d77e5308-a6fb-4de7-bacd-c99aa93f46ae tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:36.571080 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d77e5308-a6fb-4de7-bacd-c99aa93f46ae tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:36.581199 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d77e5308-a6fb-4de7-bacd-c99aa93f46ae tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:36.581657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d77e5308-a6fb-4de7-bacd-c99aa93f46ae tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:36.582647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d77e5308-a6fb-4de7-bacd-c99aa93f46ae tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:36.583012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d77e5308-a6fb-4de7-bacd-c99aa93f46ae tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:36.721883 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d77e5308-a6fb-4de7-bacd-c99aa93f46ae tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:36.729797 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d77e5308-a6fb-4de7-bacd-c99aa93f46ae tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1276 microversion: 2.1 time: 0.166120 May 27 15:46:36.730397 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3391/6767] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:36 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:37.746967 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6bba5a77-4251-49c5-99e8-8adef8fdc6dc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:37.747682 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6bba5a77-4251-49c5-99e8-8adef8fdc6dc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:37.751256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:46:37.756976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6bba5a77-4251-49c5-99e8-8adef8fdc6dc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:37.757451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6bba5a77-4251-49c5-99e8-8adef8fdc6dc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:37.758254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6bba5a77-4251-49c5-99e8-8adef8fdc6dc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:37.758711 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6bba5a77-4251-49c5-99e8-8adef8fdc6dc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:37.889713 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6bba5a77-4251-49c5-99e8-8adef8fdc6dc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:37.897542 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6bba5a77-4251-49c5-99e8-8adef8fdc6dc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1276 microversion: 2.1 time: 0.154462 May 27 15:46:37.898119 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3377/6768] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:37 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1276 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:38.913961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-083631b2-c0f9-491a-8540-2c2fcdfa7715 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:38.914924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-083631b2-c0f9-491a-8540-2c2fcdfa7715 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:38.921709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-083631b2-c0f9-491a-8540-2c2fcdfa7715 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:38.922141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-083631b2-c0f9-491a-8540-2c2fcdfa7715 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:38.922903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-083631b2-c0f9-491a-8540-2c2fcdfa7715 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:38.923341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-083631b2-c0f9-491a-8540-2c2fcdfa7715 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:39.056425 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-083631b2-c0f9-491a-8540-2c2fcdfa7715 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:39.064598 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-083631b2-c0f9-491a-8540-2c2fcdfa7715 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1276 microversion: 2.1 time: 0.154761 May 27 15:46:39.065224 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3392/6769] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:38 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1276 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:40.081970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2b7ac415-2ab7-42d3-b624-b154d0ba7b28 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:40.082653 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2b7ac415-2ab7-42d3-b624-b154d0ba7b28 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:40.084582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=8 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:46:40.090768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b7ac415-2ab7-42d3-b624-b154d0ba7b28 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:40.091242 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b7ac415-2ab7-42d3-b624-b154d0ba7b28 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:40.092627 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b7ac415-2ab7-42d3-b624-b154d0ba7b28 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:40.093266 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2b7ac415-2ab7-42d3-b624-b154d0ba7b28 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:40.222477 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2b7ac415-2ab7-42d3-b624-b154d0ba7b28 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:40.230107 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2b7ac415-2ab7-42d3-b624-b154d0ba7b28 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1264 microversion: 2.1 time: 0.152084 May 27 15:46:40.230699 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3378/6770] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:40 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:46:41.247118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e560afe1-99f5-409a-8b46-6afd4adf65a2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:41.247741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e560afe1-99f5-409a-8b46-6afd4adf65a2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:41.254814 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e560afe1-99f5-409a-8b46-6afd4adf65a2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:41.255277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e560afe1-99f5-409a-8b46-6afd4adf65a2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:41.256045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e560afe1-99f5-409a-8b46-6afd4adf65a2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:41.256491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e560afe1-99f5-409a-8b46-6afd4adf65a2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:41.387832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e560afe1-99f5-409a-8b46-6afd4adf65a2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:41.395609 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e560afe1-99f5-409a-8b46-6afd4adf65a2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1264 microversion: 2.1 time: 0.152398 May 27 15:46:41.396170 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3393/6771] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:41 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:42.413299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-38c44ec2-e904-44d4-b74b-c704edb42bd1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:42.414007 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-38c44ec2-e904-44d4-b74b-c704edb42bd1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:42.421584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-38c44ec2-e904-44d4-b74b-c704edb42bd1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:42.422056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-38c44ec2-e904-44d4-b74b-c704edb42bd1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:42.422875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-38c44ec2-e904-44d4-b74b-c704edb42bd1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:42.423516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-38c44ec2-e904-44d4-b74b-c704edb42bd1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:42.562124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-38c44ec2-e904-44d4-b74b-c704edb42bd1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:42.570555 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-38c44ec2-e904-44d4-b74b-c704edb42bd1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1264 microversion: 2.1 time: 0.161381 May 27 15:46:42.571156 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3379/6772] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:42 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:43.587404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b9f1124d-bfb7-4a24-840b-571c0c72ad11 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:43.588017 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b9f1124d-bfb7-4a24-840b-571c0c72ad11 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:43.595699 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9f1124d-bfb7-4a24-840b-571c0c72ad11 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:43.596157 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9f1124d-bfb7-4a24-840b-571c0c72ad11 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:43.597006 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9f1124d-bfb7-4a24-840b-571c0c72ad11 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:43.597449 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b9f1124d-bfb7-4a24-840b-571c0c72ad11 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:43.737456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b9f1124d-bfb7-4a24-840b-571c0c72ad11 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:43.745122 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b9f1124d-bfb7-4a24-840b-571c0c72ad11 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1264 microversion: 2.1 time: 0.161566 May 27 15:46:43.745698 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3394/6773] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:43 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:44.762047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1c107d76-724b-4211-a18c-e4605b8331b2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:44.762594 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1c107d76-724b-4211-a18c-e4605b8331b2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:44.769941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1c107d76-724b-4211-a18c-e4605b8331b2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:44.770409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1c107d76-724b-4211-a18c-e4605b8331b2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:44.771187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1c107d76-724b-4211-a18c-e4605b8331b2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:44.771641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1c107d76-724b-4211-a18c-e4605b8331b2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:44.904568 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1c107d76-724b-4211-a18c-e4605b8331b2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:44.908879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:46:44.914187 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1c107d76-724b-4211-a18c-e4605b8331b2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1264 microversion: 2.1 time: 0.156133 May 27 15:46:44.914772 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3380/6774] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:44 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:45.931742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-277779c2-f287-44ba-bd97-cc2aea024f97 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:45.932290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-277779c2-f287-44ba-bd97-cc2aea024f97 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:45.939690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-277779c2-f287-44ba-bd97-cc2aea024f97 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:45.940131 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-277779c2-f287-44ba-bd97-cc2aea024f97 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:45.941012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-277779c2-f287-44ba-bd97-cc2aea024f97 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:45.941459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-277779c2-f287-44ba-bd97-cc2aea024f97 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:46.075620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-277779c2-f287-44ba-bd97-cc2aea024f97 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:46.083764 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-277779c2-f287-44ba-bd97-cc2aea024f97 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1264 microversion: 2.1 time: 0.156073 May 27 15:46:46.084357 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3395/6775] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:45 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:47.100917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3015ca4a-baa0-4127-98ef-2a6f2fc655ad tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:47.101706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3015ca4a-baa0-4127-98ef-2a6f2fc655ad tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:47.109137 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3015ca4a-baa0-4127-98ef-2a6f2fc655ad tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:47.109603 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3015ca4a-baa0-4127-98ef-2a6f2fc655ad tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:47.110381 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3015ca4a-baa0-4127-98ef-2a6f2fc655ad tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:47.110838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3015ca4a-baa0-4127-98ef-2a6f2fc655ad tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:47.250743 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3015ca4a-baa0-4127-98ef-2a6f2fc655ad tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:47.258377 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3015ca4a-baa0-4127-98ef-2a6f2fc655ad tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1264 microversion: 2.1 time: 0.161784 May 27 15:46:47.258951 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3381/6776] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:47 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:46:48.275675 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bc59b063-bb38-47bf-8684-5a37d81a02ff tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:48.276466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bc59b063-bb38-47bf-8684-5a37d81a02ff tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:48.283677 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc59b063-bb38-47bf-8684-5a37d81a02ff tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:48.284136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc59b063-bb38-47bf-8684-5a37d81a02ff tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:48.285127 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc59b063-bb38-47bf-8684-5a37d81a02ff tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:48.285656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bc59b063-bb38-47bf-8684-5a37d81a02ff tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:48.422573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bc59b063-bb38-47bf-8684-5a37d81a02ff tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:48.431050 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bc59b063-bb38-47bf-8684-5a37d81a02ff tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1264 microversion: 2.1 time: 0.159481 May 27 15:46:48.431944 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3396/6777] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:48 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:49.453208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-12265f04-805b-48b5-ade1-f6c410359408 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:49.454021 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-12265f04-805b-48b5-ade1-f6c410359408 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:49.469222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12265f04-805b-48b5-ade1-f6c410359408 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:49.469882 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12265f04-805b-48b5-ade1-f6c410359408 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:49.471121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12265f04-805b-48b5-ade1-f6c410359408 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:49.471842 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12265f04-805b-48b5-ade1-f6c410359408 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:49.613676 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-12265f04-805b-48b5-ade1-f6c410359408 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:49.623015 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-12265f04-805b-48b5-ade1-f6c410359408 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1264 microversion: 2.1 time: 0.176441 May 27 15:46:49.624138 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3382/6778] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:49 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:49.683430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-b142e047-ca68-4d64-821c-a573602c692b req-ba2019ed-458f-47a3-a36d-bb9784a4bc1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8e1380-0f05-41dd-90ff-b826b109ccdc", "name": "network-vif-plugged", "status": "completed", "tag": "e4f8426c-49f1-4d16-9c50-aeb2c5389a71"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:46:49.693500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b142e047-ca68-4d64-821c-a573602c692b req-ba2019ed-458f-47a3-a36d-bb9784a4bc1f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:49.694136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-b142e047-ca68-4d64-821c-a573602c692b req-ba2019ed-458f-47a3-a36d-bb9784a4bc1f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:49.706692 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-b142e047-ca68-4d64-821c-a573602c692b req-ba2019ed-458f-47a3-a36d-bb9784a4bc1f service nova] Creating event network-vif-plugged:e4f8426c-49f1-4d16-9c50-aeb2c5389a71 for instance ba8e1380-0f05-41dd-90ff-b826b109ccdc on n-h2-843621-1 May 27 15:46:49.711651 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-b142e047-ca68-4d64-821c-a573602c692b req-ba2019ed-458f-47a3-a36d-bb9784a4bc1f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032017 May 27 15:46:49.712425 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3397/6779] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:46:50.642451 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4fe2b1e7-883a-4ead-abec-2dabcd3b1d45 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:50.643088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4fe2b1e7-883a-4ead-abec-2dabcd3b1d45 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:50.650320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4fe2b1e7-883a-4ead-abec-2dabcd3b1d45 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:50.650790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4fe2b1e7-883a-4ead-abec-2dabcd3b1d45 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:50.651577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4fe2b1e7-883a-4ead-abec-2dabcd3b1d45 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:50.652044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4fe2b1e7-883a-4ead-abec-2dabcd3b1d45 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:50.786982 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4fe2b1e7-883a-4ead-abec-2dabcd3b1d45 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:50.794681 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4fe2b1e7-883a-4ead-abec-2dabcd3b1d45 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1264 microversion: 2.1 time: 0.157037 May 27 15:46:50.795333 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3383/6780] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:50 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:51.813393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-13c49214-02e0-4cb0-ac1a-e60c93fb50a2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:51.814000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-13c49214-02e0-4cb0-ac1a-e60c93fb50a2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:51.820769 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13c49214-02e0-4cb0-ac1a-e60c93fb50a2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:51.821241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13c49214-02e0-4cb0-ac1a-e60c93fb50a2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:51.822010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13c49214-02e0-4cb0-ac1a-e60c93fb50a2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:51.822451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13c49214-02e0-4cb0-ac1a-e60c93fb50a2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:51.962060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-13c49214-02e0-4cb0-ac1a-e60c93fb50a2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:51.971070 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-13c49214-02e0-4cb0-ac1a-e60c93fb50a2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1451 microversion: 2.1 time: 0.162936 May 27 15:46:51.971661 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3398/6781] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:51 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:51.988058 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a934dc8e-009a-40b5-8017-1a28f9ebe3aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:46:51.988718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a934dc8e-009a-40b5-8017-1a28f9ebe3aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:46:51.994878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a934dc8e-009a-40b5-8017-1a28f9ebe3aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:51.995348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a934dc8e-009a-40b5-8017-1a28f9ebe3aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:51.996135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a934dc8e-009a-40b5-8017-1a28f9ebe3aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:51.996601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a934dc8e-009a-40b5-8017-1a28f9ebe3aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:52.126811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a934dc8e-009a-40b5-8017-1a28f9ebe3aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:46:52.134642 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a934dc8e-009a-40b5-8017-1a28f9ebe3aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1451 microversion: 2.1 time: 0.151374 May 27 15:46:52.135241 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3384/6782] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:46:51 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:46:54.164876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-ffa61640-b8f4-4472-94ea-14885b748113 req-6fddb0bd-7a5c-473e-ad15-159689b190d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8e1380-0f05-41dd-90ff-b826b109ccdc", "tag": "e4f8426c-49f1-4d16-9c50-aeb2c5389a71"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:46:54.173149 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ffa61640-b8f4-4472-94ea-14885b748113 req-6fddb0bd-7a5c-473e-ad15-159689b190d5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:46:54.173603 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ffa61640-b8f4-4472-94ea-14885b748113 req-6fddb0bd-7a5c-473e-ad15-159689b190d5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:46:54.184806 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-ffa61640-b8f4-4472-94ea-14885b748113 req-6fddb0bd-7a5c-473e-ad15-159689b190d5 service nova] Creating event network-changed:e4f8426c-49f1-4d16-9c50-aeb2c5389a71 for instance ba8e1380-0f05-41dd-90ff-b826b109ccdc on n-h2-843621-1 May 27 15:46:54.190354 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-ffa61640-b8f4-4472-94ea-14885b748113 req-6fddb0bd-7a5c-473e-ad15-159689b190d5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095892 May 27 15:46:54.191030 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3399/6783] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:47:04.907240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=17 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:47:04.908088 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=24 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:47:05.011028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-12f00dc0-cc28-420f-9f3c-34bde86b5e09 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:47:05.012071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-12f00dc0-cc28-420f-9f3c-34bde86b5e09 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:47:05.018637 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12f00dc0-cc28-420f-9f3c-34bde86b5e09 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:05.019116 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12f00dc0-cc28-420f-9f3c-34bde86b5e09 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:05.019916 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12f00dc0-cc28-420f-9f3c-34bde86b5e09 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:05.020380 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12f00dc0-cc28-420f-9f3c-34bde86b5e09 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:05.074280 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-12f00dc0-cc28-420f-9f3c-34bde86b5e09 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399/action" status: 200 len: 62375 microversion: 2.1 time: 0.172155 May 27 15:47:05.074944 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3385/6784] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:47:04 2022] POST /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399/action => generated 62375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:47:28.029981 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=19 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:47:28.030731 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=57 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:47:28.179227 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a3575c0d-750c-45bc-9f1e-7bddade57c4e tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:47:28.179934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a3575c0d-750c-45bc-9f1e-7bddade57c4e tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:47:28.186163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3575c0d-750c-45bc-9f1e-7bddade57c4e tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:28.186614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3575c0d-750c-45bc-9f1e-7bddade57c4e tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:28.187374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3575c0d-750c-45bc-9f1e-7bddade57c4e tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:28.187811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a3575c0d-750c-45bc-9f1e-7bddade57c4e tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:28.319037 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a3575c0d-750c-45bc-9f1e-7bddade57c4e tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1833 microversion: 2.1 time: 0.291265 May 27 15:47:28.319614 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3400/6785] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:47:28 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1833 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:47:29.177250 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-66e745e4-d953-42f6-b201-b4e62203957c tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:47:29.178056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-66e745e4-d953-42f6-b201-b4e62203957c tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:47:29.181946 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:47:29.182838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-f8e6f0e5-608e-4b26-95de-f8aecf165325 req-49325d20-e508-4f19-b068-cf630a845bbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbedb8ed-f021-49ed-9256-199efa92a399", "tag": "d8fec746-ba21-483f-bd39-946bac92ddd8"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:47:29.183286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:47:29.187839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66e745e4-d953-42f6-b201-b4e62203957c tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:29.188793 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66e745e4-d953-42f6-b201-b4e62203957c tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:29.189677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66e745e4-d953-42f6-b201-b4e62203957c tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:29.190378 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-66e745e4-d953-42f6-b201-b4e62203957c tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:29.192193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f8e6f0e5-608e-4b26-95de-f8aecf165325 req-49325d20-e508-4f19-b068-cf630a845bbb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:29.192655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f8e6f0e5-608e-4b26-95de-f8aecf165325 req-49325d20-e508-4f19-b068-cf630a845bbb service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:29.205438 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-f8e6f0e5-608e-4b26-95de-f8aecf165325 req-49325d20-e508-4f19-b068-cf630a845bbb service nova] Creating event network-changed:d8fec746-ba21-483f-bd39-946bac92ddd8 for instance bbedb8ed-f021-49ed-9256-199efa92a399 on n-h1-843621-1 May 27 15:47:29.210757 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-f8e6f0e5-608e-4b26-95de-f8aecf165325 req-49325d20-e508-4f19-b068-cf630a845bbb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031693 May 27 15:47:29.211686 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3401/6786] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:47:29.225207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-66e745e4-d953-42f6-b201-b4e62203957c tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:47:29.315178 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-66e745e4-d953-42f6-b201-b4e62203957c tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "DELETE /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 204 len: 0 microversion: 2.1 time: 0.142138 May 27 15:47:29.316784 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3386/6787] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:47:29 2022] DELETE /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:47:29.325368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d6d8745d-325f-434a-892b-db9c8a145edd tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:47:29.326083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d6d8745d-325f-434a-892b-db9c8a145edd tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:47:29.333417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6d8745d-325f-434a-892b-db9c8a145edd tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:29.333889 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6d8745d-325f-434a-892b-db9c8a145edd tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:29.334676 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6d8745d-325f-434a-892b-db9c8a145edd tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:29.336380 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6d8745d-325f-434a-892b-db9c8a145edd tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:29.510306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d6d8745d-325f-434a-892b-db9c8a145edd tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:47:29.519506 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d6d8745d-325f-434a-892b-db9c8a145edd tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1688 microversion: 2.1 time: 0.198280 May 27 15:47:29.520140 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3402/6788] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:47:29 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1688 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:47:30.538890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e00f0374-70da-47a9-bb27-22604dfb729e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:47:30.539732 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e00f0374-70da-47a9-bb27-22604dfb729e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:47:30.547836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e00f0374-70da-47a9-bb27-22604dfb729e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:30.548311 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e00f0374-70da-47a9-bb27-22604dfb729e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:30.549245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e00f0374-70da-47a9-bb27-22604dfb729e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:30.549706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e00f0374-70da-47a9-bb27-22604dfb729e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:30.764661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e00f0374-70da-47a9-bb27-22604dfb729e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:47:30.772927 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e00f0374-70da-47a9-bb27-22604dfb729e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 200 len: 1688 microversion: 2.1 time: 0.238257 May 27 15:47:30.773507 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3387/6789] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:47:30 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 1688 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:47:31.292639 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-16b3a57c-2efc-4f96-acf3-540cda97b41e req-1c1f8ada-2d3b-4d5c-8234-21f7e2c79f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbedb8ed-f021-49ed-9256-199efa92a399", "name": "network-vif-deleted", "tag": "d8fec746-ba21-483f-bd39-946bac92ddd8"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:47:31.304081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-16b3a57c-2efc-4f96-acf3-540cda97b41e req-1c1f8ada-2d3b-4d5c-8234-21f7e2c79f3c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:31.304528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-16b3a57c-2efc-4f96-acf3-540cda97b41e req-1c1f8ada-2d3b-4d5c-8234-21f7e2c79f3c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:31.316699 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-16b3a57c-2efc-4f96-acf3-540cda97b41e req-1c1f8ada-2d3b-4d5c-8234-21f7e2c79f3c service nova] Creating event network-vif-deleted:d8fec746-ba21-483f-bd39-946bac92ddd8 for instance bbedb8ed-f021-49ed-9256-199efa92a399 on n-h1-843621-1 May 27 15:47:31.322271 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-16b3a57c-2efc-4f96-acf3-540cda97b41e req-1c1f8ada-2d3b-4d5c-8234-21f7e2c79f3c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033385 May 27 15:47:31.322861 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3403/6790] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:47:31.790153 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b4630d8c-48c4-4597-8d25-dfb50d19ac79 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:47:31.790778 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b4630d8c-48c4-4597-8d25-dfb50d19ac79 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: bbedb8ed-f021-49ed-9256-199efa92a399] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:47:31.797646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4630d8c-48c4-4597-8d25-dfb50d19ac79 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:31.798117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4630d8c-48c4-4597-8d25-dfb50d19ac79 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:31.799635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4630d8c-48c4-4597-8d25-dfb50d19ac79 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:31.800096 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b4630d8c-48c4-4597-8d25-dfb50d19ac79 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:31.813575 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-b4630d8c-48c4-4597-8d25-dfb50d19ac79 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] HTTP exception thrown: Instance bbedb8ed-f021-49ed-9256-199efa92a399 could not be found. May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b4630d8c-48c4-4597-8d25-dfb50d19ac79 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Request method failure captured: May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 HTTP/1.1 May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikPE8HKsBFVmDjnurTK4MmS5qV_xRSU-M7F4Wkd_TzQv2GmcoU1aDqk4cUYKxa-vX6YTiuiSIkKiSvKPFRD8cWehUx9Pm5FcQMK-uoH6NmDsBRqEpYqdKyByRTnQFvK6M-nxSszSM8yHouf7ypqvuFHP-I4lMAC05OHG2zCrZxHLPq0k May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 3255afe7ba134153bcbe682b574e7803 May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-126916587 May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3255afe7ba134153bcbe682b574e7803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3255afe7ba134153bcbe682b574e7803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3255afe7ba134153bcbe682b574e7803"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3255afe7ba134153bcbe682b574e7803", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-TestNetworkAdvancedServerOps-126916587 May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 3255afe7ba134153bcbe682b574e7803 May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-126916587 May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-TestNetworkAdvancedServerOps-126916587-project May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 499fa1ef3ed047a8a92c7a23be43c8f0 May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-TestNetworkAdvancedServerOps-126916587-project May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance bbedb8ed-f021-49ed-9256-199efa92a399 could not be found. May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'bbedb8ed-f021-49ed-9256-199efa92a399'} May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbedb8ed-f021-49ed-9256-199efa92a399 could not be found. May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbedb8ed-f021-49ed-9256-199efa92a399 could not be found. May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:47:31.815208 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:47:31.820211 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:47:31.820211 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:47:31.820211 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:47:31.820211 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:47:31.820211 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:47:31.820211 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbedb8ed-f021-49ed-9256-199efa92a399 could not be found. May 27 15:47:31.820211 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:47:31.820211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b4630d8c-48c4-4597-8d25-dfb50d19ac79 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Returning 404 to user: Instance bbedb8ed-f021-49ed-9256-199efa92a399 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:47:31.820211 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b4630d8c-48c4-4597-8d25-dfb50d19ac79 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399" status: 404 len: 111 microversion: 2.1 time: 0.030431 May 27 15:47:31.820211 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3388/6791] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:47:31 2022] GET /compute/v2.1/servers/bbedb8ed-f021-49ed-9256-199efa92a399 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:47:35.123897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ee4ff69a-c634-4ddf-b8f5-d99c37306f17 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '.version_select at 0x7fc777150160>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:47:35.145763 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ee4ff69a-c634-4ddf-b8f5-d99c37306f17 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1954577956" status: 202 len: 0 microversion: 2.1 time: 0.026034 May 27 15:47:35.146410 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3404/6792] 10.222.0.13 () {58 vars in 1283 bytes} [Fri May 27 15:47:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1954577956 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:47:35.178544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5dd6b0f4-0719-4cf9-b6ad-05bb2dc26141 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'create', calling method: .version_select at 0x7fc775fb5a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1199849774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbLRUXGMGiQ/ZnSf6IHLB0q5jSKXpyrAi44ieM78aZLQvq7mrRU4SJoHK9ko8Ig+pHnI54dcTVrTq/RY4D49yoOoIA21KB+OUUN37ZfZWd2AWzH8nn9lIwiHE0T89q4wA=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:47:35.194761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-5dd6b0f4-0719-4cf9-b6ad-05bb2dc26141 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Getting quotas for project 3255afe7ba134153bcbe682b574e7803. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:47:35.201566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-5dd6b0f4-0719-4cf9-b6ad-05bb2dc26141 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Getting quotas for user 499fa1ef3ed047a8a92c7a23be43c8f0 and project 3255afe7ba134153bcbe682b574e7803. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:47:35.236969 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5dd6b0f4-0719-4cf9-b6ad-05bb2dc26141 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.062404 May 27 15:47:35.237575 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3389/6793] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:47:35 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:47:41.038735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ad4f8ac2-90e6-4dae-b66f-fd8c4729b2d0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-304351947", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "81a2a3fd-1525-4b66-b48b-3fc6db1a0258"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1199849774", "security_groups": [{"name": "tempest-secgroup-smoke-180475655"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:47:41.315604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=16 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:47:41.404897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-ad4f8ac2-90e6-4dae-b66f-fd8c4729b2d0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] validate_networks() for [('81a2a3fd-1525-4b66-b48b-3fc6db1a0258', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:47:41.917925 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ad4f8ac2-90e6-4dae-b66f-fd8c4729b2d0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:47:41.918778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ad4f8ac2-90e6-4dae-b66f-fd8c4729b2d0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:47:41.919798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ad4f8ac2-90e6-4dae-b66f-fd8c4729b2d0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:47:41.920576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ad4f8ac2-90e6-4dae-b66f-fd8c4729b2d0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:47:41.921305 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-ad4f8ac2-90e6-4dae-b66f-fd8c4729b2d0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:47:41.934916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad4f8ac2-90e6-4dae-b66f-fd8c4729b2d0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:41.935484 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad4f8ac2-90e6-4dae-b66f-fd8c4729b2d0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:41.936445 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad4f8ac2-90e6-4dae-b66f-fd8c4729b2d0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:41.937190 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ad4f8ac2-90e6-4dae-b66f-fd8c4729b2d0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:41.962966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-ad4f8ac2-90e6-4dae-b66f-fd8c4729b2d0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Getting quotas for project 3255afe7ba134153bcbe682b574e7803. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:47:41.972347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-ad4f8ac2-90e6-4dae-b66f-fd8c4729b2d0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Getting quotas for user 499fa1ef3ed047a8a92c7a23be43c8f0 and project 3255afe7ba134153bcbe682b574e7803. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:47:41.990014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ad4f8ac2-90e6-4dae-b66f-fd8c4729b2d0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:47:41.993823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ad4f8ac2-90e6-4dae-b66f-fd8c4729b2d0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:47:42.068082 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ad4f8ac2-90e6-4dae-b66f-fd8c4729b2d0 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.035083 May 27 15:47:42.070062 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3405/6794] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:47:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:47:42.082809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b03e1353-6ec4-4d98-a41d-9e26427dcf90 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:47:42.084354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b03e1353-6ec4-4d98-a41d-9e26427dcf90 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:47:42.088307 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:47:42.176040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b03e1353-6ec4-4d98-a41d-9e26427dcf90 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:47:42.188087 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b03e1353-6ec4-4d98-a41d-9e26427dcf90 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1266 microversion: 2.1 time: 0.111219 May 27 15:47:42.194448 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3390/6795] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:47:42 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:47:43.208533 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0ec9b9eb-a69e-4a10-9a6b-d5389a066464 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:47:43.209795 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0ec9b9eb-a69e-4a10-9a6b-d5389a066464 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:47:43.216383 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0ec9b9eb-a69e-4a10-9a6b-d5389a066464 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:43.217103 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0ec9b9eb-a69e-4a10-9a6b-d5389a066464 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:43.218167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0ec9b9eb-a69e-4a10-9a6b-d5389a066464 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:43.218780 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0ec9b9eb-a69e-4a10-9a6b-d5389a066464 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:43.317548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0ec9b9eb-a69e-4a10-9a6b-d5389a066464 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:47:43.329724 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0ec9b9eb-a69e-4a10-9a6b-d5389a066464 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1318 microversion: 2.1 time: 0.126593 May 27 15:47:43.333458 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3406/6796] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:47:43 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1318 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:47:44.351939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c48464c3-547c-4db1-ab7e-82d1e3a118c7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:47:44.352888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c48464c3-547c-4db1-ab7e-82d1e3a118c7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:47:44.369469 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c48464c3-547c-4db1-ab7e-82d1e3a118c7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:44.369957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c48464c3-547c-4db1-ab7e-82d1e3a118c7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:44.370994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c48464c3-547c-4db1-ab7e-82d1e3a118c7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:44.371648 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c48464c3-547c-4db1-ab7e-82d1e3a118c7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:44.560609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c48464c3-547c-4db1-ab7e-82d1e3a118c7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:47:44.573710 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c48464c3-547c-4db1-ab7e-82d1e3a118c7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1391 microversion: 2.1 time: 0.226764 May 27 15:47:44.575118 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3391/6797] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:47:44 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1391 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:47:44.964261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-f2dbf921-bbdd-4537-9d9d-26c6849cdad7 req-14aa838d-ab9c-415c-afbf-c34373356a03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a937a0-cab9-4050-a4ad-8ba580c8a352", "tag": "8f72d5d1-4bc7-4783-9bfa-89166d6d41bd"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:47:44.979127 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f2dbf921-bbdd-4537-9d9d-26c6849cdad7 req-14aa838d-ab9c-415c-afbf-c34373356a03 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:44.984181 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f2dbf921-bbdd-4537-9d9d-26c6849cdad7 req-14aa838d-ab9c-415c-afbf-c34373356a03 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:45.006396 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-f2dbf921-bbdd-4537-9d9d-26c6849cdad7 req-14aa838d-ab9c-415c-afbf-c34373356a03 service nova] Creating event network-changed:8f72d5d1-4bc7-4783-9bfa-89166d6d41bd for instance b2a937a0-cab9-4050-a4ad-8ba580c8a352 on n-h1-843621-1 May 27 15:47:45.011718 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-f2dbf921-bbdd-4537-9d9d-26c6849cdad7 req-14aa838d-ab9c-415c-afbf-c34373356a03 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060294 May 27 15:47:45.013181 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3407/6798] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:47:45.591827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3e56c0dc-82a0-4fbd-bdd6-2704de870773 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:47:45.592487 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3e56c0dc-82a0-4fbd-bdd6-2704de870773 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:47:45.599807 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e56c0dc-82a0-4fbd-bdd6-2704de870773 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:45.600275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e56c0dc-82a0-4fbd-bdd6-2704de870773 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:45.601197 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e56c0dc-82a0-4fbd-bdd6-2704de870773 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:45.601571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e56c0dc-82a0-4fbd-bdd6-2704de870773 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:45.741915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3e56c0dc-82a0-4fbd-bdd6-2704de870773 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:47:45.749808 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3e56c0dc-82a0-4fbd-bdd6-2704de870773 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1391 microversion: 2.1 time: 0.161824 May 27 15:47:45.750715 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3392/6799] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:47:45 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:47:46.772242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6110c56c-8f06-46d6-931a-7953155ded32 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:47:46.773113 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6110c56c-8f06-46d6-931a-7953155ded32 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:47:46.779632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6110c56c-8f06-46d6-931a-7953155ded32 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:46.780097 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6110c56c-8f06-46d6-931a-7953155ded32 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:46.780945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6110c56c-8f06-46d6-931a-7953155ded32 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:46.781393 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6110c56c-8f06-46d6-931a-7953155ded32 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:46.919821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6110c56c-8f06-46d6-931a-7953155ded32 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:47:46.927760 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6110c56c-8f06-46d6-931a-7953155ded32 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1391 microversion: 2.1 time: 0.161210 May 27 15:47:46.928332 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3408/6800] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:47:46 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:47:47.945372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1cfb8c6f-9e58-41b4-832d-01237b807b30 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:47:47.946041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1cfb8c6f-9e58-41b4-832d-01237b807b30 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:47:47.953196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1cfb8c6f-9e58-41b4-832d-01237b807b30 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:47.953668 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1cfb8c6f-9e58-41b4-832d-01237b807b30 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:47.954463 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1cfb8c6f-9e58-41b4-832d-01237b807b30 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:47.955441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1cfb8c6f-9e58-41b4-832d-01237b807b30 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:48.092153 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1cfb8c6f-9e58-41b4-832d-01237b807b30 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:47:48.101385 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1cfb8c6f-9e58-41b4-832d-01237b807b30 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1391 microversion: 2.1 time: 0.159758 May 27 15:47:48.102003 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3393/6801] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:47:47 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:47:49.119228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0e3de984-350c-4994-b2f8-b2f826ff5461 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:47:49.119854 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0e3de984-350c-4994-b2f8-b2f826ff5461 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:47:49.127323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0e3de984-350c-4994-b2f8-b2f826ff5461 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:49.127715 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0e3de984-350c-4994-b2f8-b2f826ff5461 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:49.128527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0e3de984-350c-4994-b2f8-b2f826ff5461 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:49.129217 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0e3de984-350c-4994-b2f8-b2f826ff5461 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:49.287169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0e3de984-350c-4994-b2f8-b2f826ff5461 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:47:49.296045 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0e3de984-350c-4994-b2f8-b2f826ff5461 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1391 microversion: 2.1 time: 0.180962 May 27 15:47:49.297334 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3409/6802] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:47:49 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:47:50.316163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5d894274-3b62-40b9-9139-5297f23bf85e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:47:50.317029 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5d894274-3b62-40b9-9139-5297f23bf85e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:47:50.324589 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5d894274-3b62-40b9-9139-5297f23bf85e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:50.325225 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5d894274-3b62-40b9-9139-5297f23bf85e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:50.326091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5d894274-3b62-40b9-9139-5297f23bf85e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:50.326630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5d894274-3b62-40b9-9139-5297f23bf85e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:50.469553 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5d894274-3b62-40b9-9139-5297f23bf85e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:47:50.478667 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5d894274-3b62-40b9-9139-5297f23bf85e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1391 microversion: 2.1 time: 0.167380 May 27 15:47:50.479257 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3394/6803] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:47:50 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:47:51.395012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-c7d58e86-e8c9-4ea7-bb58-e12350569d2b req-ee9c3e09-2444-4f65-8f80-c365e961e69d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a937a0-cab9-4050-a4ad-8ba580c8a352", "name": "network-vif-plugged", "status": "completed", "tag": "8f72d5d1-4bc7-4783-9bfa-89166d6d41bd"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:47:51.408248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-c7d58e86-e8c9-4ea7-bb58-e12350569d2b req-ee9c3e09-2444-4f65-8f80-c365e961e69d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:51.408859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-c7d58e86-e8c9-4ea7-bb58-e12350569d2b req-ee9c3e09-2444-4f65-8f80-c365e961e69d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:51.421466 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-c7d58e86-e8c9-4ea7-bb58-e12350569d2b req-ee9c3e09-2444-4f65-8f80-c365e961e69d service nova] Creating event network-vif-plugged:8f72d5d1-4bc7-4783-9bfa-89166d6d41bd for instance b2a937a0-cab9-4050-a4ad-8ba580c8a352 on n-h1-843621-1 May 27 15:47:51.426743 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-c7d58e86-e8c9-4ea7-bb58-e12350569d2b req-ee9c3e09-2444-4f65-8f80-c365e961e69d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036161 May 27 15:47:51.427564 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3410/6804] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:47:51.497371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b399f8ba-e142-4589-8206-5cd1a0e1ea01 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:47:51.497994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b399f8ba-e142-4589-8206-5cd1a0e1ea01 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:47:51.506597 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b399f8ba-e142-4589-8206-5cd1a0e1ea01 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:51.507116 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b399f8ba-e142-4589-8206-5cd1a0e1ea01 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:51.508028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b399f8ba-e142-4589-8206-5cd1a0e1ea01 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:51.508492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b399f8ba-e142-4589-8206-5cd1a0e1ea01 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:51.661042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b399f8ba-e142-4589-8206-5cd1a0e1ea01 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:47:51.668645 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b399f8ba-e142-4589-8206-5cd1a0e1ea01 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1391 microversion: 2.1 time: 0.175617 May 27 15:47:51.669250 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3395/6805] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:47:51 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:47:52.687961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aebf00ee-bef0-4767-b6db-5f3c32e62f60 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:47:52.688657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-aebf00ee-bef0-4767-b6db-5f3c32e62f60 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:47:52.691215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:47:52.692053 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:47:52.700143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aebf00ee-bef0-4767-b6db-5f3c32e62f60 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:52.700744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aebf00ee-bef0-4767-b6db-5f3c32e62f60 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:52.701789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aebf00ee-bef0-4767-b6db-5f3c32e62f60 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:52.702242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aebf00ee-bef0-4767-b6db-5f3c32e62f60 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:52.845366 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-aebf00ee-bef0-4767-b6db-5f3c32e62f60 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:47:52.854098 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-aebf00ee-bef0-4767-b6db-5f3c32e62f60 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1391 microversion: 2.1 time: 0.170742 May 27 15:47:52.854667 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3411/6806] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:47:52 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:47:53.871747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-abda7fee-b8f6-49d0-b095-fc0fddea7074 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:47:53.872376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-abda7fee-b8f6-49d0-b095-fc0fddea7074 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:47:53.874336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:47:53.880757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-abda7fee-b8f6-49d0-b095-fc0fddea7074 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:53.881231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-abda7fee-b8f6-49d0-b095-fc0fddea7074 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:53.882023 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-abda7fee-b8f6-49d0-b095-fc0fddea7074 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:53.882486 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-abda7fee-b8f6-49d0-b095-fc0fddea7074 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:54.018019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-abda7fee-b8f6-49d0-b095-fc0fddea7074 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:47:54.025716 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-abda7fee-b8f6-49d0-b095-fc0fddea7074 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1563 microversion: 2.1 time: 0.158060 May 27 15:47:54.026292 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3396/6807] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:47:53 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:47:54.042386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-358a976b-5174-493c-9b43-8d1228ee555b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:47:54.043007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-358a976b-5174-493c-9b43-8d1228ee555b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:47:54.050033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-358a976b-5174-493c-9b43-8d1228ee555b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:54.050493 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-358a976b-5174-493c-9b43-8d1228ee555b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:54.051260 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-358a976b-5174-493c-9b43-8d1228ee555b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:54.051711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-358a976b-5174-493c-9b43-8d1228ee555b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:54.182928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-358a976b-5174-493c-9b43-8d1228ee555b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:47:54.191057 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-358a976b-5174-493c-9b43-8d1228ee555b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1563 microversion: 2.1 time: 0.152486 May 27 15:47:54.191636 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3412/6808] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:47:54 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:47:56.048866 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9cfd858d-48e3-4030-8f98-7797bfe25f6d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:47:56.049519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9cfd858d-48e3-4030-8f98-7797bfe25f6d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:47:56.051192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-a80b91c4-ba42-4253-a4dd-8bfc2d402740 req-f0467489-edac-47b8-bba7-0b41662bf829 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a937a0-cab9-4050-a4ad-8ba580c8a352", "tag": "8f72d5d1-4bc7-4783-9bfa-89166d6d41bd"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:47:56.056809 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cfd858d-48e3-4030-8f98-7797bfe25f6d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:56.057729 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cfd858d-48e3-4030-8f98-7797bfe25f6d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:56.058529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cfd858d-48e3-4030-8f98-7797bfe25f6d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:56.058989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9cfd858d-48e3-4030-8f98-7797bfe25f6d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:56.061374 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-a80b91c4-ba42-4253-a4dd-8bfc2d402740 req-f0467489-edac-47b8-bba7-0b41662bf829 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:47:56.062108 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-a80b91c4-ba42-4253-a4dd-8bfc2d402740 req-f0467489-edac-47b8-bba7-0b41662bf829 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:47:56.074691 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-a80b91c4-ba42-4253-a4dd-8bfc2d402740 req-f0467489-edac-47b8-bba7-0b41662bf829 service nova] Creating event network-changed:8f72d5d1-4bc7-4783-9bfa-89166d6d41bd for instance b2a937a0-cab9-4050-a4ad-8ba580c8a352 on n-h1-843621-1 May 27 15:47:56.079900 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-a80b91c4-ba42-4253-a4dd-8bfc2d402740 req-f0467489-edac-47b8-bba7-0b41662bf829 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033162 May 27 15:47:56.081309 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3413/6809] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:47:56.204516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9cfd858d-48e3-4030-8f98-7797bfe25f6d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:47:56.222945 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9cfd858d-48e3-4030-8f98-7797bfe25f6d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1563 microversion: 2.1 time: 0.178647 May 27 15:47:56.223973 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3397/6810] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:47:56 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:48:31.526074 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7a1a53c1-8983-492e-a273-da6583a83237 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:48:31.527099 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7a1a53c1-8983-492e-a273-da6583a83237 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:48:31.529546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:48:31.530208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=38 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:48:31.537096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a1a53c1-8983-492e-a273-da6583a83237 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:31.537565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a1a53c1-8983-492e-a273-da6583a83237 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:31.538386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a1a53c1-8983-492e-a273-da6583a83237 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:31.538840 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7a1a53c1-8983-492e-a273-da6583a83237 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:31.587573 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7a1a53c1-8983-492e-a273-da6583a83237 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352/action" status: 200 len: 24565 microversion: 2.1 time: 0.066407 May 27 15:48:31.588217 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3414/6811] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:48:31 2022] POST /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352/action => generated 24565 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:48:47.213903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-af9878b4-94e4-451c-bdf4-134a337d97cd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-146551788", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1197035446", "security_groups": [{"name": "tempest-secgroup-smoke-2103483646"}], "block_device_mapping_v2": [{"uuid": "8d11e012-66a1-47b7-9305-ec4f693abda8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8b1a4599-fc38-4529-b66a-d319c59ff383"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:48:47.222301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:48:47.222984 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=42 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:48:47.329989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-af9878b4-94e4-451c-bdf4-134a337d97cd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] validate_networks() for [('8b1a4599-fc38-4529-b66a-d319c59ff383', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:48:47.727627 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-af9878b4-94e4-451c-bdf4-134a337d97cd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:48:47.728086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-af9878b4-94e4-451c-bdf4-134a337d97cd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:48:47.728583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-af9878b4-94e4-451c-bdf4-134a337d97cd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:48:47.729047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-af9878b4-94e4-451c-bdf4-134a337d97cd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:48:47.729484 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-af9878b4-94e4-451c-bdf4-134a337d97cd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:48:47.739099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af9878b4-94e4-451c-bdf4-134a337d97cd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:47.739595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af9878b4-94e4-451c-bdf4-134a337d97cd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:47.740419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af9878b4-94e4-451c-bdf4-134a337d97cd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:47.740911 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-af9878b4-94e4-451c-bdf4-134a337d97cd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:47.763931 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-af9878b4-94e4-451c-bdf4-134a337d97cd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Getting quotas for project 536a3b9dd9a745c089e2da27b9f536ff. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:48:47.771844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-af9878b4-94e4-451c-bdf4-134a337d97cd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Getting quotas for user a058052ef3fd4ee58291ccc9837558cc and project 536a3b9dd9a745c089e2da27b9f536ff. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:48:47.831996 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-af9878b4-94e4-451c-bdf4-134a337d97cd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:48:47.834774 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-af9878b4-94e4-451c-bdf4-134a337d97cd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d11e012-66a1-47b7-9305-ec4f693abda8',volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:48:47.966834 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-af9878b4-94e4-451c-bdf4-134a337d97cd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.756861 May 27 15:48:47.967531 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3398/6812] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:48:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 15:48:47.978812 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-45096edf-46eb-4078-ac9e-2edaf850bcd2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:48:47.980171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-45096edf-46eb-4078-ac9e-2edaf850bcd2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:48:47.983311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:48:47.985164 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:48:48.045654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-45096edf-46eb-4078-ac9e-2edaf850bcd2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:48:48.055709 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-45096edf-46eb-4078-ac9e-2edaf850bcd2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1094 microversion: 2.1 time: 0.081332 May 27 15:48:48.057831 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3415/6813] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:48:47 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:48:49.077574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-38a8a2e2-d4f6-4a72-9a26-ef52a774002d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:48:49.078176 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-38a8a2e2-d4f6-4a72-9a26-ef52a774002d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:48:49.130855 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-38a8a2e2-d4f6-4a72-9a26-ef52a774002d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:48:49.137711 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-38a8a2e2-d4f6-4a72-9a26-ef52a774002d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1094 microversion: 2.1 time: 0.065586 May 27 15:48:49.138470 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3399/6814] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:48:49 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:48:50.156254 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2378e7e6-de53-4429-8b26-635b53b0c815 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:48:50.156906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2378e7e6-de53-4429-8b26-635b53b0c815 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:48:50.165744 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2378e7e6-de53-4429-8b26-635b53b0c815 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:50.166415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2378e7e6-de53-4429-8b26-635b53b0c815 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:50.167436 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2378e7e6-de53-4429-8b26-635b53b0c815 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:50.168129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2378e7e6-de53-4429-8b26-635b53b0c815 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:50.254293 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2378e7e6-de53-4429-8b26-635b53b0c815 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:48:50.263285 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2378e7e6-de53-4429-8b26-635b53b0c815 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1210 microversion: 2.1 time: 0.110853 May 27 15:48:50.264108 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3416/6815] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:48:50 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:48:51.285281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8015d2b2-be47-41a6-a193-50996c798a21 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:48:51.286464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8015d2b2-be47-41a6-a193-50996c798a21 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:48:51.299849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8015d2b2-be47-41a6-a193-50996c798a21 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:51.301217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8015d2b2-be47-41a6-a193-50996c798a21 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:51.303111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8015d2b2-be47-41a6-a193-50996c798a21 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:51.304037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8015d2b2-be47-41a6-a193-50996c798a21 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:51.501342 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8015d2b2-be47-41a6-a193-50996c798a21 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:48:51.513690 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8015d2b2-be47-41a6-a193-50996c798a21 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1278 microversion: 2.1 time: 0.235106 May 27 15:48:51.516119 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3400/6816] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:48:51 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1278 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:48:52.439379 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-ebb32e0c-334e-4009-9339-488b7deb4b2a req-9bc99bfd-eae3-4aee-842f-c3dd6c1cabd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b1af148-75b8-44ef-ae92-42b522336b03", "tag": "23b97feb-8bbb-4c52-bd4a-398c66cae1b0"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:48:52.452200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ebb32e0c-334e-4009-9339-488b7deb4b2a req-9bc99bfd-eae3-4aee-842f-c3dd6c1cabd2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:52.452721 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ebb32e0c-334e-4009-9339-488b7deb4b2a req-9bc99bfd-eae3-4aee-842f-c3dd6c1cabd2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:52.479945 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-ebb32e0c-334e-4009-9339-488b7deb4b2a req-9bc99bfd-eae3-4aee-842f-c3dd6c1cabd2 service nova] Creating event network-changed:23b97feb-8bbb-4c52-bd4a-398c66cae1b0 for instance 5b1af148-75b8-44ef-ae92-42b522336b03 on n-h1-843621-1 May 27 15:48:52.488283 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-ebb32e0c-334e-4009-9339-488b7deb4b2a req-9bc99bfd-eae3-4aee-842f-c3dd6c1cabd2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052428 May 27 15:48:52.490483 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3417/6817] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:48:52.534765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-650055e5-6451-4244-bad1-f1c7cfafc7b3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:48:52.535880 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-650055e5-6451-4244-bad1-f1c7cfafc7b3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:48:52.548824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-650055e5-6451-4244-bad1-f1c7cfafc7b3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:52.549471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-650055e5-6451-4244-bad1-f1c7cfafc7b3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:52.550301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-650055e5-6451-4244-bad1-f1c7cfafc7b3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:52.550767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-650055e5-6451-4244-bad1-f1c7cfafc7b3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:52.741774 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-650055e5-6451-4244-bad1-f1c7cfafc7b3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:48:52.749817 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-650055e5-6451-4244-bad1-f1c7cfafc7b3 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1278 microversion: 2.1 time: 0.221010 May 27 15:48:52.750403 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3401/6818] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:48:52 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1278 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:48:53.769089 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-93b8bfd4-2e73-4b92-b44c-38c007118032 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:48:53.769790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-93b8bfd4-2e73-4b92-b44c-38c007118032 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:48:53.776820 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93b8bfd4-2e73-4b92-b44c-38c007118032 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:53.777222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93b8bfd4-2e73-4b92-b44c-38c007118032 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:53.778016 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93b8bfd4-2e73-4b92-b44c-38c007118032 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:53.778460 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-93b8bfd4-2e73-4b92-b44c-38c007118032 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:53.913346 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-93b8bfd4-2e73-4b92-b44c-38c007118032 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:48:53.920857 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-93b8bfd4-2e73-4b92-b44c-38c007118032 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1278 microversion: 2.1 time: 0.157203 May 27 15:48:53.921460 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3418/6819] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:48:53 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:48:54.937615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1a142d07-bc4f-4469-9fd4-933b5cff2758 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:48:54.938294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1a142d07-bc4f-4469-9fd4-933b5cff2758 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:48:54.945376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a142d07-bc4f-4469-9fd4-933b5cff2758 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:54.945856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a142d07-bc4f-4469-9fd4-933b5cff2758 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:54.946657 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a142d07-bc4f-4469-9fd4-933b5cff2758 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:54.947122 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1a142d07-bc4f-4469-9fd4-933b5cff2758 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:55.082112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1a142d07-bc4f-4469-9fd4-933b5cff2758 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:48:55.090462 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1a142d07-bc4f-4469-9fd4-933b5cff2758 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1278 microversion: 2.1 time: 0.156726 May 27 15:48:55.091043 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3402/6820] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:48:54 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:48:56.107896 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-efe49ae3-3dcd-4f4c-a662-064e27935fe9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:48:56.108551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-efe49ae3-3dcd-4f4c-a662-064e27935fe9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:48:56.115970 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efe49ae3-3dcd-4f4c-a662-064e27935fe9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:56.116424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efe49ae3-3dcd-4f4c-a662-064e27935fe9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:56.117224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efe49ae3-3dcd-4f4c-a662-064e27935fe9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:56.117668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-efe49ae3-3dcd-4f4c-a662-064e27935fe9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:56.259043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-efe49ae3-3dcd-4f4c-a662-064e27935fe9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:48:56.268836 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-efe49ae3-3dcd-4f4c-a662-064e27935fe9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1278 microversion: 2.1 time: 0.164462 May 27 15:48:56.269666 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3419/6821] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:48:56 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:48:57.287265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bf45a9b9-38d4-43d2-ab23-a197622a8129 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:48:57.287937 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bf45a9b9-38d4-43d2-ab23-a197622a8129 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:48:57.295012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf45a9b9-38d4-43d2-ab23-a197622a8129 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:57.295481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf45a9b9-38d4-43d2-ab23-a197622a8129 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:57.296259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf45a9b9-38d4-43d2-ab23-a197622a8129 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:57.296741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf45a9b9-38d4-43d2-ab23-a197622a8129 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:57.433459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bf45a9b9-38d4-43d2-ab23-a197622a8129 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:48:57.441142 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bf45a9b9-38d4-43d2-ab23-a197622a8129 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1278 microversion: 2.1 time: 0.158344 May 27 15:48:57.441723 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3403/6822] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:48:57 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:48:58.457888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8063df15-64d5-4dd6-b50d-930ae6e00eb8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:48:58.458609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8063df15-64d5-4dd6-b50d-930ae6e00eb8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:48:58.462895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:48:58.468568 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8063df15-64d5-4dd6-b50d-930ae6e00eb8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:58.469143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8063df15-64d5-4dd6-b50d-930ae6e00eb8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:58.469924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8063df15-64d5-4dd6-b50d-930ae6e00eb8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:58.470370 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8063df15-64d5-4dd6-b50d-930ae6e00eb8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:58.612288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8063df15-64d5-4dd6-b50d-930ae6e00eb8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:48:58.621071 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8063df15-64d5-4dd6-b50d-930ae6e00eb8 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1278 microversion: 2.1 time: 0.166955 May 27 15:48:58.621696 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3420/6823] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:48:58 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:48:59.638398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fe0d20b7-38d8-43d8-9972-5b3a5b383694 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:48:59.639038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fe0d20b7-38d8-43d8-9972-5b3a5b383694 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:48:59.641230 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:48:59.643049 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=8 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:48:59.649962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fe0d20b7-38d8-43d8-9972-5b3a5b383694 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:59.650446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fe0d20b7-38d8-43d8-9972-5b3a5b383694 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:59.651246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fe0d20b7-38d8-43d8-9972-5b3a5b383694 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:48:59.651712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fe0d20b7-38d8-43d8-9972-5b3a5b383694 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:48:59.783893 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fe0d20b7-38d8-43d8-9972-5b3a5b383694 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:48:59.792309 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fe0d20b7-38d8-43d8-9972-5b3a5b383694 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1278 microversion: 2.1 time: 0.157935 May 27 15:48:59.792897 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3404/6824] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:48:59 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:00.808416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-58da38de-d8cd-4a8d-b5ec-ceb74ad026fa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:00.809001 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-58da38de-d8cd-4a8d-b5ec-ceb74ad026fa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:00.816131 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58da38de-d8cd-4a8d-b5ec-ceb74ad026fa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:00.816599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58da38de-d8cd-4a8d-b5ec-ceb74ad026fa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:00.817414 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58da38de-d8cd-4a8d-b5ec-ceb74ad026fa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:00.818380 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-58da38de-d8cd-4a8d-b5ec-ceb74ad026fa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:00.962711 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-58da38de-d8cd-4a8d-b5ec-ceb74ad026fa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:00.970341 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-58da38de-d8cd-4a8d-b5ec-ceb74ad026fa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1266 microversion: 2.1 time: 0.165998 May 27 15:49:00.970909 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3421/6825] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:00 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:01.987535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d45940f9-f388-466d-bc72-14fd0c948d73 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:01.988167 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d45940f9-f388-466d-bc72-14fd0c948d73 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:01.995227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d45940f9-f388-466d-bc72-14fd0c948d73 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:01.995719 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d45940f9-f388-466d-bc72-14fd0c948d73 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:01.996602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d45940f9-f388-466d-bc72-14fd0c948d73 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:01.997082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d45940f9-f388-466d-bc72-14fd0c948d73 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:02.134745 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d45940f9-f388-466d-bc72-14fd0c948d73 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:02.142858 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d45940f9-f388-466d-bc72-14fd0c948d73 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1266 microversion: 2.1 time: 0.159237 May 27 15:49:02.143440 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3405/6826] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:01 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:03.160266 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-03d3c619-1713-4676-b01a-eef49e6a4b85 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:03.160964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-03d3c619-1713-4676-b01a-eef49e6a4b85 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:03.167970 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03d3c619-1713-4676-b01a-eef49e6a4b85 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:03.168442 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03d3c619-1713-4676-b01a-eef49e6a4b85 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:03.169263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03d3c619-1713-4676-b01a-eef49e6a4b85 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:03.169716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03d3c619-1713-4676-b01a-eef49e6a4b85 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:03.332605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-03d3c619-1713-4676-b01a-eef49e6a4b85 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:03.340803 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-03d3c619-1713-4676-b01a-eef49e6a4b85 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1266 microversion: 2.1 time: 0.184439 May 27 15:49:03.341383 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3422/6827] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:03 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:04.359464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7884951c-7d9a-4d00-806b-432247823b24 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:04.360103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7884951c-7d9a-4d00-806b-432247823b24 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:04.367829 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7884951c-7d9a-4d00-806b-432247823b24 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:04.368298 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7884951c-7d9a-4d00-806b-432247823b24 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:04.369123 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7884951c-7d9a-4d00-806b-432247823b24 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:04.369583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7884951c-7d9a-4d00-806b-432247823b24 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:04.504261 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7884951c-7d9a-4d00-806b-432247823b24 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:04.512552 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7884951c-7d9a-4d00-806b-432247823b24 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1266 microversion: 2.1 time: 0.156953 May 27 15:49:04.513161 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3406/6828] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:04 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:05.530324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d17779f9-60bd-4d90-9163-bb649b87b46c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:05.530944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d17779f9-60bd-4d90-9163-bb649b87b46c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:05.537993 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d17779f9-60bd-4d90-9163-bb649b87b46c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:05.538455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d17779f9-60bd-4d90-9163-bb649b87b46c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:05.539222 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d17779f9-60bd-4d90-9163-bb649b87b46c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:05.539666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d17779f9-60bd-4d90-9163-bb649b87b46c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:05.671941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d17779f9-60bd-4d90-9163-bb649b87b46c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:05.680194 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d17779f9-60bd-4d90-9163-bb649b87b46c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1266 microversion: 2.1 time: 0.153743 May 27 15:49:05.680800 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3423/6829] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:05 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:06.697668 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0698e147-a836-441d-8edb-5edef30c6460 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:06.698294 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0698e147-a836-441d-8edb-5edef30c6460 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:06.705879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0698e147-a836-441d-8edb-5edef30c6460 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:06.706362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0698e147-a836-441d-8edb-5edef30c6460 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:06.707163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0698e147-a836-441d-8edb-5edef30c6460 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:06.707632 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0698e147-a836-441d-8edb-5edef30c6460 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:06.846605 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0698e147-a836-441d-8edb-5edef30c6460 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:06.855030 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0698e147-a836-441d-8edb-5edef30c6460 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1266 microversion: 2.1 time: 0.161285 May 27 15:49:06.855610 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3407/6830] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:06 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:07.871587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0bec4eaa-4cf0-4270-a461-2bccc5782ca9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:07.872238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0bec4eaa-4cf0-4270-a461-2bccc5782ca9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:07.879358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0bec4eaa-4cf0-4270-a461-2bccc5782ca9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:07.879816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0bec4eaa-4cf0-4270-a461-2bccc5782ca9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:07.880589 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0bec4eaa-4cf0-4270-a461-2bccc5782ca9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:07.881062 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0bec4eaa-4cf0-4270-a461-2bccc5782ca9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:08.019680 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0bec4eaa-4cf0-4270-a461-2bccc5782ca9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:08.027861 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0bec4eaa-4cf0-4270-a461-2bccc5782ca9 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1266 microversion: 2.1 time: 0.160142 May 27 15:49:08.028431 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3424/6831] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:07 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:09.045297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5529c7a2-5778-4aa9-b7a9-aab7a35b67aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:09.045933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5529c7a2-5778-4aa9-b7a9-aab7a35b67aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:09.052904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5529c7a2-5778-4aa9-b7a9-aab7a35b67aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:09.053383 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5529c7a2-5778-4aa9-b7a9-aab7a35b67aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:09.054828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5529c7a2-5778-4aa9-b7a9-aab7a35b67aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:09.055286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5529c7a2-5778-4aa9-b7a9-aab7a35b67aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:09.187904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5529c7a2-5778-4aa9-b7a9-aab7a35b67aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:09.195776 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5529c7a2-5778-4aa9-b7a9-aab7a35b67aa tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1266 microversion: 2.1 time: 0.154354 May 27 15:49:09.196392 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3408/6832] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:09 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:10.212910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1cb6006c-0272-468a-917f-0cb84d90e85b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:10.213546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1cb6006c-0272-468a-917f-0cb84d90e85b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:10.220581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1cb6006c-0272-468a-917f-0cb84d90e85b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:10.221079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1cb6006c-0272-468a-917f-0cb84d90e85b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:10.221864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1cb6006c-0272-468a-917f-0cb84d90e85b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:10.222309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1cb6006c-0272-468a-917f-0cb84d90e85b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:10.310271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cdedc648-9553-4586-a2e1-aa4c9cadf05b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:10.310822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cdedc648-9553-4586-a2e1-aa4c9cadf05b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:10.318672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cdedc648-9553-4586-a2e1-aa4c9cadf05b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:10.319184 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cdedc648-9553-4586-a2e1-aa4c9cadf05b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:10.320586 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cdedc648-9553-4586-a2e1-aa4c9cadf05b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:10.321107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cdedc648-9553-4586-a2e1-aa4c9cadf05b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:10.381620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1cb6006c-0272-468a-917f-0cb84d90e85b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:10.390220 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1cb6006c-0272-468a-917f-0cb84d90e85b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1266 microversion: 2.1 time: 0.181597 May 27 15:49:10.391033 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3425/6833] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:10 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:10.467667 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cdedc648-9553-4586-a2e1-aa4c9cadf05b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:10.475315 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cdedc648-9553-4586-a2e1-aa4c9cadf05b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1681 microversion: 2.1 time: 0.169101 May 27 15:49:10.476459 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3409/6834] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:10 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:49:10.570413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2491f4a0-858c-486f-996d-b5a21bae45af tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:49:10.571395 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2491f4a0-858c-486f-996d-b5a21bae45af tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:10.579671 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2491f4a0-858c-486f-996d-b5a21bae45af tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:10.580191 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2491f4a0-858c-486f-996d-b5a21bae45af tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:10.581013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2491f4a0-858c-486f-996d-b5a21bae45af tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:10.581463 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2491f4a0-858c-486f-996d-b5a21bae45af tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:10.637521 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2491f4a0-858c-486f-996d-b5a21bae45af tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352/action" status: 200 len: 32634 microversion: 2.1 time: 0.071493 May 27 15:49:10.638218 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3426/6835] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:49:10 2022] POST /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352/action => generated 32634 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:49:10.843841 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-37a0d977-def3-4259-a02b-db02212adcd3 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:10.844364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-37a0d977-def3-4259-a02b-db02212adcd3 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:10.850957 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-37a0d977-def3-4259-a02b-db02212adcd3 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:10.851425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-37a0d977-def3-4259-a02b-db02212adcd3 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:10.852228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-37a0d977-def3-4259-a02b-db02212adcd3 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:10.852756 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-37a0d977-def3-4259-a02b-db02212adcd3 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:10.983577 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-37a0d977-def3-4259-a02b-db02212adcd3 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1832 microversion: 2.1 time: 0.143320 May 27 15:49:10.983848 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3410/6836] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:10 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1832 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:11.000574 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7f4e79e9-da74-4bf9-ab53-964676c74f68 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:49:11.001837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7f4e79e9-da74-4bf9-ab53-964676c74f68 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:11.009696 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f4e79e9-da74-4bf9-ab53-964676c74f68 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:11.010161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f4e79e9-da74-4bf9-ab53-964676c74f68 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:11.010945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f4e79e9-da74-4bf9-ab53-964676c74f68 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:11.011398 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7f4e79e9-da74-4bf9-ab53-964676c74f68 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:11.037738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-7f4e79e9-da74-4bf9-ab53-964676c74f68 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lazy-loading 'flavor' on Instance uuid b2a937a0-cab9-4050-a4ad-8ba580c8a352 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:49:11.049950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7f4e79e9-da74-4bf9-ab53-964676c74f68 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Going to try to live migrate instance to another host {{(pid=119249) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 27 15:49:11.407574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-49da8b08-eb57-4d59-bc49-71d8d95aa8fd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:11.408578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-49da8b08-eb57-4d59-bc49-71d8d95aa8fd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:11.416828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-49da8b08-eb57-4d59-bc49-71d8d95aa8fd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:11.417363 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-49da8b08-eb57-4d59-bc49-71d8d95aa8fd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:11.418263 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-49da8b08-eb57-4d59-bc49-71d8d95aa8fd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:11.418717 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-49da8b08-eb57-4d59-bc49-71d8d95aa8fd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:11.564152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-49da8b08-eb57-4d59-bc49-71d8d95aa8fd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:11.573494 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-49da8b08-eb57-4d59-bc49-71d8d95aa8fd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1266 microversion: 2.1 time: 0.170077 May 27 15:49:11.574096 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3411/6837] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:11 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:11.718345 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-84d37f23-7348-4d49-8974-e195a5668e43 req-45b2c15b-8e6f-4303-bc74-78ea7527e9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b1af148-75b8-44ef-ae92-42b522336b03", "name": "network-vif-plugged", "status": "completed", "tag": "23b97feb-8bbb-4c52-bd4a-398c66cae1b0"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:49:11.728282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-84d37f23-7348-4d49-8974-e195a5668e43 req-45b2c15b-8e6f-4303-bc74-78ea7527e9a0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:11.729433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-84d37f23-7348-4d49-8974-e195a5668e43 req-45b2c15b-8e6f-4303-bc74-78ea7527e9a0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:11.742999 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-84d37f23-7348-4d49-8974-e195a5668e43 req-45b2c15b-8e6f-4303-bc74-78ea7527e9a0 service nova] Creating event network-vif-plugged:23b97feb-8bbb-4c52-bd4a-398c66cae1b0 for instance 5b1af148-75b8-44ef-ae92-42b522336b03 on n-h1-843621-1 May 27 15:49:11.748961 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-84d37f23-7348-4d49-8974-e195a5668e43 req-45b2c15b-8e6f-4303-bc74-78ea7527e9a0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034300 May 27 15:49:11.749988 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3412/6838] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:49:12.591532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9a7df20f-f63f-4f54-ada0-59232b67cf64 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:12.592266 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9a7df20f-f63f-4f54-ada0-59232b67cf64 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:12.600147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a7df20f-f63f-4f54-ada0-59232b67cf64 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:12.600630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a7df20f-f63f-4f54-ada0-59232b67cf64 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:12.601458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a7df20f-f63f-4f54-ada0-59232b67cf64 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:12.601920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9a7df20f-f63f-4f54-ada0-59232b67cf64 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:12.643903 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7f4e79e9-da74-4bf9-ab53-964676c74f68 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352/action" status: 202 len: 0 microversion: 2.1 time: 1.647349 May 27 15:49:12.644733 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3427/6839] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:49:10 2022] POST /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352/action => generated 0 bytes in 1649 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:49:12.652799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ea73522a-0cec-45de-b40b-dd9763b38722 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:12.653464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ea73522a-0cec-45de-b40b-dd9763b38722 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:12.660709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea73522a-0cec-45de-b40b-dd9763b38722 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:12.661173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea73522a-0cec-45de-b40b-dd9763b38722 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:12.661965 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea73522a-0cec-45de-b40b-dd9763b38722 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:12.662411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea73522a-0cec-45de-b40b-dd9763b38722 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:12.788565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9a7df20f-f63f-4f54-ada0-59232b67cf64 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:12.797147 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9a7df20f-f63f-4f54-ada0-59232b67cf64 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1266 microversion: 2.1 time: 0.209835 May 27 15:49:12.797752 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3413/6840] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:12 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:49:12.833430 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ea73522a-0cec-45de-b40b-dd9763b38722 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:12.841144 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ea73522a-0cec-45de-b40b-dd9763b38722 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1691 microversion: 2.1 time: 0.192273 May 27 15:49:12.841716 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3428/6841] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:12 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1691 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:49:13.814654 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d9857231-30fb-470d-9009-f4a9dd1754fe tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:13.815282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d9857231-30fb-470d-9009-f4a9dd1754fe tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:13.822672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d9857231-30fb-470d-9009-f4a9dd1754fe tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:13.823165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d9857231-30fb-470d-9009-f4a9dd1754fe tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:13.823953 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d9857231-30fb-470d-9009-f4a9dd1754fe tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:13.824412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d9857231-30fb-470d-9009-f4a9dd1754fe tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:13.859202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-11b81359-c729-47a0-b928-a6b0996b7bee tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:13.859829 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-11b81359-c729-47a0-b928-a6b0996b7bee tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:13.867142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11b81359-c729-47a0-b928-a6b0996b7bee tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:13.867605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11b81359-c729-47a0-b928-a6b0996b7bee tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:13.868394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11b81359-c729-47a0-b928-a6b0996b7bee tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:13.868874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-11b81359-c729-47a0-b928-a6b0996b7bee tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:14.123888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d9857231-30fb-470d-9009-f4a9dd1754fe tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:14.131983 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d9857231-30fb-470d-9009-f4a9dd1754fe tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1452 microversion: 2.1 time: 0.321231 May 27 15:49:14.132567 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3414/6842] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:13 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1452 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:14.144876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-11b81359-c729-47a0-b928-a6b0996b7bee tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:14.152768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-07e73f0a-3f31-46f8-8a57-c895b1ff7a3b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:14.153376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-07e73f0a-3f31-46f8-8a57-c895b1ff7a3b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:14.157480 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-11b81359-c729-47a0-b928-a6b0996b7bee tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1691 microversion: 2.1 time: 0.302026 May 27 15:49:14.158381 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3429/6843] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:13 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1691 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:49:14.159766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-07e73f0a-3f31-46f8-8a57-c895b1ff7a3b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:14.160260 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-07e73f0a-3f31-46f8-8a57-c895b1ff7a3b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:14.161090 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-07e73f0a-3f31-46f8-8a57-c895b1ff7a3b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:14.161554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-07e73f0a-3f31-46f8-8a57-c895b1ff7a3b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:14.404983 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-07e73f0a-3f31-46f8-8a57-c895b1ff7a3b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:14.417540 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-07e73f0a-3f31-46f8-8a57-c895b1ff7a3b tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1452 microversion: 2.1 time: 0.270055 May 27 15:49:14.418494 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3415/6844] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:14 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1452 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:49:14.425857 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-776d7da9-648e-468c-aa96-d8f0dd6911ff req-ce3201d7-ab9d-4f94-b101-b711d6a9c13d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a937a0-cab9-4050-a4ad-8ba580c8a352", "name": "network-vif-unplugged", "status": "completed", "tag": "8f72d5d1-4bc7-4783-9bfa-89166d6d41bd"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:49:14.435402 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-776d7da9-648e-468c-aa96-d8f0dd6911ff req-ce3201d7-ab9d-4f94-b101-b711d6a9c13d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:14.435861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-776d7da9-648e-468c-aa96-d8f0dd6911ff req-ce3201d7-ab9d-4f94-b101-b711d6a9c13d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:14.448424 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-776d7da9-648e-468c-aa96-d8f0dd6911ff req-ce3201d7-ab9d-4f94-b101-b711d6a9c13d service nova] Creating event network-vif-unplugged:8f72d5d1-4bc7-4783-9bfa-89166d6d41bd for instance b2a937a0-cab9-4050-a4ad-8ba580c8a352 on n-h1-843621-1 May 27 15:49:14.454176 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-776d7da9-648e-468c-aa96-d8f0dd6911ff req-ce3201d7-ab9d-4f94-b101-b711d6a9c13d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146205 May 27 15:49:14.454800 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3430/6845] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:49:15.178018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7c914a00-25a0-474e-8d46-4a7b0c0e5c8f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:15.180351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7c914a00-25a0-474e-8d46-4a7b0c0e5c8f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:15.192212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c914a00-25a0-474e-8d46-4a7b0c0e5c8f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:15.193973 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c914a00-25a0-474e-8d46-4a7b0c0e5c8f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:15.195997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c914a00-25a0-474e-8d46-4a7b0c0e5c8f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:15.196959 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7c914a00-25a0-474e-8d46-4a7b0c0e5c8f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:15.401326 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7c914a00-25a0-474e-8d46-4a7b0c0e5c8f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:15.404995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=100 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:49:15.410936 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7c914a00-25a0-474e-8d46-4a7b0c0e5c8f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1691 microversion: 2.1 time: 0.238826 May 27 15:49:15.411904 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3416/6846] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:15 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1691 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:16.430789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6813eab9-11b9-475a-8ff7-16dc1ecbfad4 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:16.431949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-bddbdacd-65e9-4df8-8b58-8f0b80544625 req-87b16a2b-1742-4b1a-946b-d99bbe434117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b1af148-75b8-44ef-ae92-42b522336b03", "tag": "23b97feb-8bbb-4c52-bd4a-398c66cae1b0"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:49:16.432683 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6813eab9-11b9-475a-8ff7-16dc1ecbfad4 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:16.441565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6813eab9-11b9-475a-8ff7-16dc1ecbfad4 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:16.442138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6813eab9-11b9-475a-8ff7-16dc1ecbfad4 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:16.442524 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-bddbdacd-65e9-4df8-8b58-8f0b80544625 req-87b16a2b-1742-4b1a-946b-d99bbe434117 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:16.442991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-bddbdacd-65e9-4df8-8b58-8f0b80544625 req-87b16a2b-1742-4b1a-946b-d99bbe434117 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:16.443624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6813eab9-11b9-475a-8ff7-16dc1ecbfad4 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:16.444079 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6813eab9-11b9-475a-8ff7-16dc1ecbfad4 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:16.455504 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-bddbdacd-65e9-4df8-8b58-8f0b80544625 req-87b16a2b-1742-4b1a-946b-d99bbe434117 service nova] Creating event network-changed:23b97feb-8bbb-4c52-bd4a-398c66cae1b0 for instance 5b1af148-75b8-44ef-ae92-42b522336b03 on n-h1-843621-1 May 27 15:49:16.461616 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-bddbdacd-65e9-4df8-8b58-8f0b80544625 req-87b16a2b-1742-4b1a-946b-d99bbe434117 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033243 May 27 15:49:16.462226 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3417/6847] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:49:16.478270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-32509f83-ee60-4855-8e6e-9c804c43d9c9 req-aadd0804-adff-41ab-bbf4-c3f7e2eb662c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a937a0-cab9-4050-a4ad-8ba580c8a352", "tag": "8f72d5d1-4bc7-4783-9bfa-89166d6d41bd"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:49:16.487095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-32509f83-ee60-4855-8e6e-9c804c43d9c9 req-aadd0804-adff-41ab-bbf4-c3f7e2eb662c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:16.487558 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-32509f83-ee60-4855-8e6e-9c804c43d9c9 req-aadd0804-adff-41ab-bbf4-c3f7e2eb662c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:16.499907 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-32509f83-ee60-4855-8e6e-9c804c43d9c9 req-aadd0804-adff-41ab-bbf4-c3f7e2eb662c service nova] Creating event network-changed:8f72d5d1-4bc7-4783-9bfa-89166d6d41bd for instance b2a937a0-cab9-4050-a4ad-8ba580c8a352 on n-h1-843621-1 May 27 15:49:16.506275 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-32509f83-ee60-4855-8e6e-9c804c43d9c9 req-aadd0804-adff-41ab-bbf4-c3f7e2eb662c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031973 May 27 15:49:16.507700 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3418/6848] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:49:16.606752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6813eab9-11b9-475a-8ff7-16dc1ecbfad4 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:16.616430 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6813eab9-11b9-475a-8ff7-16dc1ecbfad4 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1691 microversion: 2.1 time: 0.190468 May 27 15:49:16.617600 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3431/6849] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:16 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1691 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:17.635741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f414b496-7325-4be7-8dd1-8a5796f30af7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:17.636464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f414b496-7325-4be7-8dd1-8a5796f30af7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:17.638691 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:49:17.645149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f414b496-7325-4be7-8dd1-8a5796f30af7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:17.645620 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f414b496-7325-4be7-8dd1-8a5796f30af7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:17.646422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f414b496-7325-4be7-8dd1-8a5796f30af7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:17.646875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f414b496-7325-4be7-8dd1-8a5796f30af7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:17.805951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f414b496-7325-4be7-8dd1-8a5796f30af7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:17.813579 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f414b496-7325-4be7-8dd1-8a5796f30af7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1691 microversion: 2.1 time: 0.183442 May 27 15:49:17.814150 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3419/6850] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:17 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1691 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:18.830852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-46265056-bb79-4525-821d-f34aa4f15842 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:18.831388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-46265056-bb79-4525-821d-f34aa4f15842 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:18.834148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=39 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:49:18.839911 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-46265056-bb79-4525-821d-f34aa4f15842 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:18.840375 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-46265056-bb79-4525-821d-f34aa4f15842 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:18.841256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-46265056-bb79-4525-821d-f34aa4f15842 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:18.841688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-46265056-bb79-4525-821d-f34aa4f15842 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:18.844358 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:49:18.985622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-46265056-bb79-4525-821d-f34aa4f15842 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:18.994005 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-46265056-bb79-4525-821d-f34aa4f15842 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1691 microversion: 2.1 time: 0.167048 May 27 15:49:18.994564 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3432/6851] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:18 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:49:20.012275 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-34629bb4-e73e-4740-a4ef-0ee40fa71238 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:20.012930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-34629bb4-e73e-4740-a4ef-0ee40fa71238 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:20.020150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34629bb4-e73e-4740-a4ef-0ee40fa71238 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:20.020616 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34629bb4-e73e-4740-a4ef-0ee40fa71238 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:20.021428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34629bb4-e73e-4740-a4ef-0ee40fa71238 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:20.021887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-34629bb4-e73e-4740-a4ef-0ee40fa71238 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:20.156097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-34629bb4-e73e-4740-a4ef-0ee40fa71238 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:20.164199 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-34629bb4-e73e-4740-a4ef-0ee40fa71238 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1691 microversion: 2.1 time: 0.156483 May 27 15:49:20.164792 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3420/6852] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:20 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:20.503920 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-474d403d-39d9-477f-9056-aa28fdc80183 req-46457a35-77e9-47f7-b959-0bc3d2fc3a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a937a0-cab9-4050-a4ad-8ba580c8a352", "name": "network-vif-unplugged", "status": "completed", "tag": "8f72d5d1-4bc7-4783-9bfa-89166d6d41bd"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:49:20.513292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-474d403d-39d9-477f-9056-aa28fdc80183 req-46457a35-77e9-47f7-b959-0bc3d2fc3a18 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:20.513940 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-474d403d-39d9-477f-9056-aa28fdc80183 req-46457a35-77e9-47f7-b959-0bc3d2fc3a18 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:20.526164 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-474d403d-39d9-477f-9056-aa28fdc80183 req-46457a35-77e9-47f7-b959-0bc3d2fc3a18 service nova] Creating event network-vif-unplugged:8f72d5d1-4bc7-4783-9bfa-89166d6d41bd for instance b2a937a0-cab9-4050-a4ad-8ba580c8a352 on n-h1-843621-1 May 27 15:49:20.531971 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-474d403d-39d9-477f-9056-aa28fdc80183 req-46457a35-77e9-47f7-b959-0bc3d2fc3a18 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031827 May 27 15:49:20.532752 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3433/6853] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:49:21.182637 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d8772dbd-43ca-4b1f-a98b-3907bfd70da1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:21.183323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d8772dbd-43ca-4b1f-a98b-3907bfd70da1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:21.190614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8772dbd-43ca-4b1f-a98b-3907bfd70da1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:21.191119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8772dbd-43ca-4b1f-a98b-3907bfd70da1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:21.191913 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8772dbd-43ca-4b1f-a98b-3907bfd70da1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:21.192390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d8772dbd-43ca-4b1f-a98b-3907bfd70da1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:21.386843 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d8772dbd-43ca-4b1f-a98b-3907bfd70da1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:21.394727 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d8772dbd-43ca-4b1f-a98b-3907bfd70da1 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1691 microversion: 2.1 time: 0.216103 May 27 15:49:21.395306 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3421/6854] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:21 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1691 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:22.413635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-632d463b-01fa-4a65-89d5-bea8dbeced0f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:22.414349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-632d463b-01fa-4a65-89d5-bea8dbeced0f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:22.421283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-632d463b-01fa-4a65-89d5-bea8dbeced0f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:22.421741 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-632d463b-01fa-4a65-89d5-bea8dbeced0f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:22.422649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-632d463b-01fa-4a65-89d5-bea8dbeced0f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:22.422964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-632d463b-01fa-4a65-89d5-bea8dbeced0f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:22.563228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-632d463b-01fa-4a65-89d5-bea8dbeced0f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:22.570977 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-632d463b-01fa-4a65-89d5-bea8dbeced0f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1681 microversion: 2.1 time: 0.162549 May 27 15:49:22.571563 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3434/6855] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:22 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:22.587146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c3157f05-8eca-46f8-9226-f7660b2fa856 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:22.587951 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c3157f05-8eca-46f8-9226-f7660b2fa856 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:22.594689 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3157f05-8eca-46f8-9226-f7660b2fa856 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:22.595159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3157f05-8eca-46f8-9226-f7660b2fa856 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:22.595942 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3157f05-8eca-46f8-9226-f7660b2fa856 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:22.596429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c3157f05-8eca-46f8-9226-f7660b2fa856 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:22.739123 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c3157f05-8eca-46f8-9226-f7660b2fa856 tempest-TestNetworkAdvancedServerOps-1749707435 tempest-TestNetworkAdvancedServerOps-1749707435-project-admin] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1832 microversion: 2.1 time: 0.155608 May 27 15:49:22.740115 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3422/6856] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:22 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1832 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:22.756064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fe9b8d66-b8bf-478e-8ff1-6f481683ad35 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:22.756664 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fe9b8d66-b8bf-478e-8ff1-6f481683ad35 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:22.763376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe9b8d66-b8bf-478e-8ff1-6f481683ad35 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:22.763838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe9b8d66-b8bf-478e-8ff1-6f481683ad35 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:22.764620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe9b8d66-b8bf-478e-8ff1-6f481683ad35 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:22.765090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fe9b8d66-b8bf-478e-8ff1-6f481683ad35 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:22.899056 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fe9b8d66-b8bf-478e-8ff1-6f481683ad35 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:22.907267 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fe9b8d66-b8bf-478e-8ff1-6f481683ad35 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1681 microversion: 2.1 time: 0.155282 May 27 15:49:22.907836 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3435/6857] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:22 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:22.999257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-73655ef1-c366-48fb-902a-3a8bcbe647a5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:49:23.000231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-73655ef1-c366-48fb-902a-3a8bcbe647a5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:23.006415 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73655ef1-c366-48fb-902a-3a8bcbe647a5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:23.006818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73655ef1-c366-48fb-902a-3a8bcbe647a5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:23.007596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73655ef1-c366-48fb-902a-3a8bcbe647a5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:23.008051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-73655ef1-c366-48fb-902a-3a8bcbe647a5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:23.057236 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-73655ef1-c366-48fb-902a-3a8bcbe647a5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352/action" status: 200 len: 38387 microversion: 2.1 time: 0.061742 May 27 15:49:23.057906 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3423/6858] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:49:22 2022] POST /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352/action => generated 38387 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:49:24.056898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-64a7cd12-43a9-4c3a-afc8-1bb86a3efcec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:24.057437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-64a7cd12-43a9-4c3a-afc8-1bb86a3efcec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:24.057596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-da17f103-9d55-44c4-ad1d-eb35a56de437 req-434a7107-0814-4308-997e-33828bbc1944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a937a0-cab9-4050-a4ad-8ba580c8a352", "tag": "8f72d5d1-4bc7-4783-9bfa-89166d6d41bd"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:49:24.064811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64a7cd12-43a9-4c3a-afc8-1bb86a3efcec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:24.065367 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64a7cd12-43a9-4c3a-afc8-1bb86a3efcec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:24.066245 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64a7cd12-43a9-4c3a-afc8-1bb86a3efcec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:24.066770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64a7cd12-43a9-4c3a-afc8-1bb86a3efcec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:24.068743 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-da17f103-9d55-44c4-ad1d-eb35a56de437 req-434a7107-0814-4308-997e-33828bbc1944 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:24.069214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-da17f103-9d55-44c4-ad1d-eb35a56de437 req-434a7107-0814-4308-997e-33828bbc1944 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:24.081338 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-da17f103-9d55-44c4-ad1d-eb35a56de437 req-434a7107-0814-4308-997e-33828bbc1944 service nova] Creating event network-changed:8f72d5d1-4bc7-4783-9bfa-89166d6d41bd for instance b2a937a0-cab9-4050-a4ad-8ba580c8a352 on n-h2-843621-1 May 27 15:49:24.086682 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-da17f103-9d55-44c4-ad1d-eb35a56de437 req-434a7107-0814-4308-997e-33828bbc1944 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034035 May 27 15:49:24.087991 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3424/6859] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:49:24.094378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-64a7cd12-43a9-4c3a-afc8-1bb86a3efcec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:49:24.184024 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-64a7cd12-43a9-4c3a-afc8-1bb86a3efcec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 204 len: 0 microversion: 2.1 time: 0.131177 May 27 15:49:24.188637 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3436/6860] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:49:24 2022] DELETE /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:49:24.195042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-903d4a52-588f-45e6-9cad-f727aa9fb529 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:24.195766 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-903d4a52-588f-45e6-9cad-f727aa9fb529 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:24.203241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-903d4a52-588f-45e6-9cad-f727aa9fb529 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:24.203708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-903d4a52-588f-45e6-9cad-f727aa9fb529 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:24.204744 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-903d4a52-588f-45e6-9cad-f727aa9fb529 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:24.205209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-903d4a52-588f-45e6-9cad-f727aa9fb529 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:24.409774 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-903d4a52-588f-45e6-9cad-f727aa9fb529 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:24.421921 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-903d4a52-588f-45e6-9cad-f727aa9fb529 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 200 len: 1687 microversion: 2.1 time: 0.231249 May 27 15:49:24.423781 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3425/6861] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:24 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 1687 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:25.225142 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-1ad8864d-4e51-40c8-b4c7-7d6d80d83999 req-4348e115-20c1-4859-908d-4ea18fa6c5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a937a0-cab9-4050-a4ad-8ba580c8a352", "name": "network-vif-deleted", "tag": "8f72d5d1-4bc7-4783-9bfa-89166d6d41bd"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:49:25.236709 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-1ad8864d-4e51-40c8-b4c7-7d6d80d83999 req-4348e115-20c1-4859-908d-4ea18fa6c5d4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:25.237258 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-1ad8864d-4e51-40c8-b4c7-7d6d80d83999 req-4348e115-20c1-4859-908d-4ea18fa6c5d4 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:25.253142 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-1ad8864d-4e51-40c8-b4c7-7d6d80d83999 req-4348e115-20c1-4859-908d-4ea18fa6c5d4 service nova] Creating event network-vif-deleted:8f72d5d1-4bc7-4783-9bfa-89166d6d41bd for instance b2a937a0-cab9-4050-a4ad-8ba580c8a352 on n-h2-843621-1 May 27 15:49:25.261056 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-1ad8864d-4e51-40c8-b4c7-7d6d80d83999 req-4348e115-20c1-4859-908d-4ea18fa6c5d4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039643 May 27 15:49:25.261686 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3437/6862] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:49:25.439887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-482ca427-279a-4005-8fba-b5ba82257240 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:25.441407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-482ca427-279a-4005-8fba-b5ba82257240 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: b2a937a0-cab9-4050-a4ad-8ba580c8a352] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:25.448879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-482ca427-279a-4005-8fba-b5ba82257240 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:25.449411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-482ca427-279a-4005-8fba-b5ba82257240 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:25.450285 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-482ca427-279a-4005-8fba-b5ba82257240 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:25.450875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-482ca427-279a-4005-8fba-b5ba82257240 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:25.467144 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-482ca427-279a-4005-8fba-b5ba82257240 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] HTTP exception thrown: Instance b2a937a0-cab9-4050-a4ad-8ba580c8a352 could not be found. May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-482ca427-279a-4005-8fba-b5ba82257240 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Request method failure captured: May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 HTTP/1.1 May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikPE8HKsBFVmDjnurTK4MmS5qV_xRSU-M7F4Wkd_TzQv2GmcoU1aDqk4cUYKxa-vX6YTiuiSIkKiSvKPFRD8cWehUx9Pm5FcQMK-uoH6NmDsBRqEpYqdKyByRTnQFvK6M-nxSszSM8yHouf7ypqvuFHP-I4lMAC05OHG2zCrZxHLPq0k May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 3255afe7ba134153bcbe682b574e7803 May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-126916587 May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3255afe7ba134153bcbe682b574e7803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3255afe7ba134153bcbe682b574e7803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3255afe7ba134153bcbe682b574e7803"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3255afe7ba134153bcbe682b574e7803", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-TestNetworkAdvancedServerOps-126916587 May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 3255afe7ba134153bcbe682b574e7803 May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-126916587 May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-TestNetworkAdvancedServerOps-126916587-project May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 499fa1ef3ed047a8a92c7a23be43c8f0 May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-TestNetworkAdvancedServerOps-126916587-project May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance b2a937a0-cab9-4050-a4ad-8ba580c8a352 could not be found. May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'b2a937a0-cab9-4050-a4ad-8ba580c8a352'} May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a937a0-cab9-4050-a4ad-8ba580c8a352 could not be found. May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a937a0-cab9-4050-a4ad-8ba580c8a352 could not be found. May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:49:25.469031 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:49:25.475890 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:49:25.475890 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:49:25.475890 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:49:25.475890 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:49:25.475890 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:49:25.475890 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a937a0-cab9-4050-a4ad-8ba580c8a352 could not be found. May 27 15:49:25.475890 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:49:25.475890 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-482ca427-279a-4005-8fba-b5ba82257240 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Returning 404 to user: Instance b2a937a0-cab9-4050-a4ad-8ba580c8a352 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:49:25.475890 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-482ca427-279a-4005-8fba-b5ba82257240 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352" status: 404 len: 111 microversion: 2.1 time: 0.035389 May 27 15:49:25.475890 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3426/6863] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:25 2022] GET /compute/v2.1/servers/b2a937a0-cab9-4050-a4ad-8ba580c8a352 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:49:29.080567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2bc2300b-fa5e-4e36-8588-4b8729a9cd77 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '.version_select at 0x7fc775a18280>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:29.102154 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2bc2300b-fa5e-4e36-8588-4b8729a9cd77 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1199849774" status: 202 len: 0 microversion: 2.1 time: 0.025777 May 27 15:49:29.102662 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3438/6864] 10.222.0.13 () {58 vars in 1283 bytes} [Fri May 27 15:49:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1199849774 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:49:29.132781 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2cd79cff-171a-4716-a4a6-4291a513e08e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'create', calling method: .version_select at 0x7fc775586160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-42877908", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQrwCwDxqm+6rNSBW10H1/uu+jh82N4V8MAUb9DC9trKj7MCewol9BfZUFmD5Qsdf7nNkGeNHPg1g3CZ2uFD/0Wo7f2l2TG6PxbdwUNQ8XGCWgfXS/5N9LMqKK8pIT64Q=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:49:29.150671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-2cd79cff-171a-4716-a4a6-4291a513e08e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Getting quotas for project 3255afe7ba134153bcbe682b574e7803. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:49:29.157586 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-2cd79cff-171a-4716-a4a6-4291a513e08e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Getting quotas for user 499fa1ef3ed047a8a92c7a23be43c8f0 and project 3255afe7ba134153bcbe682b574e7803. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:49:29.183373 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2cd79cff-171a-4716-a4a6-4291a513e08e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.054592 May 27 15:49:29.184201 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3427/6865] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:49:29 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:49:34.892870 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e1f81618-bce7-4fd8-93f9-56c9a01ab8de tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-472475897", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "1f1fe812-7b2b-427f-94a0-e94ced332b8b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-42877908", "security_groups": [{"name": "tempest-secgroup-smoke-1266608265"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:49:35.244039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:49:35.298808 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-e1f81618-bce7-4fd8-93f9-56c9a01ab8de tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] validate_networks() for [('1f1fe812-7b2b-427f-94a0-e94ced332b8b', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:49:35.836221 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-e1f81618-bce7-4fd8-93f9-56c9a01ab8de tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:49:35.836656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-e1f81618-bce7-4fd8-93f9-56c9a01ab8de tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:49:35.837703 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-e1f81618-bce7-4fd8-93f9-56c9a01ab8de tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:49:35.838118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-e1f81618-bce7-4fd8-93f9-56c9a01ab8de tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:49:35.838719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-e1f81618-bce7-4fd8-93f9-56c9a01ab8de tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:49:35.848957 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1f81618-bce7-4fd8-93f9-56c9a01ab8de tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:35.849787 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1f81618-bce7-4fd8-93f9-56c9a01ab8de tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:35.850757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1f81618-bce7-4fd8-93f9-56c9a01ab8de tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:35.851205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e1f81618-bce7-4fd8-93f9-56c9a01ab8de tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:35.873304 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-e1f81618-bce7-4fd8-93f9-56c9a01ab8de tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Getting quotas for project 3255afe7ba134153bcbe682b574e7803. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:49:35.878936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-e1f81618-bce7-4fd8-93f9-56c9a01ab8de tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Getting quotas for user 499fa1ef3ed047a8a92c7a23be43c8f0 and project 3255afe7ba134153bcbe682b574e7803. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:49:35.893746 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e1f81618-bce7-4fd8-93f9-56c9a01ab8de tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:49:35.896354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e1f81618-bce7-4fd8-93f9-56c9a01ab8de tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:49:35.946098 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e1f81618-bce7-4fd8-93f9-56c9a01ab8de tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.058588 May 27 15:49:35.947945 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3439/6866] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:49:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:49:35.956502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=42 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:49:35.960909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-575066d4-b929-43a4-98f0-37f18101c73b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:35.961714 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-575066d4-b929-43a4-98f0-37f18101c73b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:36.067385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-575066d4-b929-43a4-98f0-37f18101c73b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:36.078187 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-575066d4-b929-43a4-98f0-37f18101c73b tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1264 microversion: 2.1 time: 0.123388 May 27 15:49:36.078874 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3428/6867] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:35 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1264 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:37.100480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2211d774-9631-4a43-9899-c5238e78d317 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:37.105685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2211d774-9631-4a43-9899-c5238e78d317 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:37.122192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2211d774-9631-4a43-9899-c5238e78d317 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:37.122743 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2211d774-9631-4a43-9899-c5238e78d317 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:37.123673 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2211d774-9631-4a43-9899-c5238e78d317 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:37.124597 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2211d774-9631-4a43-9899-c5238e78d317 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:37.228807 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2211d774-9631-4a43-9899-c5238e78d317 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:37.238604 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2211d774-9631-4a43-9899-c5238e78d317 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1324 microversion: 2.1 time: 0.145036 May 27 15:49:37.239807 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3440/6868] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:37 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1324 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:38.258509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2ba5a148-f663-4759-aa79-cbc99b048040 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:38.260318 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2ba5a148-f663-4759-aa79-cbc99b048040 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:38.272727 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ba5a148-f663-4759-aa79-cbc99b048040 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:38.275131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ba5a148-f663-4759-aa79-cbc99b048040 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:38.276520 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ba5a148-f663-4759-aa79-cbc99b048040 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:38.277008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2ba5a148-f663-4759-aa79-cbc99b048040 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:38.438488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2ba5a148-f663-4759-aa79-cbc99b048040 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:38.447349 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2ba5a148-f663-4759-aa79-cbc99b048040 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1390 microversion: 2.1 time: 0.192334 May 27 15:49:38.447945 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3429/6869] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:38 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1390 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:38.708959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-650d381c-642a-4663-96fc-d4067f9a3cea req-ba113355-ce65-485e-a926-df21a7118ffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54e46111-b443-4094-8c6c-ea49bd06aa43", "tag": "0936c0b2-b488-46c1-8fd2-6f24e7d42f7c"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:49:38.738105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-650d381c-642a-4663-96fc-d4067f9a3cea req-ba113355-ce65-485e-a926-df21a7118ffc service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:38.738861 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-650d381c-642a-4663-96fc-d4067f9a3cea req-ba113355-ce65-485e-a926-df21a7118ffc service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:38.754680 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-650d381c-642a-4663-96fc-d4067f9a3cea req-ba113355-ce65-485e-a926-df21a7118ffc service nova] Creating event network-changed:0936c0b2-b488-46c1-8fd2-6f24e7d42f7c for instance 54e46111-b443-4094-8c6c-ea49bd06aa43 on n-h1-843621-1 May 27 15:49:38.762263 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-650d381c-642a-4663-96fc-d4067f9a3cea req-ba113355-ce65-485e-a926-df21a7118ffc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056878 May 27 15:49:38.763592 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3441/6870] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:49:39.465722 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-44fe5f47-5dc1-47af-9719-85ac1c875b66 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:39.466280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-44fe5f47-5dc1-47af-9719-85ac1c875b66 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:39.473560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44fe5f47-5dc1-47af-9719-85ac1c875b66 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:39.474065 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44fe5f47-5dc1-47af-9719-85ac1c875b66 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:39.474854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44fe5f47-5dc1-47af-9719-85ac1c875b66 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:39.475324 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-44fe5f47-5dc1-47af-9719-85ac1c875b66 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:39.617694 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-44fe5f47-5dc1-47af-9719-85ac1c875b66 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:39.625957 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-44fe5f47-5dc1-47af-9719-85ac1c875b66 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1390 microversion: 2.1 time: 0.164850 May 27 15:49:39.626754 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3430/6871] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:39 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:40.646326 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2ad69087-8d13-4ef1-bcc1-ec06a8500d26 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:40.647089 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2ad69087-8d13-4ef1-bcc1-ec06a8500d26 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:40.654182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2ad69087-8d13-4ef1-bcc1-ec06a8500d26 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:40.654655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2ad69087-8d13-4ef1-bcc1-ec06a8500d26 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:40.655452 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2ad69087-8d13-4ef1-bcc1-ec06a8500d26 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:40.655891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2ad69087-8d13-4ef1-bcc1-ec06a8500d26 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:40.804011 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2ad69087-8d13-4ef1-bcc1-ec06a8500d26 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:40.812553 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2ad69087-8d13-4ef1-bcc1-ec06a8500d26 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1390 microversion: 2.1 time: 0.171645 May 27 15:49:40.813122 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3442/6872] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:40 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:41.832632 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-99001af8-a035-4ce8-a358-cceb6ba876cc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:41.833446 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-99001af8-a035-4ce8-a358-cceb6ba876cc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:41.851309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99001af8-a035-4ce8-a358-cceb6ba876cc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:41.851964 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99001af8-a035-4ce8-a358-cceb6ba876cc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:41.852865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99001af8-a035-4ce8-a358-cceb6ba876cc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:41.854030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-99001af8-a035-4ce8-a358-cceb6ba876cc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:41.991450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-99001af8-a035-4ce8-a358-cceb6ba876cc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:41.999328 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-99001af8-a035-4ce8-a358-cceb6ba876cc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1390 microversion: 2.1 time: 0.173146 May 27 15:49:41.999920 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3431/6873] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:41 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:49:43.015714 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cb95f42a-a3b9-4497-8d8f-213ec5be902e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:43.016526 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cb95f42a-a3b9-4497-8d8f-213ec5be902e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:43.023544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cb95f42a-a3b9-4497-8d8f-213ec5be902e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:43.024007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cb95f42a-a3b9-4497-8d8f-213ec5be902e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:43.024803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cb95f42a-a3b9-4497-8d8f-213ec5be902e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:43.025763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cb95f42a-a3b9-4497-8d8f-213ec5be902e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:43.156380 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cb95f42a-a3b9-4497-8d8f-213ec5be902e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:43.163936 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cb95f42a-a3b9-4497-8d8f-213ec5be902e tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1390 microversion: 2.1 time: 0.152284 May 27 15:49:43.164507 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3443/6874] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:43 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:43.781397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-ac0a7937-0d9c-477f-96bd-886dd7ef8bbe req-0b7ef21e-6553-407b-8112-047fe7903058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54e46111-b443-4094-8c6c-ea49bd06aa43", "name": "network-vif-plugged", "status": "completed", "tag": "0936c0b2-b488-46c1-8fd2-6f24e7d42f7c"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:49:43.791872 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-ac0a7937-0d9c-477f-96bd-886dd7ef8bbe req-0b7ef21e-6553-407b-8112-047fe7903058 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:43.792419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-ac0a7937-0d9c-477f-96bd-886dd7ef8bbe req-0b7ef21e-6553-407b-8112-047fe7903058 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:43.804844 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-ac0a7937-0d9c-477f-96bd-886dd7ef8bbe req-0b7ef21e-6553-407b-8112-047fe7903058 service nova] Creating event network-vif-plugged:0936c0b2-b488-46c1-8fd2-6f24e7d42f7c for instance 54e46111-b443-4094-8c6c-ea49bd06aa43 on n-h1-843621-1 May 27 15:49:43.810738 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-ac0a7937-0d9c-477f-96bd-886dd7ef8bbe req-0b7ef21e-6553-407b-8112-047fe7903058 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033105 May 27 15:49:43.811339 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3432/6875] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:49:44.182338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5fc115db-c478-4fd1-aef8-7cc6f3334ae5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:44.182867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5fc115db-c478-4fd1-aef8-7cc6f3334ae5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:44.189876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fc115db-c478-4fd1-aef8-7cc6f3334ae5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:44.190338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fc115db-c478-4fd1-aef8-7cc6f3334ae5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:44.191110 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fc115db-c478-4fd1-aef8-7cc6f3334ae5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:44.191557 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5fc115db-c478-4fd1-aef8-7cc6f3334ae5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:44.325941 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5fc115db-c478-4fd1-aef8-7cc6f3334ae5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:44.333784 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5fc115db-c478-4fd1-aef8-7cc6f3334ae5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1390 microversion: 2.1 time: 0.155912 May 27 15:49:44.334317 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3444/6876] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:44 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:45.352475 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-456961af-4b06-410e-bbb7-e45a1f76fcfe tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:45.353257 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-456961af-4b06-410e-bbb7-e45a1f76fcfe tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:45.361182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-456961af-4b06-410e-bbb7-e45a1f76fcfe tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:45.362152 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-456961af-4b06-410e-bbb7-e45a1f76fcfe tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:45.363089 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-456961af-4b06-410e-bbb7-e45a1f76fcfe tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:45.363559 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-456961af-4b06-410e-bbb7-e45a1f76fcfe tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:45.495482 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-456961af-4b06-410e-bbb7-e45a1f76fcfe tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:45.503193 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-456961af-4b06-410e-bbb7-e45a1f76fcfe tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1561 microversion: 2.1 time: 0.156020 May 27 15:49:45.503772 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3433/6877] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:45 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:45.520296 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7e2a91f7-de33-4b8e-9ed4-2a57fdbc62f9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:45.520889 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7e2a91f7-de33-4b8e-9ed4-2a57fdbc62f9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:45.528096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e2a91f7-de33-4b8e-9ed4-2a57fdbc62f9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:45.528549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e2a91f7-de33-4b8e-9ed4-2a57fdbc62f9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:45.529338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e2a91f7-de33-4b8e-9ed4-2a57fdbc62f9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:45.529811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7e2a91f7-de33-4b8e-9ed4-2a57fdbc62f9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:45.663945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7e2a91f7-de33-4b8e-9ed4-2a57fdbc62f9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:45.673241 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7e2a91f7-de33-4b8e-9ed4-2a57fdbc62f9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1561 microversion: 2.1 time: 0.157140 May 27 15:49:45.673826 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3445/6878] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:45 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:49:47.293612 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ca5e7f63-f52b-4f9b-a355-58ebcbe24919 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:49:47.295090 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ca5e7f63-f52b-4f9b-a355-58ebcbe24919 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:49:47.296694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-933b2b1a-fb11-45f3-9fa8-ec256a2333d7 req-395a243a-5fb8-4f45-ae66-102a1e92e023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54e46111-b443-4094-8c6c-ea49bd06aa43", "tag": "0936c0b2-b488-46c1-8fd2-6f24e7d42f7c"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:49:47.301458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:49:47.303669 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:49:47.304440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:49:47.305636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca5e7f63-f52b-4f9b-a355-58ebcbe24919 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:47.307204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca5e7f63-f52b-4f9b-a355-58ebcbe24919 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:47.308405 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca5e7f63-f52b-4f9b-a355-58ebcbe24919 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:47.309253 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ca5e7f63-f52b-4f9b-a355-58ebcbe24919 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:47.309501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-933b2b1a-fb11-45f3-9fa8-ec256a2333d7 req-395a243a-5fb8-4f45-ae66-102a1e92e023 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:49:47.310045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-933b2b1a-fb11-45f3-9fa8-ec256a2333d7 req-395a243a-5fb8-4f45-ae66-102a1e92e023 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:49:47.330309 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-933b2b1a-fb11-45f3-9fa8-ec256a2333d7 req-395a243a-5fb8-4f45-ae66-102a1e92e023 service nova] Creating event network-changed:0936c0b2-b488-46c1-8fd2-6f24e7d42f7c for instance 54e46111-b443-4094-8c6c-ea49bd06aa43 on n-h1-843621-1 May 27 15:49:47.336293 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-933b2b1a-fb11-45f3-9fa8-ec256a2333d7 req-395a243a-5fb8-4f45-ae66-102a1e92e023 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044417 May 27 15:49:47.337050 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3446/6879] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:49:47.461576 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ca5e7f63-f52b-4f9b-a355-58ebcbe24919 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:49:47.470402 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ca5e7f63-f52b-4f9b-a355-58ebcbe24919 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1561 microversion: 2.1 time: 0.182874 May 27 15:49:47.471080 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3434/6880] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:49:47 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1561 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:50:24.790285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:50:24.791111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=36 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:50:24.795306 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d0e4b7e0-9bed-44eb-a826-4f04178545dc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:50:24.796310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d0e4b7e0-9bed-44eb-a826-4f04178545dc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:50:24.803462 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d0e4b7e0-9bed-44eb-a826-4f04178545dc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:50:24.803917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d0e4b7e0-9bed-44eb-a826-4f04178545dc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:50:24.804692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d0e4b7e0-9bed-44eb-a826-4f04178545dc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:50:24.805156 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d0e4b7e0-9bed-44eb-a826-4f04178545dc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:50:24.854967 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d0e4b7e0-9bed-44eb-a826-4f04178545dc tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43/action" status: 200 len: 24562 microversion: 2.1 time: 0.067198 May 27 15:50:24.855921 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3447/6881] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:50:24 2022] POST /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43/action => generated 24562 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:50:58.191109 n-d-843621-1 devstack@n-api.service[119248]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c1a6c103-78d1-418b-834c-c2adf4156fe8] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 27 15:50:58.191900 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:50:58.192943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=32 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:50:58.195468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-ff10adf3-b45e-4521-bb4f-20c7ae21c8e6 req-de1a6bc3-ae4e-416a-8cac-f21078d8c898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b1af148-75b8-44ef-ae92-42b522336b03", "tag": "23b97feb-8bbb-4c52-bd4a-398c66cae1b0"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:50:58.197406 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-556f9cb8-77e5-4e1f-828f-a0035b1587c1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:50:58.198502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-556f9cb8-77e5-4e1f-828f-a0035b1587c1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:50:58.200975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:50:58.201895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:50:58.206916 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-556f9cb8-77e5-4e1f-828f-a0035b1587c1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:50:58.207390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-556f9cb8-77e5-4e1f-828f-a0035b1587c1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:50:58.208529 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ff10adf3-b45e-4521-bb4f-20c7ae21c8e6 req-de1a6bc3-ae4e-416a-8cac-f21078d8c898 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:50:58.208836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-556f9cb8-77e5-4e1f-828f-a0035b1587c1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:50:58.209163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-ff10adf3-b45e-4521-bb4f-20c7ae21c8e6 req-de1a6bc3-ae4e-416a-8cac-f21078d8c898 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:50:58.209287 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-556f9cb8-77e5-4e1f-828f-a0035b1587c1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:50:58.224626 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-ff10adf3-b45e-4521-bb4f-20c7ae21c8e6 req-de1a6bc3-ae4e-416a-8cac-f21078d8c898 service nova] Creating event network-changed:23b97feb-8bbb-4c52-bd4a-398c66cae1b0 for instance 5b1af148-75b8-44ef-ae92-42b522336b03 on n-h1-843621-1 May 27 15:50:58.230332 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-ff10adf3-b45e-4521-bb4f-20c7ae21c8e6 req-de1a6bc3-ae4e-416a-8cac-f21078d8c898 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039110 May 27 15:50:58.231180 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3448/6882] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:50:58.241440 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-556f9cb8-77e5-4e1f-828f-a0035b1587c1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:50:58.326260 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-556f9cb8-77e5-4e1f-828f-a0035b1587c1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 204 len: 0 microversion: 2.1 time: 0.137296 May 27 15:50:58.331811 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3435/6883] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:50:58 2022] DELETE /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:50:58.339192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-34b818e8-42fa-45ee-b170-fbe18aa27ee7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:50:58.339908 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-34b818e8-42fa-45ee-b170-fbe18aa27ee7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:50:58.347703 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-34b818e8-42fa-45ee-b170-fbe18aa27ee7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:50:58.348067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-34b818e8-42fa-45ee-b170-fbe18aa27ee7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:50:58.348888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-34b818e8-42fa-45ee-b170-fbe18aa27ee7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:50:58.349342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-34b818e8-42fa-45ee-b170-fbe18aa27ee7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:50:58.490573 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-34b818e8-42fa-45ee-b170-fbe18aa27ee7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:50:58.498407 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-34b818e8-42fa-45ee-b170-fbe18aa27ee7 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1577 microversion: 2.1 time: 0.164671 May 27 15:50:58.498987 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3449/6884] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:50:58 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:50:59.516097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-745acf8f-9114-4b1f-90d6-ffe90035119c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:50:59.517214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-745acf8f-9114-4b1f-90d6-ffe90035119c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:50:59.531392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-745acf8f-9114-4b1f-90d6-ffe90035119c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:50:59.531868 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-745acf8f-9114-4b1f-90d6-ffe90035119c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:50:59.532691 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-745acf8f-9114-4b1f-90d6-ffe90035119c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:50:59.533169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-745acf8f-9114-4b1f-90d6-ffe90035119c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:50:59.533928 n-d-843621-1 devstack@n-api.service[119248]: INFO oslo.messaging._drivers.impl_rabbit [-] [c1a6c103-78d1-418b-834c-c2adf4156fe8] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 43684. May 27 15:50:59.667988 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-745acf8f-9114-4b1f-90d6-ffe90035119c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:50:59.676351 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-745acf8f-9114-4b1f-90d6-ffe90035119c tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1577 microversion: 2.1 time: 0.164649 May 27 15:50:59.676964 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3436/6885] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:50:59 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:00.554647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-13089cb2-b6d6-4960-8836-07773e3b4c1f req-a63de4e9-cd16-46f7-b260-d5bc552d6e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b1af148-75b8-44ef-ae92-42b522336b03", "name": "network-vif-deleted", "tag": "23b97feb-8bbb-4c52-bd4a-398c66cae1b0"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:51:00.563646 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-13089cb2-b6d6-4960-8836-07773e3b4c1f req-a63de4e9-cd16-46f7-b260-d5bc552d6e6f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:00.564107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-13089cb2-b6d6-4960-8836-07773e3b4c1f req-a63de4e9-cd16-46f7-b260-d5bc552d6e6f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:00.576774 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-13089cb2-b6d6-4960-8836-07773e3b4c1f req-a63de4e9-cd16-46f7-b260-d5bc552d6e6f service nova] Creating event network-vif-deleted:23b97feb-8bbb-4c52-bd4a-398c66cae1b0 for instance 5b1af148-75b8-44ef-ae92-42b522336b03 on n-h1-843621-1 May 27 15:51:00.581549 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-13089cb2-b6d6-4960-8836-07773e3b4c1f req-a63de4e9-cd16-46f7-b260-d5bc552d6e6f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030760 May 27 15:51:00.582153 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3450/6886] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:51:00.694456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-693f2ff5-9e3f-4de6-8731-2d17440aa6ef tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:00.695221 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-693f2ff5-9e3f-4de6-8731-2d17440aa6ef tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:00.703341 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-693f2ff5-9e3f-4de6-8731-2d17440aa6ef tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:00.703835 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-693f2ff5-9e3f-4de6-8731-2d17440aa6ef tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:00.704631 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-693f2ff5-9e3f-4de6-8731-2d17440aa6ef tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:00.705127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-693f2ff5-9e3f-4de6-8731-2d17440aa6ef tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:00.769212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-693f2ff5-9e3f-4de6-8731-2d17440aa6ef tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:00.776996 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-693f2ff5-9e3f-4de6-8731-2d17440aa6ef tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1225 microversion: 2.1 time: 0.086588 May 27 15:51:00.777653 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3437/6887] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:00 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:01.795367 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3bbe1fae-e95d-4fed-b22a-93dcccaeafcc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:01.796044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3bbe1fae-e95d-4fed-b22a-93dcccaeafcc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:01.802399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3bbe1fae-e95d-4fed-b22a-93dcccaeafcc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:01.802854 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3bbe1fae-e95d-4fed-b22a-93dcccaeafcc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:01.803618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3bbe1fae-e95d-4fed-b22a-93dcccaeafcc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:01.804059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3bbe1fae-e95d-4fed-b22a-93dcccaeafcc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:01.867657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3bbe1fae-e95d-4fed-b22a-93dcccaeafcc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:01.875999 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3bbe1fae-e95d-4fed-b22a-93dcccaeafcc tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1225 microversion: 2.1 time: 0.085854 May 27 15:51:01.876581 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3451/6888] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:01 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:02.897467 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b199780a-8072-41f5-b02e-33288318d9d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:02.898411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b199780a-8072-41f5-b02e-33288318d9d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:02.906459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b199780a-8072-41f5-b02e-33288318d9d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:02.906936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b199780a-8072-41f5-b02e-33288318d9d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:02.907738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b199780a-8072-41f5-b02e-33288318d9d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:02.908203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b199780a-8072-41f5-b02e-33288318d9d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:02.980452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b199780a-8072-41f5-b02e-33288318d9d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:02.989160 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b199780a-8072-41f5-b02e-33288318d9d1 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1225 microversion: 2.1 time: 0.100112 May 27 15:51:02.989764 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3438/6889] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:02 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:03.997179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-64a1da80-834c-4666-bb21-1c91dc7dfd95 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "346e776e-8931-417f-87da-575810efb12b"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:51:03.998690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-64a1da80-834c-4666-bb21-1c91dc7dfd95 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:04.005837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2bd9ff40-23fd-4b8b-8e26-ddcb9c6df632 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:04.006397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64a1da80-834c-4666-bb21-1c91dc7dfd95 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:04.006518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2bd9ff40-23fd-4b8b-8e26-ddcb9c6df632 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:04.006612 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64a1da80-834c-4666-bb21-1c91dc7dfd95 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:04.007301 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64a1da80-834c-4666-bb21-1c91dc7dfd95 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:04.007742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64a1da80-834c-4666-bb21-1c91dc7dfd95 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:04.014934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bd9ff40-23fd-4b8b-8e26-ddcb9c6df632 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:04.015499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bd9ff40-23fd-4b8b-8e26-ddcb9c6df632 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:04.016383 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bd9ff40-23fd-4b8b-8e26-ddcb9c6df632 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:04.017251 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bd9ff40-23fd-4b8b-8e26-ddcb9c6df632 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:04.093823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2bd9ff40-23fd-4b8b-8e26-ddcb9c6df632 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:04.097882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-64a1da80-834c-4666-bb21-1c91dc7dfd95 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:51:04.098323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-64a1da80-834c-4666-bb21-1c91dc7dfd95 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:51:04.098811 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-64a1da80-834c-4666-bb21-1c91dc7dfd95 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:51:04.099228 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-64a1da80-834c-4666-bb21-1c91dc7dfd95 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:51:04.099651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-64a1da80-834c-4666-bb21-1c91dc7dfd95 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:51:04.103215 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2bd9ff40-23fd-4b8b-8e26-ddcb9c6df632 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1225 microversion: 2.1 time: 0.101348 May 27 15:51:04.104211 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3439/6890] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:04 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:51:04.178104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-64a1da80-834c-4666-bb21-1c91dc7dfd95 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:04.185499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64a1da80-834c-4666-bb21-1c91dc7dfd95 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:04.185992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64a1da80-834c-4666-bb21-1c91dc7dfd95 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:04.186905 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64a1da80-834c-4666-bb21-1c91dc7dfd95 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:04.187376 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-64a1da80-834c-4666-bb21-1c91dc7dfd95 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:04.221244 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-64a1da80-834c-4666-bb21-1c91dc7dfd95 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43/action" status: 202 len: 1136 microversion: 2.1 time: 0.228340 May 27 15:51:04.231145 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3452/6891] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:51:03 2022] POST /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43/action => generated 1136 bytes in 230 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 27 15:51:04.236217 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eb3946c7-bf99-41c4-ba90-f9e431168500 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:04.236891 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-eb3946c7-bf99-41c4-ba90-f9e431168500 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:04.244119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb3946c7-bf99-41c4-ba90-f9e431168500 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:04.244119 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb3946c7-bf99-41c4-ba90-f9e431168500 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:04.245013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb3946c7-bf99-41c4-ba90-f9e431168500 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:04.245481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eb3946c7-bf99-41c4-ba90-f9e431168500 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:04.423604 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-eb3946c7-bf99-41c4-ba90-f9e431168500 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:04.431258 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-eb3946c7-bf99-41c4-ba90-f9e431168500 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1689 microversion: 2.1 time: 0.198935 May 27 15:51:04.432131 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3440/6892] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:04 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1689 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:05.123491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-36e5a72f-3c2e-4abe-a01d-9196c3c3c6f6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:05.124148 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-36e5a72f-3c2e-4abe-a01d-9196c3c3c6f6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:05.131153 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36e5a72f-3c2e-4abe-a01d-9196c3c3c6f6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:05.131620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36e5a72f-3c2e-4abe-a01d-9196c3c3c6f6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:05.132396 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36e5a72f-3c2e-4abe-a01d-9196c3c3c6f6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:05.132879 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-36e5a72f-3c2e-4abe-a01d-9196c3c3c6f6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:05.198225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-36e5a72f-3c2e-4abe-a01d-9196c3c3c6f6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:05.206731 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-36e5a72f-3c2e-4abe-a01d-9196c3c3c6f6 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1225 microversion: 2.1 time: 0.087051 May 27 15:51:05.207668 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3453/6893] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:05 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:05.449410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7f2a5d24-94e0-4c7e-867d-6932f75c7b00 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:05.450000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7f2a5d24-94e0-4c7e-867d-6932f75c7b00 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:05.456915 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f2a5d24-94e0-4c7e-867d-6932f75c7b00 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:05.457372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f2a5d24-94e0-4c7e-867d-6932f75c7b00 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:05.458150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f2a5d24-94e0-4c7e-867d-6932f75c7b00 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:05.458604 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7f2a5d24-94e0-4c7e-867d-6932f75c7b00 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:05.595794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7f2a5d24-94e0-4c7e-867d-6932f75c7b00 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:05.604699 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7f2a5d24-94e0-4c7e-867d-6932f75c7b00 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1689 microversion: 2.1 time: 0.159284 May 27 15:51:05.605472 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3441/6894] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:05 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:06.224367 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-57c804e8-6a43-4998-9344-d69070f8e610 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:06.225044 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-57c804e8-6a43-4998-9344-d69070f8e610 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:06.239043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57c804e8-6a43-4998-9344-d69070f8e610 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:06.239565 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57c804e8-6a43-4998-9344-d69070f8e610 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:06.240351 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57c804e8-6a43-4998-9344-d69070f8e610 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:06.240822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57c804e8-6a43-4998-9344-d69070f8e610 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:06.307119 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-57c804e8-6a43-4998-9344-d69070f8e610 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:06.322249 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-57c804e8-6a43-4998-9344-d69070f8e610 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1225 microversion: 2.1 time: 0.101840 May 27 15:51:06.322847 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3454/6895] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:06 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:06.623145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3e99c1f6-4c2d-41ba-8403-1a06697106c9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:06.623829 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3e99c1f6-4c2d-41ba-8403-1a06697106c9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:06.631683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e99c1f6-4c2d-41ba-8403-1a06697106c9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:06.632163 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e99c1f6-4c2d-41ba-8403-1a06697106c9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:06.633011 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e99c1f6-4c2d-41ba-8403-1a06697106c9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:06.633510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3e99c1f6-4c2d-41ba-8403-1a06697106c9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:06.774985 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3e99c1f6-4c2d-41ba-8403-1a06697106c9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:06.783797 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3e99c1f6-4c2d-41ba-8403-1a06697106c9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1689 microversion: 2.1 time: 0.166087 May 27 15:51:06.784397 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3442/6896] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:06 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:07.339120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a00c9e44-121b-43a3-8a5c-4035a469a7dd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:07.340054 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a00c9e44-121b-43a3-8a5c-4035a469a7dd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:07.355577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a00c9e44-121b-43a3-8a5c-4035a469a7dd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:07.355577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a00c9e44-121b-43a3-8a5c-4035a469a7dd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:07.355577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a00c9e44-121b-43a3-8a5c-4035a469a7dd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:07.355577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a00c9e44-121b-43a3-8a5c-4035a469a7dd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:07.419824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a00c9e44-121b-43a3-8a5c-4035a469a7dd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:07.427839 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a00c9e44-121b-43a3-8a5c-4035a469a7dd tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1225 microversion: 2.1 time: 0.092788 May 27 15:51:07.428417 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3455/6897] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:07 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:07.801264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-00fa06e6-5d2e-4f8f-9185-f850098c68d7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:07.802070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-00fa06e6-5d2e-4f8f-9185-f850098c68d7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:07.809640 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-00fa06e6-5d2e-4f8f-9185-f850098c68d7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:07.810114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-00fa06e6-5d2e-4f8f-9185-f850098c68d7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:07.810904 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-00fa06e6-5d2e-4f8f-9185-f850098c68d7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:07.811362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-00fa06e6-5d2e-4f8f-9185-f850098c68d7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:07.944843 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-00fa06e6-5d2e-4f8f-9185-f850098c68d7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:07.952850 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-00fa06e6-5d2e-4f8f-9185-f850098c68d7 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1689 microversion: 2.1 time: 0.155512 May 27 15:51:07.953545 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3443/6898] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:07 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:08.445267 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1c500bf4-3a07-45d0-a106-7a7a08edb990 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:08.445891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1c500bf4-3a07-45d0-a106-7a7a08edb990 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:08.453034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c500bf4-3a07-45d0-a106-7a7a08edb990 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:08.453501 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c500bf4-3a07-45d0-a106-7a7a08edb990 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:08.454294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c500bf4-3a07-45d0-a106-7a7a08edb990 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:08.454746 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c500bf4-3a07-45d0-a106-7a7a08edb990 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:08.523837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1c500bf4-3a07-45d0-a106-7a7a08edb990 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:08.532331 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1c500bf4-3a07-45d0-a106-7a7a08edb990 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1225 microversion: 2.1 time: 0.090984 May 27 15:51:08.532943 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3456/6899] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:08 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:08.970143 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b01bda49-bb1b-4e84-aa82-0ac3098f38f2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:08.970783 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b01bda49-bb1b-4e84-aa82-0ac3098f38f2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:08.978196 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b01bda49-bb1b-4e84-aa82-0ac3098f38f2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:08.978678 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b01bda49-bb1b-4e84-aa82-0ac3098f38f2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:08.979479 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b01bda49-bb1b-4e84-aa82-0ac3098f38f2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:08.979944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b01bda49-bb1b-4e84-aa82-0ac3098f38f2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:09.115482 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b01bda49-bb1b-4e84-aa82-0ac3098f38f2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:09.123722 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b01bda49-bb1b-4e84-aa82-0ac3098f38f2 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1689 microversion: 2.1 time: 0.157764 May 27 15:51:09.124613 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3444/6900] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:08 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:09.550015 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-255c2fcf-7c55-4632-a49b-d1a97f8d3a86 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:09.550614 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-255c2fcf-7c55-4632-a49b-d1a97f8d3a86 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:09.558034 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-255c2fcf-7c55-4632-a49b-d1a97f8d3a86 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:09.558496 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-255c2fcf-7c55-4632-a49b-d1a97f8d3a86 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:09.560000 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-255c2fcf-7c55-4632-a49b-d1a97f8d3a86 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:09.560694 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-255c2fcf-7c55-4632-a49b-d1a97f8d3a86 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:09.627958 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-255c2fcf-7c55-4632-a49b-d1a97f8d3a86 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:09.635549 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-255c2fcf-7c55-4632-a49b-d1a97f8d3a86 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 200 len: 1225 microversion: 2.1 time: 0.089474 May 27 15:51:09.636139 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3457/6901] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:09 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:10.141309 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-52896deb-b926-4f39-a63a-7507ace67436 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:10.142210 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-52896deb-b926-4f39-a63a-7507ace67436 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:10.149441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-52896deb-b926-4f39-a63a-7507ace67436 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:10.149916 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-52896deb-b926-4f39-a63a-7507ace67436 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:10.150712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-52896deb-b926-4f39-a63a-7507ace67436 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:10.151170 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-52896deb-b926-4f39-a63a-7507ace67436 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:10.289531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-52896deb-b926-4f39-a63a-7507ace67436 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:10.297158 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-52896deb-b926-4f39-a63a-7507ace67436 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1689 microversion: 2.1 time: 0.160311 May 27 15:51:10.297745 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3445/6902] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:10 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:10.653333 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f7d5b2c3-548d-466f-980a-f96cece5c9b2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:10.653988 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f7d5b2c3-548d-466f-980a-f96cece5c9b2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: 5b1af148-75b8-44ef-ae92-42b522336b03] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:10.661525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f7d5b2c3-548d-466f-980a-f96cece5c9b2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:10.661985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f7d5b2c3-548d-466f-980a-f96cece5c9b2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:10.662790 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f7d5b2c3-548d-466f-980a-f96cece5c9b2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:10.663233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f7d5b2c3-548d-466f-980a-f96cece5c9b2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:10.676893 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-f7d5b2c3-548d-466f-980a-f96cece5c9b2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] HTTP exception thrown: Instance 5b1af148-75b8-44ef-ae92-42b522336b03 could not be found. May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f7d5b2c3-548d-466f-980a-f96cece5c9b2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Request method failure captured: May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 HTTP/1.1 May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikO_1Chjp-7OdQPlgoy0i68J74Yy9denIkk1niNkSk2uFWUy4CftwGV6LxM4FCEGakqUTp0mkulJ5awBDUhVVOjGCfP23UpxiQizq-3BPePUyAFyMxEgrT5T05iojcJbMyfNSyzYbX68HBU5apXXyE_-yRBe0ARJTHso9aoG2B7TFtpc May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_536a3b9dd9a745c089e2da27b9f536ff", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TestVolumeBootPattern-685942222 May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TestVolumeBootPattern-685942222-project May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: a058052ef3fd4ee58291ccc9837558cc May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TestVolumeBootPattern-685942222-project May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 5b1af148-75b8-44ef-ae92-42b522336b03 could not be found. May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '5b1af148-75b8-44ef-ae92-42b522336b03'} May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b1af148-75b8-44ef-ae92-42b522336b03 could not be found. May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b1af148-75b8-44ef-ae92-42b522336b03 could not be found. May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:51:10.678610 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:51:10.683234 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:51:10.683234 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:51:10.683234 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:51:10.683234 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:51:10.683234 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:51:10.683234 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b1af148-75b8-44ef-ae92-42b522336b03 could not be found. May 27 15:51:10.683234 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:51:10.683234 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f7d5b2c3-548d-466f-980a-f96cece5c9b2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Returning 404 to user: Instance 5b1af148-75b8-44ef-ae92-42b522336b03 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:51:10.683234 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f7d5b2c3-548d-466f-980a-f96cece5c9b2 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03" status: 404 len: 111 microversion: 2.1 time: 0.030722 May 27 15:51:10.683234 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3458/6903] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:10 2022] GET /compute/v2.1/servers/5b1af148-75b8-44ef-ae92-42b522336b03 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:51:11.315595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f3cb540d-554b-4b78-8338-4de3eec08cb9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:11.316246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f3cb540d-554b-4b78-8338-4de3eec08cb9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:11.323283 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f3cb540d-554b-4b78-8338-4de3eec08cb9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:11.323759 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f3cb540d-554b-4b78-8338-4de3eec08cb9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:11.324550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f3cb540d-554b-4b78-8338-4de3eec08cb9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:11.325041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f3cb540d-554b-4b78-8338-4de3eec08cb9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:11.469239 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f3cb540d-554b-4b78-8338-4de3eec08cb9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:11.477029 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f3cb540d-554b-4b78-8338-4de3eec08cb9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1689 microversion: 2.1 time: 0.166001 May 27 15:51:11.477604 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3446/6904] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:11 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:12.495884 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-af214db4-c0c5-4f1a-9bca-97632d95beb9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:12.497087 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-af214db4-c0c5-4f1a-9bca-97632d95beb9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:12.504605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af214db4-c0c5-4f1a-9bca-97632d95beb9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:12.505094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af214db4-c0c5-4f1a-9bca-97632d95beb9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:12.505898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af214db4-c0c5-4f1a-9bca-97632d95beb9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:12.506347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-af214db4-c0c5-4f1a-9bca-97632d95beb9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:12.664319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-af214db4-c0c5-4f1a-9bca-97632d95beb9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:12.672765 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-af214db4-c0c5-4f1a-9bca-97632d95beb9 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1689 microversion: 2.1 time: 0.181046 May 27 15:51:12.673345 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3459/6905] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:12 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:13.690339 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b9344c24-2918-4c70-861f-40da73fa3434 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:13.691002 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b9344c24-2918-4c70-861f-40da73fa3434 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:13.698012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9344c24-2918-4c70-861f-40da73fa3434 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:13.698484 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9344c24-2918-4c70-861f-40da73fa3434 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:13.699282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9344c24-2918-4c70-861f-40da73fa3434 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:13.699748 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b9344c24-2918-4c70-861f-40da73fa3434 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:13.837371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b9344c24-2918-4c70-861f-40da73fa3434 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:13.846353 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b9344c24-2918-4c70-861f-40da73fa3434 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1689 microversion: 2.1 time: 0.159938 May 27 15:51:13.847150 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3447/6906] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:13 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:14.863489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e38729dc-6f60-475c-bc7d-394417b298df tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:14.864244 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e38729dc-6f60-475c-bc7d-394417b298df tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:14.871344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e38729dc-6f60-475c-bc7d-394417b298df tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:14.871822 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e38729dc-6f60-475c-bc7d-394417b298df tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:14.872576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e38729dc-6f60-475c-bc7d-394417b298df tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:14.873045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e38729dc-6f60-475c-bc7d-394417b298df tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:15.014536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e38729dc-6f60-475c-bc7d-394417b298df tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:15.023287 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e38729dc-6f60-475c-bc7d-394417b298df tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1689 microversion: 2.1 time: 0.163660 May 27 15:51:15.023874 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3460/6907] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:14 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:16.042547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6e80c404-a2f0-4f7f-88d5-f068bc888335 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:16.044680 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6e80c404-a2f0-4f7f-88d5-f068bc888335 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:16.060394 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6e80c404-a2f0-4f7f-88d5-f068bc888335 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:16.061155 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6e80c404-a2f0-4f7f-88d5-f068bc888335 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:16.062224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6e80c404-a2f0-4f7f-88d5-f068bc888335 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:16.062923 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6e80c404-a2f0-4f7f-88d5-f068bc888335 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:16.263712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6e80c404-a2f0-4f7f-88d5-f068bc888335 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:16.273610 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6e80c404-a2f0-4f7f-88d5-f068bc888335 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1689 microversion: 2.1 time: 0.236307 May 27 15:51:16.275662 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3448/6908] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:16 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1689 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:17.292708 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-445e3f06-485d-4c0c-be9e-311c28f4b18a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:17.293323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-445e3f06-485d-4c0c-be9e-311c28f4b18a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:17.300887 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-445e3f06-485d-4c0c-be9e-311c28f4b18a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:17.301368 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-445e3f06-485d-4c0c-be9e-311c28f4b18a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:17.302132 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-445e3f06-485d-4c0c-be9e-311c28f4b18a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:17.302575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-445e3f06-485d-4c0c-be9e-311c28f4b18a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:17.449726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-445e3f06-485d-4c0c-be9e-311c28f4b18a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:17.458261 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-445e3f06-485d-4c0c-be9e-311c28f4b18a tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1695 microversion: 2.1 time: 0.169505 May 27 15:51:17.458967 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3461/6909] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:17 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:18.476318 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4f7a5a7a-ff76-42c2-913c-d1549aa9d4b8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:18.476930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4f7a5a7a-ff76-42c2-913c-d1549aa9d4b8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:18.484963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4f7a5a7a-ff76-42c2-913c-d1549aa9d4b8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:18.485434 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4f7a5a7a-ff76-42c2-913c-d1549aa9d4b8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:18.486240 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4f7a5a7a-ff76-42c2-913c-d1549aa9d4b8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:18.486699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4f7a5a7a-ff76-42c2-913c-d1549aa9d4b8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:18.635519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4f7a5a7a-ff76-42c2-913c-d1549aa9d4b8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:18.639091 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:51:18.644695 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4f7a5a7a-ff76-42c2-913c-d1549aa9d4b8 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1695 microversion: 2.1 time: 0.172599 May 27 15:51:18.645277 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3449/6910] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:18 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:19.662482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-985ed6ac-1c13-49e8-b995-5abc063581ec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:19.663097 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-985ed6ac-1c13-49e8-b995-5abc063581ec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:19.672062 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-985ed6ac-1c13-49e8-b995-5abc063581ec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:19.672519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-985ed6ac-1c13-49e8-b995-5abc063581ec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:19.673327 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-985ed6ac-1c13-49e8-b995-5abc063581ec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:19.673771 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-985ed6ac-1c13-49e8-b995-5abc063581ec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:19.814256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-985ed6ac-1c13-49e8-b995-5abc063581ec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:19.822766 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-985ed6ac-1c13-49e8-b995-5abc063581ec tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1695 microversion: 2.1 time: 0.164142 May 27 15:51:19.823459 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3462/6911] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:19 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:20.122622 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cb487dee-4236-4c94-ba54-34a787e98807 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:20.123578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cb487dee-4236-4c94-ba54-34a787e98807 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:20.128770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-9bb77a22-b7df-40c6-9dc0-5297a4ef315f req-08d6465c-a4aa-4e36-887c-9bfe1947bce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8e1380-0f05-41dd-90ff-b826b109ccdc", "tag": "e4f8426c-49f1-4d16-9c50-aeb2c5389a71"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:51:20.131854 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb487dee-4236-4c94-ba54-34a787e98807 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:20.132394 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb487dee-4236-4c94-ba54-34a787e98807 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:20.133244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb487dee-4236-4c94-ba54-34a787e98807 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:20.133728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cb487dee-4236-4c94-ba54-34a787e98807 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:20.144008 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-9bb77a22-b7df-40c6-9dc0-5297a4ef315f req-08d6465c-a4aa-4e36-887c-9bfe1947bce5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:20.144788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-9bb77a22-b7df-40c6-9dc0-5297a4ef315f req-08d6465c-a4aa-4e36-887c-9bfe1947bce5 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:20.161815 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-9bb77a22-b7df-40c6-9dc0-5297a4ef315f req-08d6465c-a4aa-4e36-887c-9bfe1947bce5 service nova] Creating event network-changed:e4f8426c-49f1-4d16-9c50-aeb2c5389a71 for instance ba8e1380-0f05-41dd-90ff-b826b109ccdc on n-h2-843621-1 May 27 15:51:20.167812 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-9bb77a22-b7df-40c6-9dc0-5297a4ef315f req-08d6465c-a4aa-4e36-887c-9bfe1947bce5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042708 May 27 15:51:20.168026 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cb487dee-4236-4c94-ba54-34a787e98807 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:51:20.169147 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3463/6912] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:51:20.280510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-4aedc329-1195-441e-bee3-4c8299a7a358 req-4264eae2-6c2d-42a7-8437-ecd960c31c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54e46111-b443-4094-8c6c-ea49bd06aa43", "name": "network-vif-unplugged", "status": "completed", "tag": "0936c0b2-b488-46c1-8fd2-6f24e7d42f7c"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:51:20.293406 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cb487dee-4236-4c94-ba54-34a787e98807 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 204 len: 0 microversion: 2.1 time: 0.174424 May 27 15:51:20.298486 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3450/6913] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:51:20 2022] DELETE /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:51:20.308264 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4aedc329-1195-441e-bee3-4c8299a7a358 req-4264eae2-6c2d-42a7-8437-ecd960c31c6b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:20.308758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-4aedc329-1195-441e-bee3-4c8299a7a358 req-4264eae2-6c2d-42a7-8437-ecd960c31c6b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:20.315325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-079ba737-7bfc-4f65-8656-93d86ab55e86 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:20.316284 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-079ba737-7bfc-4f65-8656-93d86ab55e86 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:20.330651 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-079ba737-7bfc-4f65-8656-93d86ab55e86 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:20.330651 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-079ba737-7bfc-4f65-8656-93d86ab55e86 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:20.333492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-079ba737-7bfc-4f65-8656-93d86ab55e86 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:20.333492 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-079ba737-7bfc-4f65-8656-93d86ab55e86 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:20.337910 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-4aedc329-1195-441e-bee3-4c8299a7a358 req-4264eae2-6c2d-42a7-8437-ecd960c31c6b service nova] Creating event network-vif-unplugged:0936c0b2-b488-46c1-8fd2-6f24e7d42f7c for instance 54e46111-b443-4094-8c6c-ea49bd06aa43 on n-h1-843621-1 May 27 15:51:20.347246 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-4aedc329-1195-441e-bee3-4c8299a7a358 req-4264eae2-6c2d-42a7-8437-ecd960c31c6b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074181 May 27 15:51:20.347881 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3464/6914] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:51:20.515494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-079ba737-7bfc-4f65-8656-93d86ab55e86 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:20.524052 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-079ba737-7bfc-4f65-8656-93d86ab55e86 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1575 microversion: 2.1 time: 0.218536 May 27 15:51:20.524648 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3451/6915] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:20 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1575 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:20.845714 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ecf999e6-b447-4edd-b59b-17636efcf742 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:20.846439 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ecf999e6-b447-4edd-b59b-17636efcf742 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:20.852974 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecf999e6-b447-4edd-b59b-17636efcf742 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:20.853448 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecf999e6-b447-4edd-b59b-17636efcf742 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:20.854230 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecf999e6-b447-4edd-b59b-17636efcf742 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:20.854692 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ecf999e6-b447-4edd-b59b-17636efcf742 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:21.008996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ecf999e6-b447-4edd-b59b-17636efcf742 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:21.013193 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:51:21.020231 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ecf999e6-b447-4edd-b59b-17636efcf742 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1680 microversion: 2.1 time: 0.183617 May 27 15:51:21.021141 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3465/6916] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:20 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:21.542906 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bb9cce92-b94e-47b5-916e-572af026f028 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:21.544830 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bb9cce92-b94e-47b5-916e-572af026f028 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:21.552203 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb9cce92-b94e-47b5-916e-572af026f028 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:21.552704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb9cce92-b94e-47b5-916e-572af026f028 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:21.553529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb9cce92-b94e-47b5-916e-572af026f028 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:21.554246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb9cce92-b94e-47b5-916e-572af026f028 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:21.705838 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bb9cce92-b94e-47b5-916e-572af026f028 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:21.714052 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bb9cce92-b94e-47b5-916e-572af026f028 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1575 microversion: 2.1 time: 0.175138 May 27 15:51:21.714647 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3452/6917] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:21 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:22.346071 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-f50d0322-116b-41c8-88c6-2b6410a1c412 req-2980f762-ade1-446e-966b-990dc713880e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8e1380-0f05-41dd-90ff-b826b109ccdc", "name": "network-vif-deleted", "tag": "e4f8426c-49f1-4d16-9c50-aeb2c5389a71"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:51:22.358105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f50d0322-116b-41c8-88c6-2b6410a1c412 req-2980f762-ade1-446e-966b-990dc713880e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:22.358805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f50d0322-116b-41c8-88c6-2b6410a1c412 req-2980f762-ade1-446e-966b-990dc713880e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:22.377334 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-f50d0322-116b-41c8-88c6-2b6410a1c412 req-2980f762-ade1-446e-966b-990dc713880e service nova] Creating event network-vif-deleted:e4f8426c-49f1-4d16-9c50-aeb2c5389a71 for instance ba8e1380-0f05-41dd-90ff-b826b109ccdc on n-h2-843621-1 May 27 15:51:22.392861 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-f50d0322-116b-41c8-88c6-2b6410a1c412 req-2980f762-ade1-446e-966b-990dc713880e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049544 May 27 15:51:22.394414 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3466/6918] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:51:22.397619 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-6e0dd3ac-9ac0-4c87-a681-bf7ff46f2f36 req-20536628-bcd1-49dd-91ea-309a81180a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54e46111-b443-4094-8c6c-ea49bd06aa43", "name": "network-vif-plugged", "status": "completed", "tag": "0936c0b2-b488-46c1-8fd2-6f24e7d42f7c"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:51:22.410596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-6e0dd3ac-9ac0-4c87-a681-bf7ff46f2f36 req-20536628-bcd1-49dd-91ea-309a81180a2d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:22.411062 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-6e0dd3ac-9ac0-4c87-a681-bf7ff46f2f36 req-20536628-bcd1-49dd-91ea-309a81180a2d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:22.423112 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-6e0dd3ac-9ac0-4c87-a681-bf7ff46f2f36 req-20536628-bcd1-49dd-91ea-309a81180a2d service nova] Creating event network-vif-plugged:0936c0b2-b488-46c1-8fd2-6f24e7d42f7c for instance 54e46111-b443-4094-8c6c-ea49bd06aa43 on n-h1-843621-1 May 27 15:51:22.428459 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-6e0dd3ac-9ac0-4c87-a681-bf7ff46f2f36 req-20536628-bcd1-49dd-91ea-309a81180a2d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036101 May 27 15:51:22.429110 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3453/6919] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:51:22.735242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9168da0a-c811-4069-a241-24258d9be1a4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:22.735966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9168da0a-c811-4069-a241-24258d9be1a4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:22.743230 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9168da0a-c811-4069-a241-24258d9be1a4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:22.743999 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9168da0a-c811-4069-a241-24258d9be1a4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:22.745039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9168da0a-c811-4069-a241-24258d9be1a4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:22.745684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9168da0a-c811-4069-a241-24258d9be1a4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:22.818972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9168da0a-c811-4069-a241-24258d9be1a4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:22.827165 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9168da0a-c811-4069-a241-24258d9be1a4 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1223 microversion: 2.1 time: 0.097185 May 27 15:51:22.827758 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3467/6920] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:22 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:23.846443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-62cf0463-4a3c-4cf2-898d-672a0940bf15 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:23.847068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-62cf0463-4a3c-4cf2-898d-672a0940bf15 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:23.853637 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62cf0463-4a3c-4cf2-898d-672a0940bf15 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:23.854112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62cf0463-4a3c-4cf2-898d-672a0940bf15 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:23.854987 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62cf0463-4a3c-4cf2-898d-672a0940bf15 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:23.855483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62cf0463-4a3c-4cf2-898d-672a0940bf15 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:23.921408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-62cf0463-4a3c-4cf2-898d-672a0940bf15 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:23.929359 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-62cf0463-4a3c-4cf2-898d-672a0940bf15 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1223 microversion: 2.1 time: 0.089020 May 27 15:51:23.929947 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3454/6921] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:23 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:24.947109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-1c2d20bc-9ca5-4dd6-8042-964a60ff9887 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:24.947932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-1c2d20bc-9ca5-4dd6-8042-964a60ff9887 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:24.955500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c2d20bc-9ca5-4dd6-8042-964a60ff9887 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:24.956059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c2d20bc-9ca5-4dd6-8042-964a60ff9887 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:24.956931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c2d20bc-9ca5-4dd6-8042-964a60ff9887 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:24.959544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-1c2d20bc-9ca5-4dd6-8042-964a60ff9887 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:25.033570 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-1c2d20bc-9ca5-4dd6-8042-964a60ff9887 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:25.041966 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-1c2d20bc-9ca5-4dd6-8042-964a60ff9887 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1223 microversion: 2.1 time: 0.098807 May 27 15:51:25.042673 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3468/6922] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:24 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:26.058412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2465e2c9-b9e3-46f0-b1f3-703b78c82ba5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:26.059709 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2465e2c9-b9e3-46f0-b1f3-703b78c82ba5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:26.066803 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2465e2c9-b9e3-46f0-b1f3-703b78c82ba5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:26.067281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2465e2c9-b9e3-46f0-b1f3-703b78c82ba5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:26.068148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2465e2c9-b9e3-46f0-b1f3-703b78c82ba5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:26.068618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2465e2c9-b9e3-46f0-b1f3-703b78c82ba5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:26.135587 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2465e2c9-b9e3-46f0-b1f3-703b78c82ba5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:26.144505 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2465e2c9-b9e3-46f0-b1f3-703b78c82ba5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1223 microversion: 2.1 time: 0.089877 May 27 15:51:26.145082 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3455/6923] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:26 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:27.162509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0b2cdcd4-d30b-4d9a-a87b-696acba968d5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:27.163128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0b2cdcd4-d30b-4d9a-a87b-696acba968d5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:27.169760 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b2cdcd4-d30b-4d9a-a87b-696acba968d5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:27.170215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b2cdcd4-d30b-4d9a-a87b-696acba968d5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:27.171101 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b2cdcd4-d30b-4d9a-a87b-696acba968d5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:27.171548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0b2cdcd4-d30b-4d9a-a87b-696acba968d5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:27.242465 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0b2cdcd4-d30b-4d9a-a87b-696acba968d5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:27.255576 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0b2cdcd4-d30b-4d9a-a87b-696acba968d5 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1223 microversion: 2.1 time: 0.097148 May 27 15:51:27.256166 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3469/6924] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:27 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:28.272291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9284247d-2625-4d78-bf93-f44cf4d96349 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:28.273108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9284247d-2625-4d78-bf93-f44cf4d96349 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:28.277715 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:51:28.284121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9284247d-2625-4d78-bf93-f44cf4d96349 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:28.284613 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9284247d-2625-4d78-bf93-f44cf4d96349 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:28.285616 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9284247d-2625-4d78-bf93-f44cf4d96349 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:28.286086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9284247d-2625-4d78-bf93-f44cf4d96349 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:28.355403 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9284247d-2625-4d78-bf93-f44cf4d96349 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:28.366795 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9284247d-2625-4d78-bf93-f44cf4d96349 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1223 microversion: 2.1 time: 0.098440 May 27 15:51:28.367403 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3456/6925] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:28 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:29.384658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-41ed4db7-183e-42ab-8a3b-9257c1f9a925 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:29.385337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-41ed4db7-183e-42ab-8a3b-9257c1f9a925 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:29.388872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=49 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:51:29.395089 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-41ed4db7-183e-42ab-8a3b-9257c1f9a925 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:29.395544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-41ed4db7-183e-42ab-8a3b-9257c1f9a925 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:29.396338 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-41ed4db7-183e-42ab-8a3b-9257c1f9a925 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:29.396882 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-41ed4db7-183e-42ab-8a3b-9257c1f9a925 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:29.465403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-41ed4db7-183e-42ab-8a3b-9257c1f9a925 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:29.473897 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-41ed4db7-183e-42ab-8a3b-9257c1f9a925 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1223 microversion: 2.1 time: 0.092960 May 27 15:51:29.474408 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3470/6926] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:29 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:30.491154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f8f8c7a1-6f6f-4f65-9ae6-b5dfe2f4f15d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:30.491788 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f8f8c7a1-6f6f-4f65-9ae6-b5dfe2f4f15d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:30.499178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8f8c7a1-6f6f-4f65-9ae6-b5dfe2f4f15d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:30.499652 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8f8c7a1-6f6f-4f65-9ae6-b5dfe2f4f15d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:30.500436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8f8c7a1-6f6f-4f65-9ae6-b5dfe2f4f15d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:30.500929 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f8f8c7a1-6f6f-4f65-9ae6-b5dfe2f4f15d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:30.563066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f8f8c7a1-6f6f-4f65-9ae6-b5dfe2f4f15d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:30.570853 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f8f8c7a1-6f6f-4f65-9ae6-b5dfe2f4f15d tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1223 microversion: 2.1 time: 0.083800 May 27 15:51:30.571420 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3457/6927] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:30 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:31.587935 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-db605055-2aec-4e23-a30b-cbc46d899f5a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:31.588473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-db605055-2aec-4e23-a30b-cbc46d899f5a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:31.595666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db605055-2aec-4e23-a30b-cbc46d899f5a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:31.596131 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db605055-2aec-4e23-a30b-cbc46d899f5a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:31.596943 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db605055-2aec-4e23-a30b-cbc46d899f5a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:31.597396 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db605055-2aec-4e23-a30b-cbc46d899f5a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:31.630280 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db605055-2aec-4e23-a30b-cbc46d899f5a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:31.630736 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db605055-2aec-4e23-a30b-cbc46d899f5a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:31.631189 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-db605055-2aec-4e23-a30b-cbc46d899f5a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lazy-loading 'fault' on Instance uuid ba8e1380-0f05-41dd-90ff-b826b109ccdc {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:51:31.674996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-db605055-2aec-4e23-a30b-cbc46d899f5a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a058052ef3fd4ee58291ccc9837558cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536a3b9dd9a745c089e2da27b9f536ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:51:31.682650 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-db605055-2aec-4e23-a30b-cbc46d899f5a tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 200 len: 1228 microversion: 2.1 time: 0.098987 May 27 15:51:31.683415 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3471/6928] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:31 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 1228 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:51:32.700825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6dfc97a3-cec1-4162-8c3f-8f06b27db904 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:32.701384 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6dfc97a3-cec1-4162-8c3f-8f06b27db904 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: ba8e1380-0f05-41dd-90ff-b826b109ccdc] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:32.708454 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6dfc97a3-cec1-4162-8c3f-8f06b27db904 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:32.708970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6dfc97a3-cec1-4162-8c3f-8f06b27db904 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:32.709765 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6dfc97a3-cec1-4162-8c3f-8f06b27db904 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:32.710223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6dfc97a3-cec1-4162-8c3f-8f06b27db904 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:32.725115 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-6dfc97a3-cec1-4162-8c3f-8f06b27db904 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] HTTP exception thrown: Instance ba8e1380-0f05-41dd-90ff-b826b109ccdc could not be found. May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6dfc97a3-cec1-4162-8c3f-8f06b27db904 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Request method failure captured: May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc HTTP/1.1 May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikO_1Chjp-7OdQPlgoy0i68J74Yy9denIkk1niNkSk2uFWUy4CftwGV6LxM4FCEGakqUTp0mkulJ5awBDUhVVOjGCfP23UpxiQizq-3BPePUyAFyMxEgrT5T05iojcJbMyfNSyzYbX68HBU5apXXyE_-yRBe0ARJTHso9aoG2B7TFtpc May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_536a3b9dd9a745c089e2da27b9f536ff", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-TestVolumeBootPattern-685942222 May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-TestVolumeBootPattern-685942222-project May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: a058052ef3fd4ee58291ccc9837558cc May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-TestVolumeBootPattern-685942222-project May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance ba8e1380-0f05-41dd-90ff-b826b109ccdc could not be found. May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'ba8e1380-0f05-41dd-90ff-b826b109ccdc'} May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba8e1380-0f05-41dd-90ff-b826b109ccdc could not be found. May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba8e1380-0f05-41dd-90ff-b826b109ccdc could not be found. May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:51:32.726784 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:51:32.732006 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:51:32.732006 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:51:32.732006 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:51:32.732006 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:51:32.732006 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:51:32.732006 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba8e1380-0f05-41dd-90ff-b826b109ccdc could not be found. May 27 15:51:32.732006 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:51:32.732006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6dfc97a3-cec1-4162-8c3f-8f06b27db904 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Returning 404 to user: Instance ba8e1380-0f05-41dd-90ff-b826b109ccdc could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:51:32.732006 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6dfc97a3-cec1-4162-8c3f-8f06b27db904 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc" status: 404 len: 111 microversion: 2.1 time: 0.031934 May 27 15:51:32.732006 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3458/6929] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:32 2022] GET /compute/v2.1/servers/ba8e1380-0f05-41dd-90ff-b826b109ccdc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:51:33.179060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f852d27e-f39f-48a6-9a5d-083bc699e943 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:33.179581 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f852d27e-f39f-48a6-9a5d-083bc699e943 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:33.187138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f852d27e-f39f-48a6-9a5d-083bc699e943 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:33.187601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f852d27e-f39f-48a6-9a5d-083bc699e943 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:33.188378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f852d27e-f39f-48a6-9a5d-083bc699e943 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:33.188864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f852d27e-f39f-48a6-9a5d-083bc699e943 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:33.202851 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-f852d27e-f39f-48a6-9a5d-083bc699e943 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] HTTP exception thrown: Instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb could not be found. May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f852d27e-f39f-48a6-9a5d-083bc699e943 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Request method failure captured: May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb HTTP/1.1 May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikO_1Chjp-7OdQPlgoy0i68J74Yy9denIkk1niNkSk2uFWUy4CftwGV6LxM4FCEGakqUTp0mkulJ5awBDUhVVOjGCfP23UpxiQizq-3BPePUyAFyMxEgrT5T05iojcJbMyfNSyzYbX68HBU5apXXyE_-yRBe0ARJTHso9aoG2B7TFtpc May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_536a3b9dd9a745c089e2da27b9f536ff", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TestVolumeBootPattern-685942222 May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TestVolumeBootPattern-685942222-project May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: a058052ef3fd4ee58291ccc9837558cc May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TestVolumeBootPattern-685942222-project May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb could not be found. May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb'} May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb could not be found. May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:51:33.204528 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:51:33.209522 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb could not be found. May 27 15:51:33.209522 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:51:33.209522 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:51:33.209522 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:51:33.209522 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:51:33.209522 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:51:33.209522 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:51:33.209522 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:51:33.209522 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:51:33.209522 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb could not be found. May 27 15:51:33.209522 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:51:33.209522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f852d27e-f39f-48a6-9a5d-083bc699e943 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Returning 404 to user: Instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:51:33.209522 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f852d27e-f39f-48a6-9a5d-083bc699e943 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 404 len: 111 microversion: 2.1 time: 0.030981 May 27 15:51:33.209522 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3472/6930] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:51:33 2022] DELETE /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:51:33.214699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2acf9e14-d93a-4a53-8092-a7893ae51019 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:33.215414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2acf9e14-d93a-4a53-8092-a7893ae51019 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] [instance: c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:33.221472 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2acf9e14-d93a-4a53-8092-a7893ae51019 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:33.221944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2acf9e14-d93a-4a53-8092-a7893ae51019 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:33.222721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2acf9e14-d93a-4a53-8092-a7893ae51019 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:33.223179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2acf9e14-d93a-4a53-8092-a7893ae51019 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:33.237387 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-2acf9e14-d93a-4a53-8092-a7893ae51019 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] HTTP exception thrown: Instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb could not be found. May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2acf9e14-d93a-4a53-8092-a7893ae51019 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Request method failure captured: May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb HTTP/1.1 May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikO_1Chjp-7OdQPlgoy0i68J74Yy9denIkk1niNkSk2uFWUy4CftwGV6LxM4FCEGakqUTp0mkulJ5awBDUhVVOjGCfP23UpxiQizq-3BPePUyAFyMxEgrT5T05iojcJbMyfNSyzYbX68HBU5apXXyE_-yRBe0ARJTHso9aoG2B7TFtpc May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/536a3b9dd9a745c089e2da27b9f536ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_536a3b9dd9a745c089e2da27b9f536ff", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-TestVolumeBootPattern-685942222 May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 536a3b9dd9a745c089e2da27b9f536ff May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-TestVolumeBootPattern-685942222 May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-TestVolumeBootPattern-685942222-project May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: a058052ef3fd4ee58291ccc9837558cc May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-TestVolumeBootPattern-685942222-project May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb could not be found. May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb'} May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb could not be found. May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb could not be found. May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:51:33.238932 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:51:33.243545 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:51:33.243545 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:51:33.243545 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:51:33.243545 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:51:33.243545 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:51:33.243545 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb could not be found. May 27 15:51:33.243545 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:51:33.243545 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2acf9e14-d93a-4a53-8092-a7893ae51019 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Returning 404 to user: Instance c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:51:33.243545 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2acf9e14-d93a-4a53-8092-a7893ae51019 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb" status: 404 len: 111 microversion: 2.1 time: 0.029549 May 27 15:51:33.243545 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3459/6931] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:51:33 2022] GET /compute/v2.1/servers/c6f04f7b-fb77-48ef-b0ca-03c4fe44c4cb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:51:38.988134 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-31ed1fc0-9b5f-480d-9b56-0246a4061d10 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] Calling method '.version_select at 0x7fc775a188b0>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:51:39.016061 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-31ed1fc0-9b5f-480d-9b56-0246a4061d10 tempest-TestVolumeBootPattern-685942222 tempest-TestVolumeBootPattern-685942222-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1197035446" status: 202 len: 0 microversion: 2.1 time: 0.032750 May 27 15:51:39.020874 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3473/6932] 10.222.0.13 () {58 vars in 1262 bytes} [Fri May 27 15:51:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1197035446 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:51:57.287519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bb2e33a1-d1c4-4ca2-b8d0-264b19d2fbaa tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:51:57.288377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bb2e33a1-d1c4-4ca2-b8d0-264b19d2fbaa tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:51:57.291175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=7 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:51:57.292004 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:51:57.298280 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb2e33a1-d1c4-4ca2-b8d0-264b19d2fbaa tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:57.298837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb2e33a1-d1c4-4ca2-b8d0-264b19d2fbaa tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:57.299638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb2e33a1-d1c4-4ca2-b8d0-264b19d2fbaa tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:51:57.300094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bb2e33a1-d1c4-4ca2-b8d0-264b19d2fbaa tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:51:57.368003 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bb2e33a1-d1c4-4ca2-b8d0-264b19d2fbaa tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "POST /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43/action" status: 200 len: 24565 microversion: 2.1 time: 0.084720 May 27 15:51:57.368700 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3460/6933] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:51:57 2022] POST /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43/action => generated 24565 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 15:52:18.227261 n-d-843621-1 devstack@n-api.service[119248]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:52:18.227993 n-d-843621-1 devstack@n-api.service[119248]: Fri May 27 15:52:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:52:37.178058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=36 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:52:37.180237 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:52:37.182899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-7146820e-9ab4-4079-8013-86a440b2c49f req-f14e88c2-afe4-48d5-8001-eb4caa071c8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54e46111-b443-4094-8c6c-ea49bd06aa43", "tag": "0936c0b2-b488-46c1-8fd2-6f24e7d42f7c"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:52:37.184726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6298621b-654e-43b3-9d1c-ccb85ea16c3d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:52:37.185233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6298621b-654e-43b3-9d1c-ccb85ea16c3d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:52:37.189575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:52:37.190683 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=4 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:52:37.193221 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6298621b-654e-43b3-9d1c-ccb85ea16c3d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:52:37.193739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6298621b-654e-43b3-9d1c-ccb85ea16c3d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:52:37.194601 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6298621b-654e-43b3-9d1c-ccb85ea16c3d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:52:37.195117 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6298621b-654e-43b3-9d1c-ccb85ea16c3d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:52:37.199528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-7146820e-9ab4-4079-8013-86a440b2c49f req-f14e88c2-afe4-48d5-8001-eb4caa071c8e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:52:37.199688 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-7146820e-9ab4-4079-8013-86a440b2c49f req-f14e88c2-afe4-48d5-8001-eb4caa071c8e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:52:37.212494 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-7146820e-9ab4-4079-8013-86a440b2c49f req-f14e88c2-afe4-48d5-8001-eb4caa071c8e service nova] Creating event network-changed:0936c0b2-b488-46c1-8fd2-6f24e7d42f7c for instance 54e46111-b443-4094-8c6c-ea49bd06aa43 on n-h1-843621-1 May 27 15:52:37.217730 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-7146820e-9ab4-4079-8013-86a440b2c49f req-f14e88c2-afe4-48d5-8001-eb4caa071c8e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039774 May 27 15:52:37.218523 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3461/6934] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:52:37.229048 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6298621b-654e-43b3-9d1c-ccb85ea16c3d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:52:37.314625 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6298621b-654e-43b3-9d1c-ccb85ea16c3d tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "DELETE /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 204 len: 0 microversion: 2.1 time: 0.139087 May 27 15:52:37.318263 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3474/6935] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:52:37 2022] DELETE /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:52:37.324935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1f831a61-eb50-48f1-bb30-e54a29d64890 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:52:37.326047 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1f831a61-eb50-48f1-bb30-e54a29d64890 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:52:37.333704 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f831a61-eb50-48f1-bb30-e54a29d64890 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:52:37.334528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f831a61-eb50-48f1-bb30-e54a29d64890 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:52:37.335408 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f831a61-eb50-48f1-bb30-e54a29d64890 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:52:37.336097 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1f831a61-eb50-48f1-bb30-e54a29d64890 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:52:37.627887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1f831a61-eb50-48f1-bb30-e54a29d64890 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:52:37.635641 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1f831a61-eb50-48f1-bb30-e54a29d64890 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1686 microversion: 2.1 time: 0.315907 May 27 15:52:37.636210 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3462/6936] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:52:37 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1686 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:52:38.654214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c95c2fbb-0a2b-4937-a150-c4c61ea2b6e5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:52:38.654918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c95c2fbb-0a2b-4937-a150-c4c61ea2b6e5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:52:38.662234 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c95c2fbb-0a2b-4937-a150-c4c61ea2b6e5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:52:38.662689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c95c2fbb-0a2b-4937-a150-c4c61ea2b6e5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:52:38.663457 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c95c2fbb-0a2b-4937-a150-c4c61ea2b6e5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:52:38.663900 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c95c2fbb-0a2b-4937-a150-c4c61ea2b6e5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:52:38.805451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c95c2fbb-0a2b-4937-a150-c4c61ea2b6e5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499fa1ef3ed047a8a92c7a23be43c8f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3255afe7ba134153bcbe682b574e7803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:52:38.813657 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c95c2fbb-0a2b-4937-a150-c4c61ea2b6e5 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 200 len: 1686 microversion: 2.1 time: 0.163673 May 27 15:52:38.814243 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3475/6937] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:52:38 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:52:39.411343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-58796c70-0376-4fb8-afd1-09364da434c2 req-77d1e218-6895-4953-a9f9-e2d6fd97d707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54e46111-b443-4094-8c6c-ea49bd06aa43", "name": "network-vif-deleted", "tag": "0936c0b2-b488-46c1-8fd2-6f24e7d42f7c"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:52:39.420518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-58796c70-0376-4fb8-afd1-09364da434c2 req-77d1e218-6895-4953-a9f9-e2d6fd97d707 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:52:39.421012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-58796c70-0376-4fb8-afd1-09364da434c2 req-77d1e218-6895-4953-a9f9-e2d6fd97d707 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:52:39.433567 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-58796c70-0376-4fb8-afd1-09364da434c2 req-77d1e218-6895-4953-a9f9-e2d6fd97d707 service nova] Creating event network-vif-deleted:0936c0b2-b488-46c1-8fd2-6f24e7d42f7c for instance 54e46111-b443-4094-8c6c-ea49bd06aa43 on n-h1-843621-1 May 27 15:52:39.440542 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-58796c70-0376-4fb8-afd1-09364da434c2 req-77d1e218-6895-4953-a9f9-e2d6fd97d707 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114729 May 27 15:52:39.441190 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3463/6938] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:52:39.831209 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-699b6074-84ad-4eaf-8b8c-2e12f536a78f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:52:39.831742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-699b6074-84ad-4eaf-8b8c-2e12f536a78f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] [instance: 54e46111-b443-4094-8c6c-ea49bd06aa43] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:52:39.840491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-699b6074-84ad-4eaf-8b8c-2e12f536a78f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:52:39.840915 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-699b6074-84ad-4eaf-8b8c-2e12f536a78f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:52:39.841697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-699b6074-84ad-4eaf-8b8c-2e12f536a78f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:52:39.842139 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-699b6074-84ad-4eaf-8b8c-2e12f536a78f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:52:39.855905 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-699b6074-84ad-4eaf-8b8c-2e12f536a78f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] HTTP exception thrown: Instance 54e46111-b443-4094-8c6c-ea49bd06aa43 could not be found. May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-699b6074-84ad-4eaf-8b8c-2e12f536a78f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Request method failure captured: May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 HTTP/1.1 May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikPE8HKsBFVmDjnurTK4MmS5qV_xRSU-M7F4Wkd_TzQv2GmcoU1aDqk4cUYKxa-vX6YTiuiSIkKiSvKPFRD8cWehUx9Pm5FcQMK-uoH6NmDsBRqEpYqdKyByRTnQFvK6M-nxSszSM8yHouf7ypqvuFHP-I4lMAC05OHG2zCrZxHLPq0k May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 3255afe7ba134153bcbe682b574e7803 May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-126916587 May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3255afe7ba134153bcbe682b574e7803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/3255afe7ba134153bcbe682b574e7803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/3255afe7ba134153bcbe682b574e7803"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_3255afe7ba134153bcbe682b574e7803", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-TestNetworkAdvancedServerOps-126916587 May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 3255afe7ba134153bcbe682b574e7803 May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-126916587 May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-TestNetworkAdvancedServerOps-126916587-project May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 499fa1ef3ed047a8a92c7a23be43c8f0 May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-TestNetworkAdvancedServerOps-126916587-project May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 54e46111-b443-4094-8c6c-ea49bd06aa43 could not be found. May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '54e46111-b443-4094-8c6c-ea49bd06aa43'} May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54e46111-b443-4094-8c6c-ea49bd06aa43 could not be found. May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54e46111-b443-4094-8c6c-ea49bd06aa43 could not be found. May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:52:39.857641 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:52:39.863039 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:52:39.863039 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:52:39.863039 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:52:39.863039 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:52:39.863039 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:52:39.863039 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54e46111-b443-4094-8c6c-ea49bd06aa43 could not be found. May 27 15:52:39.863039 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:52:39.863039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-699b6074-84ad-4eaf-8b8c-2e12f536a78f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Returning 404 to user: Instance 54e46111-b443-4094-8c6c-ea49bd06aa43 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:52:39.863039 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-699b6074-84ad-4eaf-8b8c-2e12f536a78f tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43" status: 404 len: 111 microversion: 2.1 time: 0.031863 May 27 15:52:39.863039 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3476/6939] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:52:39 2022] GET /compute/v2.1/servers/54e46111-b443-4094-8c6c-ea49bd06aa43 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:52:43.247538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ed0ad9c5-d368-4471-983b-f8c7e59af590 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] Calling method '.version_select at 0x7fc7754025e0>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:52:43.280880 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ed0ad9c5-d368-4471-983b-f8c7e59af590 tempest-TestNetworkAdvancedServerOps-126916587 tempest-TestNetworkAdvancedServerOps-126916587-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-42877908" status: 202 len: 0 microversion: 2.1 time: 0.037455 May 27 15:52:43.282210 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3464/6940] 10.222.0.13 () {58 vars in 1277 bytes} [Fri May 27 15:52:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-42877908 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:52:55.650213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:52:55.650951 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:52:55.772243 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7b643c55-5120-47d5-a841-2df18db5f485 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-171183553", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:52:55.954464 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-7b643c55-5120-47d5-a841-2df18db5f485 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] validate_networks() for None {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:52:56.221897 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-7b643c55-5120-47d5-a841-2df18db5f485 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:52:56.222329 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-7b643c55-5120-47d5-a841-2df18db5f485 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:52:56.222810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-7b643c55-5120-47d5-a841-2df18db5f485 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:52:56.223229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-7b643c55-5120-47d5-a841-2df18db5f485 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:52:56.223645 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-7b643c55-5120-47d5-a841-2df18db5f485 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:52:56.232797 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b643c55-5120-47d5-a841-2df18db5f485 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:52:56.233285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b643c55-5120-47d5-a841-2df18db5f485 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:52:56.234115 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b643c55-5120-47d5-a841-2df18db5f485 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:52:56.234564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7b643c55-5120-47d5-a841-2df18db5f485 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:52:56.252403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-7b643c55-5120-47d5-a841-2df18db5f485 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Getting quotas for project 26a04c616b774a8e8fdd3c25dfad3868. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:52:56.257772 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-7b643c55-5120-47d5-a841-2df18db5f485 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Getting quotas for user 76502d9ce01d4fd68afb2b802c580acf and project 26a04c616b774a8e8fdd3c25dfad3868. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:52:56.270453 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7b643c55-5120-47d5-a841-2df18db5f485 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:52:56.272779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7b643c55-5120-47d5-a841-2df18db5f485 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:52:56.317286 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7b643c55-5120-47d5-a841-2df18db5f485 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672811 May 27 15:52:56.317939 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3477/6941] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:52:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:52:56.328195 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3040029f-eb8a-4dce-ba9a-af169a478955 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:52:56.329656 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3040029f-eb8a-4dce-ba9a-af169a478955 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:52:56.333147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=10 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:52:56.334464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:52:56.392101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3040029f-eb8a-4dce-ba9a-af169a478955 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76502d9ce01d4fd68afb2b802c580acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a04c616b774a8e8fdd3c25dfad3868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:52:56.399317 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3040029f-eb8a-4dce-ba9a-af169a478955 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] 10.222.0.13 "GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2" status: 200 len: 1221 microversion: 2.1 time: 0.075050 May 27 15:52:56.399893 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3465/6942] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:52:56 2022] GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2 => generated 1221 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:52:57.418114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2501e4dc-d2b2-48a2-bc3c-897f1d64e48c tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:52:57.419798 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2501e4dc-d2b2-48a2-bc3c-897f1d64e48c tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:52:57.427605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2501e4dc-d2b2-48a2-bc3c-897f1d64e48c tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:52:57.428064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2501e4dc-d2b2-48a2-bc3c-897f1d64e48c tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:52:57.429208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2501e4dc-d2b2-48a2-bc3c-897f1d64e48c tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:52:57.429662 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2501e4dc-d2b2-48a2-bc3c-897f1d64e48c tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:52:57.492655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2501e4dc-d2b2-48a2-bc3c-897f1d64e48c tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76502d9ce01d4fd68afb2b802c580acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a04c616b774a8e8fdd3c25dfad3868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:52:57.500289 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2501e4dc-d2b2-48a2-bc3c-897f1d64e48c tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] 10.222.0.13 "GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2" status: 200 len: 1291 microversion: 2.1 time: 0.087332 May 27 15:52:57.500928 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3478/6943] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:52:57 2022] GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2 => generated 1291 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:52:58.517442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b22c9416-b031-45ed-af71-753b17252e25 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:52:58.518388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b22c9416-b031-45ed-af71-753b17252e25 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:52:58.526400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b22c9416-b031-45ed-af71-753b17252e25 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:52:58.526870 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b22c9416-b031-45ed-af71-753b17252e25 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:52:58.527672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b22c9416-b031-45ed-af71-753b17252e25 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:52:58.528127 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b22c9416-b031-45ed-af71-753b17252e25 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:52:58.665557 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b22c9416-b031-45ed-af71-753b17252e25 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76502d9ce01d4fd68afb2b802c580acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a04c616b774a8e8fdd3c25dfad3868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:52:58.678641 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b22c9416-b031-45ed-af71-753b17252e25 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] 10.222.0.13 "GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2" status: 200 len: 1321 microversion: 2.1 time: 0.165756 May 27 15:52:58.679244 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3466/6944] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:52:58 2022] GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:52:58.915324 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-d3242a58-28ec-4e81-8eb4-54ad76952fea req-63907471-0246-4508-885d-ae73c4bed0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449ad8d3-da0d-4c7c-91e6-a647977556f2", "tag": "0c1de927-5b2b-430c-a8ad-46edcf7b00eb"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:52:58.927444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d3242a58-28ec-4e81-8eb4-54ad76952fea req-63907471-0246-4508-885d-ae73c4bed0d6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:52:58.928277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d3242a58-28ec-4e81-8eb4-54ad76952fea req-63907471-0246-4508-885d-ae73c4bed0d6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:52:58.942791 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-d3242a58-28ec-4e81-8eb4-54ad76952fea req-63907471-0246-4508-885d-ae73c4bed0d6 service nova] Creating event network-changed:0c1de927-5b2b-430c-a8ad-46edcf7b00eb for instance 449ad8d3-da0d-4c7c-91e6-a647977556f2 on n-h1-843621-1 May 27 15:52:58.949021 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-d3242a58-28ec-4e81-8eb4-54ad76952fea req-63907471-0246-4508-885d-ae73c4bed0d6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040212 May 27 15:52:58.949832 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3479/6945] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:52:59.695634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d021046a-2f9b-43b1-84bd-64f75f8130e5 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:52:59.696264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d021046a-2f9b-43b1-84bd-64f75f8130e5 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:52:59.703000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d021046a-2f9b-43b1-84bd-64f75f8130e5 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:52:59.703477 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d021046a-2f9b-43b1-84bd-64f75f8130e5 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:52:59.704270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d021046a-2f9b-43b1-84bd-64f75f8130e5 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:52:59.704747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d021046a-2f9b-43b1-84bd-64f75f8130e5 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:52:59.839498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d021046a-2f9b-43b1-84bd-64f75f8130e5 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76502d9ce01d4fd68afb2b802c580acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a04c616b774a8e8fdd3c25dfad3868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:52:59.847849 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d021046a-2f9b-43b1-84bd-64f75f8130e5 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] 10.222.0.13 "GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2" status: 200 len: 1321 microversion: 2.1 time: 0.156255 May 27 15:52:59.848438 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3467/6946] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:52:59 2022] GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:00.866069 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c516ab71-3c07-4fa9-a9ce-c6285d96654c tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:00.866784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c516ab71-3c07-4fa9-a9ce-c6285d96654c tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:00.873067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c516ab71-3c07-4fa9-a9ce-c6285d96654c tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:00.873525 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c516ab71-3c07-4fa9-a9ce-c6285d96654c tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:00.874292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c516ab71-3c07-4fa9-a9ce-c6285d96654c tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:00.874784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c516ab71-3c07-4fa9-a9ce-c6285d96654c tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:01.002185 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c516ab71-3c07-4fa9-a9ce-c6285d96654c tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76502d9ce01d4fd68afb2b802c580acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a04c616b774a8e8fdd3c25dfad3868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:01.009781 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c516ab71-3c07-4fa9-a9ce-c6285d96654c tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] 10.222.0.13 "GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2" status: 200 len: 1321 microversion: 2.1 time: 0.148749 May 27 15:53:01.010355 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3480/6947] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:00 2022] GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:02.027111 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c305972d-e8f3-4f1d-a85c-09e71f12f544 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:02.027746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c305972d-e8f3-4f1d-a85c-09e71f12f544 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:02.035169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c305972d-e8f3-4f1d-a85c-09e71f12f544 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:02.035672 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c305972d-e8f3-4f1d-a85c-09e71f12f544 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:02.036459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c305972d-e8f3-4f1d-a85c-09e71f12f544 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:02.036943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c305972d-e8f3-4f1d-a85c-09e71f12f544 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:02.166192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c305972d-e8f3-4f1d-a85c-09e71f12f544 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76502d9ce01d4fd68afb2b802c580acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a04c616b774a8e8fdd3c25dfad3868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:02.174305 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c305972d-e8f3-4f1d-a85c-09e71f12f544 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] 10.222.0.13 "GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2" status: 200 len: 1321 microversion: 2.1 time: 0.151236 May 27 15:53:02.174885 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3468/6948] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:02 2022] GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:03.190749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-03ab715a-2159-4f15-bfb3-52040976ff69 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:03.191365 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-03ab715a-2159-4f15-bfb3-52040976ff69 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:03.198292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03ab715a-2159-4f15-bfb3-52040976ff69 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:03.198747 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03ab715a-2159-4f15-bfb3-52040976ff69 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:03.199512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03ab715a-2159-4f15-bfb3-52040976ff69 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:03.199957 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-03ab715a-2159-4f15-bfb3-52040976ff69 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:03.329447 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-03ab715a-2159-4f15-bfb3-52040976ff69 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76502d9ce01d4fd68afb2b802c580acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a04c616b774a8e8fdd3c25dfad3868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:03.337323 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-03ab715a-2159-4f15-bfb3-52040976ff69 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] 10.222.0.13 "GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2" status: 200 len: 1321 microversion: 2.1 time: 0.150424 May 27 15:53:03.337920 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3481/6949] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:03 2022] GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:04.354773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8244d44e-a579-4b1d-8bdc-9419d2c5e238 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:04.355501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8244d44e-a579-4b1d-8bdc-9419d2c5e238 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:04.363103 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8244d44e-a579-4b1d-8bdc-9419d2c5e238 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:04.363578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8244d44e-a579-4b1d-8bdc-9419d2c5e238 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:04.364369 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8244d44e-a579-4b1d-8bdc-9419d2c5e238 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:04.364875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8244d44e-a579-4b1d-8bdc-9419d2c5e238 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:04.502670 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8244d44e-a579-4b1d-8bdc-9419d2c5e238 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76502d9ce01d4fd68afb2b802c580acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a04c616b774a8e8fdd3c25dfad3868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:04.510829 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8244d44e-a579-4b1d-8bdc-9419d2c5e238 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] 10.222.0.13 "GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2" status: 200 len: 1321 microversion: 2.1 time: 0.159898 May 27 15:53:04.511408 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3469/6950] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:04 2022] GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:53:04.664341 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-3d6c58c7-aa02-4f7e-9998-e486636e085d req-e561194a-8f2d-46cc-90aa-912fb930bf32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449ad8d3-da0d-4c7c-91e6-a647977556f2", "name": "network-vif-plugged", "status": "completed", "tag": "0c1de927-5b2b-430c-a8ad-46edcf7b00eb"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:53:04.672521 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3d6c58c7-aa02-4f7e-9998-e486636e085d req-e561194a-8f2d-46cc-90aa-912fb930bf32 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:04.673007 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3d6c58c7-aa02-4f7e-9998-e486636e085d req-e561194a-8f2d-46cc-90aa-912fb930bf32 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:04.683902 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-3d6c58c7-aa02-4f7e-9998-e486636e085d req-e561194a-8f2d-46cc-90aa-912fb930bf32 service nova] Creating event network-vif-plugged:0c1de927-5b2b-430c-a8ad-46edcf7b00eb for instance 449ad8d3-da0d-4c7c-91e6-a647977556f2 on n-h1-843621-1 May 27 15:53:04.688997 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-3d6c58c7-aa02-4f7e-9998-e486636e085d req-e561194a-8f2d-46cc-90aa-912fb930bf32 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092940 May 27 15:53:04.689589 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3482/6951] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:53:05.528071 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-22342f3e-7e91-432f-b8bc-fb968434eb43 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:05.528725 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-22342f3e-7e91-432f-b8bc-fb968434eb43 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:05.535474 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22342f3e-7e91-432f-b8bc-fb968434eb43 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:05.535989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22342f3e-7e91-432f-b8bc-fb968434eb43 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:05.536804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22342f3e-7e91-432f-b8bc-fb968434eb43 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:05.537264 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-22342f3e-7e91-432f-b8bc-fb968434eb43 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:05.663146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-22342f3e-7e91-432f-b8bc-fb968434eb43 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76502d9ce01d4fd68afb2b802c580acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a04c616b774a8e8fdd3c25dfad3868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:05.678448 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-22342f3e-7e91-432f-b8bc-fb968434eb43 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] 10.222.0.13 "GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2" status: 200 len: 1321 microversion: 2.1 time: 0.155049 May 27 15:53:05.679024 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3470/6952] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:05 2022] GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:06.693138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:53:06.693919 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:53:06.698294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b08c2611-1dbc-4446-813c-045fd4940446 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:06.698992 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b08c2611-1dbc-4446-813c-045fd4940446 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:06.706104 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b08c2611-1dbc-4446-813c-045fd4940446 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:06.706560 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b08c2611-1dbc-4446-813c-045fd4940446 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:06.707322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b08c2611-1dbc-4446-813c-045fd4940446 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:06.707765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b08c2611-1dbc-4446-813c-045fd4940446 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:06.845617 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b08c2611-1dbc-4446-813c-045fd4940446 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76502d9ce01d4fd68afb2b802c580acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a04c616b774a8e8fdd3c25dfad3868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:06.853335 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b08c2611-1dbc-4446-813c-045fd4940446 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] 10.222.0.13 "GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2" status: 200 len: 1470 microversion: 2.1 time: 0.162043 May 27 15:53:06.853905 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3483/6953] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:06 2022] GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:06.872101 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:53:06.929358 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-65b44398-75c8-4675-8d97-18c866587aaf tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Calling method '.version_select at 0x7fc7753f4b80>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:06.995890 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-65b44398-75c8-4675-8d97-18c866587aaf tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/753ad0d362654514ab31466340e97d80" status: 200 len: 371 microversion: 2.1 time: 0.128146 May 27 15:53:06.996469 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3471/6954] 10.222.0.13 () {58 vars in 1241 bytes} [Fri May 27 15:53:06 2022] GET /compute/v2.1/os-quota-sets/753ad0d362654514ab31466340e97d80 => generated 371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:53:07.006833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c3e28cd6-e06d-4e66-8586-06386ffe60bb tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1138301452", "id": 1606164616, "os-flavor-access:is_public": "True"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:53:07.008542 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:53:07.008542 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 15:53:07.024423 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c3e28cd6-e06d-4e66-8586-06386ffe60bb tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.021269 May 27 15:53:07.025039 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3484/6955] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:53:07 2022] POST /compute/v2.1/flavors => generated 438 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:53:07.036630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-de707fd3-3ed4-47f3-8b99-e3971bb732de tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1606164616"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:53:07.037769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-de707fd3-3ed4-47f3-8b99-e3971bb732de tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:07.043831 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de707fd3-3ed4-47f3-8b99-e3971bb732de tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:07.044299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de707fd3-3ed4-47f3-8b99-e3971bb732de tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:07.045102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de707fd3-3ed4-47f3-8b99-e3971bb732de tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:07.045561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de707fd3-3ed4-47f3-8b99-e3971bb732de tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:07.229131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-de707fd3-3ed4-47f3-8b99-e3971bb732de tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '65b42aad6dec4224983632fab3ec6221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753ad0d362654514ab31466340e97d80', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:07.235816 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-de707fd3-3ed4-47f3-8b99-e3971bb732de tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1138301452 {{(pid=119248) resize /opt/stack/nova/nova/compute/api.py:4166}} May 27 15:53:07.242244 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de707fd3-3ed4-47f3-8b99-e3971bb732de tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:07.242712 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de707fd3-3ed4-47f3-8b99-e3971bb732de tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:07.243561 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de707fd3-3ed4-47f3-8b99-e3971bb732de tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:07.244019 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-de707fd3-3ed4-47f3-8b99-e3971bb732de tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:07.269787 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-de707fd3-3ed4-47f3-8b99-e3971bb732de tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Getting quotas for project 26a04c616b774a8e8fdd3c25dfad3868. Resources: {'ram', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:53:07.274818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-de707fd3-3ed4-47f3-8b99-e3971bb732de tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Getting quotas for user 76502d9ce01d4fd68afb2b802c580acf and project 26a04c616b774a8e8fdd3c25dfad3868. Resources: {'ram', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:53:07.286788 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.compute.api [None req-de707fd3-3ed4-47f3-8b99-e3971bb732de tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] ram quota exceeded for 753ad0d362654514ab31466340e97d80, tried to resize instance. May 27 15:53:07.287353 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-de707fd3-3ed4-47f3-8b99-e3971bb732de tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-de707fd3-3ed4-47f3-8b99-e3971bb732de tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Request method failure captured: May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: request: POST /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2/action HTTP/1.1 May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 39 May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikPPXuuufcKzYIE90QWrU1KU0cApBLg6SviweLyO9Z6UOxY2wYy7m1QWLN2JY1kRr2RB_n-g4NgK6xtvPBXXk8td-F0i_SXk5gTfFBK0G3FEzYNzT4SJkmi8gruMRxeogkjo2Jo8xS4NlmmIusukx9c8waaM6TUDSxz2mRK2VfvZy01M May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 753ad0d362654514ab31466340e97d80 May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1772154950 May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,admin,member May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,admin,member May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/753ad0d362654514ab31466340e97d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/753ad0d362654514ab31466340e97d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/753ad0d362654514ab31466340e97d80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_753ad0d362654514ab31466340e97d80", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1772154950 May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 753ad0d362654514ab31466340e97d80 May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1772154950 May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServersAdminNegativeTestJSON-1772154950-project-admin May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: 65b42aad6dec4224983632fab3ec6221 May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1772154950-project-admin May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: {"resize": {"flavorRef": "1606164616"}} May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '449ad8d3-da0d-4c7c-91e6-a647977556f2', 'body': {'resize': {'flavorRef': '1606164616'}}} May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:53:07.289538 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-de707fd3-3ed4-47f3-8b99-e3971bb732de tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-de707fd3-3ed4-47f3-8b99-e3971bb732de tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2/action" status: 403 len: 118 microversion: 2.1 time: 0.259191 May 27 15:53:07.295635 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3472/6956] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:53:07 2022] POST /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2/action => generated 118 bytes in 260 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 15:53:07.299912 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d5054a80-ddf2-46b2-a4ee-c5e658cf0ebe tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:07.300665 n-d-843621-1 devstack@n-api.service[119249]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:53:07.300665 n-d-843621-1 devstack@n-api.service[119249]: warnings.warn(msg) May 27 15:53:07.317048 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d5054a80-ddf2-46b2-a4ee-c5e658cf0ebe tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/1606164616" status: 202 len: 0 microversion: 2.1 time: 0.020870 May 27 15:53:07.317594 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3485/6957] 10.222.0.13 () {58 vars in 1160 bytes} [Fri May 27 15:53:07 2022] DELETE /compute/v2.1/flavors/1606164616 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:53:07.325276 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-63eb6fe9-3e72-4679-aed7-b732b71b7ee4 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:07.344019 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-63eb6fe9-3e72-4679-aed7-b732b71b7ee4 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022364 May 27 15:53:07.344598 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3473/6958] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 15:53:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:07.360763 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c0273b08-9e12-46f5-b037-38baf5ebd519 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Calling method '.version_select at 0x7fc775c21940>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:07.429432 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c0273b08-9e12-46f5-b037-38baf5ebd519 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] 10.222.0.13 "GET /compute/v2.1/os-quota-sets/753ad0d362654514ab31466340e97d80" status: 200 len: 371 microversion: 2.1 time: 0.072381 May 27 15:53:07.430005 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3486/6959] 10.222.0.13 () {58 vars in 1241 bytes} [Fri May 27 15:53:07 2022] GET /compute/v2.1/os-quota-sets/753ad0d362654514ab31466340e97d80 => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:53:07.440573 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-005d5054-3869-4a36-a84b-9f76cda69b45 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-228681792", "id": 597544043, "os-flavor-access:is_public": "True"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:53:07.442196 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:53:07.442196 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:53:07.457488 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-005d5054-3869-4a36-a84b-9f76cda69b45 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.021148 May 27 15:53:07.458052 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3474/6960] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:53:07 2022] POST /compute/v2.1/flavors => generated 433 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:53:07.468886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-07af6568-a696-4186-97d5-34cb45f08959 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "597544043"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:53:07.469954 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-07af6568-a696-4186-97d5-34cb45f08959 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:07.476280 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07af6568-a696-4186-97d5-34cb45f08959 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:07.476773 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07af6568-a696-4186-97d5-34cb45f08959 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:07.477553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07af6568-a696-4186-97d5-34cb45f08959 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:07.477997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07af6568-a696-4186-97d5-34cb45f08959 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:07.561424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-07af6568-a696-4186-97d5-34cb45f08959 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '65b42aad6dec4224983632fab3ec6221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753ad0d362654514ab31466340e97d80', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:07.568273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-07af6568-a696-4186-97d5-34cb45f08959 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-228681792 {{(pid=119249) resize /opt/stack/nova/nova/compute/api.py:4166}} May 27 15:53:07.574660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07af6568-a696-4186-97d5-34cb45f08959 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:07.575118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07af6568-a696-4186-97d5-34cb45f08959 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:07.575919 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07af6568-a696-4186-97d5-34cb45f08959 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:07.576361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-07af6568-a696-4186-97d5-34cb45f08959 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:07.597417 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-07af6568-a696-4186-97d5-34cb45f08959 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Getting quotas for project 26a04c616b774a8e8fdd3c25dfad3868. Resources: {'ram', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:53:07.602409 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-07af6568-a696-4186-97d5-34cb45f08959 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Getting quotas for user 76502d9ce01d4fd68afb2b802c580acf and project 26a04c616b774a8e8fdd3c25dfad3868. Resources: {'ram', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:53:07.614739 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.compute.api [None req-07af6568-a696-4186-97d5-34cb45f08959 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] cores quota exceeded for 753ad0d362654514ab31466340e97d80, tried to resize instance. May 27 15:53:07.615283 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-07af6568-a696-4186-97d5-34cb45f08959 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-07af6568-a696-4186-97d5-34cb45f08959 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Request method failure captured: May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: request: POST /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2/action HTTP/1.1 May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 38 May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikPPXuuufcKzYIE90QWrU1KU0cApBLg6SviweLyO9Z6UOxY2wYy7m1QWLN2JY1kRr2RB_n-g4NgK6xtvPBXXk8td-F0i_SXk5gTfFBK0G3FEzYNzT4SJkmi8gruMRxeogkjo2Jo8xS4NlmmIusukx9c8waaM6TUDSxz2mRK2VfvZy01M May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 753ad0d362654514ab31466340e97d80 May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1772154950 May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,admin,member May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,admin,member May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/753ad0d362654514ab31466340e97d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/753ad0d362654514ab31466340e97d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/753ad0d362654514ab31466340e97d80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_753ad0d362654514ab31466340e97d80", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1772154950 May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 753ad0d362654514ab31466340e97d80 May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1772154950 May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersAdminNegativeTestJSON-1772154950-project-admin May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 65b42aad6dec4224983632fab3ec6221 May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1772154950-project-admin May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: {"resize": {"flavorRef": "597544043"}} May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '449ad8d3-da0d-4c7c-91e6-a647977556f2', 'body': {'resize': {'flavorRef': '597544043'}}} May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:53:07.617426 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-07af6568-a696-4186-97d5-34cb45f08959 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-07af6568-a696-4186-97d5-34cb45f08959 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] 10.222.0.13 "POST /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2/action" status: 403 len: 113 microversion: 2.1 time: 0.153850 May 27 15:53:07.623397 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3487/6961] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:53:07 2022] POST /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2/action => generated 113 bytes in 155 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 27 15:53:07.628496 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e02dd188-9d70-4f85-9bab-b524145b3bbc tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:07.629283 n-d-843621-1 devstack@n-api.service[119248]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:53:07.629283 n-d-843621-1 devstack@n-api.service[119248]: warnings.warn(msg) May 27 15:53:07.646071 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e02dd188-9d70-4f85-9bab-b524145b3bbc tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] 10.222.0.13 "DELETE /compute/v2.1/flavors/597544043" status: 202 len: 0 microversion: 2.1 time: 0.021960 May 27 15:53:07.646592 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3475/6962] 10.222.0.13 () {58 vars in 1157 bytes} [Fri May 27 15:53:07 2022] DELETE /compute/v2.1/flavors/597544043 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:53:07.654444 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cdab8af0-4772-4e22-98e7-bbefb3a82a00 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:07.674431 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cdab8af0-4772-4e22-98e7-bbefb3a82a00 tempest-ServersAdminNegativeTestJSON-1772154950 tempest-ServersAdminNegativeTestJSON-1772154950-project-admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023507 May 27 15:53:07.675008 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3488/6963] 10.222.0.13 () {58 vars in 1145 bytes} [Fri May 27 15:53:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:07.691973 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e8d81b7-2882-4f40-a17a-edf2596b37f2 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:07.692526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e8d81b7-2882-4f40-a17a-edf2596b37f2 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:07.698768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e8d81b7-2882-4f40-a17a-edf2596b37f2 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:07.699245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e8d81b7-2882-4f40-a17a-edf2596b37f2 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:07.700035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e8d81b7-2882-4f40-a17a-edf2596b37f2 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:07.700498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e8d81b7-2882-4f40-a17a-edf2596b37f2 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:07.727749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e8d81b7-2882-4f40-a17a-edf2596b37f2 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:53:07.806914 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e8d81b7-2882-4f40-a17a-edf2596b37f2 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] 10.222.0.13 "DELETE /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2" status: 204 len: 0 microversion: 2.1 time: 0.119071 May 27 15:53:07.807606 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3476/6964] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:53:07 2022] DELETE /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:53:07.816208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c551ba6b-51f1-4567-bda2-a8eaae6eb4d5 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:07.816923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c551ba6b-51f1-4567-bda2-a8eaae6eb4d5 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:07.823851 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c551ba6b-51f1-4567-bda2-a8eaae6eb4d5 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:07.824313 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c551ba6b-51f1-4567-bda2-a8eaae6eb4d5 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:07.825124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c551ba6b-51f1-4567-bda2-a8eaae6eb4d5 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:07.825569 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c551ba6b-51f1-4567-bda2-a8eaae6eb4d5 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:07.956224 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c551ba6b-51f1-4567-bda2-a8eaae6eb4d5 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76502d9ce01d4fd68afb2b802c580acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a04c616b774a8e8fdd3c25dfad3868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:07.963867 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c551ba6b-51f1-4567-bda2-a8eaae6eb4d5 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] 10.222.0.13 "GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2" status: 200 len: 1476 microversion: 2.1 time: 0.152176 May 27 15:53:07.964456 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3489/6965] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:07 2022] GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2 => generated 1476 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:08.982419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e8a1af5c-12a2-484e-b765-6b7f26735529 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:08.983130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e8a1af5c-12a2-484e-b765-6b7f26735529 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:08.990056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e8a1af5c-12a2-484e-b765-6b7f26735529 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:08.990524 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e8a1af5c-12a2-484e-b765-6b7f26735529 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:08.991301 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e8a1af5c-12a2-484e-b765-6b7f26735529 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:08.991757 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e8a1af5c-12a2-484e-b765-6b7f26735529 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:09.123618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e8a1af5c-12a2-484e-b765-6b7f26735529 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76502d9ce01d4fd68afb2b802c580acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a04c616b774a8e8fdd3c25dfad3868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:09.131739 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e8a1af5c-12a2-484e-b765-6b7f26735529 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] 10.222.0.13 "GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2" status: 200 len: 1476 microversion: 2.1 time: 0.153632 May 27 15:53:09.132422 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3477/6966] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:08 2022] GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2 => generated 1476 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:09.728465 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-60d262f3-2885-4f95-a693-2ba097840409 req-b5105c8f-3935-4524-b328-4f8cded65a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449ad8d3-da0d-4c7c-91e6-a647977556f2", "name": "network-vif-deleted", "tag": "0c1de927-5b2b-430c-a8ad-46edcf7b00eb"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:53:09.744969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-60d262f3-2885-4f95-a693-2ba097840409 req-b5105c8f-3935-4524-b328-4f8cded65a08 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:09.745624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-60d262f3-2885-4f95-a693-2ba097840409 req-b5105c8f-3935-4524-b328-4f8cded65a08 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:09.763802 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-60d262f3-2885-4f95-a693-2ba097840409 req-b5105c8f-3935-4524-b328-4f8cded65a08 service nova] Creating event network-vif-deleted:0c1de927-5b2b-430c-a8ad-46edcf7b00eb for instance 449ad8d3-da0d-4c7c-91e6-a647977556f2 on n-h1-843621-1 May 27 15:53:09.769553 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-60d262f3-2885-4f95-a693-2ba097840409 req-b5105c8f-3935-4524-b328-4f8cded65a08 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046385 May 27 15:53:09.770173 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3490/6967] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:53:10.149063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3f6fe141-01d7-46bd-acc7-a217c083fd4e tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:10.149720 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3f6fe141-01d7-46bd-acc7-a217c083fd4e tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:10.156787 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f6fe141-01d7-46bd-acc7-a217c083fd4e tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:10.158241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f6fe141-01d7-46bd-acc7-a217c083fd4e tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:10.158738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f6fe141-01d7-46bd-acc7-a217c083fd4e tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:10.159382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f6fe141-01d7-46bd-acc7-a217c083fd4e tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:10.190528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f6fe141-01d7-46bd-acc7-a217c083fd4e tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:10.190993 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3f6fe141-01d7-46bd-acc7-a217c083fd4e tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:10.191459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.objects.instance [None req-3f6fe141-01d7-46bd-acc7-a217c083fd4e tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lazy-loading 'fault' on Instance uuid 449ad8d3-da0d-4c7c-91e6-a647977556f2 {{(pid=119248) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:53:10.235993 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3f6fe141-01d7-46bd-acc7-a217c083fd4e tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76502d9ce01d4fd68afb2b802c580acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a04c616b774a8e8fdd3c25dfad3868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:10.244122 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3f6fe141-01d7-46bd-acc7-a217c083fd4e tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] 10.222.0.13 "GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2" status: 200 len: 1311 microversion: 2.1 time: 0.098479 May 27 15:53:10.244309 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3478/6968] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:10 2022] GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:11.262382 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ec401c5c-6257-479b-bd6b-4c3b1e55e757 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:11.263094 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ec401c5c-6257-479b-bd6b-4c3b1e55e757 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] [instance: 449ad8d3-da0d-4c7c-91e6-a647977556f2] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:11.269677 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ec401c5c-6257-479b-bd6b-4c3b1e55e757 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:11.270135 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ec401c5c-6257-479b-bd6b-4c3b1e55e757 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:11.270902 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ec401c5c-6257-479b-bd6b-4c3b1e55e757 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:11.271349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ec401c5c-6257-479b-bd6b-4c3b1e55e757 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:11.285134 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-ec401c5c-6257-479b-bd6b-4c3b1e55e757 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] HTTP exception thrown: Instance 449ad8d3-da0d-4c7c-91e6-a647977556f2 could not be found. May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ec401c5c-6257-479b-bd6b-4c3b1e55e757 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Request method failure captured: May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2 HTTP/1.1 May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikPPWG_xJRs8yM2aGlRZI__gw_CPUs2jWDBlHSdM6djUsTb8KjVhMDnxzPCP-hauoGYOguNvWfScfJQcZ5WnH_7YjFqCgaXEubKLSYLMptCD9Hpu0ygLP8Az7KvSZRORR9QnKx6F-nQOzOF6zzjoGcI73JnnUqF-Q2GDqd_1c9r_wzq8 May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 26a04c616b774a8e8fdd3c25dfad3868 May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-466016937 May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/26a04c616b774a8e8fdd3c25dfad3868"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/26a04c616b774a8e8fdd3c25dfad3868"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/26a04c616b774a8e8fdd3c25dfad3868"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_26a04c616b774a8e8fdd3c25dfad3868", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServersAdminNegativeTestJSON-466016937 May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 26a04c616b774a8e8fdd3c25dfad3868 May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-466016937 May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServersAdminNegativeTestJSON-466016937-project May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: 76502d9ce01d4fd68afb2b802c580acf May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServersAdminNegativeTestJSON-466016937-project May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 449ad8d3-da0d-4c7c-91e6-a647977556f2 could not be found. May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '449ad8d3-da0d-4c7c-91e6-a647977556f2'} May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449ad8d3-da0d-4c7c-91e6-a647977556f2 could not be found. May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449ad8d3-da0d-4c7c-91e6-a647977556f2 could not be found. May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:53:11.286779 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:53:11.291427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:53:11.291427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:53:11.291427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:53:11.291427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:53:11.291427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:53:11.291427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449ad8d3-da0d-4c7c-91e6-a647977556f2 could not be found. May 27 15:53:11.291427 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:53:11.291427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ec401c5c-6257-479b-bd6b-4c3b1e55e757 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] Returning 404 to user: Instance 449ad8d3-da0d-4c7c-91e6-a647977556f2 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:53:11.291427 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ec401c5c-6257-479b-bd6b-4c3b1e55e757 tempest-ServersAdminNegativeTestJSON-466016937 tempest-ServersAdminNegativeTestJSON-466016937-project] 10.222.0.13 "GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2" status: 404 len: 111 microversion: 2.1 time: 0.030931 May 27 15:53:11.291427 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3491/6969] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:11 2022] GET /compute/v2.1/servers/449ad8d3-da0d-4c7c-91e6-a647977556f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:53:14.251943 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f951aa26-f877-45c4-afe5-85dd0fee17d5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1886543783", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "b37d8976-a83d-4eb7-9c66-d17d81c302b6"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:53:14.302330 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-f951aa26-f877-45c4-afe5-85dd0fee17d5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] validate_networks() for [('b37d8976-a83d-4eb7-9c66-d17d81c302b6', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:53:14.660574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f951aa26-f877-45c4-afe5-85dd0fee17d5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:53:14.661060 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f951aa26-f877-45c4-afe5-85dd0fee17d5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:53:14.661550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f951aa26-f877-45c4-afe5-85dd0fee17d5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:53:14.661975 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f951aa26-f877-45c4-afe5-85dd0fee17d5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:53:14.662407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-f951aa26-f877-45c4-afe5-85dd0fee17d5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:53:14.671330 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f951aa26-f877-45c4-afe5-85dd0fee17d5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:14.671792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f951aa26-f877-45c4-afe5-85dd0fee17d5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:14.672608 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f951aa26-f877-45c4-afe5-85dd0fee17d5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:14.673100 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f951aa26-f877-45c4-afe5-85dd0fee17d5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:14.690131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-f951aa26-f877-45c4-afe5-85dd0fee17d5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Getting quotas for project 805edb44db8647cbb5e0bf00b90f7a93. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:53:14.695273 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-f951aa26-f877-45c4-afe5-85dd0fee17d5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Getting quotas for user d9afda5835e8400f8518033d98f1d6e9 and project 805edb44db8647cbb5e0bf00b90f7a93. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:53:14.708114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f951aa26-f877-45c4-afe5-85dd0fee17d5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:53:14.710404 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f951aa26-f877-45c4-afe5-85dd0fee17d5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:53:14.752657 n-d-843621-1 devstack@n-api.service[119248]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f951aa26-f877-45c4-afe5-85dd0fee17d5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [afb36b4d-95cb-487d-833f-752e8a9a2ce9] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 15:53:15.761405 n-d-843621-1 devstack@n-api.service[119248]: INFO oslo.messaging._drivers.impl_rabbit [None req-f951aa26-f877-45c4-afe5-85dd0fee17d5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [afb36b4d-95cb-487d-833f-752e8a9a2ce9] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 44190. May 27 15:53:15.765915 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f951aa26-f877-45c4-afe5-85dd0fee17d5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.634198 May 27 15:53:15.766941 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3479/6970] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:53:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:53:15.777035 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5a5ffa72-98c9-4aae-bb39-5f246d80ec73 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:15.778213 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5a5ffa72-98c9-4aae-bb39-5f246d80ec73 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:15.837259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5a5ffa72-98c9-4aae-bb39-5f246d80ec73 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:15.845825 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5a5ffa72-98c9-4aae-bb39-5f246d80ec73 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1215 microversion: 2.1 time: 0.072699 May 27 15:53:15.846387 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3492/6971] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:15 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:53:16.863851 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-521c13bb-28c6-4856-b3dd-8ee07817b0ee tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:16.865165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-521c13bb-28c6-4856-b3dd-8ee07817b0ee tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:16.872211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-521c13bb-28c6-4856-b3dd-8ee07817b0ee tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:16.872949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-521c13bb-28c6-4856-b3dd-8ee07817b0ee tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:16.873902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-521c13bb-28c6-4856-b3dd-8ee07817b0ee tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:16.874522 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-521c13bb-28c6-4856-b3dd-8ee07817b0ee tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:16.944989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-521c13bb-28c6-4856-b3dd-8ee07817b0ee tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:16.953066 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-521c13bb-28c6-4856-b3dd-8ee07817b0ee tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1275 microversion: 2.1 time: 0.093958 May 27 15:53:16.954399 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3480/6972] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:16 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1275 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:17.972758 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8d18f350-ca3e-487d-b39c-d8301c7638cb tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:17.973372 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8d18f350-ca3e-487d-b39c-d8301c7638cb tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:17.977297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:53:17.981564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d18f350-ca3e-487d-b39c-d8301c7638cb tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:17.982025 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d18f350-ca3e-487d-b39c-d8301c7638cb tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:17.982806 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d18f350-ca3e-487d-b39c-d8301c7638cb tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:17.983250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d18f350-ca3e-487d-b39c-d8301c7638cb tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:18.119061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8d18f350-ca3e-487d-b39c-d8301c7638cb tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:18.126787 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8d18f350-ca3e-487d-b39c-d8301c7638cb tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1315 microversion: 2.1 time: 0.159145 May 27 15:53:18.137350 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3493/6973] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:17 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:18.151723 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-66587e1b-093f-4c3f-8ea7-89cfc8f428a7 req-91035f09-9d8b-4f86-9223-6d232d38f57d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24382bde-cbe4-4376-83db-0803cbebbda5", "tag": "fb76842f-93cf-4618-b1f3-0455c58e3e99"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:53:18.162764 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-66587e1b-093f-4c3f-8ea7-89cfc8f428a7 req-91035f09-9d8b-4f86-9223-6d232d38f57d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:18.163322 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-66587e1b-093f-4c3f-8ea7-89cfc8f428a7 req-91035f09-9d8b-4f86-9223-6d232d38f57d service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:18.175134 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-66587e1b-093f-4c3f-8ea7-89cfc8f428a7 req-91035f09-9d8b-4f86-9223-6d232d38f57d service nova] Creating event network-changed:fb76842f-93cf-4618-b1f3-0455c58e3e99 for instance 24382bde-cbe4-4376-83db-0803cbebbda5 on n-h1-843621-1 May 27 15:53:18.180463 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-66587e1b-093f-4c3f-8ea7-89cfc8f428a7 req-91035f09-9d8b-4f86-9223-6d232d38f57d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032382 May 27 15:53:18.181347 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3481/6974] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:53:19.144619 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-279b5a46-3fa2-4fb6-8d6b-1b1c2a32a94c tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:19.145336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-279b5a46-3fa2-4fb6-8d6b-1b1c2a32a94c tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:19.152471 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-279b5a46-3fa2-4fb6-8d6b-1b1c2a32a94c tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:19.152958 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-279b5a46-3fa2-4fb6-8d6b-1b1c2a32a94c tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:19.153730 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-279b5a46-3fa2-4fb6-8d6b-1b1c2a32a94c tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:19.154177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-279b5a46-3fa2-4fb6-8d6b-1b1c2a32a94c tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:19.283176 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-279b5a46-3fa2-4fb6-8d6b-1b1c2a32a94c tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:19.291071 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-279b5a46-3fa2-4fb6-8d6b-1b1c2a32a94c tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1315 microversion: 2.1 time: 0.150662 May 27 15:53:19.291648 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3494/6975] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:19 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:20.309887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-12a09d48-3f26-4a0c-9af0-23e022ce530a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:20.310635 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-12a09d48-3f26-4a0c-9af0-23e022ce530a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:20.317464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12a09d48-3f26-4a0c-9af0-23e022ce530a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:20.317933 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12a09d48-3f26-4a0c-9af0-23e022ce530a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:20.318718 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12a09d48-3f26-4a0c-9af0-23e022ce530a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:20.319175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-12a09d48-3f26-4a0c-9af0-23e022ce530a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:20.456175 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-12a09d48-3f26-4a0c-9af0-23e022ce530a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:20.463773 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-12a09d48-3f26-4a0c-9af0-23e022ce530a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1315 microversion: 2.1 time: 0.158992 May 27 15:53:20.464345 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3482/6976] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:20 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:21.481294 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-78fa2536-c9ff-49ad-b745-af7857f389cf tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:21.482194 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-78fa2536-c9ff-49ad-b745-af7857f389cf tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:21.490058 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-78fa2536-c9ff-49ad-b745-af7857f389cf tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:21.490510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-78fa2536-c9ff-49ad-b745-af7857f389cf tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:21.491276 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-78fa2536-c9ff-49ad-b745-af7857f389cf tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:21.491718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-78fa2536-c9ff-49ad-b745-af7857f389cf tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:21.624284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-78fa2536-c9ff-49ad-b745-af7857f389cf tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:21.631794 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-78fa2536-c9ff-49ad-b745-af7857f389cf tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1315 microversion: 2.1 time: 0.155013 May 27 15:53:21.632373 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3495/6977] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:21 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:22.649579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-48ea5d71-0b4b-4d2d-92be-a923f99e09c5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:22.650316 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-48ea5d71-0b4b-4d2d-92be-a923f99e09c5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:22.657865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48ea5d71-0b4b-4d2d-92be-a923f99e09c5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:22.658344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48ea5d71-0b4b-4d2d-92be-a923f99e09c5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:22.659165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48ea5d71-0b4b-4d2d-92be-a923f99e09c5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:22.659628 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-48ea5d71-0b4b-4d2d-92be-a923f99e09c5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:22.681349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-e2a3d2e8-8f60-454e-9081-28486748e082 req-bdc81227-3692-4a84-8aae-88c8dbf665dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24382bde-cbe4-4376-83db-0803cbebbda5", "name": "network-vif-plugged", "status": "completed", "tag": "fb76842f-93cf-4618-b1f3-0455c58e3e99"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:53:22.691080 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-e2a3d2e8-8f60-454e-9081-28486748e082 req-bdc81227-3692-4a84-8aae-88c8dbf665dd service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:22.691540 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-e2a3d2e8-8f60-454e-9081-28486748e082 req-bdc81227-3692-4a84-8aae-88c8dbf665dd service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:22.705899 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-e2a3d2e8-8f60-454e-9081-28486748e082 req-bdc81227-3692-4a84-8aae-88c8dbf665dd service nova] Creating event network-vif-plugged:fb76842f-93cf-4618-b1f3-0455c58e3e99 for instance 24382bde-cbe4-4376-83db-0803cbebbda5 on n-h1-843621-1 May 27 15:53:22.711208 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-e2a3d2e8-8f60-454e-9081-28486748e082 req-bdc81227-3692-4a84-8aae-88c8dbf665dd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034095 May 27 15:53:22.712180 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3496/6978] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:53:22.795691 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-48ea5d71-0b4b-4d2d-92be-a923f99e09c5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:22.803256 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-48ea5d71-0b4b-4d2d-92be-a923f99e09c5 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1315 microversion: 2.1 time: 0.158207 May 27 15:53:22.803840 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3483/6979] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:22 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:23.821877 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0babd7ef-c98b-4e6a-b1f4-32d840377543 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:23.822578 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0babd7ef-c98b-4e6a-b1f4-32d840377543 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:23.829693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0babd7ef-c98b-4e6a-b1f4-32d840377543 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:23.830239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0babd7ef-c98b-4e6a-b1f4-32d840377543 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:23.831291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0babd7ef-c98b-4e6a-b1f4-32d840377543 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:23.832048 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0babd7ef-c98b-4e6a-b1f4-32d840377543 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:23.975700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0babd7ef-c98b-4e6a-b1f4-32d840377543 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:23.983116 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0babd7ef-c98b-4e6a-b1f4-32d840377543 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1315 microversion: 2.1 time: 0.165574 May 27 15:53:23.983701 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3497/6980] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:23 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:25.000825 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c57e5720-2c9e-46fe-9775-ac4fb7809f59 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:25.001471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c57e5720-2c9e-46fe-9775-ac4fb7809f59 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:25.004271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=5 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:53:25.005162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=8 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:53:25.010824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c57e5720-2c9e-46fe-9775-ac4fb7809f59 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:25.011308 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c57e5720-2c9e-46fe-9775-ac4fb7809f59 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:25.012100 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c57e5720-2c9e-46fe-9775-ac4fb7809f59 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:25.012562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c57e5720-2c9e-46fe-9775-ac4fb7809f59 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:25.144897 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c57e5720-2c9e-46fe-9775-ac4fb7809f59 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:25.147148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:53:25.153878 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c57e5720-2c9e-46fe-9775-ac4fb7809f59 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1501 microversion: 2.1 time: 0.157017 May 27 15:53:25.154460 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3484/6981] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:24 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:25.170670 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cde58834-75e1-45bf-91ec-6a0f8f59d322 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:53:25.171682 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cde58834-75e1-45bf-91ec-6a0f8f59d322 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:25.178507 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cde58834-75e1-45bf-91ec-6a0f8f59d322 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:25.178967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cde58834-75e1-45bf-91ec-6a0f8f59d322 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:25.179737 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cde58834-75e1-45bf-91ec-6a0f8f59d322 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:25.180180 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cde58834-75e1-45bf-91ec-6a0f8f59d322 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:25.254416 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cde58834-75e1-45bf-91ec-6a0f8f59d322 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:25.260121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cde58834-75e1-45bf-91ec-6a0f8f59d322 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Old instance type m1.heat2, new instance type m1.heat {{(pid=119249) resize /opt/stack/nova/nova/compute/api.py:4166}} May 27 15:53:25.266334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-cde58834-75e1-45bf-91ec-6a0f8f59d322 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:53:25.267385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-cde58834-75e1-45bf-91ec-6a0f8f59d322 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:53:25.267871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-cde58834-75e1-45bf-91ec-6a0f8f59d322 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:53:25.268542 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-cde58834-75e1-45bf-91ec-6a0f8f59d322 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:53:25.268986 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-cde58834-75e1-45bf-91ec-6a0f8f59d322 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:53:25.373416 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cde58834-75e1-45bf-91ec-6a0f8f59d322 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "POST /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5/action" status: 202 len: 0 microversion: 2.1 time: 0.206600 May 27 15:53:25.374203 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3498/6982] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:53:25 2022] POST /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:53:25.382717 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-79100c31-ec19-4cc7-83ce-def145343c2d tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:25.383354 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-79100c31-ec19-4cc7-83ce-def145343c2d tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:25.390611 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-79100c31-ec19-4cc7-83ce-def145343c2d tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:25.391090 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-79100c31-ec19-4cc7-83ce-def145343c2d tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:25.392480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-79100c31-ec19-4cc7-83ce-def145343c2d tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:25.392968 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-79100c31-ec19-4cc7-83ce-def145343c2d tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:25.536112 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-79100c31-ec19-4cc7-83ce-def145343c2d tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:25.544424 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-79100c31-ec19-4cc7-83ce-def145343c2d tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1510 microversion: 2.1 time: 0.165428 May 27 15:53:25.545251 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3485/6983] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:25 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:26.558406 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=4 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:53:26.563774 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c565c2b5-056d-4798-ba96-3f1e7dd5ee13 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:26.564466 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c565c2b5-056d-4798-ba96-3f1e7dd5ee13 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:26.567240 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:53:26.574481 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c565c2b5-056d-4798-ba96-3f1e7dd5ee13 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:26.574950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c565c2b5-056d-4798-ba96-3f1e7dd5ee13 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:26.575740 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c565c2b5-056d-4798-ba96-3f1e7dd5ee13 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:26.576195 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c565c2b5-056d-4798-ba96-3f1e7dd5ee13 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:26.582381 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:53:26.725761 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c565c2b5-056d-4798-ba96-3f1e7dd5ee13 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:26.734801 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c565c2b5-056d-4798-ba96-3f1e7dd5ee13 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1510 microversion: 2.1 time: 0.177208 May 27 15:53:26.735566 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3499/6984] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:26 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:27.752610 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f740bbe3-22cd-45bb-b7e9-63c0a28fde80 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:27.753181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f740bbe3-22cd-45bb-b7e9-63c0a28fde80 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:27.755856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:53:27.761692 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f740bbe3-22cd-45bb-b7e9-63c0a28fde80 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:27.762165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f740bbe3-22cd-45bb-b7e9-63c0a28fde80 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:27.762942 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f740bbe3-22cd-45bb-b7e9-63c0a28fde80 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:27.763397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f740bbe3-22cd-45bb-b7e9-63c0a28fde80 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:27.897256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f740bbe3-22cd-45bb-b7e9-63c0a28fde80 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:27.906149 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f740bbe3-22cd-45bb-b7e9-63c0a28fde80 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.157615 May 27 15:53:27.906732 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3486/6985] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:27 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:28.925131 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ff727772-1423-4f00-900f-7b392454ab3b tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:28.925788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ff727772-1423-4f00-900f-7b392454ab3b tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:28.932760 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff727772-1423-4f00-900f-7b392454ab3b tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:28.933220 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff727772-1423-4f00-900f-7b392454ab3b tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:28.933990 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff727772-1423-4f00-900f-7b392454ab3b tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:28.934437 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff727772-1423-4f00-900f-7b392454ab3b tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:29.070871 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ff727772-1423-4f00-900f-7b392454ab3b tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:29.078442 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ff727772-1423-4f00-900f-7b392454ab3b tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.157846 May 27 15:53:29.079017 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3500/6986] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:28 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:30.095634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a3204ccf-60f2-4896-a833-0e0951435961 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:30.096269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a3204ccf-60f2-4896-a833-0e0951435961 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:30.102986 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a3204ccf-60f2-4896-a833-0e0951435961 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:30.103458 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a3204ccf-60f2-4896-a833-0e0951435961 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:30.104246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a3204ccf-60f2-4896-a833-0e0951435961 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:30.104737 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a3204ccf-60f2-4896-a833-0e0951435961 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:30.232394 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a3204ccf-60f2-4896-a833-0e0951435961 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:30.240518 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a3204ccf-60f2-4896-a833-0e0951435961 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.148949 May 27 15:53:30.241121 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3487/6987] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:30 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:31.258143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-54af9b97-993e-4e53-a51a-526dd62abb6a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:31.258689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-54af9b97-993e-4e53-a51a-526dd62abb6a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:31.265600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54af9b97-993e-4e53-a51a-526dd62abb6a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:31.266059 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54af9b97-993e-4e53-a51a-526dd62abb6a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:31.266829 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54af9b97-993e-4e53-a51a-526dd62abb6a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:31.267278 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-54af9b97-993e-4e53-a51a-526dd62abb6a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:31.401595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-54af9b97-993e-4e53-a51a-526dd62abb6a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:31.409107 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-54af9b97-993e-4e53-a51a-526dd62abb6a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.155164 May 27 15:53:31.409678 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3501/6988] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:31 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:32.426209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-049711e5-f42c-494e-b8c3-b3a94856f155 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:32.426837 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-049711e5-f42c-494e-b8c3-b3a94856f155 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:32.434078 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-049711e5-f42c-494e-b8c3-b3a94856f155 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:32.434548 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-049711e5-f42c-494e-b8c3-b3a94856f155 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:32.435331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-049711e5-f42c-494e-b8c3-b3a94856f155 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:32.435787 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-049711e5-f42c-494e-b8c3-b3a94856f155 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:32.575051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-049711e5-f42c-494e-b8c3-b3a94856f155 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:32.583714 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-049711e5-f42c-494e-b8c3-b3a94856f155 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.161336 May 27 15:53:32.584298 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3488/6989] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:32 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:33.601419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b585da74-83f0-48a1-8678-2f63e896a4b9 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:33.602033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b585da74-83f0-48a1-8678-2f63e896a4b9 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:33.608976 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b585da74-83f0-48a1-8678-2f63e896a4b9 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:33.609433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b585da74-83f0-48a1-8678-2f63e896a4b9 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:33.610205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b585da74-83f0-48a1-8678-2f63e896a4b9 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:33.610655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b585da74-83f0-48a1-8678-2f63e896a4b9 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:33.739010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b585da74-83f0-48a1-8678-2f63e896a4b9 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:33.746667 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b585da74-83f0-48a1-8678-2f63e896a4b9 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.149152 May 27 15:53:33.747237 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3502/6990] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:33 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:34.763747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cd4642bb-60d0-445b-81e2-b2df281108f1 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:34.764289 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cd4642bb-60d0-445b-81e2-b2df281108f1 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:34.771697 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cd4642bb-60d0-445b-81e2-b2df281108f1 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:34.772179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cd4642bb-60d0-445b-81e2-b2df281108f1 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:34.772995 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cd4642bb-60d0-445b-81e2-b2df281108f1 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:34.773461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cd4642bb-60d0-445b-81e2-b2df281108f1 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:34.905930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cd4642bb-60d0-445b-81e2-b2df281108f1 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:34.914069 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cd4642bb-60d0-445b-81e2-b2df281108f1 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.154330 May 27 15:53:34.914646 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3489/6991] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:34 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:35.931672 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f6de39c5-ac9b-4f57-a175-0ad90b13effc tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:35.932295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f6de39c5-ac9b-4f57-a175-0ad90b13effc tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:35.939328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6de39c5-ac9b-4f57-a175-0ad90b13effc tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:35.939789 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6de39c5-ac9b-4f57-a175-0ad90b13effc tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:35.940564 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6de39c5-ac9b-4f57-a175-0ad90b13effc tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:35.941033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f6de39c5-ac9b-4f57-a175-0ad90b13effc tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:36.067126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f6de39c5-ac9b-4f57-a175-0ad90b13effc tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:36.074694 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f6de39c5-ac9b-4f57-a175-0ad90b13effc tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.146987 May 27 15:53:36.075264 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3503/6992] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:35 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:37.092179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b833e5eb-a19e-4592-ae21-b2ca1ac49789 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:37.092746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b833e5eb-a19e-4592-ae21-b2ca1ac49789 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:37.099898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b833e5eb-a19e-4592-ae21-b2ca1ac49789 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:37.100361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b833e5eb-a19e-4592-ae21-b2ca1ac49789 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:37.101179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b833e5eb-a19e-4592-ae21-b2ca1ac49789 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:37.101728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b833e5eb-a19e-4592-ae21-b2ca1ac49789 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:37.253686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b833e5eb-a19e-4592-ae21-b2ca1ac49789 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:37.262764 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b833e5eb-a19e-4592-ae21-b2ca1ac49789 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.174552 May 27 15:53:37.263346 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3490/6993] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:37 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:38.280356 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8ff9252e-c16a-476e-866f-a4e99d2a3933 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:38.281215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8ff9252e-c16a-476e-866f-a4e99d2a3933 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:38.288173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ff9252e-c16a-476e-866f-a4e99d2a3933 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:38.288629 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ff9252e-c16a-476e-866f-a4e99d2a3933 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:38.289509 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ff9252e-c16a-476e-866f-a4e99d2a3933 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:38.289952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8ff9252e-c16a-476e-866f-a4e99d2a3933 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:38.425052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8ff9252e-c16a-476e-866f-a4e99d2a3933 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:38.432634 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8ff9252e-c16a-476e-866f-a4e99d2a3933 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.156905 May 27 15:53:38.433223 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3504/6994] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:38 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:53:39.450228 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8b9d3f48-d956-433e-966d-eef7d72ffef0 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:39.450853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8b9d3f48-d956-433e-966d-eef7d72ffef0 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:39.458674 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b9d3f48-d956-433e-966d-eef7d72ffef0 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:39.459150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b9d3f48-d956-433e-966d-eef7d72ffef0 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:39.459973 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b9d3f48-d956-433e-966d-eef7d72ffef0 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:39.460489 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8b9d3f48-d956-433e-966d-eef7d72ffef0 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:39.594017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8b9d3f48-d956-433e-966d-eef7d72ffef0 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:39.602111 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8b9d3f48-d956-433e-966d-eef7d72ffef0 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.155699 May 27 15:53:39.602699 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3491/6995] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:39 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:40.619360 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5cd59e1c-a4c4-4474-825b-eaa7c7eec89e tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:40.619928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5cd59e1c-a4c4-4474-825b-eaa7c7eec89e tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:40.627171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5cd59e1c-a4c4-4474-825b-eaa7c7eec89e tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:40.627605 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5cd59e1c-a4c4-4474-825b-eaa7c7eec89e tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:40.628363 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5cd59e1c-a4c4-4474-825b-eaa7c7eec89e tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:40.628852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5cd59e1c-a4c4-4474-825b-eaa7c7eec89e tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:40.758046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5cd59e1c-a4c4-4474-825b-eaa7c7eec89e tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:40.765692 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5cd59e1c-a4c4-4474-825b-eaa7c7eec89e tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.150257 May 27 15:53:40.766263 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3505/6996] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:40 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:41.784944 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-05b29cf4-e659-457a-b332-510f74d5c384 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:41.785503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-05b29cf4-e659-457a-b332-510f74d5c384 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:41.792614 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05b29cf4-e659-457a-b332-510f74d5c384 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:41.793132 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05b29cf4-e659-457a-b332-510f74d5c384 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:41.793936 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05b29cf4-e659-457a-b332-510f74d5c384 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:41.794400 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-05b29cf4-e659-457a-b332-510f74d5c384 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:41.946281 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-05b29cf4-e659-457a-b332-510f74d5c384 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:41.956496 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-05b29cf4-e659-457a-b332-510f74d5c384 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.176811 May 27 15:53:41.961277 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3492/6997] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:41 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:42.982309 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-12bd35e5-78d0-4516-8130-5e982c2e7e15 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:42.982932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-12bd35e5-78d0-4516-8130-5e982c2e7e15 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:42.989976 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12bd35e5-78d0-4516-8130-5e982c2e7e15 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:42.990440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12bd35e5-78d0-4516-8130-5e982c2e7e15 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:42.991210 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12bd35e5-78d0-4516-8130-5e982c2e7e15 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:42.991654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12bd35e5-78d0-4516-8130-5e982c2e7e15 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:43.126649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-12bd35e5-78d0-4516-8130-5e982c2e7e15 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:43.135353 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-12bd35e5-78d0-4516-8130-5e982c2e7e15 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.157038 May 27 15:53:43.135941 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3506/6998] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:42 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:44.153246 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-6169046a-71a6-4384-8b0a-36ca7c2e0f84 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:44.153770 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-6169046a-71a6-4384-8b0a-36ca7c2e0f84 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:44.161604 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6169046a-71a6-4384-8b0a-36ca7c2e0f84 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:44.162082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6169046a-71a6-4384-8b0a-36ca7c2e0f84 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:44.162875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6169046a-71a6-4384-8b0a-36ca7c2e0f84 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:44.163342 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-6169046a-71a6-4384-8b0a-36ca7c2e0f84 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:44.291889 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-6169046a-71a6-4384-8b0a-36ca7c2e0f84 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:44.299537 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-6169046a-71a6-4384-8b0a-36ca7c2e0f84 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.150281 May 27 15:53:44.300126 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3493/6999] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:44 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:45.317482 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ab75cde9-4f56-4fe8-8f2b-f5459b12ce68 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:45.318308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ab75cde9-4f56-4fe8-8f2b-f5459b12ce68 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:45.325076 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab75cde9-4f56-4fe8-8f2b-f5459b12ce68 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:45.325528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab75cde9-4f56-4fe8-8f2b-f5459b12ce68 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:45.326291 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab75cde9-4f56-4fe8-8f2b-f5459b12ce68 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:45.326729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ab75cde9-4f56-4fe8-8f2b-f5459b12ce68 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:45.460138 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ab75cde9-4f56-4fe8-8f2b-f5459b12ce68 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:45.467611 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ab75cde9-4f56-4fe8-8f2b-f5459b12ce68 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.154734 May 27 15:53:45.468193 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3507/7000] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:45 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:46.485500 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e2f56f18-10bc-4547-a156-001a44bf9f6c tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:46.486141 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e2f56f18-10bc-4547-a156-001a44bf9f6c tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:46.493636 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2f56f18-10bc-4547-a156-001a44bf9f6c tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:46.494118 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2f56f18-10bc-4547-a156-001a44bf9f6c tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:46.494919 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2f56f18-10bc-4547-a156-001a44bf9f6c tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:46.495382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e2f56f18-10bc-4547-a156-001a44bf9f6c tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:46.623578 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e2f56f18-10bc-4547-a156-001a44bf9f6c tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:46.631112 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e2f56f18-10bc-4547-a156-001a44bf9f6c tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.149491 May 27 15:53:46.631700 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3494/7001] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:46 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:47.648791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-76b08dd3-8a3d-4f76-83d1-03675d92a12b tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:47.649403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-76b08dd3-8a3d-4f76-83d1-03675d92a12b tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:47.656364 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76b08dd3-8a3d-4f76-83d1-03675d92a12b tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:47.656856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76b08dd3-8a3d-4f76-83d1-03675d92a12b tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:47.657620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76b08dd3-8a3d-4f76-83d1-03675d92a12b tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:47.658061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76b08dd3-8a3d-4f76-83d1-03675d92a12b tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:47.787731 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-76b08dd3-8a3d-4f76-83d1-03675d92a12b tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:47.795325 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-76b08dd3-8a3d-4f76-83d1-03675d92a12b tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.150440 May 27 15:53:47.795900 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3508/7002] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:47 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:48.813277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c9a528c1-fe39-47ef-8b75-ce619691c6b2 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:48.814061 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c9a528c1-fe39-47ef-8b75-ce619691c6b2 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:48.823338 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c9a528c1-fe39-47ef-8b75-ce619691c6b2 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:48.823941 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c9a528c1-fe39-47ef-8b75-ce619691c6b2 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:48.824978 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c9a528c1-fe39-47ef-8b75-ce619691c6b2 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:48.825531 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c9a528c1-fe39-47ef-8b75-ce619691c6b2 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:48.963794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c9a528c1-fe39-47ef-8b75-ce619691c6b2 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:48.971475 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c9a528c1-fe39-47ef-8b75-ce619691c6b2 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.163170 May 27 15:53:48.972059 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3495/7003] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:48 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:49.989704 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-95d7507f-72e2-44fb-a859-45fcaecd1958 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:49.990377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-95d7507f-72e2-44fb-a859-45fcaecd1958 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:49.997837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-95d7507f-72e2-44fb-a859-45fcaecd1958 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:49.998397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-95d7507f-72e2-44fb-a859-45fcaecd1958 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:49.999173 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-95d7507f-72e2-44fb-a859-45fcaecd1958 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:49.999606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-95d7507f-72e2-44fb-a859-45fcaecd1958 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:50.132936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-95d7507f-72e2-44fb-a859-45fcaecd1958 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:50.140429 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-95d7507f-72e2-44fb-a859-45fcaecd1958 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.155149 May 27 15:53:50.141035 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3509/7004] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:49 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:51.157857 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8f19c6e5-11f3-4ada-b68e-c6f8cdead6e6 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:51.158483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8f19c6e5-11f3-4ada-b68e-c6f8cdead6e6 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:51.165484 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f19c6e5-11f3-4ada-b68e-c6f8cdead6e6 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:51.165952 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f19c6e5-11f3-4ada-b68e-c6f8cdead6e6 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:51.166726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f19c6e5-11f3-4ada-b68e-c6f8cdead6e6 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:51.167181 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8f19c6e5-11f3-4ada-b68e-c6f8cdead6e6 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:51.305575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8f19c6e5-11f3-4ada-b68e-c6f8cdead6e6 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:51.313384 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8f19c6e5-11f3-4ada-b68e-c6f8cdead6e6 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.159472 May 27 15:53:51.313960 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3496/7005] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:51 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:53:52.332124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-db15237d-f153-4603-8c0a-8882b786d981 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:52.333400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-db15237d-f153-4603-8c0a-8882b786d981 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:52.340537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db15237d-f153-4603-8c0a-8882b786d981 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:52.340977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db15237d-f153-4603-8c0a-8882b786d981 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:52.341755 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db15237d-f153-4603-8c0a-8882b786d981 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:52.342205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-db15237d-f153-4603-8c0a-8882b786d981 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:52.482752 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-db15237d-f153-4603-8c0a-8882b786d981 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:52.490948 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-db15237d-f153-4603-8c0a-8882b786d981 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.163317 May 27 15:53:52.491828 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3510/7006] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:52 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:53.513850 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e496b445-7c4d-42fe-88f5-927c82964b68 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:53.514502 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e496b445-7c4d-42fe-88f5-927c82964b68 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:53.522443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e496b445-7c4d-42fe-88f5-927c82964b68 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:53.522917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e496b445-7c4d-42fe-88f5-927c82964b68 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:53.523702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e496b445-7c4d-42fe-88f5-927c82964b68 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:53.524162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e496b445-7c4d-42fe-88f5-927c82964b68 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:53.658590 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e496b445-7c4d-42fe-88f5-927c82964b68 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:53.666346 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e496b445-7c4d-42fe-88f5-927c82964b68 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.157255 May 27 15:53:53.666912 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3497/7007] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:53 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:54.683778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-065a5a40-9ad2-4ff5-924e-6459835ebc8f tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:54.684401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-065a5a40-9ad2-4ff5-924e-6459835ebc8f tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:54.691378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-065a5a40-9ad2-4ff5-924e-6459835ebc8f tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:54.691836 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-065a5a40-9ad2-4ff5-924e-6459835ebc8f tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:54.692612 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-065a5a40-9ad2-4ff5-924e-6459835ebc8f tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:54.693085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-065a5a40-9ad2-4ff5-924e-6459835ebc8f tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:54.827290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-065a5a40-9ad2-4ff5-924e-6459835ebc8f tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:54.836747 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-065a5a40-9ad2-4ff5-924e-6459835ebc8f tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1515 microversion: 2.1 time: 0.156838 May 27 15:53:54.837345 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3511/7008] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:54 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:55.381528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-259413d7-b487-412e-a960-31ca2f089002 req-2e051003-0921-432e-afff-9dfc63e5c488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24382bde-cbe4-4376-83db-0803cbebbda5", "name": "network-vif-unplugged", "status": "completed", "tag": "fb76842f-93cf-4618-b1f3-0455c58e3e99"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:53:55.391270 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-259413d7-b487-412e-a960-31ca2f089002 req-2e051003-0921-432e-afff-9dfc63e5c488 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:55.391839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-259413d7-b487-412e-a960-31ca2f089002 req-2e051003-0921-432e-afff-9dfc63e5c488 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:55.397282 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=80 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:53:55.405795 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-259413d7-b487-412e-a960-31ca2f089002 req-2e051003-0921-432e-afff-9dfc63e5c488 service nova] Creating event network-vif-unplugged:fb76842f-93cf-4618-b1f3-0455c58e3e99 for instance 24382bde-cbe4-4376-83db-0803cbebbda5 on n-h2-843621-1 May 27 15:53:55.411569 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [req-259413d7-b487-412e-a960-31ca2f089002 req-2e051003-0921-432e-afff-9dfc63e5c488 service nova] Instance 24382bde-cbe4-4376-83db-0803cbebbda5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119248) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 15:53:55.424271 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-259413d7-b487-412e-a960-31ca2f089002 req-2e051003-0921-432e-afff-9dfc63e5c488 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046900 May 27 15:53:55.425364 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3498/7009] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:53:55.862315 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4b07f196-724d-4310-8806-b37b7554d7b8 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:55.863206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4b07f196-724d-4310-8806-b37b7554d7b8 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:55.870786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b07f196-724d-4310-8806-b37b7554d7b8 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:55.871253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b07f196-724d-4310-8806-b37b7554d7b8 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:55.872098 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b07f196-724d-4310-8806-b37b7554d7b8 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:55.872552 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4b07f196-724d-4310-8806-b37b7554d7b8 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:56.091566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4b07f196-724d-4310-8806-b37b7554d7b8 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:56.100268 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4b07f196-724d-4310-8806-b37b7554d7b8 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1514 microversion: 2.1 time: 0.241350 May 27 15:53:56.101003 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3512/7010] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:55 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:57.118288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-29524678-2946-4806-ad0e-5b72fa628ccc tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:57.119043 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-29524678-2946-4806-ad0e-5b72fa628ccc tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:57.126263 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29524678-2946-4806-ad0e-5b72fa628ccc tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:57.126746 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29524678-2946-4806-ad0e-5b72fa628ccc tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:57.127541 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29524678-2946-4806-ad0e-5b72fa628ccc tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:57.128008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-29524678-2946-4806-ad0e-5b72fa628ccc tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:57.442745 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-3bad3d0c-38bc-40f1-9cc2-49ea0167c7b9 req-edc0b847-ebf9-4946-97ea-0af268d36558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24382bde-cbe4-4376-83db-0803cbebbda5", "tag": "fb76842f-93cf-4618-b1f3-0455c58e3e99"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:53:57.447349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=28 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:53:57.453377 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3bad3d0c-38bc-40f1-9cc2-49ea0167c7b9 req-edc0b847-ebf9-4946-97ea-0af268d36558 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:57.453828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3bad3d0c-38bc-40f1-9cc2-49ea0167c7b9 req-edc0b847-ebf9-4946-97ea-0af268d36558 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:57.458145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=84 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:53:57.467323 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-3bad3d0c-38bc-40f1-9cc2-49ea0167c7b9 req-edc0b847-ebf9-4946-97ea-0af268d36558 service nova] Creating event network-changed:fb76842f-93cf-4618-b1f3-0455c58e3e99 for instance 24382bde-cbe4-4376-83db-0803cbebbda5 on n-h2-843621-1 May 27 15:53:57.473162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [req-3bad3d0c-38bc-40f1-9cc2-49ea0167c7b9 req-edc0b847-ebf9-4946-97ea-0af268d36558 service nova] Instance 24382bde-cbe4-4376-83db-0803cbebbda5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119249) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 15:53:57.486003 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-3bad3d0c-38bc-40f1-9cc2-49ea0167c7b9 req-edc0b847-ebf9-4946-97ea-0af268d36558 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047217 May 27 15:53:57.486793 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3513/7011] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:53:57.586529 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-29524678-2946-4806-ad0e-5b72fa628ccc tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:57.595377 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-29524678-2946-4806-ad0e-5b72fa628ccc tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1512 microversion: 2.1 time: 0.481284 May 27 15:53:57.596225 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3499/7012] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:57 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1512 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:58.614162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-be6d0e53-c306-4a6b-9460-76488170f933 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:58.614803 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-be6d0e53-c306-4a6b-9460-76488170f933 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:58.622354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be6d0e53-c306-4a6b-9460-76488170f933 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:58.622820 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be6d0e53-c306-4a6b-9460-76488170f933 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:58.623600 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be6d0e53-c306-4a6b-9460-76488170f933 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:58.624049 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-be6d0e53-c306-4a6b-9460-76488170f933 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:58.762184 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-be6d0e53-c306-4a6b-9460-76488170f933 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:53:58.770239 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-be6d0e53-c306-4a6b-9460-76488170f933 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1509 microversion: 2.1 time: 0.160507 May 27 15:53:58.770821 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3514/7013] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:53:58 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:53:58.786905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-38a247c6-9b6a-4eec-9663-9a18860fe10a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:53:58.788342 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-38a247c6-9b6a-4eec-9663-9a18860fe10a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:53:58.791207 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=28 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:53:58.796828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-38a247c6-9b6a-4eec-9663-9a18860fe10a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:58.797304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-38a247c6-9b6a-4eec-9663-9a18860fe10a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:58.798135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-38a247c6-9b6a-4eec-9663-9a18860fe10a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:58.798737 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-38a247c6-9b6a-4eec-9663-9a18860fe10a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:58.826218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-38a247c6-9b6a-4eec-9663-9a18860fe10a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:53:58.879531 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.compute.api [None req-38a247c6-9b6a-4eec-9663-9a18860fe10a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Found an unconfirmed migration during delete, id: 16, status: finished May 27 15:53:59.215623 n-d-843621-1 devstack@n-api.service[119249]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:53:59.215879 n-d-843621-1 devstack@n-api.service[119249]: Fri May 27 15:53:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:53:59.777800 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-3eba5335-f8a6-4a8b-8aca-85f35451144f req-b73ade6c-5292-4fd4-aa10-3cc3207459b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24382bde-cbe4-4376-83db-0803cbebbda5", "name": "network-vif-plugged", "status": "completed", "tag": "fb76842f-93cf-4618-b1f3-0455c58e3e99"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:53:59.789265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3eba5335-f8a6-4a8b-8aca-85f35451144f req-b73ade6c-5292-4fd4-aa10-3cc3207459b0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:53:59.789693 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-3eba5335-f8a6-4a8b-8aca-85f35451144f req-b73ade6c-5292-4fd4-aa10-3cc3207459b0 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:53:59.802317 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-3eba5335-f8a6-4a8b-8aca-85f35451144f req-b73ade6c-5292-4fd4-aa10-3cc3207459b0 service nova] Creating event network-vif-plugged:fb76842f-93cf-4618-b1f3-0455c58e3e99 for instance 24382bde-cbe4-4376-83db-0803cbebbda5 on n-h2-843621-1 May 27 15:53:59.808923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [req-3eba5335-f8a6-4a8b-8aca-85f35451144f req-b73ade6c-5292-4fd4-aa10-3cc3207459b0 service nova] Instance 24382bde-cbe4-4376-83db-0803cbebbda5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119249) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 15:53:59.820791 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-3eba5335-f8a6-4a8b-8aca-85f35451144f req-b73ade6c-5292-4fd4-aa10-3cc3207459b0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046422 May 27 15:53:59.821614 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3515/7014] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:54:00.227038 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-38a247c6-9b6a-4eec-9663-9a18860fe10a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "DELETE /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 204 len: 0 microversion: 2.1 time: 1.443632 May 27 15:54:00.227669 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3500/7015] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:53:58 2022] DELETE /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 0 bytes in 1445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:54:00.236545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bfc93f67-d8fe-4169-b757-5414a634284d tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:00.237328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bfc93f67-d8fe-4169-b757-5414a634284d tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:00.244194 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bfc93f67-d8fe-4169-b757-5414a634284d tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:00.244666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bfc93f67-d8fe-4169-b757-5414a634284d tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:00.245470 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bfc93f67-d8fe-4169-b757-5414a634284d tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:00.245920 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bfc93f67-d8fe-4169-b757-5414a634284d tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:00.391051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bfc93f67-d8fe-4169-b757-5414a634284d tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:00.399220 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bfc93f67-d8fe-4169-b757-5414a634284d tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1501 microversion: 2.1 time: 0.167064 May 27 15:54:00.399802 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3516/7016] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:00 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:01.417095 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-448db228-32c2-49f4-ba77-86cd2b99e894 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:01.417845 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-448db228-32c2-49f4-ba77-86cd2b99e894 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:01.425256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-448db228-32c2-49f4-ba77-86cd2b99e894 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:01.425721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-448db228-32c2-49f4-ba77-86cd2b99e894 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:01.426519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-448db228-32c2-49f4-ba77-86cd2b99e894 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:01.427041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-448db228-32c2-49f4-ba77-86cd2b99e894 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:01.612624 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-448db228-32c2-49f4-ba77-86cd2b99e894 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9afda5835e8400f8518033d98f1d6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '805edb44db8647cbb5e0bf00b90f7a93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:01.620799 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-448db228-32c2-49f4-ba77-86cd2b99e894 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 200 len: 1501 microversion: 2.1 time: 0.208665 May 27 15:54:01.621387 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3501/7017] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:01 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 1501 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:02.038367 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-f742dcc2-15a3-4b7c-b65c-8414fc3e39ff req-321a5ea9-f21c-446f-a4cc-664c080f3b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24382bde-cbe4-4376-83db-0803cbebbda5", "name": "network-vif-deleted", "tag": "fb76842f-93cf-4618-b1f3-0455c58e3e99"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:54:02.048177 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f742dcc2-15a3-4b7c-b65c-8414fc3e39ff req-321a5ea9-f21c-446f-a4cc-664c080f3b3b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:02.048587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-f742dcc2-15a3-4b7c-b65c-8414fc3e39ff req-321a5ea9-f21c-446f-a4cc-664c080f3b3b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:02.060724 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-f742dcc2-15a3-4b7c-b65c-8414fc3e39ff req-321a5ea9-f21c-446f-a4cc-664c080f3b3b service nova] Creating event network-vif-deleted:fb76842f-93cf-4618-b1f3-0455c58e3e99 for instance 24382bde-cbe4-4376-83db-0803cbebbda5 on n-h2-843621-1 May 27 15:54:02.066196 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-f742dcc2-15a3-4b7c-b65c-8414fc3e39ff req-321a5ea9-f21c-446f-a4cc-664c080f3b3b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031927 May 27 15:54:02.066890 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3517/7018] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:54:02.638509 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-881c6f23-6973-4cec-86a3-1cfaf2ae86dd tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:02.639154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-881c6f23-6973-4cec-86a3-1cfaf2ae86dd tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:02.646517 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-881c6f23-6973-4cec-86a3-1cfaf2ae86dd tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:02.647618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-881c6f23-6973-4cec-86a3-1cfaf2ae86dd tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:02.648407 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-881c6f23-6973-4cec-86a3-1cfaf2ae86dd tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:02.648905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-881c6f23-6973-4cec-86a3-1cfaf2ae86dd tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:02.663277 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-881c6f23-6973-4cec-86a3-1cfaf2ae86dd tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] HTTP exception thrown: Instance 24382bde-cbe4-4376-83db-0803cbebbda5 could not be found. May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-881c6f23-6973-4cec-86a3-1cfaf2ae86dd tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Request method failure captured: May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 HTTP/1.1 May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikPPqr1WHcjsMjLp8bKdZHZNjMDR4tHG9mRjbcn3GjWXmtYFKU0riO0kC8kX9dudvfHpqYIfNndcCRg1fSwJhhpv8mdb2MJVokG8YdfyN3L1-4GcEJe8V2mpsmu2XD82e9GLqY4iEgNxZvNnettSvZmTT9_TlNr6lYTxtMO7T9d8a0bI May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 805edb44db8647cbb5e0bf00b90f7a93 May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-DeleteServersTestJSON-1050445509 May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/805edb44db8647cbb5e0bf00b90f7a93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/805edb44db8647cbb5e0bf00b90f7a93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/805edb44db8647cbb5e0bf00b90f7a93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_805edb44db8647cbb5e0bf00b90f7a93", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-DeleteServersTestJSON-1050445509 May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 805edb44db8647cbb5e0bf00b90f7a93 May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-DeleteServersTestJSON-1050445509 May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-DeleteServersTestJSON-1050445509-project May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: d9afda5835e8400f8518033d98f1d6e9 May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-DeleteServersTestJSON-1050445509-project May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 24382bde-cbe4-4376-83db-0803cbebbda5 could not be found. May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '24382bde-cbe4-4376-83db-0803cbebbda5'} May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24382bde-cbe4-4376-83db-0803cbebbda5 could not be found. May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24382bde-cbe4-4376-83db-0803cbebbda5 could not be found. May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:54:02.665010 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:54:02.670329 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:54:02.670329 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:54:02.670329 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:54:02.670329 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:54:02.670329 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:54:02.670329 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24382bde-cbe4-4376-83db-0803cbebbda5 could not be found. May 27 15:54:02.670329 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:54:02.670329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-881c6f23-6973-4cec-86a3-1cfaf2ae86dd tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Returning 404 to user: Instance 24382bde-cbe4-4376-83db-0803cbebbda5 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:54:02.670329 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-881c6f23-6973-4cec-86a3-1cfaf2ae86dd tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 404 len: 111 microversion: 2.1 time: 0.031875 May 27 15:54:02.670329 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3502/7019] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:02 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:54:02.681971 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ebeb6ed5-e1a0-4306-b6b3-d0e961bb420a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:02.682553 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ebeb6ed5-e1a0-4306-b6b3-d0e961bb420a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:02.688778 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ebeb6ed5-e1a0-4306-b6b3-d0e961bb420a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:02.689233 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ebeb6ed5-e1a0-4306-b6b3-d0e961bb420a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:02.689991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ebeb6ed5-e1a0-4306-b6b3-d0e961bb420a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:02.690429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ebeb6ed5-e1a0-4306-b6b3-d0e961bb420a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:02.704504 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-ebeb6ed5-e1a0-4306-b6b3-d0e961bb420a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] HTTP exception thrown: Instance 24382bde-cbe4-4376-83db-0803cbebbda5 could not be found. May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ebeb6ed5-e1a0-4306-b6b3-d0e961bb420a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Request method failure captured: May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: request: DELETE /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 HTTP/1.1 May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikPPqr1WHcjsMjLp8bKdZHZNjMDR4tHG9mRjbcn3GjWXmtYFKU0riO0kC8kX9dudvfHpqYIfNndcCRg1fSwJhhpv8mdb2MJVokG8YdfyN3L1-4GcEJe8V2mpsmu2XD82e9GLqY4iEgNxZvNnettSvZmTT9_TlNr6lYTxtMO7T9d8a0bI May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 805edb44db8647cbb5e0bf00b90f7a93 May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-DeleteServersTestJSON-1050445509 May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/805edb44db8647cbb5e0bf00b90f7a93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/805edb44db8647cbb5e0bf00b90f7a93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/805edb44db8647cbb5e0bf00b90f7a93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_805edb44db8647cbb5e0bf00b90f7a93", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-DeleteServersTestJSON-1050445509 May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 805edb44db8647cbb5e0bf00b90f7a93 May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-DeleteServersTestJSON-1050445509 May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-DeleteServersTestJSON-1050445509-project May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: d9afda5835e8400f8518033d98f1d6e9 May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-DeleteServersTestJSON-1050445509-project May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 24382bde-cbe4-4376-83db-0803cbebbda5 could not be found. May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '24382bde-cbe4-4376-83db-0803cbebbda5'} May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24382bde-cbe4-4376-83db-0803cbebbda5 could not be found. May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:54:02.706197 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:54:02.712241 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24382bde-cbe4-4376-83db-0803cbebbda5 could not be found. May 27 15:54:02.712241 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:54:02.712241 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:54:02.712241 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:54:02.712241 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:54:02.712241 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:54:02.712241 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:54:02.712241 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:54:02.712241 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:54:02.712241 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24382bde-cbe4-4376-83db-0803cbebbda5 could not be found. May 27 15:54:02.712241 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:54:02.712241 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ebeb6ed5-e1a0-4306-b6b3-d0e961bb420a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Returning 404 to user: Instance 24382bde-cbe4-4376-83db-0803cbebbda5 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:54:02.712241 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ebeb6ed5-e1a0-4306-b6b3-d0e961bb420a tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "DELETE /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 404 len: 111 microversion: 2.1 time: 0.029987 May 27 15:54:02.712241 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3518/7020] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:54:02 2022] DELETE /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:54:02.717178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c549f29a-8f6e-4228-9e85-cfb6ca8c0070 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:02.717856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c549f29a-8f6e-4228-9e85-cfb6ca8c0070 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] [instance: 24382bde-cbe4-4376-83db-0803cbebbda5] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:02.724811 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c549f29a-8f6e-4228-9e85-cfb6ca8c0070 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:02.725804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c549f29a-8f6e-4228-9e85-cfb6ca8c0070 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:02.726609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c549f29a-8f6e-4228-9e85-cfb6ca8c0070 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:02.727076 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c549f29a-8f6e-4228-9e85-cfb6ca8c0070 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:02.741651 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-c549f29a-8f6e-4228-9e85-cfb6ca8c0070 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] HTTP exception thrown: Instance 24382bde-cbe4-4376-83db-0803cbebbda5 could not be found. May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c549f29a-8f6e-4228-9e85-cfb6ca8c0070 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Request method failure captured: May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 HTTP/1.1 May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikPPqr1WHcjsMjLp8bKdZHZNjMDR4tHG9mRjbcn3GjWXmtYFKU0riO0kC8kX9dudvfHpqYIfNndcCRg1fSwJhhpv8mdb2MJVokG8YdfyN3L1-4GcEJe8V2mpsmu2XD82e9GLqY4iEgNxZvNnettSvZmTT9_TlNr6lYTxtMO7T9d8a0bI May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 805edb44db8647cbb5e0bf00b90f7a93 May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-DeleteServersTestJSON-1050445509 May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/805edb44db8647cbb5e0bf00b90f7a93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/805edb44db8647cbb5e0bf00b90f7a93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/805edb44db8647cbb5e0bf00b90f7a93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_805edb44db8647cbb5e0bf00b90f7a93", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-DeleteServersTestJSON-1050445509 May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 805edb44db8647cbb5e0bf00b90f7a93 May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-DeleteServersTestJSON-1050445509 May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-DeleteServersTestJSON-1050445509-project May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: d9afda5835e8400f8518033d98f1d6e9 May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-DeleteServersTestJSON-1050445509-project May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance 24382bde-cbe4-4376-83db-0803cbebbda5 could not be found. May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': '24382bde-cbe4-4376-83db-0803cbebbda5'} May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24382bde-cbe4-4376-83db-0803cbebbda5 could not be found. May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24382bde-cbe4-4376-83db-0803cbebbda5 could not be found. May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:54:02.743245 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:54:02.748749 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:54:02.748749 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:54:02.748749 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:54:02.748749 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:54:02.748749 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:54:02.748749 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24382bde-cbe4-4376-83db-0803cbebbda5 could not be found. May 27 15:54:02.748749 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:54:02.748749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c549f29a-8f6e-4228-9e85-cfb6ca8c0070 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] Returning 404 to user: Instance 24382bde-cbe4-4376-83db-0803cbebbda5 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:54:02.748749 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c549f29a-8f6e-4228-9e85-cfb6ca8c0070 tempest-DeleteServersTestJSON-1050445509 tempest-DeleteServersTestJSON-1050445509-project] 10.222.0.13 "GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5" status: 404 len: 111 microversion: 2.1 time: 0.031504 May 27 15:54:02.748749 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3503/7021] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:02 2022] GET /compute/v2.1/servers/24382bde-cbe4-4376-83db-0803cbebbda5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:54:05.582223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-dceddb61-c484-431b-ae18-95b80007ef01 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1902978232", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "2209191c-9289-4ef6-9c5e-4802b4f573c8"}]}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:54:05.635207 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-dceddb61-c484-431b-ae18-95b80007ef01 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] validate_networks() for [('2209191c-9289-4ef6-9c5e-4802b4f573c8', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:54:06.010893 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-dceddb61-c484-431b-ae18-95b80007ef01 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:54:06.011322 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-dceddb61-c484-431b-ae18-95b80007ef01 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:54:06.011802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-dceddb61-c484-431b-ae18-95b80007ef01 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:54:06.012253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-dceddb61-c484-431b-ae18-95b80007ef01 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:54:06.012733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-dceddb61-c484-431b-ae18-95b80007ef01 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:54:06.022449 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dceddb61-c484-431b-ae18-95b80007ef01 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:06.022910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dceddb61-c484-431b-ae18-95b80007ef01 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:06.024253 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dceddb61-c484-431b-ae18-95b80007ef01 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:06.024718 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-dceddb61-c484-431b-ae18-95b80007ef01 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:06.042160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-dceddb61-c484-431b-ae18-95b80007ef01 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Getting quotas for project 81229c6bb3044a7fba4fe081f35d3b21. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:54:06.047421 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-dceddb61-c484-431b-ae18-95b80007ef01 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Getting quotas for user c8827c7bc3994623b020b5a3d1feb785 and project 81229c6bb3044a7fba4fe081f35d3b21. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:54:06.064953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dceddb61-c484-431b-ae18-95b80007ef01 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:54:06.067296 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-dceddb61-c484-431b-ae18-95b80007ef01 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:54:06.113253 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-dceddb61-c484-431b-ae18-95b80007ef01 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655060 May 27 15:54:06.113922 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3519/7022] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:54:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:54:06.124107 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1d5e0855-c2b1-4bba-9987-6a3848469a90 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:06.124859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1d5e0855-c2b1-4bba-9987-6a3848469a90 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:06.185554 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1d5e0855-c2b1-4bba-9987-6a3848469a90 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:06.193220 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1d5e0855-c2b1-4bba-9987-6a3848469a90 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1218 microversion: 2.1 time: 0.073042 May 27 15:54:06.193791 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3504/7023] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:06 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:07.210838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5513d670-7ea2-4b33-98cb-7de3539d4e94 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:07.211499 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5513d670-7ea2-4b33-98cb-7de3539d4e94 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:07.218632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5513d670-7ea2-4b33-98cb-7de3539d4e94 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:07.219089 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5513d670-7ea2-4b33-98cb-7de3539d4e94 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:07.219890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5513d670-7ea2-4b33-98cb-7de3539d4e94 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:07.220334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5513d670-7ea2-4b33-98cb-7de3539d4e94 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:07.297903 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5513d670-7ea2-4b33-98cb-7de3539d4e94 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:07.306703 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5513d670-7ea2-4b33-98cb-7de3539d4e94 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1276 microversion: 2.1 time: 0.100585 May 27 15:54:07.307410 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3520/7024] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:07 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1276 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:08.325397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1856da85-1bcb-47f0-b4e6-d283782b37bc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:08.326099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1856da85-1bcb-47f0-b4e6-d283782b37bc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:08.332731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1856da85-1bcb-47f0-b4e6-d283782b37bc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:08.333183 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1856da85-1bcb-47f0-b4e6-d283782b37bc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:08.333994 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1856da85-1bcb-47f0-b4e6-d283782b37bc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:08.334480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1856da85-1bcb-47f0-b4e6-d283782b37bc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:08.373272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-2c50aa27-5ceb-43a1-8a7a-cd269345b40e req-32426d59-ac0f-4843-be08-cb7c1bcbbcca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1c99736-8e53-4188-8064-aa06ddaa5c1c", "tag": "7cd1da6a-ebd9-4b06-b22f-50a46aac23dc"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:54:08.394384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2c50aa27-5ceb-43a1-8a7a-cd269345b40e req-32426d59-ac0f-4843-be08-cb7c1bcbbcca service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:08.394622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-2c50aa27-5ceb-43a1-8a7a-cd269345b40e req-32426d59-ac0f-4843-be08-cb7c1bcbbcca service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:08.407667 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-2c50aa27-5ceb-43a1-8a7a-cd269345b40e req-32426d59-ac0f-4843-be08-cb7c1bcbbcca service nova] Creating event network-changed:7cd1da6a-ebd9-4b06-b22f-50a46aac23dc for instance a1c99736-8e53-4188-8064-aa06ddaa5c1c on n-h2-843621-1 May 27 15:54:08.412808 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-2c50aa27-5ceb-43a1-8a7a-cd269345b40e req-32426d59-ac0f-4843-be08-cb7c1bcbbcca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043272 May 27 15:54:08.413478 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3521/7025] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:54:08.591629 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1856da85-1bcb-47f0-b4e6-d283782b37bc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:08.599284 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1856da85-1bcb-47f0-b4e6-d283782b37bc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1318 microversion: 2.1 time: 0.278371 May 27 15:54:08.599820 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3505/7026] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:08 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:09.618845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-24c4d63f-0a17-48f0-ad60-ebc87a3aca98 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:09.619454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-24c4d63f-0a17-48f0-ad60-ebc87a3aca98 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:09.626924 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-24c4d63f-0a17-48f0-ad60-ebc87a3aca98 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:09.627385 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-24c4d63f-0a17-48f0-ad60-ebc87a3aca98 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:09.628170 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-24c4d63f-0a17-48f0-ad60-ebc87a3aca98 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:09.628620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-24c4d63f-0a17-48f0-ad60-ebc87a3aca98 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:09.853340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-24c4d63f-0a17-48f0-ad60-ebc87a3aca98 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:09.861188 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-24c4d63f-0a17-48f0-ad60-ebc87a3aca98 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1318 microversion: 2.1 time: 0.248055 May 27 15:54:09.861766 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3522/7027] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:09 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:10.879310 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-77b25e0d-4c8a-4090-9093-db87d11331e0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:10.879980 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-77b25e0d-4c8a-4090-9093-db87d11331e0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:10.888192 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77b25e0d-4c8a-4090-9093-db87d11331e0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:10.888792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77b25e0d-4c8a-4090-9093-db87d11331e0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:10.889660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77b25e0d-4c8a-4090-9093-db87d11331e0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:10.890165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77b25e0d-4c8a-4090-9093-db87d11331e0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:11.025488 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-77b25e0d-4c8a-4090-9093-db87d11331e0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:11.033115 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-77b25e0d-4c8a-4090-9093-db87d11331e0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1318 microversion: 2.1 time: 0.157886 May 27 15:54:11.033702 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3506/7028] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:10 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:12.050544 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5274b8ae-ee46-4dd6-9d0a-1e2d65e8bfa4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:12.051168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5274b8ae-ee46-4dd6-9d0a-1e2d65e8bfa4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:12.058657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5274b8ae-ee46-4dd6-9d0a-1e2d65e8bfa4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:12.059205 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5274b8ae-ee46-4dd6-9d0a-1e2d65e8bfa4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:12.059980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5274b8ae-ee46-4dd6-9d0a-1e2d65e8bfa4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:12.060423 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5274b8ae-ee46-4dd6-9d0a-1e2d65e8bfa4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:12.199585 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5274b8ae-ee46-4dd6-9d0a-1e2d65e8bfa4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:12.207535 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5274b8ae-ee46-4dd6-9d0a-1e2d65e8bfa4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1318 microversion: 2.1 time: 0.161264 May 27 15:54:12.208334 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3523/7029] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:12 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:13.225417 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-33d5f447-8f0a-4a60-b33d-e28204f0c59f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:13.226053 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-33d5f447-8f0a-4a60-b33d-e28204f0c59f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:13.233675 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-33d5f447-8f0a-4a60-b33d-e28204f0c59f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:13.234155 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-33d5f447-8f0a-4a60-b33d-e28204f0c59f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:13.234991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-33d5f447-8f0a-4a60-b33d-e28204f0c59f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:13.235457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-33d5f447-8f0a-4a60-b33d-e28204f0c59f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:13.372067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-33d5f447-8f0a-4a60-b33d-e28204f0c59f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:13.379553 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-33d5f447-8f0a-4a60-b33d-e28204f0c59f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1318 microversion: 2.1 time: 0.158133 May 27 15:54:13.380115 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3507/7030] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:13 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:13.828651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-26e6b131-f260-47ad-a490-17f4abd199d7 req-6108334c-5c2b-4c69-a545-c551ed9f86e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c99736-8e53-4188-8064-aa06ddaa5c1c", "name": "network-vif-plugged", "status": "completed", "tag": "7cd1da6a-ebd9-4b06-b22f-50a46aac23dc"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:54:13.838975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-26e6b131-f260-47ad-a490-17f4abd199d7 req-6108334c-5c2b-4c69-a545-c551ed9f86e3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:13.839497 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-26e6b131-f260-47ad-a490-17f4abd199d7 req-6108334c-5c2b-4c69-a545-c551ed9f86e3 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:13.851112 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-26e6b131-f260-47ad-a490-17f4abd199d7 req-6108334c-5c2b-4c69-a545-c551ed9f86e3 service nova] Creating event network-vif-plugged:7cd1da6a-ebd9-4b06-b22f-50a46aac23dc for instance a1c99736-8e53-4188-8064-aa06ddaa5c1c on n-h2-843621-1 May 27 15:54:13.856038 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-26e6b131-f260-47ad-a490-17f4abd199d7 req-6108334c-5c2b-4c69-a545-c551ed9f86e3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031125 May 27 15:54:13.856634 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3524/7031] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:54:14.397566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e5a72352-31ee-4686-becc-0366a0365471 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:14.398328 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e5a72352-31ee-4686-becc-0366a0365471 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:14.405629 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5a72352-31ee-4686-becc-0366a0365471 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:14.406098 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5a72352-31ee-4686-becc-0366a0365471 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:14.406884 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5a72352-31ee-4686-becc-0366a0365471 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:14.407336 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e5a72352-31ee-4686-becc-0366a0365471 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:14.555265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e5a72352-31ee-4686-becc-0366a0365471 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:14.563527 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e5a72352-31ee-4686-becc-0366a0365471 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1318 microversion: 2.1 time: 0.170120 May 27 15:54:14.564089 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3508/7032] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:14 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:54:15.585182 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-09958bae-56a1-4c3c-9395-3c634bab4016 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:15.586519 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-09958bae-56a1-4c3c-9395-3c634bab4016 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:15.592927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09958bae-56a1-4c3c-9395-3c634bab4016 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:15.593389 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09958bae-56a1-4c3c-9395-3c634bab4016 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:15.594167 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09958bae-56a1-4c3c-9395-3c634bab4016 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:15.594620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-09958bae-56a1-4c3c-9395-3c634bab4016 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:15.729685 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-09958bae-56a1-4c3c-9395-3c634bab4016 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:15.737741 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-09958bae-56a1-4c3c-9395-3c634bab4016 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1509 microversion: 2.1 time: 0.157692 May 27 15:54:15.738317 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3525/7033] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:15 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:15.756179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1d3d752a-1245-416d-bd4e-957ad30628d4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:15.756864 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1d3d752a-1245-416d-bd4e-957ad30628d4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:15.764823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d3d752a-1245-416d-bd4e-957ad30628d4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:15.765306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d3d752a-1245-416d-bd4e-957ad30628d4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:15.766099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d3d752a-1245-416d-bd4e-957ad30628d4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:15.766571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1d3d752a-1245-416d-bd4e-957ad30628d4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:15.896227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1d3d752a-1245-416d-bd4e-957ad30628d4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:15.903915 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1d3d752a-1245-416d-bd4e-957ad30628d4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1509 microversion: 2.1 time: 0.151720 May 27 15:54:15.904488 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3509/7034] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:15 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:15.919596 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-180037d3-967f-45b9-92da-613bb20f7583 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:54:15.920772 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-180037d3-967f-45b9-92da-613bb20f7583 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:15.926805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-180037d3-967f-45b9-92da-613bb20f7583 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:15.927265 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-180037d3-967f-45b9-92da-613bb20f7583 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:15.928045 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-180037d3-967f-45b9-92da-613bb20f7583 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:15.928489 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-180037d3-967f-45b9-92da-613bb20f7583 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:15.992596 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-180037d3-967f-45b9-92da-613bb20f7583 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "PUT /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1081 microversion: 2.1 time: 0.076287 May 27 15:54:15.993267 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3526/7035] 10.222.0.13 () {60 vars in 1255 bytes} [Fri May 27 15:54:15 2022] PUT /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1081 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:16.008794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-89f99843-098c-465b-895f-eec699346fb4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:16.009437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-89f99843-098c-465b-895f-eec699346fb4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:16.017410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89f99843-098c-465b-895f-eec699346fb4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:16.018033 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89f99843-098c-465b-895f-eec699346fb4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:16.019461 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89f99843-098c-465b-895f-eec699346fb4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:16.020140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-89f99843-098c-465b-895f-eec699346fb4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:16.160135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-89f99843-098c-465b-895f-eec699346fb4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:16.168812 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-89f99843-098c-465b-895f-eec699346fb4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1507 microversion: 2.1 time: 0.164889 May 27 15:54:16.169403 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3510/7036] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:16 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:16.185192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b8c1bfc8-a04e-4dff-806f-87a267885179 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:16.185805 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b8c1bfc8-a04e-4dff-806f-87a267885179 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:16.187757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:54:16.188424 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:54:16.194443 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8c1bfc8-a04e-4dff-806f-87a267885179 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:16.194896 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8c1bfc8-a04e-4dff-806f-87a267885179 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:16.195729 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8c1bfc8-a04e-4dff-806f-87a267885179 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:16.196171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b8c1bfc8-a04e-4dff-806f-87a267885179 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:16.331333 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b8c1bfc8-a04e-4dff-806f-87a267885179 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:16.338971 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b8c1bfc8-a04e-4dff-806f-87a267885179 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1507 microversion: 2.1 time: 0.157752 May 27 15:54:16.339547 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3527/7037] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:16 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:54:16.352910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:54:16.364710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-67d918b3-c612-4187-8f2e-543f48714b93 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:54:16.365740 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-67d918b3-c612-4187-8f2e-543f48714b93 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:16.372441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67d918b3-c612-4187-8f2e-543f48714b93 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:16.372948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67d918b3-c612-4187-8f2e-543f48714b93 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:16.373741 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67d918b3-c612-4187-8f2e-543f48714b93 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:16.374204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-67d918b3-c612-4187-8f2e-543f48714b93 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:16.402528 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-67d918b3-c612-4187-8f2e-543f48714b93 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:16.408791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-67d918b3-c612-4187-8f2e-543f48714b93 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Old instance type m1.heat2, new instance type m1.heat {{(pid=119248) resize /opt/stack/nova/nova/compute/api.py:4166}} May 27 15:54:16.415762 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-67d918b3-c612-4187-8f2e-543f48714b93 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:54:16.416206 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-67d918b3-c612-4187-8f2e-543f48714b93 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:54:16.416726 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-67d918b3-c612-4187-8f2e-543f48714b93 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:54:16.417162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-67d918b3-c612-4187-8f2e-543f48714b93 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:54:16.417595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-67d918b3-c612-4187-8f2e-543f48714b93 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:54:16.485372 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-67d918b3-c612-4187-8f2e-543f48714b93 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "POST /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c/action" status: 202 len: 0 microversion: 2.1 time: 0.133915 May 27 15:54:16.486120 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3511/7038] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:54:16 2022] POST /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:54:16.495786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8e21f3ae-9b34-4d69-8788-47de2ea0de30 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:16.496543 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8e21f3ae-9b34-4d69-8788-47de2ea0de30 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:16.503997 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e21f3ae-9b34-4d69-8788-47de2ea0de30 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:16.504454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e21f3ae-9b34-4d69-8788-47de2ea0de30 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:16.505342 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e21f3ae-9b34-4d69-8788-47de2ea0de30 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:16.505813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8e21f3ae-9b34-4d69-8788-47de2ea0de30 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:16.645825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8e21f3ae-9b34-4d69-8788-47de2ea0de30 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:16.655201 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8e21f3ae-9b34-4d69-8788-47de2ea0de30 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1518 microversion: 2.1 time: 0.164476 May 27 15:54:16.655913 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3528/7039] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:16 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:17.675126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8d93efc4-dc91-4d93-b10c-c9bc67fa4dd0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:17.675702 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8d93efc4-dc91-4d93-b10c-c9bc67fa4dd0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:17.681954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d93efc4-dc91-4d93-b10c-c9bc67fa4dd0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:17.682432 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d93efc4-dc91-4d93-b10c-c9bc67fa4dd0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:17.683233 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d93efc4-dc91-4d93-b10c-c9bc67fa4dd0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:17.683700 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8d93efc4-dc91-4d93-b10c-c9bc67fa4dd0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:17.823499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8d93efc4-dc91-4d93-b10c-c9bc67fa4dd0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:17.831619 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8d93efc4-dc91-4d93-b10c-c9bc67fa4dd0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1518 microversion: 2.1 time: 0.161309 May 27 15:54:17.832221 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3512/7040] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:17 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:18.851102 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f75546a4-c566-4bfa-99b8-e01a9c76be04 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:18.851660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f75546a4-c566-4bfa-99b8-e01a9c76be04 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:18.858683 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f75546a4-c566-4bfa-99b8-e01a9c76be04 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:18.859139 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f75546a4-c566-4bfa-99b8-e01a9c76be04 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:18.859904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f75546a4-c566-4bfa-99b8-e01a9c76be04 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:18.860350 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f75546a4-c566-4bfa-99b8-e01a9c76be04 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:18.987821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f75546a4-c566-4bfa-99b8-e01a9c76be04 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:18.995903 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f75546a4-c566-4bfa-99b8-e01a9c76be04 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.148769 May 27 15:54:18.996472 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3529/7041] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:18 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:20.013411 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bd3c7080-5a3c-4354-8a26-98d7509b9ccf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:20.014022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bd3c7080-5a3c-4354-8a26-98d7509b9ccf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:20.021186 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd3c7080-5a3c-4354-8a26-98d7509b9ccf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:20.021661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd3c7080-5a3c-4354-8a26-98d7509b9ccf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:20.022441 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd3c7080-5a3c-4354-8a26-98d7509b9ccf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:20.022928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bd3c7080-5a3c-4354-8a26-98d7509b9ccf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:20.155480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bd3c7080-5a3c-4354-8a26-98d7509b9ccf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:20.157769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:54:20.165033 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bd3c7080-5a3c-4354-8a26-98d7509b9ccf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.155468 May 27 15:54:20.165616 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3513/7042] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:20 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:21.182746 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b59f3384-9f63-48de-bf01-7083be6849fb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:21.183289 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b59f3384-9f63-48de-bf01-7083be6849fb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:21.190215 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b59f3384-9f63-48de-bf01-7083be6849fb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:21.190668 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b59f3384-9f63-48de-bf01-7083be6849fb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:21.191438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b59f3384-9f63-48de-bf01-7083be6849fb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:21.191875 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b59f3384-9f63-48de-bf01-7083be6849fb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:21.319054 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b59f3384-9f63-48de-bf01-7083be6849fb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:21.326807 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b59f3384-9f63-48de-bf01-7083be6849fb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.148503 May 27 15:54:21.327381 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3530/7043] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:21 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:22.345443 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-983f492f-c012-4f62-aa5c-d0d194ff935a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:22.346070 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-983f492f-c012-4f62-aa5c-d0d194ff935a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:22.353905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-983f492f-c012-4f62-aa5c-d0d194ff935a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:22.354377 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-983f492f-c012-4f62-aa5c-d0d194ff935a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:22.355162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-983f492f-c012-4f62-aa5c-d0d194ff935a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:22.355623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-983f492f-c012-4f62-aa5c-d0d194ff935a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:22.490211 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-983f492f-c012-4f62-aa5c-d0d194ff935a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:22.498308 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-983f492f-c012-4f62-aa5c-d0d194ff935a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.156863 May 27 15:54:22.498879 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3514/7044] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:22 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:23.515236 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0d55d18c-bfee-4dbd-8b48-1fb8851db677 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:23.515860 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0d55d18c-bfee-4dbd-8b48-1fb8851db677 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:23.523832 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0d55d18c-bfee-4dbd-8b48-1fb8851db677 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:23.524292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0d55d18c-bfee-4dbd-8b48-1fb8851db677 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:23.525093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0d55d18c-bfee-4dbd-8b48-1fb8851db677 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:23.525541 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-0d55d18c-bfee-4dbd-8b48-1fb8851db677 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:23.654785 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0d55d18c-bfee-4dbd-8b48-1fb8851db677 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:23.662349 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0d55d18c-bfee-4dbd-8b48-1fb8851db677 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.150963 May 27 15:54:23.662926 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3531/7045] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:23 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:24.679874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-997958ab-600b-449d-ab43-d08107ea998d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:24.680525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-997958ab-600b-449d-ab43-d08107ea998d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:24.687661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-997958ab-600b-449d-ab43-d08107ea998d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:24.688140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-997958ab-600b-449d-ab43-d08107ea998d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:24.688960 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-997958ab-600b-449d-ab43-d08107ea998d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:24.689428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-997958ab-600b-449d-ab43-d08107ea998d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:24.817579 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-997958ab-600b-449d-ab43-d08107ea998d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:24.825813 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-997958ab-600b-449d-ab43-d08107ea998d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.150396 May 27 15:54:24.826454 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3515/7046] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:24 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:25.843194 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-42298c23-0c29-43ca-a621-79e2a074239b tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:25.843738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-42298c23-0c29-43ca-a621-79e2a074239b tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:25.850738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42298c23-0c29-43ca-a621-79e2a074239b tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:25.851256 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42298c23-0c29-43ca-a621-79e2a074239b tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:25.852014 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42298c23-0c29-43ca-a621-79e2a074239b tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:25.852455 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-42298c23-0c29-43ca-a621-79e2a074239b tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:25.983427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-42298c23-0c29-43ca-a621-79e2a074239b tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:25.990962 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-42298c23-0c29-43ca-a621-79e2a074239b tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.151763 May 27 15:54:25.991540 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3532/7047] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:25 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:27.008039 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-126e8129-c10d-45ab-a005-ca5474c3f27a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:27.008585 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-126e8129-c10d-45ab-a005-ca5474c3f27a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:27.015735 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-126e8129-c10d-45ab-a005-ca5474c3f27a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:27.016214 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-126e8129-c10d-45ab-a005-ca5474c3f27a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:27.017044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-126e8129-c10d-45ab-a005-ca5474c3f27a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:27.017514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-126e8129-c10d-45ab-a005-ca5474c3f27a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:27.153633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-126e8129-c10d-45ab-a005-ca5474c3f27a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:27.161156 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-126e8129-c10d-45ab-a005-ca5474c3f27a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.157113 May 27 15:54:27.161725 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3516/7048] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:27 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:28.179732 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cef69468-707b-488d-b8a8-2f94a63a00c9 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:28.180340 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cef69468-707b-488d-b8a8-2f94a63a00c9 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:28.182967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:54:28.188431 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cef69468-707b-488d-b8a8-2f94a63a00c9 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:28.188916 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cef69468-707b-488d-b8a8-2f94a63a00c9 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:28.189688 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cef69468-707b-488d-b8a8-2f94a63a00c9 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:28.190133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-cef69468-707b-488d-b8a8-2f94a63a00c9 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:28.194745 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:54:28.322842 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cef69468-707b-488d-b8a8-2f94a63a00c9 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:28.330388 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cef69468-707b-488d-b8a8-2f94a63a00c9 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.155015 May 27 15:54:28.330957 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3533/7049] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:28 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:29.348089 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-03f236e9-7d44-4155-b2fc-7df632748ffc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:29.348752 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-03f236e9-7d44-4155-b2fc-7df632748ffc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:29.351508 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:54:29.358320 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03f236e9-7d44-4155-b2fc-7df632748ffc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:29.358792 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03f236e9-7d44-4155-b2fc-7df632748ffc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:29.359609 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03f236e9-7d44-4155-b2fc-7df632748ffc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:29.360082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-03f236e9-7d44-4155-b2fc-7df632748ffc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:29.490748 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-03f236e9-7d44-4155-b2fc-7df632748ffc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:29.498903 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-03f236e9-7d44-4155-b2fc-7df632748ffc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.154723 May 27 15:54:29.499506 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3517/7050] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:29 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:30.515545 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-764efa20-0e01-4d78-90dd-40f3f040ec68 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:30.516221 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-764efa20-0e01-4d78-90dd-40f3f040ec68 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:30.524506 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-764efa20-0e01-4d78-90dd-40f3f040ec68 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:30.524985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-764efa20-0e01-4d78-90dd-40f3f040ec68 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:30.525751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-764efa20-0e01-4d78-90dd-40f3f040ec68 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:30.526196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-764efa20-0e01-4d78-90dd-40f3f040ec68 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:30.659514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-764efa20-0e01-4d78-90dd-40f3f040ec68 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:30.667158 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-764efa20-0e01-4d78-90dd-40f3f040ec68 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.155517 May 27 15:54:30.667770 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3534/7051] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:30 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:31.684321 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-62680500-26f7-4833-919a-40d523fe07b4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:31.684901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-62680500-26f7-4833-919a-40d523fe07b4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:31.691428 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62680500-26f7-4833-919a-40d523fe07b4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:31.691899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62680500-26f7-4833-919a-40d523fe07b4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:31.692698 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62680500-26f7-4833-919a-40d523fe07b4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:31.693156 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62680500-26f7-4833-919a-40d523fe07b4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:31.821634 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-62680500-26f7-4833-919a-40d523fe07b4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:31.829203 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-62680500-26f7-4833-919a-40d523fe07b4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.149217 May 27 15:54:31.829765 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3518/7052] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:31 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:32.850658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c6d120a5-fdaa-41c7-992b-d95bef7e8ba7 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:32.851829 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c6d120a5-fdaa-41c7-992b-d95bef7e8ba7 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:32.859022 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c6d120a5-fdaa-41c7-992b-d95bef7e8ba7 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:32.859477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c6d120a5-fdaa-41c7-992b-d95bef7e8ba7 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:32.860257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c6d120a5-fdaa-41c7-992b-d95bef7e8ba7 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:32.860722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c6d120a5-fdaa-41c7-992b-d95bef7e8ba7 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:32.987487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c6d120a5-fdaa-41c7-992b-d95bef7e8ba7 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:32.994948 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c6d120a5-fdaa-41c7-992b-d95bef7e8ba7 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.152124 May 27 15:54:32.995521 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3535/7053] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:32 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:34.012476 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ed177b6d-ba92-4778-af15-97b79e51671e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:34.013136 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ed177b6d-ba92-4778-af15-97b79e51671e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:34.020615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed177b6d-ba92-4778-af15-97b79e51671e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:34.021114 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed177b6d-ba92-4778-af15-97b79e51671e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:34.021901 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed177b6d-ba92-4778-af15-97b79e51671e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:34.022360 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ed177b6d-ba92-4778-af15-97b79e51671e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:34.152187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ed177b6d-ba92-4778-af15-97b79e51671e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:34.159706 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ed177b6d-ba92-4778-af15-97b79e51671e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.151370 May 27 15:54:34.160269 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3519/7054] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:34 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:35.178609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e658dc4b-db0f-4ba3-b73b-0ad90f0cec1f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:35.179751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e658dc4b-db0f-4ba3-b73b-0ad90f0cec1f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:35.186610 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e658dc4b-db0f-4ba3-b73b-0ad90f0cec1f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:35.187064 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e658dc4b-db0f-4ba3-b73b-0ad90f0cec1f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:35.187826 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e658dc4b-db0f-4ba3-b73b-0ad90f0cec1f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:35.188268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e658dc4b-db0f-4ba3-b73b-0ad90f0cec1f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:35.315050 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e658dc4b-db0f-4ba3-b73b-0ad90f0cec1f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:35.323423 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e658dc4b-db0f-4ba3-b73b-0ad90f0cec1f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.148773 May 27 15:54:35.323998 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3536/7055] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:35 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:36.341165 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-5007d52d-ecc6-4738-b84e-bfd6977e65b8 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:36.341806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-5007d52d-ecc6-4738-b84e-bfd6977e65b8 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:36.348645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5007d52d-ecc6-4738-b84e-bfd6977e65b8 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:36.349150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5007d52d-ecc6-4738-b84e-bfd6977e65b8 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:36.349934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5007d52d-ecc6-4738-b84e-bfd6977e65b8 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:36.350393 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-5007d52d-ecc6-4738-b84e-bfd6977e65b8 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:36.486130 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-5007d52d-ecc6-4738-b84e-bfd6977e65b8 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:36.494462 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-5007d52d-ecc6-4738-b84e-bfd6977e65b8 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.157229 May 27 15:54:36.495036 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3520/7056] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:36 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:37.511672 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-74255510-032e-4637-acef-762ec411c9c5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:37.512288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-74255510-032e-4637-acef-762ec411c9c5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:37.519928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-74255510-032e-4637-acef-762ec411c9c5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:37.520420 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-74255510-032e-4637-acef-762ec411c9c5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:37.521244 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-74255510-032e-4637-acef-762ec411c9c5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:37.521726 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-74255510-032e-4637-acef-762ec411c9c5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:37.649477 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-74255510-032e-4637-acef-762ec411c9c5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:37.656915 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-74255510-032e-4637-acef-762ec411c9c5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.149671 May 27 15:54:37.657489 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3537/7057] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:37 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:38.674202 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ab3cd751-ee2e-4629-b69e-b5c3b2832b9c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:38.674747 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ab3cd751-ee2e-4629-b69e-b5c3b2832b9c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:38.681954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab3cd751-ee2e-4629-b69e-b5c3b2832b9c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:38.682421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab3cd751-ee2e-4629-b69e-b5c3b2832b9c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:38.683204 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab3cd751-ee2e-4629-b69e-b5c3b2832b9c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:38.683660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ab3cd751-ee2e-4629-b69e-b5c3b2832b9c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:38.810907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ab3cd751-ee2e-4629-b69e-b5c3b2832b9c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:38.818458 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ab3cd751-ee2e-4629-b69e-b5c3b2832b9c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.148239 May 27 15:54:38.819024 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3521/7058] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:38 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:39.836172 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8d693c82-85f2-40b8-ac54-675c173d04cf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:39.836739 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8d693c82-85f2-40b8-ac54-675c173d04cf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:39.843427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d693c82-85f2-40b8-ac54-675c173d04cf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:39.843890 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d693c82-85f2-40b8-ac54-675c173d04cf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:39.844690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d693c82-85f2-40b8-ac54-675c173d04cf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:39.845141 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8d693c82-85f2-40b8-ac54-675c173d04cf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:39.976888 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8d693c82-85f2-40b8-ac54-675c173d04cf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:39.984405 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8d693c82-85f2-40b8-ac54-675c173d04cf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.152936 May 27 15:54:39.985025 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3538/7059] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:39 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:41.000786 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3170cc81-89a6-4d14-8a22-bb626977d596 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:41.001357 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3170cc81-89a6-4d14-8a22-bb626977d596 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:41.008304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3170cc81-89a6-4d14-8a22-bb626977d596 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:41.008805 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3170cc81-89a6-4d14-8a22-bb626977d596 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:41.009595 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3170cc81-89a6-4d14-8a22-bb626977d596 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:41.010068 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3170cc81-89a6-4d14-8a22-bb626977d596 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:41.137536 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3170cc81-89a6-4d14-8a22-bb626977d596 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:41.145647 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3170cc81-89a6-4d14-8a22-bb626977d596 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.148874 May 27 15:54:41.146216 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3522/7060] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:40 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:42.164442 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3190cea2-ecc9-44d2-9193-156b8421c3b5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:42.165128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3190cea2-ecc9-44d2-9193-156b8421c3b5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:42.172945 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3190cea2-ecc9-44d2-9193-156b8421c3b5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:42.173413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3190cea2-ecc9-44d2-9193-156b8421c3b5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:42.174208 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3190cea2-ecc9-44d2-9193-156b8421c3b5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:42.174660 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3190cea2-ecc9-44d2-9193-156b8421c3b5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:42.348967 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3190cea2-ecc9-44d2-9193-156b8421c3b5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:42.357484 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3190cea2-ecc9-44d2-9193-156b8421c3b5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.198119 May 27 15:54:42.366813 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3539/7061] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:42 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:43.374376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cded282c-a807-442e-b41c-ae23ab69cf00 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:43.375013 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cded282c-a807-442e-b41c-ae23ab69cf00 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:43.382173 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cded282c-a807-442e-b41c-ae23ab69cf00 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:43.382645 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cded282c-a807-442e-b41c-ae23ab69cf00 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:43.383437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cded282c-a807-442e-b41c-ae23ab69cf00 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:43.383903 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cded282c-a807-442e-b41c-ae23ab69cf00 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:43.517749 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cded282c-a807-442e-b41c-ae23ab69cf00 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:43.526508 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cded282c-a807-442e-b41c-ae23ab69cf00 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.156046 May 27 15:54:43.527134 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3523/7062] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:43 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:44.543536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4270a96d-6bb1-499c-b9fd-1b91b30ff98d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:44.544163 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4270a96d-6bb1-499c-b9fd-1b91b30ff98d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:44.551635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4270a96d-6bb1-499c-b9fd-1b91b30ff98d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:44.552093 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4270a96d-6bb1-499c-b9fd-1b91b30ff98d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:44.552896 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4270a96d-6bb1-499c-b9fd-1b91b30ff98d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:44.553332 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4270a96d-6bb1-499c-b9fd-1b91b30ff98d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:44.686551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4270a96d-6bb1-499c-b9fd-1b91b30ff98d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:44.694172 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4270a96d-6bb1-499c-b9fd-1b91b30ff98d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1523 microversion: 2.1 time: 0.154700 May 27 15:54:44.694841 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3540/7063] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:44 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:45.710858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a00af982-0ea5-440e-b651-19966690c6a5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:45.711499 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a00af982-0ea5-440e-b651-19966690c6a5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:45.717949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a00af982-0ea5-440e-b651-19966690c6a5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:45.718426 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a00af982-0ea5-440e-b651-19966690c6a5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:45.719222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a00af982-0ea5-440e-b651-19966690c6a5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:45.719687 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a00af982-0ea5-440e-b651-19966690c6a5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:45.743813 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-c9a2b32a-a8bc-4f13-9277-addb412acaab req-dcc29d6d-057b-4ad1-955d-37607abb0fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c99736-8e53-4188-8064-aa06ddaa5c1c", "name": "network-vif-unplugged", "status": "completed", "tag": "7cd1da6a-ebd9-4b06-b22f-50a46aac23dc"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:54:45.753628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-c9a2b32a-a8bc-4f13-9277-addb412acaab req-dcc29d6d-057b-4ad1-955d-37607abb0fca service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:45.754229 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-c9a2b32a-a8bc-4f13-9277-addb412acaab req-dcc29d6d-057b-4ad1-955d-37607abb0fca service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:45.768336 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-c9a2b32a-a8bc-4f13-9277-addb412acaab req-dcc29d6d-057b-4ad1-955d-37607abb0fca service nova] Creating event network-vif-unplugged:7cd1da6a-ebd9-4b06-b22f-50a46aac23dc for instance a1c99736-8e53-4188-8064-aa06ddaa5c1c on n-h1-843621-1 May 27 15:54:45.774362 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [req-c9a2b32a-a8bc-4f13-9277-addb412acaab req-dcc29d6d-057b-4ad1-955d-37607abb0fca service nova] Instance a1c99736-8e53-4188-8064-aa06ddaa5c1c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119249) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 15:54:45.786508 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-c9a2b32a-a8bc-4f13-9277-addb412acaab req-dcc29d6d-057b-4ad1-955d-37607abb0fca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047158 May 27 15:54:45.788808 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3541/7064] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:54:45.869717 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a00af982-0ea5-440e-b651-19966690c6a5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:45.877422 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a00af982-0ea5-440e-b651-19966690c6a5 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1522 microversion: 2.1 time: 0.170596 May 27 15:54:45.878046 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3524/7065] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:45 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:46.897143 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aca4e3cb-efb8-42e0-a6b8-45c61a97e050 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:46.898528 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-aca4e3cb-efb8-42e0-a6b8-45c61a97e050 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:46.904950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aca4e3cb-efb8-42e0-a6b8-45c61a97e050 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:46.905405 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aca4e3cb-efb8-42e0-a6b8-45c61a97e050 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:46.906166 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aca4e3cb-efb8-42e0-a6b8-45c61a97e050 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:46.906608 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aca4e3cb-efb8-42e0-a6b8-45c61a97e050 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:47.311953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-aca4e3cb-efb8-42e0-a6b8-45c61a97e050 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:47.319537 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-aca4e3cb-efb8-42e0-a6b8-45c61a97e050 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1520 microversion: 2.1 time: 0.427719 May 27 15:54:47.320703 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3542/7066] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:46 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1520 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:47.804543 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-a35efb14-ef97-4f7e-b083-3481d934a49a req-d342eae3-9d33-4481-97ad-3a124e656aed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1c99736-8e53-4188-8064-aa06ddaa5c1c", "tag": "7cd1da6a-ebd9-4b06-b22f-50a46aac23dc"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:54:47.813695 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-a35efb14-ef97-4f7e-b083-3481d934a49a req-d342eae3-9d33-4481-97ad-3a124e656aed service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:47.814159 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-a35efb14-ef97-4f7e-b083-3481d934a49a req-d342eae3-9d33-4481-97ad-3a124e656aed service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:47.826118 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-a35efb14-ef97-4f7e-b083-3481d934a49a req-d342eae3-9d33-4481-97ad-3a124e656aed service nova] Creating event network-changed:7cd1da6a-ebd9-4b06-b22f-50a46aac23dc for instance a1c99736-8e53-4188-8064-aa06ddaa5c1c on n-h1-843621-1 May 27 15:54:47.831409 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [req-a35efb14-ef97-4f7e-b083-3481d934a49a req-d342eae3-9d33-4481-97ad-3a124e656aed service nova] Instance a1c99736-8e53-4188-8064-aa06ddaa5c1c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119248) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 15:54:47.843873 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-a35efb14-ef97-4f7e-b083-3481d934a49a req-d342eae3-9d33-4481-97ad-3a124e656aed service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043286 May 27 15:54:47.844461 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3525/7067] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:54:48.337576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b7949e19-85ec-4f4a-b278-0abc99e8096b tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:48.339505 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b7949e19-85ec-4f4a-b278-0abc99e8096b tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:48.347288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7949e19-85ec-4f4a-b278-0abc99e8096b tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:48.347740 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7949e19-85ec-4f4a-b278-0abc99e8096b tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:48.348512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7949e19-85ec-4f4a-b278-0abc99e8096b tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:48.348980 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b7949e19-85ec-4f4a-b278-0abc99e8096b tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:48.479770 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b7949e19-85ec-4f4a-b278-0abc99e8096b tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:48.487481 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b7949e19-85ec-4f4a-b278-0abc99e8096b tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1520 microversion: 2.1 time: 0.154057 May 27 15:54:48.488178 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3543/7068] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:48 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:49.507847 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-25408b13-ce18-4a80-9c66-88d112369cf4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:49.508571 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-25408b13-ce18-4a80-9c66-88d112369cf4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:49.516629 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-25408b13-ce18-4a80-9c66-88d112369cf4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:49.517146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-25408b13-ce18-4a80-9c66-88d112369cf4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:49.517945 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-25408b13-ce18-4a80-9c66-88d112369cf4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:49.518397 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-25408b13-ce18-4a80-9c66-88d112369cf4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:49.658295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-25408b13-ce18-4a80-9c66-88d112369cf4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:49.667014 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-25408b13-ce18-4a80-9c66-88d112369cf4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1520 microversion: 2.1 time: 0.164932 May 27 15:54:49.667741 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3526/7069] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:49 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:50.684743 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-24e07cee-26a5-4d85-b2bc-2da27312ea8a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:50.685325 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-24e07cee-26a5-4d85-b2bc-2da27312ea8a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:50.692295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-24e07cee-26a5-4d85-b2bc-2da27312ea8a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:50.692784 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-24e07cee-26a5-4d85-b2bc-2da27312ea8a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:50.693551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-24e07cee-26a5-4d85-b2bc-2da27312ea8a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:50.693996 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-24e07cee-26a5-4d85-b2bc-2da27312ea8a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:50.829023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-24e07cee-26a5-4d85-b2bc-2da27312ea8a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:50.836713 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-24e07cee-26a5-4d85-b2bc-2da27312ea8a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1517 microversion: 2.1 time: 0.156004 May 27 15:54:50.837272 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3544/7070] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:50 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:50.853295 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e9645f2c-b056-4fee-b151-356db88b360d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:54:50.853859 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e9645f2c-b056-4fee-b151-356db88b360d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:50.861022 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e9645f2c-b056-4fee-b151-356db88b360d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:50.861503 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e9645f2c-b056-4fee-b151-356db88b360d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:50.862304 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e9645f2c-b056-4fee-b151-356db88b360d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:50.862772 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e9645f2c-b056-4fee-b151-356db88b360d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:50.923964 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e9645f2c-b056-4fee-b151-356db88b360d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "POST /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c/action" status: 204 len: 0 microversion: 2.1 time: 0.074962 May 27 15:54:50.924692 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3527/7071] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:54:50 2022] POST /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:54:50.932952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-5bcc1817-56c4-49a4-8e56-fed8ac8bcdaf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:50.933821 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-5bcc1817-56c4-49a4-8e56-fed8ac8bcdaf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:50.940283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5bcc1817-56c4-49a4-8e56-fed8ac8bcdaf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:50.940656 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5bcc1817-56c4-49a4-8e56-fed8ac8bcdaf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:50.941633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5bcc1817-56c4-49a4-8e56-fed8ac8bcdaf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:50.942200 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-5bcc1817-56c4-49a4-8e56-fed8ac8bcdaf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:51.162632 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-5bcc1817-56c4-49a4-8e56-fed8ac8bcdaf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:51.171240 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-5bcc1817-56c4-49a4-8e56-fed8ac8bcdaf tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1517 microversion: 2.1 time: 0.242426 May 27 15:54:51.171894 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3545/7072] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:50 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1517 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:54:52.189437 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4050c123-1d19-4642-884a-8a6c703e70fa tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:52.190161 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4050c123-1d19-4642-884a-8a6c703e70fa tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:52.198067 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4050c123-1d19-4642-884a-8a6c703e70fa tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:52.198583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4050c123-1d19-4642-884a-8a6c703e70fa tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:52.199385 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4050c123-1d19-4642-884a-8a6c703e70fa tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:52.199851 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4050c123-1d19-4642-884a-8a6c703e70fa tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:52.329633 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4050c123-1d19-4642-884a-8a6c703e70fa tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:52.337345 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4050c123-1d19-4642-884a-8a6c703e70fa tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1509 microversion: 2.1 time: 0.152491 May 27 15:54:52.338746 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3528/7073] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:52 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:52.354748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-109d4d50-646c-4acd-9564-1333da75210f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:52.355748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-109d4d50-646c-4acd-9564-1333da75210f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:52.363171 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-109d4d50-646c-4acd-9564-1333da75210f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:52.364105 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-109d4d50-646c-4acd-9564-1333da75210f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:52.364408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-109d4d50-646c-4acd-9564-1333da75210f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:52.364904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-109d4d50-646c-4acd-9564-1333da75210f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:52.502825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-109d4d50-646c-4acd-9564-1333da75210f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:52.510951 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-109d4d50-646c-4acd-9564-1333da75210f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1509 microversion: 2.1 time: 0.160555 May 27 15:54:52.511528 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3546/7074] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:52 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:54:52.528053 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ac68ee26-e3c7-4587-8826-71a7999f6cc9 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:52.528731 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ac68ee26-e3c7-4587-8826-71a7999f6cc9 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:52.534858 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac68ee26-e3c7-4587-8826-71a7999f6cc9 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:52.535325 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac68ee26-e3c7-4587-8826-71a7999f6cc9 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:52.536172 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac68ee26-e3c7-4587-8826-71a7999f6cc9 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:52.536710 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ac68ee26-e3c7-4587-8826-71a7999f6cc9 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:52.540149 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:54:52.677806 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-ac68ee26-e3c7-4587-8826-71a7999f6cc9 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:52.685690 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ac68ee26-e3c7-4587-8826-71a7999f6cc9 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 200 len: 1509 microversion: 2.1 time: 0.161620 May 27 15:54:52.686347 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3529/7075] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:52 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:52.701782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8a481260-17bf-481c-a336-3b33abbc6aeb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:52.702290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8a481260-17bf-481c-a336-3b33abbc6aeb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:52.708433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a481260-17bf-481c-a336-3b33abbc6aeb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:52.708932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a481260-17bf-481c-a336-3b33abbc6aeb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:52.709697 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a481260-17bf-481c-a336-3b33abbc6aeb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:52.710145 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8a481260-17bf-481c-a336-3b33abbc6aeb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:52.739515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8a481260-17bf-481c-a336-3b33abbc6aeb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:54:52.821486 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8a481260-17bf-481c-a336-3b33abbc6aeb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 204 len: 0 microversion: 2.1 time: 0.122986 May 27 15:54:52.822091 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3547/7076] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:54:52 2022] DELETE /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:54:52.881780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c1d1ca3d-fccc-4d48-8dc2-2a7d6a6b2181 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1466644762", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "2209191c-9289-4ef6-9c5e-4802b4f573c8"}]}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:54:52.933905 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-c1d1ca3d-fccc-4d48-8dc2-2a7d6a6b2181 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] validate_networks() for [('2209191c-9289-4ef6-9c5e-4802b4f573c8', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:54:53.046021 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-22800a2b-463b-4bba-8a6c-95e4bf66a79b req-9471f649-331c-4738-8123-55977b6c574b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c99736-8e53-4188-8064-aa06ddaa5c1c", "name": "network-vif-plugged", "status": "completed", "tag": "7cd1da6a-ebd9-4b06-b22f-50a46aac23dc"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:54:53.055654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-22800a2b-463b-4bba-8a6c-95e4bf66a79b req-9471f649-331c-4738-8123-55977b6c574b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:53.055987 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-22800a2b-463b-4bba-8a6c-95e4bf66a79b req-9471f649-331c-4738-8123-55977b6c574b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:53.068618 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-22800a2b-463b-4bba-8a6c-95e4bf66a79b req-9471f649-331c-4738-8123-55977b6c574b service nova] Creating event network-vif-plugged:7cd1da6a-ebd9-4b06-b22f-50a46aac23dc for instance a1c99736-8e53-4188-8064-aa06ddaa5c1c on n-h1-843621-1 May 27 15:54:53.073889 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-22800a2b-463b-4bba-8a6c-95e4bf66a79b req-9471f649-331c-4738-8123-55977b6c574b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032262 May 27 15:54:53.074702 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3548/7077] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:54:53.304567 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-c1d1ca3d-fccc-4d48-8dc2-2a7d6a6b2181 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:54:53.305051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-c1d1ca3d-fccc-4d48-8dc2-2a7d6a6b2181 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:54:53.305606 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-c1d1ca3d-fccc-4d48-8dc2-2a7d6a6b2181 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:54:53.306042 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-c1d1ca3d-fccc-4d48-8dc2-2a7d6a6b2181 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:54:53.306506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-c1d1ca3d-fccc-4d48-8dc2-2a7d6a6b2181 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:54:53.315596 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c1d1ca3d-fccc-4d48-8dc2-2a7d6a6b2181 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:53.316075 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c1d1ca3d-fccc-4d48-8dc2-2a7d6a6b2181 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:53.316954 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c1d1ca3d-fccc-4d48-8dc2-2a7d6a6b2181 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:53.317422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c1d1ca3d-fccc-4d48-8dc2-2a7d6a6b2181 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:53.334178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-c1d1ca3d-fccc-4d48-8dc2-2a7d6a6b2181 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Getting quotas for project 81229c6bb3044a7fba4fe081f35d3b21. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:54:53.339966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-c1d1ca3d-fccc-4d48-8dc2-2a7d6a6b2181 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Getting quotas for user c8827c7bc3994623b020b5a3d1feb785 and project 81229c6bb3044a7fba4fe081f35d3b21. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:54:53.352873 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c1d1ca3d-fccc-4d48-8dc2-2a7d6a6b2181 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:54:53.355199 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c1d1ca3d-fccc-4d48-8dc2-2a7d6a6b2181 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:54:53.399539 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c1d1ca3d-fccc-4d48-8dc2-2a7d6a6b2181 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521968 May 27 15:54:53.400189 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3530/7078] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:54:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:54:53.411515 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-cb3983c9-0a92-4b84-ac5b-5aedc1a4fa4e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:53.412234 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-cb3983c9-0a92-4b84-ac5b-5aedc1a4fa4e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:53.467891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-cb3983c9-0a92-4b84-ac5b-5aedc1a4fa4e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:53.474596 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-cb3983c9-0a92-4b84-ac5b-5aedc1a4fa4e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1218 microversion: 2.1 time: 0.068050 May 27 15:54:53.476991 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3549/7079] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:53 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:54.493575 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9030d34e-8792-484d-8304-69806870638c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:54.494218 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9030d34e-8792-484d-8304-69806870638c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:54.500724 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9030d34e-8792-484d-8304-69806870638c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:54.501200 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9030d34e-8792-484d-8304-69806870638c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:54.501989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9030d34e-8792-484d-8304-69806870638c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:54.502630 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9030d34e-8792-484d-8304-69806870638c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:54.572962 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9030d34e-8792-484d-8304-69806870638c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:54.581920 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9030d34e-8792-484d-8304-69806870638c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1270 microversion: 2.1 time: 0.093940 May 27 15:54:54.582516 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3531/7080] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:54 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:54:55.293415 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-006beb9c-a82c-49f1-a9e9-aa2916a3af37 req-39dc1f5d-8b1b-4a1c-bc69-e7aab4c824f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c99736-8e53-4188-8064-aa06ddaa5c1c", "name": "network-vif-deleted", "tag": "7cd1da6a-ebd9-4b06-b22f-50a46aac23dc"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:54:55.305052 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-006beb9c-a82c-49f1-a9e9-aa2916a3af37 req-39dc1f5d-8b1b-4a1c-bc69-e7aab4c824f2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:55.305931 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-006beb9c-a82c-49f1-a9e9-aa2916a3af37 req-39dc1f5d-8b1b-4a1c-bc69-e7aab4c824f2 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:55.315973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:54:55.318666 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-006beb9c-a82c-49f1-a9e9-aa2916a3af37 req-39dc1f5d-8b1b-4a1c-bc69-e7aab4c824f2 service nova] Creating event network-vif-deleted:7cd1da6a-ebd9-4b06-b22f-50a46aac23dc for instance a1c99736-8e53-4188-8064-aa06ddaa5c1c on n-h1-843621-1 May 27 15:54:55.324424 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-006beb9c-a82c-49f1-a9e9-aa2916a3af37 req-39dc1f5d-8b1b-4a1c-bc69-e7aab4c824f2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034548 May 27 15:54:55.325412 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3550/7081] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:54:55.599791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-9b2587d5-2315-42e0-825e-cf17ed26bd87 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:55.600447 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-9b2587d5-2315-42e0-825e-cf17ed26bd87 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:55.608344 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b2587d5-2315-42e0-825e-cf17ed26bd87 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:55.608860 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b2587d5-2315-42e0-825e-cf17ed26bd87 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:55.609667 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b2587d5-2315-42e0-825e-cf17ed26bd87 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:55.610140 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-9b2587d5-2315-42e0-825e-cf17ed26bd87 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:55.741241 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-9b2587d5-2315-42e0-825e-cf17ed26bd87 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:55.749234 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-9b2587d5-2315-42e0-825e-cf17ed26bd87 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1318 microversion: 2.1 time: 0.153646 May 27 15:54:55.749866 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3532/7082] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:55 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:56.768731 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3fe70789-9c9a-43aa-b6fd-92a06a357b7f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:56.769631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3fe70789-9c9a-43aa-b6fd-92a06a357b7f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:56.776604 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fe70789-9c9a-43aa-b6fd-92a06a357b7f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:56.777078 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fe70789-9c9a-43aa-b6fd-92a06a357b7f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:56.777851 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fe70789-9c9a-43aa-b6fd-92a06a357b7f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:56.778302 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3fe70789-9c9a-43aa-b6fd-92a06a357b7f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:56.909858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3fe70789-9c9a-43aa-b6fd-92a06a357b7f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:56.918292 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3fe70789-9c9a-43aa-b6fd-92a06a357b7f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1318 microversion: 2.1 time: 0.155769 May 27 15:54:56.918875 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3551/7083] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:56 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:57.339808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-ffbc9832-5401-47f5-a3c9-0c2ea72e96e9 req-71597614-095d-4103-ae80-d3de5ec679b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3efff23e-c4fc-4708-923c-d6f1f1116104", "tag": "e01de142-2ff5-4b5f-a8e9-320c2c0c9ba5"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:54:57.348804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-ffbc9832-5401-47f5-a3c9-0c2ea72e96e9 req-71597614-095d-4103-ae80-d3de5ec679b1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:57.349269 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-ffbc9832-5401-47f5-a3c9-0c2ea72e96e9 req-71597614-095d-4103-ae80-d3de5ec679b1 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:57.360206 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-ffbc9832-5401-47f5-a3c9-0c2ea72e96e9 req-71597614-095d-4103-ae80-d3de5ec679b1 service nova] Creating event network-changed:e01de142-2ff5-4b5f-a8e9-320c2c0c9ba5 for instance 3efff23e-c4fc-4708-923c-d6f1f1116104 on n-h1-843621-1 May 27 15:54:57.365475 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-ffbc9832-5401-47f5-a3c9-0c2ea72e96e9 req-71597614-095d-4103-ae80-d3de5ec679b1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029844 May 27 15:54:57.365917 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3533/7084] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:54:57.936096 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-12478813-fad1-4585-ab01-a9f2da31965d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:57.936764 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-12478813-fad1-4585-ab01-a9f2da31965d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:57.943710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12478813-fad1-4585-ab01-a9f2da31965d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:57.944162 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12478813-fad1-4585-ab01-a9f2da31965d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:57.945681 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12478813-fad1-4585-ab01-a9f2da31965d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:57.946124 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12478813-fad1-4585-ab01-a9f2da31965d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:58.074853 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-12478813-fad1-4585-ab01-a9f2da31965d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:58.082317 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-12478813-fad1-4585-ab01-a9f2da31965d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1318 microversion: 2.1 time: 0.150117 May 27 15:54:58.082887 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3552/7085] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:57 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:54:59.100822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4082ee68-d032-41b0-84af-dc3a6ebb4464 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:54:59.101546 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4082ee68-d032-41b0-84af-dc3a6ebb4464 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:54:59.107827 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4082ee68-d032-41b0-84af-dc3a6ebb4464 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:59.108236 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4082ee68-d032-41b0-84af-dc3a6ebb4464 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:59.109051 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4082ee68-d032-41b0-84af-dc3a6ebb4464 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:54:59.109507 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4082ee68-d032-41b0-84af-dc3a6ebb4464 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:54:59.238535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4082ee68-d032-41b0-84af-dc3a6ebb4464 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:54:59.247879 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4082ee68-d032-41b0-84af-dc3a6ebb4464 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1318 microversion: 2.1 time: 0.152232 May 27 15:54:59.248461 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3534/7086] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:54:59 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:00.264641 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-857faae3-0ce4-477e-8ea2-69716702e07f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:00.265281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-857faae3-0ce4-477e-8ea2-69716702e07f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:00.268113 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:55:00.274311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-857faae3-0ce4-477e-8ea2-69716702e07f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:00.274766 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-857faae3-0ce4-477e-8ea2-69716702e07f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:00.275537 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-857faae3-0ce4-477e-8ea2-69716702e07f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:00.275985 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-857faae3-0ce4-477e-8ea2-69716702e07f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:00.411179 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-857faae3-0ce4-477e-8ea2-69716702e07f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:00.418961 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-857faae3-0ce4-477e-8ea2-69716702e07f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1318 microversion: 2.1 time: 0.158205 May 27 15:55:00.419742 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3553/7087] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:00 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:01.435877 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e81088aa-7fdd-43f0-a6e8-3e60685247ab tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:01.436537 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e81088aa-7fdd-43f0-a6e8-3e60685247ab tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:01.439482 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:55:01.446256 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e81088aa-7fdd-43f0-a6e8-3e60685247ab tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:01.446828 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e81088aa-7fdd-43f0-a6e8-3e60685247ab tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:01.447638 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e81088aa-7fdd-43f0-a6e8-3e60685247ab tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:01.448100 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e81088aa-7fdd-43f0-a6e8-3e60685247ab tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:01.592909 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e81088aa-7fdd-43f0-a6e8-3e60685247ab tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:01.601616 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e81088aa-7fdd-43f0-a6e8-3e60685247ab tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1318 microversion: 2.1 time: 0.169331 May 27 15:55:01.602194 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3535/7088] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:01 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:02.619061 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a4e654fb-0614-4df2-869c-63a07e527374 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:02.619598 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a4e654fb-0614-4df2-869c-63a07e527374 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:02.626657 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4e654fb-0614-4df2-869c-63a07e527374 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:02.627107 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4e654fb-0614-4df2-869c-63a07e527374 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:02.627867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4e654fb-0614-4df2-869c-63a07e527374 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:02.628308 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a4e654fb-0614-4df2-869c-63a07e527374 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:02.760710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a4e654fb-0614-4df2-869c-63a07e527374 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:02.768215 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a4e654fb-0614-4df2-869c-63a07e527374 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1318 microversion: 2.1 time: 0.153725 May 27 15:55:02.768815 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3554/7089] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:02 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:03.096935 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-7e71c65c-96fa-4363-a7a1-d3d4fcf583b2 req-5dc806b2-278b-4cad-a9a3-3a8496d07413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3efff23e-c4fc-4708-923c-d6f1f1116104", "name": "network-vif-plugged", "status": "completed", "tag": "e01de142-2ff5-4b5f-a8e9-320c2c0c9ba5"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:55:03.110034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-7e71c65c-96fa-4363-a7a1-d3d4fcf583b2 req-5dc806b2-278b-4cad-a9a3-3a8496d07413 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:03.110649 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-7e71c65c-96fa-4363-a7a1-d3d4fcf583b2 req-5dc806b2-278b-4cad-a9a3-3a8496d07413 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:03.123276 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-7e71c65c-96fa-4363-a7a1-d3d4fcf583b2 req-5dc806b2-278b-4cad-a9a3-3a8496d07413 service nova] Creating event network-vif-plugged:e01de142-2ff5-4b5f-a8e9-320c2c0c9ba5 for instance 3efff23e-c4fc-4708-923c-d6f1f1116104 on n-h1-843621-1 May 27 15:55:03.129123 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-7e71c65c-96fa-4363-a7a1-d3d4fcf583b2 req-5dc806b2-278b-4cad-a9a3-3a8496d07413 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035967 May 27 15:55:03.129819 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3536/7090] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:55:03.785287 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-de007239-cc2f-43f4-8480-ce885d40fdcc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:03.785944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-de007239-cc2f-43f4-8480-ce885d40fdcc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:03.787862 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:55:03.794624 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de007239-cc2f-43f4-8480-ce885d40fdcc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:03.795090 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de007239-cc2f-43f4-8480-ce885d40fdcc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:03.795873 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de007239-cc2f-43f4-8480-ce885d40fdcc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:03.796323 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-de007239-cc2f-43f4-8480-ce885d40fdcc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:03.927285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-de007239-cc2f-43f4-8480-ce885d40fdcc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:03.934829 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-de007239-cc2f-43f4-8480-ce885d40fdcc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1318 microversion: 2.1 time: 0.153435 May 27 15:55:03.935412 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3555/7091] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:03 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:04.952288 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-7e2bdc51-125f-4c82-add5-0bb0e2e5512e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:04.953028 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-7e2bdc51-125f-4c82-add5-0bb0e2e5512e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:04.955005 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:55:04.955673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:55:04.963296 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e2bdc51-125f-4c82-add5-0bb0e2e5512e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:04.963761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e2bdc51-125f-4c82-add5-0bb0e2e5512e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:04.964544 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e2bdc51-125f-4c82-add5-0bb0e2e5512e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:04.965044 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-7e2bdc51-125f-4c82-add5-0bb0e2e5512e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:05.100455 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-7e2bdc51-125f-4c82-add5-0bb0e2e5512e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:05.108959 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-7e2bdc51-125f-4c82-add5-0bb0e2e5512e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1318 microversion: 2.1 time: 0.160951 May 27 15:55:05.109561 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3537/7092] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:04 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:06.126066 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-fda736ab-9e43-4bf2-bbbf-607ce4d1ec80 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:06.126689 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-fda736ab-9e43-4bf2-bbbf-607ce4d1ec80 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:06.133652 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fda736ab-9e43-4bf2-bbbf-607ce4d1ec80 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:06.134111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fda736ab-9e43-4bf2-bbbf-607ce4d1ec80 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:06.135510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fda736ab-9e43-4bf2-bbbf-607ce4d1ec80 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:06.135957 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-fda736ab-9e43-4bf2-bbbf-607ce4d1ec80 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:06.270972 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-fda736ab-9e43-4bf2-bbbf-607ce4d1ec80 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:06.278583 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-fda736ab-9e43-4bf2-bbbf-607ce4d1ec80 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1508 microversion: 2.1 time: 0.156412 May 27 15:55:06.279150 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3556/7093] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:06 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:06.295169 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4ddc2ee6-9718-4448-9209-3179afbbf4e4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:06.295930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4ddc2ee6-9718-4448-9209-3179afbbf4e4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:06.302896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ddc2ee6-9718-4448-9209-3179afbbf4e4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:06.303370 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ddc2ee6-9718-4448-9209-3179afbbf4e4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:06.304148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ddc2ee6-9718-4448-9209-3179afbbf4e4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:06.304602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4ddc2ee6-9718-4448-9209-3179afbbf4e4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:06.439738 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4ddc2ee6-9718-4448-9209-3179afbbf4e4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:06.447377 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4ddc2ee6-9718-4448-9209-3179afbbf4e4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1508 microversion: 2.1 time: 0.156645 May 27 15:55:06.447958 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3538/7094] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:06 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:06.463186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-87b5bfe5-2844-4ae9-8a78-56224935937f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:55:06.464210 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-87b5bfe5-2844-4ae9-8a78-56224935937f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:06.470468 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87b5bfe5-2844-4ae9-8a78-56224935937f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:06.470921 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87b5bfe5-2844-4ae9-8a78-56224935937f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:06.471710 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87b5bfe5-2844-4ae9-8a78-56224935937f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:06.472150 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-87b5bfe5-2844-4ae9-8a78-56224935937f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:06.500510 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-87b5bfe5-2844-4ae9-8a78-56224935937f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:06.506427 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-87b5bfe5-2844-4ae9-8a78-56224935937f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Old instance type m1.heat2, new instance type m1.heat {{(pid=119249) resize /opt/stack/nova/nova/compute/api.py:4166}} May 27 15:55:06.512522 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-87b5bfe5-2844-4ae9-8a78-56224935937f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:55:06.512977 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-87b5bfe5-2844-4ae9-8a78-56224935937f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:55:06.513454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-87b5bfe5-2844-4ae9-8a78-56224935937f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:55:06.513867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-87b5bfe5-2844-4ae9-8a78-56224935937f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:55:06.514281 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-87b5bfe5-2844-4ae9-8a78-56224935937f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:55:06.577051 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-87b5bfe5-2844-4ae9-8a78-56224935937f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "POST /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104/action" status: 202 len: 0 microversion: 2.1 time: 0.117787 May 27 15:55:06.577737 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3557/7095] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:55:06 2022] POST /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:55:06.585997 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-32f0e0e8-cf35-4db2-9f1b-61cf8a5bbddb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:06.586767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-32f0e0e8-cf35-4db2-9f1b-61cf8a5bbddb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:06.593939 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32f0e0e8-cf35-4db2-9f1b-61cf8a5bbddb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:06.594495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32f0e0e8-cf35-4db2-9f1b-61cf8a5bbddb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:06.595368 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32f0e0e8-cf35-4db2-9f1b-61cf8a5bbddb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:06.595843 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-32f0e0e8-cf35-4db2-9f1b-61cf8a5bbddb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:06.735483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-32f0e0e8-cf35-4db2-9f1b-61cf8a5bbddb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:06.744708 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-32f0e0e8-cf35-4db2-9f1b-61cf8a5bbddb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1515 microversion: 2.1 time: 0.162513 May 27 15:55:06.745386 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3539/7096] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:06 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:07.763210 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a322d215-54e0-4994-be58-bb84f1631e65 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:07.763827 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a322d215-54e0-4994-be58-bb84f1631e65 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:07.770450 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a322d215-54e0-4994-be58-bb84f1631e65 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:07.770961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a322d215-54e0-4994-be58-bb84f1631e65 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:07.771762 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a322d215-54e0-4994-be58-bb84f1631e65 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:07.772209 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a322d215-54e0-4994-be58-bb84f1631e65 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:07.902158 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a322d215-54e0-4994-be58-bb84f1631e65 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:07.909880 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a322d215-54e0-4994-be58-bb84f1631e65 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1515 microversion: 2.1 time: 0.151842 May 27 15:55:07.910460 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3558/7097] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:07 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:08.928297 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2bf48d1b-3d31-487a-b706-32cf40dad55d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:08.928998 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2bf48d1b-3d31-487a-b706-32cf40dad55d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:08.935940 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bf48d1b-3d31-487a-b706-32cf40dad55d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:08.936412 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bf48d1b-3d31-487a-b706-32cf40dad55d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:08.937222 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bf48d1b-3d31-487a-b706-32cf40dad55d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:08.937677 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2bf48d1b-3d31-487a-b706-32cf40dad55d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:09.071849 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2bf48d1b-3d31-487a-b706-32cf40dad55d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:09.079543 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2bf48d1b-3d31-487a-b706-32cf40dad55d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.155421 May 27 15:55:09.080128 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3540/7098] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:08 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:10.097411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ff2bfb8f-45b1-4894-865c-862dc9012500 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:10.098035 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ff2bfb8f-45b1-4894-865c-862dc9012500 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:10.104898 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff2bfb8f-45b1-4894-865c-862dc9012500 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:10.105357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff2bfb8f-45b1-4894-865c-862dc9012500 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:10.106129 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff2bfb8f-45b1-4894-865c-862dc9012500 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:10.106576 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ff2bfb8f-45b1-4894-865c-862dc9012500 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:10.234966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ff2bfb8f-45b1-4894-865c-862dc9012500 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:10.242768 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ff2bfb8f-45b1-4894-865c-862dc9012500 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.149286 May 27 15:55:10.243340 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3559/7099] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:10 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:11.260371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-62be71f9-1beb-445d-9620-36bb720f4ff3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:11.261036 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-62be71f9-1beb-445d-9620-36bb720f4ff3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:11.267979 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62be71f9-1beb-445d-9620-36bb720f4ff3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:11.268459 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62be71f9-1beb-445d-9620-36bb720f4ff3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:11.269550 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62be71f9-1beb-445d-9620-36bb720f4ff3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:11.270014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-62be71f9-1beb-445d-9620-36bb720f4ff3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:11.399291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-62be71f9-1beb-445d-9620-36bb720f4ff3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:11.407507 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-62be71f9-1beb-445d-9620-36bb720f4ff3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.151049 May 27 15:55:11.408085 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3541/7100] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:11 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:12.424283 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d6260163-e05d-432b-9bd9-b0e88c38a4b6 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:12.424950 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d6260163-e05d-432b-9bd9-b0e88c38a4b6 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:12.432520 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6260163-e05d-432b-9bd9-b0e88c38a4b6 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:12.433572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6260163-e05d-432b-9bd9-b0e88c38a4b6 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:12.434334 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6260163-e05d-432b-9bd9-b0e88c38a4b6 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:12.434913 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d6260163-e05d-432b-9bd9-b0e88c38a4b6 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:12.580242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d6260163-e05d-432b-9bd9-b0e88c38a4b6 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:12.591982 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d6260163-e05d-432b-9bd9-b0e88c38a4b6 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.171604 May 27 15:55:12.592566 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3560/7101] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:12 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:13.609030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-35ca95a0-f7fe-4dc2-bc83-d5237320309e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:13.609671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-35ca95a0-f7fe-4dc2-bc83-d5237320309e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:13.616818 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-35ca95a0-f7fe-4dc2-bc83-d5237320309e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:13.617245 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-35ca95a0-f7fe-4dc2-bc83-d5237320309e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:13.618041 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-35ca95a0-f7fe-4dc2-bc83-d5237320309e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:13.618510 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-35ca95a0-f7fe-4dc2-bc83-d5237320309e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:13.750148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-35ca95a0-f7fe-4dc2-bc83-d5237320309e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:13.757893 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-35ca95a0-f7fe-4dc2-bc83-d5237320309e tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.152823 May 27 15:55:13.758472 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3542/7102] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:13 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:14.775344 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e8bcdfab-4e46-4742-a81d-370cbed554bc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:14.775894 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e8bcdfab-4e46-4742-a81d-370cbed554bc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:14.783261 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8bcdfab-4e46-4742-a81d-370cbed554bc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:14.783719 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8bcdfab-4e46-4742-a81d-370cbed554bc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:14.784483 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8bcdfab-4e46-4742-a81d-370cbed554bc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:14.784955 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e8bcdfab-4e46-4742-a81d-370cbed554bc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:14.915819 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e8bcdfab-4e46-4742-a81d-370cbed554bc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:14.923452 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e8bcdfab-4e46-4742-a81d-370cbed554bc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.152100 May 27 15:55:14.924013 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3561/7103] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:14 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:15.940902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-d12482ca-2f14-4bf4-912c-728cec2611fc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:15.941540 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-d12482ca-2f14-4bf4-912c-728cec2611fc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:15.948565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d12482ca-2f14-4bf4-912c-728cec2611fc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:15.949584 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d12482ca-2f14-4bf4-912c-728cec2611fc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:15.950370 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d12482ca-2f14-4bf4-912c-728cec2611fc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:15.950831 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-d12482ca-2f14-4bf4-912c-728cec2611fc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:16.133332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-d12482ca-2f14-4bf4-912c-728cec2611fc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:16.141765 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-d12482ca-2f14-4bf4-912c-728cec2611fc tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.204829 May 27 15:55:16.142358 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3543/7104] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:15 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:17.160386 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-2d5275b6-ad28-4734-a1a4-d855c8bb0557 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:17.161024 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-2d5275b6-ad28-4734-a1a4-d855c8bb0557 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:17.168190 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2d5275b6-ad28-4734-a1a4-d855c8bb0557 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:17.168647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2d5275b6-ad28-4734-a1a4-d855c8bb0557 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:17.169456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2d5275b6-ad28-4734-a1a4-d855c8bb0557 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:17.170495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-2d5275b6-ad28-4734-a1a4-d855c8bb0557 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:17.341349 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-2d5275b6-ad28-4734-a1a4-d855c8bb0557 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:17.350299 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-2d5275b6-ad28-4734-a1a4-d855c8bb0557 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.193998 May 27 15:55:17.350886 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3562/7105] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:17 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:18.367585 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0caaf05d-2011-437f-a53f-f610b50271ff tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:18.368223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0caaf05d-2011-437f-a53f-f610b50271ff tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:18.376061 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0caaf05d-2011-437f-a53f-f610b50271ff tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:18.376530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0caaf05d-2011-437f-a53f-f610b50271ff tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:18.377343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0caaf05d-2011-437f-a53f-f610b50271ff tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:18.377802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0caaf05d-2011-437f-a53f-f610b50271ff tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:18.597690 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0caaf05d-2011-437f-a53f-f610b50271ff tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:18.606019 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0caaf05d-2011-437f-a53f-f610b50271ff tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.242476 May 27 15:55:18.606602 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3544/7106] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:18 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:19.623782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f9b18787-fc2e-4f10-8c69-07c5afb748cb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:19.624319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f9b18787-fc2e-4f10-8c69-07c5afb748cb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:19.632126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f9b18787-fc2e-4f10-8c69-07c5afb748cb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:19.632580 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f9b18787-fc2e-4f10-8c69-07c5afb748cb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:19.633378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f9b18787-fc2e-4f10-8c69-07c5afb748cb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:19.633824 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f9b18787-fc2e-4f10-8c69-07c5afb748cb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:19.761394 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f9b18787-fc2e-4f10-8c69-07c5afb748cb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:19.770068 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f9b18787-fc2e-4f10-8c69-07c5afb748cb tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.150290 May 27 15:55:19.770667 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3563/7107] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:19 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:20.787305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e836e980-e40c-48c4-af25-b79795de33ce tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:20.787934 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e836e980-e40c-48c4-af25-b79795de33ce tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:20.794850 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e836e980-e40c-48c4-af25-b79795de33ce tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:20.796054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e836e980-e40c-48c4-af25-b79795de33ce tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:20.796892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e836e980-e40c-48c4-af25-b79795de33ce tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:20.797364 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e836e980-e40c-48c4-af25-b79795de33ce tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:20.931840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-e836e980-e40c-48c4-af25-b79795de33ce tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:20.939424 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e836e980-e40c-48c4-af25-b79795de33ce tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.156251 May 27 15:55:20.939994 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3545/7108] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:20 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:21.955968 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d5a96acb-4746-4ac1-a57e-b862880ef6ca tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:21.956591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d5a96acb-4746-4ac1-a57e-b862880ef6ca tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:21.963579 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d5a96acb-4746-4ac1-a57e-b862880ef6ca tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:21.964027 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d5a96acb-4746-4ac1-a57e-b862880ef6ca tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:21.964827 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d5a96acb-4746-4ac1-a57e-b862880ef6ca tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:21.965272 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d5a96acb-4746-4ac1-a57e-b862880ef6ca tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:22.171440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d5a96acb-4746-4ac1-a57e-b862880ef6ca tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:22.178861 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d5a96acb-4746-4ac1-a57e-b862880ef6ca tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.226755 May 27 15:55:22.179427 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3564/7109] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:21 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:23.196742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-86fbe77e-148c-4b93-9371-3dcd5d8855c3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:23.197362 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-86fbe77e-148c-4b93-9371-3dcd5d8855c3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:23.204277 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-86fbe77e-148c-4b93-9371-3dcd5d8855c3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:23.204780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-86fbe77e-148c-4b93-9371-3dcd5d8855c3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:23.205560 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-86fbe77e-148c-4b93-9371-3dcd5d8855c3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:23.206018 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-86fbe77e-148c-4b93-9371-3dcd5d8855c3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:23.209066 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=90 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:55:23.339150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-86fbe77e-148c-4b93-9371-3dcd5d8855c3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:23.347340 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-86fbe77e-148c-4b93-9371-3dcd5d8855c3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.154678 May 27 15:55:23.347913 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3546/7110] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:23 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:24.363953 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-13ffd7b3-7999-4be1-9f37-e4792b7556c1 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:24.364625 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-13ffd7b3-7999-4be1-9f37-e4792b7556c1 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:24.371549 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13ffd7b3-7999-4be1-9f37-e4792b7556c1 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:24.372010 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13ffd7b3-7999-4be1-9f37-e4792b7556c1 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:24.373359 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13ffd7b3-7999-4be1-9f37-e4792b7556c1 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:24.375936 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-13ffd7b3-7999-4be1-9f37-e4792b7556c1 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:24.510288 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-13ffd7b3-7999-4be1-9f37-e4792b7556c1 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:24.517981 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-13ffd7b3-7999-4be1-9f37-e4792b7556c1 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.157934 May 27 15:55:24.518593 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3565/7111] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:24 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:25.536146 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-834ed6ee-050b-446a-ab3c-7bb3c38e41d0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:25.537077 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-834ed6ee-050b-446a-ab3c-7bb3c38e41d0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:25.544000 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-834ed6ee-050b-446a-ab3c-7bb3c38e41d0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:25.544472 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-834ed6ee-050b-446a-ab3c-7bb3c38e41d0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:25.545376 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-834ed6ee-050b-446a-ab3c-7bb3c38e41d0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:25.545839 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-834ed6ee-050b-446a-ab3c-7bb3c38e41d0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:25.673516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-834ed6ee-050b-446a-ab3c-7bb3c38e41d0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:25.681320 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-834ed6ee-050b-446a-ab3c-7bb3c38e41d0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.149626 May 27 15:55:25.681897 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3547/7112] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:25 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:26.699239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8df82958-48e5-4b5d-8ea1-4011a7c6ed35 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:26.699867 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8df82958-48e5-4b5d-8ea1-4011a7c6ed35 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:26.707239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8df82958-48e5-4b5d-8ea1-4011a7c6ed35 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:26.707698 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8df82958-48e5-4b5d-8ea1-4011a7c6ed35 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:26.708469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8df82958-48e5-4b5d-8ea1-4011a7c6ed35 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:26.709186 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8df82958-48e5-4b5d-8ea1-4011a7c6ed35 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:26.711524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:55:26.842606 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8df82958-48e5-4b5d-8ea1-4011a7c6ed35 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:26.850165 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8df82958-48e5-4b5d-8ea1-4011a7c6ed35 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.155037 May 27 15:55:26.850862 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3566/7113] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:26 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:27.867359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-75e35491-a782-422b-80ac-fafb21be7e7d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:27.868008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-75e35491-a782-422b-80ac-fafb21be7e7d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:27.875150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75e35491-a782-422b-80ac-fafb21be7e7d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:27.875629 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75e35491-a782-422b-80ac-fafb21be7e7d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:27.876420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75e35491-a782-422b-80ac-fafb21be7e7d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:27.876928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-75e35491-a782-422b-80ac-fafb21be7e7d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:28.002965 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-75e35491-a782-422b-80ac-fafb21be7e7d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:28.010606 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-75e35491-a782-422b-80ac-fafb21be7e7d tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.147142 May 27 15:55:28.011183 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3548/7114] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:27 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:29.027259 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3830ea21-9578-4757-9d1a-b462b72dc1a0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:29.027874 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3830ea21-9578-4757-9d1a-b462b72dc1a0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:29.035268 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3830ea21-9578-4757-9d1a-b462b72dc1a0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:29.035722 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3830ea21-9578-4757-9d1a-b462b72dc1a0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:29.036480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3830ea21-9578-4757-9d1a-b462b72dc1a0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:29.036944 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3830ea21-9578-4757-9d1a-b462b72dc1a0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:29.173128 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3830ea21-9578-4757-9d1a-b462b72dc1a0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:29.180604 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3830ea21-9578-4757-9d1a-b462b72dc1a0 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.157285 May 27 15:55:29.181220 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3567/7115] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:29 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:30.197644 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-117e900d-dc8d-4144-9576-92b881d59025 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:30.198279 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-117e900d-dc8d-4144-9576-92b881d59025 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:30.205073 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-117e900d-dc8d-4144-9576-92b881d59025 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:30.205547 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-117e900d-dc8d-4144-9576-92b881d59025 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:30.206335 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-117e900d-dc8d-4144-9576-92b881d59025 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:30.206793 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-117e900d-dc8d-4144-9576-92b881d59025 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:30.335666 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-117e900d-dc8d-4144-9576-92b881d59025 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:30.343323 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-117e900d-dc8d-4144-9576-92b881d59025 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.149678 May 27 15:55:30.343900 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3549/7116] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:30 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:31.359906 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d50c52d9-a6de-4943-830b-f152853ac5c3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:31.360527 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d50c52d9-a6de-4943-830b-f152853ac5c3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:31.363336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=34 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:55:31.368738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d50c52d9-a6de-4943-830b-f152853ac5c3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:31.369192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d50c52d9-a6de-4943-830b-f152853ac5c3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:31.369957 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d50c52d9-a6de-4943-830b-f152853ac5c3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:31.370397 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d50c52d9-a6de-4943-830b-f152853ac5c3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:31.495791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d50c52d9-a6de-4943-830b-f152853ac5c3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:31.503263 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d50c52d9-a6de-4943-830b-f152853ac5c3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.147817 May 27 15:55:31.503831 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3568/7117] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:31 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:32.520164 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-19c3379f-3d84-4410-8983-4a7c8164d2e3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:32.520836 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-19c3379f-3d84-4410-8983-4a7c8164d2e3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:32.523551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=30 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:55:32.529016 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19c3379f-3d84-4410-8983-4a7c8164d2e3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:32.529498 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19c3379f-3d84-4410-8983-4a7c8164d2e3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:32.530333 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19c3379f-3d84-4410-8983-4a7c8164d2e3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:32.530822 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19c3379f-3d84-4410-8983-4a7c8164d2e3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:32.671660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-19c3379f-3d84-4410-8983-4a7c8164d2e3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:32.679460 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-19c3379f-3d84-4410-8983-4a7c8164d2e3 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.163570 May 27 15:55:32.680071 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3550/7118] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:32 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:33.696712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3b5a393a-0362-4c6c-a15f-1cd333b02f2c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:33.697284 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3b5a393a-0362-4c6c-a15f-1cd333b02f2c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:33.704800 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b5a393a-0362-4c6c-a15f-1cd333b02f2c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:33.705263 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b5a393a-0362-4c6c-a15f-1cd333b02f2c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:33.706039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b5a393a-0362-4c6c-a15f-1cd333b02f2c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:33.706487 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3b5a393a-0362-4c6c-a15f-1cd333b02f2c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:33.834572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3b5a393a-0362-4c6c-a15f-1cd333b02f2c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:33.842212 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3b5a393a-0362-4c6c-a15f-1cd333b02f2c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.149642 May 27 15:55:33.842889 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3569/7119] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:33 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:34.859789 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-19cebfe3-e0e3-4d7e-ba6c-4f2a3eb524ed tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:34.860433 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-19cebfe3-e0e3-4d7e-ba6c-4f2a3eb524ed tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:34.867699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19cebfe3-e0e3-4d7e-ba6c-4f2a3eb524ed tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:34.868182 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19cebfe3-e0e3-4d7e-ba6c-4f2a3eb524ed tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:34.869014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19cebfe3-e0e3-4d7e-ba6c-4f2a3eb524ed tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:34.869481 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-19cebfe3-e0e3-4d7e-ba6c-4f2a3eb524ed tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:35.002861 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-19cebfe3-e0e3-4d7e-ba6c-4f2a3eb524ed tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:35.010378 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-19cebfe3-e0e3-4d7e-ba6c-4f2a3eb524ed tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1520 microversion: 2.1 time: 0.155625 May 27 15:55:35.010956 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3551/7120] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:34 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:35.788290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-1fe98f63-1565-4026-a1ca-6f5b92df0dab req-5d16c468-5cf6-4878-a289-a034211e0005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3efff23e-c4fc-4708-923c-d6f1f1116104", "name": "network-vif-unplugged", "status": "completed", "tag": "e01de142-2ff5-4b5f-a8e9-320c2c0c9ba5"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:55:35.796872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-1fe98f63-1565-4026-a1ca-6f5b92df0dab req-5d16c468-5cf6-4878-a289-a034211e0005 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:35.797917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-1fe98f63-1565-4026-a1ca-6f5b92df0dab req-5d16c468-5cf6-4878-a289-a034211e0005 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:35.810407 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-1fe98f63-1565-4026-a1ca-6f5b92df0dab req-5d16c468-5cf6-4878-a289-a034211e0005 service nova] Creating event network-vif-unplugged:e01de142-2ff5-4b5f-a8e9-320c2c0c9ba5 for instance 3efff23e-c4fc-4708-923c-d6f1f1116104 on n-h2-843621-1 May 27 15:55:35.816551 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [req-1fe98f63-1565-4026-a1ca-6f5b92df0dab req-5d16c468-5cf6-4878-a289-a034211e0005 service nova] Instance 3efff23e-c4fc-4708-923c-d6f1f1116104 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119249) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 15:55:35.831282 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-1fe98f63-1565-4026-a1ca-6f5b92df0dab req-5d16c468-5cf6-4878-a289-a034211e0005 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111853 May 27 15:55:35.831993 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3570/7121] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:55:36.027371 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a9b1b6bd-04ae-44dc-ac9c-8b68fb42a4ec tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:36.028154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a9b1b6bd-04ae-44dc-ac9c-8b68fb42a4ec tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:36.035262 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a9b1b6bd-04ae-44dc-ac9c-8b68fb42a4ec tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:36.035927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a9b1b6bd-04ae-44dc-ac9c-8b68fb42a4ec tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:36.036999 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a9b1b6bd-04ae-44dc-ac9c-8b68fb42a4ec tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:36.037532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a9b1b6bd-04ae-44dc-ac9c-8b68fb42a4ec tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:36.250483 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a9b1b6bd-04ae-44dc-ac9c-8b68fb42a4ec tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:36.258246 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a9b1b6bd-04ae-44dc-ac9c-8b68fb42a4ec tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1519 microversion: 2.1 time: 0.234783 May 27 15:55:36.259071 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3552/7122] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:36 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1519 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:37.277310 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-9d82b1d1-7b8c-43c6-be41-01d0d89d52db tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:37.278083 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-9d82b1d1-7b8c-43c6-be41-01d0d89d52db tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:37.284297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d82b1d1-7b8c-43c6-be41-01d0d89d52db tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:37.284788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d82b1d1-7b8c-43c6-be41-01d0d89d52db tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:37.285566 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d82b1d1-7b8c-43c6-be41-01d0d89d52db tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:37.286012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-9d82b1d1-7b8c-43c6-be41-01d0d89d52db tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:37.415530 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-9d82b1d1-7b8c-43c6-be41-01d0d89d52db tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:37.423085 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-9d82b1d1-7b8c-43c6-be41-01d0d89d52db tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1517 microversion: 2.1 time: 0.151029 May 27 15:55:37.423662 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3571/7123] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:37 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:37.853761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-1e0488be-4c77-4194-ac8d-55fe2eda7fd2 req-2f34f22b-7186-4c4d-b877-15e5597a07cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3efff23e-c4fc-4708-923c-d6f1f1116104", "tag": "e01de142-2ff5-4b5f-a8e9-320c2c0c9ba5"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:55:37.863306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-1e0488be-4c77-4194-ac8d-55fe2eda7fd2 req-2f34f22b-7186-4c4d-b877-15e5597a07cc service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:37.863785 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-1e0488be-4c77-4194-ac8d-55fe2eda7fd2 req-2f34f22b-7186-4c4d-b877-15e5597a07cc service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:37.885516 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-1e0488be-4c77-4194-ac8d-55fe2eda7fd2 req-2f34f22b-7186-4c4d-b877-15e5597a07cc service nova] Creating event network-changed:e01de142-2ff5-4b5f-a8e9-320c2c0c9ba5 for instance 3efff23e-c4fc-4708-923c-d6f1f1116104 on n-h2-843621-1 May 27 15:55:37.891148 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [req-1e0488be-4c77-4194-ac8d-55fe2eda7fd2 req-2f34f22b-7186-4c4d-b877-15e5597a07cc service nova] Instance 3efff23e-c4fc-4708-923c-d6f1f1116104 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119248) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 15:55:37.902218 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-1e0488be-4c77-4194-ac8d-55fe2eda7fd2 req-2f34f22b-7186-4c4d-b877-15e5597a07cc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052100 May 27 15:55:37.903055 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3553/7124] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:55:38.236293 n-d-843621-1 devstack@n-api.service[119248]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:55:38.237167 n-d-843621-1 devstack@n-api.service[119248]: Fri May 27 15:55:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:55:38.439650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-027458c3-c63a-4e02-936b-2d65bc46d9e4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:38.440277 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-027458c3-c63a-4e02-936b-2d65bc46d9e4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:38.449667 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-027458c3-c63a-4e02-936b-2d65bc46d9e4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:38.450133 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-027458c3-c63a-4e02-936b-2d65bc46d9e4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:38.450964 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-027458c3-c63a-4e02-936b-2d65bc46d9e4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:38.453123 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-027458c3-c63a-4e02-936b-2d65bc46d9e4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:38.693408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-027458c3-c63a-4e02-936b-2d65bc46d9e4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:38.701404 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-027458c3-c63a-4e02-936b-2d65bc46d9e4 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1514 microversion: 2.1 time: 0.265671 May 27 15:55:38.702570 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3572/7125] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:38 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1514 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:38.723896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e4a79f13-1c25-4950-afb2-f83ace37e48f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:55:38.724555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-e4a79f13-1c25-4950-afb2-f83ace37e48f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:38.731014 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4a79f13-1c25-4950-afb2-f83ace37e48f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:38.731495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4a79f13-1c25-4950-afb2-f83ace37e48f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:38.732313 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4a79f13-1c25-4950-afb2-f83ace37e48f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:38.732804 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-e4a79f13-1c25-4950-afb2-f83ace37e48f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:38.798056 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e4a79f13-1c25-4950-afb2-f83ace37e48f tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "POST /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104/action" status: 204 len: 0 microversion: 2.1 time: 0.078382 May 27 15:55:38.798756 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3554/7126] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:55:38 2022] POST /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:55:38.807192 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-673992f2-2864-410e-85dc-51d75103f073 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:38.807991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-673992f2-2864-410e-85dc-51d75103f073 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:38.815239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-673992f2-2864-410e-85dc-51d75103f073 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:38.816042 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-673992f2-2864-410e-85dc-51d75103f073 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:38.817013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-673992f2-2864-410e-85dc-51d75103f073 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:38.817473 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-673992f2-2864-410e-85dc-51d75103f073 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:38.975866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-673992f2-2864-410e-85dc-51d75103f073 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:38.983724 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-673992f2-2864-410e-85dc-51d75103f073 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1514 microversion: 2.1 time: 0.180702 May 27 15:55:38.984316 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3573/7127] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:38 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:40.002659 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-3d306b98-614c-42f8-8a3b-e5b3fb806b82 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:40.003388 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-3d306b98-614c-42f8-8a3b-e5b3fb806b82 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:40.010299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d306b98-614c-42f8-8a3b-e5b3fb806b82 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:40.010794 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d306b98-614c-42f8-8a3b-e5b3fb806b82 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:40.011892 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d306b98-614c-42f8-8a3b-e5b3fb806b82 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:40.012530 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-3d306b98-614c-42f8-8a3b-e5b3fb806b82 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:40.146632 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-3d306b98-614c-42f8-8a3b-e5b3fb806b82 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:40.154550 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-3d306b98-614c-42f8-8a3b-e5b3fb806b82 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1506 microversion: 2.1 time: 0.157099 May 27 15:55:40.155894 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3555/7128] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:39 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:40.171502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-12a18f80-a51c-4677-835d-4d6597bf366c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:40.172122 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-12a18f80-a51c-4677-835d-4d6597bf366c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:40.179011 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12a18f80-a51c-4677-835d-4d6597bf366c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:40.179469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12a18f80-a51c-4677-835d-4d6597bf366c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:40.180292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12a18f80-a51c-4677-835d-4d6597bf366c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:40.180757 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12a18f80-a51c-4677-835d-4d6597bf366c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:40.316438 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-dd81cc2f-496a-4c7f-b0c3-beebeb1814dc req-a6132fe9-5e21-4ffa-93f4-073740d6e6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3efff23e-c4fc-4708-923c-d6f1f1116104", "name": "network-vif-plugged", "status": "completed", "tag": "e01de142-2ff5-4b5f-a8e9-320c2c0c9ba5"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:55:40.319328 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-12a18f80-a51c-4677-835d-4d6597bf366c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:40.327661 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-dd81cc2f-496a-4c7f-b0c3-beebeb1814dc req-a6132fe9-5e21-4ffa-93f4-073740d6e6e7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:40.328032 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-12a18f80-a51c-4677-835d-4d6597bf366c tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1506 microversion: 2.1 time: 0.160323 May 27 15:55:40.328154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-dd81cc2f-496a-4c7f-b0c3-beebeb1814dc req-a6132fe9-5e21-4ffa-93f4-073740d6e6e7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:40.332831 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3574/7129] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:40 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:40.340292 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-dd81cc2f-496a-4c7f-b0c3-beebeb1814dc req-a6132fe9-5e21-4ffa-93f4-073740d6e6e7 service nova] Creating event network-vif-plugged:e01de142-2ff5-4b5f-a8e9-320c2c0c9ba5 for instance 3efff23e-c4fc-4708-923c-d6f1f1116104 on n-h2-843621-1 May 27 15:55:40.344413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-835d0212-0c51-4377-bc88-2be2b65035e2 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:40.345216 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-835d0212-0c51-4377-bc88-2be2b65035e2 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:40.345838 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-dd81cc2f-496a-4c7f-b0c3-beebeb1814dc req-a6132fe9-5e21-4ffa-93f4-073740d6e6e7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032941 May 27 15:55:40.346432 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3556/7130] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:55:40.354401 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-835d0212-0c51-4377-bc88-2be2b65035e2 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:40.355650 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-835d0212-0c51-4377-bc88-2be2b65035e2 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:40.356716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-835d0212-0c51-4377-bc88-2be2b65035e2 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:40.357706 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-835d0212-0c51-4377-bc88-2be2b65035e2 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:40.487690 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-835d0212-0c51-4377-bc88-2be2b65035e2 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:40.495445 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-835d0212-0c51-4377-bc88-2be2b65035e2 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1506 microversion: 2.1 time: 0.155180 May 27 15:55:40.496026 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3575/7131] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:40 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:40.513506 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b881180c-0a24-4524-bd81-4e3b5f7bde4a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:40.514121 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b881180c-0a24-4524-bd81-4e3b5f7bde4a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:40.521372 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b881180c-0a24-4524-bd81-4e3b5f7bde4a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:40.521856 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b881180c-0a24-4524-bd81-4e3b5f7bde4a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:40.522659 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b881180c-0a24-4524-bd81-4e3b5f7bde4a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:40.523124 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b881180c-0a24-4524-bd81-4e3b5f7bde4a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:40.553305 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b881180c-0a24-4524-bd81-4e3b5f7bde4a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:55:40.636127 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b881180c-0a24-4524-bd81-4e3b5f7bde4a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 204 len: 0 microversion: 2.1 time: 0.126614 May 27 15:55:40.636805 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3557/7132] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:55:40 2022] DELETE /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:55:40.653865 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d9edd4a3-9ddc-4b07-909d-1c0d09c7a45a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:40.654388 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d9edd4a3-9ddc-4b07-909d-1c0d09c7a45a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:40.661767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9edd4a3-9ddc-4b07-909d-1c0d09c7a45a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:40.661767 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9edd4a3-9ddc-4b07-909d-1c0d09c7a45a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:40.662546 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9edd4a3-9ddc-4b07-909d-1c0d09c7a45a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:40.662991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9edd4a3-9ddc-4b07-909d-1c0d09c7a45a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:40.689009 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d9edd4a3-9ddc-4b07-909d-1c0d09c7a45a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Going to try to terminate instance {{(pid=119249) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:55:40.732302 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.compute.api [None req-d9edd4a3-9ddc-4b07-909d-1c0d09c7a45a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Instance is already in deleting state, ignoring this request May 27 15:55:40.733754 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d9edd4a3-9ddc-4b07-909d-1c0d09c7a45a tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 204 len: 0 microversion: 2.1 time: 0.083428 May 27 15:55:40.734319 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3576/7133] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:55:40 2022] DELETE /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:55:40.743056 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-627a8dc0-85b9-4590-b140-5cd009d46343 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:40.743810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-627a8dc0-85b9-4590-b140-5cd009d46343 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:40.751290 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-627a8dc0-85b9-4590-b140-5cd009d46343 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:40.751767 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-627a8dc0-85b9-4590-b140-5cd009d46343 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:40.752566 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-627a8dc0-85b9-4590-b140-5cd009d46343 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:40.753054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-627a8dc0-85b9-4590-b140-5cd009d46343 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:40.889025 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-627a8dc0-85b9-4590-b140-5cd009d46343 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:40.897140 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-627a8dc0-85b9-4590-b140-5cd009d46343 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1512 microversion: 2.1 time: 0.158273 May 27 15:55:40.898113 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3558/7134] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:40 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:41.915469 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-05a06441-0390-45bd-a7c3-8e828e882c24 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:41.916246 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-05a06441-0390-45bd-a7c3-8e828e882c24 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:41.923433 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05a06441-0390-45bd-a7c3-8e828e882c24 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:41.924973 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05a06441-0390-45bd-a7c3-8e828e882c24 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:41.926239 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05a06441-0390-45bd-a7c3-8e828e882c24 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:41.926895 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-05a06441-0390-45bd-a7c3-8e828e882c24 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:42.147429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-05a06441-0390-45bd-a7c3-8e828e882c24 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8827c7bc3994623b020b5a3d1feb785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81229c6bb3044a7fba4fe081f35d3b21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:42.158781 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-05a06441-0390-45bd-a7c3-8e828e882c24 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 200 len: 1512 microversion: 2.1 time: 0.246589 May 27 15:55:42.159065 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3577/7135] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:41 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 1512 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:42.513754 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-27a3af7f-e43d-4449-895e-cc9cc8ec54c8 req-86ab0145-b8fe-48df-82fe-49b642421198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3efff23e-c4fc-4708-923c-d6f1f1116104", "name": "network-vif-deleted", "tag": "e01de142-2ff5-4b5f-a8e9-320c2c0c9ba5"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:55:42.526686 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-27a3af7f-e43d-4449-895e-cc9cc8ec54c8 req-86ab0145-b8fe-48df-82fe-49b642421198 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:42.527171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-27a3af7f-e43d-4449-895e-cc9cc8ec54c8 req-86ab0145-b8fe-48df-82fe-49b642421198 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:42.540298 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-27a3af7f-e43d-4449-895e-cc9cc8ec54c8 req-86ab0145-b8fe-48df-82fe-49b642421198 service nova] Creating event network-vif-deleted:e01de142-2ff5-4b5f-a8e9-320c2c0c9ba5 for instance 3efff23e-c4fc-4708-923c-d6f1f1116104 on n-h2-843621-1 May 27 15:55:42.545416 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-27a3af7f-e43d-4449-895e-cc9cc8ec54c8 req-86ab0145-b8fe-48df-82fe-49b642421198 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035427 May 27 15:55:42.546067 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3559/7136] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:55:43.175292 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-907aaddd-ac66-4b72-8f58-23c47afc92d8 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:43.176126 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-907aaddd-ac66-4b72-8f58-23c47afc92d8 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: 3efff23e-c4fc-4708-923c-d6f1f1116104] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:43.183118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-907aaddd-ac66-4b72-8f58-23c47afc92d8 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:43.183571 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-907aaddd-ac66-4b72-8f58-23c47afc92d8 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:43.184336 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-907aaddd-ac66-4b72-8f58-23c47afc92d8 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:43.184800 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-907aaddd-ac66-4b72-8f58-23c47afc92d8 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:43.198444 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-907aaddd-ac66-4b72-8f58-23c47afc92d8 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] HTTP exception thrown: Instance 3efff23e-c4fc-4708-923c-d6f1f1116104 could not be found. May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-907aaddd-ac66-4b72-8f58-23c47afc92d8 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Request method failure captured: May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 HTTP/1.1 May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikPQdMBcjam4remh1l61N1sJzIqirX0Fw9wcD4ooL_TrM9EVuCRmqhZT6H42DBAiXF75mixy7prkccvrXJ20G2GtKkUYUy6fYhyAehFzrea052l5eyGZ-ggkXhzmryXRWeA8_3TjEIu8Kju9xuIdviM5vCY6R5uJm61S9Wf7n7OomJ-I May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 81229c6bb3044a7fba4fe081f35d3b21 May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerDiskConfigTestJSON-845034219 May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/81229c6bb3044a7fba4fe081f35d3b21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/81229c6bb3044a7fba4fe081f35d3b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/81229c6bb3044a7fba4fe081f35d3b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_81229c6bb3044a7fba4fe081f35d3b21", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerDiskConfigTestJSON-845034219 May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 81229c6bb3044a7fba4fe081f35d3b21 May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-845034219 May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerDiskConfigTestJSON-845034219-project May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: c8827c7bc3994623b020b5a3d1feb785 May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerDiskConfigTestJSON-845034219-project May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance 3efff23e-c4fc-4708-923c-d6f1f1116104 could not be found. May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': '3efff23e-c4fc-4708-923c-d6f1f1116104'} May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3efff23e-c4fc-4708-923c-d6f1f1116104 could not be found. May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3efff23e-c4fc-4708-923c-d6f1f1116104 could not be found. May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:55:43.200120 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:55:43.205575 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:55:43.205575 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:55:43.205575 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:55:43.205575 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:55:43.205575 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:55:43.205575 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3efff23e-c4fc-4708-923c-d6f1f1116104 could not be found. May 27 15:55:43.205575 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:55:43.205575 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-907aaddd-ac66-4b72-8f58-23c47afc92d8 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Returning 404 to user: Instance 3efff23e-c4fc-4708-923c-d6f1f1116104 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:55:43.205575 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-907aaddd-ac66-4b72-8f58-23c47afc92d8 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104" status: 404 len: 111 microversion: 2.1 time: 0.030129 May 27 15:55:43.205575 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3578/7137] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:43 2022] GET /compute/v2.1/servers/3efff23e-c4fc-4708-923c-d6f1f1116104 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:55:43.213366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c878c4ea-40c9-4a9b-bdd7-c4689d91c162 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:43.213966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c878c4ea-40c9-4a9b-bdd7-c4689d91c162 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:43.220421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c878c4ea-40c9-4a9b-bdd7-c4689d91c162 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:43.220925 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c878c4ea-40c9-4a9b-bdd7-c4689d91c162 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:43.221706 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c878c4ea-40c9-4a9b-bdd7-c4689d91c162 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:43.222166 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c878c4ea-40c9-4a9b-bdd7-c4689d91c162 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:43.235364 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-c878c4ea-40c9-4a9b-bdd7-c4689d91c162 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] HTTP exception thrown: Instance a1c99736-8e53-4188-8064-aa06ddaa5c1c could not be found. May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c878c4ea-40c9-4a9b-bdd7-c4689d91c162 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Request method failure captured: May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: request: DELETE /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c HTTP/1.1 May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikPQdMBcjam4remh1l61N1sJzIqirX0Fw9wcD4ooL_TrM9EVuCRmqhZT6H42DBAiXF75mixy7prkccvrXJ20G2GtKkUYUy6fYhyAehFzrea052l5eyGZ-ggkXhzmryXRWeA8_3TjEIu8Kju9xuIdviM5vCY6R5uJm61S9Wf7n7OomJ-I May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 81229c6bb3044a7fba4fe081f35d3b21 May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerDiskConfigTestJSON-845034219 May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/81229c6bb3044a7fba4fe081f35d3b21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/81229c6bb3044a7fba4fe081f35d3b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/81229c6bb3044a7fba4fe081f35d3b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_81229c6bb3044a7fba4fe081f35d3b21", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerDiskConfigTestJSON-845034219 May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 81229c6bb3044a7fba4fe081f35d3b21 May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-845034219 May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerDiskConfigTestJSON-845034219-project May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: c8827c7bc3994623b020b5a3d1feb785 May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerDiskConfigTestJSON-845034219-project May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance a1c99736-8e53-4188-8064-aa06ddaa5c1c could not be found. May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'a1c99736-8e53-4188-8064-aa06ddaa5c1c'} May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c99736-8e53-4188-8064-aa06ddaa5c1c could not be found. May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:55:43.237060 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:55:43.241874 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c99736-8e53-4188-8064-aa06ddaa5c1c could not be found. May 27 15:55:43.241874 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:55:43.241874 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:55:43.241874 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:55:43.241874 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:55:43.241874 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:55:43.241874 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:55:43.241874 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:55:43.241874 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:55:43.241874 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c99736-8e53-4188-8064-aa06ddaa5c1c could not be found. May 27 15:55:43.241874 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:55:43.241874 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c878c4ea-40c9-4a9b-bdd7-c4689d91c162 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Returning 404 to user: Instance a1c99736-8e53-4188-8064-aa06ddaa5c1c could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:55:43.241874 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c878c4ea-40c9-4a9b-bdd7-c4689d91c162 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 404 len: 111 microversion: 2.1 time: 0.030295 May 27 15:55:43.241874 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3560/7138] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:55:43 2022] DELETE /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:55:43.247661 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-12be0875-5fcb-4d81-8f62-ef7cc3bcdc82 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:43.248279 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-12be0875-5fcb-4d81-8f62-ef7cc3bcdc82 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] [instance: a1c99736-8e53-4188-8064-aa06ddaa5c1c] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:43.254868 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12be0875-5fcb-4d81-8f62-ef7cc3bcdc82 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:43.255320 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12be0875-5fcb-4d81-8f62-ef7cc3bcdc82 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:43.256081 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12be0875-5fcb-4d81-8f62-ef7cc3bcdc82 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:43.256524 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-12be0875-5fcb-4d81-8f62-ef7cc3bcdc82 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:43.270996 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-12be0875-5fcb-4d81-8f62-ef7cc3bcdc82 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] HTTP exception thrown: Instance a1c99736-8e53-4188-8064-aa06ddaa5c1c could not be found. May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-12be0875-5fcb-4d81-8f62-ef7cc3bcdc82 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Request method failure captured: May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c HTTP/1.1 May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikPQdMBcjam4remh1l61N1sJzIqirX0Fw9wcD4ooL_TrM9EVuCRmqhZT6H42DBAiXF75mixy7prkccvrXJ20G2GtKkUYUy6fYhyAehFzrea052l5eyGZ-ggkXhzmryXRWeA8_3TjEIu8Kju9xuIdviM5vCY6R5uJm61S9Wf7n7OomJ-I May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 81229c6bb3044a7fba4fe081f35d3b21 May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerDiskConfigTestJSON-845034219 May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/81229c6bb3044a7fba4fe081f35d3b21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/81229c6bb3044a7fba4fe081f35d3b21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/81229c6bb3044a7fba4fe081f35d3b21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_81229c6bb3044a7fba4fe081f35d3b21", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerDiskConfigTestJSON-845034219 May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 81229c6bb3044a7fba4fe081f35d3b21 May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-845034219 May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerDiskConfigTestJSON-845034219-project May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: c8827c7bc3994623b020b5a3d1feb785 May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerDiskConfigTestJSON-845034219-project May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance a1c99736-8e53-4188-8064-aa06ddaa5c1c could not be found. May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'a1c99736-8e53-4188-8064-aa06ddaa5c1c'} May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c99736-8e53-4188-8064-aa06ddaa5c1c could not be found. May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c99736-8e53-4188-8064-aa06ddaa5c1c could not be found. May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:55:43.272666 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:55:43.277712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:55:43.277712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:55:43.277712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:55:43.277712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:55:43.277712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:55:43.277712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c99736-8e53-4188-8064-aa06ddaa5c1c could not be found. May 27 15:55:43.277712 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:55:43.277712 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-12be0875-5fcb-4d81-8f62-ef7cc3bcdc82 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] Returning 404 to user: Instance a1c99736-8e53-4188-8064-aa06ddaa5c1c could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:55:43.277712 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-12be0875-5fcb-4d81-8f62-ef7cc3bcdc82 tempest-ServerDiskConfigTestJSON-845034219 tempest-ServerDiskConfigTestJSON-845034219-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c" status: 404 len: 111 microversion: 2.1 time: 0.030395 May 27 15:55:43.278457 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3579/7139] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:43 2022] GET /compute/v2.1/servers/a1c99736-8e53-4188-8064-aa06ddaa5c1c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:55:49.438699 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-e07eecf9-7072-4beb-8513-82e97d4246b8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Action: 'create', calling method: .version_select at 0x7fc7753f49d0>, body: {"keypair": {"name": "tempest-keypair-184006460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORodtfhkRzK6oJknsEoFsBRuuc+BgHtROjZ+oRD58kpAbPi6VKHASoKd/UxVq3CAXp62hHgTtFh6HOANRiO6uSyhhfB/nigBBhXgbjImYOAdDBe7w85z9iQ2avXNLwrjA=="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:55:49.454054 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-e07eecf9-7072-4beb-8513-82e97d4246b8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Getting quotas for project 4bf1bc3819eb42918161ebc1e15905b5. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:55:49.459918 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-e07eecf9-7072-4beb-8513-82e97d4246b8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Getting quotas for user fdbc608df8f14e9bbec62e59d64b9709 and project 4bf1bc3819eb42918161ebc1e15905b5. Resources: {'key_pairs'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:55:49.490075 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-e07eecf9-7072-4beb-8513-82e97d4246b8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.178531 May 27 15:55:49.490678 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3561/7140] 10.222.0.13 () {60 vars in 1158 bytes} [Fri May 27 15:55:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:55:50.814517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-57374217-d68e-480a-a07b-683f8f182f7b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-802703565", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "266be84d-1558-4fa8-8dad-35d983dd6eed"}], "security_groups": [{"name": "tempest-securitygroup--655085404"}], "key_name": "tempest-keypair-184006460", "user_data": "}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:55:50.927837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.network.neutron [None req-57374217-d68e-480a-a07b-683f8f182f7b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] validate_networks() for [('266be84d-1558-4fa8-8dad-35d983dd6eed', None, None, None, None, None)] {{(pid=119249) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:55:51.437547 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-57374217-d68e-480a-a07b-683f8f182f7b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Flavor limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:55:51.438043 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-57374217-d68e-480a-a07b-683f8f182f7b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Image limits 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:55:51.438592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-57374217-d68e-480a-a07b-683f8f182f7b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Flavor pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:55:51.439113 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-57374217-d68e-480a-a07b-683f8f182f7b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Image pref 0:0:0 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:55:51.439595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.virt.hardware [None req-57374217-d68e-480a-a07b-683f8f182f7b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119249) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:55:51.448491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57374217-d68e-480a-a07b-683f8f182f7b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:51.449042 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57374217-d68e-480a-a07b-683f8f182f7b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:51.449910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57374217-d68e-480a-a07b-683f8f182f7b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:51.450438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-57374217-d68e-480a-a07b-683f8f182f7b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:51.468403 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-57374217-d68e-480a-a07b-683f8f182f7b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Getting quotas for project 4bf1bc3819eb42918161ebc1e15905b5. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:55:51.473907 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.quota [None req-57374217-d68e-480a-a07b-683f8f182f7b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Getting quotas for user fdbc608df8f14e9bbec62e59d64b9709 and project 4bf1bc3819eb42918161ebc1e15905b5. Resources: {'ram', 'instances', 'cores'} {{(pid=119249) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:55:51.488012 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-57374217-d68e-480a-a07b-683f8f182f7b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Going to run 1 instances... {{(pid=119249) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:55:51.490337 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-57374217-d68e-480a-a07b-683f8f182f7b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119249) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:55:51.540850 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-57374217-d68e-480a-a07b-683f8f182f7b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.730820 May 27 15:55:51.546608 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3580/7141] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:55:50 2022] POST /compute/v2.1/servers => generated 408 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 15:55:51.552134 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b9c78098-a1ce-4d62-a3e7-84e29dc2e41a tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:51.552875 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b9c78098-a1ce-4d62-a3e7-84e29dc2e41a tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:51.617912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b9c78098-a1ce-4d62-a3e7-84e29dc2e41a tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:51.625774 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b9c78098-a1ce-4d62-a3e7-84e29dc2e41a tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1237 microversion: 2.1 time: 0.077969 May 27 15:55:51.626378 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3562/7142] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:51 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:52.658838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f17522f8-7f49-4d5a-a15f-5bac9e682265 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:52.659556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f17522f8-7f49-4d5a-a15f-5bac9e682265 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:52.684218 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f17522f8-7f49-4d5a-a15f-5bac9e682265 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:52.684481 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f17522f8-7f49-4d5a-a15f-5bac9e682265 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:52.685290 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f17522f8-7f49-4d5a-a15f-5bac9e682265 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:52.685733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f17522f8-7f49-4d5a-a15f-5bac9e682265 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:52.785700 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f17522f8-7f49-4d5a-a15f-5bac9e682265 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:52.797198 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f17522f8-7f49-4d5a-a15f-5bac9e682265 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1307 microversion: 2.1 time: 0.157958 May 27 15:55:52.807696 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3581/7143] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:52 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1307 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:53.813877 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0043243a-dc4d-4833-8fce-84329262566f tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:53.814494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0043243a-dc4d-4833-8fce-84329262566f tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:53.817442 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:55:53.823565 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0043243a-dc4d-4833-8fce-84329262566f tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:53.824045 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0043243a-dc4d-4833-8fce-84329262566f tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:53.824989 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0043243a-dc4d-4833-8fce-84329262566f tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:53.825453 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0043243a-dc4d-4833-8fce-84329262566f tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:53.980189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0043243a-dc4d-4833-8fce-84329262566f tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:53.990273 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0043243a-dc4d-4833-8fce-84329262566f tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1362 microversion: 2.1 time: 0.180327 May 27 15:55:53.990877 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3563/7144] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:53 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:54.203060 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-0e7fd167-bc35-401a-a2dc-94c1ad54abc5 req-c0c3e563-cd1b-4997-bdd6-9b9d7aa5861b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c582392b-25e6-4da1-8f65-e62d7a8f9b05", "tag": "1ae0853c-a1d3-46d2-baa0-ee57eb46b467"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:55:54.211991 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0e7fd167-bc35-401a-a2dc-94c1ad54abc5 req-c0c3e563-cd1b-4997-bdd6-9b9d7aa5861b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:54.212459 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-0e7fd167-bc35-401a-a2dc-94c1ad54abc5 req-c0c3e563-cd1b-4997-bdd6-9b9d7aa5861b service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:54.225505 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-0e7fd167-bc35-401a-a2dc-94c1ad54abc5 req-c0c3e563-cd1b-4997-bdd6-9b9d7aa5861b service nova] Creating event network-changed:1ae0853c-a1d3-46d2-baa0-ee57eb46b467 for instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 on n-h1-843621-1 May 27 15:55:54.230716 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-0e7fd167-bc35-401a-a2dc-94c1ad54abc5 req-c0c3e563-cd1b-4997-bdd6-9b9d7aa5861b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094373 May 27 15:55:54.231634 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3582/7145] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:55:55.007762 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-df1f89d4-1f34-4531-9053-5dedaed2ebf7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:55.008429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-df1f89d4-1f34-4531-9053-5dedaed2ebf7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:55.015452 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df1f89d4-1f34-4531-9053-5dedaed2ebf7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:55.015930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df1f89d4-1f34-4531-9053-5dedaed2ebf7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:55.016742 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df1f89d4-1f34-4531-9053-5dedaed2ebf7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:55.017209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-df1f89d4-1f34-4531-9053-5dedaed2ebf7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:55.145401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-df1f89d4-1f34-4531-9053-5dedaed2ebf7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:55.152808 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-df1f89d4-1f34-4531-9053-5dedaed2ebf7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1362 microversion: 2.1 time: 0.149119 May 27 15:55:55.153380 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3564/7146] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:55 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:56.171408 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aa64ca12-58e5-4701-96c8-c5afd2f557f3 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:56.172147 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-aa64ca12-58e5-4701-96c8-c5afd2f557f3 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:56.178631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa64ca12-58e5-4701-96c8-c5afd2f557f3 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:56.179089 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa64ca12-58e5-4701-96c8-c5afd2f557f3 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:56.179859 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa64ca12-58e5-4701-96c8-c5afd2f557f3 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:56.180307 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa64ca12-58e5-4701-96c8-c5afd2f557f3 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:56.316856 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-aa64ca12-58e5-4701-96c8-c5afd2f557f3 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:56.324359 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-aa64ca12-58e5-4701-96c8-c5afd2f557f3 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1362 microversion: 2.1 time: 0.158190 May 27 15:55:56.324957 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3583/7147] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:56 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:57.341398 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1eb78e40-868f-40f1-88fd-c65e2ed5a82d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:57.342017 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1eb78e40-868f-40f1-88fd-c65e2ed5a82d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:57.350523 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1eb78e40-868f-40f1-88fd-c65e2ed5a82d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:57.351001 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1eb78e40-868f-40f1-88fd-c65e2ed5a82d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:57.351798 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1eb78e40-868f-40f1-88fd-c65e2ed5a82d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:57.352254 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1eb78e40-868f-40f1-88fd-c65e2ed5a82d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:57.485248 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1eb78e40-868f-40f1-88fd-c65e2ed5a82d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:57.492786 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1eb78e40-868f-40f1-88fd-c65e2ed5a82d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1362 microversion: 2.1 time: 0.155254 May 27 15:55:57.493364 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3565/7148] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:57 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:55:58.510174 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-25559be7-1c24-4994-aa14-59491498f166 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:58.510816 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-25559be7-1c24-4994-aa14-59491498f166 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:58.517488 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-25559be7-1c24-4994-aa14-59491498f166 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:58.517949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-25559be7-1c24-4994-aa14-59491498f166 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:58.518716 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-25559be7-1c24-4994-aa14-59491498f166 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:58.519161 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-25559be7-1c24-4994-aa14-59491498f166 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:58.523491 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:55:58.653609 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-25559be7-1c24-4994-aa14-59491498f166 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:58.661945 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-25559be7-1c24-4994-aa14-59491498f166 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1362 microversion: 2.1 time: 0.155874 May 27 15:55:58.662541 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3584/7149] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:58 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:55:59.679425 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1e358e77-4a08-487d-ab85-60f761a65da9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:55:59.680004 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1e358e77-4a08-487d-ab85-60f761a65da9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:55:59.687422 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e358e77-4a08-487d-ab85-60f761a65da9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:59.687894 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e358e77-4a08-487d-ab85-60f761a65da9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:59.688696 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e358e77-4a08-487d-ab85-60f761a65da9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:55:59.689154 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e358e77-4a08-487d-ab85-60f761a65da9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:55:59.819879 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1e358e77-4a08-487d-ab85-60f761a65da9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:55:59.832086 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1e358e77-4a08-487d-ab85-60f761a65da9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1362 microversion: 2.1 time: 0.156548 May 27 15:55:59.832751 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3566/7150] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:55:59 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:00.848852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-753e6fd3-7af1-4c0b-b37e-d6d545ff7c4c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:00.849502 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-753e6fd3-7af1-4c0b-b37e-d6d545ff7c4c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:00.856633 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-753e6fd3-7af1-4c0b-b37e-d6d545ff7c4c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:00.857116 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-753e6fd3-7af1-4c0b-b37e-d6d545ff7c4c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:00.857891 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-753e6fd3-7af1-4c0b-b37e-d6d545ff7c4c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:00.858858 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-753e6fd3-7af1-4c0b-b37e-d6d545ff7c4c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:00.986966 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-753e6fd3-7af1-4c0b-b37e-d6d545ff7c4c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:00.994599 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-753e6fd3-7af1-4c0b-b37e-d6d545ff7c4c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1362 microversion: 2.1 time: 0.149648 May 27 15:56:00.995174 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3585/7151] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:00 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:01.557126 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-10c5d925-09c4-4e14-afca-52799da3e137 req-365d866a-3f12-4067-bcbf-349a7d48a150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c582392b-25e6-4da1-8f65-e62d7a8f9b05", "name": "network-vif-plugged", "status": "completed", "tag": "1ae0853c-a1d3-46d2-baa0-ee57eb46b467"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:56:01.565420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-10c5d925-09c4-4e14-afca-52799da3e137 req-365d866a-3f12-4067-bcbf-349a7d48a150 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:01.565896 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-10c5d925-09c4-4e14-afca-52799da3e137 req-365d866a-3f12-4067-bcbf-349a7d48a150 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:01.577583 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-10c5d925-09c4-4e14-afca-52799da3e137 req-365d866a-3f12-4067-bcbf-349a7d48a150 service nova] Creating event network-vif-plugged:1ae0853c-a1d3-46d2-baa0-ee57eb46b467 for instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 on n-h1-843621-1 May 27 15:56:01.582608 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-10c5d925-09c4-4e14-afca-52799da3e137 req-365d866a-3f12-4067-bcbf-349a7d48a150 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081173 May 27 15:56:01.583196 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3567/7152] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:56:02.011918 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-e6e2c8bb-0e76-4b15-98c3-71c2f0c3844e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:02.012536 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-e6e2c8bb-0e76-4b15-98c3-71c2f0c3844e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:02.015051 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:56:02.015814 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=6 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:56:02.017476 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:56:02.024539 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e6e2c8bb-0e76-4b15-98c3-71c2f0c3844e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:02.025023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e6e2c8bb-0e76-4b15-98c3-71c2f0c3844e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:02.025792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e6e2c8bb-0e76-4b15-98c3-71c2f0c3844e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:02.026242 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-e6e2c8bb-0e76-4b15-98c3-71c2f0c3844e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:02.160934 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-e6e2c8bb-0e76-4b15-98c3-71c2f0c3844e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:02.168390 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-e6e2c8bb-0e76-4b15-98c3-71c2f0c3844e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1362 microversion: 2.1 time: 0.160408 May 27 15:56:02.168994 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3586/7153] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:02 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:03.181457 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:56:03.186801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-c253b4cb-55a8-40c1-88ca-3544767bcb44 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:03.187525 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-c253b4cb-55a8-40c1-88ca-3544767bcb44 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:03.189351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:56:03.195646 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c253b4cb-55a8-40c1-88ca-3544767bcb44 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:03.196116 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c253b4cb-55a8-40c1-88ca-3544767bcb44 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:03.196926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c253b4cb-55a8-40c1-88ca-3544767bcb44 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:03.197392 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-c253b4cb-55a8-40c1-88ca-3544767bcb44 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:03.327093 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-c253b4cb-55a8-40c1-88ca-3544767bcb44 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:03.335202 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-c253b4cb-55a8-40c1-88ca-3544767bcb44 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1548 microversion: 2.1 time: 0.154699 May 27 15:56:03.335776 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3568/7154] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:03 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:03.351927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6818f0cf-a5dc-4bc3-b23b-a7d060eaec53 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:03.352436 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6818f0cf-a5dc-4bc3-b23b-a7d060eaec53 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:03.359498 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6818f0cf-a5dc-4bc3-b23b-a7d060eaec53 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:03.359959 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6818f0cf-a5dc-4bc3-b23b-a7d060eaec53 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:03.360753 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6818f0cf-a5dc-4bc3-b23b-a7d060eaec53 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:03.361194 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6818f0cf-a5dc-4bc3-b23b-a7d060eaec53 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:03.440916 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6818f0cf-a5dc-4bc3-b23b-a7d060eaec53 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092901 May 27 15:56:03.441519 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3587/7155] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 15:56:03 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:56:04.346963 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cdbdb2cc-4f9a-49da-bacb-87240ec95f9a tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:04.347598 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cdbdb2cc-4f9a-49da-bacb-87240ec95f9a tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:04.364884 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cdbdb2cc-4f9a-49da-bacb-87240ec95f9a tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:04.365361 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cdbdb2cc-4f9a-49da-bacb-87240ec95f9a tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:04.366299 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cdbdb2cc-4f9a-49da-bacb-87240ec95f9a tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:04.366768 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cdbdb2cc-4f9a-49da-bacb-87240ec95f9a tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:04.445622 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-28eb2379-958f-42b4-8208-95b09427f8ed req-6ddf7980-9f38-44be-8076-073a7449e3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c582392b-25e6-4da1-8f65-e62d7a8f9b05", "tag": "1ae0853c-a1d3-46d2-baa0-ee57eb46b467"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:56:04.454363 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-28eb2379-958f-42b4-8208-95b09427f8ed req-6ddf7980-9f38-44be-8076-073a7449e3f7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:04.454733 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-28eb2379-958f-42b4-8208-95b09427f8ed req-6ddf7980-9f38-44be-8076-073a7449e3f7 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:04.466193 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-28eb2379-958f-42b4-8208-95b09427f8ed req-6ddf7980-9f38-44be-8076-073a7449e3f7 service nova] Creating event network-changed:1ae0853c-a1d3-46d2-baa0-ee57eb46b467 for instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 on n-h1-843621-1 May 27 15:56:04.472413 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-28eb2379-958f-42b4-8208-95b09427f8ed req-6ddf7980-9f38-44be-8076-073a7449e3f7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086610 May 27 15:56:04.473305 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3588/7156] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:56:04.518157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cdbdb2cc-4f9a-49da-bacb-87240ec95f9a tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:04.526535 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cdbdb2cc-4f9a-49da-bacb-87240ec95f9a tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1548 microversion: 2.1 time: 0.183980 May 27 15:56:04.537147 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3569/7157] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:04 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1548 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:04.546779 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-446fe810-66f8-4d95-bf74-ac79b028a57c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:04.547765 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-446fe810-66f8-4d95-bf74-ac79b028a57c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:04.554168 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-446fe810-66f8-4d95-bf74-ac79b028a57c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:04.554616 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-446fe810-66f8-4d95-bf74-ac79b028a57c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:04.555384 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-446fe810-66f8-4d95-bf74-ac79b028a57c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:04.555825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-446fe810-66f8-4d95-bf74-ac79b028a57c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:04.699039 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-446fe810-66f8-4d95-bf74-ac79b028a57c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:04.707646 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-446fe810-66f8-4d95-bf74-ac79b028a57c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1548 microversion: 2.1 time: 0.165969 May 27 15:56:04.708446 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3589/7158] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:04 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:05.725387 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-77c8a76f-ca9f-4f0f-b09e-5bcd33527e48 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:05.725949 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-77c8a76f-ca9f-4f0f-b09e-5bcd33527e48 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:05.733157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77c8a76f-ca9f-4f0f-b09e-5bcd33527e48 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:05.733642 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77c8a76f-ca9f-4f0f-b09e-5bcd33527e48 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:05.735079 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77c8a76f-ca9f-4f0f-b09e-5bcd33527e48 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:05.735552 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-77c8a76f-ca9f-4f0f-b09e-5bcd33527e48 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:05.869429 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-77c8a76f-ca9f-4f0f-b09e-5bcd33527e48 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:05.877155 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-77c8a76f-ca9f-4f0f-b09e-5bcd33527e48 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1665 microversion: 2.1 time: 0.155637 May 27 15:56:05.877735 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3570/7159] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:05 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:05.893475 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-541f7a71-411f-4b7f-9da6-22007efddf24 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:05.894102 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-541f7a71-411f-4b7f-9da6-22007efddf24 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:05.901311 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-541f7a71-411f-4b7f-9da6-22007efddf24 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:05.901782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-541f7a71-411f-4b7f-9da6-22007efddf24 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:05.902559 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-541f7a71-411f-4b7f-9da6-22007efddf24 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:05.903013 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-541f7a71-411f-4b7f-9da6-22007efddf24 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:06.033419 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-541f7a71-411f-4b7f-9da6-22007efddf24 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:06.041035 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-541f7a71-411f-4b7f-9da6-22007efddf24 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1665 microversion: 2.1 time: 0.151457 May 27 15:56:06.041605 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3590/7160] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:05 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:06.057069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fb438b16-aded-45cf-8591-1ab2da8e15c9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:56:06.058108 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fb438b16-aded-45cf-8591-1ab2da8e15c9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:06.064142 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb438b16-aded-45cf-8591-1ab2da8e15c9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:06.064618 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb438b16-aded-45cf-8591-1ab2da8e15c9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:06.065448 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb438b16-aded-45cf-8591-1ab2da8e15c9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:06.065914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fb438b16-aded-45cf-8591-1ab2da8e15c9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:06.095224 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fb438b16-aded-45cf-8591-1ab2da8e15c9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:06.101012 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fb438b16-aded-45cf-8591-1ab2da8e15c9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Old instance type m1.heat2, new instance type m1.heat {{(pid=119248) resize /opt/stack/nova/nova/compute/api.py:4166}} May 27 15:56:06.107271 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-fb438b16-aded-45cf-8591-1ab2da8e15c9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:56:06.107719 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-fb438b16-aded-45cf-8591-1ab2da8e15c9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:56:06.108221 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-fb438b16-aded-45cf-8591-1ab2da8e15c9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:56:06.108653 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-fb438b16-aded-45cf-8591-1ab2da8e15c9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:56:06.109135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-fb438b16-aded-45cf-8591-1ab2da8e15c9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:56:06.172570 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fb438b16-aded-45cf-8591-1ab2da8e15c9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "POST /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05/action" status: 202 len: 0 microversion: 2.1 time: 0.119494 May 27 15:56:06.173459 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3571/7161] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:56:06 2022] POST /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:56:06.181626 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-b89a91cd-a42c-4141-9ac9-070e6490b35d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:06.182248 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-b89a91cd-a42c-4141-9ac9-070e6490b35d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:06.188347 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b89a91cd-a42c-4141-9ac9-070e6490b35d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:06.188845 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b89a91cd-a42c-4141-9ac9-070e6490b35d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:06.189636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b89a91cd-a42c-4141-9ac9-070e6490b35d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:06.190063 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-b89a91cd-a42c-4141-9ac9-070e6490b35d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:06.334837 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-b89a91cd-a42c-4141-9ac9-070e6490b35d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:06.342381 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-b89a91cd-a42c-4141-9ac9-070e6490b35d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1674 microversion: 2.1 time: 0.164828 May 27 15:56:06.342960 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3591/7162] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:06 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:07.362439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-1e580ad4-4734-412d-8888-fbbd0caebabb tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:07.363072 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-1e580ad4-4734-412d-8888-fbbd0caebabb tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:07.372815 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e580ad4-4734-412d-8888-fbbd0caebabb tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:07.373286 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e580ad4-4734-412d-8888-fbbd0caebabb tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:07.374069 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e580ad4-4734-412d-8888-fbbd0caebabb tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:07.374532 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-1e580ad4-4734-412d-8888-fbbd0caebabb tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:07.505910 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-1e580ad4-4734-412d-8888-fbbd0caebabb tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:07.516511 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-1e580ad4-4734-412d-8888-fbbd0caebabb tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1674 microversion: 2.1 time: 0.159489 May 27 15:56:07.517145 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3572/7163] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:07 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:08.534219 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-377eec6a-770d-4720-a6ee-248c4edfe8a6 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:08.534850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-377eec6a-770d-4720-a6ee-248c4edfe8a6 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:08.541497 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-377eec6a-770d-4720-a6ee-248c4edfe8a6 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:08.541961 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-377eec6a-770d-4720-a6ee-248c4edfe8a6 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:08.542738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-377eec6a-770d-4720-a6ee-248c4edfe8a6 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:08.543188 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-377eec6a-770d-4720-a6ee-248c4edfe8a6 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:08.670451 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-377eec6a-770d-4720-a6ee-248c4edfe8a6 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:08.678548 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-377eec6a-770d-4720-a6ee-248c4edfe8a6 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.148412 May 27 15:56:08.679127 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3592/7164] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:08 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:09.695902 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-4375c848-a850-4a2f-b586-dcd4f354a5cc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:09.696562 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-4375c848-a850-4a2f-b586-dcd4f354a5cc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:09.703551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4375c848-a850-4a2f-b586-dcd4f354a5cc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:09.704027 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4375c848-a850-4a2f-b586-dcd4f354a5cc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:09.704853 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4375c848-a850-4a2f-b586-dcd4f354a5cc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:09.705323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-4375c848-a850-4a2f-b586-dcd4f354a5cc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:09.837179 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-4375c848-a850-4a2f-b586-dcd4f354a5cc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:09.845337 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-4375c848-a850-4a2f-b586-dcd4f354a5cc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.153470 May 27 15:56:09.845915 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3573/7165] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:09 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:10.862869 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4ca00630-2001-4e3c-a132-329fbc8c45ab tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:10.863518 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4ca00630-2001-4e3c-a132-329fbc8c45ab tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:10.870438 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4ca00630-2001-4e3c-a132-329fbc8c45ab tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:10.870892 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4ca00630-2001-4e3c-a132-329fbc8c45ab tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:10.871651 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4ca00630-2001-4e3c-a132-329fbc8c45ab tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:10.872092 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4ca00630-2001-4e3c-a132-329fbc8c45ab tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:11.001189 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-4ca00630-2001-4e3c-a132-329fbc8c45ab tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:11.008726 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4ca00630-2001-4e3c-a132-329fbc8c45ab tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.150231 May 27 15:56:11.009306 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3593/7166] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:10 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:12.026278 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a4c2e3c7-5b08-4b25-a8a1-836d721a2a2b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:12.026914 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a4c2e3c7-5b08-4b25-a8a1-836d721a2a2b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:12.034671 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4c2e3c7-5b08-4b25-a8a1-836d721a2a2b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:12.035147 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4c2e3c7-5b08-4b25-a8a1-836d721a2a2b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:12.035958 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4c2e3c7-5b08-4b25-a8a1-836d721a2a2b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:12.036421 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4c2e3c7-5b08-4b25-a8a1-836d721a2a2b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:12.166420 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a4c2e3c7-5b08-4b25-a8a1-836d721a2a2b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:12.174581 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a4c2e3c7-5b08-4b25-a8a1-836d721a2a2b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.152324 May 27 15:56:12.175150 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3574/7167] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:12 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:13.192033 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-741eeab3-57b2-41df-aa40-27e05984d7e9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:13.192626 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-741eeab3-57b2-41df-aa40-27e05984d7e9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:13.199828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-741eeab3-57b2-41df-aa40-27e05984d7e9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:13.200279 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-741eeab3-57b2-41df-aa40-27e05984d7e9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:13.201075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-741eeab3-57b2-41df-aa40-27e05984d7e9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:13.201591 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-741eeab3-57b2-41df-aa40-27e05984d7e9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:13.333636 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-741eeab3-57b2-41df-aa40-27e05984d7e9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:13.341171 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-741eeab3-57b2-41df-aa40-27e05984d7e9 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.153221 May 27 15:56:13.341749 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3594/7168] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:13 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:14.359187 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-f14a2b05-bd99-47eb-afb7-6f4ba61237df tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:14.359887 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-f14a2b05-bd99-47eb-afb7-6f4ba61237df tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:14.367219 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f14a2b05-bd99-47eb-afb7-6f4ba61237df tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:14.367687 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f14a2b05-bd99-47eb-afb7-6f4ba61237df tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:14.368480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f14a2b05-bd99-47eb-afb7-6f4ba61237df tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:14.368966 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-f14a2b05-bd99-47eb-afb7-6f4ba61237df tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:14.500641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-f14a2b05-bd99-47eb-afb7-6f4ba61237df tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:14.508393 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-f14a2b05-bd99-47eb-afb7-6f4ba61237df tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.153148 May 27 15:56:14.508997 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3575/7169] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:14 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:15.525962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d9f12793-241d-4634-90a6-b2c7c3db9598 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:15.526592 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d9f12793-241d-4634-90a6-b2c7c3db9598 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:15.534285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9f12793-241d-4634-90a6-b2c7c3db9598 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:15.534748 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9f12793-241d-4634-90a6-b2c7c3db9598 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:15.535742 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9f12793-241d-4634-90a6-b2c7c3db9598 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:15.536198 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d9f12793-241d-4634-90a6-b2c7c3db9598 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:15.954030 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d9f12793-241d-4634-90a6-b2c7c3db9598 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:15.961786 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d9f12793-241d-4634-90a6-b2c7c3db9598 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.439741 May 27 15:56:15.962365 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3595/7170] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:15 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:16.979728 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-63fc29ce-7362-4004-b721-a6cbc418f72a tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:16.980366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-63fc29ce-7362-4004-b721-a6cbc418f72a tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:16.989713 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63fc29ce-7362-4004-b721-a6cbc418f72a tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:16.990189 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63fc29ce-7362-4004-b721-a6cbc418f72a tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:16.990991 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63fc29ce-7362-4004-b721-a6cbc418f72a tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:16.991460 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-63fc29ce-7362-4004-b721-a6cbc418f72a tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:17.138518 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-63fc29ce-7362-4004-b721-a6cbc418f72a tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:17.146652 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-63fc29ce-7362-4004-b721-a6cbc418f72a tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.170991 May 27 15:56:17.147237 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3576/7171] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:16 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:18.164802 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-52014326-a1e1-4d36-aabd-8c15fab72d90 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:18.165429 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-52014326-a1e1-4d36-aabd-8c15fab72d90 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:18.172866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52014326-a1e1-4d36-aabd-8c15fab72d90 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:18.173318 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52014326-a1e1-4d36-aabd-8c15fab72d90 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:18.174075 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52014326-a1e1-4d36-aabd-8c15fab72d90 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:18.174514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-52014326-a1e1-4d36-aabd-8c15fab72d90 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:18.306952 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-52014326-a1e1-4d36-aabd-8c15fab72d90 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:18.314938 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-52014326-a1e1-4d36-aabd-8c15fab72d90 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.154079 May 27 15:56:18.315506 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3596/7172] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:18 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:19.332840 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0e397b7b-9a85-4f41-a14e-4c19114cd4a5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:19.333476 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0e397b7b-9a85-4f41-a14e-4c19114cd4a5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:19.340464 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e397b7b-9a85-4f41-a14e-4c19114cd4a5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:19.340973 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e397b7b-9a85-4f41-a14e-4c19114cd4a5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:19.341769 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e397b7b-9a85-4f41-a14e-4c19114cd4a5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:19.342231 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0e397b7b-9a85-4f41-a14e-4c19114cd4a5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:19.470082 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0e397b7b-9a85-4f41-a14e-4c19114cd4a5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:19.478094 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0e397b7b-9a85-4f41-a14e-4c19114cd4a5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.149902 May 27 15:56:19.478908 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3577/7173] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:19 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:20.495866 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ea90480b-1920-4f1f-a04c-ea6d488b5a47 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:20.496480 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ea90480b-1920-4f1f-a04c-ea6d488b5a47 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:20.503440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea90480b-1920-4f1f-a04c-ea6d488b5a47 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:20.503894 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea90480b-1920-4f1f-a04c-ea6d488b5a47 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:20.504654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea90480b-1920-4f1f-a04c-ea6d488b5a47 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:20.505121 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ea90480b-1920-4f1f-a04c-ea6d488b5a47 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:20.634070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ea90480b-1920-4f1f-a04c-ea6d488b5a47 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:20.642207 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ea90480b-1920-4f1f-a04c-ea6d488b5a47 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.150312 May 27 15:56:20.642780 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3597/7174] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:20 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:21.660209 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cc1a02e9-714d-4bad-9c4a-348c02b6c697 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:21.660808 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cc1a02e9-714d-4bad-9c4a-348c02b6c697 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:21.667878 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cc1a02e9-714d-4bad-9c4a-348c02b6c697 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:21.668359 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cc1a02e9-714d-4bad-9c4a-348c02b6c697 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:21.669188 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cc1a02e9-714d-4bad-9c4a-348c02b6c697 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:21.669655 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cc1a02e9-714d-4bad-9c4a-348c02b6c697 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:21.804898 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cc1a02e9-714d-4bad-9c4a-348c02b6c697 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:21.808382 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:56:21.813464 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cc1a02e9-714d-4bad-9c4a-348c02b6c697 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.157779 May 27 15:56:21.814049 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3578/7175] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:21 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:22.832085 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6a36ef9a-2f52-4924-b7c7-535abaa90e7e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:22.832949 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6a36ef9a-2f52-4924-b7c7-535abaa90e7e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:22.842223 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6a36ef9a-2f52-4924-b7c7-535abaa90e7e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:22.842681 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6a36ef9a-2f52-4924-b7c7-535abaa90e7e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:22.843467 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6a36ef9a-2f52-4924-b7c7-535abaa90e7e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:22.843923 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6a36ef9a-2f52-4924-b7c7-535abaa90e7e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:22.976209 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6a36ef9a-2f52-4924-b7c7-535abaa90e7e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:22.983849 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6a36ef9a-2f52-4924-b7c7-535abaa90e7e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.157112 May 27 15:56:22.985079 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3598/7176] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:22 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:24.001577 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0df299f9-bf73-446a-ac51-fa5bb8d11253 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:24.002212 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0df299f9-bf73-446a-ac51-fa5bb8d11253 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:24.010494 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0df299f9-bf73-446a-ac51-fa5bb8d11253 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:24.010970 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0df299f9-bf73-446a-ac51-fa5bb8d11253 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:24.011761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0df299f9-bf73-446a-ac51-fa5bb8d11253 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:24.012227 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0df299f9-bf73-446a-ac51-fa5bb8d11253 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:24.145131 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0df299f9-bf73-446a-ac51-fa5bb8d11253 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:24.152697 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0df299f9-bf73-446a-ac51-fa5bb8d11253 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.155074 May 27 15:56:24.153281 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3579/7177] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:23 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:25.170631 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-d32934bc-343b-4ae5-9c1b-8bb0fe1a5ccc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:25.171250 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-d32934bc-343b-4ae5-9c1b-8bb0fe1a5ccc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:25.179185 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d32934bc-343b-4ae5-9c1b-8bb0fe1a5ccc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:25.179640 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d32934bc-343b-4ae5-9c1b-8bb0fe1a5ccc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:25.180400 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d32934bc-343b-4ae5-9c1b-8bb0fe1a5ccc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:25.180876 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-d32934bc-343b-4ae5-9c1b-8bb0fe1a5ccc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:25.309297 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-d32934bc-343b-4ae5-9c1b-8bb0fe1a5ccc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:25.316752 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-d32934bc-343b-4ae5-9c1b-8bb0fe1a5ccc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.150090 May 27 15:56:25.317322 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3599/7178] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:25 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:26.333773 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-259d1911-378e-42ae-9b31-dadfed694620 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:26.334414 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-259d1911-378e-42ae-9b31-dadfed694620 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:26.341535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-259d1911-378e-42ae-9b31-dadfed694620 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:26.342009 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-259d1911-378e-42ae-9b31-dadfed694620 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:26.342801 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-259d1911-378e-42ae-9b31-dadfed694620 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:26.343265 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-259d1911-378e-42ae-9b31-dadfed694620 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:26.478183 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-259d1911-378e-42ae-9b31-dadfed694620 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:26.486310 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-259d1911-378e-42ae-9b31-dadfed694620 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.156489 May 27 15:56:26.486887 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3580/7179] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:26 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:27.503833 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-bf72a699-484d-4763-a4de-542942fc112c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:27.504454 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-bf72a699-484d-4763-a4de-542942fc112c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:27.511286 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf72a699-484d-4763-a4de-542942fc112c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:27.511743 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf72a699-484d-4763-a4de-542942fc112c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:27.512512 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf72a699-484d-4763-a4de-542942fc112c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:27.512982 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-bf72a699-484d-4763-a4de-542942fc112c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:27.648160 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-bf72a699-484d-4763-a4de-542942fc112c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:27.657624 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-bf72a699-484d-4763-a4de-542942fc112c tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.158101 May 27 15:56:27.658336 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3600/7180] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:27 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:28.678419 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-b1099cb7-ad37-4753-99c9-88962e645489 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:28.679030 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-b1099cb7-ad37-4753-99c9-88962e645489 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:28.686673 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b1099cb7-ad37-4753-99c9-88962e645489 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:28.687317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b1099cb7-ad37-4753-99c9-88962e645489 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:28.688106 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b1099cb7-ad37-4753-99c9-88962e645489 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:28.688623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-b1099cb7-ad37-4753-99c9-88962e645489 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:28.837205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-b1099cb7-ad37-4753-99c9-88962e645489 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:28.845598 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-b1099cb7-ad37-4753-99c9-88962e645489 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.171915 May 27 15:56:28.846187 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3581/7181] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:28 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:29.862751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3ae29816-90a5-4360-8817-3a9a2855b423 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:29.863378 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3ae29816-90a5-4360-8817-3a9a2855b423 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:29.870392 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ae29816-90a5-4360-8817-3a9a2855b423 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:29.870847 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ae29816-90a5-4360-8817-3a9a2855b423 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:29.871618 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ae29816-90a5-4360-8817-3a9a2855b423 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:29.872062 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3ae29816-90a5-4360-8817-3a9a2855b423 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:29.876995 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=96 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:56:30.008280 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3ae29816-90a5-4360-8817-3a9a2855b423 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:30.015843 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3ae29816-90a5-4360-8817-3a9a2855b423 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.157709 May 27 15:56:30.016971 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3601/7182] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:29 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:31.036651 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8c0511dc-c5ad-4715-ad80-5a2973dcd536 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:31.037315 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8c0511dc-c5ad-4715-ad80-5a2973dcd536 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:31.046480 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8c0511dc-c5ad-4715-ad80-5a2973dcd536 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:31.046955 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8c0511dc-c5ad-4715-ad80-5a2973dcd536 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:31.047790 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8c0511dc-c5ad-4715-ad80-5a2973dcd536 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:31.048259 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8c0511dc-c5ad-4715-ad80-5a2973dcd536 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:31.189401 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8c0511dc-c5ad-4715-ad80-5a2973dcd536 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:31.199170 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8c0511dc-c5ad-4715-ad80-5a2973dcd536 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.167385 May 27 15:56:31.200515 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3582/7183] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:31 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:32.221196 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-70cd01ec-9e6f-495a-bdcc-07064b22926b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:32.221825 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-70cd01ec-9e6f-495a-bdcc-07064b22926b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:32.226819 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=32 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:56:32.232612 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70cd01ec-9e6f-495a-bdcc-07064b22926b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:32.233067 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70cd01ec-9e6f-495a-bdcc-07064b22926b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:32.233855 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70cd01ec-9e6f-495a-bdcc-07064b22926b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:32.234300 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-70cd01ec-9e6f-495a-bdcc-07064b22926b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:32.378899 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-70cd01ec-9e6f-495a-bdcc-07064b22926b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:32.386489 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-70cd01ec-9e6f-495a-bdcc-07064b22926b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.169958 May 27 15:56:32.387055 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3602/7184] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:32 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:33.404813 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-fff77081-3dcc-45d5-951a-7c838e1d4dd1 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:33.405456 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-fff77081-3dcc-45d5-951a-7c838e1d4dd1 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:33.408810 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=34 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:56:33.414331 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fff77081-3dcc-45d5-951a-7c838e1d4dd1 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:33.414802 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fff77081-3dcc-45d5-951a-7c838e1d4dd1 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:33.415600 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fff77081-3dcc-45d5-951a-7c838e1d4dd1 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:33.416064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-fff77081-3dcc-45d5-951a-7c838e1d4dd1 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:33.556761 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-fff77081-3dcc-45d5-951a-7c838e1d4dd1 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:33.564500 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-fff77081-3dcc-45d5-951a-7c838e1d4dd1 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.163706 May 27 15:56:33.565122 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3583/7185] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:33 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:34.583620 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-a687505b-d1c0-45af-838c-8387ae23b0e8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:34.584500 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-a687505b-d1c0-45af-838c-8387ae23b0e8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:34.593872 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a687505b-d1c0-45af-838c-8387ae23b0e8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:34.596781 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a687505b-d1c0-45af-838c-8387ae23b0e8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:34.598118 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a687505b-d1c0-45af-838c-8387ae23b0e8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:34.598654 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-a687505b-d1c0-45af-838c-8387ae23b0e8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:34.747684 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-a687505b-d1c0-45af-838c-8387ae23b0e8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:34.757002 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-a687505b-d1c0-45af-838c-8387ae23b0e8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1679 microversion: 2.1 time: 0.178578 May 27 15:56:34.757909 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3603/7186] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:34 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:35.500851 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-1ddade93-223d-47be-acf9-60d2fbd57acd req-65fb3456-dd59-42bb-9830-9b763c3ef28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c582392b-25e6-4da1-8f65-e62d7a8f9b05", "name": "network-vif-unplugged", "status": "completed", "tag": "1ae0853c-a1d3-46d2-baa0-ee57eb46b467"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:56:35.510205 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-1ddade93-223d-47be-acf9-60d2fbd57acd req-65fb3456-dd59-42bb-9830-9b763c3ef28f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:35.511171 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-1ddade93-223d-47be-acf9-60d2fbd57acd req-65fb3456-dd59-42bb-9830-9b763c3ef28f service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:35.527247 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-1ddade93-223d-47be-acf9-60d2fbd57acd req-65fb3456-dd59-42bb-9830-9b763c3ef28f service nova] Creating event network-vif-unplugged:1ae0853c-a1d3-46d2-baa0-ee57eb46b467 for instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 on n-h2-843621-1 May 27 15:56:35.536035 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [req-1ddade93-223d-47be-acf9-60d2fbd57acd req-65fb3456-dd59-42bb-9830-9b763c3ef28f service nova] Instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119248) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 15:56:35.548323 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-1ddade93-223d-47be-acf9-60d2fbd57acd req-65fb3456-dd59-42bb-9830-9b763c3ef28f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050819 May 27 15:56:35.549901 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3584/7187] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:56:35.778269 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6ea0a987-bad4-4c97-b41c-22ce521cce56 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:35.778904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6ea0a987-bad4-4c97-b41c-22ce521cce56 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:35.786567 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ea0a987-bad4-4c97-b41c-22ce521cce56 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:35.787030 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ea0a987-bad4-4c97-b41c-22ce521cce56 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:35.787817 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ea0a987-bad4-4c97-b41c-22ce521cce56 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:35.788296 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6ea0a987-bad4-4c97-b41c-22ce521cce56 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:36.013026 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6ea0a987-bad4-4c97-b41c-22ce521cce56 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:36.022881 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6ea0a987-bad4-4c97-b41c-22ce521cce56 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1678 microversion: 2.1 time: 0.248453 May 27 15:56:36.023685 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3604/7188] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:35 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1678 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:56:37.044145 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-a4f9ef48-3a10-4cf2-a6cc-9ce21485e372 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:37.044928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-a4f9ef48-3a10-4cf2-a6cc-9ce21485e372 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:37.051907 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4f9ef48-3a10-4cf2-a6cc-9ce21485e372 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:37.052383 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4f9ef48-3a10-4cf2-a6cc-9ce21485e372 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:37.053223 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4f9ef48-3a10-4cf2-a6cc-9ce21485e372 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:37.053685 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-a4f9ef48-3a10-4cf2-a6cc-9ce21485e372 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:37.189847 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-a4f9ef48-3a10-4cf2-a6cc-9ce21485e372 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:37.197750 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-a4f9ef48-3a10-4cf2-a6cc-9ce21485e372 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1676 microversion: 2.1 time: 0.158806 May 27 15:56:37.198351 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3585/7189] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:37 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:37.567295 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-d4278425-6505-43b5-87bb-58e8369ea9ad req-cd2fa0a2-5926-4c6b-b250-7329b9270472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c582392b-25e6-4da1-8f65-e62d7a8f9b05", "tag": "1ae0853c-a1d3-46d2-baa0-ee57eb46b467"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:56:37.576441 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d4278425-6505-43b5-87bb-58e8369ea9ad req-cd2fa0a2-5926-4c6b-b250-7329b9270472 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:37.576927 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-d4278425-6505-43b5-87bb-58e8369ea9ad req-cd2fa0a2-5926-4c6b-b250-7329b9270472 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:37.589204 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-d4278425-6505-43b5-87bb-58e8369ea9ad req-cd2fa0a2-5926-4c6b-b250-7329b9270472 service nova] Creating event network-changed:1ae0853c-a1d3-46d2-baa0-ee57eb46b467 for instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 on n-h2-843621-1 May 27 15:56:37.595049 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [req-d4278425-6505-43b5-87bb-58e8369ea9ad req-cd2fa0a2-5926-4c6b-b250-7329b9270472 service nova] Instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-843621-1', 'n-h1-843621-1'} {{(pid=119249) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 27 15:56:37.606486 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-d4278425-6505-43b5-87bb-58e8369ea9ad req-cd2fa0a2-5926-4c6b-b250-7329b9270472 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042912 May 27 15:56:37.607171 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3605/7190] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:56:38.216495 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-cbe41fcf-55cc-424f-8524-c9ccbfdd1cd5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:38.217089 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-cbe41fcf-55cc-424f-8524-c9ccbfdd1cd5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:38.224178 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cbe41fcf-55cc-424f-8524-c9ccbfdd1cd5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:38.224650 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cbe41fcf-55cc-424f-8524-c9ccbfdd1cd5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:38.225514 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cbe41fcf-55cc-424f-8524-c9ccbfdd1cd5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:38.225977 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-cbe41fcf-55cc-424f-8524-c9ccbfdd1cd5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:38.425721 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-cbe41fcf-55cc-424f-8524-c9ccbfdd1cd5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:38.433999 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-cbe41fcf-55cc-424f-8524-c9ccbfdd1cd5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1673 microversion: 2.1 time: 0.222425 May 27 15:56:38.434692 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3586/7191] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:38 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1673 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:38.455764 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-4321cf0f-1bf6-4100-9748-ac0965ecd85b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:56:38.456399 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-4321cf0f-1bf6-4100-9748-ac0965ecd85b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:38.462864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4321cf0f-1bf6-4100-9748-ac0965ecd85b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:38.463319 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4321cf0f-1bf6-4100-9748-ac0965ecd85b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:38.464109 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4321cf0f-1bf6-4100-9748-ac0965ecd85b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:38.464637 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-4321cf0f-1bf6-4100-9748-ac0965ecd85b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:38.529977 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-4321cf0f-1bf6-4100-9748-ac0965ecd85b tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "POST /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05/action" status: 204 len: 0 microversion: 2.1 time: 0.079147 May 27 15:56:38.530634 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3606/7192] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:56:38 2022] POST /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:56:38.553162 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8381fe42-c83f-4247-b9ca-8b9e51e3daee tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:38.553824 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8381fe42-c83f-4247-b9ca-8b9e51e3daee tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:38.560976 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8381fe42-c83f-4247-b9ca-8b9e51e3daee tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:38.561535 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8381fe42-c83f-4247-b9ca-8b9e51e3daee tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:38.567080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8381fe42-c83f-4247-b9ca-8b9e51e3daee tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:38.567080 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8381fe42-c83f-4247-b9ca-8b9e51e3daee tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:38.728834 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-8381fe42-c83f-4247-b9ca-8b9e51e3daee tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:38.737905 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8381fe42-c83f-4247-b9ca-8b9e51e3daee tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1673 microversion: 2.1 time: 0.202314 May 27 15:56:38.738602 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3587/7193] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:38 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1673 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:39.760635 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-c3b9af39-62aa-4cbe-9280-946d4ad635cc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:39.761579 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-c3b9af39-62aa-4cbe-9280-946d4ad635cc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:39.768962 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3b9af39-62aa-4cbe-9280-946d4ad635cc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:39.769667 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3b9af39-62aa-4cbe-9280-946d4ad635cc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:39.770799 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3b9af39-62aa-4cbe-9280-946d4ad635cc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:39.771299 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-c3b9af39-62aa-4cbe-9280-946d4ad635cc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:39.910786 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-c3b9af39-62aa-4cbe-9280-946d4ad635cc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:39.918562 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-c3b9af39-62aa-4cbe-9280-946d4ad635cc tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1665 microversion: 2.1 time: 0.166045 May 27 15:56:39.919148 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3607/7194] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:39 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1665 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:39.936037 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-0a6c0a26-6dcf-48f3-accb-8dd42e1ca225 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:39.937102 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-0a6c0a26-6dcf-48f3-accb-8dd42e1ca225 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:39.946471 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a6c0a26-6dcf-48f3-accb-8dd42e1ca225 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:39.947317 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a6c0a26-6dcf-48f3-accb-8dd42e1ca225 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:39.948501 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a6c0a26-6dcf-48f3-accb-8dd42e1ca225 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:39.949034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-0a6c0a26-6dcf-48f3-accb-8dd42e1ca225 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:40.082845 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-0a6c0a26-6dcf-48f3-accb-8dd42e1ca225 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:40.090902 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-0a6c0a26-6dcf-48f3-accb-8dd42e1ca225 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1665 microversion: 2.1 time: 0.159206 May 27 15:56:40.091481 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3588/7195] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:39 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:40.107658 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-f95c59e9-d904-4b8a-a7ee-a3a780e1a741 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:40.108273 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-f95c59e9-d904-4b8a-a7ee-a3a780e1a741 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:40.115130 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f95c59e9-d904-4b8a-a7ee-a3a780e1a741 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:40.115587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f95c59e9-d904-4b8a-a7ee-a3a780e1a741 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:40.116428 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f95c59e9-d904-4b8a-a7ee-a3a780e1a741 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:40.116910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-f95c59e9-d904-4b8a-a7ee-a3a780e1a741 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:40.254548 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-f95c59e9-d904-4b8a-a7ee-a3a780e1a741 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:40.262505 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-f95c59e9-d904-4b8a-a7ee-a3a780e1a741 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1665 microversion: 2.1 time: 0.158762 May 27 15:56:40.263070 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3608/7196] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:40 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:40.279424 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8a32bc10-3a9b-41be-876d-99a57e82f1aa tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:40.279948 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8a32bc10-3a9b-41be-876d-99a57e82f1aa tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:40.286582 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a32bc10-3a9b-41be-876d-99a57e82f1aa tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:40.287055 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a32bc10-3a9b-41be-876d-99a57e82f1aa tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:40.287844 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a32bc10-3a9b-41be-876d-99a57e82f1aa tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:40.288306 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a32bc10-3a9b-41be-876d-99a57e82f1aa tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:40.313329 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8a32bc10-3a9b-41be-876d-99a57e82f1aa tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Going to try to terminate instance {{(pid=119248) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:56:40.396637 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8a32bc10-3a9b-41be-876d-99a57e82f1aa tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 204 len: 0 microversion: 2.1 time: 0.120973 May 27 15:56:40.397274 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3589/7197] 10.222.0.13 () {58 vars in 1238 bytes} [Fri May 27 15:56:40 2022] DELETE /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:56:40.405969 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-27b498ed-d682-4fee-83db-70654cb90497 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:40.406587 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-27b498ed-d682-4fee-83db-70654cb90497 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:40.413354 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-27b498ed-d682-4fee-83db-70654cb90497 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:40.413886 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-27b498ed-d682-4fee-83db-70654cb90497 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:40.414791 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-27b498ed-d682-4fee-83db-70654cb90497 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:40.415238 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-27b498ed-d682-4fee-83db-70654cb90497 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:40.556572 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-27b498ed-d682-4fee-83db-70654cb90497 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:40.565529 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-27b498ed-d682-4fee-83db-70654cb90497 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1671 microversion: 2.1 time: 0.163641 May 27 15:56:40.566128 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3609/7198] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:40 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:56:40.584928 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-9f9ec7e8-267d-4937-816d-4624f3d2b321 req-ec2aaf9a-ff20-4637-a493-0f1425379de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c582392b-25e6-4da1-8f65-e62d7a8f9b05", "name": "network-vif-plugged", "status": "completed", "tag": "1ae0853c-a1d3-46d2-baa0-ee57eb46b467"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:56:40.594319 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9f9ec7e8-267d-4937-816d-4624f3d2b321 req-ec2aaf9a-ff20-4637-a493-0f1425379de6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:40.594791 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-9f9ec7e8-267d-4937-816d-4624f3d2b321 req-ec2aaf9a-ff20-4637-a493-0f1425379de6 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:40.607593 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-9f9ec7e8-267d-4937-816d-4624f3d2b321 req-ec2aaf9a-ff20-4637-a493-0f1425379de6 service nova] Creating event network-vif-plugged:1ae0853c-a1d3-46d2-baa0-ee57eb46b467 for instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 on n-h2-843621-1 May 27 15:56:40.612474 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-9f9ec7e8-267d-4937-816d-4624f3d2b321 req-ec2aaf9a-ff20-4637-a493-0f1425379de6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033548 May 27 15:56:40.613113 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3590/7199] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:56:41.584599 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3783bb9b-93de-4db9-9718-096f48946398 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:41.585357 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3783bb9b-93de-4db9-9718-096f48946398 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:41.593695 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3783bb9b-93de-4db9-9718-096f48946398 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:41.593853 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3783bb9b-93de-4db9-9718-096f48946398 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:41.594647 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3783bb9b-93de-4db9-9718-096f48946398 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:41.595214 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3783bb9b-93de-4db9-9718-096f48946398 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:41.784749 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3783bb9b-93de-4db9-9718-096f48946398 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:41.793297 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3783bb9b-93de-4db9-9718-096f48946398 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1671 microversion: 2.1 time: 0.213955 May 27 15:56:41.794100 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3610/7200] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:41 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1671 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:42.680237 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-f018e140-0ab7-4fcd-a225-b0007edbf2a3 req-44c103e6-749d-41e1-9a80-524045c6476c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c582392b-25e6-4da1-8f65-e62d7a8f9b05", "name": "network-vif-deleted", "tag": "1ae0853c-a1d3-46d2-baa0-ee57eb46b467"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:56:42.698846 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-f018e140-0ab7-4fcd-a225-b0007edbf2a3 req-44c103e6-749d-41e1-9a80-524045c6476c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:42.701670 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-f018e140-0ab7-4fcd-a225-b0007edbf2a3 req-44c103e6-749d-41e1-9a80-524045c6476c service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:42.718599 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-f018e140-0ab7-4fcd-a225-b0007edbf2a3 req-44c103e6-749d-41e1-9a80-524045c6476c service nova] Creating event network-vif-deleted:1ae0853c-a1d3-46d2-baa0-ee57eb46b467 for instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 on n-h2-843621-1 May 27 15:56:42.725100 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-f018e140-0ab7-4fcd-a225-b0007edbf2a3 req-44c103e6-749d-41e1-9a80-524045c6476c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050716 May 27 15:56:42.726884 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3591/7201] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:56:42.813088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-3d57f5c9-cadc-46b0-b579-c2d1bea6d1d8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:42.813751 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-3d57f5c9-cadc-46b0-b579-c2d1bea6d1d8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:42.831011 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d57f5c9-cadc-46b0-b579-c2d1bea6d1d8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:42.831773 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d57f5c9-cadc-46b0-b579-c2d1bea6d1d8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:42.836225 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d57f5c9-cadc-46b0-b579-c2d1bea6d1d8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:42.836850 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d57f5c9-cadc-46b0-b579-c2d1bea6d1d8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:42.894514 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d57f5c9-cadc-46b0-b579-c2d1bea6d1d8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:42.895257 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-3d57f5c9-cadc-46b0-b579-c2d1bea6d1d8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:42.895917 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.objects.instance [None req-3d57f5c9-cadc-46b0-b579-c2d1bea6d1d8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lazy-loading 'fault' on Instance uuid c582392b-25e6-4da1-8f65-e62d7a8f9b05 {{(pid=119249) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:56:42.949801 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-3d57f5c9-cadc-46b0-b579-c2d1bea6d1d8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:42.958299 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-3d57f5c9-cadc-46b0-b579-c2d1bea6d1d8 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 200 len: 1327 microversion: 2.1 time: 0.150640 May 27 15:56:42.958805 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3611/7202] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:42 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 1327 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:43.977623 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8a1d0e62-36fa-47a5-85fc-f0b6f4ee7ad5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:43.978351 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-8a1d0e62-36fa-47a5-85fc-f0b6f4ee7ad5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:43.984930 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a1d0e62-36fa-47a5-85fc-f0b6f4ee7ad5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:43.985410 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a1d0e62-36fa-47a5-85fc-f0b6f4ee7ad5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:43.986868 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a1d0e62-36fa-47a5-85fc-f0b6f4ee7ad5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:43.987332 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-8a1d0e62-36fa-47a5-85fc-f0b6f4ee7ad5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:44.004174 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.wsgi [None req-8a1d0e62-36fa-47a5-85fc-f0b6f4ee7ad5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] HTTP exception thrown: Instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 could not be found. May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8a1d0e62-36fa-47a5-85fc-f0b6f4ee7ad5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Request method failure captured: May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: request: GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 HTTP/1.1 May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: Accept: application/json May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: Accept-Encoding: identity May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: Connection: close May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: Content-Length: 0 May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: Content-Type: application/json May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: Host: 10.222.0.13 May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: Openstack-System-Scope: None May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: User-Agent: python-urllib3/1.26.9 May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: X-Auth-Token: gAAAAABikPSF4GQjGGnwmXL4GMMz4PWQVG3opgZEn7quhm4--XSazVfENRut-Tai2vcB7wKvq6yWFWXsM-uto-ETkjpUBP152nephqQDobgq1itVqu2YGKzZVJPm6Iqs1GNc4Kn5SxJuILLUh5oTTynjWAAT_4173YLALScKMLxTVM0AP7c3d28 May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Id: None May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: X-Domain-Name: None May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: X-Identity-Status: Confirmed May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: X-Is-Admin-Project: True May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Id: default May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Domain-Name: Default May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Id: 4bf1bc3819eb42918161ebc1e15905b5 May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: X-Project-Name: tempest-ServerActionsTestJSON-1264201106 May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: X-Role: reader,member May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: X-Roles: reader,member May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4bf1bc3819eb42918161ebc1e15905b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4bf1bc3819eb42918161ebc1e15905b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4bf1bc3819eb42918161ebc1e15905b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4bf1bc3819eb42918161ebc1e15905b5", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant: tempest-ServerActionsTestJSON-1264201106 May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Id: 4bf1bc3819eb42918161ebc1e15905b5 May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: X-Tenant-Name: tempest-ServerActionsTestJSON-1264201106 May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: X-User: tempest-ServerActionsTestJSON-1264201106-project May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Id: default May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: X-User-Domain-Name: Default May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: X-User-Id: fdbc608df8f14e9bbec62e59d64b9709 May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: X-User-Name: tempest-ServerActionsTestJSON-1264201106-project May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: method: > May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: exception: Instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 could not be found. May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: action_args: {'id': 'c582392b-25e6-4da1-8f65-e62d7a8f9b05'} May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 could not be found. May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 could not be found. May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:56:44.005917 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:56:44.013439 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:56:44.013439 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:56:44.013439 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:56:44.013439 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:56:44.013439 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:56:44.013439 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 could not be found. May 27 15:56:44.013439 n-d-843621-1 devstack@n-api.service[119248]: ERROR nova.api.openstack.wsgi May 27 15:56:44.013439 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-8a1d0e62-36fa-47a5-85fc-f0b6f4ee7ad5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Returning 404 to user: Instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 could not be found. {{(pid=119248) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:56:44.013439 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-8a1d0e62-36fa-47a5-85fc-f0b6f4ee7ad5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 404 len: 111 microversion: 2.1 time: 0.035325 May 27 15:56:44.013439 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3592/7203] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:43 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:56:44.024976 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-76b4db8c-2769-4ffb-8ac8-8c06ae838d9e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:44.026097 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-76b4db8c-2769-4ffb-8ac8-8c06ae838d9e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: c582392b-25e6-4da1-8f65-e62d7a8f9b05] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:44.034333 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76b4db8c-2769-4ffb-8ac8-8c06ae838d9e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:44.034788 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76b4db8c-2769-4ffb-8ac8-8c06ae838d9e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:44.035705 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76b4db8c-2769-4ffb-8ac8-8c06ae838d9e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:44.036202 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-76b4db8c-2769-4ffb-8ac8-8c06ae838d9e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:44.052559 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.wsgi [None req-76b4db8c-2769-4ffb-8ac8-8c06ae838d9e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] HTTP exception thrown: Instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 could not be found. May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-76b4db8c-2769-4ffb-8ac8-8c06ae838d9e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Request method failure captured: May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: request: GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 HTTP/1.1 May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: Accept: application/json May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: Accept-Encoding: identity May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: Connection: close May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: Content-Length: 0 May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: Content-Type: application/json May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: Host: 10.222.0.13 May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: Openstack-System-Scope: None May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: User-Agent: python-urllib3/1.26.9 May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: X-Auth-Token: gAAAAABikPSF4GQjGGnwmXL4GMMz4PWQVG3opgZEn7quhm4--XSazVfENRut-Tai2vcB7wKvq6yWFWXsM-uto-ETkjpUBP152nephqQDobgq1itVqu2YGKzZVJPm6Iqs1GNc4Kn5SxJuILLUh5oTTynjWAAT_4173YLALScKMLxTVM0AP7c3d28 May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Id: None May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: X-Domain-Name: None May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: X-Identity-Status: Confirmed May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: X-Is-Admin-Project: True May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Id: default May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Domain-Name: Default May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Id: 4bf1bc3819eb42918161ebc1e15905b5 May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: X-Project-Name: tempest-ServerActionsTestJSON-1264201106 May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: X-Role: reader,member May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: X-Roles: reader,member May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4bf1bc3819eb42918161ebc1e15905b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4bf1bc3819eb42918161ebc1e15905b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4bf1bc3819eb42918161ebc1e15905b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4bf1bc3819eb42918161ebc1e15905b5", "adminURL": "http://10.222.0.13:8080"}]}] May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant: tempest-ServerActionsTestJSON-1264201106 May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Id: 4bf1bc3819eb42918161ebc1e15905b5 May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: X-Tenant-Name: tempest-ServerActionsTestJSON-1264201106 May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: X-User: tempest-ServerActionsTestJSON-1264201106-project May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Id: default May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: X-User-Domain-Name: Default May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: X-User-Id: fdbc608df8f14e9bbec62e59d64b9709 May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: X-User-Name: tempest-ServerActionsTestJSON-1264201106-project May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: method: > May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: exception: Instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 could not be found. May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: action_args: {'id': 'c582392b-25e6-4da1-8f65-e62d7a8f9b05'} May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 could not be found. May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 could not be found. May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:56:44.054470 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:56:44.059975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:56:44.059975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:56:44.059975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:56:44.059975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:56:44.059975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:56:44.059975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 could not be found. May 27 15:56:44.059975 n-d-843621-1 devstack@n-api.service[119249]: ERROR nova.api.openstack.wsgi May 27 15:56:44.059975 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-76b4db8c-2769-4ffb-8ac8-8c06ae838d9e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Returning 404 to user: Instance c582392b-25e6-4da1-8f65-e62d7a8f9b05 could not be found. {{(pid=119249) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:56:44.059975 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-76b4db8c-2769-4ffb-8ac8-8c06ae838d9e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05" status: 404 len: 111 microversion: 2.1 time: 0.035905 May 27 15:56:44.059975 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3612/7204] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:44 2022] GET /compute/v2.1/servers/c582392b-25e6-4da1-8f65-e62d7a8f9b05 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:56:44.107912 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ba488813-6a1c-4c71-8a98-7915c3d9eaea tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-350203298", "imageRef": "346e776e-8931-417f-87da-575810efb12b", "flavorRef": "452", "networks": [{"uuid": "266be84d-1558-4fa8-8dad-35d983dd6eed"}], "security_groups": [{"name": "tempest-securitygroup--655085404"}], "key_name": "tempest-keypair-184006460", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:56:44.215516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.network.neutron [None req-ba488813-6a1c-4c71-8a98-7915c3d9eaea tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] validate_networks() for [('266be84d-1558-4fa8-8dad-35d983dd6eed', None, None, None, None, None)] {{(pid=119248) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:56:44.716293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ba488813-6a1c-4c71-8a98-7915c3d9eaea tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Flavor limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:56:44.716293 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ba488813-6a1c-4c71-8a98-7915c3d9eaea tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Image limits 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:56:44.716583 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ba488813-6a1c-4c71-8a98-7915c3d9eaea tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Flavor pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:56:44.717008 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ba488813-6a1c-4c71-8a98-7915c3d9eaea tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Image pref 0:0:0 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:56:44.717467 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.virt.hardware [None req-ba488813-6a1c-4c71-8a98-7915c3d9eaea tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119248) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:56:44.729663 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba488813-6a1c-4c71-8a98-7915c3d9eaea tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:44.730144 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba488813-6a1c-4c71-8a98-7915c3d9eaea tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:44.730982 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba488813-6a1c-4c71-8a98-7915c3d9eaea tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:44.731450 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ba488813-6a1c-4c71-8a98-7915c3d9eaea tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:44.751497 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-ba488813-6a1c-4c71-8a98-7915c3d9eaea tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Getting quotas for project 4bf1bc3819eb42918161ebc1e15905b5. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:56:44.757852 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.quota [None req-ba488813-6a1c-4c71-8a98-7915c3d9eaea tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Getting quotas for user fdbc608df8f14e9bbec62e59d64b9709 and project 4bf1bc3819eb42918161ebc1e15905b5. Resources: {'ram', 'instances', 'cores'} {{(pid=119248) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:56:44.771708 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ba488813-6a1c-4c71-8a98-7915c3d9eaea tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Going to run 1 instances... {{(pid=119248) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:56:44.774086 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ba488813-6a1c-4c71-8a98-7915c3d9eaea tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: 46f1520f-3c01-447d-84d5-185eced5dc34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='346e776e-8931-417f-87da-575810efb12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119248) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:56:44.820107 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ba488813-6a1c-4c71-8a98-7915c3d9eaea tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.716036 May 27 15:56:44.820796 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3593/7205] 10.222.0.13 () {60 vars in 1146 bytes} [Fri May 27 15:56:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:56:44.831982 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-0ed5a194-692d-4106-9ec8-df3e9cdcf6ad tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:44.832723 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-0ed5a194-692d-4106-9ec8-df3e9cdcf6ad tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: 46f1520f-3c01-447d-84d5-185eced5dc34] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:44.889782 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-0ed5a194-692d-4106-9ec8-df3e9cdcf6ad tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:44.899396 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-0ed5a194-692d-4106-9ec8-df3e9cdcf6ad tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34" status: 200 len: 1237 microversion: 2.1 time: 0.072363 May 27 15:56:44.899978 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3613/7206] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:44 2022] GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34 => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:45.920040 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-2348d863-f26a-44d2-aae1-3281ad91c5d7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:45.920927 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-2348d863-f26a-44d2-aae1-3281ad91c5d7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: 46f1520f-3c01-447d-84d5-185eced5dc34] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:45.927516 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2348d863-f26a-44d2-aae1-3281ad91c5d7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:45.928120 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2348d863-f26a-44d2-aae1-3281ad91c5d7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:45.928920 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2348d863-f26a-44d2-aae1-3281ad91c5d7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:45.929391 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-2348d863-f26a-44d2-aae1-3281ad91c5d7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:45.995863 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-2348d863-f26a-44d2-aae1-3281ad91c5d7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:46.004016 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-2348d863-f26a-44d2-aae1-3281ad91c5d7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34" status: 200 len: 1295 microversion: 2.1 time: 0.088994 May 27 15:56:46.004599 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3594/7207] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:45 2022] GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34 => generated 1295 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:47.022809 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-ec6d3a53-2ff7-4dfb-88d0-81625f5616f5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:47.023517 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-ec6d3a53-2ff7-4dfb-88d0-81625f5616f5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: 46f1520f-3c01-447d-84d5-185eced5dc34] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:47.031530 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ec6d3a53-2ff7-4dfb-88d0-81625f5616f5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:47.031983 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ec6d3a53-2ff7-4dfb-88d0-81625f5616f5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:47.032809 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ec6d3a53-2ff7-4dfb-88d0-81625f5616f5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:47.033738 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-ec6d3a53-2ff7-4dfb-88d0-81625f5616f5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:47.175411 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-ec6d3a53-2ff7-4dfb-88d0-81625f5616f5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:47.183242 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-ec6d3a53-2ff7-4dfb-88d0-81625f5616f5 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34" status: 200 len: 1362 microversion: 2.1 time: 0.165421 May 27 15:56:47.183822 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3614/7208] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:47 2022] GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:47.528034 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-0390ba7c-5e01-4c2c-bce8-1533c2946dff req-d4892773-20e6-4abd-95b0-249e374ada9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46f1520f-3c01-447d-84d5-185eced5dc34", "tag": "d47a5abf-04d7-42ec-bc72-69c1eac8f466"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:56:47.539869 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0390ba7c-5e01-4c2c-bce8-1533c2946dff req-d4892773-20e6-4abd-95b0-249e374ada9e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:47.540436 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-0390ba7c-5e01-4c2c-bce8-1533c2946dff req-d4892773-20e6-4abd-95b0-249e374ada9e service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:47.553332 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-0390ba7c-5e01-4c2c-bce8-1533c2946dff req-d4892773-20e6-4abd-95b0-249e374ada9e service nova] Creating event network-changed:d47a5abf-04d7-42ec-bc72-69c1eac8f466 for instance 46f1520f-3c01-447d-84d5-185eced5dc34 on n-h1-843621-1 May 27 15:56:47.558618 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-0390ba7c-5e01-4c2c-bce8-1533c2946dff req-d4892773-20e6-4abd-95b0-249e374ada9e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036588 May 27 15:56:47.559540 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3595/7209] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:56:48.200169 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-206a9702-ba51-4e08-b268-01beae59d43d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:48.200828 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-206a9702-ba51-4e08-b268-01beae59d43d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: 46f1520f-3c01-447d-84d5-185eced5dc34] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:48.208577 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-206a9702-ba51-4e08-b268-01beae59d43d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:48.209070 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-206a9702-ba51-4e08-b268-01beae59d43d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:48.209865 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-206a9702-ba51-4e08-b268-01beae59d43d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:48.210456 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-206a9702-ba51-4e08-b268-01beae59d43d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:48.345206 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-206a9702-ba51-4e08-b268-01beae59d43d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:48.353067 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-206a9702-ba51-4e08-b268-01beae59d43d tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34" status: 200 len: 1362 microversion: 2.1 time: 0.156734 May 27 15:56:48.353637 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3615/7210] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:48 2022] GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:49.372574 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-23927c19-6002-41a4-b4ce-4fa0699a35da tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:49.373323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-23927c19-6002-41a4-b4ce-4fa0699a35da tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: 46f1520f-3c01-447d-84d5-185eced5dc34] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:49.379780 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23927c19-6002-41a4-b4ce-4fa0699a35da tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:49.380255 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23927c19-6002-41a4-b4ce-4fa0699a35da tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:49.381064 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23927c19-6002-41a4-b4ce-4fa0699a35da tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:49.381519 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-23927c19-6002-41a4-b4ce-4fa0699a35da tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:49.513615 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-23927c19-6002-41a4-b4ce-4fa0699a35da tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:49.522069 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-23927c19-6002-41a4-b4ce-4fa0699a35da tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34" status: 200 len: 1362 microversion: 2.1 time: 0.155187 May 27 15:56:49.522654 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3596/7211] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:49 2022] GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:50.539440 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-6bb1f9c5-f9c4-4058-be56-84785948e250 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:50.540065 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-6bb1f9c5-f9c4-4058-be56-84785948e250 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: 46f1520f-3c01-447d-84d5-185eced5dc34] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:50.547136 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6bb1f9c5-f9c4-4058-be56-84785948e250 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:50.547595 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6bb1f9c5-f9c4-4058-be56-84785948e250 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:50.548904 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6bb1f9c5-f9c4-4058-be56-84785948e250 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:50.549343 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-6bb1f9c5-f9c4-4058-be56-84785948e250 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:50.683823 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-6bb1f9c5-f9c4-4058-be56-84785948e250 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:50.692290 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-6bb1f9c5-f9c4-4058-be56-84785948e250 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34" status: 200 len: 1362 microversion: 2.1 time: 0.156735 May 27 15:56:50.692885 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3616/7212] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:50 2022] GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:51.710343 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-054a75cb-d0bc-45d6-8805-c492d4ee9f6e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:51.711094 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-054a75cb-d0bc-45d6-8805-c492d4ee9f6e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: 46f1520f-3c01-447d-84d5-185eced5dc34] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:51.718117 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-054a75cb-d0bc-45d6-8805-c492d4ee9f6e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:51.718587 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-054a75cb-d0bc-45d6-8805-c492d4ee9f6e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:51.719386 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-054a75cb-d0bc-45d6-8805-c492d4ee9f6e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:51.719848 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-054a75cb-d0bc-45d6-8805-c492d4ee9f6e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:51.743555 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:56:51.868829 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-054a75cb-d0bc-45d6-8805-c492d4ee9f6e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:51.877465 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-054a75cb-d0bc-45d6-8805-c492d4ee9f6e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34" status: 200 len: 1362 microversion: 2.1 time: 0.170456 May 27 15:56:51.878051 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3597/7213] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:51 2022] GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:52.894838 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-aa09a359-fe0d-434f-96d0-ed91ba0de92e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:52.895792 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-aa09a359-fe0d-434f-96d0-ed91ba0de92e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: 46f1520f-3c01-447d-84d5-185eced5dc34] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:52.902954 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa09a359-fe0d-434f-96d0-ed91ba0de92e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:52.903413 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa09a359-fe0d-434f-96d0-ed91ba0de92e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:52.904187 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa09a359-fe0d-434f-96d0-ed91ba0de92e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:52.904628 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-aa09a359-fe0d-434f-96d0-ed91ba0de92e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:53.037804 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-aa09a359-fe0d-434f-96d0-ed91ba0de92e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:53.045335 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-aa09a359-fe0d-434f-96d0-ed91ba0de92e tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34" status: 200 len: 1362 microversion: 2.1 time: 0.154449 May 27 15:56:53.045916 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3617/7214] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:52 2022] GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:53.726291 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [req-31f177e4-b2cc-4ce0-ba48-e8e7bfa518ff req-38cd7ae2-3e1f-47cb-8928-3e90194555a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f1520f-3c01-447d-84d5-185eced5dc34", "name": "network-vif-plugged", "status": "completed", "tag": "d47a5abf-04d7-42ec-bc72-69c1eac8f466"}]} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:56:53.736899 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-31f177e4-b2cc-4ce0-ba48-e8e7bfa518ff req-38cd7ae2-3e1f-47cb-8928-3e90194555a9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:53.737390 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [req-31f177e4-b2cc-4ce0-ba48-e8e7bfa518ff req-38cd7ae2-3e1f-47cb-8928-3e90194555a9 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:53.748908 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.compute.server_external_events [req-31f177e4-b2cc-4ce0-ba48-e8e7bfa518ff req-38cd7ae2-3e1f-47cb-8928-3e90194555a9 service nova] Creating event network-vif-plugged:d47a5abf-04d7-42ec-bc72-69c1eac8f466 for instance 46f1520f-3c01-447d-84d5-185eced5dc34 on n-h1-843621-1 May 27 15:56:53.755093 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [req-31f177e4-b2cc-4ce0-ba48-e8e7bfa518ff req-38cd7ae2-3e1f-47cb-8928-3e90194555a9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032537 May 27 15:56:53.755771 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3598/7215] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:56:54.062735 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-8f403c5f-f35d-44e9-9365-66a2bff0d8b4 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:54.063361 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-8f403c5f-f35d-44e9-9365-66a2bff0d8b4 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: 46f1520f-3c01-447d-84d5-185eced5dc34] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:54.072023 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8f403c5f-f35d-44e9-9365-66a2bff0d8b4 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:54.072649 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8f403c5f-f35d-44e9-9365-66a2bff0d8b4 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:54.074088 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8f403c5f-f35d-44e9-9365-66a2bff0d8b4 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:54.074928 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-8f403c5f-f35d-44e9-9365-66a2bff0d8b4 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:54.079495 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:56:54.203970 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-8f403c5f-f35d-44e9-9365-66a2bff0d8b4 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:54.211755 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-8f403c5f-f35d-44e9-9365-66a2bff0d8b4 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34" status: 200 len: 1362 microversion: 2.1 time: 0.152915 May 27 15:56:54.212324 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3618/7216] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:54 2022] GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:55.227695 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=2 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:56:55.228526 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell0:SELECT=6 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:56:55.233006 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-078efaae-0d05-4d6e-99cc-d0cc255024ce tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:55.233823 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-078efaae-0d05-4d6e-99cc-d0cc255024ce tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: 46f1520f-3c01-447d-84d5-185eced5dc34] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:55.241643 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-078efaae-0d05-4d6e-99cc-d0cc255024ce tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:55.242099 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-078efaae-0d05-4d6e-99cc-d0cc255024ce tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:55.242888 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-078efaae-0d05-4d6e-99cc-d0cc255024ce tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:55.243348 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-078efaae-0d05-4d6e-99cc-d0cc255024ce tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:55.659435 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-078efaae-0d05-4d6e-99cc-d0cc255024ce tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:55.667730 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-078efaae-0d05-4d6e-99cc-d0cc255024ce tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34" status: 200 len: 1362 microversion: 2.1 time: 0.442063 May 27 15:56:55.668307 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3599/7217] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:55 2022] GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34 => generated 1362 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:56.684932 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-39754ea2-51fc-408e-8944-af7202fef8a1 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:56.685679 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-39754ea2-51fc-408e-8944-af7202fef8a1 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: 46f1520f-3c01-447d-84d5-185eced5dc34] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:56.687556 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell0:SELECT=2 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:56:56.694826 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-39754ea2-51fc-408e-8944-af7202fef8a1 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:56.695285 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-39754ea2-51fc-408e-8944-af7202fef8a1 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:56.696046 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-39754ea2-51fc-408e-8944-af7202fef8a1 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:56.696490 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-39754ea2-51fc-408e-8944-af7202fef8a1 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:56.823355 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-39754ea2-51fc-408e-8944-af7202fef8a1 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:56:56.830904 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-39754ea2-51fc-408e-8944-af7202fef8a1 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34" status: 200 len: 1549 microversion: 2.1 time: 0.149878 May 27 15:56:56.831586 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3619/7218] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:56:56 2022] GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:56:56.848520 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-ce7a36be-cba3-436a-9377-dc749fa1d993 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:56:56.849063 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-ce7a36be-cba3-436a-9377-dc749fa1d993 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: 46f1520f-3c01-447d-84d5-185eced5dc34] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:56:56.856157 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ce7a36be-cba3-436a-9377-dc749fa1d993 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:56.856660 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ce7a36be-cba3-436a-9377-dc749fa1d993 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:56.857468 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ce7a36be-cba3-436a-9377-dc749fa1d993 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:56.857926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-ce7a36be-cba3-436a-9377-dc749fa1d993 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:56.936907 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-ce7a36be-cba3-436a-9377-dc749fa1d993 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092283 May 27 15:56:56.937539 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3600/7219] 10.222.0.13 () {58 vars in 1274 bytes} [Fri May 27 15:56:56 2022] GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:56:57.853929 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [req-1dd63c4c-bc2e-4c42-9823-a1b761d3376a req-52c94fc3-dbcc-4a71-b91a-c02975dcbb09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46f1520f-3c01-447d-84d5-185eced5dc34", "tag": "d47a5abf-04d7-42ec-bc72-69c1eac8f466"}]} {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:56:57.863262 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-1dd63c4c-bc2e-4c42-9823-a1b761d3376a req-52c94fc3-dbcc-4a71-b91a-c02975dcbb09 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:56:57.863852 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [req-1dd63c4c-bc2e-4c42-9823-a1b761d3376a req-52c94fc3-dbcc-4a71-b91a-c02975dcbb09 service nova] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:56:57.875115 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.compute.server_external_events [req-1dd63c4c-bc2e-4c42-9823-a1b761d3376a req-52c94fc3-dbcc-4a71-b91a-c02975dcbb09 service nova] Creating event network-changed:d47a5abf-04d7-42ec-bc72-69c1eac8f466 for instance 46f1520f-3c01-447d-84d5-185eced5dc34 on n-h1-843621-1 May 27 15:56:57.880268 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [req-1dd63c4c-bc2e-4c42-9823-a1b761d3376a req-52c94fc3-dbcc-4a71-b91a-c02975dcbb09 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030073 May 27 15:56:57.881133 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3620/7220] 10.222.0.13 () {64 vars in 1317 bytes} [Fri May 27 15:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:57:19.225938 n-d-843621-1 devstack@n-api.service[119249]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:57:19.226635 n-d-843621-1 devstack@n-api.service[119249]: Fri May 27 15:57:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:58:02.546551 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:58:02.547323 n-d-843621-1 devstack@n-api.service[119248]: DEBUG dbcounter [-] [119248] Writing DB stats nova_cell1:SELECT=14 {{(pid=119248) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:58:02.552416 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-eaf91a88-0675-41c6-a14a-e02c252672c7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:58:02.561135 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eaf91a88-0675-41c6-a14a-e02c252672c7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:58:02.561602 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-eaf91a88-0675-41c6-a14a-e02c252672c7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:58:02.585085 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-eaf91a88-0675-41c6-a14a-e02c252672c7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: 46f1520f-3c01-447d-84d5-185eced5dc34] Going to try to stop instance {{(pid=119248) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 15:58:02.628802 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-eaf91a88-0675-41c6-a14a-e02c252672c7 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "POST /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34/action" status: 202 len: 0 microversion: 2.1 time: 0.084635 May 27 15:58:02.629395 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3601/7221] 10.222.0.13 () {60 vars in 1277 bytes} [Fri May 27 15:58:02 2022] POST /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:58:02.636810 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_api:SELECT=41 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:58:02.637910 n-d-843621-1 devstack@n-api.service[119249]: DEBUG dbcounter [-] [119249] Writing DB stats nova_cell1:SELECT=12 {{(pid=119249) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:58:02.643114 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.api.openstack.wsgi [None req-7fe3ef99-322a-494c-9605-026a72bc2a75 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119249) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:58:02.643830 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.compute.api [None req-7fe3ef99-322a-494c-9605-026a72bc2a75 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: 46f1520f-3c01-447d-84d5-185eced5dc34] Fetching instance by UUID {{(pid=119249) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:58:02.654404 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fe3ef99-322a-494c-9605-026a72bc2a75 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:58:02.654864 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fe3ef99-322a-494c-9605-026a72bc2a75 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:58:02.655655 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fe3ef99-322a-494c-9605-026a72bc2a75 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:58:02.656111 n-d-843621-1 devstack@n-api.service[119249]: DEBUG oslo_concurrency.lockutils [None req-7fe3ef99-322a-494c-9605-026a72bc2a75 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119249) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:58:02.801156 n-d-843621-1 devstack@n-api.service[119249]: DEBUG nova.policy [None req-7fe3ef99-322a-494c-9605-026a72bc2a75 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119249) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:58:02.808837 n-d-843621-1 devstack@n-api.service[119249]: INFO nova.api.openstack.requestlog [None req-7fe3ef99-322a-494c-9605-026a72bc2a75 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34" status: 200 len: 1676 microversion: 2.1 time: 0.174781 May 27 15:58:02.809407 n-d-843621-1 devstack@n-api.service[119249]: [pid: 119249|app: 0|req: 3621/7222] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:58:02 2022] GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:58:03.827926 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.api.openstack.wsgi [None req-bf626753-e7a6-436e-b99c-e55ed83918a0 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Calling method '>' {{(pid=119248) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:58:03.828601 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.compute.api [None req-bf626753-e7a6-436e-b99c-e55ed83918a0 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] [instance: 46f1520f-3c01-447d-84d5-185eced5dc34] Fetching instance by UUID {{(pid=119248) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:58:03.837865 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf626753-e7a6-436e-b99c-e55ed83918a0 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:58:03.838366 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf626753-e7a6-436e-b99c-e55ed83918a0 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:58:03.839150 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf626753-e7a6-436e-b99c-e55ed83918a0 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:58:03.839641 n-d-843621-1 devstack@n-api.service[119248]: DEBUG oslo_concurrency.lockutils [None req-bf626753-e7a6-436e-b99c-e55ed83918a0 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Lock "57e0886a-3e0a-4a65-b585-e8d63742d44b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119248) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:58:03.972038 n-d-843621-1 devstack@n-api.service[119248]: DEBUG nova.policy [None req-bf626753-e7a6-436e-b99c-e55ed83918a0 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdbc608df8f14e9bbec62e59d64b9709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf1bc3819eb42918161ebc1e15905b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119248) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:58:03.979877 n-d-843621-1 devstack@n-api.service[119248]: INFO nova.api.openstack.requestlog [None req-bf626753-e7a6-436e-b99c-e55ed83918a0 tempest-ServerActionsTestJSON-1264201106 tempest-ServerActionsTestJSON-1264201106-project] 10.222.0.13 "GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34" status: 200 len: 1676 microversion: 2.1 time: 0.157118 May 27 15:58:03.980449 n-d-843621-1 devstack@n-api.service[119248]: [pid: 119248|app: 0|req: 3602/7223] 10.222.0.13 () {58 vars in 1235 bytes} [Fri May 27 15:58:03 2022] GET /compute/v2.1/servers/46f1520f-3c01-447d-84d5-185eced5dc34 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:58:58.246261 n-d-843621-1 devstack@n-api.service[119248]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:58:58.246973 n-d-843621-1 devstack@n-api.service[119248]: Fri May 27 15:58:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:58:59.229345 n-d-843621-1 devstack@n-api.service[119249]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:58:59.229901 n-d-843621-1 devstack@n-api.service[119249]: Fri May 27 15:58:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:00:39.236939 n-d-843621-1 devstack@n-api.service[119249]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:00:39.237686 n-d-843621-1 devstack@n-api.service[119249]: Fri May 27 16:00:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:00:49.898425 n-d-843621-1 devstack@n-api.service[119248]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:00:49.899021 n-d-843621-1 devstack@n-api.service[119248]: Fri May 27 16:00:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:02:18.254238 n-d-843621-1 devstack@n-api.service[119248]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:02:18.254912 n-d-843621-1 devstack@n-api.service[119248]: Fri May 27 16:02:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:02:18.306466 n-d-843621-1 devstack@n-api.service[119248]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:02:18.306634 n-d-843621-1 devstack@n-api.service[119248]: Fri May 27 16:02:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:02:19.237810 n-d-843621-1 devstack@n-api.service[119249]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:02:19.238416 n-d-843621-1 devstack@n-api.service[119249]: Fri May 27 16:02:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:02:35.222514 n-d-843621-1 devstack@n-api.service[119249]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:02:35.223237 n-d-843621-1 devstack@n-api.service[119249]: Fri May 27 16:02:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:03:59.246382 n-d-843621-1 devstack@n-api.service[119249]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:03:59.247233 n-d-843621-1 devstack@n-api.service[119249]: Fri May 27 16:03:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:04:09.906301 n-d-843621-1 devstack@n-api.service[119248]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:04:09.906954 n-d-843621-1 devstack@n-api.service[119248]: Fri May 27 16:04:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:05:38.264287 n-d-843621-1 devstack@n-api.service[119248]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:05:38.265049 n-d-843621-1 devstack@n-api.service[119248]: Fri May 27 16:05:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:05:38.314321 n-d-843621-1 devstack@n-api.service[119248]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:05:38.314498 n-d-843621-1 devstack@n-api.service[119248]: Fri May 27 16:05:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:05:39.247268 n-d-843621-1 devstack@n-api.service[119249]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:05:39.247889 n-d-843621-1 devstack@n-api.service[119249]: Fri May 27 16:05:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 16:05:55.232103 n-d-843621-1 devstack@n-api.service[119249]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 16:05:55.232843 n-d-843621-1 devstack@n-api.service[119249]: Fri May 27 16:05:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!